-- Logs begin at Sat 2022-04-30 20:01:17 UTC, end at Sat 2022-04-30 22:41:43 UTC. -- Apr 30 20:47:01.279439 ncdv-master-1 systemd[1]: Starting Devstack devstack@keystone.service... Apr 30 20:47:01.289841 ncdv-master-1 devstack@keystone.service[91006]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Apr 30 20:47:01.294397 ncdv-master-1 devstack@keystone.service[91006]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Apr 30 20:47:01 2022] *** Apr 30 20:47:01.294397 ncdv-master-1 devstack@keystone.service[91006]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 30 20:47:01.294397 ncdv-master-1 devstack@keystone.service[91006]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 30 20:47:01.294397 ncdv-master-1 devstack@keystone.service[91006]: nodename: ncdv-master-1 Apr 30 20:47:01.294397 ncdv-master-1 devstack@keystone.service[91006]: machine: x86_64 Apr 30 20:47:01.294397 ncdv-master-1 devstack@keystone.service[91006]: clock source: unix Apr 30 20:47:01.294397 ncdv-master-1 devstack@keystone.service[91006]: pcre jit disabled Apr 30 20:47:01.294397 ncdv-master-1 devstack@keystone.service[91006]: detected number of CPU cores: 4 Apr 30 20:47:01.294397 ncdv-master-1 devstack@keystone.service[91006]: current working directory: / Apr 30 20:47:01.294397 ncdv-master-1 devstack@keystone.service[91006]: detected binary path: /usr/bin/uwsgi-core Apr 30 20:47:01.294397 ncdv-master-1 devstack@keystone.service[91006]: your processes number limit is 47680 Apr 30 20:47:01.294990 ncdv-master-1 devstack@keystone.service[91006]: your memory page size is 4096 bytes Apr 30 20:47:01.294990 ncdv-master-1 devstack@keystone.service[91006]: detected max file descriptor number: 2048 Apr 30 20:47:01.294990 ncdv-master-1 devstack@keystone.service[91006]: lock engine: pthread robust mutexes Apr 30 20:47:01.294990 ncdv-master-1 devstack@keystone.service[91006]: thunder lock: enabled Apr 30 20:47:01.294990 ncdv-master-1 devstack@keystone.service[91006]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Apr 30 20:47:01.294990 ncdv-master-1 devstack@keystone.service[91006]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 30 20:47:01.345245 ncdv-master-1 devstack@keystone.service[91006]: Python main interpreter initialized at 0x5581cacc59c0 Apr 30 20:47:01.345245 ncdv-master-1 devstack@keystone.service[91006]: python threads support enabled Apr 30 20:47:01.345245 ncdv-master-1 devstack@keystone.service[91006]: your server socket listen backlog is limited to 100 connections Apr 30 20:47:01.345245 ncdv-master-1 devstack@keystone.service[91006]: your mercy for graceful operations on workers is 90 seconds Apr 30 20:47:01.345560 ncdv-master-1 devstack@keystone.service[91006]: mapped 403077 bytes (393 KB) for 2 cores Apr 30 20:47:01.345659 ncdv-master-1 devstack@keystone.service[91006]: *** Operational MODE: preforking *** Apr 30 20:47:01.345942 ncdv-master-1 devstack@keystone.service[91006]: *** uWSGI is running in multiple interpreter mode *** Apr 30 20:47:01.345942 ncdv-master-1 devstack@keystone.service[91006]: spawned uWSGI master process (pid: 91006) Apr 30 20:47:01.346145 ncdv-master-1 systemd[1]: Started Devstack devstack@keystone.service. Apr 30 20:47:01.353780 ncdv-master-1 devstack@keystone.service[91006]: spawned uWSGI worker 1 (pid: 91017, cores: 1) Apr 30 20:47:01.353780 ncdv-master-1 devstack@keystone.service[91006]: spawned uWSGI worker 2 (pid: 91018, cores: 1) Apr 30 20:47:01.353780 ncdv-master-1 devstack@keystone.service[91006]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 30 20:47:07.202548 ncdv-master-1 devstack@keystone.service[91017]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 30 20:47:07.202548 ncdv-master-1 devstack@keystone.service[91017]: from cryptography.utils import int_from_bytes Apr 30 20:47:07.203349 ncdv-master-1 devstack@keystone.service[91017]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 30 20:47:07.203349 ncdv-master-1 devstack@keystone.service[91017]: from cryptography.utils import int_from_bytes Apr 30 20:47:07.209414 ncdv-master-1 devstack@keystone.service[91018]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 30 20:47:07.209414 ncdv-master-1 devstack@keystone.service[91018]: from cryptography.utils import int_from_bytes Apr 30 20:47:07.209980 ncdv-master-1 devstack@keystone.service[91018]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 30 20:47:07.209980 ncdv-master-1 devstack@keystone.service[91018]: from cryptography.utils import int_from_bytes Apr 30 20:47:07.252887 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 30 20:47:07.253077 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 30 20:47:07.253269 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] command line args: [] {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 30 20:47:07.253536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 30 20:47:07.253712 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ================================================================================ {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 30 20:47:07.253988 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] admin_token = **** {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.254229 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] config_dir = [] {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.254415 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.254597 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] config_source = [] {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.254776 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] debug = True {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.254973 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.256391 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.256391 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.256391 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.256391 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.256391 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] list_limit = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.256391 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] log_config_append = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.256826 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.256826 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] log_dir = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.256972 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] log_file = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.257048 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 30 20:47:07.257121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.257191 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 30 20:47:07.257309 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.257437 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] command line args: [] {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 30 20:47:07.257536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.257613 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 30 20:47:07.257779 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ================================================================================ {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 30 20:47:07.257873 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.257955 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.258088 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] admin_token = **** {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.258165 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.258290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] config_dir = [] {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.258371 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.258448 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.258572 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.258654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] config_source = [] {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.258766 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] debug = True {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.258850 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.258978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.259092 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.259212 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.259290 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.259407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.259489 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.259632 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.259765 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.259875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.259954 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.260100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] list_limit = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.260187 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.260266 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] log_config_append = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.260446 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.260621 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] log_dir = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.260703 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.260834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] log_file = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.260922 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] publish_errors = False {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.260999 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.261120 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.261237 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.261313 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.261436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.261523 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.261647 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.261726 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.261895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.262027 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.262109 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.262193 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] standard_threads = False {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.262306 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.262385 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.262546 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.262628 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.262733 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.262809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.262908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] use_journal = False {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.262991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.263084 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] use_json = False {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.263209 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.263296 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] use_stderr = False {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.263418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] use_syslog = False {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.263582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.263662 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.263739 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.263889 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.263972 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.264125 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.264209 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.264382 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.264618 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.264705 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.264778 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] publish_errors = False {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.264909 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.265004 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.265107 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.265224 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.265355 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.265435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.265616 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.265690 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.265947 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.266038 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.266109 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] standard_threads = False {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.266180 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.266337 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.266416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.266578 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.266657 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.266737 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.266837 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.266922 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] use_journal = False {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.267072 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.267160 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] use_json = False {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.267238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] use_stderr = False {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.267314 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.267464 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] use_syslog = False {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.267580 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.267776 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 20:47:07.267894 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.267998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.268099 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.268197 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.268292 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.268398 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.268502 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.268599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.268721 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.268845 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.268975 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.269093 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.269237 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.269341 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.269471 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.269576 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.269720 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.269872 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.269985 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.270086 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.270183 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.270290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.270393 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.270496 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.270627 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.270757 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.270879 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.271000 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.271115 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.271236 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.271351 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.271465 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.271579 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.271693 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.271814 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.271939 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.272054 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.272168 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.272282 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.272394 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.272513 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.272639 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.272755 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.272875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.273148 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.273269 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.273383 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.273515 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.273622 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.273718 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.273874 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.273985 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.274093 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.274093 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.274280 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.274378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.274480 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.274578 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.274685 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.274789 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.274886 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.274989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.275092 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.275191 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.275294 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.275398 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.275506 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.275610 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.275708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.275826 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.275947 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.276069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.276192 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.276314 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.276435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.276550 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.276664 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.276778 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.276902 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.277022 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.277137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.277258 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.277378 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.277499 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.277622 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.277743 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.277876 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.277992 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.278117 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.278241 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.278363 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.278485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.278607 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.278732 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.279385 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.279515 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.279632 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.279752 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.279876 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.279992 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.280108 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.280263 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.280339 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.280411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.280483 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.280560 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.280633 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.280711 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.280784 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.280856 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.280927 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.280998 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.281069 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.281148 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.281731 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.281899 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.281976 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.282096 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.282186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.282260 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.282337 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.282438 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.282552 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.282632 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.282791 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.283002 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.283093 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.283249 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.283360 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.283482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.283716 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.283793 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.283979 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.284122 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.284202 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.284362 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.284441 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.284604 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.284695 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.284843 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.284922 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.285117 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.285210 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.285348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.285436 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.285583 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.285662 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.285833 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.285927 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.286066 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.286158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.286296 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.286376 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.286530 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.286615 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.286758 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.286845 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.287001 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.287080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.287232 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.287315 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.287470 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.287560 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.287704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.287782 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.287936 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.288014 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.288171 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.288258 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.288404 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.288485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.288637 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.288716 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] auth.external = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.288868 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.288953 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.289123 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.289200 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.289363 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.289442 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.289596 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] auth.password = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.289681 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.289846 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] auth.token = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.289928 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.290082 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.290167 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.290314 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.290399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.290551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.290629 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.290777 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.290854 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.291011 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.291145 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.291231 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.291306 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.291460 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.291553 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.291689 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.291795 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] credential.caching = True {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.291927 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.292020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.292159 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.292239 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.292404 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.292486 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.292638 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.292727 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.292877 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.292956 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.293109 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.293188 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.293365 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.293522 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.293599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] auth.external = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.293672 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.293846 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.293932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.294320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.294435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.294435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.294579 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.294652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] auth.password = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.294725 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.294805 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] auth.token = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.294886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.295025 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.295112 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.295260 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.295340 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.295505 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.295586 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] federation.caching = True {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.295737 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.295818 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.295983 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.296069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.296230 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.296311 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.296458 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.296536 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.296690 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] credential.caching = True {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.296774 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.297512 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.297611 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.297780 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.297877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.298038 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.298130 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.298270 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.298352 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.298511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.298592 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.298745 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.298824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.298980 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] identity.caching = True {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.299064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.299228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.299310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.299466 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.299545 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.299704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.299798 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.299940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.300021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.300189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.300277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.300420 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.300509 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.300656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.300744 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.300905 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.300985 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.301157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.301246 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] federation.caching = True {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.301389 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.301478 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.301619 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.301708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.301874 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.301965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.302119 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.302208 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.302365 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.302453 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.302600 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.302690 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.302852 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.302940 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.303086 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.303167 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.303340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.303422 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.303578 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.303665 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.303811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.303900 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.304041 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.304130 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] identity.caching = True {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.304275 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.304364 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.304503 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.304601 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.304739 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.304874 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.304999 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.305118 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.305243 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.305379 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.305507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.305633 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.305964 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.306101 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.306101 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.306358 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.306490 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.306624 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.306754 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.306882 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.307012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.307154 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.307283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.307427 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.307554 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.307690 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.307821 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.307967 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.308101 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.308246 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.308377 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.308509 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.308641 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.308785 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.308915 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.309046 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.309181 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.309317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.309449 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.309593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.309724 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.309896 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.310043 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.310186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.310326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.310478 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.310608 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.310740 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.310873 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.311002 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.311136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.311288 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.311422 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.311557 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.311691 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.311825 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.311957 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.312104 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.312237 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.user = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.312375 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.312505 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.312642 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.312781 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.312927 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.313060 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.313192 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.313324 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.313456 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.313587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.313730 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.313887 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.314015 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.314147 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.314304 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.314390 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.314479 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.314556 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.314630 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.314717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.314846 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.314990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.315139 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.315255 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.315332 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.315405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.315478 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.315551 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.315633 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.315708 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.315781 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.315854 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.315926 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.315998 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.316079 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.316154 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.316154 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.316285 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.316357 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.316429 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.316509 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.316583 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.316655 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.316727 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.user = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.316799 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.316877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.317029 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.317106 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.317179 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.317251 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.317323 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.317403 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.317478 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.317550 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.317623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.317695 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.317785 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.317874 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.317951 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.318023 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.318096 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.318174 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.318249 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.318329 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.318403 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.318534 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.318649 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.318761 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.318881 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.319008 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.319116 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.319254 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.319342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] resource.caching = True {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.319499 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.319580 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.319756 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.319837 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.320000 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.320089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.320229 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.320316 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.320481 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.320563 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.320718 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.320799 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.320955 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.321053 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.321200 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.321278 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.321409 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.321489 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.321642 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] role.caching = True {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.321730 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.321915 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] role.driver = sql {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.322000 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.322151 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.322230 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.322408 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.322488 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.322640 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.322722 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.322885 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.322966 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.323119 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.323200 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.323355 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.323437 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.323590 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.323670 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.323837 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.323917 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.324079 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.324162 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.324309 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.324388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.324541 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.324620 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.324781 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] resource.caching = True {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.324863 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.325024 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.325104 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.325269 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.325348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.325502 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.325711 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.325811 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.325972 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.326052 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.326221 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.326317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.326471 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.326552 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.326703 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.326783 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.326940 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.327028 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.327173 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.327252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] role.caching = True {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.327415 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] role.driver = sql {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.327494 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.327644 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.327726 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.327887 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.327966 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.328141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.328221 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.328372 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.328454 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.328602 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.328683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.328851 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.328931 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.329093 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.329173 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.329340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.329421 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.329573 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.329651 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.329834 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.329920 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.330066 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.330146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.330301 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] token.caching = True {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.330382 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.330536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.330619 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.330782 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.330862 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.331018 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.331210 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.331300 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.331448 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.331529 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.331698 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.331779 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.331948 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.332037 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.332190 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.332269 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.332436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.332517 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.332667 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.332755 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.332900 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.332979 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.333134 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.333214 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.333378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.333466 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.333607 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.333686 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.333865 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.333945 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.334097 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.334191 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.334346 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.334427 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.334603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.334684 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] database.connection = **** {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.334851 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.334941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.335087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.335168 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.335322 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.335402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.335550 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.335631 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.335785 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] token.caching = True {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.335866 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.336020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.336099 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.336254 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.336335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.336487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.336567 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.336729 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.336808 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.336964 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.337044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.337189 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.337265 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.337426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.337507 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.337667 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.337748 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.337940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.338022 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.338177 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.338256 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.338404 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.338482 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.338634 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.338720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.338866 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.338945 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.339019 ncdv-master-1 devstack@keystone.service[91017]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 30 20:47:07.339114 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.339343 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.339584 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.339889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.340180 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] database.connection = **** {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.340448 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.340719 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.340975 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.341237 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.341491 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.341747 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.342022 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.342279 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.342541 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.342797 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.343059 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.343317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.343582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.344375 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.344636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.344886 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.345145 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.345403 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 20:47:07.345578 ncdv-master-1 devstack@keystone.service[91018]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 30 20:47:07.371538 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.371766 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.371993 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.372769 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.372985 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.373205 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.380594 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.381905 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.409395 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.409612 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.410353 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.410583 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.469042 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.469322 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.519364 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.519593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.519711 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.519945 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.602537 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.602767 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.602993 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.603080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.603216 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.603321 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.603435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.603520 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.603647 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.603732 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.603903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.604117 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.635371 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.635604 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.635691 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.635830 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.635915 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.636050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.636135 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.636267 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.636360 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.636482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.636570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.636699 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.636787 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.636932 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.647829 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.648215 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.660605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.660793 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.660880 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.661032 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.661118 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.661252 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.661335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.661468 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.661562 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.661682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.661796 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.661920 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.662006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.662133 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 30 20:47:07.679953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.680161 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 30 20:47:07.680342 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.680496 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.680581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 30 20:47:07.680695 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 30 20:47:07.680884 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.680969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.681087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 30 20:47:07.681203 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.681358 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.681449 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.681622 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.681704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.681905 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.682163 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.693164 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.693437 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.693674 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.693882 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.693968 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.694164 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.694405 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.694691 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.702292 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:47:07.702860 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:47:07.705586 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:47:07.705892 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.706173 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.706256 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:47:07.706450 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.706534 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.706729 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.706814 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.706988 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.707072 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.707254 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.707346 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.707521 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.707603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.707785 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.707868 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.708059 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.708148 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.708331 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.708413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.708609 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.708972 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.735565 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.736331 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.737129 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:47:07.737403 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.737985 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:47:07.738268 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.742819 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:47:07.743097 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.743371 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.743719 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:47:07.744002 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.744288 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.751195 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:47:07.751472 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.752243 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:47:07.752527 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.755942 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:47:07.756225 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.756503 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.756781 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.757035 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:47:07.757132 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.757311 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.757394 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.757595 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.757688 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.757904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.758001 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.758183 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.758459 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.758846 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.759127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.776573 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.776853 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.777885 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.778169 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.781556 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:47:07.782929 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:47:07.785254 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.785532 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.786775 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.787078 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.790689 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:47:07.792120 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:47:07.794314 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:47:07.795796 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:47:07.798502 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.798795 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.799082 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.799362 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.799634 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.800018 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.800117 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.800320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.800607 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.800894 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.801177 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.801590 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.819472 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:47:07.819749 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.820021 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.820285 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.821196 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:47:07.821484 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.821764 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.822053 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.828305 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.830055 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.830169 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.830327 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.831880 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.832159 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.833349 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:47:07.833623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.833932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.834228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.834518 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.835255 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:47:07.835536 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.835818 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.836100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.836386 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.848724 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:47:07.849002 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.849277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.849558 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.849860 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.850137 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.850405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.852166 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:47:07.852444 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.852731 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.853017 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.853302 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.853581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.853889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.869272 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:47:07.872966 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:47:07.873815 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:47:07.877272 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.877747 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:47:07.878924 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.880552 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:47:07.880842 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.881109 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.881238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.882758 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.884400 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:47:07.884681 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.884963 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.888417 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.890237 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:47:07.892417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.893482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.893791 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.894076 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.894349 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.894476 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:47:07.897727 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.898045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.898338 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.898649 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.903455 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:47:07.903740 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.904017 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.908390 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:47:07.908675 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.908958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.912634 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:47:07.912911 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.913186 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.913459 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.913728 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.914025 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.914300 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.914567 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.914828 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.915091 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.915364 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.915635 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.915909 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.916164 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.917059 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 30 20:47:07.917342 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.917625 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.917929 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.918214 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.918487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.918779 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.919050 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.919320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.919589 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.919868 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.920140 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.920417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.920692 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 30 20:47:07.954987 ncdv-master-1 devstack@keystone.service[91017]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5581cacc59c0 pid: 91017 (default app) Apr 30 20:47:07.958220 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43183601-b9eb-488c-8c96-58b4899c1236 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:07.958511 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43183601-b9eb-488c-8c96-58b4899c1236 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:07.958788 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43183601-b9eb-488c-8c96-58b4899c1236 None None] PATH_INFO: `/v3` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:07.959665 ncdv-master-1 devstack@keystone.service[91018]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5581cacc59c0 pid: 91018 (default app) Apr 30 20:47:07.963053 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 791 bytes} [Sat Apr 30 20:47:07 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:17.423434 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd06737-0851-4f9c-86dc-58740ee0627e None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:17.423949 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd06737-0851-4f9c-86dc-58740ee0627e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:17.424055 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd06737-0851-4f9c-86dc-58740ee0627e None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:17.428346 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:47:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:47:17.433507 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c978a-d4f8-4ea8-86cf-4a15a9100418 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:17.433950 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c978a-d4f8-4ea8-86cf-4a15a9100418 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:17.434098 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c978a-d4f8-4ea8-86cf-4a15a9100418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:17.464450 ncdv-master-1 devstack@keystone.service[91017]: DEBUG oslo_db.sqlalchemy.engines [None req-f61c978a-d4f8-4ea8-86cf-4a15a9100418 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91017) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 20:47:17.651901 ncdv-master-1 devstack@keystone.service[91017]: DEBUG passlib.handlers.bcrypt [None req-f61c978a-d4f8-4ea8-86cf-4a15a9100418 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=91017) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 30 20:47:17.652253 ncdv-master-1 devstack@keystone.service[91017]: DEBUG passlib.handlers.bcrypt [None req-f61c978a-d4f8-4ea8-86cf-4a15a9100418 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91017) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 30 20:47:17.707864 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-f61c978a-d4f8-4ea8-86cf-4a15a9100418 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:47:17.709472 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f61c978a-d4f8-4ea8-86cf-4a15a9100418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:47:17.846363 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2/3] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:47:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Apr 30 20:47:18.012872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd06737-0851-4f9c-86dc-58740ee0627e None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:18.046744 ncdv-master-1 devstack@keystone.service[91018]: DEBUG oslo_db.sqlalchemy.engines [None req-abd06737-0851-4f9c-86dc-58740ee0627e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91018) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 20:47:18.179347 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd06737-0851-4f9c-86dc-58740ee0627e None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:18.183608 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85433a1f-ba3b-41d8-ab58-dbf357f058fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:18.184262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85433a1f-ba3b-41d8-ab58-dbf357f058fd admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:18.184553 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85433a1f-ba3b-41d8-ab58-dbf357f058fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:18.184830 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85433a1f-ba3b-41d8-ab58-dbf357f058fd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:18.192885 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85433a1f-ba3b-41d8-ab58-dbf357f058fd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:18.245487 ncdv-master-1 devstack@keystone.service[91018]: WARNING keystone.common.rbac_enforcer.enforcer [None req-85433a1f-ba3b-41d8-ab58-dbf357f058fd admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 30 20:47:18.245853 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85433a1f-ba3b-41d8-ab58-dbf357f058fd admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:18.255223 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1324 bytes} [Sat Apr 30 20:47:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 20:47:18.261169 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c978a-d4f8-4ea8-86cf-4a15a9100418 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:18.276242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c978a-d4f8-4ea8-86cf-4a15a9100418 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:18.280843 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ab93a-eb81-42f5-a38d-9e71314922b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:18.284384 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ab93a-eb81-42f5-a38d-9e71314922b9 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:18.284384 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ab93a-eb81-42f5-a38d-9e71314922b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:18.284384 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ab93a-eb81-42f5-a38d-9e71314922b9 admin admin] PATH_INFO: `/v3/projects/137d4e571f624bfe845b398839c48b74` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:18.284676 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1ab93a-eb81-42f5-a38d-9e71314922b9 admin admin] RBAC: Authorizing `identity:get_project(project_id=137d4e571f624bfe845b398839c48b74)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:18.336944 ncdv-master-1 devstack@keystone.service[91017]: WARNING keystone.common.rbac_enforcer.enforcer [None req-aa1ab93a-eb81-42f5-a38d-9e71314922b9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 30 20:47:18.337284 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1ab93a-eb81-42f5-a38d-9e71314922b9 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:18.341887 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3/5] 10.222.0.23 () {56 vars in 1207 bytes} [Sat Apr 30 20:47:18 2022] GET /identity/v3/projects/137d4e571f624bfe845b398839c48b74 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:47:20.602132 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3dc422-6ba1-4c9b-b4b9-bb8b2e86a3ed None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:20.602622 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3dc422-6ba1-4c9b-b4b9-bb8b2e86a3ed None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:20.602622 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3dc422-6ba1-4c9b-b4b9-bb8b2e86a3ed None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:20.606695 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3/6] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:47:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:47:20.612071 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc280966-926f-4662-a81e-8ec7345f4f5f None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:20.612487 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc280966-926f-4662-a81e-8ec7345f4f5f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:20.612624 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc280966-926f-4662-a81e-8ec7345f4f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:20.631322 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-bc280966-926f-4662-a81e-8ec7345f4f5f None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:47:20.632826 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-bc280966-926f-4662-a81e-8ec7345f4f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:47:20.640483 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4/7] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:47:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Apr 30 20:47:20.663896 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3dc422-6ba1-4c9b-b4b9-bb8b2e86a3ed None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:20.675834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3dc422-6ba1-4c9b-b4b9-bb8b2e86a3ed None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:20.679978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05262cb2-8299-4d72-8502-02997878df46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:20.680594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05262cb2-8299-4d72-8502-02997878df46 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:20.680873 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05262cb2-8299-4d72-8502-02997878df46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:20.681145 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05262cb2-8299-4d72-8502-02997878df46 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:20.689220 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05262cb2-8299-4d72-8502-02997878df46 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:20.691003 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05262cb2-8299-4d72-8502-02997878df46 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:20.699549 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1324 bytes} [Sat Apr 30 20:47:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 20:47:20.705302 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc280966-926f-4662-a81e-8ec7345f4f5f None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:20.714111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc280966-926f-4662-a81e-8ec7345f4f5f None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:20.718373 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e92f7-9c2f-4de2-82da-d4fdbd5f65f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:20.719360 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e92f7-9c2f-4de2-82da-d4fdbd5f65f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:20.719643 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e92f7-9c2f-4de2-82da-d4fdbd5f65f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:20.719917 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e92f7-9c2f-4de2-82da-d4fdbd5f65f8 admin admin] PATH_INFO: `/v3/users/53a451439fd64d8ca37cd0e229eb98e1` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:20.721550 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17e92f7-9c2f-4de2-82da-d4fdbd5f65f8 admin admin] RBAC: Authorizing `identity:get_user(user_id=53a451439fd64d8ca37cd0e229eb98e1)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:20.723401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17e92f7-9c2f-4de2-82da-d4fdbd5f65f8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:20.724932 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 5/9] 10.222.0.23 () {56 vars in 1198 bytes} [Sat Apr 30 20:47:20 2022] GET /identity/v3/users/53a451439fd64d8ca37cd0e229eb98e1 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:23.087847 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a0c4c-eb44-44d0-b119-c9c514aeea0b None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:23.088366 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a0c4c-eb44-44d0-b119-c9c514aeea0b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:23.088366 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a0c4c-eb44-44d0-b119-c9c514aeea0b None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:23.089724 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:47:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:47:23.092067 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21544fc-cb3b-48d3-89e9-0a25993739c8 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:23.092461 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21544fc-cb3b-48d3-89e9-0a25993739c8 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:23.092629 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21544fc-cb3b-48d3-89e9-0a25993739c8 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:23.094774 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 6/11] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:47:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:47:23.095126 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcf59b-5efb-43f4-8846-86165b1cd9fb None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:23.095415 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcf59b-5efb-43f4-8846-86165b1cd9fb None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:23.095758 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcf59b-5efb-43f4-8846-86165b1cd9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:23.099911 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7d7c5-6058-44c3-80b7-b8679ebee87c None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:23.100200 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7d7c5-6058-44c3-80b7-b8679ebee87c None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:23.100479 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7d7c5-6058-44c3-80b7-b8679ebee87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:23.119887 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-99e7d7c5-6058-44c3-80b7-b8679ebee87c None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:47:23.121060 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-99e7d7c5-6058-44c3-80b7-b8679ebee87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:47:23.136019 ncdv-master-1 devstack@keystone.service[91018]: DEBUG passlib.handlers.bcrypt [None req-bbdcf59b-5efb-43f4-8846-86165b1cd9fb None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=91018) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 30 20:47:23.136438 ncdv-master-1 devstack@keystone.service[91018]: DEBUG passlib.handlers.bcrypt [None req-bbdcf59b-5efb-43f4-8846-86165b1cd9fb None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91018) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 30 20:47:23.183545 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-bbdcf59b-5efb-43f4-8846-86165b1cd9fb None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:47:23.185151 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-bbdcf59b-5efb-43f4-8846-86165b1cd9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:47:23.197129 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 7/12] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:47:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:47:23.221243 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7d7c5-6058-44c3-80b7-b8679ebee87c None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:23.283024 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 6/13] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:47:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:47:23.306375 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdcf59b-5efb-43f4-8846-86165b1cd9fb None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:23.320426 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7d7c5-6058-44c3-80b7-b8679ebee87c None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:23.353448 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b49bf0-d188-4537-afe6-551ad2127fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:23.354056 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b49bf0-d188-4537-afe6-551ad2127fbd None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:23.354338 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b49bf0-d188-4537-afe6-551ad2127fbd None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:23.354613 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b49bf0-d188-4537-afe6-551ad2127fbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:23.404281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdcf59b-5efb-43f4-8846-86165b1cd9fb None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:23.417678 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b49bf0-d188-4537-afe6-551ad2127fbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:23.419191 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b49bf0-d188-4537-afe6-551ad2127fbd None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:23.437058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54659bb7-7a88-467d-9b04-da9543a36589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:23.438135 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54659bb7-7a88-467d-9b04-da9543a36589 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:23.438426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54659bb7-7a88-467d-9b04-da9543a36589 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:23.438708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54659bb7-7a88-467d-9b04-da9543a36589 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:23.450297 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54659bb7-7a88-467d-9b04-da9543a36589 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:47:23.461954 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-54659bb7-7a88-467d-9b04-da9543a36589 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:47:23.461954 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:47:23.461954 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:47:23.461954 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:47:23.461954 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:47:23.461954 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:47:23.461954 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:47:23.461954 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:47:23.461954 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:47:23.461954 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:47:23.461954 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:47:23.461954 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:47:23.461954 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:47:23.461954 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:47:23.461954 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:47:23.461954 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:47:23.464132 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:47:23.464132 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:47:23.464132 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:47:23.464132 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:47:23.464132 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:47:23.464132 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:47:23.464132 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:47:23.464132 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:47:23.464132 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:47:23.464132 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:47:23.464132 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:47:23.464132 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:47:23.464132 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:47:23.464132 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:47:23.464132 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:47:23.464132 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:47:23.465049 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:47:23.465049 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:47:23.465049 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:47:23.465049 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:47:23.465049 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:47:23.465049 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:47:23.465049 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:47:23.465049 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:47:23.465049 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:47:23.465049 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:47:23.465049 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:47:23.465049 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:47:23.465049 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 7/14] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Apr 30 20:47:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:47:23.469809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54659bb7-7a88-467d-9b04-da9543a36589 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:23.516285 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 8/15] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:47:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 30 20:47:23.521997 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b49bf0-d188-4537-afe6-551ad2127fbd None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:23.568184 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54659bb7-7a88-467d-9b04-da9543a36589 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:23.603926 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48541ef4-973a-45d8-8687-0e621985fed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:23.604520 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48541ef4-973a-45d8-8687-0e621985fed1 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:23.604799 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48541ef4-973a-45d8-8687-0e621985fed1 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:23.605072 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48541ef4-973a-45d8-8687-0e621985fed1 None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:23.605871 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48541ef4-973a-45d8-8687-0e621985fed1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:47:23.606184 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48541ef4-973a-45d8-8687-0e621985fed1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:23.607707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48541ef4-973a-45d8-8687-0e621985fed1 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:23.620844 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 8/16] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:47:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:47:23.627225 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48541ef4-973a-45d8-8687-0e621985fed1 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:23.725352 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48541ef4-973a-45d8-8687-0e621985fed1 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:23.727487 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b49bf0-d188-4537-afe6-551ad2127fbd None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:23.757125 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395e1c3-96d8-4393-a8a8-8891590711df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:23.758024 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395e1c3-96d8-4393-a8a8-8891590711df None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:23.758307 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395e1c3-96d8-4393-a8a8-8891590711df None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:23.758580 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395e1c3-96d8-4393-a8a8-8891590711df None admin] PATH_INFO: `/v3/users/53a451439fd64d8ca37cd0e229eb98e1` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:23.759703 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9d3a7-fd72-4232-b5e4-0f3f8ec969b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:23.760111 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9395e1c3-96d8-4393-a8a8-8891590711df None admin] RBAC: Authorizing `identity:get_user(user_id=53a451439fd64d8ca37cd0e229eb98e1)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:23.760489 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9d3a7-fd72-4232-b5e4-0f3f8ec969b6 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:23.760775 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9d3a7-fd72-4232-b5e4-0f3f8ec969b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:23.761050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9d3a7-fd72-4232-b5e4-0f3f8ec969b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:23.761586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9395e1c3-96d8-4393-a8a8-8891590711df None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:23.763227 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 9/17] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:47:23 2022] GET /identity/v3/users/53a451439fd64d8ca37cd0e229eb98e1 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:47:23.769231 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395e1c3-96d8-4393-a8a8-8891590711df None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:23.772560 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f9d3a7-fd72-4232-b5e4-0f3f8ec969b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:23.774057 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f9d3a7-fd72-4232-b5e4-0f3f8ec969b6 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:23.794135 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-99f9d3a7-fd72-4232-b5e4-0f3f8ec969b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:47:23.794135 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:47:23.794135 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:47:23.794135 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:47:23.794135 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:47:23.794135 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:47:23.794135 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:47:23.794135 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:47:23.794135 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:47:23.794135 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:47:23.794135 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:47:23.794135 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:47:23.794135 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:47:23.794135 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:47:23.794135 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:47:23.795137 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:47:23.795137 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:47:23.795137 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:47:23.795137 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:47:23.795137 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:47:23.795137 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:47:23.795137 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:47:23.795137 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:47:23.795137 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:47:23.795137 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:47:23.795137 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:47:23.795137 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:47:23.795137 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:47:23.795137 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:47:23.795137 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:47:23.795137 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:47:23.795137 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:47:23.796163 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:47:23.796163 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:47:23.796163 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:47:23.796163 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:47:23.796163 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 9/18] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:47:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:47:23.800940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9d3a7-fd72-4232-b5e4-0f3f8ec969b6 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:23.864136 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395e1c3-96d8-4393-a8a8-8891590711df None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:23.895503 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9d3a7-fd72-4232-b5e4-0f3f8ec969b6 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:23.895841 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad8eae2-1240-424d-beee-551a809c30f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:23.896617 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8eae2-1240-424d-beee-551a809c30f7 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:23.896898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8eae2-1240-424d-beee-551a809c30f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:23.897170 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8eae2-1240-424d-beee-551a809c30f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:23.898372 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad8eae2-1240-424d-beee-551a809c30f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:23.899813 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad8eae2-1240-424d-beee-551a809c30f7 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:23.901396 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 10/19] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:47:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:47:23.907117 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad8eae2-1240-424d-beee-551a809c30f7 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:23.927959 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7873d-7518-4d58-a625-e8603b36faff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:23.928678 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7873d-7518-4d58-a625-e8603b36faff None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:23.928960 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7873d-7518-4d58-a625-e8603b36faff None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:23.929263 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7873d-7518-4d58-a625-e8603b36faff None admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:23.930014 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7873d-7518-4d58-a625-e8603b36faff None admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:47:23.930322 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7873d-7518-4d58-a625-e8603b36faff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:23.931714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7873d-7518-4d58-a625-e8603b36faff None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:23.948965 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 10/20] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:47:24.004211 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad8eae2-1240-424d-beee-551a809c30f7 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:24.038031 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77c0d6-470c-42a6-84e7-247bd6c41721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:24.038703 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77c0d6-470c-42a6-84e7-247bd6c41721 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:24.038983 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77c0d6-470c-42a6-84e7-247bd6c41721 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:24.039257 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77c0d6-470c-42a6-84e7-247bd6c41721 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:24.040086 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a77c0d6-470c-42a6-84e7-247bd6c41721 None admin] RBAC: Adding query filter params (role.id=30112eb1f3e047398c3c82fb40b72e62, scope.domain.id=default, user.id=53a451439fd64d8ca37cd0e229eb98e1) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:47:24.040393 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a77c0d6-470c-42a6-84e7-247bd6c41721 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:24.041904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a77c0d6-470c-42a6-84e7-247bd6c41721 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:24.051755 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 11/21] 10.222.0.23 () {56 vars in 1322 bytes} [Sat Apr 30 20:47:23 2022] GET /identity/v3/role_assignments?user.id=53a451439fd64d8ca37cd0e229eb98e1&scope.domain.id=default&role.id=30112eb1f3e047398c3c82fb40b72e62 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:47:26.910068 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83609fb9-dbe2-4c3c-9e0b-82ab8abc03d0 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:26.911102 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83609fb9-dbe2-4c3c-9e0b-82ab8abc03d0 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:26.911592 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83609fb9-dbe2-4c3c-9e0b-82ab8abc03d0 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:26.913428 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 11/22] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:47:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:47:26.918602 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63da8d1-44d2-4e27-9cf7-bee3cf2a23e8 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:26.919449 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63da8d1-44d2-4e27-9cf7-bee3cf2a23e8 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:26.919925 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63da8d1-44d2-4e27-9cf7-bee3cf2a23e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:26.946746 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-c63da8d1-44d2-4e27-9cf7-bee3cf2a23e8 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:47:26.948286 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c63da8d1-44d2-4e27-9cf7-bee3cf2a23e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:47:26.957386 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4c3a4-1c11-4bfb-b706-93214e887c84 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:26.958004 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4c3a4-1c11-4bfb-b706-93214e887c84 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:26.958483 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4c3a4-1c11-4bfb-b706-93214e887c84 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:26.960034 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 12/23] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:47:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:47:26.965161 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10547a6f-a099-42b1-9655-42606282a4e2 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:26.965679 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10547a6f-a099-42b1-9655-42606282a4e2 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:26.966201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10547a6f-a099-42b1-9655-42606282a4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:26.999000 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-10547a6f-a099-42b1-9655-42606282a4e2 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:47:27.000902 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-10547a6f-a099-42b1-9655-42606282a4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:47:27.050544 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 12/24] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:47:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:47:27.052348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ecce3-a3ee-417f-8b81-77e89702aa02 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:27.052799 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ecce3-a3ee-417f-8b81-77e89702aa02 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:27.053212 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ecce3-a3ee-417f-8b81-77e89702aa02 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:27.054964 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 13/25] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:47:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:47:27.060590 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372e5f8-edea-490f-82e1-3be19bb66617 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:27.061042 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372e5f8-edea-490f-82e1-3be19bb66617 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:27.062094 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372e5f8-edea-490f-82e1-3be19bb66617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:27.092875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-4372e5f8-edea-490f-82e1-3be19bb66617 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:47:27.094671 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4372e5f8-edea-490f-82e1-3be19bb66617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:47:27.164602 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 13/26] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:47:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:47:27.165604 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10547a6f-a099-42b1-9655-42606282a4e2 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:27.320464 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 14/27] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:47:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:47:27.321625 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372e5f8-edea-490f-82e1-3be19bb66617 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:27.441207 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372e5f8-edea-490f-82e1-3be19bb66617 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:27.472156 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10547a6f-a099-42b1-9655-42606282a4e2 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:27.479671 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fcc956-3e81-4096-b19f-cda35d339155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:27.480647 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcc956-3e81-4096-b19f-cda35d339155 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:27.481081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcc956-3e81-4096-b19f-cda35d339155 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:27.481502 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcc956-3e81-4096-b19f-cda35d339155 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:27.501906 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fcc956-3e81-4096-b19f-cda35d339155 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:47:27.509906 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-11fcc956-3e81-4096-b19f-cda35d339155 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:47:27.509906 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:47:27.509906 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:47:27.509906 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:47:27.509906 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:47:27.509906 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:47:27.509906 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:47:27.509906 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:47:27.509906 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:47:27.509906 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:47:27.509906 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:47:27.509906 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:47:27.509906 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:47:27.509906 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:47:27.509906 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:47:27.509906 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:47:27.510945 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:47:27.510945 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:47:27.510945 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:47:27.510945 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:47:27.510945 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:47:27.510945 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:47:27.510945 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:47:27.510945 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:47:27.510945 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:47:27.510945 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:47:27.510945 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:47:27.510945 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:47:27.510945 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:47:27.510945 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:47:27.510945 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:47:27.510945 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:47:27.511788 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:47:27.511788 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:47:27.511788 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:47:27.511788 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:47:27.511788 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:47:27.511788 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:47:27.511788 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:47:27.511788 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:47:27.511788 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:47:27.511788 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:47:27.511788 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:47:27.511788 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:47:27.512853 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022503e0-34f1-4ce1-9bc5-bf34bf3303ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:27.513852 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022503e0-34f1-4ce1-9bc5-bf34bf3303ca None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:27.514283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022503e0-34f1-4ce1-9bc5-bf34bf3303ca None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:27.514691 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022503e0-34f1-4ce1-9bc5-bf34bf3303ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:27.521119 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 15/28] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Apr 30 20:47:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:47:27.522043 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fcc956-3e81-4096-b19f-cda35d339155 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:27.526219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022503e0-34f1-4ce1-9bc5-bf34bf3303ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:27.527924 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022503e0-34f1-4ce1-9bc5-bf34bf3303ca None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:27.548251 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-022503e0-34f1-4ce1-9bc5-bf34bf3303ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:47:27.548251 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:47:27.548251 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:47:27.548251 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:47:27.548251 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:47:27.548251 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:47:27.548251 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:47:27.548251 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:47:27.548251 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:47:27.548251 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:47:27.548251 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:47:27.548251 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:47:27.548251 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:47:27.548251 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:47:27.548251 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:47:27.549105 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:47:27.549105 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:47:27.549105 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:47:27.549105 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:47:27.549105 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:47:27.549105 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:47:27.549105 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:47:27.549105 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:47:27.549105 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:47:27.549105 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:47:27.549105 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:47:27.549105 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:47:27.549105 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:47:27.549105 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:47:27.549105 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:47:27.549105 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:47:27.549105 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:47:27.549930 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:47:27.549930 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:47:27.549930 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:47:27.549930 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:47:27.556789 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 14/29] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:47:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:47:27.558161 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022503e0-34f1-4ce1-9bc5-bf34bf3303ca None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:27.636488 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fcc956-3e81-4096-b19f-cda35d339155 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:27.663268 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022503e0-34f1-4ce1-9bc5-bf34bf3303ca None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:27.671036 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571a695-0d0b-44bf-9a44-8bef1a5c91c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:27.672578 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571a695-0d0b-44bf-9a44-8bef1a5c91c8 None admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:27.673008 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571a695-0d0b-44bf-9a44-8bef1a5c91c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:27.673426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571a695-0d0b-44bf-9a44-8bef1a5c91c8 None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:27.674351 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2571a695-0d0b-44bf-9a44-8bef1a5c91c8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:27.675911 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2571a695-0d0b-44bf-9a44-8bef1a5c91c8 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:27.705931 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed848640-fd72-40fa-933c-27bb15574b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:27.706914 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed848640-fd72-40fa-933c-27bb15574b1c None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:27.707434 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed848640-fd72-40fa-933c-27bb15574b1c None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:27.707944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed848640-fd72-40fa-933c-27bb15574b1c None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:27.708908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed848640-fd72-40fa-933c-27bb15574b1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:47:27.709375 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed848640-fd72-40fa-933c-27bb15574b1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:27.711292 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed848640-fd72-40fa-933c-27bb15574b1c None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:27.725600 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 15/30] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:47:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:27.730745 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed848640-fd72-40fa-933c-27bb15574b1c None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:27.835347 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed848640-fd72-40fa-933c-27bb15574b1c None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:27.873807 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0f253-87ac-4e5a-9512-2555e9d8dc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:27.874816 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0f253-87ac-4e5a-9512-2555e9d8dc0a None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:27.875251 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0f253-87ac-4e5a-9512-2555e9d8dc0a None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:27.875680 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0f253-87ac-4e5a-9512-2555e9d8dc0a None admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:27.876575 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc0f253-87ac-4e5a-9512-2555e9d8dc0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:47:27.877051 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc0f253-87ac-4e5a-9512-2555e9d8dc0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:27.878677 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc0f253-87ac-4e5a-9512-2555e9d8dc0a None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:27.892119 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 16/31] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:27.893192 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0f253-87ac-4e5a-9512-2555e9d8dc0a None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:27.980731 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 16/32] 10.222.0.23 () {60 vars in 1131 bytes} [Sat Apr 30 20:47:27 2022] POST /identity/v3/roles => generated 219 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:47:27.982795 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b79cc-8636-48df-ac76-b91556eb2288 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:27.983196 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b79cc-8636-48df-ac76-b91556eb2288 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:27.983581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b79cc-8636-48df-ac76-b91556eb2288 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:27.985703 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 17/33] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:47:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:47:27.986550 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b79cc-8636-48df-ac76-b91556eb2288 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:27.998174 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0f253-87ac-4e5a-9512-2555e9d8dc0a None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:28.053585 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a408dc-2655-4dfc-919e-0ef8ec06c9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:28.054778 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a408dc-2655-4dfc-919e-0ef8ec06c9d8 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:28.055721 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a408dc-2655-4dfc-919e-0ef8ec06c9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:28.055991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a408dc-2655-4dfc-919e-0ef8ec06c9d8 None admin] PATH_INFO: `/v3/users/53a451439fd64d8ca37cd0e229eb98e1` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:28.057456 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a408dc-2655-4dfc-919e-0ef8ec06c9d8 None admin] RBAC: Authorizing `identity:get_user(user_id=53a451439fd64d8ca37cd0e229eb98e1)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:28.058983 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a408dc-2655-4dfc-919e-0ef8ec06c9d8 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:28.065746 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 17/34] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:47:27 2022] GET /identity/v3/users/53a451439fd64d8ca37cd0e229eb98e1 => generated 247 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:28.065746 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a1b03-ee5c-44d6-af11-80c92421bc50 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:28.065746 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a1b03-ee5c-44d6-af11-80c92421bc50 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:28.065746 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a1b03-ee5c-44d6-af11-80c92421bc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:28.090474 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-a13a1b03-ee5c-44d6-af11-80c92421bc50 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:47:28.092729 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a13a1b03-ee5c-44d6-af11-80c92421bc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:47:28.144316 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b79cc-8636-48df-ac76-b91556eb2288 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:28.168718 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 18/35] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:47:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:47:28.170453 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a6e52-c09a-4ff0-b719-2c08e72f41cd None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:28.170950 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a6e52-c09a-4ff0-b719-2c08e72f41cd None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:28.171407 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a6e52-c09a-4ff0-b719-2c08e72f41cd None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:28.172932 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 19/36] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:47:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:47:28.173856 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a6e52-c09a-4ff0-b719-2c08e72f41cd None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:28.185905 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1777545-5446-4c4f-9f84-cb7fceb3f027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:28.186249 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1777545-5446-4c4f-9f84-cb7fceb3f027 None admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:28.186641 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1777545-5446-4c4f-9f84-cb7fceb3f027 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:28.186925 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1777545-5446-4c4f-9f84-cb7fceb3f027 None admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:28.188233 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1777545-5446-4c4f-9f84-cb7fceb3f027 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:28.190023 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1777545-5446-4c4f-9f84-cb7fceb3f027 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:28.285089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a6e52-c09a-4ff0-b719-2c08e72f41cd None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:28.317540 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec14528-6ff7-4157-ba3c-f38647a249bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:28.318407 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec14528-6ff7-4157-ba3c-f38647a249bb None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:28.318685 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec14528-6ff7-4157-ba3c-f38647a249bb None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:28.319045 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec14528-6ff7-4157-ba3c-f38647a249bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:28.320238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec14528-6ff7-4157-ba3c-f38647a249bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:28.321732 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec14528-6ff7-4157-ba3c-f38647a249bb None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:28.323384 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 20/37] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:47:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:28.324533 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71692585-e64f-4bae-a539-d9332f34a044 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:28.324818 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71692585-e64f-4bae-a539-d9332f34a044 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:28.325093 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71692585-e64f-4bae-a539-d9332f34a044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:28.341880 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-71692585-e64f-4bae-a539-d9332f34a044 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:47:28.343063 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-71692585-e64f-4bae-a539-d9332f34a044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:47:28.409016 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 21/38] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:47:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:47:28.409645 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71692585-e64f-4bae-a539-d9332f34a044 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:28.411067 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 18/39] 10.222.0.23 () {60 vars in 1141 bytes} [Sat Apr 30 20:47:27 2022] POST /identity/v3/projects => generated 301 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:47:28.412292 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7cfe0-e44e-4449-ba00-4349ee3f770c None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:28.412595 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7cfe0-e44e-4449-ba00-4349ee3f770c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:28.412867 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7cfe0-e44e-4449-ba00-4349ee3f770c None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:28.417937 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 19/40] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:47:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:47:28.419401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7cfe0-e44e-4449-ba00-4349ee3f770c None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:28.532723 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7cfe0-e44e-4449-ba00-4349ee3f770c None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:28.535640 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71692585-e64f-4bae-a539-d9332f34a044 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:28.568653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5ee8b-2a56-42cb-917b-3d3400319857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:28.569555 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5ee8b-2a56-42cb-917b-3d3400319857 None admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:28.569852 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5ee8b-2a56-42cb-917b-3d3400319857 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:28.570135 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5ee8b-2a56-42cb-917b-3d3400319857 None admin] PATH_INFO: `/v3/domains/default/users/53a451439fd64d8ca37cd0e229eb98e1/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:28.572203 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c5ee8b-2a56-42cb-917b-3d3400319857 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=53a451439fd64d8ca37cd0e229eb98e1, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:28.573689 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c5ee8b-2a56-42cb-917b-3d3400319857 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:28.574298 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3cf826-fc94-46b7-bef2-82e5e1ea84a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:28.575245 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cf826-fc94-46b7-bef2-82e5e1ea84a0 None admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:28.575670 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cf826-fc94-46b7-bef2-82e5e1ea84a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:28.576085 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cf826-fc94-46b7-bef2-82e5e1ea84a0 None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:28.577047 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3cf826-fc94-46b7-bef2-82e5e1ea84a0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:28.578844 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3cf826-fc94-46b7-bef2-82e5e1ea84a0 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:28.683896 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 20/41] 10.222.0.23 () {58 vars in 1361 bytes} [Sat Apr 30 20:47:28 2022] PUT /identity/v3/domains/default/users/53a451439fd64d8ca37cd0e229eb98e1/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:47:28.685339 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69bda4a-8ed6-4dfc-bf3b-d3e6e1f4ac4f None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:28.685639 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69bda4a-8ed6-4dfc-bf3b-d3e6e1f4ac4f None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:28.685962 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69bda4a-8ed6-4dfc-bf3b-d3e6e1f4ac4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:28.705003 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-f69bda4a-8ed6-4dfc-bf3b-d3e6e1f4ac4f None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:47:28.706818 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f69bda4a-8ed6-4dfc-bf3b-d3e6e1f4ac4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:47:28.777990 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 21/42] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:47:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:47:28.778957 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69bda4a-8ed6-4dfc-bf3b-d3e6e1f4ac4f None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:28.839846 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 22/43] 10.222.0.23 () {60 vars in 1131 bytes} [Sat Apr 30 20:47:28 2022] POST /identity/v3/roles => generated 225 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:47:28.841189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3cf826-fc94-46b7-bef2-82e5e1ea84a0 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:28.888892 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69bda4a-8ed6-4dfc-bf3b-d3e6e1f4ac4f None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:28.938151 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a79a3-d2d1-4a05-bbf2-a482f35c6770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:28.939339 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a79a3-d2d1-4a05-bbf2-a482f35c6770 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:28.939829 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a79a3-d2d1-4a05-bbf2-a482f35c6770 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:28.940333 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a79a3-d2d1-4a05-bbf2-a482f35c6770 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:28.941931 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6a79a3-d2d1-4a05-bbf2-a482f35c6770 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:28.943680 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6a79a3-d2d1-4a05-bbf2-a482f35c6770 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:28.945670 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 22/44] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:47:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:28.955301 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a79a3-d2d1-4a05-bbf2-a482f35c6770 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:28.968299 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3cf826-fc94-46b7-bef2-82e5e1ea84a0 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:29.007963 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b66e14c-bf3f-4951-986e-416fd028847e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:29.008723 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66e14c-bf3f-4951-986e-416fd028847e None admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:29.008958 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66e14c-bf3f-4951-986e-416fd028847e None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:29.009242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66e14c-bf3f-4951-986e-416fd028847e None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:29.010340 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b66e14c-bf3f-4951-986e-416fd028847e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:29.012545 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b66e14c-bf3f-4951-986e-416fd028847e None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:29.064924 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a79a3-d2d1-4a05-bbf2-a482f35c6770 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:29.085486 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 23/45] 10.222.0.23 () {60 vars in 1131 bytes} [Sat Apr 30 20:47:28 2022] POST /identity/v3/roles => generated 223 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:47:29.114586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0cae7-fb67-43e8-b648-80482946e420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:29.114586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0cae7-fb67-43e8-b648-80482946e420 None admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:29.114586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0cae7-fb67-43e8-b648-80482946e420 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:29.114586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0cae7-fb67-43e8-b648-80482946e420 None admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:29.114970 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0cae7-fb67-43e8-b648-80482946e420 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:29.114970 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0cae7-fb67-43e8-b648-80482946e420 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:29.206084 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 23/46] 10.222.0.23 () {60 vars in 1141 bytes} [Sat Apr 30 20:47:28 2022] POST /identity/v3/projects => generated 312 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 20:47:31.040618 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5abb1-e573-42d3-b343-9288b95f3123 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:31.041131 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5abb1-e573-42d3-b343-9288b95f3123 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:31.041239 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5abb1-e573-42d3-b343-9288b95f3123 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:31.042565 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 24/47] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:47:31.047804 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5b7cf-f157-4d04-8b2e-3c639a5576d1 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:31.048223 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5b7cf-f157-4d04-8b2e-3c639a5576d1 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:31.048379 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5b7cf-f157-4d04-8b2e-3c639a5576d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:31.065165 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-80e5b7cf-f157-4d04-8b2e-3c639a5576d1 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:47:31.066394 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-80e5b7cf-f157-4d04-8b2e-3c639a5576d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:47:31.130051 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 24/48] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:47:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:47:31.154114 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5abb1-e573-42d3-b343-9288b95f3123 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:31.252299 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5abb1-e573-42d3-b343-9288b95f3123 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:31.287838 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ee4aa-f0e0-4216-b186-5df8c87f71f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:31.288639 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ee4aa-f0e0-4216-b186-5df8c87f71f8 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:31.288925 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ee4aa-f0e0-4216-b186-5df8c87f71f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:31.289203 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ee4aa-f0e0-4216-b186-5df8c87f71f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:31.300666 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ee4aa-f0e0-4216-b186-5df8c87f71f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:47:31.309461 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-fd5ee4aa-f0e0-4216-b186-5df8c87f71f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:47:31.309461 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:47:31.309461 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:47:31.309461 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:47:31.309461 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:47:31.309461 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:47:31.309461 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:47:31.309461 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:47:31.309461 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:47:31.309461 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:47:31.309461 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:47:31.309461 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:47:31.309461 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:47:31.309461 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:47:31.309461 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:47:31.309461 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:47:31.310316 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:47:31.310316 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:47:31.310316 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:47:31.310316 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:47:31.310316 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:47:31.310316 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:47:31.310316 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:47:31.310316 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:47:31.310316 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:47:31.310316 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:47:31.310316 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:47:31.310316 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:47:31.310316 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:47:31.310316 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:47:31.310316 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:47:31.310316 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:47:31.311330 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:47:31.311330 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:47:31.311330 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:47:31.311330 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:47:31.311330 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:47:31.311330 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:47:31.311330 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:47:31.311330 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:47:31.311330 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:47:31.311330 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:47:31.311330 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:47:31.311330 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:47:31.311330 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 25/49] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Apr 30 20:47:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:47:31.317040 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5b7cf-f157-4d04-8b2e-3c639a5576d1 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:31.417635 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5b7cf-f157-4d04-8b2e-3c639a5576d1 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:31.452671 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5eb200-3dc1-47a2-9b7f-598eb92799c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:31.453336 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5eb200-3dc1-47a2-9b7f-598eb92799c8 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:31.453618 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5eb200-3dc1-47a2-9b7f-598eb92799c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:31.453924 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5eb200-3dc1-47a2-9b7f-598eb92799c8 None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:31.454667 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5eb200-3dc1-47a2-9b7f-598eb92799c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:47:31.454979 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5eb200-3dc1-47a2-9b7f-598eb92799c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:31.456353 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5eb200-3dc1-47a2-9b7f-598eb92799c8 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:31.464178 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 25/50] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:47:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:31.469675 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ee4aa-f0e0-4216-b186-5df8c87f71f8 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:31.517911 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ff82d-54b4-441f-adc9-04031a7235ee None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:31.518204 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ff82d-54b4-441f-adc9-04031a7235ee None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:31.518482 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ff82d-54b4-441f-adc9-04031a7235ee None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:31.519842 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 26/51] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:47:31.524544 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ec0f4-e113-4e7a-a544-4f5744a90696 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:31.524830 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ec0f4-e113-4e7a-a544-4f5744a90696 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:31.525107 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ec0f4-e113-4e7a-a544-4f5744a90696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:31.541126 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-1e5ec0f4-e113-4e7a-a544-4f5744a90696 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:47:31.542324 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1e5ec0f4-e113-4e7a-a544-4f5744a90696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:47:31.565711 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ee4aa-f0e0-4216-b186-5df8c87f71f8 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:31.597113 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e51ed5-129e-4b94-8c3e-ee461475e49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:31.598013 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e51ed5-129e-4b94-8c3e-ee461475e49e None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:31.598301 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e51ed5-129e-4b94-8c3e-ee461475e49e None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:31.598577 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e51ed5-129e-4b94-8c3e-ee461475e49e None admin] PATH_INFO: `/v3/users/53a451439fd64d8ca37cd0e229eb98e1` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:31.599781 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e51ed5-129e-4b94-8c3e-ee461475e49e None admin] RBAC: Authorizing `identity:get_user(user_id=53a451439fd64d8ca37cd0e229eb98e1)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:31.601254 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e51ed5-129e-4b94-8c3e-ee461475e49e None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:31.602929 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 26/52] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:47:31 2022] GET /identity/v3/users/53a451439fd64d8ca37cd0e229eb98e1 => generated 247 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:31.604911 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 27/53] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:47:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:47:31.608487 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e51ed5-129e-4b94-8c3e-ee461475e49e None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:31.629539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ec0f4-e113-4e7a-a544-4f5744a90696 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:31.703352 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e51ed5-129e-4b94-8c3e-ee461475e49e None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:31.730280 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ec0f4-e113-4e7a-a544-4f5744a90696 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:31.736337 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74ccde-e9fb-4466-80e7-b1d211fe07a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:31.737132 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74ccde-e9fb-4466-80e7-b1d211fe07a8 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:31.737417 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74ccde-e9fb-4466-80e7-b1d211fe07a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:31.737690 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74ccde-e9fb-4466-80e7-b1d211fe07a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:31.738994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec74ccde-e9fb-4466-80e7-b1d211fe07a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:31.740465 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec74ccde-e9fb-4466-80e7-b1d211fe07a8 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:31.742329 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 27/54] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:47:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:47:31.747756 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74ccde-e9fb-4466-80e7-b1d211fe07a8 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:31.764350 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee36d0-4c8d-4730-8d55-353c2d2ec611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:31.765249 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee36d0-4c8d-4730-8d55-353c2d2ec611 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:31.765428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee36d0-4c8d-4730-8d55-353c2d2ec611 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:31.765708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee36d0-4c8d-4730-8d55-353c2d2ec611 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:31.766940 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ee36d0-4c8d-4730-8d55-353c2d2ec611 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:31.768407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ee36d0-4c8d-4730-8d55-353c2d2ec611 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:31.770277 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 28/55] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:47:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:47:31.775487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee36d0-4c8d-4730-8d55-353c2d2ec611 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:31.842927 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec74ccde-e9fb-4466-80e7-b1d211fe07a8 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:31.869934 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee36d0-4c8d-4730-8d55-353c2d2ec611 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:31.875929 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb60f4-d3b3-44ac-b387-b14394012b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:31.876583 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb60f4-d3b3-44ac-b387-b14394012b38 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:31.876868 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb60f4-d3b3-44ac-b387-b14394012b38 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:31.877150 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb60f4-d3b3-44ac-b387-b14394012b38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:31.878005 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bb60f4-d3b3-44ac-b387-b14394012b38 None admin] RBAC: Adding query filter params (role.id=30112eb1f3e047398c3c82fb40b72e62, scope.domain.id=default, user.id=53a451439fd64d8ca37cd0e229eb98e1) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:47:31.878316 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bb60f4-d3b3-44ac-b387-b14394012b38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:31.879765 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bb60f4-d3b3-44ac-b387-b14394012b38 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:31.886892 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 28/56] 10.222.0.23 () {56 vars in 1322 bytes} [Sat Apr 30 20:47:31 2022] GET /identity/v3/role_assignments?user.id=53a451439fd64d8ca37cd0e229eb98e1&scope.domain.id=default&role.id=30112eb1f3e047398c3c82fb40b72e62 => generated 530 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:47:31.901958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ca4ca-3b81-4727-ba51-1385eef8f6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:31.902641 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ca4ca-3b81-4727-ba51-1385eef8f6b7 None admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:31.902922 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ca4ca-3b81-4727-ba51-1385eef8f6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:31.903197 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ca4ca-3b81-4727-ba51-1385eef8f6b7 None admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:31.903922 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ca4ca-3b81-4727-ba51-1385eef8f6b7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:31.905441 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ca4ca-3b81-4727-ba51-1385eef8f6b7 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:31.992380 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 29/57] 10.222.0.23 () {60 vars in 1140 bytes} [Sat Apr 30 20:47:31 2022] POST /identity/v3/projects => generated 298 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 20:47:34.322824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7792a5-ab02-4dd6-af77-cfd61a537b2e None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:34.323287 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7792a5-ab02-4dd6-af77-cfd61a537b2e None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:34.323378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7792a5-ab02-4dd6-af77-cfd61a537b2e None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:34.324755 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 29/58] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:47:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:47:34.330764 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606f60a-2523-4db9-baae-69692c8bacbb None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:34.331149 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606f60a-2523-4db9-baae-69692c8bacbb None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:34.331330 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606f60a-2523-4db9-baae-69692c8bacbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:34.347781 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-2606f60a-2523-4db9-baae-69692c8bacbb None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:47:34.348987 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2606f60a-2523-4db9-baae-69692c8bacbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:47:34.411638 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 30/59] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:47:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:47:34.437581 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7792a5-ab02-4dd6-af77-cfd61a537b2e None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:34.532242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7792a5-ab02-4dd6-af77-cfd61a537b2e None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:34.564304 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565afe2-b9a9-4ab8-8823-cc04797c55ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:34.565086 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565afe2-b9a9-4ab8-8823-cc04797c55ee None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:34.565372 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565afe2-b9a9-4ab8-8823-cc04797c55ee None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:34.565650 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565afe2-b9a9-4ab8-8823-cc04797c55ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:34.566919 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8565afe2-b9a9-4ab8-8823-cc04797c55ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:34.568379 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8565afe2-b9a9-4ab8-8823-cc04797c55ee None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:34.569999 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 30/60] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:47:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:34.575465 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606f60a-2523-4db9-baae-69692c8bacbb None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:34.666872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606f60a-2523-4db9-baae-69692c8bacbb None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:34.698812 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4608574-3f25-41cf-9ba0-1c2fc8f38f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:34.699464 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4608574-3f25-41cf-9ba0-1c2fc8f38f36 None admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:34.699749 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4608574-3f25-41cf-9ba0-1c2fc8f38f36 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:34.700025 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4608574-3f25-41cf-9ba0-1c2fc8f38f36 None admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:34.700719 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4608574-3f25-41cf-9ba0-1c2fc8f38f36 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:34.702214 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4608574-3f25-41cf-9ba0-1c2fc8f38f36 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:34.801684 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 31/61] 10.222.0.23 () {60 vars in 1132 bytes} [Sat Apr 30 20:47:34 2022] POST /identity/v3/users => generated 275 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:47:38.264684 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5493f-038b-47d4-bff0-ceaae88f26b6 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:38.265557 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5493f-038b-47d4-bff0-ceaae88f26b6 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:38.266042 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5493f-038b-47d4-bff0-ceaae88f26b6 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:38.268010 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 31/62] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:47:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:47:38.275004 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060027fc-1c89-4071-9c21-34d28e0352d8 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:38.275465 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060027fc-1c89-4071-9c21-34d28e0352d8 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:38.275559 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060027fc-1c89-4071-9c21-34d28e0352d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:38.302807 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-060027fc-1c89-4071-9c21-34d28e0352d8 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:47:38.304224 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-060027fc-1c89-4071-9c21-34d28e0352d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:47:38.386799 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 32/63] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:47:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:47:38.395647 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4985105-c447-453a-adc6-62394bb567c2 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:38.396202 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4985105-c447-453a-adc6-62394bb567c2 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:38.396683 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4985105-c447-453a-adc6-62394bb567c2 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:38.398308 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 32/64] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:47:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:47:38.403415 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a1112-6377-425a-854b-86e095729577 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:38.403711 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a1112-6377-425a-854b-86e095729577 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:38.403998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a1112-6377-425a-854b-86e095729577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:38.430026 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-3f6a1112-6377-425a-854b-86e095729577 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:47:38.431239 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3f6a1112-6377-425a-854b-86e095729577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:47:38.442607 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4985105-c447-453a-adc6-62394bb567c2 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:38.550515 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 33/65] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:47:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:47:38.574211 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a1112-6377-425a-854b-86e095729577 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:38.630714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4985105-c447-453a-adc6-62394bb567c2 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:38.680478 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a8442-4b48-4f9a-a910-9fa3c4e289ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:38.681566 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a8442-4b48-4f9a-a910-9fa3c4e289ce None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:38.682041 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a8442-4b48-4f9a-a910-9fa3c4e289ce None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:38.682464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a8442-4b48-4f9a-a910-9fa3c4e289ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:38.695440 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99a8442-4b48-4f9a-a910-9fa3c4e289ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:47:38.704363 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-b99a8442-4b48-4f9a-a910-9fa3c4e289ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:47:38.704363 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:47:38.704363 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:47:38.704363 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:47:38.704363 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:47:38.704363 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:47:38.704363 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:47:38.704363 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:47:38.704363 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:47:38.704363 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:47:38.704363 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:47:38.704363 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:47:38.704363 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:47:38.704363 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:47:38.704363 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:47:38.704363 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:47:38.705471 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:47:38.705471 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:47:38.705471 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:47:38.705471 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:47:38.705471 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:47:38.705471 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:47:38.705471 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:47:38.705471 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:47:38.705471 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:47:38.705471 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:47:38.705471 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:47:38.705471 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:47:38.705471 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:47:38.705471 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:47:38.705471 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:47:38.705471 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:47:38.706307 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:47:38.706307 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:47:38.706307 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:47:38.706307 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:47:38.706307 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:47:38.706307 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:47:38.706307 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:47:38.706307 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:47:38.706307 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:47:38.706307 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:47:38.706307 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:47:38.706307 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:47:38.709102 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 33/66] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:47:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:47:38.710776 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926961af-4810-43b7-892d-f2c0cb091249 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:38.712995 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926961af-4810-43b7-892d-f2c0cb091249 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:38.713508 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926961af-4810-43b7-892d-f2c0cb091249 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:38.715120 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 34/67] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:47:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:47:38.716157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926961af-4810-43b7-892d-f2c0cb091249 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:38.724124 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a1112-6377-425a-854b-86e095729577 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:38.759096 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800cdcf4-0467-4a8f-bb9e-c027532f13e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:38.759890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cdcf4-0467-4a8f-bb9e-c027532f13e7 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:38.760335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cdcf4-0467-4a8f-bb9e-c027532f13e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:38.760778 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cdcf4-0467-4a8f-bb9e-c027532f13e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:38.772341 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800cdcf4-0467-4a8f-bb9e-c027532f13e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:47:38.780308 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-800cdcf4-0467-4a8f-bb9e-c027532f13e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:47:38.780308 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:47:38.780308 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:47:38.780308 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:47:38.780308 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:47:38.780308 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:47:38.780308 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:47:38.780308 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:47:38.780308 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:47:38.780308 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:47:38.780308 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:47:38.780308 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:47:38.780308 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:47:38.780308 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:47:38.780308 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:47:38.780308 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:47:38.781271 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:47:38.781271 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:47:38.781271 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:47:38.781271 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:47:38.781271 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:47:38.781271 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:47:38.781271 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:47:38.781271 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:47:38.781271 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:47:38.781271 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:47:38.781271 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:47:38.781271 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:47:38.781271 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:47:38.781271 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:47:38.781271 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:47:38.781271 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:47:38.782075 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:47:38.782075 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:47:38.782075 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:47:38.782075 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:47:38.782075 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:47:38.782075 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:47:38.782075 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:47:38.782075 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:47:38.782075 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:47:38.782075 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:47:38.782075 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:47:38.782075 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:47:38.784524 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 34/68] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Apr 30 20:47:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:47:38.790766 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b949dae-d6c6-4f74-8cad-520d137d9198 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:38.791227 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b949dae-d6c6-4f74-8cad-520d137d9198 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:38.791653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b949dae-d6c6-4f74-8cad-520d137d9198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:38.809108 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-8b949dae-d6c6-4f74-8cad-520d137d9198 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:47:38.810554 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8b949dae-d6c6-4f74-8cad-520d137d9198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:47:38.824529 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926961af-4810-43b7-892d-f2c0cb091249 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:38.879946 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ef9de-32ac-425a-a08d-0f794e7aefb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:38.880701 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ef9de-32ac-425a-a08d-0f794e7aefb0 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:38.881464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ef9de-32ac-425a-a08d-0f794e7aefb0 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:38.882264 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ef9de-32ac-425a-a08d-0f794e7aefb0 None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:38.883542 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ef9de-32ac-425a-a08d-0f794e7aefb0 None admin] RBAC: Adding query filter params (name=member) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:47:38.884208 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ef9de-32ac-425a-a08d-0f794e7aefb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:38.886603 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ef9de-32ac-425a-a08d-0f794e7aefb0 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:38.897899 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 35/69] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:47:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:47:38.900265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b949dae-d6c6-4f74-8cad-520d137d9198 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:38.903271 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 35/70] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Apr 30 20:47:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:38.905684 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32e0ed-b470-4ec0-aeb7-0d19343433df None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:38.906214 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32e0ed-b470-4ec0-aeb7-0d19343433df None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:38.906713 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32e0ed-b470-4ec0-aeb7-0d19343433df None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:38.908421 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 36/71] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:47:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:47:38.913730 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32e0ed-b470-4ec0-aeb7-0d19343433df None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:39.012534 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b949dae-d6c6-4f74-8cad-520d137d9198 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:39.027456 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32e0ed-b470-4ec0-aeb7-0d19343433df None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:39.047372 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a175606-7f4a-411b-85db-d02367ab57db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:39.048485 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a175606-7f4a-411b-85db-d02367ab57db None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:39.048776 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a175606-7f4a-411b-85db-d02367ab57db None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:39.049329 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a175606-7f4a-411b-85db-d02367ab57db None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:39.050124 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a175606-7f4a-411b-85db-d02367ab57db None admin] RBAC: Adding query filter params (name=admin) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:47:39.050594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a175606-7f4a-411b-85db-d02367ab57db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:39.052625 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a175606-7f4a-411b-85db-d02367ab57db None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:39.061159 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a33b6-bc8e-4b6d-b05e-451700a5ffbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:39.062550 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a33b6-bc8e-4b6d-b05e-451700a5ffbe None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:39.062839 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a33b6-bc8e-4b6d-b05e-451700a5ffbe None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:39.063040 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 36/72] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:47:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:39.064269 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47a93c-dd3d-45ef-b831-6c2f14b1fb75 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:39.064564 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47a93c-dd3d-45ef-b831-6c2f14b1fb75 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:39.064846 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47a93c-dd3d-45ef-b831-6c2f14b1fb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:39.067631 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a33b6-bc8e-4b6d-b05e-451700a5ffbe None admin] PATH_INFO: `/v3/users/8a0fda9a48cb42cb8504bd361b8b4465` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:39.081084 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-5e47a93c-dd3d-45ef-b831-6c2f14b1fb75 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:47:39.082202 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a33b6-bc8e-4b6d-b05e-451700a5ffbe None admin] RBAC: Authorizing `identity:get_user(user_id=8a0fda9a48cb42cb8504bd361b8b4465)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:39.082336 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5e47a93c-dd3d-45ef-b831-6c2f14b1fb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:47:39.083676 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a33b6-bc8e-4b6d-b05e-451700a5ffbe None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:39.085448 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 37/73] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:47:38 2022] GET /identity/v3/users/8a0fda9a48cb42cb8504bd361b8b4465 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:39.090667 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a33b6-bc8e-4b6d-b05e-451700a5ffbe None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:39.148787 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 37/74] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:47:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:47:39.149647 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47a93c-dd3d-45ef-b831-6c2f14b1fb75 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:39.197779 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a33b6-bc8e-4b6d-b05e-451700a5ffbe None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:39.230121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412dcad-8cfd-47cc-8cbc-897d891f94c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:39.231003 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412dcad-8cfd-47cc-8cbc-897d891f94c3 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:39.231248 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412dcad-8cfd-47cc-8cbc-897d891f94c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:39.231530 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412dcad-8cfd-47cc-8cbc-897d891f94c3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:39.241986 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a412dcad-8cfd-47cc-8cbc-897d891f94c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:47:39.243339 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47a93c-dd3d-45ef-b831-6c2f14b1fb75 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:39.250706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-a412dcad-8cfd-47cc-8cbc-897d891f94c3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:47:39.250706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:47:39.250706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:47:39.250706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:47:39.250706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:47:39.250706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:47:39.250706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:47:39.250706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:47:39.250706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:47:39.250706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:47:39.250706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:47:39.250706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:47:39.250706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:47:39.250706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:47:39.250706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:47:39.250706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:47:39.251710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:47:39.251710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:47:39.251710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:47:39.251710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:47:39.251710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:47:39.251710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:47:39.251710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:47:39.251710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:47:39.251710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:47:39.251710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:47:39.251710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:47:39.251710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:47:39.251710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:47:39.251710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:47:39.251710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:47:39.251710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:47:39.253264 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:47:39.253264 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:47:39.253264 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:47:39.253264 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:47:39.253264 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:47:39.253264 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:47:39.253264 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:47:39.253264 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:47:39.253264 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:47:39.253264 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:47:39.253264 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:47:39.253264 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:47:39.253264 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 38/75] 10.222.0.23 () {56 vars in 1114 bytes} [Sat Apr 30 20:47:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:47:39.253264 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412dcad-8cfd-47cc-8cbc-897d891f94c3 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:39.278214 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68ff07-6cb2-4278-9d94-da4f82686b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:39.278924 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68ff07-6cb2-4278-9d94-da4f82686b46 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:39.279209 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68ff07-6cb2-4278-9d94-da4f82686b46 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:39.279488 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68ff07-6cb2-4278-9d94-da4f82686b46 None admin] PATH_INFO: `/v3/users/53a451439fd64d8ca37cd0e229eb98e1` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:39.282519 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68ff07-6cb2-4278-9d94-da4f82686b46 None admin] RBAC: Authorizing `identity:get_user(user_id=53a451439fd64d8ca37cd0e229eb98e1)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:39.284075 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68ff07-6cb2-4278-9d94-da4f82686b46 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:39.285905 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 38/76] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:47:39 2022] GET /identity/v3/users/53a451439fd64d8ca37cd0e229eb98e1 => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:39.287076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e2652-98f7-4f5a-9220-b5347148a703 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:39.287366 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e2652-98f7-4f5a-9220-b5347148a703 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:39.287651 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e2652-98f7-4f5a-9220-b5347148a703 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:39.289952 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 39/77] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:47:39.289952 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e2652-98f7-4f5a-9220-b5347148a703 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:39.357306 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412dcad-8cfd-47cc-8cbc-897d891f94c3 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:39.386355 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e2652-98f7-4f5a-9220-b5347148a703 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:39.388983 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9a2e2-fb53-4c3a-982c-689df458bb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:39.389629 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9a2e2-fb53-4c3a-982c-689df458bb52 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:39.389968 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9a2e2-fb53-4c3a-982c-689df458bb52 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:39.390248 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9a2e2-fb53-4c3a-982c-689df458bb52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:39.420550 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583dccc-04bd-4389-ac0e-951e7587961e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:39.421969 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583dccc-04bd-4389-ac0e-951e7587961e None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:39.422253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583dccc-04bd-4389-ac0e-951e7587961e None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:39.422527 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583dccc-04bd-4389-ac0e-951e7587961e None admin] PATH_INFO: `/v3/roles/member` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:39.432370 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583dccc-04bd-4389-ac0e-951e7587961e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:47:39.440022 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-9583dccc-04bd-4389-ac0e-951e7587961e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:47:39.440022 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:47:39.440022 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:47:39.440022 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:47:39.440022 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:47:39.440022 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:47:39.440022 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:47:39.440022 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:47:39.440022 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:47:39.440022 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:47:39.440022 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:47:39.440022 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:47:39.440022 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:47:39.440022 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:47:39.440022 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:47:39.440022 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:47:39.441048 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:47:39.441048 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:47:39.441048 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:47:39.441048 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:47:39.441048 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:47:39.441048 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:47:39.441048 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:47:39.441048 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:47:39.441048 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:47:39.441048 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:47:39.441048 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:47:39.441048 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:47:39.441048 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:47:39.441048 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:47:39.441048 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:47:39.441048 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:47:39.442141 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:47:39.442141 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:47:39.442141 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:47:39.442141 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:47:39.442141 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:47:39.442141 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:47:39.442141 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:47:39.442141 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:47:39.442141 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:47:39.442141 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:47:39.442141 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:47:39.442141 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:47:39.442141 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 40/78] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:47:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:47:39.442877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583dccc-04bd-4389-ac0e-951e7587961e None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:39.461477 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc9a2e2-fb53-4c3a-982c-689df458bb52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:39.463087 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc9a2e2-fb53-4c3a-982c-689df458bb52 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:39.537340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583dccc-04bd-4389-ac0e-951e7587961e None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:39.556440 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 39/79] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:47:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:47:39.557272 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9a2e2-fb53-4c3a-982c-689df458bb52 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:39.569022 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdc0c1-c0fe-4158-8ddc-4e7396df94cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:39.569707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdc0c1-c0fe-4158-8ddc-4e7396df94cf None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:39.570022 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdc0c1-c0fe-4158-8ddc-4e7396df94cf None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:39.570302 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdc0c1-c0fe-4158-8ddc-4e7396df94cf None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:39.571043 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbdc0c1-c0fe-4158-8ddc-4e7396df94cf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:47:39.571354 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbdc0c1-c0fe-4158-8ddc-4e7396df94cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:39.572736 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbdc0c1-c0fe-4158-8ddc-4e7396df94cf None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:39.580432 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 41/80] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:47:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:39.581589 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754c0c6-375c-435d-98ef-4ee3ea85fd0d None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:39.581914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754c0c6-375c-435d-98ef-4ee3ea85fd0d None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:39.582198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754c0c6-375c-435d-98ef-4ee3ea85fd0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:39.598290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-c754c0c6-375c-435d-98ef-4ee3ea85fd0d None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:47:39.599483 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c754c0c6-375c-435d-98ef-4ee3ea85fd0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:47:39.652026 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9a2e2-fb53-4c3a-982c-689df458bb52 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:39.661408 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 42/81] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:47:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:47:39.663398 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754c0c6-375c-435d-98ef-4ee3ea85fd0d None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:39.685136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd0947-96b4-4acc-a139-c9027b4cc9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:39.685908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd0947-96b4-4acc-a139-c9027b4cc9cf None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:39.686197 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd0947-96b4-4acc-a139-c9027b4cc9cf None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:39.686480 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd0947-96b4-4acc-a139-c9027b4cc9cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:39.750825 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd0947-96b4-4acc-a139-c9027b4cc9cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:39.752325 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd0947-96b4-4acc-a139-c9027b4cc9cf None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:39.756425 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754c0c6-375c-435d-98ef-4ee3ea85fd0d None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:39.789251 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab256053-8a04-4ceb-95ac-4b7534151732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:39.789958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab256053-8a04-4ceb-95ac-4b7534151732 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:39.790245 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab256053-8a04-4ceb-95ac-4b7534151732 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:39.790523 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab256053-8a04-4ceb-95ac-4b7534151732 None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:39.791267 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab256053-8a04-4ceb-95ac-4b7534151732 None admin] RBAC: Adding query filter params (name=member) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:47:39.791576 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab256053-8a04-4ceb-95ac-4b7534151732 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:39.792986 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab256053-8a04-4ceb-95ac-4b7534151732 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:39.800782 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 43/82] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Apr 30 20:47:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:39.801571 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab256053-8a04-4ceb-95ac-4b7534151732 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:39.847122 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 40/83] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:47:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:47:39.847971 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd0947-96b4-4acc-a139-c9027b4cc9cf None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:39.901440 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab256053-8a04-4ceb-95ac-4b7534151732 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:39.932731 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715809c-60da-464e-8400-1deafe881bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:39.933519 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715809c-60da-464e-8400-1deafe881bd6 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:39.933830 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715809c-60da-464e-8400-1deafe881bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:39.934106 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715809c-60da-464e-8400-1deafe881bd6 None admin] PATH_INFO: `/v3/projects/9431599023b44f1cb5dfb8bca0584f5f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:39.935292 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2715809c-60da-464e-8400-1deafe881bd6 None admin] RBAC: Authorizing `identity:get_project(project_id=9431599023b44f1cb5dfb8bca0584f5f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:39.936795 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2715809c-60da-464e-8400-1deafe881bd6 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:39.938473 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 44/84] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:47:39 2022] GET /identity/v3/projects/9431599023b44f1cb5dfb8bca0584f5f => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:39.939236 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715809c-60da-464e-8400-1deafe881bd6 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:39.939752 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd0947-96b4-4acc-a139-c9027b4cc9cf None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:39.973255 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e1832a-3798-42b0-9d30-6d97b8111fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:39.974157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e1832a-3798-42b0-9d30-6d97b8111fbb None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:39.974446 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e1832a-3798-42b0-9d30-6d97b8111fbb None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:39.974730 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e1832a-3798-42b0-9d30-6d97b8111fbb None admin] PATH_INFO: `/v3/users/8a0fda9a48cb42cb8504bd361b8b4465` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:39.975931 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e1832a-3798-42b0-9d30-6d97b8111fbb None admin] RBAC: Authorizing `identity:get_user(user_id=8a0fda9a48cb42cb8504bd361b8b4465)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:39.977380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e1832a-3798-42b0-9d30-6d97b8111fbb None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:39.983405 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 41/85] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:47:39 2022] GET /identity/v3/users/8a0fda9a48cb42cb8504bd361b8b4465 => generated 275 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:39.983405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e1832a-3798-42b0-9d30-6d97b8111fbb None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:40.038672 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715809c-60da-464e-8400-1deafe881bd6 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:40.070643 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec779401-23cc-49a1-ad97-dd6f2fe069bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:40.071429 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec779401-23cc-49a1-ad97-dd6f2fe069bb None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:40.071714 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec779401-23cc-49a1-ad97-dd6f2fe069bb None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:40.071998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec779401-23cc-49a1-ad97-dd6f2fe069bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:40.073167 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec779401-23cc-49a1-ad97-dd6f2fe069bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:40.074605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e1832a-3798-42b0-9d30-6d97b8111fbb None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:40.074710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec779401-23cc-49a1-ad97-dd6f2fe069bb None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:40.076266 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 45/86] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:47:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:40.077035 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec779401-23cc-49a1-ad97-dd6f2fe069bb None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:40.119476 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02e650-3548-4397-908c-ade1d248e538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:40.120345 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02e650-3548-4397-908c-ade1d248e538 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:40.120634 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02e650-3548-4397-908c-ade1d248e538 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:40.120915 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02e650-3548-4397-908c-ade1d248e538 None admin] PATH_INFO: `/v3/users/8a0fda9a48cb42cb8504bd361b8b4465` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:40.122148 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02e650-3548-4397-908c-ade1d248e538 None admin] RBAC: Authorizing `identity:get_user(user_id=8a0fda9a48cb42cb8504bd361b8b4465)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:40.123608 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02e650-3548-4397-908c-ade1d248e538 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:40.125735 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 42/87] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:47:39 2022] GET /identity/v3/users/8a0fda9a48cb42cb8504bd361b8b4465 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:40.126521 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02e650-3548-4397-908c-ade1d248e538 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:40.173946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec779401-23cc-49a1-ad97-dd6f2fe069bb None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:40.205806 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64159ca0-f83f-4c2e-9604-3909476a0065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:40.206656 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64159ca0-f83f-4c2e-9604-3909476a0065 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:40.206944 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64159ca0-f83f-4c2e-9604-3909476a0065 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:40.207224 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64159ca0-f83f-4c2e-9604-3909476a0065 None admin] PATH_INFO: `/v3/projects/9431599023b44f1cb5dfb8bca0584f5f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:40.208406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64159ca0-f83f-4c2e-9604-3909476a0065 None admin] RBAC: Authorizing `identity:get_project(project_id=9431599023b44f1cb5dfb8bca0584f5f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:40.209884 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64159ca0-f83f-4c2e-9604-3909476a0065 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:40.211562 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 46/88] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:47:40 2022] GET /identity/v3/projects/9431599023b44f1cb5dfb8bca0584f5f => generated 298 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:40.212324 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64159ca0-f83f-4c2e-9604-3909476a0065 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:40.221220 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02e650-3548-4397-908c-ade1d248e538 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:40.253626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ee609-f073-4dd7-a68b-bd3d61170fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:40.254311 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ee609-f073-4dd7-a68b-bd3d61170fea None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:40.254603 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ee609-f073-4dd7-a68b-bd3d61170fea None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:40.254885 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ee609-f073-4dd7-a68b-bd3d61170fea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:40.255721 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ee609-f073-4dd7-a68b-bd3d61170fea None admin] RBAC: Adding query filter params (role.id=9f25fed676d84770b9dc2a96a769de28, scope.project.id=9431599023b44f1cb5dfb8bca0584f5f, user.id=8a0fda9a48cb42cb8504bd361b8b4465) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:47:40.256068 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ee609-f073-4dd7-a68b-bd3d61170fea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:40.257538 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ee609-f073-4dd7-a68b-bd3d61170fea None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:40.262810 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 43/89] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:47:40 2022] GET /identity/v3/role_assignments?user.id=8a0fda9a48cb42cb8504bd361b8b4465&scope.project.id=9431599023b44f1cb5dfb8bca0584f5f&role.id=9f25fed676d84770b9dc2a96a769de28 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:40.263560 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ee609-f073-4dd7-a68b-bd3d61170fea None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:40.314797 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64159ca0-f83f-4c2e-9604-3909476a0065 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:40.351108 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef3716-b503-47ae-be52-888c3a661ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:40.351869 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef3716-b503-47ae-be52-888c3a661ccc None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:40.352233 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef3716-b503-47ae-be52-888c3a661ccc None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:40.352616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef3716-b503-47ae-be52-888c3a661ccc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:40.379427 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ee609-f073-4dd7-a68b-bd3d61170fea None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:40.415815 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e6a06-1117-4b0c-bb6b-1f5b70eebcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:40.416508 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e6a06-1117-4b0c-bb6b-1f5b70eebcc1 None admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:40.416791 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e6a06-1117-4b0c-bb6b-1f5b70eebcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:40.417067 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e6a06-1117-4b0c-bb6b-1f5b70eebcc1 None admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:40.417822 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e6a06-1117-4b0c-bb6b-1f5b70eebcc1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:40.419316 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e6a06-1117-4b0c-bb6b-1f5b70eebcc1 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:40.425261 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef3716-b503-47ae-be52-888c3a661ccc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:40.426916 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef3716-b503-47ae-be52-888c3a661ccc None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:40.506658 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 44/90] 10.222.0.23 () {60 vars in 1132 bytes} [Sat Apr 30 20:47:40 2022] POST /identity/v3/users => generated 289 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:47:40.515599 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e6a06-1117-4b0c-bb6b-1f5b70eebcc1 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:40.538569 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 47/91] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:47:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:47:40.543396 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef3716-b503-47ae-be52-888c3a661ccc None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:40.637388 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e6a06-1117-4b0c-bb6b-1f5b70eebcc1 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:40.675216 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca57cc9c-4278-47ad-a423-4fb32ef0370c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:40.675420 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef3716-b503-47ae-be52-888c3a661ccc None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:40.676466 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57cc9c-4278-47ad-a423-4fb32ef0370c None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:40.676997 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57cc9c-4278-47ad-a423-4fb32ef0370c None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:40.677514 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57cc9c-4278-47ad-a423-4fb32ef0370c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:40.713281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac13ca-08b0-4aec-a1c5-3471bac43f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:40.714020 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac13ca-08b0-4aec-a1c5-3471bac43f2f None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:40.714302 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac13ca-08b0-4aec-a1c5-3471bac43f2f None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:40.714582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac13ca-08b0-4aec-a1c5-3471bac43f2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:40.715580 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ac13ca-08b0-4aec-a1c5-3471bac43f2f None admin] RBAC: Adding query filter params (role.id=30112eb1f3e047398c3c82fb40b72e62, scope.project.id=9431599023b44f1cb5dfb8bca0584f5f, user.id=53a451439fd64d8ca37cd0e229eb98e1) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:47:40.715906 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ac13ca-08b0-4aec-a1c5-3471bac43f2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:40.718226 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ac13ca-08b0-4aec-a1c5-3471bac43f2f None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:40.724488 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 48/92] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:47:40 2022] GET /identity/v3/role_assignments?user.id=53a451439fd64d8ca37cd0e229eb98e1&scope.project.id=9431599023b44f1cb5dfb8bca0584f5f&role.id=30112eb1f3e047398c3c82fb40b72e62 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:40.725295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac13ca-08b0-4aec-a1c5-3471bac43f2f None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:40.765381 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca57cc9c-4278-47ad-a423-4fb32ef0370c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:40.767347 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca57cc9c-4278-47ad-a423-4fb32ef0370c None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:40.861464 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac13ca-08b0-4aec-a1c5-3471bac43f2f None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:40.898467 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd6d02-e43c-4f03-8825-33396f0ca43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:40.900895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd6d02-e43c-4f03-8825-33396f0ca43a None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:40.900895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd6d02-e43c-4f03-8825-33396f0ca43a None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:40.900895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd6d02-e43c-4f03-8825-33396f0ca43a None admin] PATH_INFO: `/v3/projects/9431599023b44f1cb5dfb8bca0584f5f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:40.904880 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd6d02-e43c-4f03-8825-33396f0ca43a None admin] RBAC: Authorizing `identity:get_project(project_id=9431599023b44f1cb5dfb8bca0584f5f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:40.904880 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd6d02-e43c-4f03-8825-33396f0ca43a None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:40.909017 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 49/93] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:47:40 2022] GET /identity/v3/projects/9431599023b44f1cb5dfb8bca0584f5f => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:40.911881 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 45/94] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:47:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:47:40.915672 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd6d02-e43c-4f03-8825-33396f0ca43a None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:40.917295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca57cc9c-4278-47ad-a423-4fb32ef0370c None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:41.038407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd6d02-e43c-4f03-8825-33396f0ca43a None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:41.046762 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca57cc9c-4278-47ad-a423-4fb32ef0370c None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:41.078975 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8619aff-5796-4b50-a01b-98aa343a70db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:41.079572 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8619aff-5796-4b50-a01b-98aa343a70db None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:41.079857 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8619aff-5796-4b50-a01b-98aa343a70db None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:41.080134 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8619aff-5796-4b50-a01b-98aa343a70db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:41.080973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8619aff-5796-4b50-a01b-98aa343a70db None admin] RBAC: Adding query filter params (role.id=121b12a250ae4ef8ae1a85ea8c21c4fa, scope.project.id=9431599023b44f1cb5dfb8bca0584f5f, user.id=8a0fda9a48cb42cb8504bd361b8b4465) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:47:41.081322 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8619aff-5796-4b50-a01b-98aa343a70db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:41.082887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8619aff-5796-4b50-a01b-98aa343a70db None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:41.090526 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 50/95] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:47:40 2022] GET /identity/v3/role_assignments?user.id=8a0fda9a48cb42cb8504bd361b8b4465&scope.project.id=9431599023b44f1cb5dfb8bca0584f5f&role.id=121b12a250ae4ef8ae1a85ea8c21c4fa => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:47:41.097114 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4f06a-46f5-45e9-ba05-ce3d015a979c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:41.098103 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4f06a-46f5-45e9-ba05-ce3d015a979c None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:41.098392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4f06a-46f5-45e9-ba05-ce3d015a979c None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:41.098668 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4f06a-46f5-45e9-ba05-ce3d015a979c None admin] PATH_INFO: `/v3/projects/a9c11ed2a7c548de97ed3ea0730a9251` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:41.099954 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4f06a-46f5-45e9-ba05-ce3d015a979c None admin] RBAC: Authorizing `identity:get_project(project_id=a9c11ed2a7c548de97ed3ea0730a9251)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:41.101474 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4f06a-46f5-45e9-ba05-ce3d015a979c None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:41.103329 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 46/96] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:47:40 2022] GET /identity/v3/projects/a9c11ed2a7c548de97ed3ea0730a9251 => generated 312 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:41.110290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8619aff-5796-4b50-a01b-98aa343a70db None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:41.235952 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8619aff-5796-4b50-a01b-98aa343a70db None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:41.286393 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f08c1-eb30-486b-bf97-601e2a6a8d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:41.286393 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f08c1-eb30-486b-bf97-601e2a6a8d92 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:41.286393 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f08c1-eb30-486b-bf97-601e2a6a8d92 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:41.286393 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f08c1-eb30-486b-bf97-601e2a6a8d92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:41.286683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f08c1-eb30-486b-bf97-601e2a6a8d92 None admin] RBAC: Adding query filter params (role.id=9f25fed676d84770b9dc2a96a769de28, scope.project.id=a9c11ed2a7c548de97ed3ea0730a9251, user.id=8a0fda9a48cb42cb8504bd361b8b4465) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:47:41.286683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f08c1-eb30-486b-bf97-601e2a6a8d92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:41.286683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171f08c1-eb30-486b-bf97-601e2a6a8d92 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:41.290467 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 51/97] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:47:41 2022] GET /identity/v3/role_assignments?user.id=8a0fda9a48cb42cb8504bd361b8b4465&scope.project.id=a9c11ed2a7c548de97ed3ea0730a9251&role.id=9f25fed676d84770b9dc2a96a769de28 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:43.181568 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13d132-a45f-4a76-851e-da561ee97469 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:43.182661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13d132-a45f-4a76-851e-da561ee97469 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:43.183148 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13d132-a45f-4a76-851e-da561ee97469 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:43.184983 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 47/98] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:47:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:47:43.190856 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f896c1-46b7-404e-bc21-2858268be8f7 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:43.191812 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f896c1-46b7-404e-bc21-2858268be8f7 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:43.192291 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f896c1-46b7-404e-bc21-2858268be8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:43.209966 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-93f896c1-46b7-404e-bc21-2858268be8f7 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:47:43.211479 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-93f896c1-46b7-404e-bc21-2858268be8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:47:43.290224 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 52/99] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:47:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:47:43.314293 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13d132-a45f-4a76-851e-da561ee97469 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:43.427108 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13d132-a45f-4a76-851e-da561ee97469 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:43.472377 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7876ea4-aa28-4e93-bbee-de74457ae237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:43.473616 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7876ea4-aa28-4e93-bbee-de74457ae237 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:43.474130 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7876ea4-aa28-4e93-bbee-de74457ae237 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:43.474648 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7876ea4-aa28-4e93-bbee-de74457ae237 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:43.486832 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7876ea4-aa28-4e93-bbee-de74457ae237 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:47:43.495023 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-f7876ea4-aa28-4e93-bbee-de74457ae237 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:47:43.495023 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:47:43.495023 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:47:43.495023 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:47:43.495023 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:47:43.495023 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:47:43.495023 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:47:43.495023 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:47:43.495023 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:47:43.495023 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:47:43.495023 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:47:43.495023 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:47:43.495023 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:47:43.495023 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:47:43.495023 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:47:43.495023 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:47:43.495864 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:47:43.495864 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:47:43.495864 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:47:43.495864 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:47:43.495864 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:47:43.495864 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:47:43.495864 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:47:43.495864 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:47:43.495864 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:47:43.495864 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:47:43.495864 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:47:43.495864 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:47:43.495864 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:47:43.495864 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:47:43.495864 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:47:43.495864 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:47:43.496634 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:47:43.496634 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:47:43.496634 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:47:43.496634 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:47:43.496634 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:47:43.496634 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:47:43.496634 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:47:43.496634 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:47:43.496634 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:47:43.496634 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:47:43.496634 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:47:43.496634 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:47:43.502728 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 48/100] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:47:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:47:43.508933 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f896c1-46b7-404e-bc21-2858268be8f7 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:43.756002 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f896c1-46b7-404e-bc21-2858268be8f7 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:43.792810 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7c272-3680-4b10-9069-5d9a6c70c4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:43.793852 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7c272-3680-4b10-9069-5d9a6c70c4da None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:43.794332 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7c272-3680-4b10-9069-5d9a6c70c4da None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:43.794750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7c272-3680-4b10-9069-5d9a6c70c4da None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:43.795753 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d7c272-3680-4b10-9069-5d9a6c70c4da None admin] RBAC: Adding query filter params (name=member) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:47:43.796241 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d7c272-3680-4b10-9069-5d9a6c70c4da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:43.797815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d7c272-3680-4b10-9069-5d9a6c70c4da None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:43.806998 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 53/101] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Apr 30 20:47:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:43.813353 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7876ea4-aa28-4e93-bbee-de74457ae237 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:43.827108 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c727cd-e083-4e4f-8f79-fd829b279764 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:43.828115 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c727cd-e083-4e4f-8f79-fd829b279764 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:43.828565 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c727cd-e083-4e4f-8f79-fd829b279764 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:43.830104 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 54/102] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:47:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:47:43.835073 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319775c-398a-45ad-995b-36e4db0c9489 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:43.835520 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319775c-398a-45ad-995b-36e4db0c9489 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:43.836421 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319775c-398a-45ad-995b-36e4db0c9489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:43.862496 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-d319775c-398a-45ad-995b-36e4db0c9489 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:47:43.863926 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d319775c-398a-45ad-995b-36e4db0c9489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:47:43.956589 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 55/103] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:47:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:47:44.023878 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7876ea4-aa28-4e93-bbee-de74457ae237 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:44.029454 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319775c-398a-45ad-995b-36e4db0c9489 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:44.092837 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34abf0-2502-434c-89a6-5fc38b663207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:44.093725 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34abf0-2502-434c-89a6-5fc38b663207 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:44.094039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34abf0-2502-434c-89a6-5fc38b663207 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:44.094316 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34abf0-2502-434c-89a6-5fc38b663207 None admin] PATH_INFO: `/v3/users/8a0fda9a48cb42cb8504bd361b8b4465` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:44.098485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34abf0-2502-434c-89a6-5fc38b663207 None admin] RBAC: Authorizing `identity:get_user(user_id=8a0fda9a48cb42cb8504bd361b8b4465)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:44.099998 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34abf0-2502-434c-89a6-5fc38b663207 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:44.101902 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 49/104] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:47:43 2022] GET /identity/v3/users/8a0fda9a48cb42cb8504bd361b8b4465 => generated 275 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:44.127212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34abf0-2502-434c-89a6-5fc38b663207 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:44.173810 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319775c-398a-45ad-995b-36e4db0c9489 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:44.223106 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99799c-8b57-4d80-a2e9-1b0179773366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:44.223917 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99799c-8b57-4d80-a2e9-1b0179773366 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:44.224206 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99799c-8b57-4d80-a2e9-1b0179773366 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:44.224488 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99799c-8b57-4d80-a2e9-1b0179773366 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:44.248589 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d99799c-8b57-4d80-a2e9-1b0179773366 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:47:44.266913 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-9d99799c-8b57-4d80-a2e9-1b0179773366 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:47:44.266913 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:47:44.266913 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:47:44.266913 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:47:44.266913 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:47:44.266913 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:47:44.266913 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:47:44.266913 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:47:44.266913 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:47:44.266913 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:47:44.266913 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:47:44.266913 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:47:44.266913 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:47:44.266913 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:47:44.266913 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:47:44.266913 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:47:44.268020 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:47:44.268020 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:47:44.268020 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:47:44.268020 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:47:44.268020 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:47:44.268020 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:47:44.268020 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:47:44.268020 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:47:44.268020 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:47:44.268020 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:47:44.268020 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:47:44.268020 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:47:44.268020 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:47:44.268020 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:47:44.268020 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:47:44.268020 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:47:44.268966 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:47:44.268966 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:47:44.268966 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:47:44.268966 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:47:44.268966 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:47:44.268966 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:47:44.268966 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:47:44.268966 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:47:44.268966 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:47:44.268966 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:47:44.268966 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:47:44.268966 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:47:44.284515 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 56/105] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Apr 30 20:47:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:47:44.290464 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99799c-8b57-4d80-a2e9-1b0179773366 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:44.295135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34abf0-2502-434c-89a6-5fc38b663207 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:44.331162 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718defbf-01d2-4b51-9bee-ebe39dbb31c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:44.332387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718defbf-01d2-4b51-9bee-ebe39dbb31c4 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:44.332888 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718defbf-01d2-4b51-9bee-ebe39dbb31c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:44.333373 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718defbf-01d2-4b51-9bee-ebe39dbb31c4 None admin] PATH_INFO: `/v3/projects/9431599023b44f1cb5dfb8bca0584f5f` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:44.335003 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718defbf-01d2-4b51-9bee-ebe39dbb31c4 None admin] RBAC: Authorizing `identity:get_project(project_id=9431599023b44f1cb5dfb8bca0584f5f)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:44.336810 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718defbf-01d2-4b51-9bee-ebe39dbb31c4 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:44.339671 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 50/106] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:47:44 2022] GET /identity/v3/projects/9431599023b44f1cb5dfb8bca0584f5f => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:44.346779 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718defbf-01d2-4b51-9bee-ebe39dbb31c4 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:44.511142 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718defbf-01d2-4b51-9bee-ebe39dbb31c4 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:44.549095 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb22c0c-1812-4f6d-9f3a-bc95b8b61c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:44.550915 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb22c0c-1812-4f6d-9f3a-bc95b8b61c3f None admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:44.551442 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb22c0c-1812-4f6d-9f3a-bc95b8b61c3f None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:44.551918 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb22c0c-1812-4f6d-9f3a-bc95b8b61c3f None admin] PATH_INFO: `/v3/projects/9431599023b44f1cb5dfb8bca0584f5f/users/8a0fda9a48cb42cb8504bd361b8b4465/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:44.552406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99799c-8b57-4d80-a2e9-1b0179773366 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:44.554524 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb22c0c-1812-4f6d-9f3a-bc95b8b61c3f None admin] RBAC: Authorizing `identity:create_grant(project_id=9431599023b44f1cb5dfb8bca0584f5f, user_id=8a0fda9a48cb42cb8504bd361b8b4465, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:44.556183 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb22c0c-1812-4f6d-9f3a-bc95b8b61c3f None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:44.603918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232dc1ee-f953-4c80-abf3-f9b8cbc52af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:44.604934 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232dc1ee-f953-4c80-abf3-f9b8cbc52af1 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:44.605430 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232dc1ee-f953-4c80-abf3-f9b8cbc52af1 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:44.606021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232dc1ee-f953-4c80-abf3-f9b8cbc52af1 None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:44.607104 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232dc1ee-f953-4c80-abf3-f9b8cbc52af1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:47:44.607623 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232dc1ee-f953-4c80-abf3-f9b8cbc52af1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:44.609973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232dc1ee-f953-4c80-abf3-f9b8cbc52af1 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:44.619277 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 57/107] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:47:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:44.621169 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58b7f6-b04f-412f-93b5-af090869b800 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:44.621665 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58b7f6-b04f-412f-93b5-af090869b800 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:44.622181 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58b7f6-b04f-412f-93b5-af090869b800 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:44.624307 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 58/108] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:47:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:47:44.625450 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58b7f6-b04f-412f-93b5-af090869b800 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:44.652433 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 51/109] 10.222.0.23 () {58 vars in 1439 bytes} [Sat Apr 30 20:47:44 2022] PUT /identity/v3/projects/9431599023b44f1cb5dfb8bca0584f5f/users/8a0fda9a48cb42cb8504bd361b8b4465/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:47:44.654412 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24856fa9-fe0b-41be-af51-63a207d050dd None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:44.656011 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24856fa9-fe0b-41be-af51-63a207d050dd None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:44.656516 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24856fa9-fe0b-41be-af51-63a207d050dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:44.680043 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-24856fa9-fe0b-41be-af51-63a207d050dd None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:47:44.682843 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-24856fa9-fe0b-41be-af51-63a207d050dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:47:44.757184 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58b7f6-b04f-412f-93b5-af090869b800 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:44.783270 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 52/110] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:47:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:47:44.787141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a4ac4-9a4c-4566-aa6d-0630679d7c50 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:44.787141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a4ac4-9a4c-4566-aa6d-0630679d7c50 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:44.787141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a4ac4-9a4c-4566-aa6d-0630679d7c50 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:44.787141 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 53/111] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:47:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:47:44.792786 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf7404-8bd2-482d-8429-6d3a41833fee None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:44.793082 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf7404-8bd2-482d-8429-6d3a41833fee None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:44.793358 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf7404-8bd2-482d-8429-6d3a41833fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:44.813090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377a077-9aec-4049-9663-71a5f74a0a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:44.817811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-c2cf7404-8bd2-482d-8429-6d3a41833fee None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:47:44.817811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c2cf7404-8bd2-482d-8429-6d3a41833fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:47:44.818958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377a077-9aec-4049-9663-71a5f74a0a97 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:44.819461 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377a077-9aec-4049-9663-71a5f74a0a97 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:44.820386 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377a077-9aec-4049-9663-71a5f74a0a97 None admin] PATH_INFO: `/v3/users/53a451439fd64d8ca37cd0e229eb98e1` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:44.822178 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c377a077-9aec-4049-9663-71a5f74a0a97 None admin] RBAC: Authorizing `identity:get_user(user_id=53a451439fd64d8ca37cd0e229eb98e1)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:44.823998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c377a077-9aec-4049-9663-71a5f74a0a97 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:44.827898 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 59/112] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:47:44 2022] GET /identity/v3/users/53a451439fd64d8ca37cd0e229eb98e1 => generated 247 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:44.832724 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377a077-9aec-4049-9663-71a5f74a0a97 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:44.934299 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 54/113] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:47:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:47:44.936672 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf7404-8bd2-482d-8429-6d3a41833fee None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:44.983658 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377a077-9aec-4049-9663-71a5f74a0a97 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:45.017491 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d7c79d-99ee-4a67-82bb-82694851b6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:45.018341 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7c79d-99ee-4a67-82bb-82694851b6aa None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:45.018620 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7c79d-99ee-4a67-82bb-82694851b6aa None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:45.019052 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7c79d-99ee-4a67-82bb-82694851b6aa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:45.029686 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d7c79d-99ee-4a67-82bb-82694851b6aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:47:45.039439 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-95d7c79d-99ee-4a67-82bb-82694851b6aa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:47:45.039439 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:47:45.039439 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:47:45.039439 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:47:45.039439 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:47:45.039439 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:47:45.039439 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:47:45.039439 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:47:45.039439 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:47:45.039439 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:47:45.039439 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:47:45.039439 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:47:45.039439 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:47:45.039439 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:47:45.039439 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:47:45.039439 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:47:45.040526 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:47:45.040526 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:47:45.040526 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:47:45.040526 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:47:45.040526 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:47:45.040526 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:47:45.040526 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:47:45.040526 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:47:45.040526 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:47:45.040526 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:47:45.040526 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:47:45.040526 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:47:45.040526 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:47:45.040526 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:47:45.040526 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:47:45.040526 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:47:45.041475 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:47:45.041475 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:47:45.041475 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:47:45.041475 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:47:45.041475 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:47:45.041475 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:47:45.041475 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:47:45.041475 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:47:45.041475 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:47:45.041475 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:47:45.041475 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:47:45.041475 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:47:45.042226 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf7404-8bd2-482d-8429-6d3a41833fee None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:45.043591 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 60/114] 10.222.0.23 () {56 vars in 1114 bytes} [Sat Apr 30 20:47:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:47:45.049695 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645fbd9-9773-40a6-9de4-1d7078f65b94 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:45.050020 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645fbd9-9773-40a6-9de4-1d7078f65b94 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:45.050302 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645fbd9-9773-40a6-9de4-1d7078f65b94 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:45.051612 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 61/115] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:47:45.054900 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a16fe8-b72b-4dba-aabb-52a725c674d1 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:45.055193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a16fe8-b72b-4dba-aabb-52a725c674d1 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:45.055500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a16fe8-b72b-4dba-aabb-52a725c674d1 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:45.057524 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 62/116] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:47:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:47:45.057524 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a16fe8-b72b-4dba-aabb-52a725c674d1 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:45.084233 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61182bb-4182-4f18-878b-6471dd46afad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:45.085016 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61182bb-4182-4f18-878b-6471dd46afad None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:45.085572 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61182bb-4182-4f18-878b-6471dd46afad None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:45.085572 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61182bb-4182-4f18-878b-6471dd46afad None admin] PATH_INFO: `/v3/projects/9431599023b44f1cb5dfb8bca0584f5f` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:45.086765 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61182bb-4182-4f18-878b-6471dd46afad None admin] RBAC: Authorizing `identity:get_project(project_id=9431599023b44f1cb5dfb8bca0584f5f)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:45.088299 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61182bb-4182-4f18-878b-6471dd46afad None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:45.090026 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 55/117] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:47:44 2022] GET /identity/v3/projects/9431599023b44f1cb5dfb8bca0584f5f => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:45.090791 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61182bb-4182-4f18-878b-6471dd46afad None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:45.163114 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a16fe8-b72b-4dba-aabb-52a725c674d1 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:45.192774 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61182bb-4182-4f18-878b-6471dd46afad None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:45.196802 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d12b0a7-3c80-4503-a20e-ca6d8e327cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:45.202668 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12b0a7-3c80-4503-a20e-ca6d8e327cf6 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:45.202668 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12b0a7-3c80-4503-a20e-ca6d8e327cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:45.202668 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12b0a7-3c80-4503-a20e-ca6d8e327cf6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:45.208729 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d12b0a7-3c80-4503-a20e-ca6d8e327cf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:47:45.216332 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-0d12b0a7-3c80-4503-a20e-ca6d8e327cf6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:47:45.216332 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:47:45.216332 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:47:45.216332 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:47:45.216332 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:47:45.216332 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:47:45.216332 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:47:45.216332 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:47:45.216332 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:47:45.216332 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:47:45.216332 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:47:45.216332 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:47:45.216332 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:47:45.216332 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:47:45.216332 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:47:45.216332 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:47:45.217346 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:47:45.217346 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:47:45.217346 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:47:45.217346 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:47:45.217346 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:47:45.217346 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:47:45.217346 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:47:45.217346 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:47:45.217346 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:47:45.217346 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:47:45.217346 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:47:45.217346 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:47:45.217346 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:47:45.217346 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:47:45.217346 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:47:45.217346 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:47:45.224410 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:47:45.224410 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:47:45.224410 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:47:45.224410 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:47:45.224410 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:47:45.224410 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:47:45.224410 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:47:45.224410 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:47:45.224410 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:47:45.224410 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:47:45.224410 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:47:45.224410 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:47:45.224410 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 63/118] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:47:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:47:45.224410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267112f-d905-460e-8553-5f241ed67eb2 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:45.225149 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267112f-d905-460e-8553-5f241ed67eb2 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:45.225149 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267112f-d905-460e-8553-5f241ed67eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:45.231013 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f017456f-6815-4de6-b1f3-633c55ff59d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:45.231687 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017456f-6815-4de6-b1f3-633c55ff59d7 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:45.231973 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017456f-6815-4de6-b1f3-633c55ff59d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:45.232626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017456f-6815-4de6-b1f3-633c55ff59d7 None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:45.233006 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f017456f-6815-4de6-b1f3-633c55ff59d7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:47:45.233345 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f017456f-6815-4de6-b1f3-633c55ff59d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:45.234774 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f017456f-6815-4de6-b1f3-633c55ff59d7 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:45.237645 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-3267112f-d905-460e-8553-5f241ed67eb2 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:47:45.238873 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3267112f-d905-460e-8553-5f241ed67eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:47:45.243004 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 56/119] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:47:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:45.244038 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57330cc-cc86-43a1-8cb1-aae64f43b06a None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:45.244329 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57330cc-cc86-43a1-8cb1-aae64f43b06a None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:45.244608 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57330cc-cc86-43a1-8cb1-aae64f43b06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:45.260735 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-f57330cc-cc86-43a1-8cb1-aae64f43b06a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:47:45.261960 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f57330cc-cc86-43a1-8cb1-aae64f43b06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:47:45.313899 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 64/120] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:47:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:47:45.314729 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267112f-d905-460e-8553-5f241ed67eb2 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:45.339797 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 57/121] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:47:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:47:45.342051 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57330cc-cc86-43a1-8cb1-aae64f43b06a None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:45.412263 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267112f-d905-460e-8553-5f241ed67eb2 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:45.444142 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb985c2-69eb-4739-a242-001c5952cbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:45.445030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb985c2-69eb-4739-a242-001c5952cbf7 None admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:45.445316 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb985c2-69eb-4739-a242-001c5952cbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:45.445597 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb985c2-69eb-4739-a242-001c5952cbf7 None admin] PATH_INFO: `/v3/projects/9431599023b44f1cb5dfb8bca0584f5f/users/53a451439fd64d8ca37cd0e229eb98e1/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:45.447590 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb985c2-69eb-4739-a242-001c5952cbf7 None admin] RBAC: Authorizing `identity:create_grant(project_id=9431599023b44f1cb5dfb8bca0584f5f, user_id=53a451439fd64d8ca37cd0e229eb98e1, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:45.449100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb985c2-69eb-4739-a242-001c5952cbf7 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:45.449197 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57330cc-cc86-43a1-8cb1-aae64f43b06a None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:45.486747 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7983ba3c-471e-4b68-826d-df4eba622fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:45.487430 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983ba3c-471e-4b68-826d-df4eba622fb0 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:45.487714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983ba3c-471e-4b68-826d-df4eba622fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:45.487994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983ba3c-471e-4b68-826d-df4eba622fb0 None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:45.488746 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7983ba3c-471e-4b68-826d-df4eba622fb0 None admin] RBAC: Adding query filter params (name=member) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:47:45.489056 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7983ba3c-471e-4b68-826d-df4eba622fb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:45.490492 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7983ba3c-471e-4b68-826d-df4eba622fb0 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:45.502995 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 58/122] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Apr 30 20:47:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:45.502995 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7983ba3c-471e-4b68-826d-df4eba622fb0 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:45.561397 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 65/123] 10.222.0.23 () {58 vars in 1439 bytes} [Sat Apr 30 20:47:45 2022] PUT /identity/v3/projects/9431599023b44f1cb5dfb8bca0584f5f/users/53a451439fd64d8ca37cd0e229eb98e1/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:47:45.569982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb985c2-69eb-4739-a242-001c5952cbf7 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:45.624523 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7983ba3c-471e-4b68-826d-df4eba622fb0 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:45.664959 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f72d5-3316-4b62-b646-87c8668d7b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:45.665929 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f72d5-3316-4b62-b646-87c8668d7b7c None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:45.666216 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f72d5-3316-4b62-b646-87c8668d7b7c None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:45.666495 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f72d5-3316-4b62-b646-87c8668d7b7c None admin] PATH_INFO: `/v3/users/8a0fda9a48cb42cb8504bd361b8b4465` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:45.667745 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f72d5-3316-4b62-b646-87c8668d7b7c None admin] RBAC: Authorizing `identity:get_user(user_id=8a0fda9a48cb42cb8504bd361b8b4465)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:45.669249 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f72d5-3316-4b62-b646-87c8668d7b7c None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:45.671587 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 59/124] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:47:45 2022] GET /identity/v3/users/8a0fda9a48cb42cb8504bd361b8b4465 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:45.672399 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f72d5-3316-4b62-b646-87c8668d7b7c None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:45.682301 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb985c2-69eb-4739-a242-001c5952cbf7 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:45.726341 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28561ce4-d572-4d8d-bdc5-5aefa4e2eb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:45.727162 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28561ce4-d572-4d8d-bdc5-5aefa4e2eb3a None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:45.727449 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28561ce4-d572-4d8d-bdc5-5aefa4e2eb3a None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:45.727731 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28561ce4-d572-4d8d-bdc5-5aefa4e2eb3a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:45.743980 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28561ce4-d572-4d8d-bdc5-5aefa4e2eb3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:47:45.752155 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-28561ce4-d572-4d8d-bdc5-5aefa4e2eb3a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 30 20:47:45.752155 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:47:45.752155 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:47:45.752155 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:47:45.752155 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:47:45.752155 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:47:45.752155 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:47:45.752155 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:47:45.752155 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:47:45.752155 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:47:45.752155 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:47:45.752155 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:47:45.752155 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:47:45.752155 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:47:45.752155 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:47:45.752155 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:47:45.753070 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:47:45.753070 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:47:45.753070 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:47:45.753070 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:47:45.753070 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:47:45.753070 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:47:45.753070 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:47:45.753070 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:47:45.753070 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:47:45.753070 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:47:45.753070 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:47:45.753070 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:47:45.753070 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:47:45.753070 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:47:45.753070 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:47:45.753070 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:47:45.753844 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:47:45.753844 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:47:45.753844 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:47:45.753844 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:47:45.753844 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:47:45.753844 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:47:45.753844 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:47:45.753844 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:47:45.753844 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:47:45.753844 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:47:45.753844 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Apr 30 20:47:45.753844 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:47:45.753844 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 66/125] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:47:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:47:45.759674 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28561ce4-d572-4d8d-bdc5-5aefa4e2eb3a None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:45.803305 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f72d5-3316-4b62-b646-87c8668d7b7c None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:45.844152 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf5df4-c714-4426-85af-3d7017e00bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:45.844961 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf5df4-c714-4426-85af-3d7017e00bd2 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:45.845506 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf5df4-c714-4426-85af-3d7017e00bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:45.845811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf5df4-c714-4426-85af-3d7017e00bd2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:45.847022 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddf5df4-c714-4426-85af-3d7017e00bd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:45.848954 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddf5df4-c714-4426-85af-3d7017e00bd2 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:45.851269 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 60/126] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:47:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:45.854517 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf5df4-c714-4426-85af-3d7017e00bd2 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:45.885955 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28561ce4-d572-4d8d-bdc5-5aefa4e2eb3a None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:45.929296 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0647c-ee33-4073-bfe6-0651bb1603ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:45.930207 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0647c-ee33-4073-bfe6-0651bb1603ec None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:45.930496 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0647c-ee33-4073-bfe6-0651bb1603ec None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:45.930778 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0647c-ee33-4073-bfe6-0651bb1603ec None admin] PATH_INFO: `/v3/users/8a0fda9a48cb42cb8504bd361b8b4465` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:45.932013 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c0647c-ee33-4073-bfe6-0651bb1603ec None admin] RBAC: Authorizing `identity:get_user(user_id=8a0fda9a48cb42cb8504bd361b8b4465)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:45.933950 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c0647c-ee33-4073-bfe6-0651bb1603ec None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:45.935982 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 67/127] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:47:45 2022] GET /identity/v3/users/8a0fda9a48cb42cb8504bd361b8b4465 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:45.937551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0647c-ee33-4073-bfe6-0651bb1603ec None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:45.958933 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf5df4-c714-4426-85af-3d7017e00bd2 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:46.011560 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b95e25-4f42-4d63-89db-269c1bd0379d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:46.012909 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b95e25-4f42-4d63-89db-269c1bd0379d None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:46.013210 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b95e25-4f42-4d63-89db-269c1bd0379d None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:46.013749 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b95e25-4f42-4d63-89db-269c1bd0379d None admin] PATH_INFO: `/v3/projects/9431599023b44f1cb5dfb8bca0584f5f` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:46.015706 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b95e25-4f42-4d63-89db-269c1bd0379d None admin] RBAC: Authorizing `identity:get_project(project_id=9431599023b44f1cb5dfb8bca0584f5f)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:46.017988 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b95e25-4f42-4d63-89db-269c1bd0379d None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:46.019705 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 61/128] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:47:45 2022] GET /identity/v3/projects/9431599023b44f1cb5dfb8bca0584f5f => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:46.022492 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b95e25-4f42-4d63-89db-269c1bd0379d None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:46.060289 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0647c-ee33-4073-bfe6-0651bb1603ec None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:46.102325 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b399a55-7d03-4ded-94e8-315381172ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:46.103000 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b399a55-7d03-4ded-94e8-315381172ec0 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:46.103285 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b399a55-7d03-4ded-94e8-315381172ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:46.103963 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b399a55-7d03-4ded-94e8-315381172ec0 None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:46.104727 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b399a55-7d03-4ded-94e8-315381172ec0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:47:46.105039 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b399a55-7d03-4ded-94e8-315381172ec0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:46.106830 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b399a55-7d03-4ded-94e8-315381172ec0 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:46.117632 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 68/129] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Apr 30 20:47:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:46.122552 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b399a55-7d03-4ded-94e8-315381172ec0 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:46.133679 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b95e25-4f42-4d63-89db-269c1bd0379d None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:46.168755 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ddea2-0cf9-4e38-8457-345fae2e04f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:46.169354 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ddea2-0cf9-4e38-8457-345fae2e04f0 None admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:46.169641 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ddea2-0cf9-4e38-8457-345fae2e04f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:46.169965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ddea2-0cf9-4e38-8457-345fae2e04f0 None admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:46.170672 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ddea2-0cf9-4e38-8457-345fae2e04f0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:46.172790 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ddea2-0cf9-4e38-8457-345fae2e04f0 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:46.231477 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b399a55-7d03-4ded-94e8-315381172ec0 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:46.263347 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187acf90-204a-4d36-bf37-96569234b13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:46.264203 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187acf90-204a-4d36-bf37-96569234b13d None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:46.264504 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187acf90-204a-4d36-bf37-96569234b13d None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:46.264797 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187acf90-204a-4d36-bf37-96569234b13d None admin] PATH_INFO: `/v3/projects/a9c11ed2a7c548de97ed3ea0730a9251` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:46.266066 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187acf90-204a-4d36-bf37-96569234b13d None admin] RBAC: Authorizing `identity:get_project(project_id=a9c11ed2a7c548de97ed3ea0730a9251)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:46.267545 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187acf90-204a-4d36-bf37-96569234b13d None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:46.269594 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 69/130] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:47:46 2022] GET /identity/v3/projects/a9c11ed2a7c548de97ed3ea0730a9251 => generated 312 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:46.270501 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187acf90-204a-4d36-bf37-96569234b13d None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:46.288459 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 62/131] 10.222.0.23 () {60 vars in 1141 bytes} [Sat Apr 30 20:47:46 2022] POST /identity/v3/projects => generated 302 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:47:46.289150 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ddea2-0cf9-4e38-8457-345fae2e04f0 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:46.415805 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ddea2-0cf9-4e38-8457-345fae2e04f0 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:46.455845 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86fe131-0609-41b4-a17d-1ed4f5a2dcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:46.457198 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fe131-0609-41b4-a17d-1ed4f5a2dcba None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:46.457691 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fe131-0609-41b4-a17d-1ed4f5a2dcba None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:46.458192 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fe131-0609-41b4-a17d-1ed4f5a2dcba None admin] PATH_INFO: `/v3/users/baa6d4cbf2ca472a81b7e44df021f0c0` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:46.474493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86fe131-0609-41b4-a17d-1ed4f5a2dcba None admin] RBAC: Authorizing `identity:get_user(user_id=baa6d4cbf2ca472a81b7e44df021f0c0)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:46.476358 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86fe131-0609-41b4-a17d-1ed4f5a2dcba None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:46.478562 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 63/132] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:47:46 2022] GET /identity/v3/users/baa6d4cbf2ca472a81b7e44df021f0c0 => generated 289 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:46.479523 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86fe131-0609-41b4-a17d-1ed4f5a2dcba None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:46.488362 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187acf90-204a-4d36-bf37-96569234b13d None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:46.528480 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb6f6d-0d09-4786-95bb-9cc55540fba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:46.529699 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb6f6d-0d09-4786-95bb-9cc55540fba8 None admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:46.530746 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb6f6d-0d09-4786-95bb-9cc55540fba8 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:46.531189 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb6f6d-0d09-4786-95bb-9cc55540fba8 None admin] PATH_INFO: `/v3/projects/9431599023b44f1cb5dfb8bca0584f5f/users/8a0fda9a48cb42cb8504bd361b8b4465/roles/121b12a250ae4ef8ae1a85ea8c21c4fa` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:46.534086 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb6f6d-0d09-4786-95bb-9cc55540fba8 None admin] RBAC: Authorizing `identity:create_grant(project_id=9431599023b44f1cb5dfb8bca0584f5f, user_id=8a0fda9a48cb42cb8504bd361b8b4465, role_id=121b12a250ae4ef8ae1a85ea8c21c4fa)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:46.536887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb6f6d-0d09-4786-95bb-9cc55540fba8 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:46.587438 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86fe131-0609-41b4-a17d-1ed4f5a2dcba None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:46.624424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5dc39b-a745-4ade-9d8e-10800ea4f6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:46.625319 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5dc39b-a745-4ade-9d8e-10800ea4f6f8 None admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:46.625603 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5dc39b-a745-4ade-9d8e-10800ea4f6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:46.625955 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5dc39b-a745-4ade-9d8e-10800ea4f6f8 None admin] PATH_INFO: `/v3/projects/a9c11ed2a7c548de97ed3ea0730a9251/users/8a0fda9a48cb42cb8504bd361b8b4465/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:46.627954 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5dc39b-a745-4ade-9d8e-10800ea4f6f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=a9c11ed2a7c548de97ed3ea0730a9251, user_id=8a0fda9a48cb42cb8504bd361b8b4465, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:46.629414 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5dc39b-a745-4ade-9d8e-10800ea4f6f8 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:46.673984 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 70/133] 10.222.0.23 () {58 vars in 1439 bytes} [Sat Apr 30 20:47:46 2022] PUT /identity/v3/projects/9431599023b44f1cb5dfb8bca0584f5f/users/8a0fda9a48cb42cb8504bd361b8b4465/roles/121b12a250ae4ef8ae1a85ea8c21c4fa => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:47:46.675062 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb6f6d-0d09-4786-95bb-9cc55540fba8 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:46.711692 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 64/134] 10.222.0.23 () {58 vars in 1439 bytes} [Sat Apr 30 20:47:46 2022] PUT /identity/v3/projects/a9c11ed2a7c548de97ed3ea0730a9251/users/8a0fda9a48cb42cb8504bd361b8b4465/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:47:46.802202 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb6f6d-0d09-4786-95bb-9cc55540fba8 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:46.838246 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4221c4f-f3ce-4ba3-ba3a-647b4a1f6bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:46.838915 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4221c4f-f3ce-4ba3-ba3a-647b4a1f6bea None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:46.839208 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4221c4f-f3ce-4ba3-ba3a-647b4a1f6bea None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:46.839491 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4221c4f-f3ce-4ba3-ba3a-647b4a1f6bea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:46.915259 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4221c4f-f3ce-4ba3-ba3a-647b4a1f6bea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:46.916829 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4221c4f-f3ce-4ba3-ba3a-647b4a1f6bea None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:47.037850 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 71/135] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:47:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:47:47.043302 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5dc39b-a745-4ade-9d8e-10800ea4f6f8 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:47.194304 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5dc39b-a745-4ade-9d8e-10800ea4f6f8 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:47.237189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356bb257-feea-4d45-887b-13b4cc8c1191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:47.238084 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356bb257-feea-4d45-887b-13b4cc8c1191 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:47.238370 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356bb257-feea-4d45-887b-13b4cc8c1191 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:47.238643 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356bb257-feea-4d45-887b-13b4cc8c1191 None admin] PATH_INFO: `/v3/projects/9431599023b44f1cb5dfb8bca0584f5f` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:47.242530 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356bb257-feea-4d45-887b-13b4cc8c1191 None admin] RBAC: Authorizing `identity:get_project(project_id=9431599023b44f1cb5dfb8bca0584f5f)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:47.244004 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356bb257-feea-4d45-887b-13b4cc8c1191 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:47.245697 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 65/136] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:47:47 2022] GET /identity/v3/projects/9431599023b44f1cb5dfb8bca0584f5f => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:47.251920 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4221c4f-f3ce-4ba3-ba3a-647b4a1f6bea None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:47.366823 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce87a4-cebd-4430-b4b7-dfa882f070e8 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:47.367111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce87a4-cebd-4430-b4b7-dfa882f070e8 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:47.367302 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce87a4-cebd-4430-b4b7-dfa882f070e8 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:47.368956 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 66/137] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:47:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:47:47.387287 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606195e0-c3c9-42f8-84ca-189b64ebbdac None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:47.387598 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606195e0-c3c9-42f8-84ca-189b64ebbdac None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:47.387864 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606195e0-c3c9-42f8-84ca-189b64ebbdac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:47.410233 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4221c4f-f3ce-4ba3-ba3a-647b4a1f6bea None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:47.426816 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-606195e0-c3c9-42f8-84ca-189b64ebbdac None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:47:47.428049 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-606195e0-c3c9-42f8-84ca-189b64ebbdac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:47:47.445437 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7fe423-da9b-4648-af8d-e31edcf9e1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:47.446154 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fe423-da9b-4648-af8d-e31edcf9e1e4 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:47.446438 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fe423-da9b-4648-af8d-e31edcf9e1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:47.446718 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fe423-da9b-4648-af8d-e31edcf9e1e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:47.447573 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7fe423-da9b-4648-af8d-e31edcf9e1e4 None admin] RBAC: Adding query filter params (role.id=df4ebd23bc804a629fbb7b2dad89c96a, scope.project.id=9431599023b44f1cb5dfb8bca0584f5f, user.id=baa6d4cbf2ca472a81b7e44df021f0c0) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:47:47.447888 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7fe423-da9b-4648-af8d-e31edcf9e1e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:47.449397 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7fe423-da9b-4648-af8d-e31edcf9e1e4 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:47.456595 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 72/138] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:47:47 2022] GET /identity/v3/role_assignments?user.id=baa6d4cbf2ca472a81b7e44df021f0c0&scope.project.id=9431599023b44f1cb5dfb8bca0584f5f&role.id=df4ebd23bc804a629fbb7b2dad89c96a => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:47.549687 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 67/139] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:47:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:47:47.596030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7fe423-da9b-4648-af8d-e31edcf9e1e4 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:47.744508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7fe423-da9b-4648-af8d-e31edcf9e1e4 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:47.790547 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9602657-94f8-4c31-b8e7-75da7e637454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:47.791695 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9602657-94f8-4c31-b8e7-75da7e637454 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:47.792188 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9602657-94f8-4c31-b8e7-75da7e637454 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:47.792668 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9602657-94f8-4c31-b8e7-75da7e637454 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:47.807829 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9602657-94f8-4c31-b8e7-75da7e637454 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:47:47.816284 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-e9602657-94f8-4c31-b8e7-75da7e637454 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:47:47.816284 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:47:47.816284 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:47:47.816284 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:47:47.816284 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:47:47.816284 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:47:47.816284 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:47:47.816284 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:47:47.816284 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:47:47.816284 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:47:47.816284 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:47:47.816284 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:47:47.816284 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:47:47.816284 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:47:47.816284 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:47:47.816284 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:47:47.817120 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:47:47.817120 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:47:47.817120 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:47:47.817120 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:47:47.817120 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:47:47.817120 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:47:47.817120 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:47:47.817120 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:47:47.817120 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:47:47.817120 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:47:47.817120 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:47:47.817120 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:47:47.817120 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:47:47.817120 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:47:47.817120 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:47:47.817120 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:47:47.817886 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:47:47.817886 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:47:47.817886 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:47:47.817886 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:47:47.817886 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:47:47.817886 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:47:47.817886 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:47:47.817886 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:47:47.817886 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:47:47.817886 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:47:47.817886 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:47:47.817886 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:47:47.820454 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 73/140] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:47:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:47:47.826032 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606195e0-c3c9-42f8-84ca-189b64ebbdac None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:47.951582 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606195e0-c3c9-42f8-84ca-189b64ebbdac None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:47.993541 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b6ca1-ed68-4c17-b688-78383be50ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:47.994639 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b6ca1-ed68-4c17-b688-78383be50ec0 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:47.995130 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b6ca1-ed68-4c17-b688-78383be50ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:47.995611 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b6ca1-ed68-4c17-b688-78383be50ec0 None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:47.996543 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b6ca1-ed68-4c17-b688-78383be50ec0 None admin] RBAC: Adding query filter params (name=member) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:47:47.997057 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b6ca1-ed68-4c17-b688-78383be50ec0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:47.998661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b6ca1-ed68-4c17-b688-78383be50ec0 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:48.013068 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 68/141] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Apr 30 20:47:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:48.018767 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9602657-94f8-4c31-b8e7-75da7e637454 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:48.141219 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9602657-94f8-4c31-b8e7-75da7e637454 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:48.186028 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b062b-2506-46c5-8c5a-cc9437ce7aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:48.187796 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b062b-2506-46c5-8c5a-cc9437ce7aa5 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:48.188274 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b062b-2506-46c5-8c5a-cc9437ce7aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:48.188778 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b062b-2506-46c5-8c5a-cc9437ce7aa5 None admin] PATH_INFO: `/v3/users/8a0fda9a48cb42cb8504bd361b8b4465` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:48.194463 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b062b-2506-46c5-8c5a-cc9437ce7aa5 None admin] RBAC: Authorizing `identity:get_user(user_id=8a0fda9a48cb42cb8504bd361b8b4465)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:48.196141 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b062b-2506-46c5-8c5a-cc9437ce7aa5 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:48.197995 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 74/142] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:47:48 2022] GET /identity/v3/users/8a0fda9a48cb42cb8504bd361b8b4465 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:48.203625 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b6ca1-ed68-4c17-b688-78383be50ec0 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:48.326410 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b6ca1-ed68-4c17-b688-78383be50ec0 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:48.362733 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee28a1-2da0-4664-aa56-b1c4aadf87ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:48.363449 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee28a1-2da0-4664-aa56-b1c4aadf87ed None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:48.363736 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee28a1-2da0-4664-aa56-b1c4aadf87ed None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:48.364018 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee28a1-2da0-4664-aa56-b1c4aadf87ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:48.432339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee28a1-2da0-4664-aa56-b1c4aadf87ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:48.433853 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee28a1-2da0-4664-aa56-b1c4aadf87ed None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:48.541979 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 69/143] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:47:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:47:48.542162 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b062b-2506-46c5-8c5a-cc9437ce7aa5 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:48.612147 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e6571-a151-4d08-8e6c-f3ddcc7ec5ad None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:48.612432 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e6571-a151-4d08-8e6c-f3ddcc7ec5ad None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:48.613405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e6571-a151-4d08-8e6c-f3ddcc7ec5ad None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:48.615919 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 70/144] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:47:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:47:48.621324 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d51746-78d2-45e3-ae1b-b99b9fb0ff16 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:48.621932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d51746-78d2-45e3-ae1b-b99b9fb0ff16 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:48.622579 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d51746-78d2-45e3-ae1b-b99b9fb0ff16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:48.647302 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-94d51746-78d2-45e3-ae1b-b99b9fb0ff16 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:47:48.649320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-94d51746-78d2-45e3-ae1b-b99b9fb0ff16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:47:48.740140 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 71/145] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:47:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:47:48.751901 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b062b-2506-46c5-8c5a-cc9437ce7aa5 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:48.791280 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d51746-78d2-45e3-ae1b-b99b9fb0ff16 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:48.830569 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa255e-e7e0-43e5-bd40-f7865cafd3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:48.831663 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa255e-e7e0-43e5-bd40-f7865cafd3c4 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:48.832131 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa255e-e7e0-43e5-bd40-f7865cafd3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:48.832597 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa255e-e7e0-43e5-bd40-f7865cafd3c4 None admin] PATH_INFO: `/v3/projects/9431599023b44f1cb5dfb8bca0584f5f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:48.834067 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fa255e-e7e0-43e5-bd40-f7865cafd3c4 None admin] RBAC: Authorizing `identity:get_project(project_id=9431599023b44f1cb5dfb8bca0584f5f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:48.835700 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fa255e-e7e0-43e5-bd40-f7865cafd3c4 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:48.837570 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 75/146] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:47:48 2022] GET /identity/v3/projects/9431599023b44f1cb5dfb8bca0584f5f => generated 298 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:48.870451 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa255e-e7e0-43e5-bd40-f7865cafd3c4 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:48.928285 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d51746-78d2-45e3-ae1b-b99b9fb0ff16 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:48.968659 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bde994-544b-4eea-a1da-bf73513b7eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:48.970829 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bde994-544b-4eea-a1da-bf73513b7eca None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:48.971355 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bde994-544b-4eea-a1da-bf73513b7eca None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:48.971775 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bde994-544b-4eea-a1da-bf73513b7eca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:48.983879 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bde994-544b-4eea-a1da-bf73513b7eca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:47:48.992570 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-96bde994-544b-4eea-a1da-bf73513b7eca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:47:48.992570 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:47:48.992570 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:47:48.992570 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:47:48.992570 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:47:48.992570 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:47:48.992570 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:47:48.992570 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:47:48.992570 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:47:48.992570 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:47:48.992570 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:47:48.992570 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:47:48.992570 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:47:48.992570 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:47:48.992570 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:47:48.992570 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:47:48.993464 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:47:48.993464 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:47:48.993464 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:47:48.993464 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:47:48.993464 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:47:48.993464 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:47:48.993464 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:47:48.993464 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:47:48.993464 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:47:48.993464 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:47:48.993464 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:47:48.993464 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:47:48.993464 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:47:48.993464 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:47:48.993464 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:47:48.993464 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:47:48.994273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:47:48.994273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:47:48.994273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:47:48.994273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:47:48.994273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:47:48.994273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:47:48.994273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:47:48.994273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:47:48.994273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:47:48.994273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:47:48.994273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:47:48.994273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:47:48.996812 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 72/147] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Apr 30 20:47:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:47:49.002590 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bde994-544b-4eea-a1da-bf73513b7eca None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:49.054082 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa255e-e7e0-43e5-bd40-f7865cafd3c4 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:49.098636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788a3bb-3639-4687-a9c6-4f7bef561793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:49.099406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788a3bb-3639-4687-a9c6-4f7bef561793 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:49.100091 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788a3bb-3639-4687-a9c6-4f7bef561793 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:49.100091 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788a3bb-3639-4687-a9c6-4f7bef561793 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:49.101129 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c788a3bb-3639-4687-a9c6-4f7bef561793 None admin] RBAC: Adding query filter params (role.id=9f25fed676d84770b9dc2a96a769de28, scope.project.id=9431599023b44f1cb5dfb8bca0584f5f, user.id=8a0fda9a48cb42cb8504bd361b8b4465) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:47:49.101662 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c788a3bb-3639-4687-a9c6-4f7bef561793 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:49.103204 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c788a3bb-3639-4687-a9c6-4f7bef561793 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:49.118832 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 76/148] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:47:48 2022] GET /identity/v3/role_assignments?user.id=8a0fda9a48cb42cb8504bd361b8b4465&scope.project.id=9431599023b44f1cb5dfb8bca0584f5f&role.id=9f25fed676d84770b9dc2a96a769de28 => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:49.147096 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bde994-544b-4eea-a1da-bf73513b7eca None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:49.196091 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ffa2ec-0117-4905-9807-b45e411f47b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:49.198965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffa2ec-0117-4905-9807-b45e411f47b3 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:49.198965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffa2ec-0117-4905-9807-b45e411f47b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:49.198965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffa2ec-0117-4905-9807-b45e411f47b3 None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:49.198965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ffa2ec-0117-4905-9807-b45e411f47b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:47:49.198965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ffa2ec-0117-4905-9807-b45e411f47b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:49.200632 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ffa2ec-0117-4905-9807-b45e411f47b3 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:49.215191 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 73/149] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:47:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:47:49.221443 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788a3bb-3639-4687-a9c6-4f7bef561793 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:49.339109 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788a3bb-3639-4687-a9c6-4f7bef561793 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:49.379021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f58f89a-7530-4ee5-bf94-2238d9884199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:49.379845 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58f89a-7530-4ee5-bf94-2238d9884199 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:49.380130 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58f89a-7530-4ee5-bf94-2238d9884199 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:49.380407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58f89a-7530-4ee5-bf94-2238d9884199 None admin] PATH_INFO: `/v3/users/53a451439fd64d8ca37cd0e229eb98e1` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:49.382174 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f58f89a-7530-4ee5-bf94-2238d9884199 None admin] RBAC: Authorizing `identity:get_user(user_id=53a451439fd64d8ca37cd0e229eb98e1)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:49.384928 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f58f89a-7530-4ee5-bf94-2238d9884199 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:49.388681 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 77/150] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:47:49 2022] GET /identity/v3/users/53a451439fd64d8ca37cd0e229eb98e1 => generated 247 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:49.394838 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ffa2ec-0117-4905-9807-b45e411f47b3 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:49.506014 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ffa2ec-0117-4905-9807-b45e411f47b3 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:49.546792 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fff0fa-ee86-4aa0-a0b5-3a90dd643d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:49.547818 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fff0fa-ee86-4aa0-a0b5-3a90dd643d44 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:49.548301 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fff0fa-ee86-4aa0-a0b5-3a90dd643d44 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:49.548774 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fff0fa-ee86-4aa0-a0b5-3a90dd643d44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:49.620244 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fff0fa-ee86-4aa0-a0b5-3a90dd643d44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:49.622113 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fff0fa-ee86-4aa0-a0b5-3a90dd643d44 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:49.723856 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 74/151] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:47:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:47:49.730852 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f58f89a-7530-4ee5-bf94-2238d9884199 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:49.867500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f58f89a-7530-4ee5-bf94-2238d9884199 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:49.917683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9381b5-22f3-4d33-8f5d-a12b07c70811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:49.918877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9381b5-22f3-4d33-8f5d-a12b07c70811 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:49.919310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9381b5-22f3-4d33-8f5d-a12b07c70811 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:49.919735 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9381b5-22f3-4d33-8f5d-a12b07c70811 None admin] PATH_INFO: `/v3/projects/9431599023b44f1cb5dfb8bca0584f5f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:49.926781 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9381b5-22f3-4d33-8f5d-a12b07c70811 None admin] RBAC: Authorizing `identity:get_project(project_id=9431599023b44f1cb5dfb8bca0584f5f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:49.928547 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9381b5-22f3-4d33-8f5d-a12b07c70811 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:49.930713 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 78/152] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:47:49 2022] GET /identity/v3/projects/9431599023b44f1cb5dfb8bca0584f5f => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:49.937022 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fff0fa-ee86-4aa0-a0b5-3a90dd643d44 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:50.084428 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fff0fa-ee86-4aa0-a0b5-3a90dd643d44 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:50.135753 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62088906-9b7e-4c4c-b84a-fde769d31c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:50.136422 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62088906-9b7e-4c4c-b84a-fde769d31c06 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:50.136709 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62088906-9b7e-4c4c-b84a-fde769d31c06 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:50.136991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62088906-9b7e-4c4c-b84a-fde769d31c06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:50.137852 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62088906-9b7e-4c4c-b84a-fde769d31c06 None admin] RBAC: Adding query filter params (role.id=30112eb1f3e047398c3c82fb40b72e62, scope.project.id=9431599023b44f1cb5dfb8bca0584f5f, user.id=53a451439fd64d8ca37cd0e229eb98e1) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:47:50.138172 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62088906-9b7e-4c4c-b84a-fde769d31c06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:50.139669 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62088906-9b7e-4c4c-b84a-fde769d31c06 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:50.150581 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 75/153] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:47:49 2022] GET /identity/v3/role_assignments?user.id=53a451439fd64d8ca37cd0e229eb98e1&scope.project.id=9431599023b44f1cb5dfb8bca0584f5f&role.id=30112eb1f3e047398c3c82fb40b72e62 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:50.197882 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ddf46-477d-4f77-8f59-8d3a7c62a7af None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:50.198515 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ddf46-477d-4f77-8f59-8d3a7c62a7af None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:50.198987 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ddf46-477d-4f77-8f59-8d3a7c62a7af None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:50.200639 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 79/154] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:47:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:47:50.207232 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562f50a-62a9-4f7a-943a-f3b05d0dda02 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:50.207528 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562f50a-62a9-4f7a-943a-f3b05d0dda02 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:50.207821 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562f50a-62a9-4f7a-943a-f3b05d0dda02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:50.234326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-7562f50a-62a9-4f7a-943a-f3b05d0dda02 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:47:50.235580 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7562f50a-62a9-4f7a-943a-f3b05d0dda02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:47:50.341894 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 76/155] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:47:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:47:50.363895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2add670-2e36-4526-9837-739742e756fa None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:50.364504 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2add670-2e36-4526-9837-739742e756fa None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:50.364978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2add670-2e36-4526-9837-739742e756fa None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:50.366604 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 80/156] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:47:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:47:50.372357 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f957730-9e0f-49f7-8db3-cbef8de90b89 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:50.372642 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f957730-9e0f-49f7-8db3-cbef8de90b89 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:50.372935 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f957730-9e0f-49f7-8db3-cbef8de90b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:50.384169 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2add670-2e36-4526-9837-739742e756fa None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:50.395248 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-3f957730-9e0f-49f7-8db3-cbef8de90b89 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:47:50.396462 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3f957730-9e0f-49f7-8db3-cbef8de90b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:47:50.467538 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 77/157] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:47:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:47:50.494734 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f957730-9e0f-49f7-8db3-cbef8de90b89 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:50.510942 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2add670-2e36-4526-9837-739742e756fa None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:50.553439 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471e65b-1f08-4ca0-9424-38045ea47ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:50.554812 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471e65b-1f08-4ca0-9424-38045ea47ee2 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:50.555326 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471e65b-1f08-4ca0-9424-38045ea47ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:50.555801 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471e65b-1f08-4ca0-9424-38045ea47ee2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:50.557247 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7471e65b-1f08-4ca0-9424-38045ea47ee2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:50.559188 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7471e65b-1f08-4ca0-9424-38045ea47ee2 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:50.561242 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 81/158] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:47:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:47:50.567327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471e65b-1f08-4ca0-9424-38045ea47ee2 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:50.621604 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f957730-9e0f-49f7-8db3-cbef8de90b89 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:50.664302 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d01b7-d0c1-4843-ac81-e4d04f263403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:50.665453 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d01b7-d0c1-4843-ac81-e4d04f263403 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:50.665453 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d01b7-d0c1-4843-ac81-e4d04f263403 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:50.665648 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d01b7-d0c1-4843-ac81-e4d04f263403 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:50.678960 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d01b7-d0c1-4843-ac81-e4d04f263403 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:47:50.687845 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-870d01b7-d0c1-4843-ac81-e4d04f263403 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:47:50.687845 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:47:50.687845 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:47:50.687845 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:47:50.687845 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:47:50.687845 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:47:50.687845 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:47:50.687845 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:47:50.687845 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:47:50.687845 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:47:50.687845 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:47:50.687845 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:47:50.687845 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:47:50.687845 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:47:50.687845 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:47:50.687845 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:47:50.688744 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:47:50.688744 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:47:50.688744 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:47:50.688744 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:47:50.688744 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:47:50.688744 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:47:50.688744 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:47:50.688744 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:47:50.688744 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:47:50.688744 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:47:50.688744 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:47:50.688744 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:47:50.688744 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:47:50.688744 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:47:50.688744 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:47:50.688744 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:47:50.689723 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:47:50.689723 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:47:50.689723 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:47:50.689723 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:47:50.689723 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:47:50.689723 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:47:50.689723 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:47:50.689723 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:47:50.689723 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:47:50.689723 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:47:50.689723 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:47:50.689723 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:47:50.690464 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471e65b-1f08-4ca0-9424-38045ea47ee2 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:50.698418 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 78/159] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:47:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:47:50.698418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01577457-c370-47a0-a209-5e5a03a61ef6 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:50.698418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01577457-c370-47a0-a209-5e5a03a61ef6 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:50.698418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01577457-c370-47a0-a209-5e5a03a61ef6 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:50.698418 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 79/160] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:47:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:47:50.701806 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01577457-c370-47a0-a209-5e5a03a61ef6 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:50.727640 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e969294d-c7fc-4df1-b45a-cfd097d0d88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:50.728311 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969294d-c7fc-4df1-b45a-cfd097d0d88b None admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:50.728587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969294d-c7fc-4df1-b45a-cfd097d0d88b None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:50.728868 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969294d-c7fc-4df1-b45a-cfd097d0d88b None admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:50.729556 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e969294d-c7fc-4df1-b45a-cfd097d0d88b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:50.731105 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e969294d-c7fc-4df1-b45a-cfd097d0d88b None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:50.804416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01577457-c370-47a0-a209-5e5a03a61ef6 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:50.836786 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91770a-39ce-4b99-8d59-6a3da9447da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:50.837198 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 82/161] 10.222.0.23 () {60 vars in 1132 bytes} [Sat Apr 30 20:47:50 2022] POST /identity/v3/users => generated 283 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:47:50.838480 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5b8f3-4cb2-4f27-9d08-4aeff324dd23 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:50.838772 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5b8f3-4cb2-4f27-9d08-4aeff324dd23 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:50.839048 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5b8f3-4cb2-4f27-9d08-4aeff324dd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:50.846150 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91770a-39ce-4b99-8d59-6a3da9447da2 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:50.846551 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91770a-39ce-4b99-8d59-6a3da9447da2 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:50.846844 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91770a-39ce-4b99-8d59-6a3da9447da2 None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:50.847677 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91770a-39ce-4b99-8d59-6a3da9447da2 None admin] RBAC: Adding query filter params (name=member) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:47:50.848043 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91770a-39ce-4b99-8d59-6a3da9447da2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:50.849536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91770a-39ce-4b99-8d59-6a3da9447da2 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:50.856700 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-3cb5b8f3-4cb2-4f27-9d08-4aeff324dd23 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:47:50.857979 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3cb5b8f3-4cb2-4f27-9d08-4aeff324dd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:47:50.860753 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 80/162] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Apr 30 20:47:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:47:50.863240 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310e756-9612-4d63-ac34-ccd76f2b25f3 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:50.863533 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310e756-9612-4d63-ac34-ccd76f2b25f3 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:50.863812 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310e756-9612-4d63-ac34-ccd76f2b25f3 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:50.869995 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 81/163] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:47:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:47:50.870866 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f310e756-9612-4d63-ac34-ccd76f2b25f3 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:50.934597 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 83/164] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:47:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:47:50.935833 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edcdcc-03ae-4c59-8c20-9f0b8f80db41 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:50.936119 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edcdcc-03ae-4c59-8c20-9f0b8f80db41 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:50.936914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edcdcc-03ae-4c59-8c20-9f0b8f80db41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:50.960825 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-41edcdcc-03ae-4c59-8c20-9f0b8f80db41 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:47:50.962662 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-41edcdcc-03ae-4c59-8c20-9f0b8f80db41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:47:50.982146 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f310e756-9612-4d63-ac34-ccd76f2b25f3 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:51.022995 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d55dd-7244-4f35-855e-b8cc83e5a748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:51.023891 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d55dd-7244-4f35-855e-b8cc83e5a748 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:51.024174 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d55dd-7244-4f35-855e-b8cc83e5a748 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:51.024477 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d55dd-7244-4f35-855e-b8cc83e5a748 None admin] PATH_INFO: `/v3/users/8a0fda9a48cb42cb8504bd361b8b4465` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:51.025702 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d55dd-7244-4f35-855e-b8cc83e5a748 None admin] RBAC: Authorizing `identity:get_user(user_id=8a0fda9a48cb42cb8504bd361b8b4465)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:51.027193 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d55dd-7244-4f35-855e-b8cc83e5a748 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:51.033382 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 82/165] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:47:50 2022] GET /identity/v3/users/8a0fda9a48cb42cb8504bd361b8b4465 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:47:51.033382 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d55dd-7244-4f35-855e-b8cc83e5a748 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:51.043999 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 84/166] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:47:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:47:51.046355 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edcdcc-03ae-4c59-8c20-9f0b8f80db41 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:51.142916 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d55dd-7244-4f35-855e-b8cc83e5a748 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:51.152040 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edcdcc-03ae-4c59-8c20-9f0b8f80db41 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:51.196688 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9056e2-b59f-4e91-9883-dbccc99b016b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:51.197523 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9056e2-b59f-4e91-9883-dbccc99b016b None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:51.197838 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9056e2-b59f-4e91-9883-dbccc99b016b None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:51.204121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9056e2-b59f-4e91-9883-dbccc99b016b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:51.204262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf97325-209b-4662-8a9e-cae7df23ba9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:51.204262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf97325-209b-4662-8a9e-cae7df23ba9a None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:51.204262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf97325-209b-4662-8a9e-cae7df23ba9a None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:51.204262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf97325-209b-4662-8a9e-cae7df23ba9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:51.213865 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9056e2-b59f-4e91-9883-dbccc99b016b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:47:51.223238 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-7f9056e2-b59f-4e91-9883-dbccc99b016b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:47:51.223238 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:47:51.223238 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:47:51.223238 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:47:51.223238 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:47:51.223238 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:47:51.223238 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:47:51.223238 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:47:51.223238 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:47:51.223238 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:47:51.223238 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:47:51.223238 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:47:51.223238 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:47:51.223238 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:47:51.223238 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:47:51.223238 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:47:51.224127 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:47:51.224127 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:47:51.224127 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:47:51.224127 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:47:51.224127 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:47:51.224127 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:47:51.224127 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:47:51.224127 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:47:51.224127 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:47:51.224127 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:47:51.224127 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:47:51.224127 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:47:51.224127 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:47:51.224127 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:47:51.224127 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:47:51.224127 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:47:51.224885 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:47:51.224885 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:47:51.224885 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:47:51.224885 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:47:51.224885 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:47:51.224885 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:47:51.224885 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:47:51.224885 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:47:51.224885 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:47:51.224885 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:47:51.224885 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:47:51.224885 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:47:51.224885 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 83/167] 10.222.0.23 () {56 vars in 1114 bytes} [Sat Apr 30 20:47:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:47:51.225696 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9056e2-b59f-4e91-9883-dbccc99b016b None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:51.288854 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf97325-209b-4662-8a9e-cae7df23ba9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:51.288854 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf97325-209b-4662-8a9e-cae7df23ba9a None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:51.340092 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9056e2-b59f-4e91-9883-dbccc99b016b None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:51.390183 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a03bc-a24f-4b75-885c-89cb74edf862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:51.391219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a03bc-a24f-4b75-885c-89cb74edf862 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:51.391626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a03bc-a24f-4b75-885c-89cb74edf862 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:51.392043 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a03bc-a24f-4b75-885c-89cb74edf862 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:51.403250 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a03bc-a24f-4b75-885c-89cb74edf862 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:47:51.411484 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-986a03bc-a24f-4b75-885c-89cb74edf862 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 30 20:47:51.411484 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:47:51.411484 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:47:51.411484 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:47:51.411484 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:47:51.411484 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:47:51.411484 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:47:51.411484 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:47:51.411484 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:47:51.411484 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:47:51.411484 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:47:51.411484 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:47:51.411484 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:47:51.411484 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:47:51.411484 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:47:51.411484 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:47:51.412377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:47:51.412377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:47:51.412377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:47:51.412377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:47:51.412377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:47:51.412377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:47:51.412377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:47:51.412377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:47:51.412377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:47:51.412377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:47:51.412377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:47:51.412377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:47:51.412377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:47:51.412377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:47:51.412377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:47:51.412377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:47:51.413177 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:47:51.413177 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:47:51.413177 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:47:51.413177 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:47:51.413177 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:47:51.413177 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:47:51.413177 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:47:51.413177 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:47:51.413177 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:47:51.413177 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:47:51.413177 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Apr 30 20:47:51.413177 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:47:51.413177 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 84/168] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:47:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:47:51.413936 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a03bc-a24f-4b75-885c-89cb74edf862 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:51.419632 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 85/169] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:47:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:47:51.420734 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf97325-209b-4662-8a9e-cae7df23ba9a None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:51.564750 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a03bc-a24f-4b75-885c-89cb74edf862 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:51.584023 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf97325-209b-4662-8a9e-cae7df23ba9a None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:51.619671 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d8f2f-2cb1-4246-a725-fbda71246ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:51.620585 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d8f2f-2cb1-4246-a725-fbda71246ba2 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:51.621041 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d8f2f-2cb1-4246-a725-fbda71246ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:51.621640 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d8f2f-2cb1-4246-a725-fbda71246ba2 None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:51.623274 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056d8f2f-2cb1-4246-a725-fbda71246ba2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:47:51.623730 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056d8f2f-2cb1-4246-a725-fbda71246ba2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:51.625983 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056d8f2f-2cb1-4246-a725-fbda71246ba2 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:51.635118 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 85/170] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:47:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:51.636560 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d8f2f-2cb1-4246-a725-fbda71246ba2 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:51.663367 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e79dbe-51b6-47ce-850a-197b0de6b384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:51.664040 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e79dbe-51b6-47ce-850a-197b0de6b384 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:51.664316 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e79dbe-51b6-47ce-850a-197b0de6b384 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:51.664583 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e79dbe-51b6-47ce-850a-197b0de6b384 None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:51.665413 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e79dbe-51b6-47ce-850a-197b0de6b384 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:47:51.665624 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e79dbe-51b6-47ce-850a-197b0de6b384 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:51.667032 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e79dbe-51b6-47ce-850a-197b0de6b384 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:51.685092 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 86/171] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Apr 30 20:47:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:51.685868 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e79dbe-51b6-47ce-850a-197b0de6b384 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:51.750956 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d8f2f-2cb1-4246-a725-fbda71246ba2 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:51.789447 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e59a4-73fa-40ec-8723-3de4aeaddc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:51.790772 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e59a4-73fa-40ec-8723-3de4aeaddc6e None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:51.791259 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e59a4-73fa-40ec-8723-3de4aeaddc6e None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:51.791732 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e59a4-73fa-40ec-8723-3de4aeaddc6e None admin] PATH_INFO: `/v3/projects/a9c11ed2a7c548de97ed3ea0730a9251` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:51.793122 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e59a4-73fa-40ec-8723-3de4aeaddc6e None admin] RBAC: Authorizing `identity:get_project(project_id=a9c11ed2a7c548de97ed3ea0730a9251)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:51.794825 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e59a4-73fa-40ec-8723-3de4aeaddc6e None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:51.797517 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 86/172] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:47:51 2022] GET /identity/v3/projects/a9c11ed2a7c548de97ed3ea0730a9251 => generated 312 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:51.798645 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e59a4-73fa-40ec-8723-3de4aeaddc6e None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:51.908522 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e59a4-73fa-40ec-8723-3de4aeaddc6e None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:51.909407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e79dbe-51b6-47ce-850a-197b0de6b384 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:51.946157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0739b-46c2-4d29-94e6-d0f3e5e16379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:51.947447 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0739b-46c2-4d29-94e6-d0f3e5e16379 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:51.947930 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0739b-46c2-4d29-94e6-d0f3e5e16379 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:51.948404 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0739b-46c2-4d29-94e6-d0f3e5e16379 None admin] PATH_INFO: `/v3/users/baa6d4cbf2ca472a81b7e44df021f0c0` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:51.949830 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d0739b-46c2-4d29-94e6-d0f3e5e16379 None admin] RBAC: Authorizing `identity:get_user(user_id=baa6d4cbf2ca472a81b7e44df021f0c0)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:51.951588 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d0739b-46c2-4d29-94e6-d0f3e5e16379 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:51.953986 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 87/173] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:47:51 2022] GET /identity/v3/users/baa6d4cbf2ca472a81b7e44df021f0c0 => generated 289 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:51.955156 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0739b-46c2-4d29-94e6-d0f3e5e16379 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:51.961831 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5bdc7d-5771-4fce-9773-a4476b1aacf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:51.962715 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bdc7d-5771-4fce-9773-a4476b1aacf9 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:51.963103 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bdc7d-5771-4fce-9773-a4476b1aacf9 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:51.963387 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bdc7d-5771-4fce-9773-a4476b1aacf9 None admin] PATH_INFO: `/v3/users/8a0fda9a48cb42cb8504bd361b8b4465` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:51.970825 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5bdc7d-5771-4fce-9773-a4476b1aacf9 None admin] RBAC: Authorizing `identity:get_user(user_id=8a0fda9a48cb42cb8504bd361b8b4465)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:51.972305 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5bdc7d-5771-4fce-9773-a4476b1aacf9 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:51.974383 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 87/174] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:47:51 2022] GET /identity/v3/users/8a0fda9a48cb42cb8504bd361b8b4465 => generated 275 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:51.975195 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5bdc7d-5771-4fce-9773-a4476b1aacf9 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:52.057918 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0739b-46c2-4d29-94e6-d0f3e5e16379 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:52.092128 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea90e9f-50e9-483d-aebd-d8e30bab23f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:52.093145 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea90e9f-50e9-483d-aebd-d8e30bab23f9 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:52.093630 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea90e9f-50e9-483d-aebd-d8e30bab23f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:52.094160 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea90e9f-50e9-483d-aebd-d8e30bab23f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:52.095443 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea90e9f-50e9-483d-aebd-d8e30bab23f9 None admin] RBAC: Adding query filter params (role.id=9f25fed676d84770b9dc2a96a769de28, scope.project.id=a9c11ed2a7c548de97ed3ea0730a9251, user.id=8a0fda9a48cb42cb8504bd361b8b4465) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:47:52.095956 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea90e9f-50e9-483d-aebd-d8e30bab23f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:52.097601 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea90e9f-50e9-483d-aebd-d8e30bab23f9 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:52.103856 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 88/175] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:47:51 2022] GET /identity/v3/role_assignments?user.id=8a0fda9a48cb42cb8504bd361b8b4465&scope.project.id=a9c11ed2a7c548de97ed3ea0730a9251&role.id=9f25fed676d84770b9dc2a96a769de28 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:52.104918 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea90e9f-50e9-483d-aebd-d8e30bab23f9 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:52.172174 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5bdc7d-5771-4fce-9773-a4476b1aacf9 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:52.212221 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea90e9f-50e9-483d-aebd-d8e30bab23f9 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:52.248370 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cceb84-742c-447d-8e2b-a96f4d8fb928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:52.249940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cceb84-742c-447d-8e2b-a96f4d8fb928 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:52.250695 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cceb84-742c-447d-8e2b-a96f4d8fb928 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:52.251271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cceb84-742c-447d-8e2b-a96f4d8fb928 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:52.254560 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fddcfbc-96da-478f-8120-63aa23677450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:52.255458 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddcfbc-96da-478f-8120-63aa23677450 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:52.255740 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddcfbc-96da-478f-8120-63aa23677450 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:52.256030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddcfbc-96da-478f-8120-63aa23677450 None admin] PATH_INFO: `/v3/projects/9431599023b44f1cb5dfb8bca0584f5f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:52.257910 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fddcfbc-96da-478f-8120-63aa23677450 None admin] RBAC: Authorizing `identity:get_project(project_id=9431599023b44f1cb5dfb8bca0584f5f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:52.259398 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fddcfbc-96da-478f-8120-63aa23677450 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:52.261165 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 88/176] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:47:51 2022] GET /identity/v3/projects/9431599023b44f1cb5dfb8bca0584f5f => generated 298 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:52.268290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fddcfbc-96da-478f-8120-63aa23677450 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:52.331439 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cceb84-742c-447d-8e2b-a96f4d8fb928 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:52.333327 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cceb84-742c-447d-8e2b-a96f4d8fb928 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:52.438157 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 89/177] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:47:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:47:52.443710 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cceb84-742c-447d-8e2b-a96f4d8fb928 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:52.485427 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fddcfbc-96da-478f-8120-63aa23677450 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:52.547368 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3b9f0-217a-4b88-8be2-ffcf0f67afef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:52.548661 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3b9f0-217a-4b88-8be2-ffcf0f67afef None admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:52.549177 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3b9f0-217a-4b88-8be2-ffcf0f67afef None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:52.549652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3b9f0-217a-4b88-8be2-ffcf0f67afef None admin] PATH_INFO: `/v3/projects/9431599023b44f1cb5dfb8bca0584f5f/users/baa6d4cbf2ca472a81b7e44df021f0c0/roles/df4ebd23bc804a629fbb7b2dad89c96a` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:52.553144 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3b9f0-217a-4b88-8be2-ffcf0f67afef None admin] RBAC: Authorizing `identity:create_grant(project_id=9431599023b44f1cb5dfb8bca0584f5f, user_id=baa6d4cbf2ca472a81b7e44df021f0c0, role_id=df4ebd23bc804a629fbb7b2dad89c96a)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:52.554842 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3b9f0-217a-4b88-8be2-ffcf0f67afef None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:52.608048 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cceb84-742c-447d-8e2b-a96f4d8fb928 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:52.646969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4ab21-03d4-4109-976b-366d61f21261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:52.648665 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4ab21-03d4-4109-976b-366d61f21261 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:52.649153 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4ab21-03d4-4109-976b-366d61f21261 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:52.649627 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4ab21-03d4-4109-976b-366d61f21261 None admin] PATH_INFO: `/v3/projects/9431599023b44f1cb5dfb8bca0584f5f` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:52.651090 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf4ab21-03d4-4109-976b-366d61f21261 None admin] RBAC: Authorizing `identity:get_project(project_id=9431599023b44f1cb5dfb8bca0584f5f)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:52.652881 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf4ab21-03d4-4109-976b-366d61f21261 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:52.654884 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 90/178] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:47:52 2022] GET /identity/v3/projects/9431599023b44f1cb5dfb8bca0584f5f => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:52.666968 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 89/179] 10.222.0.23 () {58 vars in 1439 bytes} [Sat Apr 30 20:47:52 2022] PUT /identity/v3/projects/9431599023b44f1cb5dfb8bca0584f5f/users/baa6d4cbf2ca472a81b7e44df021f0c0/roles/df4ebd23bc804a629fbb7b2dad89c96a => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 20:47:52.667656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4ab21-03d4-4109-976b-366d61f21261 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:52.778171 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4ab21-03d4-4109-976b-366d61f21261 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:52.816424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f23fb-247c-43ea-b690-a0424848fada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:52.817452 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f23fb-247c-43ea-b690-a0424848fada None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:52.817970 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f23fb-247c-43ea-b690-a0424848fada None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:52.818469 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f23fb-247c-43ea-b690-a0424848fada None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:52.819510 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081f23fb-247c-43ea-b690-a0424848fada None admin] RBAC: Adding query filter params (role.id=121b12a250ae4ef8ae1a85ea8c21c4fa, scope.project.id=9431599023b44f1cb5dfb8bca0584f5f, user.id=8a0fda9a48cb42cb8504bd361b8b4465) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:47:52.820050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081f23fb-247c-43ea-b690-a0424848fada None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:52.821803 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081f23fb-247c-43ea-b690-a0424848fada None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:52.828854 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 91/180] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:47:52 2022] GET /identity/v3/role_assignments?user.id=8a0fda9a48cb42cb8504bd361b8b4465&scope.project.id=9431599023b44f1cb5dfb8bca0584f5f&role.id=121b12a250ae4ef8ae1a85ea8c21c4fa => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:47:53.672281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4da2c3-01d6-415a-a7ff-61d26bc4b644 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:53.672281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4da2c3-01d6-415a-a7ff-61d26bc4b644 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:53.672281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4da2c3-01d6-415a-a7ff-61d26bc4b644 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:53.672281 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 90/181] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:47:53.679040 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb026c6-2d46-48b3-9760-f314c971d9b0 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:53.679435 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb026c6-2d46-48b3-9760-f314c971d9b0 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:53.679641 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb026c6-2d46-48b3-9760-f314c971d9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:53.700228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-4fb026c6-2d46-48b3-9760-f314c971d9b0 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:47:53.701446 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4fb026c6-2d46-48b3-9760-f314c971d9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:47:53.799315 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 92/182] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:47:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:47:53.825225 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4da2c3-01d6-415a-a7ff-61d26bc4b644 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:53.913678 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0e621-5d69-4a3e-a78f-384cf8acb3be None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:53.914365 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0e621-5d69-4a3e-a78f-384cf8acb3be None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:53.914841 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0e621-5d69-4a3e-a78f-384cf8acb3be None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:53.916403 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 93/183] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:47:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:47:53.922202 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912d3da-a1fa-4929-8d90-69c537a845e0 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:53.922782 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912d3da-a1fa-4929-8d90-69c537a845e0 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:53.923289 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912d3da-a1fa-4929-8d90-69c537a845e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:53.928647 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4da2c3-01d6-415a-a7ff-61d26bc4b644 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:53.941317 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-3912d3da-a1fa-4929-8d90-69c537a845e0 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:47:53.942838 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3912d3da-a1fa-4929-8d90-69c537a845e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:47:53.962664 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d388db-6d09-4bfb-9620-48374d4acce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:53.963464 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d388db-6d09-4bfb-9620-48374d4acce0 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:53.963743 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d388db-6d09-4bfb-9620-48374d4acce0 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:53.964013 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d388db-6d09-4bfb-9620-48374d4acce0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:53.975155 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d388db-6d09-4bfb-9620-48374d4acce0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:47:53.982958 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-66d388db-6d09-4bfb-9620-48374d4acce0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:47:53.982958 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:47:53.982958 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:47:53.982958 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:47:53.982958 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:47:53.982958 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:47:53.982958 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:47:53.982958 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:47:53.982958 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:47:53.982958 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:47:53.982958 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:47:53.982958 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:47:53.982958 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:47:53.982958 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:47:53.982958 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:47:53.982958 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:47:53.984397 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:47:53.984397 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:47:53.984397 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:47:53.984397 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:47:53.984397 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:47:53.984397 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:47:53.984397 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:47:53.984397 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:47:53.984397 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:47:53.984397 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:47:53.984397 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:47:53.984397 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:47:53.984397 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:47:53.984397 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:47:53.984397 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:47:53.984397 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:47:53.985628 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:47:53.985628 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:47:53.985628 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:47:53.985628 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:47:53.985628 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:47:53.985628 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:47:53.985628 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:47:53.985628 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:47:53.985628 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:47:53.985628 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:47:53.985628 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:47:53.985628 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:47:53.985628 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 91/184] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Apr 30 20:47:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:47:53.990717 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d388db-6d09-4bfb-9620-48374d4acce0 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:54.018026 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 94/185] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:47:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:47:54.042059 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912d3da-a1fa-4929-8d90-69c537a845e0 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:54.102780 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d388db-6d09-4bfb-9620-48374d4acce0 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:54.136314 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b588ae-397d-4cbf-a0ca-009382838da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:54.136958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b588ae-397d-4cbf-a0ca-009382838da1 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:54.137413 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b588ae-397d-4cbf-a0ca-009382838da1 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:54.137772 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b588ae-397d-4cbf-a0ca-009382838da1 None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:54.138593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b588ae-397d-4cbf-a0ca-009382838da1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:47:54.138968 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b588ae-397d-4cbf-a0ca-009382838da1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:54.140464 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b588ae-397d-4cbf-a0ca-009382838da1 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:54.148670 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 92/186] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:47:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:47:54.154026 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b588ae-397d-4cbf-a0ca-009382838da1 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:54.163786 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912d3da-a1fa-4929-8d90-69c537a845e0 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:54.208668 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29578e59-12ba-40d6-a540-f1710ad74f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:54.209606 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29578e59-12ba-40d6-a540-f1710ad74f37 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:54.209984 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29578e59-12ba-40d6-a540-f1710ad74f37 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:54.210390 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29578e59-12ba-40d6-a540-f1710ad74f37 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:54.220935 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29578e59-12ba-40d6-a540-f1710ad74f37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:47:54.229634 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-29578e59-12ba-40d6-a540-f1710ad74f37 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:47:54.229634 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:47:54.229634 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:47:54.229634 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:47:54.229634 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:47:54.229634 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:47:54.229634 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:47:54.229634 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:47:54.229634 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:47:54.229634 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:47:54.229634 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:47:54.229634 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:47:54.229634 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:47:54.229634 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:47:54.229634 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:47:54.229634 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:47:54.230575 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:47:54.230575 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:47:54.230575 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:47:54.230575 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:47:54.230575 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:47:54.230575 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:47:54.230575 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:47:54.230575 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:47:54.230575 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:47:54.230575 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:47:54.230575 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:47:54.230575 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:47:54.230575 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:47:54.230575 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:47:54.230575 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:47:54.230575 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:47:54.231664 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:47:54.231664 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:47:54.231664 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:47:54.231664 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:47:54.231664 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:47:54.231664 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:47:54.231664 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:47:54.231664 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:47:54.231664 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:47:54.231664 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:47:54.231664 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:47:54.231664 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:47:54.231664 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 95/187] 10.222.0.23 () {56 vars in 1114 bytes} [Sat Apr 30 20:47:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:47:54.237214 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29578e59-12ba-40d6-a540-f1710ad74f37 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:54.276419 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b588ae-397d-4cbf-a0ca-009382838da1 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:54.321839 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e78683-846f-473f-a3ce-37e218ab3eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:54.323087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e78683-846f-473f-a3ce-37e218ab3eca None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:54.331429 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e78683-846f-473f-a3ce-37e218ab3eca None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:54.331429 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e78683-846f-473f-a3ce-37e218ab3eca None admin] PATH_INFO: `/v3/users/918641222bf34761b7cce301a9b1eef2` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:54.352849 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e78683-846f-473f-a3ce-37e218ab3eca None admin] RBAC: Authorizing `identity:get_user(user_id=918641222bf34761b7cce301a9b1eef2)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:54.355447 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e78683-846f-473f-a3ce-37e218ab3eca None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:54.356951 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29578e59-12ba-40d6-a540-f1710ad74f37 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:54.357648 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 93/188] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:47:54 2022] GET /identity/v3/users/918641222bf34761b7cce301a9b1eef2 => generated 283 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:47:54.366784 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e78683-846f-473f-a3ce-37e218ab3eca None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:54.395822 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f4c69-0050-4e26-9f15-2ca79374dd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:54.396667 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f4c69-0050-4e26-9f15-2ca79374dd66 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:54.396776 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f4c69-0050-4e26-9f15-2ca79374dd66 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:54.397024 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f4c69-0050-4e26-9f15-2ca79374dd66 None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:54.397791 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1f4c69-0050-4e26-9f15-2ca79374dd66 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:47:54.398106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1f4c69-0050-4e26-9f15-2ca79374dd66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:54.399502 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1f4c69-0050-4e26-9f15-2ca79374dd66 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:54.407721 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 96/189] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:47:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:54.408994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65bc0f-ba00-4a00-a5e3-761dbb5c05bb None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:54.409289 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65bc0f-ba00-4a00-a5e3-761dbb5c05bb None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:54.409568 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65bc0f-ba00-4a00-a5e3-761dbb5c05bb None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:54.410838 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 97/190] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:47:54.415143 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65bc0f-ba00-4a00-a5e3-761dbb5c05bb None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:54.475149 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e78683-846f-473f-a3ce-37e218ab3eca None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:54.512123 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ef958-3cc9-404e-a221-58d1463dda20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:54.512962 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ef958-3cc9-404e-a221-58d1463dda20 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:54.513384 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ef958-3cc9-404e-a221-58d1463dda20 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:54.513851 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ef958-3cc9-404e-a221-58d1463dda20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:54.514173 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65bc0f-ba00-4a00-a5e3-761dbb5c05bb None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:54.547054 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0184f3-3544-42ca-ab08-994f0902c0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:54.547917 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0184f3-3544-42ca-ab08-994f0902c0b1 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:54.548194 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0184f3-3544-42ca-ab08-994f0902c0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:54.548462 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0184f3-3544-42ca-ab08-994f0902c0b1 None admin] PATH_INFO: `/v3/users/918641222bf34761b7cce301a9b1eef2` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:54.549639 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0184f3-3544-42ca-ab08-994f0902c0b1 None admin] RBAC: Authorizing `identity:get_user(user_id=918641222bf34761b7cce301a9b1eef2)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:54.551119 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0184f3-3544-42ca-ab08-994f0902c0b1 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:54.553047 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 98/191] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:47:54 2022] GET /identity/v3/users/918641222bf34761b7cce301a9b1eef2 => generated 283 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:54.554248 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f8057-5954-461a-8703-afcb8b412bc7 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:54.554531 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f8057-5954-461a-8703-afcb8b412bc7 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:54.554807 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f8057-5954-461a-8703-afcb8b412bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:54.570628 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-437f8057-5954-461a-8703-afcb8b412bc7 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:47:54.571784 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-437f8057-5954-461a-8703-afcb8b412bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:47:54.598669 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ef958-3cc9-404e-a221-58d1463dda20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:54.600413 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ef958-3cc9-404e-a221-58d1463dda20 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:54.636792 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 99/192] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:47:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:47:54.637631 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f8057-5954-461a-8703-afcb8b412bc7 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:54.710459 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 94/193] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:47:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:47:54.712007 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ef958-3cc9-404e-a221-58d1463dda20 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:54.741696 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f8057-5954-461a-8703-afcb8b412bc7 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:54.774759 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de577ff-0c8c-4a22-9e2e-c18e770ec0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:54.775417 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de577ff-0c8c-4a22-9e2e-c18e770ec0d2 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:54.775800 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de577ff-0c8c-4a22-9e2e-c18e770ec0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:54.776083 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de577ff-0c8c-4a22-9e2e-c18e770ec0d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:54.810502 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ef958-3cc9-404e-a221-58d1463dda20 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:54.843206 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de577ff-0c8c-4a22-9e2e-c18e770ec0d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:54.844720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de577ff-0c8c-4a22-9e2e-c18e770ec0d2 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:54.844978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7719da62-b6a2-46e1-a84c-fdcf40e91396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:54.846038 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719da62-b6a2-46e1-a84c-fdcf40e91396 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:54.846322 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719da62-b6a2-46e1-a84c-fdcf40e91396 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:54.846596 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719da62-b6a2-46e1-a84c-fdcf40e91396 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:54.847773 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7719da62-b6a2-46e1-a84c-fdcf40e91396 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:54.849207 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7719da62-b6a2-46e1-a84c-fdcf40e91396 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:54.851006 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 95/194] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:47:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:54.851599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7719da62-b6a2-46e1-a84c-fdcf40e91396 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:54.942477 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 100/195] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:47:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:47:54.943766 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de577ff-0c8c-4a22-9e2e-c18e770ec0d2 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:54.949166 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7719da62-b6a2-46e1-a84c-fdcf40e91396 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:54.985690 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e11847-1c34-45c4-b004-19f06af2ac2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:54.986815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e11847-1c34-45c4-b004-19f06af2ac2f None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:54.987098 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e11847-1c34-45c4-b004-19f06af2ac2f None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:54.987369 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e11847-1c34-45c4-b004-19f06af2ac2f None admin] PATH_INFO: `/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:54.988554 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e11847-1c34-45c4-b004-19f06af2ac2f None admin] RBAC: Authorizing `identity:get_project(project_id=0aa8006660fe4334b8ca63e5e2a5d7e0)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:54.990047 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e11847-1c34-45c4-b004-19f06af2ac2f None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:54.996622 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 96/196] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:47:54 2022] GET /identity/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:54.996622 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e11847-1c34-45c4-b004-19f06af2ac2f None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:55.049700 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de577ff-0c8c-4a22-9e2e-c18e770ec0d2 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:55.086770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6cde7-4735-4c26-b699-ac64c0e18fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:55.087439 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6cde7-4735-4c26-b699-ac64c0e18fd7 None admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:55.087720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6cde7-4735-4c26-b699-ac64c0e18fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:55.087993 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6cde7-4735-4c26-b699-ac64c0e18fd7 None admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:55.088701 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6cde7-4735-4c26-b699-ac64c0e18fd7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:55.089455 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e11847-1c34-45c4-b004-19f06af2ac2f None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:55.090200 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6cde7-4735-4c26-b699-ac64c0e18fd7 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:55.122813 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497a039-555a-44ee-a0c5-344941f9c9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:55.124297 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497a039-555a-44ee-a0c5-344941f9c9ed None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:55.124582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497a039-555a-44ee-a0c5-344941f9c9ed None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:55.124850 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497a039-555a-44ee-a0c5-344941f9c9ed None admin] PATH_INFO: `/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:55.126049 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1497a039-555a-44ee-a0c5-344941f9c9ed None admin] RBAC: Authorizing `identity:get_project(project_id=0aa8006660fe4334b8ca63e5e2a5d7e0)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:55.127510 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1497a039-555a-44ee-a0c5-344941f9c9ed None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:55.129343 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 97/197] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:47:54 2022] GET /identity/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0 => generated 302 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:55.130039 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497a039-555a-44ee-a0c5-344941f9c9ed None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:55.197819 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 101/198] 10.222.0.23 () {60 vars in 1132 bytes} [Sat Apr 30 20:47:54 2022] POST /identity/v3/users => generated 297 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:47:55.198575 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6cde7-4735-4c26-b699-ac64c0e18fd7 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:55.238234 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497a039-555a-44ee-a0c5-344941f9c9ed None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:55.279937 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde565e-6084-4331-8302-53853867a10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:55.280733 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde565e-6084-4331-8302-53853867a10e None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:55.281085 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde565e-6084-4331-8302-53853867a10e None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:55.281476 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde565e-6084-4331-8302-53853867a10e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:55.282464 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde565e-6084-4331-8302-53853867a10e None admin] RBAC: Adding query filter params (role.id=30112eb1f3e047398c3c82fb40b72e62, scope.project.id=0aa8006660fe4334b8ca63e5e2a5d7e0, user.id=918641222bf34761b7cce301a9b1eef2) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:47:55.282852 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde565e-6084-4331-8302-53853867a10e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:55.284776 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde565e-6084-4331-8302-53853867a10e None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:55.291756 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 98/199] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:47:55 2022] GET /identity/v3/role_assignments?user.id=918641222bf34761b7cce301a9b1eef2&scope.project.id=0aa8006660fe4334b8ca63e5e2a5d7e0&role.id=30112eb1f3e047398c3c82fb40b72e62 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:55.355177 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6cde7-4735-4c26-b699-ac64c0e18fd7 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:55.416651 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7995b4-cf92-4117-b1d3-c16bda1cd105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:55.417573 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7995b4-cf92-4117-b1d3-c16bda1cd105 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:55.418031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7995b4-cf92-4117-b1d3-c16bda1cd105 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:55.418445 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7995b4-cf92-4117-b1d3-c16bda1cd105 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:55.419551 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7995b4-cf92-4117-b1d3-c16bda1cd105 None admin] RBAC: Adding query filter params (role.id=121b12a250ae4ef8ae1a85ea8c21c4fa, scope.project.id=0aa8006660fe4334b8ca63e5e2a5d7e0, user.id=918641222bf34761b7cce301a9b1eef2) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:47:55.420016 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7995b4-cf92-4117-b1d3-c16bda1cd105 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:55.422322 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7995b4-cf92-4117-b1d3-c16bda1cd105 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:55.429270 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 102/200] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:47:55 2022] GET /identity/v3/role_assignments?user.id=918641222bf34761b7cce301a9b1eef2&scope.project.id=0aa8006660fe4334b8ca63e5e2a5d7e0&role.id=121b12a250ae4ef8ae1a85ea8c21c4fa => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:55.486271 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33727789-6fe8-4b88-8460-d6d69406cfe9 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:55.486549 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33727789-6fe8-4b88-8460-d6d69406cfe9 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:55.486835 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33727789-6fe8-4b88-8460-d6d69406cfe9 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:55.488269 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 99/201] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:47:55.494330 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38639711-7e64-443c-820b-b1cbdb633913 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:55.494856 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38639711-7e64-443c-820b-b1cbdb633913 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:55.495275 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38639711-7e64-443c-820b-b1cbdb633913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:55.515349 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-38639711-7e64-443c-820b-b1cbdb633913 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:47:55.516799 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-38639711-7e64-443c-820b-b1cbdb633913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:47:55.599008 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 103/202] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:47:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:47:55.633906 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33727789-6fe8-4b88-8460-d6d69406cfe9 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:55.740718 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33727789-6fe8-4b88-8460-d6d69406cfe9 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:55.776710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a397d86-6d5e-45da-8e52-ddac4302d1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:55.777649 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a397d86-6d5e-45da-8e52-ddac4302d1e5 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:55.777986 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a397d86-6d5e-45da-8e52-ddac4302d1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:55.778255 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a397d86-6d5e-45da-8e52-ddac4302d1e5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:55.789392 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a397d86-6d5e-45da-8e52-ddac4302d1e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:47:55.797997 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-5a397d86-6d5e-45da-8e52-ddac4302d1e5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 30 20:47:55.797997 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:47:55.797997 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:47:55.797997 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:47:55.797997 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:47:55.797997 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:47:55.797997 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:47:55.797997 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:47:55.797997 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:47:55.797997 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:47:55.797997 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:47:55.797997 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:47:55.797997 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:47:55.797997 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:47:55.797997 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:47:55.797997 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:47:55.798874 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:47:55.798874 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:47:55.798874 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:47:55.798874 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:47:55.798874 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:47:55.798874 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:47:55.798874 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:47:55.798874 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:47:55.798874 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:47:55.798874 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:47:55.798874 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:47:55.798874 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:47:55.798874 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:47:55.798874 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:47:55.798874 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:47:55.798874 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:47:55.799662 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:47:55.799662 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:47:55.799662 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:47:55.799662 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:47:55.799662 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:47:55.799662 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:47:55.799662 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:47:55.799662 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:47:55.799662 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:47:55.799662 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:47:55.799662 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Apr 30 20:47:55.799662 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:47:55.799662 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 100/203] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:47:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:47:55.805218 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38639711-7e64-443c-820b-b1cbdb633913 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:55.930852 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38639711-7e64-443c-820b-b1cbdb633913 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:55.971514 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f6a23-f787-45f7-95eb-937e6a8e7823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:55.972201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f6a23-f787-45f7-95eb-937e6a8e7823 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:55.972486 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f6a23-f787-45f7-95eb-937e6a8e7823 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:55.972765 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f6a23-f787-45f7-95eb-937e6a8e7823 None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:55.973523 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f6a23-f787-45f7-95eb-937e6a8e7823 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:47:55.973855 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f6a23-f787-45f7-95eb-937e6a8e7823 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:55.975258 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f6a23-f787-45f7-95eb-937e6a8e7823 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:55.984661 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 104/204] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Apr 30 20:47:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:55.990392 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a397d86-6d5e-45da-8e52-ddac4302d1e5 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:56.092015 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a397d86-6d5e-45da-8e52-ddac4302d1e5 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:56.126746 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39b0f15-9ad1-4247-aa55-43aa38e1a042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:56.127662 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b0f15-9ad1-4247-aa55-43aa38e1a042 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:56.127951 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b0f15-9ad1-4247-aa55-43aa38e1a042 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:56.128225 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b0f15-9ad1-4247-aa55-43aa38e1a042 None admin] PATH_INFO: `/v3/users/baa6d4cbf2ca472a81b7e44df021f0c0` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:56.129434 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39b0f15-9ad1-4247-aa55-43aa38e1a042 None admin] RBAC: Authorizing `identity:get_user(user_id=baa6d4cbf2ca472a81b7e44df021f0c0)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:56.130926 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39b0f15-9ad1-4247-aa55-43aa38e1a042 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:56.132549 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 101/205] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:47:55 2022] GET /identity/v3/users/baa6d4cbf2ca472a81b7e44df021f0c0 => generated 289 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:47:56.138241 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f6a23-f787-45f7-95eb-937e6a8e7823 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:56.245555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f6a23-f787-45f7-95eb-937e6a8e7823 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:56.300326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815959df-72d5-48fb-9ad6-bf6614f716e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:56.300990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815959df-72d5-48fb-9ad6-bf6614f716e6 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:56.301276 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815959df-72d5-48fb-9ad6-bf6614f716e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:56.301556 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815959df-72d5-48fb-9ad6-bf6614f716e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:56.370303 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815959df-72d5-48fb-9ad6-bf6614f716e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:56.371799 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815959df-72d5-48fb-9ad6-bf6614f716e6 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:56.517209 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 105/206] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:47:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:47:56.819662 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39b0f15-9ad1-4247-aa55-43aa38e1a042 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:56.819662 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39b0f15-9ad1-4247-aa55-43aa38e1a042 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:56.819662 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48100984-015c-404a-a7c6-e23f03adf305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:56.819662 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48100984-015c-404a-a7c6-e23f03adf305 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:56.820382 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48100984-015c-404a-a7c6-e23f03adf305 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:56.820382 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48100984-015c-404a-a7c6-e23f03adf305 None admin] PATH_INFO: `/v3/projects/9431599023b44f1cb5dfb8bca0584f5f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:56.820382 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48100984-015c-404a-a7c6-e23f03adf305 None admin] RBAC: Authorizing `identity:get_project(project_id=9431599023b44f1cb5dfb8bca0584f5f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:56.820382 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48100984-015c-404a-a7c6-e23f03adf305 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:56.820382 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 102/207] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:47:56 2022] GET /identity/v3/projects/9431599023b44f1cb5dfb8bca0584f5f => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:56.820699 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815959df-72d5-48fb-9ad6-bf6614f716e6 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:56.858898 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815959df-72d5-48fb-9ad6-bf6614f716e6 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:56.901261 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1765c-e579-4e30-ae2a-c4e7a094ad92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:56.901955 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1765c-e579-4e30-ae2a-c4e7a094ad92 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:56.902239 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1765c-e579-4e30-ae2a-c4e7a094ad92 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:56.902515 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1765c-e579-4e30-ae2a-c4e7a094ad92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:56.903354 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1765c-e579-4e30-ae2a-c4e7a094ad92 None admin] RBAC: Adding query filter params (role.id=df4ebd23bc804a629fbb7b2dad89c96a, scope.project.id=9431599023b44f1cb5dfb8bca0584f5f, user.id=baa6d4cbf2ca472a81b7e44df021f0c0) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:47:56.903664 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1765c-e579-4e30-ae2a-c4e7a094ad92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:56.905186 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1765c-e579-4e30-ae2a-c4e7a094ad92 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:56.911992 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 106/208] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:47:56 2022] GET /identity/v3/role_assignments?user.id=baa6d4cbf2ca472a81b7e44df021f0c0&scope.project.id=9431599023b44f1cb5dfb8bca0584f5f&role.id=df4ebd23bc804a629fbb7b2dad89c96a => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:58.049940 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84bf89-d287-4536-80da-62f30beb140e None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:58.050482 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84bf89-d287-4536-80da-62f30beb140e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:58.050482 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84bf89-d287-4536-80da-62f30beb140e None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:58.051853 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 103/209] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:47:58.057036 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eae6c4-217e-4caa-83c0-05094d4ddc21 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:58.057497 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eae6c4-217e-4caa-83c0-05094d4ddc21 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:58.057656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eae6c4-217e-4caa-83c0-05094d4ddc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:58.059704 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98f431-81e3-4a21-a0f4-60a46b2caaea None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:58.060000 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98f431-81e3-4a21-a0f4-60a46b2caaea None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:58.060281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98f431-81e3-4a21-a0f4-60a46b2caaea None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:58.061600 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 104/210] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:47:58.066660 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc3f8c-22c8-4201-8abd-ba56c526c21b None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:58.067138 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc3f8c-22c8-4201-8abd-ba56c526c21b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:58.067584 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc3f8c-22c8-4201-8abd-ba56c526c21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:58.081675 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-39eae6c4-217e-4caa-83c0-05094d4ddc21 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:47:58.083058 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-39eae6c4-217e-4caa-83c0-05094d4ddc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:47:58.085248 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-70bc3f8c-22c8-4201-8abd-ba56c526c21b None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:47:58.086614 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-70bc3f8c-22c8-4201-8abd-ba56c526c21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:47:58.162148 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 105/211] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:47:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:47:58.163667 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 107/212] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:47:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:47:58.187169 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc3f8c-22c8-4201-8abd-ba56c526c21b None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:58.190380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eae6c4-217e-4caa-83c0-05094d4ddc21 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:58.300370 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eae6c4-217e-4caa-83c0-05094d4ddc21 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:58.313238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc3f8c-22c8-4201-8abd-ba56c526c21b None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:58.333587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515abd89-c41a-4185-ac34-5cfd35bfb35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:58.334413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515abd89-c41a-4185-ac34-5cfd35bfb35f None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:58.334695 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515abd89-c41a-4185-ac34-5cfd35bfb35f None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:58.334968 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515abd89-c41a-4185-ac34-5cfd35bfb35f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:58.345841 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515abd89-c41a-4185-ac34-5cfd35bfb35f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:47:58.353307 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5195f8-c53b-4719-9ccc-a0b0ebc778f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:58.353574 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-515abd89-c41a-4185-ac34-5cfd35bfb35f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:47:58.353574 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:47:58.353574 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:47:58.353574 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:47:58.353574 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:47:58.353574 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:47:58.353574 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:47:58.353574 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:47:58.353574 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:47:58.353574 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:47:58.353574 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:47:58.353574 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:47:58.353574 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:47:58.353574 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:47:58.353574 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:47:58.353574 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:47:58.355948 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:47:58.355948 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:47:58.355948 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:47:58.355948 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:47:58.355948 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:47:58.355948 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:47:58.355948 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:47:58.355948 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:47:58.355948 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:47:58.355948 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:47:58.355948 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:47:58.355948 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:47:58.355948 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:47:58.355948 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:47:58.355948 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:47:58.355948 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:47:58.357906 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:47:58.357906 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:47:58.357906 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:47:58.357906 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:47:58.357906 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:47:58.357906 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:47:58.357906 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:47:58.357906 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:47:58.357906 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:47:58.357906 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:47:58.357906 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:47:58.357906 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:47:58.360298 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5195f8-c53b-4719-9ccc-a0b0ebc778f7 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:58.360298 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5195f8-c53b-4719-9ccc-a0b0ebc778f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:58.360298 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5195f8-c53b-4719-9ccc-a0b0ebc778f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:58.360712 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 108/213] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Apr 30 20:47:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:47:58.361302 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a60e2-9128-4e2b-af8c-cab5e97b9beb None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:58.361590 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a60e2-9128-4e2b-af8c-cab5e97b9beb None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:58.361891 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a60e2-9128-4e2b-af8c-cab5e97b9beb None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:58.365793 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 109/214] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:47:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:47:58.365793 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a60e2-9128-4e2b-af8c-cab5e97b9beb None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:58.366012 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5195f8-c53b-4719-9ccc-a0b0ebc778f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:47:58.375756 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-ae5195f8-c53b-4719-9ccc-a0b0ebc778f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:47:58.375756 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:47:58.375756 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:47:58.375756 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:47:58.375756 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:47:58.375756 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:47:58.375756 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:47:58.375756 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:47:58.375756 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:47:58.375756 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:47:58.375756 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:47:58.375756 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:47:58.375756 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:47:58.375756 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:47:58.375756 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:47:58.375756 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:47:58.376663 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:47:58.376663 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:47:58.376663 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:47:58.376663 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:47:58.376663 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:47:58.376663 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:47:58.376663 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:47:58.376663 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:47:58.376663 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:47:58.376663 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:47:58.376663 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:47:58.376663 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:47:58.376663 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:47:58.376663 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:47:58.376663 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:47:58.376663 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:47:58.377447 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:47:58.377447 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:47:58.377447 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:47:58.377447 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:47:58.377447 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:47:58.377447 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:47:58.377447 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:47:58.377447 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:47:58.377447 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:47:58.377447 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:47:58.377447 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:47:58.377447 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:47:58.377447 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 106/215] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:47:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:47:58.378422 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce6d3b-4914-40d1-9187-de86fa5652d1 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:58.378741 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce6d3b-4914-40d1-9187-de86fa5652d1 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:58.379033 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce6d3b-4914-40d1-9187-de86fa5652d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:58.395655 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-1dce6d3b-4914-40d1-9187-de86fa5652d1 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:47:58.396845 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1dce6d3b-4914-40d1-9187-de86fa5652d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:47:58.459287 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 107/216] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:47:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:47:58.469967 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371353c1-3d83-4bcd-b921-12145507d378 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:58.469967 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371353c1-3d83-4bcd-b921-12145507d378 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:58.469967 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371353c1-3d83-4bcd-b921-12145507d378 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:58.469967 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 108/217] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:47:58.469967 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371353c1-3d83-4bcd-b921-12145507d378 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:58.471362 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a60e2-9128-4e2b-af8c-cab5e97b9beb None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:58.504060 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae9b04-99bb-42f1-870c-6a3d1499618a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:58.504731 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae9b04-99bb-42f1-870c-6a3d1499618a None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:58.505031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae9b04-99bb-42f1-870c-6a3d1499618a None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:58.505291 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae9b04-99bb-42f1-870c-6a3d1499618a None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:58.506089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae9b04-99bb-42f1-870c-6a3d1499618a None admin] RBAC: Adding query filter params (name=admin) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:47:58.506394 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae9b04-99bb-42f1-870c-6a3d1499618a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:58.507788 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae9b04-99bb-42f1-870c-6a3d1499618a None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:58.516217 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 110/218] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:47:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:58.516217 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48292e70-1c9b-47f3-8966-e5fa7956c69a None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:58.516217 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48292e70-1c9b-47f3-8966-e5fa7956c69a None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:58.516217 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48292e70-1c9b-47f3-8966-e5fa7956c69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:58.534496 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-48292e70-1c9b-47f3-8966-e5fa7956c69a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:47:58.535730 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-48292e70-1c9b-47f3-8966-e5fa7956c69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:47:58.566084 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371353c1-3d83-4bcd-b921-12145507d378 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:58.599254 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3aa21-035e-4180-86f1-f985409c7ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:58.599740 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 111/219] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:47:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:47:58.599917 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3aa21-035e-4180-86f1-f985409c7ce6 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:58.600201 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3aa21-035e-4180-86f1-f985409c7ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:58.600475 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3aa21-035e-4180-86f1-f985409c7ce6 None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:58.600573 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48292e70-1c9b-47f3-8966-e5fa7956c69a None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:58.601297 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3aa21-035e-4180-86f1-f985409c7ce6 None admin] RBAC: Adding query filter params (name=member) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:47:58.601612 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3aa21-035e-4180-86f1-f985409c7ce6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:58.603078 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3aa21-035e-4180-86f1-f985409c7ce6 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:58.611094 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 109/220] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Apr 30 20:47:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:58.616275 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3aa21-035e-4180-86f1-f985409c7ce6 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:58.693701 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48292e70-1c9b-47f3-8966-e5fa7956c69a None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:58.707675 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3aa21-035e-4180-86f1-f985409c7ce6 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:58.726003 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b014d-bec7-42d8-9f3e-73973c17bd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:58.726806 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b014d-bec7-42d8-9f3e-73973c17bd56 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:58.727080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b014d-bec7-42d8-9f3e-73973c17bd56 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:58.727346 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b014d-bec7-42d8-9f3e-73973c17bd56 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:58.736883 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b014d-bec7-42d8-9f3e-73973c17bd56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:47:58.738914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94376b5-708f-412f-81ff-6879e3e0afbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:58.739767 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94376b5-708f-412f-81ff-6879e3e0afbb None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:58.740042 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94376b5-708f-412f-81ff-6879e3e0afbb None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:58.740310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94376b5-708f-412f-81ff-6879e3e0afbb None admin] PATH_INFO: `/v3/users/918641222bf34761b7cce301a9b1eef2` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:58.741473 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94376b5-708f-412f-81ff-6879e3e0afbb None admin] RBAC: Authorizing `identity:get_user(user_id=918641222bf34761b7cce301a9b1eef2)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:58.742943 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94376b5-708f-412f-81ff-6879e3e0afbb None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:58.744697 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 110/221] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:47:58 2022] GET /identity/v3/users/918641222bf34761b7cce301a9b1eef2 => generated 283 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:58.744857 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-d50b014d-bec7-42d8-9f3e-73973c17bd56 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:47:58.744857 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:47:58.744857 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:47:58.744857 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:47:58.744857 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:47:58.744857 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:47:58.744857 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:47:58.744857 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:47:58.744857 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:47:58.744857 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:47:58.744857 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:47:58.744857 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:47:58.744857 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:47:58.744857 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:47:58.744857 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:47:58.744857 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:47:58.745706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:47:58.745706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:47:58.745706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:47:58.745706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:47:58.745706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:47:58.745706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:47:58.745706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:47:58.745706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:47:58.745706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:47:58.745706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:47:58.745706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:47:58.745706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:47:58.745706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:47:58.745706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:47:58.745706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:47:58.745706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:47:58.746573 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:47:58.746573 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:47:58.746573 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:47:58.746573 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:47:58.746573 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:47:58.746573 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:47:58.746573 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:47:58.746573 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:47:58.746573 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:47:58.746573 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:47:58.746573 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:47:58.746573 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:47:58.747192 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94376b5-708f-412f-81ff-6879e3e0afbb None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:58.747265 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 112/222] 10.222.0.23 () {56 vars in 1114 bytes} [Sat Apr 30 20:47:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:47:58.747265 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b014d-bec7-42d8-9f3e-73973c17bd56 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:58.843504 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94376b5-708f-412f-81ff-6879e3e0afbb None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:58.843977 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b014d-bec7-42d8-9f3e-73973c17bd56 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:58.874627 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a49c8-f301-4f26-bfca-8d8fb35bc049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:58.875479 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a49c8-f301-4f26-bfca-8d8fb35bc049 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:58.875728 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd2f7b-3af6-4a69-b4c6-1e463d57e167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:58.875920 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a49c8-f301-4f26-bfca-8d8fb35bc049 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:58.876014 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a49c8-f301-4f26-bfca-8d8fb35bc049 None admin] PATH_INFO: `/v3/users/7191e25fe82c407286c836be2d7dd20d` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:58.876506 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd2f7b-3af6-4a69-b4c6-1e463d57e167 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:58.876792 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd2f7b-3af6-4a69-b4c6-1e463d57e167 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:58.877069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd2f7b-3af6-4a69-b4c6-1e463d57e167 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:58.878297 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd2f7b-3af6-4a69-b4c6-1e463d57e167 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:58.879750 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd2f7b-3af6-4a69-b4c6-1e463d57e167 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:58.881352 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 113/223] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:47:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:58.885954 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd2f7b-3af6-4a69-b4c6-1e463d57e167 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:58.888901 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14a49c8-f301-4f26-bfca-8d8fb35bc049 None admin] RBAC: Authorizing `identity:get_user(user_id=7191e25fe82c407286c836be2d7dd20d)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:58.890947 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14a49c8-f301-4f26-bfca-8d8fb35bc049 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:58.892618 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 111/224] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:47:58 2022] GET /identity/v3/users/7191e25fe82c407286c836be2d7dd20d => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:58.893367 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a49c8-f301-4f26-bfca-8d8fb35bc049 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:58.984687 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd2f7b-3af6-4a69-b4c6-1e463d57e167 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:58.986620 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a49c8-f301-4f26-bfca-8d8fb35bc049 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:59.017273 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816108a-2e44-48a5-9a53-6aef34736e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:59.017965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816108a-2e44-48a5-9a53-6aef34736e9e None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:59.018244 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816108a-2e44-48a5-9a53-6aef34736e9e None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:59.018514 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816108a-2e44-48a5-9a53-6aef34736e9e None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:59.018996 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f14f1-b855-43b7-8602-12d44ce18c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:59.019255 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816108a-2e44-48a5-9a53-6aef34736e9e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:47:59.019560 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816108a-2e44-48a5-9a53-6aef34736e9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:59.019843 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f14f1-b855-43b7-8602-12d44ce18c8f None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:59.020123 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f14f1-b855-43b7-8602-12d44ce18c8f None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:59.020397 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f14f1-b855-43b7-8602-12d44ce18c8f None admin] PATH_INFO: `/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:59.020954 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816108a-2e44-48a5-9a53-6aef34736e9e None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:59.021559 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2f14f1-b855-43b7-8602-12d44ce18c8f None admin] RBAC: Authorizing `identity:get_project(project_id=0aa8006660fe4334b8ca63e5e2a5d7e0)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:59.023036 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2f14f1-b855-43b7-8602-12d44ce18c8f None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:59.024707 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 112/225] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:47:58 2022] GET /identity/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0 => generated 302 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:59.026593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f14f1-b855-43b7-8602-12d44ce18c8f None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:59.028801 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 114/226] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:47:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:59.029583 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816108a-2e44-48a5-9a53-6aef34736e9e None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:59.121596 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816108a-2e44-48a5-9a53-6aef34736e9e None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:59.124240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f14f1-b855-43b7-8602-12d44ce18c8f None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:59.154168 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b9a49-48c7-4b1c-b848-b89784402c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:59.154813 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b9a49-48c7-4b1c-b848-b89784402c51 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:59.155094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b9a49-48c7-4b1c-b848-b89784402c51 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:59.155370 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b9a49-48c7-4b1c-b848-b89784402c51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:59.158281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f44e4b-6e0a-4934-9aa3-79674c03e2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:59.158936 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f44e4b-6e0a-4934-9aa3-79674c03e2cd None admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:59.159211 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f44e4b-6e0a-4934-9aa3-79674c03e2cd None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:59.159476 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f44e4b-6e0a-4934-9aa3-79674c03e2cd None admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:59.160171 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f44e4b-6e0a-4934-9aa3-79674c03e2cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:59.161619 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f44e4b-6e0a-4934-9aa3-79674c03e2cd None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:59.218331 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b9a49-48c7-4b1c-b848-b89784402c51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:59.219782 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b9a49-48c7-4b1c-b848-b89784402c51 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:59.289191 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 113/227] 10.222.0.23 () {60 vars in 1132 bytes} [Sat Apr 30 20:47:59 2022] POST /identity/v3/users => generated 297 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:47:59.290258 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f44e4b-6e0a-4934-9aa3-79674c03e2cd None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:59.333887 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 115/228] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:47:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:47:59.333887 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b9a49-48c7-4b1c-b848-b89784402c51 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:59.400039 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f44e4b-6e0a-4934-9aa3-79674c03e2cd None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:59.434665 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ae0c5-d519-441f-bed6-116a8dba3e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:59.435512 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ae0c5-d519-441f-bed6-116a8dba3e07 None admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:59.435795 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ae0c5-d519-441f-bed6-116a8dba3e07 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:59.436065 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ae0c5-d519-441f-bed6-116a8dba3e07 None admin] PATH_INFO: `/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0/users/918641222bf34761b7cce301a9b1eef2/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:59.437364 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b9a49-48c7-4b1c-b848-b89784402c51 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:59.438894 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ae0c5-d519-441f-bed6-116a8dba3e07 None admin] RBAC: Authorizing `identity:create_grant(project_id=0aa8006660fe4334b8ca63e5e2a5d7e0, user_id=918641222bf34761b7cce301a9b1eef2, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:59.440335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ae0c5-d519-441f-bed6-116a8dba3e07 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:59.474738 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9448354-6726-48c0-8607-2340e4e5a9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:59.475647 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9448354-6726-48c0-8607-2340e4e5a9d5 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:59.475927 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9448354-6726-48c0-8607-2340e4e5a9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:59.476206 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9448354-6726-48c0-8607-2340e4e5a9d5 None admin] PATH_INFO: `/v3/users/918641222bf34761b7cce301a9b1eef2` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:59.477473 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9448354-6726-48c0-8607-2340e4e5a9d5 None admin] RBAC: Authorizing `identity:get_user(user_id=918641222bf34761b7cce301a9b1eef2)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:59.478986 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9448354-6726-48c0-8607-2340e4e5a9d5 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:59.480800 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 116/229] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:47:59 2022] GET /identity/v3/users/918641222bf34761b7cce301a9b1eef2 => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:59.481397 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9448354-6726-48c0-8607-2340e4e5a9d5 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:59.512231 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 114/230] 10.222.0.23 () {58 vars in 1439 bytes} [Sat Apr 30 20:47:59 2022] PUT /identity/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0/users/918641222bf34761b7cce301a9b1eef2/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:47:59.512889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ae0c5-d519-441f-bed6-116a8dba3e07 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:59.598709 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9448354-6726-48c0-8607-2340e4e5a9d5 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:59.640057 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ae0c5-d519-441f-bed6-116a8dba3e07 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:59.643273 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6856b28-10c8-4a38-8fd1-7287e14fe69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:59.644449 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6856b28-10c8-4a38-8fd1-7287e14fe69d None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:59.644937 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6856b28-10c8-4a38-8fd1-7287e14fe69d None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:59.645409 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6856b28-10c8-4a38-8fd1-7287e14fe69d None admin] PATH_INFO: `/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:59.647847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6856b28-10c8-4a38-8fd1-7287e14fe69d None admin] RBAC: Authorizing `identity:get_project(project_id=0aa8006660fe4334b8ca63e5e2a5d7e0)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:59.649731 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6856b28-10c8-4a38-8fd1-7287e14fe69d None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:59.651878 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 117/231] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:47:59 2022] GET /identity/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:59.658579 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6856b28-10c8-4a38-8fd1-7287e14fe69d None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:59.678797 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6dfa3-85ab-47ab-9eef-4445dba672b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:59.679673 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6dfa3-85ab-47ab-9eef-4445dba672b7 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:59.679959 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6dfa3-85ab-47ab-9eef-4445dba672b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:59.680238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6dfa3-85ab-47ab-9eef-4445dba672b7 None admin] PATH_INFO: `/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:59.681473 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6dfa3-85ab-47ab-9eef-4445dba672b7 None admin] RBAC: Authorizing `identity:get_project(project_id=0aa8006660fe4334b8ca63e5e2a5d7e0)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:59.683004 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6dfa3-85ab-47ab-9eef-4445dba672b7 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:59.685030 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 115/232] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:47:59 2022] GET /identity/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:59.690770 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6dfa3-85ab-47ab-9eef-4445dba672b7 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:47:59.766695 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6856b28-10c8-4a38-8fd1-7287e14fe69d None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:59.798054 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6dfa3-85ab-47ab-9eef-4445dba672b7 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:47:59.803253 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45275c47-0560-4eef-a093-7cdd73c2f7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:59.803918 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45275c47-0560-4eef-a093-7cdd73c2f7f2 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:59.804249 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45275c47-0560-4eef-a093-7cdd73c2f7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:59.804532 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45275c47-0560-4eef-a093-7cdd73c2f7f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:59.805376 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45275c47-0560-4eef-a093-7cdd73c2f7f2 None admin] RBAC: Adding query filter params (role.id=9f25fed676d84770b9dc2a96a769de28, scope.project.id=0aa8006660fe4334b8ca63e5e2a5d7e0, user.id=7191e25fe82c407286c836be2d7dd20d) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:47:59.805692 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45275c47-0560-4eef-a093-7cdd73c2f7f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:59.807194 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45275c47-0560-4eef-a093-7cdd73c2f7f2 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:59.813110 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 118/233] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:47:59 2022] GET /identity/v3/role_assignments?user.id=7191e25fe82c407286c836be2d7dd20d&scope.project.id=0aa8006660fe4334b8ca63e5e2a5d7e0&role.id=9f25fed676d84770b9dc2a96a769de28 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:47:59.847572 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7eed3f-34a8-43ab-97f3-3ac3ca7e11f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:47:59.848487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7eed3f-34a8-43ab-97f3-3ac3ca7e11f1 None admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:47:59.848775 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7eed3f-34a8-43ab-97f3-3ac3ca7e11f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:47:59.849104 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7eed3f-34a8-43ab-97f3-3ac3ca7e11f1 None admin] PATH_INFO: `/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0/users/918641222bf34761b7cce301a9b1eef2/roles/121b12a250ae4ef8ae1a85ea8c21c4fa` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:47:59.851656 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7eed3f-34a8-43ab-97f3-3ac3ca7e11f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=0aa8006660fe4334b8ca63e5e2a5d7e0, user_id=918641222bf34761b7cce301a9b1eef2, role_id=121b12a250ae4ef8ae1a85ea8c21c4fa)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:47:59.853261 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7eed3f-34a8-43ab-97f3-3ac3ca7e11f1 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:47:59.968560 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 116/234] 10.222.0.23 () {58 vars in 1439 bytes} [Sat Apr 30 20:47:59 2022] PUT /identity/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0/users/918641222bf34761b7cce301a9b1eef2/roles/121b12a250ae4ef8ae1a85ea8c21c4fa => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 20:48:02.204631 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d0b2d-6fbf-4d16-9b18-4a2a8aceeb12 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:02.205152 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d0b2d-6fbf-4d16-9b18-4a2a8aceeb12 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:02.205227 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d0b2d-6fbf-4d16-9b18-4a2a8aceeb12 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:02.206831 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 119/235] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:02.212292 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e6f2c-e5a0-4db2-8144-746b086cdac5 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:02.213133 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e6f2c-e5a0-4db2-8144-746b086cdac5 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:02.213636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e6f2c-e5a0-4db2-8144-746b086cdac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:02.231675 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-6f0e6f2c-e5a0-4db2-8144-746b086cdac5 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:02.233310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6f0e6f2c-e5a0-4db2-8144-746b086cdac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:02.311377 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 117/236] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:48:02.336364 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d0b2d-6fbf-4d16-9b18-4a2a8aceeb12 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:02.445185 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d0b2d-6fbf-4d16-9b18-4a2a8aceeb12 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:02.480731 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3265ff-833e-474e-8880-6de716b53e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:02.481480 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3265ff-833e-474e-8880-6de716b53e36 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:02.481791 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3265ff-833e-474e-8880-6de716b53e36 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:02.482114 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3265ff-833e-474e-8880-6de716b53e36 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:02.495169 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3265ff-833e-474e-8880-6de716b53e36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:48:02.503818 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-be3265ff-833e-474e-8880-6de716b53e36 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 30 20:48:02.503818 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:02.503818 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:02.503818 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:02.503818 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:02.503818 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:02.503818 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:02.503818 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:02.503818 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:02.503818 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:02.503818 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:02.503818 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:02.503818 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:48:02.503818 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:48:02.503818 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:48:02.503818 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:48:02.504751 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:48:02.504751 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:48:02.504751 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:48:02.504751 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:48:02.504751 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:02.504751 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:02.504751 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:02.504751 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:02.504751 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:02.504751 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:02.504751 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:02.504751 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:02.504751 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:02.504751 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:02.504751 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:02.504751 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:02.506103 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:02.506103 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:02.506103 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:02.506103 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:02.506103 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:48:02.506103 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:48:02.506103 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:48:02.506103 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:48:02.506103 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:48:02.506103 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:48:02.506103 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Apr 30 20:48:02.506103 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:02.506103 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 120/237] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:48:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:02.512077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e6f2c-e5a0-4db2-8144-746b086cdac5 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:02.532152 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cc77b-b9fd-40a7-87a5-ef0490b13b00 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:02.539777 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cc77b-b9fd-40a7-87a5-ef0490b13b00 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:02.539777 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cc77b-b9fd-40a7-87a5-ef0490b13b00 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:02.539777 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 121/238] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:02.539777 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6879f-f8b3-4337-9f9e-8cbc661fbcbf None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:02.539777 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6879f-f8b3-4337-9f9e-8cbc661fbcbf None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:02.539777 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6879f-f8b3-4337-9f9e-8cbc661fbcbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:02.578804 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-2fa6879f-f8b3-4337-9f9e-8cbc661fbcbf None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:02.580070 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2fa6879f-f8b3-4337-9f9e-8cbc661fbcbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:02.618549 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e6f2c-e5a0-4db2-8144-746b086cdac5 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:02.653872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae4beb-ecbb-44f9-a9d4-b02ca776db94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:02.655545 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae4beb-ecbb-44f9-a9d4-b02ca776db94 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:02.656027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae4beb-ecbb-44f9-a9d4-b02ca776db94 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:02.656513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae4beb-ecbb-44f9-a9d4-b02ca776db94 None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:02.657465 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ae4beb-ecbb-44f9-a9d4-b02ca776db94 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:02.658001 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ae4beb-ecbb-44f9-a9d4-b02ca776db94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:02.659743 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ae4beb-ecbb-44f9-a9d4-b02ca776db94 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:02.669714 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 118/239] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Apr 30 20:48:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:02.671638 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae9e6f-7bee-4e79-9860-1e32a915d39f None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:02.672105 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae9e6f-7bee-4e79-9860-1e32a915d39f None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:02.672531 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 122/240] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:48:02.672666 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae9e6f-7bee-4e79-9860-1e32a915d39f None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:02.674205 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 119/241] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:02.679945 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6879f-f8b3-4337-9f9e-8cbc661fbcbf None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:02.687347 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b242183-0ebb-4997-afdc-cb8e997fdb9b None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:02.687874 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b242183-0ebb-4997-afdc-cb8e997fdb9b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:02.688321 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b242183-0ebb-4997-afdc-cb8e997fdb9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:02.715699 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-4b242183-0ebb-4997-afdc-cb8e997fdb9b None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:02.716923 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4b242183-0ebb-4997-afdc-cb8e997fdb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:02.794111 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 120/242] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:48:02.795035 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b242183-0ebb-4997-afdc-cb8e997fdb9b None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:02.818934 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6879f-f8b3-4337-9f9e-8cbc661fbcbf None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:02.855059 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21845b-26b3-40b2-9b93-c7accba98041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:02.855927 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21845b-26b3-40b2-9b93-c7accba98041 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:02.856211 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21845b-26b3-40b2-9b93-c7accba98041 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:02.856482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21845b-26b3-40b2-9b93-c7accba98041 None admin] PATH_INFO: `/v3/users/47d68f15d1164b15b723c343c4e05191` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:02.869502 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21845b-26b3-40b2-9b93-c7accba98041 None admin] RBAC: Authorizing `identity:get_user(user_id=47d68f15d1164b15b723c343c4e05191)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:02.871037 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21845b-26b3-40b2-9b93-c7accba98041 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:02.873001 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 123/243] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:48:02 2022] GET /identity/v3/users/47d68f15d1164b15b723c343c4e05191 => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:02.874837 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c8c6b-c836-4e67-a290-35d502af9474 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:02.875121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c8c6b-c836-4e67-a290-35d502af9474 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:02.875392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c8c6b-c836-4e67-a290-35d502af9474 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:02.880858 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 124/244] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:02.880858 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c8c6b-c836-4e67-a290-35d502af9474 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:02.901953 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b242183-0ebb-4997-afdc-cb8e997fdb9b None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:02.935771 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ba84b-f057-440d-876e-2f1522404531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:02.937102 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ba84b-f057-440d-876e-2f1522404531 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:02.937405 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ba84b-f057-440d-876e-2f1522404531 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:02.937660 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ba84b-f057-440d-876e-2f1522404531 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:02.947932 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ba84b-f057-440d-876e-2f1522404531 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:48:02.955663 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-617ba84b-f057-440d-876e-2f1522404531 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:48:02.955663 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:02.955663 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:02.955663 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:02.955663 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:02.955663 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:02.955663 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:02.955663 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:02.955663 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:02.955663 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:02.955663 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:02.955663 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:02.955663 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:48:02.955663 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:48:02.955663 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:48:02.955663 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:48:02.956630 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:48:02.956630 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:48:02.956630 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:48:02.956630 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:48:02.956630 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:02.956630 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:02.956630 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:02.956630 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:02.956630 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:02.956630 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:02.956630 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:02.956630 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:02.956630 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:02.956630 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:02.956630 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:02.956630 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:02.957426 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:02.957426 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:02.957426 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:02.957426 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:02.957426 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:48:02.957426 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:48:02.957426 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:48:02.957426 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:48:02.957426 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:48:02.957426 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:48:02.957426 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:48:02.957426 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:02.957426 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 121/245] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Apr 30 20:48:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:02.958636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ba84b-f057-440d-876e-2f1522404531 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:02.979160 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c8c6b-c836-4e67-a290-35d502af9474 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:03.017016 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eca922-a128-4853-ba99-43f1ebd2850d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:03.017847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eca922-a128-4853-ba99-43f1ebd2850d None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:03.018133 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eca922-a128-4853-ba99-43f1ebd2850d None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:03.018405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eca922-a128-4853-ba99-43f1ebd2850d None admin] PATH_INFO: `/v3/domains/default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:03.019688 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eca922-a128-4853-ba99-43f1ebd2850d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:03.021146 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eca922-a128-4853-ba99-43f1ebd2850d None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:03.022802 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 125/246] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:48:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:03.022802 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a4dec-9cf5-471c-b973-9c2186f18c62 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:03.022802 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a4dec-9cf5-471c-b973-9c2186f18c62 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:03.022802 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a4dec-9cf5-471c-b973-9c2186f18c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:03.040220 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-846a4dec-9cf5-471c-b973-9c2186f18c62 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:03.041396 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-846a4dec-9cf5-471c-b973-9c2186f18c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:03.059770 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ba84b-f057-440d-876e-2f1522404531 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:03.091006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8321243-1421-4e28-bb70-c07bc3890ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:03.091764 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8321243-1421-4e28-bb70-c07bc3890ee6 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:03.092044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8321243-1421-4e28-bb70-c07bc3890ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:03.092314 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8321243-1421-4e28-bb70-c07bc3890ee6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:03.104166 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 126/247] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:48:03.106770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343906c2-f5ab-416a-a8be-94695d635243 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:03.106770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343906c2-f5ab-416a-a8be-94695d635243 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:03.106770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343906c2-f5ab-416a-a8be-94695d635243 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:03.107392 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 127/248] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:03.109612 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343906c2-f5ab-416a-a8be-94695d635243 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:03.165322 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8321243-1421-4e28-bb70-c07bc3890ee6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:03.166889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8321243-1421-4e28-bb70-c07bc3890ee6 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:03.206253 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343906c2-f5ab-416a-a8be-94695d635243 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:03.239084 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f39fe-477e-4e8e-bf9b-6e2659e00fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:03.239753 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f39fe-477e-4e8e-bf9b-6e2659e00fd7 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:03.240039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f39fe-477e-4e8e-bf9b-6e2659e00fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:03.240320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f39fe-477e-4e8e-bf9b-6e2659e00fd7 None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:03.241065 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f39fe-477e-4e8e-bf9b-6e2659e00fd7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:03.241376 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f39fe-477e-4e8e-bf9b-6e2659e00fd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:03.242814 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f39fe-477e-4e8e-bf9b-6e2659e00fd7 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:03.250663 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 128/249] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:48:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:03.251428 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f39fe-477e-4e8e-bf9b-6e2659e00fd7 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:03.265551 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 122/250] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:48:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:48:03.265551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542970d0-1080-47ef-8007-3955ec2c9ddc None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:03.265551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542970d0-1080-47ef-8007-3955ec2c9ddc None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:03.265551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542970d0-1080-47ef-8007-3955ec2c9ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:03.280067 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-542970d0-1080-47ef-8007-3955ec2c9ddc None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:03.281265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-542970d0-1080-47ef-8007-3955ec2c9ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:03.346360 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f39fe-477e-4e8e-bf9b-6e2659e00fd7 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:03.346686 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 123/251] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:48:03.347189 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542970d0-1080-47ef-8007-3955ec2c9ddc None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:03.379989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f834ad5-528c-4873-ab40-aa2de60caa02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:03.380657 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f834ad5-528c-4873-ab40-aa2de60caa02 None admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:03.380942 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f834ad5-528c-4873-ab40-aa2de60caa02 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:03.381220 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f834ad5-528c-4873-ab40-aa2de60caa02 None admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:03.382073 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f834ad5-528c-4873-ab40-aa2de60caa02 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:03.383487 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f834ad5-528c-4873-ab40-aa2de60caa02 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:03.439741 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542970d0-1080-47ef-8007-3955ec2c9ddc None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:03.458735 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 129/252] 10.222.0.23 () {60 vars in 1132 bytes} [Sat Apr 30 20:48:03 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:48:03.466700 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f834ad5-528c-4873-ab40-aa2de60caa02 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:03.474076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be8f66c-75a2-4410-b83d-1ff6a8bb89ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:03.475079 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8f66c-75a2-4410-b83d-1ff6a8bb89ac None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:03.475370 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8f66c-75a2-4410-b83d-1ff6a8bb89ac None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:03.475643 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8f66c-75a2-4410-b83d-1ff6a8bb89ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:03.487981 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be8f66c-75a2-4410-b83d-1ff6a8bb89ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:48:03.496217 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-7be8f66c-75a2-4410-b83d-1ff6a8bb89ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:48:03.496217 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:03.496217 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:03.496217 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:03.496217 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:03.496217 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:03.496217 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:03.496217 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:03.496217 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:03.496217 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:03.496217 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:03.496217 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:03.496217 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:48:03.496217 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:48:03.496217 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:48:03.496217 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:48:03.497181 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:48:03.497181 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:48:03.497181 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:48:03.497181 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:48:03.497181 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:03.497181 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:03.497181 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:03.497181 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:03.497181 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:03.497181 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:03.497181 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:03.497181 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:03.497181 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:03.497181 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:03.497181 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:03.497181 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:03.498058 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:03.498058 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:03.498058 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:03.498058 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:03.498058 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:48:03.498058 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:48:03.498058 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:48:03.498058 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:48:03.498058 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:48:03.498058 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:48:03.498058 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:48:03.498058 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:03.498058 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 124/253] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:48:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:03.501934 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be8f66c-75a2-4410-b83d-1ff6a8bb89ac None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:03.587056 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f834ad5-528c-4873-ab40-aa2de60caa02 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:03.607433 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be8f66c-75a2-4410-b83d-1ff6a8bb89ac None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:03.629508 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90747bba-9ca2-41da-b255-50ef4e410097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:03.630430 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90747bba-9ca2-41da-b255-50ef4e410097 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:03.630712 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90747bba-9ca2-41da-b255-50ef4e410097 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:03.631045 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90747bba-9ca2-41da-b255-50ef4e410097 None admin] PATH_INFO: `/v3/users/918641222bf34761b7cce301a9b1eef2` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:03.632302 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90747bba-9ca2-41da-b255-50ef4e410097 None admin] RBAC: Authorizing `identity:get_user(user_id=918641222bf34761b7cce301a9b1eef2)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:03.633820 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90747bba-9ca2-41da-b255-50ef4e410097 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:03.635665 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 130/254] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:48:03 2022] GET /identity/v3/users/918641222bf34761b7cce301a9b1eef2 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:03.636283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90747bba-9ca2-41da-b255-50ef4e410097 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:03.648231 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914647e-0dc3-4d6e-b4c6-586b90c27b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:03.648810 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914647e-0dc3-4d6e-b4c6-586b90c27b79 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:03.649088 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914647e-0dc3-4d6e-b4c6-586b90c27b79 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:03.649352 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914647e-0dc3-4d6e-b4c6-586b90c27b79 None admin] PATH_INFO: `/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:03.650571 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b914647e-0dc3-4d6e-b4c6-586b90c27b79 None admin] RBAC: Authorizing `identity:get_project(project_id=0aa8006660fe4334b8ca63e5e2a5d7e0)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:03.652039 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b914647e-0dc3-4d6e-b4c6-586b90c27b79 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:03.653891 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 125/255] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:48:03 2022] GET /identity/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:03.659817 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914647e-0dc3-4d6e-b4c6-586b90c27b79 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:03.750320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90747bba-9ca2-41da-b255-50ef4e410097 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:03.771686 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914647e-0dc3-4d6e-b4c6-586b90c27b79 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:03.789681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3fbc5-579e-44e1-9da6-db6078fdb6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:03.792212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3fbc5-579e-44e1-9da6-db6078fdb6f9 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:03.792212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3fbc5-579e-44e1-9da6-db6078fdb6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:03.792212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3fbc5-579e-44e1-9da6-db6078fdb6f9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:03.804851 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc3fbc5-579e-44e1-9da6-db6078fdb6f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:48:03.813291 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-ecc3fbc5-579e-44e1-9da6-db6078fdb6f9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:48:03.813291 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:03.813291 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:03.813291 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:03.813291 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:03.813291 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:03.813291 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:03.813291 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:03.813291 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:03.813291 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:03.813291 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:03.813291 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:03.813291 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:48:03.813291 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:48:03.813291 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:48:03.813291 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:48:03.814237 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:48:03.814237 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:48:03.814237 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:48:03.814237 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:48:03.814237 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:03.814237 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:03.814237 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:03.814237 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:03.814237 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:03.814237 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:03.814237 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:03.814237 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:03.814237 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:03.814237 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:03.814237 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:03.814237 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:03.815030 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:03.815030 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:03.815030 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:03.815030 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:03.815030 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:48:03.815030 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:48:03.815030 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:48:03.815030 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:48:03.815030 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:48:03.815030 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:48:03.815030 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:48:03.815030 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:03.815030 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 131/256] 10.222.0.23 () {56 vars in 1114 bytes} [Sat Apr 30 20:48:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:03.815664 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3fbc5-579e-44e1-9da6-db6078fdb6f9 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:03.820278 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6d13d-7657-4f6e-a3e7-bca651847a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:03.820994 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6d13d-7657-4f6e-a3e7-bca651847a47 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:03.821277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6d13d-7657-4f6e-a3e7-bca651847a47 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:03.821553 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6d13d-7657-4f6e-a3e7-bca651847a47 None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:03.822523 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a6d13d-7657-4f6e-a3e7-bca651847a47 None admin] RBAC: Adding query filter params (name=member) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:03.822834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a6d13d-7657-4f6e-a3e7-bca651847a47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:03.824530 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a6d13d-7657-4f6e-a3e7-bca651847a47 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:03.834703 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 126/257] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Apr 30 20:48:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:03.835375 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6d13d-7657-4f6e-a3e7-bca651847a47 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:03.924629 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3fbc5-579e-44e1-9da6-db6078fdb6f9 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:03.960833 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6d13d-7657-4f6e-a3e7-bca651847a47 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:03.961281 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d9916-1795-437b-89de-09487f92eaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:03.961967 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d9916-1795-437b-89de-09487f92eaa8 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:03.962250 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d9916-1795-437b-89de-09487f92eaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:03.962603 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d9916-1795-437b-89de-09487f92eaa8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:03.999467 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c37af4-8943-4e5d-9baf-fec5508e9b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:04.000173 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c37af4-8943-4e5d-9baf-fec5508e9b61 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:04.000453 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c37af4-8943-4e5d-9baf-fec5508e9b61 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:04.000776 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c37af4-8943-4e5d-9baf-fec5508e9b61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:04.001605 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c37af4-8943-4e5d-9baf-fec5508e9b61 None admin] RBAC: Adding query filter params (role.id=df4ebd23bc804a629fbb7b2dad89c96a, scope.project.id=0aa8006660fe4334b8ca63e5e2a5d7e0, user.id=47d68f15d1164b15b723c343c4e05191) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:04.001947 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c37af4-8943-4e5d-9baf-fec5508e9b61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:04.003394 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c37af4-8943-4e5d-9baf-fec5508e9b61 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:04.009262 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 127/258] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:48:03 2022] GET /identity/v3/role_assignments?user.id=47d68f15d1164b15b723c343c4e05191&scope.project.id=0aa8006660fe4334b8ca63e5e2a5d7e0&role.id=df4ebd23bc804a629fbb7b2dad89c96a => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:04.017253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c37af4-8943-4e5d-9baf-fec5508e9b61 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:04.034306 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d9916-1795-437b-89de-09487f92eaa8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:04.035814 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d9916-1795-437b-89de-09487f92eaa8 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:04.214447 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c37af4-8943-4e5d-9baf-fec5508e9b61 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:04.233517 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 132/259] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:48:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:48:04.234507 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d9916-1795-437b-89de-09487f92eaa8 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:04.295072 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef1b363-ac37-456d-94f4-7d0f0001fa44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:04.295917 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1b363-ac37-456d-94f4-7d0f0001fa44 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:04.296202 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1b363-ac37-456d-94f4-7d0f0001fa44 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:04.296472 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1b363-ac37-456d-94f4-7d0f0001fa44 None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:04.297227 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef1b363-ac37-456d-94f4-7d0f0001fa44 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:04.297531 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef1b363-ac37-456d-94f4-7d0f0001fa44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:04.298953 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef1b363-ac37-456d-94f4-7d0f0001fa44 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:04.316988 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 128/260] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:48:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:04.317837 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef1b363-ac37-456d-94f4-7d0f0001fa44 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:04.337618 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d9916-1795-437b-89de-09487f92eaa8 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:04.374842 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416c45d-e29c-416f-8c3b-5ec3bb1cf1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:04.375720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416c45d-e29c-416f-8c3b-5ec3bb1cf1f4 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:04.376001 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416c45d-e29c-416f-8c3b-5ec3bb1cf1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:04.376276 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416c45d-e29c-416f-8c3b-5ec3bb1cf1f4 None admin] PATH_INFO: `/v3/users/7191e25fe82c407286c836be2d7dd20d` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:04.377497 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4416c45d-e29c-416f-8c3b-5ec3bb1cf1f4 None admin] RBAC: Authorizing `identity:get_user(user_id=7191e25fe82c407286c836be2d7dd20d)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:04.379002 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4416c45d-e29c-416f-8c3b-5ec3bb1cf1f4 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:04.380807 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 133/261] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:48:04 2022] GET /identity/v3/users/7191e25fe82c407286c836be2d7dd20d => generated 297 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:04.381485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416c45d-e29c-416f-8c3b-5ec3bb1cf1f4 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:04.448576 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef1b363-ac37-456d-94f4-7d0f0001fa44 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:04.485224 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f51f34-0a71-4b7f-9b6b-338e2b697b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:04.485418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416c45d-e29c-416f-8c3b-5ec3bb1cf1f4 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:04.486582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f51f34-0a71-4b7f-9b6b-338e2b697b53 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:04.487075 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f51f34-0a71-4b7f-9b6b-338e2b697b53 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:04.487547 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f51f34-0a71-4b7f-9b6b-338e2b697b53 None admin] PATH_INFO: `/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:04.488950 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f51f34-0a71-4b7f-9b6b-338e2b697b53 None admin] RBAC: Authorizing `identity:get_project(project_id=0aa8006660fe4334b8ca63e5e2a5d7e0)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:04.497794 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f51f34-0a71-4b7f-9b6b-338e2b697b53 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:04.500013 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 129/262] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:48:04 2022] GET /identity/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:04.501038 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f51f34-0a71-4b7f-9b6b-338e2b697b53 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:04.525608 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2e27a-10df-4549-8c94-054697759a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:04.526526 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2e27a-10df-4549-8c94-054697759a56 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:04.526807 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2e27a-10df-4549-8c94-054697759a56 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:04.527082 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2e27a-10df-4549-8c94-054697759a56 None admin] PATH_INFO: `/v3/users/918641222bf34761b7cce301a9b1eef2` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:04.528297 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2e27a-10df-4549-8c94-054697759a56 None admin] RBAC: Authorizing `identity:get_user(user_id=918641222bf34761b7cce301a9b1eef2)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:04.529770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2e27a-10df-4549-8c94-054697759a56 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:04.531473 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 134/263] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:48:04 2022] GET /identity/v3/users/918641222bf34761b7cce301a9b1eef2 => generated 283 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:04.532323 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2e27a-10df-4549-8c94-054697759a56 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:04.675726 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f51f34-0a71-4b7f-9b6b-338e2b697b53 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:04.700431 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2e27a-10df-4549-8c94-054697759a56 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:04.743592 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ac6bb-41e0-44c5-bbe9-5438ddff1b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:04.744180 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ac6bb-41e0-44c5-bbe9-5438ddff1b3c None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:04.744463 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ac6bb-41e0-44c5-bbe9-5438ddff1b3c None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:04.744736 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ac6bb-41e0-44c5-bbe9-5438ddff1b3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:04.745570 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ac6bb-41e0-44c5-bbe9-5438ddff1b3c None admin] RBAC: Adding query filter params (role.id=30112eb1f3e047398c3c82fb40b72e62, scope.project.id=0aa8006660fe4334b8ca63e5e2a5d7e0, user.id=918641222bf34761b7cce301a9b1eef2) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:04.745908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ac6bb-41e0-44c5-bbe9-5438ddff1b3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:04.747374 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ac6bb-41e0-44c5-bbe9-5438ddff1b3c None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:04.750452 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0814d80-af88-4922-ada0-c085b603e4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:04.751308 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0814d80-af88-4922-ada0-c085b603e4e9 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:04.751584 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0814d80-af88-4922-ada0-c085b603e4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:04.751855 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0814d80-af88-4922-ada0-c085b603e4e9 None admin] PATH_INFO: `/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:04.753083 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0814d80-af88-4922-ada0-c085b603e4e9 None admin] RBAC: Authorizing `identity:get_project(project_id=0aa8006660fe4334b8ca63e5e2a5d7e0)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:04.754561 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0814d80-af88-4922-ada0-c085b603e4e9 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:04.756249 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 130/264] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:48:04 2022] GET /identity/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0 => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:04.758301 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0814d80-af88-4922-ada0-c085b603e4e9 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:04.777900 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 135/265] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:48:04 2022] GET /identity/v3/role_assignments?user.id=918641222bf34761b7cce301a9b1eef2&scope.project.id=0aa8006660fe4334b8ca63e5e2a5d7e0&role.id=30112eb1f3e047398c3c82fb40b72e62 => generated 608 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:04.779114 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ac6bb-41e0-44c5-bbe9-5438ddff1b3c None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:04.961583 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0814d80-af88-4922-ada0-c085b603e4e9 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:05.012032 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5daf9e8-8330-4673-a4fa-5d960c207113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:05.012610 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5daf9e8-8330-4673-a4fa-5d960c207113 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:05.012891 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5daf9e8-8330-4673-a4fa-5d960c207113 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:05.013164 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5daf9e8-8330-4673-a4fa-5d960c207113 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:05.057464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ac6bb-41e0-44c5-bbe9-5438ddff1b3c None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:05.084170 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5daf9e8-8330-4673-a4fa-5d960c207113 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:05.085652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5daf9e8-8330-4673-a4fa-5d960c207113 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:05.139021 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912047a4-be73-4867-a0c5-42729852adbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:05.140025 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912047a4-be73-4867-a0c5-42729852adbc None admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:05.140307 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912047a4-be73-4867-a0c5-42729852adbc None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:05.140581 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912047a4-be73-4867-a0c5-42729852adbc None admin] PATH_INFO: `/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0/users/7191e25fe82c407286c836be2d7dd20d/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:05.147348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912047a4-be73-4867-a0c5-42729852adbc None admin] RBAC: Authorizing `identity:create_grant(project_id=0aa8006660fe4334b8ca63e5e2a5d7e0, user_id=7191e25fe82c407286c836be2d7dd20d, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:05.148840 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912047a4-be73-4867-a0c5-42729852adbc None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:05.189950 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 131/266] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:48:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:48:05.195516 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5daf9e8-8330-4673-a4fa-5d960c207113 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:05.293402 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5daf9e8-8330-4673-a4fa-5d960c207113 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:05.327716 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79888ad6-d87e-4c17-888c-78fc6e7aaa19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:05.328574 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79888ad6-d87e-4c17-888c-78fc6e7aaa19 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:05.328852 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79888ad6-d87e-4c17-888c-78fc6e7aaa19 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:05.329123 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79888ad6-d87e-4c17-888c-78fc6e7aaa19 None admin] PATH_INFO: `/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:05.330341 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79888ad6-d87e-4c17-888c-78fc6e7aaa19 None admin] RBAC: Authorizing `identity:get_project(project_id=0aa8006660fe4334b8ca63e5e2a5d7e0)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:05.331789 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79888ad6-d87e-4c17-888c-78fc6e7aaa19 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:05.332227 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 136/267] 10.222.0.23 () {58 vars in 1439 bytes} [Sat Apr 30 20:48:04 2022] PUT /identity/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0/users/7191e25fe82c407286c836be2d7dd20d/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:48:05.333708 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 132/268] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:48:05 2022] GET /identity/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:48:05.339739 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912047a4-be73-4867-a0c5-42729852adbc None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:05.448625 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912047a4-be73-4867-a0c5-42729852adbc None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:05.485040 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33c7e1-ba83-42ee-82ea-e683c81e55c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:05.485711 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33c7e1-ba83-42ee-82ea-e683c81e55c9 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:05.486021 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33c7e1-ba83-42ee-82ea-e683c81e55c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:05.486297 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33c7e1-ba83-42ee-82ea-e683c81e55c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:05.487140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33c7e1-ba83-42ee-82ea-e683c81e55c9 None admin] RBAC: Adding query filter params (role.id=121b12a250ae4ef8ae1a85ea8c21c4fa, scope.project.id=0aa8006660fe4334b8ca63e5e2a5d7e0, user.id=918641222bf34761b7cce301a9b1eef2) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:05.487452 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33c7e1-ba83-42ee-82ea-e683c81e55c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:05.488917 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33c7e1-ba83-42ee-82ea-e683c81e55c9 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:05.496140 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 137/269] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:48:05 2022] GET /identity/v3/role_assignments?user.id=918641222bf34761b7cce301a9b1eef2&scope.project.id=0aa8006660fe4334b8ca63e5e2a5d7e0&role.id=121b12a250ae4ef8ae1a85ea8c21c4fa => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:06.248826 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5980203-acd1-448b-85e2-09b3d63dc3c2 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:06.249138 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5980203-acd1-448b-85e2-09b3d63dc3c2 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:06.249410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5980203-acd1-448b-85e2-09b3d63dc3c2 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:06.251108 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 133/270] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:06.256328 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128526a2-db5d-4527-980a-015c95bf53dd None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:06.256622 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128526a2-db5d-4527-980a-015c95bf53dd None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:06.256900 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128526a2-db5d-4527-980a-015c95bf53dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:06.274166 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-128526a2-db5d-4527-980a-015c95bf53dd None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:06.275345 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-128526a2-db5d-4527-980a-015c95bf53dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:06.349914 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 138/271] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:48:06.368327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5980203-acd1-448b-85e2-09b3d63dc3c2 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:06.399853 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701f8e1-012a-40e3-9dfc-f8b608d11d2a None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:06.400165 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701f8e1-012a-40e3-9dfc-f8b608d11d2a None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:06.400413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701f8e1-012a-40e3-9dfc-f8b608d11d2a None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:06.401942 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 139/272] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:06.407274 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf6a9c-2204-410b-9e74-ddb90c3f43d3 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:06.407559 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf6a9c-2204-410b-9e74-ddb90c3f43d3 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:06.407835 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf6a9c-2204-410b-9e74-ddb90c3f43d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:06.425228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-70cf6a9c-2204-410b-9e74-ddb90c3f43d3 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:06.426460 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-70cf6a9c-2204-410b-9e74-ddb90c3f43d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:06.481990 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5980203-acd1-448b-85e2-09b3d63dc3c2 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:06.502201 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 140/273] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:48:06.517216 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a48f7-aec9-4a18-87a4-3e74a0e7669d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:06.518388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a48f7-aec9-4a18-87a4-3e74a0e7669d None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:06.518902 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a48f7-aec9-4a18-87a4-3e74a0e7669d None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:06.519477 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a48f7-aec9-4a18-87a4-3e74a0e7669d None admin] PATH_INFO: `/v3/roles/member` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:06.520445 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf6a9c-2204-410b-9e74-ddb90c3f43d3 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:06.531473 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a48f7-aec9-4a18-87a4-3e74a0e7669d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:48:06.539652 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-d27a48f7-aec9-4a18-87a4-3e74a0e7669d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:48:06.539652 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:06.539652 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:06.539652 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:06.539652 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:06.539652 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:06.539652 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:06.539652 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:06.539652 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:06.539652 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:06.539652 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:06.539652 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:06.539652 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:48:06.539652 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:48:06.539652 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:48:06.539652 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:48:06.540555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:48:06.540555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:48:06.540555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:48:06.540555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:48:06.540555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:06.540555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:06.540555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:06.540555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:06.540555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:06.540555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:06.540555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:06.540555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:06.540555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:06.540555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:06.540555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:06.540555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:06.541368 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:06.541368 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:06.541368 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:06.541368 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:06.541368 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:48:06.541368 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:48:06.541368 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:48:06.541368 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:48:06.541368 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:48:06.541368 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:48:06.541368 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:48:06.541368 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:06.543445 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 134/274] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:48:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:06.549793 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a48f7-aec9-4a18-87a4-3e74a0e7669d None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:06.642257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf6a9c-2204-410b-9e74-ddb90c3f43d3 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:06.677565 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a48f7-aec9-4a18-87a4-3e74a0e7669d None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:06.683932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe61548-2c5b-4195-830d-d029da2193ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:06.684792 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe61548-2c5b-4195-830d-d029da2193ff None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:06.685070 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe61548-2c5b-4195-830d-d029da2193ff None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:06.685338 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe61548-2c5b-4195-830d-d029da2193ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:06.686770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe61548-2c5b-4195-830d-d029da2193ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:06.688758 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe61548-2c5b-4195-830d-d029da2193ff None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:06.696487 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 141/275] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:48:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:48:06.698052 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe61548-2c5b-4195-830d-d029da2193ff None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:06.722144 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46233fc-94cf-4e20-8fac-1fa376e4f550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:06.722867 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46233fc-94cf-4e20-8fac-1fa376e4f550 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:06.723144 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46233fc-94cf-4e20-8fac-1fa376e4f550 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:06.723413 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46233fc-94cf-4e20-8fac-1fa376e4f550 None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:06.724197 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46233fc-94cf-4e20-8fac-1fa376e4f550 None admin] RBAC: Adding query filter params (name=member) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:06.724502 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46233fc-94cf-4e20-8fac-1fa376e4f550 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:06.726117 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46233fc-94cf-4e20-8fac-1fa376e4f550 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:06.737821 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 135/276] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Apr 30 20:48:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:06.743037 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46233fc-94cf-4e20-8fac-1fa376e4f550 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:06.814669 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe61548-2c5b-4195-830d-d029da2193ff None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:06.850958 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb8755-9e76-45df-9b5c-38bc89f5d31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:06.851656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb8755-9e76-45df-9b5c-38bc89f5d31f None admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:06.851935 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb8755-9e76-45df-9b5c-38bc89f5d31f None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:06.852206 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb8755-9e76-45df-9b5c-38bc89f5d31f None admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:06.852901 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb8755-9e76-45df-9b5c-38bc89f5d31f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:06.854383 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb8755-9e76-45df-9b5c-38bc89f5d31f None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:06.856282 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46233fc-94cf-4e20-8fac-1fa376e4f550 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:06.887683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca0ed4-31ac-4891-823b-88ec24b48f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:06.888531 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca0ed4-31ac-4891-823b-88ec24b48f6e None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:06.888807 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca0ed4-31ac-4891-823b-88ec24b48f6e None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:06.889076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca0ed4-31ac-4891-823b-88ec24b48f6e None admin] PATH_INFO: `/v3/users/43447c6abd5e46f6b7cc8d724bcf44da` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:06.903186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ca0ed4-31ac-4891-823b-88ec24b48f6e None admin] RBAC: Authorizing `identity:get_user(user_id=43447c6abd5e46f6b7cc8d724bcf44da)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:06.904643 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ca0ed4-31ac-4891-823b-88ec24b48f6e None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:06.906860 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 136/277] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:48:06 2022] GET /identity/v3/users/43447c6abd5e46f6b7cc8d724bcf44da => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:48:06.908027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22ed60-5d63-4aac-bc5c-1709d649c270 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:06.908309 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22ed60-5d63-4aac-bc5c-1709d649c270 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:06.908576 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22ed60-5d63-4aac-bc5c-1709d649c270 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:06.910016 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 137/278] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:06.912604 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c22ed60-5d63-4aac-bc5c-1709d649c270 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:06.969399 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 142/279] 10.222.0.23 () {60 vars in 1132 bytes} [Sat Apr 30 20:48:06 2022] POST /identity/v3/users => generated 293 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 20:48:06.979434 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7a37f-4158-499b-b983-cb5e73e16fbc None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:06.979723 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7a37f-4158-499b-b983-cb5e73e16fbc None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:06.979998 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7a37f-4158-499b-b983-cb5e73e16fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:07.018791 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-5eb7a37f-4158-499b-b983-cb5e73e16fbc None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:07.019218 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c22ed60-5d63-4aac-bc5c-1709d649c270 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:07.020077 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5eb7a37f-4158-499b-b983-cb5e73e16fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:07.063705 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c455ea-ec93-44d8-b6f6-35a761652f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:07.065805 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c455ea-ec93-44d8-b6f6-35a761652f5e None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:07.066364 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c455ea-ec93-44d8-b6f6-35a761652f5e None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:07.066851 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c455ea-ec93-44d8-b6f6-35a761652f5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:07.067893 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c455ea-ec93-44d8-b6f6-35a761652f5e None admin] RBAC: Adding query filter params (role.id=9f25fed676d84770b9dc2a96a769de28, user.id=43447c6abd5e46f6b7cc8d724bcf44da, scope.system=all) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:07.068452 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c455ea-ec93-44d8-b6f6-35a761652f5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:07.070872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c455ea-ec93-44d8-b6f6-35a761652f5e None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:07.086023 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 138/280] 10.222.0.23 () {56 vars in 1308 bytes} [Sat Apr 30 20:48:06 2022] GET /identity/v3/role_assignments?user.id=43447c6abd5e46f6b7cc8d724bcf44da&scope.system=all&role.id=9f25fed676d84770b9dc2a96a769de28 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:07.109006 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 143/281] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:48:07.133967 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c455ea-ec93-44d8-b6f6-35a761652f5e None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:07.248524 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c455ea-ec93-44d8-b6f6-35a761652f5e None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:07.287702 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288bc35-8f88-4e7b-bd63-f7897b66ee4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:07.288497 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288bc35-8f88-4e7b-bd63-f7897b66ee4b None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:07.288774 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288bc35-8f88-4e7b-bd63-f7897b66ee4b None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:07.289045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288bc35-8f88-4e7b-bd63-f7897b66ee4b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:07.300636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288bc35-8f88-4e7b-bd63-f7897b66ee4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:48:07.308781 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-3288bc35-8f88-4e7b-bd63-f7897b66ee4b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 30 20:48:07.308781 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:07.308781 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:07.308781 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:07.308781 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:07.308781 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:07.308781 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:07.308781 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:07.308781 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:07.308781 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:07.308781 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:07.308781 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:07.308781 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:48:07.308781 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:48:07.308781 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:48:07.308781 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:48:07.309858 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:48:07.309858 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:48:07.309858 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:48:07.309858 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:48:07.309858 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:07.309858 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:07.309858 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:07.309858 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:07.309858 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:07.309858 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:07.309858 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:07.309858 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:07.309858 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:07.309858 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:07.309858 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:07.309858 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:07.310693 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:07.310693 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:07.310693 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:07.310693 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:07.310693 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:48:07.310693 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:48:07.310693 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:48:07.310693 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:48:07.310693 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:48:07.310693 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:48:07.310693 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Apr 30 20:48:07.310693 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:07.313973 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 139/282] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:48:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:07.320620 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb7a37f-4158-499b-b983-cb5e73e16fbc None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:07.430984 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb7a37f-4158-499b-b983-cb5e73e16fbc None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:07.465917 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e9671-7529-42fe-ae83-b8060d3e6229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:07.466658 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e9671-7529-42fe-ae83-b8060d3e6229 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:07.466944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e9671-7529-42fe-ae83-b8060d3e6229 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:07.467219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e9671-7529-42fe-ae83-b8060d3e6229 None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:07.468069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e9671-7529-42fe-ae83-b8060d3e6229 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:07.468378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e9671-7529-42fe-ae83-b8060d3e6229 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:07.469877 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e9671-7529-42fe-ae83-b8060d3e6229 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:07.481452 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 144/283] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Apr 30 20:48:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:07.485342 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288bc35-8f88-4e7b-bd63-f7897b66ee4b None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:07.671315 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288bc35-8f88-4e7b-bd63-f7897b66ee4b None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:07.715672 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6a1c4-bba2-4be4-8ce7-7ad1793f33b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:07.716597 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6a1c4-bba2-4be4-8ce7-7ad1793f33b5 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:07.716880 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6a1c4-bba2-4be4-8ce7-7ad1793f33b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:07.717155 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6a1c4-bba2-4be4-8ce7-7ad1793f33b5 None admin] PATH_INFO: `/v3/users/47d68f15d1164b15b723c343c4e05191` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:07.722312 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6a1c4-bba2-4be4-8ce7-7ad1793f33b5 None admin] RBAC: Authorizing `identity:get_user(user_id=47d68f15d1164b15b723c343c4e05191)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:07.723784 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6a1c4-bba2-4be4-8ce7-7ad1793f33b5 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:07.726409 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 140/284] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:48:07 2022] GET /identity/v3/users/47d68f15d1164b15b723c343c4e05191 => generated 297 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:07.731285 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e9671-7529-42fe-ae83-b8060d3e6229 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:07.872755 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e9671-7529-42fe-ae83-b8060d3e6229 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:07.921135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00345b7-62a7-49cf-8f21-b85caf6194f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:07.922090 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00345b7-62a7-49cf-8f21-b85caf6194f9 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:07.922318 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00345b7-62a7-49cf-8f21-b85caf6194f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:07.922592 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00345b7-62a7-49cf-8f21-b85caf6194f9 None admin] PATH_INFO: `/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:07.926491 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00345b7-62a7-49cf-8f21-b85caf6194f9 None admin] RBAC: Authorizing `identity:get_project(project_id=0aa8006660fe4334b8ca63e5e2a5d7e0)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:07.927979 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00345b7-62a7-49cf-8f21-b85caf6194f9 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:07.930026 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 145/285] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:48:07 2022] GET /identity/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:07.935598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6a1c4-bba2-4be4-8ce7-7ad1793f33b5 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:08.024486 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a9799-7d83-4965-a557-162504ba827c None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:08.024804 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a9799-7d83-4965-a557-162504ba827c None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:08.025052 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a9799-7d83-4965-a557-162504ba827c None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:08.026485 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 146/286] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:48:08.035048 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdfa23-112f-448f-b9d7-8fde7e14fe0b None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:08.035342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdfa23-112f-448f-b9d7-8fde7e14fe0b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:08.035975 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdfa23-112f-448f-b9d7-8fde7e14fe0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:08.071551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6a1c4-bba2-4be4-8ce7-7ad1793f33b5 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:08.074861 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-fcbdfa23-112f-448f-b9d7-8fde7e14fe0b None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:08.076086 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-fcbdfa23-112f-448f-b9d7-8fde7e14fe0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:08.115183 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889c58a-b458-4c42-bf73-91c506061c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:08.116389 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889c58a-b458-4c42-bf73-91c506061c9e None admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:08.116816 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889c58a-b458-4c42-bf73-91c506061c9e None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:08.117249 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889c58a-b458-4c42-bf73-91c506061c9e None admin] PATH_INFO: `/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0/users/47d68f15d1164b15b723c343c4e05191/roles/df4ebd23bc804a629fbb7b2dad89c96a` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:08.120467 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9889c58a-b458-4c42-bf73-91c506061c9e None admin] RBAC: Authorizing `identity:create_grant(project_id=0aa8006660fe4334b8ca63e5e2a5d7e0, user_id=47d68f15d1164b15b723c343c4e05191, role_id=df4ebd23bc804a629fbb7b2dad89c96a)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:08.124743 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9889c58a-b458-4c42-bf73-91c506061c9e None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:08.175625 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 147/287] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Apr 30 20:48:08.200924 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdfa23-112f-448f-b9d7-8fde7e14fe0b None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:08.222505 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 141/288] 10.222.0.23 () {58 vars in 1439 bytes} [Sat Apr 30 20:48:07 2022] PUT /identity/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0/users/47d68f15d1164b15b723c343c4e05191/roles/df4ebd23bc804a629fbb7b2dad89c96a => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:48:08.310907 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdfa23-112f-448f-b9d7-8fde7e14fe0b None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:08.357537 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f9dcb-642a-4c43-864c-77cdee0121c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:08.358941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f9dcb-642a-4c43-864c-77cdee0121c8 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:08.359218 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f9dcb-642a-4c43-864c-77cdee0121c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:08.359490 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f9dcb-642a-4c43-864c-77cdee0121c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:08.371878 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f9dcb-642a-4c43-864c-77cdee0121c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:48:08.380768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-441f9dcb-642a-4c43-864c-77cdee0121c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:48:08.380768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:08.380768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:08.380768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:08.380768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:08.380768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:08.380768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:08.380768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:08.380768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:08.380768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:08.380768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:08.380768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:08.380768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:48:08.380768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:48:08.380768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:48:08.380768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:48:08.381740 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:48:08.381740 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:48:08.381740 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:48:08.381740 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:48:08.381740 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:08.381740 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:08.381740 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:08.381740 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:08.381740 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:08.381740 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:08.381740 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:08.381740 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:08.381740 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:08.381740 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:08.381740 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:08.381740 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:08.382549 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:08.382549 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:08.382549 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:08.382549 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:08.382549 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:48:08.382549 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:48:08.382549 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:48:08.382549 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:48:08.382549 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:48:08.382549 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:48:08.382549 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:48:08.382549 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:08.382549 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 148/289] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:48:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:48:08.390917 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889c58a-b458-4c42-bf73-91c506061c9e None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:08.526150 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889c58a-b458-4c42-bf73-91c506061c9e None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:08.561910 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a771b1bd-cdc6-4d5b-8965-5fab308e9d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:08.562645 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771b1bd-cdc6-4d5b-8965-5fab308e9d51 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:08.562933 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771b1bd-cdc6-4d5b-8965-5fab308e9d51 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:08.563205 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771b1bd-cdc6-4d5b-8965-5fab308e9d51 None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:08.563958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a771b1bd-cdc6-4d5b-8965-5fab308e9d51 None admin] RBAC: Adding query filter params (name=member) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:08.564263 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a771b1bd-cdc6-4d5b-8965-5fab308e9d51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:08.565691 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a771b1bd-cdc6-4d5b-8965-5fab308e9d51 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:08.574526 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 142/290] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Apr 30 20:48:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:08.581193 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f9dcb-642a-4c43-864c-77cdee0121c8 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:08.699227 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f9dcb-642a-4c43-864c-77cdee0121c8 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:08.740960 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778880c-115d-41ec-a302-ab871fa525c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:08.742216 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778880c-115d-41ec-a302-ab871fa525c1 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:08.742730 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778880c-115d-41ec-a302-ab871fa525c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:08.743209 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778880c-115d-41ec-a302-ab871fa525c1 None admin] PATH_INFO: `/v3/users/7191e25fe82c407286c836be2d7dd20d` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:08.744648 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b778880c-115d-41ec-a302-ab871fa525c1 None admin] RBAC: Authorizing `identity:get_user(user_id=7191e25fe82c407286c836be2d7dd20d)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:08.746446 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b778880c-115d-41ec-a302-ab871fa525c1 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:08.748275 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 149/291] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:48:08 2022] GET /identity/v3/users/7191e25fe82c407286c836be2d7dd20d => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:08.754037 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a771b1bd-cdc6-4d5b-8965-5fab308e9d51 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:08.899467 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a771b1bd-cdc6-4d5b-8965-5fab308e9d51 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:08.942832 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec868be5-2e13-476a-8cc9-9d787ba05eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:08.943479 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec868be5-2e13-476a-8cc9-9d787ba05eff None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:08.943757 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec868be5-2e13-476a-8cc9-9d787ba05eff None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:08.944028 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec868be5-2e13-476a-8cc9-9d787ba05eff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:09.037229 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec868be5-2e13-476a-8cc9-9d787ba05eff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:09.038732 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec868be5-2e13-476a-8cc9-9d787ba05eff None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:09.162566 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 143/292] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:48:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:48:09.167999 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778880c-115d-41ec-a302-ab871fa525c1 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:09.291166 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778880c-115d-41ec-a302-ab871fa525c1 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:09.334990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed7c85-fd5e-415f-b240-43c8a648abf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:09.336219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed7c85-fd5e-415f-b240-43c8a648abf0 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:09.336699 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed7c85-fd5e-415f-b240-43c8a648abf0 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:09.337208 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed7c85-fd5e-415f-b240-43c8a648abf0 None admin] PATH_INFO: `/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:09.338638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed7c85-fd5e-415f-b240-43c8a648abf0 None admin] RBAC: Authorizing `identity:get_project(project_id=0aa8006660fe4334b8ca63e5e2a5d7e0)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:09.340293 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed7c85-fd5e-415f-b240-43c8a648abf0 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:09.342204 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 150/293] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:48:09 2022] GET /identity/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:09.348771 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec868be5-2e13-476a-8cc9-9d787ba05eff None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:09.503595 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec868be5-2e13-476a-8cc9-9d787ba05eff None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:09.549651 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01e66c-b069-433d-a0e5-d11b5d2142b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:09.559680 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01e66c-b069-433d-a0e5-d11b5d2142b5 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:09.559680 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01e66c-b069-433d-a0e5-d11b5d2142b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:09.559680 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01e66c-b069-433d-a0e5-d11b5d2142b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:09.559680 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c01e66c-b069-433d-a0e5-d11b5d2142b5 None admin] RBAC: Adding query filter params (role.id=9f25fed676d84770b9dc2a96a769de28, scope.project.id=0aa8006660fe4334b8ca63e5e2a5d7e0, user.id=7191e25fe82c407286c836be2d7dd20d) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:09.559680 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c01e66c-b069-433d-a0e5-d11b5d2142b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:09.559680 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c01e66c-b069-433d-a0e5-d11b5d2142b5 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:09.561707 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 144/294] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:48:09 2022] GET /identity/v3/role_assignments?user.id=7191e25fe82c407286c836be2d7dd20d&scope.project.id=0aa8006660fe4334b8ca63e5e2a5d7e0&role.id=9f25fed676d84770b9dc2a96a769de28 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:09.685910 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955e1cf-d755-4831-a985-d38df98c273f None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:09.687573 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955e1cf-d755-4831-a985-d38df98c273f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:09.688126 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955e1cf-d755-4831-a985-d38df98c273f None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:09.690233 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 151/295] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:09.696749 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f5968-33f3-4cee-aa96-f50ab93d3b2b None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:09.697384 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f5968-33f3-4cee-aa96-f50ab93d3b2b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:09.697991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f5968-33f3-4cee-aa96-f50ab93d3b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:09.716790 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-446f5968-33f3-4cee-aa96-f50ab93d3b2b None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:09.718513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-446f5968-33f3-4cee-aa96-f50ab93d3b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:09.792359 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 145/296] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:48:09.817663 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0955e1cf-d755-4831-a985-d38df98c273f None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:09.925509 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0955e1cf-d755-4831-a985-d38df98c273f None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:09.929254 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6837b-45d6-4d94-bacd-be991b90fed0 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:09.929800 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6837b-45d6-4d94-bacd-be991b90fed0 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:09.930082 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6837b-45d6-4d94-bacd-be991b90fed0 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:09.931606 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 146/297] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:48:09.938240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb982fd8-abce-4fa1-b724-3245f99bbfe8 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:09.938805 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb982fd8-abce-4fa1-b724-3245f99bbfe8 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:09.939317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb982fd8-abce-4fa1-b724-3245f99bbfe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:09.958450 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-eb982fd8-abce-4fa1-b724-3245f99bbfe8 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:09.960453 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-eb982fd8-abce-4fa1-b724-3245f99bbfe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:09.968684 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69357b54-aaf8-4d90-8226-cd2602bd37e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:09.969488 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69357b54-aaf8-4d90-8226-cd2602bd37e4 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:09.969820 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69357b54-aaf8-4d90-8226-cd2602bd37e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:09.970798 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69357b54-aaf8-4d90-8226-cd2602bd37e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:09.984472 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69357b54-aaf8-4d90-8226-cd2602bd37e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:48:09.994757 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-69357b54-aaf8-4d90-8226-cd2602bd37e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:48:09.994757 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:09.994757 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:09.994757 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:09.994757 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:09.994757 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:09.994757 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:09.994757 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:09.994757 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:09.994757 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:09.994757 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:09.994757 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:09.994757 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:48:09.994757 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:48:09.994757 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:48:09.994757 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:48:09.995684 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:48:09.995684 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:48:09.995684 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:48:09.995684 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:48:09.995684 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:09.995684 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:09.995684 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:09.995684 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:09.995684 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:09.995684 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:09.995684 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:09.995684 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:09.995684 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:09.995684 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:09.995684 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:09.995684 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:09.996901 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:09.996901 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:09.996901 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:09.996901 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:09.996901 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:48:09.996901 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:48:09.996901 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:48:09.996901 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:48:09.996901 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:48:09.996901 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:48:09.996901 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:48:09.996901 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:09.996901 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 152/298] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:48:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:10.002850 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69357b54-aaf8-4d90-8226-cd2602bd37e4 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:10.041871 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 147/299] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:48:10.064022 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb982fd8-abce-4fa1-b724-3245f99bbfe8 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:10.112429 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69357b54-aaf8-4d90-8226-cd2602bd37e4 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:10.146079 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2aad53-f5f0-4312-8c75-7d7e0fdac542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:10.146758 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2aad53-f5f0-4312-8c75-7d7e0fdac542 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:10.147041 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2aad53-f5f0-4312-8c75-7d7e0fdac542 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:10.147318 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2aad53-f5f0-4312-8c75-7d7e0fdac542 None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:10.148380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2aad53-f5f0-4312-8c75-7d7e0fdac542 None admin] RBAC: Adding query filter params (name=member) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:10.148487 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2aad53-f5f0-4312-8c75-7d7e0fdac542 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:10.150014 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2aad53-f5f0-4312-8c75-7d7e0fdac542 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:10.158961 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 153/300] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Apr 30 20:48:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:10.164509 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2aad53-f5f0-4312-8c75-7d7e0fdac542 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:10.173786 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb982fd8-abce-4fa1-b724-3245f99bbfe8 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:10.207846 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb457e17-660d-460e-a6fe-da1fdd3f558b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:10.209000 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb457e17-660d-460e-a6fe-da1fdd3f558b None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:10.209498 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb457e17-660d-460e-a6fe-da1fdd3f558b None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:10.210018 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb457e17-660d-460e-a6fe-da1fdd3f558b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:10.221917 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb457e17-660d-460e-a6fe-da1fdd3f558b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:48:10.231152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-cb457e17-660d-460e-a6fe-da1fdd3f558b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 30 20:48:10.231152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:10.231152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:10.231152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:10.231152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:10.231152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:10.231152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:10.231152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:10.231152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:10.231152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:10.231152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:10.231152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:10.231152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:48:10.231152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:48:10.231152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:48:10.231152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:48:10.232071 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:48:10.232071 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:48:10.232071 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:48:10.232071 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:48:10.232071 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:10.232071 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:10.232071 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:10.232071 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:10.232071 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:10.232071 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:10.232071 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:10.232071 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:10.232071 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:10.232071 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:10.232071 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:10.232071 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:10.232861 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:10.232861 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:10.232861 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:10.232861 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:10.232861 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:48:10.232861 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:48:10.232861 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:48:10.232861 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:48:10.232861 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:48:10.232861 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:48:10.232861 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Apr 30 20:48:10.232861 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:10.240645 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 148/301] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:48:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:10.242163 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb457e17-660d-460e-a6fe-da1fdd3f558b None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:10.282471 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2aad53-f5f0-4312-8c75-7d7e0fdac542 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:10.317782 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a067e-2334-4f96-bfcf-e597ae103a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:10.318930 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a067e-2334-4f96-bfcf-e597ae103a1f None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:10.319387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a067e-2334-4f96-bfcf-e597ae103a1f None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:10.319808 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a067e-2334-4f96-bfcf-e597ae103a1f None admin] PATH_INFO: `/v3/users/43447c6abd5e46f6b7cc8d724bcf44da` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:10.321338 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a067e-2334-4f96-bfcf-e597ae103a1f None admin] RBAC: Authorizing `identity:get_user(user_id=43447c6abd5e46f6b7cc8d724bcf44da)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:10.323105 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a067e-2334-4f96-bfcf-e597ae103a1f None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:10.325390 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 154/302] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:48:10 2022] GET /identity/v3/users/43447c6abd5e46f6b7cc8d724bcf44da => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:10.331467 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a067e-2334-4f96-bfcf-e597ae103a1f None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:10.353897 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb457e17-660d-460e-a6fe-da1fdd3f558b None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:10.389220 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a680b-b05f-4b45-8d6a-06519e7be51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:10.390106 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a680b-b05f-4b45-8d6a-06519e7be51c None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:10.390476 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a680b-b05f-4b45-8d6a-06519e7be51c None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:10.390871 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a680b-b05f-4b45-8d6a-06519e7be51c None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:10.391720 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a680b-b05f-4b45-8d6a-06519e7be51c None admin] RBAC: Adding query filter params (name=reader) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:10.392166 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a680b-b05f-4b45-8d6a-06519e7be51c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:10.393629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a680b-b05f-4b45-8d6a-06519e7be51c None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:10.404303 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 149/303] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Apr 30 20:48:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:48:10.410596 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a680b-b05f-4b45-8d6a-06519e7be51c None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:10.437973 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a067e-2334-4f96-bfcf-e597ae103a1f None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:10.472983 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658cda1f-84dc-4c78-8c8a-7ecc45fe96f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:10.474111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658cda1f-84dc-4c78-8c8a-7ecc45fe96f7 None admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:10.474540 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658cda1f-84dc-4c78-8c8a-7ecc45fe96f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:10.474990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658cda1f-84dc-4c78-8c8a-7ecc45fe96f7 None admin] PATH_INFO: `/v3/system/users/43447c6abd5e46f6b7cc8d724bcf44da/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:10.476694 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658cda1f-84dc-4c78-8c8a-7ecc45fe96f7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=43447c6abd5e46f6b7cc8d724bcf44da, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:10.478289 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658cda1f-84dc-4c78-8c8a-7ecc45fe96f7 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:10.514914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a680b-b05f-4b45-8d6a-06519e7be51c None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:10.547208 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a88982-59ff-4539-bc4b-527f24bf5989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:10.548074 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a88982-59ff-4539-bc4b-527f24bf5989 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:10.548358 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a88982-59ff-4539-bc4b-527f24bf5989 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:10.548631 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a88982-59ff-4539-bc4b-527f24bf5989 None admin] PATH_INFO: `/v3/users/676cbf8a35aa4339b5498b575d6f9506` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:10.561916 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a88982-59ff-4539-bc4b-527f24bf5989 None admin] RBAC: Authorizing `identity:get_user(user_id=676cbf8a35aa4339b5498b575d6f9506)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:10.563366 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a88982-59ff-4539-bc4b-527f24bf5989 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:10.569588 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 150/304] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:48:10 2022] GET /identity/v3/users/676cbf8a35aa4339b5498b575d6f9506 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:10.569588 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365c718-de7e-4775-a68c-d0d50c3ca5f1 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:10.569588 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365c718-de7e-4775-a68c-d0d50c3ca5f1 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:10.569588 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365c718-de7e-4775-a68c-d0d50c3ca5f1 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:10.569588 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 151/305] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:10.571679 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365c718-de7e-4775-a68c-d0d50c3ca5f1 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:10.579312 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 155/306] 10.222.0.23 () {58 vars in 1334 bytes} [Sat Apr 30 20:48:10 2022] PUT /identity/v3/system/users/43447c6abd5e46f6b7cc8d724bcf44da/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 20:48:10.583613 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b1bb8-3236-4721-85b0-33b778c8f6c5 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:10.584448 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b1bb8-3236-4721-85b0-33b778c8f6c5 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:10.584846 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b1bb8-3236-4721-85b0-33b778c8f6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:10.608746 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-5c1b1bb8-3236-4721-85b0-33b778c8f6c5 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:10.612675 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5c1b1bb8-3236-4721-85b0-33b778c8f6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:10.686957 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365c718-de7e-4775-a68c-d0d50c3ca5f1 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:10.688046 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 156/307] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:48:10.713705 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b1bb8-3236-4721-85b0-33b778c8f6c5 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:10.726079 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445959b1-30e3-4cb5-8f23-eab5c84bf0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:10.726417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445959b1-30e3-4cb5-8f23-eab5c84bf0be None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:10.726693 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445959b1-30e3-4cb5-8f23-eab5c84bf0be None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:10.726965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445959b1-30e3-4cb5-8f23-eab5c84bf0be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:10.727806 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445959b1-30e3-4cb5-8f23-eab5c84bf0be None admin] RBAC: Adding query filter params (role.id=df4ebd23bc804a629fbb7b2dad89c96a, user.id=676cbf8a35aa4339b5498b575d6f9506, scope.system=all) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:10.728175 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445959b1-30e3-4cb5-8f23-eab5c84bf0be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:10.729786 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445959b1-30e3-4cb5-8f23-eab5c84bf0be None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:10.735668 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 152/308] 10.222.0.23 () {56 vars in 1308 bytes} [Sat Apr 30 20:48:10 2022] GET /identity/v3/role_assignments?user.id=676cbf8a35aa4339b5498b575d6f9506&scope.system=all&role.id=df4ebd23bc804a629fbb7b2dad89c96a => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:48:10.828605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b1bb8-3236-4721-85b0-33b778c8f6c5 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:10.865206 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882b66e-68fc-48a6-89be-8fa06eab9ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:10.866445 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882b66e-68fc-48a6-89be-8fa06eab9ad0 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:10.866936 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882b66e-68fc-48a6-89be-8fa06eab9ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:10.867405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882b66e-68fc-48a6-89be-8fa06eab9ad0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:10.869121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5882b66e-68fc-48a6-89be-8fa06eab9ad0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:10.870890 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5882b66e-68fc-48a6-89be-8fa06eab9ad0 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:10.873094 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 157/309] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:48:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:48:10.879574 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445959b1-30e3-4cb5-8f23-eab5c84bf0be None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:10.991969 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445959b1-30e3-4cb5-8f23-eab5c84bf0be None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:11.027629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398a050-0780-41a4-bcf3-62f1f7c56dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:11.028298 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398a050-0780-41a4-bcf3-62f1f7c56dc1 None admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:11.028579 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398a050-0780-41a4-bcf3-62f1f7c56dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:11.028848 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398a050-0780-41a4-bcf3-62f1f7c56dc1 None admin] PATH_INFO: `/v3/groups` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:11.029606 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398a050-0780-41a4-bcf3-62f1f7c56dc1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:11.031167 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398a050-0780-41a4-bcf3-62f1f7c56dc1 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:11.100424 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 153/310] 10.222.0.23 () {60 vars in 1134 bytes} [Sat Apr 30 20:48:10 2022] POST /identity/v3/groups => generated 229 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:48:11.150863 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026ca4b-9946-4a5a-abd4-8453bf95257a None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:11.150863 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026ca4b-9946-4a5a-abd4-8453bf95257a None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:11.150863 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026ca4b-9946-4a5a-abd4-8453bf95257a None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:11.150863 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 158/311] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:11.156592 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e7f4e-fad1-4a0b-aa11-98d10db0731e None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:11.156887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e7f4e-fad1-4a0b-aa11-98d10db0731e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:11.157168 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e7f4e-fad1-4a0b-aa11-98d10db0731e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:11.175771 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-207e7f4e-fad1-4a0b-aa11-98d10db0731e None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:11.177060 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-207e7f4e-fad1-4a0b-aa11-98d10db0731e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:11.252236 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 154/312] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:48:11.278150 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026ca4b-9946-4a5a-abd4-8453bf95257a None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:11.385178 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026ca4b-9946-4a5a-abd4-8453bf95257a None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:11.425680 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e5f4b-31cd-4ce7-bf75-6186a0dbbc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:11.426510 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e5f4b-31cd-4ce7-bf75-6186a0dbbc46 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:11.426796 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e5f4b-31cd-4ce7-bf75-6186a0dbbc46 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:11.427072 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e5f4b-31cd-4ce7-bf75-6186a0dbbc46 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:11.439137 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e5f4b-31cd-4ce7-bf75-6186a0dbbc46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:48:11.446995 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-979e5f4b-31cd-4ce7-bf75-6186a0dbbc46 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 30 20:48:11.446995 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:11.446995 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:11.446995 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:11.446995 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:11.446995 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:11.446995 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:11.446995 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:11.446995 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:11.446995 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:11.446995 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:11.446995 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:11.446995 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:48:11.446995 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:48:11.446995 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:48:11.446995 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:48:11.447849 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:48:11.447849 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:48:11.447849 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:48:11.447849 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:48:11.447849 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:11.447849 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:11.447849 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:11.447849 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:11.447849 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:11.447849 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:11.447849 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:11.447849 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:11.447849 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:11.447849 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:11.447849 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:11.447849 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:11.448611 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:11.448611 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:11.448611 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:11.448611 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:11.448611 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:48:11.448611 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:48:11.448611 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:48:11.448611 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:48:11.448611 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:48:11.448611 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:48:11.448611 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Apr 30 20:48:11.448611 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:11.448611 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 159/313] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:48:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:11.454103 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e7f4e-fad1-4a0b-aa11-98d10db0731e None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:11.558765 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e7f4e-fad1-4a0b-aa11-98d10db0731e None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:11.599760 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a52c75-517d-4724-b898-ddf28ec7fbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:11.600419 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a52c75-517d-4724-b898-ddf28ec7fbe1 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:11.600674 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a52c75-517d-4724-b898-ddf28ec7fbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:11.600955 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a52c75-517d-4724-b898-ddf28ec7fbe1 None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:11.601705 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a52c75-517d-4724-b898-ddf28ec7fbe1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:11.602047 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a52c75-517d-4724-b898-ddf28ec7fbe1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:11.603441 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a52c75-517d-4724-b898-ddf28ec7fbe1 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:11.612873 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 155/314] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Apr 30 20:48:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:11.618864 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e5f4b-31cd-4ce7-bf75-6186a0dbbc46 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:11.731427 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e5f4b-31cd-4ce7-bf75-6186a0dbbc46 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:11.765322 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491cb722-4f4c-4669-8d1a-e3609a90fe59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:11.766300 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491cb722-4f4c-4669-8d1a-e3609a90fe59 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:11.766580 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491cb722-4f4c-4669-8d1a-e3609a90fe59 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:11.766851 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491cb722-4f4c-4669-8d1a-e3609a90fe59 None admin] PATH_INFO: `/v3/users/47d68f15d1164b15b723c343c4e05191` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:11.768056 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491cb722-4f4c-4669-8d1a-e3609a90fe59 None admin] RBAC: Authorizing `identity:get_user(user_id=47d68f15d1164b15b723c343c4e05191)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:11.769518 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491cb722-4f4c-4669-8d1a-e3609a90fe59 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:11.771464 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 160/315] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:48:11 2022] GET /identity/v3/users/47d68f15d1164b15b723c343c4e05191 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:11.776829 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a52c75-517d-4724-b898-ddf28ec7fbe1 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:11.875664 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a52c75-517d-4724-b898-ddf28ec7fbe1 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:11.913077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8cb79-ddaf-46a5-ae38-22bf5bb5517a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:11.913725 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8cb79-ddaf-46a5-ae38-22bf5bb5517a None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:11.914035 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8cb79-ddaf-46a5-ae38-22bf5bb5517a None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:11.914315 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8cb79-ddaf-46a5-ae38-22bf5bb5517a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:11.986878 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8cb79-ddaf-46a5-ae38-22bf5bb5517a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:11.988268 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8cb79-ddaf-46a5-ae38-22bf5bb5517a None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:12.095634 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 156/316] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:48:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:48:12.100757 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491cb722-4f4c-4669-8d1a-e3609a90fe59 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:12.205033 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491cb722-4f4c-4669-8d1a-e3609a90fe59 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:12.238825 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be3b22-726a-49de-8afc-f543d1728746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:12.239608 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be3b22-726a-49de-8afc-f543d1728746 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:12.239885 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be3b22-726a-49de-8afc-f543d1728746 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:12.240154 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be3b22-726a-49de-8afc-f543d1728746 None admin] PATH_INFO: `/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:12.241327 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be3b22-726a-49de-8afc-f543d1728746 None admin] RBAC: Authorizing `identity:get_project(project_id=0aa8006660fe4334b8ca63e5e2a5d7e0)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:12.242802 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be3b22-726a-49de-8afc-f543d1728746 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:12.244773 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 161/317] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:48:12 2022] GET /identity/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:12.250499 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8cb79-ddaf-46a5-ae38-22bf5bb5517a None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:12.349450 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8cb79-ddaf-46a5-ae38-22bf5bb5517a None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:12.385027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c2a7a-dc85-4beb-bae5-2f356b30ebb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:12.385681 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c2a7a-dc85-4beb-bae5-2f356b30ebb9 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:12.385985 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c2a7a-dc85-4beb-bae5-2f356b30ebb9 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:12.386257 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c2a7a-dc85-4beb-bae5-2f356b30ebb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:12.387086 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164c2a7a-dc85-4beb-bae5-2f356b30ebb9 None admin] RBAC: Adding query filter params (role.id=df4ebd23bc804a629fbb7b2dad89c96a, scope.project.id=0aa8006660fe4334b8ca63e5e2a5d7e0, user.id=47d68f15d1164b15b723c343c4e05191) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:12.387393 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164c2a7a-dc85-4beb-bae5-2f356b30ebb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:12.388832 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164c2a7a-dc85-4beb-bae5-2f356b30ebb9 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:12.397252 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 157/318] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:48:12 2022] GET /identity/v3/role_assignments?user.id=47d68f15d1164b15b723c343c4e05191&scope.project.id=0aa8006660fe4334b8ca63e5e2a5d7e0&role.id=df4ebd23bc804a629fbb7b2dad89c96a => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:13.056015 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd787e-675d-4bce-b266-6db05ecb8979 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:13.056532 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd787e-675d-4bce-b266-6db05ecb8979 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:13.056605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd787e-675d-4bce-b266-6db05ecb8979 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:13.058090 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 162/319] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:13.063194 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f841f-845d-4401-8ec9-a3cb5cbc5bf8 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:13.063634 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f841f-845d-4401-8ec9-a3cb5cbc5bf8 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:13.063724 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f841f-845d-4401-8ec9-a3cb5cbc5bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:13.080530 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-a16f841f-845d-4401-8ec9-a3cb5cbc5bf8 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:13.081696 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a16f841f-845d-4401-8ec9-a3cb5cbc5bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:13.146098 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 158/320] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:48:13.170240 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd787e-675d-4bce-b266-6db05ecb8979 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:13.204087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe7523-0760-416c-90a3-382fdaf92e5a None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:13.204383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe7523-0760-416c-90a3-382fdaf92e5a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:13.204661 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe7523-0760-416c-90a3-382fdaf92e5a None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:13.206218 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 159/321] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:48:13.211055 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ef981-9252-43aa-8048-ddda31076201 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:13.211346 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ef981-9252-43aa-8048-ddda31076201 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:13.211633 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ef981-9252-43aa-8048-ddda31076201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:13.229019 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-852ef981-9252-43aa-8048-ddda31076201 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:13.230245 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-852ef981-9252-43aa-8048-ddda31076201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:13.273848 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd787e-675d-4bce-b266-6db05ecb8979 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:13.300297 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 160/322] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:48:13.323973 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14e3ad-68a8-47da-9b6e-38560d908d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:13.325286 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14e3ad-68a8-47da-9b6e-38560d908d06 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:13.325816 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14e3ad-68a8-47da-9b6e-38560d908d06 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:13.326318 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14e3ad-68a8-47da-9b6e-38560d908d06 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:13.339833 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ef981-9252-43aa-8048-ddda31076201 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:13.341568 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14e3ad-68a8-47da-9b6e-38560d908d06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:48:13.350284 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-9f14e3ad-68a8-47da-9b6e-38560d908d06 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:48:13.350284 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:13.350284 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:13.350284 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:13.350284 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:13.350284 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:13.350284 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:13.350284 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:13.350284 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:13.350284 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:13.350284 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:13.350284 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:13.350284 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:48:13.350284 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:48:13.350284 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:48:13.350284 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:48:13.351203 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:48:13.351203 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:48:13.351203 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:48:13.351203 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:48:13.351203 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:13.351203 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:13.351203 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:13.351203 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:13.351203 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:13.351203 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:13.351203 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:13.351203 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:13.351203 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:13.351203 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:13.351203 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:13.351203 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:13.352188 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:13.352188 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:13.352188 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:13.352188 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:13.352188 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:48:13.352188 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:48:13.352188 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:48:13.352188 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:48:13.352188 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:48:13.352188 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:48:13.352188 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:48:13.352188 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:13.352188 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 163/323] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:48:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:13.356951 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14e3ad-68a8-47da-9b6e-38560d908d06 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:13.442677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ef981-9252-43aa-8048-ddda31076201 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:13.455720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14e3ad-68a8-47da-9b6e-38560d908d06 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:13.477053 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d6880-48b4-482a-bc6a-dcd53901cb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:13.477863 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d6880-48b4-482a-bc6a-dcd53901cb9a None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:13.478141 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d6880-48b4-482a-bc6a-dcd53901cb9a None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:13.478412 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d6880-48b4-482a-bc6a-dcd53901cb9a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:13.487973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5d6880-48b4-482a-bc6a-dcd53901cb9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:48:13.488420 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212916df-ae34-42a8-8c37-539ff7d01a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:13.489081 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212916df-ae34-42a8-8c37-539ff7d01a63 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:13.489360 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212916df-ae34-42a8-8c37-539ff7d01a63 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:13.489631 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212916df-ae34-42a8-8c37-539ff7d01a63 None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:13.490399 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212916df-ae34-42a8-8c37-539ff7d01a63 None admin] RBAC: Adding query filter params (name=member) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:13.490705 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212916df-ae34-42a8-8c37-539ff7d01a63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:13.492071 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212916df-ae34-42a8-8c37-539ff7d01a63 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:13.495529 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-ba5d6880-48b4-482a-bc6a-dcd53901cb9a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 30 20:48:13.495529 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:13.495529 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:13.495529 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:13.495529 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:13.495529 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:13.495529 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:13.495529 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:13.495529 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:13.495529 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:13.495529 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:13.495529 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:13.495529 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:48:13.495529 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:48:13.495529 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:48:13.495529 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:48:13.496355 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:48:13.496355 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:48:13.496355 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:48:13.496355 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:48:13.496355 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:13.496355 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:13.496355 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:13.496355 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:13.496355 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:13.496355 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:13.496355 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:13.496355 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:13.496355 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:13.496355 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:13.496355 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:13.496355 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:13.497270 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:13.497270 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:13.497270 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:13.497270 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:13.497270 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:48:13.497270 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:48:13.497270 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:48:13.497270 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:48:13.497270 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:48:13.497270 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:48:13.497270 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Apr 30 20:48:13.497270 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:13.497270 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 161/324] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:48:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:48:13.502013 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 164/325] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Apr 30 20:48:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:48:13.502848 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d6880-48b4-482a-bc6a-dcd53901cb9a None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:13.507246 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212916df-ae34-42a8-8c37-539ff7d01a63 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:13.603017 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d6880-48b4-482a-bc6a-dcd53901cb9a None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:13.606263 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212916df-ae34-42a8-8c37-539ff7d01a63 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:13.634154 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b13d6-b7ad-43c0-ba0c-994273c37c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:13.634812 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b13d6-b7ad-43c0-ba0c-994273c37c4c None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:13.635090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b13d6-b7ad-43c0-ba0c-994273c37c4c None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:13.635363 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b13d6-b7ad-43c0-ba0c-994273c37c4c None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:13.636101 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b13d6-b7ad-43c0-ba0c-994273c37c4c None admin] RBAC: Adding query filter params (name=reader) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:13.636408 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b13d6-b7ad-43c0-ba0c-994273c37c4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:13.637302 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b33b32-32d4-4905-83c5-94fc8d7188e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:13.637830 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b13d6-b7ad-43c0-ba0c-994273c37c4c None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:13.638191 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b33b32-32d4-4905-83c5-94fc8d7188e7 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:13.638469 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b33b32-32d4-4905-83c5-94fc8d7188e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:13.638738 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b33b32-32d4-4905-83c5-94fc8d7188e7 None admin] PATH_INFO: `/v3/users/43447c6abd5e46f6b7cc8d724bcf44da` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:13.640441 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b33b32-32d4-4905-83c5-94fc8d7188e7 None admin] RBAC: Authorizing `identity:get_user(user_id=43447c6abd5e46f6b7cc8d724bcf44da)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:13.641886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b33b32-32d4-4905-83c5-94fc8d7188e7 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:13.643481 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 165/326] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:48:13 2022] GET /identity/v3/users/43447c6abd5e46f6b7cc8d724bcf44da => generated 293 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:48:13.644625 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085e9eb-1296-4f17-97fe-c4bbc843feb0 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:13.644905 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085e9eb-1296-4f17-97fe-c4bbc843feb0 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:13.645177 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085e9eb-1296-4f17-97fe-c4bbc843feb0 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:13.646575 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 162/327] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Apr 30 20:48:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:13.646688 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 166/328] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:13.649329 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b13d6-b7ad-43c0-ba0c-994273c37c4c None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:13.651502 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4a674-09d6-402d-bd51-63a9619b733d None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:13.651786 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4a674-09d6-402d-bd51-63a9619b733d None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:13.652067 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4a674-09d6-402d-bd51-63a9619b733d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:13.668191 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-1bf4a674-09d6-402d-bd51-63a9619b733d None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:13.669352 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1bf4a674-09d6-402d-bd51-63a9619b733d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:13.731653 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 167/329] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:48:13.732491 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4a674-09d6-402d-bd51-63a9619b733d None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:13.748430 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b13d6-b7ad-43c0-ba0c-994273c37c4c None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:13.780215 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86651df4-f717-4465-8697-fd0679acdcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:13.780864 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86651df4-f717-4465-8697-fd0679acdcaa None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:13.781147 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86651df4-f717-4465-8697-fd0679acdcaa None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:13.781422 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86651df4-f717-4465-8697-fd0679acdcaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:13.782276 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86651df4-f717-4465-8697-fd0679acdcaa None admin] RBAC: Adding query filter params (role.id=9f25fed676d84770b9dc2a96a769de28, user.id=43447c6abd5e46f6b7cc8d724bcf44da, scope.system=all) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:13.782589 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86651df4-f717-4465-8697-fd0679acdcaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:13.784535 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86651df4-f717-4465-8697-fd0679acdcaa None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:13.795498 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 163/330] 10.222.0.23 () {56 vars in 1308 bytes} [Sat Apr 30 20:48:13 2022] GET /identity/v3/role_assignments?user.id=43447c6abd5e46f6b7cc8d724bcf44da&scope.system=all&role.id=9f25fed676d84770b9dc2a96a769de28 => generated 510 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:13.797360 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86651df4-f717-4465-8697-fd0679acdcaa None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:13.830096 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4a674-09d6-402d-bd51-63a9619b733d None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:13.866058 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f034c-09f0-4db6-9eea-59adc525042f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:13.866879 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f034c-09f0-4db6-9eea-59adc525042f None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:13.867134 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f034c-09f0-4db6-9eea-59adc525042f None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:13.867467 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f034c-09f0-4db6-9eea-59adc525042f None admin] PATH_INFO: `/v3/users/676cbf8a35aa4339b5498b575d6f9506` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:13.868707 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74f034c-09f0-4db6-9eea-59adc525042f None admin] RBAC: Authorizing `identity:get_user(user_id=676cbf8a35aa4339b5498b575d6f9506)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:13.870223 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74f034c-09f0-4db6-9eea-59adc525042f None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:13.872091 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 168/331] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:48:13 2022] GET /identity/v3/users/676cbf8a35aa4339b5498b575d6f9506 => generated 293 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:13.878356 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f034c-09f0-4db6-9eea-59adc525042f None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:13.901375 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86651df4-f717-4465-8697-fd0679acdcaa None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:13.939261 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30a915-2bdf-433f-92be-87521029429f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:13.940381 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30a915-2bdf-433f-92be-87521029429f None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:13.940813 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30a915-2bdf-433f-92be-87521029429f None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:13.941266 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30a915-2bdf-433f-92be-87521029429f None admin] PATH_INFO: `/v3/domains/default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:13.942486 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a30a915-2bdf-433f-92be-87521029429f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:13.943944 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a30a915-2bdf-433f-92be-87521029429f None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:13.945798 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 164/332] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:48:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:13.951300 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30a915-2bdf-433f-92be-87521029429f None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:13.991375 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f034c-09f0-4db6-9eea-59adc525042f None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:14.031079 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c63c6-7948-4b6b-9426-eaeb452a33b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:14.032089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c63c6-7948-4b6b-9426-eaeb452a33b7 None admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:14.032460 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c63c6-7948-4b6b-9426-eaeb452a33b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:14.032744 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c63c6-7948-4b6b-9426-eaeb452a33b7 None admin] PATH_INFO: `/v3/system/users/676cbf8a35aa4339b5498b575d6f9506/roles/df4ebd23bc804a629fbb7b2dad89c96a` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:14.034347 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c63c6-7948-4b6b-9426-eaeb452a33b7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=676cbf8a35aa4339b5498b575d6f9506, role_id=df4ebd23bc804a629fbb7b2dad89c96a)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:14.037418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c63c6-7948-4b6b-9426-eaeb452a33b7 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:14.060647 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30a915-2bdf-433f-92be-87521029429f None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:14.092328 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ff61b-a69f-4416-9395-7066b65cdf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:14.092979 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ff61b-a69f-4416-9395-7066b65cdf00 None admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:14.093258 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ff61b-a69f-4416-9395-7066b65cdf00 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:14.093525 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ff61b-a69f-4416-9395-7066b65cdf00 None admin] PATH_INFO: `/v3/groups` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:14.094221 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ff61b-a69f-4416-9395-7066b65cdf00 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:14.095913 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ff61b-a69f-4416-9395-7066b65cdf00 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:14.133507 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 169/333] 10.222.0.23 () {58 vars in 1334 bytes} [Sat Apr 30 20:48:13 2022] PUT /identity/v3/system/users/676cbf8a35aa4339b5498b575d6f9506/roles/df4ebd23bc804a629fbb7b2dad89c96a => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 20:48:14.175684 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 165/334] 10.222.0.23 () {60 vars in 1134 bytes} [Sat Apr 30 20:48:13 2022] POST /identity/v3/groups => generated 226 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:48:16.841682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53204026-b0a3-48f6-9a40-ec3a3b6d3805 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:16.842288 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53204026-b0a3-48f6-9a40-ec3a3b6d3805 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:16.842288 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53204026-b0a3-48f6-9a40-ec3a3b6d3805 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:16.843935 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 170/335] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:16.849726 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb954e8-8999-4c9e-88c4-e0c94696300b None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:16.850147 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb954e8-8999-4c9e-88c4-e0c94696300b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:16.850330 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb954e8-8999-4c9e-88c4-e0c94696300b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:16.869263 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-5fb954e8-8999-4c9e-88c4-e0c94696300b None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:16.874714 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5fb954e8-8999-4c9e-88c4-e0c94696300b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:16.953086 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 166/336] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:48:16.986202 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53204026-b0a3-48f6-9a40-ec3a3b6d3805 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:17.115351 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53204026-b0a3-48f6-9a40-ec3a3b6d3805 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:17.161259 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b85c277-d5b8-4cba-8085-5d650c2946d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:17.162087 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85c277-d5b8-4cba-8085-5d650c2946d2 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:17.162369 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85c277-d5b8-4cba-8085-5d650c2946d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:17.162642 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85c277-d5b8-4cba-8085-5d650c2946d2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:17.179915 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b85c277-d5b8-4cba-8085-5d650c2946d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:48:17.188338 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-8b85c277-d5b8-4cba-8085-5d650c2946d2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 30 20:48:17.188338 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:17.188338 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:17.188338 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:17.188338 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:17.188338 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:17.188338 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:17.188338 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:17.188338 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:17.188338 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:17.188338 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:17.188338 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:17.188338 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:48:17.188338 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:48:17.188338 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:48:17.188338 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:48:17.189203 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:48:17.189203 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:48:17.189203 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:48:17.189203 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:48:17.189203 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:17.189203 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:17.189203 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:17.189203 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:17.189203 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:17.189203 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:17.189203 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:17.189203 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:17.189203 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:17.189203 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:17.189203 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:17.189203 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:17.190731 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:17.190731 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:17.190731 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:17.190731 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:17.190731 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:48:17.190731 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:48:17.190731 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:48:17.190731 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:48:17.190731 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:48:17.190731 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:48:17.190731 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Apr 30 20:48:17.190731 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:17.190731 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 171/337] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:48:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:17.198319 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb954e8-8999-4c9e-88c4-e0c94696300b None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:17.308827 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb954e8-8999-4c9e-88c4-e0c94696300b None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:17.349943 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8deac8-53b9-44b4-87fa-a9e410105e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:17.350619 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8deac8-53b9-44b4-87fa-a9e410105e40 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:17.350898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8deac8-53b9-44b4-87fa-a9e410105e40 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:17.351170 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8deac8-53b9-44b4-87fa-a9e410105e40 None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:17.351971 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8deac8-53b9-44b4-87fa-a9e410105e40 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:17.352274 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8deac8-53b9-44b4-87fa-a9e410105e40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:17.353711 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8deac8-53b9-44b4-87fa-a9e410105e40 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:17.361986 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64f8cf-b89c-459a-aca3-d3c92ff5a59b None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:17.362573 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64f8cf-b89c-459a-aca3-d3c92ff5a59b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:17.363075 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64f8cf-b89c-459a-aca3-d3c92ff5a59b None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:17.365028 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 167/338] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Apr 30 20:48:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:17.366213 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 172/339] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:17.370980 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8deac8-53b9-44b4-87fa-a9e410105e40 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:17.376140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a3e56-6300-4048-855d-5dae31d04a47 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:17.376680 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a3e56-6300-4048-855d-5dae31d04a47 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:17.377159 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a3e56-6300-4048-855d-5dae31d04a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:17.397435 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-4c5a3e56-6300-4048-855d-5dae31d04a47 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:17.398979 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4c5a3e56-6300-4048-855d-5dae31d04a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:17.473810 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8deac8-53b9-44b4-87fa-a9e410105e40 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:17.477986 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 173/340] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:48:17.498770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a3e56-6300-4048-855d-5dae31d04a47 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:17.514006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39470e8-294c-4b76-8436-4db8d91b6776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:17.515086 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39470e8-294c-4b76-8436-4db8d91b6776 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:17.515469 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39470e8-294c-4b76-8436-4db8d91b6776 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:17.515843 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39470e8-294c-4b76-8436-4db8d91b6776 None admin] PATH_INFO: `/v3/users/676cbf8a35aa4339b5498b575d6f9506` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:17.517251 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39470e8-294c-4b76-8436-4db8d91b6776 None admin] RBAC: Authorizing `identity:get_user(user_id=676cbf8a35aa4339b5498b575d6f9506)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:17.520262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39470e8-294c-4b76-8436-4db8d91b6776 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:17.522218 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 168/341] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:48:17 2022] GET /identity/v3/users/676cbf8a35aa4339b5498b575d6f9506 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:17.528219 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39470e8-294c-4b76-8436-4db8d91b6776 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:17.626800 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a3e56-6300-4048-855d-5dae31d04a47 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:17.644860 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39470e8-294c-4b76-8436-4db8d91b6776 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:17.664540 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b0bc1-7438-486a-877c-a2ff5dfb6701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:17.665585 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b0bc1-7438-486a-877c-a2ff5dfb6701 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:17.666034 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b0bc1-7438-486a-877c-a2ff5dfb6701 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:17.672641 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b0bc1-7438-486a-877c-a2ff5dfb6701 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:17.678280 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878b0bc1-7438-486a-877c-a2ff5dfb6701 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:48:17.683495 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec83d00-265c-4784-a819-d15d23404e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:17.684160 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec83d00-265c-4784-a819-d15d23404e13 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:17.684443 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec83d00-265c-4784-a819-d15d23404e13 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:17.684717 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec83d00-265c-4784-a819-d15d23404e13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:17.685551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec83d00-265c-4784-a819-d15d23404e13 None admin] RBAC: Adding query filter params (role.id=df4ebd23bc804a629fbb7b2dad89c96a, user.id=676cbf8a35aa4339b5498b575d6f9506, scope.system=all) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:17.685887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec83d00-265c-4784-a819-d15d23404e13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:17.687360 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec83d00-265c-4784-a819-d15d23404e13 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:17.689169 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-878b0bc1-7438-486a-877c-a2ff5dfb6701 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:48:17.689169 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:17.689169 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:17.689169 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:17.689169 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:17.689169 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:17.689169 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:17.689169 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:17.689169 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:17.689169 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:17.689169 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:17.689169 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:17.689169 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:48:17.689169 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:48:17.689169 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:48:17.689169 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:48:17.690485 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:48:17.690485 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:48:17.690485 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:48:17.690485 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:48:17.690485 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:17.690485 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:17.690485 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:17.690485 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:17.690485 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:17.690485 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:17.690485 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:17.690485 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:17.690485 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:17.690485 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:17.690485 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:17.690485 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:17.691279 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:17.691279 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:17.691279 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:17.691279 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:17.691279 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:48:17.691279 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:48:17.691279 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:48:17.691279 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:48:17.691279 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:48:17.691279 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:48:17.691279 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:48:17.691279 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:17.693513 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 174/342] 10.222.0.23 () {56 vars in 1114 bytes} [Sat Apr 30 20:48:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:17.695132 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce4343-c752-4499-8565-9a4f9abda372 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:17.695616 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce4343-c752-4499-8565-9a4f9abda372 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:17.696105 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce4343-c752-4499-8565-9a4f9abda372 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:17.697893 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 175/343] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:17.703165 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5390006-e7ee-472a-bc86-b2f104306d7f None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:17.703960 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5390006-e7ee-472a-bc86-b2f104306d7f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:17.704570 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5390006-e7ee-472a-bc86-b2f104306d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:17.717922 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 169/344] 10.222.0.23 () {56 vars in 1308 bytes} [Sat Apr 30 20:48:17 2022] GET /identity/v3/role_assignments?user.id=676cbf8a35aa4339b5498b575d6f9506&scope.system=all&role.id=df4ebd23bc804a629fbb7b2dad89c96a => generated 510 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:48:17.718958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec83d00-265c-4784-a819-d15d23404e13 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:17.730778 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-a5390006-e7ee-472a-bc86-b2f104306d7f None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:17.732333 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a5390006-e7ee-472a-bc86-b2f104306d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:17.831209 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 176/345] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:48:17.885991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5390006-e7ee-472a-bc86-b2f104306d7f None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:17.925785 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec83d00-265c-4784-a819-d15d23404e13 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:17.972268 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a56d87-0ffd-4508-8d35-13d166615cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:17.972268 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a56d87-0ffd-4508-8d35-13d166615cf9 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:17.972268 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a56d87-0ffd-4508-8d35-13d166615cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:17.972582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a56d87-0ffd-4508-8d35-13d166615cf9 None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:17.973296 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a56d87-0ffd-4508-8d35-13d166615cf9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:17.973608 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a56d87-0ffd-4508-8d35-13d166615cf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:17.975230 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a56d87-0ffd-4508-8d35-13d166615cf9 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:17.984398 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 170/346] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:48:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:17.985711 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3965985-62e1-463e-b5ae-5a9b03d052b9 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:17.988096 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3965985-62e1-463e-b5ae-5a9b03d052b9 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:17.988096 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3965985-62e1-463e-b5ae-5a9b03d052b9 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:17.988576 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 171/347] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:17.993808 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3965985-62e1-463e-b5ae-5a9b03d052b9 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:18.020077 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5390006-e7ee-472a-bc86-b2f104306d7f None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:18.063639 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23012e3b-4e92-416b-8f2b-f514a91059f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:18.063639 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23012e3b-4e92-416b-8f2b-f514a91059f1 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:18.063639 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23012e3b-4e92-416b-8f2b-f514a91059f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:18.063639 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23012e3b-4e92-416b-8f2b-f514a91059f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:18.073909 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23012e3b-4e92-416b-8f2b-f514a91059f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:48:18.082929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-23012e3b-4e92-416b-8f2b-f514a91059f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:48:18.082929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:18.082929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:18.082929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:18.082929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:18.082929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:18.082929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:18.082929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:18.082929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:18.082929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:18.082929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:18.082929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:18.082929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:48:18.082929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:48:18.082929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:48:18.082929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:48:18.083889 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:48:18.083889 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:48:18.083889 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:48:18.083889 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:48:18.083889 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:18.083889 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:18.083889 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:18.083889 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:18.083889 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:18.083889 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:18.083889 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:18.083889 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:18.083889 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:18.083889 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:18.083889 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:18.083889 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:18.084697 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:18.084697 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:18.084697 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:18.084697 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:18.084697 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:48:18.084697 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:48:18.084697 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:48:18.084697 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:48:18.084697 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:48:18.084697 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:48:18.084697 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:48:18.084697 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:18.084697 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 177/348] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:48:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:48:18.085923 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558d695-6376-4624-93a8-cad1f29c338f None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:18.085923 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558d695-6376-4624-93a8-cad1f29c338f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:18.086086 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558d695-6376-4624-93a8-cad1f29c338f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:18.110143 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-0558d695-6376-4624-93a8-cad1f29c338f None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:18.111345 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0558d695-6376-4624-93a8-cad1f29c338f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:18.116812 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3965985-62e1-463e-b5ae-5a9b03d052b9 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:18.152251 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a989d0a-c24d-4df0-941b-8d3988d8cd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:18.152852 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a989d0a-c24d-4df0-941b-8d3988d8cd2a None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:18.153141 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a989d0a-c24d-4df0-941b-8d3988d8cd2a None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:18.153462 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a989d0a-c24d-4df0-941b-8d3988d8cd2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:18.184323 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 178/349] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:48:18.185201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0558d695-6376-4624-93a8-cad1f29c338f None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:18.227003 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a989d0a-c24d-4df0-941b-8d3988d8cd2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:18.228544 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a989d0a-c24d-4df0-941b-8d3988d8cd2a None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:18.291101 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0558d695-6376-4624-93a8-cad1f29c338f None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:18.327727 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35fe6ee-7294-4162-ae24-d314ed38a5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:18.328409 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fe6ee-7294-4162-ae24-d314ed38a5f9 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:18.328693 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fe6ee-7294-4162-ae24-d314ed38a5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:18.328969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fe6ee-7294-4162-ae24-d314ed38a5f9 None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:18.329726 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35fe6ee-7294-4162-ae24-d314ed38a5f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:18.330068 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35fe6ee-7294-4162-ae24-d314ed38a5f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:18.331462 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35fe6ee-7294-4162-ae24-d314ed38a5f9 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:18.340922 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 172/350] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:48:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:48:18.341796 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a989d0a-c24d-4df0-941b-8d3988d8cd2a None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:18.346116 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 179/351] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Apr 30 20:48:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:18.346973 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35fe6ee-7294-4162-ae24-d314ed38a5f9 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:18.458302 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a989d0a-c24d-4df0-941b-8d3988d8cd2a None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:18.475277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35fe6ee-7294-4162-ae24-d314ed38a5f9 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:18.492255 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75bcea5-b115-4f66-83f9-44d52df68368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:18.493052 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75bcea5-b115-4f66-83f9-44d52df68368 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:18.493327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75bcea5-b115-4f66-83f9-44d52df68368 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:18.493595 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75bcea5-b115-4f66-83f9-44d52df68368 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:18.504718 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75bcea5-b115-4f66-83f9-44d52df68368 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:48:18.510366 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882fa9d-b05b-473a-b6d5-5208dbba7981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:18.511237 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882fa9d-b05b-473a-b6d5-5208dbba7981 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:18.511516 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882fa9d-b05b-473a-b6d5-5208dbba7981 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:18.511791 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882fa9d-b05b-473a-b6d5-5208dbba7981 None admin] PATH_INFO: `/v3/projects/9431599023b44f1cb5dfb8bca0584f5f` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:18.512991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5882fa9d-b05b-473a-b6d5-5208dbba7981 None admin] RBAC: Authorizing `identity:get_project(project_id=9431599023b44f1cb5dfb8bca0584f5f)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:18.513373 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-a75bcea5-b115-4f66-83f9-44d52df68368 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:48:18.513373 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:18.513373 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:18.513373 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:18.513373 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:18.513373 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:18.513373 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:18.513373 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:18.513373 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:18.513373 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:18.513373 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:18.513373 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:18.513373 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:48:18.513373 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:48:18.513373 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:48:18.513373 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:48:18.515999 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:48:18.515999 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:48:18.515999 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:48:18.515999 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:48:18.515999 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:18.515999 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:18.515999 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:18.515999 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:18.515999 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:18.515999 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:18.515999 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:18.515999 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:18.515999 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:18.515999 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:18.515999 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:18.515999 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:18.517983 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:18.517983 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:18.517983 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:18.517983 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:18.517983 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:48:18.517983 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:48:18.517983 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:48:18.517983 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:48:18.517983 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:48:18.517983 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:48:18.517983 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:48:18.517983 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:18.519423 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5882fa9d-b05b-473a-b6d5-5208dbba7981 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:18.519576 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 173/352] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:48:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:18.519576 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75bcea5-b115-4f66-83f9-44d52df68368 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:18.519838 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 180/353] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:48:18 2022] GET /identity/v3/projects/9431599023b44f1cb5dfb8bca0584f5f => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:18.525959 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882fa9d-b05b-473a-b6d5-5208dbba7981 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:18.619747 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75bcea5-b115-4f66-83f9-44d52df68368 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:18.626257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882fa9d-b05b-473a-b6d5-5208dbba7981 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:18.656631 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605801d-1394-4d1d-99a4-8131f68c6df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:18.657296 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605801d-1394-4d1d-99a4-8131f68c6df0 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:18.657574 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605801d-1394-4d1d-99a4-8131f68c6df0 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:18.657888 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605801d-1394-4d1d-99a4-8131f68c6df0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:18.663965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170b99a-3308-4fd8-aac5-6d92bc3e4dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:18.664652 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170b99a-3308-4fd8-aac5-6d92bc3e4dda None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:18.664933 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170b99a-3308-4fd8-aac5-6d92bc3e4dda None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:18.665208 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170b99a-3308-4fd8-aac5-6d92bc3e4dda None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:18.666013 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2170b99a-3308-4fd8-aac5-6d92bc3e4dda None admin] RBAC: Adding query filter params (name=member) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:18.666325 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2170b99a-3308-4fd8-aac5-6d92bc3e4dda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:18.667754 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2170b99a-3308-4fd8-aac5-6d92bc3e4dda None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:18.677801 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 181/354] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Apr 30 20:48:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:18.678669 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170b99a-3308-4fd8-aac5-6d92bc3e4dda None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:18.732551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b605801d-1394-4d1d-99a4-8131f68c6df0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:18.734710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b605801d-1394-4d1d-99a4-8131f68c6df0 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:18.781890 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170b99a-3308-4fd8-aac5-6d92bc3e4dda None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:18.816990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a287f-17f9-4d3f-823e-a9a100490402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:18.818041 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a287f-17f9-4d3f-823e-a9a100490402 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:18.818248 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a287f-17f9-4d3f-823e-a9a100490402 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:18.818492 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a287f-17f9-4d3f-823e-a9a100490402 None admin] PATH_INFO: `/v3/groups/c8eb9f9c7db549abb7c5c502e42a8e33` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:18.824774 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a287f-17f9-4d3f-823e-a9a100490402 None admin] RBAC: Authorizing `identity:get_group(group_id=c8eb9f9c7db549abb7c5c502e42a8e33)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:18.826284 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a287f-17f9-4d3f-823e-a9a100490402 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:18.828323 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 182/355] 10.222.0.23 () {56 vars in 1180 bytes} [Sat Apr 30 20:48:18 2022] GET /identity/v3/groups/c8eb9f9c7db549abb7c5c502e42a8e33 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:18.829106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a287f-17f9-4d3f-823e-a9a100490402 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:18.835248 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 174/356] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:48:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:48:18.840804 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605801d-1394-4d1d-99a4-8131f68c6df0 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:18.944779 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a287f-17f9-4d3f-823e-a9a100490402 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:18.956606 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605801d-1394-4d1d-99a4-8131f68c6df0 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:19.000964 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f170e-6670-4728-bc56-552f87cd3244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:19.003493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f170e-6670-4728-bc56-552f87cd3244 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:19.003493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f170e-6670-4728-bc56-552f87cd3244 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:19.003493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f170e-6670-4728-bc56-552f87cd3244 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:19.004246 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa85235-71f9-4af2-b182-f6b0a7868c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:19.004758 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa85235-71f9-4af2-b182-f6b0a7868c7e None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:19.005048 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa85235-71f9-4af2-b182-f6b0a7868c7e None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:19.005323 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa85235-71f9-4af2-b182-f6b0a7868c7e None admin] PATH_INFO: `/v3/projects/9431599023b44f1cb5dfb8bca0584f5f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:19.008506 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa85235-71f9-4af2-b182-f6b0a7868c7e None admin] RBAC: Authorizing `identity:get_project(project_id=9431599023b44f1cb5dfb8bca0584f5f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:19.008506 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa85235-71f9-4af2-b182-f6b0a7868c7e None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:19.009707 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 175/357] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:48:18 2022] GET /identity/v3/projects/9431599023b44f1cb5dfb8bca0584f5f => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:48:19.010548 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa85235-71f9-4af2-b182-f6b0a7868c7e None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:19.082644 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f170e-6670-4728-bc56-552f87cd3244 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:19.084146 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f170e-6670-4728-bc56-552f87cd3244 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:19.145369 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa85235-71f9-4af2-b182-f6b0a7868c7e None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:19.191042 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3737f48d-6e97-4093-9efd-c9a734c4760c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:19.191707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737f48d-6e97-4093-9efd-c9a734c4760c None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:19.191988 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737f48d-6e97-4093-9efd-c9a734c4760c None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:19.192263 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737f48d-6e97-4093-9efd-c9a734c4760c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:19.193097 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3737f48d-6e97-4093-9efd-c9a734c4760c None admin] RBAC: Adding query filter params (group.id=c8eb9f9c7db549abb7c5c502e42a8e33, role.id=121b12a250ae4ef8ae1a85ea8c21c4fa, scope.project.id=9431599023b44f1cb5dfb8bca0584f5f) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:19.193809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3737f48d-6e97-4093-9efd-c9a734c4760c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:19.194965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3737f48d-6e97-4093-9efd-c9a734c4760c None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:19.201131 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 176/358] 10.222.0.23 () {56 vars in 1376 bytes} [Sat Apr 30 20:48:19 2022] GET /identity/v3/role_assignments?group.id=c8eb9f9c7db549abb7c5c502e42a8e33&scope.project.id=9431599023b44f1cb5dfb8bca0584f5f&role.id=121b12a250ae4ef8ae1a85ea8c21c4fa => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:19.205397 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e2533-d46a-4f43-a6c3-24eb3c5ea6bc None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:19.205397 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e2533-d46a-4f43-a6c3-24eb3c5ea6bc None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:19.205397 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e2533-d46a-4f43-a6c3-24eb3c5ea6bc None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:19.205625 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 183/359] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:48:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:48:19.205625 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f170e-6670-4728-bc56-552f87cd3244 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:19.208811 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 177/360] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:19.210651 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518807df-7373-4a30-a886-d587ccfa859e None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:19.210943 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518807df-7373-4a30-a886-d587ccfa859e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:19.211223 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518807df-7373-4a30-a886-d587ccfa859e None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:19.212644 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 178/361] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:19.214229 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce03196-49ff-471a-803d-76feb1bd2fc3 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:19.214517 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce03196-49ff-471a-803d-76feb1bd2fc3 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:19.214796 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce03196-49ff-471a-803d-76feb1bd2fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:19.235157 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-5ce03196-49ff-471a-803d-76feb1bd2fc3 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:19.236478 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5ce03196-49ff-471a-803d-76feb1bd2fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:19.337249 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f170e-6670-4728-bc56-552f87cd3244 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:19.344583 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 179/362] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:48:19.350098 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce03196-49ff-471a-803d-76feb1bd2fc3 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:19.384915 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04415bf-2aa8-4b7f-9569-24c385a19670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:19.386231 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04415bf-2aa8-4b7f-9569-24c385a19670 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:19.386728 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04415bf-2aa8-4b7f-9569-24c385a19670 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:19.387208 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04415bf-2aa8-4b7f-9569-24c385a19670 None admin] PATH_INFO: `/v3/groups/c8eb9f9c7db549abb7c5c502e42a8e33` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:19.388741 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04415bf-2aa8-4b7f-9569-24c385a19670 None admin] RBAC: Authorizing `identity:get_group(group_id=c8eb9f9c7db549abb7c5c502e42a8e33)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:19.390608 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04415bf-2aa8-4b7f-9569-24c385a19670 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:19.392669 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 184/363] 10.222.0.23 () {56 vars in 1180 bytes} [Sat Apr 30 20:48:19 2022] GET /identity/v3/groups/c8eb9f9c7db549abb7c5c502e42a8e33 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:19.394189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfb3d5-38a9-471b-a07e-bc4eedd9a544 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:19.394687 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfb3d5-38a9-471b-a07e-bc4eedd9a544 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:19.395164 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfb3d5-38a9-471b-a07e-bc4eedd9a544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:19.414986 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-eedfb3d5-38a9-471b-a07e-bc4eedd9a544 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:19.416416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-eedfb3d5-38a9-471b-a07e-bc4eedd9a544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:19.468828 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce03196-49ff-471a-803d-76feb1bd2fc3 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:19.507914 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 185/364] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:48:19.509010 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedfb3d5-38a9-471b-a07e-bc4eedd9a544 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:19.527884 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bdc45b-046f-47bb-9d09-b18ee80b789a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:19.529470 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bdc45b-046f-47bb-9d09-b18ee80b789a None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:19.530601 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bdc45b-046f-47bb-9d09-b18ee80b789a None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:19.531132 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bdc45b-046f-47bb-9d09-b18ee80b789a None admin] PATH_INFO: `/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:19.533144 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bdc45b-046f-47bb-9d09-b18ee80b789a None admin] RBAC: Authorizing `identity:get_project(project_id=0aa8006660fe4334b8ca63e5e2a5d7e0)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:19.535225 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bdc45b-046f-47bb-9d09-b18ee80b789a None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:19.538615 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 180/365] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:48:19 2022] GET /identity/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:19.539428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bdc45b-046f-47bb-9d09-b18ee80b789a None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:19.650043 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedfb3d5-38a9-471b-a07e-bc4eedd9a544 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:19.669618 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bdc45b-046f-47bb-9d09-b18ee80b789a None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:19.695848 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c497bc71-8141-4a9c-a33a-a955d15c9f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:19.696675 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c497bc71-8141-4a9c-a33a-a955d15c9f80 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:19.696959 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c497bc71-8141-4a9c-a33a-a955d15c9f80 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:19.697238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c497bc71-8141-4a9c-a33a-a955d15c9f80 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:19.708566 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45de86a-67a5-480c-9165-79a018875d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:19.709385 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45de86a-67a5-480c-9165-79a018875d5a None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:19.709682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45de86a-67a5-480c-9165-79a018875d5a None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:19.710269 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45de86a-67a5-480c-9165-79a018875d5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:19.711096 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45de86a-67a5-480c-9165-79a018875d5a None admin] RBAC: Adding query filter params (group.id=c8eb9f9c7db549abb7c5c502e42a8e33, role.id=9f25fed676d84770b9dc2a96a769de28, scope.project.id=9431599023b44f1cb5dfb8bca0584f5f) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:19.711414 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45de86a-67a5-480c-9165-79a018875d5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:19.712771 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c497bc71-8141-4a9c-a33a-a955d15c9f80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:48:19.713129 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45de86a-67a5-480c-9165-79a018875d5a None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:19.724584 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-c497bc71-8141-4a9c-a33a-a955d15c9f80 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:48:19.724584 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:19.724584 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:19.724584 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:19.724584 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:19.724584 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:19.724584 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:19.724584 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:19.724584 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:19.724584 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:19.724584 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:19.724584 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:19.724584 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:48:19.724584 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:48:19.724584 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:48:19.724584 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:48:19.725553 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:48:19.725553 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:48:19.725553 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:48:19.725553 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:48:19.725553 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:19.725553 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:19.725553 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:19.725553 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:19.725553 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:19.725553 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:19.725553 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:19.725553 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:19.725553 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:19.725553 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:19.725553 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:19.725553 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:19.726908 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:19.726908 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:19.726908 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:19.726908 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:19.726908 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:48:19.726908 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:48:19.726908 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:48:19.726908 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:48:19.726908 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:48:19.726908 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:48:19.726908 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:48:19.726908 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:19.728135 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 181/366] 10.222.0.23 () {56 vars in 1376 bytes} [Sat Apr 30 20:48:19 2022] GET /identity/v3/role_assignments?group.id=c8eb9f9c7db549abb7c5c502e42a8e33&scope.project.id=9431599023b44f1cb5dfb8bca0584f5f&role.id=9f25fed676d84770b9dc2a96a769de28 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:19.728289 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 186/367] 10.222.0.23 () {56 vars in 1114 bytes} [Sat Apr 30 20:48:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:19.728446 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45de86a-67a5-480c-9165-79a018875d5a None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:19.730943 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c497bc71-8141-4a9c-a33a-a955d15c9f80 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:19.855564 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45de86a-67a5-480c-9165-79a018875d5a None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:19.869393 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c497bc71-8141-4a9c-a33a-a955d15c9f80 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:19.894315 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6db61c-3ad0-4fa7-978b-ec99851c0b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:19.895473 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6db61c-3ad0-4fa7-978b-ec99851c0b19 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:19.895956 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6db61c-3ad0-4fa7-978b-ec99851c0b19 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:19.896431 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6db61c-3ad0-4fa7-978b-ec99851c0b19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:19.908553 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b81fe0-a8e4-4913-b74b-fcf23e7eaabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:19.909408 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b81fe0-a8e4-4913-b74b-fcf23e7eaabf None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:19.909660 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6db61c-3ad0-4fa7-978b-ec99851c0b19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:48:19.909809 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b81fe0-a8e4-4913-b74b-fcf23e7eaabf None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:19.909992 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b81fe0-a8e4-4913-b74b-fcf23e7eaabf None admin] PATH_INFO: `/v3/groups/c8eb9f9c7db549abb7c5c502e42a8e33` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:19.911763 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b81fe0-a8e4-4913-b74b-fcf23e7eaabf None admin] RBAC: Authorizing `identity:get_group(group_id=c8eb9f9c7db549abb7c5c502e42a8e33)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:19.913405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b81fe0-a8e4-4913-b74b-fcf23e7eaabf None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:19.915044 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 187/368] 10.222.0.23 () {56 vars in 1180 bytes} [Sat Apr 30 20:48:19 2022] GET /identity/v3/groups/c8eb9f9c7db549abb7c5c502e42a8e33 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:19.915828 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b81fe0-a8e4-4913-b74b-fcf23e7eaabf None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:19.919758 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-8c6db61c-3ad0-4fa7-978b-ec99851c0b19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:48:19.919758 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:19.919758 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:19.919758 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:19.919758 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:19.919758 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:19.919758 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:19.919758 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:19.919758 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:19.919758 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:19.919758 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:19.919758 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:19.919758 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:48:19.919758 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:48:19.919758 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:48:19.919758 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:48:19.920712 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:48:19.920712 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:48:19.920712 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:48:19.920712 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:48:19.920712 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:19.920712 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:19.920712 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:19.920712 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:19.920712 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:19.920712 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:19.920712 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:19.920712 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:19.920712 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:19.920712 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:19.920712 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:19.920712 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:19.921582 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:19.921582 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:19.921582 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:19.921582 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:19.921582 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:48:19.921582 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:48:19.921582 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:48:19.921582 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:48:19.921582 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:48:19.921582 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:48:19.921582 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:48:19.921582 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:19.923875 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 182/369] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Apr 30 20:48:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:19.924870 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6db61c-3ad0-4fa7-978b-ec99851c0b19 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:20.025080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b81fe0-a8e4-4913-b74b-fcf23e7eaabf None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:20.046975 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6db61c-3ad0-4fa7-978b-ec99851c0b19 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:20.060472 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6cc36b-e72b-425b-aeb8-f1753b5b4797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:20.061685 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6cc36b-e72b-425b-aeb8-f1753b5b4797 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:20.062007 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6cc36b-e72b-425b-aeb8-f1753b5b4797 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:20.062287 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6cc36b-e72b-425b-aeb8-f1753b5b4797 None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:20.063040 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6cc36b-e72b-425b-aeb8-f1753b5b4797 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:20.063352 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6cc36b-e72b-425b-aeb8-f1753b5b4797 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:20.064762 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6cc36b-e72b-425b-aeb8-f1753b5b4797 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:20.075818 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 188/370] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:48:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:20.077244 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6cc36b-e72b-425b-aeb8-f1753b5b4797 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:20.094172 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe2a64-1727-4eb6-a71d-a8c3bef571cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:20.095383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe2a64-1727-4eb6-a71d-a8c3bef571cc None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:20.096995 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe2a64-1727-4eb6-a71d-a8c3bef571cc None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:20.097520 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe2a64-1727-4eb6-a71d-a8c3bef571cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:20.098666 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fe2a64-1727-4eb6-a71d-a8c3bef571cc None admin] RBAC: Adding query filter params (group.id=c8eb9f9c7db549abb7c5c502e42a8e33, role.id=9f25fed676d84770b9dc2a96a769de28, scope.project.id=0aa8006660fe4334b8ca63e5e2a5d7e0) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:20.099182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fe2a64-1727-4eb6-a71d-a8c3bef571cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:20.100904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fe2a64-1727-4eb6-a71d-a8c3bef571cc None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:20.107222 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 183/371] 10.222.0.23 () {56 vars in 1376 bytes} [Sat Apr 30 20:48:19 2022] GET /identity/v3/role_assignments?group.id=c8eb9f9c7db549abb7c5c502e42a8e33&scope.project.id=0aa8006660fe4334b8ca63e5e2a5d7e0&role.id=9f25fed676d84770b9dc2a96a769de28 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:20.109392 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe2a64-1727-4eb6-a71d-a8c3bef571cc None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:20.193232 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6cc36b-e72b-425b-aeb8-f1753b5b4797 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:20.228951 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4fcdc-a7eb-4bdf-8ed7-e9ac0545a429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:20.229633 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4fcdc-a7eb-4bdf-8ed7-e9ac0545a429 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:20.229958 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4fcdc-a7eb-4bdf-8ed7-e9ac0545a429 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:20.230240 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4fcdc-a7eb-4bdf-8ed7-e9ac0545a429 None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:20.230992 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe4fcdc-a7eb-4bdf-8ed7-e9ac0545a429 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:20.231301 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe4fcdc-a7eb-4bdf-8ed7-e9ac0545a429 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:20.233283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe4fcdc-a7eb-4bdf-8ed7-e9ac0545a429 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:20.242306 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 189/372] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:48:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:20.247828 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4fcdc-a7eb-4bdf-8ed7-e9ac0545a429 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:20.253205 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe2a64-1727-4eb6-a71d-a8c3bef571cc None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:20.309708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f382ea4-dd02-4984-bff8-4fa016d42a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:20.311530 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f382ea4-dd02-4984-bff8-4fa016d42a49 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:20.312021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f382ea4-dd02-4984-bff8-4fa016d42a49 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:20.312496 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f382ea4-dd02-4984-bff8-4fa016d42a49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:20.357698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4fcdc-a7eb-4bdf-8ed7-e9ac0545a429 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:20.399697 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e01307-e9eb-4b23-bad2-7e9b9ddbd726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:20.403906 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e01307-e9eb-4b23-bad2-7e9b9ddbd726 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:20.403906 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e01307-e9eb-4b23-bad2-7e9b9ddbd726 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:20.403906 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e01307-e9eb-4b23-bad2-7e9b9ddbd726 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:20.413135 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f382ea4-dd02-4984-bff8-4fa016d42a49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:20.415130 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f382ea4-dd02-4984-bff8-4fa016d42a49 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:20.485269 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e01307-e9eb-4b23-bad2-7e9b9ddbd726 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:20.486782 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e01307-e9eb-4b23-bad2-7e9b9ddbd726 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:20.579737 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 184/373] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:48:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:48:20.585170 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f382ea4-dd02-4984-bff8-4fa016d42a49 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:20.635362 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 190/374] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:48:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:48:20.641113 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e01307-e9eb-4b23-bad2-7e9b9ddbd726 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:20.719085 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f382ea4-dd02-4984-bff8-4fa016d42a49 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:20.744736 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e01307-e9eb-4b23-bad2-7e9b9ddbd726 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:20.766504 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934933c6-b86e-43fc-a183-3a869eb38f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:20.767389 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934933c6-b86e-43fc-a183-3a869eb38f57 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:20.767671 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934933c6-b86e-43fc-a183-3a869eb38f57 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:20.767945 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934933c6-b86e-43fc-a183-3a869eb38f57 None admin] PATH_INFO: `/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:20.769203 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934933c6-b86e-43fc-a183-3a869eb38f57 None admin] RBAC: Authorizing `identity:get_project(project_id=0aa8006660fe4334b8ca63e5e2a5d7e0)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:20.770686 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934933c6-b86e-43fc-a183-3a869eb38f57 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:20.772681 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 185/375] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:48:20 2022] GET /identity/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:20.784158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934933c6-b86e-43fc-a183-3a869eb38f57 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:20.785905 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa5b39-7338-478d-8a95-aa297ace0e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:20.786771 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa5b39-7338-478d-8a95-aa297ace0e7e None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:20.787054 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa5b39-7338-478d-8a95-aa297ace0e7e None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:20.787328 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa5b39-7338-478d-8a95-aa297ace0e7e None admin] PATH_INFO: `/v3/projects/137d4e571f624bfe845b398839c48b74` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:20.788529 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa5b39-7338-478d-8a95-aa297ace0e7e None admin] RBAC: Authorizing `identity:get_project(project_id=137d4e571f624bfe845b398839c48b74)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:20.790015 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa5b39-7338-478d-8a95-aa297ace0e7e None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:20.791990 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 191/376] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:48:20 2022] GET /identity/v3/projects/137d4e571f624bfe845b398839c48b74 => generated 344 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:20.797419 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa5b39-7338-478d-8a95-aa297ace0e7e None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:20.895231 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934933c6-b86e-43fc-a183-3a869eb38f57 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:20.899230 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa5b39-7338-478d-8a95-aa297ace0e7e None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:20.933987 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c729b92-90a8-4382-939d-0904e101c8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:20.934954 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c729b92-90a8-4382-939d-0904e101c8ee None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:20.935236 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c729b92-90a8-4382-939d-0904e101c8ee None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:20.935511 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c729b92-90a8-4382-939d-0904e101c8ee None admin] PATH_INFO: `/v3/groups/cdb36c9638504012a713eb849ec40a0e` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:20.939525 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9272e8-deaa-4401-a0d7-96708f193d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:20.940388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9272e8-deaa-4401-a0d7-96708f193d3d None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:20.940665 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9272e8-deaa-4401-a0d7-96708f193d3d None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:20.940936 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9272e8-deaa-4401-a0d7-96708f193d3d None admin] PATH_INFO: `/v3/groups/c8eb9f9c7db549abb7c5c502e42a8e33` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:20.941191 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c729b92-90a8-4382-939d-0904e101c8ee None admin] RBAC: Authorizing `identity:get_group(group_id=cdb36c9638504012a713eb849ec40a0e)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:20.942803 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c729b92-90a8-4382-939d-0904e101c8ee None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:20.944753 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 192/377] 10.222.0.23 () {56 vars in 1180 bytes} [Sat Apr 30 20:48:20 2022] GET /identity/v3/groups/cdb36c9638504012a713eb849ec40a0e => generated 229 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:48:20.945389 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9272e8-deaa-4401-a0d7-96708f193d3d None admin] RBAC: Authorizing `identity:get_group(group_id=c8eb9f9c7db549abb7c5c502e42a8e33)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:20.946931 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9272e8-deaa-4401-a0d7-96708f193d3d None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:20.948672 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 186/378] 10.222.0.23 () {56 vars in 1180 bytes} [Sat Apr 30 20:48:20 2022] GET /identity/v3/groups/c8eb9f9c7db549abb7c5c502e42a8e33 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:48:20.954146 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c729b92-90a8-4382-939d-0904e101c8ee None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:20.957648 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9272e8-deaa-4401-a0d7-96708f193d3d None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:21.059113 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c729b92-90a8-4382-939d-0904e101c8ee None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:21.097788 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c5416-f49f-4d8b-8a26-74198f145ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:21.097788 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c5416-f49f-4d8b-8a26-74198f145ae0 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:21.097788 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c5416-f49f-4d8b-8a26-74198f145ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:21.097788 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c5416-f49f-4d8b-8a26-74198f145ae0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:21.098194 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c5416-f49f-4d8b-8a26-74198f145ae0 None admin] RBAC: Adding query filter params (group.id=c8eb9f9c7db549abb7c5c502e42a8e33, role.id=121b12a250ae4ef8ae1a85ea8c21c4fa, scope.project.id=0aa8006660fe4334b8ca63e5e2a5d7e0) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:21.098194 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c5416-f49f-4d8b-8a26-74198f145ae0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:21.099427 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c5416-f49f-4d8b-8a26-74198f145ae0 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:21.108597 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 193/379] 10.222.0.23 () {56 vars in 1376 bytes} [Sat Apr 30 20:48:20 2022] GET /identity/v3/role_assignments?group.id=c8eb9f9c7db549abb7c5c502e42a8e33&scope.project.id=0aa8006660fe4334b8ca63e5e2a5d7e0&role.id=121b12a250ae4ef8ae1a85ea8c21c4fa => generated 260 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:21.156239 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9272e8-deaa-4401-a0d7-96708f193d3d None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:21.197340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5d03d-31b4-4865-8692-d76b67bb55a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:21.198476 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5d03d-31b4-4865-8692-d76b67bb55a5 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:21.198960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5d03d-31b4-4865-8692-d76b67bb55a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:21.199432 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5d03d-31b4-4865-8692-d76b67bb55a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:21.200477 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5d03d-31b4-4865-8692-d76b67bb55a5 None admin] RBAC: Adding query filter params (group.id=cdb36c9638504012a713eb849ec40a0e, role.id=30112eb1f3e047398c3c82fb40b72e62, scope.project.id=137d4e571f624bfe845b398839c48b74) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:21.201032 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5d03d-31b4-4865-8692-d76b67bb55a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:21.204879 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5d03d-31b4-4865-8692-d76b67bb55a5 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:21.211917 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 187/380] 10.222.0.23 () {56 vars in 1376 bytes} [Sat Apr 30 20:48:20 2022] GET /identity/v3/role_assignments?group.id=cdb36c9638504012a713eb849ec40a0e&scope.project.id=137d4e571f624bfe845b398839c48b74&role.id=30112eb1f3e047398c3c82fb40b72e62 => generated 260 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:22.165217 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024df4d-b23d-42ef-a585-04fc3fa3521c None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:22.166270 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024df4d-b23d-42ef-a585-04fc3fa3521c None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:22.166789 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024df4d-b23d-42ef-a585-04fc3fa3521c None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:22.168617 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 194/381] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:22.174674 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f008c8-8dd1-41e0-aaf9-db13d98a090e None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:22.175515 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f008c8-8dd1-41e0-aaf9-db13d98a090e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:22.176007 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f008c8-8dd1-41e0-aaf9-db13d98a090e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:22.195533 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-b6f008c8-8dd1-41e0-aaf9-db13d98a090e None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:22.197039 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b6f008c8-8dd1-41e0-aaf9-db13d98a090e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:22.285792 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 188/382] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:48:22.320671 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024df4d-b23d-42ef-a585-04fc3fa3521c None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:22.453609 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024df4d-b23d-42ef-a585-04fc3fa3521c None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:22.496067 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d72b06-59fd-4ae5-bd67-c789a3f2ac83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:22.497254 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d72b06-59fd-4ae5-bd67-c789a3f2ac83 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:22.497736 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d72b06-59fd-4ae5-bd67-c789a3f2ac83 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:22.498250 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d72b06-59fd-4ae5-bd67-c789a3f2ac83 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:22.514964 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d72b06-59fd-4ae5-bd67-c789a3f2ac83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:48:22.523423 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-47d72b06-59fd-4ae5-bd67-c789a3f2ac83 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:48:22.523423 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:22.523423 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:22.523423 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:22.523423 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:22.523423 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:22.523423 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:22.523423 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:22.523423 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:22.523423 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:22.523423 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:22.523423 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:22.523423 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:48:22.523423 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:48:22.523423 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:48:22.523423 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:48:22.524292 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:48:22.524292 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:48:22.524292 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:48:22.524292 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:48:22.524292 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:22.524292 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:22.524292 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:22.524292 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:22.524292 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:22.524292 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:22.524292 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:22.524292 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:22.524292 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:22.524292 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:22.524292 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:22.524292 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:22.525084 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:22.525084 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:22.525084 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:22.525084 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:22.525084 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:48:22.525084 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:48:22.525084 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:48:22.525084 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:48:22.525084 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:48:22.525084 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:48:22.525084 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:48:22.525084 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:22.527472 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 195/383] 10.222.0.23 () {56 vars in 1114 bytes} [Sat Apr 30 20:48:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:22.533405 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f008c8-8dd1-41e0-aaf9-db13d98a090e None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:22.679898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f008c8-8dd1-41e0-aaf9-db13d98a090e None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:22.721329 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43d9bc-ef5f-4a21-8554-2067dd102d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:22.721962 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43d9bc-ef5f-4a21-8554-2067dd102d6c None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:22.722241 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43d9bc-ef5f-4a21-8554-2067dd102d6c None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:22.722515 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43d9bc-ef5f-4a21-8554-2067dd102d6c None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:22.723279 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43d9bc-ef5f-4a21-8554-2067dd102d6c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:22.723581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43d9bc-ef5f-4a21-8554-2067dd102d6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:22.724996 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43d9bc-ef5f-4a21-8554-2067dd102d6c None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:22.737913 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 189/384] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:48:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:22.740277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d72b06-59fd-4ae5-bd67-c789a3f2ac83 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:22.877684 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d72b06-59fd-4ae5-bd67-c789a3f2ac83 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:22.924965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea115c14-b222-4f48-9ba2-0ee7458772e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:22.925855 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea115c14-b222-4f48-9ba2-0ee7458772e9 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:22.926146 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea115c14-b222-4f48-9ba2-0ee7458772e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:22.926428 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea115c14-b222-4f48-9ba2-0ee7458772e9 None admin] PATH_INFO: `/v3/groups/c8eb9f9c7db549abb7c5c502e42a8e33` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:22.930454 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea115c14-b222-4f48-9ba2-0ee7458772e9 None admin] RBAC: Authorizing `identity:get_group(group_id=c8eb9f9c7db549abb7c5c502e42a8e33)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:22.931941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea115c14-b222-4f48-9ba2-0ee7458772e9 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:22.933951 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 196/385] 10.222.0.23 () {56 vars in 1180 bytes} [Sat Apr 30 20:48:22 2022] GET /identity/v3/groups/c8eb9f9c7db549abb7c5c502e42a8e33 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:22.939736 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43d9bc-ef5f-4a21-8554-2067dd102d6c None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:23.073797 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43d9bc-ef5f-4a21-8554-2067dd102d6c None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:23.114628 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569fd6b5-2b9b-4fc0-9aec-c9ec3ec1e246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:23.115875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fd6b5-2b9b-4fc0-9aec-c9ec3ec1e246 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:23.116359 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fd6b5-2b9b-4fc0-9aec-c9ec3ec1e246 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:23.116831 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fd6b5-2b9b-4fc0-9aec-c9ec3ec1e246 None admin] PATH_INFO: `/v3/projects/9431599023b44f1cb5dfb8bca0584f5f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:23.118281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569fd6b5-2b9b-4fc0-9aec-c9ec3ec1e246 None admin] RBAC: Authorizing `identity:get_project(project_id=9431599023b44f1cb5dfb8bca0584f5f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:23.119986 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569fd6b5-2b9b-4fc0-9aec-c9ec3ec1e246 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:23.121901 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 190/386] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:48:22 2022] GET /identity/v3/projects/9431599023b44f1cb5dfb8bca0584f5f => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:23.128326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea115c14-b222-4f48-9ba2-0ee7458772e9 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:23.161331 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6aaa6-3909-446c-9a4b-94f83fffb218 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:23.161988 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6aaa6-3909-446c-9a4b-94f83fffb218 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:23.162492 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6aaa6-3909-446c-9a4b-94f83fffb218 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:23.164445 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 191/387] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:48:23.169835 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03331ae2-aedc-444b-853b-46f4ef2d01a7 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:23.170935 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03331ae2-aedc-444b-853b-46f4ef2d01a7 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:23.171410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03331ae2-aedc-444b-853b-46f4ef2d01a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:23.194637 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-03331ae2-aedc-444b-853b-46f4ef2d01a7 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:23.196690 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-03331ae2-aedc-444b-853b-46f4ef2d01a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:23.294873 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 192/388] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:48:23.303865 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a062f-d8df-473a-ad24-b8df4860f384 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:23.304469 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a062f-d8df-473a-ad24-b8df4860f384 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:23.304946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a062f-d8df-473a-ad24-b8df4860f384 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:23.306628 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 193/389] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:23.308700 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea115c14-b222-4f48-9ba2-0ee7458772e9 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:23.312629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999017ce-ab89-42cf-a9b6-0eb70f7b9f0d None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:23.313132 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999017ce-ab89-42cf-a9b6-0eb70f7b9f0d None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:23.313631 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999017ce-ab89-42cf-a9b6-0eb70f7b9f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:23.342304 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-999017ce-ab89-42cf-a9b6-0eb70f7b9f0d None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:23.343459 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-999017ce-ab89-42cf-a9b6-0eb70f7b9f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:23.359792 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e202b-e5b6-4634-a951-a8f60e18f151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:23.361051 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e202b-e5b6-4634-a951-a8f60e18f151 None admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:23.361537 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e202b-e5b6-4634-a951-a8f60e18f151 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:23.362036 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e202b-e5b6-4634-a951-a8f60e18f151 None admin] PATH_INFO: `/v3/projects/9431599023b44f1cb5dfb8bca0584f5f/groups/c8eb9f9c7db549abb7c5c502e42a8e33/roles/121b12a250ae4ef8ae1a85ea8c21c4fa` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:23.364565 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e202b-e5b6-4634-a951-a8f60e18f151 None admin] RBAC: Authorizing `identity:create_grant(project_id=9431599023b44f1cb5dfb8bca0584f5f, group_id=c8eb9f9c7db549abb7c5c502e42a8e33, role_id=121b12a250ae4ef8ae1a85ea8c21c4fa)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:23.366347 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e202b-e5b6-4634-a951-a8f60e18f151 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:23.421517 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 194/390] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:48:23.422335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999017ce-ab89-42cf-a9b6-0eb70f7b9f0d None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:23.503072 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 197/391] 10.222.0.23 () {58 vars in 1442 bytes} [Sat Apr 30 20:48:23 2022] PUT /identity/v3/projects/9431599023b44f1cb5dfb8bca0584f5f/groups/c8eb9f9c7db549abb7c5c502e42a8e33/roles/121b12a250ae4ef8ae1a85ea8c21c4fa => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:48:23.504491 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e202b-e5b6-4634-a951-a8f60e18f151 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:23.568653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999017ce-ab89-42cf-a9b6-0eb70f7b9f0d None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:23.658616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628c3a1-18bc-43c9-b193-29136d1f8445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:23.659351 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628c3a1-18bc-43c9-b193-29136d1f8445 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:23.659636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628c3a1-18bc-43c9-b193-29136d1f8445 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:23.659917 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628c3a1-18bc-43c9-b193-29136d1f8445 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:23.666262 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e202b-e5b6-4634-a951-a8f60e18f151 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:23.686893 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628c3a1-18bc-43c9-b193-29136d1f8445 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:48:23.694844 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-0628c3a1-18bc-43c9-b193-29136d1f8445 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:48:23.694844 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:23.694844 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:23.694844 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:23.694844 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:23.694844 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:23.694844 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:23.694844 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:23.694844 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:23.694844 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:23.694844 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:23.694844 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:23.694844 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:48:23.694844 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:48:23.694844 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:48:23.694844 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:48:23.695808 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:48:23.695808 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:48:23.695808 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:48:23.695808 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:48:23.695808 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:23.695808 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:23.695808 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:23.695808 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:23.695808 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:23.695808 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:23.695808 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:23.695808 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:23.695808 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:23.695808 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:23.695808 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:23.695808 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:23.696601 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:23.696601 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:23.696601 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:23.696601 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:23.696601 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:48:23.696601 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:48:23.696601 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:48:23.696601 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:48:23.696601 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:48:23.696601 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:48:23.696601 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:48:23.696601 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:23.696601 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 195/392] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:48:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:23.702805 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628c3a1-18bc-43c9-b193-29136d1f8445 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:23.710889 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bee334-f46d-47da-8895-bdfc4f37d1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:23.716671 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bee334-f46d-47da-8895-bdfc4f37d1d3 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:23.716953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bee334-f46d-47da-8895-bdfc4f37d1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:23.717828 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bee334-f46d-47da-8895-bdfc4f37d1d3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:23.737480 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bee334-f46d-47da-8895-bdfc4f37d1d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:48:23.751871 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-16bee334-f46d-47da-8895-bdfc4f37d1d3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:48:23.751871 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:23.751871 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:23.751871 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:23.751871 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:23.751871 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:23.751871 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:23.751871 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:23.751871 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:23.751871 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:23.751871 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:23.751871 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:23.751871 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:48:23.751871 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:48:23.751871 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:48:23.751871 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:48:23.752813 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:48:23.752813 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:48:23.752813 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:48:23.752813 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:48:23.752813 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:23.752813 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:23.752813 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:23.752813 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:23.752813 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:23.752813 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:23.752813 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:23.752813 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:23.752813 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:23.752813 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:23.752813 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:23.752813 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:23.753635 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:23.753635 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:23.753635 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:23.753635 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:23.753635 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:48:23.753635 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:48:23.753635 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:48:23.753635 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:48:23.753635 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:48:23.753635 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:48:23.753635 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:48:23.753635 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:23.753635 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 198/393] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:48:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:23.762717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bee334-f46d-47da-8895-bdfc4f37d1d3 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:23.849597 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628c3a1-18bc-43c9-b193-29136d1f8445 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:23.867245 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bee334-f46d-47da-8895-bdfc4f37d1d3 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:23.884945 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c1323-24d7-4c43-be36-a28a480a3588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:23.886049 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c1323-24d7-4c43-be36-a28a480a3588 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:23.886565 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c1323-24d7-4c43-be36-a28a480a3588 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:23.887089 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c1323-24d7-4c43-be36-a28a480a3588 None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:23.888061 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c1323-24d7-4c43-be36-a28a480a3588 None admin] RBAC: Adding query filter params (name=member) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:23.888576 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c1323-24d7-4c43-be36-a28a480a3588 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:23.890307 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c1323-24d7-4c43-be36-a28a480a3588 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:23.900315 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 196/394] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Apr 30 20:48:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:23.906691 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c1323-24d7-4c43-be36-a28a480a3588 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:23.919280 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e037617-1af6-47a8-afad-a98a4b709c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:23.919896 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e037617-1af6-47a8-afad-a98a4b709c23 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:23.920205 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e037617-1af6-47a8-afad-a98a4b709c23 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:23.921024 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e037617-1af6-47a8-afad-a98a4b709c23 None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:23.921976 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e037617-1af6-47a8-afad-a98a4b709c23 None admin] RBAC: Adding query filter params (name=member) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:23.922297 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e037617-1af6-47a8-afad-a98a4b709c23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:23.923739 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e037617-1af6-47a8-afad-a98a4b709c23 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:23.944344 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 199/395] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Apr 30 20:48:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:23.954825 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e037617-1af6-47a8-afad-a98a4b709c23 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:24.024042 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c1323-24d7-4c43-be36-a28a480a3588 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:24.065799 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9ea96-5e72-4cc1-9cd4-636395657986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:24.067013 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9ea96-5e72-4cc1-9cd4-636395657986 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:24.067498 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9ea96-5e72-4cc1-9cd4-636395657986 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:24.068425 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9ea96-5e72-4cc1-9cd4-636395657986 None admin] PATH_INFO: `/v3/groups/c8eb9f9c7db549abb7c5c502e42a8e33` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:24.069972 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e9ea96-5e72-4cc1-9cd4-636395657986 None admin] RBAC: Authorizing `identity:get_group(group_id=c8eb9f9c7db549abb7c5c502e42a8e33)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:24.072105 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e9ea96-5e72-4cc1-9cd4-636395657986 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:24.074347 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 197/396] 10.222.0.23 () {56 vars in 1180 bytes} [Sat Apr 30 20:48:23 2022] GET /identity/v3/groups/c8eb9f9c7db549abb7c5c502e42a8e33 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:24.079900 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9ea96-5e72-4cc1-9cd4-636395657986 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:24.151302 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e037617-1af6-47a8-afad-a98a4b709c23 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:24.186855 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4561fe-df2e-4ec7-a71e-fd02ec3bb958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:24.188111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4561fe-df2e-4ec7-a71e-fd02ec3bb958 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:24.188593 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4561fe-df2e-4ec7-a71e-fd02ec3bb958 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:24.189068 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4561fe-df2e-4ec7-a71e-fd02ec3bb958 None admin] PATH_INFO: `/v3/groups/c8eb9f9c7db549abb7c5c502e42a8e33` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:24.190464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4561fe-df2e-4ec7-a71e-fd02ec3bb958 None admin] RBAC: Authorizing `identity:get_group(group_id=c8eb9f9c7db549abb7c5c502e42a8e33)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:24.192234 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4561fe-df2e-4ec7-a71e-fd02ec3bb958 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:24.194148 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 200/397] 10.222.0.23 () {56 vars in 1180 bytes} [Sat Apr 30 20:48:23 2022] GET /identity/v3/groups/c8eb9f9c7db549abb7c5c502e42a8e33 => generated 226 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:24.195536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf4550-596a-4d39-8d9d-0e9500988cfd None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:24.196022 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf4550-596a-4d39-8d9d-0e9500988cfd None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:24.196535 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf4550-596a-4d39-8d9d-0e9500988cfd None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:24.198953 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 201/398] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:24.200386 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9ea96-5e72-4cc1-9cd4-636395657986 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:24.203858 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf4550-596a-4d39-8d9d-0e9500988cfd None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:24.240987 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee97cd-e9dd-40d7-acdb-334181c85c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:24.242572 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee97cd-e9dd-40d7-acdb-334181c85c46 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:24.242810 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee97cd-e9dd-40d7-acdb-334181c85c46 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:24.243033 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee97cd-e9dd-40d7-acdb-334181c85c46 None admin] PATH_INFO: `/v3/projects/9431599023b44f1cb5dfb8bca0584f5f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:24.244246 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee97cd-e9dd-40d7-acdb-334181c85c46 None admin] RBAC: Authorizing `identity:get_project(project_id=9431599023b44f1cb5dfb8bca0584f5f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:24.245746 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee97cd-e9dd-40d7-acdb-334181c85c46 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:24.247594 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 198/399] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:48:24 2022] GET /identity/v3/projects/9431599023b44f1cb5dfb8bca0584f5f => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:48:24.249824 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c42366-3d44-481d-989d-16b2f802627c None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:24.249824 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c42366-3d44-481d-989d-16b2f802627c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:24.249824 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c42366-3d44-481d-989d-16b2f802627c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:24.267486 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-69c42366-3d44-481d-989d-16b2f802627c None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:24.268856 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-69c42366-3d44-481d-989d-16b2f802627c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:24.312627 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf4550-596a-4d39-8d9d-0e9500988cfd None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:24.337815 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 199/400] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:48:24.337815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9806cb-dbdc-43a1-b34f-07a5211ab03c None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:24.337815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9806cb-dbdc-43a1-b34f-07a5211ab03c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:24.337815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9806cb-dbdc-43a1-b34f-07a5211ab03c None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:24.338633 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 200/401] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:24.339256 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9806cb-dbdc-43a1-b34f-07a5211ab03c None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:24.360130 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c956a00-2fb4-4c21-a6c1-1317fef4fd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:24.361205 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c956a00-2fb4-4c21-a6c1-1317fef4fd9d None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:24.361488 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c956a00-2fb4-4c21-a6c1-1317fef4fd9d None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:24.361995 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c956a00-2fb4-4c21-a6c1-1317fef4fd9d None admin] PATH_INFO: `/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:24.363313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c956a00-2fb4-4c21-a6c1-1317fef4fd9d None admin] RBAC: Authorizing `identity:get_project(project_id=0aa8006660fe4334b8ca63e5e2a5d7e0)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:24.364763 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c956a00-2fb4-4c21-a6c1-1317fef4fd9d None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:24.366651 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 202/402] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:48:24 2022] GET /identity/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:24.367832 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136d5db-1829-4422-a642-cad3ae8943e9 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:24.368119 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136d5db-1829-4422-a642-cad3ae8943e9 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:24.368393 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136d5db-1829-4422-a642-cad3ae8943e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:24.384977 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-e136d5db-1829-4422-a642-cad3ae8943e9 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:24.386202 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e136d5db-1829-4422-a642-cad3ae8943e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:24.448625 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9806cb-dbdc-43a1-b34f-07a5211ab03c None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:24.457926 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 203/403] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:48:24.457926 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136d5db-1829-4422-a642-cad3ae8943e9 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:24.495174 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576403ea-b716-41c2-8153-bb2a4add3cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:24.496051 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576403ea-b716-41c2-8153-bb2a4add3cf5 None admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:24.496326 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576403ea-b716-41c2-8153-bb2a4add3cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:24.496606 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576403ea-b716-41c2-8153-bb2a4add3cf5 None admin] PATH_INFO: `/v3/projects/9431599023b44f1cb5dfb8bca0584f5f/groups/c8eb9f9c7db549abb7c5c502e42a8e33/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:24.499092 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576403ea-b716-41c2-8153-bb2a4add3cf5 None admin] RBAC: Authorizing `identity:create_grant(project_id=9431599023b44f1cb5dfb8bca0584f5f, group_id=c8eb9f9c7db549abb7c5c502e42a8e33, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:24.500534 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576403ea-b716-41c2-8153-bb2a4add3cf5 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:24.546912 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136d5db-1829-4422-a642-cad3ae8943e9 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:24.581907 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 201/404] 10.222.0.23 () {58 vars in 1442 bytes} [Sat Apr 30 20:48:24 2022] PUT /identity/v3/projects/9431599023b44f1cb5dfb8bca0584f5f/groups/c8eb9f9c7db549abb7c5c502e42a8e33/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:48:24.581907 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576403ea-b716-41c2-8153-bb2a4add3cf5 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:24.590761 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ad51e-eba3-4692-a2c0-fe15c879e516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:24.591825 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ad51e-eba3-4692-a2c0-fe15c879e516 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:24.592226 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ad51e-eba3-4692-a2c0-fe15c879e516 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:24.593015 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ad51e-eba3-4692-a2c0-fe15c879e516 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:24.609112 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ad51e-eba3-4692-a2c0-fe15c879e516 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:48:24.620323 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-216ad51e-eba3-4692-a2c0-fe15c879e516 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:48:24.620323 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:24.620323 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:24.620323 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:24.620323 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:24.620323 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:24.620323 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:24.620323 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:24.620323 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:24.620323 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:24.620323 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:24.620323 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:24.620323 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:48:24.620323 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:48:24.620323 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:48:24.620323 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:48:24.621307 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:48:24.621307 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:48:24.621307 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:48:24.621307 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:48:24.621307 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:24.621307 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:24.621307 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:24.621307 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:24.621307 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:24.621307 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:24.621307 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:24.621307 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:24.621307 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:24.621307 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:24.621307 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:24.621307 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:24.622152 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:24.622152 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:24.622152 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:24.622152 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:24.622152 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:48:24.622152 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:48:24.622152 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:48:24.622152 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:48:24.622152 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:48:24.622152 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:48:24.622152 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:48:24.622152 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:24.622152 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 204/405] 10.222.0.23 () {56 vars in 1114 bytes} [Sat Apr 30 20:48:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:24.623107 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ad51e-eba3-4692-a2c0-fe15c879e516 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:24.687303 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576403ea-b716-41c2-8153-bb2a4add3cf5 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:24.723841 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e3c8b2-4b3b-4f35-8a81-9eb4c8689e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:24.724932 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3c8b2-4b3b-4f35-8a81-9eb4c8689e24 None admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:24.725209 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3c8b2-4b3b-4f35-8a81-9eb4c8689e24 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:24.725481 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3c8b2-4b3b-4f35-8a81-9eb4c8689e24 None admin] PATH_INFO: `/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0/groups/c8eb9f9c7db549abb7c5c502e42a8e33/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:24.728433 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e3c8b2-4b3b-4f35-8a81-9eb4c8689e24 None admin] RBAC: Authorizing `identity:create_grant(project_id=0aa8006660fe4334b8ca63e5e2a5d7e0, group_id=c8eb9f9c7db549abb7c5c502e42a8e33, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:24.730437 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e3c8b2-4b3b-4f35-8a81-9eb4c8689e24 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:24.747156 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ad51e-eba3-4692-a2c0-fe15c879e516 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:24.784065 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b6f14-66a7-4c75-9a1c-b6472fd8b4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:24.784715 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b6f14-66a7-4c75-9a1c-b6472fd8b4b8 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:24.785095 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b6f14-66a7-4c75-9a1c-b6472fd8b4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:24.785416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b6f14-66a7-4c75-9a1c-b6472fd8b4b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:24.797518 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0b6f14-66a7-4c75-9a1c-b6472fd8b4b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:48:24.805412 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-6f0b6f14-66a7-4c75-9a1c-b6472fd8b4b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:48:24.805412 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:24.805412 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:24.805412 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:24.805412 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:24.805412 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:24.805412 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:24.805412 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:24.805412 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:24.805412 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:24.805412 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:24.805412 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:24.805412 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:48:24.805412 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:48:24.805412 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:48:24.805412 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:48:24.806511 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:48:24.806511 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:48:24.806511 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:48:24.806511 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:48:24.806511 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:24.806511 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:24.806511 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:24.806511 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:24.806511 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:24.806511 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:24.806511 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:24.806511 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:24.806511 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:24.806511 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:24.806511 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:24.806511 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:24.807543 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:24.807543 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:24.807543 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:24.807543 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:24.807543 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:48:24.807543 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:48:24.807543 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:48:24.807543 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:48:24.807543 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:48:24.807543 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:48:24.807543 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:48:24.807543 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:24.807543 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 205/406] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Apr 30 20:48:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:24.807543 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b6f14-66a7-4c75-9a1c-b6472fd8b4b8 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:24.826786 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 202/407] 10.222.0.23 () {58 vars in 1442 bytes} [Sat Apr 30 20:48:24 2022] PUT /identity/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0/groups/c8eb9f9c7db549abb7c5c502e42a8e33/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:48:24.828098 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e3c8b2-4b3b-4f35-8a81-9eb4c8689e24 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:24.941193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e3c8b2-4b3b-4f35-8a81-9eb4c8689e24 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:24.947859 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b6f14-66a7-4c75-9a1c-b6472fd8b4b8 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:24.979457 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1fff0-a686-4d8f-af28-4ad5a03ce03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:24.980494 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1fff0-a686-4d8f-af28-4ad5a03ce03f None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:24.980977 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1fff0-a686-4d8f-af28-4ad5a03ce03f None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:24.981451 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1fff0-a686-4d8f-af28-4ad5a03ce03f None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:24.982489 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab1fff0-a686-4d8f-af28-4ad5a03ce03f None admin] RBAC: Adding query filter params (name=admin) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:24.983566 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab1fff0-a686-4d8f-af28-4ad5a03ce03f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:24.985295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab1fff0-a686-4d8f-af28-4ad5a03ce03f None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:24.992890 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b4e98-bcd5-4cf5-957e-229d8eea9cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:24.993617 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b4e98-bcd5-4cf5-957e-229d8eea9cbd None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:24.993884 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b4e98-bcd5-4cf5-957e-229d8eea9cbd None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:24.994167 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b4e98-bcd5-4cf5-957e-229d8eea9cbd None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:24.994937 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b4e98-bcd5-4cf5-957e-229d8eea9cbd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:24.995247 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b4e98-bcd5-4cf5-957e-229d8eea9cbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:24.996145 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 203/408] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:48:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:24.996995 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b4e98-bcd5-4cf5-957e-229d8eea9cbd None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:25.004535 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1fff0-a686-4d8f-af28-4ad5a03ce03f None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:25.007137 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 206/409] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:48:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:25.014790 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b4e98-bcd5-4cf5-957e-229d8eea9cbd None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:25.121647 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1fff0-a686-4d8f-af28-4ad5a03ce03f None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:25.121885 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b4e98-bcd5-4cf5-957e-229d8eea9cbd None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:25.155926 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79d1ac-ff37-4cc2-8f3e-778f5d7fabe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:25.156143 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5162d9fc-d818-4de0-aa63-7be730a8d35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:25.156907 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79d1ac-ff37-4cc2-8f3e-778f5d7fabe7 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:25.157014 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162d9fc-d818-4de0-aa63-7be730a8d35d None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:25.157220 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79d1ac-ff37-4cc2-8f3e-778f5d7fabe7 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:25.157310 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162d9fc-d818-4de0-aa63-7be730a8d35d None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:25.157497 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79d1ac-ff37-4cc2-8f3e-778f5d7fabe7 None admin] PATH_INFO: `/v3/groups/cdb36c9638504012a713eb849ec40a0e` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:25.157590 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162d9fc-d818-4de0-aa63-7be730a8d35d None admin] PATH_INFO: `/v3/groups/c8eb9f9c7db549abb7c5c502e42a8e33` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:25.158742 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5162d9fc-d818-4de0-aa63-7be730a8d35d None admin] RBAC: Authorizing `identity:get_group(group_id=c8eb9f9c7db549abb7c5c502e42a8e33)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:25.158863 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd79d1ac-ff37-4cc2-8f3e-778f5d7fabe7 None admin] RBAC: Authorizing `identity:get_group(group_id=cdb36c9638504012a713eb849ec40a0e)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:25.160187 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd79d1ac-ff37-4cc2-8f3e-778f5d7fabe7 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:25.160291 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5162d9fc-d818-4de0-aa63-7be730a8d35d None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:25.162122 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 204/411] 10.222.0.23 () {56 vars in 1180 bytes} [Sat Apr 30 20:48:25 2022] GET /identity/v3/groups/cdb36c9638504012a713eb849ec40a0e => generated 229 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:25.162230 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 207/411] 10.222.0.23 () {56 vars in 1180 bytes} [Sat Apr 30 20:48:25 2022] GET /identity/v3/groups/c8eb9f9c7db549abb7c5c502e42a8e33 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:25.167459 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79d1ac-ff37-4cc2-8f3e-778f5d7fabe7 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:25.168167 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5162d9fc-d818-4de0-aa63-7be730a8d35d None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:25.269187 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79d1ac-ff37-4cc2-8f3e-778f5d7fabe7 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:25.278753 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5162d9fc-d818-4de0-aa63-7be730a8d35d None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:25.304300 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479977a-35d1-4783-b640-51064396c20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:25.305236 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479977a-35d1-4783-b640-51064396c20f None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:25.305517 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479977a-35d1-4783-b640-51064396c20f None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:25.305807 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8479977a-35d1-4783-b640-51064396c20f None admin] PATH_INFO: `/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:25.306983 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479977a-35d1-4783-b640-51064396c20f None admin] RBAC: Authorizing `identity:get_project(project_id=0aa8006660fe4334b8ca63e5e2a5d7e0)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:25.308430 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8479977a-35d1-4783-b640-51064396c20f None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:25.310365 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 205/412] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:48:25 2022] GET /identity/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:25.314672 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae669b1-f12c-433e-8d74-2bc2026c969a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:25.315542 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae669b1-f12c-433e-8d74-2bc2026c969a None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:25.315741 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479977a-35d1-4783-b640-51064396c20f None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:25.316947 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae669b1-f12c-433e-8d74-2bc2026c969a None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:25.316947 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae669b1-f12c-433e-8d74-2bc2026c969a None admin] PATH_INFO: `/v3/projects/137d4e571f624bfe845b398839c48b74` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:25.317395 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae669b1-f12c-433e-8d74-2bc2026c969a None admin] RBAC: Authorizing `identity:get_project(project_id=137d4e571f624bfe845b398839c48b74)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:25.318904 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae669b1-f12c-433e-8d74-2bc2026c969a None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:25.320998 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 208/413] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:48:25 2022] GET /identity/v3/projects/137d4e571f624bfe845b398839c48b74 => generated 344 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:25.330305 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae669b1-f12c-433e-8d74-2bc2026c969a None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:25.419946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8479977a-35d1-4783-b640-51064396c20f None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:25.462568 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42dcf1e-945a-4b37-8379-0a5aac041232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:25.470860 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42dcf1e-945a-4b37-8379-0a5aac041232 None admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:25.471154 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42dcf1e-945a-4b37-8379-0a5aac041232 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:25.471427 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42dcf1e-945a-4b37-8379-0a5aac041232 None admin] PATH_INFO: `/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0/groups/c8eb9f9c7db549abb7c5c502e42a8e33/roles/121b12a250ae4ef8ae1a85ea8c21c4fa` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:25.476283 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42dcf1e-945a-4b37-8379-0a5aac041232 None admin] RBAC: Authorizing `identity:create_grant(project_id=0aa8006660fe4334b8ca63e5e2a5d7e0, group_id=c8eb9f9c7db549abb7c5c502e42a8e33, role_id=121b12a250ae4ef8ae1a85ea8c21c4fa)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:25.477959 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42dcf1e-945a-4b37-8379-0a5aac041232 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:25.503940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae669b1-f12c-433e-8d74-2bc2026c969a None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:25.539182 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c67c3-adab-4933-bc66-7d3768041b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:25.540381 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c67c3-adab-4933-bc66-7d3768041b42 None admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:25.540864 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c67c3-adab-4933-bc66-7d3768041b42 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:25.541348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c67c3-adab-4933-bc66-7d3768041b42 None admin] PATH_INFO: `/v3/projects/137d4e571f624bfe845b398839c48b74/groups/cdb36c9638504012a713eb849ec40a0e/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:25.543569 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c67c3-adab-4933-bc66-7d3768041b42 None admin] RBAC: Authorizing `identity:create_grant(project_id=137d4e571f624bfe845b398839c48b74, group_id=cdb36c9638504012a713eb849ec40a0e, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:25.545375 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c67c3-adab-4933-bc66-7d3768041b42 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:25.556221 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 206/414] 10.222.0.23 () {58 vars in 1442 bytes} [Sat Apr 30 20:48:25 2022] PUT /identity/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0/groups/c8eb9f9c7db549abb7c5c502e42a8e33/roles/121b12a250ae4ef8ae1a85ea8c21c4fa => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 20:48:25.662426 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 209/415] 10.222.0.23 () {58 vars in 1442 bytes} [Sat Apr 30 20:48:25 2022] PUT /identity/v3/projects/137d4e571f624bfe845b398839c48b74/groups/cdb36c9638504012a713eb849ec40a0e/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 20:48:26.524479 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e9d68-baeb-4bd8-b016-3851ffb99498 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:26.525013 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e9d68-baeb-4bd8-b016-3851ffb99498 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:26.525013 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e9d68-baeb-4bd8-b016-3851ffb99498 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:26.526669 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 207/416] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:26.532217 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb1cf4-b6dc-47eb-b167-f255526ec8ef None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:26.532601 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb1cf4-b6dc-47eb-b167-f255526ec8ef None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:26.532691 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb1cf4-b6dc-47eb-b167-f255526ec8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:26.556663 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-34eb1cf4-b6dc-47eb-b167-f255526ec8ef None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:26.557857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-34eb1cf4-b6dc-47eb-b167-f255526ec8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:26.637997 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 210/417] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:48:26.676840 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e9d68-baeb-4bd8-b016-3851ffb99498 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:26.787656 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e9d68-baeb-4bd8-b016-3851ffb99498 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:26.829501 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ba48a-38c7-4430-8c68-ead8d90b102f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:26.830354 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ba48a-38c7-4430-8c68-ead8d90b102f None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:26.830629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ba48a-38c7-4430-8c68-ead8d90b102f None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:26.830951 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ba48a-38c7-4430-8c68-ead8d90b102f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:26.847288 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ba48a-38c7-4430-8c68-ead8d90b102f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:48:26.855394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-9d5ba48a-38c7-4430-8c68-ead8d90b102f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:48:26.855394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:26.855394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:26.855394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:26.855394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:26.855394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:26.855394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:26.855394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:26.855394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:26.855394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:26.855394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:26.855394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:26.855394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:48:26.855394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:48:26.855394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:48:26.855394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:48:26.856287 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:48:26.856287 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:48:26.856287 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:48:26.856287 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:48:26.856287 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:26.856287 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:26.856287 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:26.856287 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:26.856287 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:26.856287 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:26.856287 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:26.856287 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:26.856287 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:26.856287 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:26.856287 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:26.856287 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:26.857080 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:26.857080 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:26.857080 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:26.857080 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:26.857080 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:48:26.857080 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:48:26.857080 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:48:26.857080 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:48:26.857080 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:48:26.857080 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:48:26.857080 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:48:26.857080 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:26.857080 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 208/418] 10.222.0.23 () {56 vars in 1114 bytes} [Sat Apr 30 20:48:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:26.862974 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb1cf4-b6dc-47eb-b167-f255526ec8ef None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:26.980326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb1cf4-b6dc-47eb-b167-f255526ec8ef None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:27.013127 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428c9e7-d48a-4e9b-85b5-d6f30b34a007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:27.013818 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428c9e7-d48a-4e9b-85b5-d6f30b34a007 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:27.014642 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428c9e7-d48a-4e9b-85b5-d6f30b34a007 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:27.014913 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428c9e7-d48a-4e9b-85b5-d6f30b34a007 None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:27.015654 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8428c9e7-d48a-4e9b-85b5-d6f30b34a007 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:27.015952 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8428c9e7-d48a-4e9b-85b5-d6f30b34a007 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:27.017331 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8428c9e7-d48a-4e9b-85b5-d6f30b34a007 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:27.026583 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 211/419] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:48:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:27.032872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ba48a-38c7-4430-8c68-ead8d90b102f None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:27.144835 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ba48a-38c7-4430-8c68-ead8d90b102f None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:27.184719 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a2a44-3783-40e5-83ff-6c1c1917b009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:27.185817 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a2a44-3783-40e5-83ff-6c1c1917b009 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:27.186315 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a2a44-3783-40e5-83ff-6c1c1917b009 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:27.186814 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a2a44-3783-40e5-83ff-6c1c1917b009 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:27.255967 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443a2a44-3783-40e5-83ff-6c1c1917b009 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:27.257809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443a2a44-3783-40e5-83ff-6c1c1917b009 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:27.370496 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 209/420] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:48:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:48:27.377510 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428c9e7-d48a-4e9b-85b5-d6f30b34a007 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:27.450560 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d55a12-a8eb-4a41-87fe-62bc99fc37f5 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:27.451190 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d55a12-a8eb-4a41-87fe-62bc99fc37f5 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:27.452239 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d55a12-a8eb-4a41-87fe-62bc99fc37f5 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:27.454082 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 210/421] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:48:27.459137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875521b-d565-400c-8b6a-8b11947c684c None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:27.459679 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875521b-d565-400c-8b6a-8b11947c684c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:27.460209 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875521b-d565-400c-8b6a-8b11947c684c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:27.478016 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-0875521b-d565-400c-8b6a-8b11947c684c None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:27.479553 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0875521b-d565-400c-8b6a-8b11947c684c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:27.552311 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428c9e7-d48a-4e9b-85b5-d6f30b34a007 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:27.591056 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 211/422] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:48:27.606963 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f538de1-1904-4b5a-81fd-8ac8954a05b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:27.608216 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f538de1-1904-4b5a-81fd-8ac8954a05b3 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:27.608680 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f538de1-1904-4b5a-81fd-8ac8954a05b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:27.609130 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f538de1-1904-4b5a-81fd-8ac8954a05b3 None admin] PATH_INFO: `/v3/projects/9431599023b44f1cb5dfb8bca0584f5f` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:27.610555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f538de1-1904-4b5a-81fd-8ac8954a05b3 None admin] RBAC: Authorizing `identity:get_project(project_id=9431599023b44f1cb5dfb8bca0584f5f)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:27.612186 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f538de1-1904-4b5a-81fd-8ac8954a05b3 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:27.614458 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 212/423] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:48:27 2022] GET /identity/v3/projects/9431599023b44f1cb5dfb8bca0584f5f => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:27.619767 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875521b-d565-400c-8b6a-8b11947c684c None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:27.719530 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f538de1-1904-4b5a-81fd-8ac8954a05b3 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:27.748334 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875521b-d565-400c-8b6a-8b11947c684c None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:27.784054 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c78b1-9815-40cb-b2a7-425af7618f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:27.785206 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c78b1-9815-40cb-b2a7-425af7618f78 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:27.785663 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c78b1-9815-40cb-b2a7-425af7618f78 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:27.786205 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c78b1-9815-40cb-b2a7-425af7618f78 None admin] PATH_INFO: `/v3/groups/c8eb9f9c7db549abb7c5c502e42a8e33` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:27.787598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c78b1-9815-40cb-b2a7-425af7618f78 None admin] RBAC: Authorizing `identity:get_group(group_id=c8eb9f9c7db549abb7c5c502e42a8e33)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:27.789202 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c78b1-9815-40cb-b2a7-425af7618f78 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:27.791344 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 212/424] 10.222.0.23 () {56 vars in 1180 bytes} [Sat Apr 30 20:48:27 2022] GET /identity/v3/groups/c8eb9f9c7db549abb7c5c502e42a8e33 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:27.801127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c78b1-9815-40cb-b2a7-425af7618f78 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:27.897915 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f538de1-1904-4b5a-81fd-8ac8954a05b3 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:27.911516 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c78b1-9815-40cb-b2a7-425af7618f78 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:27.951053 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c73de-f575-48a4-8f4f-c6ff694cf153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:27.952483 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c73de-f575-48a4-8f4f-c6ff694cf153 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:27.953899 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37fe30-faee-4baf-bde4-ffd622b43188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:27.954478 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c73de-f575-48a4-8f4f-c6ff694cf153 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:27.955572 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37fe30-faee-4baf-bde4-ffd622b43188 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:27.956076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c73de-f575-48a4-8f4f-c6ff694cf153 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:27.957153 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c73de-f575-48a4-8f4f-c6ff694cf153 None admin] RBAC: Adding query filter params (group.id=c8eb9f9c7db549abb7c5c502e42a8e33, role.id=121b12a250ae4ef8ae1a85ea8c21c4fa, scope.project.id=9431599023b44f1cb5dfb8bca0584f5f) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:27.957658 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37fe30-faee-4baf-bde4-ffd622b43188 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:27.958202 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37fe30-faee-4baf-bde4-ffd622b43188 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:27.958710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c73de-f575-48a4-8f4f-c6ff694cf153 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:27.961047 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c73de-f575-48a4-8f4f-c6ff694cf153 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:27.973294 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 213/425] 10.222.0.23 () {56 vars in 1376 bytes} [Sat Apr 30 20:48:27 2022] GET /identity/v3/role_assignments?group.id=c8eb9f9c7db549abb7c5c502e42a8e33&scope.project.id=9431599023b44f1cb5dfb8bca0584f5f&role.id=121b12a250ae4ef8ae1a85ea8c21c4fa => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:27.978953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e37fe30-faee-4baf-bde4-ffd622b43188 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:48:27.987884 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-5e37fe30-faee-4baf-bde4-ffd622b43188 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:48:27.987884 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:27.987884 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:27.987884 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:27.987884 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:27.987884 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:27.987884 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:27.987884 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:27.987884 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:27.987884 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:27.987884 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:27.987884 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:27.987884 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:48:27.987884 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:48:27.987884 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:48:27.987884 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:48:27.988829 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:48:27.988829 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:48:27.988829 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:48:27.988829 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:48:27.988829 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:27.988829 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:27.988829 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:27.988829 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:27.988829 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:27.988829 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:27.988829 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:27.988829 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:27.988829 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:27.988829 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:27.988829 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:27.988829 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:27.989627 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:27.989627 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:27.989627 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:27.989627 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:27.989627 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:48:27.989627 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:48:27.989627 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:48:27.989627 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:48:27.989627 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:48:27.989627 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:48:27.989627 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:48:27.989627 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:27.992438 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 213/426] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:48:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:48:27.999159 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c73de-f575-48a4-8f4f-c6ff694cf153 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:28.107182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c73de-f575-48a4-8f4f-c6ff694cf153 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:28.143055 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06395c21-e75b-49dd-bc7d-b927c745ebb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:28.144130 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06395c21-e75b-49dd-bc7d-b927c745ebb9 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:28.144611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06395c21-e75b-49dd-bc7d-b927c745ebb9 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:28.145082 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06395c21-e75b-49dd-bc7d-b927c745ebb9 None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:28.146068 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06395c21-e75b-49dd-bc7d-b927c745ebb9 None admin] RBAC: Adding query filter params (name=member) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:28.146593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06395c21-e75b-49dd-bc7d-b927c745ebb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:28.149822 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e65e1-d982-4bfe-afe4-671102ee7cb3 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:28.150371 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e65e1-d982-4bfe-afe4-671102ee7cb3 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:28.150842 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e65e1-d982-4bfe-afe4-671102ee7cb3 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:28.152424 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 214/427] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:48:28.152750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06395c21-e75b-49dd-bc7d-b927c745ebb9 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:28.158651 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabcfe8f-1e68-476f-bed3-deb600f48106 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:28.158963 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabcfe8f-1e68-476f-bed3-deb600f48106 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:28.159207 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabcfe8f-1e68-476f-bed3-deb600f48106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:28.164446 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 214/428] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Apr 30 20:48:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:28.170933 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06395c21-e75b-49dd-bc7d-b927c745ebb9 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:28.199007 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-eabcfe8f-1e68-476f-bed3-deb600f48106 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:28.200238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-eabcfe8f-1e68-476f-bed3-deb600f48106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:28.288310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06395c21-e75b-49dd-bc7d-b927c745ebb9 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:28.301355 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 215/429] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:48:28.326714 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c6622b-ee8d-4868-b74b-e75034cae447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:28.327356 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabcfe8f-1e68-476f-bed3-deb600f48106 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:28.327804 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6622b-ee8d-4868-b74b-e75034cae447 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:28.328096 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6622b-ee8d-4868-b74b-e75034cae447 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:28.328377 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6622b-ee8d-4868-b74b-e75034cae447 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:28.402726 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c6622b-ee8d-4868-b74b-e75034cae447 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:28.403611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c6622b-ee8d-4868-b74b-e75034cae447 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:28.492795 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabcfe8f-1e68-476f-bed3-deb600f48106 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:28.505007 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 215/430] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:48:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 30 20:48:28.510672 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c6622b-ee8d-4868-b74b-e75034cae447 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:28.538036 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f98709-cac3-4614-959f-0753dc71cdc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:28.538036 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f98709-cac3-4614-959f-0753dc71cdc9 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:28.538036 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f98709-cac3-4614-959f-0753dc71cdc9 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:28.538036 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f98709-cac3-4614-959f-0753dc71cdc9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:28.548075 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f98709-cac3-4614-959f-0753dc71cdc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:48:28.555887 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-56f98709-cac3-4614-959f-0753dc71cdc9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:48:28.555887 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:28.555887 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:28.555887 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:28.555887 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:28.555887 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:28.555887 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:28.555887 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:28.555887 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:28.555887 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:28.555887 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:28.555887 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:28.555887 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:48:28.555887 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:48:28.555887 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:48:28.555887 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:48:28.557377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:48:28.557377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:48:28.557377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:48:28.557377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:48:28.557377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:28.557377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:28.557377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:28.557377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:28.557377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:28.557377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:28.557377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:28.557377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:28.557377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:28.557377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:28.557377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:28.557377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:28.558228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:28.558228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:28.558228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:28.558228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:28.558228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:48:28.558228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:48:28.558228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:48:28.558228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:48:28.558228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:48:28.558228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:48:28.558228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Apr 30 20:48:28.558228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:28.558228 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 216/431] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:48:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:28.558887 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b51894-fd1a-4070-b8d1-d2efe4cdad6c None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:28.558887 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b51894-fd1a-4070-b8d1-d2efe4cdad6c None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:28.559250 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b51894-fd1a-4070-b8d1-d2efe4cdad6c None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:28.560502 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 217/432] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:28.561737 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111d4ac-0db4-414a-b90f-62ef3b03675c None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:28.562272 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111d4ac-0db4-414a-b90f-62ef3b03675c None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:28.562717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111d4ac-0db4-414a-b90f-62ef3b03675c None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:28.563930 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 218/433] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:28.564625 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111d4ac-0db4-414a-b90f-62ef3b03675c None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:28.614588 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c6622b-ee8d-4868-b74b-e75034cae447 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:28.645960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6c535-70e2-4cdb-ac48-80dc570bbbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:28.646798 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6c535-70e2-4cdb-ac48-80dc570bbbcd None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:28.647076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6c535-70e2-4cdb-ac48-80dc570bbbcd None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:28.647344 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6c535-70e2-4cdb-ac48-80dc570bbbcd None admin] PATH_INFO: `/v3/projects/9431599023b44f1cb5dfb8bca0584f5f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:28.648522 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6c535-70e2-4cdb-ac48-80dc570bbbcd None admin] RBAC: Authorizing `identity:get_project(project_id=9431599023b44f1cb5dfb8bca0584f5f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:28.649984 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6c535-70e2-4cdb-ac48-80dc570bbbcd None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:28.651632 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 216/434] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:48:28 2022] GET /identity/v3/projects/9431599023b44f1cb5dfb8bca0584f5f => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:48:28.656735 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487fe0b-a47d-409f-a886-c762a2b78d4a None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:28.656735 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487fe0b-a47d-409f-a886-c762a2b78d4a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:28.656735 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487fe0b-a47d-409f-a886-c762a2b78d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:28.663801 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111d4ac-0db4-414a-b90f-62ef3b03675c None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:28.670392 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-b487fe0b-a47d-409f-a886-c762a2b78d4a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:28.671555 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b487fe0b-a47d-409f-a886-c762a2b78d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:28.707758 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4705027-f203-4487-bfd6-ba9538ce8d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:28.708430 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4705027-f203-4487-bfd6-ba9538ce8d92 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:28.708710 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4705027-f203-4487-bfd6-ba9538ce8d92 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:28.708989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4705027-f203-4487-bfd6-ba9538ce8d92 None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:28.709747 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4705027-f203-4487-bfd6-ba9538ce8d92 None admin] RBAC: Adding query filter params (name=member) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:28.710085 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4705027-f203-4487-bfd6-ba9538ce8d92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:28.711505 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4705027-f203-4487-bfd6-ba9538ce8d92 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:28.721747 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 219/435] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Apr 30 20:48:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:28.724320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669da43c-885b-4c28-97df-d58ea9ad7da7 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:28.724611 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669da43c-885b-4c28-97df-d58ea9ad7da7 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:28.724896 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669da43c-885b-4c28-97df-d58ea9ad7da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:28.737782 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 217/436] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:48:28.738604 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487fe0b-a47d-409f-a886-c762a2b78d4a None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:28.747121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-669da43c-885b-4c28-97df-d58ea9ad7da7 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:28.748357 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-669da43c-885b-4c28-97df-d58ea9ad7da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:28.812780 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 220/437] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:48:28.813535 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669da43c-885b-4c28-97df-d58ea9ad7da7 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:28.831750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487fe0b-a47d-409f-a886-c762a2b78d4a None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:28.863501 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d828ab-7eaf-4087-b622-f8f6aadd06b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:28.864342 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d828ab-7eaf-4087-b622-f8f6aadd06b6 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:28.864619 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d828ab-7eaf-4087-b622-f8f6aadd06b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:28.864895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d828ab-7eaf-4087-b622-f8f6aadd06b6 None admin] PATH_INFO: `/v3/groups/c8eb9f9c7db549abb7c5c502e42a8e33` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:28.866074 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d828ab-7eaf-4087-b622-f8f6aadd06b6 None admin] RBAC: Authorizing `identity:get_group(group_id=c8eb9f9c7db549abb7c5c502e42a8e33)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:28.867521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d828ab-7eaf-4087-b622-f8f6aadd06b6 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:28.869091 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 218/438] 10.222.0.23 () {56 vars in 1180 bytes} [Sat Apr 30 20:48:28 2022] GET /identity/v3/groups/c8eb9f9c7db549abb7c5c502e42a8e33 => generated 226 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:28.869943 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d828ab-7eaf-4087-b622-f8f6aadd06b6 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:28.907931 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669da43c-885b-4c28-97df-d58ea9ad7da7 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:28.939834 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85d70b-949f-4291-8ed6-8306537af7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:28.940473 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85d70b-949f-4291-8ed6-8306537af7b4 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:28.940756 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85d70b-949f-4291-8ed6-8306537af7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:28.941030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85d70b-949f-4291-8ed6-8306537af7b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:28.962275 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d828ab-7eaf-4087-b622-f8f6aadd06b6 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:28.993537 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8519db3-0623-4da1-9807-6424d0ff2944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:28.994528 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8519db3-0623-4da1-9807-6424d0ff2944 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:28.994804 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8519db3-0623-4da1-9807-6424d0ff2944 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:28.995075 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8519db3-0623-4da1-9807-6424d0ff2944 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:29.005063 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a85d70b-949f-4291-8ed6-8306537af7b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:29.005191 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8519db3-0623-4da1-9807-6424d0ff2944 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:48:29.006555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a85d70b-949f-4291-8ed6-8306537af7b4 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:29.013072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-a8519db3-0623-4da1-9807-6424d0ff2944 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:48:29.013072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:29.013072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:29.013072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:29.013072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:29.013072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:29.013072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:29.013072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:29.013072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:29.013072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:29.013072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:29.013072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:29.013072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:48:29.013072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:48:29.013072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:48:29.013072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:48:29.014640 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:48:29.014640 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:48:29.014640 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:48:29.014640 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:48:29.014640 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:29.014640 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:29.014640 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:29.014640 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:29.014640 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:29.014640 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:29.014640 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:29.014640 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:29.014640 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:29.014640 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:29.014640 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:29.014640 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:29.015416 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:29.015416 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:29.015416 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:29.015416 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:29.015416 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:48:29.015416 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:48:29.015416 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:48:29.015416 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:48:29.015416 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:48:29.015416 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:48:29.015416 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:48:29.015416 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:29.015416 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 219/439] 10.222.0.23 () {56 vars in 1114 bytes} [Sat Apr 30 20:48:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:29.016077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8519db3-0623-4da1-9807-6424d0ff2944 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:29.103441 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 221/440] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:48:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:48:29.104194 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85d70b-949f-4291-8ed6-8306537af7b4 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:29.108657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8519db3-0623-4da1-9807-6424d0ff2944 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:29.139521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6559fb-1e7a-4674-bfd4-deb10203c5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:29.140292 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6559fb-1e7a-4674-bfd4-deb10203c5f0 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:29.140570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6559fb-1e7a-4674-bfd4-deb10203c5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:29.140838 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6559fb-1e7a-4674-bfd4-deb10203c5f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:29.150505 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6559fb-1e7a-4674-bfd4-deb10203c5f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:48:29.158543 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-bf6559fb-1e7a-4674-bfd4-deb10203c5f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:48:29.158543 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:29.158543 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:29.158543 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:29.158543 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:29.158543 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:29.158543 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:29.158543 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:29.158543 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:29.158543 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:29.158543 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:29.158543 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:29.158543 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:48:29.158543 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:48:29.158543 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:48:29.158543 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:48:29.159554 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:48:29.159554 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:48:29.159554 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:48:29.159554 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:48:29.159554 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:29.159554 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:29.159554 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:29.159554 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:29.159554 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:29.159554 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:29.159554 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:29.159554 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:29.159554 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:29.159554 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:29.159554 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:29.159554 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:29.160360 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:29.160360 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:29.160360 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:29.160360 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:29.160360 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:48:29.160360 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:48:29.160360 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:48:29.160360 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:48:29.160360 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:48:29.160360 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:48:29.160360 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:48:29.160360 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:29.160360 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 220/441] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Apr 30 20:48:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:29.161335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6559fb-1e7a-4674-bfd4-deb10203c5f0 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:29.204777 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85d70b-949f-4291-8ed6-8306537af7b4 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:29.237433 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca89513-be49-4540-97a2-aa21fd098a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:29.238110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca89513-be49-4540-97a2-aa21fd098a2d None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:29.238392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca89513-be49-4540-97a2-aa21fd098a2d None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:29.238667 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca89513-be49-4540-97a2-aa21fd098a2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:29.239493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca89513-be49-4540-97a2-aa21fd098a2d None admin] RBAC: Adding query filter params (group.id=c8eb9f9c7db549abb7c5c502e42a8e33, role.id=9f25fed676d84770b9dc2a96a769de28, scope.project.id=9431599023b44f1cb5dfb8bca0584f5f) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:29.239803 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca89513-be49-4540-97a2-aa21fd098a2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:29.241227 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca89513-be49-4540-97a2-aa21fd098a2d None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:29.246850 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 222/442] 10.222.0.23 () {56 vars in 1376 bytes} [Sat Apr 30 20:48:29 2022] GET /identity/v3/role_assignments?group.id=c8eb9f9c7db549abb7c5c502e42a8e33&scope.project.id=9431599023b44f1cb5dfb8bca0584f5f&role.id=9f25fed676d84770b9dc2a96a769de28 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:29.247622 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca89513-be49-4540-97a2-aa21fd098a2d None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:29.256030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6559fb-1e7a-4674-bfd4-deb10203c5f0 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:29.298368 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e55480-5e55-4f0a-a654-8dee40bc4f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:29.299047 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e55480-5e55-4f0a-a654-8dee40bc4f07 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:29.299331 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e55480-5e55-4f0a-a654-8dee40bc4f07 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:29.299612 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e55480-5e55-4f0a-a654-8dee40bc4f07 None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:29.300373 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e55480-5e55-4f0a-a654-8dee40bc4f07 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:29.300682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e55480-5e55-4f0a-a654-8dee40bc4f07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:29.302157 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e55480-5e55-4f0a-a654-8dee40bc4f07 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:29.311493 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 221/443] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:48:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:29.321890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e55480-5e55-4f0a-a654-8dee40bc4f07 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:29.369239 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca89513-be49-4540-97a2-aa21fd098a2d None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:29.407121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f886021-a14b-4d93-b2c8-679cda0cb7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:29.408109 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f886021-a14b-4d93-b2c8-679cda0cb7b1 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:29.408462 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f886021-a14b-4d93-b2c8-679cda0cb7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:29.408836 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f886021-a14b-4d93-b2c8-679cda0cb7b1 None admin] PATH_INFO: `/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:29.410201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f886021-a14b-4d93-b2c8-679cda0cb7b1 None admin] RBAC: Authorizing `identity:get_project(project_id=0aa8006660fe4334b8ca63e5e2a5d7e0)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:29.411769 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f886021-a14b-4d93-b2c8-679cda0cb7b1 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:29.413794 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 223/444] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:48:29 2022] GET /identity/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:29.414510 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f886021-a14b-4d93-b2c8-679cda0cb7b1 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:29.430791 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e55480-5e55-4f0a-a654-8dee40bc4f07 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:29.466481 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c9be0-2024-4d82-9cc8-2c77390546dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:29.468449 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c9be0-2024-4d82-9cc8-2c77390546dd None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:29.468449 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c9be0-2024-4d82-9cc8-2c77390546dd None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:29.468449 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c9be0-2024-4d82-9cc8-2c77390546dd None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:29.469005 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c9be0-2024-4d82-9cc8-2c77390546dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:29.469256 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c9be0-2024-4d82-9cc8-2c77390546dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:29.470938 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c9be0-2024-4d82-9cc8-2c77390546dd None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:29.479356 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 222/445] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:48:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:29.480645 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c9be0-2024-4d82-9cc8-2c77390546dd None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:29.523951 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f886021-a14b-4d93-b2c8-679cda0cb7b1 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:29.562614 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee7a2d-e6b7-4dea-83c8-e7efb7d973e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:29.563302 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee7a2d-e6b7-4dea-83c8-e7efb7d973e2 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:29.563560 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee7a2d-e6b7-4dea-83c8-e7efb7d973e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:29.563834 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee7a2d-e6b7-4dea-83c8-e7efb7d973e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:29.588999 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c9be0-2024-4d82-9cc8-2c77390546dd None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:29.622751 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ebf0fc-8626-456a-9030-47ac23da02ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:29.624068 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebf0fc-8626-456a-9030-47ac23da02ae None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:29.624347 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebf0fc-8626-456a-9030-47ac23da02ae None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:29.624618 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebf0fc-8626-456a-9030-47ac23da02ae None admin] PATH_INFO: `/v3/groups/c8eb9f9c7db549abb7c5c502e42a8e33` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:29.625840 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ebf0fc-8626-456a-9030-47ac23da02ae None admin] RBAC: Authorizing `identity:get_group(group_id=c8eb9f9c7db549abb7c5c502e42a8e33)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:29.627300 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ebf0fc-8626-456a-9030-47ac23da02ae None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:29.629071 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 223/446] 10.222.0.23 () {56 vars in 1180 bytes} [Sat Apr 30 20:48:29 2022] GET /identity/v3/groups/c8eb9f9c7db549abb7c5c502e42a8e33 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:29.630721 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ebf0fc-8626-456a-9030-47ac23da02ae None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:29.636165 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee7a2d-e6b7-4dea-83c8-e7efb7d973e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:29.637645 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee7a2d-e6b7-4dea-83c8-e7efb7d973e2 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:29.738012 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ebf0fc-8626-456a-9030-47ac23da02ae None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:29.747409 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 224/447] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:48:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:48:29.747409 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee7a2d-e6b7-4dea-83c8-e7efb7d973e2 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:29.779802 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37deeef7-0617-47d8-9b32-16a4e7cd4771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:29.780576 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37deeef7-0617-47d8-9b32-16a4e7cd4771 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:29.780758 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37deeef7-0617-47d8-9b32-16a4e7cd4771 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:29.781081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37deeef7-0617-47d8-9b32-16a4e7cd4771 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:29.852023 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37deeef7-0617-47d8-9b32-16a4e7cd4771 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:29.853496 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37deeef7-0617-47d8-9b32-16a4e7cd4771 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:29.871426 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee7a2d-e6b7-4dea-83c8-e7efb7d973e2 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:29.904547 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9793f-0326-4e72-b0e3-419fae9aba68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:29.905136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9793f-0326-4e72-b0e3-419fae9aba68 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:29.905418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9793f-0326-4e72-b0e3-419fae9aba68 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:29.905698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9793f-0326-4e72-b0e3-419fae9aba68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:29.906564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b9793f-0326-4e72-b0e3-419fae9aba68 None admin] RBAC: Adding query filter params (group.id=c8eb9f9c7db549abb7c5c502e42a8e33, role.id=9f25fed676d84770b9dc2a96a769de28, scope.project.id=0aa8006660fe4334b8ca63e5e2a5d7e0) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:29.906880 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b9793f-0326-4e72-b0e3-419fae9aba68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:29.908334 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b9793f-0326-4e72-b0e3-419fae9aba68 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:29.913993 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 225/448] 10.222.0.23 () {56 vars in 1376 bytes} [Sat Apr 30 20:48:29 2022] GET /identity/v3/role_assignments?group.id=c8eb9f9c7db549abb7c5c502e42a8e33&scope.project.id=0aa8006660fe4334b8ca63e5e2a5d7e0&role.id=9f25fed676d84770b9dc2a96a769de28 => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:29.914831 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9793f-0326-4e72-b0e3-419fae9aba68 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:29.949837 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 224/449] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:48:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:48:29.955427 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37deeef7-0617-47d8-9b32-16a4e7cd4771 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:30.044087 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9793f-0326-4e72-b0e3-419fae9aba68 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:30.057173 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37deeef7-0617-47d8-9b32-16a4e7cd4771 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:30.080026 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48f636-065e-4a72-88cc-4cafe3312a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:30.080993 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48f636-065e-4a72-88cc-4cafe3312a70 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:30.081256 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48f636-065e-4a72-88cc-4cafe3312a70 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:30.081529 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48f636-065e-4a72-88cc-4cafe3312a70 None admin] PATH_INFO: `/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:30.082753 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e48f636-065e-4a72-88cc-4cafe3312a70 None admin] RBAC: Authorizing `identity:get_project(project_id=0aa8006660fe4334b8ca63e5e2a5d7e0)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:30.084205 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e48f636-065e-4a72-88cc-4cafe3312a70 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:30.085907 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 226/450] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:48:29 2022] GET /identity/v3/projects/0aa8006660fe4334b8ca63e5e2a5d7e0 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:30.091761 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48f636-065e-4a72-88cc-4cafe3312a70 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:30.095103 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd5bd6-f019-4e8b-9a40-2f8ca5c3a176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:30.096227 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd5bd6-f019-4e8b-9a40-2f8ca5c3a176 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:30.096500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd5bd6-f019-4e8b-9a40-2f8ca5c3a176 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:30.096766 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd5bd6-f019-4e8b-9a40-2f8ca5c3a176 None admin] PATH_INFO: `/v3/projects/137d4e571f624bfe845b398839c48b74` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:30.098108 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd5bd6-f019-4e8b-9a40-2f8ca5c3a176 None admin] RBAC: Authorizing `identity:get_project(project_id=137d4e571f624bfe845b398839c48b74)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:30.099441 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd5bd6-f019-4e8b-9a40-2f8ca5c3a176 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:30.103234 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 225/451] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:48:29 2022] GET /identity/v3/projects/137d4e571f624bfe845b398839c48b74 => generated 344 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:48:30.107252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd5bd6-f019-4e8b-9a40-2f8ca5c3a176 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:30.208873 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48f636-065e-4a72-88cc-4cafe3312a70 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:30.217650 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd5bd6-f019-4e8b-9a40-2f8ca5c3a176 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:30.252678 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b9837-82c3-4872-8c3f-c53072a0ded4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:30.253859 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b9837-82c3-4872-8c3f-c53072a0ded4 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:30.254353 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b9837-82c3-4872-8c3f-c53072a0ded4 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:30.254943 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b9837-82c3-4872-8c3f-c53072a0ded4 None admin] PATH_INFO: `/v3/groups/c8eb9f9c7db549abb7c5c502e42a8e33` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:30.256328 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713b9837-82c3-4872-8c3f-c53072a0ded4 None admin] RBAC: Authorizing `identity:get_group(group_id=c8eb9f9c7db549abb7c5c502e42a8e33)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:30.257626 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ba86c-4da5-460e-aa86-82d52626372d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:30.257881 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713b9837-82c3-4872-8c3f-c53072a0ded4 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:30.258546 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ba86c-4da5-460e-aa86-82d52626372d None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:30.258824 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ba86c-4da5-460e-aa86-82d52626372d None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:30.259092 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ba86c-4da5-460e-aa86-82d52626372d None admin] PATH_INFO: `/v3/groups/cdb36c9638504012a713eb849ec40a0e` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:30.259695 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 227/452] 10.222.0.23 () {56 vars in 1180 bytes} [Sat Apr 30 20:48:30 2022] GET /identity/v3/groups/c8eb9f9c7db549abb7c5c502e42a8e33 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:48:30.260261 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ba86c-4da5-460e-aa86-82d52626372d None admin] RBAC: Authorizing `identity:get_group(group_id=cdb36c9638504012a713eb849ec40a0e)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:30.261694 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ba86c-4da5-460e-aa86-82d52626372d None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:30.263316 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 226/453] 10.222.0.23 () {56 vars in 1180 bytes} [Sat Apr 30 20:48:30 2022] GET /identity/v3/groups/cdb36c9638504012a713eb849ec40a0e => generated 229 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:48:30.265390 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b9837-82c3-4872-8c3f-c53072a0ded4 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:30.270610 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ba86c-4da5-460e-aa86-82d52626372d None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:30.368806 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b9837-82c3-4872-8c3f-c53072a0ded4 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:30.372776 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ba86c-4da5-460e-aa86-82d52626372d None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:30.400000 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75080273-0bef-46be-a5cc-dbeac090f271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:30.400654 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75080273-0bef-46be-a5cc-dbeac090f271 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:30.400935 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75080273-0bef-46be-a5cc-dbeac090f271 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:30.401218 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75080273-0bef-46be-a5cc-dbeac090f271 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:30.402066 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75080273-0bef-46be-a5cc-dbeac090f271 None admin] RBAC: Adding query filter params (group.id=c8eb9f9c7db549abb7c5c502e42a8e33, role.id=121b12a250ae4ef8ae1a85ea8c21c4fa, scope.project.id=0aa8006660fe4334b8ca63e5e2a5d7e0) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:30.402380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75080273-0bef-46be-a5cc-dbeac090f271 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:30.403866 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75080273-0bef-46be-a5cc-dbeac090f271 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:30.405341 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a4b09-2b17-45e5-853f-7978afc4806b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:30.406016 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a4b09-2b17-45e5-853f-7978afc4806b None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:30.406304 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a4b09-2b17-45e5-853f-7978afc4806b None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:30.406577 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a4b09-2b17-45e5-853f-7978afc4806b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:30.407404 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a4b09-2b17-45e5-853f-7978afc4806b None admin] RBAC: Adding query filter params (group.id=cdb36c9638504012a713eb849ec40a0e, role.id=30112eb1f3e047398c3c82fb40b72e62, scope.project.id=137d4e571f624bfe845b398839c48b74) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:30.407718 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a4b09-2b17-45e5-853f-7978afc4806b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:30.409135 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a4b09-2b17-45e5-853f-7978afc4806b None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:30.410109 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 228/454] 10.222.0.23 () {56 vars in 1376 bytes} [Sat Apr 30 20:48:30 2022] GET /identity/v3/role_assignments?group.id=c8eb9f9c7db549abb7c5c502e42a8e33&scope.project.id=0aa8006660fe4334b8ca63e5e2a5d7e0&role.id=121b12a250ae4ef8ae1a85ea8c21c4fa => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:48:30.414993 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 227/455] 10.222.0.23 () {56 vars in 1376 bytes} [Sat Apr 30 20:48:30 2022] GET /identity/v3/role_assignments?group.id=cdb36c9638504012a713eb849ec40a0e&scope.project.id=137d4e571f624bfe845b398839c48b74&role.id=30112eb1f3e047398c3c82fb40b72e62 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:33.397726 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6734a-197e-4e0c-b837-5ba5c70d371f None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:33.398785 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6734a-197e-4e0c-b837-5ba5c70d371f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:33.399282 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6734a-197e-4e0c-b837-5ba5c70d371f None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:33.401283 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 229/456] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:33.407699 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243b108-09b0-437a-9a8e-a22571617af2 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:33.408665 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243b108-09b0-437a-9a8e-a22571617af2 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:33.409142 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243b108-09b0-437a-9a8e-a22571617af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:33.432011 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-a243b108-09b0-437a-9a8e-a22571617af2 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:33.433228 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a243b108-09b0-437a-9a8e-a22571617af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:33.555746 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 228/457] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:48:33.599305 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe6734a-197e-4e0c-b837-5ba5c70d371f None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:33.698060 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2b521-fd35-4461-928b-248ebedf835e None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:33.698390 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2b521-fd35-4461-928b-248ebedf835e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:33.698627 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2b521-fd35-4461-928b-248ebedf835e None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:33.700232 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 229/458] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:33.705432 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84307933-84ec-4f10-a129-0551ed8f8f63 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:33.705716 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84307933-84ec-4f10-a129-0551ed8f8f63 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:33.706070 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84307933-84ec-4f10-a129-0551ed8f8f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:33.727934 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-84307933-84ec-4f10-a129-0551ed8f8f63 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:33.729494 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-84307933-84ec-4f10-a129-0551ed8f8f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:33.729602 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe6734a-197e-4e0c-b837-5ba5c70d371f None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:33.770900 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec969456-4a44-4cba-8841-e76b8438e0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:33.772075 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec969456-4a44-4cba-8841-e76b8438e0c1 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:33.772556 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec969456-4a44-4cba-8841-e76b8438e0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:33.773048 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec969456-4a44-4cba-8841-e76b8438e0c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:33.785726 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec969456-4a44-4cba-8841-e76b8438e0c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:33.787564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec969456-4a44-4cba-8841-e76b8438e0c1 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:33.805681 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-ec969456-4a44-4cba-8841-e76b8438e0c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:33.805681 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:33.805681 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:33.805681 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:33.805681 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:33.805681 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:33.805681 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:33.805681 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:33.805681 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:33.805681 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:33.805681 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:33.805681 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:33.805681 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:48:33.805681 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:48:33.805681 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:48:33.806695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:48:33.806695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:33.806695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:33.806695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:33.806695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:33.806695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:33.806695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:33.806695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:33.806695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:33.806695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:33.806695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:33.806695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:33.806695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:33.806695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:33.806695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:33.806695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:33.806695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:33.807535 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:48:33.807535 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:48:33.807535 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:33.807535 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:33.809946 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 230/459] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:48:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:33.812258 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c6a90-ee23-42d9-a344-27effbefeb55 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:33.812759 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c6a90-ee23-42d9-a344-27effbefeb55 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:33.813233 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c6a90-ee23-42d9-a344-27effbefeb55 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:33.815823 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 231/460] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:33.821281 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c6a90-ee23-42d9-a344-27effbefeb55 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:33.824360 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 230/461] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:48:33.827188 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76f18f-ea63-4b6a-9bc3-a8e43a8294bc None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:33.827188 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76f18f-ea63-4b6a-9bc3-a8e43a8294bc None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:33.827188 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76f18f-ea63-4b6a-9bc3-a8e43a8294bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:33.865454 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-1a76f18f-ea63-4b6a-9bc3-a8e43a8294bc None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:33.867008 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1a76f18f-ea63-4b6a-9bc3-a8e43a8294bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:33.953848 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 231/462] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:48:33.955090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a76f18f-ea63-4b6a-9bc3-a8e43a8294bc None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:33.987249 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c6a90-ee23-42d9-a344-27effbefeb55 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:34.034386 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ced2c-8aa9-4dd8-bb24-a229fa2c2bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:34.035059 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ced2c-8aa9-4dd8-bb24-a229fa2c2bf9 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:34.035342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ced2c-8aa9-4dd8-bb24-a229fa2c2bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:34.035619 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ced2c-8aa9-4dd8-bb24-a229fa2c2bf9 None admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:34.040507 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ced2c-8aa9-4dd8-bb24-a229fa2c2bf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:34.040507 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ced2c-8aa9-4dd8-bb24-a229fa2c2bf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:34.040507 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ced2c-8aa9-4dd8-bb24-a229fa2c2bf9 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:34.054952 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 232/463] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:48:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:48:34.055875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ced2c-8aa9-4dd8-bb24-a229fa2c2bf9 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:34.075253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a76f18f-ea63-4b6a-9bc3-a8e43a8294bc None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:34.115683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2aa28-2bf7-4f98-baa7-fa6153e5a924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:34.116525 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2aa28-2bf7-4f98-baa7-fa6153e5a924 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:34.116804 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2aa28-2bf7-4f98-baa7-fa6153e5a924 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:34.117080 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2aa28-2bf7-4f98-baa7-fa6153e5a924 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:34.128051 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af2aa28-2bf7-4f98-baa7-fa6153e5a924 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:34.129550 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af2aa28-2bf7-4f98-baa7-fa6153e5a924 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:34.152573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-0af2aa28-2bf7-4f98-baa7-fa6153e5a924 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:34.152573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:34.152573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:34.152573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:34.152573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:34.152573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:34.152573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:34.152573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:34.152573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:34.152573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:34.152573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:34.152573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:34.152573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:48:34.152573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:48:34.152573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:48:34.153525 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:48:34.153525 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:34.153525 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:34.153525 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:34.153525 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:34.153525 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:34.153525 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:34.153525 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:34.153525 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:34.153525 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:34.153525 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:34.153525 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:34.153525 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:34.153525 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:34.153525 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:34.153525 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:34.153525 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:34.160366 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:48:34.160366 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:48:34.160366 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:34.160366 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:34.160366 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 232/464] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:48:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:34.160366 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2aa28-2bf7-4f98-baa7-fa6153e5a924 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:34.179682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ced2c-8aa9-4dd8-bb24-a229fa2c2bf9 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:34.212182 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b2260-72fa-44ae-8b2d-dc17966fcdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:34.212969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b2260-72fa-44ae-8b2d-dc17966fcdc8 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:34.213246 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b2260-72fa-44ae-8b2d-dc17966fcdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:34.213517 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b2260-72fa-44ae-8b2d-dc17966fcdc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:34.224228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6b2260-72fa-44ae-8b2d-dc17966fcdc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:34.225720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6b2260-72fa-44ae-8b2d-dc17966fcdc8 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:34.243369 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-4b6b2260-72fa-44ae-8b2d-dc17966fcdc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:34.243369 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:34.243369 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:34.243369 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:34.243369 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:34.243369 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:34.243369 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:34.243369 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:34.243369 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:34.243369 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:34.243369 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:34.243369 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:34.243369 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:48:34.243369 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:48:34.243369 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:48:34.244241 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:48:34.244241 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:34.244241 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:34.244241 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:34.244241 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:34.244241 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:34.244241 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:34.244241 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:34.244241 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:34.244241 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:34.244241 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:34.244241 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:34.244241 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:34.244241 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:34.244241 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:34.244241 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:34.244241 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:34.245077 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:48:34.245077 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:48:34.245077 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:34.245077 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:34.245077 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 233/465] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:48:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:34.245875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2c0b5-7221-4996-8775-12f666fd0c7b None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:34.246046 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2c0b5-7221-4996-8775-12f666fd0c7b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:34.246313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2c0b5-7221-4996-8775-12f666fd0c7b None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:34.247964 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 234/466] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:34.248277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2c0b5-7221-4996-8775-12f666fd0c7b None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:34.266075 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2aa28-2bf7-4f98-baa7-fa6153e5a924 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:34.305986 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6b0fd-301e-4162-9ca1-7241429ba8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:34.306739 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6b0fd-301e-4162-9ca1-7241429ba8d1 None admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:34.307018 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6b0fd-301e-4162-9ca1-7241429ba8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:34.307302 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6b0fd-301e-4162-9ca1-7241429ba8d1 None admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:34.307987 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d6b0fd-301e-4162-9ca1-7241429ba8d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:34.309516 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d6b0fd-301e-4162-9ca1-7241429ba8d1 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:34.353900 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2c0b5-7221-4996-8775-12f666fd0c7b None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:34.387651 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528d86b-81d3-4698-9e27-8a2e6ac58b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:34.388310 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528d86b-81d3-4698-9e27-8a2e6ac58b68 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:34.388593 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528d86b-81d3-4698-9e27-8a2e6ac58b68 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:34.389515 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528d86b-81d3-4698-9e27-8a2e6ac58b68 None admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:34.390297 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528d86b-81d3-4698-9e27-8a2e6ac58b68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:34.390616 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528d86b-81d3-4698-9e27-8a2e6ac58b68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:34.391996 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528d86b-81d3-4698-9e27-8a2e6ac58b68 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:34.403118 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 235/467] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:48:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:34.403910 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528d86b-81d3-4698-9e27-8a2e6ac58b68 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:34.438478 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 233/468] 10.222.0.23 () {60 vars in 1132 bytes} [Sat Apr 30 20:48:34 2022] POST /identity/v3/users => generated 246 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:48:34.441958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626b733-e257-4064-95ba-6b5a7a3308f0 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:34.441958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626b733-e257-4064-95ba-6b5a7a3308f0 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:34.441958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626b733-e257-4064-95ba-6b5a7a3308f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:34.459842 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-2626b733-e257-4064-95ba-6b5a7a3308f0 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:34.461026 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2626b733-e257-4064-95ba-6b5a7a3308f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:34.514639 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528d86b-81d3-4698-9e27-8a2e6ac58b68 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:34.545784 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 234/469] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:48:34.545784 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626b733-e257-4064-95ba-6b5a7a3308f0 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:34.560528 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759f23d-653d-4f6c-b367-bbc46a0af6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:34.562235 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759f23d-653d-4f6c-b367-bbc46a0af6ad None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:34.567713 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759f23d-653d-4f6c-b367-bbc46a0af6ad None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:34.567713 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759f23d-653d-4f6c-b367-bbc46a0af6ad None admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:34.567713 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d759f23d-653d-4f6c-b367-bbc46a0af6ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:34.567713 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d759f23d-653d-4f6c-b367-bbc46a0af6ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:34.568832 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d759f23d-653d-4f6c-b367-bbc46a0af6ad None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:34.590289 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 236/470] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:48:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:34.591609 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759f23d-653d-4f6c-b367-bbc46a0af6ad None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:34.652849 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626b733-e257-4064-95ba-6b5a7a3308f0 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:34.692772 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0ed36-7687-4d47-92bd-f267cf7b4db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:34.693458 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0ed36-7687-4d47-92bd-f267cf7b4db3 None admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:34.693745 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0ed36-7687-4d47-92bd-f267cf7b4db3 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:34.694052 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0ed36-7687-4d47-92bd-f267cf7b4db3 None admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:34.694789 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be0ed36-7687-4d47-92bd-f267cf7b4db3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:34.696365 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be0ed36-7687-4d47-92bd-f267cf7b4db3 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:34.705804 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759f23d-653d-4f6c-b367-bbc46a0af6ad None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:34.748930 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd1ad4-48ad-4c92-9bda-bd119e248a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:34.749729 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd1ad4-48ad-4c92-9bda-bd119e248a20 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:34.750071 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd1ad4-48ad-4c92-9bda-bd119e248a20 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:34.750346 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd1ad4-48ad-4c92-9bda-bd119e248a20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:34.761006 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd1ad4-48ad-4c92-9bda-bd119e248a20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:34.762591 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd1ad4-48ad-4c92-9bda-bd119e248a20 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:34.781789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-4dcd1ad4-48ad-4c92-9bda-bd119e248a20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:34.781789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:34.781789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:34.781789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:34.781789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:34.781789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:34.781789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:34.781789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:34.781789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:34.781789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:34.781789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:34.781789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:34.781789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:48:34.781789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:48:34.781789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:48:34.782667 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:48:34.782667 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:34.782667 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:34.782667 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:34.782667 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:34.782667 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:34.782667 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:34.782667 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:34.782667 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:34.782667 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:34.782667 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:34.782667 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:34.782667 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:34.782667 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:34.782667 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:34.782667 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:34.782667 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:34.783500 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:48:34.783500 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:48:34.783500 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:34.783500 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:34.783500 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 237/471] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:48:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:34.783772 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd1ad4-48ad-4c92-9bda-bd119e248a20 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:34.827638 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 235/472] 10.222.0.23 () {60 vars in 1132 bytes} [Sat Apr 30 20:48:34 2022] POST /identity/v3/users => generated 248 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:48:34.833785 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0ed36-7687-4d47-92bd-f267cf7b4db3 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:34.895123 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd1ad4-48ad-4c92-9bda-bd119e248a20 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:34.932623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb48959-9dbe-4ff2-b6f4-5b804b04c703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:34.933240 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb48959-9dbe-4ff2-b6f4-5b804b04c703 None admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:34.933512 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb48959-9dbe-4ff2-b6f4-5b804b04c703 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:34.933853 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb48959-9dbe-4ff2-b6f4-5b804b04c703 None admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:34.935003 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb48959-9dbe-4ff2-b6f4-5b804b04c703 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:34.936546 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb48959-9dbe-4ff2-b6f4-5b804b04c703 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:34.958036 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0ed36-7687-4d47-92bd-f267cf7b4db3 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:34.995167 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67101f09-2b1d-495a-8ace-5bda62f18993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:34.995858 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67101f09-2b1d-495a-8ace-5bda62f18993 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:34.996140 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67101f09-2b1d-495a-8ace-5bda62f18993 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:34.996419 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67101f09-2b1d-495a-8ace-5bda62f18993 None admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:34.997159 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67101f09-2b1d-495a-8ace-5bda62f18993 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:34.997469 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67101f09-2b1d-495a-8ace-5bda62f18993 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:34.998931 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67101f09-2b1d-495a-8ace-5bda62f18993 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:35.021077 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 236/473] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:48:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:35.021077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ab4d6-b978-441f-a2b0-2bd7a4fce426 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:35.021077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ab4d6-b978-441f-a2b0-2bd7a4fce426 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:35.021077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ab4d6-b978-441f-a2b0-2bd7a4fce426 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:35.021077 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 237/474] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:35.024375 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ab4d6-b978-441f-a2b0-2bd7a4fce426 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:35.037450 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 238/475] 10.222.0.23 () {60 vars in 1132 bytes} [Sat Apr 30 20:48:34 2022] POST /identity/v3/users => generated 248 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:48:35.040155 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2ae73-6664-4133-9b4c-525dadcadb6a None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:35.040825 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2ae73-6664-4133-9b4c-525dadcadb6a None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:35.041317 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2ae73-6664-4133-9b4c-525dadcadb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:35.064190 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-e5e2ae73-6664-4133-9b4c-525dadcadb6a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:35.065938 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e5e2ae73-6664-4133-9b4c-525dadcadb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:35.145953 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 239/476] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:48:35.174718 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ab4d6-b978-441f-a2b0-2bd7a4fce426 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:35.178610 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2ae73-6664-4133-9b4c-525dadcadb6a None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:35.228729 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac07947-7ba7-471f-adae-8a7abc5f41db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:35.229972 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac07947-7ba7-471f-adae-8a7abc5f41db None admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:35.230504 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac07947-7ba7-471f-adae-8a7abc5f41db None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:35.230791 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac07947-7ba7-471f-adae-8a7abc5f41db None admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:35.231675 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac07947-7ba7-471f-adae-8a7abc5f41db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:35.233388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac07947-7ba7-471f-adae-8a7abc5f41db None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:35.303486 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2ae73-6664-4133-9b4c-525dadcadb6a None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:35.333559 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 238/477] 10.222.0.23 () {60 vars in 1132 bytes} [Sat Apr 30 20:48:35 2022] POST /identity/v3/users => generated 249 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:48:35.349805 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ffad8-d4aa-4730-afdd-bff7d21691c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:35.350818 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ffad8-d4aa-4730-afdd-bff7d21691c0 None admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:35.351274 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ffad8-d4aa-4730-afdd-bff7d21691c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:35.351719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ffad8-d4aa-4730-afdd-bff7d21691c0 None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:35.352646 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ffad8-d4aa-4730-afdd-bff7d21691c0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:35.354304 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ffad8-d4aa-4730-afdd-bff7d21691c0 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:35.420969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.sql.core [None req-897ffad8-d4aa-4730-afdd-bff7d21691c0 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Apr 30 20:48:35.420969 ncdv-master-1 devstack@keystone.service[91017]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Apr 30 20:48:35.420969 ncdv-master-1 devstack@keystone.service[91017]: [parameters: {'id': '31aca837197a42e39c9d77f96c3f6674', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Apr 30 20:48:35.420969 ncdv-master-1 devstack@keystone.service[91017]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91017) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 30 20:48:35.439920 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-897ffad8-d4aa-4730-afdd-bff7d21691c0 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Apr 30 20:48:35.439920 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:35.439920 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Apr 30 20:48:35.439920 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self.dialect.do_execute( Apr 30 20:48:35.439920 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Apr 30 20:48:35.439920 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Apr 30 20:48:35.439920 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Apr 30 20:48:35.439920 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application result = self._query(query) Apr 30 20:48:35.439920 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Apr 30 20:48:35.439920 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application conn.query(q) Apr 30 20:48:35.439920 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Apr 30 20:48:35.439920 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Apr 30 20:48:35.439920 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Apr 30 20:48:35.439920 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application result.read() Apr 30 20:48:35.439920 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Apr 30 20:48:35.441117 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Apr 30 20:48:35.441117 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Apr 30 20:48:35.441117 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application packet.raise_for_error() Apr 30 20:48:35.441117 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Apr 30 20:48:35.441117 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Apr 30 20:48:35.441117 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Apr 30 20:48:35.441117 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Apr 30 20:48:35.441117 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Apr 30 20:48:35.441117 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:35.441117 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Apr 30 20:48:35.441117 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:35.441117 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:35.441117 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Apr 30 20:48:35.441117 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return method(*args, **kwargs) Apr 30 20:48:35.441117 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Apr 30 20:48:35.441117 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return ref.to_dict() Apr 30 20:48:35.441117 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Apr 30 20:48:35.441117 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application next(self.gen) Apr 30 20:48:35.442339 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Apr 30 20:48:35.442339 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application yield resource Apr 30 20:48:35.442339 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Apr 30 20:48:35.442339 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application next(self.gen) Apr 30 20:48:35.442339 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Apr 30 20:48:35.442339 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self.session.rollback() Apr 30 20:48:35.442339 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Apr 30 20:48:35.442339 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self.force_reraise() Apr 30 20:48:35.442339 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Apr 30 20:48:35.442339 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise self.value Apr 30 20:48:35.442339 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Apr 30 20:48:35.442339 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Apr 30 20:48:35.442339 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Apr 30 20:48:35.442339 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application session.commit() Apr 30 20:48:35.442339 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1431, in commit Apr 30 20:48:35.442339 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Apr 30 20:48:35.442339 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Apr 30 20:48:35.443750 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._prepare_impl() Apr 30 20:48:35.443750 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Apr 30 20:48:35.443750 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self.session.flush() Apr 30 20:48:35.443750 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3363, in flush Apr 30 20:48:35.443750 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._flush(objects) Apr 30 20:48:35.443750 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3503, in _flush Apr 30 20:48:35.443750 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Apr 30 20:48:35.443750 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Apr 30 20:48:35.443750 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application compat.raise_( Apr 30 20:48:35.443750 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Apr 30 20:48:35.443750 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception Apr 30 20:48:35.443750 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3463, in _flush Apr 30 20:48:35.443750 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application flush_context.execute() Apr 30 20:48:35.443750 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Apr 30 20:48:35.443750 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rec.execute(self) Apr 30 20:48:35.443750 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Apr 30 20:48:35.443750 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Apr 30 20:48:35.445038 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Apr 30 20:48:35.445038 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application _emit_insert_statements( Apr 30 20:48:35.445038 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Apr 30 20:48:35.445038 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application c = connection._execute_20( Apr 30 20:48:35.445038 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Apr 30 20:48:35.445038 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Apr 30 20:48:35.445038 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Apr 30 20:48:35.445038 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Apr 30 20:48:35.445038 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Apr 30 20:48:35.445038 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ret = self._execute_context( Apr 30 20:48:35.445038 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Apr 30 20:48:35.445038 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Apr 30 20:48:35.445038 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Apr 30 20:48:35.445038 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Apr 30 20:48:35.445038 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Apr 30 20:48:35.445038 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception Apr 30 20:48:35.446097 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Apr 30 20:48:35.446097 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self.dialect.do_execute( Apr 30 20:48:35.446097 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Apr 30 20:48:35.446097 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Apr 30 20:48:35.446097 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Apr 30 20:48:35.446097 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application result = self._query(query) Apr 30 20:48:35.446097 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Apr 30 20:48:35.446097 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application conn.query(q) Apr 30 20:48:35.446097 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Apr 30 20:48:35.446097 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Apr 30 20:48:35.446097 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Apr 30 20:48:35.446097 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application result.read() Apr 30 20:48:35.446097 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Apr 30 20:48:35.446097 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Apr 30 20:48:35.446097 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Apr 30 20:48:35.446097 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application packet.raise_for_error() Apr 30 20:48:35.447087 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Apr 30 20:48:35.447087 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Apr 30 20:48:35.447087 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Apr 30 20:48:35.447087 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Apr 30 20:48:35.447087 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Apr 30 20:48:35.447087 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Apr 30 20:48:35.447087 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [parameters: {'id': '31aca837197a42e39c9d77f96c3f6674', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Apr 30 20:48:35.447087 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Apr 30 20:48:35.447087 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:35.447087 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:48:35.447087 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:35.447087 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:35.447087 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:35.447087 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:35.447087 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:35.447087 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:35.448231 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:35.448231 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:35.448231 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:35.448231 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:35.448231 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:35.448231 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:35.448231 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Apr 30 20:48:35.448231 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Apr 30 20:48:35.448231 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:35.448231 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:35.448231 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Apr 30 20:48:35.448231 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Apr 30 20:48:35.448231 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Apr 30 20:48:35.448231 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Apr 30 20:48:35.448231 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Apr 30 20:48:35.448231 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:35.451852 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 240/478] 10.222.0.23 () {60 vars in 1131 bytes} [Sat Apr 30 20:48:35 2022] POST /identity/v3/roles => generated 144 bytes in 273 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:48:35.457627 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac07947-7ba7-471f-adae-8a7abc5f41db None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:35.608628 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac07947-7ba7-471f-adae-8a7abc5f41db None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:35.659844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf7b3b-b11b-45b0-9493-cbf8c50bacfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:35.660663 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf7b3b-b11b-45b0-9493-cbf8c50bacfb None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:35.660938 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf7b3b-b11b-45b0-9493-cbf8c50bacfb None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:35.661207 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf7b3b-b11b-45b0-9493-cbf8c50bacfb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:35.678704 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf7b3b-b11b-45b0-9493-cbf8c50bacfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:48:35.687501 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-cabf7b3b-b11b-45b0-9493-cbf8c50bacfb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:48:35.687501 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:35.687501 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:35.687501 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:35.687501 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:35.687501 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:35.687501 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:35.687501 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:35.687501 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:35.687501 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:35.687501 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:35.687501 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:35.687501 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:48:35.687501 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:48:35.687501 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:48:35.687501 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:48:35.688408 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:48:35.688408 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:48:35.688408 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:48:35.688408 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:48:35.688408 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:35.688408 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:35.688408 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:35.688408 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:35.688408 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:35.688408 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:35.688408 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:35.688408 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:35.688408 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:35.688408 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:35.688408 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:35.688408 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:35.689232 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:35.689232 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:35.689232 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:35.689232 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:35.689232 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:48:35.689232 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:48:35.689232 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:48:35.689232 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:48:35.689232 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:48:35.689232 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:48:35.689232 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 30 20:48:35.689232 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:35.689232 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 239/479] 10.222.0.23 () {56 vars in 1114 bytes} [Sat Apr 30 20:48:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:35.695037 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ffad8-d4aa-4730-afdd-bff7d21691c0 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:35.798580 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ffad8-d4aa-4730-afdd-bff7d21691c0 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:35.834670 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd0bfa-a8e2-4406-b14d-351135497e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:35.835339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd0bfa-a8e2-4406-b14d-351135497e2d None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:35.835618 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd0bfa-a8e2-4406-b14d-351135497e2d None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:35.835892 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd0bfa-a8e2-4406-b14d-351135497e2d None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:35.836634 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd0bfa-a8e2-4406-b14d-351135497e2d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:35.836938 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd0bfa-a8e2-4406-b14d-351135497e2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:35.838349 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd0bfa-a8e2-4406-b14d-351135497e2d None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:35.847021 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 241/480] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:48:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:37.189207 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba4524-cab9-462a-8cf5-82881afdb43a None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:37.189727 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba4524-cab9-462a-8cf5-82881afdb43a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:37.189727 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba4524-cab9-462a-8cf5-82881afdb43a None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:37.191371 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 240/481] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:37.197002 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34166530-cecf-4d68-9047-e51da34b7fd4 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:37.197451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34166530-cecf-4d68-9047-e51da34b7fd4 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:37.197536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34166530-cecf-4d68-9047-e51da34b7fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:37.215644 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-34166530-cecf-4d68-9047-e51da34b7fd4 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:37.216841 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-34166530-cecf-4d68-9047-e51da34b7fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:37.290100 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 242/482] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:48:37.310140 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba4524-cab9-462a-8cf5-82881afdb43a None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:37.415491 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba4524-cab9-462a-8cf5-82881afdb43a None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:37.449503 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf2b55-ade0-461f-8957-67a48d47cb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:37.450337 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf2b55-ade0-461f-8957-67a48d47cb9e None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:37.450627 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf2b55-ade0-461f-8957-67a48d47cb9e None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:37.450884 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf2b55-ade0-461f-8957-67a48d47cb9e None admin] PATH_INFO: `/v3/roles/service` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:37.461369 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf2b55-ade0-461f-8957-67a48d47cb9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:48:37.469095 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-f9bf2b55-ade0-461f-8957-67a48d47cb9e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:48:37.469095 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:37.469095 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:37.469095 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:37.469095 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:37.469095 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:37.469095 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:37.469095 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:37.469095 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:37.469095 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:37.469095 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:37.469095 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:37.469095 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:48:37.469095 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:48:37.469095 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:48:37.469095 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:48:37.470012 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:48:37.470012 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:48:37.470012 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:48:37.470012 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:48:37.470012 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:37.470012 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:37.470012 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:37.470012 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:37.470012 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:37.470012 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:37.470012 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:37.470012 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:37.470012 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:37.470012 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:37.470012 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:37.470012 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:37.471072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:37.471072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:37.471072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:37.471072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:37.471072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:48:37.471072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:48:37.471072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:48:37.471072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:48:37.471072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:48:37.471072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:48:37.471072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:48:37.471072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:37.471072 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 241/483] 10.222.0.23 () {56 vars in 1102 bytes} [Sat Apr 30 20:48:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:37.476674 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34166530-cecf-4d68-9047-e51da34b7fd4 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:37.578849 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34166530-cecf-4d68-9047-e51da34b7fd4 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:37.614309 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d51cf-f977-4496-b504-e814fdc8f033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:37.614976 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d51cf-f977-4496-b504-e814fdc8f033 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:37.615257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d51cf-f977-4496-b504-e814fdc8f033 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:37.615529 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d51cf-f977-4496-b504-e814fdc8f033 None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:37.616266 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d51cf-f977-4496-b504-e814fdc8f033 None admin] RBAC: Adding query filter params (name=service) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:37.616569 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d51cf-f977-4496-b504-e814fdc8f033 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:37.617976 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d51cf-f977-4496-b504-e814fdc8f033 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:37.626928 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 243/484] 10.222.0.23 () {56 vars in 1103 bytes} [Sat Apr 30 20:48:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:37.632126 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf2b55-ade0-461f-8957-67a48d47cb9e None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:37.736871 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf2b55-ade0-461f-8957-67a48d47cb9e None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:37.770041 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e75f66-980b-44c1-b3d3-52a0202fca08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:37.770825 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e75f66-980b-44c1-b3d3-52a0202fca08 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:37.771107 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e75f66-980b-44c1-b3d3-52a0202fca08 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:37.771377 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e75f66-980b-44c1-b3d3-52a0202fca08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:37.782273 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e75f66-980b-44c1-b3d3-52a0202fca08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:37.783742 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e75f66-980b-44c1-b3d3-52a0202fca08 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:37.800750 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-44e75f66-980b-44c1-b3d3-52a0202fca08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:37.800750 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:37.800750 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:37.800750 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:37.800750 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:37.800750 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:37.800750 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:37.800750 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:37.800750 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:37.800750 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:37.800750 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:37.800750 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:37.800750 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:48:37.800750 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:48:37.800750 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:48:37.802899 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:48:37.802899 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:37.802899 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:37.802899 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:37.802899 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:37.802899 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:37.802899 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:37.802899 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:37.802899 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:37.802899 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:37.802899 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:37.802899 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:37.802899 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:37.802899 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:37.802899 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:37.802899 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:37.802899 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:37.804935 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:48:37.804935 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:48:37.804935 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:37.804935 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:37.804935 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 242/485] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:48:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:37.813240 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d51cf-f977-4496-b504-e814fdc8f033 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:37.918386 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d51cf-f977-4496-b504-e814fdc8f033 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:37.944640 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f4df3-9b40-41ac-ba1a-0a3d718ada5d None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:37.944640 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f4df3-9b40-41ac-ba1a-0a3d718ada5d None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:37.944640 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f4df3-9b40-41ac-ba1a-0a3d718ada5d None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:37.945940 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 243/486] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:37.951123 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b321df-bd47-438f-8523-ef758548acb3 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:37.951715 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b321df-bd47-438f-8523-ef758548acb3 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:37.952200 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b321df-bd47-438f-8523-ef758548acb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:37.956477 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0859d0f7-4b51-425a-9a78-412d9c799b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:37.957193 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859d0f7-4b51-425a-9a78-412d9c799b7c None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:37.957484 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859d0f7-4b51-425a-9a78-412d9c799b7c None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:37.957773 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859d0f7-4b51-425a-9a78-412d9c799b7c None admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:37.958584 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0859d0f7-4b51-425a-9a78-412d9c799b7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:37.958937 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0859d0f7-4b51-425a-9a78-412d9c799b7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:37.965780 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0859d0f7-4b51-425a-9a78-412d9c799b7c None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:37.974617 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 244/487] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:48:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:37.979829 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0859d0f7-4b51-425a-9a78-412d9c799b7c None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:37.987133 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-46b321df-bd47-438f-8523-ef758548acb3 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:37.988551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-46b321df-bd47-438f-8523-ef758548acb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:38.084407 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0859d0f7-4b51-425a-9a78-412d9c799b7c None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:38.105289 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 244/488] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:48:38.106544 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef30e68-a4ac-4671-9d23-c05f3c919635 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:38.106838 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef30e68-a4ac-4671-9d23-c05f3c919635 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:38.107116 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef30e68-a4ac-4671-9d23-c05f3c919635 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:38.113024 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 245/489] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:38.114563 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabe86b-3567-4a41-b5bc-195db47c92fd None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:38.114851 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabe86b-3567-4a41-b5bc-195db47c92fd None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:38.115134 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabe86b-3567-4a41-b5bc-195db47c92fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:38.132529 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-1fabe86b-3567-4a41-b5bc-195db47c92fd None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:38.133707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1fabe86b-3567-4a41-b5bc-195db47c92fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:38.137089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49711c20-b635-4f3c-8c34-1adf097d814f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:38.137920 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49711c20-b635-4f3c-8c34-1adf097d814f None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:38.138203 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49711c20-b635-4f3c-8c34-1adf097d814f None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:38.138473 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49711c20-b635-4f3c-8c34-1adf097d814f None admin] PATH_INFO: `/v3/users/nova` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:38.150242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49711c20-b635-4f3c-8c34-1adf097d814f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:38.151735 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49711c20-b635-4f3c-8c34-1adf097d814f None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:38.173718 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-49711c20-b635-4f3c-8c34-1adf097d814f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 30 20:48:38.173718 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:38.173718 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:38.173718 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:38.173718 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:38.173718 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:38.173718 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:38.173718 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:38.173718 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:38.173718 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:38.173718 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:38.173718 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:38.173718 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:48:38.173718 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:48:38.173718 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:48:38.173718 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:48:38.174711 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:38.174711 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:38.174711 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:48:38.174711 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:48:38.174711 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:48:38.174711 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:48:38.174711 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:38.174711 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:38.174711 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:38.174711 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:38.174711 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:38.174711 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:38.174711 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:38.174711 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:38.174711 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:38.174711 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:38.174711 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:38.174711 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:38.175623 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:38.175623 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:38.175623 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:48:38.175623 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:48:38.175623 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:48:38.175623 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:48:38.175623 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:48:38.175623 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:48:38.175623 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Apr 30 20:48:38.175623 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:38.175623 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 245/490] 10.222.0.23 () {56 vars in 1093 bytes} [Sat Apr 30 20:48:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:38.176713 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49711c20-b635-4f3c-8c34-1adf097d814f None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:38.205474 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 246/491] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:48:38.206374 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fabe86b-3567-4a41-b5bc-195db47c92fd None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:38.296194 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49711c20-b635-4f3c-8c34-1adf097d814f None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:38.332975 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d97f38-1a04-4815-976c-b697957382ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:38.333797 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d97f38-1a04-4815-976c-b697957382ac None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:38.334099 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d97f38-1a04-4815-976c-b697957382ac None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:38.334374 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d97f38-1a04-4815-976c-b697957382ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:38.335475 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fabe86b-3567-4a41-b5bc-195db47c92fd None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:38.347719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d97f38-1a04-4815-976c-b697957382ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:48:38.358209 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-b0d97f38-1a04-4815-976c-b697957382ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:48:38.358209 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:38.358209 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:38.358209 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:38.358209 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:38.358209 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:38.358209 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:38.358209 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:38.358209 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:38.358209 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:38.358209 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:38.358209 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:38.358209 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:48:38.358209 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:48:38.358209 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:48:38.358209 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:48:38.359328 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:48:38.359328 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:48:38.359328 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:48:38.359328 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:48:38.359328 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:38.359328 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:38.359328 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:38.359328 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:38.359328 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:38.359328 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:38.359328 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:38.359328 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:38.359328 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:38.359328 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:38.359328 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:38.359328 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:38.360228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:38.360228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:38.360228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:38.360228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:38.360228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:48:38.360228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:48:38.360228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:48:38.360228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:48:38.360228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:48:38.360228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:48:38.360228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:48:38.360228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:38.361841 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 246/492] 10.222.0.23 () {56 vars in 1102 bytes} [Sat Apr 30 20:48:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:38.362807 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d97f38-1a04-4815-976c-b697957382ac None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:38.383150 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067425db-6de5-433d-81f8-9962de086bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:38.383840 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067425db-6de5-433d-81f8-9962de086bf3 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:38.384123 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067425db-6de5-433d-81f8-9962de086bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:38.384407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067425db-6de5-433d-81f8-9962de086bf3 None admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:38.385505 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067425db-6de5-433d-81f8-9962de086bf3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:38.385903 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067425db-6de5-433d-81f8-9962de086bf3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:38.387841 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067425db-6de5-433d-81f8-9962de086bf3 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:38.441927 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 247/493] 10.222.0.23 () {56 vars in 1133 bytes} [Sat Apr 30 20:48:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:38.443396 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067425db-6de5-433d-81f8-9962de086bf3 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:38.481421 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d97f38-1a04-4815-976c-b697957382ac None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:38.524726 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adba284-e97e-43b9-a9c8-3cb2eee8dce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:38.525711 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adba284-e97e-43b9-a9c8-3cb2eee8dce9 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:38.526031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adba284-e97e-43b9-a9c8-3cb2eee8dce9 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:38.526406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adba284-e97e-43b9-a9c8-3cb2eee8dce9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:38.541845 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adba284-e97e-43b9-a9c8-3cb2eee8dce9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:48:38.545860 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-6adba284-e97e-43b9-a9c8-3cb2eee8dce9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:48:38.545860 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:38.545860 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:38.545860 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:38.545860 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:38.545860 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:38.545860 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:38.545860 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:38.545860 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:38.545860 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:38.545860 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:38.545860 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:38.545860 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:48:38.545860 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:48:38.545860 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:48:38.545860 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:48:38.546725 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:48:38.546725 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:48:38.546725 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:48:38.546725 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:48:38.546725 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:38.546725 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:38.546725 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:38.546725 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:38.546725 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:38.546725 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:38.546725 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:38.546725 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:38.546725 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:38.546725 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:38.546725 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:38.546725 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:38.547512 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:38.547512 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:38.547512 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:38.547512 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:38.547512 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:48:38.547512 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:48:38.547512 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:48:38.547512 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:48:38.547512 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:48:38.547512 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:48:38.547512 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:48:38.547512 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:38.550497 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 247/494] 10.222.0.23 () {56 vars in 1102 bytes} [Sat Apr 30 20:48:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:38.551465 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adba284-e97e-43b9-a9c8-3cb2eee8dce9 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:38.573291 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067425db-6de5-433d-81f8-9962de086bf3 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:38.614912 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b9d36-d109-44aa-a3bd-7a66193bbecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:38.615604 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b9d36-d109-44aa-a3bd-7a66193bbecf None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:38.615889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b9d36-d109-44aa-a3bd-7a66193bbecf None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:38.616229 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b9d36-d109-44aa-a3bd-7a66193bbecf None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:38.616985 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b9d36-d109-44aa-a3bd-7a66193bbecf None admin] RBAC: Adding query filter params (name=service) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:38.617403 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b9d36-d109-44aa-a3bd-7a66193bbecf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:38.618947 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b9d36-d109-44aa-a3bd-7a66193bbecf None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:38.634598 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 248/495] 10.222.0.23 () {56 vars in 1103 bytes} [Sat Apr 30 20:48:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:38.634598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b9d36-d109-44aa-a3bd-7a66193bbecf None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:38.694719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adba284-e97e-43b9-a9c8-3cb2eee8dce9 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:38.737902 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a7f8e-a296-47f5-af59-00265a9d067b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:38.738709 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a7f8e-a296-47f5-af59-00265a9d067b None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:38.739099 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a7f8e-a296-47f5-af59-00265a9d067b None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:38.739488 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a7f8e-a296-47f5-af59-00265a9d067b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:38.745345 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b9d36-d109-44aa-a3bd-7a66193bbecf None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:38.779805 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf085f6-2d9e-4a01-9b54-1c96c4b69d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:38.780709 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf085f6-2d9e-4a01-9b54-1c96c4b69d30 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:38.781167 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf085f6-2d9e-4a01-9b54-1c96c4b69d30 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:38.781581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf085f6-2d9e-4a01-9b54-1c96c4b69d30 None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:38.782506 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf085f6-2d9e-4a01-9b54-1c96c4b69d30 None admin] RBAC: Adding query filter params (name=service) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:38.782955 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf085f6-2d9e-4a01-9b54-1c96c4b69d30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:38.784875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf085f6-2d9e-4a01-9b54-1c96c4b69d30 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:38.793333 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 249/496] 10.222.0.23 () {56 vars in 1103 bytes} [Sat Apr 30 20:48:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:38.794043 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf085f6-2d9e-4a01-9b54-1c96c4b69d30 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:38.812124 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a7f8e-a296-47f5-af59-00265a9d067b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:38.813599 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a7f8e-a296-47f5-af59-00265a9d067b None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:38.890952 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf085f6-2d9e-4a01-9b54-1c96c4b69d30 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:38.912650 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 248/497] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:48:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:48:38.912650 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3812d-c702-4518-86bd-b8a25d5a6778 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:38.912650 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3812d-c702-4518-86bd-b8a25d5a6778 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:38.912650 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3812d-c702-4518-86bd-b8a25d5a6778 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:38.912650 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 249/498] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:38.912650 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3812d-c702-4518-86bd-b8a25d5a6778 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:38.923952 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f64e1-6cf5-4942-b87e-e49bbf65e339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:38.924734 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f64e1-6cf5-4942-b87e-e49bbf65e339 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:38.925014 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f64e1-6cf5-4942-b87e-e49bbf65e339 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:38.925288 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f64e1-6cf5-4942-b87e-e49bbf65e339 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:38.935384 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f64e1-6cf5-4942-b87e-e49bbf65e339 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:38.937394 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f64e1-6cf5-4942-b87e-e49bbf65e339 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:38.953687 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-376f64e1-6cf5-4942-b87e-e49bbf65e339 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:38.953687 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:38.953687 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:38.953687 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:38.953687 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:38.953687 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:38.953687 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:38.953687 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:38.953687 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:38.953687 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:38.953687 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:38.953687 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:38.953687 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:48:38.953687 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:48:38.953687 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:48:38.954727 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:48:38.954727 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:38.954727 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:38.954727 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:38.954727 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:38.954727 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:38.954727 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:38.954727 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:38.954727 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:38.954727 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:38.954727 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:38.954727 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:38.954727 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:38.954727 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:38.954727 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:38.954727 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:38.954727 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:38.955633 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:48:38.955633 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:48:38.955633 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:38.955633 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:38.961809 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 250/499] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:48:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:38.961809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7dfac-9505-4367-9c45-2b3839f3736a None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:38.961809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7dfac-9505-4367-9c45-2b3839f3736a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:38.961809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7dfac-9505-4367-9c45-2b3839f3736a None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:38.961809 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 251/500] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:38.961809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7dfac-9505-4367-9c45-2b3839f3736a None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:39.009387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3812d-c702-4518-86bd-b8a25d5a6778 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:39.040738 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a8ae5-99a7-45f0-82f4-f8a3721708e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:39.041516 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a8ae5-99a7-45f0-82f4-f8a3721708e0 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:39.041823 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a8ae5-99a7-45f0-82f4-f8a3721708e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:39.042096 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a8ae5-99a7-45f0-82f4-f8a3721708e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:39.052317 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a8ae5-99a7-45f0-82f4-f8a3721708e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:39.053712 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a8ae5-99a7-45f0-82f4-f8a3721708e0 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:39.059897 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7dfac-9505-4367-9c45-2b3839f3736a None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:39.071118 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-040a8ae5-99a7-45f0-82f4-f8a3721708e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:39.071118 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:39.071118 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:39.071118 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:39.071118 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:39.071118 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:39.071118 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:39.071118 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:39.071118 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:39.071118 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:39.071118 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:39.071118 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:39.071118 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:48:39.071118 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:48:39.071118 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:48:39.071965 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:48:39.071965 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:39.071965 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:39.071965 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:39.071965 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:39.071965 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:39.071965 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:39.071965 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:39.071965 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:39.071965 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:39.071965 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:39.071965 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:39.071965 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:39.071965 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:39.071965 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:39.071965 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:39.071965 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:39.072794 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:48:39.072794 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:48:39.072794 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:39.072794 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:39.072794 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 250/501] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:48:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:39.073468 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9651c4d-253d-459e-b367-e430e70cc2da None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:39.073724 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9651c4d-253d-459e-b367-e430e70cc2da None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:39.074023 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9651c4d-253d-459e-b367-e430e70cc2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:39.089401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-c9651c4d-253d-459e-b367-e430e70cc2da None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:39.090621 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c9651c4d-253d-459e-b367-e430e70cc2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:39.097018 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c42b82-65ee-42a2-acf7-7a7e0ae7c076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:39.097844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c42b82-65ee-42a2-acf7-7a7e0ae7c076 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:39.098130 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c42b82-65ee-42a2-acf7-7a7e0ae7c076 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:39.098405 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c42b82-65ee-42a2-acf7-7a7e0ae7c076 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:39.109137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c42b82-65ee-42a2-acf7-7a7e0ae7c076 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:39.110628 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c42b82-65ee-42a2-acf7-7a7e0ae7c076 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:39.127929 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-71c42b82-65ee-42a2-acf7-7a7e0ae7c076 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:39.127929 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:39.127929 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:39.127929 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:39.127929 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:39.127929 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:39.127929 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:39.127929 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:39.127929 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:39.127929 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:39.127929 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:39.127929 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:39.127929 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:48:39.127929 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:48:39.127929 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:48:39.128938 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:48:39.128938 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:39.128938 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:39.128938 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:39.128938 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:39.128938 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:39.128938 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:39.128938 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:39.128938 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:39.128938 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:39.128938 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:39.128938 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:39.128938 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:39.128938 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:39.128938 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:39.128938 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:39.128938 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:39.130021 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:48:39.130021 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:48:39.130021 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:39.130021 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:39.130021 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 252/502] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:48:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:39.130021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c42b82-65ee-42a2-acf7-7a7e0ae7c076 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:39.155968 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 251/503] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:48:39.157249 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e49a7-798e-422c-8fcd-31673fb1c6a0 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:39.157537 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e49a7-798e-422c-8fcd-31673fb1c6a0 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:39.157851 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e49a7-798e-422c-8fcd-31673fb1c6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:39.174051 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-a22e49a7-798e-422c-8fcd-31673fb1c6a0 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:39.175251 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a22e49a7-798e-422c-8fcd-31673fb1c6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:39.230051 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c42b82-65ee-42a2-acf7-7a7e0ae7c076 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:39.239189 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 252/504] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:48:39.240023 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e49a7-798e-422c-8fcd-31673fb1c6a0 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:39.262164 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8411934-4042-457e-b01d-527a6b70436a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:39.262818 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8411934-4042-457e-b01d-527a6b70436a None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:39.263098 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8411934-4042-457e-b01d-527a6b70436a None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:39.263371 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8411934-4042-457e-b01d-527a6b70436a None admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:39.264191 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8411934-4042-457e-b01d-527a6b70436a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:39.264501 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8411934-4042-457e-b01d-527a6b70436a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:39.265920 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8411934-4042-457e-b01d-527a6b70436a None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:39.277456 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 253/505] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:48:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:39.278391 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8411934-4042-457e-b01d-527a6b70436a None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:39.338407 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e49a7-798e-422c-8fcd-31673fb1c6a0 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:39.370955 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8411934-4042-457e-b01d-527a6b70436a None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:39.372466 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4fc42-36bd-4756-811b-46e9cf28f823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:39.373160 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4fc42-36bd-4756-811b-46e9cf28f823 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:39.373439 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4fc42-36bd-4756-811b-46e9cf28f823 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:39.373708 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4fc42-36bd-4756-811b-46e9cf28f823 None admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:39.374454 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef4fc42-36bd-4756-811b-46e9cf28f823 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:39.374760 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef4fc42-36bd-4756-811b-46e9cf28f823 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:39.376152 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef4fc42-36bd-4756-811b-46e9cf28f823 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:39.387091 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 253/506] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:48:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:39.387785 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4fc42-36bd-4756-811b-46e9cf28f823 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:39.402959 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b21a06-7780-4f70-a51c-a87744886535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:39.403613 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b21a06-7780-4f70-a51c-a87744886535 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:39.403899 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b21a06-7780-4f70-a51c-a87744886535 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:39.404171 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b21a06-7780-4f70-a51c-a87744886535 None admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:39.405419 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b21a06-7780-4f70-a51c-a87744886535 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:39.405724 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b21a06-7780-4f70-a51c-a87744886535 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:39.407137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b21a06-7780-4f70-a51c-a87744886535 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:39.417722 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 254/507] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:48:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:39.418521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b21a06-7780-4f70-a51c-a87744886535 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:39.485049 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4fc42-36bd-4756-811b-46e9cf28f823 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:39.511207 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b21a06-7780-4f70-a51c-a87744886535 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:39.516572 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3086cf-12af-4284-b5c4-32ec4ff1e424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:39.517366 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3086cf-12af-4284-b5c4-32ec4ff1e424 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:39.517647 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3086cf-12af-4284-b5c4-32ec4ff1e424 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:39.517949 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3086cf-12af-4284-b5c4-32ec4ff1e424 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:39.528075 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3086cf-12af-4284-b5c4-32ec4ff1e424 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:48:39.536337 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-2f3086cf-12af-4284-b5c4-32ec4ff1e424 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:48:39.536337 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:39.536337 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:39.536337 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:39.536337 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:39.536337 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:39.536337 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:39.536337 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:39.536337 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:39.536337 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:39.536337 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:39.536337 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:39.536337 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:48:39.536337 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:48:39.536337 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:48:39.536337 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:48:39.537442 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:48:39.537442 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:48:39.537442 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:48:39.537442 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:48:39.537442 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:39.537442 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:39.537442 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:39.537442 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:39.537442 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:39.537442 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:39.537442 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:39.537442 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:39.537442 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:39.537442 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:39.537442 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:39.537442 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:39.538610 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:39.538610 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:39.538610 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:39.538610 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:39.538610 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:48:39.538610 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:48:39.538610 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:48:39.538610 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:48:39.538610 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:48:39.538610 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:48:39.538610 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:48:39.538610 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:39.538610 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 254/508] 10.222.0.23 () {56 vars in 1102 bytes} [Sat Apr 30 20:48:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:39.538610 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3086cf-12af-4284-b5c4-32ec4ff1e424 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:39.547055 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e5fd8-057b-4c22-bfed-1e0d8f47683c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:39.547843 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e5fd8-057b-4c22-bfed-1e0d8f47683c None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:39.548118 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e5fd8-057b-4c22-bfed-1e0d8f47683c None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:39.548389 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e5fd8-057b-4c22-bfed-1e0d8f47683c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:39.562941 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e5fd8-057b-4c22-bfed-1e0d8f47683c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:39.564439 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e5fd8-057b-4c22-bfed-1e0d8f47683c None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:39.581273 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-3f8e5fd8-057b-4c22-bfed-1e0d8f47683c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:39.581273 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:39.581273 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:39.581273 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:39.581273 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:39.581273 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:39.581273 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:39.581273 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:39.581273 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:39.581273 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:39.581273 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:39.581273 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:39.581273 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:48:39.581273 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:48:39.581273 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:48:39.582355 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:48:39.582355 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:39.582355 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:39.582355 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:39.582355 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:39.582355 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:39.582355 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:39.582355 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:39.582355 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:39.582355 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:39.582355 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:39.582355 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:39.582355 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:39.582355 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:39.582355 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:39.582355 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:39.582355 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:39.583275 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:48:39.583275 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:48:39.583275 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:39.583275 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:39.583275 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 255/509] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:48:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:39.583275 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e5fd8-057b-4c22-bfed-1e0d8f47683c None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:39.637339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3086cf-12af-4284-b5c4-32ec4ff1e424 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:39.669399 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c1944-fa1e-46ee-b84d-3af6b9f43e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:39.670819 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c1944-fa1e-46ee-b84d-3af6b9f43e33 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:39.671109 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c1944-fa1e-46ee-b84d-3af6b9f43e33 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:39.671380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c1944-fa1e-46ee-b84d-3af6b9f43e33 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:39.678734 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c1944-fa1e-46ee-b84d-3af6b9f43e33 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:39.679263 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e5fd8-057b-4c22-bfed-1e0d8f47683c None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:39.680181 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c1944-fa1e-46ee-b84d-3af6b9f43e33 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:39.693897 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-9a6c1944-fa1e-46ee-b84d-3af6b9f43e33 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 30 20:48:39.693897 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:39.693897 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:39.693897 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:39.693897 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:39.693897 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:39.693897 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:39.693897 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:39.693897 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:39.693897 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:39.693897 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:39.693897 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:39.693897 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:48:39.693897 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:48:39.693897 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:48:39.693897 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:48:39.694786 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:39.694786 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:39.694786 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:48:39.694786 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:48:39.694786 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:48:39.694786 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:48:39.694786 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:39.694786 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:39.694786 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:39.694786 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:39.694786 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:39.694786 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:39.694786 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:39.694786 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:39.694786 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:39.694786 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:39.694786 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:39.694786 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:39.695667 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:39.695667 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:39.695667 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:48:39.695667 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:48:39.695667 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:48:39.695667 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:48:39.695667 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:48:39.695667 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:48:39.695667 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Apr 30 20:48:39.695667 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:39.695667 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 255/510] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:48:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:39.696222 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c1944-fa1e-46ee-b84d-3af6b9f43e33 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:39.718411 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef7603-09b3-4974-a37c-23c776a12419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:39.719204 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef7603-09b3-4974-a37c-23c776a12419 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:39.719486 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef7603-09b3-4974-a37c-23c776a12419 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:39.719762 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef7603-09b3-4974-a37c-23c776a12419 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:39.727554 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef7603-09b3-4974-a37c-23c776a12419 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:39.729130 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef7603-09b3-4974-a37c-23c776a12419 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:39.744321 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-2fef7603-09b3-4974-a37c-23c776a12419 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 30 20:48:39.744321 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:39.744321 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:39.744321 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:39.744321 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:39.744321 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:39.744321 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:39.744321 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:39.744321 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:39.744321 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:39.744321 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:39.744321 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:39.744321 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:48:39.744321 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:48:39.744321 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:48:39.744321 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:48:39.748110 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:39.748110 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:39.748110 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:48:39.748110 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:48:39.748110 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:48:39.748110 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:48:39.748110 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:39.748110 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:39.748110 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:39.748110 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:39.748110 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:39.748110 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:39.748110 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:39.748110 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:39.748110 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:39.748110 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:39.748110 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:39.748110 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:39.749218 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:39.749218 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:39.749218 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:48:39.749218 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:48:39.749218 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:48:39.749218 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:48:39.749218 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:48:39.749218 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:48:39.749218 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Apr 30 20:48:39.749218 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:39.749218 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 256/511] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:48:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:39.749218 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef7603-09b3-4974-a37c-23c776a12419 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:39.795613 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c1944-fa1e-46ee-b84d-3af6b9f43e33 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:39.834259 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2dbbc3-2daa-4d43-8521-df2c8c19dab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:39.835056 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2dbbc3-2daa-4d43-8521-df2c8c19dab6 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:39.835335 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2dbbc3-2daa-4d43-8521-df2c8c19dab6 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:39.835611 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2dbbc3-2daa-4d43-8521-df2c8c19dab6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:39.842836 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2dbbc3-2daa-4d43-8521-df2c8c19dab6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:39.844292 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2dbbc3-2daa-4d43-8521-df2c8c19dab6 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:39.850442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef7603-09b3-4974-a37c-23c776a12419 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:39.858941 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-1a2dbbc3-2daa-4d43-8521-df2c8c19dab6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:48:39.858941 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:39.858941 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:39.858941 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:39.858941 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:39.858941 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:39.858941 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:39.858941 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:39.858941 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:39.858941 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:39.858941 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:39.858941 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:39.858941 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:48:39.858941 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:48:39.858941 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:48:39.859907 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:48:39.859907 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:39.859907 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:39.859907 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:39.859907 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:39.859907 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:39.859907 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:39.859907 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:39.859907 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:39.859907 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:39.859907 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:39.859907 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:39.859907 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:39.859907 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:39.859907 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:39.859907 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:39.859907 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:39.860792 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:48:39.860792 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:48:39.860792 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:48:39.860792 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:48:39.860792 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:48:39.860792 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:48:39.860792 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:48:39.860792 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:39.860792 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 256/512] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:48:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:39.861365 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2dbbc3-2daa-4d43-8521-df2c8c19dab6 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:39.884785 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f81e8-1b08-46e1-8b27-469fa9c06f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:39.885444 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f81e8-1b08-46e1-8b27-469fa9c06f7c None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:39.885724 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f81e8-1b08-46e1-8b27-469fa9c06f7c None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:39.886031 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f81e8-1b08-46e1-8b27-469fa9c06f7c None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:39.886765 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f81e8-1b08-46e1-8b27-469fa9c06f7c None admin] RBAC: Adding query filter params (name=service) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:39.887069 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f81e8-1b08-46e1-8b27-469fa9c06f7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:39.888491 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f81e8-1b08-46e1-8b27-469fa9c06f7c None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:39.896465 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 257/513] 10.222.0.23 () {56 vars in 1103 bytes} [Sat Apr 30 20:48:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:39.897232 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f81e8-1b08-46e1-8b27-469fa9c06f7c None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:39.956160 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2dbbc3-2daa-4d43-8521-df2c8c19dab6 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:39.988740 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb5d5af-8c66-45c5-b943-165d4e42d9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:39.989394 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5d5af-8c66-45c5-b943-165d4e42d9cf None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:39.989679 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5d5af-8c66-45c5-b943-165d4e42d9cf None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:39.989989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5d5af-8c66-45c5-b943-165d4e42d9cf None admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:39.990702 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb5d5af-8c66-45c5-b943-165d4e42d9cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:39.991012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb5d5af-8c66-45c5-b943-165d4e42d9cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:39.992413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb5d5af-8c66-45c5-b943-165d4e42d9cf None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:39.995922 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f81e8-1b08-46e1-8b27-469fa9c06f7c None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:40.003394 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 257/514] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:48:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:40.004019 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb5d5af-8c66-45c5-b943-165d4e42d9cf None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:40.031638 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3fe459-eca8-4f6f-9c78-0223c54f70b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:40.032281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fe459-eca8-4f6f-9c78-0223c54f70b2 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:40.032558 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fe459-eca8-4f6f-9c78-0223c54f70b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:40.032830 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fe459-eca8-4f6f-9c78-0223c54f70b2 None admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:40.033646 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3fe459-eca8-4f6f-9c78-0223c54f70b2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:40.033983 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3fe459-eca8-4f6f-9c78-0223c54f70b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:40.035445 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3fe459-eca8-4f6f-9c78-0223c54f70b2 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:40.051803 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 258/515] 10.222.0.23 () {56 vars in 1137 bytes} [Sat Apr 30 20:48:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:40.052690 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3fe459-eca8-4f6f-9c78-0223c54f70b2 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:40.100402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb5d5af-8c66-45c5-b943-165d4e42d9cf None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:40.131955 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181a62f-4c08-4daf-abbd-a57dc94a74e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:40.132616 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181a62f-4c08-4daf-abbd-a57dc94a74e8 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:40.132894 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181a62f-4c08-4daf-abbd-a57dc94a74e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:40.133167 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181a62f-4c08-4daf-abbd-a57dc94a74e8 None admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:40.134022 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1181a62f-4c08-4daf-abbd-a57dc94a74e8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:40.134329 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1181a62f-4c08-4daf-abbd-a57dc94a74e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:40.135789 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1181a62f-4c08-4daf-abbd-a57dc94a74e8 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:40.146823 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3fe459-eca8-4f6f-9c78-0223c54f70b2 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:40.171255 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 258/516] 10.222.0.23 () {56 vars in 1137 bytes} [Sat Apr 30 20:48:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:40.171889 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181a62f-4c08-4daf-abbd-a57dc94a74e8 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:40.178569 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fb636-2f61-4987-b122-82767e908d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:40.179224 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fb636-2f61-4987-b122-82767e908d6f None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:40.179509 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fb636-2f61-4987-b122-82767e908d6f None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:40.179783 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fb636-2f61-4987-b122-82767e908d6f None admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:40.180559 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fb636-2f61-4987-b122-82767e908d6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:40.180865 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fb636-2f61-4987-b122-82767e908d6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:40.182322 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fb636-2f61-4987-b122-82767e908d6f None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:40.199911 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 259/517] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Apr 30 20:48:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:40.200683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fb636-2f61-4987-b122-82767e908d6f None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:40.271983 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181a62f-4c08-4daf-abbd-a57dc94a74e8 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:40.298944 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fb636-2f61-4987-b122-82767e908d6f None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:40.305043 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81cebd-d7fb-4296-93da-6cd091d6d6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:40.305869 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81cebd-d7fb-4296-93da-6cd091d6d6a2 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:40.306157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81cebd-d7fb-4296-93da-6cd091d6d6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:40.306435 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce81cebd-d7fb-4296-93da-6cd091d6d6a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:40.316597 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81cebd-d7fb-4296-93da-6cd091d6d6a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:40.318093 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce81cebd-d7fb-4296-93da-6cd091d6d6a2 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:40.331350 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465bcbc-113b-410c-92c3-d74c26ac1b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:40.332001 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465bcbc-113b-410c-92c3-d74c26ac1b7a None admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:40.332281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465bcbc-113b-410c-92c3-d74c26ac1b7a None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:40.332551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465bcbc-113b-410c-92c3-d74c26ac1b7a None admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:40.333236 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465bcbc-113b-410c-92c3-d74c26ac1b7a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:40.334694 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465bcbc-113b-410c-92c3-d74c26ac1b7a None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:40.335437 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-ce81cebd-d7fb-4296-93da-6cd091d6d6a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:40.335437 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:40.335437 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:40.335437 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:40.335437 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:40.335437 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:40.335437 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:40.335437 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:40.335437 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:40.335437 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:40.335437 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:40.335437 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:40.335437 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:48:40.335437 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:48:40.335437 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:48:40.336404 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:48:40.336404 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:40.336404 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:40.336404 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:40.336404 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:40.336404 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:40.336404 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:40.336404 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:40.336404 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:40.336404 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:40.336404 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:40.336404 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:40.336404 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:40.336404 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:40.336404 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:40.336404 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:40.336404 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:40.337440 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:48:40.337440 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:48:40.337440 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:40.337440 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:40.337440 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 259/518] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:48:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:40.340989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81cebd-d7fb-4296-93da-6cd091d6d6a2 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:40.425832 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 260/519] 10.222.0.23 () {60 vars in 1132 bytes} [Sat Apr 30 20:48:40 2022] POST /identity/v3/users => generated 247 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:48:40.426594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465bcbc-113b-410c-92c3-d74c26ac1b7a None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:40.435309 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce81cebd-d7fb-4296-93da-6cd091d6d6a2 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:40.477909 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d25bb9-f491-42be-8990-93b60bcb6d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:40.479120 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d25bb9-f491-42be-8990-93b60bcb6d66 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:40.479736 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d25bb9-f491-42be-8990-93b60bcb6d66 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:40.480019 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d25bb9-f491-42be-8990-93b60bcb6d66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:40.531825 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465bcbc-113b-410c-92c3-d74c26ac1b7a None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:40.552113 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d25bb9-f491-42be-8990-93b60bcb6d66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:40.553638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d25bb9-f491-42be-8990-93b60bcb6d66 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:40.568834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd4598-6917-4ccd-8208-6a84dce91665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:40.569707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd4598-6917-4ccd-8208-6a84dce91665 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:40.570025 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd4598-6917-4ccd-8208-6a84dce91665 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:40.575161 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd4598-6917-4ccd-8208-6a84dce91665 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:40.646634 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd4598-6917-4ccd-8208-6a84dce91665 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:40.648457 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd4598-6917-4ccd-8208-6a84dce91665 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:40.657114 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 260/520] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:48:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:48:40.658071 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d25bb9-f491-42be-8990-93b60bcb6d66 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:40.747037 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 261/521] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:48:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:48:40.748665 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd4598-6917-4ccd-8208-6a84dce91665 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:40.757370 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d25bb9-f491-42be-8990-93b60bcb6d66 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:40.793955 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf3444-61a9-4f7a-8215-01b78cfa884e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:40.794615 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf3444-61a9-4f7a-8215-01b78cfa884e None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:40.794948 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf3444-61a9-4f7a-8215-01b78cfa884e None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:40.795774 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf3444-61a9-4f7a-8215-01b78cfa884e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:40.796607 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf3444-61a9-4f7a-8215-01b78cfa884e None admin] RBAC: Adding query filter params (role.id=0971c8bf92d64c50a5cbbf7d146af841, scope.project.id=6b52e5e13b9144dfb663578766c2bac0, user.id=fca4ee1f64c8489ebe7296f9f8f0ab41) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:40.796991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf3444-61a9-4f7a-8215-01b78cfa884e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:40.798429 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf3444-61a9-4f7a-8215-01b78cfa884e None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:40.814017 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 261/522] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:48:40 2022] GET /identity/v3/role_assignments?user.id=fca4ee1f64c8489ebe7296f9f8f0ab41&scope.project.id=6b52e5e13b9144dfb663578766c2bac0&role.id=0971c8bf92d64c50a5cbbf7d146af841 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:40.814017 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf3444-61a9-4f7a-8215-01b78cfa884e None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:40.873316 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd4598-6917-4ccd-8208-6a84dce91665 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:40.923340 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf3444-61a9-4f7a-8215-01b78cfa884e None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:40.923900 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617edf2-3c58-4a23-bf09-bf3eb6cdc088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:40.924681 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617edf2-3c58-4a23-bf09-bf3eb6cdc088 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:40.925064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617edf2-3c58-4a23-bf09-bf3eb6cdc088 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:40.925442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617edf2-3c58-4a23-bf09-bf3eb6cdc088 None admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:40.926382 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617edf2-3c58-4a23-bf09-bf3eb6cdc088 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:40.926791 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617edf2-3c58-4a23-bf09-bf3eb6cdc088 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:40.928415 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617edf2-3c58-4a23-bf09-bf3eb6cdc088 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:40.941090 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 262/523] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:48:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:40.942307 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617edf2-3c58-4a23-bf09-bf3eb6cdc088 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:40.962265 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fa2b0-0b88-4ed8-95d4-bd1256811708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:40.963328 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fa2b0-0b88-4ed8-95d4-bd1256811708 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:40.963758 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fa2b0-0b88-4ed8-95d4-bd1256811708 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:40.964209 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fa2b0-0b88-4ed8-95d4-bd1256811708 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:40.976358 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438fa2b0-0b88-4ed8-95d4-bd1256811708 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:40.978281 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438fa2b0-0b88-4ed8-95d4-bd1256811708 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:40.997954 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-438fa2b0-0b88-4ed8-95d4-bd1256811708 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:40.997954 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:40.997954 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:40.997954 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:40.997954 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:40.997954 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:40.997954 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:40.997954 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:40.997954 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:40.997954 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:40.997954 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:40.997954 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:40.997954 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:48:40.997954 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:48:40.997954 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:48:40.998933 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:48:40.998933 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:40.998933 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:40.998933 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:40.998933 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:40.998933 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:40.998933 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:40.998933 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:40.998933 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:40.998933 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:40.998933 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:40.998933 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:40.998933 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:40.998933 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:40.998933 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:40.998933 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:40.998933 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:40.999784 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:48:40.999784 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:48:40.999784 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:40.999784 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:41.006502 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 262/524] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:48:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:41.007658 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fa2b0-0b88-4ed8-95d4-bd1256811708 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:41.052387 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617edf2-3c58-4a23-bf09-bf3eb6cdc088 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:41.085943 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3334cb-abe0-42ca-8218-ed24978791ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:41.086845 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3334cb-abe0-42ca-8218-ed24978791ba None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:41.087198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3334cb-abe0-42ca-8218-ed24978791ba None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:41.087547 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3334cb-abe0-42ca-8218-ed24978791ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:41.099449 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3334cb-abe0-42ca-8218-ed24978791ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:41.101018 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3334cb-abe0-42ca-8218-ed24978791ba None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:41.119021 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-fa3334cb-abe0-42ca-8218-ed24978791ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:41.119021 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:41.119021 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:41.119021 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:41.119021 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:41.119021 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:41.119021 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:41.119021 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:41.119021 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:41.119021 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:41.119021 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:41.119021 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:41.119021 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:48:41.119021 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:48:41.119021 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:48:41.119884 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:48:41.119884 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:41.119884 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:41.119884 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:41.119884 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:41.119884 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:41.119884 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:41.119884 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:41.119884 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:41.119884 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:41.119884 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:41.119884 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:41.119884 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:41.119884 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:41.119884 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:41.119884 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:41.119884 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:41.120735 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:48:41.120735 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:48:41.120735 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:41.120735 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:41.124794 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 263/525] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:48:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:41.125712 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3334cb-abe0-42ca-8218-ed24978791ba None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:41.126126 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fa2b0-0b88-4ed8-95d4-bd1256811708 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:41.162917 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4f5f6-db00-44b6-a2be-3f6bdd2b957a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:41.163715 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4f5f6-db00-44b6-a2be-3f6bdd2b957a None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:41.163999 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4f5f6-db00-44b6-a2be-3f6bdd2b957a None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:41.164273 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4f5f6-db00-44b6-a2be-3f6bdd2b957a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:41.172329 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f4f5f6-db00-44b6-a2be-3f6bdd2b957a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:41.173841 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f4f5f6-db00-44b6-a2be-3f6bdd2b957a None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:41.190821 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-e0f4f5f6-db00-44b6-a2be-3f6bdd2b957a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 30 20:48:41.190821 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:41.190821 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:41.190821 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:41.190821 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:41.190821 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:41.190821 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:41.190821 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:41.190821 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:41.190821 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:41.190821 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:41.190821 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:41.190821 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:48:41.190821 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:48:41.190821 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:48:41.190821 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:48:41.193467 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:41.193467 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:41.193467 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:48:41.193467 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:48:41.193467 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:48:41.193467 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:48:41.193467 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:41.193467 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:41.193467 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:41.193467 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:41.193467 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:41.193467 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:41.193467 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:41.193467 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:41.193467 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:41.193467 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:41.193467 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:41.193467 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:41.195717 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:41.195717 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:41.195717 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:48:41.195717 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:48:41.195717 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:48:41.195717 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:48:41.195717 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:48:41.195717 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:48:41.195717 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Apr 30 20:48:41.195717 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:41.195717 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 263/526] 10.222.0.23 () {56 vars in 1102 bytes} [Sat Apr 30 20:48:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:41.195717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4f5f6-db00-44b6-a2be-3f6bdd2b957a None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:41.232632 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3334cb-abe0-42ca-8218-ed24978791ba None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:41.267845 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf475d-71ad-49f5-8843-1dd4141eb54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:41.268562 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf475d-71ad-49f5-8843-1dd4141eb54f None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:41.271599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf475d-71ad-49f5-8843-1dd4141eb54f None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:41.271599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf475d-71ad-49f5-8843-1dd4141eb54f None admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:41.271599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf475d-71ad-49f5-8843-1dd4141eb54f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:41.271599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf475d-71ad-49f5-8843-1dd4141eb54f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:41.272196 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf475d-71ad-49f5-8843-1dd4141eb54f None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:41.289986 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 264/527] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:48:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:41.291261 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf475d-71ad-49f5-8843-1dd4141eb54f None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:41.297742 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4f5f6-db00-44b6-a2be-3f6bdd2b957a None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:41.332639 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e01173-64fc-4d8d-bafc-34b0d0643e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:41.333307 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e01173-64fc-4d8d-bafc-34b0d0643e40 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:41.333592 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e01173-64fc-4d8d-bafc-34b0d0643e40 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:41.333918 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e01173-64fc-4d8d-bafc-34b0d0643e40 None admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:41.334693 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e01173-64fc-4d8d-bafc-34b0d0643e40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:41.335005 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e01173-64fc-4d8d-bafc-34b0d0643e40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:41.336465 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e01173-64fc-4d8d-bafc-34b0d0643e40 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:41.352951 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 264/528] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:48:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:41.353851 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e01173-64fc-4d8d-bafc-34b0d0643e40 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:41.397933 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf475d-71ad-49f5-8843-1dd4141eb54f None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:41.432086 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4dcfc-75b1-4868-9fff-b7de95a65ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:41.433047 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4dcfc-75b1-4868-9fff-b7de95a65ebe None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:41.433599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4dcfc-75b1-4868-9fff-b7de95a65ebe None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:41.433914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4dcfc-75b1-4868-9fff-b7de95a65ebe None admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:41.434890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4dcfc-75b1-4868-9fff-b7de95a65ebe None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:41.435208 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4dcfc-75b1-4868-9fff-b7de95a65ebe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:41.437368 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4dcfc-75b1-4868-9fff-b7de95a65ebe None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:41.454257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e01173-64fc-4d8d-bafc-34b0d0643e40 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:41.461848 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 265/529] 10.222.0.23 () {56 vars in 1139 bytes} [Sat Apr 30 20:48:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:41.462726 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4dcfc-75b1-4868-9fff-b7de95a65ebe None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:41.499248 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e763f-387f-4941-aaf0-abc2659dbce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:41.500195 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e763f-387f-4941-aaf0-abc2659dbce6 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:41.500477 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e763f-387f-4941-aaf0-abc2659dbce6 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:41.501482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e763f-387f-4941-aaf0-abc2659dbce6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:41.509429 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e763f-387f-4941-aaf0-abc2659dbce6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:41.511320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e763f-387f-4941-aaf0-abc2659dbce6 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:41.528281 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-dc9e763f-387f-4941-aaf0-abc2659dbce6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:48:41.528281 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:41.528281 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:41.528281 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:41.528281 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:41.528281 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:41.528281 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:41.528281 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:41.528281 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:41.528281 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:41.528281 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:41.528281 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:41.528281 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:48:41.528281 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:48:41.528281 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:48:41.529913 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:48:41.529913 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:41.529913 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:41.529913 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:41.529913 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:41.529913 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:41.529913 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:41.529913 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:41.529913 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:41.529913 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:41.529913 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:41.529913 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:41.529913 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:41.529913 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:41.529913 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:41.529913 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:41.529913 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:41.531208 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:48:41.531208 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:48:41.531208 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:48:41.531208 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:48:41.531208 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:48:41.531208 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:48:41.531208 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:48:41.531208 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:41.537883 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 265/530] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:48:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:41.537883 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e763f-387f-4941-aaf0-abc2659dbce6 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:41.586850 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4dcfc-75b1-4868-9fff-b7de95a65ebe None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:41.631335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560efd09-accc-4f57-b6db-56116a250ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:41.632916 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560efd09-accc-4f57-b6db-56116a250ee8 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:41.633371 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560efd09-accc-4f57-b6db-56116a250ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:41.633715 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560efd09-accc-4f57-b6db-56116a250ee8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:41.641129 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e763f-387f-4941-aaf0-abc2659dbce6 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:41.643071 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560efd09-accc-4f57-b6db-56116a250ee8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:41.645422 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560efd09-accc-4f57-b6db-56116a250ee8 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:41.663394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-560efd09-accc-4f57-b6db-56116a250ee8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:48:41.663394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:41.663394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:41.663394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:41.663394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:41.663394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:41.663394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:41.663394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:41.663394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:41.663394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:41.663394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:41.663394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:41.663394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:48:41.663394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:48:41.663394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:48:41.664558 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:48:41.664558 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:41.664558 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:41.664558 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:41.664558 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:41.664558 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:41.664558 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:41.664558 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:41.664558 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:41.664558 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:41.664558 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:41.664558 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:41.664558 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:41.664558 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:41.664558 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:41.664558 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:41.664558 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:41.665862 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:48:41.665862 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:48:41.665862 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:48:41.665862 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:48:41.665862 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:48:41.665862 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:48:41.665862 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:48:41.665862 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:41.665862 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 266/531] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:48:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:41.670535 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560efd09-accc-4f57-b6db-56116a250ee8 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:41.682047 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00745017-8373-44d8-b10d-7e2e63bfb9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:41.682761 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00745017-8373-44d8-b10d-7e2e63bfb9df None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:41.683046 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00745017-8373-44d8-b10d-7e2e63bfb9df None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:41.683318 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00745017-8373-44d8-b10d-7e2e63bfb9df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:41.755075 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00745017-8373-44d8-b10d-7e2e63bfb9df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:41.756880 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00745017-8373-44d8-b10d-7e2e63bfb9df None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:41.798110 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560efd09-accc-4f57-b6db-56116a250ee8 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:41.840643 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc90c5-9f4d-4100-8af9-6ad6bc2941fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:41.841685 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc90c5-9f4d-4100-8af9-6ad6bc2941fa None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:41.842202 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc90c5-9f4d-4100-8af9-6ad6bc2941fa None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:41.842718 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc90c5-9f4d-4100-8af9-6ad6bc2941fa None admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:41.843701 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdc90c5-9f4d-4100-8af9-6ad6bc2941fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:41.844219 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdc90c5-9f4d-4100-8af9-6ad6bc2941fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:41.846134 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdc90c5-9f4d-4100-8af9-6ad6bc2941fa None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:41.858769 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 267/532] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Apr 30 20:48:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:41.859844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc90c5-9f4d-4100-8af9-6ad6bc2941fa None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:41.878188 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 266/533] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:48:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:48:41.879586 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00745017-8373-44d8-b10d-7e2e63bfb9df None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:41.985836 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc90c5-9f4d-4100-8af9-6ad6bc2941fa None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:42.001896 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00745017-8373-44d8-b10d-7e2e63bfb9df None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:42.029957 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441551a-c13c-48a8-b00f-73af5ea0413a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:42.031557 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441551a-c13c-48a8-b00f-73af5ea0413a None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:42.032150 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441551a-c13c-48a8-b00f-73af5ea0413a None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:42.032634 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441551a-c13c-48a8-b00f-73af5ea0413a None admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:42.033638 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1441551a-c13c-48a8-b00f-73af5ea0413a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:42.034445 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1441551a-c13c-48a8-b00f-73af5ea0413a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:42.035494 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaab99c-c3a1-4812-8ad7-95588c3c071f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:42.036147 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaab99c-c3a1-4812-8ad7-95588c3c071f None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:42.036429 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaab99c-c3a1-4812-8ad7-95588c3c071f None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:42.036707 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaab99c-c3a1-4812-8ad7-95588c3c071f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:42.036990 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1441551a-c13c-48a8-b00f-73af5ea0413a None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:42.037532 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaab99c-c3a1-4812-8ad7-95588c3c071f None admin] RBAC: Adding query filter params (role.id=0971c8bf92d64c50a5cbbf7d146af841, scope.project.id=6b52e5e13b9144dfb663578766c2bac0, user.id=e302b1298dd04d6590e3d079f7b13b29) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:42.037882 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaab99c-c3a1-4812-8ad7-95588c3c071f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:42.039316 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaab99c-c3a1-4812-8ad7-95588c3c071f None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:42.049963 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 267/534] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:48:41 2022] GET /identity/v3/role_assignments?user.id=e302b1298dd04d6590e3d079f7b13b29&scope.project.id=6b52e5e13b9144dfb663578766c2bac0&role.id=0971c8bf92d64c50a5cbbf7d146af841 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:42.050921 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaab99c-c3a1-4812-8ad7-95588c3c071f None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:42.052375 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 268/535] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Apr 30 20:48:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:42.058402 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441551a-c13c-48a8-b00f-73af5ea0413a None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:42.209685 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441551a-c13c-48a8-b00f-73af5ea0413a None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:42.219068 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaab99c-c3a1-4812-8ad7-95588c3c071f None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:42.259686 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1357b0-0cac-4209-bf12-fac276a7d204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:42.260819 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1357b0-0cac-4209-bf12-fac276a7d204 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:42.261388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1357b0-0cac-4209-bf12-fac276a7d204 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:42.261895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1357b0-0cac-4209-bf12-fac276a7d204 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:42.262173 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de331e-cfd0-487c-8077-469dd3f4ca1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:42.262983 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de331e-cfd0-487c-8077-469dd3f4ca1b None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:42.263266 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de331e-cfd0-487c-8077-469dd3f4ca1b None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:42.263540 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de331e-cfd0-487c-8077-469dd3f4ca1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:42.263916 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1357b0-0cac-4209-bf12-fac276a7d204 None admin] RBAC: Adding query filter params (role.id=0971c8bf92d64c50a5cbbf7d146af841, scope.project.id=6b52e5e13b9144dfb663578766c2bac0, user.id=f3dc7765f32c4b00a7e41f2754b9595b) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:42.264449 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1357b0-0cac-4209-bf12-fac276a7d204 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:42.266183 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1357b0-0cac-4209-bf12-fac276a7d204 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:42.275836 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de331e-cfd0-487c-8077-469dd3f4ca1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:42.277321 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de331e-cfd0-487c-8077-469dd3f4ca1b None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:42.296338 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-d1de331e-cfd0-487c-8077-469dd3f4ca1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:42.296338 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:42.296338 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:42.296338 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:42.296338 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:42.296338 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:42.296338 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:42.296338 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:42.296338 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:42.296338 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:42.296338 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:42.296338 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:42.296338 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:48:42.296338 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:48:42.296338 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:48:42.297226 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:48:42.297226 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:42.297226 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:42.297226 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:42.297226 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:42.297226 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:42.297226 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:42.297226 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:42.297226 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:42.297226 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:42.297226 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:42.297226 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:42.297226 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:42.297226 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:42.297226 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:42.297226 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:42.297226 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:42.298122 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:48:42.298122 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:48:42.298122 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:42.298122 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:42.298332 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 269/536] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:48:42 2022] GET /identity/v3/role_assignments?user.id=f3dc7765f32c4b00a7e41f2754b9595b&scope.project.id=6b52e5e13b9144dfb663578766c2bac0&role.id=0971c8bf92d64c50a5cbbf7d146af841 => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:48:42.298404 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 268/537] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:48:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:42.304880 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1357b0-0cac-4209-bf12-fac276a7d204 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:42.434529 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1357b0-0cac-4209-bf12-fac276a7d204 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:42.491061 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ff994-f037-405e-b34e-341379a4045f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:42.491731 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ff994-f037-405e-b34e-341379a4045f None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:42.492012 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ff994-f037-405e-b34e-341379a4045f None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:42.492286 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ff994-f037-405e-b34e-341379a4045f None admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:42.493013 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59ff994-f037-405e-b34e-341379a4045f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:42.493442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59ff994-f037-405e-b34e-341379a4045f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:42.494861 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59ff994-f037-405e-b34e-341379a4045f None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:42.516004 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 270/538] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:48:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:42.522864 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de331e-cfd0-487c-8077-469dd3f4ca1b None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:42.673398 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de331e-cfd0-487c-8077-469dd3f4ca1b None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:42.723840 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654c040-c1fb-4dd9-8367-69cf376f2f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:42.724635 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654c040-c1fb-4dd9-8367-69cf376f2f33 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:42.724914 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654c040-c1fb-4dd9-8367-69cf376f2f33 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:42.725181 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654c040-c1fb-4dd9-8367-69cf376f2f33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:42.734815 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654c040-c1fb-4dd9-8367-69cf376f2f33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:42.736280 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654c040-c1fb-4dd9-8367-69cf376f2f33 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:42.754066 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-6654c040-c1fb-4dd9-8367-69cf376f2f33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:48:42.754066 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:42.754066 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:42.754066 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:42.754066 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:42.754066 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:42.754066 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:42.754066 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:42.754066 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:42.754066 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:42.754066 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:42.754066 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:42.754066 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:48:42.754066 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:48:42.754066 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:48:42.754987 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:48:42.754987 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:42.754987 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:42.754987 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:42.754987 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:42.754987 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:42.754987 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:42.754987 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:42.754987 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:42.754987 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:42.754987 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:42.754987 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:42.754987 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:42.754987 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:42.754987 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:42.754987 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:42.754987 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:42.755836 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:48:42.755836 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:48:42.755836 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:48:42.755836 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:48:42.755836 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:48:42.755836 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:48:42.755836 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:48:42.755836 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:42.755836 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 269/539] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:48:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:42.761794 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ff994-f037-405e-b34e-341379a4045f None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:42.929522 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ff994-f037-405e-b34e-341379a4045f None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:42.940678 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe9236-6730-488f-a10d-3645ad61aa23 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:42.940951 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe9236-6730-488f-a10d-3645ad61aa23 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:42.941232 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe9236-6730-488f-a10d-3645ad61aa23 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:42.942858 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 270/540] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:42.947512 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bfda7-182d-4e2c-8cba-3caf646ae1e8 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:42.947794 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bfda7-182d-4e2c-8cba-3caf646ae1e8 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:42.948067 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bfda7-182d-4e2c-8cba-3caf646ae1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:42.979868 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-616bfda7-182d-4e2c-8cba-3caf646ae1e8 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:42.981075 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-616bfda7-182d-4e2c-8cba-3caf646ae1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:42.986334 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa0ce2-4d95-46ac-b6fb-b4dbc8aea9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:42.986994 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa0ce2-4d95-46ac-b6fb-b4dbc8aea9fc None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:42.987275 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa0ce2-4d95-46ac-b6fb-b4dbc8aea9fc None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:42.987548 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa0ce2-4d95-46ac-b6fb-b4dbc8aea9fc None admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:42.988329 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfa0ce2-4d95-46ac-b6fb-b4dbc8aea9fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:42.988636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfa0ce2-4d95-46ac-b6fb-b4dbc8aea9fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:42.991514 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfa0ce2-4d95-46ac-b6fb-b4dbc8aea9fc None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:43.017921 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 271/541] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Apr 30 20:48:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:43.022928 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa0ce2-4d95-46ac-b6fb-b4dbc8aea9fc None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:43.083703 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 271/542] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:48:43.129502 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616bfda7-182d-4e2c-8cba-3caf646ae1e8 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:43.193547 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa0ce2-4d95-46ac-b6fb-b4dbc8aea9fc None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:43.255761 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616bfda7-182d-4e2c-8cba-3caf646ae1e8 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:43.275851 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510903a7-1731-4152-b76c-33e8d266bff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:43.275851 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510903a7-1731-4152-b76c-33e8d266bff7 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:43.275851 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510903a7-1731-4152-b76c-33e8d266bff7 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:43.275851 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510903a7-1731-4152-b76c-33e8d266bff7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:43.276648 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510903a7-1731-4152-b76c-33e8d266bff7 None admin] RBAC: Adding query filter params (role.id=0971c8bf92d64c50a5cbbf7d146af841, scope.project.id=6b52e5e13b9144dfb663578766c2bac0, user.id=0b0cb145b72a492ebb8c0e9223be47a1) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:43.277011 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510903a7-1731-4152-b76c-33e8d266bff7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:43.278508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510903a7-1731-4152-b76c-33e8d266bff7 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:43.295693 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 272/543] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:48:43 2022] GET /identity/v3/role_assignments?user.id=0b0cb145b72a492ebb8c0e9223be47a1&scope.project.id=6b52e5e13b9144dfb663578766c2bac0&role.id=0971c8bf92d64c50a5cbbf7d146af841 => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:43.322422 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ecd187-fc44-4c0d-a920-1c49dd582e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:43.323630 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecd187-fc44-4c0d-a920-1c49dd582e62 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:43.324122 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecd187-fc44-4c0d-a920-1c49dd582e62 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:43.324644 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecd187-fc44-4c0d-a920-1c49dd582e62 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:43.343946 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ecd187-fc44-4c0d-a920-1c49dd582e62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:48:43.352483 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-57ecd187-fc44-4c0d-a920-1c49dd582e62 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:48:43.352483 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:43.352483 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:43.352483 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:43.352483 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:43.352483 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:43.352483 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:43.352483 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:43.352483 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:43.352483 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:43.352483 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:43.352483 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:43.352483 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:48:43.352483 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:48:43.352483 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:48:43.352483 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:48:43.353452 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:48:43.353452 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:48:43.353452 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:48:43.353452 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:48:43.353452 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:43.353452 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:43.353452 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:43.353452 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:43.353452 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:43.353452 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:43.353452 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:43.353452 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:43.353452 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:43.353452 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:43.353452 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:43.353452 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:43.354296 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:43.354296 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:43.354296 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:43.354296 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:43.354296 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:48:43.354296 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:48:43.354296 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:48:43.354296 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:48:43.354296 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:48:43.354296 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:48:43.354296 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:48:43.354296 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:43.357115 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 272/544] 10.222.0.23 () {56 vars in 1102 bytes} [Sat Apr 30 20:48:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:43.366999 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510903a7-1731-4152-b76c-33e8d266bff7 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:43.525073 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510903a7-1731-4152-b76c-33e8d266bff7 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:43.537447 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14a01e-82d4-439a-b305-7c3dc3a4e981 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:43.538493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14a01e-82d4-439a-b305-7c3dc3a4e981 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:43.538982 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14a01e-82d4-439a-b305-7c3dc3a4e981 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:43.541041 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 273/545] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:48:43.548407 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c37b9-2a1b-4f82-bdd2-186dc12c2e37 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:43.549441 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c37b9-2a1b-4f82-bdd2-186dc12c2e37 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:43.549922 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c37b9-2a1b-4f82-bdd2-186dc12c2e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:43.581461 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae52b19-9772-4686-928d-bf627908328d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:43.582171 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae52b19-9772-4686-928d-bf627908328d None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:43.582443 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae52b19-9772-4686-928d-bf627908328d None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:43.582718 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae52b19-9772-4686-928d-bf627908328d None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:43.582820 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-3b9c37b9-2a1b-4f82-bdd2-186dc12c2e37 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:43.583479 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae52b19-9772-4686-928d-bf627908328d None admin] RBAC: Adding query filter params (name=service) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:43.583788 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae52b19-9772-4686-928d-bf627908328d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:43.584030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3b9c37b9-2a1b-4f82-bdd2-186dc12c2e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:43.585251 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae52b19-9772-4686-928d-bf627908328d None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:43.596554 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 273/546] 10.222.0.23 () {56 vars in 1103 bytes} [Sat Apr 30 20:48:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:43.602746 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae52b19-9772-4686-928d-bf627908328d None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:43.716182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae52b19-9772-4686-928d-bf627908328d None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:43.759316 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 274/547] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:48:43.760748 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f91b16-d669-4c3a-83d8-9dea1267ff7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:43.761539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f91b16-d669-4c3a-83d8-9dea1267ff7b None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:43.761850 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f91b16-d669-4c3a-83d8-9dea1267ff7b None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:43.762133 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f91b16-d669-4c3a-83d8-9dea1267ff7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:43.782810 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f91b16-d669-4c3a-83d8-9dea1267ff7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:43.784188 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f91b16-d669-4c3a-83d8-9dea1267ff7b None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:43.805404 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-d1f91b16-d669-4c3a-83d8-9dea1267ff7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:43.805404 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:43.805404 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:43.805404 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:43.805404 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:43.805404 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:43.805404 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:43.805404 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:43.805404 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:43.805404 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:43.805404 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:43.805404 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:43.805404 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:48:43.805404 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:48:43.805404 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:48:43.806362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:48:43.806362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:43.806362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:43.806362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:43.806362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:43.806362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:43.806362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:43.806362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:43.806362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:43.806362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:43.806362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:43.806362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:43.806362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:43.806362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:43.806362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:43.806362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:43.806362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:43.807206 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:48:43.807206 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:48:43.807206 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:43.807206 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:43.811819 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 274/548] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:48:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:43.812626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9c37b9-2a1b-4f82-bdd2-186dc12c2e37 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:43.873921 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f91b16-d669-4c3a-83d8-9dea1267ff7b None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:43.937570 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9c37b9-2a1b-4f82-bdd2-186dc12c2e37 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:43.987386 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a09ac1-3707-4393-a822-1761166c5b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:43.988061 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a09ac1-3707-4393-a822-1761166c5b22 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:43.988348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a09ac1-3707-4393-a822-1761166c5b22 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:43.988624 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a09ac1-3707-4393-a822-1761166c5b22 None admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:43.989358 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a09ac1-3707-4393-a822-1761166c5b22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:43.989663 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a09ac1-3707-4393-a822-1761166c5b22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:43.991089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a09ac1-3707-4393-a822-1761166c5b22 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:43.997601 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f91b16-d669-4c3a-83d8-9dea1267ff7b None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:44.012475 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 275/549] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:48:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:44.016876 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a09ac1-3707-4393-a822-1761166c5b22 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:44.051099 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b079f3-57fe-4380-963e-f91a6496252d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:44.051876 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b079f3-57fe-4380-963e-f91a6496252d None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:44.052157 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b079f3-57fe-4380-963e-f91a6496252d None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:44.052437 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b079f3-57fe-4380-963e-f91a6496252d None admin] PATH_INFO: `/v3/roles/service` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:44.066711 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b079f3-57fe-4380-963e-f91a6496252d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:48:44.074601 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-87b079f3-57fe-4380-963e-f91a6496252d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:48:44.074601 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:44.074601 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:44.074601 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:44.074601 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:44.074601 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:44.074601 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:44.074601 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:44.074601 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:44.074601 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:44.074601 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:44.074601 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:44.074601 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:48:44.074601 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:48:44.074601 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:48:44.074601 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:48:44.076670 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:48:44.076670 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:48:44.076670 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:48:44.076670 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:48:44.076670 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:44.076670 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:44.076670 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:44.076670 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:44.076670 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:44.076670 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:44.076670 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:44.076670 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:44.076670 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:44.076670 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:44.076670 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:44.076670 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:44.078642 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:44.078642 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:44.078642 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:44.078642 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:44.078642 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:48:44.078642 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:48:44.078642 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:48:44.078642 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:48:44.078642 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:48:44.078642 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:48:44.078642 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:48:44.078642 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:44.078642 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 275/550] 10.222.0.23 () {56 vars in 1102 bytes} [Sat Apr 30 20:48:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:44.092238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b079f3-57fe-4380-963e-f91a6496252d None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:44.123947 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a09ac1-3707-4393-a822-1761166c5b22 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:44.172661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c2cca-fecd-407d-8c02-97e90a780154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:44.173463 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c2cca-fecd-407d-8c02-97e90a780154 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:44.173746 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c2cca-fecd-407d-8c02-97e90a780154 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:44.174038 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c2cca-fecd-407d-8c02-97e90a780154 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:44.183627 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c2cca-fecd-407d-8c02-97e90a780154 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:44.203603 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c2cca-fecd-407d-8c02-97e90a780154 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:44.206521 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-a93c2cca-fecd-407d-8c02-97e90a780154 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 30 20:48:44.206521 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:44.206521 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:44.206521 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:44.206521 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:44.206521 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:44.206521 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:44.206521 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:44.206521 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:44.206521 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:44.206521 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:44.206521 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:44.206521 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:48:44.206521 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:48:44.206521 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:48:44.206521 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:48:44.208535 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:44.208535 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:44.208535 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:48:44.208535 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:48:44.208535 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:48:44.208535 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:48:44.208535 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:44.208535 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:44.208535 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:44.208535 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:44.208535 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:44.208535 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:44.208535 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:44.208535 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:44.208535 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:44.208535 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:44.208535 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:44.208535 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:44.210757 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:44.210757 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:44.210757 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:48:44.210757 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:48:44.210757 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:48:44.210757 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:48:44.210757 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:48:44.210757 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:48:44.210757 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Apr 30 20:48:44.210757 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:44.226163 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 276/551] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Apr 30 20:48:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:44.229070 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c2cca-fecd-407d-8c02-97e90a780154 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:44.280982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b079f3-57fe-4380-963e-f91a6496252d None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:44.366562 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0900bc-d629-4412-bd66-8148cdf94cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:44.367164 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0900bc-d629-4412-bd66-8148cdf94cf4 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:44.367447 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0900bc-d629-4412-bd66-8148cdf94cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:44.367722 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0900bc-d629-4412-bd66-8148cdf94cf4 None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:44.368482 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0900bc-d629-4412-bd66-8148cdf94cf4 None admin] RBAC: Adding query filter params (name=service) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:44.368786 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0900bc-d629-4412-bd66-8148cdf94cf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:44.370188 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0900bc-d629-4412-bd66-8148cdf94cf4 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:44.374112 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c2cca-fecd-407d-8c02-97e90a780154 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:44.389565 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 276/552] 10.222.0.23 () {56 vars in 1103 bytes} [Sat Apr 30 20:48:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:48:44.395380 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0900bc-d629-4412-bd66-8148cdf94cf4 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:44.458493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d3ff25-b4a5-45f8-8f29-1492c5a20d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:44.459192 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3ff25-b4a5-45f8-8f29-1492c5a20d3a None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:44.459484 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3ff25-b4a5-45f8-8f29-1492c5a20d3a None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:44.459770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3ff25-b4a5-45f8-8f29-1492c5a20d3a None admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:44.460623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d3ff25-b4a5-45f8-8f29-1492c5a20d3a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:44.460938 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d3ff25-b4a5-45f8-8f29-1492c5a20d3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:44.462665 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d3ff25-b4a5-45f8-8f29-1492c5a20d3a None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:44.501783 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 277/553] 10.222.0.23 () {56 vars in 1135 bytes} [Sat Apr 30 20:48:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:44.506100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0900bc-d629-4412-bd66-8148cdf94cf4 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:44.516066 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d3ff25-b4a5-45f8-8f29-1492c5a20d3a None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:44.556478 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c984b-4522-4b9e-90f0-8147e00fdb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:44.558020 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c984b-4522-4b9e-90f0-8147e00fdb02 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:44.558513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c984b-4522-4b9e-90f0-8147e00fdb02 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:44.559010 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c984b-4522-4b9e-90f0-8147e00fdb02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:44.579215 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c984b-4522-4b9e-90f0-8147e00fdb02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:44.584444 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c984b-4522-4b9e-90f0-8147e00fdb02 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:44.625864 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-f47c984b-4522-4b9e-90f0-8147e00fdb02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:44.625864 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:44.625864 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:44.625864 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:44.625864 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:44.625864 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:44.625864 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:44.625864 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:44.625864 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:44.625864 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:44.625864 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:44.625864 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:44.625864 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:48:44.625864 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:48:44.625864 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:48:44.626744 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:48:44.626744 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:44.626744 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:44.626744 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:44.626744 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:44.626744 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:44.626744 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:44.626744 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:44.626744 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:44.626744 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:44.626744 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:44.626744 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:44.626744 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:44.626744 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:44.626744 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:44.626744 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:44.626744 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:44.627557 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:48:44.627557 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:48:44.627557 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:44.627557 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:44.629601 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 277/554] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:48:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:48:44.635228 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c984b-4522-4b9e-90f0-8147e00fdb02 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:44.656493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d3ff25-b4a5-45f8-8f29-1492c5a20d3a None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:44.694077 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf365f06-93ff-4b8f-ae2b-53d5d691cd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:44.694737 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf365f06-93ff-4b8f-ae2b-53d5d691cd34 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:44.695742 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf365f06-93ff-4b8f-ae2b-53d5d691cd34 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:44.696025 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf365f06-93ff-4b8f-ae2b-53d5d691cd34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:44.813439 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf365f06-93ff-4b8f-ae2b-53d5d691cd34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:44.815972 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf365f06-93ff-4b8f-ae2b-53d5d691cd34 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:44.821281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c984b-4522-4b9e-90f0-8147e00fdb02 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:44.855567 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5020a-8e79-4cc2-84bc-69ac3e5b5d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:44.856536 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5020a-8e79-4cc2-84bc-69ac3e5b5d28 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:44.857003 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5020a-8e79-4cc2-84bc-69ac3e5b5d28 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:44.857508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5020a-8e79-4cc2-84bc-69ac3e5b5d28 None admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:44.858474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d5020a-8e79-4cc2-84bc-69ac3e5b5d28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:44.858984 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d5020a-8e79-4cc2-84bc-69ac3e5b5d28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:44.860557 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d5020a-8e79-4cc2-84bc-69ac3e5b5d28 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:44.873599 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 278/555] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:48:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:48:44.875095 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec4f0b-bfa5-441d-a6b8-5635603d162b None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:44.875599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec4f0b-bfa5-441d-a6b8-5635603d162b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:44.876127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec4f0b-bfa5-441d-a6b8-5635603d162b None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:44.881778 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 279/556] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:44.882889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec4f0b-bfa5-441d-a6b8-5635603d162b None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:44.936411 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 278/557] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:48:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 30 20:48:44.938131 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e05df8-cfdf-4d5f-9790-1a7f0dc00980 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:44.938650 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e05df8-cfdf-4d5f-9790-1a7f0dc00980 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:44.939138 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e05df8-cfdf-4d5f-9790-1a7f0dc00980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:44.963493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-e1e05df8-cfdf-4d5f-9790-1a7f0dc00980 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:44.965401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e1e05df8-cfdf-4d5f-9790-1a7f0dc00980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:44.995682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec4f0b-bfa5-441d-a6b8-5635603d162b None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:45.040305 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd894e1d-e2c0-4a6e-8ca0-fd750ec2ace9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:45.041386 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd894e1d-e2c0-4a6e-8ca0-fd750ec2ace9 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:45.041887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd894e1d-e2c0-4a6e-8ca0-fd750ec2ace9 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:45.042305 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd894e1d-e2c0-4a6e-8ca0-fd750ec2ace9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:45.051499 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd894e1d-e2c0-4a6e-8ca0-fd750ec2ace9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:45.053534 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 279/558] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:48:45.054312 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd894e1d-e2c0-4a6e-8ca0-fd750ec2ace9 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:45.054456 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e05df8-cfdf-4d5f-9790-1a7f0dc00980 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:45.071949 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-dd894e1d-e2c0-4a6e-8ca0-fd750ec2ace9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 30 20:48:45.071949 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:45.071949 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:45.071949 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:45.071949 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:45.071949 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:45.071949 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:45.071949 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:45.071949 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:45.071949 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:45.071949 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:45.071949 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:45.071949 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:48:45.071949 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:48:45.071949 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:48:45.071949 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:48:45.073128 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:45.073128 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:45.073128 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:48:45.073128 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:48:45.073128 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:48:45.073128 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:48:45.073128 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:45.073128 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:45.073128 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:45.073128 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:45.073128 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:45.073128 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:45.073128 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:45.073128 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:45.073128 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:45.073128 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:45.073128 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:45.073128 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:45.074321 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:45.074321 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:45.074321 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:48:45.074321 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:48:45.074321 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:48:45.074321 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:48:45.074321 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:48:45.074321 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:48:45.074321 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Apr 30 20:48:45.074321 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:45.075246 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 280/559] 10.222.0.23 () {56 vars in 1093 bytes} [Sat Apr 30 20:48:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:45.081272 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd894e1d-e2c0-4a6e-8ca0-fd750ec2ace9 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:45.174233 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e05df8-cfdf-4d5f-9790-1a7f0dc00980 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:45.184991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd894e1d-e2c0-4a6e-8ca0-fd750ec2ace9 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:45.211453 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d0000-edb1-4d43-b0d2-d9b1636098ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:45.212253 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d0000-edb1-4d43-b0d2-d9b1636098ae None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:45.212538 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d0000-edb1-4d43-b0d2-d9b1636098ae None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:45.213072 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d0000-edb1-4d43-b0d2-d9b1636098ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:45.220660 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b82cca8-c294-4c11-a9f1-a3eeeae57804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:45.221380 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82cca8-c294-4c11-a9f1-a3eeeae57804 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:45.221657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82cca8-c294-4c11-a9f1-a3eeeae57804 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:45.221992 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82cca8-c294-4c11-a9f1-a3eeeae57804 None admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:45.222818 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b82cca8-c294-4c11-a9f1-a3eeeae57804 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:45.223125 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b82cca8-c294-4c11-a9f1-a3eeeae57804 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:45.223391 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d0000-edb1-4d43-b0d2-d9b1636098ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:45.224554 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b82cca8-c294-4c11-a9f1-a3eeeae57804 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:45.224855 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d0000-edb1-4d43-b0d2-d9b1636098ae None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:45.244049 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-2f7d0000-edb1-4d43-b0d2-d9b1636098ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:45.244049 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:45.244049 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:45.244049 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:45.244049 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:45.244049 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:45.244049 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:45.244049 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:45.244049 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:45.244049 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:45.244049 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:45.244049 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:45.244049 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:48:45.244049 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:48:45.244049 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:48:45.244933 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:48:45.244933 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:45.244933 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:45.244933 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:45.244933 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:45.244933 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:45.244933 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:45.244933 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:45.244933 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:45.244933 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:45.244933 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:45.244933 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:45.244933 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:45.244933 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:45.244933 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:45.244933 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:45.244933 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:45.246691 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:48:45.246691 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:48:45.246691 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:45.246691 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:45.247369 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 281/560] 10.222.0.23 () {56 vars in 1133 bytes} [Sat Apr 30 20:48:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:48:45.248771 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b82cca8-c294-4c11-a9f1-a3eeeae57804 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:45.250046 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 280/561] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:48:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:45.251834 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf7806-a2ac-4580-8bb8-5d7b1f97f849 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:45.252132 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf7806-a2ac-4580-8bb8-5d7b1f97f849 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:45.253281 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf7806-a2ac-4580-8bb8-5d7b1f97f849 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:45.254796 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 281/562] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:45.259439 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf7806-a2ac-4580-8bb8-5d7b1f97f849 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:45.355457 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b82cca8-c294-4c11-a9f1-a3eeeae57804 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:45.369306 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf7806-a2ac-4580-8bb8-5d7b1f97f849 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:45.390846 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7254b-26c8-4fde-be5a-ba8c772b3107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:45.391654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7254b-26c8-4fde-be5a-ba8c772b3107 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:45.391937 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7254b-26c8-4fde-be5a-ba8c772b3107 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:45.392210 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7254b-26c8-4fde-be5a-ba8c772b3107 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:45.403810 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d7254b-26c8-4fde-be5a-ba8c772b3107 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:48:45.404110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac013f5c-410f-4892-b0c0-975d01c2e70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:45.405432 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac013f5c-410f-4892-b0c0-975d01c2e70a None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:45.405714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac013f5c-410f-4892-b0c0-975d01c2e70a None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:45.406017 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac013f5c-410f-4892-b0c0-975d01c2e70a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:45.412166 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-08d7254b-26c8-4fde-be5a-ba8c772b3107 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:48:45.412166 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:45.412166 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:45.412166 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:45.412166 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:45.412166 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:45.412166 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:45.412166 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:45.412166 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:45.412166 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:45.412166 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:45.412166 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:45.412166 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:48:45.412166 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:48:45.412166 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:48:45.412166 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:48:45.413142 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:48:45.413142 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:48:45.413142 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:48:45.413142 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:48:45.413142 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:45.413142 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:45.413142 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:45.413142 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:45.413142 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:45.413142 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:45.413142 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:45.413142 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:45.413142 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:45.413142 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:45.413142 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:45.413142 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:45.414013 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:45.414013 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:45.414013 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:45.414013 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:45.414013 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:48:45.414013 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:48:45.414013 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:48:45.414013 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:48:45.414013 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:48:45.414013 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:48:45.414013 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:48:45.414013 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:45.414013 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 282/563] 10.222.0.23 () {56 vars in 1102 bytes} [Sat Apr 30 20:48:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:45.419303 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7254b-26c8-4fde-be5a-ba8c772b3107 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:45.419374 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac013f5c-410f-4892-b0c0-975d01c2e70a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:45.420904 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac013f5c-410f-4892-b0c0-975d01c2e70a None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:45.438661 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-ac013f5c-410f-4892-b0c0-975d01c2e70a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:45.438661 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:45.438661 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:45.438661 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:45.438661 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:45.438661 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:45.438661 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:45.438661 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:45.438661 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:45.438661 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:45.438661 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:45.438661 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:45.438661 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:48:45.438661 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:48:45.438661 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:48:45.439545 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:48:45.439545 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:45.439545 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:45.439545 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:45.439545 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:45.439545 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:45.439545 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:45.439545 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:45.439545 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:45.439545 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:45.439545 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:45.439545 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:45.439545 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:45.439545 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:45.439545 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:45.439545 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:45.439545 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:45.440408 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:48:45.440408 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:48:45.440408 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:45.440408 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:45.440408 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 282/564] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:48:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:45.441290 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c50b4-d591-45d4-aeee-5e70ea9cfa9c None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:45.441391 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c50b4-d591-45d4-aeee-5e70ea9cfa9c None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:45.441888 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c50b4-d591-45d4-aeee-5e70ea9cfa9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:45.462004 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-1b4c50b4-d591-45d4-aeee-5e70ea9cfa9c None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:45.463212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1b4c50b4-d591-45d4-aeee-5e70ea9cfa9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:45.531691 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7254b-26c8-4fde-be5a-ba8c772b3107 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:45.534072 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 283/565] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:48:45.534810 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c50b4-d591-45d4-aeee-5e70ea9cfa9c None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:45.574037 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b2e76-b93e-4c76-bdb2-c2738c0862f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:45.574728 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b2e76-b93e-4c76-bdb2-c2738c0862f9 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:45.574979 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b2e76-b93e-4c76-bdb2-c2738c0862f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:45.575254 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b2e76-b93e-4c76-bdb2-c2738c0862f9 None admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:45.575976 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b2e76-b93e-4c76-bdb2-c2738c0862f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:45.576356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b2e76-b93e-4c76-bdb2-c2738c0862f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:45.577854 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b2e76-b93e-4c76-bdb2-c2738c0862f9 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:45.589901 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 283/566] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:48:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:45.591045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b2e76-b93e-4c76-bdb2-c2738c0862f9 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:45.643902 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c50b4-d591-45d4-aeee-5e70ea9cfa9c None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:45.677963 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b50497-c874-4be3-a3bc-a51d6db7f902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:45.678719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b50497-c874-4be3-a3bc-a51d6db7f902 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:45.678919 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b50497-c874-4be3-a3bc-a51d6db7f902 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:45.679200 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b50497-c874-4be3-a3bc-a51d6db7f902 None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:45.679974 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b50497-c874-4be3-a3bc-a51d6db7f902 None admin] RBAC: Adding query filter params (name=service) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:45.680291 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b50497-c874-4be3-a3bc-a51d6db7f902 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:45.681749 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b50497-c874-4be3-a3bc-a51d6db7f902 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:45.694584 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 284/567] 10.222.0.23 () {56 vars in 1103 bytes} [Sat Apr 30 20:48:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:45.694584 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b50497-c874-4be3-a3bc-a51d6db7f902 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:45.694804 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b2e76-b93e-4c76-bdb2-c2738c0862f9 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:45.725562 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb3699-264f-4c62-bf71-dcd020dd8b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:45.726257 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb3699-264f-4c62-bf71-dcd020dd8b8f None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:45.726548 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb3699-264f-4c62-bf71-dcd020dd8b8f None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:45.726830 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb3699-264f-4c62-bf71-dcd020dd8b8f None admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:45.727569 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb3699-264f-4c62-bf71-dcd020dd8b8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:45.727872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb3699-264f-4c62-bf71-dcd020dd8b8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:45.729247 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb3699-264f-4c62-bf71-dcd020dd8b8f None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:45.746649 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 284/568] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:48:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:45.746649 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb3699-264f-4c62-bf71-dcd020dd8b8f None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:45.795123 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b50497-c874-4be3-a3bc-a51d6db7f902 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:45.829647 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2312ca21-1858-48d9-a383-df779ebf9045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:45.831907 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312ca21-1858-48d9-a383-df779ebf9045 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:45.833099 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312ca21-1858-48d9-a383-df779ebf9045 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:45.833099 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312ca21-1858-48d9-a383-df779ebf9045 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:45.848812 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2312ca21-1858-48d9-a383-df779ebf9045 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:48:45.856618 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-2312ca21-1858-48d9-a383-df779ebf9045 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:48:45.856618 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:45.856618 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:45.856618 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:45.856618 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:45.856618 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:45.856618 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:45.856618 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:45.856618 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:45.856618 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:45.856618 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:45.856618 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:45.856618 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:48:45.856618 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:48:45.856618 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:48:45.856618 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:48:45.857671 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:48:45.857671 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:48:45.857671 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:48:45.857671 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:48:45.857671 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:45.857671 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:45.857671 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:45.857671 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:45.857671 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:45.857671 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:45.857671 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:45.857671 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:45.857671 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:45.857671 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:45.857671 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:45.857671 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:45.858613 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:45.858613 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:45.858613 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:45.858613 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:45.858613 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:48:45.858613 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:48:45.858613 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:48:45.858613 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:48:45.858613 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:48:45.858613 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:48:45.858613 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:48:45.858613 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:45.859378 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb3699-264f-4c62-bf71-dcd020dd8b8f None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:45.859453 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 285/569] 10.222.0.23 () {56 vars in 1102 bytes} [Sat Apr 30 20:48:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:45.859453 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2312ca21-1858-48d9-a383-df779ebf9045 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:45.895081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c3a5b-f06c-4319-8c44-63fddfd38f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:45.895877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c3a5b-f06c-4319-8c44-63fddfd38f05 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:45.896161 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c3a5b-f06c-4319-8c44-63fddfd38f05 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:45.896437 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c3a5b-f06c-4319-8c44-63fddfd38f05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:45.903114 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c3a5b-f06c-4319-8c44-63fddfd38f05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:45.905177 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c3a5b-f06c-4319-8c44-63fddfd38f05 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:45.919286 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-a48c3a5b-f06c-4319-8c44-63fddfd38f05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:48:45.919286 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:45.919286 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:45.919286 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:45.919286 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:45.919286 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:45.919286 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:45.919286 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:45.919286 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:45.919286 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:45.919286 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:45.919286 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:45.919286 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:48:45.919286 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:48:45.919286 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:48:45.920221 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:48:45.920221 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:45.920221 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:45.920221 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:45.920221 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:45.920221 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:45.920221 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:45.920221 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:45.920221 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:45.920221 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:45.920221 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:45.920221 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:45.920221 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:45.920221 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:45.920221 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:45.920221 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:45.920221 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:45.922122 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:48:45.922122 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:48:45.922122 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:48:45.922122 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:48:45.922122 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:48:45.922122 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:48:45.922122 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:48:45.922122 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:45.922122 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 285/570] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:48:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:45.922122 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c3a5b-f06c-4319-8c44-63fddfd38f05 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:45.976629 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2312ca21-1858-48d9-a383-df779ebf9045 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:46.007721 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b080676-bedc-48d4-aa16-07e89d668505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:46.008512 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b080676-bedc-48d4-aa16-07e89d668505 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:46.008792 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b080676-bedc-48d4-aa16-07e89d668505 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:46.009063 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b080676-bedc-48d4-aa16-07e89d668505 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:46.018720 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c3a5b-f06c-4319-8c44-63fddfd38f05 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:46.020184 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b080676-bedc-48d4-aa16-07e89d668505 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:46.021643 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b080676-bedc-48d4-aa16-07e89d668505 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:46.038496 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-2b080676-bedc-48d4-aa16-07e89d668505 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:46.038496 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:46.038496 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:46.038496 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:46.038496 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:46.038496 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:46.038496 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:46.038496 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:46.038496 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:46.038496 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:46.038496 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:46.038496 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:46.038496 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:48:46.038496 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:48:46.038496 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:48:46.039365 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:48:46.039365 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:46.039365 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:46.039365 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:46.039365 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:46.039365 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:46.039365 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:46.039365 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:46.039365 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:46.039365 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:46.039365 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:46.039365 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:46.039365 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:46.039365 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:46.039365 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:46.039365 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:46.039365 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:46.040228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:48:46.040228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:48:46.040228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:46.040228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:46.040228 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 286/571] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:48:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:46.040695 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b080676-bedc-48d4-aa16-07e89d668505 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:46.051982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca520f-c345-4eaa-88ae-c74d56ce8c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:46.052775 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca520f-c345-4eaa-88ae-c74d56ce8c06 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:46.053113 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca520f-c345-4eaa-88ae-c74d56ce8c06 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:46.053394 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca520f-c345-4eaa-88ae-c74d56ce8c06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:46.060024 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ca520f-c345-4eaa-88ae-c74d56ce8c06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:46.062004 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ca520f-c345-4eaa-88ae-c74d56ce8c06 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:46.075256 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-33ca520f-c345-4eaa-88ae-c74d56ce8c06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:48:46.075256 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:46.075256 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:46.075256 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:46.075256 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:46.075256 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:46.075256 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:46.075256 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:46.075256 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:46.075256 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:46.075256 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:46.075256 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:46.075256 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:48:46.075256 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:48:46.075256 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:48:46.076731 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:48:46.076731 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:46.076731 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:46.076731 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:46.076731 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:46.076731 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:46.076731 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:46.076731 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:46.076731 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:46.076731 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:46.076731 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:46.076731 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:46.076731 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:46.076731 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:46.076731 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:46.076731 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:46.076731 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:46.077642 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:48:46.077642 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:48:46.077642 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:48:46.077642 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:48:46.077642 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:48:46.077642 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:48:46.077642 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:48:46.077642 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:46.077642 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 286/572] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:48:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:46.078191 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca520f-c345-4eaa-88ae-c74d56ce8c06 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:46.134211 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b080676-bedc-48d4-aa16-07e89d668505 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:46.165773 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3235f4e7-7615-4aa7-8f55-a862964ce3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:46.166436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235f4e7-7615-4aa7-8f55-a862964ce3d8 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:46.166719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235f4e7-7615-4aa7-8f55-a862964ce3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:46.166993 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235f4e7-7615-4aa7-8f55-a862964ce3d8 None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:46.167727 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3235f4e7-7615-4aa7-8f55-a862964ce3d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:46.168036 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3235f4e7-7615-4aa7-8f55-a862964ce3d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:46.169418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3235f4e7-7615-4aa7-8f55-a862964ce3d8 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:46.170230 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca520f-c345-4eaa-88ae-c74d56ce8c06 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:46.177222 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 287/573] 10.222.0.23 () {56 vars in 1103 bytes} [Sat Apr 30 20:48:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:46.178519 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cac5f5-21c2-4f65-b192-7a55b7504d2b None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:46.178802 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cac5f5-21c2-4f65-b192-7a55b7504d2b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:46.179077 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cac5f5-21c2-4f65-b192-7a55b7504d2b None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:46.181358 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 288/574] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:46.181358 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cac5f5-21c2-4f65-b192-7a55b7504d2b None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:46.204990 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f1c72-4e6d-4feb-a10d-ee7b90375e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:46.205640 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f1c72-4e6d-4feb-a10d-ee7b90375e98 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:46.205938 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f1c72-4e6d-4feb-a10d-ee7b90375e98 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:46.206211 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f1c72-4e6d-4feb-a10d-ee7b90375e98 None admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:46.206986 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507f1c72-4e6d-4feb-a10d-ee7b90375e98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:46.207291 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507f1c72-4e6d-4feb-a10d-ee7b90375e98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:46.208717 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507f1c72-4e6d-4feb-a10d-ee7b90375e98 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:46.220307 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 287/575] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Apr 30 20:48:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:46.221086 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f1c72-4e6d-4feb-a10d-ee7b90375e98 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:46.279158 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cac5f5-21c2-4f65-b192-7a55b7504d2b None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:46.311106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03462ae3-c7a6-4f5d-9a12-c36e22d4acd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:46.311758 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03462ae3-c7a6-4f5d-9a12-c36e22d4acd8 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:46.312035 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03462ae3-c7a6-4f5d-9a12-c36e22d4acd8 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:46.312305 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03462ae3-c7a6-4f5d-9a12-c36e22d4acd8 None admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:46.313012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03462ae3-c7a6-4f5d-9a12-c36e22d4acd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:46.313103 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f1c72-4e6d-4feb-a10d-ee7b90375e98 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:46.313313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03462ae3-c7a6-4f5d-9a12-c36e22d4acd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:46.314707 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03462ae3-c7a6-4f5d-9a12-c36e22d4acd8 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:46.325944 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 289/576] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:48:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:46.327077 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03462ae3-c7a6-4f5d-9a12-c36e22d4acd8 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:46.346145 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de330f-7c46-4e3a-ac19-7cb153de6161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:46.346807 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de330f-7c46-4e3a-ac19-7cb153de6161 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:46.347089 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de330f-7c46-4e3a-ac19-7cb153de6161 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:46.347363 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de330f-7c46-4e3a-ac19-7cb153de6161 None admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:46.348140 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de330f-7c46-4e3a-ac19-7cb153de6161 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:46.348445 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de330f-7c46-4e3a-ac19-7cb153de6161 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:46.349919 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de330f-7c46-4e3a-ac19-7cb153de6161 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:46.360968 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 288/577] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Apr 30 20:48:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:46.362254 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3916566-5b89-41f2-aa92-fe0789d412a2 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:46.362526 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3916566-5b89-41f2-aa92-fe0789d412a2 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:46.362802 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3916566-5b89-41f2-aa92-fe0789d412a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:46.380107 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-a3916566-5b89-41f2-aa92-fe0789d412a2 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:46.381896 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a3916566-5b89-41f2-aa92-fe0789d412a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:46.421390 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03462ae3-c7a6-4f5d-9a12-c36e22d4acd8 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:46.447304 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 289/578] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:48:46.448140 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3916566-5b89-41f2-aa92-fe0789d412a2 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:46.458114 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638bf61-6e26-49d9-a305-51a1fa8c3f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:46.458906 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638bf61-6e26-49d9-a305-51a1fa8c3f0b None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:46.459188 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638bf61-6e26-49d9-a305-51a1fa8c3f0b None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:46.459464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638bf61-6e26-49d9-a305-51a1fa8c3f0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:46.469468 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0638bf61-6e26-49d9-a305-51a1fa8c3f0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:46.471420 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0638bf61-6e26-49d9-a305-51a1fa8c3f0b None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:46.489063 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-0638bf61-6e26-49d9-a305-51a1fa8c3f0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:46.489063 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:46.489063 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:46.489063 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:46.489063 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:46.489063 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:46.489063 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:46.489063 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:46.489063 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:46.489063 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:46.489063 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:46.489063 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:46.489063 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:48:46.489063 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:48:46.489063 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:48:46.490130 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:48:46.490130 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:46.490130 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:46.490130 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:46.490130 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:46.490130 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:46.490130 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:46.490130 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:46.490130 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:46.490130 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:46.490130 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:46.490130 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:46.490130 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:46.490130 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:46.490130 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:46.490130 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:46.490130 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:46.491142 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:48:46.491142 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:48:46.491142 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:46.491142 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:46.491142 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 290/579] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:48:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:46.491546 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638bf61-6e26-49d9-a305-51a1fa8c3f0b None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:46.541807 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3916566-5b89-41f2-aa92-fe0789d412a2 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:46.574531 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a315424-da09-491c-922c-fd9adcc93396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:46.575181 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a315424-da09-491c-922c-fd9adcc93396 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:46.575464 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a315424-da09-491c-922c-fd9adcc93396 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:46.575738 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a315424-da09-491c-922c-fd9adcc93396 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:46.576585 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a315424-da09-491c-922c-fd9adcc93396 None admin] RBAC: Adding query filter params (role.id=0971c8bf92d64c50a5cbbf7d146af841, scope.project.id=6b52e5e13b9144dfb663578766c2bac0, user.id=27edf527e36c4ee7a9065688f4bed942) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:46.576898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a315424-da09-491c-922c-fd9adcc93396 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:46.578395 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a315424-da09-491c-922c-fd9adcc93396 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:46.583650 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 290/580] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:48:46 2022] GET /identity/v3/role_assignments?user.id=27edf527e36c4ee7a9065688f4bed942&scope.project.id=6b52e5e13b9144dfb663578766c2bac0&role.id=0971c8bf92d64c50a5cbbf7d146af841 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:46.584398 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a315424-da09-491c-922c-fd9adcc93396 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:46.586026 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638bf61-6e26-49d9-a305-51a1fa8c3f0b None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:46.622097 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619548ce-6130-4808-bcec-504fb70e0744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:46.623583 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619548ce-6130-4808-bcec-504fb70e0744 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:46.623944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619548ce-6130-4808-bcec-504fb70e0744 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:46.624295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619548ce-6130-4808-bcec-504fb70e0744 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:46.632470 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619548ce-6130-4808-bcec-504fb70e0744 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:46.634027 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619548ce-6130-4808-bcec-504fb70e0744 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:46.650340 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-619548ce-6130-4808-bcec-504fb70e0744 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 30 20:48:46.650340 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:46.650340 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:46.650340 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:46.650340 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:46.650340 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:46.650340 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:46.650340 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:46.650340 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:46.650340 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:46.650340 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:46.650340 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:46.650340 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:48:46.650340 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:48:46.650340 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:48:46.650340 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:48:46.651579 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:46.651579 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:46.651579 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:48:46.651579 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:48:46.651579 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:48:46.651579 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:48:46.651579 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:46.651579 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:46.651579 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:46.651579 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:46.651579 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:46.651579 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:46.651579 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:46.651579 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:46.651579 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:46.651579 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:46.651579 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:46.651579 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:46.652764 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:46.652764 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:46.652764 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:48:46.652764 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:48:46.652764 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:48:46.652764 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:48:46.652764 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:48:46.652764 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:48:46.652764 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Apr 30 20:48:46.652764 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:46.659309 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 291/581] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:48:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:46.659309 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619548ce-6130-4808-bcec-504fb70e0744 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:46.695395 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a315424-da09-491c-922c-fd9adcc93396 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:46.729362 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c63ae8-6be1-4a10-8717-2fb6d73fca6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:46.730388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c63ae8-6be1-4a10-8717-2fb6d73fca6f None admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:46.730740 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c63ae8-6be1-4a10-8717-2fb6d73fca6f None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:46.731081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c63ae8-6be1-4a10-8717-2fb6d73fca6f None admin] PATH_INFO: `/v3/projects/6b52e5e13b9144dfb663578766c2bac0/users/fca4ee1f64c8489ebe7296f9f8f0ab41/roles/0971c8bf92d64c50a5cbbf7d146af841` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:46.747217 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c63ae8-6be1-4a10-8717-2fb6d73fca6f None admin] RBAC: Authorizing `identity:create_grant(project_id=6b52e5e13b9144dfb663578766c2bac0, user_id=fca4ee1f64c8489ebe7296f9f8f0ab41, role_id=0971c8bf92d64c50a5cbbf7d146af841)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:46.749353 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c63ae8-6be1-4a10-8717-2fb6d73fca6f None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:46.763392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619548ce-6130-4808-bcec-504fb70e0744 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:46.797546 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610be88d-ef2c-424b-aa71-4de6d847dd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:46.798295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610be88d-ef2c-424b-aa71-4de6d847dd21 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:46.798577 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610be88d-ef2c-424b-aa71-4de6d847dd21 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:46.798851 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610be88d-ef2c-424b-aa71-4de6d847dd21 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:46.808640 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610be88d-ef2c-424b-aa71-4de6d847dd21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:48:46.816451 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-610be88d-ef2c-424b-aa71-4de6d847dd21 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:48:46.816451 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:46.816451 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:46.816451 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:46.816451 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:46.816451 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:46.816451 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:46.816451 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:46.816451 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:46.816451 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:46.816451 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:46.816451 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:46.816451 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:48:46.816451 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:48:46.816451 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:48:46.816451 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:48:46.817605 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:48:46.817605 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:48:46.817605 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:48:46.817605 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:48:46.817605 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:46.817605 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:46.817605 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:46.817605 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:46.817605 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:46.817605 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:46.817605 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:46.817605 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:46.817605 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:46.817605 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:46.817605 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:46.817605 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:46.818675 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:46.818675 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:46.818675 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:46.818675 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:46.818675 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:48:46.818675 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:48:46.818675 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:48:46.818675 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:48:46.818675 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:48:46.818675 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:48:46.818675 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:48:46.818675 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:46.818675 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 292/582] 10.222.0.23 () {56 vars in 1102 bytes} [Sat Apr 30 20:48:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:46.819501 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610be88d-ef2c-424b-aa71-4de6d847dd21 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:46.828550 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 291/583] 10.222.0.23 () {58 vars in 1439 bytes} [Sat Apr 30 20:48:46 2022] PUT /identity/v3/projects/6b52e5e13b9144dfb663578766c2bac0/users/fca4ee1f64c8489ebe7296f9f8f0ab41/roles/0971c8bf92d64c50a5cbbf7d146af841 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:48:46.828550 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c63ae8-6be1-4a10-8717-2fb6d73fca6f None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:46.940176 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610be88d-ef2c-424b-aa71-4de6d847dd21 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:46.952098 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c63ae8-6be1-4a10-8717-2fb6d73fca6f None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:46.978242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5abd4-3478-492d-95c9-776256fc87e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:46.978927 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5abd4-3478-492d-95c9-776256fc87e8 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:46.979442 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5abd4-3478-492d-95c9-776256fc87e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:46.979558 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5abd4-3478-492d-95c9-776256fc87e8 None admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:46.980266 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c5abd4-3478-492d-95c9-776256fc87e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:46.980578 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c5abd4-3478-492d-95c9-776256fc87e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:46.982098 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c5abd4-3478-492d-95c9-776256fc87e8 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:46.991961 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b9a84-ab61-4a79-b2d4-ecdf468d6f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:46.992901 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b9a84-ab61-4a79-b2d4-ecdf468d6f92 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:46.993327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b9a84-ab61-4a79-b2d4-ecdf468d6f92 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:46.993942 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b9a84-ab61-4a79-b2d4-ecdf468d6f92 None admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:46.995044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b9a84-ab61-4a79-b2d4-ecdf468d6f92 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:46.995506 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b9a84-ab61-4a79-b2d4-ecdf468d6f92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:46.996551 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 293/584] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:48:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:46.997306 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b9a84-ab61-4a79-b2d4-ecdf468d6f92 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:46.997476 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5abd4-3478-492d-95c9-776256fc87e8 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:47.016353 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 292/585] 10.222.0.23 () {56 vars in 1137 bytes} [Sat Apr 30 20:48:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:47.017430 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b9a84-ab61-4a79-b2d4-ecdf468d6f92 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:47.118508 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5abd4-3478-492d-95c9-776256fc87e8 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:47.121613 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b9a84-ab61-4a79-b2d4-ecdf468d6f92 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:47.159724 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a51d8-a2f0-4a3d-8493-b553da1283d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:47.160512 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a51d8-a2f0-4a3d-8493-b553da1283d0 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:47.160787 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a51d8-a2f0-4a3d-8493-b553da1283d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:47.161057 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a51d8-a2f0-4a3d-8493-b553da1283d0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:47.166461 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387c645-85ba-43cb-b221-067a8c9adcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:47.167348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387c645-85ba-43cb-b221-067a8c9adcf1 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:47.167782 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387c645-85ba-43cb-b221-067a8c9adcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:47.168208 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387c645-85ba-43cb-b221-067a8c9adcf1 None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:47.169392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387c645-85ba-43cb-b221-067a8c9adcf1 None admin] RBAC: Adding query filter params (name=service) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:47.169510 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a51d8-a2f0-4a3d-8493-b553da1283d0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:47.170539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387c645-85ba-43cb-b221-067a8c9adcf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:47.171447 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a51d8-a2f0-4a3d-8493-b553da1283d0 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:47.172491 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387c645-85ba-43cb-b221-067a8c9adcf1 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:47.182317 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 294/586] 10.222.0.23 () {56 vars in 1103 bytes} [Sat Apr 30 20:48:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:47.183451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387c645-85ba-43cb-b221-067a8c9adcf1 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:47.185771 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-8f8a51d8-a2f0-4a3d-8493-b553da1283d0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 30 20:48:47.185771 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:47.185771 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:47.185771 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:47.185771 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:47.185771 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:47.185771 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:47.185771 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:47.185771 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:47.185771 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:47.185771 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:47.185771 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:47.185771 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:48:47.185771 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:48:47.185771 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:48:47.185771 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:48:47.186890 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:47.186890 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:47.186890 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:48:47.186890 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:48:47.186890 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:48:47.186890 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:48:47.186890 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:47.186890 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:47.186890 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:47.186890 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:47.186890 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:47.186890 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:47.186890 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:47.186890 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:47.186890 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:47.186890 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:47.186890 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:47.186890 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:47.187946 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:47.187946 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:47.187946 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:48:47.187946 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:48:47.187946 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:48:47.187946 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:48:47.187946 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:48:47.187946 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:48:47.187946 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Apr 30 20:48:47.187946 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:47.191608 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 293/587] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:48:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:47.192471 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a51d8-a2f0-4a3d-8493-b553da1283d0 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:47.296611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a51d8-a2f0-4a3d-8493-b553da1283d0 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:47.309273 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387c645-85ba-43cb-b221-067a8c9adcf1 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:47.332134 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b9428-fe2a-41c1-a8f9-7a46ac242de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:47.333022 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b9428-fe2a-41c1-a8f9-7a46ac242de0 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:47.333299 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b9428-fe2a-41c1-a8f9-7a46ac242de0 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:47.333569 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b9428-fe2a-41c1-a8f9-7a46ac242de0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:47.346301 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48642e2c-9014-45a5-a1d3-e2494fa989c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:47.347310 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48642e2c-9014-45a5-a1d3-e2494fa989c0 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:47.347746 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48642e2c-9014-45a5-a1d3-e2494fa989c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:47.348171 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48642e2c-9014-45a5-a1d3-e2494fa989c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:47.348721 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b9428-fe2a-41c1-a8f9-7a46ac242de0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:47.350237 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b9428-fe2a-41c1-a8f9-7a46ac242de0 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:47.360240 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48642e2c-9014-45a5-a1d3-e2494fa989c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:47.361941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48642e2c-9014-45a5-a1d3-e2494fa989c0 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:47.368008 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-127b9428-fe2a-41c1-a8f9-7a46ac242de0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:47.368008 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:47.368008 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:47.368008 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:47.368008 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:47.368008 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:47.368008 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:47.368008 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:47.368008 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:47.368008 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:47.368008 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:47.368008 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:47.368008 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:48:47.368008 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:48:47.368008 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:48:47.369121 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:48:47.369121 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:47.369121 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:47.369121 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:47.369121 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:47.369121 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:47.369121 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:47.369121 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:47.369121 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:47.369121 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:47.369121 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:47.369121 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:47.369121 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:47.369121 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:47.369121 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:47.369121 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:47.369121 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:47.370206 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:48:47.370206 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:48:47.370206 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:47.370206 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:47.374137 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 294/588] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:48:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:47.375008 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b9428-fe2a-41c1-a8f9-7a46ac242de0 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:47.382559 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-48642e2c-9014-45a5-a1d3-e2494fa989c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:47.382559 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:47.382559 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:47.382559 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:47.382559 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:47.382559 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:47.382559 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:47.382559 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:47.382559 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:47.382559 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:47.382559 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:47.382559 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:47.382559 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:48:47.382559 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:48:47.382559 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:48:47.383650 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:48:47.383650 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:47.383650 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:47.383650 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:47.383650 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:47.383650 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:47.383650 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:47.383650 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:47.383650 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:47.383650 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:47.383650 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:47.383650 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:47.383650 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:47.383650 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:47.383650 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:47.383650 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:47.383650 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:47.384616 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:48:47.384616 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:48:47.384616 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:47.384616 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:47.386420 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 295/589] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:48:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:47.387398 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48642e2c-9014-45a5-a1d3-e2494fa989c0 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:47.477137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b9428-fe2a-41c1-a8f9-7a46ac242de0 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:47.495164 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48642e2c-9014-45a5-a1d3-e2494fa989c0 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:47.510824 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992de1ca-cded-40a0-abb4-afefd666d999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:47.511489 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992de1ca-cded-40a0-abb4-afefd666d999 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:47.511767 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992de1ca-cded-40a0-abb4-afefd666d999 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:47.512038 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992de1ca-cded-40a0-abb4-afefd666d999 None admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:47.512855 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992de1ca-cded-40a0-abb4-afefd666d999 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:47.513162 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992de1ca-cded-40a0-abb4-afefd666d999 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:47.515337 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992de1ca-cded-40a0-abb4-afefd666d999 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:47.533224 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6f82e-70ff-4772-97fa-513366eade2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:47.537798 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 295/590] 10.222.0.23 () {56 vars in 1137 bytes} [Sat Apr 30 20:48:47 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:47.537798 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992de1ca-cded-40a0-abb4-afefd666d999 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:47.544253 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6f82e-70ff-4772-97fa-513366eade2d None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:47.544253 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6f82e-70ff-4772-97fa-513366eade2d None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:47.544253 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6f82e-70ff-4772-97fa-513366eade2d None admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:47.544253 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb6f82e-70ff-4772-97fa-513366eade2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:47.544253 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb6f82e-70ff-4772-97fa-513366eade2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:47.544253 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb6f82e-70ff-4772-97fa-513366eade2d None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:47.557006 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 296/591] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:48:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:47.558355 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6f82e-70ff-4772-97fa-513366eade2d None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:47.697143 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992de1ca-cded-40a0-abb4-afefd666d999 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:47.729910 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6f82e-70ff-4772-97fa-513366eade2d None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:47.733255 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44fa0d2-9146-4241-a32c-bb6573f77d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:47.733394 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fa0d2-9146-4241-a32c-bb6573f77d98 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:47.733586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fa0d2-9146-4241-a32c-bb6573f77d98 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:47.733878 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fa0d2-9146-4241-a32c-bb6573f77d98 None admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:47.734602 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44fa0d2-9146-4241-a32c-bb6573f77d98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:47.734908 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44fa0d2-9146-4241-a32c-bb6573f77d98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:47.736288 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44fa0d2-9146-4241-a32c-bb6573f77d98 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:47.752571 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 296/592] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:48:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:47.752571 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44fa0d2-9146-4241-a32c-bb6573f77d98 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:47.772305 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c2394-0d4a-482d-ab93-b5e630aa297b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:47.773886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c2394-0d4a-482d-ab93-b5e630aa297b None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:47.774409 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c2394-0d4a-482d-ab93-b5e630aa297b None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:47.774891 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c2394-0d4a-482d-ab93-b5e630aa297b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:47.786398 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c2394-0d4a-482d-ab93-b5e630aa297b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:47.788189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6c2394-0d4a-482d-ab93-b5e630aa297b None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:47.807641 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-9e6c2394-0d4a-482d-ab93-b5e630aa297b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:47.807641 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:47.807641 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:47.807641 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:47.807641 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:47.807641 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:47.807641 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:47.807641 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:47.807641 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:47.807641 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:47.807641 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:47.807641 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:47.807641 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:48:47.807641 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:48:47.807641 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:48:47.808618 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:48:47.808618 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:47.808618 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:47.808618 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:47.808618 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:47.808618 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:47.808618 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:47.808618 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:47.808618 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:47.808618 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:47.808618 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:47.808618 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:47.808618 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:47.808618 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:47.808618 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:47.808618 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:47.808618 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:47.809515 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:48:47.809515 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:48:47.809515 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:47.809515 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:47.811668 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 297/593] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:48:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:47.812846 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c2394-0d4a-482d-ab93-b5e630aa297b None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:47.857157 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44fa0d2-9146-4241-a32c-bb6573f77d98 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:47.891799 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d53d6-e8ef-415f-8922-22a91ca15060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:47.892596 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d53d6-e8ef-415f-8922-22a91ca15060 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:47.892877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d53d6-e8ef-415f-8922-22a91ca15060 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:47.893153 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d53d6-e8ef-415f-8922-22a91ca15060 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:47.902850 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d53d6-e8ef-415f-8922-22a91ca15060 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:47.905249 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d53d6-e8ef-415f-8922-22a91ca15060 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:47.923050 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-eb0d53d6-e8ef-415f-8922-22a91ca15060 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 30 20:48:47.923050 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:47.923050 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:47.923050 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:47.923050 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:47.923050 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:47.923050 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:47.923050 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:47.923050 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:47.923050 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:47.923050 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:47.923050 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:47.923050 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:48:47.923050 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:48:47.923050 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:48:47.923050 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:48:47.924027 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:47.924027 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:47.924027 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:48:47.924027 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:48:47.924027 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:48:47.924027 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:48:47.924027 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:47.924027 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:47.924027 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:47.924027 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:47.924027 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:47.924027 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:47.924027 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:47.924027 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:47.924027 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:47.924027 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:47.924027 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:47.924027 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:47.924966 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:47.924966 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:47.924966 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:48:47.924966 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:48:47.924966 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:48:47.924966 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:48:47.924966 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:48:47.924966 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:48:47.924966 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Apr 30 20:48:47.924966 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:47.925495 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6c2394-0d4a-482d-ab93-b5e630aa297b None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:47.931919 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 297/594] 10.222.0.23 () {56 vars in 1102 bytes} [Sat Apr 30 20:48:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:47.932969 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d53d6-e8ef-415f-8922-22a91ca15060 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:47.964647 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41ea7e-7cfb-4642-b0f8-37de51b6ec9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:47.965704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41ea7e-7cfb-4642-b0f8-37de51b6ec9b None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:47.966023 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41ea7e-7cfb-4642-b0f8-37de51b6ec9b None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:47.966303 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41ea7e-7cfb-4642-b0f8-37de51b6ec9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:47.979877 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b41ea7e-7cfb-4642-b0f8-37de51b6ec9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:47.981433 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b41ea7e-7cfb-4642-b0f8-37de51b6ec9b None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:47.995688 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-0b41ea7e-7cfb-4642-b0f8-37de51b6ec9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:48:47.995688 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:47.995688 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:47.995688 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:47.995688 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:47.995688 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:47.995688 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:47.995688 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:47.995688 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:47.995688 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:47.995688 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:47.995688 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:47.995688 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:48:47.995688 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:48:47.995688 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:48:47.996800 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:48:47.996800 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:47.996800 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:47.996800 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:47.996800 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:47.996800 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:47.996800 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:47.996800 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:47.996800 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:47.996800 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:47.996800 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:47.996800 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:47.996800 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:47.996800 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:47.996800 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:47.996800 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:47.996800 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:47.998032 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:48:47.998032 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:48:47.998032 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:48:47.998032 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:48:47.998032 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:48:47.998032 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:48:47.998032 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:48:47.998032 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:47.999184 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 298/595] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:48:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:48.004394 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41ea7e-7cfb-4642-b0f8-37de51b6ec9b None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:48.048275 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d53d6-e8ef-415f-8922-22a91ca15060 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:48.090267 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce709e9-8d20-4ed1-bb85-30de4a5cb69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:48.091281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce709e9-8d20-4ed1-bb85-30de4a5cb69d None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:48.092270 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce709e9-8d20-4ed1-bb85-30de4a5cb69d None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:48.092862 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce709e9-8d20-4ed1-bb85-30de4a5cb69d None admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:48.094384 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce709e9-8d20-4ed1-bb85-30de4a5cb69d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:48.098081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce709e9-8d20-4ed1-bb85-30de4a5cb69d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:48.100325 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce709e9-8d20-4ed1-bb85-30de4a5cb69d None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:48.121990 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 298/596] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:48:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:48.123477 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce709e9-8d20-4ed1-bb85-30de4a5cb69d None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:48.129000 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41ea7e-7cfb-4642-b0f8-37de51b6ec9b None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:48.165966 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da625123-4d2c-4c12-a0b3-f639c8683903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:48.167646 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da625123-4d2c-4c12-a0b3-f639c8683903 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:48.168149 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da625123-4d2c-4c12-a0b3-f639c8683903 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:48.168535 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da625123-4d2c-4c12-a0b3-f639c8683903 None admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:48.169509 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da625123-4d2c-4c12-a0b3-f639c8683903 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:48.169973 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da625123-4d2c-4c12-a0b3-f639c8683903 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:48.171529 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da625123-4d2c-4c12-a0b3-f639c8683903 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:48.205025 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 299/597] 10.222.0.23 () {56 vars in 1139 bytes} [Sat Apr 30 20:48:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:48.205025 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da625123-4d2c-4c12-a0b3-f639c8683903 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:48.234397 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce709e9-8d20-4ed1-bb85-30de4a5cb69d None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:48.279806 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941221ef-58f6-4318-9f94-d2ac5d96d545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:48.280664 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941221ef-58f6-4318-9f94-d2ac5d96d545 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:48.281129 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941221ef-58f6-4318-9f94-d2ac5d96d545 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:48.281558 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941221ef-58f6-4318-9f94-d2ac5d96d545 None admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:48.282528 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941221ef-58f6-4318-9f94-d2ac5d96d545 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:48.283003 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941221ef-58f6-4318-9f94-d2ac5d96d545 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:48.284617 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941221ef-58f6-4318-9f94-d2ac5d96d545 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:48.298241 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 299/598] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Apr 30 20:48:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:48.299273 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941221ef-58f6-4318-9f94-d2ac5d96d545 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:48.314418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da625123-4d2c-4c12-a0b3-f639c8683903 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:48.351153 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b5c023-28c8-45f1-a8f8-c7571442e9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:48.352131 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5c023-28c8-45f1-a8f8-c7571442e9bc None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:48.352515 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5c023-28c8-45f1-a8f8-c7571442e9bc None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:48.352948 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5c023-28c8-45f1-a8f8-c7571442e9bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:48.361194 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b5c023-28c8-45f1-a8f8-c7571442e9bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:48.363065 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b5c023-28c8-45f1-a8f8-c7571442e9bc None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:48.377312 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-08b5c023-28c8-45f1-a8f8-c7571442e9bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:48:48.377312 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:48.377312 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:48.377312 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:48.377312 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:48.377312 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:48.377312 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:48.377312 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:48.377312 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:48.377312 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:48.377312 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:48.377312 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:48.377312 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:48:48.377312 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:48:48.377312 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:48:48.380229 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:48:48.380229 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:48.380229 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:48.380229 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:48.380229 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:48.380229 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:48.380229 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:48.380229 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:48.380229 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:48.380229 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:48.380229 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:48.380229 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:48.380229 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:48.380229 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:48.380229 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:48.380229 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:48.380229 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:48.381332 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:48:48.381332 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:48:48.381332 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:48:48.381332 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:48:48.381332 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:48:48.381332 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:48:48.381332 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:48:48.381332 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:48.381332 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 300/599] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:48:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:48.382397 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b5c023-28c8-45f1-a8f8-c7571442e9bc None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:48.406034 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941221ef-58f6-4318-9f94-d2ac5d96d545 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:48.440244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd6701-8681-4597-af49-ee45e35852ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:48.441279 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd6701-8681-4597-af49-ee45e35852ad None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:48.441736 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd6701-8681-4597-af49-ee45e35852ad None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:48.442206 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd6701-8681-4597-af49-ee45e35852ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:48.453509 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd6701-8681-4597-af49-ee45e35852ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:48.455196 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd6701-8681-4597-af49-ee45e35852ad None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:48.473610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-21bd6701-8681-4597-af49-ee45e35852ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:48.473610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:48.473610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:48.473610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:48.473610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:48.473610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:48.473610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:48.473610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:48.473610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:48.473610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:48.473610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:48.473610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:48.473610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:48:48.473610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:48:48.473610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:48:48.474761 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:48:48.474761 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:48.474761 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:48.474761 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:48.474761 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:48.474761 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:48.474761 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:48.474761 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:48.474761 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:48.474761 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:48.474761 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:48.474761 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:48.474761 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:48.474761 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:48.474761 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:48.474761 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:48.474761 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:48.475859 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:48:48.475859 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:48:48.475859 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:48.475859 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:48.477805 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 300/600] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:48:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:48.479406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd6701-8681-4597-af49-ee45e35852ad None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:48.501549 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b5c023-28c8-45f1-a8f8-c7571442e9bc None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:48.546066 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c311af-147a-490c-ad8e-a0e0e7e65f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:48.547085 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c311af-147a-490c-ad8e-a0e0e7e65f79 None admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:48.547289 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c311af-147a-490c-ad8e-a0e0e7e65f79 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:48.547570 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c311af-147a-490c-ad8e-a0e0e7e65f79 None admin] PATH_INFO: `/v3/projects/6b52e5e13b9144dfb663578766c2bac0/users/e302b1298dd04d6590e3d079f7b13b29/roles/0971c8bf92d64c50a5cbbf7d146af841` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:48.563027 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c311af-147a-490c-ad8e-a0e0e7e65f79 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b52e5e13b9144dfb663578766c2bac0, user_id=e302b1298dd04d6590e3d079f7b13b29, role_id=0971c8bf92d64c50a5cbbf7d146af841)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:48.564514 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c311af-147a-490c-ad8e-a0e0e7e65f79 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:48.592642 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd6701-8681-4597-af49-ee45e35852ad None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:48.626201 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd23f80-1651-44d7-b481-1f232a4dc71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:48.626863 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd23f80-1651-44d7-b481-1f232a4dc71a None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:48.627148 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd23f80-1651-44d7-b481-1f232a4dc71a None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:48.627428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd23f80-1651-44d7-b481-1f232a4dc71a None admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:48.628213 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd23f80-1651-44d7-b481-1f232a4dc71a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:48.628521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd23f80-1651-44d7-b481-1f232a4dc71a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:48.630032 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd23f80-1651-44d7-b481-1f232a4dc71a None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:48.642387 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 301/601] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Apr 30 20:48:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:48.643236 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd23f80-1651-44d7-b481-1f232a4dc71a None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:48.650125 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 301/602] 10.222.0.23 () {58 vars in 1439 bytes} [Sat Apr 30 20:48:48 2022] PUT /identity/v3/projects/6b52e5e13b9144dfb663578766c2bac0/users/e302b1298dd04d6590e3d079f7b13b29/roles/0971c8bf92d64c50a5cbbf7d146af841 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:48:48.650931 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c311af-147a-490c-ad8e-a0e0e7e65f79 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:48.762233 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd23f80-1651-44d7-b481-1f232a4dc71a None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:48.775938 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c311af-147a-490c-ad8e-a0e0e7e65f79 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:48.811206 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9f065-b4f2-418f-b94b-0735d93f62ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:48.812417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9f065-b4f2-418f-b94b-0735d93f62ca None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:48.813344 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9f065-b4f2-418f-b94b-0735d93f62ca None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:48.813826 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9f065-b4f2-418f-b94b-0735d93f62ca None admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:48.815032 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9f065-b4f2-418f-b94b-0735d93f62ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:48.815531 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9f065-b4f2-418f-b94b-0735d93f62ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:48.818822 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9f065-b4f2-418f-b94b-0735d93f62ca None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:48.822364 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fbd2e8-b35e-4055-88fc-fb4b8e3675a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:48.823342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fbd2e8-b35e-4055-88fc-fb4b8e3675a9 None admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:48.823748 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fbd2e8-b35e-4055-88fc-fb4b8e3675a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:48.824130 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fbd2e8-b35e-4055-88fc-fb4b8e3675a9 None admin] PATH_INFO: `/v3/projects/6b52e5e13b9144dfb663578766c2bac0/users/f3dc7765f32c4b00a7e41f2754b9595b/roles/0971c8bf92d64c50a5cbbf7d146af841` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:48.837698 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 302/603] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:48:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:48.850947 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fbd2e8-b35e-4055-88fc-fb4b8e3675a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b52e5e13b9144dfb663578766c2bac0, user_id=f3dc7765f32c4b00a7e41f2754b9595b, role_id=0971c8bf92d64c50a5cbbf7d146af841)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:48.852682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fbd2e8-b35e-4055-88fc-fb4b8e3675a9 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:48.855255 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9f065-b4f2-418f-b94b-0735d93f62ca None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:48.987564 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9f065-b4f2-418f-b94b-0735d93f62ca None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:49.003045 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 302/604] 10.222.0.23 () {58 vars in 1439 bytes} [Sat Apr 30 20:48:48 2022] PUT /identity/v3/projects/6b52e5e13b9144dfb663578766c2bac0/users/f3dc7765f32c4b00a7e41f2754b9595b/roles/0971c8bf92d64c50a5cbbf7d146af841 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:48:49.004365 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a95a9-2ad5-4821-bc24-ba5fb1b17c41 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:49.004658 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a95a9-2ad5-4821-bc24-ba5fb1b17c41 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:49.004940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a95a9-2ad5-4821-bc24-ba5fb1b17c41 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:49.006320 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 303/605] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:49.014055 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6f2db-a22e-40fc-8519-351851a0347d None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:49.014228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6f2db-a22e-40fc-8519-351851a0347d None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:49.014493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6f2db-a22e-40fc-8519-351851a0347d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:49.034524 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-6ee6f2db-a22e-40fc-8519-351851a0347d None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:49.035776 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6ee6f2db-a22e-40fc-8519-351851a0347d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:49.047458 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111f951-ef55-426a-9ff0-e659f1357c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:49.048262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111f951-ef55-426a-9ff0-e659f1357c5b None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:49.048545 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111f951-ef55-426a-9ff0-e659f1357c5b None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:49.048822 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111f951-ef55-426a-9ff0-e659f1357c5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:49.063075 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111f951-ef55-426a-9ff0-e659f1357c5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:49.064574 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111f951-ef55-426a-9ff0-e659f1357c5b None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:49.083941 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-8111f951-ef55-426a-9ff0-e659f1357c5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:48:49.083941 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:49.083941 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:49.083941 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:49.083941 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:49.083941 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:49.083941 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:49.083941 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:49.083941 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:49.083941 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:49.083941 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:49.083941 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:49.083941 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:48:49.083941 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:48:49.083941 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:48:49.084921 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:48:49.084921 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:49.084921 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:49.084921 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:49.084921 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:49.084921 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:49.084921 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:49.084921 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:49.084921 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:49.084921 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:49.084921 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:49.084921 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:49.084921 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:49.084921 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:49.084921 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:49.084921 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:49.084921 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:49.085823 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:48:49.085823 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:48:49.085823 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:48:49.085823 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:48:49.085823 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:48:49.085823 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:48:49.085823 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:48:49.085823 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:49.085823 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 303/606] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:48:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:48:49.090802 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111f951-ef55-426a-9ff0-e659f1357c5b None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:49.121964 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 304/607] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:48:49.150548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6f2db-a22e-40fc-8519-351851a0347d None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:49.291701 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111f951-ef55-426a-9ff0-e659f1357c5b None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:49.302434 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6f2db-a22e-40fc-8519-351851a0347d None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:49.327160 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d370d-ff1f-4028-b13b-d98f32626a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:49.327662 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d370d-ff1f-4028-b13b-d98f32626a06 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:49.327942 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d370d-ff1f-4028-b13b-d98f32626a06 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:49.328213 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d370d-ff1f-4028-b13b-d98f32626a06 None admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:49.328993 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d370d-ff1f-4028-b13b-d98f32626a06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:49.329605 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d370d-ff1f-4028-b13b-d98f32626a06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:49.330787 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d370d-ff1f-4028-b13b-d98f32626a06 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:49.342760 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 304/608] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Apr 30 20:48:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:49.344329 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c4478-fef2-4311-812b-cba6e9ad7cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:49.345647 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c4478-fef2-4311-812b-cba6e9ad7cf1 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:49.346164 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c4478-fef2-4311-812b-cba6e9ad7cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:49.346666 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c4478-fef2-4311-812b-cba6e9ad7cf1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:49.348685 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d370d-ff1f-4028-b13b-d98f32626a06 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:49.358232 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c4478-fef2-4311-812b-cba6e9ad7cf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:48:49.366473 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-0a6c4478-fef2-4311-812b-cba6e9ad7cf1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:48:49.366473 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:49.366473 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:49.366473 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:49.366473 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:49.366473 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:49.366473 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:49.366473 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:49.366473 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:49.366473 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:49.366473 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:49.366473 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:49.366473 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:48:49.366473 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:48:49.366473 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:48:49.366473 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:48:49.367503 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:48:49.367503 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:48:49.367503 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:48:49.367503 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:48:49.367503 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:49.367503 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:49.367503 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:49.367503 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:49.367503 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:49.367503 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:49.367503 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:49.367503 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:49.367503 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:49.367503 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:49.367503 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:49.367503 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:49.368334 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:49.368334 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:49.368334 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:49.368334 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:49.368334 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:48:49.368334 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:48:49.368334 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:48:49.368334 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:48:49.368334 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:48:49.368334 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:48:49.368334 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:48:49.368334 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:49.373858 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 305/609] 10.222.0.23 () {56 vars in 1102 bytes} [Sat Apr 30 20:48:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:48:49.377637 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c4478-fef2-4311-812b-cba6e9ad7cf1 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:49.449052 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d370d-ff1f-4028-b13b-d98f32626a06 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:49.480359 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c4478-fef2-4311-812b-cba6e9ad7cf1 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:49.487397 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fa232-64ee-4e4a-bb79-7fd745ffbbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:49.488285 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fa232-64ee-4e4a-bb79-7fd745ffbbd9 None admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:49.488564 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fa232-64ee-4e4a-bb79-7fd745ffbbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:49.488931 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fa232-64ee-4e4a-bb79-7fd745ffbbd9 None admin] PATH_INFO: `/v3/projects/6b52e5e13b9144dfb663578766c2bac0/users/0b0cb145b72a492ebb8c0e9223be47a1/roles/0971c8bf92d64c50a5cbbf7d146af841` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:49.505314 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fa232-64ee-4e4a-bb79-7fd745ffbbd9 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b52e5e13b9144dfb663578766c2bac0, user_id=0b0cb145b72a492ebb8c0e9223be47a1, role_id=0971c8bf92d64c50a5cbbf7d146af841)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:49.506916 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fa232-64ee-4e4a-bb79-7fd745ffbbd9 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:49.519129 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953e01b-5332-46b8-b866-425c7738d1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:49.519965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953e01b-5332-46b8-b866-425c7738d1cf None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:49.520330 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953e01b-5332-46b8-b866-425c7738d1cf None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:49.520673 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953e01b-5332-46b8-b866-425c7738d1cf None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:49.521559 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953e01b-5332-46b8-b866-425c7738d1cf None admin] RBAC: Adding query filter params (name=service) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:49.521978 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953e01b-5332-46b8-b866-425c7738d1cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:49.523489 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953e01b-5332-46b8-b866-425c7738d1cf None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:49.532142 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 306/610] 10.222.0.23 () {56 vars in 1103 bytes} [Sat Apr 30 20:48:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:48:49.535189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd2211-3c12-4de9-81b9-be1f195e1738 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:49.535710 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd2211-3c12-4de9-81b9-be1f195e1738 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:49.536222 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd2211-3c12-4de9-81b9-be1f195e1738 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:49.537714 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 307/611] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:49.538837 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd2211-3c12-4de9-81b9-be1f195e1738 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:49.637786 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 305/612] 10.222.0.23 () {58 vars in 1439 bytes} [Sat Apr 30 20:48:49 2022] PUT /identity/v3/projects/6b52e5e13b9144dfb663578766c2bac0/users/0b0cb145b72a492ebb8c0e9223be47a1/roles/0971c8bf92d64c50a5cbbf7d146af841 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:48:49.639982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178780c1-eb30-488d-a3a9-1d96725ecfb9 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:49.640500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178780c1-eb30-488d-a3a9-1d96725ecfb9 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:49.640977 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178780c1-eb30-488d-a3a9-1d96725ecfb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:49.646986 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd2211-3c12-4de9-81b9-be1f195e1738 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:49.678958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-178780c1-eb30-488d-a3a9-1d96725ecfb9 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:49.680199 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-178780c1-eb30-488d-a3a9-1d96725ecfb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:49.721106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1f578-1505-43f2-9fe4-e9fc1839515c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:49.721950 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1f578-1505-43f2-9fe4-e9fc1839515c None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:49.722235 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1f578-1505-43f2-9fe4-e9fc1839515c None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:49.722511 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1f578-1505-43f2-9fe4-e9fc1839515c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:49.739413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1f578-1505-43f2-9fe4-e9fc1839515c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:49.742046 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1f578-1505-43f2-9fe4-e9fc1839515c None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:49.766699 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-b2c1f578-1505-43f2-9fe4-e9fc1839515c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:49.766699 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:49.766699 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:49.766699 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:49.766699 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:49.766699 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:49.766699 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:49.766699 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:49.766699 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:49.766699 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:49.766699 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:49.766699 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:49.766699 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:48:49.766699 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:48:49.766699 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:48:49.767666 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:48:49.767666 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:49.767666 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:49.767666 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:49.767666 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:49.767666 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:49.767666 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:49.767666 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:49.767666 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:49.767666 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:49.767666 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:49.767666 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:49.767666 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:49.767666 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:49.767666 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:49.767666 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:49.767666 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:49.768550 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:48:49.768550 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:48:49.768550 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:49.768550 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:49.771383 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 308/613] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:48:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:49.781439 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1f578-1505-43f2-9fe4-e9fc1839515c None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:49.869301 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 306/614] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:48:49.894387 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178780c1-eb30-488d-a3a9-1d96725ecfb9 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:49.902930 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1f578-1505-43f2-9fe4-e9fc1839515c None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:49.951495 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5a8ca-4087-45bc-9abb-bc9bbd4e8010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:49.952377 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5a8ca-4087-45bc-9abb-bc9bbd4e8010 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:49.952692 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5a8ca-4087-45bc-9abb-bc9bbd4e8010 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:49.952972 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c5a8ca-4087-45bc-9abb-bc9bbd4e8010 None admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:49.953706 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c5a8ca-4087-45bc-9abb-bc9bbd4e8010 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:49.954053 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c5a8ca-4087-45bc-9abb-bc9bbd4e8010 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:49.955456 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c5a8ca-4087-45bc-9abb-bc9bbd4e8010 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:49.973482 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 309/615] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:48:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:49.974730 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5a8ca-4087-45bc-9abb-bc9bbd4e8010 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:50.024262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178780c1-eb30-488d-a3a9-1d96725ecfb9 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:50.070606 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970254f8-61e4-483e-a346-e107279a6aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:50.071415 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970254f8-61e4-483e-a346-e107279a6aa2 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:50.071690 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970254f8-61e4-483e-a346-e107279a6aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:50.071961 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970254f8-61e4-483e-a346-e107279a6aa2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:50.097126 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970254f8-61e4-483e-a346-e107279a6aa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:48:50.104853 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-970254f8-61e4-483e-a346-e107279a6aa2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:48:50.104853 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:50.104853 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:50.104853 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:50.104853 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:50.104853 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:50.104853 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:50.104853 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:50.104853 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:50.104853 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:50.104853 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:50.104853 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:50.104853 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:48:50.104853 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:48:50.104853 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:48:50.104853 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:48:50.105795 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:48:50.105795 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:48:50.105795 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:48:50.105795 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:48:50.105795 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:50.105795 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:50.105795 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:50.105795 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:50.105795 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:50.105795 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:50.105795 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:50.105795 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:50.105795 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:50.105795 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:50.105795 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:50.105795 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:50.106642 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:50.106642 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:50.106642 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:50.106642 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:50.106642 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:48:50.106642 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:48:50.106642 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:48:50.106642 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:48:50.106642 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:48:50.106642 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:48:50.106642 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:48:50.106642 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:50.115574 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 307/616] 10.222.0.23 () {56 vars in 1102 bytes} [Sat Apr 30 20:48:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:48:50.120726 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c5a8ca-4087-45bc-9abb-bc9bbd4e8010 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:50.120957 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970254f8-61e4-483e-a346-e107279a6aa2 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:50.193289 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b27ca-91d5-4549-921e-1d0f03526c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:50.194096 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b27ca-91d5-4549-921e-1d0f03526c03 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:50.194377 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b27ca-91d5-4549-921e-1d0f03526c03 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:50.194648 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b27ca-91d5-4549-921e-1d0f03526c03 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:50.209904 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b27ca-91d5-4549-921e-1d0f03526c03 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:50.211358 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b27ca-91d5-4549-921e-1d0f03526c03 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:50.238042 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-9c9b27ca-91d5-4549-921e-1d0f03526c03 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 30 20:48:50.238042 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:50.238042 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:50.238042 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:50.238042 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:50.238042 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:50.238042 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:50.238042 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:50.238042 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:50.238042 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:50.238042 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:50.238042 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:50.238042 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:48:50.238042 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:48:50.238042 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:48:50.238042 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:48:50.240250 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:50.240250 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:50.240250 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:48:50.240250 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:48:50.240250 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:48:50.240250 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:48:50.240250 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:50.240250 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:50.240250 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:50.240250 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:50.240250 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:50.240250 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:50.240250 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:50.240250 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:50.240250 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:50.240250 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:50.240250 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:50.240250 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:50.242602 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:50.242602 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:50.242602 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:48:50.242602 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:48:50.242602 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:48:50.242602 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:48:50.242602 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:48:50.242602 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:48:50.242602 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Apr 30 20:48:50.242602 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:50.242602 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 310/617] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Apr 30 20:48:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:50.249718 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b27ca-91d5-4549-921e-1d0f03526c03 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:50.283579 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970254f8-61e4-483e-a346-e107279a6aa2 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:50.351809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4729411-fecc-4762-b524-bfeec6c303ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:50.352484 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4729411-fecc-4762-b524-bfeec6c303ba None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:50.352764 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4729411-fecc-4762-b524-bfeec6c303ba None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:50.353034 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4729411-fecc-4762-b524-bfeec6c303ba None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:50.353790 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4729411-fecc-4762-b524-bfeec6c303ba None admin] RBAC: Adding query filter params (name=service) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:50.354097 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4729411-fecc-4762-b524-bfeec6c303ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:50.355471 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4729411-fecc-4762-b524-bfeec6c303ba None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:50.373729 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 308/618] 10.222.0.23 () {56 vars in 1103 bytes} [Sat Apr 30 20:48:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:48:50.379104 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4729411-fecc-4762-b524-bfeec6c303ba None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:50.395227 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b27ca-91d5-4549-921e-1d0f03526c03 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:50.430536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95b188-2b1c-438c-a3ff-91313591b302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:50.431219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95b188-2b1c-438c-a3ff-91313591b302 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:50.431501 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95b188-2b1c-438c-a3ff-91313591b302 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:50.431779 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95b188-2b1c-438c-a3ff-91313591b302 None admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:50.432620 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95b188-2b1c-438c-a3ff-91313591b302 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:50.432931 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95b188-2b1c-438c-a3ff-91313591b302 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:50.434415 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95b188-2b1c-438c-a3ff-91313591b302 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:50.457266 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 311/619] 10.222.0.23 () {56 vars in 1135 bytes} [Sat Apr 30 20:48:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:50.458575 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95b188-2b1c-438c-a3ff-91313591b302 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:50.479981 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4729411-fecc-4762-b524-bfeec6c303ba None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:50.533983 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f2dae4-6f51-45bb-8795-ca7a7a42082b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:50.536108 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2dae4-6f51-45bb-8795-ca7a7a42082b None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:50.536389 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2dae4-6f51-45bb-8795-ca7a7a42082b None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:50.536665 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2dae4-6f51-45bb-8795-ca7a7a42082b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:50.583884 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f2dae4-6f51-45bb-8795-ca7a7a42082b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:50.586200 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f2dae4-6f51-45bb-8795-ca7a7a42082b None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:50.599817 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95b188-2b1c-438c-a3ff-91313591b302 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:50.615831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-00f2dae4-6f51-45bb-8795-ca7a7a42082b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:50.615831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:50.615831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:50.615831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:50.615831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:50.615831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:50.615831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:50.615831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:50.615831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:50.615831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:50.615831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:50.615831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:50.615831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:48:50.615831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:48:50.615831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:48:50.618358 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:48:50.618358 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:50.618358 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:50.618358 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:50.618358 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:50.618358 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:50.618358 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:50.618358 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:50.618358 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:50.618358 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:50.618358 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:50.618358 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:50.618358 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:50.618358 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:50.618358 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:50.618358 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:50.618358 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:50.620514 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:48:50.620514 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:48:50.620514 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:50.620514 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:50.620514 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 309/620] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:48:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:48:50.626990 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f2dae4-6f51-45bb-8795-ca7a7a42082b None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:50.638155 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ea739-fca3-49dc-85a6-55b644791abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:50.639573 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ea739-fca3-49dc-85a6-55b644791abc None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:50.639854 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ea739-fca3-49dc-85a6-55b644791abc None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:50.640128 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ea739-fca3-49dc-85a6-55b644791abc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:50.650616 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ea739-fca3-49dc-85a6-55b644791abc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:50.652125 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ea739-fca3-49dc-85a6-55b644791abc None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:50.669805 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-456ea739-fca3-49dc-85a6-55b644791abc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:50.669805 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:50.669805 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:50.669805 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:50.669805 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:50.669805 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:50.669805 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:50.669805 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:50.669805 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:50.669805 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:50.669805 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:50.669805 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:50.669805 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:48:50.669805 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:48:50.669805 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:48:50.671808 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:48:50.671808 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:50.671808 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:50.671808 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:50.671808 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:50.671808 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:50.671808 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:50.671808 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:50.671808 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:50.671808 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:50.671808 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:50.671808 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:50.671808 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:50.671808 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:50.671808 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:50.671808 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:50.671808 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:50.673942 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:48:50.673942 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:48:50.673942 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:50.673942 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:50.678007 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 312/621] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:48:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:50.678822 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ea739-fca3-49dc-85a6-55b644791abc None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:50.798866 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f2dae4-6f51-45bb-8795-ca7a7a42082b None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:50.840109 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ea739-fca3-49dc-85a6-55b644791abc None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:50.842244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09232d7c-72b7-4055-b642-1943e82da0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:50.842917 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09232d7c-72b7-4055-b642-1943e82da0ca None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:50.843197 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09232d7c-72b7-4055-b642-1943e82da0ca None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:50.843479 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09232d7c-72b7-4055-b642-1943e82da0ca None admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:50.844202 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09232d7c-72b7-4055-b642-1943e82da0ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:50.844508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09232d7c-72b7-4055-b642-1943e82da0ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:50.846195 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09232d7c-72b7-4055-b642-1943e82da0ca None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:50.870445 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 310/622] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:48:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:48:50.877600 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09232d7c-72b7-4055-b642-1943e82da0ca None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:50.908352 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1126d-7793-41fb-b2f9-a4a05a94f6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:50.909030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1126d-7793-41fb-b2f9-a4a05a94f6a1 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:50.909313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1126d-7793-41fb-b2f9-a4a05a94f6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:50.909589 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1126d-7793-41fb-b2f9-a4a05a94f6a1 None admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:50.910343 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1126d-7793-41fb-b2f9-a4a05a94f6a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:50.910676 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1126d-7793-41fb-b2f9-a4a05a94f6a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:50.912031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1126d-7793-41fb-b2f9-a4a05a94f6a1 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:50.933790 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 313/623] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:48:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:48:50.939002 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1126d-7793-41fb-b2f9-a4a05a94f6a1 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:51.023471 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09232d7c-72b7-4055-b642-1943e82da0ca None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:51.041361 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1126d-7793-41fb-b2f9-a4a05a94f6a1 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:51.078142 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f601b-6a9f-40dd-9ef1-4223d3148ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:51.078933 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f601b-6a9f-40dd-9ef1-4223d3148ea4 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:51.079218 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f601b-6a9f-40dd-9ef1-4223d3148ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:51.079496 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f601b-6a9f-40dd-9ef1-4223d3148ea4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:51.080612 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6cd28e-66d7-4cf3-8401-2911513a2d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:51.081423 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6cd28e-66d7-4cf3-8401-2911513a2d24 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:51.081703 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6cd28e-66d7-4cf3-8401-2911513a2d24 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:51.082052 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6cd28e-66d7-4cf3-8401-2911513a2d24 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:51.090652 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f601b-6a9f-40dd-9ef1-4223d3148ea4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:51.092157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f601b-6a9f-40dd-9ef1-4223d3148ea4 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:51.098313 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6cd28e-66d7-4cf3-8401-2911513a2d24 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:51.099761 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6cd28e-66d7-4cf3-8401-2911513a2d24 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:51.119272 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-372f601b-6a9f-40dd-9ef1-4223d3148ea4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:48:51.119272 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:51.119272 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:51.119272 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:51.119272 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:51.119272 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:51.119272 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:51.119272 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:51.119272 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:51.119272 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:51.119272 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:51.119272 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:51.119272 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:48:51.119272 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:48:51.119272 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:48:51.120223 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:48:51.120223 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:51.120223 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:51.120223 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:51.120223 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:51.120223 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:51.120223 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:51.120223 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:51.120223 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:51.120223 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:51.120223 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:51.120223 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:51.120223 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:51.120223 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:51.120223 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:51.120223 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:51.120223 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:51.121122 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:48:51.121122 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:48:51.121122 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:48:51.121122 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:48:51.121122 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:48:51.121122 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:48:51.121122 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:48:51.121122 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:51.121122 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 314/624] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:48:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:48:51.129523 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-aa6cd28e-66d7-4cf3-8401-2911513a2d24 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 30 20:48:51.129523 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:51.129523 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:51.129523 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:51.129523 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:51.129523 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:51.129523 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:51.129523 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:51.129523 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:51.129523 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:51.129523 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:51.129523 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:51.129523 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:48:51.129523 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:48:51.129523 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:48:51.129523 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:48:51.131724 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:51.131724 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:51.131724 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:48:51.131724 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:48:51.131724 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:48:51.131724 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:48:51.131724 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:51.131724 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:51.131724 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:51.131724 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:51.131724 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:51.131724 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:51.131724 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:51.131724 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:51.131724 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:51.131724 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:51.131724 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:51.131724 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:51.133974 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:51.133974 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:51.133974 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:48:51.133974 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:48:51.133974 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:48:51.133974 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:48:51.133974 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:48:51.133974 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:48:51.133974 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Apr 30 20:48:51.133974 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:51.133974 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 311/625] 10.222.0.23 () {56 vars in 1093 bytes} [Sat Apr 30 20:48:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:51.135326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f601b-6a9f-40dd-9ef1-4223d3148ea4 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:51.141120 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6cd28e-66d7-4cf3-8401-2911513a2d24 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:51.266465 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f601b-6a9f-40dd-9ef1-4223d3148ea4 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:51.283642 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6cd28e-66d7-4cf3-8401-2911513a2d24 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:51.315363 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a370dbe-0d00-4282-8bb0-1ccfb71ff77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:51.316038 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a370dbe-0d00-4282-8bb0-1ccfb71ff77d None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:51.316329 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a370dbe-0d00-4282-8bb0-1ccfb71ff77d None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:51.316606 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a370dbe-0d00-4282-8bb0-1ccfb71ff77d None admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:51.317398 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a370dbe-0d00-4282-8bb0-1ccfb71ff77d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:51.317709 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a370dbe-0d00-4282-8bb0-1ccfb71ff77d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:51.320211 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a370dbe-0d00-4282-8bb0-1ccfb71ff77d None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:51.324321 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201e205-316d-476d-a287-87eb1565cbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:51.328480 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201e205-316d-476d-a287-87eb1565cbb3 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:51.328480 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201e205-316d-476d-a287-87eb1565cbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:51.328480 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201e205-316d-476d-a287-87eb1565cbb3 None admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:51.328480 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2201e205-316d-476d-a287-87eb1565cbb3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:51.328480 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2201e205-316d-476d-a287-87eb1565cbb3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:51.328480 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2201e205-316d-476d-a287-87eb1565cbb3 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:51.349163 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 312/626] 10.222.0.23 () {56 vars in 1133 bytes} [Sat Apr 30 20:48:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:51.356270 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201e205-316d-476d-a287-87eb1565cbb3 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:51.360128 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 315/627] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Apr 30 20:48:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:51.369344 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a370dbe-0d00-4282-8bb0-1ccfb71ff77d None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:51.481794 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a370dbe-0d00-4282-8bb0-1ccfb71ff77d None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:51.498094 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201e205-316d-476d-a287-87eb1565cbb3 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:51.516094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef106a52-7aaa-4edd-b21e-667c6a40c4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:51.517222 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef106a52-7aaa-4edd-b21e-667c6a40c4e6 None admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:51.517700 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef106a52-7aaa-4edd-b21e-667c6a40c4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:51.518173 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef106a52-7aaa-4edd-b21e-667c6a40c4e6 None admin] PATH_INFO: `/v3/projects/6b52e5e13b9144dfb663578766c2bac0/users/27edf527e36c4ee7a9065688f4bed942/roles/0971c8bf92d64c50a5cbbf7d146af841` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:51.534844 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef106a52-7aaa-4edd-b21e-667c6a40c4e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b52e5e13b9144dfb663578766c2bac0, user_id=27edf527e36c4ee7a9065688f4bed942, role_id=0971c8bf92d64c50a5cbbf7d146af841)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:51.536542 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef106a52-7aaa-4edd-b21e-667c6a40c4e6 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:51.538412 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52cb60d-b08d-4200-be5f-eb88ba3e7010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:51.541870 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52cb60d-b08d-4200-be5f-eb88ba3e7010 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:51.541870 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52cb60d-b08d-4200-be5f-eb88ba3e7010 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:51.541870 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52cb60d-b08d-4200-be5f-eb88ba3e7010 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:51.606387 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52cb60d-b08d-4200-be5f-eb88ba3e7010 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:51.608445 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52cb60d-b08d-4200-be5f-eb88ba3e7010 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:51.694016 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 316/628] 10.222.0.23 () {58 vars in 1439 bytes} [Sat Apr 30 20:48:51 2022] PUT /identity/v3/projects/6b52e5e13b9144dfb663578766c2bac0/users/27edf527e36c4ee7a9065688f4bed942/roles/0971c8bf92d64c50a5cbbf7d146af841 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:48:51.695627 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a78d76-f239-4ab0-9add-2e75d33a6da7 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:51.695918 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a78d76-f239-4ab0-9add-2e75d33a6da7 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:51.696489 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a78d76-f239-4ab0-9add-2e75d33a6da7 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:51.697829 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 317/629] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:51.710739 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2bbfb-2895-4ccc-bc63-f5fe89b3fe49 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:51.711071 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2bbfb-2895-4ccc-bc63-f5fe89b3fe49 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:51.711296 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2bbfb-2895-4ccc-bc63-f5fe89b3fe49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:51.714677 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 313/630] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:48:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 30 20:48:51.724101 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52cb60d-b08d-4200-be5f-eb88ba3e7010 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:51.747014 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-ebc2bbfb-2895-4ccc-bc63-f5fe89b3fe49 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:51.748222 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ebc2bbfb-2895-4ccc-bc63-f5fe89b3fe49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:51.837798 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52cb60d-b08d-4200-be5f-eb88ba3e7010 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:51.885246 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d005ce14-77ab-40e6-a137-76dadab1f5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:51.886100 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 318/631] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:48:51.886995 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005ce14-77ab-40e6-a137-76dadab1f5a2 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:51.886995 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005ce14-77ab-40e6-a137-76dadab1f5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:51.886995 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005ce14-77ab-40e6-a137-76dadab1f5a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:51.887393 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046f71e-070c-42ba-aef9-cb7b12e2ecbf None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:51.893796 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046f71e-070c-42ba-aef9-cb7b12e2ecbf None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:51.893796 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046f71e-070c-42ba-aef9-cb7b12e2ecbf None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:51.895086 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 319/632] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:51.896551 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f9a28-424f-4c5e-8a11-e8e2f54c3be3 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:51.896905 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f9a28-424f-4c5e-8a11-e8e2f54c3be3 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:51.897252 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f9a28-424f-4c5e-8a11-e8e2f54c3be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:51.899005 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d005ce14-77ab-40e6-a137-76dadab1f5a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:51.900483 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d005ce14-77ab-40e6-a137-76dadab1f5a2 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:51.914455 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-693f9a28-424f-4c5e-8a11-e8e2f54c3be3 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:51.915738 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-693f9a28-424f-4c5e-8a11-e8e2f54c3be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:51.922362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-d005ce14-77ab-40e6-a137-76dadab1f5a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:51.922362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:51.922362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:51.922362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:51.922362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:51.922362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:51.922362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:51.922362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:51.922362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:51.922362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:51.922362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:51.922362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:51.922362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:48:51.922362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:48:51.922362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:48:51.924330 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:48:51.924330 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:51.924330 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:51.924330 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:51.924330 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:51.924330 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:51.924330 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:51.924330 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:51.924330 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:51.924330 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:51.924330 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:51.924330 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:51.924330 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:51.924330 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:51.924330 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:51.924330 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:51.924330 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:51.926410 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:48:51.926410 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:48:51.926410 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:51.926410 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:51.926410 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 314/633] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:48:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:51.929517 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d005ce14-77ab-40e6-a137-76dadab1f5a2 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:51.996963 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 320/634] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:48:51.998035 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f9a28-424f-4c5e-8a11-e8e2f54c3be3 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:52.037978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d005ce14-77ab-40e6-a137-76dadab1f5a2 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:52.085774 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f149ae-8abf-4b0b-8d54-9201cc894454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:52.086456 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f149ae-8abf-4b0b-8d54-9201cc894454 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:52.086778 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f149ae-8abf-4b0b-8d54-9201cc894454 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:52.087055 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f149ae-8abf-4b0b-8d54-9201cc894454 None admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:52.087831 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f149ae-8abf-4b0b-8d54-9201cc894454 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:52.088572 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f149ae-8abf-4b0b-8d54-9201cc894454 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:52.090349 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f149ae-8abf-4b0b-8d54-9201cc894454 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:52.106031 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 315/635] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:48:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:52.106948 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f149ae-8abf-4b0b-8d54-9201cc894454 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:52.116912 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f9a28-424f-4c5e-8a11-e8e2f54c3be3 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:52.151872 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829dd878-f143-434f-91fe-498dd56b55bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:52.152673 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829dd878-f143-434f-91fe-498dd56b55bd None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:52.152956 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829dd878-f143-434f-91fe-498dd56b55bd None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:52.153231 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829dd878-f143-434f-91fe-498dd56b55bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:52.164135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829dd878-f143-434f-91fe-498dd56b55bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:48:52.171822 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-829dd878-f143-434f-91fe-498dd56b55bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:48:52.171822 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:52.171822 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:52.171822 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:52.171822 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:52.171822 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:52.171822 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:52.171822 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:52.171822 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:52.171822 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:52.171822 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:52.171822 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:52.171822 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:48:52.171822 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:48:52.171822 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:48:52.171822 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:48:52.173954 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:48:52.173954 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:48:52.173954 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:48:52.173954 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:48:52.173954 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:52.173954 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:52.173954 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:52.173954 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:52.173954 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:52.173954 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:52.173954 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:52.173954 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:52.173954 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:52.173954 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:52.173954 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:52.173954 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:52.175934 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:52.175934 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:52.175934 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:52.175934 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:52.175934 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:48:52.175934 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:48:52.175934 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:48:52.175934 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:48:52.175934 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:48:52.175934 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:48:52.175934 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:48:52.175934 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:52.175934 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 321/636] 10.222.0.23 () {56 vars in 1102 bytes} [Sat Apr 30 20:48:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:52.175934 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829dd878-f143-434f-91fe-498dd56b55bd None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:52.215875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f149ae-8abf-4b0b-8d54-9201cc894454 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:52.250328 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbe56d-7385-4572-a2dd-299f9043a346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:52.251092 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbe56d-7385-4572-a2dd-299f9043a346 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:52.251375 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbe56d-7385-4572-a2dd-299f9043a346 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:52.251644 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbe56d-7385-4572-a2dd-299f9043a346 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:52.262226 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fbe56d-7385-4572-a2dd-299f9043a346 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:48:52.273784 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-58fbe56d-7385-4572-a2dd-299f9043a346 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:48:52.273784 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:52.273784 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:52.273784 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:52.273784 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:52.273784 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:52.273784 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:52.273784 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:52.273784 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:52.273784 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:52.273784 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:52.273784 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:52.273784 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:48:52.273784 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:48:52.273784 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:48:52.273784 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:48:52.275932 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:48:52.275932 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:48:52.275932 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:48:52.275932 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:48:52.275932 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:52.275932 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:52.275932 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:52.275932 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:52.275932 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:52.275932 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:52.275932 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:52.275932 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:52.275932 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:52.275932 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:52.275932 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:52.275932 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:52.277917 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:52.277917 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:52.277917 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:52.277917 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:52.277917 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:48:52.277917 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:48:52.277917 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:48:52.277917 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:48:52.277917 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:48:52.277917 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:48:52.277917 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:48:52.277917 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:52.293503 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829dd878-f143-434f-91fe-498dd56b55bd None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:52.294255 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 316/637] 10.222.0.23 () {56 vars in 1102 bytes} [Sat Apr 30 20:48:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:52.294255 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbe56d-7385-4572-a2dd-299f9043a346 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:52.310761 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b05512-df65-47aa-b749-c867f7e63475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:52.311572 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b05512-df65-47aa-b749-c867f7e63475 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:52.311853 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b05512-df65-47aa-b749-c867f7e63475 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:52.312128 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b05512-df65-47aa-b749-c867f7e63475 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:52.318914 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b05512-df65-47aa-b749-c867f7e63475 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:52.320366 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b05512-df65-47aa-b749-c867f7e63475 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:52.335092 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-99b05512-df65-47aa-b749-c867f7e63475 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:48:52.335092 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:52.335092 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:52.335092 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:52.335092 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:52.335092 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:52.335092 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:52.335092 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:52.335092 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:52.335092 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:52.335092 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:52.335092 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:52.335092 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:48:52.335092 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:48:52.335092 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:48:52.337038 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:48:52.337038 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:52.337038 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:52.337038 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:52.337038 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:52.337038 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:52.337038 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:52.337038 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:52.337038 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:52.337038 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:52.337038 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:52.337038 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:52.337038 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:52.337038 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:52.337038 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:52.337038 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:52.337038 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:52.339298 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:48:52.339298 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:48:52.339298 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:48:52.339298 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:48:52.339298 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:48:52.339298 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:48:52.339298 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:48:52.339298 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:52.345778 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 322/638] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:48:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:52.345778 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b05512-df65-47aa-b749-c867f7e63475 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:52.379498 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fbe56d-7385-4572-a2dd-299f9043a346 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:52.416756 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4bca5e-765f-4627-be41-52ecd7eb807a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:52.417436 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bca5e-765f-4627-be41-52ecd7eb807a None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:52.417782 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bca5e-765f-4627-be41-52ecd7eb807a None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:52.418085 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bca5e-765f-4627-be41-52ecd7eb807a None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:52.418844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4bca5e-765f-4627-be41-52ecd7eb807a None admin] RBAC: Adding query filter params (name=service) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:52.419151 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4bca5e-765f-4627-be41-52ecd7eb807a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:52.421111 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4bca5e-765f-4627-be41-52ecd7eb807a None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:52.430458 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 317/639] 10.222.0.23 () {56 vars in 1103 bytes} [Sat Apr 30 20:48:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:52.431314 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4bca5e-765f-4627-be41-52ecd7eb807a None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:52.449578 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b05512-df65-47aa-b749-c867f7e63475 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:52.485232 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eeb0ae-e22c-4496-844d-e7e09ba645d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:52.485922 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eeb0ae-e22c-4496-844d-e7e09ba645d2 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:52.486205 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eeb0ae-e22c-4496-844d-e7e09ba645d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:52.486482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eeb0ae-e22c-4496-844d-e7e09ba645d2 None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:52.487227 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eeb0ae-e22c-4496-844d-e7e09ba645d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:52.487532 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eeb0ae-e22c-4496-844d-e7e09ba645d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:52.488930 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eeb0ae-e22c-4496-844d-e7e09ba645d2 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:52.507148 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 323/640] 10.222.0.23 () {56 vars in 1103 bytes} [Sat Apr 30 20:48:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:52.507980 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eeb0ae-e22c-4496-844d-e7e09ba645d2 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:52.532582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4bca5e-765f-4627-be41-52ecd7eb807a None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:52.567521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c0a3a-9dba-4086-946d-44215dadcf11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:52.568054 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c0a3a-9dba-4086-946d-44215dadcf11 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:52.568337 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c0a3a-9dba-4086-946d-44215dadcf11 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:52.568615 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c0a3a-9dba-4086-946d-44215dadcf11 None admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:52.569407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7c0a3a-9dba-4086-946d-44215dadcf11 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:52.569708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7c0a3a-9dba-4086-946d-44215dadcf11 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:52.571176 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7c0a3a-9dba-4086-946d-44215dadcf11 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:52.584117 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 318/641] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Apr 30 20:48:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:52.584997 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c0a3a-9dba-4086-946d-44215dadcf11 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:52.617719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eeb0ae-e22c-4496-844d-e7e09ba645d2 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:52.652227 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45bda9-8d6b-41cc-84db-f4d69595d224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:52.653013 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45bda9-8d6b-41cc-84db-f4d69595d224 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:52.653292 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45bda9-8d6b-41cc-84db-f4d69595d224 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:52.653563 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45bda9-8d6b-41cc-84db-f4d69595d224 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:52.663845 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45bda9-8d6b-41cc-84db-f4d69595d224 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:52.665310 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45bda9-8d6b-41cc-84db-f4d69595d224 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:52.687325 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c0a3a-9dba-4086-946d-44215dadcf11 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:52.687514 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-ff45bda9-8d6b-41cc-84db-f4d69595d224 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:52.687514 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:52.687514 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:52.687514 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:52.687514 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:52.687514 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:52.687514 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:52.687514 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:52.687514 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:52.687514 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:52.687514 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:52.687514 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:52.687514 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:48:52.687514 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:48:52.687514 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:48:52.688478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:48:52.688478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:52.688478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:52.688478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:52.688478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:52.688478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:52.688478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:52.688478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:52.688478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:52.688478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:52.688478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:52.688478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:52.688478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:52.688478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:52.688478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:52.688478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:52.688478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:52.689382 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:48:52.689382 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:48:52.689382 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:52.689382 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:52.689382 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 324/642] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:48:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:52.693458 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45bda9-8d6b-41cc-84db-f4d69595d224 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:52.727397 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be960dfa-1253-456f-9c6e-f62f4b507018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:52.728183 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be960dfa-1253-456f-9c6e-f62f4b507018 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:52.728461 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be960dfa-1253-456f-9c6e-f62f4b507018 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:52.728732 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be960dfa-1253-456f-9c6e-f62f4b507018 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:52.739405 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be960dfa-1253-456f-9c6e-f62f4b507018 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:52.740889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be960dfa-1253-456f-9c6e-f62f4b507018 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:52.758795 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-be960dfa-1253-456f-9c6e-f62f4b507018 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:52.758795 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:52.758795 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:52.758795 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:52.758795 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:52.758795 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:52.758795 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:52.758795 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:52.758795 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:52.758795 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:52.758795 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:52.758795 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:52.758795 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:48:52.758795 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:48:52.758795 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:48:52.759696 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:48:52.759696 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:52.759696 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:52.759696 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:52.759696 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:52.759696 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:52.759696 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:52.759696 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:52.759696 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:52.759696 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:52.759696 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:52.759696 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:52.759696 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:52.759696 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:52.759696 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:52.759696 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:52.759696 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:52.760683 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:48:52.760683 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:48:52.760683 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:52.760683 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:52.760683 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 319/643] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:48:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:52.761468 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b1296-b8a4-4d62-a7b4-72eaede6992a None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:52.761468 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b1296-b8a4-4d62-a7b4-72eaede6992a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:52.761602 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b1296-b8a4-4d62-a7b4-72eaede6992a None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:52.763104 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 320/644] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:52.767604 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b1296-b8a4-4d62-a7b4-72eaede6992a None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:52.796396 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45bda9-8d6b-41cc-84db-f4d69595d224 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:52.829645 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5726735-bb2d-475b-bf92-484c4f26c6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:52.830350 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5726735-bb2d-475b-bf92-484c4f26c6f4 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:52.830639 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5726735-bb2d-475b-bf92-484c4f26c6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:52.830915 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5726735-bb2d-475b-bf92-484c4f26c6f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:52.831741 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5726735-bb2d-475b-bf92-484c4f26c6f4 None admin] RBAC: Adding query filter params (role.id=0971c8bf92d64c50a5cbbf7d146af841, scope.project.id=6b52e5e13b9144dfb663578766c2bac0, user.id=fca4ee1f64c8489ebe7296f9f8f0ab41) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:52.832055 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5726735-bb2d-475b-bf92-484c4f26c6f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:52.833516 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5726735-bb2d-475b-bf92-484c4f26c6f4 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:52.846657 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 325/645] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:48:52 2022] GET /identity/v3/role_assignments?user.id=fca4ee1f64c8489ebe7296f9f8f0ab41&scope.project.id=6b52e5e13b9144dfb663578766c2bac0&role.id=0971c8bf92d64c50a5cbbf7d146af841 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:52.846657 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5726735-bb2d-475b-bf92-484c4f26c6f4 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:52.871185 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b1296-b8a4-4d62-a7b4-72eaede6992a None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:52.907791 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb102e-ca08-4ad0-8917-204ba0d29491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:52.908459 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb102e-ca08-4ad0-8917-204ba0d29491 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:52.908737 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb102e-ca08-4ad0-8917-204ba0d29491 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:52.909014 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb102e-ca08-4ad0-8917-204ba0d29491 None admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:52.909750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb102e-ca08-4ad0-8917-204ba0d29491 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:52.910088 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb102e-ca08-4ad0-8917-204ba0d29491 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:52.911521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb102e-ca08-4ad0-8917-204ba0d29491 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:52.928578 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 321/646] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:48:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:52.928578 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c9475-7269-4ad8-99e0-a50a6d26e62e None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:52.928578 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c9475-7269-4ad8-99e0-a50a6d26e62e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:52.928578 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c9475-7269-4ad8-99e0-a50a6d26e62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:52.948382 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-098c9475-7269-4ad8-99e0-a50a6d26e62e None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:52.950750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-098c9475-7269-4ad8-99e0-a50a6d26e62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:52.982219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5726735-bb2d-475b-bf92-484c4f26c6f4 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:53.019316 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd6e4b-2f48-4439-b20b-49093dfa921f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:53.020059 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd6e4b-2f48-4439-b20b-49093dfa921f None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:53.020412 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd6e4b-2f48-4439-b20b-49093dfa921f None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:53.020762 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd6e4b-2f48-4439-b20b-49093dfa921f None admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:53.021807 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd6e4b-2f48-4439-b20b-49093dfa921f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:53.022053 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd6e4b-2f48-4439-b20b-49093dfa921f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:53.023589 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd6e4b-2f48-4439-b20b-49093dfa921f None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:53.042014 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 326/647] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:48:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:53.043089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd6e4b-2f48-4439-b20b-49093dfa921f None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:53.047166 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 322/648] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:48:53.049184 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c9475-7269-4ad8-99e0-a50a6d26e62e None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:53.167615 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd6e4b-2f48-4439-b20b-49093dfa921f None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:53.182916 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c9475-7269-4ad8-99e0-a50a6d26e62e None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:53.206831 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a46dd-ed84-437d-ad8f-bf694f1c4de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:53.207688 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a46dd-ed84-437d-ad8f-bf694f1c4de7 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:53.207975 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a46dd-ed84-437d-ad8f-bf694f1c4de7 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:53.208251 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a46dd-ed84-437d-ad8f-bf694f1c4de7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:53.215981 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a46dd-ed84-437d-ad8f-bf694f1c4de7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:53.218036 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a46dd-ed84-437d-ad8f-bf694f1c4de7 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:53.225554 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71135188-8072-4088-a35d-044dfbb65a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:53.226384 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71135188-8072-4088-a35d-044dfbb65a37 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:53.226694 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71135188-8072-4088-a35d-044dfbb65a37 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:53.226966 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71135188-8072-4088-a35d-044dfbb65a37 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:53.233246 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-461a46dd-ed84-437d-ad8f-bf694f1c4de7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 30 20:48:53.233246 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:53.233246 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:53.233246 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:53.233246 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:53.233246 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:53.233246 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:53.233246 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:53.233246 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:53.233246 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:53.233246 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:53.233246 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:53.233246 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:48:53.233246 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:48:53.233246 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:48:53.233246 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:48:53.236949 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:53.236949 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:53.236949 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:48:53.236949 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:48:53.236949 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:48:53.236949 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:48:53.236949 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:53.236949 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:53.236949 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:53.236949 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:53.236949 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:53.236949 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:53.236949 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:53.236949 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:53.236949 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:53.236949 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:53.236949 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:53.236949 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:53.238178 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:53.238178 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:53.238178 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:48:53.238178 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:48:53.238178 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:48:53.238178 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:48:53.238178 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:48:53.238178 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:48:53.238178 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Apr 30 20:48:53.238178 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:53.238722 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71135188-8072-4088-a35d-044dfbb65a37 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:53.238880 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 327/649] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:48:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:53.238880 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a46dd-ed84-437d-ad8f-bf694f1c4de7 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:53.239007 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71135188-8072-4088-a35d-044dfbb65a37 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:53.253574 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-71135188-8072-4088-a35d-044dfbb65a37 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 30 20:48:53.253574 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:53.253574 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:53.253574 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:53.253574 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:53.253574 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:53.253574 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:53.253574 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:53.253574 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:53.253574 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:53.253574 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:53.253574 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:53.253574 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:48:53.253574 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:48:53.253574 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:48:53.253574 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:48:53.254763 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:53.254763 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:53.254763 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:48:53.254763 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:48:53.254763 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:48:53.254763 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:48:53.254763 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:53.254763 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:53.254763 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:53.254763 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:53.254763 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:53.254763 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:53.254763 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:53.254763 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:53.254763 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:53.254763 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:53.254763 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:53.254763 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:53.255722 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:53.255722 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:53.255722 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:48:53.255722 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:48:53.255722 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:48:53.255722 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:48:53.255722 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:48:53.255722 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:48:53.255722 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Apr 30 20:48:53.255722 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:53.255722 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 323/650] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:48:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:53.256309 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71135188-8072-4088-a35d-044dfbb65a37 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:53.359890 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a46dd-ed84-437d-ad8f-bf694f1c4de7 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:53.370074 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71135188-8072-4088-a35d-044dfbb65a37 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:53.395115 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9e70d-8bde-4b54-81c6-ec68b1672125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:53.396020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9e70d-8bde-4b54-81c6-ec68b1672125 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:53.396368 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9e70d-8bde-4b54-81c6-ec68b1672125 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:53.396708 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9e70d-8bde-4b54-81c6-ec68b1672125 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:53.406474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450023d8-a2b6-49ce-af0b-1faf803fc48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:53.407408 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450023d8-a2b6-49ce-af0b-1faf803fc48d None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:53.407901 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450023d8-a2b6-49ce-af0b-1faf803fc48d None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:53.408078 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f9e70d-8bde-4b54-81c6-ec68b1672125 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:48:53.408594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450023d8-a2b6-49ce-af0b-1faf803fc48d None admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:53.409626 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450023d8-a2b6-49ce-af0b-1faf803fc48d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:53.410180 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450023d8-a2b6-49ce-af0b-1faf803fc48d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:53.411809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450023d8-a2b6-49ce-af0b-1faf803fc48d None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:53.415789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-48f9e70d-8bde-4b54-81c6-ec68b1672125 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:48:53.415789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:53.415789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:53.415789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:53.415789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:53.415789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:53.415789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:53.415789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:53.415789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:53.415789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:53.415789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:53.415789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:53.415789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:48:53.415789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:48:53.415789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:48:53.415789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:48:53.416735 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:48:53.416735 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:48:53.416735 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:48:53.416735 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:48:53.416735 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:53.416735 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:53.416735 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:53.416735 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:53.416735 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:53.416735 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:53.416735 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:53.416735 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:53.416735 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:53.416735 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:53.416735 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:53.416735 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:53.417570 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:53.417570 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:53.417570 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:53.417570 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:53.417570 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:48:53.417570 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:48:53.417570 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:48:53.417570 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:48:53.417570 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:48:53.417570 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:48:53.417570 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:48:53.417570 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:53.417570 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 328/651] 10.222.0.23 () {56 vars in 1102 bytes} [Sat Apr 30 20:48:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:53.418342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9e70d-8bde-4b54-81c6-ec68b1672125 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:53.433454 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 324/652] 10.222.0.23 () {56 vars in 1137 bytes} [Sat Apr 30 20:48:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:53.434674 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450023d8-a2b6-49ce-af0b-1faf803fc48d None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:53.522647 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9e70d-8bde-4b54-81c6-ec68b1672125 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:53.535732 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450023d8-a2b6-49ce-af0b-1faf803fc48d None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:53.556843 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aff020-926a-4234-adf3-f31f3fdd1f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:53.557510 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aff020-926a-4234-adf3-f31f3fdd1f1a None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:53.557811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aff020-926a-4234-adf3-f31f3fdd1f1a None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:53.558088 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aff020-926a-4234-adf3-f31f3fdd1f1a None admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:53.558917 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aff020-926a-4234-adf3-f31f3fdd1f1a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:53.559221 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aff020-926a-4234-adf3-f31f3fdd1f1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:53.561203 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aff020-926a-4234-adf3-f31f3fdd1f1a None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:53.573079 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb459c7-bc55-4116-bc5d-35dbc5dce5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:53.574157 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb459c7-bc55-4116-bc5d-35dbc5dce5ea None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:53.579503 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb459c7-bc55-4116-bc5d-35dbc5dce5ea None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:53.579503 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb459c7-bc55-4116-bc5d-35dbc5dce5ea None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:53.579503 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb459c7-bc55-4116-bc5d-35dbc5dce5ea None admin] RBAC: Adding query filter params (name=service) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:53.579503 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb459c7-bc55-4116-bc5d-35dbc5dce5ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:53.579503 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb459c7-bc55-4116-bc5d-35dbc5dce5ea None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:53.582519 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 329/653] 10.222.0.23 () {56 vars in 1137 bytes} [Sat Apr 30 20:48:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:53.583410 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aff020-926a-4234-adf3-f31f3fdd1f1a None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:53.588736 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 325/654] 10.222.0.23 () {56 vars in 1103 bytes} [Sat Apr 30 20:48:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:53.589816 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb459c7-bc55-4116-bc5d-35dbc5dce5ea None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:53.683783 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aff020-926a-4234-adf3-f31f3fdd1f1a None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:53.692845 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb459c7-bc55-4116-bc5d-35dbc5dce5ea None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:53.719115 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c399d5-ef0a-40ae-a3fd-c14bb95a0c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:53.719789 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c399d5-ef0a-40ae-a3fd-c14bb95a0c64 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:53.720290 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c399d5-ef0a-40ae-a3fd-c14bb95a0c64 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:53.720572 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c399d5-ef0a-40ae-a3fd-c14bb95a0c64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:53.733469 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e7709-8767-4cd0-b858-9fe5843e6b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:53.734475 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e7709-8767-4cd0-b858-9fe5843e6b50 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:53.734960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e7709-8767-4cd0-b858-9fe5843e6b50 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:53.735488 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e7709-8767-4cd0-b858-9fe5843e6b50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:53.789205 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c399d5-ef0a-40ae-a3fd-c14bb95a0c64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:53.790418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c399d5-ef0a-40ae-a3fd-c14bb95a0c64 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:53.806828 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e7709-8767-4cd0-b858-9fe5843e6b50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:53.808704 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e7709-8767-4cd0-b858-9fe5843e6b50 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:53.915066 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 326/655] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:48:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:48:53.916682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e7709-8767-4cd0-b858-9fe5843e6b50 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:53.965325 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 330/656] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:48:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:48:53.966532 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c399d5-ef0a-40ae-a3fd-c14bb95a0c64 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:54.019837 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e7709-8767-4cd0-b858-9fe5843e6b50 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:54.056788 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd882f4e-77b2-4ec8-9ae2-9ab6c68396f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:54.058764 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd882f4e-77b2-4ec8-9ae2-9ab6c68396f5 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:54.059987 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd882f4e-77b2-4ec8-9ae2-9ab6c68396f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:54.061137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd882f4e-77b2-4ec8-9ae2-9ab6c68396f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:54.073903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c399d5-ef0a-40ae-a3fd-c14bb95a0c64 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:54.084493 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd882f4e-77b2-4ec8-9ae2-9ab6c68396f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:54.086956 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd882f4e-77b2-4ec8-9ae2-9ab6c68396f5 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:54.109502 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e30bf1-836d-4a00-bea1-0aa83aa98da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:54.110329 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e30bf1-836d-4a00-bea1-0aa83aa98da2 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:54.110607 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e30bf1-836d-4a00-bea1-0aa83aa98da2 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:54.110931 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e30bf1-836d-4a00-bea1-0aa83aa98da2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:54.121193 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e30bf1-836d-4a00-bea1-0aa83aa98da2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:54.122670 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e30bf1-836d-4a00-bea1-0aa83aa98da2 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:54.133981 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-cd882f4e-77b2-4ec8-9ae2-9ab6c68396f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:54.133981 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:54.133981 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:54.133981 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:54.133981 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:54.133981 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:54.133981 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:54.133981 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:54.133981 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:54.133981 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:54.133981 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:54.133981 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:54.133981 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:48:54.133981 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:48:54.133981 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:48:54.134899 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:48:54.134899 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:54.134899 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:54.134899 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:54.134899 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:54.134899 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:54.134899 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:54.134899 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:54.134899 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:54.134899 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:54.134899 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:54.134899 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:54.134899 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:54.134899 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:54.134899 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:54.134899 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:54.134899 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:54.135793 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:48:54.135793 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:48:54.135793 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:54.135793 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:54.141077 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-b9e30bf1-836d-4a00-bea1-0aa83aa98da2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:54.141077 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:54.141077 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:54.141077 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:54.141077 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:54.141077 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:54.141077 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:54.141077 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:54.141077 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:54.141077 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:54.141077 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:54.141077 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:54.141077 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:48:54.141077 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:48:54.141077 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:48:54.142033 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:48:54.142033 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:54.142033 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:54.142033 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:54.142033 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:54.142033 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:54.142033 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:54.142033 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:54.142033 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:54.142033 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:54.142033 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:54.142033 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:54.142033 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:54.142033 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:54.142033 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:54.142033 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:54.142033 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:54.142915 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:48:54.142915 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:48:54.142915 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:54.142915 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:54.142915 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 331/657] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:48:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:54.143592 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e30bf1-836d-4a00-bea1-0aa83aa98da2 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:54.146972 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 327/658] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:48:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:54.148079 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd882f4e-77b2-4ec8-9ae2-9ab6c68396f5 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:54.255668 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e30bf1-836d-4a00-bea1-0aa83aa98da2 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:54.302387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70cfa5-c4e4-4bdb-9d9b-1c2777c7a372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:54.303291 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70cfa5-c4e4-4bdb-9d9b-1c2777c7a372 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:54.303643 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70cfa5-c4e4-4bdb-9d9b-1c2777c7a372 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:54.304228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70cfa5-c4e4-4bdb-9d9b-1c2777c7a372 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:54.309243 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd882f4e-77b2-4ec8-9ae2-9ab6c68396f5 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:54.315326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c70cfa5-c4e4-4bdb-9d9b-1c2777c7a372 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:54.316769 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c70cfa5-c4e4-4bdb-9d9b-1c2777c7a372 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:54.334137 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-2c70cfa5-c4e4-4bdb-9d9b-1c2777c7a372 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:54.334137 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:54.334137 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:54.334137 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:54.334137 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:54.334137 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:54.334137 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:54.334137 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:54.334137 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:54.334137 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:54.334137 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:54.334137 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:54.334137 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:48:54.334137 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:48:54.334137 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:48:54.335086 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:48:54.335086 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:54.335086 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:54.335086 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:54.335086 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:54.335086 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:54.335086 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:54.335086 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:54.335086 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:54.335086 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:54.335086 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:54.335086 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:54.335086 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:54.335086 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:54.335086 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:54.335086 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:54.335086 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:54.335986 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:48:54.335986 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:48:54.335986 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:54.335986 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:54.335986 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 332/659] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:48:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:54.336258 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70cfa5-c4e4-4bdb-9d9b-1c2777c7a372 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:54.356111 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9155a215-a50a-445b-b0ec-b0618a064cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:54.360388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155a215-a50a-445b-b0ec-b0618a064cc2 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:54.360388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155a215-a50a-445b-b0ec-b0618a064cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:54.360388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155a215-a50a-445b-b0ec-b0618a064cc2 None admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:54.360388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9155a215-a50a-445b-b0ec-b0618a064cc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:54.360388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9155a215-a50a-445b-b0ec-b0618a064cc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:54.361637 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9155a215-a50a-445b-b0ec-b0618a064cc2 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:54.375422 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 328/660] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:48:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:54.377046 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f458fa7-70bd-430d-95d5-ff56e02f167b None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:54.377467 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f458fa7-70bd-430d-95d5-ff56e02f167b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:54.377921 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f458fa7-70bd-430d-95d5-ff56e02f167b None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:54.383433 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 329/661] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:54.383433 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f458fa7-70bd-430d-95d5-ff56e02f167b None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:54.457956 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70cfa5-c4e4-4bdb-9d9b-1c2777c7a372 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:54.503110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b32d9a-107f-4850-aca3-ba8a9683da66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:54.503888 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b32d9a-107f-4850-aca3-ba8a9683da66 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:54.504125 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f458fa7-70bd-430d-95d5-ff56e02f167b None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:54.504236 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b32d9a-107f-4850-aca3-ba8a9683da66 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:54.504615 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b32d9a-107f-4850-aca3-ba8a9683da66 None admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:54.505424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b32d9a-107f-4850-aca3-ba8a9683da66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:54.505911 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b32d9a-107f-4850-aca3-ba8a9683da66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:54.507328 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b32d9a-107f-4850-aca3-ba8a9683da66 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:54.519164 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 333/662] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:48:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:54.519966 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b32d9a-107f-4850-aca3-ba8a9683da66 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:54.542159 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a5dc5-6fc9-4a68-9e78-7cf006914f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:54.542905 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a5dc5-6fc9-4a68-9e78-7cf006914f40 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:54.543257 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a5dc5-6fc9-4a68-9e78-7cf006914f40 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:54.543608 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a5dc5-6fc9-4a68-9e78-7cf006914f40 None admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:54.544323 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a5dc5-6fc9-4a68-9e78-7cf006914f40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:54.544657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a5dc5-6fc9-4a68-9e78-7cf006914f40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:54.546059 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a5dc5-6fc9-4a68-9e78-7cf006914f40 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:54.562395 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 330/663] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:48:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:54.562395 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6d3d2-0819-4bb6-81f3-4c44c0af890d None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:54.562395 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6d3d2-0819-4bb6-81f3-4c44c0af890d None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:54.562395 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6d3d2-0819-4bb6-81f3-4c44c0af890d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:54.575829 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-add6d3d2-0819-4bb6-81f3-4c44c0af890d None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:54.577812 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-add6d3d2-0819-4bb6-81f3-4c44c0af890d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:54.625316 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b32d9a-107f-4850-aca3-ba8a9683da66 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:54.643772 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 331/664] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:48:54.644820 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add6d3d2-0819-4bb6-81f3-4c44c0af890d None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:54.673549 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6413a7-c9d6-43d8-843c-b697679c1569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:54.674401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6413a7-c9d6-43d8-843c-b697679c1569 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:54.674666 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6413a7-c9d6-43d8-843c-b697679c1569 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:54.674940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6413a7-c9d6-43d8-843c-b697679c1569 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:54.682789 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6413a7-c9d6-43d8-843c-b697679c1569 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:54.684253 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6413a7-c9d6-43d8-843c-b697679c1569 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:54.698706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-6a6413a7-c9d6-43d8-843c-b697679c1569 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 30 20:48:54.698706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:54.698706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:54.698706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:54.698706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:54.698706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:54.698706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:54.698706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:54.698706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:54.698706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:54.698706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:54.698706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:54.698706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:48:54.698706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:48:54.698706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:48:54.698706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:48:54.699862 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:54.699862 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:54.699862 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:48:54.699862 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:48:54.699862 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:48:54.699862 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:48:54.699862 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:54.699862 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:54.699862 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:54.699862 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:54.699862 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:54.699862 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:54.699862 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:54.699862 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:54.699862 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:54.699862 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:54.699862 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:54.699862 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:54.700830 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:54.700830 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:54.700830 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:48:54.700830 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:48:54.700830 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:48:54.700830 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:48:54.700830 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:48:54.700830 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:48:54.700830 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Apr 30 20:48:54.700830 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:54.700830 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 334/665] 10.222.0.23 () {56 vars in 1102 bytes} [Sat Apr 30 20:48:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:54.700830 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6413a7-c9d6-43d8-843c-b697679c1569 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:54.755187 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add6d3d2-0819-4bb6-81f3-4c44c0af890d None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:54.791769 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c53f61-46e4-40fb-bd5d-85b4027dc593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:54.792645 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c53f61-46e4-40fb-bd5d-85b4027dc593 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:54.792997 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c53f61-46e4-40fb-bd5d-85b4027dc593 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:54.793333 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c53f61-46e4-40fb-bd5d-85b4027dc593 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:54.799623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6413a7-c9d6-43d8-843c-b697679c1569 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:54.800521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c53f61-46e4-40fb-bd5d-85b4027dc593 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:54.802129 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c53f61-46e4-40fb-bd5d-85b4027dc593 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:54.816308 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-72c53f61-46e4-40fb-bd5d-85b4027dc593 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:48:54.816308 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:54.816308 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:54.816308 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:54.816308 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:54.816308 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:54.816308 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:54.816308 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:54.816308 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:54.816308 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:54.816308 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:54.816308 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:54.816308 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:48:54.816308 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:48:54.816308 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:48:54.817379 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:48:54.817379 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:54.817379 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:54.817379 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:54.817379 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:54.817379 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:54.817379 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:54.817379 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:54.817379 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:54.817379 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:54.817379 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:54.817379 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:54.817379 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:54.817379 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:54.817379 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:54.817379 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:54.817379 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:54.818471 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:48:54.818471 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:48:54.818471 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:48:54.818471 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:48:54.818471 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:48:54.818471 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:48:54.818471 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:48:54.818471 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:54.818471 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 332/666] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:48:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:54.818996 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c53f61-46e4-40fb-bd5d-85b4027dc593 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:54.838886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8c211-f14e-4c44-bc26-bc29a14388e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:54.839688 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8c211-f14e-4c44-bc26-bc29a14388e1 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:54.839976 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8c211-f14e-4c44-bc26-bc29a14388e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:54.840253 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8c211-f14e-4c44-bc26-bc29a14388e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:54.847189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f8c211-f14e-4c44-bc26-bc29a14388e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:54.848665 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f8c211-f14e-4c44-bc26-bc29a14388e1 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:54.863299 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-03f8c211-f14e-4c44-bc26-bc29a14388e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:48:54.863299 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:54.863299 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:54.863299 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:54.863299 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:54.863299 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:54.863299 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:54.863299 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:54.863299 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:54.863299 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:54.863299 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:54.863299 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:54.863299 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:48:54.863299 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:48:54.863299 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:48:54.864231 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:48:54.864231 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:54.864231 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:54.864231 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:54.864231 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:54.864231 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:54.864231 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:54.864231 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:54.864231 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:54.864231 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:54.864231 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:54.864231 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:54.864231 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:54.864231 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:54.864231 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:54.864231 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:54.864231 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:54.865131 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:48:54.865131 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:48:54.865131 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:48:54.865131 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:48:54.865131 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:48:54.865131 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:48:54.865131 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:48:54.865131 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:54.865131 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 335/667] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:48:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:54.865704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8c211-f14e-4c44-bc26-bc29a14388e1 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:54.921637 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c53f61-46e4-40fb-bd5d-85b4027dc593 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:54.955049 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6fc74-2c26-426a-98b8-94d5300dbf03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:54.955846 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6fc74-2c26-426a-98b8-94d5300dbf03 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:54.956131 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6fc74-2c26-426a-98b8-94d5300dbf03 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:54.956480 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6fc74-2c26-426a-98b8-94d5300dbf03 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:54.966857 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6fc74-2c26-426a-98b8-94d5300dbf03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:48:54.973240 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8c211-f14e-4c44-bc26-bc29a14388e1 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:54.974987 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-23c6fc74-2c26-426a-98b8-94d5300dbf03 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:48:54.974987 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:54.974987 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:54.974987 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:54.974987 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:54.974987 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:54.974987 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:54.974987 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:54.974987 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:54.974987 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:54.974987 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:54.974987 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:54.974987 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:48:54.974987 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:48:54.974987 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:48:54.974987 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:48:54.975930 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:48:54.975930 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:48:54.975930 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:48:54.975930 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:48:54.975930 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:54.975930 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:54.975930 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:54.975930 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:54.975930 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:54.975930 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:54.975930 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:54.975930 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:54.975930 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:54.975930 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:54.975930 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:54.975930 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:54.976788 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:54.976788 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:54.976788 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:54.976788 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:54.976788 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:48:54.976788 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:48:54.976788 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:48:54.976788 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:48:54.976788 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:48:54.976788 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:48:54.976788 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:48:54.976788 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:54.976788 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 333/668] 10.222.0.23 () {56 vars in 1102 bytes} [Sat Apr 30 20:48:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:54.977494 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6fc74-2c26-426a-98b8-94d5300dbf03 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:55.013636 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf64f7-d833-4d77-ba8b-834d03d02e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:55.014392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf64f7-d833-4d77-ba8b-834d03d02e41 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:55.014685 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf64f7-d833-4d77-ba8b-834d03d02e41 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:55.014964 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf64f7-d833-4d77-ba8b-834d03d02e41 None admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:55.015798 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf64f7-d833-4d77-ba8b-834d03d02e41 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:55.016107 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf64f7-d833-4d77-ba8b-834d03d02e41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:55.017549 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf64f7-d833-4d77-ba8b-834d03d02e41 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:55.040470 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 336/669] 10.222.0.23 () {56 vars in 1139 bytes} [Sat Apr 30 20:48:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:55.041411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf64f7-d833-4d77-ba8b-834d03d02e41 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:55.073810 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6fc74-2c26-426a-98b8-94d5300dbf03 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:55.106882 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15fb69a-81c4-44d5-bd05-8398ba9c9d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:55.108100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fb69a-81c4-44d5-bd05-8398ba9c9d6d None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:55.108384 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fb69a-81c4-44d5-bd05-8398ba9c9d6d None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:55.108663 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fb69a-81c4-44d5-bd05-8398ba9c9d6d None admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:55.109442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15fb69a-81c4-44d5-bd05-8398ba9c9d6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:55.109750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15fb69a-81c4-44d5-bd05-8398ba9c9d6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:55.111205 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15fb69a-81c4-44d5-bd05-8398ba9c9d6d None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:55.127621 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 334/670] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Apr 30 20:48:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:55.127621 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15fb69a-81c4-44d5-bd05-8398ba9c9d6d None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:55.154808 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf64f7-d833-4d77-ba8b-834d03d02e41 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:55.197653 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623966c7-af98-46dd-94e3-01ec1553ec51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:55.198375 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623966c7-af98-46dd-94e3-01ec1553ec51 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:55.198661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623966c7-af98-46dd-94e3-01ec1553ec51 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:55.199276 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623966c7-af98-46dd-94e3-01ec1553ec51 None admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:55.199753 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623966c7-af98-46dd-94e3-01ec1553ec51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:55.200068 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623966c7-af98-46dd-94e3-01ec1553ec51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:55.201646 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623966c7-af98-46dd-94e3-01ec1553ec51 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:55.214044 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 337/671] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Apr 30 20:48:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:55.214923 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623966c7-af98-46dd-94e3-01ec1553ec51 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:55.229439 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15fb69a-81c4-44d5-bd05-8398ba9c9d6d None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:55.264324 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501be3c9-d729-46d1-87c3-1985d399c8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:55.265079 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501be3c9-d729-46d1-87c3-1985d399c8a9 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:55.265430 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501be3c9-d729-46d1-87c3-1985d399c8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:55.265799 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501be3c9-d729-46d1-87c3-1985d399c8a9 None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:55.266638 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501be3c9-d729-46d1-87c3-1985d399c8a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:55.267019 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501be3c9-d729-46d1-87c3-1985d399c8a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:55.269131 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501be3c9-d729-46d1-87c3-1985d399c8a9 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:55.285217 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 335/672] 10.222.0.23 () {56 vars in 1103 bytes} [Sat Apr 30 20:48:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:55.286123 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501be3c9-d729-46d1-87c3-1985d399c8a9 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:55.318575 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623966c7-af98-46dd-94e3-01ec1553ec51 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:55.351406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4916d8d-5030-487e-b51d-b936cbe86140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:55.351987 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4916d8d-5030-487e-b51d-b936cbe86140 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:55.352272 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4916d8d-5030-487e-b51d-b936cbe86140 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:55.352551 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4916d8d-5030-487e-b51d-b936cbe86140 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:55.382687 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501be3c9-d729-46d1-87c3-1985d399c8a9 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:55.414605 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf481aa-694f-4398-b514-90409adbae37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:55.415252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf481aa-694f-4398-b514-90409adbae37 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:55.415533 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf481aa-694f-4398-b514-90409adbae37 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:55.415807 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf481aa-694f-4398-b514-90409adbae37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:55.416619 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf481aa-694f-4398-b514-90409adbae37 None admin] RBAC: Adding query filter params (role.id=0971c8bf92d64c50a5cbbf7d146af841, scope.project.id=6b52e5e13b9144dfb663578766c2bac0, user.id=f3dc7765f32c4b00a7e41f2754b9595b) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:55.416929 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf481aa-694f-4398-b514-90409adbae37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:55.417708 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4916d8d-5030-487e-b51d-b936cbe86140 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:55.418473 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf481aa-694f-4398-b514-90409adbae37 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:55.419214 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4916d8d-5030-487e-b51d-b936cbe86140 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:55.424641 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 336/673] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:48:55 2022] GET /identity/v3/role_assignments?user.id=f3dc7765f32c4b00a7e41f2754b9595b&scope.project.id=6b52e5e13b9144dfb663578766c2bac0&role.id=0971c8bf92d64c50a5cbbf7d146af841 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:55.425411 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf481aa-694f-4398-b514-90409adbae37 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:55.537910 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 338/674] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:48:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:48:55.537910 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4916d8d-5030-487e-b51d-b936cbe86140 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:55.538222 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf481aa-694f-4398-b514-90409adbae37 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:55.572259 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436881cd-8d6b-4723-b2f4-6d5d151ab8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:55.573104 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436881cd-8d6b-4723-b2f4-6d5d151ab8b3 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:55.573487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436881cd-8d6b-4723-b2f4-6d5d151ab8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:55.573885 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436881cd-8d6b-4723-b2f4-6d5d151ab8b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:55.574892 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436881cd-8d6b-4723-b2f4-6d5d151ab8b3 None admin] RBAC: Adding query filter params (role.id=0971c8bf92d64c50a5cbbf7d146af841, scope.project.id=6b52e5e13b9144dfb663578766c2bac0, user.id=e302b1298dd04d6590e3d079f7b13b29) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:55.575282 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436881cd-8d6b-4723-b2f4-6d5d151ab8b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:55.578406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436881cd-8d6b-4723-b2f4-6d5d151ab8b3 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:55.594617 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 337/675] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:48:55 2022] GET /identity/v3/role_assignments?user.id=e302b1298dd04d6590e3d079f7b13b29&scope.project.id=6b52e5e13b9144dfb663578766c2bac0&role.id=0971c8bf92d64c50a5cbbf7d146af841 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:55.594617 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837f892-3346-41cd-8769-9b9f5beba3e0 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:55.594617 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837f892-3346-41cd-8769-9b9f5beba3e0 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:55.594617 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837f892-3346-41cd-8769-9b9f5beba3e0 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:55.594617 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 338/676] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:55.594617 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837f892-3346-41cd-8769-9b9f5beba3e0 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:55.652121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4916d8d-5030-487e-b51d-b936cbe86140 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:55.690897 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8f831-3baf-43f0-9cb2-b8b0d5c07e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:55.699017 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8f831-3baf-43f0-9cb2-b8b0d5c07e82 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:55.699017 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8f831-3baf-43f0-9cb2-b8b0d5c07e82 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:55.699017 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8f831-3baf-43f0-9cb2-b8b0d5c07e82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:55.704488 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab8f831-3baf-43f0-9cb2-b8b0d5c07e82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:55.707193 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab8f831-3baf-43f0-9cb2-b8b0d5c07e82 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:55.732242 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-3ab8f831-3baf-43f0-9cb2-b8b0d5c07e82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:55.732242 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:55.732242 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:55.732242 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:55.732242 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:55.732242 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:55.732242 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:55.732242 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:55.732242 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:55.732242 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:55.732242 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:55.732242 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:55.732242 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:48:55.732242 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:48:55.732242 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:48:55.733214 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:48:55.733214 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:55.733214 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:55.733214 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:55.733214 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:55.733214 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:55.733214 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:55.733214 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:55.733214 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:55.733214 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:55.733214 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:55.733214 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:55.733214 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:55.733214 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:55.733214 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:55.733214 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:55.733214 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:55.734116 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:48:55.734116 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:48:55.734116 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:55.734116 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:55.734116 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 339/677] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:48:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:55.735692 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d26d3-fef9-4760-b206-b667bb8466c3 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:55.735692 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d26d3-fef9-4760-b206-b667bb8466c3 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:55.735913 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d26d3-fef9-4760-b206-b667bb8466c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:55.738843 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837f892-3346-41cd-8769-9b9f5beba3e0 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:55.758963 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-eb8d26d3-fef9-4760-b206-b667bb8466c3 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:55.760188 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-eb8d26d3-fef9-4760-b206-b667bb8466c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:55.777041 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2ad4c-737e-4034-a4a8-f1fe484b0ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:55.778201 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2ad4c-737e-4034-a4a8-f1fe484b0ee5 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:55.782316 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2ad4c-737e-4034-a4a8-f1fe484b0ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:55.782316 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2ad4c-737e-4034-a4a8-f1fe484b0ee5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:55.791111 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca2ad4c-737e-4034-a4a8-f1fe484b0ee5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:55.792581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca2ad4c-737e-4034-a4a8-f1fe484b0ee5 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:55.810992 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-7ca2ad4c-737e-4034-a4a8-f1fe484b0ee5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:55.810992 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:55.810992 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:55.810992 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:55.810992 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:55.810992 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:55.810992 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:55.810992 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:55.810992 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:55.810992 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:55.810992 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:55.810992 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:55.810992 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:48:55.810992 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:48:55.810992 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:48:55.814400 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:48:55.814400 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:55.814400 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:55.814400 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:55.814400 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:55.814400 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:55.814400 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:55.814400 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:55.814400 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:55.814400 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:55.814400 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:55.814400 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:55.814400 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:55.814400 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:55.814400 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:55.814400 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:55.814400 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:55.817372 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:48:55.817372 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:48:55.817372 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:55.817372 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:55.817372 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 339/678] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:48:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:55.818746 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2ad4c-737e-4034-a4a8-f1fe484b0ee5 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:55.848026 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 340/679] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:48:55.848814 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d26d3-fef9-4760-b206-b667bb8466c3 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:55.953733 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2ad4c-737e-4034-a4a8-f1fe484b0ee5 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:55.974241 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d26d3-fef9-4760-b206-b667bb8466c3 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:55.989962 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a2583-f087-4db1-b13a-ce39c8801ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:55.990629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a2583-f087-4db1-b13a-ce39c8801ac9 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:55.990916 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a2583-f087-4db1-b13a-ce39c8801ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:55.991193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a2583-f087-4db1-b13a-ce39c8801ac9 None admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:55.991913 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288a2583-f087-4db1-b13a-ce39c8801ac9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:55.992223 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288a2583-f087-4db1-b13a-ce39c8801ac9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:55.993593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288a2583-f087-4db1-b13a-ce39c8801ac9 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:56.006446 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 340/680] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:48:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:56.006959 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a2583-f087-4db1-b13a-ce39c8801ac9 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:56.020705 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e8edb-bc7c-40a6-9a99-a6e4db7271a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:56.023048 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e8edb-bc7c-40a6-9a99-a6e4db7271a7 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:56.024070 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e8edb-bc7c-40a6-9a99-a6e4db7271a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:56.024722 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e8edb-bc7c-40a6-9a99-a6e4db7271a7 None admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:56.027036 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e8edb-bc7c-40a6-9a99-a6e4db7271a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:56.028044 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e8edb-bc7c-40a6-9a99-a6e4db7271a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:56.031076 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e8edb-bc7c-40a6-9a99-a6e4db7271a7 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:56.043693 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 341/681] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:48:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:56.044549 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e8edb-bc7c-40a6-9a99-a6e4db7271a7 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:56.114917 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a2583-f087-4db1-b13a-ce39c8801ac9 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:56.150087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc617f-8bfe-4d0d-8b78-f92a49457039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:56.151512 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc617f-8bfe-4d0d-8b78-f92a49457039 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:56.151917 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc617f-8bfe-4d0d-8b78-f92a49457039 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:56.152560 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc617f-8bfe-4d0d-8b78-f92a49457039 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:56.164647 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc617f-8bfe-4d0d-8b78-f92a49457039 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:48:56.170393 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e8edb-bc7c-40a6-9a99-a6e4db7271a7 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:56.175025 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-44bc617f-8bfe-4d0d-8b78-f92a49457039 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:48:56.175025 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:56.175025 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:56.175025 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:56.175025 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:56.175025 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:56.175025 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:56.175025 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:56.175025 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:56.175025 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:56.175025 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:56.175025 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:56.175025 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:48:56.175025 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:48:56.175025 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:48:56.175025 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:48:56.176129 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:48:56.176129 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:48:56.176129 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:48:56.176129 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:48:56.176129 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:56.176129 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:56.176129 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:56.176129 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:56.176129 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:56.176129 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:56.176129 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:56.176129 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:56.176129 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:56.176129 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:56.176129 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:56.176129 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:56.177163 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:56.177163 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:56.177163 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:56.177163 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:56.177163 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:48:56.177163 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:48:56.177163 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:48:56.177163 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:48:56.177163 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:48:56.177163 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:48:56.177163 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:48:56.177163 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:56.181798 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 341/682] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Apr 30 20:48:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:56.181798 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc617f-8bfe-4d0d-8b78-f92a49457039 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:56.208703 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151ecf5-fdc1-4823-a0a2-5483c248963a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:56.209924 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151ecf5-fdc1-4823-a0a2-5483c248963a None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:56.210659 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151ecf5-fdc1-4823-a0a2-5483c248963a None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:56.211117 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151ecf5-fdc1-4823-a0a2-5483c248963a None admin] PATH_INFO: `/v3/users/swift` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:56.222403 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7151ecf5-fdc1-4823-a0a2-5483c248963a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:56.225816 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7151ecf5-fdc1-4823-a0a2-5483c248963a None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:56.244827 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-7151ecf5-fdc1-4823-a0a2-5483c248963a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 30 20:48:56.244827 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:56.244827 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:56.244827 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:56.244827 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:56.244827 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:56.244827 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:56.244827 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:56.244827 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:56.244827 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:56.244827 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:56.244827 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:56.244827 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:48:56.244827 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:48:56.244827 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:48:56.244827 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:48:56.246058 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:56.246058 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:56.246058 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:48:56.246058 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:48:56.246058 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:48:56.246058 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:48:56.246058 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:56.246058 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:56.246058 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:56.246058 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:56.246058 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:56.246058 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:56.246058 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:56.246058 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:56.246058 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:56.246058 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:56.246058 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:56.246058 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:56.247215 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:56.247215 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:56.247215 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:48:56.247215 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:48:56.247215 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:48:56.247215 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:48:56.247215 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:48:56.247215 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:48:56.247215 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Apr 30 20:48:56.247215 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:56.253648 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 342/683] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Apr 30 20:48:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:56.254854 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151ecf5-fdc1-4823-a0a2-5483c248963a None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:56.302022 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc617f-8bfe-4d0d-8b78-f92a49457039 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:56.335966 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb0b2a9-e58d-4d2b-af30-fb635a25518e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:56.337020 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0b2a9-e58d-4d2b-af30-fb635a25518e None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:56.337452 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0b2a9-e58d-4d2b-af30-fb635a25518e None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:56.337903 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0b2a9-e58d-4d2b-af30-fb635a25518e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:56.345354 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb0b2a9-e58d-4d2b-af30-fb635a25518e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:56.347040 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb0b2a9-e58d-4d2b-af30-fb635a25518e None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:56.356420 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151ecf5-fdc1-4823-a0a2-5483c248963a None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:56.362632 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-7eb0b2a9-e58d-4d2b-af30-fb635a25518e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:48:56.362632 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:56.362632 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:56.362632 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:56.362632 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:56.362632 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:56.362632 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:56.362632 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:56.362632 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:56.362632 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:56.362632 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:56.362632 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:56.362632 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:48:56.362632 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:48:56.362632 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:48:56.363668 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:48:56.363668 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:56.363668 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:56.363668 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:56.363668 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:56.363668 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:56.363668 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:56.363668 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:56.363668 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:56.363668 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:56.363668 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:56.363668 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:56.363668 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:56.363668 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:56.363668 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:56.363668 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:56.363668 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:56.364762 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:48:56.364762 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:48:56.364762 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:48:56.364762 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:48:56.364762 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:48:56.364762 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:48:56.364762 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:48:56.364762 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:56.369994 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 342/684] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:48:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:56.371030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb0b2a9-e58d-4d2b-af30-fb635a25518e None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:56.393779 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810327b-b7fc-494b-86e9-d4260b17d178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:56.394736 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810327b-b7fc-494b-86e9-d4260b17d178 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:56.394981 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810327b-b7fc-494b-86e9-d4260b17d178 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:56.395379 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810327b-b7fc-494b-86e9-d4260b17d178 None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:56.396269 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c810327b-b7fc-494b-86e9-d4260b17d178 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:56.396646 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c810327b-b7fc-494b-86e9-d4260b17d178 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:56.398145 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c810327b-b7fc-494b-86e9-d4260b17d178 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:56.406837 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 343/685] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:48:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:56.407758 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810327b-b7fc-494b-86e9-d4260b17d178 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:56.481813 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb0b2a9-e58d-4d2b-af30-fb635a25518e None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:56.507020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810327b-b7fc-494b-86e9-d4260b17d178 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:56.516897 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e57fd01-5210-4fda-b3e1-e9eecd605ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:56.517743 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57fd01-5210-4fda-b3e1-e9eecd605ef7 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:56.518189 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57fd01-5210-4fda-b3e1-e9eecd605ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:56.518629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57fd01-5210-4fda-b3e1-e9eecd605ef7 None admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:56.519581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e57fd01-5210-4fda-b3e1-e9eecd605ef7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:56.520019 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e57fd01-5210-4fda-b3e1-e9eecd605ef7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:56.521587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e57fd01-5210-4fda-b3e1-e9eecd605ef7 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:56.540412 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 343/686] 10.222.0.23 () {56 vars in 1135 bytes} [Sat Apr 30 20:48:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:56.543826 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e57fd01-5210-4fda-b3e1-e9eecd605ef7 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:56.548817 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51175d0-5cfe-4f6c-acd2-f276460870b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:56.549540 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51175d0-5cfe-4f6c-acd2-f276460870b0 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:56.549850 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51175d0-5cfe-4f6c-acd2-f276460870b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:56.550127 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51175d0-5cfe-4f6c-acd2-f276460870b0 None admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:56.551026 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51175d0-5cfe-4f6c-acd2-f276460870b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:56.551779 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51175d0-5cfe-4f6c-acd2-f276460870b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:56.553705 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51175d0-5cfe-4f6c-acd2-f276460870b0 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:56.581484 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 344/687] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Apr 30 20:48:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:56.582810 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51175d0-5cfe-4f6c-acd2-f276460870b0 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:56.653453 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e57fd01-5210-4fda-b3e1-e9eecd605ef7 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:56.687683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00937732-318d-4e66-a068-e1ecb56cfc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:56.688474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00937732-318d-4e66-a068-e1ecb56cfc58 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:56.688752 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00937732-318d-4e66-a068-e1ecb56cfc58 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:56.689022 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00937732-318d-4e66-a068-e1ecb56cfc58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:56.693332 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51175d0-5cfe-4f6c-acd2-f276460870b0 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:56.700264 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00937732-318d-4e66-a068-e1ecb56cfc58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:56.702439 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00937732-318d-4e66-a068-e1ecb56cfc58 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:56.721484 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-00937732-318d-4e66-a068-e1ecb56cfc58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:56.721484 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:56.721484 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:56.721484 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:56.721484 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:56.721484 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:56.721484 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:56.721484 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:56.721484 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:56.721484 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:56.721484 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:56.721484 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:56.721484 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:48:56.721484 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:48:56.721484 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:48:56.723820 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:48:56.723820 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:56.723820 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:56.723820 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:56.723820 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:56.723820 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:56.723820 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:56.723820 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:56.723820 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:56.723820 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:56.723820 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:56.723820 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:56.723820 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:56.723820 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:56.723820 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:56.723820 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:56.723820 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:56.726076 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:48:56.726076 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:48:56.726076 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:56.726076 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:56.726076 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 344/688] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:48:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:56.726076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00937732-318d-4e66-a068-e1ecb56cfc58 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:56.732027 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606482a-4fc5-4ab1-ade3-727f6f38cc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:56.735843 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606482a-4fc5-4ab1-ade3-727f6f38cc4b None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:56.735843 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606482a-4fc5-4ab1-ade3-727f6f38cc4b None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:56.735843 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606482a-4fc5-4ab1-ade3-727f6f38cc4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:56.801923 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606482a-4fc5-4ab1-ade3-727f6f38cc4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:56.804190 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606482a-4fc5-4ab1-ade3-727f6f38cc4b None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:56.822354 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00937732-318d-4e66-a068-e1ecb56cfc58 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:56.856691 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5841a-9736-4b2c-a008-5665b9a61745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:56.857373 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5841a-9736-4b2c-a008-5665b9a61745 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:56.857650 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5841a-9736-4b2c-a008-5665b9a61745 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:56.857952 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5841a-9736-4b2c-a008-5665b9a61745 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:56.858772 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a5841a-9736-4b2c-a008-5665b9a61745 None admin] RBAC: Adding query filter params (role.id=0971c8bf92d64c50a5cbbf7d146af841, scope.project.id=6b52e5e13b9144dfb663578766c2bac0, user.id=0b0cb145b72a492ebb8c0e9223be47a1) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:56.859136 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a5841a-9736-4b2c-a008-5665b9a61745 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:56.860621 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a5841a-9736-4b2c-a008-5665b9a61745 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:56.874100 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 345/689] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:48:56 2022] GET /identity/v3/role_assignments?user.id=0b0cb145b72a492ebb8c0e9223be47a1&scope.project.id=6b52e5e13b9144dfb663578766c2bac0&role.id=0971c8bf92d64c50a5cbbf7d146af841 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:56.875164 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5841a-9736-4b2c-a008-5665b9a61745 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:56.930966 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 345/690] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:48:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:48:56.936986 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606482a-4fc5-4ab1-ade3-727f6f38cc4b None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:56.978436 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5841a-9736-4b2c-a008-5665b9a61745 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:57.024477 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf8348-1b8f-4903-b254-516f717e9266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:57.025054 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf8348-1b8f-4903-b254-516f717e9266 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:57.025332 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf8348-1b8f-4903-b254-516f717e9266 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:57.025605 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf8348-1b8f-4903-b254-516f717e9266 None admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:57.027210 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf8348-1b8f-4903-b254-516f717e9266 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:57.027518 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf8348-1b8f-4903-b254-516f717e9266 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:57.028959 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf8348-1b8f-4903-b254-516f717e9266 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:57.058055 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 346/691] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:48:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:57.064912 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf8348-1b8f-4903-b254-516f717e9266 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:57.113542 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606482a-4fc5-4ab1-ade3-727f6f38cc4b None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:57.178755 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989bf54-f6e1-4c2f-877f-3028f458b653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:57.179596 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989bf54-f6e1-4c2f-877f-3028f458b653 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:57.179883 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989bf54-f6e1-4c2f-877f-3028f458b653 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:57.180154 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989bf54-f6e1-4c2f-877f-3028f458b653 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:57.190881 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a989bf54-f6e1-4c2f-877f-3028f458b653 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:57.192334 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a989bf54-f6e1-4c2f-877f-3028f458b653 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:57.212178 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-a989bf54-f6e1-4c2f-877f-3028f458b653 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:57.212178 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:57.212178 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:57.212178 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:57.212178 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:57.212178 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:57.212178 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:57.212178 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:57.212178 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:57.212178 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:57.212178 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:57.212178 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:57.212178 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:48:57.212178 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:48:57.212178 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:48:57.225086 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:48:57.225086 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:57.225086 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:57.225086 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:57.225086 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:57.225086 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:57.225086 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:57.225086 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:57.225086 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:57.225086 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:57.225086 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:57.225086 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:57.225086 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:57.225086 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:57.225086 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:57.225086 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:57.225086 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:57.227358 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:48:57.227358 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:48:57.227358 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:57.227358 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:57.227358 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 346/692] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:48:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:48:57.227358 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989bf54-f6e1-4c2f-877f-3028f458b653 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:57.228146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf8348-1b8f-4903-b254-516f717e9266 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:57.258924 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ece9a-0b20-4682-a2ea-7097e521470d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:57.259710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ece9a-0b20-4682-a2ea-7097e521470d None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:57.259984 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ece9a-0b20-4682-a2ea-7097e521470d None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:57.260253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ece9a-0b20-4682-a2ea-7097e521470d None admin] PATH_INFO: `/v3/users/nova` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:57.270756 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ece9a-0b20-4682-a2ea-7097e521470d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:57.276342 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ece9a-0b20-4682-a2ea-7097e521470d None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:57.291293 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-e96ece9a-0b20-4682-a2ea-7097e521470d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 30 20:48:57.291293 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:57.291293 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:57.291293 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:57.291293 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:57.291293 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:57.291293 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:57.291293 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:57.291293 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:57.291293 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:57.291293 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:57.291293 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:57.291293 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:48:57.291293 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:48:57.291293 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:48:57.291293 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:48:57.294427 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:57.294427 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:57.294427 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:48:57.294427 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:48:57.294427 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:48:57.294427 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:48:57.294427 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:57.294427 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:57.294427 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:57.294427 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:57.294427 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:57.294427 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:57.294427 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:57.294427 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:57.294427 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:57.294427 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:57.294427 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:57.294427 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:57.296794 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:57.296794 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:57.296794 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:48:57.296794 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:48:57.296794 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:48:57.296794 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:48:57.296794 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:48:57.296794 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:48:57.296794 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Apr 30 20:48:57.296794 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:57.296794 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 347/693] 10.222.0.23 () {56 vars in 1093 bytes} [Sat Apr 30 20:48:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:57.303656 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ece9a-0b20-4682-a2ea-7097e521470d None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:57.324616 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989bf54-f6e1-4c2f-877f-3028f458b653 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:57.377783 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef97d0-d141-48e1-932a-c445489b24af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:57.377783 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef97d0-d141-48e1-932a-c445489b24af None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:57.377783 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef97d0-d141-48e1-932a-c445489b24af None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:57.377783 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef97d0-d141-48e1-932a-c445489b24af None admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:57.378212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef97d0-d141-48e1-932a-c445489b24af None admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:57.378212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef97d0-d141-48e1-932a-c445489b24af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:57.378212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef97d0-d141-48e1-932a-c445489b24af None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:57.405194 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 347/694] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:48:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:57.407641 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef97d0-d141-48e1-932a-c445489b24af None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:57.469329 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ece9a-0b20-4682-a2ea-7097e521470d None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:57.546381 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db85514-659b-403f-8824-24ce7222be31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:57.546971 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db85514-659b-403f-8824-24ce7222be31 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:57.547247 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db85514-659b-403f-8824-24ce7222be31 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:57.547515 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db85514-659b-403f-8824-24ce7222be31 None admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:57.548346 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db85514-659b-403f-8824-24ce7222be31 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:57.548649 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db85514-659b-403f-8824-24ce7222be31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:57.550115 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db85514-659b-403f-8824-24ce7222be31 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:57.588494 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 348/695] 10.222.0.23 () {56 vars in 1133 bytes} [Sat Apr 30 20:48:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:48:57.591125 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef97d0-d141-48e1-932a-c445489b24af None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:57.595412 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db85514-659b-403f-8824-24ce7222be31 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:57.645616 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c3904-621d-412c-8c06-ed469f00103d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:57.646444 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c3904-621d-412c-8c06-ed469f00103d None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:57.647033 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c3904-621d-412c-8c06-ed469f00103d None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:57.647308 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c3904-621d-412c-8c06-ed469f00103d None admin] PATH_INFO: `/v3/projects/service` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:57.654673 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128c3904-621d-412c-8c06-ed469f00103d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:57.656551 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128c3904-621d-412c-8c06-ed469f00103d None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:57.673308 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-128c3904-621d-412c-8c06-ed469f00103d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:48:57.673308 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:57.673308 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:57.673308 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:57.673308 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:57.673308 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:57.673308 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:57.673308 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:57.673308 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:57.673308 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:57.673308 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:57.673308 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:57.673308 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:48:57.673308 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:48:57.673308 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:48:57.674265 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:48:57.674265 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:57.674265 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:57.674265 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:57.674265 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:57.674265 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:57.674265 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:57.674265 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:57.674265 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:57.674265 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:57.674265 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:57.674265 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:57.674265 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:57.674265 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:57.674265 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:57.674265 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:57.674265 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:57.675142 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:48:57.675142 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:48:57.675142 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:48:57.675142 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:48:57.675142 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:48:57.675142 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:48:57.675142 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:48:57.675142 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:57.675142 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 348/696] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:48:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:57.682372 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c3904-621d-412c-8c06-ed469f00103d None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:57.780183 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db85514-659b-403f-8824-24ce7222be31 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:57.821272 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c69933-40c1-4794-841b-cebc645cd51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:57.821864 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c69933-40c1-4794-841b-cebc645cd51a None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:57.822145 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c69933-40c1-4794-841b-cebc645cd51a None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:57.822417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c69933-40c1-4794-841b-cebc645cd51a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:57.855427 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c3904-621d-412c-8c06-ed469f00103d None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:57.916673 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c69933-40c1-4794-841b-cebc645cd51a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:57.918348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c69933-40c1-4794-841b-cebc645cd51a None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:57.928292 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e81c9f7-d06a-4552-b04a-d96848579699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:57.929223 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81c9f7-d06a-4552-b04a-d96848579699 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:57.929692 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81c9f7-d06a-4552-b04a-d96848579699 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:57.930152 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81c9f7-d06a-4552-b04a-d96848579699 None admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:57.937798 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e81c9f7-d06a-4552-b04a-d96848579699 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:57.937798 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e81c9f7-d06a-4552-b04a-d96848579699 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:57.937798 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e81c9f7-d06a-4552-b04a-d96848579699 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:57.959539 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 349/697] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Apr 30 20:48:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:57.965193 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e81c9f7-d06a-4552-b04a-d96848579699 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:58.028153 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 349/698] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:48:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:48:58.030071 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79f3b7-7b3c-46a2-b90d-cee775206331 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:58.030357 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79f3b7-7b3c-46a2-b90d-cee775206331 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:58.030633 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79f3b7-7b3c-46a2-b90d-cee775206331 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:58.035821 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 350/699] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:58.036618 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd79f3b7-7b3c-46a2-b90d-cee775206331 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:58.100545 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e81c9f7-d06a-4552-b04a-d96848579699 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:58.140054 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86116c-fbeb-4007-ac7d-3d4c6932f57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:58.140720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86116c-fbeb-4007-ac7d-3d4c6932f57c None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:58.141058 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86116c-fbeb-4007-ac7d-3d4c6932f57c None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:58.141339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86116c-fbeb-4007-ac7d-3d4c6932f57c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:58.142244 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86116c-fbeb-4007-ac7d-3d4c6932f57c None admin] RBAC: Adding query filter params (role.id=0971c8bf92d64c50a5cbbf7d146af841, scope.project.id=6b52e5e13b9144dfb663578766c2bac0, user.id=27edf527e36c4ee7a9065688f4bed942) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:58.142560 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86116c-fbeb-4007-ac7d-3d4c6932f57c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:58.144001 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86116c-fbeb-4007-ac7d-3d4c6932f57c None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:58.154585 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 350/700] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:48:57 2022] GET /identity/v3/role_assignments?user.id=27edf527e36c4ee7a9065688f4bed942&scope.project.id=6b52e5e13b9144dfb663578766c2bac0&role.id=0971c8bf92d64c50a5cbbf7d146af841 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:58.156027 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ef68f-65c7-4ee6-950a-dcb9d24b7869 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:58.156322 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ef68f-65c7-4ee6-950a-dcb9d24b7869 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:58.156595 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ef68f-65c7-4ee6-950a-dcb9d24b7869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:58.158183 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd79f3b7-7b3c-46a2-b90d-cee775206331 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:58.193275 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-fe1ef68f-65c7-4ee6-950a-dcb9d24b7869 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:58.194365 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-fe1ef68f-65c7-4ee6-950a-dcb9d24b7869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:58.198808 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27370ee-3e9c-4f00-93c6-7922e71748a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:58.199863 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27370ee-3e9c-4f00-93c6-7922e71748a8 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:58.200289 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27370ee-3e9c-4f00-93c6-7922e71748a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:58.200705 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27370ee-3e9c-4f00-93c6-7922e71748a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:58.213946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27370ee-3e9c-4f00-93c6-7922e71748a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:58.216186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27370ee-3e9c-4f00-93c6-7922e71748a8 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:58.239074 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-a27370ee-3e9c-4f00-93c6-7922e71748a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:58.239074 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:58.239074 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:58.239074 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:58.239074 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:58.239074 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:58.239074 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:58.239074 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:58.239074 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:58.239074 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:58.239074 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:58.239074 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:58.239074 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:48:58.239074 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:48:58.239074 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:48:58.240264 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:48:58.240264 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:58.240264 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:58.240264 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:58.240264 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:58.240264 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:58.240264 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:58.240264 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:58.240264 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:58.240264 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:58.240264 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:58.240264 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:58.240264 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:58.240264 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:58.240264 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:58.240264 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:58.240264 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:58.241920 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:48:58.241920 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:48:58.241920 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:58.241920 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:58.246166 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 351/701] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:48:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:58.255357 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27370ee-3e9c-4f00-93c6-7922e71748a8 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:58.327524 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 351/702] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:48:58.329052 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba77144-15a7-4426-832a-73d2ea62548c None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:58.329463 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba77144-15a7-4426-832a-73d2ea62548c None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:58.332486 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba77144-15a7-4426-832a-73d2ea62548c None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:58.332486 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 352/703] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:58.337796 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3619f2d-d19e-4413-ae70-9bc33d738a91 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:58.338091 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3619f2d-d19e-4413-ae70-9bc33d738a91 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:58.338387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3619f2d-d19e-4413-ae70-9bc33d738a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:58.369579 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-b3619f2d-d19e-4413-ae70-9bc33d738a91 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:58.370736 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b3619f2d-d19e-4413-ae70-9bc33d738a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:58.423857 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27370ee-3e9c-4f00-93c6-7922e71748a8 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:58.461856 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 353/704] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 20:48:58.461856 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3619f2d-d19e-4413-ae70-9bc33d738a91 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:58.471704 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cce29e-0bb2-4caf-aed5-602b6a816401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:58.472744 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cce29e-0bb2-4caf-aed5-602b6a816401 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:58.473021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cce29e-0bb2-4caf-aed5-602b6a816401 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:58.473293 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cce29e-0bb2-4caf-aed5-602b6a816401 None admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:58.474166 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cce29e-0bb2-4caf-aed5-602b6a816401 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:58.474356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cce29e-0bb2-4caf-aed5-602b6a816401 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:58.475894 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cce29e-0bb2-4caf-aed5-602b6a816401 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:58.491414 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 352/705] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:48:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:58.492260 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cce29e-0bb2-4caf-aed5-602b6a816401 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:58.583539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3619f2d-d19e-4413-ae70-9bc33d738a91 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:58.607793 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cce29e-0bb2-4caf-aed5-602b6a816401 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:58.625601 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc31f8-86d5-4933-8cc5-50868385a12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:58.626428 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc31f8-86d5-4933-8cc5-50868385a12f None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:58.627135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc31f8-86d5-4933-8cc5-50868385a12f None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:58.627418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc31f8-86d5-4933-8cc5-50868385a12f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:58.628554 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc31f8-86d5-4933-8cc5-50868385a12f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:58.631113 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc31f8-86d5-4933-8cc5-50868385a12f None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:58.640481 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419bd22-246d-4836-b962-a5588861a558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:58.641266 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419bd22-246d-4836-b962-a5588861a558 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:58.641539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419bd22-246d-4836-b962-a5588861a558 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:58.641836 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419bd22-246d-4836-b962-a5588861a558 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:58.647478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-6cdc31f8-86d5-4933-8cc5-50868385a12f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 30 20:48:58.647478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:58.647478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:48:58.647478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:48:58.647478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:48:58.647478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:48:58.647478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:48:58.647478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:48:58.647478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 30 20:48:58.647478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:58.647478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:48:58.647478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:58.647478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:58.647478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:58.647478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:58.647478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:58.648407 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:58.648407 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:58.648407 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:58.648407 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:58.648407 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:58.648407 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:58.648407 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:58.648407 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:48:58.648407 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:48:58.648407 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:48:58.648407 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:48:58.648407 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:58.648407 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:58.648407 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:58.648407 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:58.648407 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:58.649260 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:58.649260 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:58.649260 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:58.649260 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:58.649260 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:58.649260 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:58.649260 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:58.649260 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:58.649260 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:58.649260 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:58.649260 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:58.649260 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:48:58.649260 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:48:58.649260 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 30 20:48:58.649260 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:58.649260 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 354/706] 10.222.0.23 () {56 vars in 1129 bytes} [Sat Apr 30 20:48:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:58.650622 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc31f8-86d5-4933-8cc5-50868385a12f None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:58.654535 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419bd22-246d-4836-b962-a5588861a558 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:58.656110 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419bd22-246d-4836-b962-a5588861a558 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:58.673257 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-8419bd22-246d-4836-b962-a5588861a558 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:58.673257 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:58.673257 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:58.673257 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:58.673257 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:58.673257 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:58.673257 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:58.673257 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:58.673257 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:58.673257 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:58.673257 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:58.673257 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:58.673257 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:48:58.673257 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:48:58.673257 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:48:58.675454 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:48:58.675454 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:58.675454 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:58.675454 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:58.675454 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:58.675454 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:58.675454 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:58.675454 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:58.675454 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:58.675454 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:58.675454 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:58.675454 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:58.675454 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:58.675454 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:58.675454 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:58.675454 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:58.675454 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:58.677946 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:48:58.677946 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:48:58.677946 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:48:58.677946 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:58.677946 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 353/707] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:48:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:58.677946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419bd22-246d-4836-b962-a5588861a558 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:58.768805 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc31f8-86d5-4933-8cc5-50868385a12f None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:58.800483 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419bd22-246d-4836-b962-a5588861a558 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:58.805193 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe814704-545a-4ff4-bd2c-121313507b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:58.806330 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe814704-545a-4ff4-bd2c-121313507b26 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:58.806721 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe814704-545a-4ff4-bd2c-121313507b26 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:58.807100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe814704-545a-4ff4-bd2c-121313507b26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:58.814520 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe814704-545a-4ff4-bd2c-121313507b26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:58.817123 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe814704-545a-4ff4-bd2c-121313507b26 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:58.833576 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-fe814704-545a-4ff4-bd2c-121313507b26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:48:58.833576 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:58.833576 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:58.833576 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:58.833576 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:58.833576 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:58.833576 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:58.833576 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:58.833576 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:58.833576 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:58.833576 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:58.833576 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:58.833576 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:48:58.833576 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:48:58.833576 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:48:58.835160 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:48:58.835160 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:58.835160 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:58.835160 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:58.835160 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:58.835160 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:58.835160 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:58.835160 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:58.835160 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:58.835160 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:58.835160 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:58.835160 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:58.835160 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:58.835160 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:58.835160 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:58.835160 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:58.835160 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:58.837220 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:48:58.837220 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:48:58.837220 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:48:58.837220 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:48:58.837220 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:48:58.837220 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:48:58.837220 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:48:58.837220 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:48:58.837220 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 355/708] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:48:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:58.838242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe814704-545a-4ff4-bd2c-121313507b26 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:58.843246 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c72059-af27-4133-b02f-eb5cf0f1ad78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:58.843936 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c72059-af27-4133-b02f-eb5cf0f1ad78 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:58.844219 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c72059-af27-4133-b02f-eb5cf0f1ad78 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:58.844496 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c72059-af27-4133-b02f-eb5cf0f1ad78 None admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:58.845464 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c72059-af27-4133-b02f-eb5cf0f1ad78 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:58.845888 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c72059-af27-4133-b02f-eb5cf0f1ad78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:58.847185 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c72059-af27-4133-b02f-eb5cf0f1ad78 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:58.854800 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 354/709] 10.222.0.23 () {56 vars in 1124 bytes} [Sat Apr 30 20:48:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:58.855646 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c72059-af27-4133-b02f-eb5cf0f1ad78 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:58.964661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe814704-545a-4ff4-bd2c-121313507b26 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:58.979930 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c72059-af27-4133-b02f-eb5cf0f1ad78 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:59.007995 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044cd3f-d167-4208-bdaa-7d02e26731e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:59.009036 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044cd3f-d167-4208-bdaa-7d02e26731e1 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:59.009324 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044cd3f-d167-4208-bdaa-7d02e26731e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:59.016469 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044cd3f-d167-4208-bdaa-7d02e26731e1 None admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:59.016469 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e044cd3f-d167-4208-bdaa-7d02e26731e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:59.016469 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e044cd3f-d167-4208-bdaa-7d02e26731e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:59.016469 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e044cd3f-d167-4208-bdaa-7d02e26731e1 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:59.017566 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078509df-92c3-4b0c-86e3-0a483e94233d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:59.018461 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078509df-92c3-4b0c-86e3-0a483e94233d None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:59.018912 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078509df-92c3-4b0c-86e3-0a483e94233d None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:59.019351 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078509df-92c3-4b0c-86e3-0a483e94233d None admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:59.020293 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078509df-92c3-4b0c-86e3-0a483e94233d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:59.020772 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078509df-92c3-4b0c-86e3-0a483e94233d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:59.022446 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078509df-92c3-4b0c-86e3-0a483e94233d None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:59.030859 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 356/710] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:48:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:59.030859 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044cd3f-d167-4208-bdaa-7d02e26731e1 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:59.044646 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 355/711] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Apr 30 20:48:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:59.046513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078509df-92c3-4b0c-86e3-0a483e94233d None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:59.155426 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044cd3f-d167-4208-bdaa-7d02e26731e1 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:59.162218 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078509df-92c3-4b0c-86e3-0a483e94233d None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:59.200121 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22117725-67c5-4658-8d18-642bcf9462cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:59.201153 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22117725-67c5-4658-8d18-642bcf9462cb None admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:59.201611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22117725-67c5-4658-8d18-642bcf9462cb None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:59.202126 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22117725-67c5-4658-8d18-642bcf9462cb None admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:59.203007 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22117725-67c5-4658-8d18-642bcf9462cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:59.204654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22117725-67c5-4658-8d18-642bcf9462cb None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:59.217031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521217c3-057d-403f-bf7a-27972c06ee5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:59.217692 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521217c3-057d-403f-bf7a-27972c06ee5c None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:59.218018 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521217c3-057d-403f-bf7a-27972c06ee5c None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:59.218293 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521217c3-057d-403f-bf7a-27972c06ee5c None admin] PATH_INFO: `/v3/services` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:59.219216 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521217c3-057d-403f-bf7a-27972c06ee5c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:59.219470 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521217c3-057d-403f-bf7a-27972c06ee5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:59.221363 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521217c3-057d-403f-bf7a-27972c06ee5c None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:59.229883 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 357/712] 10.222.0.23 () {56 vars in 1124 bytes} [Sat Apr 30 20:48:59 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:59.230302 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521217c3-057d-403f-bf7a-27972c06ee5c None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:59.337604 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 356/713] 10.222.0.23 () {60 vars in 1132 bytes} [Sat Apr 30 20:48:59 2022] POST /identity/v3/users => generated 254 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:48:59.366589 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521217c3-057d-403f-bf7a-27972c06ee5c None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:59.418590 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5841ed-b705-45fc-9d13-b4be30a08fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:59.419307 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5841ed-b705-45fc-9d13-b4be30a08fc5 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:59.420183 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5841ed-b705-45fc-9d13-b4be30a08fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:59.420468 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5841ed-b705-45fc-9d13-b4be30a08fc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:59.421332 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5841ed-b705-45fc-9d13-b4be30a08fc5 None admin] RBAC: Adding query filter params (role.id=30112eb1f3e047398c3c82fb40b72e62, scope.project.id=6b52e5e13b9144dfb663578766c2bac0, user.id=fca4ee1f64c8489ebe7296f9f8f0ab41) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:48:59.421645 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5841ed-b705-45fc-9d13-b4be30a08fc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:59.423231 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5841ed-b705-45fc-9d13-b4be30a08fc5 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:59.434956 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 358/714] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:48:59 2022] GET /identity/v3/role_assignments?user.id=fca4ee1f64c8489ebe7296f9f8f0ab41&scope.project.id=6b52e5e13b9144dfb663578766c2bac0&role.id=30112eb1f3e047398c3c82fb40b72e62 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:48:59.652102 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46aecf-898f-481a-bb64-c8c42ec4aceb None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:59.652400 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46aecf-898f-481a-bb64-c8c42ec4aceb None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:59.652582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46aecf-898f-481a-bb64-c8c42ec4aceb None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:59.654895 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 357/715] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:48:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:48:59.660788 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df2a01-4a6c-47d5-a951-d58360b0fdab None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:59.661079 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df2a01-4a6c-47d5-a951-d58360b0fdab None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:59.661364 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df2a01-4a6c-47d5-a951-d58360b0fdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:59.682504 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-72df2a01-4a6c-47d5-a951-d58360b0fdab None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:48:59.683739 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-72df2a01-4a6c-47d5-a951-d58360b0fdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:48:59.777870 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 359/716] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:48:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:48:59.798181 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec46aecf-898f-481a-bb64-c8c42ec4aceb None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:48:59.900730 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec46aecf-898f-481a-bb64-c8c42ec4aceb None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:48:59.947491 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ddb8ae-1c65-4469-88a8-65d1ae89f545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:48:59.948295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ddb8ae-1c65-4469-88a8-65d1ae89f545 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:48:59.948632 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ddb8ae-1c65-4469-88a8-65d1ae89f545 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:48:59.948912 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ddb8ae-1c65-4469-88a8-65d1ae89f545 None admin] PATH_INFO: `/v3/services/network` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:48:59.949568 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ddb8ae-1c65-4469-88a8-65d1ae89f545 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:48:59.953414 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ddb8ae-1c65-4469-88a8-65d1ae89f545 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:48:59.970339 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-34ddb8ae-1c65-4469-88a8-65d1ae89f545 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 30 20:48:59.970339 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:59.970339 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:48:59.970339 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:48:59.970339 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:48:59.970339 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:48:59.970339 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:48:59.970339 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:48:59.970339 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Apr 30 20:48:59.970339 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:59.970339 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:48:59.970339 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:59.970339 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:48:59.970339 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:48:59.970339 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:48:59.970339 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:48:59.970339 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:48:59.971419 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:48:59.971419 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:48:59.971419 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:48:59.971419 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:48:59.971419 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:48:59.971419 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:48:59.971419 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:48:59.971419 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:48:59.971419 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:48:59.971419 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:48:59.971419 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:48:59.971419 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:48:59.971419 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:48:59.971419 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:48:59.971419 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:48:59.971419 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:48:59.972274 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:48:59.972274 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:48:59.972274 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:48:59.972274 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:48:59.972274 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:48:59.972274 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:48:59.972274 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:48:59.972274 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:48:59.972274 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:48:59.972274 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:48:59.972274 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:48:59.972274 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:48:59.972274 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Apr 30 20:48:59.972274 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:48:59.976328 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 358/717] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:48:59 2022] GET /identity/v3/services/network => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:48:59.977744 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df2a01-4a6c-47d5-a951-d58360b0fdab None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:00.084338 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df2a01-4a6c-47d5-a951-d58360b0fdab None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:00.119588 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a81590-355b-4169-99a8-bb73be5857c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:00.120252 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a81590-355b-4169-99a8-bb73be5857c9 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:00.120533 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a81590-355b-4169-99a8-bb73be5857c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:00.120808 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a81590-355b-4169-99a8-bb73be5857c9 None admin] PATH_INFO: `/v3/services` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:00.121506 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a81590-355b-4169-99a8-bb73be5857c9 None admin] RBAC: Adding query filter params (name=network) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:00.121833 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a81590-355b-4169-99a8-bb73be5857c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:00.123224 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a81590-355b-4169-99a8-bb73be5857c9 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:00.132053 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 360/718] 10.222.0.23 () {56 vars in 1112 bytes} [Sat Apr 30 20:48:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:00.134002 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ddb8ae-1c65-4469-88a8-65d1ae89f545 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:00.265706 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ddb8ae-1c65-4469-88a8-65d1ae89f545 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:00.324310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456edca7-992e-4902-91f3-30d7e40ef3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:00.324973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456edca7-992e-4902-91f3-30d7e40ef3b6 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:00.325249 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456edca7-992e-4902-91f3-30d7e40ef3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:00.325520 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456edca7-992e-4902-91f3-30d7e40ef3b6 None admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:00.326822 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456edca7-992e-4902-91f3-30d7e40ef3b6 None admin] RBAC: Adding query filter params (type=network) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:00.327125 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456edca7-992e-4902-91f3-30d7e40ef3b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:00.328507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456edca7-992e-4902-91f3-30d7e40ef3b6 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:00.336550 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 359/719] 10.222.0.23 () {56 vars in 1112 bytes} [Sat Apr 30 20:49:00 2022] GET /identity/v3/services?type=network => generated 124 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:01.198811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98afb20-905e-4be0-8f1e-8376d26dfa75 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:01.199333 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98afb20-905e-4be0-8f1e-8376d26dfa75 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:01.199413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98afb20-905e-4be0-8f1e-8376d26dfa75 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:01.201098 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 361/720] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:49:01.206007 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25573007-ac4c-410c-8487-c201db887a64 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:01.206402 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25573007-ac4c-410c-8487-c201db887a64 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:01.206564 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25573007-ac4c-410c-8487-c201db887a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:01.230772 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-25573007-ac4c-410c-8487-c201db887a64 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:01.232008 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-25573007-ac4c-410c-8487-c201db887a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:01.319630 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 360/721] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:49:01.360059 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98afb20-905e-4be0-8f1e-8376d26dfa75 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:01.502828 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98afb20-905e-4be0-8f1e-8376d26dfa75 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:01.537151 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580cc31-1288-446d-a281-5b256426302c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:01.538047 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580cc31-1288-446d-a281-5b256426302c None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:01.538425 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580cc31-1288-446d-a281-5b256426302c None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:01.538709 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580cc31-1288-446d-a281-5b256426302c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:01.549545 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580cc31-1288-446d-a281-5b256426302c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:49:01.557478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-f580cc31-1288-446d-a281-5b256426302c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:49:01.557478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:01.557478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:01.557478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:01.557478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:01.557478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:01.557478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:01.557478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:01.557478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:01.557478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:01.557478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:01.557478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:01.557478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:49:01.557478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:49:01.557478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:49:01.557478 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:49:01.558439 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:49:01.558439 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:49:01.558439 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:49:01.558439 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:49:01.558439 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:01.558439 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:01.558439 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:01.558439 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:01.558439 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:01.558439 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:01.558439 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:01.558439 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:01.558439 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:01.558439 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:01.558439 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:01.558439 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:01.559285 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:01.559285 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:01.559285 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:01.559285 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:01.559285 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:49:01.559285 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:49:01.559285 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:49:01.559285 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:49:01.559285 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:49:01.559285 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:49:01.559285 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:49:01.559285 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:01.559285 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 362/722] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Apr 30 20:49:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:01.567224 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25573007-ac4c-410c-8487-c201db887a64 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:01.677657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25573007-ac4c-410c-8487-c201db887a64 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:01.712233 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5623cb-93c6-43d1-bb88-2a895073fc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:01.713270 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5623cb-93c6-43d1-bb88-2a895073fc72 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:01.713780 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5623cb-93c6-43d1-bb88-2a895073fc72 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:01.714266 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5623cb-93c6-43d1-bb88-2a895073fc72 None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:01.715219 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5623cb-93c6-43d1-bb88-2a895073fc72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:01.715758 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5623cb-93c6-43d1-bb88-2a895073fc72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:01.717961 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5623cb-93c6-43d1-bb88-2a895073fc72 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:01.727556 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 361/723] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:49:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:01.732897 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580cc31-1288-446d-a281-5b256426302c None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:01.838581 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580cc31-1288-446d-a281-5b256426302c None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:01.877229 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365bb16-9e5e-4b72-8221-a3e31aec97e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:01.878188 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365bb16-9e5e-4b72-8221-a3e31aec97e0 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:01.878473 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365bb16-9e5e-4b72-8221-a3e31aec97e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:01.878746 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365bb16-9e5e-4b72-8221-a3e31aec97e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:01.893075 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f365bb16-9e5e-4b72-8221-a3e31aec97e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:01.894575 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f365bb16-9e5e-4b72-8221-a3e31aec97e0 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:01.919302 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-f365bb16-9e5e-4b72-8221-a3e31aec97e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:01.919302 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:01.919302 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:01.919302 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:01.919302 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:01.919302 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:01.919302 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:01.919302 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:01.919302 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:01.919302 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:01.919302 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:01.919302 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:01.919302 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:49:01.919302 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:49:01.919302 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:49:01.920273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:49:01.920273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:01.920273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:01.920273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:01.920273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:01.920273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:01.920273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:01.920273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:01.920273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:01.920273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:01.920273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:01.920273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:01.920273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:01.920273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:01.920273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:01.920273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:01.920273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:01.921158 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:49:01.921158 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:49:01.921158 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:01.921158 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:01.921158 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 363/724] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:49:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:01.926044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5623cb-93c6-43d1-bb88-2a895073fc72 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:02.073547 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5623cb-93c6-43d1-bb88-2a895073fc72 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:02.118413 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7116d2-7057-42f4-b7d3-6107865d42d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:02.118991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7116d2-7057-42f4-b7d3-6107865d42d1 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:02.119270 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7116d2-7057-42f4-b7d3-6107865d42d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:02.119540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7116d2-7057-42f4-b7d3-6107865d42d1 None admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:02.120256 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7116d2-7057-42f4-b7d3-6107865d42d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:02.120560 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7116d2-7057-42f4-b7d3-6107865d42d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:02.121959 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7116d2-7057-42f4-b7d3-6107865d42d1 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:02.137661 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 362/725] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:49:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:02.143975 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365bb16-9e5e-4b72-8221-a3e31aec97e0 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:02.274307 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365bb16-9e5e-4b72-8221-a3e31aec97e0 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:02.313874 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b535d0-f054-47d0-a5c0-65e34f8dfab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:02.314795 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b535d0-f054-47d0-a5c0-65e34f8dfab9 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:02.315078 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b535d0-f054-47d0-a5c0-65e34f8dfab9 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:02.315351 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b535d0-f054-47d0-a5c0-65e34f8dfab9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:02.330595 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b535d0-f054-47d0-a5c0-65e34f8dfab9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:02.332062 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b535d0-f054-47d0-a5c0-65e34f8dfab9 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:02.347462 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-f8b535d0-f054-47d0-a5c0-65e34f8dfab9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 30 20:49:02.347462 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:02.347462 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:02.347462 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:02.347462 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:02.347462 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:02.347462 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:02.347462 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:02.347462 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:02.347462 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:02.347462 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:02.347462 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:02.347462 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:49:02.347462 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:49:02.347462 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:49:02.347462 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:49:02.348480 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:02.348480 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:02.348480 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:49:02.348480 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:49:02.348480 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:49:02.348480 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:49:02.348480 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:02.348480 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:02.348480 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:02.348480 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:02.348480 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:02.348480 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:02.348480 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:02.348480 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:02.348480 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:02.348480 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:02.348480 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:02.348480 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:02.349410 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:02.349410 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:02.349410 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:49:02.349410 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:49:02.349410 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:49:02.349410 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:49:02.349410 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:49:02.349410 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:49:02.349410 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Apr 30 20:49:02.349410 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:02.349410 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 364/726] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Apr 30 20:49:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:02.354685 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7116d2-7057-42f4-b7d3-6107865d42d1 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:02.388227 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c88be-2f32-4dca-a1b5-af83661059c5 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:02.388451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c88be-2f32-4dca-a1b5-af83661059c5 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:02.388717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c88be-2f32-4dca-a1b5-af83661059c5 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:02.390397 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 365/727] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:49:02.399692 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfdb529-0f50-484f-bbb3-5a7b190a4d36 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:02.399980 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfdb529-0f50-484f-bbb3-5a7b190a4d36 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:02.403110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfdb529-0f50-484f-bbb3-5a7b190a4d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:02.430995 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-9dfdb529-0f50-484f-bbb3-5a7b190a4d36 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:02.443239 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-9dfdb529-0f50-484f-bbb3-5a7b190a4d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:02.498697 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7116d2-7057-42f4-b7d3-6107865d42d1 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:02.515492 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 366/728] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:49:02.517230 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414610ed-1016-45c9-9f19-b7e5f82b329a None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:02.517722 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414610ed-1016-45c9-9f19-b7e5f82b329a None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:02.518266 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414610ed-1016-45c9-9f19-b7e5f82b329a None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:02.519958 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 367/729] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:49:02.525611 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6efb3-0f12-4603-ad24-7ec6ae1a9d5f None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:02.526167 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6efb3-0f12-4603-ad24-7ec6ae1a9d5f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:02.526649 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6efb3-0f12-4603-ad24-7ec6ae1a9d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:02.551468 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-43c6efb3-0f12-4603-ad24-7ec6ae1a9d5f None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:02.551678 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03002904-77c9-4220-b765-efa081bd04a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:02.552137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03002904-77c9-4220-b765-efa081bd04a7 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:02.552422 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03002904-77c9-4220-b765-efa081bd04a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:02.552649 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-43c6efb3-0f12-4603-ad24-7ec6ae1a9d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:02.552774 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03002904-77c9-4220-b765-efa081bd04a7 None admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:02.553510 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03002904-77c9-4220-b765-efa081bd04a7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:02.553847 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03002904-77c9-4220-b765-efa081bd04a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:02.555381 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03002904-77c9-4220-b765-efa081bd04a7 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:02.616659 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 363/730] 10.222.0.23 () {56 vars in 1135 bytes} [Sat Apr 30 20:49:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:02.618095 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ae506-e852-466d-b8a9-ff8c372ea9be None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:02.618387 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ae506-e852-466d-b8a9-ff8c372ea9be None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:02.618663 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ae506-e852-466d-b8a9-ff8c372ea9be None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:02.620039 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 364/731] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:49:02.622232 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ae506-e852-466d-b8a9-ff8c372ea9be None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:02.649988 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 368/732] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:49:02.650775 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6efb3-0f12-4603-ad24-7ec6ae1a9d5f None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:02.729771 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ae506-e852-466d-b8a9-ff8c372ea9be None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:02.756898 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6efb3-0f12-4603-ad24-7ec6ae1a9d5f None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:02.767554 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae8bfb-a5cf-4598-8799-810d609e47b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:02.768333 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae8bfb-a5cf-4598-8799-810d609e47b2 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:02.768609 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae8bfb-a5cf-4598-8799-810d609e47b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:02.768880 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae8bfb-a5cf-4598-8799-810d609e47b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:02.779170 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dae8bfb-a5cf-4598-8799-810d609e47b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:49:02.786731 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-4dae8bfb-a5cf-4598-8799-810d609e47b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:49:02.786731 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:02.786731 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:02.786731 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:02.786731 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:02.786731 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:02.786731 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:02.786731 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:02.786731 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:02.786731 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:02.786731 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:02.786731 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:02.786731 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:49:02.786731 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:49:02.786731 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:49:02.786731 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:49:02.787675 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:49:02.787675 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:49:02.787675 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:49:02.787675 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:49:02.787675 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:02.787675 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:02.787675 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:02.787675 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:02.787675 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:02.787675 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:02.787675 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:02.787675 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:02.787675 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:02.787675 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:02.787675 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:02.787675 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:02.788594 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:02.788594 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:02.788594 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:02.788594 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:02.788594 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:49:02.788594 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:49:02.788594 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:49:02.788594 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:49:02.788594 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:49:02.788594 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:49:02.788594 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:49:02.788594 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:02.788594 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 365/733] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Apr 30 20:49:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:02.789337 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e24f23-cc04-43af-b131-2de03c8e493d None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:02.789337 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e24f23-cc04-43af-b131-2de03c8e493d None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:02.790033 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e24f23-cc04-43af-b131-2de03c8e493d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:02.796184 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81458ba-8e01-4c91-b9d3-bd4bc4b44971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:02.796845 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81458ba-8e01-4c91-b9d3-bd4bc4b44971 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:02.797132 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81458ba-8e01-4c91-b9d3-bd4bc4b44971 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:02.797412 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81458ba-8e01-4c91-b9d3-bd4bc4b44971 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:02.805802 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-64e24f23-cc04-43af-b131-2de03c8e493d None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:02.806979 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-64e24f23-cc04-43af-b131-2de03c8e493d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:02.864901 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81458ba-8e01-4c91-b9d3-bd4bc4b44971 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:02.866443 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81458ba-8e01-4c91-b9d3-bd4bc4b44971 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:02.881931 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 366/734] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:49:02.881931 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e24f23-cc04-43af-b131-2de03c8e493d None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:02.972988 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 369/735] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:49:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 20:49:02.972988 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81458ba-8e01-4c91-b9d3-bd4bc4b44971 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:02.987415 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e24f23-cc04-43af-b131-2de03c8e493d None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:03.020502 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594dea9-a838-4d01-9d21-841920f3f2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:03.021161 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594dea9-a838-4d01-9d21-841920f3f2b3 None admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:03.021444 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594dea9-a838-4d01-9d21-841920f3f2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:03.021719 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594dea9-a838-4d01-9d21-841920f3f2b3 None admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:03.022458 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b594dea9-a838-4d01-9d21-841920f3f2b3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:03.023844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b594dea9-a838-4d01-9d21-841920f3f2b3 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:03.066303 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81458ba-8e01-4c91-b9d3-bd4bc4b44971 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:03.101338 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34954d45-fe5f-4b7e-a1b3-b5beed6d720b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:03.102053 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34954d45-fe5f-4b7e-a1b3-b5beed6d720b None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:03.102368 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34954d45-fe5f-4b7e-a1b3-b5beed6d720b None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:03.102635 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34954d45-fe5f-4b7e-a1b3-b5beed6d720b None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:03.103392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34954d45-fe5f-4b7e-a1b3-b5beed6d720b None admin] RBAC: Adding query filter params (name=admin) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:03.103705 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34954d45-fe5f-4b7e-a1b3-b5beed6d720b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:03.105115 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34954d45-fe5f-4b7e-a1b3-b5beed6d720b None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:03.114978 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 370/736] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:49:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:03.115636 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34954d45-fe5f-4b7e-a1b3-b5beed6d720b None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:03.157116 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 367/737] 10.222.0.23 () {60 vars in 1141 bytes} [Sat Apr 30 20:49:02 2022] POST /identity/v3/services => generated 251 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:49:03.157116 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594dea9-a838-4d01-9d21-841920f3f2b3 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:03.256905 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34954d45-fe5f-4b7e-a1b3-b5beed6d720b None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:03.275733 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594dea9-a838-4d01-9d21-841920f3f2b3 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:03.296605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac5c14-8332-4779-b438-534add719261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:03.297577 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac5c14-8332-4779-b438-534add719261 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:03.297901 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac5c14-8332-4779-b438-534add719261 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:03.298177 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac5c14-8332-4779-b438-534add719261 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:03.309425 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac5c14-8332-4779-b438-534add719261 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:49:03.312309 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866aa97-9486-49d2-9070-21f35377a6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:03.313122 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866aa97-9486-49d2-9070-21f35377a6e1 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:03.313403 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866aa97-9486-49d2-9070-21f35377a6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:03.313677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866aa97-9486-49d2-9070-21f35377a6e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:03.317791 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-17ac5c14-8332-4779-b438-534add719261 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:49:03.317791 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:03.317791 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:03.317791 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:03.317791 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:03.317791 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:03.317791 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:03.317791 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:03.317791 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:03.317791 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:03.317791 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:03.317791 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:03.317791 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:49:03.317791 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:49:03.317791 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:49:03.317791 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:49:03.318755 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:49:03.318755 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:49:03.318755 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:49:03.318755 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:49:03.318755 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:03.318755 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:03.318755 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:03.318755 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:03.318755 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:03.318755 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:03.318755 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:03.318755 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:03.318755 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:03.318755 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:03.318755 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:03.318755 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:03.319594 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:03.319594 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:03.319594 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:03.319594 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:03.319594 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:49:03.319594 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:49:03.319594 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:49:03.319594 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:49:03.319594 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:49:03.319594 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:49:03.319594 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:49:03.319594 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:03.319594 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 371/738] 10.222.0.23 () {56 vars in 1102 bytes} [Sat Apr 30 20:49:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:03.320368 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac5c14-8332-4779-b438-534add719261 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:03.328686 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6866aa97-9486-49d2-9070-21f35377a6e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:03.330286 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6866aa97-9486-49d2-9070-21f35377a6e1 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:03.350426 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-6866aa97-9486-49d2-9070-21f35377a6e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:03.350426 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:03.350426 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:03.350426 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:03.350426 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:03.350426 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:03.350426 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:03.350426 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:03.350426 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:03.350426 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:03.350426 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:03.350426 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:03.350426 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:49:03.350426 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:49:03.350426 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:49:03.353184 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:49:03.353184 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:03.353184 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:03.353184 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:03.353184 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:03.353184 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:03.353184 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:03.353184 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:03.353184 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:03.353184 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:03.353184 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:03.353184 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:03.353184 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:03.353184 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:03.353184 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:03.353184 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:03.353184 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:03.354299 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:49:03.354299 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:49:03.354299 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:03.354299 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:03.354299 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 368/739] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:49:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:03.354299 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8360516-3c6f-45c1-938d-164474caa639 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:03.354299 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8360516-3c6f-45c1-938d-164474caa639 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:03.354299 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8360516-3c6f-45c1-938d-164474caa639 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:03.355253 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 369/740] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:49:03.355253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8360516-3c6f-45c1-938d-164474caa639 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:03.424499 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac5c14-8332-4779-b438-534add719261 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:03.462168 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73fb34-f710-43e7-834a-ba9425198f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:03.462956 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73fb34-f710-43e7-834a-ba9425198f4b None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:03.463233 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73fb34-f710-43e7-834a-ba9425198f4b None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:03.463502 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73fb34-f710-43e7-834a-ba9425198f4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:03.467012 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8360516-3c6f-45c1-938d-164474caa639 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:03.474074 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b73fb34-f710-43e7-834a-ba9425198f4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:03.475527 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b73fb34-f710-43e7-834a-ba9425198f4b None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:03.492622 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-1b73fb34-f710-43e7-834a-ba9425198f4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:03.492622 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:03.492622 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:03.492622 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:03.492622 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:03.492622 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:03.492622 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:03.492622 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:03.492622 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:03.492622 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:03.492622 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:03.492622 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:03.492622 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:49:03.492622 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:49:03.492622 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:49:03.493582 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:49:03.493582 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:03.493582 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:03.493582 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:03.493582 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:03.493582 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:03.493582 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:03.493582 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:03.493582 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:03.493582 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:03.493582 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:03.493582 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:03.493582 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:03.493582 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:03.493582 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:03.493582 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:03.493582 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:03.494815 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:49:03.494815 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:49:03.494815 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:03.494815 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:03.494815 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 372/741] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:49:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:03.494815 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73fb34-f710-43e7-834a-ba9425198f4b None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:03.503317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e850c-c606-41ee-bc0b-606c82471427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:03.503978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e850c-c606-41ee-bc0b-606c82471427 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:03.504257 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e850c-c606-41ee-bc0b-606c82471427 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:03.504529 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e850c-c606-41ee-bc0b-606c82471427 None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:03.505977 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674e850c-c606-41ee-bc0b-606c82471427 None admin] RBAC: Adding query filter params (name=service) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:03.506291 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674e850c-c606-41ee-bc0b-606c82471427 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:03.507809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674e850c-c606-41ee-bc0b-606c82471427 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:03.521463 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 370/742] 10.222.0.23 () {56 vars in 1103 bytes} [Sat Apr 30 20:49:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:03.522707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4de31c-d684-4723-ac54-37ebfb5e9af3 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:03.522995 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4de31c-d684-4723-ac54-37ebfb5e9af3 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:03.523278 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4de31c-d684-4723-ac54-37ebfb5e9af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:03.540605 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-cd4de31c-d684-4723-ac54-37ebfb5e9af3 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:03.546853 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-cd4de31c-d684-4723-ac54-37ebfb5e9af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:03.746949 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 371/743] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:03 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 20:49:03.747473 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73fb34-f710-43e7-834a-ba9425198f4b None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:03.748440 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4de31c-d684-4723-ac54-37ebfb5e9af3 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:03.781899 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984dc2c-ac6f-4502-9e7c-be82c351ccb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:03.782492 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984dc2c-ac6f-4502-9e7c-be82c351ccb1 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:03.782781 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984dc2c-ac6f-4502-9e7c-be82c351ccb1 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:03.783057 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984dc2c-ac6f-4502-9e7c-be82c351ccb1 None admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:03.783799 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f984dc2c-ac6f-4502-9e7c-be82c351ccb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:03.784108 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f984dc2c-ac6f-4502-9e7c-be82c351ccb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:03.785492 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f984dc2c-ac6f-4502-9e7c-be82c351ccb1 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:03.797690 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 373/744] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:49:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:03.802649 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984dc2c-ac6f-4502-9e7c-be82c351ccb1 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:03.858198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4de31c-d684-4723-ac54-37ebfb5e9af3 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:03.893453 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932279d-84a3-4423-a5b7-379787bcc45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:03.894387 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932279d-84a3-4423-a5b7-379787bcc45c None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:03.894824 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932279d-84a3-4423-a5b7-379787bcc45c None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:03.895352 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932279d-84a3-4423-a5b7-379787bcc45c None admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:03.896220 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3932279d-84a3-4423-a5b7-379787bcc45c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:03.896696 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3932279d-84a3-4423-a5b7-379787bcc45c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:03.898110 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3932279d-84a3-4423-a5b7-379787bcc45c None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:03.902295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984dc2c-ac6f-4502-9e7c-be82c351ccb1 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:03.914087 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 372/745] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:49:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:03.914087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932279d-84a3-4423-a5b7-379787bcc45c None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:03.939595 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ea6465-7097-47ae-b3ee-a5e80549a2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:03.940390 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea6465-7097-47ae-b3ee-a5e80549a2c6 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:03.940663 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea6465-7097-47ae-b3ee-a5e80549a2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:03.940939 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea6465-7097-47ae-b3ee-a5e80549a2c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:03.950745 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ea6465-7097-47ae-b3ee-a5e80549a2c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:03.952201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ea6465-7097-47ae-b3ee-a5e80549a2c6 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:03.977562 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-b8ea6465-7097-47ae-b3ee-a5e80549a2c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:03.977562 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:03.977562 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:03.977562 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:03.977562 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:03.977562 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:03.977562 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:03.977562 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:03.977562 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:03.977562 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:03.977562 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:03.977562 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:03.977562 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:49:03.977562 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:49:03.977562 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:49:03.978706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:49:03.978706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:03.978706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:03.978706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:03.978706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:03.978706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:03.978706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:03.978706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:03.978706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:03.978706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:03.978706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:03.978706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:03.978706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:03.978706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:03.978706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:03.978706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:03.978706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:03.980117 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:49:03.980117 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:49:03.980117 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:03.980117 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:03.980117 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 374/746] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:49:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:03.980117 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ea6465-7097-47ae-b3ee-a5e80549a2c6 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:04.029890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932279d-84a3-4423-a5b7-379787bcc45c None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:04.064136 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436a815-1454-41eb-bcca-17f847b71b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:04.064739 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436a815-1454-41eb-bcca-17f847b71b50 None admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:04.065020 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436a815-1454-41eb-bcca-17f847b71b50 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:04.065289 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436a815-1454-41eb-bcca-17f847b71b50 None admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:04.066039 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436a815-1454-41eb-bcca-17f847b71b50 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:04.067431 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436a815-1454-41eb-bcca-17f847b71b50 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:04.082435 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ea6465-7097-47ae-b3ee-a5e80549a2c6 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:04.115983 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a6e6d7-a99f-4e84-abd9-c1d1cd87cb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:04.116936 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6e6d7-a99f-4e84-abd9-c1d1cd87cb05 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:04.117220 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6e6d7-a99f-4e84-abd9-c1d1cd87cb05 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:04.117494 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6e6d7-a99f-4e84-abd9-c1d1cd87cb05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:04.124157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a6e6d7-a99f-4e84-abd9-c1d1cd87cb05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:04.125598 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a6e6d7-a99f-4e84-abd9-c1d1cd87cb05 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:04.139929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-23a6e6d7-a99f-4e84-abd9-c1d1cd87cb05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:49:04.139929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:04.139929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:04.139929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:04.139929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:04.139929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:04.139929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:04.139929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:04.139929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:04.139929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:04.139929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:04.139929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:04.139929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:49:04.139929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:49:04.139929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:49:04.146622 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:49:04.146622 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:04.146622 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:04.146622 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:04.146622 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:04.146622 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:04.146622 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:04.146622 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:04.146622 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:04.146622 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:04.146622 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:04.146622 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:04.146622 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:04.146622 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:04.146622 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:04.146622 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:04.146622 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:04.147554 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:49:04.147554 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:49:04.147554 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:49:04.147554 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:49:04.147554 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:49:04.147554 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:49:04.147554 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:49:04.147554 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:04.147554 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 375/747] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:49:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:04.147554 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a6e6d7-a99f-4e84-abd9-c1d1cd87cb05 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:04.154993 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 373/748] 10.222.0.23 () {60 vars in 1141 bytes} [Sat Apr 30 20:49:03 2022] POST /identity/v3/services => generated 240 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:49:04.156053 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436a815-1454-41eb-bcca-17f847b71b50 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:04.296729 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436a815-1454-41eb-bcca-17f847b71b50 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:04.298421 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a6e6d7-a99f-4e84-abd9-c1d1cd87cb05 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:04.333539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033179a4-a46c-453d-ad79-4d4c3995068c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:04.334264 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033179a4-a46c-453d-ad79-4d4c3995068c None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:04.334743 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033179a4-a46c-453d-ad79-4d4c3995068c None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:04.335093 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033179a4-a46c-453d-ad79-4d4c3995068c None admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:04.335932 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033179a4-a46c-453d-ad79-4d4c3995068c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:04.336349 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033179a4-a46c-453d-ad79-4d4c3995068c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:04.337488 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bbf940-0a73-4d4c-9090-3066a1359fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:04.338034 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033179a4-a46c-453d-ad79-4d4c3995068c None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:04.338712 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbf940-0a73-4d4c-9090-3066a1359fc3 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:04.339146 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbf940-0a73-4d4c-9090-3066a1359fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:04.339567 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbf940-0a73-4d4c-9090-3066a1359fc3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:04.349198 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bbf940-0a73-4d4c-9090-3066a1359fc3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:04.350945 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bbf940-0a73-4d4c-9090-3066a1359fc3 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:04.353179 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 374/749] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:49:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:04.354506 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033179a4-a46c-453d-ad79-4d4c3995068c None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:04.367288 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-62bbf940-0a73-4d4c-9090-3066a1359fc3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 30 20:49:04.367288 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:04.367288 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:04.367288 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:04.367288 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:04.367288 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:04.367288 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:04.367288 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:04.367288 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:04.367288 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:04.367288 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:04.367288 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:04.367288 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:49:04.367288 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:49:04.367288 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:49:04.367288 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:49:04.368484 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:04.368484 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:04.368484 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:49:04.368484 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:49:04.368484 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:49:04.368484 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:49:04.368484 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:04.368484 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:04.368484 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:04.368484 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:04.368484 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:04.368484 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:04.368484 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:04.368484 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:04.368484 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:04.368484 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:04.368484 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:04.368484 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:04.369639 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:04.369639 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:04.369639 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:49:04.369639 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:49:04.369639 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:49:04.369639 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:49:04.369639 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:49:04.369639 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:49:04.369639 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Apr 30 20:49:04.369639 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:04.372016 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 376/750] 10.222.0.23 () {56 vars in 1093 bytes} [Sat Apr 30 20:49:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:04.373079 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bbf940-0a73-4d4c-9090-3066a1359fc3 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:04.463800 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033179a4-a46c-453d-ad79-4d4c3995068c None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:04.480728 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bbf940-0a73-4d4c-9090-3066a1359fc3 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:04.498501 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d069d7cd-94fd-4a24-8ebd-df2bcccdb8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:04.499158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069d7cd-94fd-4a24-8ebd-df2bcccdb8f4 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:04.499436 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069d7cd-94fd-4a24-8ebd-df2bcccdb8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:04.499707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069d7cd-94fd-4a24-8ebd-df2bcccdb8f4 None admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:04.500489 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d069d7cd-94fd-4a24-8ebd-df2bcccdb8f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:04.500790 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d069d7cd-94fd-4a24-8ebd-df2bcccdb8f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:04.502368 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d069d7cd-94fd-4a24-8ebd-df2bcccdb8f4 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:04.514573 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 375/751] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Apr 30 20:49:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:04.515488 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d069d7cd-94fd-4a24-8ebd-df2bcccdb8f4 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:04.517488 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8a7cd-fe19-483c-ba38-2542349c5b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:04.518570 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8a7cd-fe19-483c-ba38-2542349c5b9d None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:04.519125 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8a7cd-fe19-483c-ba38-2542349c5b9d None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:04.519608 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8a7cd-fe19-483c-ba38-2542349c5b9d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:04.527785 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e8a7cd-fe19-483c-ba38-2542349c5b9d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:04.530172 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e8a7cd-fe19-483c-ba38-2542349c5b9d None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:04.545299 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-b9e8a7cd-fe19-483c-ba38-2542349c5b9d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 30 20:49:04.545299 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:04.545299 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:04.545299 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:04.545299 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:04.545299 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:04.545299 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:04.545299 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:04.545299 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:04.545299 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:04.545299 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:04.545299 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:04.545299 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:49:04.545299 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:49:04.545299 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:49:04.545299 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:49:04.549861 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:04.549861 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:04.549861 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:49:04.549861 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:49:04.549861 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:49:04.549861 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:49:04.549861 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:04.549861 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:04.549861 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:04.549861 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:04.549861 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:04.549861 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:04.549861 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:04.549861 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:04.549861 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:04.549861 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:04.549861 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:04.549861 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:04.551033 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:04.551033 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:04.551033 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:49:04.551033 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:49:04.551033 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:49:04.551033 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:49:04.551033 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:49:04.551033 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:49:04.551033 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 30 20:49:04.551033 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:04.551033 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 377/752] 10.222.0.23 () {56 vars in 1117 bytes} [Sat Apr 30 20:49:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:04.551033 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8a7cd-fe19-483c-ba38-2542349c5b9d None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:04.620473 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d069d7cd-94fd-4a24-8ebd-df2bcccdb8f4 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:04.657311 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd6177-8927-4052-ad9d-ec11c47e42a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:04.658280 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd6177-8927-4052-ad9d-ec11c47e42a9 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:04.658406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd6177-8927-4052-ad9d-ec11c47e42a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:04.658609 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd6177-8927-4052-ad9d-ec11c47e42a9 None admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:04.659455 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd6177-8927-4052-ad9d-ec11c47e42a9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:04.659769 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd6177-8927-4052-ad9d-ec11c47e42a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:04.661170 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd6177-8927-4052-ad9d-ec11c47e42a9 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:04.661940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8a7cd-fe19-483c-ba38-2542349c5b9d None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:04.683552 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 376/753] 10.222.0.23 () {56 vars in 1133 bytes} [Sat Apr 30 20:49:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:04.684421 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd6177-8927-4052-ad9d-ec11c47e42a9 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:04.696708 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a0450-2c6c-42d4-879a-da18c8ad6547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:04.697580 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a0450-2c6c-42d4-879a-da18c8ad6547 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:04.698072 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a0450-2c6c-42d4-879a-da18c8ad6547 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:04.698541 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a0450-2c6c-42d4-879a-da18c8ad6547 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:04.699526 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699a0450-2c6c-42d4-879a-da18c8ad6547 None admin] RBAC: Adding query filter params (role.id=30112eb1f3e047398c3c82fb40b72e62, scope.project.id=6b52e5e13b9144dfb663578766c2bac0, user.id=27edf527e36c4ee7a9065688f4bed942) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:04.700018 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699a0450-2c6c-42d4-879a-da18c8ad6547 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:04.702167 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699a0450-2c6c-42d4-879a-da18c8ad6547 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:04.708124 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 378/754] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:49:04 2022] GET /identity/v3/role_assignments?user.id=27edf527e36c4ee7a9065688f4bed942&scope.project.id=6b52e5e13b9144dfb663578766c2bac0&role.id=30112eb1f3e047398c3c82fb40b72e62 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:04.709124 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a0450-2c6c-42d4-879a-da18c8ad6547 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:04.787255 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd6177-8927-4052-ad9d-ec11c47e42a9 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:04.815111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a0450-2c6c-42d4-879a-da18c8ad6547 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:04.822167 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d7fbe-7a70-4533-87c4-d13c74e45355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:04.822852 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d7fbe-7a70-4533-87c4-d13c74e45355 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:04.823133 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d7fbe-7a70-4533-87c4-d13c74e45355 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:04.823409 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d7fbe-7a70-4533-87c4-d13c74e45355 None admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:04.824281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d7fbe-7a70-4533-87c4-d13c74e45355 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:04.824567 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d7fbe-7a70-4533-87c4-d13c74e45355 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:04.826686 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d7fbe-7a70-4533-87c4-d13c74e45355 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:04.845722 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 377/755] 10.222.0.23 () {56 vars in 1149 bytes} [Sat Apr 30 20:49:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:04.851256 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d7fbe-7a70-4533-87c4-d13c74e45355 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:04.854556 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf26923-1b73-4298-959f-1554c520ba1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:04.855562 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf26923-1b73-4298-959f-1554c520ba1f None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:04.856001 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf26923-1b73-4298-959f-1554c520ba1f None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:04.856426 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf26923-1b73-4298-959f-1554c520ba1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:04.868384 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf26923-1b73-4298-959f-1554c520ba1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:04.870136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf26923-1b73-4298-959f-1554c520ba1f None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:04.889591 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-bcf26923-1b73-4298-959f-1554c520ba1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:04.889591 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:04.889591 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:04.889591 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:04.889591 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:04.889591 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:04.889591 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:04.889591 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:04.889591 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:04.889591 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:04.889591 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:04.889591 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:04.889591 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:49:04.889591 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:49:04.889591 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:49:04.890733 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:49:04.890733 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:04.890733 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:04.890733 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:04.890733 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:04.890733 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:04.890733 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:04.890733 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:04.890733 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:04.890733 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:04.890733 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:04.890733 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:04.890733 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:04.890733 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:04.890733 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:04.890733 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:04.890733 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:04.891792 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:49:04.891792 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:49:04.891792 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:04.891792 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:04.893672 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 379/756] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:49:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:04.906824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf26923-1b73-4298-959f-1554c520ba1f None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:04.965348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d7fbe-7a70-4533-87c4-d13c74e45355 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:05.003951 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb28ae-bad7-4c3d-b081-3e6f34c44038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:05.004611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb28ae-bad7-4c3d-b081-3e6f34c44038 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:05.004881 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb28ae-bad7-4c3d-b081-3e6f34c44038 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:05.006287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb28ae-bad7-4c3d-b081-3e6f34c44038 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:05.096555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf26923-1b73-4298-959f-1554c520ba1f None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:05.100685 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb28ae-bad7-4c3d-b081-3e6f34c44038 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:05.102193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb28ae-bad7-4c3d-b081-3e6f34c44038 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:05.175615 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21468d9-4024-4d02-80a5-a252029284b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:05.176206 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21468d9-4024-4d02-80a5-a252029284b6 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:05.176525 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21468d9-4024-4d02-80a5-a252029284b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:05.176803 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21468d9-4024-4d02-80a5-a252029284b6 None admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:05.177654 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21468d9-4024-4d02-80a5-a252029284b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:05.177852 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21468d9-4024-4d02-80a5-a252029284b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:05.179234 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21468d9-4024-4d02-80a5-a252029284b6 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:05.203962 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 378/757] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:49:04 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 30 20:49:05.205258 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 380/758] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:49:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:05.210736 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb28ae-bad7-4c3d-b081-3e6f34c44038 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:05.214716 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21468d9-4024-4d02-80a5-a252029284b6 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:05.318051 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb28ae-bad7-4c3d-b081-3e6f34c44038 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:05.421557 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21468d9-4024-4d02-80a5-a252029284b6 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:05.490838 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110530fc-5b73-4edf-bb80-045770c29cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:05.491656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110530fc-5b73-4edf-bb80-045770c29cdb None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:05.491937 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110530fc-5b73-4edf-bb80-045770c29cdb None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:05.492211 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110530fc-5b73-4edf-bb80-045770c29cdb None admin] PATH_INFO: `/v3/projects/service` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:05.511235 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110530fc-5b73-4edf-bb80-045770c29cdb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:05.512724 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110530fc-5b73-4edf-bb80-045770c29cdb None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:05.538474 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-110530fc-5b73-4edf-bb80-045770c29cdb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:49:05.538474 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:05.538474 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:05.538474 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:05.538474 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:05.538474 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:05.538474 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:05.538474 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:05.538474 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:05.538474 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:05.538474 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:05.538474 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:05.538474 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:49:05.538474 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:49:05.538474 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:49:05.546922 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:49:05.546922 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:05.546922 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:05.546922 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:05.546922 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:05.546922 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:05.546922 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:05.546922 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:05.546922 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:05.546922 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:05.546922 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:05.546922 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:05.546922 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:05.546922 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:05.546922 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:05.546922 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:05.546922 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:05.547851 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:49:05.547851 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:49:05.547851 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:49:05.547851 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:49:05.547851 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:49:05.547851 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:49:05.547851 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:49:05.547851 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:05.547851 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 381/759] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:49:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:49:05.547851 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110530fc-5b73-4edf-bb80-045770c29cdb None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:05.599734 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50bd31-ca3c-408e-802f-5b0fbac05093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:05.601252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50bd31-ca3c-408e-802f-5b0fbac05093 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:05.602124 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50bd31-ca3c-408e-802f-5b0fbac05093 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:05.602639 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50bd31-ca3c-408e-802f-5b0fbac05093 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:05.623990 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb50bd31-ca3c-408e-802f-5b0fbac05093 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:05.625827 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb50bd31-ca3c-408e-802f-5b0fbac05093 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:05.661791 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-fb50bd31-ca3c-408e-802f-5b0fbac05093 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:05.661791 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:05.661791 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:05.661791 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:05.661791 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:05.661791 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:05.661791 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:05.661791 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:05.661791 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:05.661791 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:05.661791 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:05.661791 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:05.661791 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:49:05.661791 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:49:05.661791 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:49:05.662787 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:49:05.662787 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:05.662787 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:05.662787 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:05.662787 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:05.662787 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:05.662787 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:05.662787 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:05.662787 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:05.662787 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:05.662787 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:05.662787 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:05.662787 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:05.662787 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:05.662787 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:05.662787 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:05.662787 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:05.663673 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:49:05.663673 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:49:05.663673 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:05.663673 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:05.666232 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 379/760] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:49:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 456 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:05.671779 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50bd31-ca3c-408e-802f-5b0fbac05093 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:05.679885 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110530fc-5b73-4edf-bb80-045770c29cdb None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:05.717119 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8b432-a22e-4e0d-810e-db58d0fa0abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:05.717809 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8b432-a22e-4e0d-810e-db58d0fa0abb None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:05.718097 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8b432-a22e-4e0d-810e-db58d0fa0abb None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:05.718376 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8b432-a22e-4e0d-810e-db58d0fa0abb None admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:05.719476 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8b432-a22e-4e0d-810e-db58d0fa0abb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:05.719787 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8b432-a22e-4e0d-810e-db58d0fa0abb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:05.721487 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8b432-a22e-4e0d-810e-db58d0fa0abb None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:05.739934 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 382/761] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Apr 30 20:49:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:05.741223 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8b432-a22e-4e0d-810e-db58d0fa0abb None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:05.824846 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50bd31-ca3c-408e-802f-5b0fbac05093 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:05.857772 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28337268-1281-4927-a045-b980bb6c6542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:05.858432 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28337268-1281-4927-a045-b980bb6c6542 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:05.858707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28337268-1281-4927-a045-b980bb6c6542 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:05.858978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28337268-1281-4927-a045-b980bb6c6542 None admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:05.859691 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28337268-1281-4927-a045-b980bb6c6542 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:05.859990 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28337268-1281-4927-a045-b980bb6c6542 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:05.860784 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8b432-a22e-4e0d-810e-db58d0fa0abb None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:05.861346 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28337268-1281-4927-a045-b980bb6c6542 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:05.878251 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 380/762] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:49:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:49:05.880894 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40edc18-b327-40ba-9d16-890753194fdb None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:05.881431 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40edc18-b327-40ba-9d16-890753194fdb None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:05.882100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40edc18-b327-40ba-9d16-890753194fdb None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:05.884200 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 381/763] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:49:05.885155 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40edc18-b327-40ba-9d16-890753194fdb None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:05.912451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c670b-68b5-4887-a9c1-68bc85657dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:05.914212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c670b-68b5-4887-a9c1-68bc85657dc5 None admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:05.914746 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c670b-68b5-4887-a9c1-68bc85657dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:05.915241 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c670b-68b5-4887-a9c1-68bc85657dc5 None admin] PATH_INFO: `/v3/projects/6b52e5e13b9144dfb663578766c2bac0/users/fca4ee1f64c8489ebe7296f9f8f0ab41/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:05.918203 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570c670b-68b5-4887-a9c1-68bc85657dc5 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b52e5e13b9144dfb663578766c2bac0, user_id=fca4ee1f64c8489ebe7296f9f8f0ab41, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:05.920896 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570c670b-68b5-4887-a9c1-68bc85657dc5 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:06.011264 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40edc18-b327-40ba-9d16-890753194fdb None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:06.044831 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64deaba8-5936-4c4e-81e2-b005a722928a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:06.045631 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64deaba8-5936-4c4e-81e2-b005a722928a None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:06.045938 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64deaba8-5936-4c4e-81e2-b005a722928a None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:06.046208 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64deaba8-5936-4c4e-81e2-b005a722928a None admin] PATH_INFO: `/v3/projects/service` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:06.052899 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64deaba8-5936-4c4e-81e2-b005a722928a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:06.054372 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64deaba8-5936-4c4e-81e2-b005a722928a None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:06.068985 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-64deaba8-5936-4c4e-81e2-b005a722928a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:49:06.068985 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:06.068985 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:06.068985 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:06.068985 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:06.068985 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:06.068985 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:06.068985 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:06.068985 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:06.068985 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:06.068985 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:06.068985 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:06.068985 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:49:06.068985 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:49:06.068985 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:49:06.070234 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:49:06.070234 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:06.070234 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:06.070234 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:06.070234 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:06.070234 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:06.070234 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:06.070234 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:06.070234 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:06.070234 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:06.070234 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:06.070234 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:06.070234 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:06.070234 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:06.070234 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:06.070234 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:06.070234 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:06.071693 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:49:06.071693 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:49:06.071693 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:49:06.071693 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:49:06.071693 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:49:06.071693 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:49:06.071693 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:49:06.071693 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:06.071693 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 382/764] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:49:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:06.072855 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03790651-6d36-4b1c-b193-eeb453496e99 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:06.072855 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03790651-6d36-4b1c-b193-eeb453496e99 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:06.072855 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03790651-6d36-4b1c-b193-eeb453496e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:06.092828 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-03790651-6d36-4b1c-b193-eeb453496e99 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:06.094077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-03790651-6d36-4b1c-b193-eeb453496e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:06.161998 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 383/765] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:49:06.162845 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03790651-6d36-4b1c-b193-eeb453496e99 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:06.262348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03790651-6d36-4b1c-b193-eeb453496e99 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:06.289903 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 383/766] 10.222.0.23 () {58 vars in 1439 bytes} [Sat Apr 30 20:49:05 2022] PUT /identity/v3/projects/6b52e5e13b9144dfb663578766c2bac0/users/fca4ee1f64c8489ebe7296f9f8f0ab41/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 20:49:06.291135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c670b-68b5-4887-a9c1-68bc85657dc5 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:06.306800 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f976948-b38a-4117-84af-a11347a99707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:06.307538 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f976948-b38a-4117-84af-a11347a99707 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:06.307873 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f976948-b38a-4117-84af-a11347a99707 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:06.308155 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f976948-b38a-4117-84af-a11347a99707 None admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:06.309196 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f976948-b38a-4117-84af-a11347a99707 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:06.309515 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f976948-b38a-4117-84af-a11347a99707 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:06.311301 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f976948-b38a-4117-84af-a11347a99707 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:06.324932 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 384/767] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Apr 30 20:49:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:06.331328 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f976948-b38a-4117-84af-a11347a99707 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:06.441847 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f976948-b38a-4117-84af-a11347a99707 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:06.479208 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bfe6a8-340c-495a-8f06-6be4fe670015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:06.479884 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfe6a8-340c-495a-8f06-6be4fe670015 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:06.480171 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfe6a8-340c-495a-8f06-6be4fe670015 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:06.480456 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfe6a8-340c-495a-8f06-6be4fe670015 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:06.481359 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bfe6a8-340c-495a-8f06-6be4fe670015 None admin] RBAC: Adding query filter params (role.id=0971c8bf92d64c50a5cbbf7d146af841, scope.project.id=6b52e5e13b9144dfb663578766c2bac0, user.id=2e3511017b8e4b4f9805a65c3ac173f9) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:06.481682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bfe6a8-340c-495a-8f06-6be4fe670015 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:06.483772 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bfe6a8-340c-495a-8f06-6be4fe670015 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:06.490735 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 385/768] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:49:06 2022] GET /identity/v3/role_assignments?user.id=2e3511017b8e4b4f9805a65c3ac173f9&scope.project.id=6b52e5e13b9144dfb663578766c2bac0&role.id=0971c8bf92d64c50a5cbbf7d146af841 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:49:06.534339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c670b-68b5-4887-a9c1-68bc85657dc5 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:06.598020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf02fc-bf13-4102-a4e6-1a8d0ece0949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:06.599311 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf02fc-bf13-4102-a4e6-1a8d0ece0949 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:06.599833 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf02fc-bf13-4102-a4e6-1a8d0ece0949 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:06.600338 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf02fc-bf13-4102-a4e6-1a8d0ece0949 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:06.601236 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf02fc-bf13-4102-a4e6-1a8d0ece0949 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:06.602930 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf02fc-bf13-4102-a4e6-1a8d0ece0949 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:06.619772 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-cbaf02fc-bf13-4102-a4e6-1a8d0ece0949 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 30 20:49:06.619772 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:06.619772 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:49:06.619772 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:49:06.619772 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:49:06.619772 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:49:06.619772 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:49:06.619772 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:49:06.619772 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 30 20:49:06.619772 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:06.619772 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:49:06.619772 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:06.619772 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:06.619772 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:06.619772 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:06.619772 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:06.620830 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:06.620830 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:06.620830 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:06.620830 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:06.620830 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:06.620830 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:06.620830 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:06.620830 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:49:06.620830 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:49:06.620830 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:49:06.620830 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:49:06.620830 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:06.620830 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:06.620830 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:06.620830 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:06.620830 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:06.621705 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:06.621705 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:06.621705 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:06.621705 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:06.621705 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:06.621705 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:06.621705 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:06.621705 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:06.621705 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:06.621705 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:06.621705 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:06.621705 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:49:06.621705 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:49:06.621705 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 30 20:49:06.621705 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:06.626223 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 384/769] 10.222.0.23 () {56 vars in 1129 bytes} [Sat Apr 30 20:49:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:06.631911 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bfe6a8-340c-495a-8f06-6be4fe670015 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:06.751180 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bfe6a8-340c-495a-8f06-6be4fe670015 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:06.786168 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b71119-0e2d-4b75-b43d-37d3a1a93789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:06.786754 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b71119-0e2d-4b75-b43d-37d3a1a93789 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:06.787038 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b71119-0e2d-4b75-b43d-37d3a1a93789 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:06.787317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b71119-0e2d-4b75-b43d-37d3a1a93789 None admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:06.788024 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b71119-0e2d-4b75-b43d-37d3a1a93789 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:06.788333 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b71119-0e2d-4b75-b43d-37d3a1a93789 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:06.789703 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b71119-0e2d-4b75-b43d-37d3a1a93789 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:06.794987 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 386/770] 10.222.0.23 () {56 vars in 1124 bytes} [Sat Apr 30 20:49:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:06.803063 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf02fc-bf13-4102-a4e6-1a8d0ece0949 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:06.892872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a99f3-bc58-4fcf-b6aa-8796fc429b80 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:06.893238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a99f3-bc58-4fcf-b6aa-8796fc429b80 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:06.893425 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a99f3-bc58-4fcf-b6aa-8796fc429b80 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:06.894963 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 387/771] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:49:06.899939 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f27f69-774d-445b-9e6f-1ff67567fdfa None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:06.900230 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f27f69-774d-445b-9e6f-1ff67567fdfa None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:06.900513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f27f69-774d-445b-9e6f-1ff67567fdfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:06.930944 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-d1f27f69-774d-445b-9e6f-1ff67567fdfa None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:06.932160 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d1f27f69-774d-445b-9e6f-1ff67567fdfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:06.938077 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf02fc-bf13-4102-a4e6-1a8d0ece0949 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:06.979140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d2d9ac-7687-4e2b-a174-d7c95ff35b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:06.979814 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2d9ac-7687-4e2b-a174-d7c95ff35b43 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:06.980102 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2d9ac-7687-4e2b-a174-d7c95ff35b43 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:06.980378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2d9ac-7687-4e2b-a174-d7c95ff35b43 None admin] PATH_INFO: `/v3/services` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:06.981863 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d2d9ac-7687-4e2b-a174-d7c95ff35b43 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:06.982180 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d2d9ac-7687-4e2b-a174-d7c95ff35b43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:06.983565 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d2d9ac-7687-4e2b-a174-d7c95ff35b43 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:06.995907 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 385/772] 10.222.0.23 () {56 vars in 1124 bytes} [Sat Apr 30 20:49:06 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:07.006538 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d2d9ac-7687-4e2b-a174-d7c95ff35b43 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:07.032470 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 388/773] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 30 20:49:07.053977 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f27f69-774d-445b-9e6f-1ff67567fdfa None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:07.199719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d2d9ac-7687-4e2b-a174-d7c95ff35b43 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:07.238045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f27f69-774d-445b-9e6f-1ff67567fdfa None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:07.238513 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91c16a-67ec-4f9e-8504-67f354bb0963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:07.239570 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91c16a-67ec-4f9e-8504-67f354bb0963 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:07.240083 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91c16a-67ec-4f9e-8504-67f354bb0963 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:07.240580 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91c16a-67ec-4f9e-8504-67f354bb0963 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:07.241610 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91c16a-67ec-4f9e-8504-67f354bb0963 None admin] RBAC: Adding query filter params (interface=public, service_id=b0a88be552014b479d81441e45cb5ad9, region_id=RegionOne) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:07.242165 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91c16a-67ec-4f9e-8504-67f354bb0963 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:07.243806 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91c16a-67ec-4f9e-8504-67f354bb0963 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:07.253702 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 386/774] 10.222.0.23 () {56 vars in 1251 bytes} [Sat Apr 30 20:49:07 2022] GET /identity/v3/endpoints?service_id=b0a88be552014b479d81441e45cb5ad9&interface=public®ion_id=RegionOne => generated 194 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:07.259225 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91c16a-67ec-4f9e-8504-67f354bb0963 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:07.338570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2c0dc-a2af-4dd7-a25b-ad09aa793f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:07.339306 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2c0dc-a2af-4dd7-a25b-ad09aa793f03 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:07.339594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2c0dc-a2af-4dd7-a25b-ad09aa793f03 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:07.339872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2c0dc-a2af-4dd7-a25b-ad09aa793f03 None admin] PATH_INFO: `/v3/services/network` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:07.340536 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab2c0dc-a2af-4dd7-a25b-ad09aa793f03 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:07.342023 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab2c0dc-a2af-4dd7-a25b-ad09aa793f03 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:07.366557 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-2ab2c0dc-a2af-4dd7-a25b-ad09aa793f03 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 30 20:49:07.366557 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:07.366557 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:49:07.366557 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:49:07.366557 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:49:07.366557 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:49:07.366557 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:49:07.366557 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:49:07.366557 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Apr 30 20:49:07.366557 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:07.366557 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:49:07.366557 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:07.366557 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:07.366557 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:07.366557 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:07.366557 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:07.366557 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:07.367656 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:07.367656 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:07.367656 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:07.367656 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:07.367656 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:07.367656 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:07.367656 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:49:07.367656 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:49:07.367656 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:49:07.367656 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:49:07.367656 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:07.367656 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:07.367656 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:07.367656 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:07.367656 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:07.367656 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:07.368515 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:07.368515 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:07.368515 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:07.368515 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:07.368515 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:07.368515 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:07.368515 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:07.368515 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:07.368515 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:07.368515 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:07.368515 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:49:07.368515 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:49:07.368515 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Apr 30 20:49:07.368515 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:07.368515 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 389/775] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:49:07 2022] GET /identity/v3/services/network => generated 88 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:49:07.369402 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04727bb6-8894-4855-b379-a300e891edc4 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:07.371241 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04727bb6-8894-4855-b379-a300e891edc4 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:07.371241 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04727bb6-8894-4855-b379-a300e891edc4 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:07.376400 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 390/776] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:49:07.378536 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04727bb6-8894-4855-b379-a300e891edc4 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:07.386194 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91c16a-67ec-4f9e-8504-67f354bb0963 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:07.425489 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734eabe-dd06-4c7b-91bc-1dd58c5ecd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:07.426185 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734eabe-dd06-4c7b-91bc-1dd58c5ecd5f None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:07.426468 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734eabe-dd06-4c7b-91bc-1dd58c5ecd5f None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:07.426743 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734eabe-dd06-4c7b-91bc-1dd58c5ecd5f None admin] PATH_INFO: `/v3/services` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:07.427422 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4734eabe-dd06-4c7b-91bc-1dd58c5ecd5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:07.428787 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4734eabe-dd06-4c7b-91bc-1dd58c5ecd5f None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:07.434166 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 387/777] 10.222.0.23 () {56 vars in 1087 bytes} [Sat Apr 30 20:49:07 2022] GET /identity/v3/services => generated 772 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:07.435998 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a728d8c-902f-4a61-98f9-63914e785f85 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:07.436287 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a728d8c-902f-4a61-98f9-63914e785f85 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:07.436564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a728d8c-902f-4a61-98f9-63914e785f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:07.453726 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-5a728d8c-902f-4a61-98f9-63914e785f85 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:07.454978 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5a728d8c-902f-4a61-98f9-63914e785f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:07.508430 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04727bb6-8894-4855-b379-a300e891edc4 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:07.548417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ba339-d96e-4209-8078-f1b3da187b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:07.549100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ba339-d96e-4209-8078-f1b3da187b6d None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:07.549383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ba339-d96e-4209-8078-f1b3da187b6d None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:07.549660 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ba339-d96e-4209-8078-f1b3da187b6d None admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:07.550424 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4ba339-d96e-4209-8078-f1b3da187b6d None admin] RBAC: Adding query filter params (name=network) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:07.551271 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4ba339-d96e-4209-8078-f1b3da187b6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:07.552880 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4ba339-d96e-4209-8078-f1b3da187b6d None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:07.563227 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 391/778] 10.222.0.23 () {56 vars in 1112 bytes} [Sat Apr 30 20:49:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:07.565625 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ba339-d96e-4209-8078-f1b3da187b6d None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:07.584128 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 388/779] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:49:07.642831 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a728d8c-902f-4a61-98f9-63914e785f85 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:07.724032 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ba339-d96e-4209-8078-f1b3da187b6d None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:07.761112 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a728d8c-902f-4a61-98f9-63914e785f85 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:07.769566 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada829e-20d9-4e8c-9753-079f1b058f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:07.770617 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada829e-20d9-4e8c-9753-079f1b058f8a None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:07.771541 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada829e-20d9-4e8c-9753-079f1b058f8a None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:07.772048 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada829e-20d9-4e8c-9753-079f1b058f8a None admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:07.772983 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dada829e-20d9-4e8c-9753-079f1b058f8a None admin] RBAC: Adding query filter params (type=network) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:07.773519 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dada829e-20d9-4e8c-9753-079f1b058f8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:07.775245 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dada829e-20d9-4e8c-9753-079f1b058f8a None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:07.782876 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 392/780] 10.222.0.23 () {56 vars in 1112 bytes} [Sat Apr 30 20:49:07 2022] GET /identity/v3/services?type=network => generated 350 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:07.787607 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada829e-20d9-4e8c-9753-079f1b058f8a None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:07.801972 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465cf08-a407-4db4-ac70-5a6c61cf7939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:07.802779 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465cf08-a407-4db4-ac70-5a6c61cf7939 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:07.803063 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465cf08-a407-4db4-ac70-5a6c61cf7939 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:07.803338 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465cf08-a407-4db4-ac70-5a6c61cf7939 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:07.818359 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0465cf08-a407-4db4-ac70-5a6c61cf7939 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:49:07.826956 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-0465cf08-a407-4db4-ac70-5a6c61cf7939 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:49:07.826956 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:07.826956 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:07.826956 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:07.826956 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:07.826956 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:07.826956 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:07.826956 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:07.826956 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:07.826956 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:07.826956 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:07.826956 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:07.826956 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:49:07.826956 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:49:07.826956 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:49:07.826956 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:49:07.827943 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:49:07.827943 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:49:07.827943 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:49:07.827943 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:49:07.827943 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:07.827943 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:07.827943 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:07.827943 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:07.827943 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:07.827943 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:07.827943 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:07.827943 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:07.827943 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:07.827943 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:07.827943 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:07.827943 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:07.828810 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:07.828810 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:07.828810 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:07.828810 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:07.828810 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:49:07.828810 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:49:07.828810 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:49:07.828810 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:49:07.828810 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:49:07.828810 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:49:07.828810 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:49:07.828810 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:07.828810 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 389/781] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Apr 30 20:49:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:49:07.837808 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465cf08-a407-4db4-ac70-5a6c61cf7939 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:07.984387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465cf08-a407-4db4-ac70-5a6c61cf7939 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:07.986703 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada829e-20d9-4e8c-9753-079f1b058f8a None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:08.045951 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02b468-da2a-4a66-85a4-70e71d12d4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:08.046623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02b468-da2a-4a66-85a4-70e71d12d4c9 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:08.047882 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02b468-da2a-4a66-85a4-70e71d12d4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:08.047882 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02b468-da2a-4a66-85a4-70e71d12d4c9 None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:08.047882 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02b468-da2a-4a66-85a4-70e71d12d4c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:08.049824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02b468-da2a-4a66-85a4-70e71d12d4c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:08.049824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02b468-da2a-4a66-85a4-70e71d12d4c9 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:08.056647 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5ad01-8855-4149-9dc0-7230cde5a9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:08.056647 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5ad01-8855-4149-9dc0-7230cde5a9f0 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:08.056647 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5ad01-8855-4149-9dc0-7230cde5a9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:08.056647 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c5ad01-8855-4149-9dc0-7230cde5a9f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:08.057100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c5ad01-8855-4149-9dc0-7230cde5a9f0 None admin] RBAC: Adding query filter params (interface=public, service_id=07792c53d10e432a93e85b9ed02df2bd, region_id=RegionOne) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:08.057100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c5ad01-8855-4149-9dc0-7230cde5a9f0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:08.057100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c5ad01-8855-4149-9dc0-7230cde5a9f0 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:08.065623 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 390/782] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:49:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:08.070808 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02b468-da2a-4a66-85a4-70e71d12d4c9 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:08.076730 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 393/783] 10.222.0.23 () {56 vars in 1251 bytes} [Sat Apr 30 20:49:07 2022] GET /identity/v3/endpoints?service_id=07792c53d10e432a93e85b9ed02df2bd&interface=public®ion_id=RegionOne => generated 194 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:08.081698 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5ad01-8855-4149-9dc0-7230cde5a9f0 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:08.238455 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c5ad01-8855-4149-9dc0-7230cde5a9f0 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:08.281506 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b0e6e7-28e5-46ce-a61d-4feb2a002aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:08.282209 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0e6e7-28e5-46ce-a61d-4feb2a002aa1 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:08.282492 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0e6e7-28e5-46ce-a61d-4feb2a002aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:08.282769 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0e6e7-28e5-46ce-a61d-4feb2a002aa1 None admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:08.283453 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b0e6e7-28e5-46ce-a61d-4feb2a002aa1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:08.284840 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b0e6e7-28e5-46ce-a61d-4feb2a002aa1 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:08.290542 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 394/784] 10.222.0.23 () {56 vars in 1087 bytes} [Sat Apr 30 20:49:08 2022] GET /identity/v3/services => generated 772 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:08.309145 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02b468-da2a-4a66-85a4-70e71d12d4c9 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:08.367557 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fd2a3-8a93-4b11-86c0-a2cfbaa47eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:08.368402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fd2a3-8a93-4b11-86c0-a2cfbaa47eb4 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:08.368687 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fd2a3-8a93-4b11-86c0-a2cfbaa47eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:08.368964 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fd2a3-8a93-4b11-86c0-a2cfbaa47eb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:08.388740 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64fd2a3-8a93-4b11-86c0-a2cfbaa47eb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:08.390271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64fd2a3-8a93-4b11-86c0-a2cfbaa47eb4 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:08.419346 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-d64fd2a3-8a93-4b11-86c0-a2cfbaa47eb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:08.419346 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:08.419346 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:08.419346 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:08.419346 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:08.419346 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:08.419346 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:08.419346 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:08.419346 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:08.419346 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:08.419346 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:08.419346 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:08.419346 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:49:08.419346 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:49:08.419346 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:49:08.420343 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:49:08.420343 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:08.420343 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:08.420343 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:08.420343 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:08.420343 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:08.420343 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:08.420343 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:08.420343 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:08.420343 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:08.420343 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:08.420343 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:08.420343 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:08.420343 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:08.420343 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:08.420343 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:08.420343 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:08.421248 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:49:08.421248 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:49:08.421248 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:08.421248 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:08.421248 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 391/785] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:49:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:49:08.426596 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b0e6e7-28e5-46ce-a61d-4feb2a002aa1 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:08.568767 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b0e6e7-28e5-46ce-a61d-4feb2a002aa1 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:08.603008 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4fadc3-1b4e-4229-ba09-9aef4610aaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:08.603674 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fadc3-1b4e-4229-ba09-9aef4610aaea None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:08.603954 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fadc3-1b4e-4229-ba09-9aef4610aaea None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:08.604229 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fadc3-1b4e-4229-ba09-9aef4610aaea None admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:08.604942 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4fadc3-1b4e-4229-ba09-9aef4610aaea None admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:08.605244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4fadc3-1b4e-4229-ba09-9aef4610aaea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:08.606645 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4fadc3-1b4e-4229-ba09-9aef4610aaea None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:08.619436 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 395/786] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:49:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:08.626871 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fd2a3-8a93-4b11-86c0-a2cfbaa47eb4 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:08.733472 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fd2a3-8a93-4b11-86c0-a2cfbaa47eb4 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:08.779674 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d783a7-6a8f-40b2-9ee6-b87cee42585e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:08.780793 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d783a7-6a8f-40b2-9ee6-b87cee42585e None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:08.781258 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d783a7-6a8f-40b2-9ee6-b87cee42585e None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:08.781715 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d783a7-6a8f-40b2-9ee6-b87cee42585e None admin] PATH_INFO: `/v3/users/swift` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:08.790613 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d783a7-6a8f-40b2-9ee6-b87cee42585e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:08.792327 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d783a7-6a8f-40b2-9ee6-b87cee42585e None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:08.806726 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-90d783a7-6a8f-40b2-9ee6-b87cee42585e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 30 20:49:08.806726 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:08.806726 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:08.806726 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:08.806726 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:08.806726 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:08.806726 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:08.806726 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:08.806726 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:08.806726 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:08.806726 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:08.806726 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:08.806726 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:49:08.806726 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:49:08.806726 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:49:08.806726 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:49:08.807708 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:08.807708 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:08.807708 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:49:08.807708 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:49:08.807708 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:49:08.807708 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:49:08.807708 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:08.807708 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:08.807708 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:08.807708 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:08.807708 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:08.807708 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:08.807708 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:08.807708 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:08.807708 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:08.807708 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:08.807708 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:08.807708 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:08.808720 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:08.808720 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:08.808720 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:49:08.808720 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:49:08.808720 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:49:08.808720 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:49:08.808720 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:49:08.808720 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:49:08.808720 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Apr 30 20:49:08.808720 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:08.812057 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 392/787] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Apr 30 20:49:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:08.820549 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4fadc3-1b4e-4229-ba09-9aef4610aaea None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:08.921915 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4fadc3-1b4e-4229-ba09-9aef4610aaea None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:08.960472 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3177f9-091f-4bf2-a245-3378a3dbde5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:08.961464 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3177f9-091f-4bf2-a245-3378a3dbde5f None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:08.961912 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3177f9-091f-4bf2-a245-3378a3dbde5f None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:08.962351 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3177f9-091f-4bf2-a245-3378a3dbde5f None admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:08.963321 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3177f9-091f-4bf2-a245-3378a3dbde5f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:08.963780 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3177f9-091f-4bf2-a245-3378a3dbde5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:08.965360 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3177f9-091f-4bf2-a245-3378a3dbde5f None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:08.989218 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 396/788] 10.222.0.23 () {56 vars in 1135 bytes} [Sat Apr 30 20:49:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:08.993804 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d783a7-6a8f-40b2-9ee6-b87cee42585e None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:09.228896 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d646b01-7777-414b-9689-1703b9a7e9e7 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:09.229446 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d646b01-7777-414b-9689-1703b9a7e9e7 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:09.229901 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d646b01-7777-414b-9689-1703b9a7e9e7 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:09.231375 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 397/789] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:49:09.236956 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df291d2-a2fb-463e-b812-a0110714c538 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:09.237247 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df291d2-a2fb-463e-b812-a0110714c538 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:09.237531 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df291d2-a2fb-463e-b812-a0110714c538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:09.264762 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-0df291d2-a2fb-463e-b812-a0110714c538 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:09.265991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0df291d2-a2fb-463e-b812-a0110714c538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:09.287132 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d783a7-6a8f-40b2-9ee6-b87cee42585e None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:09.355476 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e80b489-d872-415e-9754-a42f4f360294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:09.356350 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80b489-d872-415e-9754-a42f4f360294 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:09.356636 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80b489-d872-415e-9754-a42f4f360294 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:09.357466 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e80b489-d872-415e-9754-a42f4f360294 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:09.371672 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e80b489-d872-415e-9754-a42f4f360294 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:09.381915 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e80b489-d872-415e-9754-a42f4f360294 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:09.389380 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 398/790] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:49:09.398174 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-0e80b489-d872-415e-9754-a42f4f360294 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:09.398174 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:09.398174 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:09.398174 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:09.398174 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:09.398174 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:09.398174 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:09.398174 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:09.398174 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:09.398174 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:09.398174 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:09.398174 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:09.398174 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:49:09.398174 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:49:09.398174 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:49:09.399056 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:49:09.399056 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:09.399056 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:09.399056 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:09.399056 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:09.399056 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:09.399056 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:09.399056 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:09.399056 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:09.399056 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:09.399056 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:09.399056 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:09.399056 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:09.399056 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:09.399056 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:09.399056 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:09.399056 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:09.400160 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:49:09.400160 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:49:09.400160 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:09.400160 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:09.400160 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 393/791] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:49:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:09.405472 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df291d2-a2fb-463e-b812-a0110714c538 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:09.411583 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84256bac-6770-49f6-abed-a5f8e6f39fc8 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:09.412147 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84256bac-6770-49f6-abed-a5f8e6f39fc8 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:09.412687 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84256bac-6770-49f6-abed-a5f8e6f39fc8 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:09.414560 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 394/792] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:49:09.420399 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a691b-5112-428e-8ae1-f59b08f4757c None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:09.420931 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a691b-5112-428e-8ae1-f59b08f4757c None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:09.421406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a691b-5112-428e-8ae1-f59b08f4757c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:09.446431 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-436a691b-5112-428e-8ae1-f59b08f4757c None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:09.447990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-436a691b-5112-428e-8ae1-f59b08f4757c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:09.521866 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 395/793] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 30 20:49:09.521866 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a691b-5112-428e-8ae1-f59b08f4757c None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:09.557433 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df291d2-a2fb-463e-b812-a0110714c538 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:09.592960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b007d3-613e-47d9-ad65-fcf8d78a1b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:09.594032 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b007d3-613e-47d9-ad65-fcf8d78a1b21 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:09.594520 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b007d3-613e-47d9-ad65-fcf8d78a1b21 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:09.595260 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b007d3-613e-47d9-ad65-fcf8d78a1b21 None admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:09.596226 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b007d3-613e-47d9-ad65-fcf8d78a1b21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:09.596796 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b007d3-613e-47d9-ad65-fcf8d78a1b21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:09.598411 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b007d3-613e-47d9-ad65-fcf8d78a1b21 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:09.610954 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 399/794] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:49:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:09.612035 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b007d3-613e-47d9-ad65-fcf8d78a1b21 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:09.638271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a691b-5112-428e-8ae1-f59b08f4757c None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:09.676246 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ff00d-c0b2-4be3-b9b1-4f2e6dec9423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:09.677393 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ff00d-c0b2-4be3-b9b1-4f2e6dec9423 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:09.677984 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ff00d-c0b2-4be3-b9b1-4f2e6dec9423 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:09.678467 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ff00d-c0b2-4be3-b9b1-4f2e6dec9423 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:09.689276 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ff00d-c0b2-4be3-b9b1-4f2e6dec9423 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:49:09.697380 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-c26ff00d-c0b2-4be3-b9b1-4f2e6dec9423 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:49:09.697380 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:09.697380 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:09.697380 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:09.697380 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:09.697380 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:09.697380 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:09.697380 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:09.697380 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:09.697380 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:09.697380 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:09.697380 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:09.697380 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:49:09.697380 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:49:09.697380 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:49:09.697380 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:49:09.698359 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:49:09.698359 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:49:09.698359 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:49:09.698359 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:49:09.698359 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:09.698359 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:09.698359 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:09.698359 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:09.698359 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:09.698359 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:09.698359 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:09.698359 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:09.698359 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:09.698359 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:09.698359 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:09.698359 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:09.700369 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:09.700369 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:09.700369 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:09.700369 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:09.700369 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:49:09.700369 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:49:09.700369 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:49:09.700369 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:49:09.700369 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:49:09.700369 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:49:09.700369 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:49:09.700369 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:09.703990 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 396/795] 10.222.0.23 () {56 vars in 1102 bytes} [Sat Apr 30 20:49:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:09.705215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ff00d-c0b2-4be3-b9b1-4f2e6dec9423 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:09.749110 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b007d3-613e-47d9-ad65-fcf8d78a1b21 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:09.792815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9fcba-0868-44ce-bae1-c52969814952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:09.793539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9fcba-0868-44ce-bae1-c52969814952 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:09.793846 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9fcba-0868-44ce-bae1-c52969814952 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:09.794128 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9fcba-0868-44ce-bae1-c52969814952 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:09.807598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a9fcba-0868-44ce-bae1-c52969814952 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:49:09.813896 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ff00d-c0b2-4be3-b9b1-4f2e6dec9423 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:09.817650 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-15a9fcba-0868-44ce-bae1-c52969814952 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:49:09.817650 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:09.817650 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:09.817650 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:09.817650 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:09.817650 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:09.817650 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:09.817650 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:09.817650 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:09.817650 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:09.817650 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:09.817650 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:09.817650 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:49:09.817650 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:49:09.817650 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:49:09.817650 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:49:09.818597 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:49:09.818597 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:49:09.818597 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:49:09.818597 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:49:09.818597 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:09.818597 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:09.818597 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:09.818597 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:09.818597 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:09.818597 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:09.818597 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:09.818597 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:09.818597 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:09.818597 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:09.818597 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:09.818597 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:09.824522 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:09.824522 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:09.824522 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:09.824522 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:09.824522 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:49:09.824522 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:49:09.824522 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:49:09.824522 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:49:09.824522 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:49:09.824522 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:49:09.824522 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:49:09.824522 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:09.824522 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 400/796] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Apr 30 20:49:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:09.825224 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9fcba-0868-44ce-bae1-c52969814952 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:09.870570 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42122ca-8a32-4ed9-a43f-0c1d709706ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:09.871757 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42122ca-8a32-4ed9-a43f-0c1d709706ac None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:09.872043 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42122ca-8a32-4ed9-a43f-0c1d709706ac None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:09.872346 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42122ca-8a32-4ed9-a43f-0c1d709706ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:09.881671 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42122ca-8a32-4ed9-a43f-0c1d709706ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:09.883655 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42122ca-8a32-4ed9-a43f-0c1d709706ac None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:09.902592 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-c42122ca-8a32-4ed9-a43f-0c1d709706ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:49:09.902592 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:09.902592 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:09.902592 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:09.902592 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:09.902592 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:09.902592 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:09.902592 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:09.902592 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:09.902592 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:09.902592 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:09.902592 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:09.902592 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:49:09.902592 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:49:09.902592 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:49:09.903536 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:49:09.903536 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:09.903536 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:09.903536 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:09.903536 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:09.903536 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:09.903536 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:09.903536 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:09.903536 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:09.903536 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:09.903536 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:09.903536 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:09.903536 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:09.903536 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:09.903536 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:09.903536 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:09.903536 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:09.905141 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:49:09.905141 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:49:09.905141 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:49:09.905141 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:49:09.905141 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:49:09.905141 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:49:09.905141 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:49:09.905141 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:09.909118 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 397/797] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:49:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:09.909998 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42122ca-8a32-4ed9-a43f-0c1d709706ac None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:09.934995 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9fcba-0868-44ce-bae1-c52969814952 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:09.969363 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f0aba-e66d-4404-aec2-dd600fc82d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:09.971193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f0aba-e66d-4404-aec2-dd600fc82d85 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:09.971689 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f0aba-e66d-4404-aec2-dd600fc82d85 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:09.972410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f0aba-e66d-4404-aec2-dd600fc82d85 None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:09.973570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f0aba-e66d-4404-aec2-dd600fc82d85 None admin] RBAC: Adding query filter params (name=service) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:09.974433 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f0aba-e66d-4404-aec2-dd600fc82d85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:09.976025 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f0aba-e66d-4404-aec2-dd600fc82d85 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:09.987516 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 401/798] 10.222.0.23 () {56 vars in 1103 bytes} [Sat Apr 30 20:49:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:09.988771 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f0aba-e66d-4404-aec2-dd600fc82d85 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:10.027352 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42122ca-8a32-4ed9-a43f-0c1d709706ac None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:10.064201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f893c1-858f-4ff9-b3ae-28729c09fa5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:10.065228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f893c1-858f-4ff9-b3ae-28729c09fa5c None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:10.065721 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f893c1-858f-4ff9-b3ae-28729c09fa5c None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:10.066245 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f893c1-858f-4ff9-b3ae-28729c09fa5c None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:10.067248 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f893c1-858f-4ff9-b3ae-28729c09fa5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:10.067816 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f893c1-858f-4ff9-b3ae-28729c09fa5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:10.069384 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f893c1-858f-4ff9-b3ae-28729c09fa5c None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:10.079108 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 398/799] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:49:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:10.080297 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f893c1-858f-4ff9-b3ae-28729c09fa5c None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:10.100979 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f0aba-e66d-4404-aec2-dd600fc82d85 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:10.137298 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe6430-c5f7-4722-bbda-c2cef348ef28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:10.138567 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe6430-c5f7-4722-bbda-c2cef348ef28 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:10.138863 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe6430-c5f7-4722-bbda-c2cef348ef28 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:10.139218 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe6430-c5f7-4722-bbda-c2cef348ef28 None admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:10.140102 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe6430-c5f7-4722-bbda-c2cef348ef28 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:10.140416 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe6430-c5f7-4722-bbda-c2cef348ef28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:10.145735 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe6430-c5f7-4722-bbda-c2cef348ef28 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:10.165466 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 402/800] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Apr 30 20:49:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:10.166410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe6430-c5f7-4722-bbda-c2cef348ef28 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:10.191297 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f893c1-858f-4ff9-b3ae-28729c09fa5c None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:10.226325 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f794a2-ca7f-4308-82c7-b796b7a423c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:10.227536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f794a2-ca7f-4308-82c7-b796b7a423c6 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:10.228036 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f794a2-ca7f-4308-82c7-b796b7a423c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:10.228560 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f794a2-ca7f-4308-82c7-b796b7a423c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:10.239867 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f794a2-ca7f-4308-82c7-b796b7a423c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:10.241694 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f794a2-ca7f-4308-82c7-b796b7a423c6 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:10.259811 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-72f794a2-ca7f-4308-82c7-b796b7a423c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:10.259811 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:10.259811 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:10.259811 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:10.259811 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:10.259811 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:10.259811 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:10.259811 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:10.259811 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:10.259811 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:10.259811 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:10.259811 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:10.259811 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:49:10.259811 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:49:10.259811 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:49:10.260731 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:49:10.260731 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:10.260731 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:10.260731 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:10.260731 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:10.260731 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:10.260731 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:10.260731 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:10.260731 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:10.260731 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:10.260731 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:10.260731 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:10.260731 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:10.260731 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:10.260731 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:10.260731 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:10.260731 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:10.261598 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:49:10.261598 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:49:10.261598 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:10.261598 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:10.265368 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 399/801] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:49:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:10.266481 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f794a2-ca7f-4308-82c7-b796b7a423c6 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:10.283212 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe6430-c5f7-4722-bbda-c2cef348ef28 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:10.317931 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189faa5-525b-4b72-a318-bd7cbf819506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:10.318649 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189faa5-525b-4b72-a318-bd7cbf819506 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:10.318934 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189faa5-525b-4b72-a318-bd7cbf819506 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:10.319401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189faa5-525b-4b72-a318-bd7cbf819506 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:10.331494 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8189faa5-525b-4b72-a318-bd7cbf819506 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:10.333735 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8189faa5-525b-4b72-a318-bd7cbf819506 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:10.359964 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-8189faa5-525b-4b72-a318-bd7cbf819506 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:10.359964 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:10.359964 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:10.359964 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:10.359964 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:10.359964 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:10.359964 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:10.359964 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:10.359964 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:10.359964 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:10.359964 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:10.359964 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:10.359964 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:49:10.359964 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:49:10.359964 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:49:10.361082 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:49:10.361082 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:10.361082 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:10.361082 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:10.361082 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:10.361082 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:10.361082 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:10.361082 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:10.361082 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:10.361082 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:10.361082 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:10.361082 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:10.361082 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:10.361082 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:10.361082 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:10.361082 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:10.361082 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:10.366909 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:49:10.366909 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:49:10.366909 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:10.366909 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:10.366909 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 403/802] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:49:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:10.366909 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189faa5-525b-4b72-a318-bd7cbf819506 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:10.379175 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f794a2-ca7f-4308-82c7-b796b7a423c6 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:10.416656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1feab-14fe-4e19-be50-298f1aa7f2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:10.417653 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1feab-14fe-4e19-be50-298f1aa7f2d0 None admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:10.417962 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1feab-14fe-4e19-be50-298f1aa7f2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:10.418233 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1feab-14fe-4e19-be50-298f1aa7f2d0 None admin] PATH_INFO: `/v3/projects/6b52e5e13b9144dfb663578766c2bac0/users/27edf527e36c4ee7a9065688f4bed942/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:10.420689 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1feab-14fe-4e19-be50-298f1aa7f2d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b52e5e13b9144dfb663578766c2bac0, user_id=27edf527e36c4ee7a9065688f4bed942, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:10.422143 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1feab-14fe-4e19-be50-298f1aa7f2d0 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:10.459923 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189faa5-525b-4b72-a318-bd7cbf819506 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:10.492484 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aff374-569d-44f8-b13f-432e9d24b13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:10.493144 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aff374-569d-44f8-b13f-432e9d24b13e None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:10.493425 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aff374-569d-44f8-b13f-432e9d24b13e None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:10.493698 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aff374-569d-44f8-b13f-432e9d24b13e None admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:10.494439 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aff374-569d-44f8-b13f-432e9d24b13e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:10.494744 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aff374-569d-44f8-b13f-432e9d24b13e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:10.496167 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aff374-569d-44f8-b13f-432e9d24b13e None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:10.507837 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 404/803] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:49:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:10.509395 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e087458-7755-494f-b055-e82ced61ca43 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:10.509673 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e087458-7755-494f-b055-e82ced61ca43 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:10.509993 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e087458-7755-494f-b055-e82ced61ca43 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:10.512304 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 405/804] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:49:10.512304 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e087458-7755-494f-b055-e82ced61ca43 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:10.524832 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 400/805] 10.222.0.23 () {58 vars in 1439 bytes} [Sat Apr 30 20:49:10 2022] PUT /identity/v3/projects/6b52e5e13b9144dfb663578766c2bac0/users/27edf527e36c4ee7a9065688f4bed942/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:49:10.524832 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1feab-14fe-4e19-be50-298f1aa7f2d0 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:10.646889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e087458-7755-494f-b055-e82ced61ca43 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:10.648962 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1feab-14fe-4e19-be50-298f1aa7f2d0 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:10.688138 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7bf42-93ac-4daf-837e-6579adff6aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:10.689127 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7bf42-93ac-4daf-837e-6579adff6aa0 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:10.689521 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7bf42-93ac-4daf-837e-6579adff6aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:10.689950 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7bf42-93ac-4daf-837e-6579adff6aa0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:10.691195 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a84d0d-5460-4494-95b1-71a3e0691bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:10.691864 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a84d0d-5460-4494-95b1-71a3e0691bad None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:10.692148 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a84d0d-5460-4494-95b1-71a3e0691bad None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:10.692424 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a84d0d-5460-4494-95b1-71a3e0691bad None admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:10.693914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a84d0d-5460-4494-95b1-71a3e0691bad None admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:10.694569 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a84d0d-5460-4494-95b1-71a3e0691bad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:10.696563 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a84d0d-5460-4494-95b1-71a3e0691bad None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:10.702392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b7bf42-93ac-4daf-837e-6579adff6aa0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:10.704066 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b7bf42-93ac-4daf-837e-6579adff6aa0 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:10.713888 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 406/806] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:49:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:10.715616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6095ce-d7fd-481d-aa1b-3eca1754c76e None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:10.716054 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6095ce-d7fd-481d-aa1b-3eca1754c76e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:10.716543 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6095ce-d7fd-481d-aa1b-3eca1754c76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:10.724810 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-84b7bf42-93ac-4daf-837e-6579adff6aa0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 30 20:49:10.724810 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:10.724810 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:10.724810 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:10.724810 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:10.724810 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:10.724810 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:10.724810 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:10.724810 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:10.724810 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:10.724810 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:10.724810 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:10.724810 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:49:10.724810 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:49:10.724810 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:49:10.724810 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:49:10.725783 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:10.725783 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:10.725783 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:49:10.725783 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:49:10.725783 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:49:10.725783 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:49:10.725783 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:10.725783 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:10.725783 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:10.725783 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:10.725783 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:10.725783 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:10.725783 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:10.725783 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:10.725783 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:10.725783 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:10.725783 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:10.725783 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:10.727831 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:10.727831 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:10.727831 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:49:10.727831 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:49:10.727831 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:49:10.727831 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:49:10.727831 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:49:10.727831 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:49:10.727831 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 30 20:49:10.727831 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:10.727831 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 401/807] 10.222.0.23 () {56 vars in 1117 bytes} [Sat Apr 30 20:49:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:10.727831 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7bf42-93ac-4daf-837e-6579adff6aa0 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:10.742906 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-2d6095ce-d7fd-481d-aa1b-3eca1754c76e None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:10.744101 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2d6095ce-d7fd-481d-aa1b-3eca1754c76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:10.819183 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 407/808] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:49:10.820395 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6095ce-d7fd-481d-aa1b-3eca1754c76e None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:10.849940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7bf42-93ac-4daf-837e-6579adff6aa0 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:10.887859 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31402ea-1238-4452-8f33-a3b5abf9e982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:10.888704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31402ea-1238-4452-8f33-a3b5abf9e982 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:10.888985 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31402ea-1238-4452-8f33-a3b5abf9e982 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:10.889260 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31402ea-1238-4452-8f33-a3b5abf9e982 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:10.897682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31402ea-1238-4452-8f33-a3b5abf9e982 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:10.899091 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31402ea-1238-4452-8f33-a3b5abf9e982 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:10.913405 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-d31402ea-1238-4452-8f33-a3b5abf9e982 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 30 20:49:10.913405 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:10.913405 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:10.913405 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:10.913405 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:10.913405 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:10.913405 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:10.913405 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:10.913405 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:10.913405 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:10.913405 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:10.913405 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:10.913405 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:49:10.913405 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:49:10.913405 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:49:10.913405 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:49:10.914711 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:10.914711 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:10.914711 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:49:10.914711 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:49:10.914711 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:49:10.914711 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:49:10.914711 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:10.914711 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:10.914711 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:10.914711 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:10.914711 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:10.914711 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:10.914711 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:10.914711 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:10.914711 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:10.914711 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:10.914711 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:10.914711 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:10.915714 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:10.915714 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:10.915714 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:49:10.915714 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:49:10.915714 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:49:10.915714 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:49:10.915714 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:49:10.915714 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:49:10.915714 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Apr 30 20:49:10.915714 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:10.919216 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 402/809] 10.222.0.23 () {56 vars in 1093 bytes} [Sat Apr 30 20:49:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:10.920614 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31402ea-1238-4452-8f33-a3b5abf9e982 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:10.934848 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6095ce-d7fd-481d-aa1b-3eca1754c76e None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:10.967658 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b729e-5630-4bf4-9bcc-1f872b743440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:10.968336 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b729e-5630-4bf4-9bcc-1f872b743440 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:10.968606 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b729e-5630-4bf4-9bcc-1f872b743440 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:10.968881 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b729e-5630-4bf4-9bcc-1f872b743440 None admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:10.969702 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b729e-5630-4bf4-9bcc-1f872b743440 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:10.970289 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b729e-5630-4bf4-9bcc-1f872b743440 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:10.971809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b729e-5630-4bf4-9bcc-1f872b743440 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:10.989744 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 408/810] 10.222.0.23 () {56 vars in 1149 bytes} [Sat Apr 30 20:49:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:10.990677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b729e-5630-4bf4-9bcc-1f872b743440 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:11.043832 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31402ea-1238-4452-8f33-a3b5abf9e982 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:11.080562 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040a0b7-9f71-44a0-be8c-873c9257f58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:11.081535 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040a0b7-9f71-44a0-be8c-873c9257f58f None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:11.081953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040a0b7-9f71-44a0-be8c-873c9257f58f None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:11.082334 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040a0b7-9f71-44a0-be8c-873c9257f58f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:11.082982 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f040a0b7-9f71-44a0-be8c-873c9257f58f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:11.084348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f040a0b7-9f71-44a0-be8c-873c9257f58f None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:11.089596 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b729e-5630-4bf4-9bcc-1f872b743440 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:11.096788 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-f040a0b7-9f71-44a0-be8c-873c9257f58f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 30 20:49:11.096788 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:11.096788 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:49:11.096788 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:49:11.096788 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:49:11.096788 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:49:11.096788 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:49:11.096788 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:49:11.096788 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 30 20:49:11.096788 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:11.096788 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:49:11.096788 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:11.096788 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:11.096788 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:11.096788 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:11.096788 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:11.097710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:11.097710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:11.097710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:11.097710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:11.097710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:11.097710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:11.097710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:11.097710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:49:11.097710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:49:11.097710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:49:11.097710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:49:11.097710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:11.097710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:11.097710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:11.097710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:11.097710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:11.098602 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:11.098602 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:11.098602 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:11.098602 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:11.098602 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:11.098602 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:11.098602 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:11.098602 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:11.098602 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:11.098602 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:11.098602 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:11.098602 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:49:11.098602 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:49:11.098602 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 30 20:49:11.098602 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:11.098602 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 403/811] 10.222.0.23 () {56 vars in 1129 bytes} [Sat Apr 30 20:49:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:11.099457 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040a0b7-9f71-44a0-be8c-873c9257f58f None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:11.127579 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300df76-66b2-4734-99d2-5c78d87d7522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:11.128336 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300df76-66b2-4734-99d2-5c78d87d7522 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:11.128692 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300df76-66b2-4734-99d2-5c78d87d7522 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:11.129043 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300df76-66b2-4734-99d2-5c78d87d7522 None admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:11.130007 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300df76-66b2-4734-99d2-5c78d87d7522 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:11.130395 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300df76-66b2-4734-99d2-5c78d87d7522 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:11.131944 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300df76-66b2-4734-99d2-5c78d87d7522 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:11.155323 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 409/812] 10.222.0.23 () {56 vars in 1133 bytes} [Sat Apr 30 20:49:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:11.156818 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63ff56-7023-449d-a1cd-14a330ddc827 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:11.157271 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63ff56-7023-449d-a1cd-14a330ddc827 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:11.157544 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63ff56-7023-449d-a1cd-14a330ddc827 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:11.159366 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 410/813] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:49:11.159746 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63ff56-7023-449d-a1cd-14a330ddc827 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:11.206474 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040a0b7-9f71-44a0-be8c-873c9257f58f None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:11.239749 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc40dfd-14b0-44e7-bf1f-566ceb3265db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:11.240627 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc40dfd-14b0-44e7-bf1f-566ceb3265db None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:11.240978 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc40dfd-14b0-44e7-bf1f-566ceb3265db None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:11.241325 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc40dfd-14b0-44e7-bf1f-566ceb3265db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:11.252236 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc40dfd-14b0-44e7-bf1f-566ceb3265db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:11.253792 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc40dfd-14b0-44e7-bf1f-566ceb3265db None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:11.264922 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63ff56-7023-449d-a1cd-14a330ddc827 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:11.271036 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-bbc40dfd-14b0-44e7-bf1f-566ceb3265db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:11.271036 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:11.271036 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:11.271036 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:11.271036 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:11.271036 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:11.271036 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:11.271036 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:11.271036 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:11.271036 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:11.271036 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:11.271036 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:11.271036 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:49:11.271036 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:49:11.271036 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:49:11.272120 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:49:11.272120 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:11.272120 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:11.272120 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:11.272120 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:11.272120 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:11.272120 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:11.272120 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:11.272120 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:11.272120 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:11.272120 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:11.272120 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:11.272120 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:11.272120 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:11.272120 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:11.272120 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:11.272120 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:11.273228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:49:11.273228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:49:11.273228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:11.273228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:11.277346 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 404/814] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:49:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:11.278240 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc40dfd-14b0-44e7-bf1f-566ceb3265db None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:11.306210 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d852a76-3741-45b8-821c-b9c9f2051bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:11.306984 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d852a76-3741-45b8-821c-b9c9f2051bcd None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:11.307344 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d852a76-3741-45b8-821c-b9c9f2051bcd None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:11.307667 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d852a76-3741-45b8-821c-b9c9f2051bcd None admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:11.308540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d852a76-3741-45b8-821c-b9c9f2051bcd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:11.308649 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d852a76-3741-45b8-821c-b9c9f2051bcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:11.310570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d852a76-3741-45b8-821c-b9c9f2051bcd None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:11.319631 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 411/815] 10.222.0.23 () {56 vars in 1124 bytes} [Sat Apr 30 20:49:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:11.319631 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf9ace-b1c4-46f2-a3e7-868b9a30934e None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:11.319631 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf9ace-b1c4-46f2-a3e7-868b9a30934e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:11.319631 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf9ace-b1c4-46f2-a3e7-868b9a30934e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:11.332642 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-1fcf9ace-b1c4-46f2-a3e7-868b9a30934e None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:11.333876 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1fcf9ace-b1c4-46f2-a3e7-868b9a30934e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:11.390938 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc40dfd-14b0-44e7-bf1f-566ceb3265db None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:11.409857 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 412/816] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:49:11.409857 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf9ace-b1c4-46f2-a3e7-868b9a30934e None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:11.428479 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de70e5b-2c32-4b79-8f4a-aed0a5466dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:11.429128 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de70e5b-2c32-4b79-8f4a-aed0a5466dac None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:11.429416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de70e5b-2c32-4b79-8f4a-aed0a5466dac None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:11.429680 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de70e5b-2c32-4b79-8f4a-aed0a5466dac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:11.500748 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de70e5b-2c32-4b79-8f4a-aed0a5466dac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:11.502246 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de70e5b-2c32-4b79-8f4a-aed0a5466dac None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:11.509079 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf9ace-b1c4-46f2-a3e7-868b9a30934e None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:11.543993 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3fa20-76cf-4b1b-9da1-99f98b42c36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:11.545570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3fa20-76cf-4b1b-9da1-99f98b42c36c None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:11.545570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3fa20-76cf-4b1b-9da1-99f98b42c36c None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:11.545863 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3fa20-76cf-4b1b-9da1-99f98b42c36c None admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:11.546529 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b3fa20-76cf-4b1b-9da1-99f98b42c36c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:11.546829 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b3fa20-76cf-4b1b-9da1-99f98b42c36c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:11.548192 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b3fa20-76cf-4b1b-9da1-99f98b42c36c None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:11.563687 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 413/817] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:49:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:11.563687 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3fa20-76cf-4b1b-9da1-99f98b42c36c None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:11.605605 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 405/818] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:49:11 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 30 20:49:11.605605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de70e5b-2c32-4b79-8f4a-aed0a5466dac None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:11.678795 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3fa20-76cf-4b1b-9da1-99f98b42c36c None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:11.699548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de70e5b-2c32-4b79-8f4a-aed0a5466dac None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:11.711889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d8918-cbeb-41d3-9af4-0dcc8063403e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:11.712762 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d8918-cbeb-41d3-9af4-0dcc8063403e None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:11.713194 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d8918-cbeb-41d3-9af4-0dcc8063403e None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:11.713721 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d8918-cbeb-41d3-9af4-0dcc8063403e None admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:11.714601 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719d8918-cbeb-41d3-9af4-0dcc8063403e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:11.715062 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719d8918-cbeb-41d3-9af4-0dcc8063403e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:11.717178 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719d8918-cbeb-41d3-9af4-0dcc8063403e None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:11.722269 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 414/819] 10.222.0.23 () {56 vars in 1124 bytes} [Sat Apr 30 20:49:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:11.723230 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d8918-cbeb-41d3-9af4-0dcc8063403e None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:11.738768 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0fbd4-2b8a-4ee4-8a1d-f245b45e29d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:11.739677 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0fbd4-2b8a-4ee4-8a1d-f245b45e29d7 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:11.739967 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0fbd4-2b8a-4ee4-8a1d-f245b45e29d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:11.740244 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0fbd4-2b8a-4ee4-8a1d-f245b45e29d7 None admin] PATH_INFO: `/v3/services/network` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:11.740899 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da0fbd4-2b8a-4ee4-8a1d-f245b45e29d7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:11.742327 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da0fbd4-2b8a-4ee4-8a1d-f245b45e29d7 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:11.753646 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-6da0fbd4-2b8a-4ee4-8a1d-f245b45e29d7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 30 20:49:11.753646 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:11.753646 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:49:11.753646 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:49:11.753646 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:49:11.753646 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:49:11.753646 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:49:11.753646 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:49:11.753646 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Apr 30 20:49:11.753646 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:11.753646 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:49:11.753646 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:11.753646 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:11.753646 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:11.753646 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:11.753646 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:11.753646 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:11.754878 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:11.754878 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:11.754878 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:11.754878 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:11.754878 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:11.754878 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:11.754878 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:49:11.754878 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:49:11.754878 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:49:11.754878 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:49:11.754878 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:11.754878 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:11.754878 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:11.754878 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:11.754878 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:11.754878 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:11.755952 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:11.755952 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:11.755952 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:11.755952 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:11.755952 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:11.755952 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:11.755952 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:11.755952 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:11.755952 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:11.755952 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:11.755952 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:49:11.755952 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:49:11.755952 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Apr 30 20:49:11.755952 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:11.759495 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 406/820] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:49:11 2022] GET /identity/v3/services/network => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:11.760305 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0fbd4-2b8a-4ee4-8a1d-f245b45e29d7 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:11.827191 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d8918-cbeb-41d3-9af4-0dcc8063403e None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:11.857107 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0fbd4-2b8a-4ee4-8a1d-f245b45e29d7 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:11.860764 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4796c4-e3bd-4ece-ade6-6da235b3a75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:11.861548 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4796c4-e3bd-4ece-ade6-6da235b3a75d None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:11.861863 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4796c4-e3bd-4ece-ade6-6da235b3a75d None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:11.862142 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4796c4-e3bd-4ece-ade6-6da235b3a75d None admin] PATH_INFO: `/v3/projects/service` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:11.868825 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4796c4-e3bd-4ece-ade6-6da235b3a75d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:11.870318 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4796c4-e3bd-4ece-ade6-6da235b3a75d None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:11.884448 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-2d4796c4-e3bd-4ece-ade6-6da235b3a75d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:49:11.884448 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:11.884448 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:11.884448 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:11.884448 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:11.884448 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:11.884448 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:11.884448 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:11.884448 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:11.884448 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:11.884448 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:11.884448 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:11.884448 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:49:11.884448 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:49:11.884448 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:49:11.885388 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:49:11.885388 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:11.885388 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:11.885388 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:11.885388 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:11.885388 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:11.885388 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:11.885388 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:11.885388 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:11.885388 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:11.885388 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:11.885388 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:11.885388 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:11.885388 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:11.885388 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:11.885388 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:11.885388 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:11.886317 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:49:11.886317 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:49:11.886317 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:49:11.886317 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:49:11.886317 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:49:11.886317 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:49:11.886317 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:49:11.886317 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:11.886317 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 415/821] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:49:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:11.886821 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4796c4-e3bd-4ece-ade6-6da235b3a75d None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:11.894632 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8fb4c-988e-4bf0-9135-f954eea8eb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:11.895425 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8fb4c-988e-4bf0-9135-f954eea8eb80 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:11.895703 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8fb4c-988e-4bf0-9135-f954eea8eb80 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:11.895976 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8fb4c-988e-4bf0-9135-f954eea8eb80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:11.907277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad8fb4c-988e-4bf0-9135-f954eea8eb80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:11.908698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad8fb4c-988e-4bf0-9135-f954eea8eb80 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:11.925563 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-fad8fb4c-988e-4bf0-9135-f954eea8eb80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:11.925563 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:11.925563 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:11.925563 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:11.925563 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:11.925563 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:11.925563 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:11.925563 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:11.925563 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:11.925563 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:11.925563 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:11.925563 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:11.925563 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:49:11.925563 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:49:11.925563 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:49:11.926601 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:49:11.926601 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:11.926601 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:11.926601 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:11.926601 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:11.926601 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:11.926601 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:11.926601 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:11.926601 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:11.926601 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:11.926601 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:11.926601 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:11.926601 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:11.926601 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:11.926601 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:11.926601 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:11.926601 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:11.927694 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:49:11.927694 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:49:11.927694 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:11.927694 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:11.931392 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 407/822] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:49:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:11.932066 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8fb4c-988e-4bf0-9135-f954eea8eb80 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:11.985882 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4796c4-e3bd-4ece-ade6-6da235b3a75d None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:12.024743 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f86fa8-8ce9-43ba-b4e6-bb93f1924aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:12.025396 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f86fa8-8ce9-43ba-b4e6-bb93f1924aee None admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:12.025685 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f86fa8-8ce9-43ba-b4e6-bb93f1924aee None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:12.025993 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f86fa8-8ce9-43ba-b4e6-bb93f1924aee None admin] PATH_INFO: `/v3/endpoints` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:12.026727 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f86fa8-8ce9-43ba-b4e6-bb93f1924aee None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:12.028100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f86fa8-8ce9-43ba-b4e6-bb93f1924aee None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:12.041329 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8fb4c-988e-4bf0-9135-f954eea8eb80 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:12.074068 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9417b-c7fe-43ea-bcb2-113393b5ca9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:12.074869 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9417b-c7fe-43ea-bcb2-113393b5ca9f None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:12.075149 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9417b-c7fe-43ea-bcb2-113393b5ca9f None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:12.076004 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9417b-c7fe-43ea-bcb2-113393b5ca9f None admin] PATH_INFO: `/v3/services` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:12.076705 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9417b-c7fe-43ea-bcb2-113393b5ca9f None admin] RBAC: Adding query filter params (name=network) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:12.077006 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9417b-c7fe-43ea-bcb2-113393b5ca9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:12.078430 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9417b-c7fe-43ea-bcb2-113393b5ca9f None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:12.082781 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 408/823] 10.222.0.23 () {56 vars in 1112 bytes} [Sat Apr 30 20:49:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:12.083539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9417b-c7fe-43ea-bcb2-113393b5ca9f None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:12.158212 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 416/824] 10.222.0.23 () {60 vars in 1144 bytes} [Sat Apr 30 20:49:11 2022] POST /identity/v3/endpoints => generated 346 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:49:12.159274 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f86fa8-8ce9-43ba-b4e6-bb93f1924aee None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:12.208274 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9417b-c7fe-43ea-bcb2-113393b5ca9f None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:12.267089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c8e8b-e7d4-4b4c-8a8b-ece8258f8cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:12.268275 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c8e8b-e7d4-4b4c-8a8b-ece8258f8cc6 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:12.269113 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c8e8b-e7d4-4b4c-8a8b-ece8258f8cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:12.269541 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c8e8b-e7d4-4b4c-8a8b-ece8258f8cc6 None admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:12.270828 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c8e8b-e7d4-4b4c-8a8b-ece8258f8cc6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:12.271478 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c8e8b-e7d4-4b4c-8a8b-ece8258f8cc6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:12.273531 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c8e8b-e7d4-4b4c-8a8b-ece8258f8cc6 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:12.289231 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f86fa8-8ce9-43ba-b4e6-bb93f1924aee None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:12.295809 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 409/825] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Apr 30 20:49:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:12.295809 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c8e8b-e7d4-4b4c-8a8b-ece8258f8cc6 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:12.332908 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e020b68-b901-404f-8e06-45a7985e2451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:12.333784 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e020b68-b901-404f-8e06-45a7985e2451 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:12.334196 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e020b68-b901-404f-8e06-45a7985e2451 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:12.334591 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e020b68-b901-404f-8e06-45a7985e2451 None admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:12.335434 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e020b68-b901-404f-8e06-45a7985e2451 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:12.335854 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e020b68-b901-404f-8e06-45a7985e2451 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:12.337574 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e020b68-b901-404f-8e06-45a7985e2451 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:12.351255 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 417/826] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:12.353167 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e020b68-b901-404f-8e06-45a7985e2451 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:12.411445 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c8e8b-e7d4-4b4c-8a8b-ece8258f8cc6 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:12.446391 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a611d-0fb2-4d99-b77a-019d505446f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:12.447058 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a611d-0fb2-4d99-b77a-019d505446f7 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:12.447337 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a611d-0fb2-4d99-b77a-019d505446f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:12.447608 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a611d-0fb2-4d99-b77a-019d505446f7 None admin] PATH_INFO: `/v3/services` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:12.448307 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a611d-0fb2-4d99-b77a-019d505446f7 None admin] RBAC: Adding query filter params (type=network) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:12.448605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a611d-0fb2-4d99-b77a-019d505446f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:12.449996 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a611d-0fb2-4d99-b77a-019d505446f7 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:12.455724 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 410/827] 10.222.0.23 () {56 vars in 1112 bytes} [Sat Apr 30 20:49:12 2022] GET /identity/v3/services?type=network => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:12.456504 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a611d-0fb2-4d99-b77a-019d505446f7 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:12.459976 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e020b68-b901-404f-8e06-45a7985e2451 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:12.505650 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d3eb9-cf87-4fd7-91ca-16169553936e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:12.506582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d3eb9-cf87-4fd7-91ca-16169553936e None admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:12.506861 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d3eb9-cf87-4fd7-91ca-16169553936e None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:12.507138 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d3eb9-cf87-4fd7-91ca-16169553936e None admin] PATH_INFO: `/v3/projects/6b52e5e13b9144dfb663578766c2bac0/users/2e3511017b8e4b4f9805a65c3ac173f9/roles/0971c8bf92d64c50a5cbbf7d146af841` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:12.523038 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d3eb9-cf87-4fd7-91ca-16169553936e None admin] RBAC: Authorizing `identity:create_grant(project_id=6b52e5e13b9144dfb663578766c2bac0, user_id=2e3511017b8e4b4f9805a65c3ac173f9, role_id=0971c8bf92d64c50a5cbbf7d146af841)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:12.524489 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d3eb9-cf87-4fd7-91ca-16169553936e None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:12.560622 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a611d-0fb2-4d99-b77a-019d505446f7 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:12.582557 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 418/828] 10.222.0.23 () {58 vars in 1439 bytes} [Sat Apr 30 20:49:12 2022] PUT /identity/v3/projects/6b52e5e13b9144dfb663578766c2bac0/users/2e3511017b8e4b4f9805a65c3ac173f9/roles/0971c8bf92d64c50a5cbbf7d146af841 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:49:12.583837 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d3eb9-cf87-4fd7-91ca-16169553936e None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:12.597294 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def25b42-aadf-4eca-898f-5a25d474568a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:12.597951 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def25b42-aadf-4eca-898f-5a25d474568a None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:12.598231 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def25b42-aadf-4eca-898f-5a25d474568a None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:12.598501 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def25b42-aadf-4eca-898f-5a25d474568a None admin] PATH_INFO: `/v3/projects/service` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:12.605922 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def25b42-aadf-4eca-898f-5a25d474568a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:12.607738 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def25b42-aadf-4eca-898f-5a25d474568a None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:12.623188 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-def25b42-aadf-4eca-898f-5a25d474568a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:49:12.623188 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:12.623188 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:12.623188 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:12.623188 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:12.623188 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:12.623188 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:12.623188 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:12.623188 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:12.623188 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:12.623188 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:12.623188 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:12.623188 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:49:12.623188 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:49:12.623188 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:49:12.624176 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:49:12.624176 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:12.624176 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:12.624176 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:12.624176 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:12.624176 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:12.624176 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:12.624176 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:12.624176 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:12.624176 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:12.624176 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:12.624176 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:12.624176 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:12.624176 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:12.624176 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:12.624176 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:12.624176 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:12.625380 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:49:12.625380 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:49:12.625380 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:49:12.625380 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:49:12.625380 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:49:12.625380 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:49:12.625380 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:49:12.625380 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:12.625380 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 411/829] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:49:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:12.630605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def25b42-aadf-4eca-898f-5a25d474568a None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:12.699363 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d3eb9-cf87-4fd7-91ca-16169553936e None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:12.735792 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def25b42-aadf-4eca-898f-5a25d474568a None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:12.737347 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf36d34-d492-4c9e-9cb3-36e20fee339a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:12.738442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf36d34-d492-4c9e-9cb3-36e20fee339a None admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:12.738938 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf36d34-d492-4c9e-9cb3-36e20fee339a None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:12.739433 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf36d34-d492-4c9e-9cb3-36e20fee339a None admin] PATH_INFO: `/v3/endpoints` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:12.740406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf36d34-d492-4c9e-9cb3-36e20fee339a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:12.742053 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf36d34-d492-4c9e-9cb3-36e20fee339a None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:12.776744 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e9681-965a-49dd-9f49-3abc40460294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:12.777465 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e9681-965a-49dd-9f49-3abc40460294 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:12.777824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e9681-965a-49dd-9f49-3abc40460294 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:12.778138 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e9681-965a-49dd-9f49-3abc40460294 None admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:12.778969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e9681-965a-49dd-9f49-3abc40460294 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:12.779275 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e9681-965a-49dd-9f49-3abc40460294 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:12.780787 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e9681-965a-49dd-9f49-3abc40460294 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:12.795076 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 412/830] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Apr 30 20:49:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:49:12.801090 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e9681-965a-49dd-9f49-3abc40460294 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:12.826049 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 419/831] 10.222.0.23 () {60 vars in 1144 bytes} [Sat Apr 30 20:49:12 2022] POST /identity/v3/endpoints => generated 327 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:49:12.920792 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e9681-965a-49dd-9f49-3abc40460294 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:12.966130 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ae0bd-db09-44f0-b740-3bbd005b5919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:12.967366 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ae0bd-db09-44f0-b740-3bbd005b5919 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:12.967928 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ae0bd-db09-44f0-b740-3bbd005b5919 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:12.968419 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ae0bd-db09-44f0-b740-3bbd005b5919 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:12.969519 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ae0bd-db09-44f0-b740-3bbd005b5919 None admin] RBAC: Adding query filter params (role.id=30112eb1f3e047398c3c82fb40b72e62, scope.project.id=6b52e5e13b9144dfb663578766c2bac0, user.id=fca4ee1f64c8489ebe7296f9f8f0ab41) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:12.970428 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ae0bd-db09-44f0-b740-3bbd005b5919 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:12.972162 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ae0bd-db09-44f0-b740-3bbd005b5919 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:12.979747 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 413/832] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:49:12 2022] GET /identity/v3/role_assignments?user.id=fca4ee1f64c8489ebe7296f9f8f0ab41&scope.project.id=6b52e5e13b9144dfb663578766c2bac0&role.id=30112eb1f3e047398c3c82fb40b72e62 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:49:13.027057 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b211bd-04f9-4734-919a-24e2030bf0a9 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:13.027587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b211bd-04f9-4734-919a-24e2030bf0a9 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:13.027587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b211bd-04f9-4734-919a-24e2030bf0a9 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:13.029925 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 420/833] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:49:13.035690 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed85191-166d-4b7e-9786-15d8ed18580e None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:13.036052 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed85191-166d-4b7e-9786-15d8ed18580e None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:13.036340 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed85191-166d-4b7e-9786-15d8ed18580e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:13.055272 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-fed85191-166d-4b7e-9786-15d8ed18580e None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:13.056477 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-fed85191-166d-4b7e-9786-15d8ed18580e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:13.136384 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 414/834] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:49:13.166027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b211bd-04f9-4734-919a-24e2030bf0a9 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:13.293839 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b211bd-04f9-4734-919a-24e2030bf0a9 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:13.336780 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d75b139-d2d4-40cb-8df0-96464414c276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:13.337575 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75b139-d2d4-40cb-8df0-96464414c276 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:13.337886 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75b139-d2d4-40cb-8df0-96464414c276 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:13.338159 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75b139-d2d4-40cb-8df0-96464414c276 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:13.348639 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d75b139-d2d4-40cb-8df0-96464414c276 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:49:13.356618 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-6d75b139-d2d4-40cb-8df0-96464414c276 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:49:13.356618 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:13.356618 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:13.356618 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:13.356618 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:13.356618 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:13.356618 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:13.356618 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:13.356618 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:13.356618 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:13.356618 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:13.356618 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:13.356618 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:49:13.356618 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:49:13.356618 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:49:13.356618 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:49:13.357588 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:49:13.357588 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:49:13.357588 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:49:13.357588 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:49:13.357588 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:13.357588 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:13.357588 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:13.357588 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:13.357588 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:13.357588 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:13.357588 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:13.357588 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:13.357588 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:13.357588 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:13.357588 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:13.357588 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:13.359552 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:13.359552 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:13.359552 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:13.359552 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:13.359552 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:49:13.359552 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:49:13.359552 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:49:13.359552 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:49:13.359552 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:49:13.359552 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:49:13.359552 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:49:13.359552 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:13.359552 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 421/835] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Apr 30 20:49:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:13.364036 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed85191-166d-4b7e-9786-15d8ed18580e None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:13.464333 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed85191-166d-4b7e-9786-15d8ed18580e None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:13.499959 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383637a-b9b4-4b96-a386-02b8b1a71536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:13.500628 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383637a-b9b4-4b96-a386-02b8b1a71536 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:13.500907 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383637a-b9b4-4b96-a386-02b8b1a71536 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:13.501179 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383637a-b9b4-4b96-a386-02b8b1a71536 None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:13.501956 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2383637a-b9b4-4b96-a386-02b8b1a71536 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:13.502261 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2383637a-b9b4-4b96-a386-02b8b1a71536 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:13.503638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2383637a-b9b4-4b96-a386-02b8b1a71536 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:13.512434 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 415/836] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:49:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:13.518786 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d75b139-d2d4-40cb-8df0-96464414c276 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:13.626004 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d75b139-d2d4-40cb-8df0-96464414c276 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:13.662824 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a2fc4-20bc-4bb7-b28c-b44890c64008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:13.672457 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a2fc4-20bc-4bb7-b28c-b44890c64008 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:13.672766 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a2fc4-20bc-4bb7-b28c-b44890c64008 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:13.673141 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a2fc4-20bc-4bb7-b28c-b44890c64008 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:13.686433 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a2fc4-20bc-4bb7-b28c-b44890c64008 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:13.692301 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a2fc4-20bc-4bb7-b28c-b44890c64008 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:13.710382 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-bd4a2fc4-20bc-4bb7-b28c-b44890c64008 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:13.710382 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:13.710382 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:13.710382 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:13.710382 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:13.710382 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:13.710382 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:13.710382 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:13.710382 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:13.710382 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:13.710382 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:13.710382 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:13.710382 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:49:13.710382 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:49:13.710382 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:49:13.711292 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:49:13.711292 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:13.711292 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:13.711292 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:13.711292 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:13.711292 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:13.711292 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:13.711292 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:13.711292 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:13.711292 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:13.711292 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:13.711292 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:13.711292 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:13.711292 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:13.711292 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:13.711292 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:13.711292 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:13.712824 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:49:13.712824 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:49:13.712824 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:13.712824 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:13.712824 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 422/837] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:49:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:13.717780 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383637a-b9b4-4b96-a386-02b8b1a71536 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:13.822375 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383637a-b9b4-4b96-a386-02b8b1a71536 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:13.861251 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3ac3d-2901-4ed6-a617-7b92de804594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:13.861944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3ac3d-2901-4ed6-a617-7b92de804594 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:13.862223 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3ac3d-2901-4ed6-a617-7b92de804594 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:13.862496 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3ac3d-2901-4ed6-a617-7b92de804594 None admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:13.863206 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f3ac3d-2901-4ed6-a617-7b92de804594 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:13.863508 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f3ac3d-2901-4ed6-a617-7b92de804594 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:13.864877 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f3ac3d-2901-4ed6-a617-7b92de804594 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:13.877835 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 416/838] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:49:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:13.883291 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a2fc4-20bc-4bb7-b28c-b44890c64008 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:13.988292 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a2fc4-20bc-4bb7-b28c-b44890c64008 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:14.021361 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4746647-670b-4a17-a13b-554969af85dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:14.022188 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4746647-670b-4a17-a13b-554969af85dd None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:14.022465 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4746647-670b-4a17-a13b-554969af85dd None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:14.022737 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4746647-670b-4a17-a13b-554969af85dd None admin] PATH_INFO: `/v3/users/swift` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:14.031183 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4746647-670b-4a17-a13b-554969af85dd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:14.032628 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4746647-670b-4a17-a13b-554969af85dd None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:14.047601 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-a4746647-670b-4a17-a13b-554969af85dd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 30 20:49:14.047601 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:14.047601 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:14.047601 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:14.047601 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:14.047601 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:14.047601 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:14.047601 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:14.047601 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:14.047601 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:14.047601 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:14.047601 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:14.047601 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:49:14.047601 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:49:14.047601 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:49:14.047601 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:49:14.050152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:14.050152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:14.050152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:49:14.050152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:49:14.050152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:49:14.050152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:49:14.050152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:14.050152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:14.050152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:14.050152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:14.050152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:14.050152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:14.050152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:14.050152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:14.050152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:14.050152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:14.050152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:14.050152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:14.052640 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:14.052640 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:14.052640 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:49:14.052640 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:49:14.052640 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:49:14.052640 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:49:14.052640 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:49:14.052640 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:49:14.052640 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Apr 30 20:49:14.052640 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:14.052640 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 423/839] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Apr 30 20:49:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:14.056603 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3ac3d-2901-4ed6-a617-7b92de804594 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:14.158756 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3ac3d-2901-4ed6-a617-7b92de804594 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:14.191740 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46faf5-db96-4c0f-ac51-eb780511cc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:14.192466 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46faf5-db96-4c0f-ac51-eb780511cc19 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:14.192742 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46faf5-db96-4c0f-ac51-eb780511cc19 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:14.193056 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46faf5-db96-4c0f-ac51-eb780511cc19 None admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:14.193912 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d46faf5-db96-4c0f-ac51-eb780511cc19 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:14.194217 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d46faf5-db96-4c0f-ac51-eb780511cc19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:14.195639 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d46faf5-db96-4c0f-ac51-eb780511cc19 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:14.213254 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 417/840] 10.222.0.23 () {56 vars in 1135 bytes} [Sat Apr 30 20:49:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:14.219291 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4746647-670b-4a17-a13b-554969af85dd None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:14.326549 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4746647-670b-4a17-a13b-554969af85dd None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:14.360454 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450b473-2d47-4519-907a-194e8492bff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:14.361104 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450b473-2d47-4519-907a-194e8492bff0 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:14.361378 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450b473-2d47-4519-907a-194e8492bff0 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:14.361652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450b473-2d47-4519-907a-194e8492bff0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:14.429626 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450b473-2d47-4519-907a-194e8492bff0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:14.431038 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450b473-2d47-4519-907a-194e8492bff0 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:14.537918 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 424/841] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:49:14 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 30 20:49:14.544924 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46faf5-db96-4c0f-ac51-eb780511cc19 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:14.654722 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46faf5-db96-4c0f-ac51-eb780511cc19 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:14.677343 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba158b1-001a-4572-87a3-3f0444587a47 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:14.677646 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba158b1-001a-4572-87a3-3f0444587a47 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:14.678050 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba158b1-001a-4572-87a3-3f0444587a47 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:14.680803 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 425/842] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:49:14.684807 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ea9be-f447-49b4-9734-cfb4818ba50e None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:14.685178 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ea9be-f447-49b4-9734-cfb4818ba50e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:14.685538 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ea9be-f447-49b4-9734-cfb4818ba50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:14.691669 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7c625-6bed-479f-840e-950a70016d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:14.692721 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7c625-6bed-479f-840e-950a70016d2d None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:14.693185 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7c625-6bed-479f-840e-950a70016d2d None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:14.693642 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7c625-6bed-479f-840e-950a70016d2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:14.703443 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-955ea9be-f447-49b4-9734-cfb4818ba50e None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:14.704596 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7c625-6bed-479f-840e-950a70016d2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:14.704773 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-955ea9be-f447-49b4-9734-cfb4818ba50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:14.706440 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7c625-6bed-479f-840e-950a70016d2d None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:14.725043 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-0bf7c625-6bed-479f-840e-950a70016d2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:14.725043 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:14.725043 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:14.725043 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:14.725043 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:14.725043 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:14.725043 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:14.725043 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:14.725043 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:14.725043 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:14.725043 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:14.725043 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:14.725043 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:49:14.725043 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:49:14.725043 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:49:14.726012 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:49:14.726012 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:14.726012 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:14.726012 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:14.726012 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:14.726012 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:14.726012 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:14.726012 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:14.726012 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:14.726012 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:14.726012 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:14.726012 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:14.726012 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:14.726012 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:14.726012 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:14.726012 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:14.726012 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:14.726898 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:49:14.726898 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:49:14.726898 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:14.726898 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:14.728779 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 418/843] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:49:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:14.737139 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7c625-6bed-479f-840e-950a70016d2d None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:14.785866 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 426/844] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 30 20:49:14.801958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ea9be-f447-49b4-9734-cfb4818ba50e None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:14.835393 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7c625-6bed-479f-840e-950a70016d2d None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:14.871606 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e1c0d-6935-494d-a7e1-f62ae0fe59c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:14.872352 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e1c0d-6935-494d-a7e1-f62ae0fe59c7 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:14.872633 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e1c0d-6935-494d-a7e1-f62ae0fe59c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:14.872908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e1c0d-6935-494d-a7e1-f62ae0fe59c7 None admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:14.873623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724e1c0d-6935-494d-a7e1-f62ae0fe59c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:14.873953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724e1c0d-6935-494d-a7e1-f62ae0fe59c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:14.875327 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724e1c0d-6935-494d-a7e1-f62ae0fe59c7 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:14.887693 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 419/845] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:49:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:14.893181 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e1c0d-6935-494d-a7e1-f62ae0fe59c7 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:14.902054 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ea9be-f447-49b4-9734-cfb4818ba50e None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:14.941971 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a07d1-91b1-4c69-9e37-00fb7e409da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:14.942690 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a07d1-91b1-4c69-9e37-00fb7e409da6 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:14.942973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a07d1-91b1-4c69-9e37-00fb7e409da6 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:14.943252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a07d1-91b1-4c69-9e37-00fb7e409da6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:14.943909 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a07d1-91b1-4c69-9e37-00fb7e409da6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:14.945286 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a07d1-91b1-4c69-9e37-00fb7e409da6 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:14.957814 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-c63a07d1-91b1-4c69-9e37-00fb7e409da6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 30 20:49:14.957814 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:14.957814 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:49:14.957814 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:49:14.957814 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:49:14.957814 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:49:14.957814 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:49:14.957814 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:49:14.957814 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 30 20:49:14.957814 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:14.957814 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:49:14.957814 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:14.957814 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:14.957814 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:14.957814 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:14.957814 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:14.957814 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:14.958815 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:14.958815 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:14.958815 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:14.958815 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:14.958815 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:14.958815 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:14.958815 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:49:14.958815 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:49:14.958815 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:49:14.958815 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:49:14.958815 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:14.958815 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:14.958815 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:14.958815 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:14.958815 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:14.958815 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:14.959633 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:14.959633 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:14.959633 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:14.959633 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:14.959633 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:14.959633 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:14.959633 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:14.959633 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:14.959633 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:14.959633 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:14.959633 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:49:14.959633 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:49:14.959633 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 30 20:49:14.959633 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:14.963823 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 427/846] 10.222.0.23 () {56 vars in 1114 bytes} [Sat Apr 30 20:49:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:49:14.965025 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a07d1-91b1-4c69-9e37-00fb7e409da6 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:15.001506 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e1c0d-6935-494d-a7e1-f62ae0fe59c7 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:15.036133 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1fb9e-726b-40b1-9b8b-56f91347c7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:15.036930 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1fb9e-726b-40b1-9b8b-56f91347c7aa None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:15.037212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1fb9e-726b-40b1-9b8b-56f91347c7aa None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:15.037487 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1fb9e-726b-40b1-9b8b-56f91347c7aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:15.045639 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f1fb9e-726b-40b1-9b8b-56f91347c7aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:15.047119 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f1fb9e-726b-40b1-9b8b-56f91347c7aa None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:15.062493 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-a9f1fb9e-726b-40b1-9b8b-56f91347c7aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:49:15.062493 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:15.062493 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:15.062493 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:15.062493 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:15.062493 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:15.062493 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:15.062493 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:15.062493 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:15.062493 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:15.062493 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:15.062493 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:15.062493 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:49:15.062493 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:49:15.062493 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:49:15.064608 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:49:15.064608 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:15.064608 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:15.064608 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:15.064608 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:15.064608 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:15.064608 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:15.064608 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:15.064608 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:15.064608 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:15.064608 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:15.064608 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:15.064608 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:15.064608 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:15.064608 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:15.064608 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:15.064608 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:15.066860 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:49:15.066860 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:49:15.066860 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:49:15.066860 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:49:15.066860 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:49:15.066860 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:49:15.066860 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:49:15.066860 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:15.067898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a07d1-91b1-4c69-9e37-00fb7e409da6 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:15.077805 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 420/847] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:49:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:49:15.077805 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1fb9e-726b-40b1-9b8b-56f91347c7aa None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:15.101861 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe3030-e7d6-443b-aab9-33cf44819b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:15.102553 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe3030-e7d6-443b-aab9-33cf44819b72 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:15.102834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe3030-e7d6-443b-aab9-33cf44819b72 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:15.103108 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe3030-e7d6-443b-aab9-33cf44819b72 None admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:15.103845 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe3030-e7d6-443b-aab9-33cf44819b72 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:15.104156 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe3030-e7d6-443b-aab9-33cf44819b72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:15.105592 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe3030-e7d6-443b-aab9-33cf44819b72 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:15.115732 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 428/848] 10.222.0.23 () {56 vars in 1114 bytes} [Sat Apr 30 20:49:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:49:15.117141 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe3030-e7d6-443b-aab9-33cf44819b72 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:15.178989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1fb9e-726b-40b1-9b8b-56f91347c7aa None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:15.213950 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6999a6-01aa-4e62-a7bc-9bee472ee7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:15.214539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6999a6-01aa-4e62-a7bc-9bee472ee7fc None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:15.214819 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6999a6-01aa-4e62-a7bc-9bee472ee7fc None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:15.215090 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6999a6-01aa-4e62-a7bc-9bee472ee7fc None admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:15.215873 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6999a6-01aa-4e62-a7bc-9bee472ee7fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:15.216956 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6999a6-01aa-4e62-a7bc-9bee472ee7fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:15.218473 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6999a6-01aa-4e62-a7bc-9bee472ee7fc None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:15.219331 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe3030-e7d6-443b-aab9-33cf44819b72 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:15.235962 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 421/849] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Apr 30 20:49:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:15.237074 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6999a6-01aa-4e62-a7bc-9bee472ee7fc None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:15.253706 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b53389-9ebb-4f9c-a8af-2bfe4e488f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:15.259176 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b53389-9ebb-4f9c-a8af-2bfe4e488f4c None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:15.259176 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b53389-9ebb-4f9c-a8af-2bfe4e488f4c None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:15.259176 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b53389-9ebb-4f9c-a8af-2bfe4e488f4c None admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:15.259176 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b53389-9ebb-4f9c-a8af-2bfe4e488f4c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:15.259176 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b53389-9ebb-4f9c-a8af-2bfe4e488f4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:15.259176 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b53389-9ebb-4f9c-a8af-2bfe4e488f4c None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:15.265885 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 429/850] 10.222.0.23 () {56 vars in 1114 bytes} [Sat Apr 30 20:49:15 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:49:15.297982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2a7de-4e62-4d0f-8dad-37ccea10814a None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:15.298271 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2a7de-4e62-4d0f-8dad-37ccea10814a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:15.298555 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2a7de-4e62-4d0f-8dad-37ccea10814a None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:15.300282 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 430/851] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:49:15.307688 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d7a3c-2b52-4399-9f36-e1a0925b73b3 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:15.308322 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d7a3c-2b52-4399-9f36-e1a0925b73b3 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:15.308803 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d7a3c-2b52-4399-9f36-e1a0925b73b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:15.328610 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-d92d7a3c-2b52-4399-9f36-e1a0925b73b3 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:15.330349 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d92d7a3c-2b52-4399-9f36-e1a0925b73b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:15.368339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6999a6-01aa-4e62-a7bc-9bee472ee7fc None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:15.406228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106b42f-1d5d-4b61-9b5b-5955cbe3bf7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:15.407294 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106b42f-1d5d-4b61-9b5b-5955cbe3bf7c None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:15.407807 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106b42f-1d5d-4b61-9b5b-5955cbe3bf7c None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:15.408312 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106b42f-1d5d-4b61-9b5b-5955cbe3bf7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:15.409427 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2106b42f-1d5d-4b61-9b5b-5955cbe3bf7c None admin] RBAC: Adding query filter params (role.id=30112eb1f3e047398c3c82fb40b72e62, scope.project.id=6b52e5e13b9144dfb663578766c2bac0, user.id=27edf527e36c4ee7a9065688f4bed942) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:15.410005 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2106b42f-1d5d-4b61-9b5b-5955cbe3bf7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:15.411693 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2106b42f-1d5d-4b61-9b5b-5955cbe3bf7c None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:15.417798 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 431/852] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:15 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:49:15.423649 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 422/853] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:49:15 2022] GET /identity/v3/role_assignments?user.id=27edf527e36c4ee7a9065688f4bed942&scope.project.id=6b52e5e13b9144dfb663578766c2bac0&role.id=30112eb1f3e047398c3c82fb40b72e62 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:49:15.441006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d7a3c-2b52-4399-9f36-e1a0925b73b3 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:15.557433 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d7a3c-2b52-4399-9f36-e1a0925b73b3 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:15.594601 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56920e74-2ff3-4f21-a85d-c9a314701691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:15.595679 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56920e74-2ff3-4f21-a85d-c9a314701691 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:15.595965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56920e74-2ff3-4f21-a85d-c9a314701691 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:15.596244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56920e74-2ff3-4f21-a85d-c9a314701691 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:15.608087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56920e74-2ff3-4f21-a85d-c9a314701691 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:49:15.617214 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-56920e74-2ff3-4f21-a85d-c9a314701691 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:49:15.617214 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:15.617214 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:15.617214 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:15.617214 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:15.617214 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:15.617214 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:15.617214 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:15.617214 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:15.617214 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:15.617214 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:15.617214 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:15.617214 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:49:15.617214 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:49:15.617214 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:49:15.617214 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:49:15.618234 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:49:15.618234 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:49:15.618234 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:49:15.618234 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:49:15.618234 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:15.618234 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:15.618234 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:15.618234 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:15.618234 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:15.618234 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:15.618234 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:15.618234 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:15.618234 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:15.618234 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:15.618234 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:15.618234 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:15.619072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:15.619072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:15.619072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:15.619072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:15.619072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:49:15.619072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:49:15.619072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:49:15.619072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:49:15.619072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:49:15.619072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:49:15.619072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:49:15.619072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:15.623035 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 432/854] 10.222.0.23 () {56 vars in 1102 bytes} [Sat Apr 30 20:49:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:15.624058 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106b42f-1d5d-4b61-9b5b-5955cbe3bf7c None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:15.657522 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73fc30-e797-46df-b17d-59c5f17de099 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:15.657978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73fc30-e797-46df-b17d-59c5f17de099 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:15.658385 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73fc30-e797-46df-b17d-59c5f17de099 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:15.660522 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 433/855] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:49:15.665647 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492de3c-f345-4fcb-9959-556978c90ca0 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:15.666073 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492de3c-f345-4fcb-9959-556978c90ca0 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:15.666426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492de3c-f345-4fcb-9959-556978c90ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:15.687614 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-6492de3c-f345-4fcb-9959-556978c90ca0 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:15.688963 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6492de3c-f345-4fcb-9959-556978c90ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:15.743670 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106b42f-1d5d-4b61-9b5b-5955cbe3bf7c None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:15.772951 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 434/856] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:15 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:49:15.781123 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9856e9c-39ba-4a91-9131-97eaf604d2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:15.781881 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9856e9c-39ba-4a91-9131-97eaf604d2c9 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:15.782164 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9856e9c-39ba-4a91-9131-97eaf604d2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:15.782488 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9856e9c-39ba-4a91-9131-97eaf604d2c9 None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:15.783236 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9856e9c-39ba-4a91-9131-97eaf604d2c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:15.783542 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9856e9c-39ba-4a91-9131-97eaf604d2c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:15.784913 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9856e9c-39ba-4a91-9131-97eaf604d2c9 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:15.793636 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 423/857] 10.222.0.23 () {56 vars in 1103 bytes} [Sat Apr 30 20:49:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:15.799287 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9856e9c-39ba-4a91-9131-97eaf604d2c9 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:15.799948 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492de3c-f345-4fcb-9959-556978c90ca0 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:15.901275 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492de3c-f345-4fcb-9959-556978c90ca0 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:15.905203 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9856e9c-39ba-4a91-9131-97eaf604d2c9 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:15.935315 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47623bc-c6c5-4218-b13c-f42b1cf2c5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:15.936111 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47623bc-c6c5-4218-b13c-f42b1cf2c5b7 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:15.936391 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47623bc-c6c5-4218-b13c-f42b1cf2c5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:15.936664 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47623bc-c6c5-4218-b13c-f42b1cf2c5b7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:15.937326 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47623bc-c6c5-4218-b13c-f42b1cf2c5b7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:15.938736 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47623bc-c6c5-4218-b13c-f42b1cf2c5b7 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:15.941016 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a5e65-951a-4b24-b02f-aadf7a24a42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:15.942262 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a5e65-951a-4b24-b02f-aadf7a24a42b None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:15.942753 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a5e65-951a-4b24-b02f-aadf7a24a42b None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:15.943223 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a5e65-951a-4b24-b02f-aadf7a24a42b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:15.952261 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-b47623bc-c6c5-4218-b13c-f42b1cf2c5b7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 30 20:49:15.952261 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:15.952261 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:49:15.952261 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:49:15.952261 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:49:15.952261 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:49:15.952261 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:49:15.952261 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:49:15.952261 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 30 20:49:15.952261 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:15.952261 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:49:15.952261 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:15.952261 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:15.952261 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:15.952261 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:15.952261 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:15.953222 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:15.953222 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:15.953222 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:15.953222 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:15.953222 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:15.953222 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:15.953222 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:15.953222 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:49:15.953222 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:49:15.953222 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:49:15.953222 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:49:15.953222 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:15.953222 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:15.953222 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:15.953222 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:15.953222 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:15.959516 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:15.959516 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:15.959516 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:15.959516 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:15.959516 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:15.959516 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:15.959516 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:15.959516 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:15.959516 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:15.959516 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:15.959516 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:15.959516 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:49:15.959516 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:49:15.959516 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 30 20:49:15.959516 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:15.959516 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 435/858] 10.222.0.23 () {56 vars in 1132 bytes} [Sat Apr 30 20:49:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:49:15.960365 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47623bc-c6c5-4218-b13c-f42b1cf2c5b7 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:15.962605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0a5e65-951a-4b24-b02f-aadf7a24a42b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:15.964270 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0a5e65-951a-4b24-b02f-aadf7a24a42b None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:15.982996 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-cc0a5e65-951a-4b24-b02f-aadf7a24a42b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:15.982996 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:15.982996 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:15.982996 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:15.982996 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:15.982996 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:15.982996 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:15.982996 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:15.982996 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:15.982996 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:15.982996 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:15.982996 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:15.982996 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:49:15.982996 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:49:15.982996 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:49:15.983947 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:49:15.983947 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:15.983947 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:15.983947 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:15.983947 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:15.983947 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:15.983947 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:15.983947 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:15.983947 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:15.983947 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:15.983947 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:15.983947 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:15.983947 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:15.983947 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:15.983947 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:15.983947 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:15.983947 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:15.984816 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:49:15.984816 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:49:15.984816 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:15.984816 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:15.987122 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 424/859] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:49:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:49:15.992542 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a5e65-951a-4b24-b02f-aadf7a24a42b None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:16.097513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47623bc-c6c5-4218-b13c-f42b1cf2c5b7 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:16.113335 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a5e65-951a-4b24-b02f-aadf7a24a42b None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:16.132239 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e98b66-484d-4b76-9418-3c6792a3a1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:16.133232 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e98b66-484d-4b76-9418-3c6792a3a1a9 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:16.133709 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e98b66-484d-4b76-9418-3c6792a3a1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:16.134199 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e98b66-484d-4b76-9418-3c6792a3a1a9 None admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:16.135090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e98b66-484d-4b76-9418-3c6792a3a1a9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:16.135592 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e98b66-484d-4b76-9418-3c6792a3a1a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:16.137167 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e98b66-484d-4b76-9418-3c6792a3a1a9 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:16.147170 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 436/860] 10.222.0.23 () {56 vars in 1126 bytes} [Sat Apr 30 20:49:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:16.147785 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e98b66-484d-4b76-9418-3c6792a3a1a9 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:16.152209 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8d57b-b357-4cca-9d91-73dd7f0e4d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:16.153107 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8d57b-b357-4cca-9d91-73dd7f0e4d0e None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:16.153644 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8d57b-b357-4cca-9d91-73dd7f0e4d0e None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:16.154135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8d57b-b357-4cca-9d91-73dd7f0e4d0e None admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:16.155051 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b8d57b-b357-4cca-9d91-73dd7f0e4d0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:16.155571 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b8d57b-b357-4cca-9d91-73dd7f0e4d0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:16.157576 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b8d57b-b357-4cca-9d91-73dd7f0e4d0e None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:16.173222 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 425/861] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:49:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:16.178730 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8d57b-b357-4cca-9d91-73dd7f0e4d0e None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:16.266585 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e98b66-484d-4b76-9418-3c6792a3a1a9 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:16.291589 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8d57b-b357-4cca-9d91-73dd7f0e4d0e None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:16.314465 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a5dc8-2d56-4ac3-9b60-f34ad04d0571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:16.315184 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a5dc8-2d56-4ac3-9b60-f34ad04d0571 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:16.315466 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a5dc8-2d56-4ac3-9b60-f34ad04d0571 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:16.315794 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a5dc8-2d56-4ac3-9b60-f34ad04d0571 None admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:16.316753 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a5dc8-2d56-4ac3-9b60-f34ad04d0571 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:16.316885 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a5dc8-2d56-4ac3-9b60-f34ad04d0571 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:16.318199 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a5dc8-2d56-4ac3-9b60-f34ad04d0571 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:16.330403 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 437/862] 10.222.0.23 () {56 vars in 1126 bytes} [Sat Apr 30 20:49:16 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:49:16.346462 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed64ac-4ea3-4724-8791-164f08769ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:16.347299 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed64ac-4ea3-4724-8791-164f08769ce6 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:16.347581 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed64ac-4ea3-4724-8791-164f08769ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:16.347879 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed64ac-4ea3-4724-8791-164f08769ce6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:16.356201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed64ac-4ea3-4724-8791-164f08769ce6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:16.357833 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed64ac-4ea3-4724-8791-164f08769ce6 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:16.375220 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-5bed64ac-4ea3-4724-8791-164f08769ce6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 30 20:49:16.375220 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:16.375220 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:16.375220 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:16.375220 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:16.375220 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:16.375220 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:16.375220 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:16.375220 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:16.375220 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:16.375220 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:16.375220 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:16.375220 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:49:16.375220 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:49:16.375220 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:49:16.375220 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:49:16.376238 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:16.376238 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:16.376238 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:49:16.376238 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:49:16.376238 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:49:16.376238 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:49:16.376238 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:16.376238 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:16.376238 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:16.376238 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:16.376238 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:16.376238 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:16.376238 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:16.376238 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:16.376238 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:16.376238 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:16.376238 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:16.376238 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:16.377194 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:16.377194 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:16.377194 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:49:16.377194 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:49:16.377194 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:49:16.377194 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:49:16.377194 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:49:16.377194 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:49:16.377194 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 30 20:49:16.377194 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:16.377194 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 426/863] 10.222.0.23 () {56 vars in 1117 bytes} [Sat Apr 30 20:49:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:16.382671 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a5dc8-2d56-4ac3-9b60-f34ad04d0571 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:16.507493 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a5dc8-2d56-4ac3-9b60-f34ad04d0571 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:16.543315 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e95aa1-1bef-4e52-96a9-a10909c34e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:16.544831 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e95aa1-1bef-4e52-96a9-a10909c34e40 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:16.545268 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e95aa1-1bef-4e52-96a9-a10909c34e40 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:16.545698 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e95aa1-1bef-4e52-96a9-a10909c34e40 None admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:16.546747 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e95aa1-1bef-4e52-96a9-a10909c34e40 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:16.547238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e95aa1-1bef-4e52-96a9-a10909c34e40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:16.548908 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e95aa1-1bef-4e52-96a9-a10909c34e40 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:16.570609 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 438/864] 10.222.0.23 () {56 vars in 1149 bytes} [Sat Apr 30 20:49:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:16.576153 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed64ac-4ea3-4724-8791-164f08769ce6 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:16.679763 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed64ac-4ea3-4724-8791-164f08769ce6 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:16.714428 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ee450-6a0a-4ce9-89c5-e2491abdbd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:16.715076 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ee450-6a0a-4ce9-89c5-e2491abdbd1b None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:16.715356 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ee450-6a0a-4ce9-89c5-e2491abdbd1b None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:16.715629 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ee450-6a0a-4ce9-89c5-e2491abdbd1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:16.783806 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ee450-6a0a-4ce9-89c5-e2491abdbd1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:16.785187 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ee450-6a0a-4ce9-89c5-e2491abdbd1b None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:16.885161 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 427/865] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:49:16 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 30 20:49:16.890825 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e95aa1-1bef-4e52-96a9-a10909c34e40 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:16.991980 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e95aa1-1bef-4e52-96a9-a10909c34e40 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:17.025320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94e0ac-34fe-4b35-9b7f-84a650210e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:17.026156 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94e0ac-34fe-4b35-9b7f-84a650210e55 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:17.026440 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94e0ac-34fe-4b35-9b7f-84a650210e55 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:17.026718 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94e0ac-34fe-4b35-9b7f-84a650210e55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:17.037526 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab94e0ac-34fe-4b35-9b7f-84a650210e55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:17.038961 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab94e0ac-34fe-4b35-9b7f-84a650210e55 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:17.058023 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-ab94e0ac-34fe-4b35-9b7f-84a650210e55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:17.058023 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:17.058023 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:17.058023 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:17.058023 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:17.058023 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:17.058023 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:17.058023 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:17.058023 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:17.058023 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:17.058023 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:17.058023 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:17.058023 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:49:17.058023 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:49:17.058023 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:49:17.058956 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:49:17.058956 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:17.058956 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:17.058956 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:17.058956 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:17.058956 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:17.058956 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:17.058956 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:17.058956 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:17.058956 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:17.058956 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:17.058956 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:17.058956 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:17.058956 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:17.058956 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:17.058956 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:17.058956 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:17.059931 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:49:17.059931 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:49:17.059931 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:17.059931 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:17.063903 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 439/866] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:49:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:17.066415 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ee450-6a0a-4ce9-89c5-e2491abdbd1b None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:17.171052 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ee450-6a0a-4ce9-89c5-e2491abdbd1b None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:17.206959 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c1ca4-46f7-4f33-8296-2cd5cc7b94a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:17.207931 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c1ca4-46f7-4f33-8296-2cd5cc7b94a2 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:17.208401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c1ca4-46f7-4f33-8296-2cd5cc7b94a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:17.208880 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c1ca4-46f7-4f33-8296-2cd5cc7b94a2 None admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:17.209836 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c1ca4-46f7-4f33-8296-2cd5cc7b94a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:17.210347 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c1ca4-46f7-4f33-8296-2cd5cc7b94a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:17.211906 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c1ca4-46f7-4f33-8296-2cd5cc7b94a2 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:17.228658 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 428/867] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:49:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:17.230417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94e0ac-34fe-4b35-9b7f-84a650210e55 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:17.335629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94e0ac-34fe-4b35-9b7f-84a650210e55 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:17.370464 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf097b-3238-477f-8374-d951ad311579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:17.371260 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf097b-3238-477f-8374-d951ad311579 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:17.371544 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf097b-3238-477f-8374-d951ad311579 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:17.371821 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf097b-3238-477f-8374-d951ad311579 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:17.379071 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecf097b-3238-477f-8374-d951ad311579 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:17.380516 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecf097b-3238-477f-8374-d951ad311579 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:17.394706 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-2ecf097b-3238-477f-8374-d951ad311579 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:49:17.394706 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:17.394706 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:17.394706 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:17.394706 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:17.394706 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:17.394706 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:17.394706 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:17.394706 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:17.394706 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:17.394706 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:17.394706 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:17.394706 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:49:17.394706 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:49:17.394706 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:49:17.395643 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:49:17.395643 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:17.395643 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:17.395643 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:17.395643 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:17.395643 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:17.395643 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:17.395643 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:17.395643 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:17.395643 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:17.395643 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:17.395643 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:17.395643 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:17.395643 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:17.395643 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:17.395643 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:17.395643 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:17.396546 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:49:17.396546 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:49:17.396546 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:49:17.396546 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:49:17.396546 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:49:17.396546 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:49:17.396546 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:49:17.396546 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:17.396546 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 440/868] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:49:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:17.401486 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c1ca4-46f7-4f33-8296-2cd5cc7b94a2 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:17.507536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c1ca4-46f7-4f33-8296-2cd5cc7b94a2 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:17.545517 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65632b5-e31d-4904-a97d-a89aa01508b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:17.546231 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65632b5-e31d-4904-a97d-a89aa01508b9 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:17.546520 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65632b5-e31d-4904-a97d-a89aa01508b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:17.546798 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65632b5-e31d-4904-a97d-a89aa01508b9 None admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:17.547592 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65632b5-e31d-4904-a97d-a89aa01508b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:17.547908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65632b5-e31d-4904-a97d-a89aa01508b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:17.549361 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65632b5-e31d-4904-a97d-a89aa01508b9 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:17.563220 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 429/869] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Apr 30 20:49:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:17.568908 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf097b-3238-477f-8374-d951ad311579 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:17.677168 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf097b-3238-477f-8374-d951ad311579 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:17.696837 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f262d3-a11c-4a7d-845f-2e70b2f76aad None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:17.697149 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f262d3-a11c-4a7d-845f-2e70b2f76aad None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:17.697386 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f262d3-a11c-4a7d-845f-2e70b2f76aad None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:17.699042 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 430/870] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:49:17.704002 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3de54f-0a2a-43e2-af31-4b308b297339 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:17.704288 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3de54f-0a2a-43e2-af31-4b308b297339 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:17.704565 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3de54f-0a2a-43e2-af31-4b308b297339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:17.712653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62abb6d7-447a-45cb-9c08-e07dcea3b1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:17.713312 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abb6d7-447a-45cb-9c08-e07dcea3b1ae None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:17.713596 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abb6d7-447a-45cb-9c08-e07dcea3b1ae None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:17.713919 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abb6d7-447a-45cb-9c08-e07dcea3b1ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:17.714790 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62abb6d7-447a-45cb-9c08-e07dcea3b1ae None admin] RBAC: Adding query filter params (role.id=0971c8bf92d64c50a5cbbf7d146af841, scope.project.id=6b52e5e13b9144dfb663578766c2bac0, user.id=2e3511017b8e4b4f9805a65c3ac173f9) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:17.715186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62abb6d7-447a-45cb-9c08-e07dcea3b1ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:17.717919 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62abb6d7-447a-45cb-9c08-e07dcea3b1ae None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:17.722032 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-5f3de54f-0a2a-43e2-af31-4b308b297339 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:17.724653 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5f3de54f-0a2a-43e2-af31-4b308b297339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:17.724758 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 441/871] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:49:17 2022] GET /identity/v3/role_assignments?user.id=2e3511017b8e4b4f9805a65c3ac173f9&scope.project.id=6b52e5e13b9144dfb663578766c2bac0&role.id=0971c8bf92d64c50a5cbbf7d146af841 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:17.813975 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 431/872] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 30 20:49:17.833293 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62abb6d7-447a-45cb-9c08-e07dcea3b1ae None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:17.942012 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62abb6d7-447a-45cb-9c08-e07dcea3b1ae None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:17.977374 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb684f-8673-4c22-bfe9-6a6360e2a1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:17.978121 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb684f-8673-4c22-bfe9-6a6360e2a1a0 None admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:17.978409 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb684f-8673-4c22-bfe9-6a6360e2a1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:17.978681 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb684f-8673-4c22-bfe9-6a6360e2a1a0 None admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:17.979417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb684f-8673-4c22-bfe9-6a6360e2a1a0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:17.980800 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb684f-8673-4c22-bfe9-6a6360e2a1a0 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:18.005069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec34ce-a32f-4aea-8b86-7a302930a1e6 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:18.005703 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec34ce-a32f-4aea-8b86-7a302930a1e6 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:18.006224 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec34ce-a32f-4aea-8b86-7a302930a1e6 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:18.007913 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 432/873] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:49:18.014072 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4416249-2454-4dae-89bc-3141ef3ff8d5 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:18.014361 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4416249-2454-4dae-89bc-3141ef3ff8d5 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:18.014641 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4416249-2454-4dae-89bc-3141ef3ff8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:18.032146 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-f4416249-2454-4dae-89bc-3141ef3ff8d5 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:18.033630 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f4416249-2454-4dae-89bc-3141ef3ff8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:18.065897 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 442/874] 10.222.0.23 () {60 vars in 1141 bytes} [Sat Apr 30 20:49:17 2022] POST /identity/v3/services => generated 251 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:49:18.131799 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 433/875] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:18 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 30 20:49:18.157382 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb684f-8673-4c22-bfe9-6a6360e2a1a0 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:18.277695 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb684f-8673-4c22-bfe9-6a6360e2a1a0 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:18.318777 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d6ae3-4c03-4733-89a9-b075b4a3fe8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:18.319595 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d6ae3-4c03-4733-89a9-b075b4a3fe8c None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:18.319881 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d6ae3-4c03-4733-89a9-b075b4a3fe8c None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:18.320158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d6ae3-4c03-4733-89a9-b075b4a3fe8c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:18.320815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d6ae3-4c03-4733-89a9-b075b4a3fe8c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:18.322239 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d6ae3-4c03-4733-89a9-b075b4a3fe8c None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:18.335098 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-742d6ae3-4c03-4733-89a9-b075b4a3fe8c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 30 20:49:18.335098 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:18.335098 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:49:18.335098 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:49:18.335098 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:49:18.335098 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:49:18.335098 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:49:18.335098 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:49:18.335098 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 30 20:49:18.335098 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:18.335098 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:49:18.335098 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:18.335098 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:18.335098 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:18.335098 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:18.335098 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:18.335098 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:18.336094 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:18.336094 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:18.336094 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:18.336094 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:18.336094 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:18.336094 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:18.336094 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:49:18.336094 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:49:18.336094 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:49:18.336094 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:49:18.336094 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:18.336094 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:18.336094 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:18.336094 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:18.336094 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:18.336094 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:18.337243 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:18.337243 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:18.337243 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:18.337243 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:18.337243 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:18.337243 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:18.337243 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:18.337243 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:18.337243 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:18.337243 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:18.337243 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:49:18.337243 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:49:18.337243 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 30 20:49:18.337243 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:18.337243 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 443/876] 10.222.0.23 () {56 vars in 1126 bytes} [Sat Apr 30 20:49:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:18.344420 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4416249-2454-4dae-89bc-3141ef3ff8d5 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:18.442754 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4416249-2454-4dae-89bc-3141ef3ff8d5 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:18.476722 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8892c-4816-4b85-bd30-620d1f903700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:18.477402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8892c-4816-4b85-bd30-620d1f903700 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:18.477684 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8892c-4816-4b85-bd30-620d1f903700 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:18.477989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8892c-4816-4b85-bd30-620d1f903700 None admin] PATH_INFO: `/v3/services` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:18.478698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a8892c-4816-4b85-bd30-620d1f903700 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:18.479005 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a8892c-4816-4b85-bd30-620d1f903700 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:18.480380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a8892c-4816-4b85-bd30-620d1f903700 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:18.485430 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 434/877] 10.222.0.23 () {56 vars in 1122 bytes} [Sat Apr 30 20:49:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:18.491130 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d6ae3-4c03-4733-89a9-b075b4a3fe8c None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:18.596783 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d6ae3-4c03-4733-89a9-b075b4a3fe8c None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:18.633095 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c9d95c-8ef5-40ab-953c-03301cf60417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:18.634134 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9d95c-8ef5-40ab-953c-03301cf60417 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:18.634650 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9d95c-8ef5-40ab-953c-03301cf60417 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:18.635129 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9d95c-8ef5-40ab-953c-03301cf60417 None admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:18.636031 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c9d95c-8ef5-40ab-953c-03301cf60417 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:18.636554 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c9d95c-8ef5-40ab-953c-03301cf60417 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:18.638729 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c9d95c-8ef5-40ab-953c-03301cf60417 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:18.649921 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 444/878] 10.222.0.23 () {56 vars in 1122 bytes} [Sat Apr 30 20:49:18 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:18.784886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210a562-24e7-4d3e-8277-6e73c150326b None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:18.785260 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210a562-24e7-4d3e-8277-6e73c150326b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:18.785461 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210a562-24e7-4d3e-8277-6e73c150326b None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:18.787106 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 435/879] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:49:18.792889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7870d-edb8-4893-b07e-d53ac88368d8 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:18.793178 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7870d-edb8-4893-b07e-d53ac88368d8 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:18.793457 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7870d-edb8-4893-b07e-d53ac88368d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:18.812049 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-05f7870d-edb8-4893-b07e-d53ac88368d8 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:18.813276 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-05f7870d-edb8-4893-b07e-d53ac88368d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:18.885137 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 445/880] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:18 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:49:18.909112 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210a562-24e7-4d3e-8277-6e73c150326b None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:19.018759 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210a562-24e7-4d3e-8277-6e73c150326b None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:19.055935 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a98a624-a7ab-42a4-965b-73ba67cf221e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:19.056608 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98a624-a7ab-42a4-965b-73ba67cf221e None admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:19.056891 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98a624-a7ab-42a4-965b-73ba67cf221e None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:19.057170 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98a624-a7ab-42a4-965b-73ba67cf221e None admin] PATH_INFO: `/v3/services` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:19.057953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a98a624-a7ab-42a4-965b-73ba67cf221e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:19.059340 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a98a624-a7ab-42a4-965b-73ba67cf221e None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:19.160112 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 436/881] 10.222.0.23 () {60 vars in 1141 bytes} [Sat Apr 30 20:49:18 2022] POST /identity/v3/services => generated 269 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:49:20.215745 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c54207-7e05-435f-a9ad-9034439aed6d None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:20.216335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c54207-7e05-435f-a9ad-9034439aed6d None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:20.216335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c54207-7e05-435f-a9ad-9034439aed6d None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:20.217948 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 446/882] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:49:20.223619 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de0608-fb50-4802-b5c0-22bb82febe0c None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:20.224467 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de0608-fb50-4802-b5c0-22bb82febe0c None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:20.224953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de0608-fb50-4802-b5c0-22bb82febe0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:20.242805 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-40de0608-fb50-4802-b5c0-22bb82febe0c None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:20.244339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-40de0608-fb50-4802-b5c0-22bb82febe0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:20.320784 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 437/883] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:20 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:49:20.345510 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c54207-7e05-435f-a9ad-9034439aed6d None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:20.454465 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c54207-7e05-435f-a9ad-9034439aed6d None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:20.488804 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a33bb84-cabb-4469-8cb9-4a840ddc414f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:20.489540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33bb84-cabb-4469-8cb9-4a840ddc414f None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:20.489852 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33bb84-cabb-4469-8cb9-4a840ddc414f None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:20.490128 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33bb84-cabb-4469-8cb9-4a840ddc414f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:20.501150 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a33bb84-cabb-4469-8cb9-4a840ddc414f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:49:20.509248 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-9a33bb84-cabb-4469-8cb9-4a840ddc414f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 30 20:49:20.509248 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:20.509248 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:20.509248 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:20.509248 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:20.509248 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:20.509248 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:20.509248 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:20.509248 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:20.509248 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:20.509248 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:20.509248 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:20.509248 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:49:20.509248 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:49:20.509248 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:49:20.509248 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:49:20.510209 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:49:20.510209 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:49:20.510209 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:49:20.510209 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:49:20.510209 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:20.510209 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:20.510209 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:20.510209 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:20.510209 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:20.510209 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:20.510209 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:20.510209 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:20.510209 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:20.510209 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:20.510209 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:20.510209 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:20.511044 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:20.511044 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:20.511044 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:20.511044 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:20.511044 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:49:20.511044 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:49:20.511044 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:49:20.511044 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:49:20.511044 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:49:20.511044 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:49:20.511044 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 30 20:49:20.511044 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:20.511044 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 447/884] 10.222.0.23 () {56 vars in 1120 bytes} [Sat Apr 30 20:49:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:20.518357 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de0608-fb50-4802-b5c0-22bb82febe0c None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:20.542712 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88eb7e6-5c3a-4e51-8e1b-69339f7f01b0 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:20.545875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88eb7e6-5c3a-4e51-8e1b-69339f7f01b0 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:20.545875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88eb7e6-5c3a-4e51-8e1b-69339f7f01b0 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:20.545875 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 448/885] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:49:20.556766 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e536ef-1eb2-495e-84c6-ee6fa3dcfb33 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:20.557132 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e536ef-1eb2-495e-84c6-ee6fa3dcfb33 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:20.557485 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e536ef-1eb2-495e-84c6-ee6fa3dcfb33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:20.577896 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-06e536ef-1eb2-495e-84c6-ee6fa3dcfb33 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:20.580445 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-06e536ef-1eb2-495e-84c6-ee6fa3dcfb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:20.635030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de0608-fb50-4802-b5c0-22bb82febe0c None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:20.657781 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 449/886] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:20 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 30 20:49:20.675253 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c180345-f37d-41c7-8fec-e068d45d5b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:20.675967 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c180345-f37d-41c7-8fec-e068d45d5b66 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:20.676247 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c180345-f37d-41c7-8fec-e068d45d5b66 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:20.676516 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c180345-f37d-41c7-8fec-e068d45d5b66 None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:20.677257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c180345-f37d-41c7-8fec-e068d45d5b66 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:20.677562 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c180345-f37d-41c7-8fec-e068d45d5b66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:20.679579 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e536ef-1eb2-495e-84c6-ee6fa3dcfb33 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:20.683124 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c180345-f37d-41c7-8fec-e068d45d5b66 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:20.696557 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 438/887] 10.222.0.23 () {56 vars in 1115 bytes} [Sat Apr 30 20:49:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:20.701551 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c180345-f37d-41c7-8fec-e068d45d5b66 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:20.798693 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e536ef-1eb2-495e-84c6-ee6fa3dcfb33 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:20.820172 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c180345-f37d-41c7-8fec-e068d45d5b66 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:20.837991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714eda5-fbba-4f2a-8b80-5034d151d02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:20.839306 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714eda5-fbba-4f2a-8b80-5034d151d02f None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:20.839593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714eda5-fbba-4f2a-8b80-5034d151d02f None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:20.840003 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714eda5-fbba-4f2a-8b80-5034d151d02f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:20.840788 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0714eda5-fbba-4f2a-8b80-5034d151d02f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:20.843170 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0714eda5-fbba-4f2a-8b80-5034d151d02f None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:20.859216 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-0714eda5-fbba-4f2a-8b80-5034d151d02f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 30 20:49:20.859216 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:20.859216 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:49:20.859216 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:49:20.859216 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:49:20.859216 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:49:20.859216 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:49:20.859216 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:49:20.859216 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 30 20:49:20.859216 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:20.859216 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:49:20.859216 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:20.859216 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:20.859216 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:20.859216 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:20.859216 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:20.859216 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:20.860229 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:20.860229 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:20.860229 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:20.860229 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:20.860229 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:20.860229 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:20.860229 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:49:20.860229 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:49:20.860229 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:49:20.860229 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:49:20.860229 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:20.860229 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:20.860229 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:20.860229 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:20.860229 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:20.860229 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:20.861735 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:20.861735 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:20.861735 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:20.861735 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:20.861735 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:20.861735 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:20.861735 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:20.861735 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:20.861735 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:20.861735 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:20.861735 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:49:20.861735 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:49:20.861735 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 30 20:49:20.861735 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:20.861735 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 450/888] 10.222.0.23 () {56 vars in 1114 bytes} [Sat Apr 30 20:49:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:49:20.862555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bc4ea-a793-4f25-acb5-c5c3f57ea521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:20.862555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bc4ea-a793-4f25-acb5-c5c3f57ea521 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:20.862954 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bc4ea-a793-4f25-acb5-c5c3f57ea521 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:20.863107 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bc4ea-a793-4f25-acb5-c5c3f57ea521 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:20.866082 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714eda5-fbba-4f2a-8b80-5034d151d02f None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:20.878055 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44bc4ea-a793-4f25-acb5-c5c3f57ea521 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:20.879579 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44bc4ea-a793-4f25-acb5-c5c3f57ea521 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:20.900055 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-a44bc4ea-a793-4f25-acb5-c5c3f57ea521 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:20.900055 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:20.900055 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:20.900055 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:20.900055 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:20.900055 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:20.900055 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:20.900055 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:20.900055 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:20.900055 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:20.900055 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:20.900055 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:20.900055 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:49:20.900055 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:49:20.900055 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:49:20.902275 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:49:20.902275 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:20.902275 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:20.902275 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:20.902275 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:20.902275 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:20.902275 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:20.902275 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:20.902275 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:20.902275 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:20.902275 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:20.902275 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:20.902275 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:20.902275 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:20.902275 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:20.902275 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:20.902275 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:20.905071 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:49:20.905071 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:49:20.905071 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:20.905071 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:20.906729 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 439/889] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:49:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:20.913813 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bc4ea-a793-4f25-acb5-c5c3f57ea521 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:20.974887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714eda5-fbba-4f2a-8b80-5034d151d02f None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:21.007829 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c452b-4f1f-4804-99d5-02387cd4aa4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:21.008492 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c452b-4f1f-4804-99d5-02387cd4aa4e None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:21.008771 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c452b-4f1f-4804-99d5-02387cd4aa4e None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:21.009041 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c452b-4f1f-4804-99d5-02387cd4aa4e None admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:21.009739 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c452b-4f1f-4804-99d5-02387cd4aa4e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:21.010065 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c452b-4f1f-4804-99d5-02387cd4aa4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:21.011433 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c452b-4f1f-4804-99d5-02387cd4aa4e None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:21.011643 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bc4ea-a793-4f25-acb5-c5c3f57ea521 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:21.021318 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 451/890] 10.222.0.23 () {56 vars in 1114 bytes} [Sat Apr 30 20:49:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:49:21.022184 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c452b-4f1f-4804-99d5-02387cd4aa4e None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:21.046988 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2586b8d-9c63-4383-9074-6a59577ec276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:21.047747 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2586b8d-9c63-4383-9074-6a59577ec276 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:21.048032 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2586b8d-9c63-4383-9074-6a59577ec276 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:21.048307 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2586b8d-9c63-4383-9074-6a59577ec276 None admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:21.049127 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2586b8d-9c63-4383-9074-6a59577ec276 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:21.049386 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2586b8d-9c63-4383-9074-6a59577ec276 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:21.050844 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2586b8d-9c63-4383-9074-6a59577ec276 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:21.068001 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 440/891] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:49:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:49:21.068871 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2586b8d-9c63-4383-9074-6a59577ec276 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:21.123893 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c452b-4f1f-4804-99d5-02387cd4aa4e None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:21.158154 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e36fa6-cdb6-4c07-bf69-ba08b9d9e9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:21.158817 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e36fa6-cdb6-4c07-bf69-ba08b9d9e9b0 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:21.159148 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e36fa6-cdb6-4c07-bf69-ba08b9d9e9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:21.159426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e36fa6-cdb6-4c07-bf69-ba08b9d9e9b0 None admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:21.160156 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e36fa6-cdb6-4c07-bf69-ba08b9d9e9b0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:21.160465 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e36fa6-cdb6-4c07-bf69-ba08b9d9e9b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:21.161882 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e36fa6-cdb6-4c07-bf69-ba08b9d9e9b0 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:21.166574 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 452/892] 10.222.0.23 () {56 vars in 1114 bytes} [Sat Apr 30 20:49:21 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:21.167846 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c171e78-c6ec-42a2-bccb-81ac4dbb9e88 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:21.168134 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c171e78-c6ec-42a2-bccb-81ac4dbb9e88 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:21.168346 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2586b8d-9c63-4383-9074-6a59577ec276 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:21.168446 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c171e78-c6ec-42a2-bccb-81ac4dbb9e88 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:21.173579 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 453/893] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:49:21.174395 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c171e78-c6ec-42a2-bccb-81ac4dbb9e88 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:21.204283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ff8b7-d47c-404d-8c65-65cea5529fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:21.205383 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ff8b7-d47c-404d-8c65-65cea5529fc8 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:21.205873 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ff8b7-d47c-404d-8c65-65cea5529fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:21.206358 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ff8b7-d47c-404d-8c65-65cea5529fc8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:21.214027 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ff8b7-d47c-404d-8c65-65cea5529fc8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:21.215585 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ff8b7-d47c-404d-8c65-65cea5529fc8 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:21.231763 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-db4ff8b7-d47c-404d-8c65-65cea5529fc8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 30 20:49:21.231763 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:21.231763 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:21.231763 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:21.231763 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:21.231763 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:21.231763 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:21.231763 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:21.231763 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:21.231763 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:21.231763 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:21.231763 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:21.231763 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:49:21.231763 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:49:21.231763 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:49:21.231763 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:49:21.233273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:21.233273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:21.233273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:49:21.233273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:49:21.233273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:49:21.233273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:49:21.233273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:21.233273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:21.233273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:21.233273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:21.233273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:21.233273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:21.233273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:21.233273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:21.233273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:21.233273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:21.233273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:21.233273 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:21.234258 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:21.234258 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:21.234258 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:49:21.234258 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:49:21.234258 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:49:21.234258 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:49:21.234258 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:49:21.234258 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:49:21.234258 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 30 20:49:21.234258 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:21.234258 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 441/894] 10.222.0.23 () {56 vars in 1117 bytes} [Sat Apr 30 20:49:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:49:21.235430 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2279c4-00f3-4c0c-a34b-d41ca70a3c0b None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:21.235430 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2279c4-00f3-4c0c-a34b-d41ca70a3c0b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:21.235820 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2279c4-00f3-4c0c-a34b-d41ca70a3c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:21.253618 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-0f2279c4-00f3-4c0c-a34b-d41ca70a3c0b None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:21.255054 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0f2279c4-00f3-4c0c-a34b-d41ca70a3c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:21.284828 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c171e78-c6ec-42a2-bccb-81ac4dbb9e88 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:21.318099 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2de8b9-643e-449a-803e-1069a443b79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:21.318704 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2de8b9-643e-449a-803e-1069a443b79a None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:21.318981 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2de8b9-643e-449a-803e-1069a443b79a None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:21.319254 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2de8b9-643e-449a-803e-1069a443b79a None admin] PATH_INFO: `/v3/endpoints` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:21.320093 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2de8b9-643e-449a-803e-1069a443b79a None admin] RBAC: Adding query filter params (interface=public, service_id=133be04db27d45cdaccf05109683704f, region_id=RegionOne) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:21.320426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2de8b9-643e-449a-803e-1069a443b79a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:21.321787 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2de8b9-643e-449a-803e-1069a443b79a None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:21.327160 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 454/895] 10.222.0.23 () {56 vars in 1251 bytes} [Sat Apr 30 20:49:21 2022] GET /identity/v3/endpoints?service_id=133be04db27d45cdaccf05109683704f&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:21.330645 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2de8b9-643e-449a-803e-1069a443b79a None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:21.334968 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 442/896] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:49:21.336632 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2279c4-00f3-4c0c-a34b-d41ca70a3c0b None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:21.433847 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2de8b9-643e-449a-803e-1069a443b79a None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:21.466807 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2279c4-00f3-4c0c-a34b-d41ca70a3c0b None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:21.467983 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24585a23-53c3-44fb-94bb-dfd31d10be23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:21.469745 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24585a23-53c3-44fb-94bb-dfd31d10be23 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:21.470505 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24585a23-53c3-44fb-94bb-dfd31d10be23 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:21.470970 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24585a23-53c3-44fb-94bb-dfd31d10be23 None admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:21.471986 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24585a23-53c3-44fb-94bb-dfd31d10be23 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:21.472475 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24585a23-53c3-44fb-94bb-dfd31d10be23 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:21.474548 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24585a23-53c3-44fb-94bb-dfd31d10be23 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:21.493910 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 455/897] 10.222.0.23 () {56 vars in 1149 bytes} [Sat Apr 30 20:49:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:21.494535 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24585a23-53c3-44fb-94bb-dfd31d10be23 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:21.504599 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba129f6-3d70-4560-ae8a-3d9b90d797fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:21.505270 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba129f6-3d70-4560-ae8a-3d9b90d797fa None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:21.505557 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba129f6-3d70-4560-ae8a-3d9b90d797fa None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:21.505889 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba129f6-3d70-4560-ae8a-3d9b90d797fa None admin] PATH_INFO: `/v3/services` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:21.506637 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba129f6-3d70-4560-ae8a-3d9b90d797fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:21.508024 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba129f6-3d70-4560-ae8a-3d9b90d797fa None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:21.514353 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 443/898] 10.222.0.23 () {56 vars in 1087 bytes} [Sat Apr 30 20:49:21 2022] GET /identity/v3/services => generated 1268 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 20:49:21.515378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba129f6-3d70-4560-ae8a-3d9b90d797fa None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:21.616002 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24585a23-53c3-44fb-94bb-dfd31d10be23 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:21.620096 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba129f6-3d70-4560-ae8a-3d9b90d797fa None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:21.652793 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec735a-6d2a-4a56-897c-6b639ce1f539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:21.653551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec735a-6d2a-4a56-897c-6b639ce1f539 None admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:21.653985 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec735a-6d2a-4a56-897c-6b639ce1f539 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:21.654397 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec735a-6d2a-4a56-897c-6b639ce1f539 None admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:21.655242 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec735a-6d2a-4a56-897c-6b639ce1f539 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:21.656655 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec735a-6d2a-4a56-897c-6b639ce1f539 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:21.656779 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d00235-5aa7-4d30-bbc7-6261a61cf690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:21.657398 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d00235-5aa7-4d30-bbc7-6261a61cf690 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:21.657683 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d00235-5aa7-4d30-bbc7-6261a61cf690 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:21.657998 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d00235-5aa7-4d30-bbc7-6261a61cf690 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:21.728190 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d00235-5aa7-4d30-bbc7-6261a61cf690 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:21.729668 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d00235-5aa7-4d30-bbc7-6261a61cf690 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:21.736703 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 456/899] 10.222.0.23 () {60 vars in 1141 bytes} [Sat Apr 30 20:49:21 2022] POST /identity/v3/services => generated 241 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:49:21.737991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca7219-f81a-4559-8080-1f174c7fafe9 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:21.738274 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca7219-f81a-4559-8080-1f174c7fafe9 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:21.738547 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca7219-f81a-4559-8080-1f174c7fafe9 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:21.739978 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 457/900] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:49:21.746956 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de839311-a865-4ef7-9d94-cf9860b092f7 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:21.747871 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de839311-a865-4ef7-9d94-cf9860b092f7 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:21.748437 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de839311-a865-4ef7-9d94-cf9860b092f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:21.772055 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-de839311-a865-4ef7-9d94-cf9860b092f7 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:21.773400 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-de839311-a865-4ef7-9d94-cf9860b092f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:21.861409 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 444/901] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:49:21 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 30 20:49:21.867263 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d00235-5aa7-4d30-bbc7-6261a61cf690 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:21.869174 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 458/902] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 30 20:49:21.894398 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de839311-a865-4ef7-9d94-cf9860b092f7 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:21.994532 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d00235-5aa7-4d30-bbc7-6261a61cf690 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:22.016679 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de839311-a865-4ef7-9d94-cf9860b092f7 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:22.029191 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794fe64c-b090-430a-9c09-8ceef14e8766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:22.030017 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fe64c-b090-430a-9c09-8ceef14e8766 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:22.030293 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fe64c-b090-430a-9c09-8ceef14e8766 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:22.030561 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fe64c-b090-430a-9c09-8ceef14e8766 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:22.040587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794fe64c-b090-430a-9c09-8ceef14e8766 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:22.042058 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794fe64c-b090-430a-9c09-8ceef14e8766 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:22.057596 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f5cc33-1e3e-40ac-a6be-3a41e7acd6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:22.058435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5cc33-1e3e-40ac-a6be-3a41e7acd6f7 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:22.058717 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5cc33-1e3e-40ac-a6be-3a41e7acd6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:22.058991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5cc33-1e3e-40ac-a6be-3a41e7acd6f7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:22.059667 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f5cc33-1e3e-40ac-a6be-3a41e7acd6f7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:22.059912 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-794fe64c-b090-430a-9c09-8ceef14e8766 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:22.059912 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:22.059912 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:22.059912 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:22.059912 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:22.059912 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:22.059912 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:22.059912 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:22.059912 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:22.059912 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:22.059912 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:22.059912 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:22.059912 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:49:22.059912 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:49:22.059912 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:49:22.060759 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:49:22.060759 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:22.060759 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:22.060759 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:22.060759 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:22.060759 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:22.060759 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:22.060759 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:22.060759 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:22.060759 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:22.060759 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:22.060759 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:22.060759 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:22.060759 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:22.060759 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:22.060759 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:22.060759 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:22.061683 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:49:22.061683 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:49:22.061683 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:22.061683 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:22.061960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f5cc33-1e3e-40ac-a6be-3a41e7acd6f7 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:22.062032 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 445/903] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:49:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:49:22.067571 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794fe64c-b090-430a-9c09-8ceef14e8766 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:22.074249 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-a7f5cc33-1e3e-40ac-a6be-3a41e7acd6f7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 30 20:49:22.074249 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:22.074249 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:49:22.074249 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:49:22.074249 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:49:22.074249 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:49:22.074249 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:49:22.074249 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:49:22.074249 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 30 20:49:22.074249 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:22.074249 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:49:22.074249 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:22.074249 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:22.074249 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:22.074249 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:22.074249 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:22.075275 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:22.075275 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:22.075275 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:22.075275 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:22.075275 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:22.075275 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:22.075275 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:22.075275 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:49:22.075275 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:49:22.075275 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:49:22.075275 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:49:22.075275 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:22.075275 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:22.075275 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:22.075275 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:22.075275 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:22.076137 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:22.076137 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:22.076137 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:22.076137 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:22.076137 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:22.076137 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:22.076137 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:22.076137 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:22.076137 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:22.076137 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:22.076137 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:22.076137 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:49:22.076137 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:49:22.076137 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 30 20:49:22.076137 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:22.076137 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 459/904] 10.222.0.23 () {56 vars in 1132 bytes} [Sat Apr 30 20:49:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:49:22.081674 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f5cc33-1e3e-40ac-a6be-3a41e7acd6f7 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:22.192531 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794fe64c-b090-430a-9c09-8ceef14e8766 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:22.194811 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f5cc33-1e3e-40ac-a6be-3a41e7acd6f7 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:22.233939 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9bc57-6b75-40af-b19c-fa4f15d00ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:22.234602 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9bc57-6b75-40af-b19c-fa4f15d00ee6 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:22.234882 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9bc57-6b75-40af-b19c-fa4f15d00ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:22.235141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02b583-027a-4dfa-a25a-3a9bcc48176c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:22.235644 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9bc57-6b75-40af-b19c-fa4f15d00ee6 None admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:22.235844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9bc57-6b75-40af-b19c-fa4f15d00ee6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:22.236147 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9bc57-6b75-40af-b19c-fa4f15d00ee6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:22.236769 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02b583-027a-4dfa-a25a-3a9bcc48176c None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:22.237213 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02b583-027a-4dfa-a25a-3a9bcc48176c None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:22.237507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9bc57-6b75-40af-b19c-fa4f15d00ee6 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:22.237830 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02b583-027a-4dfa-a25a-3a9bcc48176c None admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:22.238699 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a02b583-027a-4dfa-a25a-3a9bcc48176c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:22.239180 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a02b583-027a-4dfa-a25a-3a9bcc48176c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:22.240701 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a02b583-027a-4dfa-a25a-3a9bcc48176c None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:22.242820 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 460/905] 10.222.0.23 () {56 vars in 1126 bytes} [Sat Apr 30 20:49:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:49:22.248848 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9bc57-6b75-40af-b19c-fa4f15d00ee6 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:22.258485 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 446/906] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:49:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:22.259611 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02b583-027a-4dfa-a25a-3a9bcc48176c None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:22.348539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9bc57-6b75-40af-b19c-fa4f15d00ee6 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:22.367386 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02b583-027a-4dfa-a25a-3a9bcc48176c None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:22.382284 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb78fef-564a-4928-a67b-e6af302c179e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:22.382943 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb78fef-564a-4928-a67b-e6af302c179e None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:22.383228 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb78fef-564a-4928-a67b-e6af302c179e None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:22.383508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb78fef-564a-4928-a67b-e6af302c179e None admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:22.384294 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb78fef-564a-4928-a67b-e6af302c179e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:22.384730 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb78fef-564a-4928-a67b-e6af302c179e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:22.385907 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb78fef-564a-4928-a67b-e6af302c179e None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:22.396198 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 461/907] 10.222.0.23 () {56 vars in 1126 bytes} [Sat Apr 30 20:49:22 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:22.398315 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb78fef-564a-4928-a67b-e6af302c179e None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:22.406267 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fbbd83-39b3-4dd1-8ec0-8345fb2b3a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:22.407319 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbbd83-39b3-4dd1-8ec0-8345fb2b3a1b None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:22.407823 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbbd83-39b3-4dd1-8ec0-8345fb2b3a1b None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:22.408282 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbbd83-39b3-4dd1-8ec0-8345fb2b3a1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:22.415718 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fbbd83-39b3-4dd1-8ec0-8345fb2b3a1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:22.417373 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fbbd83-39b3-4dd1-8ec0-8345fb2b3a1b None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:22.432857 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-70fbbd83-39b3-4dd1-8ec0-8345fb2b3a1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:49:22.432857 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:22.432857 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:22.432857 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:22.432857 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:22.432857 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:22.432857 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:22.432857 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:22.432857 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:22.432857 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:22.432857 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:22.432857 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:22.432857 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:49:22.432857 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:49:22.432857 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:49:22.433795 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:49:22.433795 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:22.433795 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:22.433795 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:22.433795 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:22.433795 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:22.433795 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:22.433795 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:22.433795 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:22.433795 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:22.433795 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:22.433795 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:22.433795 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:22.433795 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:22.433795 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:22.433795 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:22.433795 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:22.435262 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:49:22.435262 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:49:22.435262 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:49:22.435262 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:49:22.435262 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:49:22.435262 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:49:22.435262 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:49:22.435262 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:22.437458 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 447/908] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:49:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:22.443343 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fbbd83-39b3-4dd1-8ec0-8345fb2b3a1b None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:22.496952 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb78fef-564a-4928-a67b-e6af302c179e None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:22.530625 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c653b-7bd4-45e9-ae82-4816e27d9375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:22.531451 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c653b-7bd4-45e9-ae82-4816e27d9375 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:22.531738 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c653b-7bd4-45e9-ae82-4816e27d9375 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:22.532021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c653b-7bd4-45e9-ae82-4816e27d9375 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:22.533184 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c653b-7bd4-45e9-ae82-4816e27d9375 None admin] RBAC: Adding query filter params (interface=public, service_id=5ede9239f7074edbb6a1de34e3564c66, region_id=RegionOne) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:22.533503 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c653b-7bd4-45e9-ae82-4816e27d9375 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:22.535180 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c653b-7bd4-45e9-ae82-4816e27d9375 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:22.545846 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 462/909] 10.222.0.23 () {56 vars in 1251 bytes} [Sat Apr 30 20:49:22 2022] GET /identity/v3/endpoints?service_id=5ede9239f7074edbb6a1de34e3564c66&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:49:22.548338 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c653b-7bd4-45e9-ae82-4816e27d9375 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:22.556996 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fbbd83-39b3-4dd1-8ec0-8345fb2b3a1b None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:22.592387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008806a-7034-44a0-82aa-04b4d0ec9216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:22.593110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008806a-7034-44a0-82aa-04b4d0ec9216 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:22.593399 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008806a-7034-44a0-82aa-04b4d0ec9216 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:22.593678 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008806a-7034-44a0-82aa-04b4d0ec9216 None admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:22.594567 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008806a-7034-44a0-82aa-04b4d0ec9216 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:22.595140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008806a-7034-44a0-82aa-04b4d0ec9216 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:22.596659 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008806a-7034-44a0-82aa-04b4d0ec9216 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:22.614106 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 448/910] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Apr 30 20:49:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:49:22.615595 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008806a-7034-44a0-82aa-04b4d0ec9216 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:22.671716 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c653b-7bd4-45e9-ae82-4816e27d9375 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:22.715840 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae908665-60e5-4482-bcea-341ff4288bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:22.716963 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae908665-60e5-4482-bcea-341ff4288bbf None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:22.717448 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae908665-60e5-4482-bcea-341ff4288bbf None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:22.718157 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae908665-60e5-4482-bcea-341ff4288bbf None admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:22.718861 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae908665-60e5-4482-bcea-341ff4288bbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:22.720513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae908665-60e5-4482-bcea-341ff4288bbf None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:22.724587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008806a-7034-44a0-82aa-04b4d0ec9216 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:22.738399 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 463/911] 10.222.0.23 () {56 vars in 1087 bytes} [Sat Apr 30 20:49:22 2022] GET /identity/v3/services => generated 1497 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 20:49:22.771716 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f82d0-5256-48ec-861f-37028504cbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:22.772464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f82d0-5256-48ec-861f-37028504cbf1 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:22.772798 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f82d0-5256-48ec-861f-37028504cbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:22.773080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f82d0-5256-48ec-861f-37028504cbf1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:22.773962 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f82d0-5256-48ec-861f-37028504cbf1 None admin] RBAC: Adding query filter params (role.id=058cab574a7548388406f3e3d6bb5779, scope.project.id=6b52e5e13b9144dfb663578766c2bac0, user.id=2e3511017b8e4b4f9805a65c3ac173f9) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:22.774281 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f82d0-5256-48ec-861f-37028504cbf1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:22.775769 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f82d0-5256-48ec-861f-37028504cbf1 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:22.784061 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 449/912] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:49:22 2022] GET /identity/v3/role_assignments?user.id=2e3511017b8e4b4f9805a65c3ac173f9&scope.project.id=6b52e5e13b9144dfb663578766c2bac0&role.id=058cab574a7548388406f3e3d6bb5779 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:49:23.915648 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406034b-59fc-4e23-b0b2-937be7437e5e None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:23.916173 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406034b-59fc-4e23-b0b2-937be7437e5e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:23.916254 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406034b-59fc-4e23-b0b2-937be7437e5e None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:23.917948 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 464/913] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:49:23.923523 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af704c3c-2830-44e0-9e16-c68777f601e7 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:23.923927 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af704c3c-2830-44e0-9e16-c68777f601e7 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:23.924117 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af704c3c-2830-44e0-9e16-c68777f601e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:23.945584 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-af704c3c-2830-44e0-9e16-c68777f601e7 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:23.946826 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-af704c3c-2830-44e0-9e16-c68777f601e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:24.023085 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 450/914] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:49:24.046926 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406034b-59fc-4e23-b0b2-937be7437e5e None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:24.145605 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406034b-59fc-4e23-b0b2-937be7437e5e None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:24.179034 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7967b2-7a51-41d6-a99b-4267ff23bedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:24.179747 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7967b2-7a51-41d6-a99b-4267ff23bedf None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:24.180025 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7967b2-7a51-41d6-a99b-4267ff23bedf None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:24.180293 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7967b2-7a51-41d6-a99b-4267ff23bedf None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:24.180936 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7967b2-7a51-41d6-a99b-4267ff23bedf None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:24.182349 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7967b2-7a51-41d6-a99b-4267ff23bedf None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:24.189665 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d528ba-f586-464b-851a-f34c85daa029 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:24.189993 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d528ba-f586-464b-851a-f34c85daa029 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:24.190273 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d528ba-f586-464b-851a-f34c85daa029 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:24.191876 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 451/915] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:49:24.194657 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-0b7967b2-7a51-41d6-a99b-4267ff23bedf None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 30 20:49:24.194657 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:24.194657 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:49:24.194657 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:49:24.194657 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:49:24.194657 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:49:24.194657 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:49:24.194657 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:49:24.194657 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 30 20:49:24.194657 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:24.194657 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:49:24.194657 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:24.194657 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:24.194657 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:24.194657 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:24.194657 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:24.194657 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:24.195870 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:24.195870 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:24.195870 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:24.195870 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:24.195870 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:24.195870 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:24.195870 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:49:24.195870 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:49:24.195870 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:49:24.195870 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:49:24.195870 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:24.195870 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:24.195870 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:24.195870 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:24.195870 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:24.195870 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:24.197182 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:24.197182 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:24.197182 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:24.197182 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:24.197182 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:24.197182 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:24.197182 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:24.197182 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:24.197182 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:24.197182 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:24.197182 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:49:24.197182 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:49:24.197182 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 30 20:49:24.197182 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:24.197182 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 465/916] 10.222.0.23 () {56 vars in 1114 bytes} [Sat Apr 30 20:49:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:24.198045 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d28cf3-da64-4ba8-b789-8c4234e35ccd None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:24.198045 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d28cf3-da64-4ba8-b789-8c4234e35ccd None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:24.198045 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d28cf3-da64-4ba8-b789-8c4234e35ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:24.201555 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7967b2-7a51-41d6-a99b-4267ff23bedf None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:24.215786 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-12d28cf3-da64-4ba8-b789-8c4234e35ccd None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:24.216980 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-12d28cf3-da64-4ba8-b789-8c4234e35ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:24.301895 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 452/917] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 30 20:49:24.304817 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7967b2-7a51-41d6-a99b-4267ff23bedf None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:24.319822 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d28cf3-da64-4ba8-b789-8c4234e35ccd None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:24.339111 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92352e46-b49a-43c4-97c0-dc0dfae3c8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:24.340082 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92352e46-b49a-43c4-97c0-dc0dfae3c8e9 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:24.341518 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92352e46-b49a-43c4-97c0-dc0dfae3c8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:24.342295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92352e46-b49a-43c4-97c0-dc0dfae3c8e9 None admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:24.343285 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92352e46-b49a-43c4-97c0-dc0dfae3c8e9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:24.343954 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92352e46-b49a-43c4-97c0-dc0dfae3c8e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:24.346407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92352e46-b49a-43c4-97c0-dc0dfae3c8e9 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:24.353111 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 466/918] 10.222.0.23 () {56 vars in 1114 bytes} [Sat Apr 30 20:49:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:49:24.360885 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92352e46-b49a-43c4-97c0-dc0dfae3c8e9 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:24.428955 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d28cf3-da64-4ba8-b789-8c4234e35ccd None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:24.465022 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb382a-8b6f-489d-8ba2-9839e03435c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:24.466628 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb382a-8b6f-489d-8ba2-9839e03435c1 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:24.467082 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb382a-8b6f-489d-8ba2-9839e03435c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:24.467518 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb382a-8b6f-489d-8ba2-9839e03435c1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:24.468349 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb382a-8b6f-489d-8ba2-9839e03435c1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:24.470194 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb382a-8b6f-489d-8ba2-9839e03435c1 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:24.478828 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92352e46-b49a-43c4-97c0-dc0dfae3c8e9 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:24.483532 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-a2bb382a-8b6f-489d-8ba2-9839e03435c1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 30 20:49:24.483532 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:24.483532 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:49:24.483532 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:49:24.483532 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:49:24.483532 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:49:24.483532 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:49:24.483532 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:49:24.483532 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 30 20:49:24.483532 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:24.483532 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:49:24.483532 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:24.483532 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:24.483532 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:24.483532 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:24.483532 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:24.483532 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:24.484749 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:24.484749 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:24.484749 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:24.484749 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:24.484749 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:24.484749 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:24.484749 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:49:24.484749 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:49:24.484749 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:49:24.484749 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:49:24.484749 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:24.484749 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:24.484749 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:24.484749 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:24.484749 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:24.484749 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:24.485822 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:24.485822 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:24.485822 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:24.485822 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:24.485822 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:24.485822 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:24.485822 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:24.485822 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:24.485822 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:24.485822 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:24.485822 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:49:24.485822 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:49:24.485822 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 30 20:49:24.485822 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:24.493183 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 453/919] 10.222.0.23 () {56 vars in 1126 bytes} [Sat Apr 30 20:49:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:24.494255 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb382a-8b6f-489d-8ba2-9839e03435c1 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:24.515855 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef08bb-f859-4880-a640-b2c11b2ab255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:24.516514 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef08bb-f859-4880-a640-b2c11b2ab255 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:24.516794 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef08bb-f859-4880-a640-b2c11b2ab255 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:24.517495 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef08bb-f859-4880-a640-b2c11b2ab255 None admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:24.518240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef08bb-f859-4880-a640-b2c11b2ab255 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:24.518562 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef08bb-f859-4880-a640-b2c11b2ab255 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:24.520434 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef08bb-f859-4880-a640-b2c11b2ab255 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:24.529918 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 467/920] 10.222.0.23 () {56 vars in 1114 bytes} [Sat Apr 30 20:49:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:49:24.533226 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef08bb-f859-4880-a640-b2c11b2ab255 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:24.605347 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb382a-8b6f-489d-8ba2-9839e03435c1 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:24.644944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8dce4-ecfb-4646-92ab-407da261679e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:24.646535 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8dce4-ecfb-4646-92ab-407da261679e None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:24.647332 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8dce4-ecfb-4646-92ab-407da261679e None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:24.647826 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8dce4-ecfb-4646-92ab-407da261679e None admin] PATH_INFO: `/v3/services` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:24.649187 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c8dce4-ecfb-4646-92ab-407da261679e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:24.649961 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c8dce4-ecfb-4646-92ab-407da261679e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:24.651985 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c8dce4-ecfb-4646-92ab-407da261679e None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:24.655482 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef08bb-f859-4880-a640-b2c11b2ab255 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:24.659372 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 454/921] 10.222.0.23 () {56 vars in 1122 bytes} [Sat Apr 30 20:49:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:24.665609 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8dce4-ecfb-4646-92ab-407da261679e None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:24.703451 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd4873-fcc8-4837-9d70-c1526fade616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:24.704521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd4873-fcc8-4837-9d70-c1526fade616 None admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:24.705002 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd4873-fcc8-4837-9d70-c1526fade616 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:24.705473 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd4873-fcc8-4837-9d70-c1526fade616 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:24.706444 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd4873-fcc8-4837-9d70-c1526fade616 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:24.708496 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd4873-fcc8-4837-9d70-c1526fade616 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:24.767060 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8dce4-ecfb-4646-92ab-407da261679e None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:24.799460 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 468/922] 10.222.0.23 () {60 vars in 1144 bytes} [Sat Apr 30 20:49:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 20:49:24.822702 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953b7b1-ae41-46d4-8f60-e300f7848d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:24.823383 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953b7b1-ae41-46d4-8f60-e300f7848d57 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:24.823670 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953b7b1-ae41-46d4-8f60-e300f7848d57 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:24.823951 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953b7b1-ae41-46d4-8f60-e300f7848d57 None admin] PATH_INFO: `/v3/services` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:24.824668 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9953b7b1-ae41-46d4-8f60-e300f7848d57 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:24.824979 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9953b7b1-ae41-46d4-8f60-e300f7848d57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:24.827034 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9953b7b1-ae41-46d4-8f60-e300f7848d57 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:24.833061 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 455/923] 10.222.0.23 () {56 vars in 1122 bytes} [Sat Apr 30 20:49:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:24.839157 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd4873-fcc8-4837-9d70-c1526fade616 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:24.951704 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd4873-fcc8-4837-9d70-c1526fade616 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:24.996097 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7fb6ad-233a-42af-a7f3-44ed71e26509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:24.996778 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fb6ad-233a-42af-a7f3-44ed71e26509 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:24.997097 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fb6ad-233a-42af-a7f3-44ed71e26509 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:24.997374 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fb6ad-233a-42af-a7f3-44ed71e26509 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:24.998293 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7fb6ad-233a-42af-a7f3-44ed71e26509 None admin] RBAC: Adding query filter params (interface=public, service_id=0d5bde65582944c082b504bde87dee18, region_id=RegionOne) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:24.998609 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7fb6ad-233a-42af-a7f3-44ed71e26509 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:25.000042 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7fb6ad-233a-42af-a7f3-44ed71e26509 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:25.007515 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 469/924] 10.222.0.23 () {56 vars in 1251 bytes} [Sat Apr 30 20:49:24 2022] GET /identity/v3/endpoints?service_id=0d5bde65582944c082b504bde87dee18&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:25.014056 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953b7b1-ae41-46d4-8f60-e300f7848d57 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:25.120192 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953b7b1-ae41-46d4-8f60-e300f7848d57 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:25.154643 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef9314-5037-4306-b4a9-d3f2d900ea95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:25.155312 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef9314-5037-4306-b4a9-d3f2d900ea95 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:25.155654 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef9314-5037-4306-b4a9-d3f2d900ea95 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:25.155931 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef9314-5037-4306-b4a9-d3f2d900ea95 None admin] PATH_INFO: `/v3/services` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:25.156613 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef9314-5037-4306-b4a9-d3f2d900ea95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:25.158021 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef9314-5037-4306-b4a9-d3f2d900ea95 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:25.164328 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 456/925] 10.222.0.23 () {56 vars in 1087 bytes} [Sat Apr 30 20:49:25 2022] GET /identity/v3/services => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 20:49:25.169727 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ee95a-cd48-49e5-92a3-e8c40bf2169e None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:25.170292 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ee95a-cd48-49e5-92a3-e8c40bf2169e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:25.170700 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ee95a-cd48-49e5-92a3-e8c40bf2169e None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:25.171371 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7b8b1-2809-4e25-8ae4-337d13d8ad88 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:25.171665 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7b8b1-2809-4e25-8ae4-337d13d8ad88 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:25.171948 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7b8b1-2809-4e25-8ae4-337d13d8ad88 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:25.173009 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 470/926] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:49:25.175647 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 457/927] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:49:25.179469 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574defcd-0073-42f1-9ad8-edfa8fe662e5 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:25.179644 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0934a-cf41-4e3b-bdda-0950932c6689 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:25.179763 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574defcd-0073-42f1-9ad8-edfa8fe662e5 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:25.180029 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574defcd-0073-42f1-9ad8-edfa8fe662e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:25.180354 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0934a-cf41-4e3b-bdda-0950932c6689 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:25.180630 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0934a-cf41-4e3b-bdda-0950932c6689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:25.199147 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-1da0934a-cf41-4e3b-bdda-0950932c6689 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:25.201082 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1da0934a-cf41-4e3b-bdda-0950932c6689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:25.201926 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-574defcd-0073-42f1-9ad8-edfa8fe662e5 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:25.203615 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-574defcd-0073-42f1-9ad8-edfa8fe662e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:25.290115 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 471/928] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:49:25.299422 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 458/929] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 30 20:49:25.316731 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0934a-cf41-4e3b-bdda-0950932c6689 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:25.327564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574defcd-0073-42f1-9ad8-edfa8fe662e5 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:25.438988 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0934a-cf41-4e3b-bdda-0950932c6689 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:25.460279 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574defcd-0073-42f1-9ad8-edfa8fe662e5 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:25.474287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68726a2-72c4-4d0a-8a12-9d0fbcc840bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:25.475341 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68726a2-72c4-4d0a-8a12-9d0fbcc840bb None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:25.475821 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68726a2-72c4-4d0a-8a12-9d0fbcc840bb None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:25.476269 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68726a2-72c4-4d0a-8a12-9d0fbcc840bb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:25.477088 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68726a2-72c4-4d0a-8a12-9d0fbcc840bb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:25.478919 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68726a2-72c4-4d0a-8a12-9d0fbcc840bb None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:25.491608 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-f68726a2-72c4-4d0a-8a12-9d0fbcc840bb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 30 20:49:25.491608 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:25.491608 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:49:25.491608 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:49:25.491608 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:49:25.491608 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:49:25.491608 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:49:25.491608 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:49:25.491608 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 30 20:49:25.491608 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:25.491608 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:49:25.491608 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:25.491608 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:25.491608 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:25.491608 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:25.491608 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:25.492555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:25.492555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:25.492555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:25.492555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:25.492555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:25.492555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:25.492555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:25.492555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:49:25.492555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:49:25.492555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:49:25.492555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:49:25.492555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:25.492555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:25.492555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:25.492555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:25.492555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:25.493390 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:25.493390 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:25.493390 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:25.493390 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:25.493390 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:25.493390 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:25.493390 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:25.493390 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:25.493390 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:25.493390 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:25.493390 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:25.493390 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:49:25.493390 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:49:25.493390 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 30 20:49:25.493390 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:25.496541 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 472/930] 10.222.0.23 () {56 vars in 1132 bytes} [Sat Apr 30 20:49:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:25.502502 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59e62a-b49a-4fb4-aa0c-46cd3b785262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:25.503058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68726a2-72c4-4d0a-8a12-9d0fbcc840bb None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:25.503561 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59e62a-b49a-4fb4-aa0c-46cd3b785262 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:25.503916 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59e62a-b49a-4fb4-aa0c-46cd3b785262 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:25.504198 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59e62a-b49a-4fb4-aa0c-46cd3b785262 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:25.517148 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e59e62a-b49a-4fb4-aa0c-46cd3b785262 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:49:25.527376 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-7e59e62a-b49a-4fb4-aa0c-46cd3b785262 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 30 20:49:25.527376 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:25.527376 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:25.527376 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:25.527376 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:25.527376 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:25.527376 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:25.527376 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:25.527376 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:25.527376 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:25.527376 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:25.527376 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:25.527376 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:49:25.527376 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:49:25.527376 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:49:25.527376 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:49:25.528385 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:49:25.528385 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:49:25.528385 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:49:25.528385 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:49:25.528385 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:25.528385 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:25.528385 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:25.528385 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:25.528385 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:25.528385 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:25.528385 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:25.528385 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:25.528385 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:25.528385 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:25.528385 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:25.528385 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:25.529227 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:25.529227 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:25.529227 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:25.529227 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:25.529227 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:49:25.529227 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:49:25.529227 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:49:25.529227 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:49:25.529227 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:49:25.529227 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:49:25.529227 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 30 20:49:25.529227 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:25.533835 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 459/931] 10.222.0.23 () {56 vars in 1120 bytes} [Sat Apr 30 20:49:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:25.535165 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59e62a-b49a-4fb4-aa0c-46cd3b785262 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:25.632322 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68726a2-72c4-4d0a-8a12-9d0fbcc840bb None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:25.640371 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59e62a-b49a-4fb4-aa0c-46cd3b785262 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:25.674726 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcdd4d7-1f8b-4f85-b192-bd302251b3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:25.675266 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd2f7a-dc0b-4a63-9f9a-4a66e1179789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:25.675391 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcdd4d7-1f8b-4f85-b192-bd302251b3f3 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:25.675653 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcdd4d7-1f8b-4f85-b192-bd302251b3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:25.675925 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcdd4d7-1f8b-4f85-b192-bd302251b3f3 None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:25.676667 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcdd4d7-1f8b-4f85-b192-bd302251b3f3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:25.676792 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd2f7a-dc0b-4a63-9f9a-4a66e1179789 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:25.676966 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcdd4d7-1f8b-4f85-b192-bd302251b3f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:25.677434 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd2f7a-dc0b-4a63-9f9a-4a66e1179789 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:25.677931 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd2f7a-dc0b-4a63-9f9a-4a66e1179789 None admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:25.678545 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcdd4d7-1f8b-4f85-b192-bd302251b3f3 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:25.679050 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd2f7a-dc0b-4a63-9f9a-4a66e1179789 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:25.679565 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd2f7a-dc0b-4a63-9f9a-4a66e1179789 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:25.681668 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd2f7a-dc0b-4a63-9f9a-4a66e1179789 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:25.691369 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 460/932] 10.222.0.23 () {56 vars in 1115 bytes} [Sat Apr 30 20:49:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:25.692995 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 473/933] 10.222.0.23 () {56 vars in 1126 bytes} [Sat Apr 30 20:49:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:49:25.695620 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcdd4d7-1f8b-4f85-b192-bd302251b3f3 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:25.695910 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd2f7a-dc0b-4a63-9f9a-4a66e1179789 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:25.798041 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcdd4d7-1f8b-4f85-b192-bd302251b3f3 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:25.807730 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd2f7a-dc0b-4a63-9f9a-4a66e1179789 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:25.831436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019d0e1-7a45-4124-b1b5-c5d92f288548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:25.832181 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019d0e1-7a45-4124-b1b5-c5d92f288548 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:25.832513 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019d0e1-7a45-4124-b1b5-c5d92f288548 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:25.832789 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019d0e1-7a45-4124-b1b5-c5d92f288548 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:25.844669 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47dc494-96e4-45eb-ba94-4639679c581c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:25.845882 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47dc494-96e4-45eb-ba94-4639679c581c None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:25.846281 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e019d0e1-7a45-4124-b1b5-c5d92f288548 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:25.846617 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47dc494-96e4-45eb-ba94-4639679c581c None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:25.847091 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47dc494-96e4-45eb-ba94-4639679c581c None admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:25.847775 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e019d0e1-7a45-4124-b1b5-c5d92f288548 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:25.848390 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47dc494-96e4-45eb-ba94-4639679c581c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:25.848913 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47dc494-96e4-45eb-ba94-4639679c581c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:25.850493 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47dc494-96e4-45eb-ba94-4639679c581c None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:25.855861 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 474/934] 10.222.0.23 () {56 vars in 1126 bytes} [Sat Apr 30 20:49:25 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:25.861736 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47dc494-96e4-45eb-ba94-4639679c581c None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:25.870222 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-e019d0e1-7a45-4124-b1b5-c5d92f288548 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:25.870222 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:25.870222 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:25.870222 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:25.870222 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:25.870222 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:25.870222 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:25.870222 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:25.870222 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:25.870222 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:25.870222 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:25.870222 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:25.870222 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:49:25.870222 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:49:25.870222 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:49:25.871312 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:49:25.871312 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:25.871312 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:25.871312 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:25.871312 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:25.871312 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:25.871312 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:25.871312 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:25.871312 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:25.871312 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:25.871312 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:25.871312 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:25.871312 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:25.871312 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:25.871312 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:25.871312 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:25.871312 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:25.872446 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:49:25.872446 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:49:25.872446 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:25.872446 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:25.878569 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 461/935] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:49:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:25.881718 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019d0e1-7a45-4124-b1b5-c5d92f288548 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:25.988391 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47dc494-96e4-45eb-ba94-4639679c581c None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:25.994594 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019d0e1-7a45-4124-b1b5-c5d92f288548 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:26.035267 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6cef4-9820-4a34-88f3-d96ccfd91523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:26.035742 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11a637-c9b5-41c5-ab8d-9b24862774b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:26.036542 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11a637-c9b5-41c5-ab8d-9b24862774b7 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:26.036887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6cef4-9820-4a34-88f3-d96ccfd91523 None admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:26.037002 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11a637-c9b5-41c5-ab8d-9b24862774b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:26.037348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11a637-c9b5-41c5-ab8d-9b24862774b7 None admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:26.037549 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6cef4-9820-4a34-88f3-d96ccfd91523 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:26.037992 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6cef4-9820-4a34-88f3-d96ccfd91523 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:26.038363 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11a637-c9b5-41c5-ab8d-9b24862774b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:26.038759 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11a637-c9b5-41c5-ab8d-9b24862774b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:26.039199 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6cef4-9820-4a34-88f3-d96ccfd91523 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:26.040345 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11a637-c9b5-41c5-ab8d-9b24862774b7 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:26.040892 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6cef4-9820-4a34-88f3-d96ccfd91523 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:26.060381 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 462/936] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:49:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:49:26.072758 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11a637-c9b5-41c5-ab8d-9b24862774b7 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:26.164047 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 475/937] 10.222.0.23 () {60 vars in 1144 bytes} [Sat Apr 30 20:49:25 2022] POST /identity/v3/endpoints => generated 347 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:49:26.184348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11a637-c9b5-41c5-ab8d-9b24862774b7 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:26.229857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875c11c-af7a-436e-9906-7ffe2a9c16e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:26.230686 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875c11c-af7a-436e-9906-7ffe2a9c16e2 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:26.230971 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875c11c-af7a-436e-9906-7ffe2a9c16e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:26.231245 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875c11c-af7a-436e-9906-7ffe2a9c16e2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:26.239724 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4875c11c-af7a-436e-9906-7ffe2a9c16e2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:26.241138 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4875c11c-af7a-436e-9906-7ffe2a9c16e2 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:26.261821 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-4875c11c-af7a-436e-9906-7ffe2a9c16e2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 30 20:49:26.261821 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:26.261821 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:26.261821 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:26.261821 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:26.261821 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:26.261821 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:26.261821 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:26.261821 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:26.261821 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:26.261821 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:26.261821 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:26.261821 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:49:26.261821 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:49:26.261821 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:49:26.261821 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:49:26.263384 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:26.263384 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:26.263384 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:49:26.263384 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:49:26.263384 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:49:26.263384 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:49:26.263384 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:26.263384 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:26.263384 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:26.263384 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:26.263384 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:26.263384 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:26.263384 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:26.263384 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:26.263384 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:26.263384 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:26.263384 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:26.263384 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:26.264518 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:26.264518 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:26.264518 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:49:26.264518 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:49:26.264518 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:49:26.264518 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:49:26.264518 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:49:26.264518 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:49:26.264518 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 30 20:49:26.264518 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:26.264518 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 463/938] 10.222.0.23 () {56 vars in 1117 bytes} [Sat Apr 30 20:49:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:49:26.269849 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6cef4-9820-4a34-88f3-d96ccfd91523 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:26.378926 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6cef4-9820-4a34-88f3-d96ccfd91523 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:26.414723 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3da43-bd16-4e93-bb86-65acdd752884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:26.415415 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3da43-bd16-4e93-bb86-65acdd752884 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:26.415702 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3da43-bd16-4e93-bb86-65acdd752884 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:26.415974 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3da43-bd16-4e93-bb86-65acdd752884 None admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:26.416833 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c3da43-bd16-4e93-bb86-65acdd752884 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:26.417142 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c3da43-bd16-4e93-bb86-65acdd752884 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:26.418659 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c3da43-bd16-4e93-bb86-65acdd752884 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:26.437386 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 476/939] 10.222.0.23 () {56 vars in 1149 bytes} [Sat Apr 30 20:49:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:26.443346 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875c11c-af7a-436e-9906-7ffe2a9c16e2 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:26.542057 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875c11c-af7a-436e-9906-7ffe2a9c16e2 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:26.576907 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5feec0-b475-4e46-ae3f-62de8e4e78c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:26.578162 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5feec0-b475-4e46-ae3f-62de8e4e78c5 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:26.578646 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5feec0-b475-4e46-ae3f-62de8e4e78c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:26.579136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5feec0-b475-4e46-ae3f-62de8e4e78c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:26.589445 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5feec0-b475-4e46-ae3f-62de8e4e78c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:26.591242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5feec0-b475-4e46-ae3f-62de8e4e78c5 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:26.610145 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-4a5feec0-b475-4e46-ae3f-62de8e4e78c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:26.610145 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:26.610145 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:26.610145 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:26.610145 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:26.610145 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:26.610145 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:26.610145 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:26.610145 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:26.610145 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:26.610145 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:26.610145 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:26.610145 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:49:26.610145 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:49:26.610145 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:49:26.611035 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:49:26.611035 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:26.611035 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:26.611035 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:26.611035 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:26.611035 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:26.611035 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:26.611035 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:26.611035 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:26.611035 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:26.611035 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:26.611035 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:26.611035 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:26.611035 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:26.611035 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:26.611035 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:26.611035 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:26.611929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:49:26.611929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:49:26.611929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:26.611929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:26.617848 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 464/940] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:49:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:26.620011 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3da43-bd16-4e93-bb86-65acdd752884 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:26.720384 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3da43-bd16-4e93-bb86-65acdd752884 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:26.754228 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35c720-eb91-441c-bb78-8524cc91b442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:26.755216 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35c720-eb91-441c-bb78-8524cc91b442 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:26.755694 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35c720-eb91-441c-bb78-8524cc91b442 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:26.756202 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35c720-eb91-441c-bb78-8524cc91b442 None admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:26.757106 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35c720-eb91-441c-bb78-8524cc91b442 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:26.757606 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35c720-eb91-441c-bb78-8524cc91b442 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:26.759179 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35c720-eb91-441c-bb78-8524cc91b442 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:26.775970 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 477/941] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:49:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:26.777780 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5feec0-b475-4e46-ae3f-62de8e4e78c5 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:26.881474 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5feec0-b475-4e46-ae3f-62de8e4e78c5 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:26.915866 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06964e9-4732-4e53-b020-f8d5185b755b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:26.916663 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06964e9-4732-4e53-b020-f8d5185b755b None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:26.916946 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06964e9-4732-4e53-b020-f8d5185b755b None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:26.917224 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06964e9-4732-4e53-b020-f8d5185b755b None admin] PATH_INFO: `/v3/projects/service` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:26.924718 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06964e9-4732-4e53-b020-f8d5185b755b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:26.926210 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06964e9-4732-4e53-b020-f8d5185b755b None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:26.940066 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-a06964e9-4732-4e53-b020-f8d5185b755b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:49:26.940066 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:26.940066 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:26.940066 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:26.940066 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:26.940066 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:26.940066 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:26.940066 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:26.940066 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:26.940066 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:26.940066 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:26.940066 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:26.940066 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:49:26.940066 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:49:26.940066 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:49:26.940995 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:49:26.940995 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:26.940995 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:26.940995 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:26.940995 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:26.940995 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:26.940995 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:26.940995 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:26.940995 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:26.940995 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:26.940995 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:26.940995 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:26.940995 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:26.940995 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:26.940995 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:26.940995 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:26.940995 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:26.942350 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:49:26.942350 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:49:26.942350 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:49:26.942350 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:49:26.942350 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:49:26.942350 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:49:26.942350 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:49:26.942350 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:26.942350 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 465/942] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:49:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:26.947271 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35c720-eb91-441c-bb78-8524cc91b442 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:27.053352 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35c720-eb91-441c-bb78-8524cc91b442 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:27.087520 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a560b-9ebe-4aa5-bc0d-77762052c87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:27.088191 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a560b-9ebe-4aa5-bc0d-77762052c87f None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:27.088480 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a560b-9ebe-4aa5-bc0d-77762052c87f None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:27.088760 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a560b-9ebe-4aa5-bc0d-77762052c87f None admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:27.089559 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a560b-9ebe-4aa5-bc0d-77762052c87f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:27.089901 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a560b-9ebe-4aa5-bc0d-77762052c87f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:27.091930 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a560b-9ebe-4aa5-bc0d-77762052c87f None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:27.105173 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 478/943] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Apr 30 20:49:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:27.110941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06964e9-4732-4e53-b020-f8d5185b755b None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:27.218248 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06964e9-4732-4e53-b020-f8d5185b755b None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:27.253549 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e085b-d56f-4900-b0ac-be656cceec38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:27.254493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e085b-d56f-4900-b0ac-be656cceec38 None admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:27.254773 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e085b-d56f-4900-b0ac-be656cceec38 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:27.255045 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e085b-d56f-4900-b0ac-be656cceec38 None admin] PATH_INFO: `/v3/projects/6b52e5e13b9144dfb663578766c2bac0/users/2e3511017b8e4b4f9805a65c3ac173f9/roles/058cab574a7548388406f3e3d6bb5779` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:27.257288 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e085b-d56f-4900-b0ac-be656cceec38 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b52e5e13b9144dfb663578766c2bac0, user_id=2e3511017b8e4b4f9805a65c3ac173f9, role_id=058cab574a7548388406f3e3d6bb5779)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:27.258776 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e085b-d56f-4900-b0ac-be656cceec38 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:27.359324 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 466/944] 10.222.0.23 () {58 vars in 1439 bytes} [Sat Apr 30 20:49:27 2022] PUT /identity/v3/projects/6b52e5e13b9144dfb663578766c2bac0/users/2e3511017b8e4b4f9805a65c3ac173f9/roles/058cab574a7548388406f3e3d6bb5779 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:49:27.402671 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f755c4f-9da0-4710-829b-2b08d3961a93 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:27.402989 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f755c4f-9da0-4710-829b-2b08d3961a93 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:27.403313 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f755c4f-9da0-4710-829b-2b08d3961a93 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:27.405215 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 479/945] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:49:27.411303 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878f89b-90af-4f11-873b-92ef61d948a9 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:27.411615 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878f89b-90af-4f11-873b-92ef61d948a9 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:27.411895 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878f89b-90af-4f11-873b-92ef61d948a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:27.430746 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-e878f89b-90af-4f11-873b-92ef61d948a9 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:27.432010 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e878f89b-90af-4f11-873b-92ef61d948a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:27.514019 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 467/946] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:49:27.532887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f755c4f-9da0-4710-829b-2b08d3961a93 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:27.594449 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d193c3-8d88-4854-9a9e-55df352c5de0 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:27.594734 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d193c3-8d88-4854-9a9e-55df352c5de0 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:27.595279 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d193c3-8d88-4854-9a9e-55df352c5de0 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:27.597191 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 468/947] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:49:27.602177 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf05901-7855-4411-b99b-464b6c78a4d9 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:27.602786 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf05901-7855-4411-b99b-464b6c78a4d9 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:27.603231 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf05901-7855-4411-b99b-464b6c78a4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:27.623172 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-fdf05901-7855-4411-b99b-464b6c78a4d9 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:27.624860 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-fdf05901-7855-4411-b99b-464b6c78a4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:27.649433 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f755c4f-9da0-4710-829b-2b08d3961a93 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:27.697213 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e0735-728d-4b51-8243-a910a4eb57c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:27.697968 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e0735-728d-4b51-8243-a910a4eb57c6 None admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:27.698254 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e0735-728d-4b51-8243-a910a4eb57c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:27.698530 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e0735-728d-4b51-8243-a910a4eb57c6 None admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:27.699123 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 469/948] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 30 20:49:27.699368 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e0735-728d-4b51-8243-a910a4eb57c6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:27.700918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e0735-728d-4b51-8243-a910a4eb57c6 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:27.702346 ncdv-master-1 devstack@keystone.service[91018]: WARNING keystone.server.flask.common [None req-2b4e0735-728d-4b51-8243-a910a4eb57c6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Apr 30 20:49:27.724299 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf05901-7855-4411-b99b-464b6c78a4d9 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:27.763333 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.sql.core [None req-2b4e0735-728d-4b51-8243-a910a4eb57c6 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Apr 30 20:49:27.763333 ncdv-master-1 devstack@keystone.service[91018]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Apr 30 20:49:27.763333 ncdv-master-1 devstack@keystone.service[91018]: [parameters: {'id': '27c8e1c2b24b4cf8b432dff588b25644', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Apr 30 20:49:27.763333 ncdv-master-1 devstack@keystone.service[91018]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91018) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 30 20:49:27.790385 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-2b4e0735-728d-4b51-8243-a910a4eb57c6 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 27c8e1c2b24b4cf8b432dff588b25644.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 27c8e1c2b24b4cf8b432dff588b25644. Apr 30 20:49:27.790385 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:27.790385 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Apr 30 20:49:27.790385 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self.dialect.do_execute( Apr 30 20:49:27.790385 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Apr 30 20:49:27.790385 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Apr 30 20:49:27.790385 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Apr 30 20:49:27.790385 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application result = self._query(query) Apr 30 20:49:27.790385 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Apr 30 20:49:27.790385 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application conn.query(q) Apr 30 20:49:27.790385 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Apr 30 20:49:27.790385 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Apr 30 20:49:27.790385 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Apr 30 20:49:27.791295 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application result.read() Apr 30 20:49:27.791295 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Apr 30 20:49:27.791295 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Apr 30 20:49:27.791295 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Apr 30 20:49:27.791295 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application packet.raise_for_error() Apr 30 20:49:27.791295 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Apr 30 20:49:27.791295 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Apr 30 20:49:27.791295 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Apr 30 20:49:27.791295 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Apr 30 20:49:27.791295 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Apr 30 20:49:27.791295 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:27.791295 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Apr 30 20:49:27.791295 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:27.791295 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:27.791295 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Apr 30 20:49:27.791295 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return method(*args, **kwargs) Apr 30 20:49:27.791295 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Apr 30 20:49:27.791295 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return project_ref.to_dict() Apr 30 20:49:27.792252 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Apr 30 20:49:27.792252 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application next(self.gen) Apr 30 20:49:27.792252 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Apr 30 20:49:27.792252 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application yield resource Apr 30 20:49:27.792252 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Apr 30 20:49:27.792252 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application next(self.gen) Apr 30 20:49:27.792252 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Apr 30 20:49:27.792252 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self.session.rollback() Apr 30 20:49:27.792252 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Apr 30 20:49:27.792252 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self.force_reraise() Apr 30 20:49:27.792252 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Apr 30 20:49:27.792252 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise self.value Apr 30 20:49:27.792252 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Apr 30 20:49:27.792252 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Apr 30 20:49:27.792252 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Apr 30 20:49:27.792252 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application session.commit() Apr 30 20:49:27.792252 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1431, in commit Apr 30 20:49:27.793654 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Apr 30 20:49:27.793654 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Apr 30 20:49:27.793654 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self._prepare_impl() Apr 30 20:49:27.793654 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Apr 30 20:49:27.793654 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self.session.flush() Apr 30 20:49:27.793654 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3363, in flush Apr 30 20:49:27.793654 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self._flush(objects) Apr 30 20:49:27.793654 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3503, in _flush Apr 30 20:49:27.793654 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Apr 30 20:49:27.793654 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Apr 30 20:49:27.793654 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application compat.raise_( Apr 30 20:49:27.793654 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Apr 30 20:49:27.793654 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception Apr 30 20:49:27.793654 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3463, in _flush Apr 30 20:49:27.793654 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application flush_context.execute() Apr 30 20:49:27.793654 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Apr 30 20:49:27.793654 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rec.execute(self) Apr 30 20:49:27.796134 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Apr 30 20:49:27.796134 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Apr 30 20:49:27.796134 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Apr 30 20:49:27.796134 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application _emit_insert_statements( Apr 30 20:49:27.796134 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Apr 30 20:49:27.796134 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application c = connection._execute_20( Apr 30 20:49:27.796134 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Apr 30 20:49:27.796134 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Apr 30 20:49:27.796134 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Apr 30 20:49:27.796134 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Apr 30 20:49:27.796134 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Apr 30 20:49:27.796134 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ret = self._execute_context( Apr 30 20:49:27.796134 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Apr 30 20:49:27.796134 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Apr 30 20:49:27.796134 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Apr 30 20:49:27.798010 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Apr 30 20:49:27.798010 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Apr 30 20:49:27.798010 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception Apr 30 20:49:27.798010 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Apr 30 20:49:27.798010 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self.dialect.do_execute( Apr 30 20:49:27.798010 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Apr 30 20:49:27.798010 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Apr 30 20:49:27.798010 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Apr 30 20:49:27.798010 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application result = self._query(query) Apr 30 20:49:27.798010 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Apr 30 20:49:27.798010 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application conn.query(q) Apr 30 20:49:27.798010 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Apr 30 20:49:27.798010 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Apr 30 20:49:27.798010 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Apr 30 20:49:27.798010 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application result.read() Apr 30 20:49:27.798010 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Apr 30 20:49:27.798010 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Apr 30 20:49:27.800072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Apr 30 20:49:27.800072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application packet.raise_for_error() Apr 30 20:49:27.800072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Apr 30 20:49:27.800072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Apr 30 20:49:27.800072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Apr 30 20:49:27.800072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Apr 30 20:49:27.800072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Apr 30 20:49:27.800072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Apr 30 20:49:27.800072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [parameters: {'id': '27c8e1c2b24b4cf8b432dff588b25644', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Apr 30 20:49:27.800072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Apr 30 20:49:27.800072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:27.800072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:49:27.800072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:27.800072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:27.800072 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Apr 30 20:49:27.802047 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Apr 30 20:49:27.802047 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Apr 30 20:49:27.802047 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Apr 30 20:49:27.802047 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Apr 30 20:49:27.802047 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:27.802047 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:49:27.802047 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:27.802047 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:27.802047 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:27.802047 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:27.802047 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:27.802047 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:27.802047 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:27.802047 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:27.802047 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:27.802047 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:27.802047 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:27.804269 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:27.804269 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Apr 30 20:49:27.804269 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Apr 30 20:49:27.804269 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:27.804269 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:27.804269 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Apr 30 20:49:27.804269 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.Conflict( Apr 30 20:49:27.804269 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 27c8e1c2b24b4cf8b432dff588b25644. Apr 30 20:49:27.804269 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:27.804269 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 480/949] 10.222.0.23 () {60 vars in 1140 bytes} [Sat Apr 30 20:49:27 2022] POST /identity/v3/projects => generated 262 bytes in 257 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:27.804269 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e0735-728d-4b51-8243-a910a4eb57c6 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:27.839134 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf05901-7855-4411-b99b-464b6c78a4d9 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:27.883219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37cd4c1-f1f4-4980-8795-13b5dd99a2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:27.884583 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cd4c1-f1f4-4980-8795-13b5dd99a2f5 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:27.885069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cd4c1-f1f4-4980-8795-13b5dd99a2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:27.885541 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cd4c1-f1f4-4980-8795-13b5dd99a2f5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:27.886437 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37cd4c1-f1f4-4980-8795-13b5dd99a2f5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:27.888049 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37cd4c1-f1f4-4980-8795-13b5dd99a2f5 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:27.900754 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-c37cd4c1-f1f4-4980-8795-13b5dd99a2f5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 30 20:49:27.900754 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:27.900754 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:49:27.900754 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:49:27.900754 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:49:27.900754 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:49:27.900754 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:49:27.900754 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:49:27.900754 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 30 20:49:27.900754 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:27.900754 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:49:27.900754 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:27.900754 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:27.900754 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:27.900754 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:27.900754 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:27.900754 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:27.901769 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:27.901769 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:27.901769 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:27.901769 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:27.901769 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:27.901769 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:27.901769 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:49:27.901769 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:49:27.901769 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:49:27.901769 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:49:27.901769 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:27.901769 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:27.901769 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:27.901769 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:27.901769 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:27.901769 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:27.902620 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:27.902620 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:27.902620 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:27.902620 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:27.902620 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:27.902620 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:27.902620 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:27.902620 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:27.902620 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:27.902620 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:27.902620 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:49:27.902620 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:49:27.902620 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 30 20:49:27.902620 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:27.905524 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 470/950] 10.222.0.23 () {56 vars in 1126 bytes} [Sat Apr 30 20:49:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:27.911955 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37cd4c1-f1f4-4980-8795-13b5dd99a2f5 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:27.918221 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e0735-728d-4b51-8243-a910a4eb57c6 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:27.962350 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d94ce5-67d6-48a4-9776-e3d3e517ebd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:27.963849 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d94ce5-67d6-48a4-9776-e3d3e517ebd0 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:27.964512 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d94ce5-67d6-48a4-9776-e3d3e517ebd0 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:27.965268 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d94ce5-67d6-48a4-9776-e3d3e517ebd0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:27.974441 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d94ce5-67d6-48a4-9776-e3d3e517ebd0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:27.977094 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d94ce5-67d6-48a4-9776-e3d3e517ebd0 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:27.995815 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-57d94ce5-67d6-48a4-9776-e3d3e517ebd0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:49:27.995815 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:27.995815 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:27.995815 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:27.995815 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:27.995815 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:27.995815 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:27.995815 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:27.995815 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:27.995815 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:27.995815 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:27.995815 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:27.995815 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:49:27.995815 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:49:27.995815 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:49:27.996749 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:49:27.996749 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:27.996749 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:27.996749 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:27.996749 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:27.996749 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:27.996749 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:27.996749 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:27.996749 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:27.996749 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:27.996749 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:27.996749 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:27.996749 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:27.996749 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:27.996749 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:27.996749 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:27.996749 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:27.997746 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:49:27.997746 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:49:27.997746 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:49:27.997746 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:49:27.997746 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:49:27.997746 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:49:27.997746 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:49:27.997746 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:27.999330 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 481/951] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:49:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:28.004862 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d94ce5-67d6-48a4-9776-e3d3e517ebd0 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:28.027607 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37cd4c1-f1f4-4980-8795-13b5dd99a2f5 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:28.070069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a56e1-8c66-4cf8-8140-6742df8b909d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:28.070658 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a56e1-8c66-4cf8-8140-6742df8b909d None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:28.070939 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a56e1-8c66-4cf8-8140-6742df8b909d None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:28.071204 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a56e1-8c66-4cf8-8140-6742df8b909d None admin] PATH_INFO: `/v3/services` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:28.071927 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a56e1-8c66-4cf8-8140-6742df8b909d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:28.072365 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a56e1-8c66-4cf8-8140-6742df8b909d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:28.073642 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a56e1-8c66-4cf8-8140-6742df8b909d None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:28.079451 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 471/952] 10.222.0.23 () {56 vars in 1122 bytes} [Sat Apr 30 20:49:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:28.085201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a56e1-8c66-4cf8-8140-6742df8b909d None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:28.111420 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d94ce5-67d6-48a4-9776-e3d3e517ebd0 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:28.146813 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb453a-656c-4326-a19a-88b8ec872415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:28.147859 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb453a-656c-4326-a19a-88b8ec872415 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:28.148340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb453a-656c-4326-a19a-88b8ec872415 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:28.148824 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb453a-656c-4326-a19a-88b8ec872415 None admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:28.149783 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb453a-656c-4326-a19a-88b8ec872415 None admin] RBAC: Adding query filter params (name=service) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:28.150288 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb453a-656c-4326-a19a-88b8ec872415 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:28.151975 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb453a-656c-4326-a19a-88b8ec872415 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:28.177887 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 482/953] 10.222.0.23 () {56 vars in 1112 bytes} [Sat Apr 30 20:49:28 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:28.201534 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a56e1-8c66-4cf8-8140-6742df8b909d None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:28.239697 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e5f74-1714-4e67-9573-853eea162a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:28.240384 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e5f74-1714-4e67-9573-853eea162a11 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:28.240665 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e5f74-1714-4e67-9573-853eea162a11 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:28.240936 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e5f74-1714-4e67-9573-853eea162a11 None admin] PATH_INFO: `/v3/services` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:28.241655 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21e5f74-1714-4e67-9573-853eea162a11 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:28.242041 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21e5f74-1714-4e67-9573-853eea162a11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:28.243535 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21e5f74-1714-4e67-9573-853eea162a11 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:28.253935 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 472/954] 10.222.0.23 () {56 vars in 1122 bytes} [Sat Apr 30 20:49:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:28.257524 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb453a-656c-4326-a19a-88b8ec872415 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:28.374400 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb453a-656c-4326-a19a-88b8ec872415 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:28.415489 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be35bfb-0b19-4edb-a67a-a2e7f7579c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:28.416167 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be35bfb-0b19-4edb-a67a-a2e7f7579c7f None admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:28.416449 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be35bfb-0b19-4edb-a67a-a2e7f7579c7f None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:28.416724 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be35bfb-0b19-4edb-a67a-a2e7f7579c7f None admin] PATH_INFO: `/v3/endpoints` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:28.417472 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be35bfb-0b19-4edb-a67a-a2e7f7579c7f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:28.419560 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be35bfb-0b19-4edb-a67a-a2e7f7579c7f None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:28.507941 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 483/955] 10.222.0.23 () {60 vars in 1144 bytes} [Sat Apr 30 20:49:28 2022] POST /identity/v3/endpoints => generated 349 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:49:28.585263 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edada031-8539-4fea-b176-859843c84ebe None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:28.585643 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edada031-8539-4fea-b176-859843c84ebe None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:28.585875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edada031-8539-4fea-b176-859843c84ebe None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:28.587692 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 473/956] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:49:28.593554 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3bab64-c578-4340-92c6-c8dcdc98e8d3 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:28.593896 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3bab64-c578-4340-92c6-c8dcdc98e8d3 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:28.594152 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3bab64-c578-4340-92c6-c8dcdc98e8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:28.613181 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-4f3bab64-c578-4340-92c6-c8dcdc98e8d3 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:28.614813 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4f3bab64-c578-4340-92c6-c8dcdc98e8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:28.695278 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 484/957] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:49:28.719193 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edada031-8539-4fea-b176-859843c84ebe None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:28.823328 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edada031-8539-4fea-b176-859843c84ebe None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:28.858229 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8c52c-5587-4c61-a266-2370dd925b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:28.859031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8c52c-5587-4c61-a266-2370dd925b96 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:28.859371 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8c52c-5587-4c61-a266-2370dd925b96 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:28.859653 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8c52c-5587-4c61-a266-2370dd925b96 None admin] PATH_INFO: `/v3/services/compute` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:28.860352 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8c52c-5587-4c61-a266-2370dd925b96 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:28.861808 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a8c52c-5587-4c61-a266-2370dd925b96 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:28.873748 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-b9a8c52c-5587-4c61-a266-2370dd925b96 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 30 20:49:28.873748 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:28.873748 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:49:28.873748 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:49:28.873748 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:49:28.873748 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:49:28.873748 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:49:28.873748 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:49:28.873748 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Apr 30 20:49:28.873748 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:28.873748 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:49:28.873748 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:28.873748 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:28.873748 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:28.873748 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:28.873748 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:28.873748 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:28.874740 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:28.874740 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:28.874740 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:28.874740 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:28.874740 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:28.874740 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:28.874740 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:49:28.874740 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:49:28.874740 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:49:28.874740 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:49:28.874740 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:28.874740 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:28.874740 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:28.874740 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:28.874740 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:28.874740 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:28.875564 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:28.875564 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:28.875564 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:28.875564 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:28.875564 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:28.875564 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:28.875564 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:28.875564 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:28.875564 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:28.875564 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:28.875564 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:49:28.875564 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:49:28.875564 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Apr 30 20:49:28.875564 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:28.875564 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 474/958] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:49:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:28.881127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3bab64-c578-4340-92c6-c8dcdc98e8d3 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:28.979980 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3bab64-c578-4340-92c6-c8dcdc98e8d3 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:29.013903 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85444cd0-579b-4250-a70a-f4f5887aa530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:29.014570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85444cd0-579b-4250-a70a-f4f5887aa530 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:29.014909 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85444cd0-579b-4250-a70a-f4f5887aa530 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:29.015193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85444cd0-579b-4250-a70a-f4f5887aa530 None admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:29.015900 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85444cd0-579b-4250-a70a-f4f5887aa530 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:29.016206 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85444cd0-579b-4250-a70a-f4f5887aa530 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:29.017577 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85444cd0-579b-4250-a70a-f4f5887aa530 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:29.022981 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 485/959] 10.222.0.23 () {56 vars in 1112 bytes} [Sat Apr 30 20:49:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:29.028789 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8c52c-5587-4c61-a266-2370dd925b96 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:29.138145 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8c52c-5587-4c61-a266-2370dd925b96 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:29.177811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c643e2-3643-4728-b257-665126f36b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:29.177811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c643e2-3643-4728-b257-665126f36b8c None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:29.177811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c643e2-3643-4728-b257-665126f36b8c None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:29.177811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c643e2-3643-4728-b257-665126f36b8c None admin] PATH_INFO: `/v3/services` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:29.178560 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c643e2-3643-4728-b257-665126f36b8c None admin] RBAC: Adding query filter params (type=compute) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:29.178560 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c643e2-3643-4728-b257-665126f36b8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:29.178560 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c643e2-3643-4728-b257-665126f36b8c None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:29.182698 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 475/960] 10.222.0.23 () {56 vars in 1112 bytes} [Sat Apr 30 20:49:29 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:29.869238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f351d-2966-4d7a-91d2-aa6fb991cb97 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:29.869809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f351d-2966-4d7a-91d2-aa6fb991cb97 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:29.869809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f351d-2966-4d7a-91d2-aa6fb991cb97 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:29.871452 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 486/961] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:49:29.876952 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1e405-1dea-4b31-858f-71161001e114 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:29.877362 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1e405-1dea-4b31-858f-71161001e114 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:29.877517 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1e405-1dea-4b31-858f-71161001e114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:29.895247 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-76d1e405-1dea-4b31-858f-71161001e114 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:29.896437 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-76d1e405-1dea-4b31-858f-71161001e114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:29.978132 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 476/962] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 30 20:49:30.008705 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f351d-2966-4d7a-91d2-aa6fb991cb97 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:30.117439 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f351d-2966-4d7a-91d2-aa6fb991cb97 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:30.151862 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c197cfd-1136-4f64-8802-e7a6f7bcbc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:30.152589 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c197cfd-1136-4f64-8802-e7a6f7bcbc68 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:30.152870 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c197cfd-1136-4f64-8802-e7a6f7bcbc68 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:30.153175 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c197cfd-1136-4f64-8802-e7a6f7bcbc68 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:30.163474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c197cfd-1136-4f64-8802-e7a6f7bcbc68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:49:30.172148 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-2c197cfd-1136-4f64-8802-e7a6f7bcbc68 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 30 20:49:30.172148 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:30.172148 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:30.172148 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:30.172148 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:30.172148 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:30.172148 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:30.172148 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:30.172148 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:30.172148 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:30.172148 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:30.172148 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:30.172148 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:49:30.172148 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:49:30.172148 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:49:30.172148 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:49:30.173079 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:49:30.173079 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:49:30.173079 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:49:30.173079 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:49:30.173079 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:30.173079 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:30.173079 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:30.173079 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:30.173079 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:30.173079 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:30.173079 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:30.173079 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:30.173079 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:30.173079 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:30.173079 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:30.173079 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:30.173948 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:30.173948 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:30.173948 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:30.173948 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:30.173948 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:49:30.173948 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:49:30.173948 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:49:30.173948 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:49:30.173948 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:49:30.173948 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:49:30.173948 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 30 20:49:30.173948 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:30.173948 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 487/963] 10.222.0.23 () {56 vars in 1120 bytes} [Sat Apr 30 20:49:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:30.190897 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1e405-1dea-4b31-858f-71161001e114 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:30.302619 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1e405-1dea-4b31-858f-71161001e114 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:30.336946 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d99912-f1a4-4164-8729-33c438ae1442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:30.337622 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d99912-f1a4-4164-8729-33c438ae1442 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:30.337935 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d99912-f1a4-4164-8729-33c438ae1442 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:30.338215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d99912-f1a4-4164-8729-33c438ae1442 None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:30.338958 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d99912-f1a4-4164-8729-33c438ae1442 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:30.339263 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d99912-f1a4-4164-8729-33c438ae1442 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:30.341175 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d99912-f1a4-4164-8729-33c438ae1442 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:30.350351 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 477/964] 10.222.0.23 () {56 vars in 1115 bytes} [Sat Apr 30 20:49:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:30.355581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c197cfd-1136-4f64-8802-e7a6f7bcbc68 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:30.459506 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c197cfd-1136-4f64-8802-e7a6f7bcbc68 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:30.494522 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1eb04-b04f-4a46-bd4b-3d2d8f2075ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:30.495338 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1eb04-b04f-4a46-bd4b-3d2d8f2075ec None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:30.495622 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1eb04-b04f-4a46-bd4b-3d2d8f2075ec None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:30.495897 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1eb04-b04f-4a46-bd4b-3d2d8f2075ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:30.508372 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf1eb04-b04f-4a46-bd4b-3d2d8f2075ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:30.509890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf1eb04-b04f-4a46-bd4b-3d2d8f2075ec None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:30.529286 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-bdf1eb04-b04f-4a46-bd4b-3d2d8f2075ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:30.529286 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:30.529286 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:30.529286 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:30.529286 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:30.529286 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:30.529286 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:30.529286 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:30.529286 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:30.529286 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:30.529286 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:30.529286 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:30.529286 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:49:30.529286 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:49:30.529286 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:49:30.530305 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:49:30.530305 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:30.530305 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:30.530305 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:30.530305 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:30.530305 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:30.530305 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:30.530305 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:30.530305 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:30.530305 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:30.530305 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:30.530305 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:30.530305 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:30.530305 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:30.530305 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:30.530305 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:30.530305 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:30.531190 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:49:30.531190 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:49:30.531190 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:30.531190 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:30.531190 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 488/965] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:49:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:30.536575 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d99912-f1a4-4164-8729-33c438ae1442 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:30.637556 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d99912-f1a4-4164-8729-33c438ae1442 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:30.673425 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a03dd-97e6-4986-8b9d-730c0c8eac0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:30.674132 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a03dd-97e6-4986-8b9d-730c0c8eac0e None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:30.674412 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a03dd-97e6-4986-8b9d-730c0c8eac0e None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:30.674684 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a03dd-97e6-4986-8b9d-730c0c8eac0e None admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:30.675407 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a03dd-97e6-4986-8b9d-730c0c8eac0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:30.675711 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a03dd-97e6-4986-8b9d-730c0c8eac0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:30.677081 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a03dd-97e6-4986-8b9d-730c0c8eac0e None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:30.689635 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 478/966] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:30.695022 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1eb04-b04f-4a46-bd4b-3d2d8f2075ec None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:30.705909 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ccf74-f564-4f30-a08c-630d1c7a1e30 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:30.706487 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ccf74-f564-4f30-a08c-630d1c7a1e30 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:30.706969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ccf74-f564-4f30-a08c-630d1c7a1e30 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:30.708772 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 479/967] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:49:30.714102 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c0f8d-d89a-4ab8-99ee-056c4203011b None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:30.714607 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c0f8d-d89a-4ab8-99ee-056c4203011b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:30.715100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c0f8d-d89a-4ab8-99ee-056c4203011b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:30.735790 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-cd8c0f8d-d89a-4ab8-99ee-056c4203011b None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:30.736982 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-cd8c0f8d-d89a-4ab8-99ee-056c4203011b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:30.811471 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 480/968] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 30 20:49:30.820002 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1eb04-b04f-4a46-bd4b-3d2d8f2075ec None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:30.837043 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c0f8d-d89a-4ab8-99ee-056c4203011b None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:30.860206 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ac798-b5ed-4cdd-aa10-881b6d9615a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:30.861803 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ac798-b5ed-4cdd-aa10-881b6d9615a1 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:30.862094 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ac798-b5ed-4cdd-aa10-881b6d9615a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:30.862371 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ac798-b5ed-4cdd-aa10-881b6d9615a1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:30.874447 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52ac798-b5ed-4cdd-aa10-881b6d9615a1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:30.876084 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52ac798-b5ed-4cdd-aa10-881b6d9615a1 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:30.897179 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-f52ac798-b5ed-4cdd-aa10-881b6d9615a1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 30 20:49:30.897179 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:30.897179 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:30.897179 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:30.897179 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:30.897179 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:30.897179 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:30.897179 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:30.897179 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:30.897179 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:30.897179 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:30.897179 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:30.897179 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:49:30.897179 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:49:30.897179 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:49:30.897179 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:49:30.898237 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:30.898237 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:30.898237 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:49:30.898237 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:49:30.898237 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:49:30.898237 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:49:30.898237 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:30.898237 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:30.898237 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:30.898237 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:30.898237 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:30.898237 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:30.898237 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:30.898237 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:30.898237 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:30.898237 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:30.898237 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:30.898237 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:30.899192 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:30.899192 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:30.899192 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:49:30.899192 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:49:30.899192 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:49:30.899192 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:49:30.899192 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:49:30.899192 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:49:30.899192 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 30 20:49:30.899192 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:30.899192 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 489/969] 10.222.0.23 () {56 vars in 1117 bytes} [Sat Apr 30 20:49:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:30.904725 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ac798-b5ed-4cdd-aa10-881b6d9615a1 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:30.965003 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c0f8d-d89a-4ab8-99ee-056c4203011b None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:31.003430 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ac798-b5ed-4cdd-aa10-881b6d9615a1 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:31.008751 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ea10f-4a0d-4b53-acf9-3595c258b391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:31.009437 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ea10f-4a0d-4b53-acf9-3595c258b391 None admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:31.009719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ea10f-4a0d-4b53-acf9-3595c258b391 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:31.010025 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ea10f-4a0d-4b53-acf9-3595c258b391 None admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:31.010729 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8ea10f-4a0d-4b53-acf9-3595c258b391 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:31.012185 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8ea10f-4a0d-4b53-acf9-3595c258b391 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:31.014117 ncdv-master-1 devstack@keystone.service[91017]: WARNING keystone.server.flask.common [None req-6d8ea10f-4a0d-4b53-acf9-3595c258b391 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Apr 30 20:49:31.040805 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a04e5-6b7b-4439-b009-8cbcfcea5bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:31.041587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a04e5-6b7b-4439-b009-8cbcfcea5bbd None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:31.041900 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a04e5-6b7b-4439-b009-8cbcfcea5bbd None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:31.042177 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a04e5-6b7b-4439-b009-8cbcfcea5bbd None admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:31.043007 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a04e5-6b7b-4439-b009-8cbcfcea5bbd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:31.043314 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a04e5-6b7b-4439-b009-8cbcfcea5bbd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:31.044783 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a04e5-6b7b-4439-b009-8cbcfcea5bbd None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:31.060561 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.sql.core [None req-6d8ea10f-4a0d-4b53-acf9-3595c258b391 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Apr 30 20:49:31.060561 ncdv-master-1 devstack@keystone.service[91017]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Apr 30 20:49:31.060561 ncdv-master-1 devstack@keystone.service[91017]: [parameters: {'user_id': 'cd6f5d293c7940bba456b533b7579e3c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Apr 30 20:49:31.060561 ncdv-master-1 devstack@keystone.service[91017]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91017) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 30 20:49:31.063341 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 490/970] 10.222.0.23 () {56 vars in 1149 bytes} [Sat Apr 30 20:49:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:31.064621 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b6eb5-d0a7-4f00-9dbc-d75691f527c7 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:31.064914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b6eb5-d0a7-4f00-9dbc-d75691f527c7 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:31.065192 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b6eb5-d0a7-4f00-9dbc-d75691f527c7 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:31.069804 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 491/971] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:49:31.069938 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-6d8ea10f-4a0d-4b53-acf9-3595c258b391 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Apr 30 20:49:31.069938 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:31.069938 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Apr 30 20:49:31.069938 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self.dialect.do_execute( Apr 30 20:49:31.069938 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Apr 30 20:49:31.069938 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Apr 30 20:49:31.069938 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Apr 30 20:49:31.069938 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application result = self._query(query) Apr 30 20:49:31.069938 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Apr 30 20:49:31.069938 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application conn.query(q) Apr 30 20:49:31.069938 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Apr 30 20:49:31.069938 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Apr 30 20:49:31.069938 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Apr 30 20:49:31.069938 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application result.read() Apr 30 20:49:31.069938 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Apr 30 20:49:31.070832 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Apr 30 20:49:31.070832 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Apr 30 20:49:31.070832 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application packet.raise_for_error() Apr 30 20:49:31.070832 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Apr 30 20:49:31.070832 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Apr 30 20:49:31.070832 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Apr 30 20:49:31.070832 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Apr 30 20:49:31.070832 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Apr 30 20:49:31.070832 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:31.070832 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Apr 30 20:49:31.070832 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:31.070832 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:31.070832 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Apr 30 20:49:31.070832 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return method(*args, **kwargs) Apr 30 20:49:31.070832 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Apr 30 20:49:31.070832 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Apr 30 20:49:31.070832 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Apr 30 20:49:31.070832 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application next(self.gen) Apr 30 20:49:31.071843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Apr 30 20:49:31.071843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application yield resource Apr 30 20:49:31.071843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Apr 30 20:49:31.071843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application next(self.gen) Apr 30 20:49:31.071843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Apr 30 20:49:31.071843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self.session.rollback() Apr 30 20:49:31.071843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Apr 30 20:49:31.071843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self.force_reraise() Apr 30 20:49:31.071843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Apr 30 20:49:31.071843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise self.value Apr 30 20:49:31.071843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Apr 30 20:49:31.071843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Apr 30 20:49:31.071843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Apr 30 20:49:31.071843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application session.commit() Apr 30 20:49:31.071843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1431, in commit Apr 30 20:49:31.071843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Apr 30 20:49:31.071843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Apr 30 20:49:31.072757 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._prepare_impl() Apr 30 20:49:31.072757 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Apr 30 20:49:31.072757 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self.session.flush() Apr 30 20:49:31.072757 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3363, in flush Apr 30 20:49:31.072757 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._flush(objects) Apr 30 20:49:31.072757 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3503, in _flush Apr 30 20:49:31.072757 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Apr 30 20:49:31.072757 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Apr 30 20:49:31.072757 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application compat.raise_( Apr 30 20:49:31.072757 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Apr 30 20:49:31.072757 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception Apr 30 20:49:31.072757 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3463, in _flush Apr 30 20:49:31.072757 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application flush_context.execute() Apr 30 20:49:31.072757 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Apr 30 20:49:31.072757 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rec.execute(self) Apr 30 20:49:31.072757 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Apr 30 20:49:31.072757 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Apr 30 20:49:31.073872 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Apr 30 20:49:31.073872 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application _emit_insert_statements( Apr 30 20:49:31.073872 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Apr 30 20:49:31.073872 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application result = connection._execute_20( Apr 30 20:49:31.073872 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Apr 30 20:49:31.073872 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Apr 30 20:49:31.073872 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Apr 30 20:49:31.073872 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Apr 30 20:49:31.073872 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Apr 30 20:49:31.073872 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ret = self._execute_context( Apr 30 20:49:31.073872 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Apr 30 20:49:31.073872 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Apr 30 20:49:31.073872 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Apr 30 20:49:31.073872 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Apr 30 20:49:31.073872 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Apr 30 20:49:31.073872 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception Apr 30 20:49:31.075793 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Apr 30 20:49:31.075793 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self.dialect.do_execute( Apr 30 20:49:31.075793 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Apr 30 20:49:31.075793 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Apr 30 20:49:31.075793 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Apr 30 20:49:31.075793 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application result = self._query(query) Apr 30 20:49:31.075793 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Apr 30 20:49:31.075793 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application conn.query(q) Apr 30 20:49:31.075793 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Apr 30 20:49:31.075793 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Apr 30 20:49:31.075793 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Apr 30 20:49:31.075793 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application result.read() Apr 30 20:49:31.075793 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Apr 30 20:49:31.075793 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Apr 30 20:49:31.075793 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Apr 30 20:49:31.075793 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application packet.raise_for_error() Apr 30 20:49:31.077453 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Apr 30 20:49:31.077453 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Apr 30 20:49:31.077453 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Apr 30 20:49:31.077453 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Apr 30 20:49:31.077453 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Apr 30 20:49:31.077453 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Apr 30 20:49:31.077453 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [parameters: {'user_id': 'cd6f5d293c7940bba456b533b7579e3c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Apr 30 20:49:31.077453 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Apr 30 20:49:31.077453 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:31.077453 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:49:31.077453 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:31.077453 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:31.077453 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:31.077453 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:31.077453 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:31.088736 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:31.088736 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:31.088736 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:31.088736 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:31.088736 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:31.088736 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:31.088736 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:31.088736 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Apr 30 20:49:31.088736 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Apr 30 20:49:31.088736 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:31.088736 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:31.088736 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:49:31.088736 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:49:31.088736 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:49:31.088736 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:49:31.088736 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Apr 30 20:49:31.088736 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Apr 30 20:49:31.089672 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Apr 30 20:49:31.089672 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Apr 30 20:49:31.089672 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Apr 30 20:49:31.089672 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Apr 30 20:49:31.089672 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Apr 30 20:49:31.089672 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:31.090157 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b6eb5-d0a7-4f00-9dbc-d75691f527c7 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:31.090263 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 481/972] 10.222.0.23 () {60 vars in 1131 bytes} [Sat Apr 30 20:49:30 2022] POST /identity/v3/users => generated 160 bytes in 233 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:31.090263 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ea10f-4a0d-4b53-acf9-3595c258b391 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:31.171391 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b6eb5-d0a7-4f00-9dbc-d75691f527c7 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:31.181365 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ea10f-4a0d-4b53-acf9-3595c258b391 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:31.209271 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb677d8-5109-4317-9095-caa2d0b60715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:31.210030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb677d8-5109-4317-9095-caa2d0b60715 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:31.210316 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb677d8-5109-4317-9095-caa2d0b60715 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:31.210591 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb677d8-5109-4317-9095-caa2d0b60715 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:31.218280 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14b618-5512-410a-8ff2-7e9fa8d7f248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:31.219257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14b618-5512-410a-8ff2-7e9fa8d7f248 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:31.219257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14b618-5512-410a-8ff2-7e9fa8d7f248 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:31.219553 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14b618-5512-410a-8ff2-7e9fa8d7f248 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:31.227543 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b14b618-5512-410a-8ff2-7e9fa8d7f248 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:31.229161 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b14b618-5512-410a-8ff2-7e9fa8d7f248 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:31.246228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-8b14b618-5512-410a-8ff2-7e9fa8d7f248 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 30 20:49:31.246228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:31.246228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:31.246228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:31.246228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:31.246228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:31.246228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:31.246228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:31.246228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:31.246228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:31.246228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:31.246228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:31.246228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:49:31.246228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:49:31.246228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:49:31.246228 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:49:31.247765 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:31.247765 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:31.247765 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:49:31.247765 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:49:31.247765 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:49:31.247765 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:49:31.247765 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:31.247765 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:31.247765 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:31.247765 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:31.247765 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:31.247765 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:31.247765 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:31.247765 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:31.247765 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:31.247765 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:31.247765 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:31.247765 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:31.248749 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:31.248749 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:31.248749 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:49:31.248749 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:49:31.248749 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:49:31.248749 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:49:31.248749 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:49:31.248749 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:49:31.248749 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Apr 30 20:49:31.248749 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:31.252748 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 482/973] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:49:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:31.254185 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f03099-8907-4dc0-aca9-898fd8544c62 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:31.254480 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f03099-8907-4dc0-aca9-898fd8544c62 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:31.254745 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f03099-8907-4dc0-aca9-898fd8544c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:31.272320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-64f03099-8907-4dc0-aca9-898fd8544c62 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:31.273877 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-64f03099-8907-4dc0-aca9-898fd8544c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:31.282177 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb677d8-5109-4317-9095-caa2d0b60715 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:31.283538 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb677d8-5109-4317-9095-caa2d0b60715 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:31.350533 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 483/974] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:49:31.351862 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f03099-8907-4dc0-aca9-898fd8544c62 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:31.402017 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 492/975] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:49:31 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 30 20:49:31.403348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb677d8-5109-4317-9095-caa2d0b60715 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:31.471556 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f03099-8907-4dc0-aca9-898fd8544c62 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:31.502574 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb677d8-5109-4317-9095-caa2d0b60715 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:31.511527 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45258d6c-f233-4b0d-a4db-4aa1972811d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:31.512201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45258d6c-f233-4b0d-a4db-4aa1972811d1 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:31.512509 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45258d6c-f233-4b0d-a4db-4aa1972811d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:31.512784 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45258d6c-f233-4b0d-a4db-4aa1972811d1 None admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:31.513580 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45258d6c-f233-4b0d-a4db-4aa1972811d1 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:31.513915 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45258d6c-f233-4b0d-a4db-4aa1972811d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:31.515365 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45258d6c-f233-4b0d-a4db-4aa1972811d1 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:31.536084 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0a380-ba79-4b05-bf3a-b8bab0dbf865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:31.536881 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0a380-ba79-4b05-bf3a-b8bab0dbf865 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:31.537159 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0a380-ba79-4b05-bf3a-b8bab0dbf865 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:31.537453 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0a380-ba79-4b05-bf3a-b8bab0dbf865 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:31.538161 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a0a380-ba79-4b05-bf3a-b8bab0dbf865 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:31.540322 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a0a380-ba79-4b05-bf3a-b8bab0dbf865 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:31.559977 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 484/976] 10.222.0.23 () {56 vars in 1101 bytes} [Sat Apr 30 20:49:31 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:31.560206 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-f7a0a380-ba79-4b05-bf3a-b8bab0dbf865 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 30 20:49:31.560206 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:31.560206 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:49:31.560206 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:49:31.560206 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:49:31.560206 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:49:31.560206 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:49:31.560206 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:49:31.560206 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 30 20:49:31.560206 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:31.560206 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:49:31.560206 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:31.560206 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:31.560206 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:31.560206 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:31.560206 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:31.560206 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:31.561420 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:31.561420 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:31.561420 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:31.561420 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:31.561420 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:31.561420 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:31.561420 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:49:31.561420 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:49:31.561420 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:49:31.561420 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:49:31.561420 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:31.561420 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:31.561420 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:31.561420 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:31.561420 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:31.561420 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:31.562429 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:31.562429 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:31.562429 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:31.562429 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:31.562429 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:31.562429 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:31.562429 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:31.562429 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:31.562429 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:31.562429 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:31.562429 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:49:31.562429 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:49:31.562429 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 30 20:49:31.562429 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:31.563180 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45258d6c-f233-4b0d-a4db-4aa1972811d1 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:31.563253 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 493/977] 10.222.0.23 () {56 vars in 1126 bytes} [Sat Apr 30 20:49:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:31.563253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0c90f-9411-4c93-838d-b0dd1dccb728 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:31.563253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0c90f-9411-4c93-838d-b0dd1dccb728 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:31.563253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0c90f-9411-4c93-838d-b0dd1dccb728 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:31.563253 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 494/978] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:49:31.563253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0c90f-9411-4c93-838d-b0dd1dccb728 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:31.674559 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45258d6c-f233-4b0d-a4db-4aa1972811d1 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:31.687965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0c90f-9411-4c93-838d-b0dd1dccb728 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:31.718539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1836fc-7740-413f-832c-163cc30e9ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:31.719621 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1836fc-7740-413f-832c-163cc30e9ba5 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:31.720166 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1836fc-7740-413f-832c-163cc30e9ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:31.720440 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1836fc-7740-413f-832c-163cc30e9ba5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:31.723278 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfe66d-f3f5-488e-b1a6-569d610f08f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:31.723968 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfe66d-f3f5-488e-b1a6-569d610f08f3 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:31.724319 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfe66d-f3f5-488e-b1a6-569d610f08f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:31.724666 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfe66d-f3f5-488e-b1a6-569d610f08f3 None admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:31.725452 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcfe66d-f3f5-488e-b1a6-569d610f08f3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:31.725863 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcfe66d-f3f5-488e-b1a6-569d610f08f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:31.727335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcfe66d-f3f5-488e-b1a6-569d610f08f3 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:31.737481 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 495/979] 10.222.0.23 () {56 vars in 1122 bytes} [Sat Apr 30 20:49:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:31.737727 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1836fc-7740-413f-832c-163cc30e9ba5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:31.737849 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d624b9a-1f32-4f3b-8916-54b352226f05 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:31.737849 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d624b9a-1f32-4f3b-8916-54b352226f05 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:31.738031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1836fc-7740-413f-832c-163cc30e9ba5 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:31.738105 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d624b9a-1f32-4f3b-8916-54b352226f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:31.754527 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-4d624b9a-1f32-4f3b-8916-54b352226f05 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:31.755722 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4d624b9a-1f32-4f3b-8916-54b352226f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:31.756601 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-5d1836fc-7740-413f-832c-163cc30e9ba5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:31.756601 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:31.756601 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:31.756601 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:31.756601 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:31.756601 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:31.756601 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:31.756601 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:31.756601 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:31.756601 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:31.756601 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:31.756601 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:31.756601 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:49:31.756601 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:49:31.756601 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:49:31.757592 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:49:31.757592 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:31.757592 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:31.757592 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:31.757592 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:31.757592 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:31.757592 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:31.757592 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:31.757592 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:31.757592 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:31.757592 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:31.757592 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:31.757592 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:31.757592 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:31.757592 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:31.757592 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:31.757592 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:31.758637 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:49:31.758637 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:49:31.758637 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:31.758637 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:31.758637 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 485/980] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:49:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:31.758637 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1836fc-7740-413f-832c-163cc30e9ba5 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:31.833858 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 496/981] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:49:31.835771 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d624b9a-1f32-4f3b-8916-54b352226f05 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:31.864802 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1836fc-7740-413f-832c-163cc30e9ba5 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:31.897378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5658573-dcbc-4b3c-a7ea-91e5ffea4d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:31.898064 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5658573-dcbc-4b3c-a7ea-91e5ffea4d37 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:31.898347 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5658573-dcbc-4b3c-a7ea-91e5ffea4d37 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:31.898635 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5658573-dcbc-4b3c-a7ea-91e5ffea4d37 None admin] PATH_INFO: `/v3/services` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:31.899321 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5658573-dcbc-4b3c-a7ea-91e5ffea4d37 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:31.899626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5658573-dcbc-4b3c-a7ea-91e5ffea4d37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:31.900997 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5658573-dcbc-4b3c-a7ea-91e5ffea4d37 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:31.906421 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 486/982] 10.222.0.23 () {56 vars in 1122 bytes} [Sat Apr 30 20:49:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:31.907011 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5658573-dcbc-4b3c-a7ea-91e5ffea4d37 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:31.929622 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d624b9a-1f32-4f3b-8916-54b352226f05 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:31.960792 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f7bddf-d9aa-4b57-b2e3-e17379200e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:31.961439 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7bddf-d9aa-4b57-b2e3-e17379200e7f None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:31.961719 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7bddf-d9aa-4b57-b2e3-e17379200e7f None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:31.962033 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7bddf-d9aa-4b57-b2e3-e17379200e7f None admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:31.962738 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f7bddf-d9aa-4b57-b2e3-e17379200e7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:31.963040 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f7bddf-d9aa-4b57-b2e3-e17379200e7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:31.964396 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f7bddf-d9aa-4b57-b2e3-e17379200e7f None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:31.975846 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 497/983] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:49:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:31.976524 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f7bddf-d9aa-4b57-b2e3-e17379200e7f None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:32.006217 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5658573-dcbc-4b3c-a7ea-91e5ffea4d37 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:32.038339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d4e38-8413-4b0c-897a-fa87a30cb05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:32.038992 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d4e38-8413-4b0c-897a-fa87a30cb05d None admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:32.039274 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d4e38-8413-4b0c-897a-fa87a30cb05d None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:32.039550 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d4e38-8413-4b0c-897a-fa87a30cb05d None admin] PATH_INFO: `/v3/services` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:32.040255 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006d4e38-8413-4b0c-897a-fa87a30cb05d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:32.041623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006d4e38-8413-4b0c-897a-fa87a30cb05d None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:32.068800 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f7bddf-d9aa-4b57-b2e3-e17379200e7f None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:32.100746 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac15cf-e319-40b6-b567-7e0dd9c3303b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:32.101529 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac15cf-e319-40b6-b567-7e0dd9c3303b None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:32.101829 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac15cf-e319-40b6-b567-7e0dd9c3303b None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:32.102101 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac15cf-e319-40b6-b567-7e0dd9c3303b None admin] PATH_INFO: `/v3/endpoints` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:32.102879 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac15cf-e319-40b6-b567-7e0dd9c3303b None admin] RBAC: Adding query filter params (interface=admin, service_id=0d5bde65582944c082b504bde87dee18, region_id=RegionOne) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:32.103186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac15cf-e319-40b6-b567-7e0dd9c3303b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:32.104592 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac15cf-e319-40b6-b567-7e0dd9c3303b None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:32.109962 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 498/984] 10.222.0.23 () {56 vars in 1249 bytes} [Sat Apr 30 20:49:31 2022] GET /identity/v3/endpoints?service_id=0d5bde65582944c082b504bde87dee18&interface=admin®ion_id=RegionOne => generated 193 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:32.110714 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac15cf-e319-40b6-b567-7e0dd9c3303b None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:32.121836 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 487/985] 10.222.0.23 () {60 vars in 1141 bytes} [Sat Apr 30 20:49:31 2022] POST /identity/v3/services => generated 242 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:49:32.122835 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d4e38-8413-4b0c-897a-fa87a30cb05d None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:32.224193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac15cf-e319-40b6-b567-7e0dd9c3303b None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:32.242413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d4e38-8413-4b0c-897a-fa87a30cb05d None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:32.259698 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47723072-0ea1-4a20-941f-721a4bfd0ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:32.260523 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47723072-0ea1-4a20-941f-721a4bfd0ede None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:32.260811 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47723072-0ea1-4a20-941f-721a4bfd0ede None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:32.261090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47723072-0ea1-4a20-941f-721a4bfd0ede None admin] PATH_INFO: `/v3/projects/service` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:32.269896 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47723072-0ea1-4a20-941f-721a4bfd0ede None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:32.271646 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47723072-0ea1-4a20-941f-721a4bfd0ede None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:32.281593 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e98cc1-0c73-4dd4-9190-a30acdcdbc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:32.282403 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e98cc1-0c73-4dd4-9190-a30acdcdbc8b None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:32.282816 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e98cc1-0c73-4dd4-9190-a30acdcdbc8b None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:32.283107 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e98cc1-0c73-4dd4-9190-a30acdcdbc8b None admin] PATH_INFO: `/v3/services` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:32.283800 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e98cc1-0c73-4dd4-9190-a30acdcdbc8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:32.285206 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e98cc1-0c73-4dd4-9190-a30acdcdbc8b None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:32.288509 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-47723072-0ea1-4a20-941f-721a4bfd0ede None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:49:32.288509 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:32.288509 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:32.288509 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:32.288509 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:32.288509 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:32.288509 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:32.288509 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:32.288509 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:32.288509 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:32.288509 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:32.288509 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:32.288509 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:49:32.288509 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:49:32.288509 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:49:32.289388 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:49:32.289388 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:32.289388 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:32.289388 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:32.289388 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:32.289388 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:32.289388 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:32.289388 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:32.289388 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:32.289388 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:32.289388 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:32.289388 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:32.289388 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:32.289388 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:32.289388 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:32.289388 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:32.289388 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:32.296069 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:49:32.296069 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:49:32.296069 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:49:32.296069 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:49:32.296069 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:49:32.296069 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:49:32.296069 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:49:32.296069 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:32.296069 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 499/986] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:49:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:32.299170 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 488/987] 10.222.0.23 () {56 vars in 1087 bytes} [Sat Apr 30 20:49:32 2022] GET /identity/v3/services => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 20:49:32.302926 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47723072-0ea1-4a20-941f-721a4bfd0ede None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:32.413957 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47723072-0ea1-4a20-941f-721a4bfd0ede None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:32.450995 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6beff-8fbd-486a-8f7b-1aeae0c9028e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:32.451670 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6beff-8fbd-486a-8f7b-1aeae0c9028e None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:32.451950 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6beff-8fbd-486a-8f7b-1aeae0c9028e None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:32.452335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6beff-8fbd-486a-8f7b-1aeae0c9028e None admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:32.453276 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd6beff-8fbd-486a-8f7b-1aeae0c9028e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:32.453502 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd6beff-8fbd-486a-8f7b-1aeae0c9028e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:32.454992 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd6beff-8fbd-486a-8f7b-1aeae0c9028e None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:32.467656 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 500/988] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Apr 30 20:49:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:32.473688 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e98cc1-0c73-4dd4-9190-a30acdcdbc8b None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:32.577057 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e98cc1-0c73-4dd4-9190-a30acdcdbc8b None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:32.610829 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e333ef-7ead-4a86-b6af-821d1a5a341d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:32.611487 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e333ef-7ead-4a86-b6af-821d1a5a341d None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:32.611770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e333ef-7ead-4a86-b6af-821d1a5a341d None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:32.612048 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e333ef-7ead-4a86-b6af-821d1a5a341d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:32.612872 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e333ef-7ead-4a86-b6af-821d1a5a341d None admin] RBAC: Adding query filter params (role.id=058cab574a7548388406f3e3d6bb5779, scope.project.id=6b52e5e13b9144dfb663578766c2bac0, user.id=2e3511017b8e4b4f9805a65c3ac173f9) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:32.613184 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e333ef-7ead-4a86-b6af-821d1a5a341d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:32.614650 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e333ef-7ead-4a86-b6af-821d1a5a341d None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:32.620603 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 489/989] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:49:32 2022] GET /identity/v3/role_assignments?user.id=2e3511017b8e4b4f9805a65c3ac173f9&scope.project.id=6b52e5e13b9144dfb663578766c2bac0&role.id=058cab574a7548388406f3e3d6bb5779 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:49:34.493676 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33577c91-4244-4e05-9e5b-9d26063a080c None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:34.494254 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33577c91-4244-4e05-9e5b-9d26063a080c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:34.494254 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33577c91-4244-4e05-9e5b-9d26063a080c None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:34.495665 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 501/990] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:49:34.500884 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7b30d-9042-4c49-86f1-60fe64ca56ab None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:34.501333 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7b30d-9042-4c49-86f1-60fe64ca56ab None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:34.501486 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7b30d-9042-4c49-86f1-60fe64ca56ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:34.518665 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-f0d7b30d-9042-4c49-86f1-60fe64ca56ab None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:34.519849 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f0d7b30d-9042-4c49-86f1-60fe64ca56ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:34.589890 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 490/991] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:49:34.612450 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33577c91-4244-4e05-9e5b-9d26063a080c None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:34.626049 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ec97c-256f-431f-a8ae-33de24bb7001 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:34.626414 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ec97c-256f-431f-a8ae-33de24bb7001 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:34.626663 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ec97c-256f-431f-a8ae-33de24bb7001 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:34.628226 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 491/992] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:49:34.633015 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62d227-2f09-41ea-826e-6943ff2e249d None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:34.633307 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62d227-2f09-41ea-826e-6943ff2e249d None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:34.633587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62d227-2f09-41ea-826e-6943ff2e249d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:34.650258 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-6e62d227-2f09-41ea-826e-6943ff2e249d None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:34.651430 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6e62d227-2f09-41ea-826e-6943ff2e249d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:34.716802 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33577c91-4244-4e05-9e5b-9d26063a080c None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:34.723481 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 492/993] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 30 20:49:34.747449 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62d227-2f09-41ea-826e-6943ff2e249d None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:34.748890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc26505-13ff-43d4-bd3a-083c538418ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:34.749685 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc26505-13ff-43d4-bd3a-083c538418ae None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:34.750062 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc26505-13ff-43d4-bd3a-083c538418ae None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:34.750342 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc26505-13ff-43d4-bd3a-083c538418ae None admin] PATH_INFO: `/v3/services/compute` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:34.750992 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc26505-13ff-43d4-bd3a-083c538418ae None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:34.752360 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc26505-13ff-43d4-bd3a-083c538418ae None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:34.764778 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-5dc26505-13ff-43d4-bd3a-083c538418ae None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 30 20:49:34.764778 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:34.764778 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:49:34.764778 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:49:34.764778 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:49:34.764778 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:49:34.764778 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:49:34.764778 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:49:34.764778 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Apr 30 20:49:34.764778 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:34.764778 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:49:34.764778 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:34.764778 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:34.764778 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:34.764778 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:34.764778 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:34.764778 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:34.765931 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:34.765931 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:34.765931 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:34.765931 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:34.765931 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:34.765931 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:34.765931 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:49:34.765931 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:49:34.765931 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:49:34.765931 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:49:34.765931 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:34.765931 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:34.765931 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:34.765931 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:34.765931 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:34.765931 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:34.766789 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:34.766789 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:34.766789 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:34.766789 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:34.766789 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:34.766789 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:34.766789 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:34.766789 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:34.766789 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:34.766789 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:34.766789 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:49:34.766789 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:49:34.766789 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Apr 30 20:49:34.766789 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:34.766789 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 502/994] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:49:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:34.772376 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc26505-13ff-43d4-bd3a-083c538418ae None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:34.855479 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62d227-2f09-41ea-826e-6943ff2e249d None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:34.870154 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc26505-13ff-43d4-bd3a-083c538418ae None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:34.889958 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c8e59-a45e-494c-89ed-5e6852ef8c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:34.890767 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c8e59-a45e-494c-89ed-5e6852ef8c5c None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:34.891044 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c8e59-a45e-494c-89ed-5e6852ef8c5c None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:34.891318 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c8e59-a45e-494c-89ed-5e6852ef8c5c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:34.891964 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809c8e59-a45e-494c-89ed-5e6852ef8c5c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:34.893340 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809c8e59-a45e-494c-89ed-5e6852ef8c5c None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:34.903170 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c5a40-0bdd-4cac-9def-8ad5a06b7b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:34.903827 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c5a40-0bdd-4cac-9def-8ad5a06b7b81 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:34.904106 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c5a40-0bdd-4cac-9def-8ad5a06b7b81 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:34.904537 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c5a40-0bdd-4cac-9def-8ad5a06b7b81 None admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:34.905042 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-809c8e59-a45e-494c-89ed-5e6852ef8c5c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 30 20:49:34.905042 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:34.905042 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:49:34.905042 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:49:34.905042 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:49:34.905042 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:49:34.905042 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:49:34.905042 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:49:34.905042 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 30 20:49:34.905042 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:34.905042 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:49:34.905042 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:34.905042 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:34.905042 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:34.905042 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:34.905042 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:34.905042 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:34.906012 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:34.906012 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:34.906012 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:34.906012 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:34.906012 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:34.906012 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:34.906012 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:49:34.906012 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:49:34.906012 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:49:34.906012 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:49:34.906012 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:34.906012 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:34.906012 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:34.906012 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:34.906012 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:34.906012 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:34.913539 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:34.913539 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:34.913539 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:34.913539 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:34.913539 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:34.913539 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:34.913539 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:34.913539 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:34.913539 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:34.913539 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:34.913539 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:49:34.913539 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:49:34.913539 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 30 20:49:34.913539 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:34.917974 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c5a40-0bdd-4cac-9def-8ad5a06b7b81 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:34.917974 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c5a40-0bdd-4cac-9def-8ad5a06b7b81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:34.918131 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 493/995] 10.222.0.23 () {56 vars in 1126 bytes} [Sat Apr 30 20:49:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:49:34.918214 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c5a40-0bdd-4cac-9def-8ad5a06b7b81 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:34.918214 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 503/996] 10.222.0.23 () {56 vars in 1112 bytes} [Sat Apr 30 20:49:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:49:34.918378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c8e59-a45e-494c-89ed-5e6852ef8c5c None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:34.919770 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c5a40-0bdd-4cac-9def-8ad5a06b7b81 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:35.017550 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c8e59-a45e-494c-89ed-5e6852ef8c5c None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:35.030935 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c5a40-0bdd-4cac-9def-8ad5a06b7b81 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:35.050314 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bcbe17-711b-4170-9a32-ec6bc9831f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:35.050968 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcbe17-711b-4170-9a32-ec6bc9831f83 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:35.051248 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcbe17-711b-4170-9a32-ec6bc9831f83 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:35.051521 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcbe17-711b-4170-9a32-ec6bc9831f83 None admin] PATH_INFO: `/v3/services` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:35.052213 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bcbe17-711b-4170-9a32-ec6bc9831f83 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:35.052514 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bcbe17-711b-4170-9a32-ec6bc9831f83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:35.053904 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bcbe17-711b-4170-9a32-ec6bc9831f83 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:35.058704 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 494/997] 10.222.0.23 () {56 vars in 1122 bytes} [Sat Apr 30 20:49:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:49:35.059698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c78a4-850f-4234-aadf-0d12baf86a09 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:35.059982 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c78a4-850f-4234-aadf-0d12baf86a09 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:35.060256 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c78a4-850f-4234-aadf-0d12baf86a09 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:35.061618 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 495/998] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:49:35.063935 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d3946-fc90-43cf-8ee6-6f518709ed2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:35.064099 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c78a4-850f-4234-aadf-0d12baf86a09 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:35.064598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d3946-fc90-43cf-8ee6-6f518709ed2f None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:35.064992 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d3946-fc90-43cf-8ee6-6f518709ed2f None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:35.065286 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d3946-fc90-43cf-8ee6-6f518709ed2f None admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:35.066011 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d3946-fc90-43cf-8ee6-6f518709ed2f None admin] RBAC: Adding query filter params (type=compute) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:35.066321 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d3946-fc90-43cf-8ee6-6f518709ed2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:35.067727 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d3946-fc90-43cf-8ee6-6f518709ed2f None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:35.072715 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 504/999] 10.222.0.23 () {56 vars in 1112 bytes} [Sat Apr 30 20:49:34 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:49:35.073789 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdedc46b-260a-49cb-bbe5-75fabe72aecf None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:35.074082 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdedc46b-260a-49cb-bbe5-75fabe72aecf None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:35.074357 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdedc46b-260a-49cb-bbe5-75fabe72aecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:35.090125 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-cdedc46b-260a-49cb-bbe5-75fabe72aecf None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:35.091832 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-cdedc46b-260a-49cb-bbe5-75fabe72aecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:35.154021 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 505/1000] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:35 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:49:35.154755 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdedc46b-260a-49cb-bbe5-75fabe72aecf None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:35.177785 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c78a4-850f-4234-aadf-0d12baf86a09 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:35.210275 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097acc1a-3649-4c56-95af-7fa4ccc9b814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:35.210940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097acc1a-3649-4c56-95af-7fa4ccc9b814 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:35.211229 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097acc1a-3649-4c56-95af-7fa4ccc9b814 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:35.211510 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097acc1a-3649-4c56-95af-7fa4ccc9b814 None admin] PATH_INFO: `/v3/services` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:35.212222 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097acc1a-3649-4c56-95af-7fa4ccc9b814 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:35.212531 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097acc1a-3649-4c56-95af-7fa4ccc9b814 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:35.213990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097acc1a-3649-4c56-95af-7fa4ccc9b814 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:35.219356 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 496/1001] 10.222.0.23 () {56 vars in 1122 bytes} [Sat Apr 30 20:49:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:49:35.220393 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097acc1a-3649-4c56-95af-7fa4ccc9b814 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:35.247723 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdedc46b-260a-49cb-bbe5-75fabe72aecf None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:35.283690 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899e0ac-b6e9-4627-9335-c1b7f2c01c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:35.284351 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899e0ac-b6e9-4627-9335-c1b7f2c01c9f None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:35.284632 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899e0ac-b6e9-4627-9335-c1b7f2c01c9f None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:35.284908 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899e0ac-b6e9-4627-9335-c1b7f2c01c9f None admin] PATH_INFO: `/v3/endpoints` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:35.285692 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899e0ac-b6e9-4627-9335-c1b7f2c01c9f None admin] RBAC: Adding query filter params (interface=public, service_id=0adebf5f4e3a4001aa1264c68ab6a37b, region_id=RegionOne) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:35.286033 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899e0ac-b6e9-4627-9335-c1b7f2c01c9f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:35.287402 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899e0ac-b6e9-4627-9335-c1b7f2c01c9f None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:35.292313 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 506/1002] 10.222.0.23 () {56 vars in 1251 bytes} [Sat Apr 30 20:49:35 2022] GET /identity/v3/endpoints?service_id=0adebf5f4e3a4001aa1264c68ab6a37b&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:35.293070 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899e0ac-b6e9-4627-9335-c1b7f2c01c9f None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:35.320668 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097acc1a-3649-4c56-95af-7fa4ccc9b814 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:35.354669 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd8775f-f1d7-4405-aa7f-560c7f6562f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:35.355478 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8775f-f1d7-4405-aa7f-560c7f6562f2 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:35.355758 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8775f-f1d7-4405-aa7f-560c7f6562f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:35.356038 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8775f-f1d7-4405-aa7f-560c7f6562f2 None admin] PATH_INFO: `/v3/services/image` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:35.356708 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd8775f-f1d7-4405-aa7f-560c7f6562f2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:35.358117 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd8775f-f1d7-4405-aa7f-560c7f6562f2 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:35.369915 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-3cd8775f-f1d7-4405-aa7f-560c7f6562f2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 30 20:49:35.369915 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:35.369915 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:49:35.369915 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:49:35.369915 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:49:35.369915 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:49:35.369915 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:49:35.369915 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:49:35.369915 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Apr 30 20:49:35.369915 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:35.369915 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:49:35.369915 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:35.369915 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:35.369915 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:35.369915 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:35.369915 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:35.369915 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:35.371145 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:35.371145 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:35.371145 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:35.371145 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:35.371145 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:35.371145 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:35.371145 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:49:35.371145 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:49:35.371145 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:49:35.371145 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:49:35.371145 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:35.371145 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:35.371145 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:35.371145 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:35.371145 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:35.371145 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:35.374227 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:35.374227 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:35.374227 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:35.374227 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:35.374227 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:35.374227 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:35.374227 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:35.374227 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:35.374227 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:35.374227 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:35.374227 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:49:35.374227 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:49:35.374227 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Apr 30 20:49:35.374227 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:35.374227 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 497/1003] 10.222.0.23 () {56 vars in 1105 bytes} [Sat Apr 30 20:49:35 2022] GET /identity/v3/services/image => generated 86 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:35.375449 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd8775f-f1d7-4405-aa7f-560c7f6562f2 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:35.398890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899e0ac-b6e9-4627-9335-c1b7f2c01c9f None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:35.432782 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740f0d6-9978-409c-bfbd-3fb2efd20079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:35.433355 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740f0d6-9978-409c-bfbd-3fb2efd20079 None admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:35.433639 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740f0d6-9978-409c-bfbd-3fb2efd20079 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:35.433939 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740f0d6-9978-409c-bfbd-3fb2efd20079 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:35.434717 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740f0d6-9978-409c-bfbd-3fb2efd20079 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:35.436090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740f0d6-9978-409c-bfbd-3fb2efd20079 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:35.471210 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd8775f-f1d7-4405-aa7f-560c7f6562f2 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:35.502414 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242fe51-1a7e-4b62-8d39-148dc8314a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:35.503081 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242fe51-1a7e-4b62-8d39-148dc8314a2d None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:35.503347 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242fe51-1a7e-4b62-8d39-148dc8314a2d None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:35.503617 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242fe51-1a7e-4b62-8d39-148dc8314a2d None admin] PATH_INFO: `/v3/services` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:35.504283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3242fe51-1a7e-4b62-8d39-148dc8314a2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:35.505630 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3242fe51-1a7e-4b62-8d39-148dc8314a2d None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:35.511616 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 498/1004] 10.222.0.23 () {56 vars in 1087 bytes} [Sat Apr 30 20:49:35 2022] GET /identity/v3/services => generated 1727 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 20:49:35.512882 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242fe51-1a7e-4b62-8d39-148dc8314a2d None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:35.530297 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 507/1005] 10.222.0.23 () {60 vars in 1144 bytes} [Sat Apr 30 20:49:35 2022] POST /identity/v3/endpoints => generated 325 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:49:35.632361 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242fe51-1a7e-4b62-8d39-148dc8314a2d None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:35.675978 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88cb83-b967-491f-8f57-fcfeb04589d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:35.676664 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88cb83-b967-491f-8f57-fcfeb04589d9 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:35.676943 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88cb83-b967-491f-8f57-fcfeb04589d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:35.677213 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88cb83-b967-491f-8f57-fcfeb04589d9 None admin] PATH_INFO: `/v3/services` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:35.677965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa88cb83-b967-491f-8f57-fcfeb04589d9 None admin] RBAC: Adding query filter params (name=image) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:35.678273 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa88cb83-b967-491f-8f57-fcfeb04589d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:35.679703 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa88cb83-b967-491f-8f57-fcfeb04589d9 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:35.686259 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 499/1006] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:49:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:35.695056 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740f0d6-9978-409c-bfbd-3fb2efd20079 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:35.799678 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740f0d6-9978-409c-bfbd-3fb2efd20079 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:35.832314 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986d88d-c2de-48e2-a4bd-89bd1c99d9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:35.832975 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986d88d-c2de-48e2-a4bd-89bd1c99d9c5 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:35.833256 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986d88d-c2de-48e2-a4bd-89bd1c99d9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:35.833532 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986d88d-c2de-48e2-a4bd-89bd1c99d9c5 None admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:35.834263 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986d88d-c2de-48e2-a4bd-89bd1c99d9c5 None admin] RBAC: Adding query filter params (type=image) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:35.834569 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986d88d-c2de-48e2-a4bd-89bd1c99d9c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:35.835933 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9986d88d-c2de-48e2-a4bd-89bd1c99d9c5 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:35.840543 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 508/1007] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:49:35 2022] GET /identity/v3/services?type=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:37.954097 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80737933-7836-40f3-aaab-e00b28426580 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:37.954705 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80737933-7836-40f3-aaab-e00b28426580 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:37.954705 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80737933-7836-40f3-aaab-e00b28426580 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:37.956370 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 500/1008] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:49:37.962210 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf27921-c28c-4667-8236-a2a862e301f0 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:37.962753 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf27921-c28c-4667-8236-a2a862e301f0 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:37.962753 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf27921-c28c-4667-8236-a2a862e301f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:37.981847 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-dcf27921-c28c-4667-8236-a2a862e301f0 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:37.983074 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-dcf27921-c28c-4667-8236-a2a862e301f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:38.003065 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52eb10f-c2f3-4533-9fcf-138846e65f2c None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:38.003392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52eb10f-c2f3-4533-9fcf-138846e65f2c None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:38.003627 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52eb10f-c2f3-4533-9fcf-138846e65f2c None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:38.005130 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 501/1009] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:49:38.009726 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d21b2-6786-4f97-b0b2-a99c0b709323 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:38.010055 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d21b2-6786-4f97-b0b2-a99c0b709323 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:38.010337 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d21b2-6786-4f97-b0b2-a99c0b709323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:38.026748 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-0d1d21b2-6786-4f97-b0b2-a99c0b709323 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:38.028955 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0d1d21b2-6786-4f97-b0b2-a99c0b709323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:38.054096 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 509/1010] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:37 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:49:38.077798 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf27921-c28c-4667-8236-a2a862e301f0 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:38.098291 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 502/1011] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:38 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 30 20:49:38.123072 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d21b2-6786-4f97-b0b2-a99c0b709323 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:38.175137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf27921-c28c-4667-8236-a2a862e301f0 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:38.207682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a897e-8c13-486a-a5d1-ed8fa7d15d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:38.208396 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a897e-8c13-486a-a5d1-ed8fa7d15d79 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:38.208681 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a897e-8c13-486a-a5d1-ed8fa7d15d79 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:38.208957 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a897e-8c13-486a-a5d1-ed8fa7d15d79 None admin] PATH_INFO: `/v3/services/compute` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:38.209593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723a897e-8c13-486a-a5d1-ed8fa7d15d79 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:38.210994 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723a897e-8c13-486a-a5d1-ed8fa7d15d79 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:38.217516 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d21b2-6786-4f97-b0b2-a99c0b709323 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:38.223067 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-723a897e-8c13-486a-a5d1-ed8fa7d15d79 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 30 20:49:38.223067 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:38.223067 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:49:38.223067 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:49:38.223067 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:49:38.223067 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:49:38.223067 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:49:38.223067 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:49:38.223067 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Apr 30 20:49:38.223067 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:38.223067 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:49:38.223067 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:38.223067 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:38.223067 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:38.223067 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:38.223067 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:38.223067 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:38.224289 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:38.224289 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:38.224289 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:38.224289 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:38.224289 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:38.224289 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:38.224289 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:49:38.224289 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:49:38.224289 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:49:38.224289 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:49:38.224289 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:38.224289 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:38.224289 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:38.224289 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:38.224289 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:38.224289 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:38.225243 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:38.225243 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:38.225243 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:38.225243 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:38.225243 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:38.225243 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:38.225243 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:38.225243 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:38.225243 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:38.225243 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:38.225243 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:49:38.225243 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:49:38.225243 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Apr 30 20:49:38.225243 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:38.229105 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 510/1012] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:49:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:49:38.230483 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3c279-7807-4ed6-8b4e-13ca3e7044ee None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:38.230769 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3c279-7807-4ed6-8b4e-13ca3e7044ee None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:38.231076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3c279-7807-4ed6-8b4e-13ca3e7044ee None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:38.232336 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 511/1013] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:49:38.233028 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3c279-7807-4ed6-8b4e-13ca3e7044ee None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:38.249919 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbc8f29-88a3-4e01-b4fc-38702f887029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:38.250707 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc8f29-88a3-4e01-b4fc-38702f887029 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:38.250982 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc8f29-88a3-4e01-b4fc-38702f887029 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:38.251256 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc8f29-88a3-4e01-b4fc-38702f887029 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:38.252404 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbc8f29-88a3-4e01-b4fc-38702f887029 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:38.253856 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbc8f29-88a3-4e01-b4fc-38702f887029 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:38.255567 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 503/1014] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:49:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:49:38.256556 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7e9c3-2700-4f74-b585-14a52d2ee3b9 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:38.256836 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7e9c3-2700-4f74-b585-14a52d2ee3b9 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:38.257117 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7e9c3-2700-4f74-b585-14a52d2ee3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:38.273054 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-02d7e9c3-2700-4f74-b585-14a52d2ee3b9 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:38.274257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-02d7e9c3-2700-4f74-b585-14a52d2ee3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:38.334970 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3c279-7807-4ed6-8b4e-13ca3e7044ee None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:38.337307 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 504/1015] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:38 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:49:38.338145 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7e9c3-2700-4f74-b585-14a52d2ee3b9 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:38.370893 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d27801-2ee9-4d04-9d7d-e17e77e69d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:38.371551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d27801-2ee9-4d04-9d7d-e17e77e69d12 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:38.371876 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d27801-2ee9-4d04-9d7d-e17e77e69d12 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:38.372150 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d27801-2ee9-4d04-9d7d-e17e77e69d12 None admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:38.372845 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d27801-2ee9-4d04-9d7d-e17e77e69d12 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:38.373147 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d27801-2ee9-4d04-9d7d-e17e77e69d12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:38.374535 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d27801-2ee9-4d04-9d7d-e17e77e69d12 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:38.379110 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 512/1016] 10.222.0.23 () {56 vars in 1112 bytes} [Sat Apr 30 20:49:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:38.379864 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d27801-2ee9-4d04-9d7d-e17e77e69d12 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:38.439213 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7e9c3-2700-4f74-b585-14a52d2ee3b9 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:38.472797 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ba56b-aa3b-4c55-80ac-e6e32bc74ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:38.472980 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d27801-2ee9-4d04-9d7d-e17e77e69d12 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:38.473393 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ba56b-aa3b-4c55-80ac-e6e32bc74ad8 None admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:38.473679 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ba56b-aa3b-4c55-80ac-e6e32bc74ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:38.473995 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ba56b-aa3b-4c55-80ac-e6e32bc74ad8 None admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:38.474701 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ba56b-aa3b-4c55-80ac-e6e32bc74ad8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:38.476133 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ba56b-aa3b-4c55-80ac-e6e32bc74ad8 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:38.503940 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96110f-ec58-4998-9200-a97781dea455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:38.504589 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96110f-ec58-4998-9200-a97781dea455 None admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:38.504870 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96110f-ec58-4998-9200-a97781dea455 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:38.506868 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96110f-ec58-4998-9200-a97781dea455 None admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:38.506868 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c96110f-ec58-4998-9200-a97781dea455 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:38.507222 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c96110f-ec58-4998-9200-a97781dea455 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:38.598376 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 505/1017] 10.222.0.23 () {60 vars in 1141 bytes} [Sat Apr 30 20:49:38 2022] POST /identity/v3/projects => generated 311 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:49:38.599201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ba56b-aa3b-4c55-80ac-e6e32bc74ad8 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:38.649794 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 513/1018] 10.222.0.23 () {60 vars in 1141 bytes} [Sat Apr 30 20:49:38 2022] POST /identity/v3/services => generated 242 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:49:38.711915 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ba56b-aa3b-4c55-80ac-e6e32bc74ad8 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:38.756727 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90a490-6b14-49f6-bc42-c8ca46076670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:38.757330 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90a490-6b14-49f6-bc42-c8ca46076670 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:38.757616 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90a490-6b14-49f6-bc42-c8ca46076670 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:38.757934 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90a490-6b14-49f6-bc42-c8ca46076670 None admin] PATH_INFO: `/v3/services` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:38.758662 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90a490-6b14-49f6-bc42-c8ca46076670 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:38.758969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90a490-6b14-49f6-bc42-c8ca46076670 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:38.760501 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90a490-6b14-49f6-bc42-c8ca46076670 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:38.772405 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 506/1019] 10.222.0.23 () {56 vars in 1112 bytes} [Sat Apr 30 20:49:38 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:38.773387 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96110f-ec58-4998-9200-a97781dea455 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:38.882717 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96110f-ec58-4998-9200-a97781dea455 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:38.915433 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035320e9-f591-490b-953e-beb28ebfab0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:38.916200 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035320e9-f591-490b-953e-beb28ebfab0b None admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:38.916478 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035320e9-f591-490b-953e-beb28ebfab0b None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:38.916749 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035320e9-f591-490b-953e-beb28ebfab0b None admin] PATH_INFO: `/v3/endpoints` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:38.917600 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035320e9-f591-490b-953e-beb28ebfab0b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:38.919594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035320e9-f591-490b-953e-beb28ebfab0b None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:39.021467 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 514/1020] 10.222.0.23 () {60 vars in 1144 bytes} [Sat Apr 30 20:49:38 2022] POST /identity/v3/endpoints => generated 334 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 20:49:40.982931 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f054af9-450f-459e-9462-41c0cc7372c3 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:40.983458 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f054af9-450f-459e-9462-41c0cc7372c3 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:40.983560 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f054af9-450f-459e-9462-41c0cc7372c3 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:40.985005 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 507/1021] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:49:40.989963 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d0705-05e4-4278-8138-1563e80e2102 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:40.990349 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d0705-05e4-4278-8138-1563e80e2102 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:40.990533 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d0705-05e4-4278-8138-1563e80e2102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:40.998311 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf55413-c688-4154-82d6-d6bb5d2078bb None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:40.998600 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf55413-c688-4154-82d6-d6bb5d2078bb None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:40.998878 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf55413-c688-4154-82d6-d6bb5d2078bb None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:41.000342 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 508/1022] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:49:41.005130 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7670b-7499-4906-95e9-2c52bad210bf None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:41.005424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7670b-7499-4906-95e9-2c52bad210bf None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:41.005708 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7670b-7499-4906-95e9-2c52bad210bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:41.007906 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-7d0d0705-05e4-4278-8138-1563e80e2102 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:41.009055 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7d0d0705-05e4-4278-8138-1563e80e2102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:41.022550 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-0bc7670b-7499-4906-95e9-2c52bad210bf None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:41.023739 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0bc7670b-7499-4906-95e9-2c52bad210bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:41.082991 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 515/1023] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:49:41.093440 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 509/1024] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 30 20:49:41.106792 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d0705-05e4-4278-8138-1563e80e2102 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:41.118917 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7670b-7499-4906-95e9-2c52bad210bf None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:41.203099 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d0705-05e4-4278-8138-1563e80e2102 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:41.218744 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7670b-7499-4906-95e9-2c52bad210bf None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:41.240350 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b9468-3587-45c4-adb5-5f36a0ac85b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:41.241079 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b9468-3587-45c4-adb5-5f36a0ac85b4 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:41.241360 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b9468-3587-45c4-adb5-5f36a0ac85b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:41.241635 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b9468-3587-45c4-adb5-5f36a0ac85b4 None admin] PATH_INFO: `/v3/services/image` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:41.242342 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b9468-3587-45c4-adb5-5f36a0ac85b4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:41.243773 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b9468-3587-45c4-adb5-5f36a0ac85b4 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:41.256593 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-4b4b9468-3587-45c4-adb5-5f36a0ac85b4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 30 20:49:41.256593 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:41.256593 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:49:41.256593 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:49:41.256593 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:49:41.256593 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:49:41.256593 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:49:41.256593 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:49:41.256593 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Apr 30 20:49:41.256593 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:41.256593 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:49:41.256593 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:41.256593 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:41.256593 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:41.256593 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:41.256593 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:41.256593 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:41.260770 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:41.260770 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:41.260770 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:41.260770 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:41.260770 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:41.260770 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:41.260770 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:49:41.260770 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:49:41.260770 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:49:41.260770 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:49:41.260770 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:41.260770 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:41.260770 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:41.260770 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:41.260770 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:41.260770 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:41.261628 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:41.261628 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:41.261628 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:41.261628 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:41.261628 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:41.261628 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:41.261628 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:41.261628 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:41.261628 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:41.261628 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:41.261628 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:49:41.261628 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:49:41.261628 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Apr 30 20:49:41.261628 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:41.262445 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5100bca-cc52-4532-92ca-1c0f35ace3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:41.262445 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5100bca-cc52-4532-92ca-1c0f35ace3ac None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:41.263394 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 516/1025] 10.222.0.23 () {56 vars in 1105 bytes} [Sat Apr 30 20:49:41 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:41.263562 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5100bca-cc52-4532-92ca-1c0f35ace3ac None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:41.263562 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5100bca-cc52-4532-92ca-1c0f35ace3ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:41.263562 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5100bca-cc52-4532-92ca-1c0f35ace3ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:41.263562 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5100bca-cc52-4532-92ca-1c0f35ace3ac None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:41.264282 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b9468-3587-45c4-adb5-5f36a0ac85b4 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:41.267795 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 510/1026] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:49:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:49:41.268570 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5100bca-cc52-4532-92ca-1c0f35ace3ac None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:41.363695 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b9468-3587-45c4-adb5-5f36a0ac85b4 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:41.367206 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5100bca-cc52-4532-92ca-1c0f35ace3ac None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:41.397020 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d79a5d-fe0f-4b10-b887-c659de6f52f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:41.397681 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d79a5d-fe0f-4b10-b887-c659de6f52f8 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:41.397990 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d79a5d-fe0f-4b10-b887-c659de6f52f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:41.398264 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d79a5d-fe0f-4b10-b887-c659de6f52f8 None admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:41.398965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d79a5d-fe0f-4b10-b887-c659de6f52f8 None admin] RBAC: Adding query filter params (name=image) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:41.399566 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d79a5d-fe0f-4b10-b887-c659de6f52f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:41.400633 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d79a5d-fe0f-4b10-b887-c659de6f52f8 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:41.404689 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fc2c4-129d-47d7-ab32-6780beae5f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:41.405801 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 517/1027] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:49:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:49:41.410189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fc2c4-129d-47d7-ab32-6780beae5f35 None admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:41.410310 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fc2c4-129d-47d7-ab32-6780beae5f35 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:41.410584 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fc2c4-129d-47d7-ab32-6780beae5f35 None admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:41.411030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d79a5d-fe0f-4b10-b887-c659de6f52f8 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:41.411302 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931fc2c4-129d-47d7-ab32-6780beae5f35 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:41.412754 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931fc2c4-129d-47d7-ab32-6780beae5f35 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:41.500294 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 511/1028] 10.222.0.23 () {60 vars in 1132 bytes} [Sat Apr 30 20:49:41 2022] POST /identity/v3/users => generated 285 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:49:41.501580 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1b493-ff1b-4884-9182-462c41eb3f9b None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:41.501910 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1b493-ff1b-4884-9182-462c41eb3f9b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:41.502189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1b493-ff1b-4884-9182-462c41eb3f9b None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:41.503628 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 512/1029] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:49:41.507877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d79a5d-fe0f-4b10-b887-c659de6f52f8 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:41.509065 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0317f-d1e9-48d4-98db-43663d04e068 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:41.509358 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0317f-d1e9-48d4-98db-43663d04e068 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:41.509644 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0317f-d1e9-48d4-98db-43663d04e068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:41.527498 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-d0e0317f-d1e9-48d4-98db-43663d04e068 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:41.529217 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d0e0317f-d1e9-48d4-98db-43663d04e068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:41.547401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea56e9e6-8d12-4296-81da-6c884c6817c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:41.548434 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56e9e6-8d12-4296-81da-6c884c6817c3 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:41.548890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56e9e6-8d12-4296-81da-6c884c6817c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:41.549168 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56e9e6-8d12-4296-81da-6c884c6817c3 None admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:41.549935 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea56e9e6-8d12-4296-81da-6c884c6817c3 None admin] RBAC: Adding query filter params (type=image) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:41.550298 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea56e9e6-8d12-4296-81da-6c884c6817c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:41.551712 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea56e9e6-8d12-4296-81da-6c884c6817c3 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:41.557260 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 518/1030] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:49:41 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:49:41.563431 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea56e9e6-8d12-4296-81da-6c884c6817c3 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:41.601870 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 513/1031] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 30 20:49:41.628017 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0317f-d1e9-48d4-98db-43663d04e068 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:41.670882 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea56e9e6-8d12-4296-81da-6c884c6817c3 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:41.707677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03215918-83a7-4e59-8f59-3f5ce9be670a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:41.708346 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03215918-83a7-4e59-8f59-3f5ce9be670a None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:41.708633 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03215918-83a7-4e59-8f59-3f5ce9be670a None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:41.708910 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03215918-83a7-4e59-8f59-3f5ce9be670a None admin] PATH_INFO: `/v3/endpoints` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:41.709697 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03215918-83a7-4e59-8f59-3f5ce9be670a None admin] RBAC: Adding query filter params (interface=public, service_id=2797ef3b45554fe8a0463b86245238ae, region_id=RegionOne) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:41.710188 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03215918-83a7-4e59-8f59-3f5ce9be670a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:41.711795 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03215918-83a7-4e59-8f59-3f5ce9be670a None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:41.718026 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 519/1032] 10.222.0.23 () {56 vars in 1251 bytes} [Sat Apr 30 20:49:41 2022] GET /identity/v3/endpoints?service_id=2797ef3b45554fe8a0463b86245238ae&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:49:41.724146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03215918-83a7-4e59-8f59-3f5ce9be670a None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:41.736021 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0317f-d1e9-48d4-98db-43663d04e068 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:41.766040 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6bf5d3-cb06-47ac-a3f8-2c6ce997c89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:41.766789 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bf5d3-cb06-47ac-a3f8-2c6ce997c89f None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:41.767078 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bf5d3-cb06-47ac-a3f8-2c6ce997c89f None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:41.767343 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bf5d3-cb06-47ac-a3f8-2c6ce997c89f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:41.778731 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6bf5d3-cb06-47ac-a3f8-2c6ce997c89f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:49:41.787147 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-fc6bf5d3-cb06-47ac-a3f8-2c6ce997c89f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 30 20:49:41.787147 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:41.787147 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:41.787147 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:41.787147 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:41.787147 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:41.787147 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:41.787147 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:41.787147 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:41.787147 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:41.787147 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:41.787147 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:41.787147 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:49:41.787147 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:49:41.787147 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:49:41.787147 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:49:41.794264 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:49:41.794264 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:49:41.794264 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:49:41.794264 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:49:41.794264 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:41.794264 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:41.794264 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:41.794264 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:41.794264 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:41.794264 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:41.794264 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:41.794264 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:41.794264 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:41.794264 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:41.794264 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:41.794264 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:41.795119 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:41.795119 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:41.795119 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:41.795119 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:41.795119 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:49:41.795119 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:49:41.795119 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:49:41.795119 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:49:41.795119 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:49:41.795119 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:49:41.795119 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 30 20:49:41.795119 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:41.795119 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 514/1033] 10.222.0.23 () {56 vars in 1120 bytes} [Sat Apr 30 20:49:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:49:41.795119 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6bf5d3-cb06-47ac-a3f8-2c6ce997c89f None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:41.831065 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03215918-83a7-4e59-8f59-3f5ce9be670a None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:41.864591 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8190bf8-f912-412f-b662-bd8768228d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:41.865250 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8190bf8-f912-412f-b662-bd8768228d5c None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:41.865528 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8190bf8-f912-412f-b662-bd8768228d5c None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:41.865825 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8190bf8-f912-412f-b662-bd8768228d5c None admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:41.866490 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8190bf8-f912-412f-b662-bd8768228d5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:41.867866 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8190bf8-f912-412f-b662-bd8768228d5c None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:41.874349 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 520/1034] 10.222.0.23 () {56 vars in 1087 bytes} [Sat Apr 30 20:49:41 2022] GET /identity/v3/services => generated 1957 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 20:49:41.897700 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6bf5d3-cb06-47ac-a3f8-2c6ce997c89f None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:41.934624 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90466a8d-e7fa-4a94-bb2b-f24626cc21a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:41.935312 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90466a8d-e7fa-4a94-bb2b-f24626cc21a4 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:41.935591 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90466a8d-e7fa-4a94-bb2b-f24626cc21a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:41.935862 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90466a8d-e7fa-4a94-bb2b-f24626cc21a4 None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:41.936620 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90466a8d-e7fa-4a94-bb2b-f24626cc21a4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:41.936926 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90466a8d-e7fa-4a94-bb2b-f24626cc21a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:41.938383 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90466a8d-e7fa-4a94-bb2b-f24626cc21a4 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:41.952809 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 515/1035] 10.222.0.23 () {56 vars in 1115 bytes} [Sat Apr 30 20:49:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:49:41.954093 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8190bf8-f912-412f-b662-bd8768228d5c None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:42.117808 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8190bf8-f912-412f-b662-bd8768228d5c None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:42.149551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006985b1-caee-425d-80c5-a6af4be9882e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:42.150394 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006985b1-caee-425d-80c5-a6af4be9882e None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:42.150667 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006985b1-caee-425d-80c5-a6af4be9882e None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:42.151001 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006985b1-caee-425d-80c5-a6af4be9882e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:42.161833 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006985b1-caee-425d-80c5-a6af4be9882e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:42.163273 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006985b1-caee-425d-80c5-a6af4be9882e None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:42.179738 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-006985b1-caee-425d-80c5-a6af4be9882e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:42.179738 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:42.179738 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:42.179738 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:42.179738 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:42.179738 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:42.179738 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:42.179738 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:42.179738 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:42.179738 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:42.179738 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:42.179738 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:42.179738 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:49:42.179738 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:49:42.179738 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:49:42.180782 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:49:42.180782 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:42.180782 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:42.180782 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:42.180782 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:42.180782 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:42.180782 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:42.180782 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:42.180782 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:42.180782 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:42.180782 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:42.180782 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:42.180782 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:42.180782 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:42.180782 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:42.180782 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:42.180782 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:42.186627 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:49:42.186627 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:49:42.186627 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:42.186627 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:42.186627 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 521/1036] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:49:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:42.187215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90466a8d-e7fa-4a94-bb2b-f24626cc21a4 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:42.286396 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90466a8d-e7fa-4a94-bb2b-f24626cc21a4 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:42.323120 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cbea6b-e8dd-4472-b59e-1bcfa32e996c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:42.323935 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbea6b-e8dd-4472-b59e-1bcfa32e996c None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:42.324324 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbea6b-e8dd-4472-b59e-1bcfa32e996c None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:42.324801 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbea6b-e8dd-4472-b59e-1bcfa32e996c None admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:42.326217 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cbea6b-e8dd-4472-b59e-1bcfa32e996c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:42.326630 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cbea6b-e8dd-4472-b59e-1bcfa32e996c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:42.328149 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cbea6b-e8dd-4472-b59e-1bcfa32e996c None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:42.340270 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 516/1037] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:49:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:42.345890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006985b1-caee-425d-80c5-a6af4be9882e None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:42.454948 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006985b1-caee-425d-80c5-a6af4be9882e None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:42.487246 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24930a41-eec7-4762-b001-21b66d3ffdb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:42.488028 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24930a41-eec7-4762-b001-21b66d3ffdb0 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:42.488316 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24930a41-eec7-4762-b001-21b66d3ffdb0 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:42.488587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24930a41-eec7-4762-b001-21b66d3ffdb0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:42.497268 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24930a41-eec7-4762-b001-21b66d3ffdb0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:42.498746 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24930a41-eec7-4762-b001-21b66d3ffdb0 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:42.513184 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-24930a41-eec7-4762-b001-21b66d3ffdb0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 30 20:49:42.513184 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:42.513184 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:42.513184 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:42.513184 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:42.513184 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:42.513184 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:42.513184 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:42.513184 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:42.513184 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:42.513184 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:42.513184 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:42.513184 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:49:42.513184 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:49:42.513184 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:49:42.513184 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:49:42.514417 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:42.514417 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:42.514417 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:49:42.514417 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:49:42.514417 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:49:42.514417 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:49:42.514417 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:42.514417 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:42.514417 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:42.514417 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:42.514417 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:42.514417 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:42.514417 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:42.514417 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:42.514417 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:42.514417 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:42.514417 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:42.514417 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:42.515476 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:42.515476 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:42.515476 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:49:42.515476 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:49:42.515476 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:49:42.515476 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:49:42.515476 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:49:42.515476 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:49:42.515476 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Apr 30 20:49:42.515476 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:42.515476 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 522/1038] 10.222.0.23 () {56 vars in 1093 bytes} [Sat Apr 30 20:49:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:49:42.521973 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cbea6b-e8dd-4472-b59e-1bcfa32e996c None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:42.619207 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cbea6b-e8dd-4472-b59e-1bcfa32e996c None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:42.653029 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13189100-0abe-4a69-b5e9-0242d982e3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:42.653704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13189100-0abe-4a69-b5e9-0242d982e3ad None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:42.654033 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13189100-0abe-4a69-b5e9-0242d982e3ad None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:42.654307 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13189100-0abe-4a69-b5e9-0242d982e3ad None admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:42.655138 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13189100-0abe-4a69-b5e9-0242d982e3ad None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:42.655451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13189100-0abe-4a69-b5e9-0242d982e3ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:42.656891 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13189100-0abe-4a69-b5e9-0242d982e3ad None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:42.679455 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 517/1039] 10.222.0.23 () {56 vars in 1133 bytes} [Sat Apr 30 20:49:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:49:42.680713 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24930a41-eec7-4762-b001-21b66d3ffdb0 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:42.795102 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24930a41-eec7-4762-b001-21b66d3ffdb0 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:42.827182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7b6b8-38f0-4cd5-b120-8f6b9c9bbb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:42.827827 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7b6b8-38f0-4cd5-b120-8f6b9c9bbb84 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:42.828112 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7b6b8-38f0-4cd5-b120-8f6b9c9bbb84 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:42.828387 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7b6b8-38f0-4cd5-b120-8f6b9c9bbb84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:42.892043 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed7b6b8-38f0-4cd5-b120-8f6b9c9bbb84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:42.893487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed7b6b8-38f0-4cd5-b120-8f6b9c9bbb84 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:42.991707 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 523/1040] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:49:42 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 30 20:49:42.992898 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13189100-0abe-4a69-b5e9-0242d982e3ad None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:43.093451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13189100-0abe-4a69-b5e9-0242d982e3ad None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:43.127097 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f06e3-e38d-4a06-9a80-7ce89ec21406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:43.127887 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f06e3-e38d-4a06-9a80-7ce89ec21406 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:43.128164 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f06e3-e38d-4a06-9a80-7ce89ec21406 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:43.128441 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f06e3-e38d-4a06-9a80-7ce89ec21406 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:43.138153 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f06e3-e38d-4a06-9a80-7ce89ec21406 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:43.139590 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f06e3-e38d-4a06-9a80-7ce89ec21406 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:43.157514 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-b75f06e3-e38d-4a06-9a80-7ce89ec21406 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:43.157514 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:43.157514 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:43.157514 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:43.157514 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:43.157514 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:43.157514 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:43.157514 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:43.157514 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:43.157514 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:43.157514 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:43.157514 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:43.157514 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:49:43.157514 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:49:43.157514 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:49:43.158614 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:49:43.158614 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:43.158614 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:43.158614 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:43.158614 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:43.158614 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:43.158614 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:43.158614 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:43.158614 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:43.158614 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:43.158614 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:43.158614 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:43.158614 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:43.158614 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:43.158614 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:43.158614 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:43.158614 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:43.159517 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:49:43.159517 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:49:43.159517 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:43.159517 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:43.159517 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 518/1041] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:49:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:43.165636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7b6b8-38f0-4cd5-b120-8f6b9c9bbb84 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:43.258079 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7b6b8-38f0-4cd5-b120-8f6b9c9bbb84 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:43.291022 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b586f-43c2-4b5d-a72d-3790bfdb4c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:43.291680 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b586f-43c2-4b5d-a72d-3790bfdb4c7d None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:43.291956 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b586f-43c2-4b5d-a72d-3790bfdb4c7d None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:43.292225 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b586f-43c2-4b5d-a72d-3790bfdb4c7d None admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:43.292932 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38b586f-43c2-4b5d-a72d-3790bfdb4c7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:43.293232 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38b586f-43c2-4b5d-a72d-3790bfdb4c7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:43.295231 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38b586f-43c2-4b5d-a72d-3790bfdb4c7d None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:43.310617 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 524/1042] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:49:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:43.311860 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f06e3-e38d-4a06-9a80-7ce89ec21406 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:43.407030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f06e3-e38d-4a06-9a80-7ce89ec21406 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:43.440120 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca18fc-5df3-4a22-9e6a-d4ecbc5c654a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:43.441055 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca18fc-5df3-4a22-9e6a-d4ecbc5c654a None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:43.441452 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca18fc-5df3-4a22-9e6a-d4ecbc5c654a None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:43.441849 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca18fc-5df3-4a22-9e6a-d4ecbc5c654a None admin] PATH_INFO: `/v3/projects/service` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:43.448450 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca18fc-5df3-4a22-9e6a-d4ecbc5c654a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:43.450574 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca18fc-5df3-4a22-9e6a-d4ecbc5c654a None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:43.464179 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-89ca18fc-5df3-4a22-9e6a-d4ecbc5c654a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:49:43.464179 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:43.464179 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:43.464179 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:43.464179 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:43.464179 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:43.464179 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:43.464179 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:43.464179 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:43.464179 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:43.464179 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:43.464179 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:43.464179 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:49:43.464179 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:49:43.464179 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:49:43.465090 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:49:43.465090 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:43.465090 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:43.465090 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:43.465090 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:43.465090 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:43.465090 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:43.465090 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:43.465090 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:43.465090 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:43.465090 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:43.465090 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:43.465090 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:43.465090 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:43.465090 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:43.465090 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:43.465090 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:43.466688 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:49:43.466688 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:49:43.466688 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:49:43.466688 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:49:43.466688 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:49:43.466688 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:49:43.466688 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:49:43.466688 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:43.466688 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 519/1043] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:49:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:43.473548 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b586f-43c2-4b5d-a72d-3790bfdb4c7d None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:43.569692 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b586f-43c2-4b5d-a72d-3790bfdb4c7d None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:43.602960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392509e2-3c45-4d7c-9941-d14671c8b95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:43.603618 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392509e2-3c45-4d7c-9941-d14671c8b95e None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:43.603901 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392509e2-3c45-4d7c-9941-d14671c8b95e None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:43.604175 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392509e2-3c45-4d7c-9941-d14671c8b95e None admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:43.605020 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392509e2-3c45-4d7c-9941-d14671c8b95e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:43.605327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392509e2-3c45-4d7c-9941-d14671c8b95e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:43.606819 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392509e2-3c45-4d7c-9941-d14671c8b95e None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:43.621949 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 525/1044] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Apr 30 20:49:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:43.624784 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca18fc-5df3-4a22-9e6a-d4ecbc5c654a None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:43.729979 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca18fc-5df3-4a22-9e6a-d4ecbc5c654a None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:43.763489 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847b716-8a49-4c37-8a06-49e2c635c9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:43.764145 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847b716-8a49-4c37-8a06-49e2c635c9d0 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:43.764423 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847b716-8a49-4c37-8a06-49e2c635c9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:43.764695 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847b716-8a49-4c37-8a06-49e2c635c9d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:43.765512 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f847b716-8a49-4c37-8a06-49e2c635c9d0 None admin] RBAC: Adding query filter params (role.id=058cab574a7548388406f3e3d6bb5779, scope.project.id=6b52e5e13b9144dfb663578766c2bac0, user.id=fca4ee1f64c8489ebe7296f9f8f0ab41) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:43.765852 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f847b716-8a49-4c37-8a06-49e2c635c9d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:43.767476 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f847b716-8a49-4c37-8a06-49e2c635c9d0 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:43.781863 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 520/1045] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:49:43 2022] GET /identity/v3/role_assignments?user.id=fca4ee1f64c8489ebe7296f9f8f0ab41&scope.project.id=6b52e5e13b9144dfb663578766c2bac0&role.id=058cab574a7548388406f3e3d6bb5779 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:49:43.906823 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1a502-1590-4afa-9c94-9cebd5372f58 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:43.907182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1a502-1590-4afa-9c94-9cebd5372f58 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:43.907382 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1a502-1590-4afa-9c94-9cebd5372f58 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:43.909075 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 526/1046] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:49:43.914793 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a791d2f-be7f-4da6-8546-e40a8cb6880e None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:43.915123 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a791d2f-be7f-4da6-8546-e40a8cb6880e None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:43.915351 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a791d2f-be7f-4da6-8546-e40a8cb6880e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:43.937184 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-6a791d2f-be7f-4da6-8546-e40a8cb6880e None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:43.938420 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6a791d2f-be7f-4da6-8546-e40a8cb6880e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:44.006198 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 521/1047] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:49:44.031319 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1a502-1590-4afa-9c94-9cebd5372f58 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:44.134011 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1a502-1590-4afa-9c94-9cebd5372f58 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:44.167524 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117df1f-dda2-4d4e-a9d9-8594180d9dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:44.168310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117df1f-dda2-4d4e-a9d9-8594180d9dfd None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:44.169119 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117df1f-dda2-4d4e-a9d9-8594180d9dfd None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:44.169390 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117df1f-dda2-4d4e-a9d9-8594180d9dfd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:44.179198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e117df1f-dda2-4d4e-a9d9-8594180d9dfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:49:44.187370 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-e117df1f-dda2-4d4e-a9d9-8594180d9dfd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:49:44.187370 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:44.187370 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:44.187370 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:44.187370 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:44.187370 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:44.187370 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:44.187370 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:44.187370 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:44.187370 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:44.187370 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:44.187370 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:44.187370 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:49:44.187370 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:49:44.187370 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:49:44.187370 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:49:44.188338 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:49:44.188338 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:49:44.188338 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:49:44.188338 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:49:44.188338 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:44.188338 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:44.188338 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:44.188338 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:44.188338 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:44.188338 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:44.188338 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:44.188338 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:44.188338 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:44.188338 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:44.188338 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:44.188338 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:44.189185 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:44.189185 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:44.189185 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:44.189185 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:44.189185 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:49:44.189185 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:49:44.189185 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:49:44.189185 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:49:44.189185 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:49:44.189185 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:49:44.189185 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:49:44.189185 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:44.189185 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 527/1048] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Apr 30 20:49:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:44.196148 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a791d2f-be7f-4da6-8546-e40a8cb6880e None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:44.220585 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb06f53-269d-492e-a4fe-c4246097b694 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:44.220891 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb06f53-269d-492e-a4fe-c4246097b694 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:44.221149 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb06f53-269d-492e-a4fe-c4246097b694 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:44.222537 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 528/1049] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:49:44.227336 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e971e-4ddb-4614-b766-fae18c098103 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:44.227624 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e971e-4ddb-4614-b766-fae18c098103 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:44.227902 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e971e-4ddb-4614-b766-fae18c098103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:44.244476 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-cd0e971e-4ddb-4614-b766-fae18c098103 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:44.245664 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-cd0e971e-4ddb-4614-b766-fae18c098103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:44.296639 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a791d2f-be7f-4da6-8546-e40a8cb6880e None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:44.319028 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 529/1050] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 30 20:49:44.329493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67076318-a81f-4de5-ad9f-e7fdb947b295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:44.330206 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67076318-a81f-4de5-ad9f-e7fdb947b295 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:44.330495 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67076318-a81f-4de5-ad9f-e7fdb947b295 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:44.330771 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67076318-a81f-4de5-ad9f-e7fdb947b295 None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:44.331512 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67076318-a81f-4de5-ad9f-e7fdb947b295 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:44.331817 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67076318-a81f-4de5-ad9f-e7fdb947b295 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:44.333188 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67076318-a81f-4de5-ad9f-e7fdb947b295 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:44.341931 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 522/1051] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:49:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:49:44.343193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e971e-4ddb-4614-b766-fae18c098103 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:44.346846 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67076318-a81f-4de5-ad9f-e7fdb947b295 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:44.460958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e971e-4ddb-4614-b766-fae18c098103 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:44.463577 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67076318-a81f-4de5-ad9f-e7fdb947b295 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:44.497859 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd5478-33b5-4b19-b9c7-e0d6175402f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:44.498738 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd5478-33b5-4b19-b9c7-e0d6175402f3 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:44.499022 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd5478-33b5-4b19-b9c7-e0d6175402f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:44.499300 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd5478-33b5-4b19-b9c7-e0d6175402f3 None admin] PATH_INFO: `/v3/users/69e50c22df0645959953e9c913620bc4` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:44.499500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2ecb2-baa5-407e-8754-da997c4e7aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:44.500453 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2ecb2-baa5-407e-8754-da997c4e7aa7 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:44.500736 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2ecb2-baa5-407e-8754-da997c4e7aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:44.501012 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2ecb2-baa5-407e-8754-da997c4e7aa7 None admin] PATH_INFO: `/v3/services/image` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:44.502628 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f2ecb2-baa5-407e-8754-da997c4e7aa7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:44.504017 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f2ecb2-baa5-407e-8754-da997c4e7aa7 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:44.512764 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd5478-33b5-4b19-b9c7-e0d6175402f3 None admin] RBAC: Authorizing `identity:get_user(user_id=69e50c22df0645959953e9c913620bc4)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:44.514247 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd5478-33b5-4b19-b9c7-e0d6175402f3 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:44.516185 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 523/1052] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:49:44 2022] GET /identity/v3/users/69e50c22df0645959953e9c913620bc4 => generated 285 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:49:44.517177 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-09f2ecb2-baa5-407e-8754-da997c4e7aa7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 30 20:49:44.517177 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:44.517177 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:49:44.517177 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:49:44.517177 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:49:44.517177 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:49:44.517177 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:49:44.517177 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:49:44.517177 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Apr 30 20:49:44.517177 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:44.517177 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:49:44.517177 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:44.517177 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:44.517177 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:44.517177 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:44.517177 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:44.517177 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:44.518188 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:44.518188 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:44.518188 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:44.518188 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:44.518188 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:44.518188 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:44.518188 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:49:44.518188 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:49:44.518188 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:49:44.518188 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:49:44.518188 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:44.518188 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:44.518188 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:44.518188 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:44.518188 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:44.518188 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:44.524190 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:44.524190 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:44.524190 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:44.524190 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:44.524190 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:44.524190 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:44.524190 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:44.524190 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:44.524190 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:44.524190 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:44.524190 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:49:44.524190 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:49:44.524190 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Apr 30 20:49:44.524190 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:44.524190 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 530/1053] 10.222.0.23 () {56 vars in 1105 bytes} [Sat Apr 30 20:49:44 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:44.525006 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd5478-33b5-4b19-b9c7-e0d6175402f3 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:44.525088 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2ecb2-baa5-407e-8754-da997c4e7aa7 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:44.625471 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd5478-33b5-4b19-b9c7-e0d6175402f3 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:44.627866 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2ecb2-baa5-407e-8754-da997c4e7aa7 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:44.664337 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767f1ce-61a4-432b-b28a-709428bff570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:44.665239 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2807bd-320f-4ce0-a6dd-bbb06f4b984b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:44.665914 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2807bd-320f-4ce0-a6dd-bbb06f4b984b None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:44.666168 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767f1ce-61a4-432b-b28a-709428bff570 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:44.666282 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2807bd-320f-4ce0-a6dd-bbb06f4b984b None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:44.666455 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767f1ce-61a4-432b-b28a-709428bff570 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:44.666551 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2807bd-320f-4ce0-a6dd-bbb06f4b984b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:44.666721 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767f1ce-61a4-432b-b28a-709428bff570 None admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:44.667432 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767f1ce-61a4-432b-b28a-709428bff570 None admin] RBAC: Adding query filter params (name=image) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:44.667742 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767f1ce-61a4-432b-b28a-709428bff570 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:44.669733 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767f1ce-61a4-432b-b28a-709428bff570 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:44.674804 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 531/1054] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:49:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:49:44.680251 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767f1ce-61a4-432b-b28a-709428bff570 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:44.739620 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2807bd-320f-4ce0-a6dd-bbb06f4b984b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:44.741125 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2807bd-320f-4ce0-a6dd-bbb06f4b984b None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:44.786167 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767f1ce-61a4-432b-b28a-709428bff570 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:44.818938 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b0f5b-d712-4801-bbe9-a6928838270a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:44.819603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b0f5b-d712-4801-bbe9-a6928838270a None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:44.819883 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b0f5b-d712-4801-bbe9-a6928838270a None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:44.820162 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b0f5b-d712-4801-bbe9-a6928838270a None admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:44.820864 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18b0f5b-d712-4801-bbe9-a6928838270a None admin] RBAC: Adding query filter params (type=image) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:44.821170 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18b0f5b-d712-4801-bbe9-a6928838270a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:44.822572 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18b0f5b-d712-4801-bbe9-a6928838270a None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:44.832227 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 532/1055] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:49:44 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:49:44.833209 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b0f5b-d712-4801-bbe9-a6928838270a None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:44.844183 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 524/1056] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:49:44 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 30 20:49:44.850015 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2807bd-320f-4ce0-a6dd-bbb06f4b984b None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:44.932049 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b0f5b-d712-4801-bbe9-a6928838270a None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:44.947180 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2807bd-320f-4ce0-a6dd-bbb06f4b984b None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:44.966957 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bb494-b534-41eb-91dd-7d296fd416b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:44.967642 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bb494-b534-41eb-91dd-7d296fd416b5 None admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:44.967927 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bb494-b534-41eb-91dd-7d296fd416b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:44.968202 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bb494-b534-41eb-91dd-7d296fd416b5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:44.968939 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68bb494-b534-41eb-91dd-7d296fd416b5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:44.970616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68bb494-b534-41eb-91dd-7d296fd416b5 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:44.988090 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7cc8d-107e-456c-8f9e-660584c32c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:44.988944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7cc8d-107e-456c-8f9e-660584c32c1f None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:44.989227 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7cc8d-107e-456c-8f9e-660584c32c1f None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:44.989508 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7cc8d-107e-456c-8f9e-660584c32c1f None admin] PATH_INFO: `/v3/projects/41a075d1b08a4d73ad9ec64c6ee885ee` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:44.990760 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e7cc8d-107e-456c-8f9e-660584c32c1f None admin] RBAC: Authorizing `identity:get_project(project_id=41a075d1b08a4d73ad9ec64c6ee885ee)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:44.994082 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e7cc8d-107e-456c-8f9e-660584c32c1f None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:44.994082 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 525/1057] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:49:44 2022] GET /identity/v3/projects/41a075d1b08a4d73ad9ec64c6ee885ee => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:49:44.999803 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7cc8d-107e-456c-8f9e-660584c32c1f None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:45.093799 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 533/1058] 10.222.0.23 () {60 vars in 1144 bytes} [Sat Apr 30 20:49:44 2022] POST /identity/v3/endpoints => generated 327 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:49:45.131922 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7cc8d-107e-456c-8f9e-660584c32c1f None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:45.175008 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ca0e4-158b-4585-b05a-470e9a0d7971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:45.175676 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ca0e4-158b-4585-b05a-470e9a0d7971 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:45.175956 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ca0e4-158b-4585-b05a-470e9a0d7971 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:45.176230 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ca0e4-158b-4585-b05a-470e9a0d7971 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:45.177064 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ca0e4-158b-4585-b05a-470e9a0d7971 None admin] RBAC: Adding query filter params (role.id=30112eb1f3e047398c3c82fb40b72e62, scope.project.id=41a075d1b08a4d73ad9ec64c6ee885ee, user.id=69e50c22df0645959953e9c913620bc4) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:45.177377 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ca0e4-158b-4585-b05a-470e9a0d7971 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:45.178901 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ca0e4-158b-4585-b05a-470e9a0d7971 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:45.185254 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 526/1059] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:49:44 2022] GET /identity/v3/role_assignments?user.id=69e50c22df0645959953e9c913620bc4&scope.project.id=41a075d1b08a4d73ad9ec64c6ee885ee&role.id=30112eb1f3e047398c3c82fb40b72e62 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:49:46.115215 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2966ac-16db-4003-bb34-bb660c35d796 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:46.115750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2966ac-16db-4003-bb34-bb660c35d796 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:46.115750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2966ac-16db-4003-bb34-bb660c35d796 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:46.117382 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 534/1060] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:49:46.123084 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb7f98-fe15-4e98-8384-1dc2539e4a16 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:46.123489 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb7f98-fe15-4e98-8384-1dc2539e4a16 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:46.123653 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb7f98-fe15-4e98-8384-1dc2539e4a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:46.140677 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-41bb7f98-fe15-4e98-8384-1dc2539e4a16 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:46.141878 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-41bb7f98-fe15-4e98-8384-1dc2539e4a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:46.205779 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 527/1061] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:49:46.229392 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2966ac-16db-4003-bb34-bb660c35d796 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:46.332945 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2966ac-16db-4003-bb34-bb660c35d796 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:46.366219 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b02fa-c5ae-4b22-b6b6-17e83ef206e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:46.366945 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b02fa-c5ae-4b22-b6b6-17e83ef206e6 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:46.367219 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b02fa-c5ae-4b22-b6b6-17e83ef206e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:46.367490 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b02fa-c5ae-4b22-b6b6-17e83ef206e6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:46.380526 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19b02fa-c5ae-4b22-b6b6-17e83ef206e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:49:46.389394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-c19b02fa-c5ae-4b22-b6b6-17e83ef206e6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 30 20:49:46.389394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:46.389394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:46.389394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:46.389394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:46.389394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:46.389394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:46.389394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:46.389394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:46.389394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:46.389394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:46.389394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:46.389394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:49:46.389394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:49:46.389394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:49:46.389394 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:49:46.390362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:49:46.390362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:49:46.390362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:49:46.390362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:49:46.390362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:46.390362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:46.390362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:46.390362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:46.390362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:46.390362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:46.390362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:46.390362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:46.390362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:46.390362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:46.390362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:46.390362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:46.396581 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:46.396581 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:46.396581 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:46.396581 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:46.396581 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:49:46.396581 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:49:46.396581 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:49:46.396581 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:49:46.396581 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:49:46.396581 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:49:46.396581 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 30 20:49:46.396581 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:46.396581 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 535/1062] 10.222.0.23 () {56 vars in 1120 bytes} [Sat Apr 30 20:49:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:46.398889 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb7f98-fe15-4e98-8384-1dc2539e4a16 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:46.496152 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb7f98-fe15-4e98-8384-1dc2539e4a16 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:46.526303 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc7d425-2c78-43c8-b6dc-40e58c37f1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:46.526959 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7d425-2c78-43c8-b6dc-40e58c37f1d3 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:46.527236 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7d425-2c78-43c8-b6dc-40e58c37f1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:46.527504 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7d425-2c78-43c8-b6dc-40e58c37f1d3 None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:46.528258 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc7d425-2c78-43c8-b6dc-40e58c37f1d3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:46.528556 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc7d425-2c78-43c8-b6dc-40e58c37f1d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:46.529943 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc7d425-2c78-43c8-b6dc-40e58c37f1d3 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:46.537478 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 528/1063] 10.222.0.23 () {56 vars in 1115 bytes} [Sat Apr 30 20:49:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:46.543797 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b02fa-c5ae-4b22-b6b6-17e83ef206e6 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:46.638074 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b02fa-c5ae-4b22-b6b6-17e83ef206e6 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:46.669593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411efd10-3f7f-454c-a530-da2ade17d342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:46.670409 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411efd10-3f7f-454c-a530-da2ade17d342 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:46.670686 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411efd10-3f7f-454c-a530-da2ade17d342 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:46.670960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411efd10-3f7f-454c-a530-da2ade17d342 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:46.681413 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411efd10-3f7f-454c-a530-da2ade17d342 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:46.683628 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411efd10-3f7f-454c-a530-da2ade17d342 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:46.701798 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-411efd10-3f7f-454c-a530-da2ade17d342 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:46.701798 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:46.701798 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:46.701798 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:46.701798 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:46.701798 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:46.701798 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:46.701798 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:46.701798 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:46.701798 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:46.701798 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:46.701798 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:46.701798 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:49:46.701798 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:49:46.701798 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:49:46.702791 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:49:46.702791 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:46.702791 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:46.702791 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:46.702791 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:46.702791 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:46.702791 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:46.702791 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:46.702791 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:46.702791 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:46.702791 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:46.702791 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:46.702791 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:46.702791 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:46.702791 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:46.702791 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:46.702791 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:46.703681 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:49:46.703681 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:49:46.703681 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:46.703681 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:46.703681 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 536/1064] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:49:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:49:46.716714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc7d425-2c78-43c8-b6dc-40e58c37f1d3 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:46.815316 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc7d425-2c78-43c8-b6dc-40e58c37f1d3 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:46.849035 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9939aa-6988-4924-b714-bf57c73cbce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:46.849709 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9939aa-6988-4924-b714-bf57c73cbce4 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:46.850018 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9939aa-6988-4924-b714-bf57c73cbce4 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:46.850292 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9939aa-6988-4924-b714-bf57c73cbce4 None admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:46.851010 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9939aa-6988-4924-b714-bf57c73cbce4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:46.851317 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9939aa-6988-4924-b714-bf57c73cbce4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:46.852697 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9939aa-6988-4924-b714-bf57c73cbce4 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:46.865110 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 529/1065] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:49:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:46.870893 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411efd10-3f7f-454c-a530-da2ade17d342 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:46.966879 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411efd10-3f7f-454c-a530-da2ade17d342 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:46.999507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0d358-86b1-4626-9330-fda9a5e1f992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:47.000296 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0d358-86b1-4626-9330-fda9a5e1f992 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:47.000580 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0d358-86b1-4626-9330-fda9a5e1f992 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:47.000857 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0d358-86b1-4626-9330-fda9a5e1f992 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:47.008627 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be0d358-86b1-4626-9330-fda9a5e1f992 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:47.010103 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be0d358-86b1-4626-9330-fda9a5e1f992 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:47.023915 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-1be0d358-86b1-4626-9330-fda9a5e1f992 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 30 20:49:47.023915 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:47.023915 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:47.023915 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:47.023915 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:47.023915 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:47.023915 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:47.023915 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:47.023915 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:47.023915 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:47.023915 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:47.023915 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:47.023915 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:49:47.023915 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:49:47.023915 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:49:47.023915 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:49:47.024888 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:47.024888 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:47.024888 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:49:47.024888 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:49:47.024888 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:49:47.024888 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:49:47.024888 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:47.024888 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:47.024888 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:47.024888 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:47.024888 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:47.024888 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:47.024888 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:47.024888 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:47.024888 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:47.024888 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:47.024888 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:47.024888 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:47.026322 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:47.026322 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:47.026322 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:49:47.026322 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:49:47.026322 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:49:47.026322 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:49:47.026322 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:49:47.026322 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:49:47.026322 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Apr 30 20:49:47.026322 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:47.027175 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 537/1066] 10.222.0.23 () {56 vars in 1093 bytes} [Sat Apr 30 20:49:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:47.031414 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9939aa-6988-4924-b714-bf57c73cbce4 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:47.131166 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9939aa-6988-4924-b714-bf57c73cbce4 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:47.164750 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db030b-6318-4a5b-92b6-2a5bcbf3c33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:47.165739 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db030b-6318-4a5b-92b6-2a5bcbf3c33d None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:47.166243 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db030b-6318-4a5b-92b6-2a5bcbf3c33d None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:47.166718 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db030b-6318-4a5b-92b6-2a5bcbf3c33d None admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:47.167725 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db030b-6318-4a5b-92b6-2a5bcbf3c33d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:47.168220 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db030b-6318-4a5b-92b6-2a5bcbf3c33d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:47.170629 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db030b-6318-4a5b-92b6-2a5bcbf3c33d None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:47.192860 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 530/1067] 10.222.0.23 () {56 vars in 1133 bytes} [Sat Apr 30 20:49:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:49:47.194207 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0d358-86b1-4626-9330-fda9a5e1f992 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:47.296196 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0d358-86b1-4626-9330-fda9a5e1f992 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:47.329303 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035f395-b609-48e8-9227-ac1b3f2e5502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:47.330162 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035f395-b609-48e8-9227-ac1b3f2e5502 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:47.330447 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035f395-b609-48e8-9227-ac1b3f2e5502 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:47.330720 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035f395-b609-48e8-9227-ac1b3f2e5502 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:47.343251 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035f395-b609-48e8-9227-ac1b3f2e5502 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:47.345002 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035f395-b609-48e8-9227-ac1b3f2e5502 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:47.363270 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-b035f395-b609-48e8-9227-ac1b3f2e5502 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:47.363270 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:47.363270 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:47.363270 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:47.363270 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:47.363270 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:47.363270 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:47.363270 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:47.363270 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:47.363270 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:47.363270 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:47.363270 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:47.363270 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:49:47.363270 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:49:47.363270 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:49:47.364261 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:49:47.364261 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:47.364261 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:47.364261 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:47.364261 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:47.364261 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:47.364261 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:47.364261 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:47.364261 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:47.364261 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:47.364261 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:47.364261 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:47.364261 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:47.364261 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:47.364261 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:47.364261 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:47.364261 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:47.365168 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:49:47.365168 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:49:47.365168 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:47.365168 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:47.365168 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 538/1068] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:49:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:49:47.371597 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db030b-6318-4a5b-92b6-2a5bcbf3c33d None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:47.462834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c7323-095f-410b-a248-f4d607f8f89d None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:47.463132 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c7323-095f-410b-a248-f4d607f8f89d None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:47.463387 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c7323-095f-410b-a248-f4d607f8f89d None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:47.464753 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 539/1069] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:49:47.470613 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca4909-0641-4779-b69e-650d35951875 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:47.470903 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca4909-0641-4779-b69e-650d35951875 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:47.471020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db030b-6318-4a5b-92b6-2a5bcbf3c33d None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:47.471194 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca4909-0641-4779-b69e-650d35951875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:47.488003 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-97ca4909-0641-4779-b69e-650d35951875 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:47.489184 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-97ca4909-0641-4779-b69e-650d35951875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:47.505503 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb331a-3ee4-49fa-abc9-6f98c3fac805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:47.506337 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb331a-3ee4-49fa-abc9-6f98c3fac805 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:47.506628 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb331a-3ee4-49fa-abc9-6f98c3fac805 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:47.506907 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb331a-3ee4-49fa-abc9-6f98c3fac805 None admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:47.507631 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deb331a-3ee4-49fa-abc9-6f98c3fac805 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:47.507938 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deb331a-3ee4-49fa-abc9-6f98c3fac805 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:47.509317 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deb331a-3ee4-49fa-abc9-6f98c3fac805 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:47.521424 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 531/1070] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:49:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:47.524098 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbece481-a290-4b76-a5da-9d91c5169d38 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:47.524392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbece481-a290-4b76-a5da-9d91c5169d38 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:47.524674 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbece481-a290-4b76-a5da-9d91c5169d38 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:47.526088 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 532/1071] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:49:47.526839 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbece481-a290-4b76-a5da-9d91c5169d38 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:47.559388 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 540/1072] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 30 20:49:47.560613 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368adc1d-3611-4875-848f-1da9b33fe54e None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:47.560900 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368adc1d-3611-4875-848f-1da9b33fe54e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:47.561176 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368adc1d-3611-4875-848f-1da9b33fe54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:47.580966 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-368adc1d-3611-4875-848f-1da9b33fe54e None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:47.582365 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-368adc1d-3611-4875-848f-1da9b33fe54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:47.626260 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbece481-a290-4b76-a5da-9d91c5169d38 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:47.646381 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 541/1073] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:49:47.647217 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368adc1d-3611-4875-848f-1da9b33fe54e None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:47.659703 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede821e-2c4a-4203-9157-d5d627e3cc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:47.660502 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede821e-2c4a-4203-9157-d5d627e3cc83 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:47.660791 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede821e-2c4a-4203-9157-d5d627e3cc83 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:47.661070 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede821e-2c4a-4203-9157-d5d627e3cc83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:47.667858 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede821e-2c4a-4203-9157-d5d627e3cc83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:47.669344 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede821e-2c4a-4203-9157-d5d627e3cc83 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:47.682911 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-fede821e-2c4a-4203-9157-d5d627e3cc83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:49:47.682911 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:47.682911 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:47.682911 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:47.682911 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:47.682911 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:47.682911 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:47.682911 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:47.682911 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:47.682911 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:47.682911 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:47.682911 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:47.682911 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:49:47.682911 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:49:47.682911 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:49:47.689801 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:49:47.689801 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:47.689801 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:47.689801 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:47.689801 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:47.689801 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:47.689801 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:47.689801 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:47.689801 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:47.689801 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:47.689801 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:47.689801 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:47.689801 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:47.689801 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:47.689801 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:47.689801 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:47.689801 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:47.690931 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:49:47.690931 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:49:47.690931 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:49:47.690931 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:49:47.690931 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:49:47.690931 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:49:47.690931 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:49:47.690931 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:47.690931 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 533/1074] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:49:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:47.690931 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede821e-2c4a-4203-9157-d5d627e3cc83 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:47.741412 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368adc1d-3611-4875-848f-1da9b33fe54e None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:47.774004 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff813df-a577-4dfd-9607-b84600bdbd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:47.774642 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff813df-a577-4dfd-9607-b84600bdbd15 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:47.774917 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff813df-a577-4dfd-9607-b84600bdbd15 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:47.775186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff813df-a577-4dfd-9607-b84600bdbd15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:47.787321 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede821e-2c4a-4203-9157-d5d627e3cc83 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:47.819307 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b784d-00ed-41bd-9d28-390ca177df5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:47.820027 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b784d-00ed-41bd-9d28-390ca177df5e None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:47.820311 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b784d-00ed-41bd-9d28-390ca177df5e None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:47.820586 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b784d-00ed-41bd-9d28-390ca177df5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:47.830859 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b784d-00ed-41bd-9d28-390ca177df5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:49:47.837318 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff813df-a577-4dfd-9607-b84600bdbd15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:47.838453 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-ce5b784d-00ed-41bd-9d28-390ca177df5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:49:47.838453 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:47.838453 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:47.838453 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:47.838453 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:47.838453 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:47.838453 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:47.838453 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:47.838453 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:47.838453 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:47.838453 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:47.838453 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:47.838453 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:49:47.838453 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:49:47.838453 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:49:47.838453 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:49:47.839554 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:49:47.839554 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:49:47.839554 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:49:47.839554 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:49:47.839554 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:47.839554 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:47.839554 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:47.839554 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:47.839554 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:47.839554 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:47.839554 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:47.839554 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:47.839554 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:47.839554 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:47.839554 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:47.839554 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:47.840524 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:47.840524 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:47.840524 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:47.840524 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:47.840524 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:49:47.840524 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:49:47.840524 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:49:47.840524 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:49:47.840524 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:49:47.840524 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:49:47.840524 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:49:47.840524 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:47.841252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff813df-a577-4dfd-9607-b84600bdbd15 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:47.841342 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 534/1075] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Apr 30 20:49:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:47.841342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b784d-00ed-41bd-9d28-390ca177df5e None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:47.936767 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 542/1076] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:49:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 30 20:49:47.937593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff813df-a577-4dfd-9607-b84600bdbd15 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:47.939188 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b784d-00ed-41bd-9d28-390ca177df5e None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:47.971159 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb89eb6-e9cc-4080-bfe1-fff4a21712cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:47.971819 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb89eb6-e9cc-4080-bfe1-fff4a21712cd None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:47.972104 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb89eb6-e9cc-4080-bfe1-fff4a21712cd None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:47.972381 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb89eb6-e9cc-4080-bfe1-fff4a21712cd None admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:47.973162 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb89eb6-e9cc-4080-bfe1-fff4a21712cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:47.973473 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb89eb6-e9cc-4080-bfe1-fff4a21712cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:47.974966 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb89eb6-e9cc-4080-bfe1-fff4a21712cd None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:47.987054 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 535/1077] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Apr 30 20:49:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:47.987844 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb89eb6-e9cc-4080-bfe1-fff4a21712cd None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:48.032765 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff813df-a577-4dfd-9607-b84600bdbd15 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:48.064934 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2483ec1-5b87-49b7-8fec-2a221afd5e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:48.065583 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2483ec1-5b87-49b7-8fec-2a221afd5e50 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:48.065894 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2483ec1-5b87-49b7-8fec-2a221afd5e50 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:48.066167 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2483ec1-5b87-49b7-8fec-2a221afd5e50 None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:48.066892 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2483ec1-5b87-49b7-8fec-2a221afd5e50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:48.067193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2483ec1-5b87-49b7-8fec-2a221afd5e50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:48.068541 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2483ec1-5b87-49b7-8fec-2a221afd5e50 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:48.076317 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 543/1078] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:49:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:48.077005 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2483ec1-5b87-49b7-8fec-2a221afd5e50 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:48.085887 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb89eb6-e9cc-4080-bfe1-fff4a21712cd None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:48.118915 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c780d5-4df1-4a13-943f-c6dc4b5fa68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:48.119687 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c780d5-4df1-4a13-943f-c6dc4b5fa68f None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:48.119970 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c780d5-4df1-4a13-943f-c6dc4b5fa68f None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:48.120246 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c780d5-4df1-4a13-943f-c6dc4b5fa68f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:48.130442 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c780d5-4df1-4a13-943f-c6dc4b5fa68f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:48.131892 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c780d5-4df1-4a13-943f-c6dc4b5fa68f None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:48.148789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-47c780d5-4df1-4a13-943f-c6dc4b5fa68f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:48.148789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:48.148789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:48.148789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:48.148789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:48.148789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:48.148789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:48.148789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:48.148789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:48.148789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:48.148789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:48.148789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:48.148789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:49:48.148789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:49:48.148789 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:49:48.149710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:49:48.149710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:48.149710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:48.149710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:48.149710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:48.149710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:48.149710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:48.149710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:48.149710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:48.149710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:48.149710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:48.149710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:48.149710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:48.149710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:48.149710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:48.149710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:48.149710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:48.150892 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:49:48.150892 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:49:48.150892 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:48.150892 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:48.150892 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 536/1079] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:49:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:48.150892 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c780d5-4df1-4a13-943f-c6dc4b5fa68f None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:48.172023 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2483ec1-5b87-49b7-8fec-2a221afd5e50 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:48.203874 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ad594-9e5e-480c-be2e-e81a8002e4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:48.204856 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ad594-9e5e-480c-be2e-e81a8002e4b4 None admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:48.205205 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ad594-9e5e-480c-be2e-e81a8002e4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:48.205552 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ad594-9e5e-480c-be2e-e81a8002e4b4 None admin] PATH_INFO: `/v3/projects/6b52e5e13b9144dfb663578766c2bac0/users/fca4ee1f64c8489ebe7296f9f8f0ab41/roles/058cab574a7548388406f3e3d6bb5779` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:48.207887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71ad594-9e5e-480c-be2e-e81a8002e4b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b52e5e13b9144dfb663578766c2bac0, user_id=fca4ee1f64c8489ebe7296f9f8f0ab41, role_id=058cab574a7548388406f3e3d6bb5779)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:48.209321 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71ad594-9e5e-480c-be2e-e81a8002e4b4 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:48.244007 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c780d5-4df1-4a13-943f-c6dc4b5fa68f None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:48.272116 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 544/1080] 10.222.0.23 () {58 vars in 1439 bytes} [Sat Apr 30 20:49:48 2022] PUT /identity/v3/projects/6b52e5e13b9144dfb663578766c2bac0/users/fca4ee1f64c8489ebe7296f9f8f0ab41/roles/058cab574a7548388406f3e3d6bb5779 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:49:48.272116 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ad594-9e5e-480c-be2e-e81a8002e4b4 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:48.283953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06385667-28de-4d71-b12d-f7e9b4a286a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:48.283953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06385667-28de-4d71-b12d-f7e9b4a286a2 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:48.283953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06385667-28de-4d71-b12d-f7e9b4a286a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:48.283953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06385667-28de-4d71-b12d-f7e9b4a286a2 None admin] PATH_INFO: `/v3/users/69e50c22df0645959953e9c913620bc4` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:48.284319 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06385667-28de-4d71-b12d-f7e9b4a286a2 None admin] RBAC: Authorizing `identity:get_user(user_id=69e50c22df0645959953e9c913620bc4)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:48.284990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06385667-28de-4d71-b12d-f7e9b4a286a2 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:48.286981 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 537/1081] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:49:48 2022] GET /identity/v3/users/69e50c22df0645959953e9c913620bc4 => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:48.292737 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06385667-28de-4d71-b12d-f7e9b4a286a2 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:48.390501 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ad594-9e5e-480c-be2e-e81a8002e4b4 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:48.405179 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06385667-28de-4d71-b12d-f7e9b4a286a2 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:48.430788 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9bba0-449d-42f5-9d09-f56d5ac5b5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:48.431464 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9bba0-449d-42f5-9d09-f56d5ac5b5e9 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:48.431745 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9bba0-449d-42f5-9d09-f56d5ac5b5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:48.432018 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9bba0-449d-42f5-9d09-f56d5ac5b5e9 None admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:48.432748 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9bba0-449d-42f5-9d09-f56d5ac5b5e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:48.433052 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9bba0-449d-42f5-9d09-f56d5ac5b5e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:48.434660 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9bba0-449d-42f5-9d09-f56d5ac5b5e9 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:48.447083 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 545/1082] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:49:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:48.455140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9b142-ffc0-4e28-a52e-413f1f45d09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:48.455383 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9b142-ffc0-4e28-a52e-413f1f45d09c None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:48.455586 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9b142-ffc0-4e28-a52e-413f1f45d09c None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:48.455788 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9b142-ffc0-4e28-a52e-413f1f45d09c None admin] PATH_INFO: `/v3/projects/41a075d1b08a4d73ad9ec64c6ee885ee` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:48.458122 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9b142-ffc0-4e28-a52e-413f1f45d09c None admin] RBAC: Authorizing `identity:get_project(project_id=41a075d1b08a4d73ad9ec64c6ee885ee)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:48.459610 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9b142-ffc0-4e28-a52e-413f1f45d09c None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:48.461468 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 538/1083] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:49:48 2022] GET /identity/v3/projects/41a075d1b08a4d73ad9ec64c6ee885ee => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:49:48.468471 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9bba0-449d-42f5-9d09-f56d5ac5b5e9 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:48.572484 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9bba0-449d-42f5-9d09-f56d5ac5b5e9 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:48.608784 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587c08b-82fd-4bfa-bd23-b7dbff892394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:48.609604 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587c08b-82fd-4bfa-bd23-b7dbff892394 None admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:48.609917 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587c08b-82fd-4bfa-bd23-b7dbff892394 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:48.610191 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587c08b-82fd-4bfa-bd23-b7dbff892394 None admin] PATH_INFO: `/v3/projects/41a075d1b08a4d73ad9ec64c6ee885ee/users/69e50c22df0645959953e9c913620bc4/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:48.612277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587c08b-82fd-4bfa-bd23-b7dbff892394 None admin] RBAC: Authorizing `identity:create_grant(project_id=41a075d1b08a4d73ad9ec64c6ee885ee, user_id=69e50c22df0645959953e9c913620bc4, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:48.613741 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587c08b-82fd-4bfa-bd23-b7dbff892394 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:48.689602 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 546/1084] 10.222.0.23 () {58 vars in 1439 bytes} [Sat Apr 30 20:49:48 2022] PUT /identity/v3/projects/41a075d1b08a4d73ad9ec64c6ee885ee/users/69e50c22df0645959953e9c913620bc4/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:49:50.610507 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc7c52-66f4-4be0-9c05-b878a3e2ce70 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:50.611024 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc7c52-66f4-4be0-9c05-b878a3e2ce70 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:50.611024 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc7c52-66f4-4be0-9c05-b878a3e2ce70 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:50.612324 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 539/1085] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:49:50.617323 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a678d95-0d99-44ea-8c92-596a65f833f0 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:50.617786 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a678d95-0d99-44ea-8c92-596a65f833f0 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:50.618036 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a678d95-0d99-44ea-8c92-596a65f833f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:50.634846 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-3a678d95-0d99-44ea-8c92-596a65f833f0 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:50.636010 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3a678d95-0d99-44ea-8c92-596a65f833f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:50.699040 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 547/1086] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:49:50.724477 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc7c52-66f4-4be0-9c05-b878a3e2ce70 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:50.827169 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc7c52-66f4-4be0-9c05-b878a3e2ce70 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:50.861682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40c5d5-810c-4e5f-bb35-fd6dfbe96b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:50.862438 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40c5d5-810c-4e5f-bb35-fd6dfbe96b29 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:50.862718 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40c5d5-810c-4e5f-bb35-fd6dfbe96b29 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:50.862991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40c5d5-810c-4e5f-bb35-fd6dfbe96b29 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:50.873433 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f40c5d5-810c-4e5f-bb35-fd6dfbe96b29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:49:50.881500 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-6f40c5d5-810c-4e5f-bb35-fd6dfbe96b29 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 30 20:49:50.881500 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:50.881500 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:50.881500 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:50.881500 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:50.881500 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:50.881500 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:50.881500 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:50.881500 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:50.881500 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:50.881500 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:50.881500 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:50.881500 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:49:50.881500 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:49:50.881500 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:49:50.881500 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:49:50.882598 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:49:50.882598 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:49:50.882598 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:49:50.882598 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:49:50.882598 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:50.882598 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:50.882598 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:50.882598 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:50.882598 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:50.882598 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:50.882598 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:50.882598 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:50.882598 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:50.882598 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:50.882598 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:50.882598 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:50.883444 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:50.883444 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:50.883444 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:50.883444 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:50.883444 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:49:50.883444 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:49:50.883444 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:49:50.883444 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:49:50.883444 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:49:50.883444 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:49:50.883444 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 30 20:49:50.883444 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:50.883444 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 540/1087] 10.222.0.23 () {56 vars in 1120 bytes} [Sat Apr 30 20:49:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:50.889303 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a678d95-0d99-44ea-8c92-596a65f833f0 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:50.982006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a678d95-0d99-44ea-8c92-596a65f833f0 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:51.009141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bb888-f224-4b7a-87d2-9f56dd787bc5 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:51.009429 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bb888-f224-4b7a-87d2-9f56dd787bc5 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:51.009716 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bb888-f224-4b7a-87d2-9f56dd787bc5 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:51.011125 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 541/1088] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:49:51.014733 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732a91c-3dd0-466a-8674-3fd6655961a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:51.015562 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732a91c-3dd0-466a-8674-3fd6655961a7 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:51.015845 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732a91c-3dd0-466a-8674-3fd6655961a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:51.015952 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263cf7c-de0e-4d42-a84e-2010dc4855b0 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:51.016117 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732a91c-3dd0-466a-8674-3fd6655961a7 None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:51.016236 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263cf7c-de0e-4d42-a84e-2010dc4855b0 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:51.016459 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263cf7c-de0e-4d42-a84e-2010dc4855b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:51.016851 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732a91c-3dd0-466a-8674-3fd6655961a7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:51.017154 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732a91c-3dd0-466a-8674-3fd6655961a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:51.018553 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732a91c-3dd0-466a-8674-3fd6655961a7 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:51.026331 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 548/1089] 10.222.0.23 () {56 vars in 1115 bytes} [Sat Apr 30 20:49:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:51.032006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732a91c-3dd0-466a-8674-3fd6655961a7 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:51.032842 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-a263cf7c-de0e-4d42-a84e-2010dc4855b0 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:51.034070 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a263cf7c-de0e-4d42-a84e-2010dc4855b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:51.107188 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 542/1090] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 30 20:49:51.132136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263cf7c-de0e-4d42-a84e-2010dc4855b0 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:51.133692 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732a91c-3dd0-466a-8674-3fd6655961a7 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:51.164915 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bcfeba-bd50-4760-9510-ec63706df018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:51.165685 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bcfeba-bd50-4760-9510-ec63706df018 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:51.165999 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bcfeba-bd50-4760-9510-ec63706df018 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:51.166270 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bcfeba-bd50-4760-9510-ec63706df018 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:51.176936 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bcfeba-bd50-4760-9510-ec63706df018 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:51.178427 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bcfeba-bd50-4760-9510-ec63706df018 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:51.195408 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-66bcfeba-bd50-4760-9510-ec63706df018 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:51.195408 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:51.195408 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:51.195408 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:51.195408 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:51.195408 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:51.195408 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:51.195408 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:51.195408 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:51.195408 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:51.195408 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:51.195408 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:51.195408 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:49:51.195408 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:49:51.195408 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:49:51.196595 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:49:51.196595 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:51.196595 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:51.196595 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:51.196595 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:51.196595 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:51.196595 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:51.196595 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:51.196595 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:51.196595 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:51.196595 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:51.196595 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:51.196595 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:51.196595 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:51.196595 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:51.196595 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:51.196595 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:51.197748 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:49:51.197748 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:49:51.197748 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:51.197748 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:51.197748 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 549/1091] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:49:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:49:51.202201 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bcfeba-bd50-4760-9510-ec63706df018 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:51.228747 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263cf7c-de0e-4d42-a84e-2010dc4855b0 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:51.261958 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d696a-e3c4-46a5-8363-bab1aa409550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:51.262741 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d696a-e3c4-46a5-8363-bab1aa409550 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:51.263030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d696a-e3c4-46a5-8363-bab1aa409550 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:51.263402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d696a-e3c4-46a5-8363-bab1aa409550 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:51.275436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d696a-e3c4-46a5-8363-bab1aa409550 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:49:51.283715 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-076d696a-e3c4-46a5-8363-bab1aa409550 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:49:51.283715 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:51.283715 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:51.283715 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:51.283715 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:51.283715 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:51.283715 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:51.283715 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:51.283715 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:51.283715 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:51.283715 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:51.283715 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:51.283715 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:49:51.283715 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:49:51.283715 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:49:51.283715 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:49:51.284887 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:49:51.284887 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:49:51.284887 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:49:51.284887 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:49:51.284887 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:51.284887 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:51.284887 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:51.284887 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:51.284887 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:51.284887 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:51.284887 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:51.284887 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:51.284887 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:51.284887 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:51.284887 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:51.284887 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:51.285751 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:51.285751 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:51.285751 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:51.285751 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:51.285751 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:49:51.285751 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:49:51.285751 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:49:51.285751 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:49:51.285751 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:49:51.285751 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:49:51.285751 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:49:51.285751 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:51.285751 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 543/1092] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Apr 30 20:49:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:49:51.290827 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d696a-e3c4-46a5-8363-bab1aa409550 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:51.301324 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bcfeba-bd50-4760-9510-ec63706df018 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:51.332539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe378d2c-67ec-4b9f-9c67-b584a881c812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:51.333189 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe378d2c-67ec-4b9f-9c67-b584a881c812 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:51.333468 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe378d2c-67ec-4b9f-9c67-b584a881c812 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:51.333741 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe378d2c-67ec-4b9f-9c67-b584a881c812 None admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:51.334476 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe378d2c-67ec-4b9f-9c67-b584a881c812 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:51.334781 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe378d2c-67ec-4b9f-9c67-b584a881c812 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:51.336138 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe378d2c-67ec-4b9f-9c67-b584a881c812 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:51.351545 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 550/1093] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:49:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:49:51.357511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe378d2c-67ec-4b9f-9c67-b584a881c812 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:51.387156 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d696a-e3c4-46a5-8363-bab1aa409550 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:51.419702 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2454b9-cdea-45f0-8916-730030fa42be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:51.420364 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2454b9-cdea-45f0-8916-730030fa42be None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:51.420646 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2454b9-cdea-45f0-8916-730030fa42be None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:51.420920 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2454b9-cdea-45f0-8916-730030fa42be None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:51.421876 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2454b9-cdea-45f0-8916-730030fa42be None admin] RBAC: Adding query filter params (name=admin) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:51.422182 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2454b9-cdea-45f0-8916-730030fa42be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:51.423544 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2454b9-cdea-45f0-8916-730030fa42be None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:51.431559 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 544/1094] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:49:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:49:51.437088 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2454b9-cdea-45f0-8916-730030fa42be None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:51.452521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe378d2c-67ec-4b9f-9c67-b584a881c812 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:51.485961 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee987217-74c6-4304-a095-44e26c287205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:51.486743 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee987217-74c6-4304-a095-44e26c287205 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:51.487024 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee987217-74c6-4304-a095-44e26c287205 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:51.487302 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee987217-74c6-4304-a095-44e26c287205 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:51.494223 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee987217-74c6-4304-a095-44e26c287205 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:51.495651 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee987217-74c6-4304-a095-44e26c287205 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:51.509573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-ee987217-74c6-4304-a095-44e26c287205 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 30 20:49:51.509573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:51.509573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:51.509573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:51.509573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:51.509573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:51.509573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:51.509573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:51.509573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:51.509573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:51.509573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:51.509573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:51.509573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:49:51.509573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:49:51.509573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:49:51.509573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:49:51.516092 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:51.516092 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:51.516092 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:49:51.516092 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:49:51.516092 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:49:51.516092 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:49:51.516092 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:51.516092 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:51.516092 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:51.516092 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:51.516092 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:51.516092 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:51.516092 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:51.516092 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:51.516092 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:51.516092 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:51.516092 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:51.516092 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:51.517045 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:51.517045 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:51.517045 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:49:51.517045 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:49:51.517045 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:49:51.517045 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:49:51.517045 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:49:51.517045 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:49:51.517045 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Apr 30 20:49:51.517045 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:51.517045 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 551/1095] 10.222.0.23 () {56 vars in 1093 bytes} [Sat Apr 30 20:49:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:49:51.517045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee987217-74c6-4304-a095-44e26c287205 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:51.532536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2454b9-cdea-45f0-8916-730030fa42be None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:51.565106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738cbe3-5e92-4573-915e-d3237a5c1cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:51.566008 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738cbe3-5e92-4573-915e-d3237a5c1cc0 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:51.566296 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738cbe3-5e92-4573-915e-d3237a5c1cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:51.566577 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738cbe3-5e92-4573-915e-d3237a5c1cc0 None admin] PATH_INFO: `/v3/users/69e50c22df0645959953e9c913620bc4` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:51.567782 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6738cbe3-5e92-4573-915e-d3237a5c1cc0 None admin] RBAC: Authorizing `identity:get_user(user_id=69e50c22df0645959953e9c913620bc4)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:51.569233 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6738cbe3-5e92-4573-915e-d3237a5c1cc0 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:51.570897 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 545/1096] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:49:51 2022] GET /identity/v3/users/69e50c22df0645959953e9c913620bc4 => generated 285 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:49:51.576562 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738cbe3-5e92-4573-915e-d3237a5c1cc0 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:51.611199 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee987217-74c6-4304-a095-44e26c287205 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:51.646885 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29ddf1-2aeb-4cd3-9c0d-7b88423642de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:51.647532 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29ddf1-2aeb-4cd3-9c0d-7b88423642de None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:51.647742 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29ddf1-2aeb-4cd3-9c0d-7b88423642de None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:51.648015 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29ddf1-2aeb-4cd3-9c0d-7b88423642de None admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:51.648834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd29ddf1-2aeb-4cd3-9c0d-7b88423642de None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:51.649140 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd29ddf1-2aeb-4cd3-9c0d-7b88423642de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:51.650607 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd29ddf1-2aeb-4cd3-9c0d-7b88423642de None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:51.667565 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 552/1097] 10.222.0.23 () {56 vars in 1133 bytes} [Sat Apr 30 20:49:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:49:51.672379 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738cbe3-5e92-4573-915e-d3237a5c1cc0 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:51.673656 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29ddf1-2aeb-4cd3-9c0d-7b88423642de None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:51.704770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095fa117-484d-493b-a9b0-48cccf13f6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:51.705418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fa117-484d-493b-a9b0-48cccf13f6af None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:51.705713 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fa117-484d-493b-a9b0-48cccf13f6af None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:51.706016 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fa117-484d-493b-a9b0-48cccf13f6af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:51.766165 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29ddf1-2aeb-4cd3-9c0d-7b88423642de None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:51.770449 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095fa117-484d-493b-a9b0-48cccf13f6af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:51.771916 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095fa117-484d-493b-a9b0-48cccf13f6af None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:51.798291 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50357ad5-7613-4359-8f4e-7158b49a5c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:51.798923 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50357ad5-7613-4359-8f4e-7158b49a5c8d None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:51.799207 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50357ad5-7613-4359-8f4e-7158b49a5c8d None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:51.799482 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50357ad5-7613-4359-8f4e-7158b49a5c8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:51.862669 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50357ad5-7613-4359-8f4e-7158b49a5c8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:51.864117 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50357ad5-7613-4359-8f4e-7158b49a5c8d None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:51.864979 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 546/1098] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:49:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 30 20:49:51.870731 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095fa117-484d-493b-a9b0-48cccf13f6af None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:51.956221 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 553/1099] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:49:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 30 20:49:51.961954 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50357ad5-7613-4359-8f4e-7158b49a5c8d None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:51.963040 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095fa117-484d-493b-a9b0-48cccf13f6af None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:51.995794 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f1ab7-c89f-47c0-a0e5-4958522f0ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:51.996697 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f1ab7-c89f-47c0-a0e5-4958522f0ffe None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:51.996978 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f1ab7-c89f-47c0-a0e5-4958522f0ffe None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:51.997271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f1ab7-c89f-47c0-a0e5-4958522f0ffe None admin] PATH_INFO: `/v3/projects/41a075d1b08a4d73ad9ec64c6ee885ee` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:51.998440 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955f1ab7-c89f-47c0-a0e5-4958522f0ffe None admin] RBAC: Authorizing `identity:get_project(project_id=41a075d1b08a4d73ad9ec64c6ee885ee)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:51.999867 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955f1ab7-c89f-47c0-a0e5-4958522f0ffe None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:52.006402 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 547/1100] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:49:51 2022] GET /identity/v3/projects/41a075d1b08a4d73ad9ec64c6ee885ee => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:49:52.007347 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f1ab7-c89f-47c0-a0e5-4958522f0ffe None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:52.054569 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50357ad5-7613-4359-8f4e-7158b49a5c8d None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:52.087598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1a1eb-b525-440b-91e0-99bd7c2dd1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:52.089229 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1a1eb-b525-440b-91e0-99bd7c2dd1a8 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:52.089511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1a1eb-b525-440b-91e0-99bd7c2dd1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:52.089800 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1a1eb-b525-440b-91e0-99bd7c2dd1a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:52.100190 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f1a1eb-b525-440b-91e0-99bd7c2dd1a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:52.101619 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f1a1eb-b525-440b-91e0-99bd7c2dd1a8 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:52.117912 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f1ab7-c89f-47c0-a0e5-4958522f0ffe None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:52.118346 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-e8f1a1eb-b525-440b-91e0-99bd7c2dd1a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:52.118346 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:52.118346 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:52.118346 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:52.118346 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:52.118346 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:52.118346 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:52.118346 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:52.118346 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:52.118346 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:52.118346 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:52.118346 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:52.118346 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:49:52.118346 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:49:52.118346 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:49:52.119293 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:49:52.119293 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:52.119293 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:52.119293 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:52.119293 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:52.119293 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:52.119293 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:52.119293 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:52.119293 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:52.119293 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:52.119293 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:52.119293 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:52.119293 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:52.119293 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:52.119293 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:52.119293 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:52.119293 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:52.120630 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:49:52.120630 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:49:52.120630 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:49:52.120630 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:49:52.120630 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 554/1101] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:49:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:49:52.125526 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1a1eb-b525-440b-91e0-99bd7c2dd1a8 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:52.152981 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45add626-ce54-408b-bc86-d3e1420a0a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:52.153634 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45add626-ce54-408b-bc86-d3e1420a0a89 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:52.153946 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45add626-ce54-408b-bc86-d3e1420a0a89 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:52.154219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45add626-ce54-408b-bc86-d3e1420a0a89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:52.155033 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45add626-ce54-408b-bc86-d3e1420a0a89 None admin] RBAC: Adding query filter params (role.id=30112eb1f3e047398c3c82fb40b72e62, scope.project.id=41a075d1b08a4d73ad9ec64c6ee885ee, user.id=69e50c22df0645959953e9c913620bc4) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:52.155344 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45add626-ce54-408b-bc86-d3e1420a0a89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:52.156802 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45add626-ce54-408b-bc86-d3e1420a0a89 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:52.162456 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 548/1102] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:49:52 2022] GET /identity/v3/role_assignments?user.id=69e50c22df0645959953e9c913620bc4&scope.project.id=41a075d1b08a4d73ad9ec64c6ee885ee&role.id=30112eb1f3e047398c3c82fb40b72e62 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:52.223220 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1a1eb-b525-440b-91e0-99bd7c2dd1a8 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:52.258144 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d5e9c-272d-4205-8e9b-d0c47ab3169b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:52.258816 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d5e9c-272d-4205-8e9b-d0c47ab3169b None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:52.259094 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d5e9c-272d-4205-8e9b-d0c47ab3169b None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:52.259365 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d5e9c-272d-4205-8e9b-d0c47ab3169b None admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:52.260092 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d5e9c-272d-4205-8e9b-d0c47ab3169b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:52.260393 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d5e9c-272d-4205-8e9b-d0c47ab3169b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:52.261799 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d5e9c-272d-4205-8e9b-d0c47ab3169b None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:52.274771 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 555/1103] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:49:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:49:52.280369 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45add626-ce54-408b-bc86-d3e1420a0a89 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:52.379730 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45add626-ce54-408b-bc86-d3e1420a0a89 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:52.415146 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99815c8-5870-423c-bc8c-17efa61735c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:52.416241 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99815c8-5870-423c-bc8c-17efa61735c3 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:52.416528 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99815c8-5870-423c-bc8c-17efa61735c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:52.416811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99815c8-5870-423c-bc8c-17efa61735c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:52.427634 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99815c8-5870-423c-bc8c-17efa61735c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:52.429096 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99815c8-5870-423c-bc8c-17efa61735c3 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:52.443926 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-c99815c8-5870-423c-bc8c-17efa61735c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:49:52.443926 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:49:52.443926 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:49:52.443926 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:49:52.443926 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:49:52.443926 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:49:52.443926 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:49:52.443926 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:49:52.443926 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:49:52.443926 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:49:52.443926 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:49:52.443926 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:49:52.443926 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:49:52.443926 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:49:52.443926 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:49:52.444919 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:49:52.444919 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:49:52.444919 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:49:52.444919 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:49:52.444919 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:49:52.444919 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:49:52.444919 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:49:52.444919 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:49:52.444919 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:49:52.444919 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:49:52.444919 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:49:52.444919 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:49:52.444919 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:49:52.444919 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:49:52.444919 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:49:52.444919 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:49:52.444919 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:49:52.446217 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:49:52.446217 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:49:52.446217 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:49:52.446217 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:49:52.446217 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:49:52.446217 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:49:52.446217 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:49:52.446217 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:49:52.446217 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 549/1104] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:49:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:49:52.450886 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d5e9c-272d-4205-8e9b-d0c47ab3169b None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:52.545818 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d5e9c-272d-4205-8e9b-d0c47ab3169b None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:52.577622 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f96323-8901-472e-93a4-32bb37e74810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:52.578309 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f96323-8901-472e-93a4-32bb37e74810 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:52.578592 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f96323-8901-472e-93a4-32bb37e74810 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:52.578866 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f96323-8901-472e-93a4-32bb37e74810 None admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:52.579643 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f96323-8901-472e-93a4-32bb37e74810 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:52.579953 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f96323-8901-472e-93a4-32bb37e74810 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:52.581393 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f96323-8901-472e-93a4-32bb37e74810 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:52.593002 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 556/1105] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Apr 30 20:49:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:52.599227 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99815c8-5870-423c-bc8c-17efa61735c3 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:52.693167 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99815c8-5870-423c-bc8c-17efa61735c3 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:52.724738 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f575c-7d44-4c8c-846b-91feb55048f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:52.725373 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f575c-7d44-4c8c-846b-91feb55048f0 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:52.725653 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f575c-7d44-4c8c-846b-91feb55048f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:52.725959 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f575c-7d44-4c8c-846b-91feb55048f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:52.726768 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18f575c-7d44-4c8c-846b-91feb55048f0 None admin] RBAC: Adding query filter params (role.id=058cab574a7548388406f3e3d6bb5779, scope.project.id=6b52e5e13b9144dfb663578766c2bac0, user.id=fca4ee1f64c8489ebe7296f9f8f0ab41) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:52.727075 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18f575c-7d44-4c8c-846b-91feb55048f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:52.728498 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18f575c-7d44-4c8c-846b-91feb55048f0 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:52.734682 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 550/1106] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:49:52 2022] GET /identity/v3/role_assignments?user.id=fca4ee1f64c8489ebe7296f9f8f0ab41&scope.project.id=6b52e5e13b9144dfb663578766c2bac0&role.id=058cab574a7548388406f3e3d6bb5779 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:54.498110 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83776b72-dbb6-4d39-9860-3d5a6f69bac3 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:54.498621 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83776b72-dbb6-4d39-9860-3d5a6f69bac3 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:54.498854 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83776b72-dbb6-4d39-9860-3d5a6f69bac3 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:54.500291 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 557/1107] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:49:54.505324 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c3de2-79fa-4d88-a955-d75b66cf17a1 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:54.505781 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c3de2-79fa-4d88-a955-d75b66cf17a1 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:54.505935 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c3de2-79fa-4d88-a955-d75b66cf17a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:54.523903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-ca0c3de2-79fa-4d88-a955-d75b66cf17a1 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:54.525386 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ca0c3de2-79fa-4d88-a955-d75b66cf17a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:54.591336 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 551/1108] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:49:54.616836 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83776b72-dbb6-4d39-9860-3d5a6f69bac3 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:54.714889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83776b72-dbb6-4d39-9860-3d5a6f69bac3 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:54.747551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7fcca1-5f28-43dc-97ee-45658bba681d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:54.748327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fcca1-5f28-43dc-97ee-45658bba681d None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:54.748605 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fcca1-5f28-43dc-97ee-45658bba681d None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:54.748877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fcca1-5f28-43dc-97ee-45658bba681d None admin] PATH_INFO: `/v3/domains/default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:54.750065 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7fcca1-5f28-43dc-97ee-45658bba681d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:54.751492 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7fcca1-5f28-43dc-97ee-45658bba681d None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:54.753073 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 558/1109] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:49:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:54.758924 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c3de2-79fa-4d88-a955-d75b66cf17a1 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:54.850368 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c3de2-79fa-4d88-a955-d75b66cf17a1 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:54.882909 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536672d2-4234-4760-96d3-5f80aa69b6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:54.883568 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536672d2-4234-4760-96d3-5f80aa69b6ca None admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:54.883849 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536672d2-4234-4760-96d3-5f80aa69b6ca None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:54.884123 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536672d2-4234-4760-96d3-5f80aa69b6ca None admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:54.884827 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536672d2-4234-4760-96d3-5f80aa69b6ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:54.886297 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536672d2-4234-4760-96d3-5f80aa69b6ca None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:55.035597 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 552/1110] 10.222.0.23 () {60 vars in 1132 bytes} [Sat Apr 30 20:49:54 2022] POST /identity/v3/users => generated 286 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:49:57.367603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29dc66d-77b8-4d05-8e67-c434dc17a3d5 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:57.368116 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29dc66d-77b8-4d05-8e67-c434dc17a3d5 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:57.368233 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29dc66d-77b8-4d05-8e67-c434dc17a3d5 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:57.369498 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 559/1111] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:49:57.374580 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2834a6c-c8f6-4b62-8b2f-3c193bec9122 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:57.374995 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2834a6c-c8f6-4b62-8b2f-3c193bec9122 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:57.375139 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2834a6c-c8f6-4b62-8b2f-3c193bec9122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:57.391387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-f2834a6c-c8f6-4b62-8b2f-3c193bec9122 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:49:57.392557 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f2834a6c-c8f6-4b62-8b2f-3c193bec9122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:49:57.455951 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 553/1112] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:49:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:49:57.481407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29dc66d-77b8-4d05-8e67-c434dc17a3d5 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:57.576805 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29dc66d-77b8-4d05-8e67-c434dc17a3d5 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:57.609607 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34853232-3f0f-4423-ac20-53f069b63b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:57.610474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34853232-3f0f-4423-ac20-53f069b63b0d None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:57.610753 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34853232-3f0f-4423-ac20-53f069b63b0d None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:57.611026 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34853232-3f0f-4423-ac20-53f069b63b0d None admin] PATH_INFO: `/v3/roles/121b12a250ae4ef8ae1a85ea8c21c4fa` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:57.612474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34853232-3f0f-4423-ac20-53f069b63b0d None admin] RBAC: Authorizing `identity:get_role(role_id=121b12a250ae4ef8ae1a85ea8c21c4fa)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:57.613876 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34853232-3f0f-4423-ac20-53f069b63b0d None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:57.615219 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 560/1113] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:49:57 2022] GET /identity/v3/roles/121b12a250ae4ef8ae1a85ea8c21c4fa => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:57.620914 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2834a6c-c8f6-4b62-8b2f-3c193bec9122 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:57.716001 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2834a6c-c8f6-4b62-8b2f-3c193bec9122 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:57.748296 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbba28c-aecc-40e8-9520-a2e90e50a696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:57.749155 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbba28c-aecc-40e8-9520-a2e90e50a696 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:57.749437 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbba28c-aecc-40e8-9520-a2e90e50a696 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:57.749712 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbba28c-aecc-40e8-9520-a2e90e50a696 None admin] PATH_INFO: `/v3/users/8df3505d8a4c44118741f6aa454f8b4b` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:57.762732 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbba28c-aecc-40e8-9520-a2e90e50a696 None admin] RBAC: Authorizing `identity:get_user(user_id=8df3505d8a4c44118741f6aa454f8b4b)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:57.764181 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbba28c-aecc-40e8-9520-a2e90e50a696 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:57.765893 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 554/1114] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:49:57 2022] GET /identity/v3/users/8df3505d8a4c44118741f6aa454f8b4b => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:57.771650 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34853232-3f0f-4423-ac20-53f069b63b0d None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:57.865850 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34853232-3f0f-4423-ac20-53f069b63b0d None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:57.897820 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a9a35-4df0-4490-bd60-031ed750b9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:57.898488 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a9a35-4df0-4490-bd60-031ed750b9f8 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:57.898742 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a9a35-4df0-4490-bd60-031ed750b9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:57.899013 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a9a35-4df0-4490-bd60-031ed750b9f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:57.962321 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a9a35-4df0-4490-bd60-031ed750b9f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:57.963770 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a9a35-4df0-4490-bd60-031ed750b9f8 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:58.055694 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 561/1115] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:49:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 30 20:49:58.062215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbba28c-aecc-40e8-9520-a2e90e50a696 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:58.155416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbba28c-aecc-40e8-9520-a2e90e50a696 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:58.193716 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c9faa-40f9-48b2-9be2-58b3150ca0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:58.194594 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c9faa-40f9-48b2-9be2-58b3150ca0bb None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:58.194871 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c9faa-40f9-48b2-9be2-58b3150ca0bb None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:58.195142 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c9faa-40f9-48b2-9be2-58b3150ca0bb None admin] PATH_INFO: `/v3/projects/41a075d1b08a4d73ad9ec64c6ee885ee` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:58.196291 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c9faa-40f9-48b2-9be2-58b3150ca0bb None admin] RBAC: Authorizing `identity:get_project(project_id=41a075d1b08a4d73ad9ec64c6ee885ee)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:58.197739 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c9faa-40f9-48b2-9be2-58b3150ca0bb None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:58.201367 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 555/1116] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:49:58 2022] GET /identity/v3/projects/41a075d1b08a4d73ad9ec64c6ee885ee => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:49:58.207836 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a9a35-4df0-4490-bd60-031ed750b9f8 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:49:58.300269 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a9a35-4df0-4490-bd60-031ed750b9f8 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:49:58.332285 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0305d-85fd-4c02-b9aa-9e4680212d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:49:58.332922 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0305d-85fd-4c02-b9aa-9e4680212d09 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:49:58.333197 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0305d-85fd-4c02-b9aa-9e4680212d09 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:49:58.333463 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0305d-85fd-4c02-b9aa-9e4680212d09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:49:58.334301 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd0305d-85fd-4c02-b9aa-9e4680212d09 None admin] RBAC: Adding query filter params (role.id=121b12a250ae4ef8ae1a85ea8c21c4fa, scope.project.id=41a075d1b08a4d73ad9ec64c6ee885ee, user.id=8df3505d8a4c44118741f6aa454f8b4b) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:49:58.334609 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd0305d-85fd-4c02-b9aa-9e4680212d09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:49:58.336021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd0305d-85fd-4c02-b9aa-9e4680212d09 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:49:58.341156 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 562/1117] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:49:58 2022] GET /identity/v3/role_assignments?user.id=8df3505d8a4c44118741f6aa454f8b4b&scope.project.id=41a075d1b08a4d73ad9ec64c6ee885ee&role.id=121b12a250ae4ef8ae1a85ea8c21c4fa => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:50:00.637374 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86938016-35cd-4ce2-9e22-710a25d44b76 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:00.637926 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86938016-35cd-4ce2-9e22-710a25d44b76 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:00.637926 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86938016-35cd-4ce2-9e22-710a25d44b76 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:00.639243 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 556/1118] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:50:00.644485 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf65bd0-df2e-4686-8072-816a1002b5d8 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:00.644894 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf65bd0-df2e-4686-8072-816a1002b5d8 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:00.645040 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf65bd0-df2e-4686-8072-816a1002b5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:00.661657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-bbf65bd0-df2e-4686-8072-816a1002b5d8 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:50:00.662852 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-bbf65bd0-df2e-4686-8072-816a1002b5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:50:00.725771 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 563/1119] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:50:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:50:00.748274 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86938016-35cd-4ce2-9e22-710a25d44b76 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:00.847741 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86938016-35cd-4ce2-9e22-710a25d44b76 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:00.880241 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac204d1-d576-431a-a19d-f5929d3b7ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:00.881077 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac204d1-d576-431a-a19d-f5929d3b7ff2 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:00.881356 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac204d1-d576-431a-a19d-f5929d3b7ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:00.881627 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac204d1-d576-431a-a19d-f5929d3b7ff2 None admin] PATH_INFO: `/v3/roles/121b12a250ae4ef8ae1a85ea8c21c4fa` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:00.883108 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac204d1-d576-431a-a19d-f5929d3b7ff2 None admin] RBAC: Authorizing `identity:get_role(role_id=121b12a250ae4ef8ae1a85ea8c21c4fa)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:00.884477 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac204d1-d576-431a-a19d-f5929d3b7ff2 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:00.885847 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 557/1120] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:50:00 2022] GET /identity/v3/roles/121b12a250ae4ef8ae1a85ea8c21c4fa => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:50:00.892270 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf65bd0-df2e-4686-8072-816a1002b5d8 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:00.985283 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf65bd0-df2e-4686-8072-816a1002b5d8 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:01.017746 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ddfc6-1741-4999-96a8-9507a4b3f09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:01.018627 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ddfc6-1741-4999-96a8-9507a4b3f09a None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:01.018909 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ddfc6-1741-4999-96a8-9507a4b3f09a None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:01.019183 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ddfc6-1741-4999-96a8-9507a4b3f09a None admin] PATH_INFO: `/v3/users/8df3505d8a4c44118741f6aa454f8b4b` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:01.020350 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ddfc6-1741-4999-96a8-9507a4b3f09a None admin] RBAC: Authorizing `identity:get_user(user_id=8df3505d8a4c44118741f6aa454f8b4b)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:01.021819 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ddfc6-1741-4999-96a8-9507a4b3f09a None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:01.023538 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 564/1121] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:50:00 2022] GET /identity/v3/users/8df3505d8a4c44118741f6aa454f8b4b => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:50:01.029765 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac204d1-d576-431a-a19d-f5929d3b7ff2 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:01.127955 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac204d1-d576-431a-a19d-f5929d3b7ff2 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:01.160751 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d712d7-c052-4246-9b34-da8d22ca61a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:01.161532 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d712d7-c052-4246-9b34-da8d22ca61a1 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:01.161843 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d712d7-c052-4246-9b34-da8d22ca61a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:01.162119 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d712d7-c052-4246-9b34-da8d22ca61a1 None admin] PATH_INFO: `/v3/projects/41a075d1b08a4d73ad9ec64c6ee885ee` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:01.163280 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d712d7-c052-4246-9b34-da8d22ca61a1 None admin] RBAC: Authorizing `identity:get_project(project_id=41a075d1b08a4d73ad9ec64c6ee885ee)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:01.164702 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d712d7-c052-4246-9b34-da8d22ca61a1 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:01.166412 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 558/1122] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:50:01 2022] GET /identity/v3/projects/41a075d1b08a4d73ad9ec64c6ee885ee => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:50:01.172423 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ddfc6-1741-4999-96a8-9507a4b3f09a None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:01.267438 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ddfc6-1741-4999-96a8-9507a4b3f09a None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:01.299165 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6353c5-ba12-4cdc-9f4b-d18af75c6a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:01.300043 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6353c5-ba12-4cdc-9f4b-d18af75c6a6f None admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:01.300320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6353c5-ba12-4cdc-9f4b-d18af75c6a6f None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:01.300589 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6353c5-ba12-4cdc-9f4b-d18af75c6a6f None admin] PATH_INFO: `/v3/projects/41a075d1b08a4d73ad9ec64c6ee885ee/users/8df3505d8a4c44118741f6aa454f8b4b/roles/121b12a250ae4ef8ae1a85ea8c21c4fa` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:01.302782 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6353c5-ba12-4cdc-9f4b-d18af75c6a6f None admin] RBAC: Authorizing `identity:create_grant(project_id=41a075d1b08a4d73ad9ec64c6ee885ee, user_id=8df3505d8a4c44118741f6aa454f8b4b, role_id=121b12a250ae4ef8ae1a85ea8c21c4fa)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:01.304246 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6353c5-ba12-4cdc-9f4b-d18af75c6a6f None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:01.396002 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 565/1123] 10.222.0.23 () {58 vars in 1439 bytes} [Sat Apr 30 20:50:01 2022] PUT /identity/v3/projects/41a075d1b08a4d73ad9ec64c6ee885ee/users/8df3505d8a4c44118741f6aa454f8b4b/roles/121b12a250ae4ef8ae1a85ea8c21c4fa => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:50:03.653219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6250d-ba60-44f2-a942-732c50956cdb None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:03.653725 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6250d-ba60-44f2-a942-732c50956cdb None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:03.653725 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6250d-ba60-44f2-a942-732c50956cdb None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:03.655067 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 559/1124] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:50:03.660314 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f342c-4266-4353-8d96-27a3227a99ed None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:03.660713 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f342c-4266-4353-8d96-27a3227a99ed None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:03.660956 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f342c-4266-4353-8d96-27a3227a99ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:03.677866 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-588f342c-4266-4353-8d96-27a3227a99ed None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:50:03.679046 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-588f342c-4266-4353-8d96-27a3227a99ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:50:03.740903 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 566/1125] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:50:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:50:03.765851 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6250d-ba60-44f2-a942-732c50956cdb None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:03.860954 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6250d-ba60-44f2-a942-732c50956cdb None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:03.892540 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92553c5a-bbc7-4bca-9e1c-41908aef2cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:03.893366 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92553c5a-bbc7-4bca-9e1c-41908aef2cb4 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:03.893645 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92553c5a-bbc7-4bca-9e1c-41908aef2cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:03.893948 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92553c5a-bbc7-4bca-9e1c-41908aef2cb4 None admin] PATH_INFO: `/v3/roles/121b12a250ae4ef8ae1a85ea8c21c4fa` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:03.895396 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92553c5a-bbc7-4bca-9e1c-41908aef2cb4 None admin] RBAC: Authorizing `identity:get_role(role_id=121b12a250ae4ef8ae1a85ea8c21c4fa)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:03.896761 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92553c5a-bbc7-4bca-9e1c-41908aef2cb4 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:03.898124 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 560/1126] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:50:03 2022] GET /identity/v3/roles/121b12a250ae4ef8ae1a85ea8c21c4fa => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:50:03.903663 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588f342c-4266-4353-8d96-27a3227a99ed None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:03.995976 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588f342c-4266-4353-8d96-27a3227a99ed None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:04.028698 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c098e-3122-42e6-9879-79fc9033a78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:04.029543 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c098e-3122-42e6-9879-79fc9033a78c None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:04.029853 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c098e-3122-42e6-9879-79fc9033a78c None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:04.030130 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c098e-3122-42e6-9879-79fc9033a78c None admin] PATH_INFO: `/v3/users/8df3505d8a4c44118741f6aa454f8b4b` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:04.031299 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c098e-3122-42e6-9879-79fc9033a78c None admin] RBAC: Authorizing `identity:get_user(user_id=8df3505d8a4c44118741f6aa454f8b4b)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:04.032723 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c098e-3122-42e6-9879-79fc9033a78c None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:04.034352 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 567/1127] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:50:03 2022] GET /identity/v3/users/8df3505d8a4c44118741f6aa454f8b4b => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:50:04.040094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92553c5a-bbc7-4bca-9e1c-41908aef2cb4 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:04.133720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92553c5a-bbc7-4bca-9e1c-41908aef2cb4 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:04.165823 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a376bf-0300-4567-84fe-3c9b10ec0451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:04.166420 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a376bf-0300-4567-84fe-3c9b10ec0451 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:04.166703 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a376bf-0300-4567-84fe-3c9b10ec0451 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:04.167056 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a376bf-0300-4567-84fe-3c9b10ec0451 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:04.231139 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a376bf-0300-4567-84fe-3c9b10ec0451 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:04.232594 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a376bf-0300-4567-84fe-3c9b10ec0451 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:04.324591 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 561/1128] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:50:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 30 20:50:04.330422 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c098e-3122-42e6-9879-79fc9033a78c None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:04.424171 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c098e-3122-42e6-9879-79fc9033a78c None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:04.461395 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc44ea1-c1c6-41b8-b1a2-18873ab3c2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:04.462679 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc44ea1-c1c6-41b8-b1a2-18873ab3c2c3 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:04.462966 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc44ea1-c1c6-41b8-b1a2-18873ab3c2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:04.463240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc44ea1-c1c6-41b8-b1a2-18873ab3c2c3 None admin] PATH_INFO: `/v3/projects/41a075d1b08a4d73ad9ec64c6ee885ee` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:04.464485 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc44ea1-c1c6-41b8-b1a2-18873ab3c2c3 None admin] RBAC: Authorizing `identity:get_project(project_id=41a075d1b08a4d73ad9ec64c6ee885ee)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:04.466573 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc44ea1-c1c6-41b8-b1a2-18873ab3c2c3 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:04.468259 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 568/1129] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:50:04 2022] GET /identity/v3/projects/41a075d1b08a4d73ad9ec64c6ee885ee => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:50:04.474610 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a376bf-0300-4567-84fe-3c9b10ec0451 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:04.567842 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a376bf-0300-4567-84fe-3c9b10ec0451 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:04.600485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f8fb3-9756-4fd3-9186-04d45c51960e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:04.601128 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f8fb3-9756-4fd3-9186-04d45c51960e None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:04.601410 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f8fb3-9756-4fd3-9186-04d45c51960e None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:04.601686 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f8fb3-9756-4fd3-9186-04d45c51960e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:04.602533 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f8fb3-9756-4fd3-9186-04d45c51960e None admin] RBAC: Adding query filter params (role.id=121b12a250ae4ef8ae1a85ea8c21c4fa, scope.project.id=41a075d1b08a4d73ad9ec64c6ee885ee, user.id=8df3505d8a4c44118741f6aa454f8b4b) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:50:04.602844 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f8fb3-9756-4fd3-9186-04d45c51960e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:04.604274 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f8fb3-9756-4fd3-9186-04d45c51960e None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:04.609999 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 562/1130] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:50:04 2022] GET /identity/v3/role_assignments?user.id=8df3505d8a4c44118741f6aa454f8b4b&scope.project.id=41a075d1b08a4d73ad9ec64c6ee885ee&role.id=121b12a250ae4ef8ae1a85ea8c21c4fa => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:50:06.930416 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd9e66-8f26-4b4a-9c84-caf6a0fff018 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:06.930972 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd9e66-8f26-4b4a-9c84-caf6a0fff018 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:06.930972 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd9e66-8f26-4b4a-9c84-caf6a0fff018 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:06.932302 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 569/1131] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:50:06.937459 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578170a1-484f-4110-a176-0c3f31519fbf None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:06.937888 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578170a1-484f-4110-a176-0c3f31519fbf None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:06.938050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578170a1-484f-4110-a176-0c3f31519fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:06.955311 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-578170a1-484f-4110-a176-0c3f31519fbf None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:50:06.956475 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-578170a1-484f-4110-a176-0c3f31519fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:50:07.018350 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 563/1132] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:50:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:50:07.043341 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd9e66-8f26-4b4a-9c84-caf6a0fff018 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:07.140424 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd9e66-8f26-4b4a-9c84-caf6a0fff018 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:07.171487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219fed8-034b-480a-8e1e-778b2d2644e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:07.172266 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219fed8-034b-480a-8e1e-778b2d2644e7 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:07.172543 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219fed8-034b-480a-8e1e-778b2d2644e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:07.172812 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219fed8-034b-480a-8e1e-778b2d2644e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:07.174005 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a219fed8-034b-480a-8e1e-778b2d2644e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:07.175435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a219fed8-034b-480a-8e1e-778b2d2644e7 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:07.177015 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 570/1133] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:50:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:50:07.182777 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578170a1-484f-4110-a176-0c3f31519fbf None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:07.276725 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578170a1-484f-4110-a176-0c3f31519fbf None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:07.310876 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef12e6f-96e9-4812-9c22-19c68d99fb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:07.311541 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef12e6f-96e9-4812-9c22-19c68d99fb53 None admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:07.311826 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef12e6f-96e9-4812-9c22-19c68d99fb53 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:07.312103 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef12e6f-96e9-4812-9c22-19c68d99fb53 None admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:07.312806 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef12e6f-96e9-4812-9c22-19c68d99fb53 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:07.314314 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef12e6f-96e9-4812-9c22-19c68d99fb53 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:07.454926 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 564/1134] 10.222.0.23 () {60 vars in 1141 bytes} [Sat Apr 30 20:50:07 2022] POST /identity/v3/projects => generated 311 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:50:09.759544 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968626c2-65a3-481c-a53b-0ab9c4ef7672 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:09.760103 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968626c2-65a3-481c-a53b-0ab9c4ef7672 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:09.760103 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968626c2-65a3-481c-a53b-0ab9c4ef7672 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:09.761435 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 571/1135] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:50:09.767060 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f4140-94f7-498d-9131-b0eec93a1e25 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:09.767494 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f4140-94f7-498d-9131-b0eec93a1e25 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:09.767622 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f4140-94f7-498d-9131-b0eec93a1e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:09.784515 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-3b0f4140-94f7-498d-9131-b0eec93a1e25 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:50:09.785690 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3b0f4140-94f7-498d-9131-b0eec93a1e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:50:09.849240 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 565/1136] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:50:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:50:09.875648 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968626c2-65a3-481c-a53b-0ab9c4ef7672 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:09.972568 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968626c2-65a3-481c-a53b-0ab9c4ef7672 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:10.004182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74976d31-e6a8-467d-901f-de01a60791fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:10.004942 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74976d31-e6a8-467d-901f-de01a60791fa None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:10.005219 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74976d31-e6a8-467d-901f-de01a60791fa None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:10.005488 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74976d31-e6a8-467d-901f-de01a60791fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:10.006658 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74976d31-e6a8-467d-901f-de01a60791fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:10.008081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74976d31-e6a8-467d-901f-de01a60791fa None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:10.009699 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 572/1137] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:50:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:50:10.015722 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f4140-94f7-498d-9131-b0eec93a1e25 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:10.109895 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f4140-94f7-498d-9131-b0eec93a1e25 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:10.142665 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710af7e-aa26-40e7-9fca-2f186c8b05d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:10.143329 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710af7e-aa26-40e7-9fca-2f186c8b05d2 None admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:10.143614 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710af7e-aa26-40e7-9fca-2f186c8b05d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:10.143891 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710af7e-aa26-40e7-9fca-2f186c8b05d2 None admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:10.144588 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710af7e-aa26-40e7-9fca-2f186c8b05d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:10.146066 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710af7e-aa26-40e7-9fca-2f186c8b05d2 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:10.236232 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 566/1138] 10.222.0.23 () {60 vars in 1132 bytes} [Sat Apr 30 20:50:10 2022] POST /identity/v3/users => generated 286 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:50:12.540536 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d40629-9330-4e3c-9b14-e19a1235490c None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:12.541048 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d40629-9330-4e3c-9b14-e19a1235490c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:12.541048 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d40629-9330-4e3c-9b14-e19a1235490c None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:12.542383 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 573/1139] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:50:12.547580 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c14e8-7f6c-4c79-ae1b-534fec6ddc1d None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:12.548032 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c14e8-7f6c-4c79-ae1b-534fec6ddc1d None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:12.548134 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c14e8-7f6c-4c79-ae1b-534fec6ddc1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:12.564716 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-d98c14e8-7f6c-4c79-ae1b-534fec6ddc1d None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:50:12.565912 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d98c14e8-7f6c-4c79-ae1b-534fec6ddc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:50:12.628030 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 567/1140] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:50:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:50:12.652278 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d40629-9330-4e3c-9b14-e19a1235490c None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:12.750179 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d40629-9330-4e3c-9b14-e19a1235490c None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:12.782202 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f280a-74c3-4371-93fe-58e9c60f0a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:12.782973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f280a-74c3-4371-93fe-58e9c60f0a78 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:12.783252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f280a-74c3-4371-93fe-58e9c60f0a78 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:12.783527 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f280a-74c3-4371-93fe-58e9c60f0a78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:12.793046 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f280a-74c3-4371-93fe-58e9c60f0a78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:50:12.800468 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-3e8f280a-74c3-4371-93fe-58e9c60f0a78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:50:12.800468 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:50:12.800468 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:50:12.800468 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:50:12.800468 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:50:12.800468 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:50:12.800468 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:50:12.800468 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:50:12.800468 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:50:12.800468 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:50:12.800468 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:50:12.800468 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:50:12.800468 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:50:12.800468 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:50:12.800468 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:50:12.800468 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:50:12.801623 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:50:12.801623 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:50:12.801623 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:50:12.801623 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:50:12.801623 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:50:12.801623 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:50:12.801623 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:50:12.801623 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:50:12.801623 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:50:12.801623 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:50:12.801623 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:50:12.801623 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:50:12.801623 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:50:12.801623 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:50:12.801623 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:50:12.801623 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:50:12.803026 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:50:12.803026 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:50:12.803026 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:50:12.803026 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:50:12.803026 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:50:12.803026 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:50:12.803026 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:50:12.803026 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:50:12.803026 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:50:12.803026 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:50:12.803026 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:50:12.803026 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:50:12.803026 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 574/1141] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Apr 30 20:50:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:50:12.807510 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c14e8-7f6c-4c79-ae1b-534fec6ddc1d None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:12.899679 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c14e8-7f6c-4c79-ae1b-534fec6ddc1d None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:12.931108 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed4faa-2454-4e9d-adc9-a04b8d973cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:12.931752 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed4faa-2454-4e9d-adc9-a04b8d973cc4 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:12.932032 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed4faa-2454-4e9d-adc9-a04b8d973cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:12.932302 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed4faa-2454-4e9d-adc9-a04b8d973cc4 None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:12.933031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed4faa-2454-4e9d-adc9-a04b8d973cc4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:50:12.933332 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed4faa-2454-4e9d-adc9-a04b8d973cc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:12.934750 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed4faa-2454-4e9d-adc9-a04b8d973cc4 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:12.942293 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 568/1142] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:50:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:50:12.947782 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f280a-74c3-4371-93fe-58e9c60f0a78 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:13.042048 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f280a-74c3-4371-93fe-58e9c60f0a78 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:13.073733 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635864a1-b333-4a22-bc23-e40a4a64ef63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:13.075188 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635864a1-b333-4a22-bc23-e40a4a64ef63 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:13.075503 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635864a1-b333-4a22-bc23-e40a4a64ef63 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:13.075779 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635864a1-b333-4a22-bc23-e40a4a64ef63 None admin] PATH_INFO: `/v3/users/44187e6b7e244f8a8aa7d2de61539246` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:13.088667 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635864a1-b333-4a22-bc23-e40a4a64ef63 None admin] RBAC: Authorizing `identity:get_user(user_id=44187e6b7e244f8a8aa7d2de61539246)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:13.090167 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635864a1-b333-4a22-bc23-e40a4a64ef63 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:13.091781 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 575/1143] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:50:12 2022] GET /identity/v3/users/44187e6b7e244f8a8aa7d2de61539246 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:50:13.097540 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed4faa-2454-4e9d-adc9-a04b8d973cc4 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:13.194842 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed4faa-2454-4e9d-adc9-a04b8d973cc4 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:13.227062 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf38f8-a730-4cc5-a7c0-c48d65fd4a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:13.227700 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf38f8-a730-4cc5-a7c0-c48d65fd4a54 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:13.227978 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf38f8-a730-4cc5-a7c0-c48d65fd4a54 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:13.228295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf38f8-a730-4cc5-a7c0-c48d65fd4a54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:13.292413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf38f8-a730-4cc5-a7c0-c48d65fd4a54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:13.294633 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf38f8-a730-4cc5-a7c0-c48d65fd4a54 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:13.386105 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 569/1144] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:50:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 30 20:50:13.392396 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635864a1-b333-4a22-bc23-e40a4a64ef63 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:13.484457 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635864a1-b333-4a22-bc23-e40a4a64ef63 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:13.515858 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e295b209-ce82-4523-8cdd-046a3b6b823e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:13.516695 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295b209-ce82-4523-8cdd-046a3b6b823e None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:13.516971 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295b209-ce82-4523-8cdd-046a3b6b823e None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:13.517240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e295b209-ce82-4523-8cdd-046a3b6b823e None admin] PATH_INFO: `/v3/projects/32fe18c7ad514194a6ce8578a7eed803` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:13.518388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e295b209-ce82-4523-8cdd-046a3b6b823e None admin] RBAC: Authorizing `identity:get_project(project_id=32fe18c7ad514194a6ce8578a7eed803)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:13.528347 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e295b209-ce82-4523-8cdd-046a3b6b823e None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:13.530299 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 576/1145] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:50:13 2022] GET /identity/v3/projects/32fe18c7ad514194a6ce8578a7eed803 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:50:13.536464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf38f8-a730-4cc5-a7c0-c48d65fd4a54 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:13.630357 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf38f8-a730-4cc5-a7c0-c48d65fd4a54 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:13.662682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33212d26-49f3-4dd2-86fa-886f493bf110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:13.663264 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33212d26-49f3-4dd2-86fa-886f493bf110 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:13.663544 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33212d26-49f3-4dd2-86fa-886f493bf110 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:13.663818 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33212d26-49f3-4dd2-86fa-886f493bf110 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:13.664634 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33212d26-49f3-4dd2-86fa-886f493bf110 None admin] RBAC: Adding query filter params (role.id=30112eb1f3e047398c3c82fb40b72e62, scope.project.id=32fe18c7ad514194a6ce8578a7eed803, user.id=44187e6b7e244f8a8aa7d2de61539246) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:50:13.664944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33212d26-49f3-4dd2-86fa-886f493bf110 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:13.666412 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33212d26-49f3-4dd2-86fa-886f493bf110 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:13.671611 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 570/1146] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:50:13 2022] GET /identity/v3/role_assignments?user.id=44187e6b7e244f8a8aa7d2de61539246&scope.project.id=32fe18c7ad514194a6ce8578a7eed803&role.id=30112eb1f3e047398c3c82fb40b72e62 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:50:15.951098 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf6ac3-5520-4ae9-91dc-f7a3eba19675 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:15.951658 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf6ac3-5520-4ae9-91dc-f7a3eba19675 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:15.951658 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf6ac3-5520-4ae9-91dc-f7a3eba19675 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:15.952982 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 577/1147] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:50:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:50:15.958194 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36fd1d-ebad-45de-a8d5-b6f5b82eea8a None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:15.958592 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36fd1d-ebad-45de-a8d5-b6f5b82eea8a None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:15.958751 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36fd1d-ebad-45de-a8d5-b6f5b82eea8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:15.975273 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-8a36fd1d-ebad-45de-a8d5-b6f5b82eea8a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:50:15.976436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8a36fd1d-ebad-45de-a8d5-b6f5b82eea8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:50:16.039392 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 571/1148] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:50:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:50:16.062868 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf6ac3-5520-4ae9-91dc-f7a3eba19675 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:16.162325 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf6ac3-5520-4ae9-91dc-f7a3eba19675 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:16.193676 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30387012-8c6e-4869-a6f0-a3f3061ee02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:16.194471 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30387012-8c6e-4869-a6f0-a3f3061ee02d None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:16.194749 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30387012-8c6e-4869-a6f0-a3f3061ee02d None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:16.195016 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30387012-8c6e-4869-a6f0-a3f3061ee02d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:16.205236 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30387012-8c6e-4869-a6f0-a3f3061ee02d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:50:16.212652 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-30387012-8c6e-4869-a6f0-a3f3061ee02d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:50:16.212652 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:50:16.212652 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:50:16.212652 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:50:16.212652 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:50:16.212652 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:50:16.212652 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:50:16.212652 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:50:16.212652 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:50:16.212652 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:50:16.212652 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:50:16.212652 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:50:16.212652 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:50:16.212652 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:50:16.212652 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:50:16.212652 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:50:16.213747 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:50:16.213747 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:50:16.213747 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:50:16.213747 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:50:16.213747 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:50:16.213747 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:50:16.213747 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:50:16.213747 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:50:16.213747 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:50:16.213747 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:50:16.213747 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:50:16.213747 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:50:16.213747 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:50:16.213747 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:50:16.213747 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:50:16.213747 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:50:16.214828 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:50:16.214828 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:50:16.214828 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:50:16.214828 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:50:16.214828 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:50:16.214828 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:50:16.214828 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:50:16.214828 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:50:16.214828 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:50:16.214828 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:50:16.214828 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:50:16.214828 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:50:16.214828 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 578/1149] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Apr 30 20:50:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:50:16.220221 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36fd1d-ebad-45de-a8d5-b6f5b82eea8a None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:16.314239 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36fd1d-ebad-45de-a8d5-b6f5b82eea8a None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:16.346404 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90494ef0-7313-48be-a1a9-6ffc377361a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:16.347062 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90494ef0-7313-48be-a1a9-6ffc377361a0 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:16.347347 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90494ef0-7313-48be-a1a9-6ffc377361a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:16.347625 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90494ef0-7313-48be-a1a9-6ffc377361a0 None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:16.348361 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90494ef0-7313-48be-a1a9-6ffc377361a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:50:16.348670 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90494ef0-7313-48be-a1a9-6ffc377361a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:16.350071 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90494ef0-7313-48be-a1a9-6ffc377361a0 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:16.358376 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 572/1150] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:50:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:50:16.364081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30387012-8c6e-4869-a6f0-a3f3061ee02d None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:16.462313 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30387012-8c6e-4869-a6f0-a3f3061ee02d None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:16.493937 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2f4ca-28a5-4846-a666-8c306dbc4582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:16.494777 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2f4ca-28a5-4846-a666-8c306dbc4582 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:16.495053 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2f4ca-28a5-4846-a666-8c306dbc4582 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:16.495324 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2f4ca-28a5-4846-a666-8c306dbc4582 None admin] PATH_INFO: `/v3/users/44187e6b7e244f8a8aa7d2de61539246` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:16.496552 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa2f4ca-28a5-4846-a666-8c306dbc4582 None admin] RBAC: Authorizing `identity:get_user(user_id=44187e6b7e244f8a8aa7d2de61539246)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:16.498661 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa2f4ca-28a5-4846-a666-8c306dbc4582 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:16.500268 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 579/1151] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:50:16 2022] GET /identity/v3/users/44187e6b7e244f8a8aa7d2de61539246 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:50:16.506028 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90494ef0-7313-48be-a1a9-6ffc377361a0 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:16.600060 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90494ef0-7313-48be-a1a9-6ffc377361a0 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:16.631841 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37ed91-49a9-43e7-9781-a0ae3392bf36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:16.632679 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37ed91-49a9-43e7-9781-a0ae3392bf36 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:16.632957 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37ed91-49a9-43e7-9781-a0ae3392bf36 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:16.633224 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37ed91-49a9-43e7-9781-a0ae3392bf36 None admin] PATH_INFO: `/v3/projects/32fe18c7ad514194a6ce8578a7eed803` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:16.634388 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf37ed91-49a9-43e7-9781-a0ae3392bf36 None admin] RBAC: Authorizing `identity:get_project(project_id=32fe18c7ad514194a6ce8578a7eed803)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:16.635813 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf37ed91-49a9-43e7-9781-a0ae3392bf36 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:16.637507 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 573/1152] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:50:16 2022] GET /identity/v3/projects/32fe18c7ad514194a6ce8578a7eed803 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:50:16.643349 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2f4ca-28a5-4846-a666-8c306dbc4582 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:16.737365 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2f4ca-28a5-4846-a666-8c306dbc4582 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:16.768535 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109c416-87ce-43c0-89ed-395ce67d4015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:16.769394 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109c416-87ce-43c0-89ed-395ce67d4015 None admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:16.769671 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109c416-87ce-43c0-89ed-395ce67d4015 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:16.769970 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109c416-87ce-43c0-89ed-395ce67d4015 None admin] PATH_INFO: `/v3/projects/32fe18c7ad514194a6ce8578a7eed803/users/44187e6b7e244f8a8aa7d2de61539246/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:16.771889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109c416-87ce-43c0-89ed-395ce67d4015 None admin] RBAC: Authorizing `identity:create_grant(project_id=32fe18c7ad514194a6ce8578a7eed803, user_id=44187e6b7e244f8a8aa7d2de61539246, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:16.773313 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109c416-87ce-43c0-89ed-395ce67d4015 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:16.870615 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 580/1153] 10.222.0.23 () {58 vars in 1439 bytes} [Sat Apr 30 20:50:16 2022] PUT /identity/v3/projects/32fe18c7ad514194a6ce8578a7eed803/users/44187e6b7e244f8a8aa7d2de61539246/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 20:50:19.131562 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f3f71-dfd9-471e-9131-c78038efaf5e None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:19.132093 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f3f71-dfd9-471e-9131-c78038efaf5e None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:19.132093 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f3f71-dfd9-471e-9131-c78038efaf5e None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:19.133456 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 574/1154] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:50:19.139064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372ab1d-967f-4911-a5b2-d09e8a1a8a18 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:19.139470 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372ab1d-967f-4911-a5b2-d09e8a1a8a18 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:19.139611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372ab1d-967f-4911-a5b2-d09e8a1a8a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:19.155727 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-9372ab1d-967f-4911-a5b2-d09e8a1a8a18 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:50:19.156893 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9372ab1d-967f-4911-a5b2-d09e8a1a8a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:50:19.218607 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 581/1155] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:50:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:50:19.242919 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f3f71-dfd9-471e-9131-c78038efaf5e None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:19.339715 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f3f71-dfd9-471e-9131-c78038efaf5e None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:19.371666 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18524c-cf62-40d8-b74e-e1b6132099df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:19.372548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18524c-cf62-40d8-b74e-e1b6132099df None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:19.372825 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18524c-cf62-40d8-b74e-e1b6132099df None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:19.373090 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18524c-cf62-40d8-b74e-e1b6132099df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:19.383109 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18524c-cf62-40d8-b74e-e1b6132099df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:50:19.391212 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-4c18524c-cf62-40d8-b74e-e1b6132099df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:50:19.391212 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:50:19.391212 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:50:19.391212 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:50:19.391212 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:50:19.391212 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:50:19.391212 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:50:19.391212 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:50:19.391212 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:50:19.391212 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:50:19.391212 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:50:19.391212 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:50:19.391212 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:50:19.391212 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:50:19.391212 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:50:19.391212 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:50:19.395522 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:50:19.395522 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:50:19.395522 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:50:19.395522 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:50:19.395522 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:50:19.395522 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:50:19.395522 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:50:19.395522 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:50:19.395522 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:50:19.395522 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:50:19.395522 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:50:19.395522 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:50:19.395522 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:50:19.395522 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:50:19.395522 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:50:19.395522 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:50:19.396597 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:50:19.396597 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:50:19.396597 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:50:19.396597 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:50:19.396597 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:50:19.396597 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:50:19.396597 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:50:19.396597 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:50:19.396597 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:50:19.396597 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:50:19.396597 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:50:19.396597 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:50:19.396597 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 575/1156] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Apr 30 20:50:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:50:19.398348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372ab1d-967f-4911-a5b2-d09e8a1a8a18 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:19.490274 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372ab1d-967f-4911-a5b2-d09e8a1a8a18 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:19.521533 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e9a28-5134-46f9-91d4-ca0412626856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:19.522386 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e9a28-5134-46f9-91d4-ca0412626856 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:19.522666 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e9a28-5134-46f9-91d4-ca0412626856 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:19.523011 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e9a28-5134-46f9-91d4-ca0412626856 None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:19.526300 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e9a28-5134-46f9-91d4-ca0412626856 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:50:19.526300 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e9a28-5134-46f9-91d4-ca0412626856 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:19.526300 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e9a28-5134-46f9-91d4-ca0412626856 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:19.532940 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 582/1157] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:50:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:50:19.538632 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18524c-cf62-40d8-b74e-e1b6132099df None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:19.633812 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18524c-cf62-40d8-b74e-e1b6132099df None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:19.664744 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f954d-21dc-4cd6-ac2d-0f5355257c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:19.665596 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f954d-21dc-4cd6-ac2d-0f5355257c94 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:19.665903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f954d-21dc-4cd6-ac2d-0f5355257c94 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:19.666175 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f954d-21dc-4cd6-ac2d-0f5355257c94 None admin] PATH_INFO: `/v3/users/44187e6b7e244f8a8aa7d2de61539246` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:19.667330 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f954d-21dc-4cd6-ac2d-0f5355257c94 None admin] RBAC: Authorizing `identity:get_user(user_id=44187e6b7e244f8a8aa7d2de61539246)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:19.669271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f954d-21dc-4cd6-ac2d-0f5355257c94 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:19.671059 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 576/1158] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:50:19 2022] GET /identity/v3/users/44187e6b7e244f8a8aa7d2de61539246 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:50:19.676690 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e9a28-5134-46f9-91d4-ca0412626856 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:19.771804 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e9a28-5134-46f9-91d4-ca0412626856 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:19.803517 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693c0fb-5d1e-4dbe-a261-f2095f49ea66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:19.804141 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693c0fb-5d1e-4dbe-a261-f2095f49ea66 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:19.804418 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693c0fb-5d1e-4dbe-a261-f2095f49ea66 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:19.804688 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693c0fb-5d1e-4dbe-a261-f2095f49ea66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:19.867790 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7693c0fb-5d1e-4dbe-a261-f2095f49ea66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:19.869305 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7693c0fb-5d1e-4dbe-a261-f2095f49ea66 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:19.960345 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 583/1159] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:50:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 30 20:50:19.966345 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f954d-21dc-4cd6-ac2d-0f5355257c94 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:20.060377 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f954d-21dc-4cd6-ac2d-0f5355257c94 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:20.091949 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf564c1e-0b89-456b-a225-fa6df6d6ad5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:20.092793 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf564c1e-0b89-456b-a225-fa6df6d6ad5c None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:20.093070 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf564c1e-0b89-456b-a225-fa6df6d6ad5c None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:20.093342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf564c1e-0b89-456b-a225-fa6df6d6ad5c None admin] PATH_INFO: `/v3/projects/32fe18c7ad514194a6ce8578a7eed803` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:20.094767 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf564c1e-0b89-456b-a225-fa6df6d6ad5c None admin] RBAC: Authorizing `identity:get_project(project_id=32fe18c7ad514194a6ce8578a7eed803)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:20.096188 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf564c1e-0b89-456b-a225-fa6df6d6ad5c None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:20.097856 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 577/1160] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:50:19 2022] GET /identity/v3/projects/32fe18c7ad514194a6ce8578a7eed803 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:50:20.103826 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693c0fb-5d1e-4dbe-a261-f2095f49ea66 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:20.197191 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693c0fb-5d1e-4dbe-a261-f2095f49ea66 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:20.229583 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af26c0-828e-4113-b37d-81d7cb9b6bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:20.230211 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af26c0-828e-4113-b37d-81d7cb9b6bc4 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:20.230494 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af26c0-828e-4113-b37d-81d7cb9b6bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:20.231293 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af26c0-828e-4113-b37d-81d7cb9b6bc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:20.232110 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af26c0-828e-4113-b37d-81d7cb9b6bc4 None admin] RBAC: Adding query filter params (role.id=30112eb1f3e047398c3c82fb40b72e62, scope.project.id=32fe18c7ad514194a6ce8578a7eed803, user.id=44187e6b7e244f8a8aa7d2de61539246) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:50:20.232420 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af26c0-828e-4113-b37d-81d7cb9b6bc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:20.233933 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af26c0-828e-4113-b37d-81d7cb9b6bc4 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:20.239490 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 584/1161] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:50:20 2022] GET /identity/v3/role_assignments?user.id=44187e6b7e244f8a8aa7d2de61539246&scope.project.id=32fe18c7ad514194a6ce8578a7eed803&role.id=30112eb1f3e047398c3c82fb40b72e62 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:50:22.551708 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6594e98-5148-439a-af47-333c0f939eae None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:22.552229 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6594e98-5148-439a-af47-333c0f939eae None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:22.552229 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6594e98-5148-439a-af47-333c0f939eae None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:22.553542 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 578/1162] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:50:22.558559 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a1198-db71-4431-8751-0bcea5399055 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:22.558982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a1198-db71-4431-8751-0bcea5399055 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:22.559124 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a1198-db71-4431-8751-0bcea5399055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:22.575709 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-e41a1198-db71-4431-8751-0bcea5399055 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:50:22.576898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e41a1198-db71-4431-8751-0bcea5399055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:50:22.638961 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 585/1163] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:50:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:50:22.662427 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6594e98-5148-439a-af47-333c0f939eae None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:22.759115 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6594e98-5148-439a-af47-333c0f939eae None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:22.791502 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60141942-92dc-4b80-98ef-6b6fa359a95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:22.792142 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60141942-92dc-4b80-98ef-6b6fa359a95d None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:22.792426 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60141942-92dc-4b80-98ef-6b6fa359a95d None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:22.792702 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60141942-92dc-4b80-98ef-6b6fa359a95d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:22.861353 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60141942-92dc-4b80-98ef-6b6fa359a95d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:22.862766 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60141942-92dc-4b80-98ef-6b6fa359a95d None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:22.954891 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 579/1164] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:50:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 30 20:50:22.960757 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a1198-db71-4431-8751-0bcea5399055 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:23.053065 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a1198-db71-4431-8751-0bcea5399055 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:23.084145 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be40c5d2-83e7-4f28-a004-fce88e2b722d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:23.084923 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40c5d2-83e7-4f28-a004-fce88e2b722d None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:23.085204 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40c5d2-83e7-4f28-a004-fce88e2b722d None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:23.085475 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40c5d2-83e7-4f28-a004-fce88e2b722d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:23.092418 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be40c5d2-83e7-4f28-a004-fce88e2b722d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:23.093872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be40c5d2-83e7-4f28-a004-fce88e2b722d None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:23.107818 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-be40c5d2-83e7-4f28-a004-fce88e2b722d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Apr 30 20:50:23.107818 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:50:23.107818 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Apr 30 20:50:23.107818 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Apr 30 20:50:23.107818 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:50:23.107818 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:50:23.107818 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:50:23.107818 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:50:23.107818 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Apr 30 20:50:23.107818 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:50:23.107818 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:50:23.107818 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:50:23.107818 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:50:23.107818 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:50:23.107818 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:50:23.107818 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:50:23.107818 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:50:23.109024 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:50:23.109024 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:50:23.109024 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:50:23.109024 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:50:23.109024 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:50:23.109024 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:50:23.109024 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:50:23.109024 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:50:23.109024 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:50:23.109024 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:50:23.109024 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:50:23.109024 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:50:23.109024 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:50:23.109024 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:50:23.109024 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:50:23.109024 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:50:23.110095 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:50:23.110095 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:50:23.110095 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:50:23.110095 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:50:23.110095 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:50:23.110095 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:50:23.110095 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:50:23.110095 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:50:23.110095 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:50:23.110095 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:50:23.110095 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Apr 30 20:50:23.110095 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:50:23.110095 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Apr 30 20:50:23.110095 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:50:23.110095 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 586/1165] 10.222.0.23 () {56 vars in 1117 bytes} [Sat Apr 30 20:50:22 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:50:23.114790 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60141942-92dc-4b80-98ef-6b6fa359a95d None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:23.212520 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60141942-92dc-4b80-98ef-6b6fa359a95d None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:23.244886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a07cf-33d0-4a1a-8af9-a84a38aa4fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:23.245541 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a07cf-33d0-4a1a-8af9-a84a38aa4fb3 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:23.245851 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a07cf-33d0-4a1a-8af9-a84a38aa4fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:23.246699 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a07cf-33d0-4a1a-8af9-a84a38aa4fb3 None admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:23.247411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8a07cf-33d0-4a1a-8af9-a84a38aa4fb3 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:50:23.247715 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8a07cf-33d0-4a1a-8af9-a84a38aa4fb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:23.249080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8a07cf-33d0-4a1a-8af9-a84a38aa4fb3 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:23.255958 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 580/1166] 10.222.0.23 () {56 vars in 1115 bytes} [Sat Apr 30 20:50:23 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:50:25.528755 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e03bf9-8b5b-4130-a525-982418c8a3d1 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:25.529283 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e03bf9-8b5b-4130-a525-982418c8a3d1 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:25.529283 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e03bf9-8b5b-4130-a525-982418c8a3d1 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:25.530606 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 587/1167] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:50:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:50:25.535652 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b3381-d97c-485a-a5a3-12806ed5a4ba None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:25.536033 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b3381-d97c-485a-a5a3-12806ed5a4ba None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:25.536222 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b3381-d97c-485a-a5a3-12806ed5a4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:25.552451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-354b3381-d97c-485a-a5a3-12806ed5a4ba None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:50:25.553641 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-354b3381-d97c-485a-a5a3-12806ed5a4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:50:25.617910 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 581/1168] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:50:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:50:25.641920 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e03bf9-8b5b-4130-a525-982418c8a3d1 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:25.738966 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e03bf9-8b5b-4130-a525-982418c8a3d1 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:25.770338 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2ce0f-4b23-486b-93f2-b51ce814f070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:25.770983 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2ce0f-4b23-486b-93f2-b51ce814f070 None admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:25.771262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2ce0f-4b23-486b-93f2-b51ce814f070 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:25.771559 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2ce0f-4b23-486b-93f2-b51ce814f070 None admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:25.772310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2ce0f-4b23-486b-93f2-b51ce814f070 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:25.773681 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2ce0f-4b23-486b-93f2-b51ce814f070 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:25.854146 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 588/1169] 10.222.0.23 () {60 vars in 1138 bytes} [Sat Apr 30 20:50:25 2022] POST /identity/v3/domains => generated 267 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 20:50:28.168931 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a410a0-22d4-4408-a701-90481750cef0 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:28.169483 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a410a0-22d4-4408-a701-90481750cef0 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:28.169483 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a410a0-22d4-4408-a701-90481750cef0 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:28.170873 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 582/1170] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:50:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:50:28.176053 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728737b-faed-40f3-8819-7c733afb862f None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:28.176432 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728737b-faed-40f3-8819-7c733afb862f None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:28.176606 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728737b-faed-40f3-8819-7c733afb862f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:28.193198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-2728737b-faed-40f3-8819-7c733afb862f None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:50:28.194396 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2728737b-faed-40f3-8819-7c733afb862f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:50:28.256122 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 589/1171] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:50:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:50:28.280441 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a410a0-22d4-4408-a701-90481750cef0 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:28.376841 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a410a0-22d4-4408-a701-90481750cef0 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:28.408817 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1bde5-4980-4342-8893-48515c912c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:28.409657 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1bde5-4980-4342-8893-48515c912c9c None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:28.409960 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1bde5-4980-4342-8893-48515c912c9c None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:28.410230 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1bde5-4980-4342-8893-48515c912c9c None admin] PATH_INFO: `/v3/domains/0fce6eccb1204c0c9a969fdb1a25f260` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:28.420531 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac1bde5-4980-4342-8893-48515c912c9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=0fce6eccb1204c0c9a969fdb1a25f260)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:28.421947 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac1bde5-4980-4342-8893-48515c912c9c None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:28.423543 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 583/1172] 10.222.0.23 () {56 vars in 1183 bytes} [Sat Apr 30 20:50:28 2022] GET /identity/v3/domains/0fce6eccb1204c0c9a969fdb1a25f260 => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:50:28.429483 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728737b-faed-40f3-8819-7c733afb862f None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:28.529539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728737b-faed-40f3-8819-7c733afb862f None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:28.561776 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2f778-f8c9-4f6a-aef1-83f584b74198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:28.562425 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2f778-f8c9-4f6a-aef1-83f584b74198 None admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:28.562704 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2f778-f8c9-4f6a-aef1-83f584b74198 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:28.562974 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2f778-f8c9-4f6a-aef1-83f584b74198 None admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:28.563666 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2f778-f8c9-4f6a-aef1-83f584b74198 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:28.567580 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2f778-f8c9-4f6a-aef1-83f584b74198 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:28.659903 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 590/1173] 10.222.0.23 () {60 vars in 1141 bytes} [Sat Apr 30 20:50:28 2022] POST /identity/v3/projects => generated 361 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:50:30.970236 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bbdb0-d520-4da0-94a5-5cde7f72ab03 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:30.970770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bbdb0-d520-4da0-94a5-5cde7f72ab03 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:30.970770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bbdb0-d520-4da0-94a5-5cde7f72ab03 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:30.972135 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 584/1174] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:50:30.977142 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652d737-e871-47de-8567-6994bee5cafe None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:30.977559 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652d737-e871-47de-8567-6994bee5cafe None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:30.977809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652d737-e871-47de-8567-6994bee5cafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:30.994567 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-b652d737-e871-47de-8567-6994bee5cafe None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:50:30.995732 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b652d737-e871-47de-8567-6994bee5cafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:50:31.059297 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 591/1175] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:50:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:50:31.085567 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10bbdb0-d520-4da0-94a5-5cde7f72ab03 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:31.185170 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10bbdb0-d520-4da0-94a5-5cde7f72ab03 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:31.217154 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5aa9b9-c1fc-4041-8c7c-9b5c3c090ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:31.218062 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5aa9b9-c1fc-4041-8c7c-9b5c3c090ebd None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:31.218348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5aa9b9-c1fc-4041-8c7c-9b5c3c090ebd None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:31.218626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5aa9b9-c1fc-4041-8c7c-9b5c3c090ebd None admin] PATH_INFO: `/v3/domains/0fce6eccb1204c0c9a969fdb1a25f260` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:31.220051 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5aa9b9-c1fc-4041-8c7c-9b5c3c090ebd None admin] RBAC: Authorizing `identity:get_domain(domain_id=0fce6eccb1204c0c9a969fdb1a25f260)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:31.221531 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5aa9b9-c1fc-4041-8c7c-9b5c3c090ebd None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:31.223146 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 585/1176] 10.222.0.23 () {56 vars in 1183 bytes} [Sat Apr 30 20:50:31 2022] GET /identity/v3/domains/0fce6eccb1204c0c9a969fdb1a25f260 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:50:31.228920 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652d737-e871-47de-8567-6994bee5cafe None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:31.322476 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652d737-e871-47de-8567-6994bee5cafe None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:31.354836 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c321e4-8182-41d6-9635-b8b6f4123979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:31.356072 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c321e4-8182-41d6-9635-b8b6f4123979 None admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:31.356350 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c321e4-8182-41d6-9635-b8b6f4123979 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:31.356627 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c321e4-8182-41d6-9635-b8b6f4123979 None admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:31.357327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c321e4-8182-41d6-9635-b8b6f4123979 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:31.358812 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c321e4-8182-41d6-9635-b8b6f4123979 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:31.443164 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 592/1177] 10.222.0.23 () {60 vars in 1132 bytes} [Sat Apr 30 20:50:31 2022] POST /identity/v3/users => generated 311 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:50:33.779829 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6061241-436b-4316-966d-13dbdf673154 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:33.780355 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6061241-436b-4316-966d-13dbdf673154 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:33.780447 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6061241-436b-4316-966d-13dbdf673154 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:33.781748 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 586/1178] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:50:33.786829 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b5ff9-8173-4d9a-9b14-440732af719e None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:33.787239 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b5ff9-8173-4d9a-9b14-440732af719e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:33.787383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b5ff9-8173-4d9a-9b14-440732af719e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:33.803949 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-762b5ff9-8173-4d9a-9b14-440732af719e None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:50:33.805108 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-762b5ff9-8173-4d9a-9b14-440732af719e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:50:33.866496 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 593/1179] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:50:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 30 20:50:33.890874 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6061241-436b-4316-966d-13dbdf673154 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:33.986375 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6061241-436b-4316-966d-13dbdf673154 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:34.018802 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32360ddc-6158-4a32-b65e-9ad2499dec00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:34.019576 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32360ddc-6158-4a32-b65e-9ad2499dec00 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:34.019855 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32360ddc-6158-4a32-b65e-9ad2499dec00 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:34.020125 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32360ddc-6158-4a32-b65e-9ad2499dec00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:34.029722 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32360ddc-6158-4a32-b65e-9ad2499dec00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:50:34.037293 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-32360ddc-6158-4a32-b65e-9ad2499dec00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:50:34.037293 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:50:34.037293 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:50:34.037293 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:50:34.037293 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:50:34.037293 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:50:34.037293 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:50:34.037293 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:50:34.037293 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:50:34.037293 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:50:34.037293 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:50:34.037293 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:50:34.037293 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:50:34.037293 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:50:34.037293 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:50:34.037293 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:50:34.038394 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:50:34.038394 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:50:34.038394 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:50:34.038394 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:50:34.038394 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:50:34.038394 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:50:34.038394 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:50:34.038394 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:50:34.038394 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:50:34.038394 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:50:34.038394 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:50:34.038394 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:50:34.038394 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:50:34.038394 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:50:34.038394 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:50:34.038394 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:50:34.039303 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:50:34.039303 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:50:34.039303 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:50:34.039303 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:50:34.039303 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:50:34.039303 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:50:34.039303 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:50:34.039303 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:50:34.039303 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:50:34.039303 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:50:34.039303 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:50:34.039303 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:50:34.039303 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 587/1180] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Apr 30 20:50:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:50:34.044230 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b5ff9-8173-4d9a-9b14-440732af719e None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:34.135965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b5ff9-8173-4d9a-9b14-440732af719e None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:34.167463 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748c440-9caa-4785-81ae-bdf670619ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:34.168129 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748c440-9caa-4785-81ae-bdf670619ef4 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:34.168409 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748c440-9caa-4785-81ae-bdf670619ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:34.168678 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e748c440-9caa-4785-81ae-bdf670619ef4 None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:34.169500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e748c440-9caa-4785-81ae-bdf670619ef4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:50:34.169836 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e748c440-9caa-4785-81ae-bdf670619ef4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:34.171204 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e748c440-9caa-4785-81ae-bdf670619ef4 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:34.178807 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 594/1181] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:50:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:50:34.184819 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32360ddc-6158-4a32-b65e-9ad2499dec00 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:34.279770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32360ddc-6158-4a32-b65e-9ad2499dec00 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:34.311938 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec4f05-d495-407e-8f2c-b850c32b90e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:34.312743 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec4f05-d495-407e-8f2c-b850c32b90e9 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:34.313023 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec4f05-d495-407e-8f2c-b850c32b90e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:34.313303 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec4f05-d495-407e-8f2c-b850c32b90e9 None admin] PATH_INFO: `/v3/users/c209e6358e0946c28cf11bd50b76579a` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:34.326327 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec4f05-d495-407e-8f2c-b850c32b90e9 None admin] RBAC: Authorizing `identity:get_user(user_id=c209e6358e0946c28cf11bd50b76579a)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:34.327763 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec4f05-d495-407e-8f2c-b850c32b90e9 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:34.329390 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 588/1182] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:50:34 2022] GET /identity/v3/users/c209e6358e0946c28cf11bd50b76579a => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:50:34.335056 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748c440-9caa-4785-81ae-bdf670619ef4 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:34.428809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e748c440-9caa-4785-81ae-bdf670619ef4 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:34.459943 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfef5f1-1dd2-4778-81d9-19f0e312ebb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:34.460572 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfef5f1-1dd2-4778-81d9-19f0e312ebb2 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:34.460853 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfef5f1-1dd2-4778-81d9-19f0e312ebb2 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:34.461127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfef5f1-1dd2-4778-81d9-19f0e312ebb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:34.524382 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfef5f1-1dd2-4778-81d9-19f0e312ebb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:34.525874 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfef5f1-1dd2-4778-81d9-19f0e312ebb2 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:34.618942 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 595/1183] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:50:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 30 20:50:34.625297 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec4f05-d495-407e-8f2c-b850c32b90e9 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:34.716893 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec4f05-d495-407e-8f2c-b850c32b90e9 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:34.749063 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a2c118-14b4-4206-8e01-9d93372125bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:34.749926 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2c118-14b4-4206-8e01-9d93372125bb None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:34.750210 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2c118-14b4-4206-8e01-9d93372125bb None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:34.750483 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2c118-14b4-4206-8e01-9d93372125bb None admin] PATH_INFO: `/v3/projects/819daabb8b55496bb68de010f0ea5d8b` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:34.751626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a2c118-14b4-4206-8e01-9d93372125bb None admin] RBAC: Authorizing `identity:get_project(project_id=819daabb8b55496bb68de010f0ea5d8b)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:34.753048 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a2c118-14b4-4206-8e01-9d93372125bb None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:34.754737 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 589/1184] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:50:34 2022] GET /identity/v3/projects/819daabb8b55496bb68de010f0ea5d8b => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:50:34.760584 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfef5f1-1dd2-4778-81d9-19f0e312ebb2 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:34.853200 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfef5f1-1dd2-4778-81d9-19f0e312ebb2 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:34.884907 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363efe3-d41a-4826-bbb7-e09bc27d2274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:34.885483 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363efe3-d41a-4826-bbb7-e09bc27d2274 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:34.885791 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363efe3-d41a-4826-bbb7-e09bc27d2274 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:34.886067 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363efe3-d41a-4826-bbb7-e09bc27d2274 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:34.886928 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363efe3-d41a-4826-bbb7-e09bc27d2274 None admin] RBAC: Adding query filter params (role.id=30112eb1f3e047398c3c82fb40b72e62, scope.project.id=819daabb8b55496bb68de010f0ea5d8b, user.id=c209e6358e0946c28cf11bd50b76579a) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:50:34.887238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363efe3-d41a-4826-bbb7-e09bc27d2274 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:34.888660 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363efe3-d41a-4826-bbb7-e09bc27d2274 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:34.893790 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 596/1185] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:50:34 2022] GET /identity/v3/role_assignments?user.id=c209e6358e0946c28cf11bd50b76579a&scope.project.id=819daabb8b55496bb68de010f0ea5d8b&role.id=30112eb1f3e047398c3c82fb40b72e62 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:50:37.250035 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e822696-01af-47bb-aa34-8455ef57efed None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:37.250571 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e822696-01af-47bb-aa34-8455ef57efed None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:37.250571 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e822696-01af-47bb-aa34-8455ef57efed None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:37.251925 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 590/1186] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:50:37.257182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f79af4-e89f-4117-a928-0ce265a7c228 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:37.257601 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f79af4-e89f-4117-a928-0ce265a7c228 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:37.257715 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f79af4-e89f-4117-a928-0ce265a7c228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:37.274073 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-f9f79af4-e89f-4117-a928-0ce265a7c228 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:50:37.275270 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f9f79af4-e89f-4117-a928-0ce265a7c228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:50:37.338298 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 597/1187] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:50:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:50:37.363435 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e822696-01af-47bb-aa34-8455ef57efed None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:37.458427 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e822696-01af-47bb-aa34-8455ef57efed None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:37.490171 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec46da-6d5d-42d0-ab46-4b39f1bd9247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:37.490947 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec46da-6d5d-42d0-ab46-4b39f1bd9247 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:37.491226 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec46da-6d5d-42d0-ab46-4b39f1bd9247 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:37.491499 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec46da-6d5d-42d0-ab46-4b39f1bd9247 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:37.501042 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec46da-6d5d-42d0-ab46-4b39f1bd9247 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:50:37.508443 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-2fec46da-6d5d-42d0-ab46-4b39f1bd9247 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:50:37.508443 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:50:37.508443 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:50:37.508443 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:50:37.508443 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:50:37.508443 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:50:37.508443 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:50:37.508443 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:50:37.508443 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:50:37.508443 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:50:37.508443 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:50:37.508443 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:50:37.508443 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:50:37.508443 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:50:37.508443 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:50:37.508443 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:50:37.509528 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:50:37.509528 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:50:37.509528 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:50:37.509528 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:50:37.509528 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:50:37.509528 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:50:37.509528 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:50:37.509528 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:50:37.509528 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:50:37.509528 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:50:37.509528 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:50:37.509528 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:50:37.509528 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:50:37.509528 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:50:37.509528 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:50:37.509528 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:50:37.510618 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:50:37.510618 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:50:37.510618 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:50:37.510618 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:50:37.510618 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:50:37.510618 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:50:37.510618 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:50:37.510618 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:50:37.510618 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:50:37.510618 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:50:37.510618 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:50:37.510618 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:50:37.510618 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 591/1188] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Apr 30 20:50:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:50:37.516456 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f79af4-e89f-4117-a928-0ce265a7c228 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:37.608907 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f79af4-e89f-4117-a928-0ce265a7c228 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:37.640309 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e9151-79c3-4ca4-999f-7327d9b86438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:37.640956 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e9151-79c3-4ca4-999f-7327d9b86438 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:37.641238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e9151-79c3-4ca4-999f-7327d9b86438 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:37.641513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e9151-79c3-4ca4-999f-7327d9b86438 None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:37.642284 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e9151-79c3-4ca4-999f-7327d9b86438 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:50:37.642591 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e9151-79c3-4ca4-999f-7327d9b86438 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:37.643951 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e9151-79c3-4ca4-999f-7327d9b86438 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:37.651512 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 598/1189] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:50:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:50:37.657679 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec46da-6d5d-42d0-ab46-4b39f1bd9247 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:37.750185 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec46da-6d5d-42d0-ab46-4b39f1bd9247 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:37.781800 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb55988-7f06-4cf1-a2e5-485b1074f525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:37.782600 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb55988-7f06-4cf1-a2e5-485b1074f525 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:37.782877 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb55988-7f06-4cf1-a2e5-485b1074f525 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:37.783145 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb55988-7f06-4cf1-a2e5-485b1074f525 None admin] PATH_INFO: `/v3/users/c209e6358e0946c28cf11bd50b76579a` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:37.784300 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb55988-7f06-4cf1-a2e5-485b1074f525 None admin] RBAC: Authorizing `identity:get_user(user_id=c209e6358e0946c28cf11bd50b76579a)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:37.785716 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb55988-7f06-4cf1-a2e5-485b1074f525 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:37.787331 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 592/1190] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:50:37 2022] GET /identity/v3/users/c209e6358e0946c28cf11bd50b76579a => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:50:37.792936 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e9151-79c3-4ca4-999f-7327d9b86438 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:37.885399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e9151-79c3-4ca4-999f-7327d9b86438 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:37.916504 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72167f5-9e49-4e4c-bbd8-85e7e69f3fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:37.917341 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72167f5-9e49-4e4c-bbd8-85e7e69f3fbc None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:37.917636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72167f5-9e49-4e4c-bbd8-85e7e69f3fbc None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:37.917946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72167f5-9e49-4e4c-bbd8-85e7e69f3fbc None admin] PATH_INFO: `/v3/projects/819daabb8b55496bb68de010f0ea5d8b` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:37.919110 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72167f5-9e49-4e4c-bbd8-85e7e69f3fbc None admin] RBAC: Authorizing `identity:get_project(project_id=819daabb8b55496bb68de010f0ea5d8b)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:37.920529 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72167f5-9e49-4e4c-bbd8-85e7e69f3fbc None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:37.922204 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 599/1191] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:50:37 2022] GET /identity/v3/projects/819daabb8b55496bb68de010f0ea5d8b => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:50:37.927759 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb55988-7f06-4cf1-a2e5-485b1074f525 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:38.021412 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb55988-7f06-4cf1-a2e5-485b1074f525 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:38.052616 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ef40a-0bc8-4e84-9142-0f1df4f94e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:38.053436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ef40a-0bc8-4e84-9142-0f1df4f94e8f None admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:38.053711 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ef40a-0bc8-4e84-9142-0f1df4f94e8f None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:38.054004 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ef40a-0bc8-4e84-9142-0f1df4f94e8f None admin] PATH_INFO: `/v3/projects/819daabb8b55496bb68de010f0ea5d8b/users/c209e6358e0946c28cf11bd50b76579a/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:38.055913 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ef40a-0bc8-4e84-9142-0f1df4f94e8f None admin] RBAC: Authorizing `identity:create_grant(project_id=819daabb8b55496bb68de010f0ea5d8b, user_id=c209e6358e0946c28cf11bd50b76579a, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:38.057331 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ef40a-0bc8-4e84-9142-0f1df4f94e8f None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:38.115900 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 593/1192] 10.222.0.23 () {58 vars in 1439 bytes} [Sat Apr 30 20:50:37 2022] PUT /identity/v3/projects/819daabb8b55496bb68de010f0ea5d8b/users/c209e6358e0946c28cf11bd50b76579a/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 20:50:40.379100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e9109-ad88-4a9d-b2e0-a99eeb20e589 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:40.379605 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e9109-ad88-4a9d-b2e0-a99eeb20e589 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:40.379730 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e9109-ad88-4a9d-b2e0-a99eeb20e589 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:40.381007 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 600/1193] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:50:40.386650 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba418bb-2e50-4a66-98a0-566ea5038b5c None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:40.387063 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba418bb-2e50-4a66-98a0-566ea5038b5c None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:40.387216 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba418bb-2e50-4a66-98a0-566ea5038b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:40.404631 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-5ba418bb-2e50-4a66-98a0-566ea5038b5c None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:50:40.405823 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5ba418bb-2e50-4a66-98a0-566ea5038b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:50:40.467934 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 594/1194] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:50:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:50:40.492021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e9109-ad88-4a9d-b2e0-a99eeb20e589 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:40.587541 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e9109-ad88-4a9d-b2e0-a99eeb20e589 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:40.619512 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d950191-9c0e-4e6f-b523-641c91fa7c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:40.620294 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d950191-9c0e-4e6f-b523-641c91fa7c0c None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:40.621154 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d950191-9c0e-4e6f-b523-641c91fa7c0c None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:40.621436 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d950191-9c0e-4e6f-b523-641c91fa7c0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:40.631900 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d950191-9c0e-4e6f-b523-641c91fa7c0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:50:40.639555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-8d950191-9c0e-4e6f-b523-641c91fa7c0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:50:40.639555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:50:40.639555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:50:40.639555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:50:40.639555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:50:40.639555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:50:40.639555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:50:40.639555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:50:40.639555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:50:40.639555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:50:40.639555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:50:40.639555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:50:40.639555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:50:40.639555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:50:40.639555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:50:40.639555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:50:40.640543 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:50:40.640543 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:50:40.640543 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:50:40.640543 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:50:40.640543 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:50:40.640543 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:50:40.640543 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:50:40.640543 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:50:40.640543 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:50:40.640543 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:50:40.640543 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:50:40.640543 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:50:40.640543 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:50:40.640543 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:50:40.640543 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:50:40.640543 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:50:40.641490 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:50:40.641490 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:50:40.641490 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:50:40.641490 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:50:40.641490 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:50:40.641490 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:50:40.641490 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:50:40.641490 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:50:40.641490 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:50:40.641490 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:50:40.641490 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:50:40.641490 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:50:40.641490 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 601/1195] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Apr 30 20:50:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:50:40.646880 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba418bb-2e50-4a66-98a0-566ea5038b5c None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:40.739253 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba418bb-2e50-4a66-98a0-566ea5038b5c None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:40.770744 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f1d4f-fe81-4ff4-81c5-70e46cf9d1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:40.771395 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f1d4f-fe81-4ff4-81c5-70e46cf9d1df None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:40.771674 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f1d4f-fe81-4ff4-81c5-70e46cf9d1df None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:40.771944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f1d4f-fe81-4ff4-81c5-70e46cf9d1df None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:40.772671 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f1d4f-fe81-4ff4-81c5-70e46cf9d1df None admin] RBAC: Adding query filter params (name=admin) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:50:40.772970 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f1d4f-fe81-4ff4-81c5-70e46cf9d1df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:40.774569 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f1d4f-fe81-4ff4-81c5-70e46cf9d1df None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:40.782710 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 595/1196] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:50:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:50:40.788436 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d950191-9c0e-4e6f-b523-641c91fa7c0c None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:40.881397 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d950191-9c0e-4e6f-b523-641c91fa7c0c None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:40.913748 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b72e0-5b0b-46cf-a6b9-f48f3450f567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:40.914616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b72e0-5b0b-46cf-a6b9-f48f3450f567 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:40.914896 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b72e0-5b0b-46cf-a6b9-f48f3450f567 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:40.915166 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b72e0-5b0b-46cf-a6b9-f48f3450f567 None admin] PATH_INFO: `/v3/users/c209e6358e0946c28cf11bd50b76579a` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:40.916318 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4b72e0-5b0b-46cf-a6b9-f48f3450f567 None admin] RBAC: Authorizing `identity:get_user(user_id=c209e6358e0946c28cf11bd50b76579a)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:40.917798 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4b72e0-5b0b-46cf-a6b9-f48f3450f567 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:40.919370 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 602/1197] 10.222.0.23 () {56 vars in 1177 bytes} [Sat Apr 30 20:50:40 2022] GET /identity/v3/users/c209e6358e0946c28cf11bd50b76579a => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:50:40.924954 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f1d4f-fe81-4ff4-81c5-70e46cf9d1df None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:41.019047 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f1d4f-fe81-4ff4-81c5-70e46cf9d1df None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:41.049649 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996cafa-d4b3-44cd-843c-079f4bc5d699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:41.050354 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996cafa-d4b3-44cd-843c-079f4bc5d699 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:41.050636 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996cafa-d4b3-44cd-843c-079f4bc5d699 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:41.050908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996cafa-d4b3-44cd-843c-079f4bc5d699 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:41.113836 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4996cafa-d4b3-44cd-843c-079f4bc5d699 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:41.115268 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4996cafa-d4b3-44cd-843c-079f4bc5d699 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:41.205897 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 596/1198] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:50:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 30 20:50:41.211745 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b72e0-5b0b-46cf-a6b9-f48f3450f567 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:41.306217 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b72e0-5b0b-46cf-a6b9-f48f3450f567 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:41.337914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da74e2c-1fe2-4f13-853d-d4fe51babc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:41.338754 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da74e2c-1fe2-4f13-853d-d4fe51babc25 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:41.339031 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da74e2c-1fe2-4f13-853d-d4fe51babc25 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:41.339860 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da74e2c-1fe2-4f13-853d-d4fe51babc25 None admin] PATH_INFO: `/v3/projects/819daabb8b55496bb68de010f0ea5d8b` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:41.341122 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da74e2c-1fe2-4f13-853d-d4fe51babc25 None admin] RBAC: Authorizing `identity:get_project(project_id=819daabb8b55496bb68de010f0ea5d8b)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:41.342571 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da74e2c-1fe2-4f13-853d-d4fe51babc25 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:41.344559 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 603/1199] 10.222.0.23 () {56 vars in 1186 bytes} [Sat Apr 30 20:50:41 2022] GET /identity/v3/projects/819daabb8b55496bb68de010f0ea5d8b => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:50:41.350636 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996cafa-d4b3-44cd-843c-079f4bc5d699 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:50:41.443820 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996cafa-d4b3-44cd-843c-079f4bc5d699 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:50:41.476642 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818a67b-57e9-426c-a22a-cdad8c6f711e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:50:41.477231 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818a67b-57e9-426c-a22a-cdad8c6f711e None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:50:41.477518 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818a67b-57e9-426c-a22a-cdad8c6f711e None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:50:41.477819 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818a67b-57e9-426c-a22a-cdad8c6f711e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:50:41.478638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f818a67b-57e9-426c-a22a-cdad8c6f711e None admin] RBAC: Adding query filter params (role.id=30112eb1f3e047398c3c82fb40b72e62, scope.project.id=819daabb8b55496bb68de010f0ea5d8b, user.id=c209e6358e0946c28cf11bd50b76579a) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:50:41.478949 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f818a67b-57e9-426c-a22a-cdad8c6f711e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:50:41.480414 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f818a67b-57e9-426c-a22a-cdad8c6f711e None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:50:41.486062 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 597/1200] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:50:41 2022] GET /identity/v3/role_assignments?user.id=c209e6358e0946c28cf11bd50b76579a&scope.project.id=819daabb8b55496bb68de010f0ea5d8b&role.id=30112eb1f3e047398c3c82fb40b72e62 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:51:59.944134 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae31b6-c7fc-4f27-b078-83c60793c971 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:59.944744 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae31b6-c7fc-4f27-b078-83c60793c971 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:59.944744 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae31b6-c7fc-4f27-b078-83c60793c971 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:59.946076 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 604/1201] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:51:59.951381 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd96d1c-a9dc-4eb9-a5d3-607c8f7a1e33 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:51:59.951812 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd96d1c-a9dc-4eb9-a5d3-607c8f7a1e33 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:51:59.951935 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd96d1c-a9dc-4eb9-a5d3-607c8f7a1e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:51:59.968642 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-9cd96d1c-a9dc-4eb9-a5d3-607c8f7a1e33 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:51:59.969850 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-9cd96d1c-a9dc-4eb9-a5d3-607c8f7a1e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:52:00.034688 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 598/1202] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:51:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:52:00.061237 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae31b6-c7fc-4f27-b078-83c60793c971 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:00.156923 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae31b6-c7fc-4f27-b078-83c60793c971 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:00.190120 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776d2cd-23b1-433f-8cca-499e67f69ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:00.190949 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776d2cd-23b1-433f-8cca-499e67f69ec5 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:00.191229 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776d2cd-23b1-433f-8cca-499e67f69ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:00.191502 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776d2cd-23b1-433f-8cca-499e67f69ec5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:00.201312 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a776d2cd-23b1-433f-8cca-499e67f69ec5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:00.202821 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a776d2cd-23b1-433f-8cca-499e67f69ec5 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:00.220034 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-a776d2cd-23b1-433f-8cca-499e67f69ec5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:52:00.220034 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:52:00.220034 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:52:00.220034 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:52:00.220034 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:52:00.220034 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:52:00.220034 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:52:00.220034 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:52:00.220034 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:52:00.220034 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:52:00.220034 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:52:00.220034 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:52:00.220034 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:52:00.220034 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:52:00.220034 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:52:00.221140 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:52:00.221140 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:52:00.221140 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:52:00.221140 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:52:00.221140 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:52:00.221140 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:52:00.221140 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:52:00.221140 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:52:00.221140 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:52:00.221140 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:52:00.221140 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:52:00.221140 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:52:00.221140 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:52:00.221140 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:52:00.221140 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:52:00.221140 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:52:00.221140 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:52:00.222522 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:52:00.222522 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:52:00.222522 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:52:00.222522 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:52:00.222522 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 605/1203] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:52:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:52:00.227665 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd96d1c-a9dc-4eb9-a5d3-607c8f7a1e33 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:00.325327 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd96d1c-a9dc-4eb9-a5d3-607c8f7a1e33 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:00.357624 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a6a9d8-98ee-4ecb-ad09-ba2840581c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:00.358312 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6a9d8-98ee-4ecb-ad09-ba2840581c25 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:00.358603 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6a9d8-98ee-4ecb-ad09-ba2840581c25 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:00.358881 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a6a9d8-98ee-4ecb-ad09-ba2840581c25 None admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:00.359595 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a6a9d8-98ee-4ecb-ad09-ba2840581c25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:52:00.359900 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a6a9d8-98ee-4ecb-ad09-ba2840581c25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:00.361274 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a6a9d8-98ee-4ecb-ad09-ba2840581c25 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:00.372931 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 599/1204] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:52:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:52:00.378664 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776d2cd-23b1-433f-8cca-499e67f69ec5 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:00.473058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776d2cd-23b1-433f-8cca-499e67f69ec5 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:00.504848 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14293e79-0e9f-4f8d-8808-6582c08d0d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:00.505495 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14293e79-0e9f-4f8d-8808-6582c08d0d56 None admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:00.505799 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14293e79-0e9f-4f8d-8808-6582c08d0d56 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:00.506078 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14293e79-0e9f-4f8d-8808-6582c08d0d56 None admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:00.506756 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14293e79-0e9f-4f8d-8808-6582c08d0d56 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:00.508179 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14293e79-0e9f-4f8d-8808-6582c08d0d56 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:00.583129 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 606/1205] 10.222.0.23 () {60 vars in 1132 bytes} [Sat Apr 30 20:52:00 2022] POST /identity/v3/users => generated 251 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:52:02.958022 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70814729-562a-4ff5-8172-06ad40ab2c6c None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:02.958595 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70814729-562a-4ff5-8172-06ad40ab2c6c None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:02.958595 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70814729-562a-4ff5-8172-06ad40ab2c6c None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:02.959935 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 600/1206] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:52:02.965294 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8540a9-9f85-4e11-a845-0001c982abe3 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:02.965725 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8540a9-9f85-4e11-a845-0001c982abe3 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:02.965859 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8540a9-9f85-4e11-a845-0001c982abe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:02.988479 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-8c8540a9-9f85-4e11-a845-0001c982abe3 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:52:02.989747 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8c8540a9-9f85-4e11-a845-0001c982abe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:52:03.055799 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 607/1207] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:52:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:52:03.080733 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70814729-562a-4ff5-8172-06ad40ab2c6c None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:03.188159 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70814729-562a-4ff5-8172-06ad40ab2c6c None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:03.221040 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e0999-5208-4012-b35d-05998efe9e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:03.221771 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e0999-5208-4012-b35d-05998efe9e24 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:03.222104 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e0999-5208-4012-b35d-05998efe9e24 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:03.222375 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e0999-5208-4012-b35d-05998efe9e24 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:03.232764 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90e0999-5208-4012-b35d-05998efe9e24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:52:03.240655 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-f90e0999-5208-4012-b35d-05998efe9e24 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:52:03.240655 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:52:03.240655 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:52:03.240655 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:52:03.240655 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:52:03.240655 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:52:03.240655 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:52:03.240655 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:52:03.240655 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:52:03.240655 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:52:03.240655 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:52:03.240655 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:52:03.240655 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:52:03.240655 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:52:03.240655 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:52:03.240655 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:52:03.241843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:52:03.241843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:52:03.241843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:52:03.241843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:52:03.241843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:52:03.241843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:52:03.241843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:52:03.241843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:52:03.241843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:52:03.241843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:52:03.241843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:52:03.241843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:52:03.241843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:52:03.241843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:52:03.241843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:52:03.241843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:52:03.243325 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:52:03.243325 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:52:03.243325 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:52:03.243325 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:52:03.243325 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:52:03.243325 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:52:03.243325 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:52:03.243325 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:52:03.243325 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:52:03.243325 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:52:03.243325 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:52:03.243325 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:52:03.243325 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 601/1208] 10.222.0.23 () {56 vars in 1102 bytes} [Sat Apr 30 20:52:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:52:03.248629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8540a9-9f85-4e11-a845-0001c982abe3 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:03.347196 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8540a9-9f85-4e11-a845-0001c982abe3 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:03.380376 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5855c35-52d0-4892-93dd-532c9ea453a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:03.381035 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5855c35-52d0-4892-93dd-532c9ea453a0 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:03.381319 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5855c35-52d0-4892-93dd-532c9ea453a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:03.381592 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5855c35-52d0-4892-93dd-532c9ea453a0 None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:03.382356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5855c35-52d0-4892-93dd-532c9ea453a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:52:03.382662 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5855c35-52d0-4892-93dd-532c9ea453a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:03.384123 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5855c35-52d0-4892-93dd-532c9ea453a0 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:03.391949 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 608/1209] 10.222.0.23 () {56 vars in 1103 bytes} [Sat Apr 30 20:52:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:52:03.397645 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e0999-5208-4012-b35d-05998efe9e24 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:03.494235 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e0999-5208-4012-b35d-05998efe9e24 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:03.526037 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d71b1-6cc8-4ff7-a2f6-f954b3a2e3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:03.530022 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d71b1-6cc8-4ff7-a2f6-f954b3a2e3b7 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:03.530022 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d71b1-6cc8-4ff7-a2f6-f954b3a2e3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:03.530022 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d71b1-6cc8-4ff7-a2f6-f954b3a2e3b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:03.537418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d71b1-6cc8-4ff7-a2f6-f954b3a2e3b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:03.538893 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d71b1-6cc8-4ff7-a2f6-f954b3a2e3b7 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:03.555819 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-852d71b1-6cc8-4ff7-a2f6-f954b3a2e3b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:52:03.555819 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:52:03.555819 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:52:03.555819 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:52:03.555819 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:52:03.555819 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:52:03.555819 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:52:03.555819 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:52:03.555819 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:52:03.555819 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:52:03.555819 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:52:03.555819 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:52:03.555819 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:52:03.555819 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:52:03.555819 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:52:03.556785 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:52:03.556785 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:52:03.556785 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:52:03.556785 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:52:03.556785 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:52:03.556785 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:52:03.556785 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:52:03.556785 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:52:03.556785 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:52:03.556785 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:52:03.556785 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:52:03.556785 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:52:03.556785 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:52:03.556785 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:52:03.556785 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:52:03.556785 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:52:03.556785 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:52:03.557706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:52:03.557706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:52:03.557706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:52:03.557706 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:52:03.557706 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 602/1210] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:52:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:52:03.562768 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5855c35-52d0-4892-93dd-532c9ea453a0 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:03.665815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5855c35-52d0-4892-93dd-532c9ea453a0 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:03.697982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37babc04-1e1e-43b6-9013-bbc50f56d452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:03.698639 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37babc04-1e1e-43b6-9013-bbc50f56d452 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:03.698919 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37babc04-1e1e-43b6-9013-bbc50f56d452 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:03.699192 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37babc04-1e1e-43b6-9013-bbc50f56d452 None admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:03.699908 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37babc04-1e1e-43b6-9013-bbc50f56d452 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:52:03.700214 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37babc04-1e1e-43b6-9013-bbc50f56d452 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:03.701585 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37babc04-1e1e-43b6-9013-bbc50f56d452 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:03.713362 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 609/1211] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:52:03.719560 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d71b1-6cc8-4ff7-a2f6-f954b3a2e3b7 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:03.816223 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d71b1-6cc8-4ff7-a2f6-f954b3a2e3b7 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:03.847833 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ebb15-6026-4797-9cae-9ed31307eea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:03.848623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ebb15-6026-4797-9cae-9ed31307eea8 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:03.848904 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ebb15-6026-4797-9cae-9ed31307eea8 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:03.849177 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ebb15-6026-4797-9cae-9ed31307eea8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:03.857110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ebb15-6026-4797-9cae-9ed31307eea8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:03.858653 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ebb15-6026-4797-9cae-9ed31307eea8 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:03.873128 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-7d0ebb15-6026-4797-9cae-9ed31307eea8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 30 20:52:03.873128 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:52:03.873128 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:52:03.873128 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:52:03.873128 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:52:03.873128 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:52:03.873128 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:52:03.873128 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:52:03.873128 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:52:03.873128 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:52:03.873128 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:52:03.873128 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:52:03.873128 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:52:03.873128 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:52:03.873128 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:52:03.873128 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:52:03.874296 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:52:03.874296 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:52:03.874296 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:52:03.874296 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:52:03.874296 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:52:03.874296 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:52:03.874296 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:52:03.874296 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:52:03.874296 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:52:03.874296 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:52:03.874296 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:52:03.874296 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:52:03.874296 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:52:03.874296 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:52:03.874296 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:52:03.874296 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:52:03.874296 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:52:03.874296 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:52:03.875278 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:52:03.875278 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:52:03.875278 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:52:03.875278 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:52:03.875278 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:52:03.875278 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:52:03.875278 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:52:03.875278 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:52:03.875278 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Apr 30 20:52:03.875278 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:52:03.875278 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 603/1212] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:52:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:52:03.880333 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37babc04-1e1e-43b6-9013-bbc50f56d452 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:03.981525 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37babc04-1e1e-43b6-9013-bbc50f56d452 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:04.014252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a79921-9081-4c00-9e38-a138effba42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:04.014907 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a79921-9081-4c00-9e38-a138effba42c None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:04.015186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a79921-9081-4c00-9e38-a138effba42c None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:04.015455 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a79921-9081-4c00-9e38-a138effba42c None admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:04.016269 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a79921-9081-4c00-9e38-a138effba42c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:52:04.016571 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a79921-9081-4c00-9e38-a138effba42c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:04.018030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a79921-9081-4c00-9e38-a138effba42c None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:04.034834 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 610/1213] 10.222.0.23 () {56 vars in 1143 bytes} [Sat Apr 30 20:52:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:52:04.040641 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ebb15-6026-4797-9cae-9ed31307eea8 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:04.138650 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ebb15-6026-4797-9cae-9ed31307eea8 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:04.170419 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade1969-01ea-40f8-b656-39aa1b88f2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:04.171091 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade1969-01ea-40f8-b656-39aa1b88f2e8 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:04.171370 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade1969-01ea-40f8-b656-39aa1b88f2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:04.171657 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade1969-01ea-40f8-b656-39aa1b88f2e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:04.235716 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade1969-01ea-40f8-b656-39aa1b88f2e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:04.237166 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade1969-01ea-40f8-b656-39aa1b88f2e8 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:04.332175 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 604/1214] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:52:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 30 20:52:04.337973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a79921-9081-4c00-9e38-a138effba42c None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:04.433587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a79921-9081-4c00-9e38-a138effba42c None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:04.464937 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839ee70-8661-47ee-9d00-cae425d110bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:04.465713 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839ee70-8661-47ee-9d00-cae425d110bf None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:04.466022 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839ee70-8661-47ee-9d00-cae425d110bf None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:04.466295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839ee70-8661-47ee-9d00-cae425d110bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:04.476105 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839ee70-8661-47ee-9d00-cae425d110bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:04.478140 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839ee70-8661-47ee-9d00-cae425d110bf None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:04.495534 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-8839ee70-8661-47ee-9d00-cae425d110bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:52:04.495534 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:52:04.495534 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:52:04.495534 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:52:04.495534 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:52:04.495534 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:52:04.495534 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:52:04.495534 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:52:04.495534 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:52:04.495534 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:52:04.495534 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:52:04.495534 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:52:04.495534 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:52:04.495534 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:52:04.495534 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:52:04.496610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:52:04.496610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:52:04.496610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:52:04.496610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:52:04.496610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:52:04.496610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:52:04.496610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:52:04.496610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:52:04.496610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:52:04.496610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:52:04.496610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:52:04.496610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:52:04.496610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:52:04.496610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:52:04.496610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:52:04.496610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:52:04.496610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:52:04.497589 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:52:04.497589 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:52:04.497589 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:52:04.497589 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:52:04.497589 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 611/1215] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:52:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:52:04.502565 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade1969-01ea-40f8-b656-39aa1b88f2e8 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:04.596162 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade1969-01ea-40f8-b656-39aa1b88f2e8 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:04.629526 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6cbb30-42c1-4b3d-958f-40aa0e9e09a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:04.630268 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cbb30-42c1-4b3d-958f-40aa0e9e09a6 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:04.635884 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cbb30-42c1-4b3d-958f-40aa0e9e09a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:04.635884 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cbb30-42c1-4b3d-958f-40aa0e9e09a6 None admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:04.635884 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6cbb30-42c1-4b3d-958f-40aa0e9e09a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:52:04.635884 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6cbb30-42c1-4b3d-958f-40aa0e9e09a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:04.635884 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6cbb30-42c1-4b3d-958f-40aa0e9e09a6 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:04.644546 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 605/1216] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:52:04.650385 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839ee70-8661-47ee-9d00-cae425d110bf None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:04.746004 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839ee70-8661-47ee-9d00-cae425d110bf None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:04.778732 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89733af-5df5-41b8-968c-7975b1991d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:04.779511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89733af-5df5-41b8-968c-7975b1991d3c None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:04.779792 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89733af-5df5-41b8-968c-7975b1991d3c None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:04.780068 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89733af-5df5-41b8-968c-7975b1991d3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:04.786627 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89733af-5df5-41b8-968c-7975b1991d3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:04.788122 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89733af-5df5-41b8-968c-7975b1991d3c None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:04.801909 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-d89733af-5df5-41b8-968c-7975b1991d3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:52:04.801909 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:52:04.801909 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:52:04.801909 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:52:04.801909 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:52:04.801909 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:52:04.801909 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:52:04.801909 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:52:04.801909 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:52:04.801909 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:52:04.801909 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:52:04.801909 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:52:04.801909 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:52:04.801909 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:52:04.801909 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:52:04.802971 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:52:04.802971 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:52:04.802971 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:52:04.802971 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:52:04.802971 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:52:04.802971 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:52:04.802971 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:52:04.802971 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:52:04.802971 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:52:04.802971 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:52:04.802971 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:52:04.802971 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:52:04.802971 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:52:04.802971 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:52:04.802971 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:52:04.802971 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:52:04.802971 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:52:04.804177 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:52:04.804177 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:52:04.804177 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:52:04.804177 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:52:04.804177 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:52:04.804177 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:52:04.804177 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:52:04.804177 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:52:04.804177 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 612/1217] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:52:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:52:04.809030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6cbb30-42c1-4b3d-958f-40aa0e9e09a6 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:04.906682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6cbb30-42c1-4b3d-958f-40aa0e9e09a6 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:04.959108 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3148daf-7c54-480f-a1eb-4e65320a95cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:04.959842 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3148daf-7c54-480f-a1eb-4e65320a95cb None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:04.960124 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3148daf-7c54-480f-a1eb-4e65320a95cb None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:04.960395 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3148daf-7c54-480f-a1eb-4e65320a95cb None admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:04.961985 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3148daf-7c54-480f-a1eb-4e65320a95cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:52:04.962352 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3148daf-7c54-480f-a1eb-4e65320a95cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:04.963829 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3148daf-7c54-480f-a1eb-4e65320a95cb None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:04.976352 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 606/1218] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Apr 30 20:52:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:52:04.983256 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89733af-5df5-41b8-968c-7975b1991d3c None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:05.078405 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89733af-5df5-41b8-968c-7975b1991d3c None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:05.112065 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e808bc0-58f9-4e07-865e-546c4393219f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:05.112716 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e808bc0-58f9-4e07-865e-546c4393219f None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:05.112998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e808bc0-58f9-4e07-865e-546c4393219f None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:05.113265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e808bc0-58f9-4e07-865e-546c4393219f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:05.114109 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e808bc0-58f9-4e07-865e-546c4393219f None admin] RBAC: Adding query filter params (role.id=0971c8bf92d64c50a5cbbf7d146af841, scope.project.id=6b52e5e13b9144dfb663578766c2bac0, user.id=4ad3f89b7037413a83c7905cef263b8f) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:52:05.114416 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e808bc0-58f9-4e07-865e-546c4393219f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:05.115847 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e808bc0-58f9-4e07-865e-546c4393219f None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:05.121262 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 613/1219] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:52:04 2022] GET /identity/v3/role_assignments?user.id=4ad3f89b7037413a83c7905cef263b8f&scope.project.id=6b52e5e13b9144dfb663578766c2bac0&role.id=0971c8bf92d64c50a5cbbf7d146af841 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:52:07.383977 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e4ddc-b0ba-4e4f-bdea-180e6c4240de None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:07.384520 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e4ddc-b0ba-4e4f-bdea-180e6c4240de None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:07.384520 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e4ddc-b0ba-4e4f-bdea-180e6c4240de None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:07.385910 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 607/1220] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:52:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 20:52:07.391365 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181b41d-fb83-4d84-9a56-5230406d6b2a None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:07.391778 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181b41d-fb83-4d84-9a56-5230406d6b2a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:07.391921 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181b41d-fb83-4d84-9a56-5230406d6b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:07.409061 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-3181b41d-fb83-4d84-9a56-5230406d6b2a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:52:07.410344 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3181b41d-fb83-4d84-9a56-5230406d6b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:52:07.474364 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 614/1221] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:52:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 30 20:52:07.498210 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e4ddc-b0ba-4e4f-bdea-180e6c4240de None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:07.597041 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e4ddc-b0ba-4e4f-bdea-180e6c4240de None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:07.629301 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4fce22-9d51-41f6-b148-6541318e0be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:07.630119 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fce22-9d51-41f6-b148-6541318e0be0 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:07.630405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fce22-9d51-41f6-b148-6541318e0be0 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:07.630682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fce22-9d51-41f6-b148-6541318e0be0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:07.641107 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4fce22-9d51-41f6-b148-6541318e0be0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:52:07.649507 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-fd4fce22-9d51-41f6-b148-6541318e0be0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:52:07.649507 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:52:07.649507 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:52:07.649507 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:52:07.649507 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:52:07.649507 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:52:07.649507 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:52:07.649507 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:52:07.649507 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:52:07.649507 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:52:07.649507 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:52:07.649507 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:52:07.649507 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:52:07.649507 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:52:07.649507 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:52:07.649507 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:52:07.650779 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:52:07.650779 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:52:07.650779 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:52:07.650779 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:52:07.650779 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:52:07.650779 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:52:07.650779 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:52:07.650779 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:52:07.650779 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:52:07.650779 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:52:07.650779 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:52:07.650779 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:52:07.650779 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:52:07.650779 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:52:07.650779 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:52:07.650779 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:52:07.651695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:52:07.651695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:52:07.651695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:52:07.651695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:52:07.651695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:52:07.651695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:52:07.651695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:52:07.651695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:52:07.651695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:52:07.651695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:52:07.651695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:52:07.651695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:52:07.651695 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 608/1222] 10.222.0.23 () {56 vars in 1102 bytes} [Sat Apr 30 20:52:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:52:07.657025 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181b41d-fb83-4d84-9a56-5230406d6b2a None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:07.750458 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181b41d-fb83-4d84-9a56-5230406d6b2a None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:07.783026 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0fac4f-bd11-4eab-994e-34d59de457b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:07.783686 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0fac4f-bd11-4eab-994e-34d59de457b0 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:07.783967 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0fac4f-bd11-4eab-994e-34d59de457b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:07.784242 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0fac4f-bd11-4eab-994e-34d59de457b0 None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:07.784974 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0fac4f-bd11-4eab-994e-34d59de457b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:52:07.785280 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0fac4f-bd11-4eab-994e-34d59de457b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:07.786675 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0fac4f-bd11-4eab-994e-34d59de457b0 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:07.794275 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 615/1223] 10.222.0.23 () {56 vars in 1103 bytes} [Sat Apr 30 20:52:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:52:07.800053 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4fce22-9d51-41f6-b148-6541318e0be0 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:07.898565 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4fce22-9d51-41f6-b148-6541318e0be0 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:07.931440 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841430b-84b6-4451-bb92-2020697d0254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:07.932219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841430b-84b6-4451-bb92-2020697d0254 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:07.932503 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841430b-84b6-4451-bb92-2020697d0254 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:07.932778 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841430b-84b6-4451-bb92-2020697d0254 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:07.942860 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841430b-84b6-4451-bb92-2020697d0254 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:07.944308 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841430b-84b6-4451-bb92-2020697d0254 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:07.960783 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-f841430b-84b6-4451-bb92-2020697d0254 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:52:07.960783 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:52:07.960783 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:52:07.960783 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:52:07.960783 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:52:07.960783 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:52:07.960783 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:52:07.960783 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:52:07.960783 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:52:07.960783 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:52:07.960783 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:52:07.960783 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:52:07.960783 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:52:07.960783 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:52:07.960783 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:52:07.962266 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:52:07.962266 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:52:07.962266 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:52:07.962266 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:52:07.962266 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:52:07.962266 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:52:07.962266 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:52:07.962266 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:52:07.962266 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:52:07.962266 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:52:07.962266 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:52:07.962266 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:52:07.962266 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:52:07.962266 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:52:07.962266 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:52:07.962266 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:52:07.962266 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:52:07.963580 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:52:07.963580 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:52:07.963580 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:52:07.963580 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:52:07.963580 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 609/1224] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:52:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:52:07.968518 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0fac4f-bd11-4eab-994e-34d59de457b0 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:08.062478 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0fac4f-bd11-4eab-994e-34d59de457b0 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:08.094100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949f2ac-99db-463d-85d1-3e30c87f772d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:08.094745 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949f2ac-99db-463d-85d1-3e30c87f772d None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:08.095024 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949f2ac-99db-463d-85d1-3e30c87f772d None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:08.095295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949f2ac-99db-463d-85d1-3e30c87f772d None admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:08.096001 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6949f2ac-99db-463d-85d1-3e30c87f772d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:52:08.096318 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6949f2ac-99db-463d-85d1-3e30c87f772d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:08.097686 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6949f2ac-99db-463d-85d1-3e30c87f772d None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:08.109503 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 616/1225] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:52:08.115101 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841430b-84b6-4451-bb92-2020697d0254 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:08.209850 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841430b-84b6-4451-bb92-2020697d0254 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:08.242197 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62604ed-05dd-43a8-9c66-07d3f324c23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:08.243011 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62604ed-05dd-43a8-9c66-07d3f324c23a None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:08.243292 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62604ed-05dd-43a8-9c66-07d3f324c23a None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:08.243562 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62604ed-05dd-43a8-9c66-07d3f324c23a None admin] PATH_INFO: `/v3/users/placement` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:08.250768 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62604ed-05dd-43a8-9c66-07d3f324c23a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:08.252200 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62604ed-05dd-43a8-9c66-07d3f324c23a None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:08.266662 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-b62604ed-05dd-43a8-9c66-07d3f324c23a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 30 20:52:08.266662 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:52:08.266662 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:52:08.266662 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:52:08.266662 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:52:08.266662 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:52:08.266662 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:52:08.266662 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:52:08.266662 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:52:08.266662 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:52:08.266662 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:52:08.266662 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:52:08.266662 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:52:08.266662 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:52:08.266662 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:52:08.266662 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:52:08.267911 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:52:08.267911 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:52:08.267911 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:52:08.267911 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:52:08.267911 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:52:08.267911 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:52:08.267911 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:52:08.267911 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:52:08.267911 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:52:08.267911 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:52:08.267911 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:52:08.267911 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:52:08.267911 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:52:08.267911 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:52:08.267911 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:52:08.267911 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:52:08.267911 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:52:08.267911 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:52:08.268879 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:52:08.268879 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:52:08.268879 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:52:08.268879 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:52:08.268879 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:52:08.268879 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:52:08.268879 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:52:08.268879 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:52:08.268879 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Apr 30 20:52:08.268879 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:52:08.268879 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 610/1226] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:52:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:52:08.273688 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949f2ac-99db-463d-85d1-3e30c87f772d None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:08.371049 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949f2ac-99db-463d-85d1-3e30c87f772d None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:08.404110 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d5051-6155-4375-9d15-57ba989685a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:08.404844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d5051-6155-4375-9d15-57ba989685a7 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:08.405123 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d5051-6155-4375-9d15-57ba989685a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:08.405393 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d5051-6155-4375-9d15-57ba989685a7 None admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:08.406231 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d5051-6155-4375-9d15-57ba989685a7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:52:08.406534 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d5051-6155-4375-9d15-57ba989685a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:08.407952 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d5051-6155-4375-9d15-57ba989685a7 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:08.424103 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 617/1227] 10.222.0.23 () {56 vars in 1143 bytes} [Sat Apr 30 20:52:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:52:08.429912 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62604ed-05dd-43a8-9c66-07d3f324c23a None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:08.528039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62604ed-05dd-43a8-9c66-07d3f324c23a None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:08.560232 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709bbaa-04ec-43b9-9b1d-3482d396ddfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:08.561013 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709bbaa-04ec-43b9-9b1d-3482d396ddfe None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:08.561290 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709bbaa-04ec-43b9-9b1d-3482d396ddfe None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:08.561563 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709bbaa-04ec-43b9-9b1d-3482d396ddfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:08.572368 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b709bbaa-04ec-43b9-9b1d-3482d396ddfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:08.573829 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b709bbaa-04ec-43b9-9b1d-3482d396ddfe None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:08.590626 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-b709bbaa-04ec-43b9-9b1d-3482d396ddfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:52:08.590626 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:52:08.590626 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:52:08.590626 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:52:08.590626 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:52:08.590626 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:52:08.590626 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:52:08.590626 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:52:08.590626 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:52:08.590626 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:52:08.590626 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:52:08.590626 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:52:08.590626 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:52:08.590626 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:52:08.590626 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:52:08.591695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:52:08.591695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:52:08.591695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:52:08.591695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:52:08.591695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:52:08.591695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:52:08.591695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:52:08.591695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:52:08.591695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:52:08.591695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:52:08.591695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:52:08.591695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:52:08.591695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:52:08.591695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:52:08.591695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:52:08.591695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:52:08.591695 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:52:08.592920 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:52:08.592920 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:52:08.592920 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:52:08.592920 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:52:08.592920 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 611/1228] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:52:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:52:08.598098 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d5051-6155-4375-9d15-57ba989685a7 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:08.703880 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d5051-6155-4375-9d15-57ba989685a7 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:08.736860 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124ca54-4cf3-4fe2-9ad1-4bca92b426ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:08.737508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124ca54-4cf3-4fe2-9ad1-4bca92b426ca None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:08.737811 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124ca54-4cf3-4fe2-9ad1-4bca92b426ca None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:08.738086 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124ca54-4cf3-4fe2-9ad1-4bca92b426ca None admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:08.738792 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4124ca54-4cf3-4fe2-9ad1-4bca92b426ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:52:08.739093 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4124ca54-4cf3-4fe2-9ad1-4bca92b426ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:08.740495 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4124ca54-4cf3-4fe2-9ad1-4bca92b426ca None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:08.751761 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 618/1229] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:52:08.757421 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709bbaa-04ec-43b9-9b1d-3482d396ddfe None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:08.854639 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709bbaa-04ec-43b9-9b1d-3482d396ddfe None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:08.887770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f73999-132d-43eb-b3de-9d89d2a70051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:08.888553 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f73999-132d-43eb-b3de-9d89d2a70051 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:08.888837 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f73999-132d-43eb-b3de-9d89d2a70051 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:08.889110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f73999-132d-43eb-b3de-9d89d2a70051 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:08.895551 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f73999-132d-43eb-b3de-9d89d2a70051 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:08.896978 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f73999-132d-43eb-b3de-9d89d2a70051 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:08.910817 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-86f73999-132d-43eb-b3de-9d89d2a70051 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:52:08.910817 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:52:08.910817 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:52:08.910817 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:52:08.910817 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:52:08.910817 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:52:08.910817 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:52:08.910817 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:52:08.910817 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:52:08.910817 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:52:08.910817 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:52:08.910817 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:52:08.910817 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:52:08.910817 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:52:08.910817 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:52:08.911881 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:52:08.911881 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:52:08.911881 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:52:08.911881 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:52:08.911881 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:52:08.911881 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:52:08.911881 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:52:08.911881 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:52:08.911881 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:52:08.911881 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:52:08.911881 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:52:08.911881 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:52:08.911881 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:52:08.911881 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:52:08.911881 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:52:08.911881 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:52:08.911881 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:52:08.913204 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:52:08.913204 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:52:08.913204 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:52:08.913204 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:52:08.913204 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:52:08.913204 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:52:08.913204 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:52:08.913204 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:52:08.913204 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 612/1230] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:52:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:52:08.918425 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124ca54-4cf3-4fe2-9ad1-4bca92b426ca None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:09.036081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124ca54-4cf3-4fe2-9ad1-4bca92b426ca None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:09.068797 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b9f1b1-412d-4872-b1bc-2c2ff643f18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:09.069438 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9f1b1-412d-4872-b1bc-2c2ff643f18d None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:09.069718 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9f1b1-412d-4872-b1bc-2c2ff643f18d None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:09.070023 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9f1b1-412d-4872-b1bc-2c2ff643f18d None admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:09.070876 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b9f1b1-412d-4872-b1bc-2c2ff643f18d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:52:09.071180 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b9f1b1-412d-4872-b1bc-2c2ff643f18d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:09.072607 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b9f1b1-412d-4872-b1bc-2c2ff643f18d None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:09.084225 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 619/1231] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Apr 30 20:52:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:52:09.090388 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f73999-132d-43eb-b3de-9d89d2a70051 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:09.189004 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f73999-132d-43eb-b3de-9d89d2a70051 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:09.221663 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316538c1-a8a7-4553-b714-6bf53f3dfba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:09.222559 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316538c1-a8a7-4553-b714-6bf53f3dfba0 None admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:09.222839 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316538c1-a8a7-4553-b714-6bf53f3dfba0 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:09.223105 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316538c1-a8a7-4553-b714-6bf53f3dfba0 None admin] PATH_INFO: `/v3/projects/6b52e5e13b9144dfb663578766c2bac0/users/4ad3f89b7037413a83c7905cef263b8f/roles/0971c8bf92d64c50a5cbbf7d146af841` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:09.237204 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316538c1-a8a7-4553-b714-6bf53f3dfba0 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b52e5e13b9144dfb663578766c2bac0, user_id=4ad3f89b7037413a83c7905cef263b8f, role_id=0971c8bf92d64c50a5cbbf7d146af841)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:09.238708 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316538c1-a8a7-4553-b714-6bf53f3dfba0 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:09.321229 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 613/1232] 10.222.0.23 () {58 vars in 1439 bytes} [Sat Apr 30 20:52:09 2022] PUT /identity/v3/projects/6b52e5e13b9144dfb663578766c2bac0/users/4ad3f89b7037413a83c7905cef263b8f/roles/0971c8bf92d64c50a5cbbf7d146af841 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:52:11.601946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa1039-9456-470c-b2fc-326862dcf8b6 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:11.602535 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa1039-9456-470c-b2fc-326862dcf8b6 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:11.602535 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa1039-9456-470c-b2fc-326862dcf8b6 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:11.603799 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 620/1233] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:52:11.608852 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4adf8-47e8-4940-a3c4-5ac5637959bf None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:11.609283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4adf8-47e8-4940-a3c4-5ac5637959bf None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:11.609396 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4adf8-47e8-4940-a3c4-5ac5637959bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:11.625962 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-e7f4adf8-47e8-4940-a3c4-5ac5637959bf None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:52:11.627145 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e7f4adf8-47e8-4940-a3c4-5ac5637959bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:52:11.690615 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 614/1234] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:52:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:52:11.715857 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa1039-9456-470c-b2fc-326862dcf8b6 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:11.811541 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa1039-9456-470c-b2fc-326862dcf8b6 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:11.844297 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee566993-f82c-4e62-b05d-557539d17de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:11.845185 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee566993-f82c-4e62-b05d-557539d17de9 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:11.845464 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee566993-f82c-4e62-b05d-557539d17de9 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:11.845735 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee566993-f82c-4e62-b05d-557539d17de9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:11.858523 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee566993-f82c-4e62-b05d-557539d17de9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:52:11.863943 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-ee566993-f82c-4e62-b05d-557539d17de9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:52:11.863943 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:52:11.863943 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:52:11.863943 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:52:11.863943 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:52:11.863943 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:52:11.863943 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:52:11.863943 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:52:11.863943 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:52:11.863943 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:52:11.863943 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:52:11.863943 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:52:11.863943 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:52:11.863943 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:52:11.863943 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:52:11.863943 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:52:11.865118 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:52:11.865118 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:52:11.865118 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:52:11.865118 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:52:11.865118 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:52:11.865118 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:52:11.865118 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:52:11.865118 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:52:11.865118 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:52:11.865118 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:52:11.865118 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:52:11.865118 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:52:11.865118 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:52:11.865118 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:52:11.865118 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:52:11.865118 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:52:11.866281 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:52:11.866281 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:52:11.866281 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:52:11.866281 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:52:11.866281 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:52:11.866281 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:52:11.866281 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:52:11.866281 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:52:11.866281 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:52:11.866281 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:52:11.866281 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Apr 30 20:52:11.866281 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:52:11.866281 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 621/1235] 10.222.0.23 () {56 vars in 1102 bytes} [Sat Apr 30 20:52:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:52:11.871182 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4adf8-47e8-4940-a3c4-5ac5637959bf None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:11.965775 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4adf8-47e8-4940-a3c4-5ac5637959bf None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:11.998943 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645769d-30c7-41c8-bb13-483011fb9fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:11.999602 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645769d-30c7-41c8-bb13-483011fb9fa1 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:11.999886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645769d-30c7-41c8-bb13-483011fb9fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:12.000163 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645769d-30c7-41c8-bb13-483011fb9fa1 None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:12.000908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645769d-30c7-41c8-bb13-483011fb9fa1 None admin] RBAC: Adding query filter params (name=service) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:52:12.001214 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645769d-30c7-41c8-bb13-483011fb9fa1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:12.002612 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f645769d-30c7-41c8-bb13-483011fb9fa1 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:12.010748 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 615/1236] 10.222.0.23 () {56 vars in 1103 bytes} [Sat Apr 30 20:52:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:52:12.016554 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee566993-f82c-4e62-b05d-557539d17de9 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:12.112905 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee566993-f82c-4e62-b05d-557539d17de9 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:12.145521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860c04c-d841-4212-83d6-6ad604b61e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:12.146346 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860c04c-d841-4212-83d6-6ad604b61e90 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:12.146620 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860c04c-d841-4212-83d6-6ad604b61e90 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:12.146893 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860c04c-d841-4212-83d6-6ad604b61e90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:12.157909 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c860c04c-d841-4212-83d6-6ad604b61e90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:12.159392 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c860c04c-d841-4212-83d6-6ad604b61e90 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:12.175925 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-c860c04c-d841-4212-83d6-6ad604b61e90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:52:12.175925 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:52:12.175925 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:52:12.175925 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:52:12.175925 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:52:12.175925 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:52:12.175925 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:52:12.175925 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:52:12.175925 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:52:12.175925 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:52:12.175925 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:52:12.175925 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:52:12.175925 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:52:12.175925 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:52:12.175925 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:52:12.176973 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:52:12.176973 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:52:12.176973 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:52:12.176973 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:52:12.176973 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:52:12.176973 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:52:12.176973 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:52:12.176973 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:52:12.176973 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:52:12.176973 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:52:12.176973 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:52:12.176973 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:52:12.176973 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:52:12.176973 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:52:12.176973 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:52:12.176973 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:52:12.176973 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:52:12.178126 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:52:12.178126 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:52:12.178126 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:52:12.178126 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:52:12.178126 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 622/1237] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:52:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:52:12.183070 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645769d-30c7-41c8-bb13-483011fb9fa1 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:12.280911 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645769d-30c7-41c8-bb13-483011fb9fa1 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:12.313355 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db4b27-53b9-4136-ab1d-c1e0e174a49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:12.314034 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db4b27-53b9-4136-ab1d-c1e0e174a49f None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:12.314313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db4b27-53b9-4136-ab1d-c1e0e174a49f None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:12.314585 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db4b27-53b9-4136-ab1d-c1e0e174a49f None admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:12.315292 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db4b27-53b9-4136-ab1d-c1e0e174a49f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:52:12.315596 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db4b27-53b9-4136-ab1d-c1e0e174a49f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:12.316959 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db4b27-53b9-4136-ab1d-c1e0e174a49f None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:12.328845 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 616/1238] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:52:12.334528 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860c04c-d841-4212-83d6-6ad604b61e90 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:12.431490 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860c04c-d841-4212-83d6-6ad604b61e90 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:12.464326 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020862e9-2bff-4252-9950-c9e6bbb40b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:12.465123 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020862e9-2bff-4252-9950-c9e6bbb40b92 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:12.465408 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020862e9-2bff-4252-9950-c9e6bbb40b92 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:12.465684 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020862e9-2bff-4252-9950-c9e6bbb40b92 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:12.473225 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020862e9-2bff-4252-9950-c9e6bbb40b92 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:12.474713 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020862e9-2bff-4252-9950-c9e6bbb40b92 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:12.489255 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-020862e9-2bff-4252-9950-c9e6bbb40b92 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 30 20:52:12.489255 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:52:12.489255 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:52:12.489255 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:52:12.489255 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:52:12.489255 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:52:12.489255 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:52:12.489255 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:52:12.489255 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:52:12.489255 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:52:12.489255 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:52:12.489255 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:52:12.489255 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:52:12.489255 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:52:12.489255 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:52:12.489255 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:52:12.490458 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:52:12.490458 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:52:12.490458 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:52:12.490458 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:52:12.490458 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:52:12.490458 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:52:12.490458 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:52:12.490458 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:52:12.490458 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:52:12.490458 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:52:12.490458 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:52:12.490458 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:52:12.490458 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:52:12.490458 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:52:12.490458 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:52:12.490458 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:52:12.490458 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:52:12.490458 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:52:12.491734 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:52:12.491734 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:52:12.491734 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:52:12.491734 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:52:12.491734 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:52:12.491734 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:52:12.491734 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:52:12.491734 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:52:12.491734 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Apr 30 20:52:12.491734 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:52:12.491734 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 623/1239] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:52:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:52:12.496508 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db4b27-53b9-4136-ab1d-c1e0e174a49f None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:12.593500 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db4b27-53b9-4136-ab1d-c1e0e174a49f None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:12.626421 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb947fe-1ff7-4023-821c-84ec66fd46c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:12.634421 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb947fe-1ff7-4023-821c-84ec66fd46c3 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:12.634421 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb947fe-1ff7-4023-821c-84ec66fd46c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:12.634421 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb947fe-1ff7-4023-821c-84ec66fd46c3 None admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:12.634421 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb947fe-1ff7-4023-821c-84ec66fd46c3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:52:12.634421 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb947fe-1ff7-4023-821c-84ec66fd46c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:12.634421 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb947fe-1ff7-4023-821c-84ec66fd46c3 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:12.648031 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 617/1240] 10.222.0.23 () {56 vars in 1143 bytes} [Sat Apr 30 20:52:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:52:12.654580 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020862e9-2bff-4252-9950-c9e6bbb40b92 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:12.752282 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020862e9-2bff-4252-9950-c9e6bbb40b92 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:12.785392 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07094565-cd14-4bdb-8537-deff01c15c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:12.786061 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07094565-cd14-4bdb-8537-deff01c15c1e None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:12.786341 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07094565-cd14-4bdb-8537-deff01c15c1e None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:12.786614 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07094565-cd14-4bdb-8537-deff01c15c1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:12.849917 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07094565-cd14-4bdb-8537-deff01c15c1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:12.851428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07094565-cd14-4bdb-8537-deff01c15c1e None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:12.942987 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 624/1241] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:52:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 30 20:52:12.949343 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb947fe-1ff7-4023-821c-84ec66fd46c3 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:13.044940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb947fe-1ff7-4023-821c-84ec66fd46c3 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:13.078028 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be14d6-f52f-4e91-b8fe-0bc2a09fbd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:13.078812 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be14d6-f52f-4e91-b8fe-0bc2a09fbd60 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:13.079094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be14d6-f52f-4e91-b8fe-0bc2a09fbd60 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:13.079393 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be14d6-f52f-4e91-b8fe-0bc2a09fbd60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:13.088972 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85be14d6-f52f-4e91-b8fe-0bc2a09fbd60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:13.090494 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85be14d6-f52f-4e91-b8fe-0bc2a09fbd60 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:13.107654 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-85be14d6-f52f-4e91-b8fe-0bc2a09fbd60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:52:13.107654 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:52:13.107654 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:52:13.107654 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:52:13.107654 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:52:13.107654 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:52:13.107654 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:52:13.107654 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:52:13.107654 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:52:13.107654 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:52:13.107654 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:52:13.107654 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:52:13.107654 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:52:13.107654 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:52:13.107654 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:52:13.108843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:52:13.108843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:52:13.108843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:52:13.108843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:52:13.108843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:52:13.108843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:52:13.108843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:52:13.108843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:52:13.108843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:52:13.108843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:52:13.108843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:52:13.108843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:52:13.108843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:52:13.108843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:52:13.108843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:52:13.108843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:52:13.108843 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:52:13.113817 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:52:13.113817 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:52:13.113817 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:52:13.113817 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:52:13.113817 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 618/1242] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:52:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:52:13.114673 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07094565-cd14-4bdb-8537-deff01c15c1e None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:13.211034 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07094565-cd14-4bdb-8537-deff01c15c1e None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:13.244473 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d693839-7ed7-452c-ab70-278528b61215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:13.245130 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d693839-7ed7-452c-ab70-278528b61215 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:13.245413 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d693839-7ed7-452c-ab70-278528b61215 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:13.245687 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d693839-7ed7-452c-ab70-278528b61215 None admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:13.248989 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d693839-7ed7-452c-ab70-278528b61215 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:52:13.248989 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d693839-7ed7-452c-ab70-278528b61215 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:13.248989 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d693839-7ed7-452c-ab70-278528b61215 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:13.260390 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 625/1243] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:52:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:52:13.266023 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be14d6-f52f-4e91-b8fe-0bc2a09fbd60 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:13.360299 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be14d6-f52f-4e91-b8fe-0bc2a09fbd60 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:13.393119 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bbc4b-4103-44a4-9f69-087ab1232174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:13.393920 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bbc4b-4103-44a4-9f69-087ab1232174 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:13.394195 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bbc4b-4103-44a4-9f69-087ab1232174 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:13.394466 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bbc4b-4103-44a4-9f69-087ab1232174 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:13.400934 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8bbc4b-4103-44a4-9f69-087ab1232174 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:13.402406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8bbc4b-4103-44a4-9f69-087ab1232174 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:13.416473 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-0b8bbc4b-4103-44a4-9f69-087ab1232174 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:52:13.416473 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:52:13.416473 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:52:13.416473 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:52:13.416473 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:52:13.416473 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:52:13.416473 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:52:13.416473 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:52:13.416473 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:52:13.416473 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:52:13.416473 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:52:13.416473 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:52:13.416473 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:52:13.416473 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:52:13.416473 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:52:13.417568 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:52:13.417568 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:52:13.417568 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:52:13.417568 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:52:13.417568 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:52:13.417568 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:52:13.417568 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:52:13.417568 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:52:13.417568 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:52:13.417568 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:52:13.417568 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:52:13.417568 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:52:13.417568 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:52:13.417568 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:52:13.417568 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:52:13.417568 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:52:13.417568 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:52:13.423517 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:52:13.423517 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:52:13.423517 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:52:13.423517 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:52:13.423517 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:52:13.423517 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:52:13.423517 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:52:13.423517 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:52:13.423517 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 619/1244] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:52:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:52:13.424232 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d693839-7ed7-452c-ab70-278528b61215 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:13.520332 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d693839-7ed7-452c-ab70-278528b61215 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:13.552250 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc63864-e683-4b30-8006-ee53cee754af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:13.552899 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc63864-e683-4b30-8006-ee53cee754af None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:13.553182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc63864-e683-4b30-8006-ee53cee754af None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:13.553459 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc63864-e683-4b30-8006-ee53cee754af None admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:13.554266 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc63864-e683-4b30-8006-ee53cee754af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:52:13.554573 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc63864-e683-4b30-8006-ee53cee754af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:13.556574 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc63864-e683-4b30-8006-ee53cee754af None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:13.568038 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 626/1245] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Apr 30 20:52:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:52:13.574236 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bbc4b-4103-44a4-9f69-087ab1232174 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:13.670424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bbc4b-4103-44a4-9f69-087ab1232174 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:13.702813 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10479e20-4b2e-40f0-86e7-7122cbecf9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:13.703476 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10479e20-4b2e-40f0-86e7-7122cbecf9ac None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:13.703747 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10479e20-4b2e-40f0-86e7-7122cbecf9ac None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:13.704023 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10479e20-4b2e-40f0-86e7-7122cbecf9ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:13.704842 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10479e20-4b2e-40f0-86e7-7122cbecf9ac None admin] RBAC: Adding query filter params (role.id=0971c8bf92d64c50a5cbbf7d146af841, scope.project.id=6b52e5e13b9144dfb663578766c2bac0, user.id=4ad3f89b7037413a83c7905cef263b8f) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:52:13.705153 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10479e20-4b2e-40f0-86e7-7122cbecf9ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:13.706624 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10479e20-4b2e-40f0-86e7-7122cbecf9ac None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:13.712289 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 620/1246] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:52:13 2022] GET /identity/v3/role_assignments?user.id=4ad3f89b7037413a83c7905cef263b8f&scope.project.id=6b52e5e13b9144dfb663578766c2bac0&role.id=0971c8bf92d64c50a5cbbf7d146af841 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 20:52:16.309187 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592850c-e484-445f-9562-712376155d53 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:16.311064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592850c-e484-445f-9562-712376155d53 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:16.311064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592850c-e484-445f-9562-712376155d53 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:16.311581 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 627/1247] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:52:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:52:16.317108 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723837a-e8ef-4dac-9c5b-0a5142e6c2ef None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:16.317533 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723837a-e8ef-4dac-9c5b-0a5142e6c2ef None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:16.317687 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723837a-e8ef-4dac-9c5b-0a5142e6c2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:16.334524 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-2723837a-e8ef-4dac-9c5b-0a5142e6c2ef None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:52:16.335701 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2723837a-e8ef-4dac-9c5b-0a5142e6c2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:52:16.409504 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 621/1248] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:52:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:52:16.437936 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592850c-e484-445f-9562-712376155d53 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:16.543582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592850c-e484-445f-9562-712376155d53 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:16.575957 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7f8fa-7ec7-4b08-b56f-948f794a70c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:16.576735 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7f8fa-7ec7-4b08-b56f-948f794a70c1 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:16.577016 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7f8fa-7ec7-4b08-b56f-948f794a70c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:16.577290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7f8fa-7ec7-4b08-b56f-948f794a70c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:16.587626 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7f8fa-7ec7-4b08-b56f-948f794a70c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:52:16.595426 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-a4d7f8fa-7ec7-4b08-b56f-948f794a70c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:52:16.595426 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:52:16.595426 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:52:16.595426 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:52:16.595426 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:52:16.595426 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:52:16.595426 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:52:16.595426 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:52:16.595426 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:52:16.595426 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:52:16.595426 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:52:16.595426 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:52:16.595426 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:52:16.595426 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:52:16.595426 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:52:16.595426 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:52:16.596573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:52:16.596573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:52:16.596573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:52:16.596573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:52:16.596573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:52:16.596573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:52:16.596573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:52:16.596573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:52:16.596573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:52:16.596573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:52:16.596573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:52:16.596573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:52:16.596573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:52:16.596573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:52:16.596573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:52:16.596573 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:52:16.597655 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:52:16.597655 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:52:16.597655 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:52:16.597655 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:52:16.597655 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:52:16.597655 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:52:16.597655 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:52:16.597655 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:52:16.597655 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:52:16.597655 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:52:16.597655 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:52:16.597655 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:52:16.597655 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 628/1249] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Apr 30 20:52:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:52:16.602842 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723837a-e8ef-4dac-9c5b-0a5142e6c2ef None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:16.698670 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723837a-e8ef-4dac-9c5b-0a5142e6c2ef None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:16.731477 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffedf97e-a499-4763-b9b0-8600cb0beb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:16.732141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffedf97e-a499-4763-b9b0-8600cb0beb06 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:16.732425 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffedf97e-a499-4763-b9b0-8600cb0beb06 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:16.732703 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffedf97e-a499-4763-b9b0-8600cb0beb06 None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:16.733444 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffedf97e-a499-4763-b9b0-8600cb0beb06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:52:16.733780 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffedf97e-a499-4763-b9b0-8600cb0beb06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:16.735166 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffedf97e-a499-4763-b9b0-8600cb0beb06 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:16.743025 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 622/1250] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:52:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:52:16.748878 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7f8fa-7ec7-4b08-b56f-948f794a70c1 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:16.846125 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7f8fa-7ec7-4b08-b56f-948f794a70c1 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:16.878013 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290071f3-c13e-4b59-bffe-f429c02bc643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:16.878800 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290071f3-c13e-4b59-bffe-f429c02bc643 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:16.879081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290071f3-c13e-4b59-bffe-f429c02bc643 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:16.879353 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290071f3-c13e-4b59-bffe-f429c02bc643 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:16.889967 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290071f3-c13e-4b59-bffe-f429c02bc643 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:16.891429 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290071f3-c13e-4b59-bffe-f429c02bc643 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:16.907922 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-290071f3-c13e-4b59-bffe-f429c02bc643 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:52:16.907922 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:52:16.907922 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:52:16.907922 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:52:16.907922 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:52:16.907922 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:52:16.907922 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:52:16.907922 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:52:16.907922 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:52:16.907922 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:52:16.907922 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:52:16.907922 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:52:16.907922 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:52:16.907922 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:52:16.907922 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:52:16.908984 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:52:16.908984 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:52:16.908984 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:52:16.908984 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:52:16.908984 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:52:16.908984 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:52:16.908984 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:52:16.908984 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:52:16.908984 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:52:16.908984 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:52:16.908984 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:52:16.908984 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:52:16.908984 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:52:16.908984 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:52:16.908984 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:52:16.908984 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:52:16.908984 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:52:16.910154 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:52:16.910154 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:52:16.910154 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:52:16.910154 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:52:16.910154 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 629/1251] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:52:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:52:16.914960 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffedf97e-a499-4763-b9b0-8600cb0beb06 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:17.016237 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffedf97e-a499-4763-b9b0-8600cb0beb06 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:17.055597 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ed027-007d-4d79-975f-89c070fa818f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:17.056534 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ed027-007d-4d79-975f-89c070fa818f None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:17.056831 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ed027-007d-4d79-975f-89c070fa818f None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:17.057108 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ed027-007d-4d79-975f-89c070fa818f None admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:17.057862 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ed027-007d-4d79-975f-89c070fa818f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:52:17.058170 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ed027-007d-4d79-975f-89c070fa818f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:17.059577 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ed027-007d-4d79-975f-89c070fa818f None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:17.072191 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 623/1252] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:52:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:52:17.079697 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290071f3-c13e-4b59-bffe-f429c02bc643 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:17.188657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290071f3-c13e-4b59-bffe-f429c02bc643 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:17.224388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fed0e0-b2b8-478d-9f4a-9f2c951cbbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:17.225331 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fed0e0-b2b8-478d-9f4a-9f2c951cbbac None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:17.225661 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fed0e0-b2b8-478d-9f4a-9f2c951cbbac None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:17.226013 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fed0e0-b2b8-478d-9f4a-9f2c951cbbac None admin] PATH_INFO: `/v3/users/placement` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:17.234930 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fed0e0-b2b8-478d-9f4a-9f2c951cbbac None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:17.236588 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fed0e0-b2b8-478d-9f4a-9f2c951cbbac None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:17.254211 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-25fed0e0-b2b8-478d-9f4a-9f2c951cbbac None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 30 20:52:17.254211 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:52:17.254211 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:52:17.254211 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:52:17.254211 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:52:17.254211 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:52:17.254211 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:52:17.254211 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:52:17.254211 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:52:17.254211 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:52:17.254211 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:52:17.254211 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:52:17.254211 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:52:17.254211 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:52:17.254211 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:52:17.254211 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:52:17.255288 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:52:17.255288 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:52:17.255288 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:52:17.255288 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:52:17.255288 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:52:17.255288 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:52:17.255288 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:52:17.255288 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:52:17.255288 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:52:17.255288 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:52:17.255288 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:52:17.255288 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:52:17.255288 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:52:17.255288 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:52:17.255288 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:52:17.255288 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:52:17.255288 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:52:17.255288 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:52:17.256490 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:52:17.256490 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:52:17.256490 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:52:17.256490 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:52:17.256490 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:52:17.256490 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:52:17.256490 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:52:17.256490 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:52:17.256490 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Apr 30 20:52:17.256490 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:52:17.256490 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 630/1253] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:52:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:52:17.261369 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ed027-007d-4d79-975f-89c070fa818f None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:17.369407 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ed027-007d-4d79-975f-89c070fa818f None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:17.402183 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d92d17-2f00-45cd-a331-3c4b58daa6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:17.402855 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d92d17-2f00-45cd-a331-3c4b58daa6b7 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:17.403139 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d92d17-2f00-45cd-a331-3c4b58daa6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:17.403413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d92d17-2f00-45cd-a331-3c4b58daa6b7 None admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:17.404242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d92d17-2f00-45cd-a331-3c4b58daa6b7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:52:17.404601 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d92d17-2f00-45cd-a331-3c4b58daa6b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:17.406072 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d92d17-2f00-45cd-a331-3c4b58daa6b7 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:17.423343 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 624/1254] 10.222.0.23 () {56 vars in 1143 bytes} [Sat Apr 30 20:52:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:52:17.429248 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fed0e0-b2b8-478d-9f4a-9f2c951cbbac None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:17.525309 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fed0e0-b2b8-478d-9f4a-9f2c951cbbac None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:17.557975 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2c5c0-40b6-4135-b9e9-76f30122e18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:17.561385 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2c5c0-40b6-4135-b9e9-76f30122e18f None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:17.561385 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2c5c0-40b6-4135-b9e9-76f30122e18f None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:17.561385 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2c5c0-40b6-4135-b9e9-76f30122e18f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:17.624750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2c5c0-40b6-4135-b9e9-76f30122e18f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:17.626251 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2c5c0-40b6-4135-b9e9-76f30122e18f None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:17.737857 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 631/1255] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:52:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 30 20:52:17.743899 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d92d17-2f00-45cd-a331-3c4b58daa6b7 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:17.846939 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d92d17-2f00-45cd-a331-3c4b58daa6b7 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:17.880111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71272b-b9d0-4f73-beb9-18b4686ded8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:17.880906 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71272b-b9d0-4f73-beb9-18b4686ded8b None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:17.881188 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71272b-b9d0-4f73-beb9-18b4686ded8b None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:17.881465 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71272b-b9d0-4f73-beb9-18b4686ded8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:17.891770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba71272b-b9d0-4f73-beb9-18b4686ded8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:17.893237 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba71272b-b9d0-4f73-beb9-18b4686ded8b None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:17.910859 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-ba71272b-b9d0-4f73-beb9-18b4686ded8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:52:17.910859 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:52:17.910859 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:52:17.910859 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:52:17.910859 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:52:17.910859 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:52:17.910859 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:52:17.910859 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:52:17.910859 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:52:17.910859 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:52:17.910859 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:52:17.910859 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:52:17.910859 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:52:17.910859 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:52:17.910859 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:52:17.911946 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:52:17.911946 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:52:17.911946 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:52:17.911946 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:52:17.911946 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:52:17.911946 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:52:17.911946 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:52:17.911946 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:52:17.911946 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:52:17.911946 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:52:17.911946 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:52:17.911946 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:52:17.911946 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:52:17.911946 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:52:17.911946 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:52:17.911946 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:52:17.911946 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:52:17.912925 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:52:17.912925 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:52:17.912925 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:52:17.912925 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:52:17.912925 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 625/1256] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:52:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:52:17.918068 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2c5c0-40b6-4135-b9e9-76f30122e18f None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:18.021974 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2c5c0-40b6-4135-b9e9-76f30122e18f None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:18.067242 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696d562-3423-4851-8115-5438c2f5996c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:18.069859 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696d562-3423-4851-8115-5438c2f5996c None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:18.069859 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696d562-3423-4851-8115-5438c2f5996c None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:18.069859 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696d562-3423-4851-8115-5438c2f5996c None admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:18.069859 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8696d562-3423-4851-8115-5438c2f5996c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:52:18.070727 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8696d562-3423-4851-8115-5438c2f5996c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:18.072680 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8696d562-3423-4851-8115-5438c2f5996c None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:18.088142 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 632/1257] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:52:18.094215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71272b-b9d0-4f73-beb9-18b4686ded8b None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:18.194830 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71272b-b9d0-4f73-beb9-18b4686ded8b None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:18.228671 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b9a7a-ef85-459c-85d0-e3a695f125d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:18.229465 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b9a7a-ef85-459c-85d0-e3a695f125d2 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:18.229778 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b9a7a-ef85-459c-85d0-e3a695f125d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:18.230081 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b9a7a-ef85-459c-85d0-e3a695f125d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:18.236753 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b9a7a-ef85-459c-85d0-e3a695f125d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:18.238255 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b9a7a-ef85-459c-85d0-e3a695f125d2 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:18.252150 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-1e5b9a7a-ef85-459c-85d0-e3a695f125d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:52:18.252150 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:52:18.252150 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:52:18.252150 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:52:18.252150 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:52:18.252150 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:52:18.252150 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:52:18.252150 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:52:18.252150 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:52:18.252150 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:52:18.252150 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:52:18.252150 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:52:18.252150 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:52:18.252150 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:52:18.252150 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:52:18.253249 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:52:18.253249 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:52:18.253249 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:52:18.253249 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:52:18.253249 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:52:18.253249 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:52:18.253249 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:52:18.253249 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:52:18.253249 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:52:18.253249 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:52:18.253249 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:52:18.253249 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:52:18.253249 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:52:18.253249 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:52:18.253249 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:52:18.253249 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:52:18.253249 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:52:18.254587 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:52:18.254587 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:52:18.254587 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:52:18.254587 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:52:18.254587 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:52:18.254587 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:52:18.254587 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:52:18.254587 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:52:18.254587 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 626/1258] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:52:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:52:18.259828 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696d562-3423-4851-8115-5438c2f5996c None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:18.369850 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696d562-3423-4851-8115-5438c2f5996c None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:18.402564 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756c8db-93ab-4285-8f4c-657d9fe3389c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:18.403223 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756c8db-93ab-4285-8f4c-657d9fe3389c None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:18.403535 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756c8db-93ab-4285-8f4c-657d9fe3389c None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:18.403812 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756c8db-93ab-4285-8f4c-657d9fe3389c None admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:18.404598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7756c8db-93ab-4285-8f4c-657d9fe3389c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:52:18.404904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7756c8db-93ab-4285-8f4c-657d9fe3389c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:18.406377 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7756c8db-93ab-4285-8f4c-657d9fe3389c None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:18.418093 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 633/1259] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Apr 30 20:52:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:52:18.424459 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b9a7a-ef85-459c-85d0-e3a695f125d2 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:18.535419 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b9a7a-ef85-459c-85d0-e3a695f125d2 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:18.567823 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977b0ae-a345-4b8c-8964-b3896815ff64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:18.568470 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977b0ae-a345-4b8c-8964-b3896815ff64 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:18.568750 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977b0ae-a345-4b8c-8964-b3896815ff64 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:18.569053 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977b0ae-a345-4b8c-8964-b3896815ff64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:18.569898 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e977b0ae-a345-4b8c-8964-b3896815ff64 None admin] RBAC: Adding query filter params (role.id=30112eb1f3e047398c3c82fb40b72e62, scope.project.id=6b52e5e13b9144dfb663578766c2bac0, user.id=4ad3f89b7037413a83c7905cef263b8f) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:52:18.570810 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e977b0ae-a345-4b8c-8964-b3896815ff64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:18.572252 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e977b0ae-a345-4b8c-8964-b3896815ff64 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:18.578118 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 627/1260] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:52:18 2022] GET /identity/v3/role_assignments?user.id=4ad3f89b7037413a83c7905cef263b8f&scope.project.id=6b52e5e13b9144dfb663578766c2bac0&role.id=30112eb1f3e047398c3c82fb40b72e62 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:52:21.195839 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0e60d-2f0e-4a29-bdba-45269c2b7a66 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:21.196395 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0e60d-2f0e-4a29-bdba-45269c2b7a66 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:21.196395 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0e60d-2f0e-4a29-bdba-45269c2b7a66 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:21.197728 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 634/1261] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:52:21.203128 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03478f0c-a288-4d65-adcb-c9a4415ec268 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:21.203599 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03478f0c-a288-4d65-adcb-c9a4415ec268 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:21.205215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03478f0c-a288-4d65-adcb-c9a4415ec268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:21.220255 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-03478f0c-a288-4d65-adcb-c9a4415ec268 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:52:21.221446 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-03478f0c-a288-4d65-adcb-c9a4415ec268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:52:21.288717 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 628/1262] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:52:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:52:21.313154 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0e60d-2f0e-4a29-bdba-45269c2b7a66 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:21.409382 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0e60d-2f0e-4a29-bdba-45269c2b7a66 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:21.441982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8927d-265e-4efa-a2c7-cb18e1c9b733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:21.442777 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8927d-265e-4efa-a2c7-cb18e1c9b733 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:21.443053 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8927d-265e-4efa-a2c7-cb18e1c9b733 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:21.443341 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8927d-265e-4efa-a2c7-cb18e1c9b733 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:21.453154 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee8927d-265e-4efa-a2c7-cb18e1c9b733 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:52:21.461147 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-3ee8927d-265e-4efa-a2c7-cb18e1c9b733 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:52:21.461147 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:52:21.461147 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:52:21.461147 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:52:21.461147 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:52:21.461147 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:52:21.461147 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:52:21.461147 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:52:21.461147 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:52:21.461147 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:52:21.461147 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:52:21.461147 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:52:21.461147 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:52:21.461147 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:52:21.461147 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:52:21.461147 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:52:21.463016 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:52:21.463016 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:52:21.463016 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:52:21.463016 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:52:21.463016 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:52:21.463016 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:52:21.463016 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:52:21.463016 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:52:21.463016 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:52:21.463016 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:52:21.463016 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:52:21.463016 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:52:21.463016 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:52:21.463016 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:52:21.463016 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:52:21.463016 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:52:21.463894 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:52:21.463894 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:52:21.463894 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:52:21.463894 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:52:21.463894 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:52:21.463894 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:52:21.463894 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:52:21.463894 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:52:21.463894 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:52:21.463894 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:52:21.463894 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:52:21.463894 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:52:21.463894 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 635/1263] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Apr 30 20:52:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:52:21.468823 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03478f0c-a288-4d65-adcb-c9a4415ec268 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:21.563935 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03478f0c-a288-4d65-adcb-c9a4415ec268 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:21.596923 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6df81-5fb7-492a-bed9-67a8331a571d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:21.597585 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6df81-5fb7-492a-bed9-67a8331a571d None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:21.597898 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6df81-5fb7-492a-bed9-67a8331a571d None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:21.598173 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6df81-5fb7-492a-bed9-67a8331a571d None admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:21.598906 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f6df81-5fb7-492a-bed9-67a8331a571d None admin] RBAC: Adding query filter params (name=admin) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:52:21.599212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f6df81-5fb7-492a-bed9-67a8331a571d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:21.600579 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f6df81-5fb7-492a-bed9-67a8331a571d None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:21.609024 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 629/1264] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:52:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:52:21.614710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8927d-265e-4efa-a2c7-cb18e1c9b733 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:21.712003 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8927d-265e-4efa-a2c7-cb18e1c9b733 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:21.745156 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6552aa-16a7-487d-b9c9-510d0786dd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:21.745957 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6552aa-16a7-487d-b9c9-510d0786dd37 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:21.746235 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6552aa-16a7-487d-b9c9-510d0786dd37 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:21.746504 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6552aa-16a7-487d-b9c9-510d0786dd37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:21.756972 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6552aa-16a7-487d-b9c9-510d0786dd37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:21.759044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6552aa-16a7-487d-b9c9-510d0786dd37 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:21.776436 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-1e6552aa-16a7-487d-b9c9-510d0786dd37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:52:21.776436 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:52:21.776436 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:52:21.776436 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:52:21.776436 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:52:21.776436 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:52:21.776436 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:52:21.776436 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:52:21.776436 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:52:21.776436 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:52:21.776436 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:52:21.776436 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:52:21.776436 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:52:21.776436 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:52:21.776436 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:52:21.777545 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:52:21.777545 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:52:21.777545 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:52:21.777545 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:52:21.777545 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:52:21.777545 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:52:21.777545 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:52:21.777545 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:52:21.777545 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:52:21.777545 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:52:21.777545 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:52:21.777545 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:52:21.777545 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:52:21.777545 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:52:21.777545 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:52:21.777545 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:52:21.777545 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:52:21.778708 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:52:21.778708 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:52:21.778708 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:52:21.778708 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:52:21.778708 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 636/1265] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:52:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:52:21.783667 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6df81-5fb7-492a-bed9-67a8331a571d None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:21.881731 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6df81-5fb7-492a-bed9-67a8331a571d None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:21.914613 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef89ef-072a-4704-a6fe-40ef67888857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:21.915266 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef89ef-072a-4704-a6fe-40ef67888857 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:21.915550 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef89ef-072a-4704-a6fe-40ef67888857 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:21.915824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef89ef-072a-4704-a6fe-40ef67888857 None admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:21.916548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef89ef-072a-4704-a6fe-40ef67888857 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:52:21.916921 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef89ef-072a-4704-a6fe-40ef67888857 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:21.918340 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef89ef-072a-4704-a6fe-40ef67888857 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:21.929638 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 630/1266] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:52:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:52:21.935578 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6552aa-16a7-487d-b9c9-510d0786dd37 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:22.031557 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6552aa-16a7-487d-b9c9-510d0786dd37 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:22.063713 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68192660-b854-462a-b307-95c6d911168c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:22.064557 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68192660-b854-462a-b307-95c6d911168c None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:22.064843 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68192660-b854-462a-b307-95c6d911168c None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:22.065157 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68192660-b854-462a-b307-95c6d911168c None admin] PATH_INFO: `/v3/users/placement` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:22.073226 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68192660-b854-462a-b307-95c6d911168c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:22.074785 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68192660-b854-462a-b307-95c6d911168c None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:22.088709 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-68192660-b854-462a-b307-95c6d911168c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 30 20:52:22.088709 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:52:22.088709 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:52:22.088709 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:52:22.088709 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:52:22.088709 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:52:22.088709 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:52:22.088709 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:52:22.088709 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:52:22.088709 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:52:22.088709 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:52:22.088709 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:52:22.088709 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:52:22.088709 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:52:22.088709 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:52:22.088709 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:52:22.089884 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:52:22.089884 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:52:22.089884 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:52:22.089884 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:52:22.089884 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:52:22.089884 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:52:22.089884 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:52:22.089884 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:52:22.089884 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:52:22.089884 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:52:22.089884 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:52:22.089884 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:52:22.089884 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:52:22.089884 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:52:22.089884 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:52:22.089884 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:52:22.089884 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:52:22.089884 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:52:22.091097 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:52:22.091097 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:52:22.091097 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:52:22.091097 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:52:22.091097 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:52:22.091097 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:52:22.091097 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:52:22.091097 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:52:22.091097 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Apr 30 20:52:22.091097 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:52:22.091097 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 637/1267] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:52:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:52:22.096179 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef89ef-072a-4704-a6fe-40ef67888857 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:22.190829 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef89ef-072a-4704-a6fe-40ef67888857 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:22.223983 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49719b89-68d0-4765-b105-7a92b103823b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:22.224650 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49719b89-68d0-4765-b105-7a92b103823b None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:22.224934 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49719b89-68d0-4765-b105-7a92b103823b None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:22.225208 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49719b89-68d0-4765-b105-7a92b103823b None admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:22.226100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49719b89-68d0-4765-b105-7a92b103823b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:52:22.226437 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49719b89-68d0-4765-b105-7a92b103823b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:22.227875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49719b89-68d0-4765-b105-7a92b103823b None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:22.245374 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 631/1268] 10.222.0.23 () {56 vars in 1143 bytes} [Sat Apr 30 20:52:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:52:22.250877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68192660-b854-462a-b307-95c6d911168c None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:22.350687 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68192660-b854-462a-b307-95c6d911168c None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:22.383235 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d61813-e6dd-42e9-85e5-21b7ca523e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:22.384056 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d61813-e6dd-42e9-85e5-21b7ca523e31 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:22.384336 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d61813-e6dd-42e9-85e5-21b7ca523e31 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:22.384611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d61813-e6dd-42e9-85e5-21b7ca523e31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:22.394811 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d61813-e6dd-42e9-85e5-21b7ca523e31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:22.396278 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d61813-e6dd-42e9-85e5-21b7ca523e31 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:22.413140 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-10d61813-e6dd-42e9-85e5-21b7ca523e31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:52:22.413140 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:52:22.413140 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:52:22.413140 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:52:22.413140 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:52:22.413140 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:52:22.413140 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:52:22.413140 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:52:22.413140 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:52:22.413140 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:52:22.413140 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:52:22.413140 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:52:22.413140 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:52:22.413140 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:52:22.413140 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:52:22.414617 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:52:22.414617 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:52:22.414617 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:52:22.414617 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:52:22.414617 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:52:22.414617 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:52:22.414617 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:52:22.414617 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:52:22.414617 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:52:22.414617 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:52:22.414617 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:52:22.414617 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:52:22.414617 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:52:22.414617 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:52:22.414617 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:52:22.414617 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:52:22.414617 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:52:22.415535 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:52:22.415535 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:52:22.415535 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:52:22.415535 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:52:22.415535 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 638/1269] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:52:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:52:22.420735 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49719b89-68d0-4765-b105-7a92b103823b None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:22.516798 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49719b89-68d0-4765-b105-7a92b103823b None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:22.549745 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46b208-a852-42cd-9cce-b4d63531b868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:22.550419 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46b208-a852-42cd-9cce-b4d63531b868 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:22.550696 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46b208-a852-42cd-9cce-b4d63531b868 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:22.550966 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46b208-a852-42cd-9cce-b4d63531b868 None admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:22.551668 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46b208-a852-42cd-9cce-b4d63531b868 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:52:22.551968 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46b208-a852-42cd-9cce-b4d63531b868 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:22.553366 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46b208-a852-42cd-9cce-b4d63531b868 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:22.564660 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 632/1270] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:52:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:52:22.570537 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d61813-e6dd-42e9-85e5-21b7ca523e31 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:22.666724 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d61813-e6dd-42e9-85e5-21b7ca523e31 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:22.698996 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781fda6-d787-4be6-9d6c-76d28a1e0b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:22.700510 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781fda6-d787-4be6-9d6c-76d28a1e0b31 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:22.700510 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781fda6-d787-4be6-9d6c-76d28a1e0b31 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:22.700510 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781fda6-d787-4be6-9d6c-76d28a1e0b31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:22.706703 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781fda6-d787-4be6-9d6c-76d28a1e0b31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:22.708219 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781fda6-d787-4be6-9d6c-76d28a1e0b31 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:22.722306 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-5781fda6-d787-4be6-9d6c-76d28a1e0b31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:52:22.722306 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:52:22.722306 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:52:22.722306 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:52:22.722306 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:52:22.722306 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:52:22.722306 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:52:22.722306 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:52:22.722306 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:52:22.722306 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:52:22.722306 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:52:22.722306 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:52:22.722306 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:52:22.722306 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:52:22.722306 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:52:22.723324 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:52:22.723324 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:52:22.723324 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:52:22.723324 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:52:22.723324 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:52:22.723324 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:52:22.723324 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:52:22.723324 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:52:22.723324 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:52:22.723324 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:52:22.723324 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:52:22.723324 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:52:22.723324 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:52:22.723324 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:52:22.723324 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:52:22.723324 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:52:22.723324 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:52:22.724360 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:52:22.724360 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:52:22.724360 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:52:22.724360 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:52:22.724360 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:52:22.724360 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:52:22.724360 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:52:22.724360 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:52:22.724360 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 639/1271] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:52:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 30 20:52:22.730003 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46b208-a852-42cd-9cce-b4d63531b868 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:22.825956 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46b208-a852-42cd-9cce-b4d63531b868 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:22.858861 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1efa7bd-3d4a-4940-beae-95a4ad7e8169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:22.859514 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efa7bd-3d4a-4940-beae-95a4ad7e8169 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:22.859796 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efa7bd-3d4a-4940-beae-95a4ad7e8169 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:22.860069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1efa7bd-3d4a-4940-beae-95a4ad7e8169 None admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:22.860843 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1efa7bd-3d4a-4940-beae-95a4ad7e8169 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:52:22.861143 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1efa7bd-3d4a-4940-beae-95a4ad7e8169 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:22.862609 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1efa7bd-3d4a-4940-beae-95a4ad7e8169 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:22.874110 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 633/1272] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Apr 30 20:52:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:52:22.880205 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781fda6-d787-4be6-9d6c-76d28a1e0b31 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:22.974680 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781fda6-d787-4be6-9d6c-76d28a1e0b31 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:23.006781 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d31fc1-994a-444e-9735-ee79b4e55a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:23.007672 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d31fc1-994a-444e-9735-ee79b4e55a19 None admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:23.007950 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d31fc1-994a-444e-9735-ee79b4e55a19 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:23.008224 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d31fc1-994a-444e-9735-ee79b4e55a19 None admin] PATH_INFO: `/v3/projects/6b52e5e13b9144dfb663578766c2bac0/users/4ad3f89b7037413a83c7905cef263b8f/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:23.010168 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d31fc1-994a-444e-9735-ee79b4e55a19 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b52e5e13b9144dfb663578766c2bac0, user_id=4ad3f89b7037413a83c7905cef263b8f, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:23.011589 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d31fc1-994a-444e-9735-ee79b4e55a19 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:23.069233 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 640/1273] 10.222.0.23 () {58 vars in 1439 bytes} [Sat Apr 30 20:52:22 2022] PUT /identity/v3/projects/6b52e5e13b9144dfb663578766c2bac0/users/4ad3f89b7037413a83c7905cef263b8f/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 20:52:25.350585 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fedb26-b582-4ae3-8b9a-3e76eb320c33 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:25.351137 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fedb26-b582-4ae3-8b9a-3e76eb320c33 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:25.351789 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fedb26-b582-4ae3-8b9a-3e76eb320c33 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:25.353051 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 634/1274] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:52:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:52:25.358370 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed7757-f8ce-4367-98c8-8aa0e0114faa None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:25.358777 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed7757-f8ce-4367-98c8-8aa0e0114faa None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:25.358973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed7757-f8ce-4367-98c8-8aa0e0114faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:25.375266 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-faed7757-f8ce-4367-98c8-8aa0e0114faa None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:52:25.376428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-faed7757-f8ce-4367-98c8-8aa0e0114faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:52:25.440303 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 641/1275] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:52:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:52:25.465634 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fedb26-b582-4ae3-8b9a-3e76eb320c33 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:25.563666 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fedb26-b582-4ae3-8b9a-3e76eb320c33 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:25.595375 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771911b-f231-4ba1-ae03-8392a051b102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:25.596151 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771911b-f231-4ba1-ae03-8392a051b102 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:25.596428 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771911b-f231-4ba1-ae03-8392a051b102 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:25.596700 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771911b-f231-4ba1-ae03-8392a051b102 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:25.606855 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8771911b-f231-4ba1-ae03-8392a051b102 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 20:52:25.614388 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-8771911b-f231-4ba1-ae03-8392a051b102 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:52:25.614388 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:52:25.614388 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:52:25.614388 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:52:25.614388 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:52:25.614388 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:52:25.614388 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:52:25.614388 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:52:25.614388 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:52:25.614388 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:52:25.614388 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:52:25.614388 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:52:25.614388 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Apr 30 20:52:25.614388 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(role_id) Apr 30 20:52:25.614388 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Apr 30 20:52:25.614388 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Apr 30 20:52:25.615769 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 20:52:25.615769 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 20:52:25.615769 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 20:52:25.615769 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 20:52:25.615769 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:52:25.615769 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:52:25.615769 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:52:25.615769 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:52:25.615769 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:52:25.615769 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:52:25.615769 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:52:25.615769 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:52:25.615769 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:52:25.615769 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:52:25.615769 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:52:25.615769 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:52:25.617383 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:52:25.617383 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:52:25.617383 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:52:25.617383 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:52:25.617383 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 20:52:25.617383 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 20:52:25.617383 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 20:52:25.617383 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 20:52:25.617383 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 20:52:25.617383 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 20:52:25.617383 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Apr 30 20:52:25.617383 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:52:25.617383 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 635/1276] 10.222.0.23 () {56 vars in 1096 bytes} [Sat Apr 30 20:52:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:52:25.622206 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed7757-f8ce-4367-98c8-8aa0e0114faa None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:25.720350 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed7757-f8ce-4367-98c8-8aa0e0114faa None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:25.754121 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5eeea-be08-4290-bc6d-2a4f93a85f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:25.754773 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5eeea-be08-4290-bc6d-2a4f93a85f06 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:25.755050 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5eeea-be08-4290-bc6d-2a4f93a85f06 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:25.755317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5eeea-be08-4290-bc6d-2a4f93a85f06 None admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:25.756043 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d5eeea-be08-4290-bc6d-2a4f93a85f06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:52:25.756343 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d5eeea-be08-4290-bc6d-2a4f93a85f06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:25.757703 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d5eeea-be08-4290-bc6d-2a4f93a85f06 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:25.765604 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 642/1277] 10.222.0.23 () {56 vars in 1099 bytes} [Sat Apr 30 20:52:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:52:25.771286 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771911b-f231-4ba1-ae03-8392a051b102 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:25.869279 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771911b-f231-4ba1-ae03-8392a051b102 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:25.901105 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56fbd08-d5d2-4410-8c3e-d5123a3d2936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:25.901928 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fbd08-d5d2-4410-8c3e-d5123a3d2936 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:25.902216 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fbd08-d5d2-4410-8c3e-d5123a3d2936 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:25.902497 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56fbd08-d5d2-4410-8c3e-d5123a3d2936 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:25.912551 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56fbd08-d5d2-4410-8c3e-d5123a3d2936 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:25.914563 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56fbd08-d5d2-4410-8c3e-d5123a3d2936 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:25.931095 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-f56fbd08-d5d2-4410-8c3e-d5123a3d2936 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:52:25.931095 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:52:25.931095 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:52:25.931095 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:52:25.931095 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:52:25.931095 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:52:25.931095 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:52:25.931095 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:52:25.931095 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:52:25.931095 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:52:25.931095 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:52:25.931095 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:52:25.931095 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:52:25.931095 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:52:25.931095 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:52:25.932131 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:52:25.932131 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:52:25.932131 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:52:25.932131 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:52:25.932131 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:52:25.932131 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:52:25.932131 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:52:25.932131 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:52:25.932131 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:52:25.932131 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:52:25.932131 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:52:25.932131 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:52:25.932131 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:52:25.932131 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:52:25.932131 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:52:25.932131 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:52:25.932131 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:52:25.933387 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:52:25.933387 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:52:25.933387 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:52:25.933387 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:52:25.933387 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 636/1278] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:52:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:52:25.938026 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5eeea-be08-4290-bc6d-2a4f93a85f06 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:26.034874 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5eeea-be08-4290-bc6d-2a4f93a85f06 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:26.066358 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30ff8d-a21d-4fdd-8646-d350d92bec4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:26.067009 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30ff8d-a21d-4fdd-8646-d350d92bec4f None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:26.067288 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30ff8d-a21d-4fdd-8646-d350d92bec4f None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:26.067561 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30ff8d-a21d-4fdd-8646-d350d92bec4f None admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:26.068273 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30ff8d-a21d-4fdd-8646-d350d92bec4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:52:26.068574 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30ff8d-a21d-4fdd-8646-d350d92bec4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:26.070213 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30ff8d-a21d-4fdd-8646-d350d92bec4f None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:26.082161 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 643/1279] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:52:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:52:26.088347 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56fbd08-d5d2-4410-8c3e-d5123a3d2936 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:26.184786 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56fbd08-d5d2-4410-8c3e-d5123a3d2936 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:26.218802 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5397a0-b484-4e85-85dd-890a44a7e228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:26.219595 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5397a0-b484-4e85-85dd-890a44a7e228 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:26.219878 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5397a0-b484-4e85-85dd-890a44a7e228 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:26.220155 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5397a0-b484-4e85-85dd-890a44a7e228 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:26.227394 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5397a0-b484-4e85-85dd-890a44a7e228 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:26.228890 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5397a0-b484-4e85-85dd-890a44a7e228 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:26.242859 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-6e5397a0-b484-4e85-85dd-890a44a7e228 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 30 20:52:26.242859 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:52:26.242859 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:52:26.242859 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:52:26.242859 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:52:26.242859 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:52:26.242859 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:52:26.242859 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:52:26.242859 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:52:26.242859 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:52:26.242859 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:52:26.242859 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:52:26.242859 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 20:52:26.242859 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 20:52:26.242859 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 20:52:26.242859 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 20:52:26.243960 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:52:26.243960 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:52:26.243960 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 20:52:26.243960 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:52:26.243960 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 20:52:26.243960 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 20:52:26.243960 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:52:26.243960 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:52:26.243960 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:52:26.243960 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:52:26.243960 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:52:26.243960 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:52:26.243960 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:52:26.243960 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:52:26.243960 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:52:26.243960 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:52:26.243960 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:52:26.243960 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:52:26.245109 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:52:26.245109 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:52:26.245109 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 20:52:26.245109 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 20:52:26.245109 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 20:52:26.245109 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 20:52:26.245109 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 20:52:26.245109 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 20:52:26.245109 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Apr 30 20:52:26.245109 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:52:26.245109 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 637/1280] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:52:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:52:26.249779 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30ff8d-a21d-4fdd-8646-d350d92bec4f None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:26.345736 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30ff8d-a21d-4fdd-8646-d350d92bec4f None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:26.378791 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d1bec-5aa2-4990-b7b9-64bad9f85c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:26.379559 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d1bec-5aa2-4990-b7b9-64bad9f85c5e None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:26.379843 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d1bec-5aa2-4990-b7b9-64bad9f85c5e None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:26.380117 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d1bec-5aa2-4990-b7b9-64bad9f85c5e None admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:26.380931 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d1bec-5aa2-4990-b7b9-64bad9f85c5e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:52:26.381235 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d1bec-5aa2-4990-b7b9-64bad9f85c5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:26.383274 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d1bec-5aa2-4990-b7b9-64bad9f85c5e None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:26.400049 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 644/1281] 10.222.0.23 () {56 vars in 1143 bytes} [Sat Apr 30 20:52:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:52:26.405726 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5397a0-b484-4e85-85dd-890a44a7e228 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:26.502704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5397a0-b484-4e85-85dd-890a44a7e228 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:26.535520 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab769f4-0ca7-445c-b0e8-f7fe80441822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:26.536199 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab769f4-0ca7-445c-b0e8-f7fe80441822 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:26.536482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab769f4-0ca7-445c-b0e8-f7fe80441822 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:26.536755 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab769f4-0ca7-445c-b0e8-f7fe80441822 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:26.601286 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab769f4-0ca7-445c-b0e8-f7fe80441822 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:26.602889 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab769f4-0ca7-445c-b0e8-f7fe80441822 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:26.698089 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 638/1282] 10.222.0.23 () {58 vars in 1282 bytes} [Sat Apr 30 20:52:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 30 20:52:26.703852 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d1bec-5aa2-4990-b7b9-64bad9f85c5e None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:26.798066 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d1bec-5aa2-4990-b7b9-64bad9f85c5e None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:26.830511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf3bbc2-576d-4159-9d1c-82f23ef37d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:26.831289 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3bbc2-576d-4159-9d1c-82f23ef37d98 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:26.831571 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3bbc2-576d-4159-9d1c-82f23ef37d98 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:26.831845 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3bbc2-576d-4159-9d1c-82f23ef37d98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:26.841475 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf3bbc2-576d-4159-9d1c-82f23ef37d98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:26.843210 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf3bbc2-576d-4159-9d1c-82f23ef37d98 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:26.860107 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-ebf3bbc2-576d-4159-9d1c-82f23ef37d98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:52:26.860107 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:52:26.860107 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:52:26.860107 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:52:26.860107 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:52:26.860107 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:52:26.860107 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:52:26.860107 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:52:26.860107 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:52:26.860107 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:52:26.860107 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:52:26.860107 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:52:26.860107 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 20:52:26.860107 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 20:52:26.860107 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 20:52:26.861294 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 20:52:26.861294 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:52:26.861294 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:52:26.861294 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:52:26.861294 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:52:26.861294 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:52:26.861294 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:52:26.861294 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:52:26.861294 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:52:26.861294 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:52:26.861294 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:52:26.861294 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:52:26.861294 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:52:26.861294 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:52:26.861294 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:52:26.861294 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:52:26.861294 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:52:26.866233 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Apr 30 20:52:26.866233 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 20:52:26.866233 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Apr 30 20:52:26.866233 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:52:26.866233 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 645/1283] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 20:52:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:52:26.867634 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab769f4-0ca7-445c-b0e8-f7fe80441822 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:26.961629 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab769f4-0ca7-445c-b0e8-f7fe80441822 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:26.994848 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d0b8b-1044-408b-bd68-dd8be6e64ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:26.995496 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d0b8b-1044-408b-bd68-dd8be6e64ec4 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:26.995774 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d0b8b-1044-408b-bd68-dd8be6e64ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:26.996047 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d0b8b-1044-408b-bd68-dd8be6e64ec4 None admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:26.996747 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33d0b8b-1044-408b-bd68-dd8be6e64ec4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:52:26.997048 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33d0b8b-1044-408b-bd68-dd8be6e64ec4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:26.998478 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33d0b8b-1044-408b-bd68-dd8be6e64ec4 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:27.009045 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 639/1284] 10.222.0.23 () {56 vars in 1109 bytes} [Sat Apr 30 20:52:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:52:27.014804 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf3bbc2-576d-4159-9d1c-82f23ef37d98 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:27.111475 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf3bbc2-576d-4159-9d1c-82f23ef37d98 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:27.148651 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620610a-9d47-4a02-9076-f1cb1ea3e112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:27.149429 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620610a-9d47-4a02-9076-f1cb1ea3e112 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:27.149721 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620610a-9d47-4a02-9076-f1cb1ea3e112 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:27.150026 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620610a-9d47-4a02-9076-f1cb1ea3e112 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:27.156502 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0620610a-9d47-4a02-9076-f1cb1ea3e112 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:27.158045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0620610a-9d47-4a02-9076-f1cb1ea3e112 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:27.171827 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-0620610a-9d47-4a02-9076-f1cb1ea3e112 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:52:27.171827 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:52:27.171827 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:52:27.171827 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:52:27.171827 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:52:27.171827 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:52:27.171827 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:52:27.171827 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:52:27.171827 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:52:27.171827 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:52:27.171827 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:52:27.171827 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:52:27.171827 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Apr 30 20:52:27.171827 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_project(project_id) Apr 30 20:52:27.171827 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Apr 30 20:52:27.172964 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Apr 30 20:52:27.172964 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:52:27.172964 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:52:27.172964 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:52:27.172964 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:52:27.172964 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:52:27.172964 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:52:27.172964 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:52:27.172964 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 20:52:27.172964 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:52:27.172964 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:52:27.172964 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:52:27.172964 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:52:27.172964 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:52:27.172964 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:52:27.172964 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:52:27.172964 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:52:27.174158 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Apr 30 20:52:27.174158 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Apr 30 20:52:27.174158 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 20:52:27.174158 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 20:52:27.174158 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 20:52:27.174158 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 20:52:27.174158 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Apr 30 20:52:27.174158 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 20:52:27.174158 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 646/1285] 10.222.0.23 () {56 vars in 1111 bytes} [Sat Apr 30 20:52:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:52:27.178854 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d0b8b-1044-408b-bd68-dd8be6e64ec4 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:27.289618 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d0b8b-1044-408b-bd68-dd8be6e64ec4 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:27.326080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c6b51-f2d8-4475-9ba9-2b7714fcaeb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:27.326793 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c6b51-f2d8-4475-9ba9-2b7714fcaeb0 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:27.327081 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c6b51-f2d8-4475-9ba9-2b7714fcaeb0 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:27.327361 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c6b51-f2d8-4475-9ba9-2b7714fcaeb0 None admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:27.328229 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c6b51-f2d8-4475-9ba9-2b7714fcaeb0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:52:27.328546 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c6b51-f2d8-4475-9ba9-2b7714fcaeb0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:27.330060 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c6b51-f2d8-4475-9ba9-2b7714fcaeb0 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:27.344118 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 640/1286] 10.222.0.23 () {56 vars in 1148 bytes} [Sat Apr 30 20:52:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:52:27.350759 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620610a-9d47-4a02-9076-f1cb1ea3e112 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:27.456259 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620610a-9d47-4a02-9076-f1cb1ea3e112 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:27.491891 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f574d-ea61-4d39-b697-04639136a851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:27.492564 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f574d-ea61-4d39-b697-04639136a851 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:27.492846 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f574d-ea61-4d39-b697-04639136a851 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:27.493120 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f574d-ea61-4d39-b697-04639136a851 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:27.494003 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f574d-ea61-4d39-b697-04639136a851 None admin] RBAC: Adding query filter params (role.id=30112eb1f3e047398c3c82fb40b72e62, scope.project.id=6b52e5e13b9144dfb663578766c2bac0, user.id=4ad3f89b7037413a83c7905cef263b8f) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:52:27.494319 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f574d-ea61-4d39-b697-04639136a851 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:27.495869 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f574d-ea61-4d39-b697-04639136a851 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:27.502751 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 647/1287] 10.222.0.23 () {56 vars in 1374 bytes} [Sat Apr 30 20:52:27 2022] GET /identity/v3/role_assignments?user.id=4ad3f89b7037413a83c7905cef263b8f&scope.project.id=6b52e5e13b9144dfb663578766c2bac0&role.id=30112eb1f3e047398c3c82fb40b72e62 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:52:29.854027 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e167cf-d12c-4625-9ca9-fb8e5b33dd11 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:29.854566 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e167cf-d12c-4625-9ca9-fb8e5b33dd11 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:29.854566 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e167cf-d12c-4625-9ca9-fb8e5b33dd11 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:29.855955 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 641/1288] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:52:29.861054 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7ce4d-c7b7-4448-9a3d-91c1f1735c5e None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:29.861507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7ce4d-c7b7-4448-9a3d-91c1f1735c5e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:29.871711 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7ce4d-c7b7-4448-9a3d-91c1f1735c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:29.878058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-deb7ce4d-c7b7-4448-9a3d-91c1f1735c5e None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:52:29.879236 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-deb7ce4d-c7b7-4448-9a3d-91c1f1735c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:52:29.941283 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 648/1289] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:52:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:52:29.965543 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e167cf-d12c-4625-9ca9-fb8e5b33dd11 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:30.061969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e167cf-d12c-4625-9ca9-fb8e5b33dd11 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:30.095157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e240f-6248-4ea6-9afb-fa6e9d3e7dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:30.095948 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e240f-6248-4ea6-9afb-fa6e9d3e7dde None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:30.096232 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e240f-6248-4ea6-9afb-fa6e9d3e7dde None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:30.096508 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e240f-6248-4ea6-9afb-fa6e9d3e7dde None admin] PATH_INFO: `/v3/services/placement` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:30.097155 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e240f-6248-4ea6-9afb-fa6e9d3e7dde None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:30.098554 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e240f-6248-4ea6-9afb-fa6e9d3e7dde None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:30.110158 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-394e240f-6248-4ea6-9afb-fa6e9d3e7dde None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 30 20:52:30.110158 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:52:30.110158 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:52:30.110158 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:52:30.110158 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:52:30.110158 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:52:30.110158 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:52:30.110158 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:52:30.110158 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Apr 30 20:52:30.110158 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:52:30.110158 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:52:30.110158 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:52:30.110158 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:52:30.110158 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:52:30.110158 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:52:30.110158 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:52:30.110158 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:52:30.111360 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:52:30.111360 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:52:30.111360 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:52:30.111360 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:52:30.111360 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:52:30.111360 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:52:30.111360 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:52:30.111360 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:52:30.111360 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:52:30.111360 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:52:30.111360 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:52:30.111360 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:52:30.111360 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:52:30.111360 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:52:30.111360 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:52:30.111360 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:52:30.112580 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:52:30.112580 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:52:30.112580 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:52:30.112580 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:52:30.112580 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:52:30.112580 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:52:30.112580 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:52:30.112580 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:52:30.112580 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:52:30.112580 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:52:30.112580 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:52:30.112580 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:52:30.112580 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Apr 30 20:52:30.112580 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:52:30.112580 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 642/1290] 10.222.0.23 () {56 vars in 1117 bytes} [Sat Apr 30 20:52:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:52:30.117138 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7ce4d-c7b7-4448-9a3d-91c1f1735c5e None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:30.211406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7ce4d-c7b7-4448-9a3d-91c1f1735c5e None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:30.243869 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b945176-2f27-4ac8-8ee8-1b00ee918d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:30.244555 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b945176-2f27-4ac8-8ee8-1b00ee918d92 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:30.244835 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b945176-2f27-4ac8-8ee8-1b00ee918d92 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:30.245106 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b945176-2f27-4ac8-8ee8-1b00ee918d92 None admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:30.245819 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b945176-2f27-4ac8-8ee8-1b00ee918d92 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:52:30.246124 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b945176-2f27-4ac8-8ee8-1b00ee918d92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:30.247490 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b945176-2f27-4ac8-8ee8-1b00ee918d92 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:30.252340 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 649/1291] 10.222.0.23 () {56 vars in 1116 bytes} [Sat Apr 30 20:52:30 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:52:30.258599 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e240f-6248-4ea6-9afb-fa6e9d3e7dde None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:30.356750 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e240f-6248-4ea6-9afb-fa6e9d3e7dde None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:30.389453 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78175d3e-bee5-425b-89e2-3735ebb7a205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:30.390080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78175d3e-bee5-425b-89e2-3735ebb7a205 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:30.390368 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78175d3e-bee5-425b-89e2-3735ebb7a205 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:30.390641 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78175d3e-bee5-425b-89e2-3735ebb7a205 None admin] PATH_INFO: `/v3/services` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:30.391333 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78175d3e-bee5-425b-89e2-3735ebb7a205 None admin] RBAC: Adding query filter params (type=placement) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:52:30.391637 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78175d3e-bee5-425b-89e2-3735ebb7a205 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:30.393025 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78175d3e-bee5-425b-89e2-3735ebb7a205 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:30.397277 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 643/1292] 10.222.0.23 () {56 vars in 1116 bytes} [Sat Apr 30 20:52:30 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:52:32.664978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b103312-da5a-41c3-8565-80ed914a04c6 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:32.665485 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b103312-da5a-41c3-8565-80ed914a04c6 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:32.665485 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b103312-da5a-41c3-8565-80ed914a04c6 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:32.666839 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 650/1293] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:52:32.671991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d75dc-ecda-4371-99d8-71e77be027be None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:32.672373 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d75dc-ecda-4371-99d8-71e77be027be None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:32.672548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d75dc-ecda-4371-99d8-71e77be027be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:32.689940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-8a6d75dc-ecda-4371-99d8-71e77be027be None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:52:32.691110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8a6d75dc-ecda-4371-99d8-71e77be027be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:52:32.762273 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 644/1294] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:52:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:52:32.785851 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b103312-da5a-41c3-8565-80ed914a04c6 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:32.881883 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b103312-da5a-41c3-8565-80ed914a04c6 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:32.914417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a696a64-9b01-4359-99db-7c1c7be17903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:32.915115 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a696a64-9b01-4359-99db-7c1c7be17903 None admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:32.915341 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a696a64-9b01-4359-99db-7c1c7be17903 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:32.915610 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a696a64-9b01-4359-99db-7c1c7be17903 None admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:32.916317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a696a64-9b01-4359-99db-7c1c7be17903 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:32.917673 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a696a64-9b01-4359-99db-7c1c7be17903 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:33.022366 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 651/1295] 10.222.0.23 () {60 vars in 1141 bytes} [Sat Apr 30 20:52:32 2022] POST /identity/v3/services => generated 246 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 20:52:35.357641 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32301b6e-7b34-4394-9a8f-3651a4ed0668 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:35.358230 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32301b6e-7b34-4394-9a8f-3651a4ed0668 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:35.358325 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32301b6e-7b34-4394-9a8f-3651a4ed0668 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:35.359630 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 645/1296] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:52:35.364718 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aea266-e0ac-4a4a-9595-16c779b31b75 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:35.365685 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aea266-e0ac-4a4a-9595-16c779b31b75 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:35.365685 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aea266-e0ac-4a4a-9595-16c779b31b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:35.381649 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-57aea266-e0ac-4a4a-9595-16c779b31b75 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:52:35.383353 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-57aea266-e0ac-4a4a-9595-16c779b31b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:52:35.453207 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 652/1297] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:52:35 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:52:35.477460 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32301b6e-7b34-4394-9a8f-3651a4ed0668 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:35.574268 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32301b6e-7b34-4394-9a8f-3651a4ed0668 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:35.606286 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bdaea5-dafd-4549-9072-a116a78357f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:35.607069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdaea5-dafd-4549-9072-a116a78357f6 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:35.607349 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdaea5-dafd-4549-9072-a116a78357f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:35.607620 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdaea5-dafd-4549-9072-a116a78357f6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:35.608255 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bdaea5-dafd-4549-9072-a116a78357f6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:35.609615 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bdaea5-dafd-4549-9072-a116a78357f6 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:35.621475 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-d4bdaea5-dafd-4549-9072-a116a78357f6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 30 20:52:35.621475 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:52:35.621475 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:52:35.621475 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:52:35.621475 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:52:35.621475 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:52:35.621475 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:52:35.621475 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:52:35.621475 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Apr 30 20:52:35.621475 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:52:35.621475 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:52:35.621475 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:52:35.621475 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:52:35.621475 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:52:35.621475 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:52:35.621475 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:52:35.621475 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:52:35.625027 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:52:35.625027 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:52:35.625027 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:52:35.625027 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:52:35.625027 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:52:35.625027 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:52:35.625027 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:52:35.625027 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:52:35.625027 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:52:35.625027 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:52:35.625027 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:52:35.625027 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:52:35.625027 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:52:35.625027 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:52:35.625027 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:52:35.625027 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:52:35.626120 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:52:35.626120 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:52:35.626120 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:52:35.626120 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:52:35.626120 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:52:35.626120 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:52:35.626120 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:52:35.626120 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:52:35.626120 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:52:35.626120 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:52:35.626120 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:52:35.626120 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:52:35.626120 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Apr 30 20:52:35.626120 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:52:35.626120 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 646/1298] 10.222.0.23 () {56 vars in 1117 bytes} [Sat Apr 30 20:52:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:52:35.628583 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aea266-e0ac-4a4a-9595-16c779b31b75 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:35.731214 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aea266-e0ac-4a4a-9595-16c779b31b75 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:35.764884 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e5984-7806-4517-8d92-79a9985fa188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:35.765537 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e5984-7806-4517-8d92-79a9985fa188 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:35.765853 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e5984-7806-4517-8d92-79a9985fa188 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:35.766127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e5984-7806-4517-8d92-79a9985fa188 None admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:35.766822 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e5984-7806-4517-8d92-79a9985fa188 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:52:35.767125 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e5984-7806-4517-8d92-79a9985fa188 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:35.768486 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e5984-7806-4517-8d92-79a9985fa188 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:35.773467 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 653/1299] 10.222.0.23 () {56 vars in 1116 bytes} [Sat Apr 30 20:52:35 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:52:35.779464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bdaea5-dafd-4549-9072-a116a78357f6 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:35.876236 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bdaea5-dafd-4549-9072-a116a78357f6 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:35.908650 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ecd98f-4eda-4234-9f44-638b343f493b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:35.909298 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecd98f-4eda-4234-9f44-638b343f493b None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:35.909607 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecd98f-4eda-4234-9f44-638b343f493b None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:35.909910 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecd98f-4eda-4234-9f44-638b343f493b None admin] PATH_INFO: `/v3/endpoints` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:35.910688 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ecd98f-4eda-4234-9f44-638b343f493b None admin] RBAC: Adding query filter params (interface=public, service_id=eedd0e537fc4480abfb745dbe39bb76b, region_id=RegionOne) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:52:35.910996 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ecd98f-4eda-4234-9f44-638b343f493b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:35.912353 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ecd98f-4eda-4234-9f44-638b343f493b None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:35.917312 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 647/1300] 10.222.0.23 () {56 vars in 1251 bytes} [Sat Apr 30 20:52:35 2022] GET /identity/v3/endpoints?service_id=eedd0e537fc4480abfb745dbe39bb76b&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:52:35.923166 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e5984-7806-4517-8d92-79a9985fa188 None admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:36.024348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e5984-7806-4517-8d92-79a9985fa188 None admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:36.056854 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cfac6d-6fc9-4e0f-9497-152fe1d2d777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:36.057529 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cfac6d-6fc9-4e0f-9497-152fe1d2d777 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:36.057834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cfac6d-6fc9-4e0f-9497-152fe1d2d777 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:36.058106 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cfac6d-6fc9-4e0f-9497-152fe1d2d777 None admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:36.058783 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cfac6d-6fc9-4e0f-9497-152fe1d2d777 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:36.060143 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cfac6d-6fc9-4e0f-9497-152fe1d2d777 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:36.066819 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 654/1301] 10.222.0.23 () {56 vars in 1087 bytes} [Sat Apr 30 20:52:35 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 20:52:38.373596 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755c76f-d0bf-4e24-9d27-4b107181b903 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:38.374162 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755c76f-d0bf-4e24-9d27-4b107181b903 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:38.374162 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755c76f-d0bf-4e24-9d27-4b107181b903 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:38.375528 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 648/1302] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:52:38.380625 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad495c-8f0a-49c5-91dd-d288df1a512f None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:38.381002 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad495c-8f0a-49c5-91dd-d288df1a512f None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:38.381216 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad495c-8f0a-49c5-91dd-d288df1a512f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:38.397541 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-8fad495c-8f0a-49c5-91dd-d288df1a512f None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:52:38.399228 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8fad495c-8f0a-49c5-91dd-d288df1a512f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:52:38.462574 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 655/1303] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:52:38 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 20:52:38.486258 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755c76f-d0bf-4e24-9d27-4b107181b903 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:38.584800 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755c76f-d0bf-4e24-9d27-4b107181b903 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:38.616815 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327fe6e-5bbf-4caa-9e24-eb4677baeea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:38.617597 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327fe6e-5bbf-4caa-9e24-eb4677baeea6 None admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:38.617908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327fe6e-5bbf-4caa-9e24-eb4677baeea6 None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:38.618182 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327fe6e-5bbf-4caa-9e24-eb4677baeea6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:38.618823 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0327fe6e-5bbf-4caa-9e24-eb4677baeea6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:38.620176 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0327fe6e-5bbf-4caa-9e24-eb4677baeea6 None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:38.631723 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-0327fe6e-5bbf-4caa-9e24-eb4677baeea6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 30 20:52:38.631723 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:52:38.631723 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 20:52:38.631723 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 20:52:38.631723 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 20:52:38.631723 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 20:52:38.631723 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 20:52:38.631723 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:52:38.631723 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Apr 30 20:52:38.631723 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:52:38.631723 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 20:52:38.631723 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:52:38.631723 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 20:52:38.631723 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 20:52:38.631723 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 20:52:38.631723 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 20:52:38.631723 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 20:52:38.633595 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 20:52:38.633595 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 20:52:38.633595 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 20:52:38.633595 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 20:52:38.633595 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 20:52:38.633595 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 20:52:38.633595 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 20:52:38.633595 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 20:52:38.633595 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 20:52:38.633595 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 20:52:38.633595 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 20:52:38.633595 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 20:52:38.633595 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 20:52:38.633595 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 20:52:38.633595 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 20:52:38.633595 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 20:52:38.634677 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 20:52:38.634677 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 20:52:38.634677 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 20:52:38.634677 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 20:52:38.634677 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 20:52:38.634677 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 20:52:38.634677 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 20:52:38.634677 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 20:52:38.634677 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 20:52:38.634677 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 20:52:38.634677 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 20:52:38.634677 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 20:52:38.634677 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Apr 30 20:52:38.634677 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 20:52:38.634677 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 649/1304] 10.222.0.23 () {56 vars in 1117 bytes} [Sat Apr 30 20:52:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 20:52:38.639729 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad495c-8f0a-49c5-91dd-d288df1a512f None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:38.733561 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad495c-8f0a-49c5-91dd-d288df1a512f None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:38.765279 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4b767-7cb8-4ded-bf2c-4cf2d98af5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:38.767390 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4b767-7cb8-4ded-bf2c-4cf2d98af5a0 None admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:38.767390 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4b767-7cb8-4ded-bf2c-4cf2d98af5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:38.767390 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4b767-7cb8-4ded-bf2c-4cf2d98af5a0 None admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:38.767390 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff4b767-7cb8-4ded-bf2c-4cf2d98af5a0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 20:52:38.767719 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff4b767-7cb8-4ded-bf2c-4cf2d98af5a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:38.768776 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff4b767-7cb8-4ded-bf2c-4cf2d98af5a0 None admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:38.773648 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 656/1305] 10.222.0.23 () {56 vars in 1116 bytes} [Sat Apr 30 20:52:38 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 20:52:38.779563 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327fe6e-5bbf-4caa-9e24-eb4677baeea6 None admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:52:38.876336 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327fe6e-5bbf-4caa-9e24-eb4677baeea6 None admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:52:38.908485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c2b5e-3a64-4101-9437-156de79158cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:52:38.909135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c2b5e-3a64-4101-9437-156de79158cb None admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:52:38.909417 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c2b5e-3a64-4101-9437-156de79158cb None admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:52:38.909688 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c2b5e-3a64-4101-9437-156de79158cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:52:38.910477 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c2b5e-3a64-4101-9437-156de79158cb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:52:38.911850 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c2b5e-3a64-4101-9437-156de79158cb None admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:52:38.994329 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 650/1306] 10.222.0.23 () {60 vars in 1144 bytes} [Sat Apr 30 20:52:38 2022] POST /identity/v3/endpoints => generated 331 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 20:59:20.905841 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c9004-b046-4db7-886d-1bd54eb0367d None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:20.906340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c9004-b046-4db7-886d-1bd54eb0367d None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:20.906441 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c9004-b046-4db7-886d-1bd54eb0367d None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:20.907762 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 657/1307] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:59:20.914596 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaaf3f5-018b-443a-910c-bdaf4d94bae3 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:20.915051 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaaf3f5-018b-443a-910c-bdaf4d94bae3 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:20.915210 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaaf3f5-018b-443a-910c-bdaf4d94bae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:20.996610 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-dcaaf3f5-018b-443a-910c-bdaf4d94bae3 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:59:20.997857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-dcaaf3f5-018b-443a-910c-bdaf4d94bae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:21.118120 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 651/1308] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:59:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:59:21.160786 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb2015-ebdb-4b36-967d-570f8bcd95d0 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:21.161067 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb2015-ebdb-4b36-967d-570f8bcd95d0 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:21.161570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb2015-ebdb-4b36-967d-570f8bcd95d0 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:21.163381 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 658/1309] 10.222.0.23 () {54 vars in 964 bytes} [Sat Apr 30 20:59:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:59:21.169689 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8a87f-5013-46da-bac3-7ae88e9484e6 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:21.170201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8a87f-5013-46da-bac3-7ae88e9484e6 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:21.170640 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8a87f-5013-46da-bac3-7ae88e9484e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:21.250994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-b4b8a87f-5013-46da-bac3-7ae88e9484e6 None None] MFA Rules not processed for user `0b0cb145b72a492ebb8c0e9223be47a1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:59:21.252443 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b4b8a87f-5013-46da-bac3-7ae88e9484e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:21.348174 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb2015-ebdb-4b36-967d-570f8bcd95d0 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:59:21.350199 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3fcb2015-ebdb-4b36-967d-570f8bcd95d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:21.354324 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 652/1310] 10.222.0.23 () {58 vars in 1061 bytes} [Sat Apr 30 20:59:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:59:21.468935 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb2015-ebdb-4b36-967d-570f8bcd95d0 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:59:21.545634 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771678c-87c0-4e88-b6ab-372998268d5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:59:21.546616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771678c-87c0-4e88-b6ab-372998268d5b service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:21.547078 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771678c-87c0-4e88-b6ab-372998268d5b service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:21.547507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771678c-87c0-4e88-b6ab-372998268d5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:21.549325 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e771678c-87c0-4e88-b6ab-372998268d5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:21.660617 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e771678c-87c0-4e88-b6ab-372998268d5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:59:21.662366 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e771678c-87c0-4e88-b6ab-372998268d5b service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:59:21.702250 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 659/1311] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 20:59:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 20:59:24.339700 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05455817-588f-4900-a296-8a874a79fcf3 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:24.340221 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05455817-588f-4900-a296-8a874a79fcf3 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:24.340337 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05455817-588f-4900-a296-8a874a79fcf3 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:24.347986 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752dfe1-c258-44f9-9698-3223bd877837 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:24.348837 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752dfe1-c258-44f9-9698-3223bd877837 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:24.349303 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752dfe1-c258-44f9-9698-3223bd877837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:24.352788 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 653/1312] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:59:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:59:24.445422 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-b752dfe1-c258-44f9-9698-3223bd877837 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:59:24.446767 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b752dfe1-c258-44f9-9698-3223bd877837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:24.542983 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 660/1313] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:59:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:59:24.582146 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05455817-588f-4900-a296-8a874a79fcf3 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:59:24.583667 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-05455817-588f-4900-a296-8a874a79fcf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:24.697785 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05455817-588f-4900-a296-8a874a79fcf3 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:59:24.770983 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e0300-b10c-4786-adc6-fd0d11080b2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:59:24.771663 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e0300-b10c-4786-adc6-fd0d11080b2c service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:24.771944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e0300-b10c-4786-adc6-fd0d11080b2c service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:24.772217 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e0300-b10c-4786-adc6-fd0d11080b2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:24.773879 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a89e0300-b10c-4786-adc6-fd0d11080b2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:24.880179 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e0300-b10c-4786-adc6-fd0d11080b2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:59:24.881629 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e0300-b10c-4786-adc6-fd0d11080b2c service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:59:24.899205 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 654/1314] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 20:59:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:59:27.741632 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07accf8-7983-45f9-b52a-a7aea173615c None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:27.742229 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07accf8-7983-45f9-b52a-a7aea173615c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:27.742229 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07accf8-7983-45f9-b52a-a7aea173615c None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:27.743728 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 661/1315] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:59:27.749142 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905f39f-4462-435c-aebc-c668680e8f4e None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:27.749524 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905f39f-4462-435c-aebc-c668680e8f4e None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:27.749712 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905f39f-4462-435c-aebc-c668680e8f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:27.813429 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-0905f39f-4462-435c-aebc-c668680e8f4e None None] MFA Rules not processed for user `8a0fda9a48cb42cb8504bd361b8b4465`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:59:27.814671 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0905f39f-4462-435c-aebc-c668680e8f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:27.915831 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 655/1316] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:59:27 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:59:27.956809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07accf8-7983-45f9-b52a-a7aea173615c None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:59:27.958396 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f07accf8-7983-45f9-b52a-a7aea173615c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:28.057157 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07accf8-7983-45f9-b52a-a7aea173615c None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:59:28.126719 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628672f6-9da1-4029-944f-5d5d3bd5603a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:59:28.127358 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628672f6-9da1-4029-944f-5d5d3bd5603a service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:28.127640 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628672f6-9da1-4029-944f-5d5d3bd5603a service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:28.127915 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628672f6-9da1-4029-944f-5d5d3bd5603a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:28.129635 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-628672f6-9da1-4029-944f-5d5d3bd5603a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:28.232047 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628672f6-9da1-4029-944f-5d5d3bd5603a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:59:28.233483 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628672f6-9da1-4029-944f-5d5d3bd5603a service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:59:28.252995 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 662/1317] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 20:59:27 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:59:31.410305 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffca710-5029-426e-a555-cb653be7cd34 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:31.410878 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffca710-5029-426e-a555-cb653be7cd34 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:31.410878 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffca710-5029-426e-a555-cb653be7cd34 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:31.412142 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 656/1318] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:59:31.417274 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477401dc-b039-4316-b74a-9d05a63a90e2 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:31.417700 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477401dc-b039-4316-b74a-9d05a63a90e2 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:31.417870 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477401dc-b039-4316-b74a-9d05a63a90e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:31.479700 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-477401dc-b039-4316-b74a-9d05a63a90e2 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:59:31.480902 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-477401dc-b039-4316-b74a-9d05a63a90e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:31.572530 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 663/1319] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:59:31 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:59:31.625432 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5d0b9-04eb-461a-8c4d-c7cac580a34a None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:31.625718 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5d0b9-04eb-461a-8c4d-c7cac580a34a None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:31.626027 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5d0b9-04eb-461a-8c4d-c7cac580a34a None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:31.627396 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 657/1320] 10.222.0.23 () {54 vars in 964 bytes} [Sat Apr 30 20:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:59:31.634437 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fe42e-a8eb-4d1d-8546-1249f107fb98 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:31.634730 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fe42e-a8eb-4d1d-8546-1249f107fb98 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:31.635011 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fe42e-a8eb-4d1d-8546-1249f107fb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:31.707749 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-da3fe42e-a8eb-4d1d-8546-1249f107fb98 None None] MFA Rules not processed for user `0b0cb145b72a492ebb8c0e9223be47a1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:59:31.708947 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-da3fe42e-a8eb-4d1d-8546-1249f107fb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:31.781035 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 664/1321] 10.222.0.23 () {58 vars in 1061 bytes} [Sat Apr 30 20:59:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:59:31.789984 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5d0b9-04eb-461a-8c4d-c7cac580a34a None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:59:31.791515 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0bc5d0b9-04eb-461a-8c4d-c7cac580a34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:31.889570 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5d0b9-04eb-461a-8c4d-c7cac580a34a None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:59:31.959332 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9196a-2183-4a2c-86cf-7953f7248bb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:59:31.959907 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9196a-2183-4a2c-86cf-7953f7248bb3 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:31.960187 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9196a-2183-4a2c-86cf-7953f7248bb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:31.960460 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9196a-2183-4a2c-86cf-7953f7248bb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:31.962104 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d8a9196a-2183-4a2c-86cf-7953f7248bb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:32.066752 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a9196a-2183-4a2c-86cf-7953f7248bb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:59:32.068198 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a9196a-2183-4a2c-86cf-7953f7248bb3 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:59:32.085867 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 658/1322] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 20:59:31 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:59:35.823496 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc4ec9-dde8-4cba-a5e1-8c7b60a38e49 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:35.824058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc4ec9-dde8-4cba-a5e1-8c7b60a38e49 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:35.824058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc4ec9-dde8-4cba-a5e1-8c7b60a38e49 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:35.825529 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 665/1323] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:59:35.830842 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e581d-f0bb-4822-be28-6363921042a2 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:35.831331 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e581d-f0bb-4822-be28-6363921042a2 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:35.831572 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e581d-f0bb-4822-be28-6363921042a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:35.897300 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-323e581d-f0bb-4822-be28-6363921042a2 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:59:35.898686 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-323e581d-f0bb-4822-be28-6363921042a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:35.993027 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 659/1324] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:59:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:59:36.030012 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc4ec9-dde8-4cba-a5e1-8c7b60a38e49 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:59:36.031799 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-05cc4ec9-dde8-4cba-a5e1-8c7b60a38e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:36.133688 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc4ec9-dde8-4cba-a5e1-8c7b60a38e49 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:59:36.204597 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56797786-6863-4319-a8fd-fbb5e4d424c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:59:36.205239 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56797786-6863-4319-a8fd-fbb5e4d424c4 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:36.205521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56797786-6863-4319-a8fd-fbb5e4d424c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:36.205834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56797786-6863-4319-a8fd-fbb5e4d424c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:36.208397 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-56797786-6863-4319-a8fd-fbb5e4d424c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:36.314813 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56797786-6863-4319-a8fd-fbb5e4d424c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:59:36.316768 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56797786-6863-4319-a8fd-fbb5e4d424c4 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:59:36.335190 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 666/1325] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 20:59:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:59:38.700719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fbdc2-aeba-46e5-842a-40922fa2b619 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:38.701619 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fbdc2-aeba-46e5-842a-40922fa2b619 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:38.701943 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fbdc2-aeba-46e5-842a-40922fa2b619 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:38.703396 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 660/1326] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:59:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:59:38.709585 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3c05d-03b0-4c8b-a63a-50d9a3c518e8 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:38.715094 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3c05d-03b0-4c8b-a63a-50d9a3c518e8 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:38.715094 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3c05d-03b0-4c8b-a63a-50d9a3c518e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:38.775002 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-f7e3c05d-03b0-4c8b-a63a-50d9a3c518e8 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:59:38.776198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f7e3c05d-03b0-4c8b-a63a-50d9a3c518e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:38.880596 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 667/1327] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:59:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:59:38.917368 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07fbdc2-aeba-46e5-842a-40922fa2b619 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:59:38.919119 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b07fbdc2-aeba-46e5-842a-40922fa2b619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:39.021141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07fbdc2-aeba-46e5-842a-40922fa2b619 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:59:39.094225 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0146c-375a-41de-99ae-722a0b99c0d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:59:39.094873 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0146c-375a-41de-99ae-722a0b99c0d6 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:39.095150 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0146c-375a-41de-99ae-722a0b99c0d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:39.095427 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0146c-375a-41de-99ae-722a0b99c0d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:39.097576 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-39c0146c-375a-41de-99ae-722a0b99c0d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:39.211262 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c0146c-375a-41de-99ae-722a0b99c0d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:59:39.212872 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c0146c-375a-41de-99ae-722a0b99c0d6 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:59:39.230474 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 661/1328] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 20:59:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:59:41.591914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b65ef-1565-4d27-9880-8511443ab446 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:41.592466 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b65ef-1565-4d27-9880-8511443ab446 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:41.592466 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b65ef-1565-4d27-9880-8511443ab446 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:41.593749 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 668/1329] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:59:41.599432 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac63c1d-277f-43f1-8cc9-973f563298b9 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:41.599866 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac63c1d-277f-43f1-8cc9-973f563298b9 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:41.600006 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac63c1d-277f-43f1-8cc9-973f563298b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:41.662717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-0ac63c1d-277f-43f1-8cc9-973f563298b9 None None] MFA Rules not processed for user `8a0fda9a48cb42cb8504bd361b8b4465`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:59:41.663901 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0ac63c1d-277f-43f1-8cc9-973f563298b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:41.758145 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 662/1330] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:59:41 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:59:41.797053 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b65ef-1565-4d27-9880-8511443ab446 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:59:41.798725 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-206b65ef-1565-4d27-9880-8511443ab446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:41.908326 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b65ef-1565-4d27-9880-8511443ab446 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:59:41.985029 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad8697-b760-4390-9111-a352ba393ed8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:59:41.985680 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad8697-b760-4390-9111-a352ba393ed8 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:41.986040 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad8697-b760-4390-9111-a352ba393ed8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:41.986318 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad8697-b760-4390-9111-a352ba393ed8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:41.987973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-69ad8697-b760-4390-9111-a352ba393ed8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:42.096935 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad8697-b760-4390-9111-a352ba393ed8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:59:42.098459 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad8697-b760-4390-9111-a352ba393ed8 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:59:42.116003 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 669/1331] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 20:59:41 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:59:44.830667 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3656b2-a0ba-45aa-8584-ff88ec21627b None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:44.831235 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3656b2-a0ba-45aa-8584-ff88ec21627b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:44.831235 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3656b2-a0ba-45aa-8584-ff88ec21627b None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:44.832662 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 663/1332] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:59:44.838307 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af506050-0ec4-4320-aa11-b0f80c904f2f None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:44.838848 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af506050-0ec4-4320-aa11-b0f80c904f2f None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:44.838848 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af506050-0ec4-4320-aa11-b0f80c904f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:44.917492 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-af506050-0ec4-4320-aa11-b0f80c904f2f None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:59:44.918730 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-af506050-0ec4-4320-aa11-b0f80c904f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:45.012466 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 670/1333] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:59:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:59:45.049815 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3656b2-a0ba-45aa-8584-ff88ec21627b None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:59:45.051344 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ce3656b2-a0ba-45aa-8584-ff88ec21627b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:45.159438 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3656b2-a0ba-45aa-8584-ff88ec21627b None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:59:45.237975 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb2e7a-ca26-4ab9-8da9-2490f1b73337 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:59:45.238644 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb2e7a-ca26-4ab9-8da9-2490f1b73337 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:45.238925 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb2e7a-ca26-4ab9-8da9-2490f1b73337 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:45.239202 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb2e7a-ca26-4ab9-8da9-2490f1b73337 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:45.240887 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5feb2e7a-ca26-4ab9-8da9-2490f1b73337 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:45.352941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feb2e7a-ca26-4ab9-8da9-2490f1b73337 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:59:45.354474 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feb2e7a-ca26-4ab9-8da9-2490f1b73337 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:59:45.378744 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 664/1334] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 20:59:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:59:47.789175 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed40e0-cd34-4139-8f54-7dc0804d7aa3 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:47.789748 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed40e0-cd34-4139-8f54-7dc0804d7aa3 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:47.789748 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed40e0-cd34-4139-8f54-7dc0804d7aa3 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:47.791139 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 671/1335] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:59:47.796276 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd0cac-cf50-4411-ad77-345d0ec048f5 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:47.796680 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd0cac-cf50-4411-ad77-345d0ec048f5 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:47.796840 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd0cac-cf50-4411-ad77-345d0ec048f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:47.861271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-82bd0cac-cf50-4411-ad77-345d0ec048f5 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:59:47.862538 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-82bd0cac-cf50-4411-ad77-345d0ec048f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:47.954979 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 665/1336] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:59:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:59:47.996306 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed40e0-cd34-4139-8f54-7dc0804d7aa3 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:59:47.997865 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-feed40e0-cd34-4139-8f54-7dc0804d7aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:48.098545 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed40e0-cd34-4139-8f54-7dc0804d7aa3 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:59:48.168935 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf678d-a4eb-496b-8c20-059bb60474d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:59:48.169586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf678d-a4eb-496b-8c20-059bb60474d9 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:48.169896 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf678d-a4eb-496b-8c20-059bb60474d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:48.170173 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf678d-a4eb-496b-8c20-059bb60474d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:48.171911 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-eabf678d-a4eb-496b-8c20-059bb60474d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:48.277035 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf678d-a4eb-496b-8c20-059bb60474d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:59:48.278511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf678d-a4eb-496b-8c20-059bb60474d9 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:59:48.296364 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 672/1337] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 20:59:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:59:51.260334 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416a8b6-555a-4c03-9477-ca1e72f37e59 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:51.261037 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416a8b6-555a-4c03-9477-ca1e72f37e59 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:51.261037 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416a8b6-555a-4c03-9477-ca1e72f37e59 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:51.263014 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 666/1338] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:59:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:59:51.268582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fc5a7-7e2e-417f-88bb-f557d8dc1d6b None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:51.269572 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fc5a7-7e2e-417f-88bb-f557d8dc1d6b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:51.270147 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fc5a7-7e2e-417f-88bb-f557d8dc1d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:51.338552 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-3f3fc5a7-7e2e-417f-88bb-f557d8dc1d6b None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:59:51.339672 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3f3fc5a7-7e2e-417f-88bb-f557d8dc1d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:51.439474 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 673/1339] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:59:51 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 20:59:51.475871 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416a8b6-555a-4c03-9477-ca1e72f37e59 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:59:51.478039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-9416a8b6-555a-4c03-9477-ca1e72f37e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:51.585323 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416a8b6-555a-4c03-9477-ca1e72f37e59 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:59:51.589195 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc484d-b70f-42b9-a5f1-27b68dd873ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:59:51.589677 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc484d-b70f-42b9-a5f1-27b68dd873ed service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:51.590108 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc484d-b70f-42b9-a5f1-27b68dd873ed service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:51.590389 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc484d-b70f-42b9-a5f1-27b68dd873ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:51.618959 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc484d-b70f-42b9-a5f1-27b68dd873ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:59:51.620401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc484d-b70f-42b9-a5f1-27b68dd873ed service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:59:51.646587 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 667/1340] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 20:59:51 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 20:59:56.375613 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41f4d4-ba35-4f1a-bc81-1882ebfdaf06 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:56.385174 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41f4d4-ba35-4f1a-bc81-1882ebfdaf06 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:56.385174 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41f4d4-ba35-4f1a-bc81-1882ebfdaf06 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:56.385174 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 674/1341] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:59:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:59:56.385499 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6161fd4-1358-41be-bb15-b57352a01433 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:56.385499 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6161fd4-1358-41be-bb15-b57352a01433 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:56.385499 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6161fd4-1358-41be-bb15-b57352a01433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:56.441967 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-e6161fd4-1358-41be-bb15-b57352a01433 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:59:56.443176 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e6161fd4-1358-41be-bb15-b57352a01433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:56.517007 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 668/1342] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:59:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 20:59:56.557635 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41f4d4-ba35-4f1a-bc81-1882ebfdaf06 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 20:59:56.568334 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41f4d4-ba35-4f1a-bc81-1882ebfdaf06 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 20:59:56.571826 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7dbd4-c353-4d29-9ce5-552f15b329ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 20:59:56.572459 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7dbd4-c353-4d29-9ce5-552f15b329ae service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:56.572742 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7dbd4-c353-4d29-9ce5-552f15b329ae service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:56.573020 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7dbd4-c353-4d29-9ce5-552f15b329ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:56.582487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7dbd4-c353-4d29-9ce5-552f15b329ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 20:59:56.583921 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7dbd4-c353-4d29-9ce5-552f15b329ae service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 20:59:56.593069 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 675/1343] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 20:59:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 20:59:59.953016 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa8c96-d43d-468a-9f1d-32cccfbc2561 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:59.953856 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa8c96-d43d-468a-9f1d-32cccfbc2561 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:59.953856 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa8c96-d43d-468a-9f1d-32cccfbc2561 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:59.955922 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 669/1344] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 20:59:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 20:59:59.961178 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcea443-a1e2-4075-930f-8cab0af32e3d None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 20:59:59.961605 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcea443-a1e2-4075-930f-8cab0af32e3d None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 20:59:59.961722 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcea443-a1e2-4075-930f-8cab0af32e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 20:59:59.989919 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-1fcea443-a1e2-4075-930f-8cab0af32e3d None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 20:59:59.991116 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1fcea443-a1e2-4075-930f-8cab0af32e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 20:59:59.999045 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 676/1345] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 20:59:59 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:00:00.037138 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa8c96-d43d-468a-9f1d-32cccfbc2561 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:00:00.047907 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa8c96-d43d-468a-9f1d-32cccfbc2561 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:00:00.052133 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ecf604-2169-48de-93d3-e2ba769e02ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:00:00.052847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecf604-2169-48de-93d3-e2ba769e02ae service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:00.053141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecf604-2169-48de-93d3-e2ba769e02ae service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:00.053422 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecf604-2169-48de-93d3-e2ba769e02ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:00.062724 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ecf604-2169-48de-93d3-e2ba769e02ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:00:00.064221 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ecf604-2169-48de-93d3-e2ba769e02ae service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:00:00.074714 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 670/1346] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:00:00 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:00:04.696458 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52758c1-2408-4683-980b-672b26be4781 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:04.697020 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52758c1-2408-4683-980b-672b26be4781 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:04.697020 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52758c1-2408-4683-980b-672b26be4781 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:04.698463 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 677/1347] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 21:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:00:04.703829 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbc327-216e-4167-8672-632fa68b7a08 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:04.704305 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbc327-216e-4167-8672-632fa68b7a08 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:04.704402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbc327-216e-4167-8672-632fa68b7a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:04.726306 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-03bbc327-216e-4167-8672-632fa68b7a08 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:00:04.727524 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-03bbc327-216e-4167-8672-632fa68b7a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:00:04.735413 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 671/1348] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 21:00:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:00:04.774489 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52758c1-2408-4683-980b-672b26be4781 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:00:04.785876 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52758c1-2408-4683-980b-672b26be4781 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:00:04.789462 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d6c99-56bb-4ae8-80e1-aeaaf3ebb2ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:00:04.790141 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d6c99-56bb-4ae8-80e1-aeaaf3ebb2ce service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:04.790422 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d6c99-56bb-4ae8-80e1-aeaaf3ebb2ce service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:04.790699 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d6c99-56bb-4ae8-80e1-aeaaf3ebb2ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:04.800054 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d6c99-56bb-4ae8-80e1-aeaaf3ebb2ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:00:04.801496 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d6c99-56bb-4ae8-80e1-aeaaf3ebb2ce service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:00:04.811788 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 678/1349] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:00:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:00:10.333798 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4bb85-c945-4acf-ab45-88f33f246fb2 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:10.334628 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4bb85-c945-4acf-ab45-88f33f246fb2 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:10.335156 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4bb85-c945-4acf-ab45-88f33f246fb2 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:10.342766 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 672/1350] 10.222.0.23 () {54 vars in 921 bytes} [Sat Apr 30 21:00:10 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:00:10.359363 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ec085-08a7-4e83-8f77-9cf7a7fbe1cd None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:10.360235 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ec085-08a7-4e83-8f77-9cf7a7fbe1cd None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:10.361200 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ec085-08a7-4e83-8f77-9cf7a7fbe1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:10.455537 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-bb4ec085-08a7-4e83-8f77-9cf7a7fbe1cd None None] MFA Rules not processed for user `4ad3f89b7037413a83c7905cef263b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:00:10.456949 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-bb4ec085-08a7-4e83-8f77-9cf7a7fbe1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:00:10.554947 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 679/1351] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Apr 30 21:00:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:00:14.957714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da23292-09db-45c9-8b66-5bbb5fbeb1df None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:14.958300 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da23292-09db-45c9-8b66-5bbb5fbeb1df None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:14.958300 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da23292-09db-45c9-8b66-5bbb5fbeb1df None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:14.959943 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 673/1352] 10.222.0.23 () {54 vars in 921 bytes} [Sat Apr 30 21:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:00:14.965011 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c428e3-638b-40e2-8774-6c50064b0d6c None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:14.965505 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c428e3-638b-40e2-8774-6c50064b0d6c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:14.965606 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c428e3-638b-40e2-8774-6c50064b0d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:14.983663 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-f5c428e3-638b-40e2-8774-6c50064b0d6c None None] MFA Rules not processed for user `4ad3f89b7037413a83c7905cef263b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:00:14.985795 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f5c428e3-638b-40e2-8774-6c50064b0d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:00:14.994975 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 680/1353] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Apr 30 21:00:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:00:16.733530 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d66d4-f1bc-4905-9ff8-b3cb7221a6c8 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:16.734078 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d66d4-f1bc-4905-9ff8-b3cb7221a6c8 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:16.734162 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d66d4-f1bc-4905-9ff8-b3cb7221a6c8 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:16.736036 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 674/1354] 10.222.0.23 () {54 vars in 921 bytes} [Sat Apr 30 21:00:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:00:16.741149 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6aa3d-5a60-44a4-b170-60a67fc76a0f None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:16.741594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6aa3d-5a60-44a4-b170-60a67fc76a0f None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:16.741711 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6aa3d-5a60-44a4-b170-60a67fc76a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:16.759481 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-ebd6aa3d-5a60-44a4-b170-60a67fc76a0f None None] MFA Rules not processed for user `4ad3f89b7037413a83c7905cef263b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:00:16.760750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ebd6aa3d-5a60-44a4-b170-60a67fc76a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:00:16.769452 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 681/1355] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Apr 30 21:00:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:00:20.646495 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599779d0-7a35-421e-adad-9adb07744489 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:20.647110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599779d0-7a35-421e-adad-9adb07744489 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:20.647110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599779d0-7a35-421e-adad-9adb07744489 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:20.648437 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 675/1356] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 21:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:00:20.653494 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e43759-4e01-49be-99a8-b06f5c460981 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:20.653932 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e43759-4e01-49be-99a8-b06f5c460981 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:20.654091 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e43759-4e01-49be-99a8-b06f5c460981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:20.671573 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-b9e43759-4e01-49be-99a8-b06f5c460981 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:00:20.672784 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b9e43759-4e01-49be-99a8-b06f5c460981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:00:20.680589 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 682/1357] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 21:00:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:00:20.730356 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bd6c5-1807-4e3b-827f-b8c555ca21d6 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:20.730658 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bd6c5-1807-4e3b-827f-b8c555ca21d6 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:20.730925 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bd6c5-1807-4e3b-827f-b8c555ca21d6 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:20.732592 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 676/1358] 10.222.0.23 () {54 vars in 960 bytes} [Sat Apr 30 21:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:00:20.738789 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137e0cb-d4e2-4566-9ff2-0e69dbb6dcdd None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:20.739180 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137e0cb-d4e2-4566-9ff2-0e69dbb6dcdd None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:20.739609 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137e0cb-d4e2-4566-9ff2-0e69dbb6dcdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:20.787936 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-e137e0cb-d4e2-4566-9ff2-0e69dbb6dcdd None None] MFA Rules not processed for user `fca4ee1f64c8489ebe7296f9f8f0ab41`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:00:20.789283 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e137e0cb-d4e2-4566-9ff2-0e69dbb6dcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:00:20.874484 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 683/1359] 10.222.0.23 () {58 vars in 1057 bytes} [Sat Apr 30 21:00:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:00:20.883596 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7bd6c5-1807-4e3b-827f-b8c555ca21d6 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:00:20.898705 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7bd6c5-1807-4e3b-827f-b8c555ca21d6 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:00:20.904632 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0cf69-8eab-4fc5-92ee-0a59a44510d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:00:20.905485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0cf69-8eab-4fc5-92ee-0a59a44510d6 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:20.905973 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0cf69-8eab-4fc5-92ee-0a59a44510d6 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:20.906333 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0cf69-8eab-4fc5-92ee-0a59a44510d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:20.916008 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0cf69-8eab-4fc5-92ee-0a59a44510d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:00:20.917787 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0cf69-8eab-4fc5-92ee-0a59a44510d6 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:00:20.928278 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 677/1360] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:00:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:00:23.546267 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86093636-e577-42f1-be8c-fee0c6ea81f7 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:23.546846 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86093636-e577-42f1-be8c-fee0c6ea81f7 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:23.546846 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86093636-e577-42f1-be8c-fee0c6ea81f7 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:23.548891 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 684/1361] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 21:00:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:00:23.554035 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1bfa59-b2a8-412f-9be8-3910d02d425c None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:23.554462 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1bfa59-b2a8-412f-9be8-3910d02d425c None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:23.554590 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1bfa59-b2a8-412f-9be8-3910d02d425c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:23.572215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-bf1bfa59-b2a8-412f-9be8-3910d02d425c None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:00:23.573409 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-bf1bfa59-b2a8-412f-9be8-3910d02d425c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:00:23.581507 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 678/1362] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 21:00:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:00:23.629482 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86093636-e577-42f1-be8c-fee0c6ea81f7 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:00:23.643900 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86093636-e577-42f1-be8c-fee0c6ea81f7 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:00:23.649166 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bd346-0630-4cc0-82cd-d21d8693d8f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:00:23.649825 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bd346-0630-4cc0-82cd-d21d8693d8f5 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:23.650114 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bd346-0630-4cc0-82cd-d21d8693d8f5 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:23.650383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bd346-0630-4cc0-82cd-d21d8693d8f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:23.659155 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6bd346-0630-4cc0-82cd-d21d8693d8f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:00:23.660753 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6bd346-0630-4cc0-82cd-d21d8693d8f5 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:00:23.670384 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 685/1363] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:00:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:00:26.444998 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086954a5-d61d-44ee-aa7e-05057ec2c08e None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:26.445497 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086954a5-d61d-44ee-aa7e-05057ec2c08e None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:26.445617 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086954a5-d61d-44ee-aa7e-05057ec2c08e None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:26.446959 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 679/1364] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 21:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:00:26.452137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85806fec-3401-4f15-b60d-1b5663fadc9a None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:26.452551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85806fec-3401-4f15-b60d-1b5663fadc9a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:26.452951 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85806fec-3401-4f15-b60d-1b5663fadc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:26.471463 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-85806fec-3401-4f15-b60d-1b5663fadc9a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:00:26.472673 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-85806fec-3401-4f15-b60d-1b5663fadc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:00:26.480550 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 686/1365] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 21:00:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:00:26.527154 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7a5ea-8645-44a4-bb2b-1cba391ad45b None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:26.527478 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7a5ea-8645-44a4-bb2b-1cba391ad45b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:26.527761 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7a5ea-8645-44a4-bb2b-1cba391ad45b None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:26.529186 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 680/1366] 10.222.0.23 () {54 vars in 960 bytes} [Sat Apr 30 21:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:00:26.535094 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4e319-3421-4650-ae26-0b6219d4d0d3 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:26.535388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4e319-3421-4650-ae26-0b6219d4d0d3 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:26.535669 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4e319-3421-4650-ae26-0b6219d4d0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:26.553919 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-55a4e319-3421-4650-ae26-0b6219d4d0d3 None None] MFA Rules not processed for user `fca4ee1f64c8489ebe7296f9f8f0ab41`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:00:26.555110 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-55a4e319-3421-4650-ae26-0b6219d4d0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:00:26.564323 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 687/1367] 10.222.0.23 () {58 vars in 1057 bytes} [Sat Apr 30 21:00:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:00:26.572061 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7a5ea-8645-44a4-bb2b-1cba391ad45b None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:00:26.586296 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7a5ea-8645-44a4-bb2b-1cba391ad45b None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:00:26.591746 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eccf13c-a272-43dd-ab72-18ca085b27cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:00:26.592380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eccf13c-a272-43dd-ab72-18ca085b27cd service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:26.592662 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eccf13c-a272-43dd-ab72-18ca085b27cd service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:26.592941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eccf13c-a272-43dd-ab72-18ca085b27cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:26.601859 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eccf13c-a272-43dd-ab72-18ca085b27cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:00:26.603591 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eccf13c-a272-43dd-ab72-18ca085b27cd service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:00:26.613807 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 681/1368] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:00:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:00:29.257913 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c737bb-8ae9-432e-b648-4943e97db9bb None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:29.257913 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c737bb-8ae9-432e-b648-4943e97db9bb None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:29.257913 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c737bb-8ae9-432e-b648-4943e97db9bb None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:29.259244 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 688/1369] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 21:00:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:00:29.268124 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129540ff-f8a4-4c1d-bbf7-921e4b54e1c1 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:29.269263 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129540ff-f8a4-4c1d-bbf7-921e4b54e1c1 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:29.269721 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129540ff-f8a4-4c1d-bbf7-921e4b54e1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:29.316859 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-129540ff-f8a4-4c1d-bbf7-921e4b54e1c1 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:00:29.318601 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-129540ff-f8a4-4c1d-bbf7-921e4b54e1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:00:29.328894 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 682/1370] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 21:00:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:00:29.380286 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c737bb-8ae9-432e-b648-4943e97db9bb None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:00:29.395683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c737bb-8ae9-432e-b648-4943e97db9bb None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:00:29.401496 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e615f-b428-43e8-ad09-1693afe4a577 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:00:29.402547 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e615f-b428-43e8-ad09-1693afe4a577 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:29.403003 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e615f-b428-43e8-ad09-1693afe4a577 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:29.403434 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e615f-b428-43e8-ad09-1693afe4a577 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:29.413066 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e615f-b428-43e8-ad09-1693afe4a577 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:00:29.415015 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e615f-b428-43e8-ad09-1693afe4a577 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:00:29.436911 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 689/1371] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:00:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:00:32.317020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703be4d-a3f3-43d0-becc-08673b1662db None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:32.325359 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703be4d-a3f3-43d0-becc-08673b1662db None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:32.325359 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703be4d-a3f3-43d0-becc-08673b1662db None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:32.325359 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 683/1372] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 21:00:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:00:32.330615 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77dab4b-1324-401a-aaa3-f5832f5082c0 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:32.331856 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77dab4b-1324-401a-aaa3-f5832f5082c0 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:32.332333 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77dab4b-1324-401a-aaa3-f5832f5082c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:32.357943 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-d77dab4b-1324-401a-aaa3-f5832f5082c0 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:00:32.359811 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d77dab4b-1324-401a-aaa3-f5832f5082c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:00:32.378248 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 690/1373] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 21:00:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:00:32.419022 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703be4d-a3f3-43d0-becc-08673b1662db None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:00:32.439320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703be4d-a3f3-43d0-becc-08673b1662db None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:00:32.447122 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65890bc7-a11e-4169-9377-5b20b0adcde5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:00:32.448092 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65890bc7-a11e-4169-9377-5b20b0adcde5 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:32.448617 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65890bc7-a11e-4169-9377-5b20b0adcde5 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:32.449122 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65890bc7-a11e-4169-9377-5b20b0adcde5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:32.458754 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65890bc7-a11e-4169-9377-5b20b0adcde5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:00:32.460963 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65890bc7-a11e-4169-9377-5b20b0adcde5 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:00:32.484878 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 684/1374] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:00:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:00:32.963773 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cde345-610c-44e5-b85d-33b97a4479a4 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:32.963773 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cde345-610c-44e5-b85d-33b97a4479a4 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:32.963773 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cde345-610c-44e5-b85d-33b97a4479a4 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:32.963773 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 691/1375] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 21:00:32 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:00:32.964383 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9a1e4-7f4b-4935-af2c-cfdaf12fbb44 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:32.964383 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9a1e4-7f4b-4935-af2c-cfdaf12fbb44 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:32.964383 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9a1e4-7f4b-4935-af2c-cfdaf12fbb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:32.964383 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-19d9a1e4-7f4b-4935-af2c-cfdaf12fbb44 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:00:32.964383 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-19d9a1e4-7f4b-4935-af2c-cfdaf12fbb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:00:32.964383 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 685/1376] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 21:00:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:00:33.285808 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a84ff-b181-478d-a52f-0678b44d14ab None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:33.286092 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a84ff-b181-478d-a52f-0678b44d14ab None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:33.286566 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a84ff-b181-478d-a52f-0678b44d14ab None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:33.288003 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 692/1377] 10.222.0.23 () {54 vars in 963 bytes} [Sat Apr 30 21:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:00:33.293778 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8066e-f77f-420d-84d8-76089bcbded4 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:33.294159 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8066e-f77f-420d-84d8-76089bcbded4 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:33.294434 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8066e-f77f-420d-84d8-76089bcbded4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:33.356067 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-6ae8066e-f77f-420d-84d8-76089bcbded4 None None] MFA Rules not processed for user `f3dc7765f32c4b00a7e41f2754b9595b`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:00:33.357464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6ae8066e-f77f-420d-84d8-76089bcbded4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:00:33.419535 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 686/1378] 10.222.0.23 () {58 vars in 1060 bytes} [Sat Apr 30 21:00:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:00:33.427703 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a84ff-b181-478d-a52f-0678b44d14ab None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:00:33.440347 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a84ff-b181-478d-a52f-0678b44d14ab None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:00:33.444005 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a4a50-4707-45ef-aaff-463dbc72026a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:00:33.444652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a4a50-4707-45ef-aaff-463dbc72026a service cinder] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:33.444937 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a4a50-4707-45ef-aaff-463dbc72026a service cinder] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:33.445216 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a4a50-4707-45ef-aaff-463dbc72026a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:33.454598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a4a50-4707-45ef-aaff-463dbc72026a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:00:33.456041 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a4a50-4707-45ef-aaff-463dbc72026a service cinder] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:00:33.465391 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 693/1379] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:00:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:00:35.670988 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910848cb-2e47-4bc4-935d-47f23b617731 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:35.671602 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910848cb-2e47-4bc4-935d-47f23b617731 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:35.671602 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910848cb-2e47-4bc4-935d-47f23b617731 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:35.673563 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 687/1380] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 21:00:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:00:35.678843 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6415c-2daa-44f7-8314-fa7df15006e3 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:35.679312 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6415c-2daa-44f7-8314-fa7df15006e3 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:35.679418 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6415c-2daa-44f7-8314-fa7df15006e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:35.703055 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-61e6415c-2daa-44f7-8314-fa7df15006e3 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:00:35.704242 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-61e6415c-2daa-44f7-8314-fa7df15006e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:00:35.712214 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 694/1381] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 21:00:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:00:35.757572 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910848cb-2e47-4bc4-935d-47f23b617731 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:00:35.772820 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910848cb-2e47-4bc4-935d-47f23b617731 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:00:35.778454 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c84622-04d0-4cf8-8d19-149ff5fc3b32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:00:35.779107 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c84622-04d0-4cf8-8d19-149ff5fc3b32 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:35.779421 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c84622-04d0-4cf8-8d19-149ff5fc3b32 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:35.779702 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c84622-04d0-4cf8-8d19-149ff5fc3b32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:35.788867 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c84622-04d0-4cf8-8d19-149ff5fc3b32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:00:35.790548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c84622-04d0-4cf8-8d19-149ff5fc3b32 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:00:35.800487 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 688/1382] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:00:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:00:38.665897 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507fc98-f729-4d6e-949c-36b097fb14d3 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:38.666771 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507fc98-f729-4d6e-949c-36b097fb14d3 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:38.666771 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a507fc98-f729-4d6e-949c-36b097fb14d3 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:38.668564 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 695/1383] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 21:00:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:00:38.674415 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0d07e-5850-4b02-8eb8-681464a30e31 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:38.674894 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0d07e-5850-4b02-8eb8-681464a30e31 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:38.674982 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0d07e-5850-4b02-8eb8-681464a30e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:38.693234 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-e9e0d07e-5850-4b02-8eb8-681464a30e31 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:00:38.694444 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e9e0d07e-5850-4b02-8eb8-681464a30e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:00:38.702541 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 689/1384] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 21:00:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:00:38.746512 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507fc98-f729-4d6e-949c-36b097fb14d3 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:00:38.760905 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a507fc98-f729-4d6e-949c-36b097fb14d3 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:00:38.766991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d43de-75f6-4a74-b214-8e6f24e198ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:00:38.767626 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d43de-75f6-4a74-b214-8e6f24e198ca service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:38.767904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d43de-75f6-4a74-b214-8e6f24e198ca service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:38.768176 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d43de-75f6-4a74-b214-8e6f24e198ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:38.776726 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d43de-75f6-4a74-b214-8e6f24e198ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:00:38.778482 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d43de-75f6-4a74-b214-8e6f24e198ca service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:00:38.789012 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 696/1385] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:00:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:00:41.196828 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e1799-e715-4162-8ed1-d5169ca91740 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:41.197471 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e1799-e715-4162-8ed1-d5169ca91740 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:41.197471 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e1799-e715-4162-8ed1-d5169ca91740 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:41.200393 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 690/1386] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 21:00:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:00:41.204709 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4a008-66a0-48c7-acd8-dcae65f8e28f None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:41.205173 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4a008-66a0-48c7-acd8-dcae65f8e28f None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:41.205261 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4a008-66a0-48c7-acd8-dcae65f8e28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:41.223137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-1dd4a008-66a0-48c7-acd8-dcae65f8e28f None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:00:41.224336 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1dd4a008-66a0-48c7-acd8-dcae65f8e28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:00:41.234467 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 697/1387] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 21:00:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:00:41.278461 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e1799-e715-4162-8ed1-d5169ca91740 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:00:41.294767 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e1799-e715-4162-8ed1-d5169ca91740 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:00:41.300426 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9dd2a6-8d86-4d07-83e2-d8ff4ea338a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:00:41.301139 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9dd2a6-8d86-4d07-83e2-d8ff4ea338a2 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:41.301436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9dd2a6-8d86-4d07-83e2-d8ff4ea338a2 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:41.301791 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9dd2a6-8d86-4d07-83e2-d8ff4ea338a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:41.310862 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9dd2a6-8d86-4d07-83e2-d8ff4ea338a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:00:41.312466 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9dd2a6-8d86-4d07-83e2-d8ff4ea338a2 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:00:41.322322 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 691/1388] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:00:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:00:44.122612 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343b363-8101-4e29-9b0b-73fc22fe14b0 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:44.123318 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343b363-8101-4e29-9b0b-73fc22fe14b0 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:44.123518 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343b363-8101-4e29-9b0b-73fc22fe14b0 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:44.125267 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 698/1389] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 21:00:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:00:44.130952 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef7529-518e-439e-be2d-af6aee258efb None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:44.131578 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef7529-518e-439e-be2d-af6aee258efb None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:44.131687 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef7529-518e-439e-be2d-af6aee258efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:44.154129 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-deef7529-518e-439e-be2d-af6aee258efb None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:00:44.156304 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-deef7529-518e-439e-be2d-af6aee258efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:00:44.166530 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 692/1390] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 21:00:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:00:44.214535 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343b363-8101-4e29-9b0b-73fc22fe14b0 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:00:44.230371 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343b363-8101-4e29-9b0b-73fc22fe14b0 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:00:44.236054 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6a373-0edc-48d5-8511-29d8cb3613f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:00:44.236699 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6a373-0edc-48d5-8511-29d8cb3613f2 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:44.236979 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6a373-0edc-48d5-8511-29d8cb3613f2 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:44.237253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6a373-0edc-48d5-8511-29d8cb3613f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:44.246187 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f6a373-0edc-48d5-8511-29d8cb3613f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:00:44.247781 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f6a373-0edc-48d5-8511-29d8cb3613f2 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:00:44.257118 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 699/1391] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:00:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:00:47.098054 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f0927-e5bb-484e-8a9c-1eac6d9af96d None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:47.098897 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f0927-e5bb-484e-8a9c-1eac6d9af96d None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:47.098897 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f0927-e5bb-484e-8a9c-1eac6d9af96d None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:47.100065 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 693/1392] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 21:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:00:47.105372 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2790b9-5383-4bfb-9d52-779499a21c2e None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:47.105989 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2790b9-5383-4bfb-9d52-779499a21c2e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:47.105989 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2790b9-5383-4bfb-9d52-779499a21c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:47.128246 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-2a2790b9-5383-4bfb-9d52-779499a21c2e None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:00:47.130337 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2a2790b9-5383-4bfb-9d52-779499a21c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:00:47.140262 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 700/1393] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 21:00:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:00:47.199653 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f0927-e5bb-484e-8a9c-1eac6d9af96d None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:00:47.217305 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f0927-e5bb-484e-8a9c-1eac6d9af96d None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:00:47.224859 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd165c17-2bda-47e1-b06a-dabd1d11bca8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:00:47.225517 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd165c17-2bda-47e1-b06a-dabd1d11bca8 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:47.225842 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd165c17-2bda-47e1-b06a-dabd1d11bca8 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:47.226127 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd165c17-2bda-47e1-b06a-dabd1d11bca8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:47.236193 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd165c17-2bda-47e1-b06a-dabd1d11bca8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:00:47.237837 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd165c17-2bda-47e1-b06a-dabd1d11bca8 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:00:47.252015 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 694/1394] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:00:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:00:50.136213 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86129af9-a84b-44a9-a652-2e8710d2400b None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:50.136814 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86129af9-a84b-44a9-a652-2e8710d2400b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:50.136929 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86129af9-a84b-44a9-a652-2e8710d2400b None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:50.138452 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 701/1395] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 21:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:00:50.144392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54f950-c2b2-4dbc-b61a-c14be426daf0 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:50.144978 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54f950-c2b2-4dbc-b61a-c14be426daf0 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:50.144978 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54f950-c2b2-4dbc-b61a-c14be426daf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:50.163139 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-1c54f950-c2b2-4dbc-b61a-c14be426daf0 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:00:50.166577 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1c54f950-c2b2-4dbc-b61a-c14be426daf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:00:50.172564 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 695/1396] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 21:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:00:50.217799 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86129af9-a84b-44a9-a652-2e8710d2400b None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:00:50.232919 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86129af9-a84b-44a9-a652-2e8710d2400b None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:00:50.238720 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f260f-e5d9-4b91-912c-fa4273f926ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:00:50.239393 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f260f-e5d9-4b91-912c-fa4273f926ab service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:50.239700 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f260f-e5d9-4b91-912c-fa4273f926ab service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:50.239974 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f260f-e5d9-4b91-912c-fa4273f926ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:50.248505 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f260f-e5d9-4b91-912c-fa4273f926ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:00:50.250178 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f260f-e5d9-4b91-912c-fa4273f926ab service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:00:50.260971 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 702/1397] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:00:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:00:50.454422 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cb91e-331f-434d-be23-d7d73c1c63d2 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:50.454710 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cb91e-331f-434d-be23-d7d73c1c63d2 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:50.454991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cb91e-331f-434d-be23-d7d73c1c63d2 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:50.457035 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 696/1398] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 21:00:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:00:50.462288 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b2380-86ac-4e09-88b3-fe825ad674f6 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:50.462584 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b2380-86ac-4e09-88b3-fe825ad674f6 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:50.462864 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b2380-86ac-4e09-88b3-fe825ad674f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:50.480327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-160b2380-86ac-4e09-88b3-fe825ad674f6 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:00:50.481593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-160b2380-86ac-4e09-88b3-fe825ad674f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:00:50.489971 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 703/1399] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 21:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:00:50.553222 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12800842-5c9a-43bf-be48-143ba3ae8642 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:50.553833 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12800842-5c9a-43bf-be48-143ba3ae8642 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:50.554193 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12800842-5c9a-43bf-be48-143ba3ae8642 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:50.556102 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 697/1400] 10.222.0.23 () {54 vars in 962 bytes} [Sat Apr 30 21:00:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:00:50.562247 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdecc60-7844-4fdd-87f3-1be8e2520058 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:50.563229 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdecc60-7844-4fdd-87f3-1be8e2520058 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:50.563522 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdecc60-7844-4fdd-87f3-1be8e2520058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:50.619885 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-dbdecc60-7844-4fdd-87f3-1be8e2520058 None None] MFA Rules not processed for user `e302b1298dd04d6590e3d079f7b13b29`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:00:50.621124 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-dbdecc60-7844-4fdd-87f3-1be8e2520058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:00:50.685214 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 704/1401] 10.222.0.23 () {58 vars in 1059 bytes} [Sat Apr 30 21:00:50 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:00:50.693827 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12800842-5c9a-43bf-be48-143ba3ae8642 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:00:50.705040 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12800842-5c9a-43bf-be48-143ba3ae8642 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:00:50.708536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1bb0f-19ca-4605-a875-84a2f0e4108c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e302b1298dd04d6590e3d079f7b13b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:00:50.709175 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1bb0f-19ca-4605-a875-84a2f0e4108c service glance] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:50.709453 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1bb0f-19ca-4605-a875-84a2f0e4108c service glance] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:50.709728 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1bb0f-19ca-4605-a875-84a2f0e4108c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:50.718755 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a1bb0f-19ca-4605-a875-84a2f0e4108c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:00:50.720813 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a1bb0f-19ca-4605-a875-84a2f0e4108c service glance] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:00:50.730173 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 698/1402] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:00:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:00:51.324842 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87372e56-d175-41b5-963b-b0634943d569 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:51.325380 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87372e56-d175-41b5-963b-b0634943d569 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:51.325380 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87372e56-d175-41b5-963b-b0634943d569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:51.374372 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-87372e56-d175-41b5-963b-b0634943d569 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:00:51.376111 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-87372e56-d175-41b5-963b-b0634943d569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:00:51.445319 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 705/1403] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:00:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:00:51.491197 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9df69-a817-4491-97b9-130b01710053 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:51.491693 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9df69-a817-4491-97b9-130b01710053 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:51.491905 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9df69-a817-4491-97b9-130b01710053 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:51.493514 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 699/1404] 10.222.0.23 () {54 vars in 942 bytes} [Sat Apr 30 21:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:00:51.500654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753d2a4-77e8-4095-ba98-ce07454b8869 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:51.501020 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753d2a4-77e8-4095-ba98-ce07454b8869 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:51.501332 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753d2a4-77e8-4095-ba98-ce07454b8869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:51.548709 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-c753d2a4-77e8-4095-ba98-ce07454b8869 None None] MFA Rules not processed for user `27edf527e36c4ee7a9065688f4bed942`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:00:51.549861 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c753d2a4-77e8-4095-ba98-ce07454b8869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:00:51.620289 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 706/1405] 10.222.0.23 () {58 vars in 1039 bytes} [Sat Apr 30 21:00:51 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:00:51.630555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9df69-a817-4491-97b9-130b01710053 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:00:51.643719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9df69-a817-4491-97b9-130b01710053 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:00:51.648679 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49735d19-2faa-4b4c-ae2f-984d64a7e7d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:00:51.653334 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49735d19-2faa-4b4c-ae2f-984d64a7e7d8 service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:51.653334 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49735d19-2faa-4b4c-ae2f-984d64a7e7d8 service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:51.653334 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49735d19-2faa-4b4c-ae2f-984d64a7e7d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:51.658127 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49735d19-2faa-4b4c-ae2f-984d64a7e7d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:00:51.659709 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49735d19-2faa-4b4c-ae2f-984d64a7e7d8 service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:00:51.667831 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 700/1406] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:00:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:00:52.843672 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973823e8-b1c9-4e4c-b3bc-c7aad0f11c03 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:52.844284 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973823e8-b1c9-4e4c-b3bc-c7aad0f11c03 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:52.844284 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973823e8-b1c9-4e4c-b3bc-c7aad0f11c03 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:52.849665 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 707/1407] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 21:00:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:00:52.851115 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edacb6d-f057-4f2c-a1dc-59de930a28b3 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:52.851956 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edacb6d-f057-4f2c-a1dc-59de930a28b3 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:52.851956 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edacb6d-f057-4f2c-a1dc-59de930a28b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:52.872191 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-8edacb6d-f057-4f2c-a1dc-59de930a28b3 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:00:52.880894 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8edacb6d-f057-4f2c-a1dc-59de930a28b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:00:52.886114 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 701/1408] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 21:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:00:52.929965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973823e8-b1c9-4e4c-b3bc-c7aad0f11c03 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:00:52.945745 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973823e8-b1c9-4e4c-b3bc-c7aad0f11c03 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:00:52.954426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae23ba-9f56-4969-ad7c-526157177336 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:00:52.955859 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae23ba-9f56-4969-ad7c-526157177336 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:00:52.956250 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae23ba-9f56-4969-ad7c-526157177336 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:00:52.956586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae23ba-9f56-4969-ad7c-526157177336 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:00:52.965592 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae23ba-9f56-4969-ad7c-526157177336 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:00:52.967221 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae23ba-9f56-4969-ad7c-526157177336 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:00:52.977108 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 708/1409] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:00:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:01:16.069814 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca461d-cf2a-46f6-995f-58f207d2c4b7 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:16.070459 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca461d-cf2a-46f6-995f-58f207d2c4b7 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:16.070459 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca461d-cf2a-46f6-995f-58f207d2c4b7 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:16.071763 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 702/1410] 10.222.0.23 () {54 vars in 918 bytes} [Sat Apr 30 21:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:01:16.077268 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eeb3ea-d053-4711-a8a5-ee9a0fb3b324 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:16.077835 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eeb3ea-d053-4711-a8a5-ee9a0fb3b324 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:16.077835 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eeb3ea-d053-4711-a8a5-ee9a0fb3b324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:16.095735 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-a7eeb3ea-d053-4711-a8a5-ee9a0fb3b324 None None] MFA Rules not processed for user `4ad3f89b7037413a83c7905cef263b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:01:16.096957 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a7eeb3ea-d053-4711-a8a5-ee9a0fb3b324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:01:16.105245 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 709/1411] 10.222.0.23 () {58 vars in 1015 bytes} [Sat Apr 30 21:01:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:01:16.122107 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30488a03-7cfc-4d24-a1d2-934e1a0eaa6f None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:16.122390 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30488a03-7cfc-4d24-a1d2-934e1a0eaa6f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:16.122663 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30488a03-7cfc-4d24-a1d2-934e1a0eaa6f None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:16.124027 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 703/1412] 10.222.0.23 () {54 vars in 918 bytes} [Sat Apr 30 21:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:01:16.128791 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bea06-3487-45a4-8a21-4611445a10c6 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:16.129088 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bea06-3487-45a4-8a21-4611445a10c6 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:16.129377 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881bea06-3487-45a4-8a21-4611445a10c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:16.146948 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-881bea06-3487-45a4-8a21-4611445a10c6 None None] MFA Rules not processed for user `fca4ee1f64c8489ebe7296f9f8f0ab41`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:01:16.148169 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-881bea06-3487-45a4-8a21-4611445a10c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:01:16.157701 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 710/1413] 10.222.0.23 () {58 vars in 1015 bytes} [Sat Apr 30 21:01:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:01:18.950753 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d7e43-1ebf-4734-8bc5-3c2b5b0efdbf None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:18.951590 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d7e43-1ebf-4734-8bc5-3c2b5b0efdbf None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:18.951590 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d7e43-1ebf-4734-8bc5-3c2b5b0efdbf None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:18.952919 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 30 21:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:01:18.958048 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8681bb-441e-436e-88cf-c7acf1e32950 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:18.958479 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8681bb-441e-436e-88cf-c7acf1e32950 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:18.958598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8681bb-441e-436e-88cf-c7acf1e32950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:18.976039 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-8c8681bb-441e-436e-88cf-c7acf1e32950 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:01:18.977221 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8c8681bb-441e-436e-88cf-c7acf1e32950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:01:18.985453 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 30 21:01:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:01:19.028430 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d7e43-1ebf-4734-8bc5-3c2b5b0efdbf None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:01:19.042275 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d7e43-1ebf-4734-8bc5-3c2b5b0efdbf None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:01:19.047549 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d9dae-05f3-4ef6-847d-622e56508b87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:01:19.048169 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d9dae-05f3-4ef6-847d-622e56508b87 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:19.048449 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d9dae-05f3-4ef6-847d-622e56508b87 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:19.048722 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d9dae-05f3-4ef6-847d-622e56508b87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:19.056546 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226d9dae-05f3-4ef6-847d-622e56508b87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:01:19.058160 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226d9dae-05f3-4ef6-847d-622e56508b87 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:01:19.067866 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 705/1416] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:01:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:01:20.461861 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15681054-000d-4c9c-8fb4-5af7a437ded2 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:20.462440 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15681054-000d-4c9c-8fb4-5af7a437ded2 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:20.462440 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15681054-000d-4c9c-8fb4-5af7a437ded2 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:20.463784 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sat Apr 30 21:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:01:20.468652 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052eea8c-2526-4d9f-9384-4fd3d7087e45 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:20.469575 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052eea8c-2526-4d9f-9384-4fd3d7087e45 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:20.469723 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052eea8c-2526-4d9f-9384-4fd3d7087e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:20.487710 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-052eea8c-2526-4d9f-9384-4fd3d7087e45 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:01:20.488982 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-052eea8c-2526-4d9f-9384-4fd3d7087e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:01:20.496925 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sat Apr 30 21:01:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:01:20.710252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15681054-000d-4c9c-8fb4-5af7a437ded2 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:01:20.724928 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15681054-000d-4c9c-8fb4-5af7a437ded2 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:01:20.730210 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd017818-5544-466b-bab3-e9ca57cf7e52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:01:20.730839 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd017818-5544-466b-bab3-e9ca57cf7e52 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:20.731121 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd017818-5544-466b-bab3-e9ca57cf7e52 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:20.731396 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd017818-5544-466b-bab3-e9ca57cf7e52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:20.739346 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd017818-5544-466b-bab3-e9ca57cf7e52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:01:20.740935 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd017818-5544-466b-bab3-e9ca57cf7e52 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:01:20.750163 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 713/1419] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:01:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:01:22.088628 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78608364-472a-42aa-935b-bf4e824ecb76 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:22.089232 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78608364-472a-42aa-935b-bf4e824ecb76 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:22.089232 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78608364-472a-42aa-935b-bf4e824ecb76 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:22.090625 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sat Apr 30 21:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:01:22.096200 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0797b-2520-4955-9fdd-6387948c55ad None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:22.096610 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0797b-2520-4955-9fdd-6387948c55ad None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:22.096760 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0797b-2520-4955-9fdd-6387948c55ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:22.115045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-5ef0797b-2520-4955-9fdd-6387948c55ad None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:01:22.116245 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5ef0797b-2520-4955-9fdd-6387948c55ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:01:22.124249 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sat Apr 30 21:01:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:01:22.281112 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78608364-472a-42aa-935b-bf4e824ecb76 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:01:22.295707 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78608364-472a-42aa-935b-bf4e824ecb76 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:01:22.301071 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b766f2-20ff-429b-ab4a-46fb10067226 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:01:22.301733 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b766f2-20ff-429b-ab4a-46fb10067226 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:22.302047 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b766f2-20ff-429b-ab4a-46fb10067226 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:22.302325 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b766f2-20ff-429b-ab4a-46fb10067226 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:22.310324 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b766f2-20ff-429b-ab4a-46fb10067226 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:01:22.311915 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b766f2-20ff-429b-ab4a-46fb10067226 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:01:22.321077 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 708/1422] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:01:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:01:23.650334 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bfe38d-955c-463d-9398-12e57414643f None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:23.650914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bfe38d-955c-463d-9398-12e57414643f None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:23.650914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bfe38d-955c-463d-9398-12e57414643f None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:23.652248 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sat Apr 30 21:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:01:23.657531 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c92489-2257-4386-93e0-6510377c90bd None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:23.658031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c92489-2257-4386-93e0-6510377c90bd None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:23.658128 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c92489-2257-4386-93e0-6510377c90bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:23.676119 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-c1c92489-2257-4386-93e0-6510377c90bd None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:01:23.677311 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c1c92489-2257-4386-93e0-6510377c90bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:01:23.685068 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sat Apr 30 21:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:01:23.839786 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bfe38d-955c-463d-9398-12e57414643f None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:01:23.854223 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bfe38d-955c-463d-9398-12e57414643f None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:01:23.860061 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ed871-9a2d-40ca-8da4-0325edcbb948 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:01:23.860688 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ed871-9a2d-40ca-8da4-0325edcbb948 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:23.860968 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ed871-9a2d-40ca-8da4-0325edcbb948 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:23.861238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ed871-9a2d-40ca-8da4-0325edcbb948 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:23.869153 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ed871-9a2d-40ca-8da4-0325edcbb948 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:01:23.870763 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ed871-9a2d-40ca-8da4-0325edcbb948 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:01:23.880605 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 716/1425] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:01:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:01:25.201339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d1448-2bc0-43a3-bb37-83cd492cc27e None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:25.201930 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d1448-2bc0-43a3-bb37-83cd492cc27e None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:25.201930 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d1448-2bc0-43a3-bb37-83cd492cc27e None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:25.203776 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sat Apr 30 21:01:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:01:25.208907 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef1507-3662-4c54-89e4-223c08021904 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:25.209323 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef1507-3662-4c54-89e4-223c08021904 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:25.209444 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef1507-3662-4c54-89e4-223c08021904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:25.227407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-9cef1507-3662-4c54-89e4-223c08021904 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:01:25.228628 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9cef1507-3662-4c54-89e4-223c08021904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:01:25.236317 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sat Apr 30 21:01:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:01:25.392215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d1448-2bc0-43a3-bb37-83cd492cc27e None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:01:25.406866 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d1448-2bc0-43a3-bb37-83cd492cc27e None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:01:25.412243 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd5c08-c247-474e-899f-33dbedcdfbe7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:01:25.412871 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd5c08-c247-474e-899f-33dbedcdfbe7 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:25.413149 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd5c08-c247-474e-899f-33dbedcdfbe7 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:25.413427 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd5c08-c247-474e-899f-33dbedcdfbe7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:25.421413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd5c08-c247-474e-899f-33dbedcdfbe7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:01:25.423066 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd5c08-c247-474e-899f-33dbedcdfbe7 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:01:25.432147 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 711/1428] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:01:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:01:26.783257 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d30a2-1b55-427c-8811-d2ce9014cd2c None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:26.783801 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d30a2-1b55-427c-8811-d2ce9014cd2c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:26.783801 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d30a2-1b55-427c-8811-d2ce9014cd2c None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:26.785177 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sat Apr 30 21:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:01:26.790331 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfdf68-dec9-4625-bc50-8597087a6d13 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:26.790741 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfdf68-dec9-4625-bc50-8597087a6d13 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:26.790889 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfdf68-dec9-4625-bc50-8597087a6d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:26.808993 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-57bfdf68-dec9-4625-bc50-8597087a6d13 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:01:26.810325 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-57bfdf68-dec9-4625-bc50-8597087a6d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:01:26.818552 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sat Apr 30 21:01:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:01:26.975626 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d30a2-1b55-427c-8811-d2ce9014cd2c None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:01:26.990498 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d30a2-1b55-427c-8811-d2ce9014cd2c None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:01:26.995908 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5570001-8eeb-4d06-ac41-ec1b4bd5fa5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:01:26.996553 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5570001-8eeb-4d06-ac41-ec1b4bd5fa5a service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:26.996833 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5570001-8eeb-4d06-ac41-ec1b4bd5fa5a service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:26.997107 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5570001-8eeb-4d06-ac41-ec1b4bd5fa5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:27.005693 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5570001-8eeb-4d06-ac41-ec1b4bd5fa5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:01:27.007351 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5570001-8eeb-4d06-ac41-ec1b4bd5fa5a service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:01:27.016660 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 719/1431] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:01:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:01:28.345562 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1e6f7-3fe9-4479-af3f-e7bc1c3c18e2 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:28.346151 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1e6f7-3fe9-4479-af3f-e7bc1c3c18e2 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:28.346263 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1e6f7-3fe9-4479-af3f-e7bc1c3c18e2 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:28.347656 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sat Apr 30 21:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:01:28.352601 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b3e3d-80f2-4c22-b21a-0f0b69d002ba None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:28.352989 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b3e3d-80f2-4c22-b21a-0f0b69d002ba None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:28.353156 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b3e3d-80f2-4c22-b21a-0f0b69d002ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:28.371429 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-f29b3e3d-80f2-4c22-b21a-0f0b69d002ba None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:01:28.372624 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f29b3e3d-80f2-4c22-b21a-0f0b69d002ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:01:28.381049 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sat Apr 30 21:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:01:28.536831 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1e6f7-3fe9-4479-af3f-e7bc1c3c18e2 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:01:28.551113 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1e6f7-3fe9-4479-af3f-e7bc1c3c18e2 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:01:28.556439 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e814e6-e40e-4e80-a315-79d38033a5c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:01:28.557066 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e814e6-e40e-4e80-a315-79d38033a5c8 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:28.557348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e814e6-e40e-4e80-a315-79d38033a5c8 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:28.557623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e814e6-e40e-4e80-a315-79d38033a5c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:28.566034 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e814e6-e40e-4e80-a315-79d38033a5c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:01:28.567622 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e814e6-e40e-4e80-a315-79d38033a5c8 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:01:28.576973 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 714/1434] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:01:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:01:29.926233 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f6365-03ba-438c-8f60-237c16badd10 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:29.926804 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f6365-03ba-438c-8f60-237c16badd10 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:29.926804 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f6365-03ba-438c-8f60-237c16badd10 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:29.928156 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sat Apr 30 21:01:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:01:29.933021 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52c225-6638-46aa-a3ff-025830a267c2 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:29.933437 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52c225-6638-46aa-a3ff-025830a267c2 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:29.933590 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52c225-6638-46aa-a3ff-025830a267c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:29.952435 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-1b52c225-6638-46aa-a3ff-025830a267c2 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:01:29.954187 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1b52c225-6638-46aa-a3ff-025830a267c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:01:29.961982 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sat Apr 30 21:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:01:30.116716 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f6365-03ba-438c-8f60-237c16badd10 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:01:30.131224 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f6365-03ba-438c-8f60-237c16badd10 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:01:30.136442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647896d-7136-42b1-826d-aa310c2df75b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:01:30.137072 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647896d-7136-42b1-826d-aa310c2df75b service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:30.137349 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647896d-7136-42b1-826d-aa310c2df75b service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:30.137631 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647896d-7136-42b1-826d-aa310c2df75b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:30.146145 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b647896d-7136-42b1-826d-aa310c2df75b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:01:30.147719 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b647896d-7136-42b1-826d-aa310c2df75b service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:01:30.157279 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 722/1437] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:01:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:01:31.467125 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8739c-1c4d-45ac-9b10-fc875f734b55 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:31.467688 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8739c-1c4d-45ac-9b10-fc875f734b55 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:31.467688 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8739c-1c4d-45ac-9b10-fc875f734b55 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:31.469663 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sat Apr 30 21:01:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:01:31.474962 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edbaf6-94b8-441a-9996-b99004a5a974 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:31.475392 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edbaf6-94b8-441a-9996-b99004a5a974 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:31.475506 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edbaf6-94b8-441a-9996-b99004a5a974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:31.492988 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-62edbaf6-94b8-441a-9996-b99004a5a974 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:01:31.494219 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-62edbaf6-94b8-441a-9996-b99004a5a974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:01:31.501985 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sat Apr 30 21:01:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:01:31.662279 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8739c-1c4d-45ac-9b10-fc875f734b55 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:01:31.676430 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8739c-1c4d-45ac-9b10-fc875f734b55 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:01:31.681840 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee8eef-b6b6-4877-9e4e-a8d415a8a6df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:01:31.682472 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee8eef-b6b6-4877-9e4e-a8d415a8a6df service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:31.682753 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee8eef-b6b6-4877-9e4e-a8d415a8a6df service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:31.683026 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee8eef-b6b6-4877-9e4e-a8d415a8a6df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:31.693398 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee8eef-b6b6-4877-9e4e-a8d415a8a6df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:01:31.695812 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee8eef-b6b6-4877-9e4e-a8d415a8a6df service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:01:31.710060 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 717/1440] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:01:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:01:33.924376 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffbf01-6e69-4401-a0ad-3671704e2754 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:33.924923 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffbf01-6e69-4401-a0ad-3671704e2754 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:33.925341 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffbf01-6e69-4401-a0ad-3671704e2754 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:33.927473 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 30 21:01:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:01:33.933461 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc54ac4-b971-440c-9d27-22bf55ac0443 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:33.933977 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc54ac4-b971-440c-9d27-22bf55ac0443 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:33.934076 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc54ac4-b971-440c-9d27-22bf55ac0443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:33.960134 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-7dc54ac4-b971-440c-9d27-22bf55ac0443 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:01:33.961342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7dc54ac4-b971-440c-9d27-22bf55ac0443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:01:33.969118 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 30 21:01:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:01:34.008498 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ffbf01-6e69-4401-a0ad-3671704e2754 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:01:34.019526 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ffbf01-6e69-4401-a0ad-3671704e2754 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:01:34.022984 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1c3c2-5a8a-439f-995d-86d5bcf73cbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:01:34.023610 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1c3c2-5a8a-439f-995d-86d5bcf73cbb service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:34.023891 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1c3c2-5a8a-439f-995d-86d5bcf73cbb service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:34.024161 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1c3c2-5a8a-439f-995d-86d5bcf73cbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:34.032746 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d1c3c2-5a8a-439f-995d-86d5bcf73cbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:01:34.034208 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d1c3c2-5a8a-439f-995d-86d5bcf73cbb service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:01:34.043244 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 725/1443] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:01:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:01:36.472221 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b11239-d829-488d-8baf-baf88863ec85 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:36.472685 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b11239-d829-488d-8baf-baf88863ec85 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:36.472803 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b11239-d829-488d-8baf-baf88863ec85 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:36.474207 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 30 21:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:01:36.479410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e7d89-f3a4-49dd-8b61-8e14f0db8a24 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:36.479856 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e7d89-f3a4-49dd-8b61-8e14f0db8a24 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:36.479963 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e7d89-f3a4-49dd-8b61-8e14f0db8a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:36.497809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-3b2e7d89-f3a4-49dd-8b61-8e14f0db8a24 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:01:36.498995 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3b2e7d89-f3a4-49dd-8b61-8e14f0db8a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:01:36.506681 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 30 21:01:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:01:36.545198 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b11239-d829-488d-8baf-baf88863ec85 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:01:36.555811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b11239-d829-488d-8baf-baf88863ec85 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:01:36.559369 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7291c3-8a2f-40e1-b858-d954be2b4c6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:01:36.560003 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7291c3-8a2f-40e1-b858-d954be2b4c6a service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:36.560281 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7291c3-8a2f-40e1-b858-d954be2b4c6a service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:36.560553 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7291c3-8a2f-40e1-b858-d954be2b4c6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:36.569223 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7291c3-8a2f-40e1-b858-d954be2b4c6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:01:36.570680 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7291c3-8a2f-40e1-b858-d954be2b4c6a service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:01:36.580559 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 720/1446] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:01:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:01:39.288187 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc120ee-274c-40d1-baf1-db19cfa1425b None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:39.288639 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc120ee-274c-40d1-baf1-db19cfa1425b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:39.288737 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc120ee-274c-40d1-baf1-db19cfa1425b None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:39.290171 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 30 21:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:01:39.295602 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310739c0-6d2c-4374-a572-90a410bb4a33 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:39.296046 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310739c0-6d2c-4374-a572-90a410bb4a33 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:39.296197 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310739c0-6d2c-4374-a572-90a410bb4a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:39.313986 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-310739c0-6d2c-4374-a572-90a410bb4a33 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:01:39.315175 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-310739c0-6d2c-4374-a572-90a410bb4a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:01:39.323100 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 30 21:01:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:01:39.363927 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc120ee-274c-40d1-baf1-db19cfa1425b None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:01:39.374650 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc120ee-274c-40d1-baf1-db19cfa1425b None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:01:39.378269 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f74ad-6ac8-4b38-be66-70e41ebaa022 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:01:39.378918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f74ad-6ac8-4b38-be66-70e41ebaa022 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:39.379203 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f74ad-6ac8-4b38-be66-70e41ebaa022 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:39.379481 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f74ad-6ac8-4b38-be66-70e41ebaa022 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:39.388387 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918f74ad-6ac8-4b38-be66-70e41ebaa022 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:01:39.389839 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918f74ad-6ac8-4b38-be66-70e41ebaa022 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:01:39.399049 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 728/1449] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:01:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:01:41.860980 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94df23b-0bef-4dea-a8f7-42180b4608a0 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:41.861573 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94df23b-0bef-4dea-a8f7-42180b4608a0 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:41.861573 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94df23b-0bef-4dea-a8f7-42180b4608a0 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:41.862973 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 30 21:01:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:01:41.868228 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07f943-2f70-4534-80c5-c840941defbb None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:41.868618 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07f943-2f70-4534-80c5-c840941defbb None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:41.868791 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07f943-2f70-4534-80c5-c840941defbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:41.886434 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-dc07f943-2f70-4534-80c5-c840941defbb None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:01:41.887619 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-dc07f943-2f70-4534-80c5-c840941defbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:01:41.895333 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 30 21:01:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:01:41.934607 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94df23b-0bef-4dea-a8f7-42180b4608a0 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:01:41.946055 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94df23b-0bef-4dea-a8f7-42180b4608a0 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:01:41.949460 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d47577-3456-4ba5-bfcc-80eb91f42c40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:01:41.950390 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d47577-3456-4ba5-bfcc-80eb91f42c40 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:41.950671 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d47577-3456-4ba5-bfcc-80eb91f42c40 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:41.950943 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d47577-3456-4ba5-bfcc-80eb91f42c40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:41.969583 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d47577-3456-4ba5-bfcc-80eb91f42c40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:01:41.971162 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d47577-3456-4ba5-bfcc-80eb91f42c40 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:01:41.982658 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 723/1452] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:01:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:01:44.369449 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67a7ee-6892-4077-9801-eebbe31ef46e None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:44.370031 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67a7ee-6892-4077-9801-eebbe31ef46e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:44.370031 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67a7ee-6892-4077-9801-eebbe31ef46e None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:44.371417 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 30 21:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:01:44.377161 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a678b9d-dc6f-4d37-83b4-f36191efcf5a None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:44.377610 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a678b9d-dc6f-4d37-83b4-f36191efcf5a None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:44.377718 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a678b9d-dc6f-4d37-83b4-f36191efcf5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:44.395713 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-0a678b9d-dc6f-4d37-83b4-f36191efcf5a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:01:44.396898 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0a678b9d-dc6f-4d37-83b4-f36191efcf5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:01:44.404619 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 30 21:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:01:44.443116 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d67a7ee-6892-4077-9801-eebbe31ef46e None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:01:44.454627 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d67a7ee-6892-4077-9801-eebbe31ef46e None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:01:44.458122 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7e77c-c852-439d-ab7a-6f4057c5174c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:01:44.458747 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7e77c-c852-439d-ab7a-6f4057c5174c service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:44.459057 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7e77c-c852-439d-ab7a-6f4057c5174c service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:44.459335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7e77c-c852-439d-ab7a-6f4057c5174c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:44.468081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7e77c-c852-439d-ab7a-6f4057c5174c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:01:44.469518 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7e77c-c852-439d-ab7a-6f4057c5174c service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:01:44.478773 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 731/1455] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:01:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:01:46.847992 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e7db8-dc94-4e93-b178-7c41903e28fb None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:46.848573 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e7db8-dc94-4e93-b178-7c41903e28fb None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:46.848573 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e7db8-dc94-4e93-b178-7c41903e28fb None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:46.849967 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 30 21:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:01:46.855065 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d80567-284d-49c0-835e-2793e3b0b56b None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:46.855502 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d80567-284d-49c0-835e-2793e3b0b56b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:46.855614 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d80567-284d-49c0-835e-2793e3b0b56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:46.873921 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-41d80567-284d-49c0-835e-2793e3b0b56b None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:01:46.875126 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-41d80567-284d-49c0-835e-2793e3b0b56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:01:46.883013 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 30 21:01:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:01:46.923173 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e7db8-dc94-4e93-b178-7c41903e28fb None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:01:46.933933 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e7db8-dc94-4e93-b178-7c41903e28fb None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:01:46.937402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2752d6-50dc-42b1-b678-56ada7efd17e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:01:46.938057 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2752d6-50dc-42b1-b678-56ada7efd17e service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:46.938342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2752d6-50dc-42b1-b678-56ada7efd17e service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:46.938614 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2752d6-50dc-42b1-b678-56ada7efd17e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:46.947350 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2752d6-50dc-42b1-b678-56ada7efd17e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:01:46.948788 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2752d6-50dc-42b1-b678-56ada7efd17e service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:01:46.958949 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 726/1458] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:01:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:01:49.346381 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65364ce9-839a-4d24-abf2-dcf8f38a1ddc None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:49.346947 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65364ce9-839a-4d24-abf2-dcf8f38a1ddc None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:49.346947 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65364ce9-839a-4d24-abf2-dcf8f38a1ddc None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:49.348284 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 30 21:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:01:49.353478 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d629d4-0eea-458b-8dc5-04c7c29cb2f6 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:49.354004 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d629d4-0eea-458b-8dc5-04c7c29cb2f6 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:49.354115 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d629d4-0eea-458b-8dc5-04c7c29cb2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:49.371872 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-a1d629d4-0eea-458b-8dc5-04c7c29cb2f6 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:01:49.373059 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a1d629d4-0eea-458b-8dc5-04c7c29cb2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:01:49.381328 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 30 21:01:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:01:49.419807 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65364ce9-839a-4d24-abf2-dcf8f38a1ddc None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:01:49.421987 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-65364ce9-839a-4d24-abf2-dcf8f38a1ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:01:49.434600 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65364ce9-839a-4d24-abf2-dcf8f38a1ddc None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:01:49.438749 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf307a9-16df-4b7b-b0ad-a4c638ac106c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:01:49.439379 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf307a9-16df-4b7b-b0ad-a4c638ac106c service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:49.439660 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf307a9-16df-4b7b-b0ad-a4c638ac106c service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:49.439934 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf307a9-16df-4b7b-b0ad-a4c638ac106c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:49.448567 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf307a9-16df-4b7b-b0ad-a4c638ac106c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:01:49.450284 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf307a9-16df-4b7b-b0ad-a4c638ac106c service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:01:49.459428 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 734/1461] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:01:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:01:51.795385 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1677b0-79ac-41ce-ba68-d4fd66b0d135 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:51.795932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1677b0-79ac-41ce-ba68-d4fd66b0d135 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:51.795932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1677b0-79ac-41ce-ba68-d4fd66b0d135 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:51.797346 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 30 21:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:01:51.802471 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a03bb-4a2a-48c8-ba36-997d48532c5e None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:51.802864 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a03bb-4a2a-48c8-ba36-997d48532c5e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:51.803028 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a03bb-4a2a-48c8-ba36-997d48532c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:51.823252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-e17a03bb-4a2a-48c8-ba36-997d48532c5e None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:01:51.825622 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e17a03bb-4a2a-48c8-ba36-997d48532c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:01:51.835006 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 30 21:01:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:01:51.872624 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1677b0-79ac-41ce-ba68-d4fd66b0d135 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:01:51.883956 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1677b0-79ac-41ce-ba68-d4fd66b0d135 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:01:51.887775 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e68ba-60ec-4cdc-badc-6c565692e31b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:01:51.888127 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e68ba-60ec-4cdc-badc-6c565692e31b service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:51.888406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e68ba-60ec-4cdc-badc-6c565692e31b service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:51.888678 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e68ba-60ec-4cdc-badc-6c565692e31b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:51.898075 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e68ba-60ec-4cdc-badc-6c565692e31b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:01:51.899480 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e68ba-60ec-4cdc-badc-6c565692e31b service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:01:51.908712 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 729/1464] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:01:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:01:54.238989 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5c8e2-29f4-41bb-bd10-4626cd78a063 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:54.239564 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5c8e2-29f4-41bb-bd10-4626cd78a063 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:54.239564 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d5c8e2-29f4-41bb-bd10-4626cd78a063 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:54.240911 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 30 21:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:01:54.246344 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0749f-ccab-4a53-824d-1ec27451a34e None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:54.246758 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0749f-ccab-4a53-824d-1ec27451a34e None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:54.246876 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0749f-ccab-4a53-824d-1ec27451a34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:54.264087 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-0af0749f-ccab-4a53-824d-1ec27451a34e None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:01:54.265304 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0af0749f-ccab-4a53-824d-1ec27451a34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:01:54.273293 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 30 21:01:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:01:54.311763 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5c8e2-29f4-41bb-bd10-4626cd78a063 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:01:54.322263 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d5c8e2-29f4-41bb-bd10-4626cd78a063 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:01:54.326044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd751ca-ef7d-43eb-98e7-a0f39c3c31fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:01:54.326698 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd751ca-ef7d-43eb-98e7-a0f39c3c31fc service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:54.326980 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd751ca-ef7d-43eb-98e7-a0f39c3c31fc service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:54.327254 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd751ca-ef7d-43eb-98e7-a0f39c3c31fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:54.336018 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd751ca-ef7d-43eb-98e7-a0f39c3c31fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:01:54.337456 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd751ca-ef7d-43eb-98e7-a0f39c3c31fc service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:01:54.347314 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 737/1467] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:01:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:01:56.696794 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad530aea-a183-4339-8ab0-a59cac1bca41 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:56.697316 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad530aea-a183-4339-8ab0-a59cac1bca41 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:56.697449 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad530aea-a183-4339-8ab0-a59cac1bca41 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:56.698745 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 30 21:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:01:56.704826 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e47ea-b578-4342-9c28-548443e52729 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:56.705272 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e47ea-b578-4342-9c28-548443e52729 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:56.705406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e47ea-b578-4342-9c28-548443e52729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:56.723406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-0b2e47ea-b578-4342-9c28-548443e52729 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:01:56.724603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0b2e47ea-b578-4342-9c28-548443e52729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:01:56.732357 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 30 21:01:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:01:56.769851 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad530aea-a183-4339-8ab0-a59cac1bca41 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:01:56.780858 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad530aea-a183-4339-8ab0-a59cac1bca41 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:01:56.784365 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c742cdc-17fd-470b-ab0a-ebcd6c744656 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:01:56.784995 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c742cdc-17fd-470b-ab0a-ebcd6c744656 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:01:56.785272 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c742cdc-17fd-470b-ab0a-ebcd6c744656 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:01:56.785545 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c742cdc-17fd-470b-ab0a-ebcd6c744656 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:01:56.794145 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c742cdc-17fd-470b-ab0a-ebcd6c744656 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:01:56.795594 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c742cdc-17fd-470b-ab0a-ebcd6c744656 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:01:56.804610 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 732/1470] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:01:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:02:31.612250 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44a0d1-b055-4977-8ec6-b342bfabacbe None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:02:31.612927 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44a0d1-b055-4977-8ec6-b342bfabacbe None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:02:31.612927 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44a0d1-b055-4977-8ec6-b342bfabacbe None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:02:31.614382 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 739/1471] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 21:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:02:31.619643 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d2945-8da1-4691-91a4-99662ef2a2c5 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:02:31.620120 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d2945-8da1-4691-91a4-99662ef2a2c5 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:02:31.620228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d2945-8da1-4691-91a4-99662ef2a2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:02:31.638645 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-da1d2945-8da1-4691-91a4-99662ef2a2c5 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:02:31.639862 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-da1d2945-8da1-4691-91a4-99662ef2a2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:02:31.647852 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 733/1472] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 21:02:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:02:31.696216 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed0731-0b9e-4a5e-aa90-7ee2102cf93a None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:02:31.696527 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed0731-0b9e-4a5e-aa90-7ee2102cf93a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:02:31.696807 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed0731-0b9e-4a5e-aa90-7ee2102cf93a None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:02:31.698186 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 740/1473] 10.222.0.23 () {54 vars in 962 bytes} [Sat Apr 30 21:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:02:31.703714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1be80-0019-4d83-9956-1ce7f41bce3d None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:02:31.704003 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1be80-0019-4d83-9956-1ce7f41bce3d None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:02:31.704282 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1be80-0019-4d83-9956-1ce7f41bce3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:02:31.722034 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-2bf1be80-0019-4d83-9956-1ce7f41bce3d None None] MFA Rules not processed for user `e302b1298dd04d6590e3d079f7b13b29`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:02:31.723265 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2bf1be80-0019-4d83-9956-1ce7f41bce3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:02:31.729716 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 734/1474] 10.222.0.23 () {58 vars in 1059 bytes} [Sat Apr 30 21:02:31 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:02:31.737055 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed0731-0b9e-4a5e-aa90-7ee2102cf93a None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:02:31.747931 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed0731-0b9e-4a5e-aa90-7ee2102cf93a None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:02:31.751411 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09fc2f8-26a1-4eb5-b85c-546f190cc850 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e302b1298dd04d6590e3d079f7b13b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:02:31.752035 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fc2f8-26a1-4eb5-b85c-546f190cc850 service glance] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:02:31.752315 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fc2f8-26a1-4eb5-b85c-546f190cc850 service glance] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:02:31.752587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fc2f8-26a1-4eb5-b85c-546f190cc850 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:02:31.761177 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09fc2f8-26a1-4eb5-b85c-546f190cc850 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:02:31.763199 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09fc2f8-26a1-4eb5-b85c-546f190cc850 service glance] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:02:31.772316 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 741/1475] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:02:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:02:34.184109 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f5213-b759-4aa0-b13c-4754ee7a3e6a None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:02:34.184665 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f5213-b759-4aa0-b13c-4754ee7a3e6a None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:02:34.184665 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f5213-b759-4aa0-b13c-4754ee7a3e6a None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:02:34.186075 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 735/1476] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 21:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:02:34.191395 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1ef5c-012a-4e1c-9db7-d1b492591140 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:02:34.193348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1ef5c-012a-4e1c-9db7-d1b492591140 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:02:34.193348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1ef5c-012a-4e1c-9db7-d1b492591140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:02:34.210158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-e4f1ef5c-012a-4e1c-9db7-d1b492591140 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:02:34.220506 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e4f1ef5c-012a-4e1c-9db7-d1b492591140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:02:34.220506 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 742/1477] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 21:02:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:02:34.244076 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f5213-b759-4aa0-b13c-4754ee7a3e6a None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:02:34.256464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f5213-b759-4aa0-b13c-4754ee7a3e6a None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:02:34.260804 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3100bb7c-89a4-4949-84cf-4243c8686fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:02:34.261451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100bb7c-89a4-4949-84cf-4243c8686fca admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:02:34.261733 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100bb7c-89a4-4949-84cf-4243c8686fca admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:02:34.262564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100bb7c-89a4-4949-84cf-4243c8686fca admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:02:34.263297 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3100bb7c-89a4-4949-84cf-4243c8686fca admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:02:34.265076 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-3100bb7c-89a4-4949-84cf-4243c8686fca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:02:34.265076 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:02:34.265076 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:02:34.266274 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3100bb7c-89a4-4949-84cf-4243c8686fca admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:02:34.287450 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 736/1478] 10.222.0.23 () {56 vars in 1108 bytes} [Sat Apr 30 21:02:34 2022] GET /identity/v3/projects => generated 2553 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:02:36.737489 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420c1cf-c413-42e6-b2df-110c36a5ee7b None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:02:36.737489 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420c1cf-c413-42e6-b2df-110c36a5ee7b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:02:36.737489 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e420c1cf-c413-42e6-b2df-110c36a5ee7b None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:02:36.737489 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 743/1479] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 21:02:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:02:36.738986 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bec4f1-7c46-40eb-9a6a-47e98544a406 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:02:36.738986 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bec4f1-7c46-40eb-9a6a-47e98544a406 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:02:36.738986 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bec4f1-7c46-40eb-9a6a-47e98544a406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:02:36.738986 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-07bec4f1-7c46-40eb-9a6a-47e98544a406 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:02:36.738986 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-07bec4f1-7c46-40eb-9a6a-47e98544a406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:02:36.738986 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 737/1480] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 21:02:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:02:36.739806 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420c1cf-c413-42e6-b2df-110c36a5ee7b None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:02:36.739806 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e420c1cf-c413-42e6-b2df-110c36a5ee7b None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:02:36.739806 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7994d-e4fc-4561-b268-aee8babdca13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:02:36.739806 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7994d-e4fc-4561-b268-aee8babdca13 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:02:36.740242 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7994d-e4fc-4561-b268-aee8babdca13 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:02:36.740242 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7994d-e4fc-4561-b268-aee8babdca13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:02:36.743263 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7994d-e4fc-4561-b268-aee8babdca13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:02:36.744909 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7994d-e4fc-4561-b268-aee8babdca13 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:02:36.754699 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 744/1481] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:02:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:02:39.247119 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285b0f5-938c-4916-8403-0444bc1e4e67 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:02:39.247682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285b0f5-938c-4916-8403-0444bc1e4e67 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:02:39.247682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285b0f5-938c-4916-8403-0444bc1e4e67 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:02:39.249034 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 738/1482] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 21:02:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:02:39.254135 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5273e-06bd-470e-b889-6ced03c8a63a None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:02:39.254577 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5273e-06bd-470e-b889-6ced03c8a63a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:02:39.254692 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5273e-06bd-470e-b889-6ced03c8a63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:02:39.272484 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-88a5273e-06bd-470e-b889-6ced03c8a63a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:02:39.273710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-88a5273e-06bd-470e-b889-6ced03c8a63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:02:39.281431 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 745/1483] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 21:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:02:39.318178 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285b0f5-938c-4916-8403-0444bc1e4e67 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:02:39.329880 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285b0f5-938c-4916-8403-0444bc1e4e67 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:02:39.333317 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026ba73-40d3-47b2-8837-826d8f4549ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:02:39.333986 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026ba73-40d3-47b2-8837-826d8f4549ac service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:02:39.334271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026ba73-40d3-47b2-8837-826d8f4549ac service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:02:39.334544 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026ba73-40d3-47b2-8837-826d8f4549ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:02:39.343333 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3026ba73-40d3-47b2-8837-826d8f4549ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:02:39.344770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3026ba73-40d3-47b2-8837-826d8f4549ac service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:02:39.354019 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 739/1484] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:02:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:02:41.724670 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ad556-adca-4b1b-89dd-3c1c22b6d9d6 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:02:41.725243 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ad556-adca-4b1b-89dd-3c1c22b6d9d6 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:02:41.725243 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ad556-adca-4b1b-89dd-3c1c22b6d9d6 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:02:41.726607 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 746/1485] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 21:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:02:41.731814 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ec9fc-2628-44f0-a6e3-92ed7f4531f8 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:02:41.732219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ec9fc-2628-44f0-a6e3-92ed7f4531f8 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:02:41.732376 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ec9fc-2628-44f0-a6e3-92ed7f4531f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:02:41.749579 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-546ec9fc-2628-44f0-a6e3-92ed7f4531f8 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:02:41.750791 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-546ec9fc-2628-44f0-a6e3-92ed7f4531f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:02:41.758446 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 740/1486] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 21:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:02:41.797268 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ad556-adca-4b1b-89dd-3c1c22b6d9d6 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:02:41.807919 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ad556-adca-4b1b-89dd-3c1c22b6d9d6 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:02:41.811533 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1824d8a-594b-490e-a9d4-b59f851066b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:02:41.812170 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1824d8a-594b-490e-a9d4-b59f851066b6 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:02:41.812452 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1824d8a-594b-490e-a9d4-b59f851066b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:02:41.812727 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1824d8a-594b-490e-a9d4-b59f851066b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:02:41.821485 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1824d8a-594b-490e-a9d4-b59f851066b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:02:41.822965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1824d8a-594b-490e-a9d4-b59f851066b6 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:02:41.832986 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 747/1487] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:02:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:02:44.247112 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68301b-9b5b-49af-9736-36d55360a10b None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:02:44.247657 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68301b-9b5b-49af-9736-36d55360a10b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:02:44.247776 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68301b-9b5b-49af-9736-36d55360a10b None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:02:44.249088 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 741/1488] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 21:02:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:02:44.254301 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa239662-3a82-4e0b-a263-c0ee4eee0a2b None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:02:44.254731 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa239662-3a82-4e0b-a263-c0ee4eee0a2b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:02:44.254839 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa239662-3a82-4e0b-a263-c0ee4eee0a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:02:44.272207 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-fa239662-3a82-4e0b-a263-c0ee4eee0a2b None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:02:44.273659 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-fa239662-3a82-4e0b-a263-c0ee4eee0a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:02:44.282789 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 748/1489] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 21:02:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:02:44.324327 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68301b-9b5b-49af-9736-36d55360a10b None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:02:44.334770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68301b-9b5b-49af-9736-36d55360a10b None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:02:44.338439 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b76ef-566a-4fa0-a241-e2ddf853bc1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:02:44.339078 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b76ef-566a-4fa0-a241-e2ddf853bc1c service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:02:44.339361 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b76ef-566a-4fa0-a241-e2ddf853bc1c service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:02:44.340152 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b76ef-566a-4fa0-a241-e2ddf853bc1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:02:44.349113 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b76ef-566a-4fa0-a241-e2ddf853bc1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:02:44.350639 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b76ef-566a-4fa0-a241-e2ddf853bc1c service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:02:44.360713 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 742/1490] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:02:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:02:47.222582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6ec70-cfac-4c9c-9105-2c055745b822 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:02:47.223036 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6ec70-cfac-4c9c-9105-2c055745b822 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:02:47.223146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6ec70-cfac-4c9c-9105-2c055745b822 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:02:47.224515 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 749/1491] 10.222.0.23 () {54 vars in 926 bytes} [Sat Apr 30 21:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:02:47.229661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e351e-a29e-447f-833c-2459f0c9eda8 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:02:47.230169 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e351e-a29e-447f-833c-2459f0c9eda8 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:02:47.230268 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e351e-a29e-447f-833c-2459f0c9eda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:02:47.247291 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-d22e351e-a29e-447f-833c-2459f0c9eda8 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:02:47.248464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d22e351e-a29e-447f-833c-2459f0c9eda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:02:47.256080 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 743/1492] 10.222.0.23 () {58 vars in 1023 bytes} [Sat Apr 30 21:02:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:02:47.295856 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6ec70-cfac-4c9c-9105-2c055745b822 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:02:47.306402 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6ec70-cfac-4c9c-9105-2c055745b822 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:02:47.310661 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e064ae0-f355-4bc3-90ee-3ba728538a7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:02:47.311323 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e064ae0-f355-4bc3-90ee-3ba728538a7d service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:02:47.311631 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e064ae0-f355-4bc3-90ee-3ba728538a7d service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:02:47.311907 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e064ae0-f355-4bc3-90ee-3ba728538a7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:02:47.320728 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e064ae0-f355-4bc3-90ee-3ba728538a7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:02:47.322226 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e064ae0-f355-4bc3-90ee-3ba728538a7d service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:02:47.332465 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 750/1493] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:02:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:04:26.170031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3d07d-34b0-42c3-b566-cfe5d281d981 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:04:26.170635 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3d07d-34b0-42c3-b566-cfe5d281d981 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:04:26.170635 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3d07d-34b0-42c3-b566-cfe5d281d981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:04:26.189252 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-e8b3d07d-34b0-42c3-b566-cfe5d281d981 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:04:26.190481 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e8b3d07d-34b0-42c3-b566-cfe5d281d981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:04:26.199038 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 744/1494] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:04:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:04:26.207257 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1ea7b-074a-4ba3-b203-5e71930aea7a None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:04:26.207780 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1ea7b-074a-4ba3-b203-5e71930aea7a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:04:26.207895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1ea7b-074a-4ba3-b203-5e71930aea7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:04:26.226119 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-01d1ea7b-074a-4ba3-b203-5e71930aea7a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:04:26.227395 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-01d1ea7b-074a-4ba3-b203-5e71930aea7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:04:26.235245 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 751/1495] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:04:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:04:26.239810 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b3d07d-34b0-42c3-b566-cfe5d281d981 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:04:26.249642 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b3d07d-34b0-42c3-b566-cfe5d281d981 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:04:26.254192 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bddf55-2c6b-4063-99d1-f0713456ee15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:04:26.257436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bddf55-2c6b-4063-99d1-f0713456ee15 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:04:26.257436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bddf55-2c6b-4063-99d1-f0713456ee15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:04:26.257436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bddf55-2c6b-4063-99d1-f0713456ee15 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:04:26.257436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bddf55-2c6b-4063-99d1-f0713456ee15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:04:26.257436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bddf55-2c6b-4063-99d1-f0713456ee15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:04:26.258039 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-b0bddf55-2c6b-4063-99d1-f0713456ee15 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:04:26.258039 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:04:26.258039 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:04:26.258325 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bddf55-2c6b-4063-99d1-f0713456ee15 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:04:26.270267 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 745/1496] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:04:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:04:26.279175 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1ea7b-074a-4ba3-b203-5e71930aea7a None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:04:26.288080 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1ea7b-074a-4ba3-b203-5e71930aea7a None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:04:26.292599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c426b28c-d5c9-49c0-adfa-c046219d62ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:04:26.294990 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426b28c-d5c9-49c0-adfa-c046219d62ee admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:04:26.294990 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426b28c-d5c9-49c0-adfa-c046219d62ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:04:26.294990 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426b28c-d5c9-49c0-adfa-c046219d62ee admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:04:26.294990 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c426b28c-d5c9-49c0-adfa-c046219d62ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:04:26.296350 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-c426b28c-d5c9-49c0-adfa-c046219d62ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:04:26.296350 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:04:26.296350 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:04:26.297543 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c426b28c-d5c9-49c0-adfa-c046219d62ee admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:04:26.389709 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 752/1497] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:04:26 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:04:26.394037 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bddf55-2c6b-4063-99d1-f0713456ee15 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:04:26.403704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bddf55-2c6b-4063-99d1-f0713456ee15 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:04:26.457097 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8325ce-c9a4-4e7e-8ecc-21c0f8bce664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:04:26.457746 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8325ce-c9a4-4e7e-8ecc-21c0f8bce664 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:04:26.458054 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8325ce-c9a4-4e7e-8ecc-21c0f8bce664 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:04:26.458326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8325ce-c9a4-4e7e-8ecc-21c0f8bce664 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:04:26.458990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8325ce-c9a4-4e7e-8ecc-21c0f8bce664 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:04:26.460059 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-ea8325ce-c9a4-4e7e-8ecc-21c0f8bce664 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:04:26.460059 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:04:26.460059 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:04:26.461242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8325ce-c9a4-4e7e-8ecc-21c0f8bce664 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:04:26.536541 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 746/1498] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:04:26 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:04:26.540832 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c426b28c-d5c9-49c0-adfa-c046219d62ee admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:04:26.550936 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c426b28c-d5c9-49c0-adfa-c046219d62ee admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:04:26.555525 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ff2e1-e9af-4ae1-bef0-a697a02b3e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:04:26.556676 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ff2e1-e9af-4ae1-bef0-a697a02b3e51 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:04:26.556960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ff2e1-e9af-4ae1-bef0-a697a02b3e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:04:26.557231 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ff2e1-e9af-4ae1-bef0-a697a02b3e51 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:04:26.557989 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096ff2e1-e9af-4ae1-bef0-a697a02b3e51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:04:26.558993 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-096ff2e1-e9af-4ae1-bef0-a697a02b3e51 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:04:26.558993 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:04:26.558993 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:04:26.559868 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096ff2e1-e9af-4ae1-bef0-a697a02b3e51 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:04:26.573059 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 753/1499] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:04:26.577071 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8325ce-c9a4-4e7e-8ecc-21c0f8bce664 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:04:26.587040 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8325ce-c9a4-4e7e-8ecc-21c0f8bce664 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:04:26.591647 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e37452-ce25-400d-ad11-03cd39c10418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:04:26.592298 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e37452-ce25-400d-ad11-03cd39c10418 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:04:26.593378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e37452-ce25-400d-ad11-03cd39c10418 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:04:26.593378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e37452-ce25-400d-ad11-03cd39c10418 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:04:26.593574 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e37452-ce25-400d-ad11-03cd39c10418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:04:26.594580 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-c6e37452-ce25-400d-ad11-03cd39c10418 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:04:26.594580 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:04:26.594580 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:04:26.595466 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e37452-ce25-400d-ad11-03cd39c10418 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:04:26.609070 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 747/1500] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:04:26.613060 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ff2e1-e9af-4ae1-bef0-a697a02b3e51 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:04:26.623775 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ff2e1-e9af-4ae1-bef0-a697a02b3e51 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:04:26.628373 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b541ef7d-8f4d-4cbd-b7d2-9d816df5f732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:04:26.629237 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541ef7d-8f4d-4cbd-b7d2-9d816df5f732 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:04:26.629535 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541ef7d-8f4d-4cbd-b7d2-9d816df5f732 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:04:26.629830 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541ef7d-8f4d-4cbd-b7d2-9d816df5f732 admin admin] PATH_INFO: `/v3/projects/1dcc96ebca3e4f67956a521201a42708/users/29345d3b95494fd88592297a3a81f0e4/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:04:26.644778 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b541ef7d-8f4d-4cbd-b7d2-9d816df5f732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dcc96ebca3e4f67956a521201a42708, user_id=29345d3b95494fd88592297a3a81f0e4, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:04:26.645874 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-b541ef7d-8f4d-4cbd-b7d2-9d816df5f732 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:04:26.645874 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:04:26.645874 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:04:26.647819 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b541ef7d-8f4d-4cbd-b7d2-9d816df5f732 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:04:26.737359 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 754/1501] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:04:26 2022] PUT /identity/v3/projects/1dcc96ebca3e4f67956a521201a42708/users/29345d3b95494fd88592297a3a81f0e4/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:04:26.749428 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23baa5-ad86-478d-ab22-25f705d0e95d None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:04:26.749718 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23baa5-ad86-478d-ab22-25f705d0e95d None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:04:26.750035 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23baa5-ad86-478d-ab22-25f705d0e95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:04:26.775377 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-7d23baa5-ad86-478d-ab22-25f705d0e95d None None] MFA Rules not processed for user `29345d3b95494fd88592297a3a81f0e4`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:04:26.776573 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7d23baa5-ad86-478d-ab22-25f705d0e95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:04:26.840818 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 748/1502] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:04:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:04:26.852040 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b541ef7d-8f4d-4cbd-b7d2-9d816df5f732 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:04:26.918867 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b541ef7d-8f4d-4cbd-b7d2-9d816df5f732 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:04:26.924160 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0678a-a4fa-4760-b298-d1c40c902410 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:04:26.924788 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0678a-a4fa-4760-b298-d1c40c902410 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:04:26.925068 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0678a-a4fa-4760-b298-d1c40c902410 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:04:26.925342 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0678a-a4fa-4760-b298-d1c40c902410 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:04:26.933332 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0678a-a4fa-4760-b298-d1c40c902410 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:04:26.934944 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0678a-a4fa-4760-b298-d1c40c902410 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:04:26.943323 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 755/1503] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:04:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:04:27.014061 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55da591-4cb2-4768-b753-49dfef8468ad None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:04:27.014356 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55da591-4cb2-4768-b753-49dfef8468ad None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:04:27.014638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55da591-4cb2-4768-b753-49dfef8468ad None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:04:27.015976 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 749/1504] 10.222.0.23 () {52 vars in 829 bytes} [Sat Apr 30 21:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:04:27.019579 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0678a-a4fa-4760-b298-d1c40c902410 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:04:27.079684 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0678a-a4fa-4760-b298-d1c40c902410 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:04:27.084169 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336e56a-138c-4f30-a70c-1b48eab806f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:04:27.085055 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336e56a-138c-4f30-a70c-1b48eab806f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:04:27.085333 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336e56a-138c-4f30-a70c-1b48eab806f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:04:27.085606 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336e56a-138c-4f30-a70c-1b48eab806f7 admin admin] PATH_INFO: `/v3/users/29345d3b95494fd88592297a3a81f0e4` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:04:27.087348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4336e56a-138c-4f30-a70c-1b48eab806f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29345d3b95494fd88592297a3a81f0e4)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:04:27.088358 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-4336e56a-138c-4f30-a70c-1b48eab806f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:04:27.088358 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:04:27.088358 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:04:27.089630 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4336e56a-138c-4f30-a70c-1b48eab806f7 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:04:27.294538 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4336e56a-138c-4f30-a70c-1b48eab806f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29345d3b95494fd88592297a3a81f0e4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:04:27.314685 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4336e56a-138c-4f30-a70c-1b48eab806f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29345d3b95494fd88592297a3a81f0e4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:04:27.392813 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4336e56a-138c-4f30-a70c-1b48eab806f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29345d3b95494fd88592297a3a81f0e4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:04:27.406116 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4336e56a-138c-4f30-a70c-1b48eab806f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29345d3b95494fd88592297a3a81f0e4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:04:27.406882 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4336e56a-138c-4f30-a70c-1b48eab806f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29345d3b95494fd88592297a3a81f0e4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:04:27.412946 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 756/1505] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:04:27 2022] DELETE /identity/v3/users/29345d3b95494fd88592297a3a81f0e4 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:04:27.417096 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9cb79-9804-45a0-9b12-09b19e4246a1 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:04:27.417597 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9cb79-9804-45a0-9b12-09b19e4246a1 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:04:27.417707 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9cb79-9804-45a0-9b12-09b19e4246a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:04:27.434670 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-72e9cb79-9804-45a0-9b12-09b19e4246a1 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:04:27.435845 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-72e9cb79-9804-45a0-9b12-09b19e4246a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:04:27.491501 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 750/1506] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:04:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:04:27.501442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336e56a-138c-4f30-a70c-1b48eab806f7 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:04:27.502814 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4336e56a-138c-4f30-a70c-1b48eab806f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:04:27.557854 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336e56a-138c-4f30-a70c-1b48eab806f7 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:04:27.561384 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf9856-c4fc-4234-8fca-da91a59b01b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:04:27.562064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf9856-c4fc-4234-8fca-da91a59b01b6 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:04:27.562345 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf9856-c4fc-4234-8fca-da91a59b01b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:04:27.562622 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf9856-c4fc-4234-8fca-da91a59b01b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:04:27.572265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf9856-c4fc-4234-8fca-da91a59b01b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:04:27.573701 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf9856-c4fc-4234-8fca-da91a59b01b6 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:04:27.582800 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 757/1507] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:04:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:04:28.230894 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9cb79-9804-45a0-9b12-09b19e4246a1 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:04:28.232324 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-72e9cb79-9804-45a0-9b12-09b19e4246a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:04:28.244565 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9cb79-9804-45a0-9b12-09b19e4246a1 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:04:28.249027 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5bc05f-eea8-4b6c-bb30-e09a570d5b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:04:28.249913 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5bc05f-eea8-4b6c-bb30-e09a570d5b35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:04:28.250194 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5bc05f-eea8-4b6c-bb30-e09a570d5b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:04:28.250467 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5bc05f-eea8-4b6c-bb30-e09a570d5b35 admin admin] PATH_INFO: `/v3/projects/1dcc96ebca3e4f67956a521201a42708` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:04:28.252235 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5bc05f-eea8-4b6c-bb30-e09a570d5b35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dcc96ebca3e4f67956a521201a42708)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:04:28.252666 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-de5bc05f-eea8-4b6c-bb30-e09a570d5b35 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:04:28.252666 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:04:28.252666 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:04:28.254085 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5bc05f-eea8-4b6c-bb30-e09a570d5b35 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:04:28.375542 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-de5bc05f-eea8-4b6c-bb30-e09a570d5b35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dcc96ebca3e4f67956a521201a42708', 'request_id': 'req-de5bc05f-eea8-4b6c-bb30-e09a570d5b35'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:04:28.383873 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-de5bc05f-eea8-4b6c-bb30-e09a570d5b35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dcc96ebca3e4f67956a521201a42708', 'request_id': 'req-de5bc05f-eea8-4b6c-bb30-e09a570d5b35'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:04:28.397325 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-de5bc05f-eea8-4b6c-bb30-e09a570d5b35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dcc96ebca3e4f67956a521201a42708', 'request_id': 'req-de5bc05f-eea8-4b6c-bb30-e09a570d5b35'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:04:28.483944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-de5bc05f-eea8-4b6c-bb30-e09a570d5b35 admin admin] The token cache is being invalidate because project 1dcc96ebca3e4f67956a521201a42708 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:04:28.484590 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-de5bc05f-eea8-4b6c-bb30-e09a570d5b35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:04:28.484921 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-de5bc05f-eea8-4b6c-bb30-e09a570d5b35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:04:28.486535 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 751/1508] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:04:28 2022] DELETE /identity/v3/projects/1dcc96ebca3e4f67956a521201a42708 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:07:48.657414 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d8a80-0ee5-4c48-b180-cd2f30f9815c None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:07:48.658036 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d8a80-0ee5-4c48-b180-cd2f30f9815c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:07:48.658036 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d8a80-0ee5-4c48-b180-cd2f30f9815c None None] PATH_INFO: `/v3` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:07:48.659341 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 758/1509] 10.222.0.35 () {54 vars in 925 bytes} [Sat Apr 30 21:07:48 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:07:48.665200 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccd6b6-3af3-41c9-9cb2-87c840cf31f7 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:07:48.665622 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccd6b6-3af3-41c9-9cb2-87c840cf31f7 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:07:48.665771 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccd6b6-3af3-41c9-9cb2-87c840cf31f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:07:48.684533 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-d7ccd6b6-3af3-41c9-9cb2-87c840cf31f7 None None] MFA Rules not processed for user `4ad3f89b7037413a83c7905cef263b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:07:48.685717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d7ccd6b6-3af3-41c9-9cb2-87c840cf31f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:07:48.746261 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 752/1510] 10.222.0.35 () {58 vars in 1015 bytes} [Sat Apr 30 21:07:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:07:50.444679 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180b374-204c-4edd-9c68-f8de3e02a463 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:07:50.445203 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180b374-204c-4edd-9c68-f8de3e02a463 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:07:50.445309 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180b374-204c-4edd-9c68-f8de3e02a463 None None] PATH_INFO: `/v3` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:07:50.446564 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 759/1511] 10.222.0.20 () {54 vars in 925 bytes} [Sat Apr 30 21:07:50 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:07:50.468732 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd23ea-52a8-4ef8-87c5-2601316c9529 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:07:50.469152 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd23ea-52a8-4ef8-87c5-2601316c9529 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:07:50.469302 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd23ea-52a8-4ef8-87c5-2601316c9529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:07:50.490150 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-18bd23ea-52a8-4ef8-87c5-2601316c9529 None None] MFA Rules not processed for user `4ad3f89b7037413a83c7905cef263b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:07:50.491370 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-18bd23ea-52a8-4ef8-87c5-2601316c9529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:07:50.500132 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 753/1512] 10.222.0.20 () {58 vars in 1015 bytes} [Sat Apr 30 21:07:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:07:52.932470 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f4c6b-2cba-4404-8dc2-ace6152d7ade None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:07:52.933012 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f4c6b-2cba-4404-8dc2-ace6152d7ade None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:07:52.933122 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f4c6b-2cba-4404-8dc2-ace6152d7ade None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:07:52.934525 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 760/1513] 10.222.0.23 () {54 vars in 960 bytes} [Sat Apr 30 21:07:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:07:52.939657 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81093500-b7d2-4228-afcf-541272bed5ef None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:07:52.940091 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81093500-b7d2-4228-afcf-541272bed5ef None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:07:52.940204 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81093500-b7d2-4228-afcf-541272bed5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:07:52.964190 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-81093500-b7d2-4228-afcf-541272bed5ef None None] MFA Rules not processed for user `4ad3f89b7037413a83c7905cef263b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:07:52.965391 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-81093500-b7d2-4228-afcf-541272bed5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:07:52.973827 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 754/1514] 10.222.0.23 () {58 vars in 1057 bytes} [Sat Apr 30 21:07:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:07:52.981528 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f4c6b-2cba-4404-8dc2-ace6152d7ade None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:07:52.995277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f4c6b-2cba-4404-8dc2-ace6152d7ade None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:07:53.000269 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b3b88b-19ba-4818-9264-25e9d7e4f40f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:07:53.000906 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3b88b-19ba-4818-9264-25e9d7e4f40f service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:07:53.001217 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3b88b-19ba-4818-9264-25e9d7e4f40f service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:07:53.001513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3b88b-19ba-4818-9264-25e9d7e4f40f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:07:53.010356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b3b88b-19ba-4818-9264-25e9d7e4f40f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:07:53.011967 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b3b88b-19ba-4818-9264-25e9d7e4f40f service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:07:53.021472 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 761/1515] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:07:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:07:54.505213 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e70a9-1c60-453e-bc3c-17d06ac109a9 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:07:54.505829 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e70a9-1c60-453e-bc3c-17d06ac109a9 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:07:54.506509 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e70a9-1c60-453e-bc3c-17d06ac109a9 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:07:54.507850 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 755/1516] 10.222.0.23 () {54 vars in 960 bytes} [Sat Apr 30 21:07:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:07:54.512873 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cc9ca-ca9a-48b8-81ff-a9cc921fffb3 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:07:54.513310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cc9ca-ca9a-48b8-81ff-a9cc921fffb3 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:07:54.513454 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cc9ca-ca9a-48b8-81ff-a9cc921fffb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:07:54.531256 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-248cc9ca-ca9a-48b8-81ff-a9cc921fffb3 None None] MFA Rules not processed for user `4ad3f89b7037413a83c7905cef263b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:07:54.532415 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-248cc9ca-ca9a-48b8-81ff-a9cc921fffb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:07:54.540991 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 762/1517] 10.222.0.23 () {58 vars in 1057 bytes} [Sat Apr 30 21:07:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:07:54.548696 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e70a9-1c60-453e-bc3c-17d06ac109a9 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:07:54.562224 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e70a9-1c60-453e-bc3c-17d06ac109a9 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:07:54.567026 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15bae2-76bf-47ba-b819-bc781d67af6c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:07:54.567700 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15bae2-76bf-47ba-b819-bc781d67af6c service placement] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:07:54.567982 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15bae2-76bf-47ba-b819-bc781d67af6c service placement] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:07:54.569151 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15bae2-76bf-47ba-b819-bc781d67af6c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:07:54.577199 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c15bae2-76bf-47ba-b819-bc781d67af6c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:07:54.578830 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c15bae2-76bf-47ba-b819-bc781d67af6c service placement] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:07:54.588177 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 756/1518] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:07:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:08:30.517386 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9068a-e60d-4da7-b605-886bc582438b None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:08:30.517998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9068a-e60d-4da7-b605-886bc582438b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:08:30.517998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9068a-e60d-4da7-b605-886bc582438b None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:08:30.519333 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 763/1519] 127.0.0.1 () {54 vars in 901 bytes} [Sat Apr 30 21:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:08:30.524454 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82dca2-18ea-4e47-a340-8a341abaa133 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:08:30.524903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82dca2-18ea-4e47-a340-8a341abaa133 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:08:30.525001 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82dca2-18ea-4e47-a340-8a341abaa133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:08:30.547558 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-ed82dca2-18ea-4e47-a340-8a341abaa133 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:08:30.547558 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ed82dca2-18ea-4e47-a340-8a341abaa133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:08:30.606369 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 757/1520] 127.0.0.1 () {58 vars in 998 bytes} [Sat Apr 30 21:08:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:08:30.765141 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9068a-e60d-4da7-b605-886bc582438b None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:08:30.766876 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-95b9068a-e60d-4da7-b605-886bc582438b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:08:30.842036 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9068a-e60d-4da7-b605-886bc582438b None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:08:30.850971 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e64cb16-1254-4faa-9f7a-9c8a915ecab6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:08:30.851622 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64cb16-1254-4faa-9f7a-9c8a915ecab6 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:08:30.851904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64cb16-1254-4faa-9f7a-9c8a915ecab6 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:08:30.852179 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64cb16-1254-4faa-9f7a-9c8a915ecab6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:08:30.860725 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e64cb16-1254-4faa-9f7a-9c8a915ecab6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:08:30.862394 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e64cb16-1254-4faa-9f7a-9c8a915ecab6 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:08:30.872068 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 764/1521] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:08:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:08:32.167625 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df086562-ce93-4f6d-b5d2-37020b6c5104 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:08:32.167625 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df086562-ce93-4f6d-b5d2-37020b6c5104 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:08:32.167625 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df086562-ce93-4f6d-b5d2-37020b6c5104 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:08:32.167625 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sat Apr 30 21:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:08:32.171954 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161dec5-0167-45d4-a151-74dc0c4d799c None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:08:32.172356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161dec5-0167-45d4-a151-74dc0c4d799c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:08:32.172510 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161dec5-0167-45d4-a151-74dc0c4d799c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:08:32.190704 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-9161dec5-0167-45d4-a151-74dc0c4d799c None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:08:32.191909 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9161dec5-0167-45d4-a151-74dc0c4d799c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:08:32.199925 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sat Apr 30 21:08:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:08:32.357720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df086562-ce93-4f6d-b5d2-37020b6c5104 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:08:32.372109 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df086562-ce93-4f6d-b5d2-37020b6c5104 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:08:32.377491 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78d097-0f4c-40ed-8294-2cff2e42ba31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:08:32.378168 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78d097-0f4c-40ed-8294-2cff2e42ba31 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:08:32.378455 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78d097-0f4c-40ed-8294-2cff2e42ba31 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:08:32.378733 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78d097-0f4c-40ed-8294-2cff2e42ba31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:08:32.386847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e78d097-0f4c-40ed-8294-2cff2e42ba31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:08:32.388457 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e78d097-0f4c-40ed-8294-2cff2e42ba31 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:08:32.397748 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 759/1524] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:08:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:08:36.492133 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab8295-a5cc-4e73-8a38-4c99d0e84a30 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:08:36.492710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab8295-a5cc-4e73-8a38-4c99d0e84a30 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:08:36.492710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab8295-a5cc-4e73-8a38-4c99d0e84a30 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:08:36.494085 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 30 21:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:08:36.499415 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de61708-f4d3-4a72-b0d9-5b29bc1a9382 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:08:36.499828 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de61708-f4d3-4a72-b0d9-5b29bc1a9382 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:08:36.499993 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de61708-f4d3-4a72-b0d9-5b29bc1a9382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:08:36.521162 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-1de61708-f4d3-4a72-b0d9-5b29bc1a9382 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:08:36.522399 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1de61708-f4d3-4a72-b0d9-5b29bc1a9382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:08:36.531266 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 30 21:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:08:36.569324 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab8295-a5cc-4e73-8a38-4c99d0e84a30 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:08:36.571015 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-baab8295-a5cc-4e73-8a38-4c99d0e84a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:08:36.626097 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab8295-a5cc-4e73-8a38-4c99d0e84a30 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:08:36.629594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58535ab4-2fa6-409e-90f8-cd54757d45f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:08:36.630252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58535ab4-2fa6-409e-90f8-cd54757d45f7 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:08:36.630535 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58535ab4-2fa6-409e-90f8-cd54757d45f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:08:36.630810 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58535ab4-2fa6-409e-90f8-cd54757d45f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:08:36.639912 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58535ab4-2fa6-409e-90f8-cd54757d45f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:08:36.641336 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58535ab4-2fa6-409e-90f8-cd54757d45f7 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:08:36.650358 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 767/1527] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:08:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:08:38.944779 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882d12b-e28e-402d-83c7-a8d4b9ee8fa0 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:08:38.945320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882d12b-e28e-402d-83c7-a8d4b9ee8fa0 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:08:38.945320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882d12b-e28e-402d-83c7-a8d4b9ee8fa0 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:08:38.946737 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 916 bytes} [Sat Apr 30 21:08:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:08:38.952440 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f169c2-d35c-4ba0-8b5b-2af77fa2ac77 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:08:38.952848 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f169c2-d35c-4ba0-8b5b-2af77fa2ac77 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:08:38.952996 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f169c2-d35c-4ba0-8b5b-2af77fa2ac77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:08:38.970492 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-22f169c2-d35c-4ba0-8b5b-2af77fa2ac77 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:08:38.971699 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-22f169c2-d35c-4ba0-8b5b-2af77fa2ac77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:08:38.979403 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Apr 30 21:08:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:08:39.017342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882d12b-e28e-402d-83c7-a8d4b9ee8fa0 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:08:39.019059 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3882d12b-e28e-402d-83c7-a8d4b9ee8fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:08:39.032202 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882d12b-e28e-402d-83c7-a8d4b9ee8fa0 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:08:39.035741 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37714d-ff49-46df-a55c-830a784aac97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:08:39.037847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37714d-ff49-46df-a55c-830a784aac97 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:08:39.037847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37714d-ff49-46df-a55c-830a784aac97 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:08:39.037847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37714d-ff49-46df-a55c-830a784aac97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:08:39.046276 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37714d-ff49-46df-a55c-830a784aac97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:08:39.047717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37714d-ff49-46df-a55c-830a784aac97 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:08:39.057626 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 762/1530] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:08:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:09:32.859950 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a9f4b-a3ff-4f36-9b49-716b3a4b8d77 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:09:32.860558 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a9f4b-a3ff-4f36-9b49-716b3a4b8d77 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:09:32.860558 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a9f4b-a3ff-4f36-9b49-716b3a4b8d77 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:09:32.862064 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 769/1531] 10.222.0.23 () {54 vars in 921 bytes} [Sat Apr 30 21:09:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:09:32.867151 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e10797-8f52-4483-8ac3-3e6a311b0db1 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:09:32.867657 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e10797-8f52-4483-8ac3-3e6a311b0db1 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:09:32.867843 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e10797-8f52-4483-8ac3-3e6a311b0db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:09:32.885693 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-58e10797-8f52-4483-8ac3-3e6a311b0db1 None None] MFA Rules not processed for user `4ad3f89b7037413a83c7905cef263b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:09:32.886924 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-58e10797-8f52-4483-8ac3-3e6a311b0db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:09:32.895415 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 763/1532] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Apr 30 21:09:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:11.933792 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0a010-4917-48a9-a1ef-6d1b2c32bd44 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:11.934850 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0a010-4917-48a9-a1ef-6d1b2c32bd44 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:11.935350 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0a010-4917-48a9-a1ef-6d1b2c32bd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:12.069355 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-dea0a010-4917-48a9-a1ef-6d1b2c32bd44 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:12.071104 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-dea0a010-4917-48a9-a1ef-6d1b2c32bd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:12.135743 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 770/1533] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:12.146878 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602eb56a-db07-4307-8838-16b878e36c12 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:12.147866 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602eb56a-db07-4307-8838-16b878e36c12 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:12.148347 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602eb56a-db07-4307-8838-16b878e36c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:12.171075 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-602eb56a-db07-4307-8838-16b878e36c12 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:12.172731 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-602eb56a-db07-4307-8838-16b878e36c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:12.184416 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 764/1534] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:12.190464 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0a010-4917-48a9-a1ef-6d1b2c32bd44 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:12.200946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0a010-4917-48a9-a1ef-6d1b2c32bd44 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:12.208250 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfff837-915a-42fd-bd04-ddd114248c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:12.209211 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfff837-915a-42fd-bd04-ddd114248c3f admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:12.209701 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfff837-915a-42fd-bd04-ddd114248c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:12.210219 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfff837-915a-42fd-bd04-ddd114248c3f admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:12.211153 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfff837-915a-42fd-bd04-ddd114248c3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:10:12.211676 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfff837-915a-42fd-bd04-ddd114248c3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:12.212906 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-9bfff837-915a-42fd-bd04-ddd114248c3f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:12.212906 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:10:12.212906 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:10:12.214329 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfff837-915a-42fd-bd04-ddd114248c3f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:12.227282 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 771/1535] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:10:12.235922 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602eb56a-db07-4307-8838-16b878e36c12 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:12.245900 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602eb56a-db07-4307-8838-16b878e36c12 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:12.254100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb4321e-85dc-474e-a8c6-95a6853acd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:12.255153 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4321e-85dc-474e-a8c6-95a6853acd04 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:12.255655 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4321e-85dc-474e-a8c6-95a6853acd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:12.256140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4321e-85dc-474e-a8c6-95a6853acd04 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:12.257050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb4321e-85dc-474e-a8c6-95a6853acd04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:12.258308 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-6fb4321e-85dc-474e-a8c6-95a6853acd04 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:12.258308 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:10:12.258308 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:10:12.259850 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb4321e-85dc-474e-a8c6-95a6853acd04 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:12.305139 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071c43e-974f-4dca-aa24-5a51492e7e86 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:12.305577 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071c43e-974f-4dca-aa24-5a51492e7e86 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:12.306090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071c43e-974f-4dca-aa24-5a51492e7e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:12.331947 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-c071c43e-974f-4dca-aa24-5a51492e7e86 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:12.333167 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c071c43e-974f-4dca-aa24-5a51492e7e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:12.346758 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 772/1536] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:10:12.374129 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba755140-2c01-41b6-99e7-05c3ed551dca None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:12.374533 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba755140-2c01-41b6-99e7-05c3ed551dca None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:12.374804 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba755140-2c01-41b6-99e7-05c3ed551dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:12.377459 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 765/1537] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:12 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:12.385411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb4321e-85dc-474e-a8c6-95a6853acd04 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:12.402339 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-ba755140-2c01-41b6-99e7-05c3ed551dca None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:12.403666 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ba755140-2c01-41b6-99e7-05c3ed551dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:12.528166 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb4321e-85dc-474e-a8c6-95a6853acd04 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:12.544460 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2e587-bd74-4c06-b1e0-76d65c07c491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:12.546198 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2e587-bd74-4c06-b1e0-76d65c07c491 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:12.546491 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2e587-bd74-4c06-b1e0-76d65c07c491 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:12.546772 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2e587-bd74-4c06-b1e0-76d65c07c491 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:12.547479 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2e587-bd74-4c06-b1e0-76d65c07c491 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:12.553049 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 773/1538] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:10:12.554945 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2e587-bd74-4c06-b1e0-76d65c07c491 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:12.557812 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba755140-2c01-41b6-99e7-05c3ed551dca None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:12.584462 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba755140-2c01-41b6-99e7-05c3ed551dca None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:12.598485 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d8d20-8967-4f2a-831b-0902ebe2f711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:12.599171 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d8d20-8967-4f2a-831b-0902ebe2f711 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:12.599450 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d8d20-8967-4f2a-831b-0902ebe2f711 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:12.599723 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d8d20-8967-4f2a-831b-0902ebe2f711 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:12.600456 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d8d20-8967-4f2a-831b-0902ebe2f711 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:10:12.600756 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d8d20-8967-4f2a-831b-0902ebe2f711 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:12.602428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d8d20-8967-4f2a-831b-0902ebe2f711 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:12.618257 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 774/1539] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:10:12.626028 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d8d20-8967-4f2a-831b-0902ebe2f711 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:12.638118 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d8d20-8967-4f2a-831b-0902ebe2f711 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:12.641677 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 766/1540] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:12 2022] POST /identity/v3/users => generated 292 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:12.649584 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2e587-bd74-4c06-b1e0-76d65c07c491 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:12.650593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b1e3b-c4dd-49b5-a6ea-6e028ac0fbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:12.651264 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b1e3b-c4dd-49b5-a6ea-6e028ac0fbde admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:12.651542 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b1e3b-c4dd-49b5-a6ea-6e028ac0fbde admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:12.651811 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b1e3b-c4dd-49b5-a6ea-6e028ac0fbde admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:12.652495 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b1e3b-c4dd-49b5-a6ea-6e028ac0fbde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:12.659811 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b1e3b-c4dd-49b5-a6ea-6e028ac0fbde admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:12.672410 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2e587-bd74-4c06-b1e0-76d65c07c491 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:12.688162 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a647b-288b-4265-be17-17f5ac57e29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:12.688837 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a647b-288b-4265-be17-17f5ac57e29a admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:12.689158 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a647b-288b-4265-be17-17f5ac57e29a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:12.689375 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a647b-288b-4265-be17-17f5ac57e29a admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:12.690132 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a647b-288b-4265-be17-17f5ac57e29a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:12.692050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a647b-288b-4265-be17-17f5ac57e29a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:12.709354 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 767/1541] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:12.710912 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba79ff8-3476-41b9-824b-f7ca73bdceed None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:12.711247 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba79ff8-3476-41b9-824b-f7ca73bdceed None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:12.711473 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba79ff8-3476-41b9-824b-f7ca73bdceed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:12.738398 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-0ba79ff8-3476-41b9-824b-f7ca73bdceed None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:12.739720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0ba79ff8-3476-41b9-824b-f7ca73bdceed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:12.748439 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 768/1542] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:12.749033 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba79ff8-3476-41b9-824b-f7ca73bdceed None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:12.760478 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 775/1543] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:12 2022] POST /identity/v3/projects => generated 379 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:12.766611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3ffd5-d954-4251-a830-be7952edbf50 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:12.766611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3ffd5-d954-4251-a830-be7952edbf50 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:12.766611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3ffd5-d954-4251-a830-be7952edbf50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:12.786854 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba79ff8-3476-41b9-824b-f7ca73bdceed None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:12.809062 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-2fa3ffd5-d954-4251-a830-be7952edbf50 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:12.812861 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2fa3ffd5-d954-4251-a830-be7952edbf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:12.884326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ba224-fac3-48ac-aa33-4cd7fe088d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:12.885000 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ba224-fac3-48ac-aa33-4cd7fe088d7c admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:12.885286 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ba224-fac3-48ac-aa33-4cd7fe088d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:12.885556 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ba224-fac3-48ac-aa33-4cd7fe088d7c admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:12.886341 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9ba224-fac3-48ac-aa33-4cd7fe088d7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:12.888483 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9ba224-fac3-48ac-aa33-4cd7fe088d7c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:12.899808 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 769/1544] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:12.901255 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706819ad-db16-483d-b411-2dcc738aad16 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:12.901550 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706819ad-db16-483d-b411-2dcc738aad16 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:12.901981 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706819ad-db16-483d-b411-2dcc738aad16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:12.920160 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 776/1545] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:12.922457 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3ffd5-d954-4251-a830-be7952edbf50 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:12.923904 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-706819ad-db16-483d-b411-2dcc738aad16 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:12.925094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-706819ad-db16-483d-b411-2dcc738aad16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:12.937779 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 770/1546] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:12.937779 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851c3b6-dd77-4bc0-9ab9-14a99e3885cf None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:12.937779 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851c3b6-dd77-4bc0-9ab9-14a99e3885cf None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:12.937779 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851c3b6-dd77-4bc0-9ab9-14a99e3885cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:12.941150 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3ffd5-d954-4251-a830-be7952edbf50 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:12.946184 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22909834-389a-47a2-80da-e24da94cc7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:12.951885 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22909834-389a-47a2-80da-e24da94cc7be admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:12.951885 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22909834-389a-47a2-80da-e24da94cc7be admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:12.951885 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22909834-389a-47a2-80da-e24da94cc7be admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:12.951885 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22909834-389a-47a2-80da-e24da94cc7be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:12.951885 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-22909834-389a-47a2-80da-e24da94cc7be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:12.951885 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:10:12.951885 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:10:12.952345 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22909834-389a-47a2-80da-e24da94cc7be admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:12.959223 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-3851c3b6-dd77-4bc0-9ab9-14a99e3885cf None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:12.960504 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3851c3b6-dd77-4bc0-9ab9-14a99e3885cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:12.968986 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 771/1547] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:12.970476 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff41e2-0d8e-4c57-9df9-5bac3e3005a2 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:12.970768 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff41e2-0d8e-4c57-9df9-5bac3e3005a2 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:12.971047 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff41e2-0d8e-4c57-9df9-5bac3e3005a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:12.992274 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-e8ff41e2-0d8e-4c57-9df9-5bac3e3005a2 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:12.993478 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e8ff41e2-0d8e-4c57-9df9-5bac3e3005a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:13.001657 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 772/1548] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:13.002455 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff41e2-0d8e-4c57-9df9-5bac3e3005a2 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:13.011922 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff41e2-0d8e-4c57-9df9-5bac3e3005a2 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:13.017099 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87d2a3-0c3e-4729-91ee-94ea060a6c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:13.018005 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87d2a3-0c3e-4729-91ee-94ea060a6c25 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:13.018292 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87d2a3-0c3e-4729-91ee-94ea060a6c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:13.018566 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87d2a3-0c3e-4729-91ee-94ea060a6c25 admin admin] PATH_INFO: `/v3/projects/1d316cd4e4d043ba9da2707b8006acd4/users/09f28e171049411c847508fe7521b56b/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:13.033291 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87d2a3-0c3e-4729-91ee-94ea060a6c25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d316cd4e4d043ba9da2707b8006acd4, user_id=09f28e171049411c847508fe7521b56b, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:13.037830 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-6d87d2a3-0c3e-4729-91ee-94ea060a6c25 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:13.037830 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:10:13.037830 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:10:13.037830 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87d2a3-0c3e-4729-91ee-94ea060a6c25 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:13.122283 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 777/1549] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:12 2022] POST /identity/v3/users => generated 290 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:13.123666 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e844855-cbe9-477e-b774-c3ce46a192c2 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:13.123949 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e844855-cbe9-477e-b774-c3ce46a192c2 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:13.124226 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e844855-cbe9-477e-b774-c3ce46a192c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:13.142402 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-2e844855-cbe9-477e-b774-c3ce46a192c2 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:13.143611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2e844855-cbe9-477e-b774-c3ce46a192c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:13.151440 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 778/1550] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:13.152623 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650a27e-860f-479d-b4b6-b72ae497e147 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:13.152907 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650a27e-860f-479d-b4b6-b72ae497e147 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:13.153182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650a27e-860f-479d-b4b6-b72ae497e147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:13.171271 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-b650a27e-860f-479d-b4b6-b72ae497e147 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:13.172453 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b650a27e-860f-479d-b4b6-b72ae497e147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:13.180321 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 779/1551] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:13.181146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650a27e-860f-479d-b4b6-b72ae497e147 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:13.190213 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650a27e-860f-479d-b4b6-b72ae497e147 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:13.194890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03abc2e-8a9e-49c3-a0e5-ad9eb6afefe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:13.195510 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03abc2e-8a9e-49c3-a0e5-ad9eb6afefe3 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:13.195791 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03abc2e-8a9e-49c3-a0e5-ad9eb6afefe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:13.196067 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03abc2e-8a9e-49c3-a0e5-ad9eb6afefe3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:13.196769 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03abc2e-8a9e-49c3-a0e5-ad9eb6afefe3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:10:13.197081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03abc2e-8a9e-49c3-a0e5-ad9eb6afefe3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:13.198722 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03abc2e-8a9e-49c3-a0e5-ad9eb6afefe3 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:13.209872 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 773/1552] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:13 2022] PUT /identity/v3/projects/1d316cd4e4d043ba9da2707b8006acd4/users/09f28e171049411c847508fe7521b56b/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:13.210623 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 780/1553] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:10:13.210935 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec173ad-bbfe-4061-a134-3dbdba13da48 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:13.211222 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec173ad-bbfe-4061-a134-3dbdba13da48 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:13.211500 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec173ad-bbfe-4061-a134-3dbdba13da48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:13.211832 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49833636-c22d-4dcc-9465-b3ef428f8700 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:13.212119 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49833636-c22d-4dcc-9465-b3ef428f8700 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:13.212397 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49833636-c22d-4dcc-9465-b3ef428f8700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:13.229441 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-2ec173ad-bbfe-4061-a134-3dbdba13da48 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:13.232486 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2ec173ad-bbfe-4061-a134-3dbdba13da48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:13.236621 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-49833636-c22d-4dcc-9465-b3ef428f8700 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:13.237843 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-49833636-c22d-4dcc-9465-b3ef428f8700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:13.292776 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 774/1554] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:13.294220 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32f856-5d71-4a4f-8971-f8aaf98071af None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:13.294549 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32f856-5d71-4a4f-8971-f8aaf98071af None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:13.294791 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32f856-5d71-4a4f-8971-f8aaf98071af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:13.300053 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 781/1555] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:13.300053 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49833636-c22d-4dcc-9465-b3ef428f8700 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:13.312902 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49833636-c22d-4dcc-9465-b3ef428f8700 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:13.314508 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-2f32f856-5d71-4a4f-8971-f8aaf98071af None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:13.315720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2f32f856-5d71-4a4f-8971-f8aaf98071af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:13.318145 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee6719-8cbe-4f7b-80c1-4737cc8074f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:13.318859 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee6719-8cbe-4f7b-80c1-4737cc8074f1 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:13.319141 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee6719-8cbe-4f7b-80c1-4737cc8074f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:13.319417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee6719-8cbe-4f7b-80c1-4737cc8074f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:13.320137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ee6719-8cbe-4f7b-80c1-4737cc8074f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:13.321746 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ee6719-8cbe-4f7b-80c1-4737cc8074f1 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:13.327100 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 775/1556] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:13.327100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a985f57-45f6-4a8d-a0a5-a5be2d93ba91 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:13.327100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a985f57-45f6-4a8d-a0a5-a5be2d93ba91 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:13.327100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a985f57-45f6-4a8d-a0a5-a5be2d93ba91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:13.333512 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 782/1557] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:13.334609 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee6719-8cbe-4f7b-80c1-4737cc8074f1 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:13.344131 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-0a985f57-45f6-4a8d-a0a5-a5be2d93ba91 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:13.349789 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee6719-8cbe-4f7b-80c1-4737cc8074f1 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:13.349913 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0a985f57-45f6-4a8d-a0a5-a5be2d93ba91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:13.349989 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b5387-b846-4daf-bb0b-1c3a38041279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:13.349989 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b5387-b846-4daf-bb0b-1c3a38041279 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:13.350135 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b5387-b846-4daf-bb0b-1c3a38041279 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:13.350298 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b5387-b846-4daf-bb0b-1c3a38041279 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:13.350997 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b5387-b846-4daf-bb0b-1c3a38041279 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:10:13.351356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b5387-b846-4daf-bb0b-1c3a38041279 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:13.352952 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b5387-b846-4daf-bb0b-1c3a38041279 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:13.357052 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 776/1558] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:13.357052 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a985f57-45f6-4a8d-a0a5-a5be2d93ba91 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:13.372309 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 783/1559] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:10:13.372523 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a985f57-45f6-4a8d-a0a5-a5be2d93ba91 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:13.372658 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c707b-100b-40d5-a8e4-88cfffa86ee8 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:13.372658 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c707b-100b-40d5-a8e4-88cfffa86ee8 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:13.372658 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c707b-100b-40d5-a8e4-88cfffa86ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:13.372857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5d759-27f4-4a34-b40b-bb462bc6407b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:13.372857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5d759-27f4-4a34-b40b-bb462bc6407b admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:13.372857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5d759-27f4-4a34-b40b-bb462bc6407b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:13.372857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5d759-27f4-4a34-b40b-bb462bc6407b admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:13.373098 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b5d759-27f4-4a34-b40b-bb462bc6407b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:13.375470 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b5d759-27f4-4a34-b40b-bb462bc6407b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:13.392676 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-cb2c707b-100b-40d5-a8e4-88cfffa86ee8 None None] MFA Rules not processed for user `09f28e171049411c847508fe7521b56b`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:13.393923 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-cb2c707b-100b-40d5-a8e4-88cfffa86ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:13.455620 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 784/1560] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:13.456550 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 777/1561] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:13 2022] POST /identity/v3/projects => generated 391 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:13.457190 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f9cee-b9a8-4e49-a644-896cf3739624 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:13.457382 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5d759-27f4-4a34-b40b-bb462bc6407b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:13.457482 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f9cee-b9a8-4e49-a644-896cf3739624 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:13.457735 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f9cee-b9a8-4e49-a644-896cf3739624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:13.489256 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-805f9cee-b9a8-4e49-a644-896cf3739624 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:13.489256 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-805f9cee-b9a8-4e49-a644-896cf3739624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:13.526008 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5d759-27f4-4a34-b40b-bb462bc6407b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:13.531405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f79065-dd05-41e7-be4b-59d72ff7f293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:13.532075 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f79065-dd05-41e7-be4b-59d72ff7f293 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:13.532357 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f79065-dd05-41e7-be4b-59d72ff7f293 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:13.532785 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f79065-dd05-41e7-be4b-59d72ff7f293 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:13.533515 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f79065-dd05-41e7-be4b-59d72ff7f293 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:10:13.533854 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f79065-dd05-41e7-be4b-59d72ff7f293 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:13.535481 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f79065-dd05-41e7-be4b-59d72ff7f293 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:13.543422 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 785/1562] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:13.544303 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f9cee-b9a8-4e49-a644-896cf3739624 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:13.554649 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 778/1563] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:10:13.554649 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f79065-dd05-41e7-be4b-59d72ff7f293 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:13.555094 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f9cee-b9a8-4e49-a644-896cf3739624 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:13.560114 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67e758-f597-4165-9b8a-3d14354c535a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:13.560802 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67e758-f597-4165-9b8a-3d14354c535a admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:13.561087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67e758-f597-4165-9b8a-3d14354c535a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:13.561360 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67e758-f597-4165-9b8a-3d14354c535a admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:13.562119 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67e758-f597-4165-9b8a-3d14354c535a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:10:13.569183 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67e758-f597-4165-9b8a-3d14354c535a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:13.569386 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f79065-dd05-41e7-be4b-59d72ff7f293 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:13.569488 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67e758-f597-4165-9b8a-3d14354c535a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:13.569573 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9f81f-614b-46e2-9faf-8c00572c346e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:13.569573 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9f81f-614b-46e2-9faf-8c00572c346e admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:13.569573 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9f81f-614b-46e2-9faf-8c00572c346e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:13.569573 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9f81f-614b-46e2-9faf-8c00572c346e admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:13.569911 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e9f81f-614b-46e2-9faf-8c00572c346e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:13.571316 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e9f81f-614b-46e2-9faf-8c00572c346e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:13.575740 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 786/1564] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:10:13.576603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67e758-f597-4165-9b8a-3d14354c535a admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:13.581922 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 779/1565] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:13.582969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9f81f-614b-46e2-9faf-8c00572c346e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:13.586849 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67e758-f597-4165-9b8a-3d14354c535a admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:13.591768 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6cefa8-433c-44db-9f3c-9a688c88f845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:13.592933 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cefa8-433c-44db-9f3c-9a688c88f845 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:13.593039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9f81f-614b-46e2-9faf-8c00572c346e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:13.593223 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cefa8-433c-44db-9f3c-9a688c88f845 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:13.593525 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cefa8-433c-44db-9f3c-9a688c88f845 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:13.594400 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6cefa8-433c-44db-9f3c-9a688c88f845 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:10:13.597935 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6cefa8-433c-44db-9f3c-9a688c88f845 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:13.597935 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6cefa8-433c-44db-9f3c-9a688c88f845 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:13.598106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c9398-95dc-4a17-a1f8-25d19deb63d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:13.598188 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c9398-95dc-4a17-a1f8-25d19deb63d7 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:13.598455 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c9398-95dc-4a17-a1f8-25d19deb63d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:13.598737 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c9398-95dc-4a17-a1f8-25d19deb63d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:13.599422 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c9398-95dc-4a17-a1f8-25d19deb63d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:13.601322 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c9398-95dc-4a17-a1f8-25d19deb63d7 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:13.608959 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 787/1566] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:10:13.610588 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6cefa8-433c-44db-9f3c-9a688c88f845 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:13.626141 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6cefa8-433c-44db-9f3c-9a688c88f845 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:13.630980 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac0ba7-8c35-4d83-876d-fb7a68472699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:13.631627 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac0ba7-8c35-4d83-876d-fb7a68472699 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:13.633745 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac0ba7-8c35-4d83-876d-fb7a68472699 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:13.633745 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac0ba7-8c35-4d83-876d-fb7a68472699 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:13.633745 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac0ba7-8c35-4d83-876d-fb7a68472699 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:13.634918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac0ba7-8c35-4d83-876d-fb7a68472699 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:13.694341 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 780/1567] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:13 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:13.694341 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c9398-95dc-4a17-a1f8-25d19deb63d7 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:13.733983 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 788/1568] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:13 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:13.733983 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac0ba7-8c35-4d83-876d-fb7a68472699 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:13.767765 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c9398-95dc-4a17-a1f8-25d19deb63d7 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:13.800182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac0ba7-8c35-4d83-876d-fb7a68472699 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:13.805616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acae12f-4be4-41bc-9ae7-4bd348706423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:13.806305 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acae12f-4be4-41bc-9ae7-4bd348706423 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:13.806583 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acae12f-4be4-41bc-9ae7-4bd348706423 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:13.806855 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acae12f-4be4-41bc-9ae7-4bd348706423 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:13.807570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acae12f-4be4-41bc-9ae7-4bd348706423 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:10:13.807875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acae12f-4be4-41bc-9ae7-4bd348706423 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:13.809480 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acae12f-4be4-41bc-9ae7-4bd348706423 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:13.820887 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 789/1569] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:10:13.821653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acae12f-4be4-41bc-9ae7-4bd348706423 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:13.829494 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51691506-9fe7-4706-a9c1-f02e0a056c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:13.830206 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51691506-9fe7-4706-a9c1-f02e0a056c6d admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:13.830492 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51691506-9fe7-4706-a9c1-f02e0a056c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:13.830771 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51691506-9fe7-4706-a9c1-f02e0a056c6d admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:13.831463 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51691506-9fe7-4706-a9c1-f02e0a056c6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:13.832106 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acae12f-4be4-41bc-9ae7-4bd348706423 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:13.833410 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51691506-9fe7-4706-a9c1-f02e0a056c6d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:13.836705 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d96e5b-2be9-443d-ba86-82a62effba91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:13.837370 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d96e5b-2be9-443d-ba86-82a62effba91 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:13.837652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d96e5b-2be9-443d-ba86-82a62effba91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:13.837958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d96e5b-2be9-443d-ba86-82a62effba91 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:13.838633 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d96e5b-2be9-443d-ba86-82a62effba91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:13.840716 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d96e5b-2be9-443d-ba86-82a62effba91 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:13.923495 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 781/1570] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:13 2022] POST /identity/v3/users => generated 296 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:13.924391 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51691506-9fe7-4706-a9c1-f02e0a056c6d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:13.930742 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 790/1571] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:13 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:13.931554 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d96e5b-2be9-443d-ba86-82a62effba91 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:13.934075 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51691506-9fe7-4706-a9c1-f02e0a056c6d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:13.989499 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f2292-e747-4cf4-96ab-520dc81dda01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:13.990202 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f2292-e747-4cf4-96ab-520dc81dda01 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:13.990495 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f2292-e747-4cf4-96ab-520dc81dda01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:13.990760 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f2292-e747-4cf4-96ab-520dc81dda01 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:13.991560 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f2292-e747-4cf4-96ab-520dc81dda01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:13.993497 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f2292-e747-4cf4-96ab-520dc81dda01 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:13.993607 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d96e5b-2be9-443d-ba86-82a62effba91 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:13.998198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e449974-9a56-4b12-a38a-6416513ec142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:13.999074 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e449974-9a56-4b12-a38a-6416513ec142 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:13.999356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e449974-9a56-4b12-a38a-6416513ec142 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:13.999614 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e449974-9a56-4b12-a38a-6416513ec142 admin admin] PATH_INFO: `/v3/projects/48505b349722444abdc832bcb0090b28/users/5125db469f7b4fb2a8b22c01097695a1/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:14.013652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e449974-9a56-4b12-a38a-6416513ec142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48505b349722444abdc832bcb0090b28, user_id=5125db469f7b4fb2a8b22c01097695a1, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:14.016965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e449974-9a56-4b12-a38a-6416513ec142 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:14.090937 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 782/1572] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:13 2022] POST /identity/v3/projects => generated 383 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:14.091706 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f2292-e747-4cf4-96ab-520dc81dda01 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:14.124051 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 791/1573] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:13 2022] PUT /identity/v3/projects/48505b349722444abdc832bcb0090b28/users/5125db469f7b4fb2a8b22c01097695a1/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:14.124864 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e449974-9a56-4b12-a38a-6416513ec142 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:14.153459 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f2292-e747-4cf4-96ab-520dc81dda01 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:14.193685 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e449974-9a56-4b12-a38a-6416513ec142 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:14.198405 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8845a-24e9-472d-bcae-a4dbd4ddd35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:14.199072 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8845a-24e9-472d-bcae-a4dbd4ddd35e admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:14.199356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8845a-24e9-472d-bcae-a4dbd4ddd35e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:14.199635 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8845a-24e9-472d-bcae-a4dbd4ddd35e admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:14.200321 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef8845a-24e9-472d-bcae-a4dbd4ddd35e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:14.202885 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef8845a-24e9-472d-bcae-a4dbd4ddd35e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:14.208757 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5e4d9-4a3c-4cdb-a4a6-3e3ce4e32f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:14.209423 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5e4d9-4a3c-4cdb-a4a6-3e3ce4e32f7c admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:14.209729 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5e4d9-4a3c-4cdb-a4a6-3e3ce4e32f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:14.210044 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5e4d9-4a3c-4cdb-a4a6-3e3ce4e32f7c admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:14.210723 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed5e4d9-4a3c-4cdb-a4a6-3e3ce4e32f7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:14.212640 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed5e4d9-4a3c-4cdb-a4a6-3e3ce4e32f7c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:14.301272 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 792/1574] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:14 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:14.302352 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8845a-24e9-472d-bcae-a4dbd4ddd35e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:14.312062 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8845a-24e9-472d-bcae-a4dbd4ddd35e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:14.316818 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f905485-eda9-4109-a8d9-ccfe57297240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:14.317445 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f905485-eda9-4109-a8d9-ccfe57297240 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:14.317730 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f905485-eda9-4109-a8d9-ccfe57297240 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:14.318042 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f905485-eda9-4109-a8d9-ccfe57297240 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:14.318708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f905485-eda9-4109-a8d9-ccfe57297240 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:14.320620 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f905485-eda9-4109-a8d9-ccfe57297240 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:14.331676 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 783/1575] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:14 2022] POST /identity/v3/projects => generated 403 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:14.332749 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5e4d9-4a3c-4cdb-a4a6-3e3ce4e32f7c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:14.391897 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5e4d9-4a3c-4cdb-a4a6-3e3ce4e32f7c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:14.395788 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 793/1576] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:14 2022] POST /identity/v3/users => generated 298 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:14.395788 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f905485-eda9-4109-a8d9-ccfe57297240 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:14.396741 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6e129-52ba-4639-bfb1-acef6d78888d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:14.397393 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6e129-52ba-4639-bfb1-acef6d78888d admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:14.397674 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6e129-52ba-4639-bfb1-acef6d78888d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:14.397975 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6e129-52ba-4639-bfb1-acef6d78888d admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:14.398689 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a6e129-52ba-4639-bfb1-acef6d78888d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:14.400597 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a6e129-52ba-4639-bfb1-acef6d78888d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:14.403359 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f905485-eda9-4109-a8d9-ccfe57297240 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:14.407931 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f4bd1f-f137-4c65-9aa4-9e5473b38156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:14.408579 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4bd1f-f137-4c65-9aa4-9e5473b38156 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:14.408860 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4bd1f-f137-4c65-9aa4-9e5473b38156 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:14.409139 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4bd1f-f137-4c65-9aa4-9e5473b38156 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:14.409890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f4bd1f-f137-4c65-9aa4-9e5473b38156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:14.411492 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f4bd1f-f137-4c65-9aa4-9e5473b38156 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:14.422840 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 794/1577] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:14.425116 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f4bd1f-f137-4c65-9aa4-9e5473b38156 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:14.432752 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f4bd1f-f137-4c65-9aa4-9e5473b38156 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:14.437827 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8e8d7-0e47-4fff-acfb-350a41b318bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:14.438443 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8e8d7-0e47-4fff-acfb-350a41b318bd admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:14.438725 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8e8d7-0e47-4fff-acfb-350a41b318bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:14.439004 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8e8d7-0e47-4fff-acfb-350a41b318bd admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:14.439669 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d8e8d7-0e47-4fff-acfb-350a41b318bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:14.441833 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d8e8d7-0e47-4fff-acfb-350a41b318bd admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:14.473827 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 784/1578] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:14 2022] POST /identity/v3/projects => generated 369 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:14.474647 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6e129-52ba-4639-bfb1-acef6d78888d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:14.533271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6e129-52ba-4639-bfb1-acef6d78888d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:14.537874 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efad6a-997d-4cff-a6c2-67b05473b36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:14.538536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efad6a-997d-4cff-a6c2-67b05473b36f admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:14.538855 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efad6a-997d-4cff-a6c2-67b05473b36f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:14.539141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efad6a-997d-4cff-a6c2-67b05473b36f admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:14.539821 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4efad6a-997d-4cff-a6c2-67b05473b36f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:14.541280 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 795/1579] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:14 2022] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:14.541823 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4efad6a-997d-4cff-a6c2-67b05473b36f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:14.542603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c454c86-8a1a-4ff0-88b5-986f64afe5cb None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:14.542905 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c454c86-8a1a-4ff0-88b5-986f64afe5cb None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:14.543293 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c454c86-8a1a-4ff0-88b5-986f64afe5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:14.569595 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-7c454c86-8a1a-4ff0-88b5-986f64afe5cb None None] MFA Rules not processed for user `5125db469f7b4fb2a8b22c01097695a1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:14.570857 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7c454c86-8a1a-4ff0-88b5-986f64afe5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:14.609749 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 785/1580] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:14 2022] POST /identity/v3/users => generated 292 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:14.610672 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efad6a-997d-4cff-a6c2-67b05473b36f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:14.620172 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efad6a-997d-4cff-a6c2-67b05473b36f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:14.625732 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23acdd1b-f8da-400d-b22d-d6cdfd90220a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:14.626582 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23acdd1b-f8da-400d-b22d-d6cdfd90220a admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:14.626864 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23acdd1b-f8da-400d-b22d-d6cdfd90220a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:14.627134 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23acdd1b-f8da-400d-b22d-d6cdfd90220a admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:14.627846 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23acdd1b-f8da-400d-b22d-d6cdfd90220a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:14.629504 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23acdd1b-f8da-400d-b22d-d6cdfd90220a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:14.633518 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 796/1581] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:14.634367 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c454c86-8a1a-4ff0-88b5-986f64afe5cb None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:14.639923 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 786/1582] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:14.642756 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23acdd1b-f8da-400d-b22d-d6cdfd90220a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:14.645122 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c454c86-8a1a-4ff0-88b5-986f64afe5cb None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:14.649646 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78469d-4b25-4fae-8215-f7da58058151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:14.650039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23acdd1b-f8da-400d-b22d-d6cdfd90220a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:14.650328 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78469d-4b25-4fae-8215-f7da58058151 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:14.650612 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78469d-4b25-4fae-8215-f7da58058151 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:14.650885 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78469d-4b25-4fae-8215-f7da58058151 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:14.651565 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e78469d-4b25-4fae-8215-f7da58058151 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:14.653481 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e78469d-4b25-4fae-8215-f7da58058151 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:14.654925 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ea4ea-0524-44d2-a683-a02d67dbdea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:14.655570 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ea4ea-0524-44d2-a683-a02d67dbdea5 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:14.655857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ea4ea-0524-44d2-a683-a02d67dbdea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:14.656140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ea4ea-0524-44d2-a683-a02d67dbdea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:14.656848 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ea4ea-0524-44d2-a683-a02d67dbdea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:14.658516 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ea4ea-0524-44d2-a683-a02d67dbdea5 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:14.668897 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 787/1583] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:14.669783 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ea4ea-0524-44d2-a683-a02d67dbdea5 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:14.679828 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ea4ea-0524-44d2-a683-a02d67dbdea5 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:14.684622 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fe70f-310a-42f7-81f3-e9bd8c214f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:14.685266 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fe70f-310a-42f7-81f3-e9bd8c214f58 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:14.685552 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fe70f-310a-42f7-81f3-e9bd8c214f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:14.686462 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fe70f-310a-42f7-81f3-e9bd8c214f58 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:14.690475 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892fe70f-310a-42f7-81f3-e9bd8c214f58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:14.690475 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892fe70f-310a-42f7-81f3-e9bd8c214f58 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:14.698685 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 788/1584] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:14.699459 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fe70f-310a-42f7-81f3-e9bd8c214f58 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:14.709925 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 797/1585] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:14 2022] POST /identity/v3/users => generated 302 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:14.709925 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78469d-4b25-4fae-8215-f7da58058151 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:14.710153 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fe70f-310a-42f7-81f3-e9bd8c214f58 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:14.713442 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207fba2-9f4e-4e9e-abfe-22d1af54649d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:14.714064 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207fba2-9f4e-4e9e-abfe-22d1af54649d admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:14.714349 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207fba2-9f4e-4e9e-abfe-22d1af54649d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:14.714628 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207fba2-9f4e-4e9e-abfe-22d1af54649d admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:14.715308 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5207fba2-9f4e-4e9e-abfe-22d1af54649d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:14.717286 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5207fba2-9f4e-4e9e-abfe-22d1af54649d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:14.717417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78469d-4b25-4fae-8215-f7da58058151 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:14.722146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4aad36-ab59-4998-befb-09522399c68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:14.722829 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4aad36-ab59-4998-befb-09522399c68b admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:14.729238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4aad36-ab59-4998-befb-09522399c68b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:14.729238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4aad36-ab59-4998-befb-09522399c68b admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:14.729238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4aad36-ab59-4998-befb-09522399c68b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:14.729238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4aad36-ab59-4998-befb-09522399c68b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:14.736243 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 798/1586] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:14.737202 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4aad36-ab59-4998-befb-09522399c68b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:14.746299 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4aad36-ab59-4998-befb-09522399c68b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:14.751583 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2522e5-8d7c-4bcd-ab79-b5e20244da2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:14.752184 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2522e5-8d7c-4bcd-ab79-b5e20244da2a admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:14.752466 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2522e5-8d7c-4bcd-ab79-b5e20244da2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:14.752742 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2522e5-8d7c-4bcd-ab79-b5e20244da2a admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:14.753430 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2522e5-8d7c-4bcd-ab79-b5e20244da2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:14.754998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2522e5-8d7c-4bcd-ab79-b5e20244da2a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:14.764723 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 799/1587] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:14.765599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2522e5-8d7c-4bcd-ab79-b5e20244da2a admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:14.774595 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2522e5-8d7c-4bcd-ab79-b5e20244da2a admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:14.779212 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189997c-086f-498f-89c8-0aacd7dec99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:14.779809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189997c-086f-498f-89c8-0aacd7dec99c admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:14.780091 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189997c-086f-498f-89c8-0aacd7dec99c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:14.780369 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189997c-086f-498f-89c8-0aacd7dec99c admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:14.783087 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 789/1588] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:14 2022] POST /identity/v3/users => generated 285 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:14.790457 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189997c-086f-498f-89c8-0aacd7dec99c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:14.790565 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207fba2-9f4e-4e9e-abfe-22d1af54649d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:14.790647 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189997c-086f-498f-89c8-0aacd7dec99c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:14.791847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207fba2-9f4e-4e9e-abfe-22d1af54649d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:14.797174 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b5dd9-d0c5-4b85-a141-2b8c3181f6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:14.797992 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b5dd9-d0c5-4b85-a141-2b8c3181f6b7 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:14.798269 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b5dd9-d0c5-4b85-a141-2b8c3181f6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:14.798539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b5dd9-d0c5-4b85-a141-2b8c3181f6b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:14.799288 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b5dd9-d0c5-4b85-a141-2b8c3181f6b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:14.800973 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b5dd9-d0c5-4b85-a141-2b8c3181f6b7 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:14.811926 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 790/1589] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:14.812665 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b5dd9-d0c5-4b85-a141-2b8c3181f6b7 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:14.821977 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b5dd9-d0c5-4b85-a141-2b8c3181f6b7 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:14.826580 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc66e00-be48-4e95-a8f5-64e2c577cd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:14.827394 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc66e00-be48-4e95-a8f5-64e2c577cd04 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:14.827669 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc66e00-be48-4e95-a8f5-64e2c577cd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:14.827937 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc66e00-be48-4e95-a8f5-64e2c577cd04 admin admin] PATH_INFO: `/v3/projects/6aaea47ee855426a962e821881dc45e5/users/bede9e5d50f1451dabab5e15963e0492/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:14.841590 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc66e00-be48-4e95-a8f5-64e2c577cd04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aaea47ee855426a962e821881dc45e5, user_id=bede9e5d50f1451dabab5e15963e0492, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:14.844783 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc66e00-be48-4e95-a8f5-64e2c577cd04 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:14.861680 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 800/1590] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:14 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:14.862652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189997c-086f-498f-89c8-0aacd7dec99c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:14.921375 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189997c-086f-498f-89c8-0aacd7dec99c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:14.925800 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95fd55-8da1-46db-8169-d77595dd3a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:14.926741 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95fd55-8da1-46db-8169-d77595dd3a3a admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:14.927040 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95fd55-8da1-46db-8169-d77595dd3a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:14.927315 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95fd55-8da1-46db-8169-d77595dd3a3a admin admin] PATH_INFO: `/v3/projects/b7ac8da43c5f4ed6bb286257f10d23e9/users/606783f43d2d408d870ffa9116c502eb/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:14.940694 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 791/1591] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:14 2022] PUT /identity/v3/projects/6aaea47ee855426a962e821881dc45e5/users/bede9e5d50f1451dabab5e15963e0492/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:14.940968 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab95fd55-8da1-46db-8169-d77595dd3a3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7ac8da43c5f4ed6bb286257f10d23e9, user_id=606783f43d2d408d870ffa9116c502eb, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:14.943965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab95fd55-8da1-46db-8169-d77595dd3a3a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:14.944661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc66e00-be48-4e95-a8f5-64e2c577cd04 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:15.003980 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc66e00-be48-4e95-a8f5-64e2c577cd04 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:15.008536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690bdb95-e4f6-465e-9ac7-d833be12b98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:15.009194 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690bdb95-e4f6-465e-9ac7-d833be12b98d admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:15.009480 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690bdb95-e4f6-465e-9ac7-d833be12b98d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:15.009766 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690bdb95-e4f6-465e-9ac7-d833be12b98d admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:15.010500 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690bdb95-e4f6-465e-9ac7-d833be12b98d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:15.012103 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690bdb95-e4f6-465e-9ac7-d833be12b98d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:15.020981 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 801/1592] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:14 2022] PUT /identity/v3/projects/b7ac8da43c5f4ed6bb286257f10d23e9/users/606783f43d2d408d870ffa9116c502eb/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:15.024509 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95fd55-8da1-46db-8169-d77595dd3a3a admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:15.024666 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 792/1593] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:15.024666 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690bdb95-e4f6-465e-9ac7-d833be12b98d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:15.038488 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690bdb95-e4f6-465e-9ac7-d833be12b98d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:15.087742 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95fd55-8da1-46db-8169-d77595dd3a3a admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:15.092788 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5a1bb-b15e-4a9b-af12-be4a6dfa9236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:15.093439 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5a1bb-b15e-4a9b-af12-be4a6dfa9236 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:15.093570 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03709ef0-bf4b-4964-b7e7-a3b874b75404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:15.093720 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5a1bb-b15e-4a9b-af12-be4a6dfa9236 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:15.094023 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5a1bb-b15e-4a9b-af12-be4a6dfa9236 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:15.094267 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03709ef0-bf4b-4964-b7e7-a3b874b75404 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:15.094550 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03709ef0-bf4b-4964-b7e7-a3b874b75404 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:15.094735 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5a1bb-b15e-4a9b-af12-be4a6dfa9236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:15.094826 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03709ef0-bf4b-4964-b7e7-a3b874b75404 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:15.095522 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03709ef0-bf4b-4964-b7e7-a3b874b75404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:15.096319 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5a1bb-b15e-4a9b-af12-be4a6dfa9236 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:15.097108 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03709ef0-bf4b-4964-b7e7-a3b874b75404 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:15.105855 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 802/1594] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:15.106638 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5a1bb-b15e-4a9b-af12-be4a6dfa9236 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:15.107500 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 793/1595] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:15.108828 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03709ef0-bf4b-4964-b7e7-a3b874b75404 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:15.118281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5a1bb-b15e-4a9b-af12-be4a6dfa9236 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:15.118592 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03709ef0-bf4b-4964-b7e7-a3b874b75404 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:15.122790 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ddb34-0ed6-489b-8160-163476d461c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:15.123021 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e34d9-767d-4c80-9cee-308e243fe604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:15.123450 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ddb34-0ed6-489b-8160-163476d461c2 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:15.123729 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ddb34-0ed6-489b-8160-163476d461c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:15.123923 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e34d9-767d-4c80-9cee-308e243fe604 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:15.124015 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ddb34-0ed6-489b-8160-163476d461c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:15.124202 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e34d9-767d-4c80-9cee-308e243fe604 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:15.124473 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e34d9-767d-4c80-9cee-308e243fe604 admin admin] PATH_INFO: `/v3/projects/ecf0c72e1a9c4fe0a5c05d92f2e8b2da/users/594762664aef4802bc81a9df93274a9d/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:15.124693 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ddb34-0ed6-489b-8160-163476d461c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:15.126310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ddb34-0ed6-489b-8160-163476d461c2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:15.135897 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 803/1596] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:15.136773 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ddb34-0ed6-489b-8160-163476d461c2 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:15.140160 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1e34d9-767d-4c80-9cee-308e243fe604 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecf0c72e1a9c4fe0a5c05d92f2e8b2da, user_id=594762664aef4802bc81a9df93274a9d, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:15.142924 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1e34d9-767d-4c80-9cee-308e243fe604 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:15.146090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ddb34-0ed6-489b-8160-163476d461c2 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:15.150739 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19179e02-aa31-4287-b12e-f25f13cbe876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:15.151373 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19179e02-aa31-4287-b12e-f25f13cbe876 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:15.151657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19179e02-aa31-4287-b12e-f25f13cbe876 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:15.151931 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19179e02-aa31-4287-b12e-f25f13cbe876 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:15.152602 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19179e02-aa31-4287-b12e-f25f13cbe876 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:15.155042 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19179e02-aa31-4287-b12e-f25f13cbe876 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:15.237770 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 794/1597] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:15 2022] PUT /identity/v3/projects/ecf0c72e1a9c4fe0a5c05d92f2e8b2da/users/594762664aef4802bc81a9df93274a9d/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:15.238677 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e34d9-767d-4c80-9cee-308e243fe604 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:15.261026 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 804/1598] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:15 2022] POST /identity/v3/users => generated 294 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:15.261895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19179e02-aa31-4287-b12e-f25f13cbe876 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:15.273636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19179e02-aa31-4287-b12e-f25f13cbe876 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:15.300077 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e34d9-767d-4c80-9cee-308e243fe604 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:15.304717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8acbac3-7ce4-4b1b-bca9-68cef1cc4faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:15.305387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acbac3-7ce4-4b1b-bca9-68cef1cc4faf admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:15.305675 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acbac3-7ce4-4b1b-bca9-68cef1cc4faf admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:15.308289 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acbac3-7ce4-4b1b-bca9-68cef1cc4faf admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:15.308289 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8acbac3-7ce4-4b1b-bca9-68cef1cc4faf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:15.308289 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8acbac3-7ce4-4b1b-bca9-68cef1cc4faf admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:15.318411 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 795/1599] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:15.319877 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17115c-e9c9-48ef-a312-351da8d02325 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:15.320165 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17115c-e9c9-48ef-a312-351da8d02325 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:15.320449 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17115c-e9c9-48ef-a312-351da8d02325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:15.329474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd292d-266a-4d42-9c9d-3b25b5fc298b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:15.330193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd292d-266a-4d42-9c9d-3b25b5fc298b admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:15.330479 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd292d-266a-4d42-9c9d-3b25b5fc298b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:15.330756 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd292d-266a-4d42-9c9d-3b25b5fc298b admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:15.331502 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd292d-266a-4d42-9c9d-3b25b5fc298b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:15.333170 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd292d-266a-4d42-9c9d-3b25b5fc298b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:15.343411 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 805/1600] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:15.344193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd292d-266a-4d42-9c9d-3b25b5fc298b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:15.347986 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-4d17115c-e9c9-48ef-a312-351da8d02325 None None] MFA Rules not processed for user `606783f43d2d408d870ffa9116c502eb`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:15.349209 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4d17115c-e9c9-48ef-a312-351da8d02325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:15.353584 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd292d-266a-4d42-9c9d-3b25b5fc298b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:15.358519 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f8633-1270-4df8-a6f1-d927356b656a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:15.359387 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f8633-1270-4df8-a6f1-d927356b656a admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:15.359951 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f8633-1270-4df8-a6f1-d927356b656a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:15.359951 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f8633-1270-4df8-a6f1-d927356b656a admin admin] PATH_INFO: `/v3/projects/11caae4491db49e59e9ba5ece121e1ae/users/6a7e0770efcf4733a2770a9f0439ad50/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:15.374507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f8633-1270-4df8-a6f1-d927356b656a admin admin] RBAC: Authorizing `identity:create_grant(project_id=11caae4491db49e59e9ba5ece121e1ae, user_id=6a7e0770efcf4733a2770a9f0439ad50, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:15.377152 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f8633-1270-4df8-a6f1-d927356b656a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:15.414046 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 796/1601] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:15.414939 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17115c-e9c9-48ef-a312-351da8d02325 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:15.424927 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17115c-e9c9-48ef-a312-351da8d02325 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:15.431197 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 806/1602] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:15 2022] PUT /identity/v3/projects/11caae4491db49e59e9ba5ece121e1ae/users/6a7e0770efcf4733a2770a9f0439ad50/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:15.436249 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f8633-1270-4df8-a6f1-d927356b656a admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:15.482093 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78850abb-d528-4b1a-904a-f23c57e7359f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:15.482994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78850abb-d528-4b1a-904a-f23c57e7359f admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:15.483278 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78850abb-d528-4b1a-904a-f23c57e7359f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:15.483580 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78850abb-d528-4b1a-904a-f23c57e7359f admin admin] PATH_INFO: `/v3/projects/609b6e89fbbe40388f92ad00268eebdb/users/6996dc31623e433db17e2f0587a32a6d/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:15.498099 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78850abb-d528-4b1a-904a-f23c57e7359f admin admin] RBAC: Authorizing `identity:create_grant(project_id=609b6e89fbbe40388f92ad00268eebdb, user_id=6996dc31623e433db17e2f0587a32a6d, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:15.500876 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78850abb-d528-4b1a-904a-f23c57e7359f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:15.501126 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f8633-1270-4df8-a6f1-d927356b656a admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:15.505852 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aca1b8-1224-4088-bda4-73f097e05319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:15.506520 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aca1b8-1224-4088-bda4-73f097e05319 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:15.506791 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aca1b8-1224-4088-bda4-73f097e05319 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:15.507068 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aca1b8-1224-4088-bda4-73f097e05319 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:15.507785 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aca1b8-1224-4088-bda4-73f097e05319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:15.509378 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aca1b8-1224-4088-bda4-73f097e05319 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:15.519677 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 807/1603] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:15.520899 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15a447-2468-492b-ac64-1c861ef3a3cb None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:15.522785 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15a447-2468-492b-ac64-1c861ef3a3cb None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:15.522785 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15a447-2468-492b-ac64-1c861ef3a3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:15.547122 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-bb15a447-2468-492b-ac64-1c861ef3a3cb None None] MFA Rules not processed for user `594762664aef4802bc81a9df93274a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:15.548318 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-bb15a447-2468-492b-ac64-1c861ef3a3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:15.575438 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 797/1604] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:15 2022] PUT /identity/v3/projects/609b6e89fbbe40388f92ad00268eebdb/users/6996dc31623e433db17e2f0587a32a6d/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:15.579515 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78850abb-d528-4b1a-904a-f23c57e7359f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:15.612379 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 808/1605] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:15.619745 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15a447-2468-492b-ac64-1c861ef3a3cb None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:15.623821 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15a447-2468-492b-ac64-1c861ef3a3cb None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:15.636522 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78850abb-d528-4b1a-904a-f23c57e7359f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:15.641010 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc83270-595b-43a5-8f00-24831385e7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:15.641667 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc83270-595b-43a5-8f00-24831385e7b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:15.641976 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc83270-595b-43a5-8f00-24831385e7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:15.642251 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc83270-595b-43a5-8f00-24831385e7b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:15.643130 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc83270-595b-43a5-8f00-24831385e7b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:15.644722 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc83270-595b-43a5-8f00-24831385e7b8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:15.655026 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 798/1606] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:15.655621 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc83270-595b-43a5-8f00-24831385e7b8 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:15.664877 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc83270-595b-43a5-8f00-24831385e7b8 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:15.669545 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3023e3c-e325-4317-a8d3-81988e33271e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:15.671079 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3023e3c-e325-4317-a8d3-81988e33271e admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:15.671359 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3023e3c-e325-4317-a8d3-81988e33271e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:15.671637 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3023e3c-e325-4317-a8d3-81988e33271e admin admin] PATH_INFO: `/v3/projects/40b06682f7ad42eea575a158f9c4d75f/users/fe00c7f2ec9f4d2b847741a188e301db/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:15.680337 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8145866-7d90-462e-8b6b-6cedf56a8c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:15.681226 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8145866-7d90-462e-8b6b-6cedf56a8c7a admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:15.681509 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8145866-7d90-462e-8b6b-6cedf56a8c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:15.681843 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8145866-7d90-462e-8b6b-6cedf56a8c7a admin admin] PATH_INFO: `/v3/projects/6aaea47ee855426a962e821881dc45e5/users/bede9e5d50f1451dabab5e15963e0492/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:15.683823 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8145866-7d90-462e-8b6b-6cedf56a8c7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aaea47ee855426a962e821881dc45e5, user_id=bede9e5d50f1451dabab5e15963e0492, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:15.685679 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3023e3c-e325-4317-a8d3-81988e33271e admin admin] RBAC: Authorizing `identity:create_grant(project_id=40b06682f7ad42eea575a158f9c4d75f, user_id=fe00c7f2ec9f4d2b847741a188e301db, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:15.686581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8145866-7d90-462e-8b6b-6cedf56a8c7a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:15.688351 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3023e3c-e325-4317-a8d3-81988e33271e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:15.696914 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 809/1607] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:15 2022] PUT /identity/v3/projects/6aaea47ee855426a962e821881dc45e5/users/bede9e5d50f1451dabab5e15963e0492/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:15.697681 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8145866-7d90-462e-8b6b-6cedf56a8c7a admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:15.757142 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8145866-7d90-462e-8b6b-6cedf56a8c7a admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:15.761726 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b738ce13-a0a1-45b0-8afa-e0440c4c3c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:15.762405 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b738ce13-a0a1-45b0-8afa-e0440c4c3c3e admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:15.762688 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b738ce13-a0a1-45b0-8afa-e0440c4c3c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:15.762964 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b738ce13-a0a1-45b0-8afa-e0440c4c3c3e admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:15.763644 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b738ce13-a0a1-45b0-8afa-e0440c4c3c3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:15.765586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b738ce13-a0a1-45b0-8afa-e0440c4c3c3e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:15.769526 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 799/1608] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:15 2022] PUT /identity/v3/projects/40b06682f7ad42eea575a158f9c4d75f/users/fe00c7f2ec9f4d2b847741a188e301db/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:15.774749 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ad3a9-8e01-466d-94c3-a007b52247d0 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:15.774749 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ad3a9-8e01-466d-94c3-a007b52247d0 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:15.774749 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ad3a9-8e01-466d-94c3-a007b52247d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:15.798315 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-998ad3a9-8e01-466d-94c3-a007b52247d0 None None] MFA Rules not processed for user `6a7e0770efcf4733a2770a9f0439ad50`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:15.799514 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-998ad3a9-8e01-466d-94c3-a007b52247d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:15.850311 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 810/1609] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:15 2022] POST /identity/v3/projects => generated 393 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:15.851172 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b738ce13-a0a1-45b0-8afa-e0440c4c3c3e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:15.861914 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 800/1610] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:15.863505 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44983f1-d7ac-4cd8-8077-ac8dc5c9c1ed None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:15.863947 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44983f1-d7ac-4cd8-8077-ac8dc5c9c1ed None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:15.864407 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44983f1-d7ac-4cd8-8077-ac8dc5c9c1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:15.889659 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-b44983f1-d7ac-4cd8-8077-ac8dc5c9c1ed None None] MFA Rules not processed for user `6996dc31623e433db17e2f0587a32a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:15.890907 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b44983f1-d7ac-4cd8-8077-ac8dc5c9c1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:15.915936 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b738ce13-a0a1-45b0-8afa-e0440c4c3c3e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:15.921216 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74f828-c952-46b7-8144-deaf940bb562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:15.922157 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74f828-c952-46b7-8144-deaf940bb562 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:15.922444 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74f828-c952-46b7-8144-deaf940bb562 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:15.922722 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74f828-c952-46b7-8144-deaf940bb562 admin admin] PATH_INFO: `/v3/projects/54923026560f4b51aa283b9fc0fd4737/users/7a47e7dce36e4828a9755f8bb9105f22/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:15.936683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74f828-c952-46b7-8144-deaf940bb562 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54923026560f4b51aa283b9fc0fd4737, user_id=7a47e7dce36e4828a9755f8bb9105f22, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:15.939682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74f828-c952-46b7-8144-deaf940bb562 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:15.955812 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 801/1611] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:15.956797 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44983f1-d7ac-4cd8-8077-ac8dc5c9c1ed None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:15.967768 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44983f1-d7ac-4cd8-8077-ac8dc5c9c1ed None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:15.972265 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685cc69e-73fe-4a61-9455-ee9a4c542b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:15.972903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685cc69e-73fe-4a61-9455-ee9a4c542b79 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:15.973188 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685cc69e-73fe-4a61-9455-ee9a4c542b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:15.973464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685cc69e-73fe-4a61-9455-ee9a4c542b79 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:15.974181 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685cc69e-73fe-4a61-9455-ee9a4c542b79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:15.976090 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685cc69e-73fe-4a61-9455-ee9a4c542b79 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:16.048680 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 811/1612] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:15 2022] PUT /identity/v3/projects/54923026560f4b51aa283b9fc0fd4737/users/7a47e7dce36e4828a9755f8bb9105f22/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:16.049544 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74f828-c952-46b7-8144-deaf940bb562 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:16.074644 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 802/1613] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:15 2022] POST /identity/v3/projects => generated 381 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:16.075869 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002f622-7b7c-44e9-9347-ecfcd06a7849 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:16.076168 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002f622-7b7c-44e9-9347-ecfcd06a7849 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:16.076952 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002f622-7b7c-44e9-9347-ecfcd06a7849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:16.103972 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-e002f622-7b7c-44e9-9347-ecfcd06a7849 None None] MFA Rules not processed for user `bede9e5d50f1451dabab5e15963e0492`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:16.105324 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e002f622-7b7c-44e9-9347-ecfcd06a7849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:16.119182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74f828-c952-46b7-8144-deaf940bb562 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:16.171888 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 803/1614] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:16 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:16.175781 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78180118-97d7-4288-bdf8-b1e172800a03 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:16.175879 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a531f383-5d41-405b-b21e-9d9ac4954bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:16.175993 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78180118-97d7-4288-bdf8-b1e172800a03 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:16.175993 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78180118-97d7-4288-bdf8-b1e172800a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:16.176144 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531f383-5d41-405b-b21e-9d9ac4954bf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:16.176144 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531f383-5d41-405b-b21e-9d9ac4954bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:16.176144 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531f383-5d41-405b-b21e-9d9ac4954bf3 admin admin] PATH_INFO: `/v3/projects/7df016afa19d4768bfee72654a5bb6fa/users/e794f888bafc4457b68efd8982732607/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:16.192833 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a531f383-5d41-405b-b21e-9d9ac4954bf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7df016afa19d4768bfee72654a5bb6fa, user_id=e794f888bafc4457b68efd8982732607, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:16.195621 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a531f383-5d41-405b-b21e-9d9ac4954bf3 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:16.202191 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-78180118-97d7-4288-bdf8-b1e172800a03 None None] MFA Rules not processed for user `fe00c7f2ec9f4d2b847741a188e301db`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:16.203400 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-78180118-97d7-4288-bdf8-b1e172800a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:16.259739 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 812/1615] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:16 2022] PUT /identity/v3/projects/7df016afa19d4768bfee72654a5bb6fa/users/e794f888bafc4457b68efd8982732607/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:16.260706 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a531f383-5d41-405b-b21e-9d9ac4954bf3 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:16.268869 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 804/1616] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:16 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:16.269706 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78180118-97d7-4288-bdf8-b1e172800a03 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:16.282932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78180118-97d7-4288-bdf8-b1e172800a03 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:16.324567 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a531f383-5d41-405b-b21e-9d9ac4954bf3 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:16.330810 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77527d90-7f8d-4ca2-a14b-ca51731d207e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:16.331480 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77527d90-7f8d-4ca2-a14b-ca51731d207e admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:16.331759 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77527d90-7f8d-4ca2-a14b-ca51731d207e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:16.332034 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77527d90-7f8d-4ca2-a14b-ca51731d207e admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:16.332720 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77527d90-7f8d-4ca2-a14b-ca51731d207e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:16.334739 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77527d90-7f8d-4ca2-a14b-ca51731d207e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:16.342127 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1b0f4-cbf1-4d0c-93a6-d9551e377462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:16.342790 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1b0f4-cbf1-4d0c-93a6-d9551e377462 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:16.343067 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1b0f4-cbf1-4d0c-93a6-d9551e377462 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:16.343339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1b0f4-cbf1-4d0c-93a6-d9551e377462 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:16.344531 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1b0f4-cbf1-4d0c-93a6-d9551e377462 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:16.346288 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1b0f4-cbf1-4d0c-93a6-d9551e377462 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:16.421045 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 813/1617] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:16 2022] POST /identity/v3/users => generated 303 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:16.421935 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77527d90-7f8d-4ca2-a14b-ca51731d207e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:16.431281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77527d90-7f8d-4ca2-a14b-ca51731d207e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:16.436417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59ff0a-cdcb-42d8-8944-e2b7c836c834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:16.437050 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59ff0a-cdcb-42d8-8944-e2b7c836c834 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:16.437332 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59ff0a-cdcb-42d8-8944-e2b7c836c834 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:16.437611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59ff0a-cdcb-42d8-8944-e2b7c836c834 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:16.438336 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59ff0a-cdcb-42d8-8944-e2b7c836c834 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:16.440256 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59ff0a-cdcb-42d8-8944-e2b7c836c834 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:16.448369 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 805/1618] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:16 2022] POST /identity/v3/projects => generated 385 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:16.448369 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a40f0-d634-4b31-93e1-d9ffd7a503e8 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:16.448369 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a40f0-d634-4b31-93e1-d9ffd7a503e8 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:16.448369 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a40f0-d634-4b31-93e1-d9ffd7a503e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:16.473457 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-4a2a40f0-d634-4b31-93e1-d9ffd7a503e8 None None] MFA Rules not processed for user `7a47e7dce36e4828a9755f8bb9105f22`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:16.474707 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4a2a40f0-d634-4b31-93e1-d9ffd7a503e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:16.516993 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 814/1619] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:16 2022] POST /identity/v3/projects => generated 381 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:16.516993 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59ff0a-cdcb-42d8-8944-e2b7c836c834 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:16.537098 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 806/1620] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:16 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:16.538450 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338dff44-764c-4254-96f1-e59ca504289e None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:16.538738 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338dff44-764c-4254-96f1-e59ca504289e None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:16.539381 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338dff44-764c-4254-96f1-e59ca504289e None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:16.540629 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 807/1621] 10.222.0.23 () {54 vars in 960 bytes} [Sat Apr 30 21:10:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:10:16.541198 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338dff44-764c-4254-96f1-e59ca504289e None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:16.574388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59ff0a-cdcb-42d8-8944-e2b7c836c834 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:16.579815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4ff64-ae5e-4946-9a13-2b10f61f1148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:16.580422 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4ff64-ae5e-4946-9a13-2b10f61f1148 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:16.580704 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4ff64-ae5e-4946-9a13-2b10f61f1148 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:16.580982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4ff64-ae5e-4946-9a13-2b10f61f1148 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:16.581668 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d4ff64-ae5e-4946-9a13-2b10f61f1148 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:16.583643 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d4ff64-ae5e-4946-9a13-2b10f61f1148 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:16.603798 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338dff44-764c-4254-96f1-e59ca504289e None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:16.608400 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3156a7a-462b-4679-b661-ea121b03de5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:16.609056 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3156a7a-462b-4679-b661-ea121b03de5c admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:16.609357 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3156a7a-462b-4679-b661-ea121b03de5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:16.609617 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3156a7a-462b-4679-b661-ea121b03de5c admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:16.610372 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3156a7a-462b-4679-b661-ea121b03de5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:16.611968 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3156a7a-462b-4679-b661-ea121b03de5c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:16.621452 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 808/1622] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:16.622245 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3156a7a-462b-4679-b661-ea121b03de5c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:16.633343 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3156a7a-462b-4679-b661-ea121b03de5c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:16.638229 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b19b9c-d7ac-4a3f-946c-c3927a84be00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:16.639446 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b19b9c-d7ac-4a3f-946c-c3927a84be00 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:16.639727 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b19b9c-d7ac-4a3f-946c-c3927a84be00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:16.640002 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b19b9c-d7ac-4a3f-946c-c3927a84be00 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:16.640659 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b19b9c-d7ac-4a3f-946c-c3927a84be00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:16.642602 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b19b9c-d7ac-4a3f-946c-c3927a84be00 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:16.649263 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 815/1623] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:16 2022] POST /identity/v3/users => generated 297 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:16.650131 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4ff64-ae5e-4946-9a13-2b10f61f1148 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:16.659359 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4ff64-ae5e-4946-9a13-2b10f61f1148 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:16.663975 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d3edf-4bf5-4596-82a3-000d1e5ba42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:16.664617 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d3edf-4bf5-4596-82a3-000d1e5ba42f admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:16.664904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d3edf-4bf5-4596-82a3-000d1e5ba42f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:16.665184 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d3edf-4bf5-4596-82a3-000d1e5ba42f admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:16.665926 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d3edf-4bf5-4596-82a3-000d1e5ba42f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:16.667524 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d3edf-4bf5-4596-82a3-000d1e5ba42f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:16.677101 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 816/1624] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:16.677953 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d3edf-4bf5-4596-82a3-000d1e5ba42f admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:16.687547 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d3edf-4bf5-4596-82a3-000d1e5ba42f admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:16.692350 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b951ed-7a28-45fa-a4aa-a0746bd3f213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:16.692948 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b951ed-7a28-45fa-a4aa-a0746bd3f213 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:16.693232 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b951ed-7a28-45fa-a4aa-a0746bd3f213 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:16.693512 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b951ed-7a28-45fa-a4aa-a0746bd3f213 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:16.694211 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b951ed-7a28-45fa-a4aa-a0746bd3f213 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:16.696075 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b951ed-7a28-45fa-a4aa-a0746bd3f213 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:16.734192 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 809/1625] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:16 2022] POST /identity/v3/projects => generated 403 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:16.734192 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b19b9c-d7ac-4a3f-946c-c3927a84be00 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:16.788435 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 817/1626] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:16 2022] POST /identity/v3/users => generated 299 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:16.788435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b951ed-7a28-45fa-a4aa-a0746bd3f213 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:16.790812 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b19b9c-d7ac-4a3f-946c-c3927a84be00 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:16.796032 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ca149-b7df-4154-b9ac-decafc373572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:16.796262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b951ed-7a28-45fa-a4aa-a0746bd3f213 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:16.796693 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ca149-b7df-4154-b9ac-decafc373572 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:16.797033 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ca149-b7df-4154-b9ac-decafc373572 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:16.797314 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ca149-b7df-4154-b9ac-decafc373572 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:16.798022 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ca149-b7df-4154-b9ac-decafc373572 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:16.799961 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ca149-b7df-4154-b9ac-decafc373572 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:16.800855 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1cf66c-e268-4df4-a21f-b75df3527626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:16.801517 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1cf66c-e268-4df4-a21f-b75df3527626 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:16.801826 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1cf66c-e268-4df4-a21f-b75df3527626 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:16.802109 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1cf66c-e268-4df4-a21f-b75df3527626 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:16.802790 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1cf66c-e268-4df4-a21f-b75df3527626 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:16.804709 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1cf66c-e268-4df4-a21f-b75df3527626 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:16.872434 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 810/1627] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:16 2022] POST /identity/v3/users => generated 297 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:16.874571 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def25c1e-6800-4731-96cc-51bd50a2ded9 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:16.874858 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def25c1e-6800-4731-96cc-51bd50a2ded9 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:16.875132 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def25c1e-6800-4731-96cc-51bd50a2ded9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:16.902354 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-def25c1e-6800-4731-96cc-51bd50a2ded9 None None] MFA Rules not processed for user `fca4ee1f64c8489ebe7296f9f8f0ab41`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:16.903557 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-def25c1e-6800-4731-96cc-51bd50a2ded9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:16.905663 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 818/1628] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:16 2022] POST /identity/v3/projects => generated 371 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:16.906531 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1cf66c-e268-4df4-a21f-b75df3527626 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:16.966668 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1cf66c-e268-4df4-a21f-b75df3527626 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:16.971431 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5033b6a5-8c88-40ff-984a-2960658a3021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:16.972300 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033b6a5-8c88-40ff-984a-2960658a3021 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:16.972583 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033b6a5-8c88-40ff-984a-2960658a3021 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:16.972852 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033b6a5-8c88-40ff-984a-2960658a3021 admin admin] PATH_INFO: `/v3/projects/7df016afa19d4768bfee72654a5bb6fa/users/e794f888bafc4457b68efd8982732607/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:16.974809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5033b6a5-8c88-40ff-984a-2960658a3021 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7df016afa19d4768bfee72654a5bb6fa, user_id=e794f888bafc4457b68efd8982732607, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:16.977432 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5033b6a5-8c88-40ff-984a-2960658a3021 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:16.985037 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 811/1629] 10.222.0.23 () {58 vars in 1057 bytes} [Sat Apr 30 21:10:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:16.985913 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def25c1e-6800-4731-96cc-51bd50a2ded9 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:16.988432 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 819/1630] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:16 2022] PUT /identity/v3/projects/7df016afa19d4768bfee72654a5bb6fa/users/e794f888bafc4457b68efd8982732607/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:16.989143 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5033b6a5-8c88-40ff-984a-2960658a3021 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:16.995832 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def25c1e-6800-4731-96cc-51bd50a2ded9 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:17.048838 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5033b6a5-8c88-40ff-984a-2960658a3021 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:17.050957 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fed8cb-2fca-4081-8539-65dbced1b104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:17.051632 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fed8cb-2fca-4081-8539-65dbced1b104 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:17.051983 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fed8cb-2fca-4081-8539-65dbced1b104 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:17.052178 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fed8cb-2fca-4081-8539-65dbced1b104 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:17.052898 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fed8cb-2fca-4081-8539-65dbced1b104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:17.053607 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ae826-8a7b-4474-b5b5-98e60d50dd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:17.054558 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ae826-8a7b-4474-b5b5-98e60d50dd97 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:17.054843 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ae826-8a7b-4474-b5b5-98e60d50dd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:17.055136 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ae826-8a7b-4474-b5b5-98e60d50dd97 admin admin] PATH_INFO: `/v3/projects/823953b5766f4264b65b18349bb0e32d/users/a8dd20fef4a242b1a8963a3e0e20bcf4/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:17.055236 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fed8cb-2fca-4081-8539-65dbced1b104 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:17.065732 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 812/1631] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:17.066751 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fed8cb-2fca-4081-8539-65dbced1b104 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:17.070853 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ae826-8a7b-4474-b5b5-98e60d50dd97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=823953b5766f4264b65b18349bb0e32d, user_id=a8dd20fef4a242b1a8963a3e0e20bcf4, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:17.073517 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ae826-8a7b-4474-b5b5-98e60d50dd97 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:17.076475 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fed8cb-2fca-4081-8539-65dbced1b104 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:17.081392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b48991-f69d-476b-823a-fa502252a399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:17.085407 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b48991-f69d-476b-823a-fa502252a399 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:17.085407 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b48991-f69d-476b-823a-fa502252a399 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:17.085407 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b48991-f69d-476b-823a-fa502252a399 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:17.085407 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b48991-f69d-476b-823a-fa502252a399 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:17.085407 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b48991-f69d-476b-823a-fa502252a399 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:17.152142 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 820/1632] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:16 2022] PUT /identity/v3/projects/823953b5766f4264b65b18349bb0e32d/users/a8dd20fef4a242b1a8963a3e0e20bcf4/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:17.153258 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ae826-8a7b-4474-b5b5-98e60d50dd97 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:17.158084 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 813/1633] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:17 2022] POST /identity/v3/users => generated 308 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:17.158833 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b48991-f69d-476b-823a-fa502252a399 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:17.168750 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b48991-f69d-476b-823a-fa502252a399 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:17.213337 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ae826-8a7b-4474-b5b5-98e60d50dd97 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:17.218551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f470533-8315-45ea-9374-3c08b8974d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:17.219298 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f470533-8315-45ea-9374-3c08b8974d27 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:17.219583 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f470533-8315-45ea-9374-3c08b8974d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:17.219863 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f470533-8315-45ea-9374-3c08b8974d27 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:17.220582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f470533-8315-45ea-9374-3c08b8974d27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:17.222219 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f470533-8315-45ea-9374-3c08b8974d27 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:17.224098 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898cd72-4925-4a0e-b746-416103e30e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:17.224763 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898cd72-4925-4a0e-b746-416103e30e34 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:17.225050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898cd72-4925-4a0e-b746-416103e30e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:17.225328 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898cd72-4925-4a0e-b746-416103e30e34 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:17.226119 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7898cd72-4925-4a0e-b746-416103e30e34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:17.227773 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7898cd72-4925-4a0e-b746-416103e30e34 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:17.231923 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 821/1634] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:17.234071 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f470533-8315-45ea-9374-3c08b8974d27 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:17.241182 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 814/1635] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:17.241182 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab3398f-7a20-41e3-92d8-ee7d0ba379de None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:17.241182 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab3398f-7a20-41e3-92d8-ee7d0ba379de None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:17.241182 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab3398f-7a20-41e3-92d8-ee7d0ba379de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:17.243902 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f470533-8315-45ea-9374-3c08b8974d27 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:17.249380 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691f99f-1222-45cb-bd8e-23ac1be5e710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:17.250114 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691f99f-1222-45cb-bd8e-23ac1be5e710 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:17.250398 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691f99f-1222-45cb-bd8e-23ac1be5e710 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:17.250675 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691f99f-1222-45cb-bd8e-23ac1be5e710 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:17.251358 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691f99f-1222-45cb-bd8e-23ac1be5e710 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:17.253946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691f99f-1222-45cb-bd8e-23ac1be5e710 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:17.265230 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-0ab3398f-7a20-41e3-92d8-ee7d0ba379de None None] MFA Rules not processed for user `e794f888bafc4457b68efd8982732607`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:17.266474 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0ab3398f-7a20-41e3-92d8-ee7d0ba379de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:17.333541 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 815/1636] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:17 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:17.334411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab3398f-7a20-41e3-92d8-ee7d0ba379de None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:17.346410 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 822/1637] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:17 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:17.348791 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691f99f-1222-45cb-bd8e-23ac1be5e710 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:17.358333 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691f99f-1222-45cb-bd8e-23ac1be5e710 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:17.363169 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54a045-6303-4b28-8bec-c134e7d751df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:17.364080 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54a045-6303-4b28-8bec-c134e7d751df admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:17.364360 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54a045-6303-4b28-8bec-c134e7d751df admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:17.364636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54a045-6303-4b28-8bec-c134e7d751df admin admin] PATH_INFO: `/v3/projects/cd39aa64695a4942967925e4463713bb/users/b6a6ca397aee484b93fe02aaa75890a3/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:17.378958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d54a045-6303-4b28-8bec-c134e7d751df admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd39aa64695a4942967925e4463713bb, user_id=b6a6ca397aee484b93fe02aaa75890a3, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:17.381585 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d54a045-6303-4b28-8bec-c134e7d751df admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:17.409365 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab3398f-7a20-41e3-92d8-ee7d0ba379de None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:17.414898 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f78e5e-3c70-4048-9115-55090c045c7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:17.415540 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f78e5e-3c70-4048-9115-55090c045c7b service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:17.415827 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f78e5e-3c70-4048-9115-55090c045c7b service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:17.416100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f78e5e-3c70-4048-9115-55090c045c7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:17.460013 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 823/1638] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:17 2022] PUT /identity/v3/projects/cd39aa64695a4942967925e4463713bb/users/b6a6ca397aee484b93fe02aaa75890a3/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:17.460842 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54a045-6303-4b28-8bec-c134e7d751df admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:17.478025 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f78e5e-3c70-4048-9115-55090c045c7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:17.479631 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f78e5e-3c70-4048-9115-55090c045c7b service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:17.489661 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 816/1639] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:17 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:17.494819 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f78e5e-3c70-4048-9115-55090c045c7b service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:17.505376 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f78e5e-3c70-4048-9115-55090c045c7b service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:17.521967 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54a045-6303-4b28-8bec-c134e7d751df admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:17.526920 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d38fc-ef4d-4739-977c-4ed0c9c8464d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:17.527582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d38fc-ef4d-4739-977c-4ed0c9c8464d admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:17.527865 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d38fc-ef4d-4739-977c-4ed0c9c8464d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:17.528145 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d38fc-ef4d-4739-977c-4ed0c9c8464d admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:17.528870 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d38fc-ef4d-4739-977c-4ed0c9c8464d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:17.531049 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d38fc-ef4d-4739-977c-4ed0c9c8464d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:17.543465 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 824/1640] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:17.544402 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d38fc-ef4d-4739-977c-4ed0c9c8464d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:17.554252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d38fc-ef4d-4739-977c-4ed0c9c8464d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:17.558945 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf890c14-0f7b-4b72-acd2-cd57b8d3ba77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:17.560406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf890c14-0f7b-4b72-acd2-cd57b8d3ba77 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:17.560406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf890c14-0f7b-4b72-acd2-cd57b8d3ba77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:17.560406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf890c14-0f7b-4b72-acd2-cd57b8d3ba77 admin admin] PATH_INFO: `/v3/projects/51a13c9b28c54023aa6849df2d4aa110/users/1555eaa5255042069c474927d736edfe/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:17.574923 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf890c14-0f7b-4b72-acd2-cd57b8d3ba77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51a13c9b28c54023aa6849df2d4aa110, user_id=1555eaa5255042069c474927d736edfe, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:17.576734 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be27b4-4017-41d0-a2e3-8872cc8bab4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:17.577415 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be27b4-4017-41d0-a2e3-8872cc8bab4a admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:17.577962 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be27b4-4017-41d0-a2e3-8872cc8bab4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:17.578251 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be27b4-4017-41d0-a2e3-8872cc8bab4a admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:17.578355 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf890c14-0f7b-4b72-acd2-cd57b8d3ba77 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:17.578976 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93be27b4-4017-41d0-a2e3-8872cc8bab4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:17.580886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93be27b4-4017-41d0-a2e3-8872cc8bab4a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:17.591083 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 817/1641] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:17.591901 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be27b4-4017-41d0-a2e3-8872cc8bab4a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:17.601852 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be27b4-4017-41d0-a2e3-8872cc8bab4a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:17.606547 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4f8a0-3dfe-4420-854d-b49d6bc2d2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:17.612211 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4f8a0-3dfe-4420-854d-b49d6bc2d2ec admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:17.612211 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4f8a0-3dfe-4420-854d-b49d6bc2d2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:17.612211 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4f8a0-3dfe-4420-854d-b49d6bc2d2ec admin admin] PATH_INFO: `/v3/projects/c1a16992b76c4cb28b2b554827420aa2/users/9c1363f86b5e43339ce68fdf785103c7/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:17.622294 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc4f8a0-3dfe-4420-854d-b49d6bc2d2ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1a16992b76c4cb28b2b554827420aa2, user_id=9c1363f86b5e43339ce68fdf785103c7, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:17.624986 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc4f8a0-3dfe-4420-854d-b49d6bc2d2ec admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:17.682673 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 825/1642] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:17 2022] PUT /identity/v3/projects/51a13c9b28c54023aa6849df2d4aa110/users/1555eaa5255042069c474927d736edfe/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:17.683438 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf890c14-0f7b-4b72-acd2-cd57b8d3ba77 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:17.700979 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 818/1643] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:17 2022] PUT /identity/v3/projects/c1a16992b76c4cb28b2b554827420aa2/users/9c1363f86b5e43339ce68fdf785103c7/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:17.703306 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92da4a-94fe-4763-b905-92f39581e55c None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:17.703659 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92da4a-94fe-4763-b905-92f39581e55c None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:17.708293 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92da4a-94fe-4763-b905-92f39581e55c None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:17.708293 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 819/1644] 10.222.0.23 () {54 vars in 960 bytes} [Sat Apr 30 21:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:10:17.708293 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92da4a-94fe-4763-b905-92f39581e55c None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:17.753560 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf890c14-0f7b-4b72-acd2-cd57b8d3ba77 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:17.787961 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92da4a-94fe-4763-b905-92f39581e55c None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:17.792936 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56965fab-1f30-4078-add4-fbef95b92bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:17.793614 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56965fab-1f30-4078-add4-fbef95b92bbf admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:17.794062 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56965fab-1f30-4078-add4-fbef95b92bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:17.794353 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56965fab-1f30-4078-add4-fbef95b92bbf admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:17.795117 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56965fab-1f30-4078-add4-fbef95b92bbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:17.796737 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56965fab-1f30-4078-add4-fbef95b92bbf admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:17.806955 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 820/1645] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:17.807740 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56965fab-1f30-4078-add4-fbef95b92bbf admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:17.814920 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cbcabf-c9b8-4913-b1f9-8797cc960024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:17.815941 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbcabf-c9b8-4913-b1f9-8797cc960024 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:17.816238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbcabf-c9b8-4913-b1f9-8797cc960024 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:17.816818 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbcabf-c9b8-4913-b1f9-8797cc960024 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:17.817546 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbcabf-c9b8-4913-b1f9-8797cc960024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:17.819401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbcabf-c9b8-4913-b1f9-8797cc960024 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:17.819521 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56965fab-1f30-4078-add4-fbef95b92bbf admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:17.823989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a384104-8c3c-4f1b-adce-cfc50980c573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:17.824844 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a384104-8c3c-4f1b-adce-cfc50980c573 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:17.825122 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a384104-8c3c-4f1b-adce-cfc50980c573 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:17.825406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a384104-8c3c-4f1b-adce-cfc50980c573 admin admin] PATH_INFO: `/v3/projects/823953b5766f4264b65b18349bb0e32d/users/a8dd20fef4a242b1a8963a3e0e20bcf4/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:17.828034 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a384104-8c3c-4f1b-adce-cfc50980c573 admin admin] RBAC: Authorizing `identity:create_grant(project_id=823953b5766f4264b65b18349bb0e32d, user_id=a8dd20fef4a242b1a8963a3e0e20bcf4, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:17.830077 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 826/1646] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:17.830861 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cbcabf-c9b8-4913-b1f9-8797cc960024 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:17.834031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a384104-8c3c-4f1b-adce-cfc50980c573 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:17.840600 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cbcabf-c9b8-4913-b1f9-8797cc960024 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:17.847220 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 821/1647] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:17 2022] PUT /identity/v3/projects/823953b5766f4264b65b18349bb0e32d/users/a8dd20fef4a242b1a8963a3e0e20bcf4/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:17.847884 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a384104-8c3c-4f1b-adce-cfc50980c573 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:17.905357 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429374ab-36a6-4218-8a6e-212d741e8bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:17.906281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429374ab-36a6-4218-8a6e-212d741e8bf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:17.906571 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429374ab-36a6-4218-8a6e-212d741e8bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:17.906845 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429374ab-36a6-4218-8a6e-212d741e8bf4 admin admin] PATH_INFO: `/v3/projects/eff7cb256e0f445da837a3c13b97b13a/users/35f44b3f05fd4463971a20d0d77e98b2/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:17.918113 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a384104-8c3c-4f1b-adce-cfc50980c573 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:17.921089 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429374ab-36a6-4218-8a6e-212d741e8bf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eff7cb256e0f445da837a3c13b97b13a, user_id=35f44b3f05fd4463971a20d0d77e98b2, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:17.922753 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f6ca53-e56f-4119-8b2b-03cd31928641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:17.923417 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6ca53-e56f-4119-8b2b-03cd31928641 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:17.923701 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6ca53-e56f-4119-8b2b-03cd31928641 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:17.923800 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429374ab-36a6-4218-8a6e-212d741e8bf4 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:17.923975 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6ca53-e56f-4119-8b2b-03cd31928641 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:17.924692 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f6ca53-e56f-4119-8b2b-03cd31928641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:17.926326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f6ca53-e56f-4119-8b2b-03cd31928641 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:17.936852 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 822/1648] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:17.938189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4bd12-265b-444a-b1a8-188ce7dfb5e0 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:17.938503 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4bd12-265b-444a-b1a8-188ce7dfb5e0 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:17.938786 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4bd12-265b-444a-b1a8-188ce7dfb5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:17.957021 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-86d4bd12-265b-444a-b1a8-188ce7dfb5e0 None None] MFA Rules not processed for user `fca4ee1f64c8489ebe7296f9f8f0ab41`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:17.958257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-86d4bd12-265b-444a-b1a8-188ce7dfb5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:18.037552 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 823/1649] 10.222.0.23 () {58 vars in 1057 bytes} [Sat Apr 30 21:10:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:18.038674 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4bd12-265b-444a-b1a8-188ce7dfb5e0 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:18.043233 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 827/1650] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:17 2022] PUT /identity/v3/projects/eff7cb256e0f445da837a3c13b97b13a/users/35f44b3f05fd4463971a20d0d77e98b2/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:18.049941 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429374ab-36a6-4218-8a6e-212d741e8bf4 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:18.050742 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4bd12-265b-444a-b1a8-188ce7dfb5e0 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:18.122518 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3858f-2046-4bf2-b190-acc2bf093711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:18.124201 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429374ab-36a6-4218-8a6e-212d741e8bf4 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:18.124389 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3858f-2046-4bf2-b190-acc2bf093711 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:18.124733 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3858f-2046-4bf2-b190-acc2bf093711 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:18.125362 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3858f-2046-4bf2-b190-acc2bf093711 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:18.126371 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc3858f-2046-4bf2-b190-acc2bf093711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:18.128781 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc3858f-2046-4bf2-b190-acc2bf093711 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:18.129071 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab54b18-11db-4213-ac80-88a05b3968d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:18.130021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab54b18-11db-4213-ac80-88a05b3968d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:18.130301 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab54b18-11db-4213-ac80-88a05b3968d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:18.130764 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab54b18-11db-4213-ac80-88a05b3968d8 admin admin] PATH_INFO: `/v3/projects/cd39aa64695a4942967925e4463713bb/users/b6a6ca397aee484b93fe02aaa75890a3/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:18.132996 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab54b18-11db-4213-ac80-88a05b3968d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd39aa64695a4942967925e4463713bb, user_id=b6a6ca397aee484b93fe02aaa75890a3, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:18.136470 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab54b18-11db-4213-ac80-88a05b3968d8 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:18.142053 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 824/1651] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:18.142914 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3858f-2046-4bf2-b190-acc2bf093711 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:18.150319 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 828/1652] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:18 2022] PUT /identity/v3/projects/cd39aa64695a4942967925e4463713bb/users/b6a6ca397aee484b93fe02aaa75890a3/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:18.152218 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fa97a-38ce-4c8e-90dd-2e02a332546c None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:18.152641 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fa97a-38ce-4c8e-90dd-2e02a332546c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:18.152990 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fa97a-38ce-4c8e-90dd-2e02a332546c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:18.153234 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3858f-2046-4bf2-b190-acc2bf093711 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:18.181123 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-3d0fa97a-38ce-4c8e-90dd-2e02a332546c None None] MFA Rules not processed for user `a8dd20fef4a242b1a8963a3e0e20bcf4`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:18.182421 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3d0fa97a-38ce-4c8e-90dd-2e02a332546c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:18.209188 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50640c4c-f946-4e47-9ce2-e0a2bbb4fb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:18.210116 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50640c4c-f946-4e47-9ce2-e0a2bbb4fb95 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:18.210402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50640c4c-f946-4e47-9ce2-e0a2bbb4fb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:18.210680 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50640c4c-f946-4e47-9ce2-e0a2bbb4fb95 admin admin] PATH_INFO: `/v3/projects/170f33ca0b614f3886822e038f754ea5/users/16785a3fa02a48498119761cd6da31be/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:18.225459 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50640c4c-f946-4e47-9ce2-e0a2bbb4fb95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=170f33ca0b614f3886822e038f754ea5, user_id=16785a3fa02a48498119761cd6da31be, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:18.228272 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50640c4c-f946-4e47-9ce2-e0a2bbb4fb95 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:18.249271 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 829/1653] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:18 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:18.250243 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fa97a-38ce-4c8e-90dd-2e02a332546c None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:18.259973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fa97a-38ce-4c8e-90dd-2e02a332546c None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:18.264562 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1be1e7-d9d1-4db4-83bf-0c1fa09fc0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:18.265411 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1be1e7-d9d1-4db4-83bf-0c1fa09fc0bc admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:18.265694 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1be1e7-d9d1-4db4-83bf-0c1fa09fc0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:18.267774 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1be1e7-d9d1-4db4-83bf-0c1fa09fc0bc admin admin] PATH_INFO: `/v3/projects/51a13c9b28c54023aa6849df2d4aa110/users/1555eaa5255042069c474927d736edfe/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:18.268012 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1be1e7-d9d1-4db4-83bf-0c1fa09fc0bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=51a13c9b28c54023aa6849df2d4aa110, user_id=1555eaa5255042069c474927d736edfe, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:18.270713 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1be1e7-d9d1-4db4-83bf-0c1fa09fc0bc admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:18.281082 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 830/1654] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:18 2022] PUT /identity/v3/projects/51a13c9b28c54023aa6849df2d4aa110/users/1555eaa5255042069c474927d736edfe/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:18.285056 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1be1e7-d9d1-4db4-83bf-0c1fa09fc0bc admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:18.301914 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 825/1655] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:18 2022] PUT /identity/v3/projects/170f33ca0b614f3886822e038f754ea5/users/16785a3fa02a48498119761cd6da31be/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:18.302856 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50640c4c-f946-4e47-9ce2-e0a2bbb4fb95 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:18.356112 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1be1e7-d9d1-4db4-83bf-0c1fa09fc0bc admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:18.363777 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50640c4c-f946-4e47-9ce2-e0a2bbb4fb95 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:18.368828 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef334d0-c4d3-443d-baa6-ae2fa98b70df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:18.369506 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef334d0-c4d3-443d-baa6-ae2fa98b70df admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:18.369817 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef334d0-c4d3-443d-baa6-ae2fa98b70df admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:18.370098 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef334d0-c4d3-443d-baa6-ae2fa98b70df admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:18.370828 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef334d0-c4d3-443d-baa6-ae2fa98b70df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:18.372434 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef334d0-c4d3-443d-baa6-ae2fa98b70df admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:18.383121 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 826/1656] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:18.384575 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad7b86-4486-476d-beeb-84b4ce465a76 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:18.384946 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad7b86-4486-476d-beeb-84b4ce465a76 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:18.385292 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad7b86-4486-476d-beeb-84b4ce465a76 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:18.386758 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 827/1657] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:10:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:10:18.387298 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad7b86-4486-476d-beeb-84b4ce465a76 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:18.399396 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad7b86-4486-476d-beeb-84b4ce465a76 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:18.404018 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ba6ab-bdd1-40a6-ae93-0391e0d3aa14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:18.404974 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ba6ab-bdd1-40a6-ae93-0391e0d3aa14 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:18.405328 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ba6ab-bdd1-40a6-ae93-0391e0d3aa14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:18.405749 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ba6ab-bdd1-40a6-ae93-0391e0d3aa14 admin admin] PATH_INFO: `/v3/projects/c1a16992b76c4cb28b2b554827420aa2/users/9c1363f86b5e43339ce68fdf785103c7/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:18.407781 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ba6ab-bdd1-40a6-ae93-0391e0d3aa14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1a16992b76c4cb28b2b554827420aa2, user_id=9c1363f86b5e43339ce68fdf785103c7, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:18.410759 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ba6ab-bdd1-40a6-ae93-0391e0d3aa14 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:18.418526 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f1337-7653-44e4-a003-20991af5b1f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:18.419191 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f1337-7653-44e4-a003-20991af5b1f6 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:18.419469 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f1337-7653-44e4-a003-20991af5b1f6 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:18.419740 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f1337-7653-44e4-a003-20991af5b1f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:18.421321 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 828/1658] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:18 2022] PUT /identity/v3/projects/c1a16992b76c4cb28b2b554827420aa2/users/9c1363f86b5e43339ce68fdf785103c7/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:18.422652 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e5449-3e79-4072-b60e-99775b29bed8 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:18.422912 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e5449-3e79-4072-b60e-99775b29bed8 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:18.423193 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e5449-3e79-4072-b60e-99775b29bed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:18.449957 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-f33e5449-3e79-4072-b60e-99775b29bed8 None None] MFA Rules not processed for user `b6a6ca397aee484b93fe02aaa75890a3`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:18.451269 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f33e5449-3e79-4072-b60e-99775b29bed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:18.478246 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57f1337-7653-44e4-a003-20991af5b1f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:18.479779 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57f1337-7653-44e4-a003-20991af5b1f6 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:18.489806 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 831/1659] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:18 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:18.491089 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0caeb-1dd2-4f47-bdc8-d591c0fd7e85 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:18.491375 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0caeb-1dd2-4f47-bdc8-d591c0fd7e85 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:18.491710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f0caeb-1dd2-4f47-bdc8-d591c0fd7e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:18.517555 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-62f0caeb-1dd2-4f47-bdc8-d591c0fd7e85 None None] MFA Rules not processed for user `1555eaa5255042069c474927d736edfe`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:18.518850 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-62f0caeb-1dd2-4f47-bdc8-d591c0fd7e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:18.519662 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 829/1660] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:18 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:18.520522 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e5449-3e79-4072-b60e-99775b29bed8 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:18.583683 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e5449-3e79-4072-b60e-99775b29bed8 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:18.588435 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557134b-e3b6-4c0c-b430-f940eaa34d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:18.589100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557134b-e3b6-4c0c-b430-f940eaa34d9d admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:18.589384 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557134b-e3b6-4c0c-b430-f940eaa34d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:18.589660 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557134b-e3b6-4c0c-b430-f940eaa34d9d admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:18.590412 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557134b-e3b6-4c0c-b430-f940eaa34d9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:18.590888 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 832/1661] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:18 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:18.592277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f0caeb-1dd2-4f47-bdc8-d591c0fd7e85 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:18.595780 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557134b-e3b6-4c0c-b430-f940eaa34d9d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:18.602837 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f0caeb-1dd2-4f47-bdc8-d591c0fd7e85 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:18.607984 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 830/1662] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:18.608437 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34587e2d-f818-4686-afe9-152aeab22319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:18.609495 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34587e2d-f818-4686-afe9-152aeab22319 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:18.609796 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98589cfe-e84b-4f9c-97e4-81c4c66eb203 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:18.610045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34587e2d-f818-4686-afe9-152aeab22319 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:18.610388 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98589cfe-e84b-4f9c-97e4-81c4c66eb203 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:18.610498 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34587e2d-f818-4686-afe9-152aeab22319 admin admin] PATH_INFO: `/v3/projects/eff7cb256e0f445da837a3c13b97b13a/users/35f44b3f05fd4463971a20d0d77e98b2/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:18.610908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98589cfe-e84b-4f9c-97e4-81c4c66eb203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:18.612917 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34587e2d-f818-4686-afe9-152aeab22319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eff7cb256e0f445da837a3c13b97b13a, user_id=35f44b3f05fd4463971a20d0d77e98b2, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:18.616059 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34587e2d-f818-4686-afe9-152aeab22319 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:18.636514 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 833/1663] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:18 2022] PUT /identity/v3/projects/eff7cb256e0f445da837a3c13b97b13a/users/35f44b3f05fd4463971a20d0d77e98b2/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:18.636514 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd67f7-bce3-487f-8b66-e5f4afe2db23 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:18.636514 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd67f7-bce3-487f-8b66-e5f4afe2db23 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:18.636514 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd67f7-bce3-487f-8b66-e5f4afe2db23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:18.655401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-15cd67f7-bce3-487f-8b66-e5f4afe2db23 None None] MFA Rules not processed for user `9c1363f86b5e43339ce68fdf785103c7`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:18.656625 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-15cd67f7-bce3-487f-8b66-e5f4afe2db23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:18.671281 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-98589cfe-e84b-4f9c-97e4-81c4c66eb203 None None] MFA Rules not processed for user `4ad3f89b7037413a83c7905cef263b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:18.672667 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-98589cfe-e84b-4f9c-97e4-81c4c66eb203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:18.724696 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 834/1664] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:18 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:18.729889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd67f7-bce3-487f-8b66-e5f4afe2db23 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:18.745830 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 831/1665] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:10:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:18.747237 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292612e-c90f-4d7e-ad1b-2a2547c1c196 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:18.747528 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292612e-c90f-4d7e-ad1b-2a2547c1c196 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:18.747806 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292612e-c90f-4d7e-ad1b-2a2547c1c196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:18.775068 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-9292612e-c90f-4d7e-ad1b-2a2547c1c196 None None] MFA Rules not processed for user `35f44b3f05fd4463971a20d0d77e98b2`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:18.776266 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-9292612e-c90f-4d7e-ad1b-2a2547c1c196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:18.792611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd67f7-bce3-487f-8b66-e5f4afe2db23 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:18.797891 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35405303-3e7b-4a6b-8223-92eacddd41f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:18.798805 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35405303-3e7b-4a6b-8223-92eacddd41f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:18.799090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35405303-3e7b-4a6b-8223-92eacddd41f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:18.799399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35405303-3e7b-4a6b-8223-92eacddd41f7 admin admin] PATH_INFO: `/v3/projects/170f33ca0b614f3886822e038f754ea5/users/16785a3fa02a48498119761cd6da31be/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:18.801344 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35405303-3e7b-4a6b-8223-92eacddd41f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=170f33ca0b614f3886822e038f754ea5, user_id=16785a3fa02a48498119761cd6da31be, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:18.804046 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35405303-3e7b-4a6b-8223-92eacddd41f7 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:18.822968 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 835/1666] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:18 2022] PUT /identity/v3/projects/170f33ca0b614f3886822e038f754ea5/users/16785a3fa02a48498119761cd6da31be/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:18.824082 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35405303-3e7b-4a6b-8223-92eacddd41f7 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:18.845930 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 832/1667] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:18 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:18.846880 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9292612e-c90f-4d7e-ad1b-2a2547c1c196 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:18.856372 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9292612e-c90f-4d7e-ad1b-2a2547c1c196 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:18.897291 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35405303-3e7b-4a6b-8223-92eacddd41f7 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:18.902403 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d407c1c-ce7f-4b22-a519-f03ab1ea97c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:18.903040 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d407c1c-ce7f-4b22-a519-f03ab1ea97c3 service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:18.903316 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d407c1c-ce7f-4b22-a519-f03ab1ea97c3 service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:18.903591 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d407c1c-ce7f-4b22-a519-f03ab1ea97c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:18.911378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f5ebb-0097-4465-b2d2-3ca87217e2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:18.912253 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f5ebb-0097-4465-b2d2-3ca87217e2e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:18.912525 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d407c1c-ce7f-4b22-a519-f03ab1ea97c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:18.912627 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f5ebb-0097-4465-b2d2-3ca87217e2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:18.912801 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f5ebb-0097-4465-b2d2-3ca87217e2e5 admin admin] PATH_INFO: `/v3/users/606783f43d2d408d870ffa9116c502eb` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:18.914049 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f5ebb-0097-4465-b2d2-3ca87217e2e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=606783f43d2d408d870ffa9116c502eb)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:18.914167 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d407c1c-ce7f-4b22-a519-f03ab1ea97c3 service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:18.915067 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-e54f5ebb-0097-4465-b2d2-3ca87217e2e5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:18.915067 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:10:18.915067 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:10:18.916283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f5ebb-0097-4465-b2d2-3ca87217e2e5 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:18.924228 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 836/1668] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:18.925019 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d407c1c-ce7f-4b22-a519-f03ab1ea97c3 service placement] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:18.994997 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d407c1c-ce7f-4b22-a519-f03ab1ea97c3 service placement] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:19.000676 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58479adb-e553-47d3-b359-4ec6466e9785 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:19.001320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58479adb-e553-47d3-b359-4ec6466e9785 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:19.005392 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58479adb-e553-47d3-b359-4ec6466e9785 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:19.005392 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58479adb-e553-47d3-b359-4ec6466e9785 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:19.058553 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58479adb-e553-47d3-b359-4ec6466e9785 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:19.060480 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58479adb-e553-47d3-b359-4ec6466e9785 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:19.070897 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 837/1669] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:18 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:19.073098 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba64eec-0d52-49c9-86dc-378de9de71b9 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:19.073345 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba64eec-0d52-49c9-86dc-378de9de71b9 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:19.073626 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba64eec-0d52-49c9-86dc-378de9de71b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:19.104475 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-bba64eec-0d52-49c9-86dc-378de9de71b9 None None] MFA Rules not processed for user `16785a3fa02a48498119761cd6da31be`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:19.105803 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-bba64eec-0d52-49c9-86dc-378de9de71b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:19.141441 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e54f5ebb-0097-4465-b2d2-3ca87217e2e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '606783f43d2d408d870ffa9116c502eb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:19.163250 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e54f5ebb-0097-4465-b2d2-3ca87217e2e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '606783f43d2d408d870ffa9116c502eb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:19.177771 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 838/1670] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:19 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:19.178707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba64eec-0d52-49c9-86dc-378de9de71b9 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:19.190615 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba64eec-0d52-49c9-86dc-378de9de71b9 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:19.196355 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf614b0b-2d63-43de-80e8-d31d64100587 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:19.197065 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf614b0b-2d63-43de-80e8-d31d64100587 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:19.197349 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf614b0b-2d63-43de-80e8-d31d64100587 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:19.197627 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf614b0b-2d63-43de-80e8-d31d64100587 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:19.232367 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e54f5ebb-0097-4465-b2d2-3ca87217e2e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '606783f43d2d408d870ffa9116c502eb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:19.232998 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e54f5ebb-0097-4465-b2d2-3ca87217e2e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '606783f43d2d408d870ffa9116c502eb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:19.245750 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e54f5ebb-0097-4465-b2d2-3ca87217e2e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '606783f43d2d408d870ffa9116c502eb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:19.249554 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 833/1671] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:10:18 2022] DELETE /identity/v3/users/606783f43d2d408d870ffa9116c502eb => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:19.250843 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450bde4-9898-455d-b265-64c5bfb6b979 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:19.251137 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450bde4-9898-455d-b265-64c5bfb6b979 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:19.251418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450bde4-9898-455d-b265-64c5bfb6b979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:19.255237 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf614b0b-2d63-43de-80e8-d31d64100587 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:19.256855 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf614b0b-2d63-43de-80e8-d31d64100587 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:19.267037 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 839/1672] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:19 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:19.271508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf614b0b-2d63-43de-80e8-d31d64100587 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:19.271649 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-f450bde4-9898-455d-b265-64c5bfb6b979 None None] MFA Rules not processed for user `09f28e171049411c847508fe7521b56b`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:19.271649 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f450bde4-9898-455d-b265-64c5bfb6b979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:19.283405 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf614b0b-2d63-43de-80e8-d31d64100587 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:19.332069 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 834/1673] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:19.332069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d7b4f-0432-4c67-a46b-d2241edc2f8a None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:19.332069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d7b4f-0432-4c67-a46b-d2241edc2f8a None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:19.332069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d7b4f-0432-4c67-a46b-d2241edc2f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:19.346587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc892743-29a0-4d7d-aff9-a59013f00bee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:19.347412 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc892743-29a0-4d7d-aff9-a59013f00bee service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:19.347702 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc892743-29a0-4d7d-aff9-a59013f00bee service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:19.347952 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-4b4d7b4f-0432-4c67-a46b-d2241edc2f8a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:19.348056 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc892743-29a0-4d7d-aff9-a59013f00bee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:19.349147 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4b4d7b4f-0432-4c67-a46b-d2241edc2f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:19.349730 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-bc892743-29a0-4d7d-aff9-a59013f00bee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:19.409207 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 835/1674] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:19.409876 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc892743-29a0-4d7d-aff9-a59013f00bee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:19.410698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee40f3-bac8-4a4f-9074-166f6bcab044 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:19.411061 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee40f3-bac8-4a4f-9074-166f6bcab044 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:19.411414 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee40f3-bac8-4a4f-9074-166f6bcab044 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:19.411569 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc892743-29a0-4d7d-aff9-a59013f00bee service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:19.413215 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 836/1675] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:10:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:10:19.417708 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee40f3-bac8-4a4f-9074-166f6bcab044 None None] Authenticating service token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 30 21:10:19.419748 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3aee40f3-bac8-4a4f-9074-166f6bcab044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:19.422707 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 840/1676] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:19.423521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc892743-29a0-4d7d-aff9-a59013f00bee service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:19.424789 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-bc892743-29a0-4d7d-aff9-a59013f00bee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:19.439337 ncdv-master-1 devstack@keystone.service[91017]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-3aee40f3-bac8-4a4f-9074-166f6bcab044 None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Apr 30 21:10:19.439639 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee40f3-bac8-4a4f-9074-166f6bcab044 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:19.440878 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3aee40f3-bac8-4a4f-9074-166f6bcab044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:19.504033 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee40f3-bac8-4a4f-9074-166f6bcab044 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:19.504191 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc892743-29a0-4d7d-aff9-a59013f00bee service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:19.507683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ef4a2-36b5-4460-90a6-f6253ad33f4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:19.508325 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ef4a2-36b5-4460-90a6-f6253ad33f4b service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:19.508477 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94414a48-c8bb-4a3f-b6be-e4ef8e585470 tempest-FlavorsAccessTestJSON-61126716 tempest-FlavorsAccessTestJSON-61126716-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e794f888bafc4457b68efd8982732607', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7df016afa19d4768bfee72654a5bb6fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:19.508592 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ef4a2-36b5-4460-90a6-f6253ad33f4b service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:19.508870 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ef4a2-36b5-4460-90a6-f6253ad33f4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:19.509369 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94414a48-c8bb-4a3f-b6be-e4ef8e585470 tempest-FlavorsAccessTestJSON-61126716 tempest-FlavorsAccessTestJSON-61126716-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:19.509657 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94414a48-c8bb-4a3f-b6be-e4ef8e585470 tempest-FlavorsAccessTestJSON-61126716 tempest-FlavorsAccessTestJSON-61126716-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:19.509964 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94414a48-c8bb-4a3f-b6be-e4ef8e585470 tempest-FlavorsAccessTestJSON-61126716 tempest-FlavorsAccessTestJSON-61126716-project-admin] PATH_INFO: `/v3/projects/48505b349722444abdc832bcb0090b28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:19.511260 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94414a48-c8bb-4a3f-b6be-e4ef8e585470 tempest-FlavorsAccessTestJSON-61126716 tempest-FlavorsAccessTestJSON-61126716-project-admin] RBAC: Authorizing `identity:get_project(project_id=48505b349722444abdc832bcb0090b28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:19.513352 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94414a48-c8bb-4a3f-b6be-e4ef8e585470 tempest-FlavorsAccessTestJSON-61126716 tempest-FlavorsAccessTestJSON-61126716-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:19.515876 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 837/1677] 10.222.0.23 () {58 vars in 1443 bytes} [Sat Apr 30 21:10:19 2022] GET /identity/v3/projects/48505b349722444abdc832bcb0090b28 => generated 379 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:10:19.516499 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94414a48-c8bb-4a3f-b6be-e4ef8e585470 tempest-FlavorsAccessTestJSON-61126716 tempest-FlavorsAccessTestJSON-61126716-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:19.518118 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-94414a48-c8bb-4a3f-b6be-e4ef8e585470 tempest-FlavorsAccessTestJSON-61126716 tempest-FlavorsAccessTestJSON-61126716-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:19.518730 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212ef4a2-36b5-4460-90a6-f6253ad33f4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:19.520185 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212ef4a2-36b5-4460-90a6-f6253ad33f4b service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:19.530905 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 841/1678] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:19.532455 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94414a48-c8bb-4a3f-b6be-e4ef8e585470 tempest-FlavorsAccessTestJSON-61126716 tempest-FlavorsAccessTestJSON-61126716-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:19.534407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ef4a2-36b5-4460-90a6-f6253ad33f4b service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:19.536821 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-212ef4a2-36b5-4460-90a6-f6253ad33f4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:19.537499 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16146387-5e2c-4314-ac87-806e4d84d1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:19.538345 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16146387-5e2c-4314-ac87-806e4d84d1d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:19.538628 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16146387-5e2c-4314-ac87-806e4d84d1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:19.538912 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16146387-5e2c-4314-ac87-806e4d84d1d6 admin admin] PATH_INFO: `/v3/users/6996dc31623e433db17e2f0587a32a6d` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:19.540242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16146387-5e2c-4314-ac87-806e4d84d1d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6996dc31623e433db17e2f0587a32a6d)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:19.542241 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16146387-5e2c-4314-ac87-806e4d84d1d6 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:19.553060 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ef4a2-36b5-4460-90a6-f6253ad33f4b service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:19.562366 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910c48b-c3b9-47ba-a6f9-63a734b45d81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:19.563127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910c48b-c3b9-47ba-a6f9-63a734b45d81 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:19.563401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910c48b-c3b9-47ba-a6f9-63a734b45d81 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:19.563677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910c48b-c3b9-47ba-a6f9-63a734b45d81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:19.565604 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3910c48b-c3b9-47ba-a6f9-63a734b45d81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:19.627862 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3910c48b-c3b9-47ba-a6f9-63a734b45d81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:19.629512 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3910c48b-c3b9-47ba-a6f9-63a734b45d81 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:19.639799 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 842/1679] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:19 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:19.640606 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910c48b-c3b9-47ba-a6f9-63a734b45d81 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:19.650653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910c48b-c3b9-47ba-a6f9-63a734b45d81 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:19.656165 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b903a-1587-44ed-915a-14ee8021a62a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:19.656784 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b903a-1587-44ed-915a-14ee8021a62a service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:19.657125 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b903a-1587-44ed-915a-14ee8021a62a service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:19.657400 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b903a-1587-44ed-915a-14ee8021a62a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:19.659189 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-374b903a-1587-44ed-915a-14ee8021a62a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:19.718853 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b903a-1587-44ed-915a-14ee8021a62a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:19.720470 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b903a-1587-44ed-915a-14ee8021a62a service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:19.730603 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 843/1680] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:19 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:19.789451 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b903a-1587-44ed-915a-14ee8021a62a service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:19.800566 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-16146387-5e2c-4314-ac87-806e4d84d1d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6996dc31623e433db17e2f0587a32a6d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:19.803934 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b903a-1587-44ed-915a-14ee8021a62a service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:19.812399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60c0c0-1810-408f-a57b-73a20a440193 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:19.813344 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60c0c0-1810-408f-a57b-73a20a440193 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:19.813629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60c0c0-1810-408f-a57b-73a20a440193 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:19.813958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60c0c0-1810-408f-a57b-73a20a440193 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:19.817018 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9a60c0c0-1810-408f-a57b-73a20a440193 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:19.817370 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-16146387-5e2c-4314-ac87-806e4d84d1d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6996dc31623e433db17e2f0587a32a6d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:19.830264 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60c0c0-1810-408f-a57b-73a20a440193 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:19.831911 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60c0c0-1810-408f-a57b-73a20a440193 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:19.840954 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 844/1681] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:10:19.894212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-16146387-5e2c-4314-ac87-806e4d84d1d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6996dc31623e433db17e2f0587a32a6d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:19.894913 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-16146387-5e2c-4314-ac87-806e4d84d1d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6996dc31623e433db17e2f0587a32a6d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:19.905179 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-16146387-5e2c-4314-ac87-806e4d84d1d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6996dc31623e433db17e2f0587a32a6d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:19.912877 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 838/1682] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:10:19 2022] DELETE /identity/v3/users/6996dc31623e433db17e2f0587a32a6d => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:19.917633 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa8b37-422d-48c5-aecc-9104717b0aa7 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:19.919547 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa8b37-422d-48c5-aecc-9104717b0aa7 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:19.919547 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa8b37-422d-48c5-aecc-9104717b0aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:19.937847 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-9baa8b37-422d-48c5-aecc-9104717b0aa7 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:19.940284 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68434c0f-f530-4432-8a7b-30dd35d40bda None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:19.940580 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68434c0f-f530-4432-8a7b-30dd35d40bda None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:19.940881 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68434c0f-f530-4432-8a7b-30dd35d40bda None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:19.942436 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9baa8b37-422d-48c5-aecc-9104717b0aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:19.947060 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 839/1683] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:10:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 21:10:19.949475 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da91f67-70b9-4b32-9bdd-3fcd42fda532 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:19.949783 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da91f67-70b9-4b32-9bdd-3fcd42fda532 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:19.950065 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da91f67-70b9-4b32-9bdd-3fcd42fda532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:19.972375 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-1da91f67-70b9-4b32-9bdd-3fcd42fda532 None None] MFA Rules not processed for user `fca4ee1f64c8489ebe7296f9f8f0ab41`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:19.973679 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1da91f67-70b9-4b32-9bdd-3fcd42fda532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:20.024055 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 845/1684] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:20.027174 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa8b37-422d-48c5-aecc-9104717b0aa7 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:20.027174 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9baa8b37-422d-48c5-aecc-9104717b0aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:20.041415 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa8b37-422d-48c5-aecc-9104717b0aa7 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:20.048477 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4bf47-50a2-4c0c-aa05-5bf01c2e5ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:20.049334 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4bf47-50a2-4c0c-aa05-5bf01c2e5ba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:20.049617 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4bf47-50a2-4c0c-aa05-5bf01c2e5ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:20.049987 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4bf47-50a2-4c0c-aa05-5bf01c2e5ba4 admin admin] PATH_INFO: `/v3/projects/b7ac8da43c5f4ed6bb286257f10d23e9` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:20.051207 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4bf47-50a2-4c0c-aa05-5bf01c2e5ba4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7ac8da43c5f4ed6bb286257f10d23e9)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:20.052227 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-89f4bf47-50a2-4c0c-aa05-5bf01c2e5ba4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:10:20.052227 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:10:20.052227 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:10:20.053693 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4bf47-50a2-4c0c-aa05-5bf01c2e5ba4 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:20.065018 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 840/1685] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:10:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:10:20.065901 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da91f67-70b9-4b32-9bdd-3fcd42fda532 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:20.067477 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1da91f67-70b9-4b32-9bdd-3fcd42fda532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:20.128432 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da91f67-70b9-4b32-9bdd-3fcd42fda532 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:20.132115 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425b2d2-e574-4f59-b6f5-04377eba02a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:20.132775 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425b2d2-e574-4f59-b6f5-04377eba02a7 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:20.133058 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425b2d2-e574-4f59-b6f5-04377eba02a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:20.133336 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425b2d2-e574-4f59-b6f5-04377eba02a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:20.142710 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d425b2d2-e574-4f59-b6f5-04377eba02a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:20.144280 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d425b2d2-e574-4f59-b6f5-04377eba02a7 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:20.153253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-89f4bf47-50a2-4c0c-aa05-5bf01c2e5ba4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7ac8da43c5f4ed6bb286257f10d23e9', 'request_id': 'req-89f4bf47-50a2-4c0c-aa05-5bf01c2e5ba4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:20.154078 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 841/1686] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:20.160769 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-89f4bf47-50a2-4c0c-aa05-5bf01c2e5ba4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7ac8da43c5f4ed6bb286257f10d23e9', 'request_id': 'req-89f4bf47-50a2-4c0c-aa05-5bf01c2e5ba4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:20.162436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425b2d2-e574-4f59-b6f5-04377eba02a7 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:20.163810 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d425b2d2-e574-4f59-b6f5-04377eba02a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:20.176626 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-89f4bf47-50a2-4c0c-aa05-5bf01c2e5ba4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7ac8da43c5f4ed6bb286257f10d23e9', 'request_id': 'req-89f4bf47-50a2-4c0c-aa05-5bf01c2e5ba4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:20.221703 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425b2d2-e574-4f59-b6f5-04377eba02a7 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:20.242527 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-89f4bf47-50a2-4c0c-aa05-5bf01c2e5ba4 admin admin] The token cache is being invalidate because project b7ac8da43c5f4ed6bb286257f10d23e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:10:20.242822 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-89f4bf47-50a2-4c0c-aa05-5bf01c2e5ba4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:20.243478 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-89f4bf47-50a2-4c0c-aa05-5bf01c2e5ba4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:20.245101 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 846/1687] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:10:20 2022] DELETE /identity/v3/projects/b7ac8da43c5f4ed6bb286257f10d23e9 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:20.246458 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4bf47-50a2-4c0c-aa05-5bf01c2e5ba4 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:20.248371 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-89f4bf47-50a2-4c0c-aa05-5bf01c2e5ba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:20.273489 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7dc55-9bb3-4ad8-9700-ffa56e4b895d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e302b1298dd04d6590e3d079f7b13b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:20.274506 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7dc55-9bb3-4ad8-9700-ffa56e4b895d service glance] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:20.274848 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7dc55-9bb3-4ad8-9700-ffa56e4b895d service glance] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:20.275167 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7dc55-9bb3-4ad8-9700-ffa56e4b895d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:20.276963 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-bbf7dc55-9bb3-4ad8-9700-ffa56e4b895d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:20.322090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4bf47-50a2-4c0c-aa05-5bf01c2e5ba4 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:20.328655 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9be88-6ae1-465e-bf62-d025ea63155c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:20.329337 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9be88-6ae1-465e-bf62-d025ea63155c service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:20.329621 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9be88-6ae1-465e-bf62-d025ea63155c service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:20.329985 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9be88-6ae1-465e-bf62-d025ea63155c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:20.331962 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-fcd9be88-6ae1-465e-bf62-d025ea63155c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:20.353106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7dc55-9bb3-4ad8-9700-ffa56e4b895d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:20.353106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7dc55-9bb3-4ad8-9700-ffa56e4b895d service glance] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:20.364048 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 842/1688] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:20.364890 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7dc55-9bb3-4ad8-9700-ffa56e4b895d service glance] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:20.366286 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-bbf7dc55-9bb3-4ad8-9700-ffa56e4b895d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:20.393356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd9be88-6ae1-465e-bf62-d025ea63155c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:20.395189 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd9be88-6ae1-465e-bf62-d025ea63155c service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:20.405072 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 847/1689] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:20.436202 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7dc55-9bb3-4ad8-9700-ffa56e4b895d service glance] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:20.442578 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa04d1b-c11b-4b50-a4f4-d227a15e26f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:20.443571 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa04d1b-c11b-4b50-a4f4-d227a15e26f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:20.443959 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa04d1b-c11b-4b50-a4f4-d227a15e26f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:20.444336 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa04d1b-c11b-4b50-a4f4-d227a15e26f1 admin admin] PATH_INFO: `/v3/users/a8dd20fef4a242b1a8963a3e0e20bcf4` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:20.445680 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa04d1b-c11b-4b50-a4f4-d227a15e26f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8dd20fef4a242b1a8963a3e0e20bcf4)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:20.447927 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa04d1b-c11b-4b50-a4f4-d227a15e26f1 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:20.467248 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9be88-6ae1-465e-bf62-d025ea63155c service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:20.480352 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9be88-6ae1-465e-bf62-d025ea63155c service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:20.486668 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac01e3-bf36-473f-925b-da2fa7835d9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:20.487318 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac01e3-bf36-473f-925b-da2fa7835d9e service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:20.487601 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac01e3-bf36-473f-925b-da2fa7835d9e service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:20.487921 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac01e3-bf36-473f-925b-da2fa7835d9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:20.489707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-20ac01e3-bf36-473f-925b-da2fa7835d9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:20.551764 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ac01e3-bf36-473f-925b-da2fa7835d9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:20.553367 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ac01e3-bf36-473f-925b-da2fa7835d9e service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:20.563799 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 848/1690] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:20 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:10:20.592192 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac01e3-bf36-473f-925b-da2fa7835d9e service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:20.594172 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-20ac01e3-bf36-473f-925b-da2fa7835d9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:20.604714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1fa04d1b-c11b-4b50-a4f4-d227a15e26f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8dd20fef4a242b1a8963a3e0e20bcf4'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:20.619119 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1fa04d1b-c11b-4b50-a4f4-d227a15e26f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8dd20fef4a242b1a8963a3e0e20bcf4'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:20.624413 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac01e3-bf36-473f-925b-da2fa7835d9e service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:20.637945 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60928f-b157-4735-acea-5c36e9bc14fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:20.638878 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60928f-b157-4735-acea-5c36e9bc14fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:20.639731 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60928f-b157-4735-acea-5c36e9bc14fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:20.640027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60928f-b157-4735-acea-5c36e9bc14fe admin admin] PATH_INFO: `/v3/projects/609b6e89fbbe40388f92ad00268eebdb` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:20.641286 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea60928f-b157-4735-acea-5c36e9bc14fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=609b6e89fbbe40388f92ad00268eebdb)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:20.643258 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea60928f-b157-4735-acea-5c36e9bc14fe admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:20.672123 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1fa04d1b-c11b-4b50-a4f4-d227a15e26f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8dd20fef4a242b1a8963a3e0e20bcf4'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:20.672873 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1fa04d1b-c11b-4b50-a4f4-d227a15e26f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8dd20fef4a242b1a8963a3e0e20bcf4'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:20.680844 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1fa04d1b-c11b-4b50-a4f4-d227a15e26f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8dd20fef4a242b1a8963a3e0e20bcf4'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:20.687494 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 843/1691] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:10:20 2022] DELETE /identity/v3/users/a8dd20fef4a242b1a8963a3e0e20bcf4 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:20.689861 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa04d1b-c11b-4b50-a4f4-d227a15e26f1 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:20.689861 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1fa04d1b-c11b-4b50-a4f4-d227a15e26f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:20.765923 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ea60928f-b157-4735-acea-5c36e9bc14fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '609b6e89fbbe40388f92ad00268eebdb', 'request_id': 'req-ea60928f-b157-4735-acea-5c36e9bc14fe'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:20.774516 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ea60928f-b157-4735-acea-5c36e9bc14fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '609b6e89fbbe40388f92ad00268eebdb', 'request_id': 'req-ea60928f-b157-4735-acea-5c36e9bc14fe'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:20.783582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ea60928f-b157-4735-acea-5c36e9bc14fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '609b6e89fbbe40388f92ad00268eebdb', 'request_id': 'req-ea60928f-b157-4735-acea-5c36e9bc14fe'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:20.805185 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa04d1b-c11b-4b50-a4f4-d227a15e26f1 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:20.861171 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb77411-7a31-4530-81ea-b437a72a129c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:20.862125 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb77411-7a31-4530-81ea-b437a72a129c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:20.862405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb77411-7a31-4530-81ea-b437a72a129c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:20.862681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb77411-7a31-4530-81ea-b437a72a129c admin admin] PATH_INFO: `/v3/users/7a47e7dce36e4828a9755f8bb9105f22` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:20.863879 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb77411-7a31-4530-81ea-b437a72a129c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a47e7dce36e4828a9755f8bb9105f22)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:20.865921 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb77411-7a31-4530-81ea-b437a72a129c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:20.912066 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ea60928f-b157-4735-acea-5c36e9bc14fe admin admin] The token cache is being invalidate because project 609b6e89fbbe40388f92ad00268eebdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:10:20.912513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ea60928f-b157-4735-acea-5c36e9bc14fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:20.913148 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ea60928f-b157-4735-acea-5c36e9bc14fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:20.914758 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 849/1692] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:10:20 2022] DELETE /identity/v3/projects/609b6e89fbbe40388f92ad00268eebdb => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:10:20.919020 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b412b9c-1a12-4f1b-8359-e6977ef64d55 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:20.919306 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b412b9c-1a12-4f1b-8359-e6977ef64d55 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:20.919578 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b412b9c-1a12-4f1b-8359-e6977ef64d55 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:20.921843 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 850/1693] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:10:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:10:20.922582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b412b9c-1a12-4f1b-8359-e6977ef64d55 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:20.924266 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5b412b9c-1a12-4f1b-8359-e6977ef64d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:20.939834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b412b9c-1a12-4f1b-8359-e6977ef64d55 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:20.944761 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e482ce3-27c0-4809-b4e8-387a3512d638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:20.945698 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e482ce3-27c0-4809-b4e8-387a3512d638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:20.946012 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e482ce3-27c0-4809-b4e8-387a3512d638 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:20.946286 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e482ce3-27c0-4809-b4e8-387a3512d638 admin admin] PATH_INFO: `/v3/users/9c1363f86b5e43339ce68fdf785103c7` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:20.947916 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e482ce3-27c0-4809-b4e8-387a3512d638 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c1363f86b5e43339ce68fdf785103c7)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:20.949451 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e482ce3-27c0-4809-b4e8-387a3512d638 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:21.056829 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4cb77411-7a31-4530-81ea-b437a72a129c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a47e7dce36e4828a9755f8bb9105f22'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:21.080299 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4cb77411-7a31-4530-81ea-b437a72a129c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a47e7dce36e4828a9755f8bb9105f22'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:21.131585 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2e482ce3-27c0-4809-b4e8-387a3512d638 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c1363f86b5e43339ce68fdf785103c7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:21.136135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4cb77411-7a31-4530-81ea-b437a72a129c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a47e7dce36e4828a9755f8bb9105f22'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:21.136794 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4cb77411-7a31-4530-81ea-b437a72a129c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a47e7dce36e4828a9755f8bb9105f22'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:21.152702 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2e482ce3-27c0-4809-b4e8-387a3512d638 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c1363f86b5e43339ce68fdf785103c7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:21.156689 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4cb77411-7a31-4530-81ea-b437a72a129c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a47e7dce36e4828a9755f8bb9105f22'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:21.163260 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 844/1694] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:10:20 2022] DELETE /identity/v3/users/7a47e7dce36e4828a9755f8bb9105f22 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:21.166871 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb77411-7a31-4530-81ea-b437a72a129c admin admin] Authenticating service token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 30 21:10:21.168257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4cb77411-7a31-4530-81ea-b437a72a129c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:21.250046 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2e482ce3-27c0-4809-b4e8-387a3512d638 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c1363f86b5e43339ce68fdf785103c7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:21.260325 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2e482ce3-27c0-4809-b4e8-387a3512d638 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c1363f86b5e43339ce68fdf785103c7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:21.261118 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2e482ce3-27c0-4809-b4e8-387a3512d638 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c1363f86b5e43339ce68fdf785103c7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:21.269062 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 851/1695] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:10:20 2022] DELETE /identity/v3/users/9c1363f86b5e43339ce68fdf785103c7 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:21.270263 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e482ce3-27c0-4809-b4e8-387a3512d638 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:21.271460 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2e482ce3-27c0-4809-b4e8-387a3512d638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:21.278502 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb77411-7a31-4530-81ea-b437a72a129c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:21.280392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4cb77411-7a31-4530-81ea-b437a72a129c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:21.349414 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e482ce3-27c0-4809-b4e8-387a3512d638 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:21.355443 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb77411-7a31-4530-81ea-b437a72a129c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:21.358494 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bd5d0-08cd-4fc8-9ec0-cda31e599db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:21.358494 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bd5d0-08cd-4fc8-9ec0-cda31e599db1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:21.358494 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bd5d0-08cd-4fc8-9ec0-cda31e599db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:21.358494 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bd5d0-08cd-4fc8-9ec0-cda31e599db1 admin admin] PATH_INFO: `/v3/users/6a7e0770efcf4733a2770a9f0439ad50` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:21.359869 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bd5d0-08cd-4fc8-9ec0-cda31e599db1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a7e0770efcf4733a2770a9f0439ad50)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:21.361920 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bd5d0-08cd-4fc8-9ec0-cda31e599db1 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:21.430837 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7cfe9-f094-4bc2-aa2f-06649ec5f6e8 tempest-FlavorsAccessTestJSON-61126716 tempest-FlavorsAccessTestJSON-61126716-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e794f888bafc4457b68efd8982732607', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7df016afa19d4768bfee72654a5bb6fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:21.431720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7cfe9-f094-4bc2-aa2f-06649ec5f6e8 tempest-FlavorsAccessTestJSON-61126716 tempest-FlavorsAccessTestJSON-61126716-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:21.432009 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7cfe9-f094-4bc2-aa2f-06649ec5f6e8 tempest-FlavorsAccessTestJSON-61126716 tempest-FlavorsAccessTestJSON-61126716-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:21.432288 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7cfe9-f094-4bc2-aa2f-06649ec5f6e8 tempest-FlavorsAccessTestJSON-61126716 tempest-FlavorsAccessTestJSON-61126716-project-admin] PATH_INFO: `/v3/projects/48505b349722444abdc832bcb0090b28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:21.434018 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e7cfe9-f094-4bc2-aa2f-06649ec5f6e8 tempest-FlavorsAccessTestJSON-61126716 tempest-FlavorsAccessTestJSON-61126716-project-admin] RBAC: Authorizing `identity:get_project(project_id=48505b349722444abdc832bcb0090b28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:21.436624 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e7cfe9-f094-4bc2-aa2f-06649ec5f6e8 tempest-FlavorsAccessTestJSON-61126716 tempest-FlavorsAccessTestJSON-61126716-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:21.438449 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 845/1696] 10.222.0.23 () {58 vars in 1443 bytes} [Sat Apr 30 21:10:21 2022] GET /identity/v3/projects/48505b349722444abdc832bcb0090b28 => generated 379 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:10:21.440678 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7cfe9-f094-4bc2-aa2f-06649ec5f6e8 tempest-FlavorsAccessTestJSON-61126716 tempest-FlavorsAccessTestJSON-61126716-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:21.441810 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c8e7cfe9-f094-4bc2-aa2f-06649ec5f6e8 tempest-FlavorsAccessTestJSON-61126716 tempest-FlavorsAccessTestJSON-61126716-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:21.523003 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7cfe9-f094-4bc2-aa2f-06649ec5f6e8 tempest-FlavorsAccessTestJSON-61126716 tempest-FlavorsAccessTestJSON-61126716-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:21.530120 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1cb6da-823f-47df-998e-9972fb44be43 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:21.530904 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cb6da-823f-47df-998e-9972fb44be43 service placement] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:21.531259 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cb6da-823f-47df-998e-9972fb44be43 service placement] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:21.531548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cb6da-823f-47df-998e-9972fb44be43 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:21.533474 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2e1cb6da-823f-47df-998e-9972fb44be43 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:21.552451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1cb6da-823f-47df-998e-9972fb44be43 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:21.554048 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1cb6da-823f-47df-998e-9972fb44be43 service placement] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:21.567224 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 846/1697] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:21.568715 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75767970-045b-4bd5-b318-aaf170e66f7e None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:21.568999 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75767970-045b-4bd5-b318-aaf170e66f7e None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:21.569282 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75767970-045b-4bd5-b318-aaf170e66f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:21.590249 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-667bd5d0-08cd-4fc8-9ec0-cda31e599db1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a7e0770efcf4733a2770a9f0439ad50'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:21.590406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-75767970-045b-4bd5-b318-aaf170e66f7e None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:21.591693 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-75767970-045b-4bd5-b318-aaf170e66f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:21.619977 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 847/1698] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:21.620136 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-667bd5d0-08cd-4fc8-9ec0-cda31e599db1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a7e0770efcf4733a2770a9f0439ad50'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:21.620228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75767970-045b-4bd5-b318-aaf170e66f7e None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:21.620228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-75767970-045b-4bd5-b318-aaf170e66f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:21.630632 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75767970-045b-4bd5-b318-aaf170e66f7e None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:21.636456 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb55fd7-b3d7-44e1-8a69-aea711ecd6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:21.637521 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb55fd7-b3d7-44e1-8a69-aea711ecd6d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:21.637844 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb55fd7-b3d7-44e1-8a69-aea711ecd6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:21.638126 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb55fd7-b3d7-44e1-8a69-aea711ecd6d2 admin admin] PATH_INFO: `/v3/projects/823953b5766f4264b65b18349bb0e32d` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:21.640187 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb55fd7-b3d7-44e1-8a69-aea711ecd6d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=823953b5766f4264b65b18349bb0e32d)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:21.642702 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb55fd7-b3d7-44e1-8a69-aea711ecd6d2 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:21.736321 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-667bd5d0-08cd-4fc8-9ec0-cda31e599db1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a7e0770efcf4733a2770a9f0439ad50'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:21.744386 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-667bd5d0-08cd-4fc8-9ec0-cda31e599db1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a7e0770efcf4733a2770a9f0439ad50'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:21.745337 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-667bd5d0-08cd-4fc8-9ec0-cda31e599db1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a7e0770efcf4733a2770a9f0439ad50'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:21.756060 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 852/1699] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:10:21 2022] DELETE /identity/v3/users/6a7e0770efcf4733a2770a9f0439ad50 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:21.756060 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bd5d0-08cd-4fc8-9ec0-cda31e599db1 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:21.761590 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-667bd5d0-08cd-4fc8-9ec0-cda31e599db1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:21.824173 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1eb55fd7-b3d7-44e1-8a69-aea711ecd6d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '823953b5766f4264b65b18349bb0e32d', 'request_id': 'req-1eb55fd7-b3d7-44e1-8a69-aea711ecd6d2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:21.829804 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1eb55fd7-b3d7-44e1-8a69-aea711ecd6d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '823953b5766f4264b65b18349bb0e32d', 'request_id': 'req-1eb55fd7-b3d7-44e1-8a69-aea711ecd6d2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:21.834356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bd5d0-08cd-4fc8-9ec0-cda31e599db1 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:21.837238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1eb55fd7-b3d7-44e1-8a69-aea711ecd6d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '823953b5766f4264b65b18349bb0e32d', 'request_id': 'req-1eb55fd7-b3d7-44e1-8a69-aea711ecd6d2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:21.886332 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f5810-cac6-4f21-8410-c7b11e662e79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:21.887116 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f5810-cac6-4f21-8410-c7b11e662e79 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:21.888206 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f5810-cac6-4f21-8410-c7b11e662e79 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:21.888604 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f5810-cac6-4f21-8410-c7b11e662e79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:21.890516 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6d3f5810-cac6-4f21-8410-c7b11e662e79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:21.928909 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1eb55fd7-b3d7-44e1-8a69-aea711ecd6d2 admin admin] The token cache is being invalidate because project 823953b5766f4264b65b18349bb0e32d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:10:21.929197 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1eb55fd7-b3d7-44e1-8a69-aea711ecd6d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:21.929922 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1eb55fd7-b3d7-44e1-8a69-aea711ecd6d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:21.931476 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 848/1700] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:10:21 2022] DELETE /identity/v3/projects/823953b5766f4264b65b18349bb0e32d => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:21.932292 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb55fd7-b3d7-44e1-8a69-aea711ecd6d2 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:21.934034 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1eb55fd7-b3d7-44e1-8a69-aea711ecd6d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:21.964308 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f5810-cac6-4f21-8410-c7b11e662e79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:21.966320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f5810-cac6-4f21-8410-c7b11e662e79 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:21.977156 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 853/1701] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:21.978755 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ece680-6f87-4907-b594-d4f63a1c6989 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:21.979246 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ece680-6f87-4907-b594-d4f63a1c6989 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:21.979746 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ece680-6f87-4907-b594-d4f63a1c6989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:21.997453 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-d6ece680-6f87-4907-b594-d4f63a1c6989 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:21.998764 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d6ece680-6f87-4907-b594-d4f63a1c6989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:22.010047 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 854/1702] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:22.010047 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ece680-6f87-4907-b594-d4f63a1c6989 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:22.010269 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb55fd7-b3d7-44e1-8a69-aea711ecd6d2 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:22.011545 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d6ece680-6f87-4907-b594-d4f63a1c6989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:22.020462 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63c795-69b4-4eef-8eb8-ff0446f5f80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:22.021362 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63c795-69b4-4eef-8eb8-ff0446f5f80f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:22.021647 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63c795-69b4-4eef-8eb8-ff0446f5f80f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:22.021958 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63c795-69b4-4eef-8eb8-ff0446f5f80f admin admin] PATH_INFO: `/v3/users/fe00c7f2ec9f4d2b847741a188e301db` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:22.023260 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63c795-69b4-4eef-8eb8-ff0446f5f80f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe00c7f2ec9f4d2b847741a188e301db)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:22.024845 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ece680-6f87-4907-b594-d4f63a1c6989 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:22.025384 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63c795-69b4-4eef-8eb8-ff0446f5f80f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:22.031082 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45acc267-5f44-4220-8643-f1ed6816e389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:22.032552 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45acc267-5f44-4220-8643-f1ed6816e389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:22.032945 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45acc267-5f44-4220-8643-f1ed6816e389 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:22.033295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45acc267-5f44-4220-8643-f1ed6816e389 admin admin] PATH_INFO: `/v3/projects/c1a16992b76c4cb28b2b554827420aa2` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:22.034980 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45acc267-5f44-4220-8643-f1ed6816e389 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1a16992b76c4cb28b2b554827420aa2)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:22.037401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45acc267-5f44-4220-8643-f1ed6816e389 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:22.254171 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-45acc267-5f44-4220-8643-f1ed6816e389 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1a16992b76c4cb28b2b554827420aa2', 'request_id': 'req-45acc267-5f44-4220-8643-f1ed6816e389'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:22.258134 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5a63c795-69b4-4eef-8eb8-ff0446f5f80f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe00c7f2ec9f4d2b847741a188e301db'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:22.260087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-45acc267-5f44-4220-8643-f1ed6816e389 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1a16992b76c4cb28b2b554827420aa2', 'request_id': 'req-45acc267-5f44-4220-8643-f1ed6816e389'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:22.271967 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-45acc267-5f44-4220-8643-f1ed6816e389 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1a16992b76c4cb28b2b554827420aa2', 'request_id': 'req-45acc267-5f44-4220-8643-f1ed6816e389'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:22.277178 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5a63c795-69b4-4eef-8eb8-ff0446f5f80f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe00c7f2ec9f4d2b847741a188e301db'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:22.352643 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5a63c795-69b4-4eef-8eb8-ff0446f5f80f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe00c7f2ec9f4d2b847741a188e301db'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:22.353201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5a63c795-69b4-4eef-8eb8-ff0446f5f80f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe00c7f2ec9f4d2b847741a188e301db'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:22.360489 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5a63c795-69b4-4eef-8eb8-ff0446f5f80f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe00c7f2ec9f4d2b847741a188e301db'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:22.366760 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 849/1703] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:10:21 2022] DELETE /identity/v3/users/fe00c7f2ec9f4d2b847741a188e301db => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:22.371162 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45da424-5873-463f-84b5-b378a30fe021 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:22.371687 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45da424-5873-463f-84b5-b378a30fe021 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:22.371952 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45da424-5873-463f-84b5-b378a30fe021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:22.391662 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-b45da424-5873-463f-84b5-b378a30fe021 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:22.392872 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b45da424-5873-463f-84b5-b378a30fe021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:22.449236 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-45acc267-5f44-4220-8643-f1ed6816e389 admin admin] The token cache is being invalidate because project c1a16992b76c4cb28b2b554827420aa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:10:22.449663 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-45acc267-5f44-4220-8643-f1ed6816e389 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:22.450423 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-45acc267-5f44-4220-8643-f1ed6816e389 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:22.452705 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 855/1704] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:10:22 2022] DELETE /identity/v3/projects/c1a16992b76c4cb28b2b554827420aa2 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:22.453637 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45acc267-5f44-4220-8643-f1ed6816e389 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:22.454773 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 850/1705] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:22.455529 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-45acc267-5f44-4220-8643-f1ed6816e389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:22.455744 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45da424-5873-463f-84b5-b378a30fe021 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:22.457023 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b45da424-5873-463f-84b5-b378a30fe021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:22.512971 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45da424-5873-463f-84b5-b378a30fe021 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:22.517203 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b87641-7a88-4b4b-97a1-d9d0f81e58b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:22.517879 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b87641-7a88-4b4b-97a1-d9d0f81e58b4 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:22.518165 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b87641-7a88-4b4b-97a1-d9d0f81e58b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:22.518449 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b87641-7a88-4b4b-97a1-d9d0f81e58b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:22.520354 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-25b87641-7a88-4b4b-97a1-d9d0f81e58b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:22.527505 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45acc267-5f44-4220-8643-f1ed6816e389 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:22.532301 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b87641-7a88-4b4b-97a1-d9d0f81e58b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:22.533116 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d33f2-b10f-4bb2-aaf1-44e80d53c7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:22.533886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b87641-7a88-4b4b-97a1-d9d0f81e58b4 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:22.534071 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d33f2-b10f-4bb2-aaf1-44e80d53c7af admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:22.534335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d33f2-b10f-4bb2-aaf1-44e80d53c7af admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:22.534612 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d33f2-b10f-4bb2-aaf1-44e80d53c7af admin admin] PATH_INFO: `/v3/users/5125db469f7b4fb2a8b22c01097695a1` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:22.535844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d33f2-b10f-4bb2-aaf1-44e80d53c7af admin admin] RBAC: Authorizing `identity:delete_user(user_id=5125db469f7b4fb2a8b22c01097695a1)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:22.537787 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d33f2-b10f-4bb2-aaf1-44e80d53c7af admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:22.543693 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 851/1706] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:22.548766 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e471866-5165-421d-ab46-9df9796c57e7 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:22.548766 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e471866-5165-421d-ab46-9df9796c57e7 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:22.548766 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e471866-5165-421d-ab46-9df9796c57e7 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:22.548766 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 852/1707] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:10:22.548766 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2661c1-fea3-4130-aa68-b81d86071da1 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:22.548766 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2661c1-fea3-4130-aa68-b81d86071da1 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:22.549217 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2661c1-fea3-4130-aa68-b81d86071da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:22.568301 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-1d2661c1-fea3-4130-aa68-b81d86071da1 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:22.569609 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1d2661c1-fea3-4130-aa68-b81d86071da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:22.578416 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 853/1708] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:22.579253 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2661c1-fea3-4130-aa68-b81d86071da1 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:22.580571 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1d2661c1-fea3-4130-aa68-b81d86071da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:22.592277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2661c1-fea3-4130-aa68-b81d86071da1 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:22.597004 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e59f6-6718-43f0-8ade-a1616adb3e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:22.597899 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e59f6-6718-43f0-8ade-a1616adb3e23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:22.598182 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e59f6-6718-43f0-8ade-a1616adb3e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:22.598455 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e59f6-6718-43f0-8ade-a1616adb3e23 admin admin] PATH_INFO: `/v3/projects/54923026560f4b51aa283b9fc0fd4737` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:22.599624 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e59f6-6718-43f0-8ade-a1616adb3e23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54923026560f4b51aa283b9fc0fd4737)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:22.602200 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e59f6-6718-43f0-8ade-a1616adb3e23 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:22.791252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-506d33f2-b10f-4bb2-aaf1-44e80d53c7af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5125db469f7b4fb2a8b22c01097695a1'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:22.795465 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b41e59f6-6718-43f0-8ade-a1616adb3e23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54923026560f4b51aa283b9fc0fd4737', 'request_id': 'req-b41e59f6-6718-43f0-8ade-a1616adb3e23'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:22.802519 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b41e59f6-6718-43f0-8ade-a1616adb3e23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54923026560f4b51aa283b9fc0fd4737', 'request_id': 'req-b41e59f6-6718-43f0-8ade-a1616adb3e23'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:22.804234 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-506d33f2-b10f-4bb2-aaf1-44e80d53c7af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5125db469f7b4fb2a8b22c01097695a1'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:22.810649 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b41e59f6-6718-43f0-8ade-a1616adb3e23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54923026560f4b51aa283b9fc0fd4737', 'request_id': 'req-b41e59f6-6718-43f0-8ade-a1616adb3e23'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:22.866487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-506d33f2-b10f-4bb2-aaf1-44e80d53c7af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5125db469f7b4fb2a8b22c01097695a1'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:22.874142 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-506d33f2-b10f-4bb2-aaf1-44e80d53c7af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5125db469f7b4fb2a8b22c01097695a1'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:22.874775 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-506d33f2-b10f-4bb2-aaf1-44e80d53c7af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5125db469f7b4fb2a8b22c01097695a1'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:22.880669 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 856/1709] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:10:22 2022] DELETE /identity/v3/users/5125db469f7b4fb2a8b22c01097695a1 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:22.882145 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d5beb-f7ae-4ec8-9beb-e1346c2cde89 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:22.882438 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d5beb-f7ae-4ec8-9beb-e1346c2cde89 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:22.882716 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d5beb-f7ae-4ec8-9beb-e1346c2cde89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:22.901302 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-5d9d5beb-f7ae-4ec8-9beb-e1346c2cde89 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:22.902771 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5d9d5beb-f7ae-4ec8-9beb-e1346c2cde89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:22.964621 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 857/1710] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:22.965962 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344d261-af65-483e-8237-41e44e3666fa None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:22.966258 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344d261-af65-483e-8237-41e44e3666fa None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:22.966540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344d261-af65-483e-8237-41e44e3666fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:22.972855 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b41e59f6-6718-43f0-8ade-a1616adb3e23 admin admin] The token cache is being invalidate because project 54923026560f4b51aa283b9fc0fd4737 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:10:22.973147 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b41e59f6-6718-43f0-8ade-a1616adb3e23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:22.973826 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b41e59f6-6718-43f0-8ade-a1616adb3e23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:22.975403 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 854/1711] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:10:22 2022] DELETE /identity/v3/projects/54923026560f4b51aa283b9fc0fd4737 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:22.976804 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb35ab-8bd8-470d-8c93-7a7d2e7c84b7 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:22.977094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb35ab-8bd8-470d-8c93-7a7d2e7c84b7 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:22.977372 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb35ab-8bd8-470d-8c93-7a7d2e7c84b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:22.989240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-7344d261-af65-483e-8237-41e44e3666fa None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:22.990498 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7344d261-af65-483e-8237-41e44e3666fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:22.998718 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 858/1712] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:22.999524 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344d261-af65-483e-8237-41e44e3666fa None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:23.000815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7344d261-af65-483e-8237-41e44e3666fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:23.024626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-88cb35ab-8bd8-470d-8c93-7a7d2e7c84b7 None None] MFA Rules not processed for user `fca4ee1f64c8489ebe7296f9f8f0ab41`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:23.025883 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-88cb35ab-8bd8-470d-8c93-7a7d2e7c84b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:23.060299 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344d261-af65-483e-8237-41e44e3666fa None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:23.064512 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5045248-40cf-4570-ad1b-245ee9883c0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:23.065158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5045248-40cf-4570-ad1b-245ee9883c0d service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:23.065442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5045248-40cf-4570-ad1b-245ee9883c0d service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:23.065718 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5045248-40cf-4570-ad1b-245ee9883c0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:23.067857 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e5045248-40cf-4570-ad1b-245ee9883c0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:23.080380 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5045248-40cf-4570-ad1b-245ee9883c0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:23.081923 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5045248-40cf-4570-ad1b-245ee9883c0d service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:23.091348 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 859/1713] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:23.092872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2cee25-acf5-48c6-a121-d52a349df676 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:23.092997 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 855/1714] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:10:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:23.093216 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2cee25-acf5-48c6-a121-d52a349df676 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:23.093492 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2cee25-acf5-48c6-a121-d52a349df676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:23.093860 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb35ab-8bd8-470d-8c93-7a7d2e7c84b7 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:23.095260 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-88cb35ab-8bd8-470d-8c93-7a7d2e7c84b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:23.109243 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb35ab-8bd8-470d-8c93-7a7d2e7c84b7 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:23.112388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-ca2cee25-acf5-48c6-a121-d52a349df676 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:23.113649 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ca2cee25-acf5-48c6-a121-d52a349df676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:23.114073 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50344c3-4f0a-481b-86c2-3627379016ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:23.114926 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50344c3-4f0a-481b-86c2-3627379016ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:23.115208 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50344c3-4f0a-481b-86c2-3627379016ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:23.115482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50344c3-4f0a-481b-86c2-3627379016ba admin admin] PATH_INFO: `/v3/projects/11caae4491db49e59e9ba5ece121e1ae` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:23.116740 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50344c3-4f0a-481b-86c2-3627379016ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=11caae4491db49e59e9ba5ece121e1ae)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:23.118733 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50344c3-4f0a-481b-86c2-3627379016ba admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:23.125197 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 860/1715] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:23.125197 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2cee25-acf5-48c6-a121-d52a349df676 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:23.126558 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ca2cee25-acf5-48c6-a121-d52a349df676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:23.139354 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2cee25-acf5-48c6-a121-d52a349df676 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:23.144328 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902297db-8e33-42bf-bf32-e29086d965fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:23.144984 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902297db-8e33-42bf-bf32-e29086d965fe admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:23.145317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902297db-8e33-42bf-bf32-e29086d965fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:23.145540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902297db-8e33-42bf-bf32-e29086d965fe admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:23.146303 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902297db-8e33-42bf-bf32-e29086d965fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:10:23.146611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902297db-8e33-42bf-bf32-e29086d965fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:23.148217 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902297db-8e33-42bf-bf32-e29086d965fe admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:23.160285 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 861/1716] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:10:23.164648 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902297db-8e33-42bf-bf32-e29086d965fe admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:23.166437 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-902297db-8e33-42bf-bf32-e29086d965fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:23.179958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902297db-8e33-42bf-bf32-e29086d965fe admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:23.187419 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b721bc-6de0-4e0a-9599-882fda9500ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:23.188303 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b721bc-6de0-4e0a-9599-882fda9500ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:23.188587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b721bc-6de0-4e0a-9599-882fda9500ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:23.188870 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b721bc-6de0-4e0a-9599-882fda9500ef admin admin] PATH_INFO: `/v3/users/16785a3fa02a48498119761cd6da31be` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:23.190290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b721bc-6de0-4e0a-9599-882fda9500ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=16785a3fa02a48498119761cd6da31be)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:23.192476 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b721bc-6de0-4e0a-9599-882fda9500ef admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:23.220140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f50344c3-4f0a-481b-86c2-3627379016ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11caae4491db49e59e9ba5ece121e1ae', 'request_id': 'req-f50344c3-4f0a-481b-86c2-3627379016ba'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:23.225574 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f50344c3-4f0a-481b-86c2-3627379016ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11caae4491db49e59e9ba5ece121e1ae', 'request_id': 'req-f50344c3-4f0a-481b-86c2-3627379016ba'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:23.231762 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f50344c3-4f0a-481b-86c2-3627379016ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11caae4491db49e59e9ba5ece121e1ae', 'request_id': 'req-f50344c3-4f0a-481b-86c2-3627379016ba'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:23.351050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f50344c3-4f0a-481b-86c2-3627379016ba admin admin] The token cache is being invalidate because project 11caae4491db49e59e9ba5ece121e1ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:10:23.351356 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f50344c3-4f0a-481b-86c2-3627379016ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:23.352169 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f50344c3-4f0a-481b-86c2-3627379016ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:23.354004 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 856/1717] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:10:23 2022] DELETE /identity/v3/projects/11caae4491db49e59e9ba5ece121e1ae => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:23.355583 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21083b-77b9-4e44-b955-ebfd024c2cbe None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:23.355945 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21083b-77b9-4e44-b955-ebfd024c2cbe None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:23.356293 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21083b-77b9-4e44-b955-ebfd024c2cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:23.379453 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-1f21083b-77b9-4e44-b955-ebfd024c2cbe None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:23.380733 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1f21083b-77b9-4e44-b955-ebfd024c2cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:23.383835 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c6b721bc-6de0-4e0a-9599-882fda9500ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16785a3fa02a48498119761cd6da31be'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:23.397496 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c6b721bc-6de0-4e0a-9599-882fda9500ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16785a3fa02a48498119761cd6da31be'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:23.445352 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 857/1718] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:23.446633 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21083b-77b9-4e44-b955-ebfd024c2cbe None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:23.447932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1f21083b-77b9-4e44-b955-ebfd024c2cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:23.472507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c6b721bc-6de0-4e0a-9599-882fda9500ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16785a3fa02a48498119761cd6da31be'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:23.480358 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c6b721bc-6de0-4e0a-9599-882fda9500ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16785a3fa02a48498119761cd6da31be'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:23.481443 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c6b721bc-6de0-4e0a-9599-882fda9500ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16785a3fa02a48498119761cd6da31be'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:23.488327 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 862/1719] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:10:23 2022] DELETE /identity/v3/users/16785a3fa02a48498119761cd6da31be => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:23.489142 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b721bc-6de0-4e0a-9599-882fda9500ef admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:23.493673 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c6b721bc-6de0-4e0a-9599-882fda9500ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:23.510647 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21083b-77b9-4e44-b955-ebfd024c2cbe None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:23.563811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b2744-4ebf-4dfa-bbfc-48c928d6e7ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:23.564500 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b2744-4ebf-4dfa-bbfc-48c928d6e7ff service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:23.564782 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b2744-4ebf-4dfa-bbfc-48c928d6e7ff service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:23.565113 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b2744-4ebf-4dfa-bbfc-48c928d6e7ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:23.567491 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-250b2744-4ebf-4dfa-bbfc-48c928d6e7ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:23.572959 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b721bc-6de0-4e0a-9599-882fda9500ef admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:23.573901 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e560b-25ce-4db4-99ee-78a25192b989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:23.574863 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e560b-25ce-4db4-99ee-78a25192b989 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:23.575320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e560b-25ce-4db4-99ee-78a25192b989 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:23.575790 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e560b-25ce-4db4-99ee-78a25192b989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:23.578968 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3b8e560b-25ce-4db4-99ee-78a25192b989 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:23.643367 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b2744-4ebf-4dfa-bbfc-48c928d6e7ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:23.644856 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b2744-4ebf-4dfa-bbfc-48c928d6e7ff service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:23.656124 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e560b-25ce-4db4-99ee-78a25192b989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:23.657218 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e560b-25ce-4db4-99ee-78a25192b989 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:23.657340 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 858/1720] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:23.657891 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b2744-4ebf-4dfa-bbfc-48c928d6e7ff service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:23.659239 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-250b2744-4ebf-4dfa-bbfc-48c928d6e7ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:23.670982 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 863/1721] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:23.671833 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e560b-25ce-4db4-99ee-78a25192b989 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:23.673349 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3b8e560b-25ce-4db4-99ee-78a25192b989 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:23.674933 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b2744-4ebf-4dfa-bbfc-48c928d6e7ff service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:23.680981 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191542b-b689-49e4-9f6a-6721fd45d934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:23.681974 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191542b-b689-49e4-9f6a-6721fd45d934 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:23.682455 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191542b-b689-49e4-9f6a-6721fd45d934 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:23.682985 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191542b-b689-49e4-9f6a-6721fd45d934 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:23.683868 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191542b-b689-49e4-9f6a-6721fd45d934 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:23.686186 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191542b-b689-49e4-9f6a-6721fd45d934 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:23.686384 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e560b-25ce-4db4-99ee-78a25192b989 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:23.692299 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27714ed-5684-473a-a60c-073954971d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:23.696557 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27714ed-5684-473a-a60c-073954971d9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:23.696557 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27714ed-5684-473a-a60c-073954971d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:23.696557 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27714ed-5684-473a-a60c-073954971d9e admin admin] PATH_INFO: `/v3/users/1555eaa5255042069c474927d736edfe` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:23.696557 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27714ed-5684-473a-a60c-073954971d9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1555eaa5255042069c474927d736edfe)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:23.697065 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27714ed-5684-473a-a60c-073954971d9e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:23.774174 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 859/1722] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:23 2022] POST /identity/v3/projects => generated 389 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:23.775156 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191542b-b689-49e4-9f6a-6721fd45d934 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:23.778749 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2191542b-b689-49e4-9f6a-6721fd45d934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:23.878353 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191542b-b689-49e4-9f6a-6721fd45d934 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:23.883096 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e539a-6f0f-4009-b93d-c6c7b5ced9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:23.883761 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e539a-6f0f-4009-b93d-c6c7b5ced9df admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:23.884040 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e539a-6f0f-4009-b93d-c6c7b5ced9df admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:23.884315 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e539a-6f0f-4009-b93d-c6c7b5ced9df admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:23.885033 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e539a-6f0f-4009-b93d-c6c7b5ced9df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:10:23.885335 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e539a-6f0f-4009-b93d-c6c7b5ced9df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:23.887126 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e539a-6f0f-4009-b93d-c6c7b5ced9df admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:23.899641 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 860/1723] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:10:23.900762 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e539a-6f0f-4009-b93d-c6c7b5ced9df admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:23.902479 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-485e539a-6f0f-4009-b93d-c6c7b5ced9df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:23.921215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e539a-6f0f-4009-b93d-c6c7b5ced9df admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:23.921215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfd074-b210-4cdc-8d5c-2fc3ad35f0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:23.921215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfd074-b210-4cdc-8d5c-2fc3ad35f0c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:23.921640 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfd074-b210-4cdc-8d5c-2fc3ad35f0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:23.921748 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfd074-b210-4cdc-8d5c-2fc3ad35f0c6 admin admin] PATH_INFO: `/v3/projects/40b06682f7ad42eea575a158f9c4d75f` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:23.922891 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bfd074-b210-4cdc-8d5c-2fc3ad35f0c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40b06682f7ad42eea575a158f9c4d75f)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:23.924802 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bfd074-b210-4cdc-8d5c-2fc3ad35f0c6 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:23.955110 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b27714ed-5684-473a-a60c-073954971d9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1555eaa5255042069c474927d736edfe'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:23.966440 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b27714ed-5684-473a-a60c-073954971d9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1555eaa5255042069c474927d736edfe'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:24.064836 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-55bfd074-b210-4cdc-8d5c-2fc3ad35f0c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40b06682f7ad42eea575a158f9c4d75f', 'request_id': 'req-55bfd074-b210-4cdc-8d5c-2fc3ad35f0c6'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:24.067353 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b27714ed-5684-473a-a60c-073954971d9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1555eaa5255042069c474927d736edfe'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:24.075449 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-55bfd074-b210-4cdc-8d5c-2fc3ad35f0c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40b06682f7ad42eea575a158f9c4d75f', 'request_id': 'req-55bfd074-b210-4cdc-8d5c-2fc3ad35f0c6'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:24.080368 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b27714ed-5684-473a-a60c-073954971d9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1555eaa5255042069c474927d736edfe'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:24.082035 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b27714ed-5684-473a-a60c-073954971d9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1555eaa5255042069c474927d736edfe'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:24.087586 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-55bfd074-b210-4cdc-8d5c-2fc3ad35f0c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40b06682f7ad42eea575a158f9c4d75f', 'request_id': 'req-55bfd074-b210-4cdc-8d5c-2fc3ad35f0c6'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:24.091203 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 864/1724] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:10:23 2022] DELETE /identity/v3/users/1555eaa5255042069c474927d736edfe => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:24.092747 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27714ed-5684-473a-a60c-073954971d9e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:24.094465 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b27714ed-5684-473a-a60c-073954971d9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:24.167413 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27714ed-5684-473a-a60c-073954971d9e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:24.176771 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03a9e3-0a67-4289-8fd0-8c9409314462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:24.176771 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03a9e3-0a67-4289-8fd0-8c9409314462 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:24.176771 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03a9e3-0a67-4289-8fd0-8c9409314462 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:24.176771 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03a9e3-0a67-4289-8fd0-8c9409314462 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:24.177166 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc03a9e3-0a67-4289-8fd0-8c9409314462 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:24.177166 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc03a9e3-0a67-4289-8fd0-8c9409314462 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:24.197648 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-55bfd074-b210-4cdc-8d5c-2fc3ad35f0c6 admin admin] The token cache is being invalidate because project 40b06682f7ad42eea575a158f9c4d75f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:10:24.197969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-55bfd074-b210-4cdc-8d5c-2fc3ad35f0c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:24.198993 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-55bfd074-b210-4cdc-8d5c-2fc3ad35f0c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:24.200133 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 861/1725] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:10:23 2022] DELETE /identity/v3/projects/40b06682f7ad42eea575a158f9c4d75f => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:24.201036 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfd074-b210-4cdc-8d5c-2fc3ad35f0c6 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:24.202978 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-55bfd074-b210-4cdc-8d5c-2fc3ad35f0c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:24.274474 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfd074-b210-4cdc-8d5c-2fc3ad35f0c6 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:24.279188 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee57c1-195c-4e83-9b50-1ec504ca3e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:24.280335 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee57c1-195c-4e83-9b50-1ec504ca3e12 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:24.280335 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee57c1-195c-4e83-9b50-1ec504ca3e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:24.280503 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee57c1-195c-4e83-9b50-1ec504ca3e12 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:24.281211 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee57c1-195c-4e83-9b50-1ec504ca3e12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:24.283225 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee57c1-195c-4e83-9b50-1ec504ca3e12 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:24.286540 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 865/1726] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:24 2022] POST /identity/v3/users => generated 295 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:24.287959 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03a9e3-0a67-4289-8fd0-8c9409314462 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:24.289828 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-fc03a9e3-0a67-4289-8fd0-8c9409314462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:24.303427 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03a9e3-0a67-4289-8fd0-8c9409314462 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:24.313451 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bac3ec-2676-493f-9185-15623bdbb4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:24.315829 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bac3ec-2676-493f-9185-15623bdbb4a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:24.316247 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bac3ec-2676-493f-9185-15623bdbb4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:24.316787 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bac3ec-2676-493f-9185-15623bdbb4a5 admin admin] PATH_INFO: `/v3/projects/170f33ca0b614f3886822e038f754ea5` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:24.318352 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bac3ec-2676-493f-9185-15623bdbb4a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=170f33ca0b614f3886822e038f754ea5)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:24.324532 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bac3ec-2676-493f-9185-15623bdbb4a5 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:24.393406 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 862/1727] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:24 2022] POST /identity/v3/projects => generated 403 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:24.394579 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee57c1-195c-4e83-9b50-1ec504ca3e12 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:24.396332 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4cee57c1-195c-4e83-9b50-1ec504ca3e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:24.437075 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-07bac3ec-2676-493f-9185-15623bdbb4a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '170f33ca0b614f3886822e038f754ea5', 'request_id': 'req-07bac3ec-2676-493f-9185-15623bdbb4a5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:24.444413 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-07bac3ec-2676-493f-9185-15623bdbb4a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '170f33ca0b614f3886822e038f754ea5', 'request_id': 'req-07bac3ec-2676-493f-9185-15623bdbb4a5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:24.451194 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-07bac3ec-2676-493f-9185-15623bdbb4a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '170f33ca0b614f3886822e038f754ea5', 'request_id': 'req-07bac3ec-2676-493f-9185-15623bdbb4a5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:24.462819 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee57c1-195c-4e83-9b50-1ec504ca3e12 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:24.522081 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428a4c8-123b-4c45-bad5-801bf670006a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:24.523044 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428a4c8-123b-4c45-bad5-801bf670006a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:24.523332 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428a4c8-123b-4c45-bad5-801bf670006a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:24.523613 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428a4c8-123b-4c45-bad5-801bf670006a admin admin] PATH_INFO: `/v3/users/35f44b3f05fd4463971a20d0d77e98b2` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:24.524805 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6428a4c8-123b-4c45-bad5-801bf670006a admin admin] RBAC: Authorizing `identity:delete_user(user_id=35f44b3f05fd4463971a20d0d77e98b2)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:24.526823 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6428a4c8-123b-4c45-bad5-801bf670006a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:24.592724 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-07bac3ec-2676-493f-9185-15623bdbb4a5 admin admin] The token cache is being invalidate because project 170f33ca0b614f3886822e038f754ea5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:10:24.593015 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-07bac3ec-2676-493f-9185-15623bdbb4a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:24.593669 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-07bac3ec-2676-493f-9185-15623bdbb4a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:24.596048 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 866/1728] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:10:24 2022] DELETE /identity/v3/projects/170f33ca0b614f3886822e038f754ea5 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:24.596547 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bac3ec-2676-493f-9185-15623bdbb4a5 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:24.599366 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-07bac3ec-2676-493f-9185-15623bdbb4a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:24.613816 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bac3ec-2676-493f-9185-15623bdbb4a5 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:24.619144 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3bebf0-8c46-4154-b183-ab754dabe668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:24.620021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bebf0-8c46-4154-b183-ab754dabe668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:24.620349 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bebf0-8c46-4154-b183-ab754dabe668 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:24.620628 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bebf0-8c46-4154-b183-ab754dabe668 admin admin] PATH_INFO: `/v3/projects/48505b349722444abdc832bcb0090b28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:24.621907 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3bebf0-8c46-4154-b183-ab754dabe668 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48505b349722444abdc832bcb0090b28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:24.628627 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3bebf0-8c46-4154-b183-ab754dabe668 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:24.763080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6428a4c8-123b-4c45-bad5-801bf670006a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35f44b3f05fd4463971a20d0d77e98b2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:24.766925 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ee3bebf0-8c46-4154-b183-ab754dabe668 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48505b349722444abdc832bcb0090b28', 'request_id': 'req-ee3bebf0-8c46-4154-b183-ab754dabe668'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:24.774052 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ee3bebf0-8c46-4154-b183-ab754dabe668 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48505b349722444abdc832bcb0090b28', 'request_id': 'req-ee3bebf0-8c46-4154-b183-ab754dabe668'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:24.776573 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6428a4c8-123b-4c45-bad5-801bf670006a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35f44b3f05fd4463971a20d0d77e98b2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:24.782218 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ee3bebf0-8c46-4154-b183-ab754dabe668 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48505b349722444abdc832bcb0090b28', 'request_id': 'req-ee3bebf0-8c46-4154-b183-ab754dabe668'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:24.855150 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6428a4c8-123b-4c45-bad5-801bf670006a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35f44b3f05fd4463971a20d0d77e98b2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:24.856354 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6428a4c8-123b-4c45-bad5-801bf670006a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35f44b3f05fd4463971a20d0d77e98b2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:24.866033 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6428a4c8-123b-4c45-bad5-801bf670006a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35f44b3f05fd4463971a20d0d77e98b2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:24.872440 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 863/1729] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:10:24 2022] DELETE /identity/v3/users/35f44b3f05fd4463971a20d0d77e98b2 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:24.874487 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428a4c8-123b-4c45-bad5-801bf670006a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:24.877465 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6428a4c8-123b-4c45-bad5-801bf670006a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:24.947020 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ee3bebf0-8c46-4154-b183-ab754dabe668 admin admin] The token cache is being invalidate because project 48505b349722444abdc832bcb0090b28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:10:24.947556 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ee3bebf0-8c46-4154-b183-ab754dabe668 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:24.948502 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ee3bebf0-8c46-4154-b183-ab754dabe668 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:24.954490 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 867/1730] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:10:24 2022] DELETE /identity/v3/projects/48505b349722444abdc832bcb0090b28 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:24.955327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3bebf0-8c46-4154-b183-ab754dabe668 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:24.956780 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ee3bebf0-8c46-4154-b183-ab754dabe668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:24.969481 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428a4c8-123b-4c45-bad5-801bf670006a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:24.975667 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62253c-72a2-46f0-ad43-7464a951d5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:24.980351 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62253c-72a2-46f0-ad43-7464a951d5f3 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:24.980351 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62253c-72a2-46f0-ad43-7464a951d5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:24.980351 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62253c-72a2-46f0-ad43-7464a951d5f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:24.980351 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b62253c-72a2-46f0-ad43-7464a951d5f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:24.981379 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b62253c-72a2-46f0-ad43-7464a951d5f3 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:24.996910 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 864/1731] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:24.997842 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62253c-72a2-46f0-ad43-7464a951d5f3 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:25.005228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1b62253c-72a2-46f0-ad43-7464a951d5f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:25.018906 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62253c-72a2-46f0-ad43-7464a951d5f3 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:25.023523 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb2815-bbce-4fa1-b97a-93bafa61eb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:25.024384 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb2815-bbce-4fa1-b97a-93bafa61eb88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:25.024702 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb2815-bbce-4fa1-b97a-93bafa61eb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:25.025063 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb2815-bbce-4fa1-b97a-93bafa61eb88 admin admin] PATH_INFO: `/v3/projects/51a13c9b28c54023aa6849df2d4aa110` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:25.026562 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bb2815-bbce-4fa1-b97a-93bafa61eb88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51a13c9b28c54023aa6849df2d4aa110)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:25.028529 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bb2815-bbce-4fa1-b97a-93bafa61eb88 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:25.060593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3bebf0-8c46-4154-b183-ab754dabe668 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:25.065383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c14bfb-f194-491d-89b2-a1bd80672a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:25.066089 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c14bfb-f194-491d-89b2-a1bd80672a6d admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:25.066662 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c14bfb-f194-491d-89b2-a1bd80672a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:25.066913 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c14bfb-f194-491d-89b2-a1bd80672a6d admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:25.067655 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c14bfb-f194-491d-89b2-a1bd80672a6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:25.069591 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c14bfb-f194-491d-89b2-a1bd80672a6d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:25.136071 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 868/1732] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:24 2022] POST /identity/v3/users => generated 302 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:25.137970 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5683f-267c-447a-a200-49e79515c33a None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:25.138335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5683f-267c-447a-a200-49e79515c33a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:25.139331 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5683f-267c-447a-a200-49e79515c33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:25.163649 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e3bb2815-bbce-4fa1-b97a-93bafa61eb88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51a13c9b28c54023aa6849df2d4aa110', 'request_id': 'req-e3bb2815-bbce-4fa1-b97a-93bafa61eb88'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:25.165453 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-56d5683f-267c-447a-a200-49e79515c33a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:25.166806 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-56d5683f-267c-447a-a200-49e79515c33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:25.172773 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e3bb2815-bbce-4fa1-b97a-93bafa61eb88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51a13c9b28c54023aa6849df2d4aa110', 'request_id': 'req-e3bb2815-bbce-4fa1-b97a-93bafa61eb88'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:25.181641 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e3bb2815-bbce-4fa1-b97a-93bafa61eb88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51a13c9b28c54023aa6849df2d4aa110', 'request_id': 'req-e3bb2815-bbce-4fa1-b97a-93bafa61eb88'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:25.238381 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 869/1733] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:25.239731 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5683f-267c-447a-a200-49e79515c33a None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:25.241240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-56d5683f-267c-447a-a200-49e79515c33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:25.252982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5683f-267c-447a-a200-49e79515c33a None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:25.257584 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f263293-27fa-463f-8557-a4a5a3098651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:25.258549 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f263293-27fa-463f-8557-a4a5a3098651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:25.261331 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f263293-27fa-463f-8557-a4a5a3098651 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:25.261331 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f263293-27fa-463f-8557-a4a5a3098651 admin admin] PATH_INFO: `/v3/users/e794f888bafc4457b68efd8982732607` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:25.261331 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f263293-27fa-463f-8557-a4a5a3098651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e794f888bafc4457b68efd8982732607)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:25.261574 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e3bb2815-bbce-4fa1-b97a-93bafa61eb88 admin admin] The token cache is being invalidate because project 51a13c9b28c54023aa6849df2d4aa110 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:10:25.261574 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e3bb2815-bbce-4fa1-b97a-93bafa61eb88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:25.261574 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e3bb2815-bbce-4fa1-b97a-93bafa61eb88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:25.262434 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f263293-27fa-463f-8557-a4a5a3098651 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:25.263945 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 865/1734] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:10:24 2022] DELETE /identity/v3/projects/51a13c9b28c54023aa6849df2d4aa110 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:25.264559 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb2815-bbce-4fa1-b97a-93bafa61eb88 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:25.265989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e3bb2815-bbce-4fa1-b97a-93bafa61eb88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:25.286539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb2815-bbce-4fa1-b97a-93bafa61eb88 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:25.291875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b8352-2930-4393-a6f7-f9b7e45f731c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:25.292650 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b8352-2930-4393-a6f7-f9b7e45f731c admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:25.293027 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b8352-2930-4393-a6f7-f9b7e45f731c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:25.293304 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b8352-2930-4393-a6f7-f9b7e45f731c admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:25.294065 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0b8352-2930-4393-a6f7-f9b7e45f731c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:25.295711 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0b8352-2930-4393-a6f7-f9b7e45f731c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:25.305634 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 866/1735] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:25.310094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d66c6-4062-4a75-9a9e-2a3666edb57c None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:25.310911 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d66c6-4062-4a75-9a9e-2a3666edb57c None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:25.313028 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d66c6-4062-4a75-9a9e-2a3666edb57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:25.330588 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-ea9d66c6-4062-4a75-9a9e-2a3666edb57c None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:25.331859 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ea9d66c6-4062-4a75-9a9e-2a3666edb57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:25.409594 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 867/1736] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:10:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:25.410998 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d66c6-4062-4a75-9a9e-2a3666edb57c None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:25.413794 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ea9d66c6-4062-4a75-9a9e-2a3666edb57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:25.436866 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d66c6-4062-4a75-9a9e-2a3666edb57c None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:25.442035 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ab5a0-3b00-4b0a-a234-8438a9cd5be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:25.442734 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ab5a0-3b00-4b0a-a234-8438a9cd5be4 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:25.443022 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ab5a0-3b00-4b0a-a234-8438a9cd5be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:25.443302 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ab5a0-3b00-4b0a-a234-8438a9cd5be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:25.444164 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ab5a0-3b00-4b0a-a234-8438a9cd5be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:25.445829 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ab5a0-3b00-4b0a-a234-8438a9cd5be4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:25.456381 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 868/1737] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:25.457622 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36866846-d23a-4287-a1fa-f39533b950e6 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:25.458048 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36866846-d23a-4287-a1fa-f39533b950e6 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:25.458230 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36866846-d23a-4287-a1fa-f39533b950e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:25.475972 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-36866846-d23a-4287-a1fa-f39533b950e6 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:25.477191 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-36866846-d23a-4287-a1fa-f39533b950e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:25.485694 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 869/1738] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:25.489940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647250f5-9003-4d9d-bede-d2841ef12fa0 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:25.490317 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647250f5-9003-4d9d-bede-d2841ef12fa0 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:25.490490 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647250f5-9003-4d9d-bede-d2841ef12fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:25.492750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4f263293-27fa-463f-8557-a4a5a3098651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e794f888bafc4457b68efd8982732607'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:25.507084 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4f263293-27fa-463f-8557-a4a5a3098651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e794f888bafc4457b68efd8982732607'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:25.509957 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-647250f5-9003-4d9d-bede-d2841ef12fa0 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:25.511393 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-647250f5-9003-4d9d-bede-d2841ef12fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:25.520339 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 870/1739] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:25.521249 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647250f5-9003-4d9d-bede-d2841ef12fa0 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:25.531103 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647250f5-9003-4d9d-bede-d2841ef12fa0 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:25.545316 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35605780-384e-4c3d-936b-7854657ce990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:25.545316 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35605780-384e-4c3d-936b-7854657ce990 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:25.545316 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35605780-384e-4c3d-936b-7854657ce990 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:25.545316 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35605780-384e-4c3d-936b-7854657ce990 admin admin] PATH_INFO: `/v3/projects/85d2645abec44bf6ae235dc9c4255453/users/01766db7d16149f3841de6c31798e3ba/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:25.563437 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35605780-384e-4c3d-936b-7854657ce990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85d2645abec44bf6ae235dc9c4255453, user_id=01766db7d16149f3841de6c31798e3ba, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:25.566588 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35605780-384e-4c3d-936b-7854657ce990 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:25.569309 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4f263293-27fa-463f-8557-a4a5a3098651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e794f888bafc4457b68efd8982732607'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:25.578325 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4f263293-27fa-463f-8557-a4a5a3098651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e794f888bafc4457b68efd8982732607'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:25.579135 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4f263293-27fa-463f-8557-a4a5a3098651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e794f888bafc4457b68efd8982732607'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:25.585376 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 870/1740] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:10:25 2022] DELETE /identity/v3/users/e794f888bafc4457b68efd8982732607 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:25.586311 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f263293-27fa-463f-8557-a4a5a3098651 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:25.587884 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4f263293-27fa-463f-8557-a4a5a3098651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:25.657442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f263293-27fa-463f-8557-a4a5a3098651 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:25.662903 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc4027-9203-43dc-97d9-8fb574f5e573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:25.663773 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc4027-9203-43dc-97d9-8fb574f5e573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:25.664061 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc4027-9203-43dc-97d9-8fb574f5e573 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:25.664344 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc4027-9203-43dc-97d9-8fb574f5e573 admin admin] PATH_INFO: `/v3/projects/eff7cb256e0f445da837a3c13b97b13a` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:25.673113 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 871/1741] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:25 2022] PUT /identity/v3/projects/85d2645abec44bf6ae235dc9c4255453/users/01766db7d16149f3841de6c31798e3ba/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:25.673868 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35605780-384e-4c3d-936b-7854657ce990 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:25.674374 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc4027-9203-43dc-97d9-8fb574f5e573 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eff7cb256e0f445da837a3c13b97b13a)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:25.676362 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc4027-9203-43dc-97d9-8fb574f5e573 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:25.679239 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-35605780-384e-4c3d-936b-7854657ce990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:25.746253 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35605780-384e-4c3d-936b-7854657ce990 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:25.751458 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce3ffd3-9efa-4c79-9831-44d2f5eaa2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:25.752135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3ffd3-9efa-4c79-9831-44d2f5eaa2ca admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:25.752731 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3ffd3-9efa-4c79-9831-44d2f5eaa2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:25.752731 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3ffd3-9efa-4c79-9831-44d2f5eaa2ca admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:25.753424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce3ffd3-9efa-4c79-9831-44d2f5eaa2ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:25.755082 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce3ffd3-9efa-4c79-9831-44d2f5eaa2ca admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:25.768764 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 872/1742] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:25.768764 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce3ffd3-9efa-4c79-9831-44d2f5eaa2ca admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:25.770072 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5ce3ffd3-9efa-4c79-9831-44d2f5eaa2ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:25.784202 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce3ffd3-9efa-4c79-9831-44d2f5eaa2ca admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:25.788691 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b0e75-4731-4d5d-a250-2cba9c59949b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:25.789424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b0e75-4731-4d5d-a250-2cba9c59949b admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:25.789647 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b0e75-4731-4d5d-a250-2cba9c59949b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:25.789970 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b0e75-4731-4d5d-a250-2cba9c59949b admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:25.790699 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3b0e75-4731-4d5d-a250-2cba9c59949b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:10:25.791009 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3b0e75-4731-4d5d-a250-2cba9c59949b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:25.793158 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3b0e75-4731-4d5d-a250-2cba9c59949b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:25.807606 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 873/1743] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:10:25.808961 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096aaff-74d9-467e-8dcb-b1c98bb170a8 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:25.809242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096aaff-74d9-467e-8dcb-b1c98bb170a8 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:25.809534 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096aaff-74d9-467e-8dcb-b1c98bb170a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:25.823355 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bacc4027-9203-43dc-97d9-8fb574f5e573 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eff7cb256e0f445da837a3c13b97b13a', 'request_id': 'req-bacc4027-9203-43dc-97d9-8fb574f5e573'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:25.829575 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-5096aaff-74d9-467e-8dcb-b1c98bb170a8 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:25.830774 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5096aaff-74d9-467e-8dcb-b1c98bb170a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:25.834621 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bacc4027-9203-43dc-97d9-8fb574f5e573 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eff7cb256e0f445da837a3c13b97b13a', 'request_id': 'req-bacc4027-9203-43dc-97d9-8fb574f5e573'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:25.844715 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bacc4027-9203-43dc-97d9-8fb574f5e573 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eff7cb256e0f445da837a3c13b97b13a', 'request_id': 'req-bacc4027-9203-43dc-97d9-8fb574f5e573'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:25.894947 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 874/1744] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:25.896078 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544d9e7-1916-4b02-9e4f-cdeb3e77dca7 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:25.896896 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544d9e7-1916-4b02-9e4f-cdeb3e77dca7 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:25.896896 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544d9e7-1916-4b02-9e4f-cdeb3e77dca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:25.923292 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-b544d9e7-1916-4b02-9e4f-cdeb3e77dca7 None None] MFA Rules not processed for user `01766db7d16149f3841de6c31798e3ba`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:25.924496 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b544d9e7-1916-4b02-9e4f-cdeb3e77dca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:25.946792 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bacc4027-9203-43dc-97d9-8fb574f5e573 admin admin] The token cache is being invalidate because project eff7cb256e0f445da837a3c13b97b13a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:10:25.947108 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bacc4027-9203-43dc-97d9-8fb574f5e573 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:25.947761 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bacc4027-9203-43dc-97d9-8fb574f5e573 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:25.949369 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 871/1745] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:10:25 2022] DELETE /identity/v3/projects/eff7cb256e0f445da837a3c13b97b13a => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:25.953483 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc4027-9203-43dc-97d9-8fb574f5e573 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:25.954828 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-bacc4027-9203-43dc-97d9-8fb574f5e573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:25.994787 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 875/1746] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:25.995612 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544d9e7-1916-4b02-9e4f-cdeb3e77dca7 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:25.998482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b544d9e7-1916-4b02-9e4f-cdeb3e77dca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:26.014838 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544d9e7-1916-4b02-9e4f-cdeb3e77dca7 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:26.019812 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc722f-1eb7-4ad6-9ae6-10f2e9d9a60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:26.020657 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc722f-1eb7-4ad6-9ae6-10f2e9d9a60e admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:26.020939 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc722f-1eb7-4ad6-9ae6-10f2e9d9a60e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:26.021216 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc722f-1eb7-4ad6-9ae6-10f2e9d9a60e admin admin] PATH_INFO: `/v3/projects/2f4e29696e894e59bae3740046e2c292/users/0edf5889c5684ab49edb05564134d37a/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:26.024788 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc4027-9203-43dc-97d9-8fb574f5e573 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:26.030580 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85bfd79-1af7-442c-9357-145b159f10d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:26.031304 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85bfd79-1af7-442c-9357-145b159f10d3 service swift] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:26.031595 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85bfd79-1af7-442c-9357-145b159f10d3 service swift] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:26.031881 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85bfd79-1af7-442c-9357-145b159f10d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:26.037014 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c85bfd79-1af7-442c-9357-145b159f10d3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:26.048635 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc722f-1eb7-4ad6-9ae6-10f2e9d9a60e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f4e29696e894e59bae3740046e2c292, user_id=0edf5889c5684ab49edb05564134d37a, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:26.052734 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc722f-1eb7-4ad6-9ae6-10f2e9d9a60e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:26.119375 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85bfd79-1af7-442c-9357-145b159f10d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:26.121009 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85bfd79-1af7-442c-9357-145b159f10d3 service swift] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:26.137555 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 876/1747] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:25 2022] PUT /identity/v3/projects/2f4e29696e894e59bae3740046e2c292/users/0edf5889c5684ab49edb05564134d37a/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:26.139440 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc722f-1eb7-4ad6-9ae6-10f2e9d9a60e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:26.142797 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8bfc722f-1eb7-4ad6-9ae6-10f2e9d9a60e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:26.149208 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 872/1748] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:10:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:10:26.150297 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85bfd79-1af7-442c-9357-145b159f10d3 service swift] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:26.155135 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c85bfd79-1af7-442c-9357-145b159f10d3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:26.175340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85bfd79-1af7-442c-9357-145b159f10d3 service swift] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:26.369495 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc722f-1eb7-4ad6-9ae6-10f2e9d9a60e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:26.375996 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ef07f-3c2b-4e79-a83b-f530abf967fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:26.376720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ef07f-3c2b-4e79-a83b-f530abf967fd admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:26.377211 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ef07f-3c2b-4e79-a83b-f530abf967fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:26.377509 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ef07f-3c2b-4e79-a83b-f530abf967fd admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:26.378559 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ef07f-3c2b-4e79-a83b-f530abf967fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:26.380785 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ef07f-3c2b-4e79-a83b-f530abf967fd admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:26.490452 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 877/1749] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:26 2022] POST /identity/v3/projects => generated 377 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:26.490452 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4450f2b-da0d-4917-a365-77db15fd815b None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:26.490452 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4450f2b-da0d-4917-a365-77db15fd815b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:26.490452 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4450f2b-da0d-4917-a365-77db15fd815b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:26.507353 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885e355-e622-402a-ba9e-4cc54db1e27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:26.508191 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885e355-e622-402a-ba9e-4cc54db1e27c admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:26.508460 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885e355-e622-402a-ba9e-4cc54db1e27c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:26.509019 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885e355-e622-402a-ba9e-4cc54db1e27c admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:26.510231 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885e355-e622-402a-ba9e-4cc54db1e27c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:10:26.510554 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885e355-e622-402a-ba9e-4cc54db1e27c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:26.513057 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885e355-e622-402a-ba9e-4cc54db1e27c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:26.518660 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-e4450f2b-da0d-4917-a365-77db15fd815b None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:26.520494 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e4450f2b-da0d-4917-a365-77db15fd815b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:26.548741 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 873/1750] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:10:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:10:26.555349 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885e355-e622-402a-ba9e-4cc54db1e27c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:26.560603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5885e355-e622-402a-ba9e-4cc54db1e27c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:26.599051 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885e355-e622-402a-ba9e-4cc54db1e27c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:26.633019 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 878/1751] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:26.636524 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4450f2b-da0d-4917-a365-77db15fd815b None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:26.638091 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e4450f2b-da0d-4917-a365-77db15fd815b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:26.659349 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4450f2b-da0d-4917-a365-77db15fd815b None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:26.664257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b4cbc-da45-4540-bb0e-c284e32bc1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:26.665137 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b4cbc-da45-4540-bb0e-c284e32bc1e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:26.665428 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b4cbc-da45-4540-bb0e-c284e32bc1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:26.665709 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b4cbc-da45-4540-bb0e-c284e32bc1e6 admin admin] PATH_INFO: `/v3/projects/7df016afa19d4768bfee72654a5bb6fa` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:26.667079 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b4cbc-da45-4540-bb0e-c284e32bc1e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7df016afa19d4768bfee72654a5bb6fa)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:26.669168 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b4cbc-da45-4540-bb0e-c284e32bc1e6 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:26.681079 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b4ab8b-1e72-4c93-b01f-e0e11cbd532c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:26.681744 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4ab8b-1e72-4c93-b01f-e0e11cbd532c admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:26.682058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4ab8b-1e72-4c93-b01f-e0e11cbd532c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:26.682325 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4ab8b-1e72-4c93-b01f-e0e11cbd532c admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:26.683019 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b4ab8b-1e72-4c93-b01f-e0e11cbd532c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:26.685006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b4ab8b-1e72-4c93-b01f-e0e11cbd532c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:26.778323 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6e7b4cbc-da45-4540-bb0e-c284e32bc1e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7df016afa19d4768bfee72654a5bb6fa', 'request_id': 'req-6e7b4cbc-da45-4540-bb0e-c284e32bc1e6'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:26.786279 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6e7b4cbc-da45-4540-bb0e-c284e32bc1e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7df016afa19d4768bfee72654a5bb6fa', 'request_id': 'req-6e7b4cbc-da45-4540-bb0e-c284e32bc1e6'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:26.792936 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6e7b4cbc-da45-4540-bb0e-c284e32bc1e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7df016afa19d4768bfee72654a5bb6fa', 'request_id': 'req-6e7b4cbc-da45-4540-bb0e-c284e32bc1e6'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:26.861291 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 874/1752] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:26 2022] POST /identity/v3/projects => generated 391 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:26.861291 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84800887-2dad-40da-8a41-2261c04c5295 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:26.861291 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84800887-2dad-40da-8a41-2261c04c5295 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:26.861291 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84800887-2dad-40da-8a41-2261c04c5295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:26.891542 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-84800887-2dad-40da-8a41-2261c04c5295 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:26.892997 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-84800887-2dad-40da-8a41-2261c04c5295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:26.952490 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6e7b4cbc-da45-4540-bb0e-c284e32bc1e6 admin admin] The token cache is being invalidate because project 7df016afa19d4768bfee72654a5bb6fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:10:26.952793 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6e7b4cbc-da45-4540-bb0e-c284e32bc1e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:26.954984 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6e7b4cbc-da45-4540-bb0e-c284e32bc1e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:26.957443 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 879/1753] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:10:26 2022] DELETE /identity/v3/projects/7df016afa19d4768bfee72654a5bb6fa => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:26.962148 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6366d-4d1a-4283-8d74-36b93c54d605 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:26.962323 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 875/1754] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:26.962458 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6366d-4d1a-4283-8d74-36b93c54d605 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:26.962458 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6366d-4d1a-4283-8d74-36b93c54d605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:26.962597 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84800887-2dad-40da-8a41-2261c04c5295 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:26.973126 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84800887-2dad-40da-8a41-2261c04c5295 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:26.978225 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002d8ba-808e-492d-af61-77a3bd6d60b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:26.978904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002d8ba-808e-492d-af61-77a3bd6d60b7 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:26.979225 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002d8ba-808e-492d-af61-77a3bd6d60b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:26.979469 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002d8ba-808e-492d-af61-77a3bd6d60b7 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:26.982733 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002d8ba-808e-492d-af61-77a3bd6d60b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:26.985385 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002d8ba-808e-492d-af61-77a3bd6d60b7 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:27.034802 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-fbd6366d-4d1a-4283-8d74-36b93c54d605 None None] MFA Rules not processed for user `0b0cb145b72a492ebb8c0e9223be47a1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:27.085965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-fbd6366d-4d1a-4283-8d74-36b93c54d605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:27.092986 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 880/1755] 10.222.0.35 () {58 vars in 1015 bytes} [Sat Apr 30 21:10:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:27.093980 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6366d-4d1a-4283-8d74-36b93c54d605 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:27.095322 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-fbd6366d-4d1a-4283-8d74-36b93c54d605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:27.121619 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6366d-4d1a-4283-8d74-36b93c54d605 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:27.126824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f9451-56fc-4721-a7a8-b3848cefa303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:27.127675 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f9451-56fc-4721-a7a8-b3848cefa303 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:27.127964 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f9451-56fc-4721-a7a8-b3848cefa303 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:27.128257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f9451-56fc-4721-a7a8-b3848cefa303 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:27.128937 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2f9451-56fc-4721-a7a8-b3848cefa303 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:27.131252 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2f9451-56fc-4721-a7a8-b3848cefa303 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:27.512361 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 876/1756] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:26 2022] POST /identity/v3/users => generated 289 bytes in 550 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:27.512361 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61fd1fb-6dc8-4442-9710-35e64e80efa9 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:27.512361 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61fd1fb-6dc8-4442-9710-35e64e80efa9 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:27.512361 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61fd1fb-6dc8-4442-9710-35e64e80efa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:27.530442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-d61fd1fb-6dc8-4442-9710-35e64e80efa9 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:27.531718 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d61fd1fb-6dc8-4442-9710-35e64e80efa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:27.543893 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 877/1757] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:27.543893 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61fd1fb-6dc8-4442-9710-35e64e80efa9 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:27.546240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d61fd1fb-6dc8-4442-9710-35e64e80efa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:27.559027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61fd1fb-6dc8-4442-9710-35e64e80efa9 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:27.565984 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bed92b-369e-4e33-911b-0a1b779bd257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:27.567012 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bed92b-369e-4e33-911b-0a1b779bd257 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:27.567295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bed92b-369e-4e33-911b-0a1b779bd257 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:27.567641 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bed92b-369e-4e33-911b-0a1b779bd257 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:27.568350 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bed92b-369e-4e33-911b-0a1b779bd257 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:27.570329 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bed92b-369e-4e33-911b-0a1b779bd257 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:27.625336 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 881/1758] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:27 2022] POST /identity/v3/projects => generated 381 bytes in 529 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:27.625336 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab286a0-18f6-4679-97ea-f7ed7758b3f7 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:27.625336 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab286a0-18f6-4679-97ea-f7ed7758b3f7 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:27.625336 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab286a0-18f6-4679-97ea-f7ed7758b3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:27.643921 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-eab286a0-18f6-4679-97ea-f7ed7758b3f7 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:27.646897 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-eab286a0-18f6-4679-97ea-f7ed7758b3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:27.709124 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 878/1759] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:27 2022] POST /identity/v3/users => generated 302 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:27.709837 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 882/1760] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:27.710577 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab286a0-18f6-4679-97ea-f7ed7758b3f7 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:27.712346 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-eab286a0-18f6-4679-97ea-f7ed7758b3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:27.717636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bed92b-369e-4e33-911b-0a1b779bd257 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:27.722937 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d4bed92b-369e-4e33-911b-0a1b779bd257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:27.727214 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab286a0-18f6-4679-97ea-f7ed7758b3f7 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:27.730145 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ffa2b-38a0-49f4-8b07-f08e5362ee50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:27.730820 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ffa2b-38a0-49f4-8b07-f08e5362ee50 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:27.731107 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ffa2b-38a0-49f4-8b07-f08e5362ee50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:27.731386 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ffa2b-38a0-49f4-8b07-f08e5362ee50 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:27.732168 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ffa2b-38a0-49f4-8b07-f08e5362ee50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:27.734436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ffa2b-38a0-49f4-8b07-f08e5362ee50 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:27.743108 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bed92b-369e-4e33-911b-0a1b779bd257 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:27.754883 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 883/1761] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:27.755897 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ffa2b-38a0-49f4-8b07-f08e5362ee50 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:27.770874 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ffa2b-38a0-49f4-8b07-f08e5362ee50 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:27.780087 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502572b-22d4-4fa8-a88e-f184b2bc5706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:27.781598 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502572b-22d4-4fa8-a88e-f184b2bc5706 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:27.782162 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502572b-22d4-4fa8-a88e-f184b2bc5706 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:27.787340 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502572b-22d4-4fa8-a88e-f184b2bc5706 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:27.787340 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e502572b-22d4-4fa8-a88e-f184b2bc5706 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:10:27.787340 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e502572b-22d4-4fa8-a88e-f184b2bc5706 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:27.787340 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e502572b-22d4-4fa8-a88e-f184b2bc5706 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:27.804309 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 884/1762] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:10:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:10:27.805196 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502572b-22d4-4fa8-a88e-f184b2bc5706 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:27.815407 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502572b-22d4-4fa8-a88e-f184b2bc5706 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:27.816131 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a1933-3c54-450d-bf65-c87ebfde4314 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:27.817107 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a1933-3c54-450d-bf65-c87ebfde4314 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:27.817389 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a1933-3c54-450d-bf65-c87ebfde4314 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:27.817665 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a1933-3c54-450d-bf65-c87ebfde4314 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:27.819788 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-582a1933-3c54-450d-bf65-c87ebfde4314 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:27.820568 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb10b976-0f66-4add-a256-ac4e6ef83561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:27.821231 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10b976-0f66-4add-a256-ac4e6ef83561 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:27.821517 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10b976-0f66-4add-a256-ac4e6ef83561 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:27.821816 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10b976-0f66-4add-a256-ac4e6ef83561 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:27.822537 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb10b976-0f66-4add-a256-ac4e6ef83561 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:27.824475 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb10b976-0f66-4add-a256-ac4e6ef83561 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:27.839201 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a1933-3c54-450d-bf65-c87ebfde4314 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:27.840837 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a1933-3c54-450d-bf65-c87ebfde4314 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:27.854004 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 879/1763] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:27.857988 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a1933-3c54-450d-bf65-c87ebfde4314 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:27.865293 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a1933-3c54-450d-bf65-c87ebfde4314 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:27.870305 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a9f335-a5bd-403b-a25e-3e49011983a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:27.870971 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9f335-a5bd-403b-a25e-3e49011983a2 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:27.871255 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9f335-a5bd-403b-a25e-3e49011983a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:27.871530 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9f335-a5bd-403b-a25e-3e49011983a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:27.872256 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a9f335-a5bd-403b-a25e-3e49011983a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:27.873938 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a9f335-a5bd-403b-a25e-3e49011983a2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:27.891194 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 880/1764] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:27.891194 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e140e1-7e94-41c4-a815-e8247fd70a8d None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:27.891194 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e140e1-7e94-41c4-a815-e8247fd70a8d None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:27.891194 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e140e1-7e94-41c4-a815-e8247fd70a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:27.909423 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-18e140e1-7e94-41c4-a815-e8247fd70a8d None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:27.913405 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-18e140e1-7e94-41c4-a815-e8247fd70a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:27.919539 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 881/1765] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:27.921093 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e140e1-7e94-41c4-a815-e8247fd70a8d None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:27.931472 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e140e1-7e94-41c4-a815-e8247fd70a8d None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:27.937038 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8cee41-fa1a-4704-acbd-7b39417ba85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:27.944212 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8cee41-fa1a-4704-acbd-7b39417ba85d admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:27.944212 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8cee41-fa1a-4704-acbd-7b39417ba85d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:27.944409 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 885/1766] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:27 2022] POST /identity/v3/users => generated 291 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:27.944490 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8cee41-fa1a-4704-acbd-7b39417ba85d admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:27.944564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb10b976-0f66-4add-a256-ac4e6ef83561 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:27.944643 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8cee41-fa1a-4704-acbd-7b39417ba85d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:27.944643 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8cee41-fa1a-4704-acbd-7b39417ba85d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:27.951646 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb10b976-0f66-4add-a256-ac4e6ef83561 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:27.956138 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 882/1767] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:27.956958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8cee41-fa1a-4704-acbd-7b39417ba85d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:27.964736 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a88f9f-e7c4-4156-b699-aad5e2de1a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:27.966019 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a88f9f-e7c4-4156-b699-aad5e2de1a9b admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:27.967087 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a88f9f-e7c4-4156-b699-aad5e2de1a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:27.967785 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a88f9f-e7c4-4156-b699-aad5e2de1a9b admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:27.969014 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8cee41-fa1a-4704-acbd-7b39417ba85d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:27.970073 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a88f9f-e7c4-4156-b699-aad5e2de1a9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:27.973294 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a88f9f-e7c4-4156-b699-aad5e2de1a9b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:27.975872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafab6a0-e967-478d-8f2e-bb959f293973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:27.979702 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafab6a0-e967-478d-8f2e-bb959f293973 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:27.979702 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafab6a0-e967-478d-8f2e-bb959f293973 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:27.979702 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafab6a0-e967-478d-8f2e-bb959f293973 admin admin] PATH_INFO: `/v3/projects/b829b92b4f6045e0a2f52fd5a025822f/users/6f1c4811f83d4eb694d1546a71626e4c/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:27.997211 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafab6a0-e967-478d-8f2e-bb959f293973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b829b92b4f6045e0a2f52fd5a025822f, user_id=6f1c4811f83d4eb694d1546a71626e4c, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:28.000320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafab6a0-e967-478d-8f2e-bb959f293973 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:28.068207 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 886/1768] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:27 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:28.069161 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a88f9f-e7c4-4156-b699-aad5e2de1a9b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:28.138234 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a88f9f-e7c4-4156-b699-aad5e2de1a9b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:28.146912 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 883/1769] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:27 2022] PUT /identity/v3/projects/b829b92b4f6045e0a2f52fd5a025822f/users/6f1c4811f83d4eb694d1546a71626e4c/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:28.152548 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafab6a0-e967-478d-8f2e-bb959f293973 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:28.232003 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04931e0d-5a59-4f9b-92ba-0e66dabbc4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:28.232972 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04931e0d-5a59-4f9b-92ba-0e66dabbc4b6 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:28.233698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04931e0d-5a59-4f9b-92ba-0e66dabbc4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:28.234193 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04931e0d-5a59-4f9b-92ba-0e66dabbc4b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:28.235100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04931e0d-5a59-4f9b-92ba-0e66dabbc4b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:10:28.235424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04931e0d-5a59-4f9b-92ba-0e66dabbc4b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:28.237121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04931e0d-5a59-4f9b-92ba-0e66dabbc4b6 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:28.257477 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafab6a0-e967-478d-8f2e-bb959f293973 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:28.261151 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 887/1770] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:10:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:10:28.262283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04931e0d-5a59-4f9b-92ba-0e66dabbc4b6 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:28.262465 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a23619-77ac-4ad4-9783-12085823f02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:28.263252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a23619-77ac-4ad4-9783-12085823f02c admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:28.264599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a23619-77ac-4ad4-9783-12085823f02c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:28.264895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a23619-77ac-4ad4-9783-12085823f02c admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:28.265643 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a23619-77ac-4ad4-9783-12085823f02c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:28.267310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a23619-77ac-4ad4-9783-12085823f02c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:28.298171 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 884/1771] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:28.299145 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a23619-77ac-4ad4-9783-12085823f02c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:28.299714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04931e0d-5a59-4f9b-92ba-0e66dabbc4b6 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:28.311039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dec79c-7250-4989-bc22-f2748febca45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:28.312790 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dec79c-7250-4989-bc22-f2748febca45 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:28.312790 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dec79c-7250-4989-bc22-f2748febca45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:28.312790 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dec79c-7250-4989-bc22-f2748febca45 admin admin] PATH_INFO: `/v3/projects/f637293a37cf4ded88e20fae41323d1a/users/0bf48a2788554054b6d36719147ef1b4/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:28.317442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a23619-77ac-4ad4-9783-12085823f02c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:28.321239 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61349d2-1b82-4040-8354-f965cd0773f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:28.322073 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61349d2-1b82-4040-8354-f965cd0773f4 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:28.322356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61349d2-1b82-4040-8354-f965cd0773f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:28.322634 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61349d2-1b82-4040-8354-f965cd0773f4 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:28.323683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61349d2-1b82-4040-8354-f965cd0773f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:28.326928 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61349d2-1b82-4040-8354-f965cd0773f4 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:28.461128 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 885/1772] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:28 2022] POST /identity/v3/users => generated 287 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:28.462265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61349d2-1b82-4040-8354-f965cd0773f4 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:28.497335 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dec79c-7250-4989-bc22-f2748febca45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f637293a37cf4ded88e20fae41323d1a, user_id=0bf48a2788554054b6d36719147ef1b4, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:28.502231 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dec79c-7250-4989-bc22-f2748febca45 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:28.508621 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61349d2-1b82-4040-8354-f965cd0773f4 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:28.514546 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c430d9-177a-46d9-ab63-792fc2571d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:28.515244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c430d9-177a-46d9-ab63-792fc2571d2c admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:28.515530 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c430d9-177a-46d9-ab63-792fc2571d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:28.515810 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c430d9-177a-46d9-ab63-792fc2571d2c admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:28.516543 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c430d9-177a-46d9-ab63-792fc2571d2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:28.518435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c430d9-177a-46d9-ab63-792fc2571d2c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:28.535317 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 886/1773] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:28.536314 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c430d9-177a-46d9-ab63-792fc2571d2c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:28.549347 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c430d9-177a-46d9-ab63-792fc2571d2c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:28.558731 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478466f9-de93-45a6-9887-dafbe7437959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:28.562245 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478466f9-de93-45a6-9887-dafbe7437959 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:28.562245 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478466f9-de93-45a6-9887-dafbe7437959 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:28.562245 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478466f9-de93-45a6-9887-dafbe7437959 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:28.562245 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478466f9-de93-45a6-9887-dafbe7437959 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:28.567547 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478466f9-de93-45a6-9887-dafbe7437959 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:28.630092 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 888/1774] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:28 2022] PUT /identity/v3/projects/f637293a37cf4ded88e20fae41323d1a/users/0bf48a2788554054b6d36719147ef1b4/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:28.631486 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dec79c-7250-4989-bc22-f2748febca45 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:28.682656 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 887/1775] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:28 2022] POST /identity/v3/projects => generated 375 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:28.683501 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478466f9-de93-45a6-9887-dafbe7437959 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:28.771063 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dec79c-7250-4989-bc22-f2748febca45 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:28.778211 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b57ce-2674-472d-a18f-6d2cf2e2b669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:28.779075 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b57ce-2674-472d-a18f-6d2cf2e2b669 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:28.779574 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b57ce-2674-472d-a18f-6d2cf2e2b669 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:28.779960 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b57ce-2674-472d-a18f-6d2cf2e2b669 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:28.780771 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2b57ce-2674-472d-a18f-6d2cf2e2b669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:28.783684 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2b57ce-2674-472d-a18f-6d2cf2e2b669 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:28.788865 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478466f9-de93-45a6-9887-dafbe7437959 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:28.800047 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 889/1776] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:28.800047 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b57ce-2674-472d-a18f-6d2cf2e2b669 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:28.804020 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76107fa0-4482-4aa2-9e82-955a351a8d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:28.804729 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76107fa0-4482-4aa2-9e82-955a351a8d13 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:28.805007 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76107fa0-4482-4aa2-9e82-955a351a8d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:28.805279 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76107fa0-4482-4aa2-9e82-955a351a8d13 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:28.806083 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76107fa0-4482-4aa2-9e82-955a351a8d13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:28.807829 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76107fa0-4482-4aa2-9e82-955a351a8d13 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:28.821519 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 888/1777] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:28.822957 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04553e88-dbe0-44b1-90a0-f77f144b5795 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:28.823371 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04553e88-dbe0-44b1-90a0-f77f144b5795 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:28.823710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04553e88-dbe0-44b1-90a0-f77f144b5795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:28.829264 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b57ce-2674-472d-a18f-6d2cf2e2b669 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:28.840056 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c1ae8-3c57-4fe8-8016-27b6d5c94a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:28.840775 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c1ae8-3c57-4fe8-8016-27b6d5c94a42 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:28.841056 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c1ae8-3c57-4fe8-8016-27b6d5c94a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:28.841331 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c1ae8-3c57-4fe8-8016-27b6d5c94a42 admin admin] PATH_INFO: `/v3/projects/b829b92b4f6045e0a2f52fd5a025822f/users/6f1c4811f83d4eb694d1546a71626e4c/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:28.843489 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c1ae8-3c57-4fe8-8016-27b6d5c94a42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b829b92b4f6045e0a2f52fd5a025822f, user_id=6f1c4811f83d4eb694d1546a71626e4c, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:28.846755 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c1ae8-3c57-4fe8-8016-27b6d5c94a42 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:28.862757 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 890/1778] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:28 2022] PUT /identity/v3/projects/b829b92b4f6045e0a2f52fd5a025822f/users/6f1c4811f83d4eb694d1546a71626e4c/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:28.862757 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c1ae8-3c57-4fe8-8016-27b6d5c94a42 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:28.888052 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-04553e88-dbe0-44b1-90a0-f77f144b5795 None None] MFA Rules not processed for user `0bf48a2788554054b6d36719147ef1b4`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:28.891419 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-04553e88-dbe0-44b1-90a0-f77f144b5795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:28.966618 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 889/1779] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:28.967574 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04553e88-dbe0-44b1-90a0-f77f144b5795 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:28.969904 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c1ae8-3c57-4fe8-8016-27b6d5c94a42 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:28.975427 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446041b-eec2-437b-9306-b095011535ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:28.977458 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446041b-eec2-437b-9306-b095011535ed admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:28.977458 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446041b-eec2-437b-9306-b095011535ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:28.977458 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446041b-eec2-437b-9306-b095011535ed admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:28.977965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446041b-eec2-437b-9306-b095011535ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:28.980768 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446041b-eec2-437b-9306-b095011535ed admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:28.983948 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04553e88-dbe0-44b1-90a0-f77f144b5795 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:28.990650 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634ea997-3fad-4fb5-8873-02da97b65a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:28.991961 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ea997-3fad-4fb5-8873-02da97b65a8b admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:28.992517 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ea997-3fad-4fb5-8873-02da97b65a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:28.993022 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634ea997-3fad-4fb5-8873-02da97b65a8b admin admin] PATH_INFO: `/v3/projects/aba0b127c04d4ea595f14a5d573313b2/users/f640d0ae6e03466ba0de6b0001ae8d2c/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:29.014812 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634ea997-3fad-4fb5-8873-02da97b65a8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aba0b127c04d4ea595f14a5d573313b2, user_id=f640d0ae6e03466ba0de6b0001ae8d2c, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:29.018355 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634ea997-3fad-4fb5-8873-02da97b65a8b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:29.103568 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 891/1780] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:28 2022] POST /identity/v3/users => generated 288 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:29.103568 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446041b-eec2-437b-9306-b095011535ed admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:29.114248 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446041b-eec2-437b-9306-b095011535ed admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:29.119606 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83647529-d45e-4798-906e-9a3f55b2abdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:29.120291 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83647529-d45e-4798-906e-9a3f55b2abdc admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:29.120582 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83647529-d45e-4798-906e-9a3f55b2abdc admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:29.120857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83647529-d45e-4798-906e-9a3f55b2abdc admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:29.121598 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83647529-d45e-4798-906e-9a3f55b2abdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:29.123347 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83647529-d45e-4798-906e-9a3f55b2abdc admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:29.136563 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 890/1781] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:28 2022] PUT /identity/v3/projects/aba0b127c04d4ea595f14a5d573313b2/users/f640d0ae6e03466ba0de6b0001ae8d2c/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:29.139182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e0f29-06b2-4b6d-a619-fd380f5b7f1d None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:29.139758 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e0f29-06b2-4b6d-a619-fd380f5b7f1d None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:29.140257 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e0f29-06b2-4b6d-a619-fd380f5b7f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:29.146118 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 892/1782] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:29.150268 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83647529-d45e-4798-906e-9a3f55b2abdc admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:29.180105 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83647529-d45e-4798-906e-9a3f55b2abdc admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:29.192891 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-534e0f29-06b2-4b6d-a619-fd380f5b7f1d None None] MFA Rules not processed for user `6f1c4811f83d4eb694d1546a71626e4c`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:29.194871 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-534e0f29-06b2-4b6d-a619-fd380f5b7f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:29.308064 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970dc6e-8cea-4206-98d3-fe120b399bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:29.309284 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970dc6e-8cea-4206-98d3-fe120b399bbf admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:29.309787 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970dc6e-8cea-4206-98d3-fe120b399bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:29.310396 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970dc6e-8cea-4206-98d3-fe120b399bbf admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:29.311368 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2970dc6e-8cea-4206-98d3-fe120b399bbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:29.314535 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2970dc6e-8cea-4206-98d3-fe120b399bbf admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:29.330632 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 891/1783] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:29 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:29.330632 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e0f29-06b2-4b6d-a619-fd380f5b7f1d None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:29.348395 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e0f29-06b2-4b6d-a619-fd380f5b7f1d None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:29.353365 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10bbe5-a3f0-4717-a32c-7b2e857fc48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:29.354103 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10bbe5-a3f0-4717-a32c-7b2e857fc48b admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:29.354391 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10bbe5-a3f0-4717-a32c-7b2e857fc48b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:29.354695 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10bbe5-a3f0-4717-a32c-7b2e857fc48b admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:29.355452 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10bbe5-a3f0-4717-a32c-7b2e857fc48b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:29.357693 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10bbe5-a3f0-4717-a32c-7b2e857fc48b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:29.377832 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 892/1784] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:29.377832 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1965a-4933-4592-8bbc-a19a1c00356b None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:29.377832 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1965a-4933-4592-8bbc-a19a1c00356b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:29.378182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1965a-4933-4592-8bbc-a19a1c00356b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:29.390772 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 893/1785] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:29 2022] POST /identity/v3/projects => generated 377 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:29.391637 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970dc6e-8cea-4206-98d3-fe120b399bbf admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:29.423338 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-e1f1965a-4933-4592-8bbc-a19a1c00356b None None] MFA Rules not processed for user `f640d0ae6e03466ba0de6b0001ae8d2c`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:29.431249 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e1f1965a-4933-4592-8bbc-a19a1c00356b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:29.519477 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970dc6e-8cea-4206-98d3-fe120b399bbf admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:29.536315 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8cbf5-2c2e-4b76-868e-adf4c3b515f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:29.537903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8cbf5-2c2e-4b76-868e-adf4c3b515f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:29.539116 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8cbf5-2c2e-4b76-868e-adf4c3b515f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:29.539948 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8cbf5-2c2e-4b76-868e-adf4c3b515f1 admin admin] PATH_INFO: `/v3/projects/02bd5a4841264531b97b5cf4e0a5acff/users/2c3c9b45ec964cf0b7ff966cb7884b6e/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:29.574709 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8cbf5-2c2e-4b76-868e-adf4c3b515f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02bd5a4841264531b97b5cf4e0a5acff, user_id=2c3c9b45ec964cf0b7ff966cb7884b6e, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:29.578081 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8cbf5-2c2e-4b76-868e-adf4c3b515f1 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:29.579287 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 893/1786] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:29.580283 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1965a-4933-4592-8bbc-a19a1c00356b None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:29.581521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e1f1965a-4933-4592-8bbc-a19a1c00356b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:29.652524 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 894/1787] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:29 2022] PUT /identity/v3/projects/02bd5a4841264531b97b5cf4e0a5acff/users/2c3c9b45ec964cf0b7ff966cb7884b6e/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:29.653811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8cbf5-2c2e-4b76-868e-adf4c3b515f1 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:29.673586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1965a-4933-4592-8bbc-a19a1c00356b None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:29.757577 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc45e79c-ac0c-4901-8809-ef1b87f5cc67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:29.758259 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45e79c-ac0c-4901-8809-ef1b87f5cc67 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:29.758548 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45e79c-ac0c-4901-8809-ef1b87f5cc67 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:29.758831 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45e79c-ac0c-4901-8809-ef1b87f5cc67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:29.763141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8cbf5-2c2e-4b76-868e-adf4c3b515f1 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:29.771948 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be2ba1-5b06-4f86-a310-d9a5b93176d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:29.772735 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be2ba1-5b06-4f86-a310-d9a5b93176d8 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:29.772983 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be2ba1-5b06-4f86-a310-d9a5b93176d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:29.773270 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be2ba1-5b06-4f86-a310-d9a5b93176d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:29.774060 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be2ba1-5b06-4f86-a310-d9a5b93176d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:29.775804 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be2ba1-5b06-4f86-a310-d9a5b93176d8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:29.788098 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 895/1788] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:29.789098 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be2ba1-5b06-4f86-a310-d9a5b93176d8 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:29.800232 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be2ba1-5b06-4f86-a310-d9a5b93176d8 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:29.805538 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1c0c7-8e88-4a09-be5e-ad95648a716d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:29.807900 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1c0c7-8e88-4a09-be5e-ad95648a716d admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:29.807900 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1c0c7-8e88-4a09-be5e-ad95648a716d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:29.807900 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1c0c7-8e88-4a09-be5e-ad95648a716d admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:29.807900 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a1c0c7-8e88-4a09-be5e-ad95648a716d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:29.809461 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a1c0c7-8e88-4a09-be5e-ad95648a716d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:29.829727 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc45e79c-ac0c-4901-8809-ef1b87f5cc67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:29.831368 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc45e79c-ac0c-4901-8809-ef1b87f5cc67 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:29.842278 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 894/1789] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:29 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:29.843837 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347762e-e682-499c-9ff3-e7b8e98a6b0a None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:29.844135 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347762e-e682-499c-9ff3-e7b8e98a6b0a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:29.844477 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347762e-e682-499c-9ff3-e7b8e98a6b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:29.881255 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-c347762e-e682-499c-9ff3-e7b8e98a6b0a None None] MFA Rules not processed for user `0edf5889c5684ab49edb05564134d37a`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:29.882676 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c347762e-e682-499c-9ff3-e7b8e98a6b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:29.883276 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 896/1790] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:29 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:29.888391 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1c0c7-8e88-4a09-be5e-ad95648a716d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:29.911326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1c0c7-8e88-4a09-be5e-ad95648a716d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:29.928050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169200ef-1756-4538-800c-2b23ba31ea68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:29.928880 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169200ef-1756-4538-800c-2b23ba31ea68 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:29.930680 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169200ef-1756-4538-800c-2b23ba31ea68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:29.931472 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169200ef-1756-4538-800c-2b23ba31ea68 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:29.933824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169200ef-1756-4538-800c-2b23ba31ea68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:29.937459 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169200ef-1756-4538-800c-2b23ba31ea68 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:30.035838 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 895/1791] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:30.037290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd922d2c-fd09-4511-8de4-71e5ae054d5d None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:30.037662 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd922d2c-fd09-4511-8de4-71e5ae054d5d None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:30.038438 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd922d2c-fd09-4511-8de4-71e5ae054d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:30.078879 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-bd922d2c-fd09-4511-8de4-71e5ae054d5d None None] MFA Rules not processed for user `2c3c9b45ec964cf0b7ff966cb7884b6e`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:30.078879 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-bd922d2c-fd09-4511-8de4-71e5ae054d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:30.091512 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 897/1792] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:29 2022] POST /identity/v3/projects => generated 381 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:30.092430 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169200ef-1756-4538-800c-2b23ba31ea68 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:30.193465 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169200ef-1756-4538-800c-2b23ba31ea68 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:30.199158 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f78d926-f0f0-479e-b7a3-d81c82b1d713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:30.200247 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 896/1793] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:30.200515 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78d926-f0f0-479e-b7a3-d81c82b1d713 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:30.201629 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78d926-f0f0-479e-b7a3-d81c82b1d713 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:30.201739 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd922d2c-fd09-4511-8de4-71e5ae054d5d None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:30.202399 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78d926-f0f0-479e-b7a3-d81c82b1d713 admin admin] PATH_INFO: `/v3/projects/02d4b69a8bca48c89aa72fbff5506f51/users/63b5c43c308c4a57b0e7c3600f4c8806/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:30.219565 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd922d2c-fd09-4511-8de4-71e5ae054d5d None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:30.220414 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f78d926-f0f0-479e-b7a3-d81c82b1d713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02d4b69a8bca48c89aa72fbff5506f51, user_id=63b5c43c308c4a57b0e7c3600f4c8806, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:30.224526 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f78d926-f0f0-479e-b7a3-d81c82b1d713 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:30.225020 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adacf6f7-9f47-4213-95ce-0da038ddfa42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:30.225769 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacf6f7-9f47-4213-95ce-0da038ddfa42 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:30.226167 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacf6f7-9f47-4213-95ce-0da038ddfa42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:30.226545 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacf6f7-9f47-4213-95ce-0da038ddfa42 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:30.227386 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adacf6f7-9f47-4213-95ce-0da038ddfa42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:30.229586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adacf6f7-9f47-4213-95ce-0da038ddfa42 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:30.242183 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 897/1794] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:30.243112 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adacf6f7-9f47-4213-95ce-0da038ddfa42 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:30.249316 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-adacf6f7-9f47-4213-95ce-0da038ddfa42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:30.258374 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adacf6f7-9f47-4213-95ce-0da038ddfa42 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:30.263193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e5d56-44ed-4d71-9f65-5091da857daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:30.264555 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e5d56-44ed-4d71-9f65-5091da857daf admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:30.264555 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e5d56-44ed-4d71-9f65-5091da857daf admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:30.264555 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e5d56-44ed-4d71-9f65-5091da857daf admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:30.265208 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e5d56-44ed-4d71-9f65-5091da857daf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:30.267106 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805e5d56-44ed-4d71-9f65-5091da857daf admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:30.313626 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 898/1795] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:30 2022] PUT /identity/v3/projects/02d4b69a8bca48c89aa72fbff5506f51/users/63b5c43c308c4a57b0e7c3600f4c8806/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:30.314560 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f78d926-f0f0-479e-b7a3-d81c82b1d713 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:30.380136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f78d926-f0f0-479e-b7a3-d81c82b1d713 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:30.385083 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db4101-e59f-4234-a066-fe4f7d9a3192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:30.385738 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db4101-e59f-4234-a066-fe4f7d9a3192 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:30.386062 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db4101-e59f-4234-a066-fe4f7d9a3192 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:30.386328 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db4101-e59f-4234-a066-fe4f7d9a3192 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:30.387152 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9db4101-e59f-4234-a066-fe4f7d9a3192 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:30.389150 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9db4101-e59f-4234-a066-fe4f7d9a3192 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:30.397260 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 898/1796] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:30 2022] POST /identity/v3/projects => generated 403 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:30.399190 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e5d56-44ed-4d71-9f65-5091da857daf admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:30.470743 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e5d56-44ed-4d71-9f65-5091da857daf admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:30.475611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6c621-c1ab-40f7-b2de-2652fc16dffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:30.476630 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6c621-c1ab-40f7-b2de-2652fc16dffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:30.476913 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6c621-c1ab-40f7-b2de-2652fc16dffb admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:30.477396 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6c621-c1ab-40f7-b2de-2652fc16dffb admin admin] PATH_INFO: `/v3/users/01766db7d16149f3841de6c31798e3ba` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:30.478900 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6c621-c1ab-40f7-b2de-2652fc16dffb admin admin] RBAC: Authorizing `identity:delete_user(user_id=01766db7d16149f3841de6c31798e3ba)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:30.480889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6c621-c1ab-40f7-b2de-2652fc16dffb admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:30.496103 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 899/1797] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:30 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:30.499173 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db4101-e59f-4234-a066-fe4f7d9a3192 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:30.509577 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db4101-e59f-4234-a066-fe4f7d9a3192 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:30.521050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2a446-b8b6-483c-a806-87a911177297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:30.521050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2a446-b8b6-483c-a806-87a911177297 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:30.521050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2a446-b8b6-483c-a806-87a911177297 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:30.521050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2a446-b8b6-483c-a806-87a911177297 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:30.521475 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2a446-b8b6-483c-a806-87a911177297 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:30.523245 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2a446-b8b6-483c-a806-87a911177297 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:30.626219 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 900/1798] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:30 2022] POST /identity/v3/projects => generated 373 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:30.626219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2a446-b8b6-483c-a806-87a911177297 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:30.646842 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c2f6c621-c1ab-40f7-b2de-2652fc16dffb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01766db7d16149f3841de6c31798e3ba'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:30.664618 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c2f6c621-c1ab-40f7-b2de-2652fc16dffb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01766db7d16149f3841de6c31798e3ba'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:30.696861 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2a446-b8b6-483c-a806-87a911177297 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:30.701889 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc535fec-6dbd-40e0-83cf-34f34a7c3f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:30.702800 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc535fec-6dbd-40e0-83cf-34f34a7c3f19 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:30.703081 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc535fec-6dbd-40e0-83cf-34f34a7c3f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:30.703356 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc535fec-6dbd-40e0-83cf-34f34a7c3f19 admin admin] PATH_INFO: `/v3/projects/d06b273304514194953750d777a28a81/users/4ea77e4036934f6f8dea5ac65e73ada8/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:30.719608 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc535fec-6dbd-40e0-83cf-34f34a7c3f19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d06b273304514194953750d777a28a81, user_id=4ea77e4036934f6f8dea5ac65e73ada8, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:30.722393 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc535fec-6dbd-40e0-83cf-34f34a7c3f19 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:30.752320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c2f6c621-c1ab-40f7-b2de-2652fc16dffb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01766db7d16149f3841de6c31798e3ba'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:30.759984 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c2f6c621-c1ab-40f7-b2de-2652fc16dffb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01766db7d16149f3841de6c31798e3ba'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:30.761565 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c2f6c621-c1ab-40f7-b2de-2652fc16dffb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01766db7d16149f3841de6c31798e3ba'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:30.766909 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 899/1799] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:10:30 2022] DELETE /identity/v3/users/01766db7d16149f3841de6c31798e3ba => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:30.768317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e518dd-cdd4-4f03-b090-e573419200a2 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:30.768680 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e518dd-cdd4-4f03-b090-e573419200a2 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:30.769034 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e518dd-cdd4-4f03-b090-e573419200a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:30.797548 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-48e518dd-cdd4-4f03-b090-e573419200a2 None None] MFA Rules not processed for user `63b5c43c308c4a57b0e7c3600f4c8806`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:30.799015 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-48e518dd-cdd4-4f03-b090-e573419200a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:30.810143 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 901/1800] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:30 2022] PUT /identity/v3/projects/d06b273304514194953750d777a28a81/users/4ea77e4036934f6f8dea5ac65e73ada8/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:30.811323 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc535fec-6dbd-40e0-83cf-34f34a7c3f19 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:30.812775 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-bc535fec-6dbd-40e0-83cf-34f34a7c3f19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:30.898887 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc535fec-6dbd-40e0-83cf-34f34a7c3f19 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:30.900906 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 900/1801] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:30.901985 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e518dd-cdd4-4f03-b090-e573419200a2 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:30.903481 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-48e518dd-cdd4-4f03-b090-e573419200a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:30.908665 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0663769d-0462-4a3d-80db-eb4e4fa1952b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:30.909376 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663769d-0462-4a3d-80db-eb4e4fa1952b admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:30.909660 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663769d-0462-4a3d-80db-eb4e4fa1952b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:30.909974 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663769d-0462-4a3d-80db-eb4e4fa1952b admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:30.910835 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0663769d-0462-4a3d-80db-eb4e4fa1952b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:30.912863 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0663769d-0462-4a3d-80db-eb4e4fa1952b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:30.979439 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e518dd-cdd4-4f03-b090-e573419200a2 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:30.984942 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac033a-32ee-408b-b5c6-5919c1e46773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:30.985922 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac033a-32ee-408b-b5c6-5919c1e46773 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:30.986448 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac033a-32ee-408b-b5c6-5919c1e46773 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:30.987021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac033a-32ee-408b-b5c6-5919c1e46773 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:30.988134 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac033a-32ee-408b-b5c6-5919c1e46773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:30.989785 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac033a-32ee-408b-b5c6-5919c1e46773 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:31.000548 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 901/1802] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:31.005938 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac033a-32ee-408b-b5c6-5919c1e46773 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:31.005938 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5dac033a-32ee-408b-b5c6-5919c1e46773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:31.016662 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac033a-32ee-408b-b5c6-5919c1e46773 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:31.021389 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291b76a-d8c1-4ad8-95f6-ddfc53f4f104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:31.022102 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291b76a-d8c1-4ad8-95f6-ddfc53f4f104 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:31.022387 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291b76a-d8c1-4ad8-95f6-ddfc53f4f104 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:31.022669 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291b76a-d8c1-4ad8-95f6-ddfc53f4f104 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:31.023366 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b291b76a-d8c1-4ad8-95f6-ddfc53f4f104 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:31.025521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b291b76a-d8c1-4ad8-95f6-ddfc53f4f104 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:31.032107 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 902/1803] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:30 2022] POST /identity/v3/users => generated 308 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:31.034697 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4723ed-5426-4d28-92ee-843645823142 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:31.034697 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4723ed-5426-4d28-92ee-843645823142 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:31.034697 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4723ed-5426-4d28-92ee-843645823142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:31.053852 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-cd4723ed-5426-4d28-92ee-843645823142 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:31.055403 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-cd4723ed-5426-4d28-92ee-843645823142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:31.064423 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 903/1804] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:31.070214 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4723ed-5426-4d28-92ee-843645823142 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:31.071802 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-cd4723ed-5426-4d28-92ee-843645823142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:31.084970 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4723ed-5426-4d28-92ee-843645823142 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:31.089833 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc361ec-2c5b-4a6c-a0d4-bf906e1afcbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:31.090531 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc361ec-2c5b-4a6c-a0d4-bf906e1afcbf admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:31.090798 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc361ec-2c5b-4a6c-a0d4-bf906e1afcbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:31.091074 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc361ec-2c5b-4a6c-a0d4-bf906e1afcbf admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:31.091836 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc361ec-2c5b-4a6c-a0d4-bf906e1afcbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:31.093457 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc361ec-2c5b-4a6c-a0d4-bf906e1afcbf admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:31.104865 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 904/1805] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:31.104865 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc361ec-2c5b-4a6c-a0d4-bf906e1afcbf admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:31.107646 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-dfc361ec-2c5b-4a6c-a0d4-bf906e1afcbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:31.123958 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc361ec-2c5b-4a6c-a0d4-bf906e1afcbf admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:31.129062 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2b77c-6bbf-4ed7-aed5-33f60418dec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:31.129848 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2b77c-6bbf-4ed7-aed5-33f60418dec2 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:31.130322 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2b77c-6bbf-4ed7-aed5-33f60418dec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:31.130607 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2b77c-6bbf-4ed7-aed5-33f60418dec2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:31.133835 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f2b77c-6bbf-4ed7-aed5-33f60418dec2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:31.136649 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f2b77c-6bbf-4ed7-aed5-33f60418dec2 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:31.137571 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 902/1806] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:31 2022] POST /identity/v3/users => generated 293 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:31.138507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291b76a-d8c1-4ad8-95f6-ddfc53f4f104 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:31.150985 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291b76a-d8c1-4ad8-95f6-ddfc53f4f104 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:31.156693 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db54d21-ec56-4197-802b-51998f3c2db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:31.157681 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db54d21-ec56-4197-802b-51998f3c2db0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:31.158092 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db54d21-ec56-4197-802b-51998f3c2db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:31.158471 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db54d21-ec56-4197-802b-51998f3c2db0 admin admin] PATH_INFO: `/v3/projects/a471a14b990c4df2985409af245452e6/users/41ab105c59224bb1ad3b2f7598a40bc2/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:31.180586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db54d21-ec56-4197-802b-51998f3c2db0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a471a14b990c4df2985409af245452e6, user_id=41ab105c59224bb1ad3b2f7598a40bc2, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:31.183587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db54d21-ec56-4197-802b-51998f3c2db0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:31.238290 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 905/1807] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:31 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:31.239195 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2b77c-6bbf-4ed7-aed5-33f60418dec2 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:31.266380 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 903/1808] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:31 2022] PUT /identity/v3/projects/a471a14b990c4df2985409af245452e6/users/41ab105c59224bb1ad3b2f7598a40bc2/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:31.267668 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db54d21-ec56-4197-802b-51998f3c2db0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:31.269891 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0db54d21-ec56-4197-802b-51998f3c2db0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:31.363000 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2b77c-6bbf-4ed7-aed5-33f60418dec2 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:31.377371 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db54d21-ec56-4197-802b-51998f3c2db0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:31.381606 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af960fe6-86cf-473e-975e-12a5cceb23a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:31.382301 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af960fe6-86cf-473e-975e-12a5cceb23a1 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:31.382603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af960fe6-86cf-473e-975e-12a5cceb23a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:31.382872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af960fe6-86cf-473e-975e-12a5cceb23a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:31.438977 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ae1f6-f1a0-48e4-854a-b06b3f665318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:31.439737 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ae1f6-f1a0-48e4-854a-b06b3f665318 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:31.440023 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ae1f6-f1a0-48e4-854a-b06b3f665318 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:31.440307 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ae1f6-f1a0-48e4-854a-b06b3f665318 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:31.441044 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ae1f6-f1a0-48e4-854a-b06b3f665318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:31.442991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ae1f6-f1a0-48e4-854a-b06b3f665318 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:31.453831 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 906/1809] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:31.453831 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ae1f6-f1a0-48e4-854a-b06b3f665318 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:31.471449 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af960fe6-86cf-473e-975e-12a5cceb23a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:31.473459 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af960fe6-86cf-473e-975e-12a5cceb23a1 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:31.475113 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ae1f6-f1a0-48e4-854a-b06b3f665318 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:31.485401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc2268-9e2d-4472-aafb-40a5eb4ceeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:31.486335 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc2268-9e2d-4472-aafb-40a5eb4ceeb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:31.486786 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc2268-9e2d-4472-aafb-40a5eb4ceeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:31.487070 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc2268-9e2d-4472-aafb-40a5eb4ceeb7 admin admin] PATH_INFO: `/v3/projects/d06b273304514194953750d777a28a81/users/4ea77e4036934f6f8dea5ac65e73ada8/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:31.487425 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 904/1810] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:31.489129 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc2268-9e2d-4472-aafb-40a5eb4ceeb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d06b273304514194953750d777a28a81, user_id=4ea77e4036934f6f8dea5ac65e73ada8, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:31.492046 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc2268-9e2d-4472-aafb-40a5eb4ceeb7 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:31.493639 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af960fe6-86cf-473e-975e-12a5cceb23a1 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:31.510827 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 907/1811] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:31 2022] PUT /identity/v3/projects/d06b273304514194953750d777a28a81/users/4ea77e4036934f6f8dea5ac65e73ada8/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:31.510827 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc2268-9e2d-4472-aafb-40a5eb4ceeb7 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:31.511091 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af960fe6-86cf-473e-975e-12a5cceb23a1 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:31.601277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc2268-9e2d-4472-aafb-40a5eb4ceeb7 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:31.602598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995da37-9bc1-4300-b23a-bd6a247ca622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:31.603739 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995da37-9bc1-4300-b23a-bd6a247ca622 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:31.604638 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995da37-9bc1-4300-b23a-bd6a247ca622 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:31.605225 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995da37-9bc1-4300-b23a-bd6a247ca622 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:31.606471 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3995da37-9bc1-4300-b23a-bd6a247ca622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:31.606612 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc296d89-375a-4661-882d-a88cfe8ca6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:31.607769 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc296d89-375a-4661-882d-a88cfe8ca6c3 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:31.608049 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc296d89-375a-4661-882d-a88cfe8ca6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:31.608323 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc296d89-375a-4661-882d-a88cfe8ca6c3 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:31.609018 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc296d89-375a-4661-882d-a88cfe8ca6c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:31.610462 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3995da37-9bc1-4300-b23a-bd6a247ca622 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:31.611056 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc296d89-375a-4661-882d-a88cfe8ca6c3 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:31.632450 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 905/1812] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:31.633682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995da37-9bc1-4300-b23a-bd6a247ca622 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:31.644812 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995da37-9bc1-4300-b23a-bd6a247ca622 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:31.649836 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b91c3-023b-46d4-ad76-987156cd37c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:31.650497 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b91c3-023b-46d4-ad76-987156cd37c2 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:31.650789 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b91c3-023b-46d4-ad76-987156cd37c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:31.651121 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b91c3-023b-46d4-ad76-987156cd37c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:31.651870 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b91c3-023b-46d4-ad76-987156cd37c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:31.653831 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b91c3-023b-46d4-ad76-987156cd37c2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:31.667014 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 906/1813] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:31.668162 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b91c3-023b-46d4-ad76-987156cd37c2 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:31.687924 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 908/1814] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:31 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:31.688458 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b91c3-023b-46d4-ad76-987156cd37c2 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:31.689540 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cacfee-e758-458b-a18d-d503b8057154 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:31.689788 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cacfee-e758-458b-a18d-d503b8057154 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:31.690063 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cacfee-e758-458b-a18d-d503b8057154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:31.697701 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e11d3-87a3-414b-9735-1f250bb25af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:31.707788 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e11d3-87a3-414b-9735-1f250bb25af1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:31.710542 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e11d3-87a3-414b-9735-1f250bb25af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:31.710542 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e11d3-87a3-414b-9735-1f250bb25af1 admin admin] PATH_INFO: `/v3/projects/fdf5f626cd484dacb0d7020b27c52261/users/c43dab85c5b04ebcbc04c48525699dbd/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:31.722081 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-01cacfee-e758-458b-a18d-d503b8057154 None None] MFA Rules not processed for user `4ea77e4036934f6f8dea5ac65e73ada8`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:31.730535 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-01cacfee-e758-458b-a18d-d503b8057154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:31.744474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e11d3-87a3-414b-9735-1f250bb25af1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdf5f626cd484dacb0d7020b27c52261, user_id=c43dab85c5b04ebcbc04c48525699dbd, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:31.747557 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e11d3-87a3-414b-9735-1f250bb25af1 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:31.825699 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 907/1815] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:31 2022] PUT /identity/v3/projects/fdf5f626cd484dacb0d7020b27c52261/users/c43dab85c5b04ebcbc04c48525699dbd/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:31.827176 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e11d3-87a3-414b-9735-1f250bb25af1 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:31.881589 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 909/1816] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:31 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:31.883847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cacfee-e758-458b-a18d-d503b8057154 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:31.900904 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cacfee-e758-458b-a18d-d503b8057154 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:31.933021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e11d3-87a3-414b-9735-1f250bb25af1 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:31.947373 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383af34c-83f1-412b-9551-6dc26f2498f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:31.948587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383af34c-83f1-412b-9551-6dc26f2498f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:31.948875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383af34c-83f1-412b-9551-6dc26f2498f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:31.949152 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383af34c-83f1-412b-9551-6dc26f2498f5 admin admin] PATH_INFO: `/v3/projects/1966d802dbb04c6ca9ff26d7e3adcb5d/users/26bd0c33d8424f0bb4ec21acd7b18ee0/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:31.968736 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383af34c-83f1-412b-9551-6dc26f2498f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1966d802dbb04c6ca9ff26d7e3adcb5d, user_id=26bd0c33d8424f0bb4ec21acd7b18ee0, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:31.971470 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383af34c-83f1-412b-9551-6dc26f2498f5 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:31.985667 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa685f2-3350-433b-94f8-0594a0022a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:31.986610 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa685f2-3350-433b-94f8-0594a0022a6b admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:31.986891 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa685f2-3350-433b-94f8-0594a0022a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:31.991294 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa685f2-3350-433b-94f8-0594a0022a6b admin admin] PATH_INFO: `/v3/projects/a471a14b990c4df2985409af245452e6/users/41ab105c59224bb1ad3b2f7598a40bc2/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:31.991294 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa685f2-3350-433b-94f8-0594a0022a6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a471a14b990c4df2985409af245452e6, user_id=41ab105c59224bb1ad3b2f7598a40bc2, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:31.991913 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa685f2-3350-433b-94f8-0594a0022a6b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:32.012728 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 910/1817] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:31 2022] PUT /identity/v3/projects/a471a14b990c4df2985409af245452e6/users/41ab105c59224bb1ad3b2f7598a40bc2/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:32.014331 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa685f2-3350-433b-94f8-0594a0022a6b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:32.077662 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 908/1818] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:31 2022] PUT /identity/v3/projects/1966d802dbb04c6ca9ff26d7e3adcb5d/users/26bd0c33d8424f0bb4ec21acd7b18ee0/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:32.078672 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383af34c-83f1-412b-9551-6dc26f2498f5 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:32.097826 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa685f2-3350-433b-94f8-0594a0022a6b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:32.168776 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383af34c-83f1-412b-9551-6dc26f2498f5 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:32.171224 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1de839-27fc-436b-b23b-63bd779ce47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:32.171909 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1de839-27fc-436b-b23b-63bd779ce47e admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:32.173038 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1de839-27fc-436b-b23b-63bd779ce47e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:32.173401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1de839-27fc-436b-b23b-63bd779ce47e admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:32.174165 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1de839-27fc-436b-b23b-63bd779ce47e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:32.174279 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4403a3ab-0c1a-41e5-9391-2689999d5c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:32.175030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403a3ab-0c1a-41e5-9391-2689999d5c31 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:32.175319 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403a3ab-0c1a-41e5-9391-2689999d5c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:32.175599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403a3ab-0c1a-41e5-9391-2689999d5c31 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:32.175916 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1de839-27fc-436b-b23b-63bd779ce47e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:32.176325 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4403a3ab-0c1a-41e5-9391-2689999d5c31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:32.185576 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4403a3ab-0c1a-41e5-9391-2689999d5c31 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:32.189825 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 911/1819] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:32.189825 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1de839-27fc-436b-b23b-63bd779ce47e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:32.191765 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0d1de839-27fc-436b-b23b-63bd779ce47e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:32.200285 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 909/1820] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:32.200285 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e7e6c-72b6-4260-a85b-d37932bca001 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:32.200285 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e7e6c-72b6-4260-a85b-d37932bca001 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:32.200285 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e7e6c-72b6-4260-a85b-d37932bca001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:32.235249 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-937e7e6c-72b6-4260-a85b-d37932bca001 None None] MFA Rules not processed for user `41ab105c59224bb1ad3b2f7598a40bc2`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:32.236483 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-937e7e6c-72b6-4260-a85b-d37932bca001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:32.295562 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1de839-27fc-436b-b23b-63bd779ce47e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:32.308667 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a51cd1-029b-454b-b3cb-e07d474da6fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:32.309342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a51cd1-029b-454b-b3cb-e07d474da6fc service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:32.309626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a51cd1-029b-454b-b3cb-e07d474da6fc service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:32.309938 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a51cd1-029b-454b-b3cb-e07d474da6fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:32.327096 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 910/1821] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:32 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:32.327096 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e7e6c-72b6-4260-a85b-d37932bca001 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:32.329071 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-937e7e6c-72b6-4260-a85b-d37932bca001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:32.371924 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e7e6c-72b6-4260-a85b-d37932bca001 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:32.378054 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9658831-8275-422d-8987-521b0f1e8a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:32.379010 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9658831-8275-422d-8987-521b0f1e8a9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:32.379368 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9658831-8275-422d-8987-521b0f1e8a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:32.379476 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a51cd1-029b-454b-b3cb-e07d474da6fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:32.379760 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9658831-8275-422d-8987-521b0f1e8a9f admin admin] PATH_INFO: `/v3/projects/85d2645abec44bf6ae235dc9c4255453` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:32.381065 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9658831-8275-422d-8987-521b0f1e8a9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=85d2645abec44bf6ae235dc9c4255453)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:32.381324 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a51cd1-029b-454b-b3cb-e07d474da6fc service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:32.383340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9658831-8275-422d-8987-521b0f1e8a9f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:32.393325 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 912/1822] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:32 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:32.394184 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a51cd1-029b-454b-b3cb-e07d474da6fc service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:32.405443 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a51cd1-029b-454b-b3cb-e07d474da6fc service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:32.411092 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148672c-3354-4b4c-839a-5b3c6d841068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:32.411781 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148672c-3354-4b4c-839a-5b3c6d841068 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:32.412063 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148672c-3354-4b4c-839a-5b3c6d841068 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:32.412337 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148672c-3354-4b4c-839a-5b3c6d841068 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:32.413076 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9148672c-3354-4b4c-839a-5b3c6d841068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:32.415012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9148672c-3354-4b4c-839a-5b3c6d841068 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:32.431945 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 913/1823] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:32.437222 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148672c-3354-4b4c-839a-5b3c6d841068 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:32.443541 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148672c-3354-4b4c-839a-5b3c6d841068 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:32.448450 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a42a2-8f0a-4b8e-b73d-461203d6ffa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:32.449330 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a42a2-8f0a-4b8e-b73d-461203d6ffa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:32.449639 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a42a2-8f0a-4b8e-b73d-461203d6ffa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:32.449943 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a42a2-8f0a-4b8e-b73d-461203d6ffa5 admin admin] PATH_INFO: `/v3/projects/aa3c2e0b24464e67b52e707dc7915dd2/users/4e0c63064b8d4efab074b0842e3d0914/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:32.467662 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a42a2-8f0a-4b8e-b73d-461203d6ffa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa3c2e0b24464e67b52e707dc7915dd2, user_id=4e0c63064b8d4efab074b0842e3d0914, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:32.471275 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a42a2-8f0a-4b8e-b73d-461203d6ffa5 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:32.552777 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 914/1824] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:32 2022] PUT /identity/v3/projects/aa3c2e0b24464e67b52e707dc7915dd2/users/4e0c63064b8d4efab074b0842e3d0914/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:32.553596 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a42a2-8f0a-4b8e-b73d-461203d6ffa5 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:32.568737 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d9658831-8275-422d-8987-521b0f1e8a9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85d2645abec44bf6ae235dc9c4255453', 'request_id': 'req-d9658831-8275-422d-8987-521b0f1e8a9f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:32.589169 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d9658831-8275-422d-8987-521b0f1e8a9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85d2645abec44bf6ae235dc9c4255453', 'request_id': 'req-d9658831-8275-422d-8987-521b0f1e8a9f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:32.600338 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d9658831-8275-422d-8987-521b0f1e8a9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85d2645abec44bf6ae235dc9c4255453', 'request_id': 'req-d9658831-8275-422d-8987-521b0f1e8a9f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:32.644640 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a42a2-8f0a-4b8e-b73d-461203d6ffa5 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:32.672227 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d9658831-8275-422d-8987-521b0f1e8a9f admin admin] The token cache is being invalidate because project 85d2645abec44bf6ae235dc9c4255453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:10:32.673207 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d9658831-8275-422d-8987-521b0f1e8a9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:32.673505 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d9658831-8275-422d-8987-521b0f1e8a9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:32.681589 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 911/1825] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:10:32 2022] DELETE /identity/v3/projects/85d2645abec44bf6ae235dc9c4255453 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:32.683146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9658831-8275-422d-8987-521b0f1e8a9f admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:32.684720 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d9658831-8275-422d-8987-521b0f1e8a9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:32.757155 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bcf64c-cf0f-44b4-b037-254dc4ae0a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:32.757155 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bcf64c-cf0f-44b4-b037-254dc4ae0a7d admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:32.757155 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bcf64c-cf0f-44b4-b037-254dc4ae0a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:32.757155 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bcf64c-cf0f-44b4-b037-254dc4ae0a7d admin admin] PATH_INFO: `/v3/projects/fdf5f626cd484dacb0d7020b27c52261/users/c43dab85c5b04ebcbc04c48525699dbd/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:32.762313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bcf64c-cf0f-44b4-b037-254dc4ae0a7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdf5f626cd484dacb0d7020b27c52261, user_id=c43dab85c5b04ebcbc04c48525699dbd, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:32.769049 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bcf64c-cf0f-44b4-b037-254dc4ae0a7d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:32.792078 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 915/1826] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:32 2022] PUT /identity/v3/projects/fdf5f626cd484dacb0d7020b27c52261/users/c43dab85c5b04ebcbc04c48525699dbd/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:32.792269 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9658831-8275-422d-8987-521b0f1e8a9f admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:32.795029 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bcf64c-cf0f-44b4-b037-254dc4ae0a7d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:32.804144 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-72bcf64c-cf0f-44b4-b037-254dc4ae0a7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:32.898355 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bcf64c-cf0f-44b4-b037-254dc4ae0a7d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:32.903768 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2babc-ee34-4d3c-8def-0bf6399ac014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:32.904618 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2babc-ee34-4d3c-8def-0bf6399ac014 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:32.904892 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2babc-ee34-4d3c-8def-0bf6399ac014 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:32.905166 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2babc-ee34-4d3c-8def-0bf6399ac014 admin admin] PATH_INFO: `/v3/projects/1966d802dbb04c6ca9ff26d7e3adcb5d/users/26bd0c33d8424f0bb4ec21acd7b18ee0/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:32.909110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a2babc-ee34-4d3c-8def-0bf6399ac014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1966d802dbb04c6ca9ff26d7e3adcb5d, user_id=26bd0c33d8424f0bb4ec21acd7b18ee0, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:32.910573 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a2babc-ee34-4d3c-8def-0bf6399ac014 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:32.913667 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ed596-d4ae-45bd-844d-ad860e831350 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:32.914776 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ed596-d4ae-45bd-844d-ad860e831350 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:32.915123 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ed596-d4ae-45bd-844d-ad860e831350 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:32.915465 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ed596-d4ae-45bd-844d-ad860e831350 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:32.919312 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-cc3ed596-d4ae-45bd-844d-ad860e831350 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:32.937271 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 916/1827] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:32 2022] PUT /identity/v3/projects/1966d802dbb04c6ca9ff26d7e3adcb5d/users/26bd0c33d8424f0bb4ec21acd7b18ee0/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:32.938349 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2babc-ee34-4d3c-8def-0bf6399ac014 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:32.953731 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-26a2babc-ee34-4d3c-8def-0bf6399ac014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:33.034756 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ed596-d4ae-45bd-844d-ad860e831350 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:33.036341 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ed596-d4ae-45bd-844d-ad860e831350 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:33.053802 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 912/1828] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:32 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:33.058032 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2babc-ee34-4d3c-8def-0bf6399ac014 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:33.063481 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb9242f-f375-4b6d-b7a1-3d02d72f20f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:33.063876 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ed596-d4ae-45bd-844d-ad860e831350 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:33.064160 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb9242f-f375-4b6d-b7a1-3d02d72f20f6 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:33.064556 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb9242f-f375-4b6d-b7a1-3d02d72f20f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:33.064843 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb9242f-f375-4b6d-b7a1-3d02d72f20f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:33.065619 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb9242f-f375-4b6d-b7a1-3d02d72f20f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:33.067636 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb9242f-f375-4b6d-b7a1-3d02d72f20f6 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:33.068396 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-cc3ed596-d4ae-45bd-844d-ad860e831350 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:33.082147 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 917/1829] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:33.082147 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c8a3b-a093-4f2c-ac2c-8eabb59133de None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:33.082147 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c8a3b-a093-4f2c-ac2c-8eabb59133de None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:33.082147 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c8a3b-a093-4f2c-ac2c-8eabb59133de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:33.082606 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ed596-d4ae-45bd-844d-ad860e831350 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:33.087253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a6076-ee1e-4f5a-ab7a-6899f123db8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:33.088125 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a6076-ee1e-4f5a-ab7a-6899f123db8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:33.088430 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a6076-ee1e-4f5a-ab7a-6899f123db8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:33.088726 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a6076-ee1e-4f5a-ab7a-6899f123db8a admin admin] PATH_INFO: `/v3/users/6f1c4811f83d4eb694d1546a71626e4c` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:33.089954 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429a6076-ee1e-4f5a-ab7a-6899f123db8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f1c4811f83d4eb694d1546a71626e4c)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:33.092453 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429a6076-ee1e-4f5a-ab7a-6899f123db8a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:33.121663 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-741c8a3b-a093-4f2c-ac2c-8eabb59133de None None] MFA Rules not processed for user `26bd0c33d8424f0bb4ec21acd7b18ee0`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:33.123051 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-741c8a3b-a093-4f2c-ac2c-8eabb59133de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:33.221967 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 918/1830] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:33 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:33.223010 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c8a3b-a093-4f2c-ac2c-8eabb59133de None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:33.249203 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c8a3b-a093-4f2c-ac2c-8eabb59133de None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:33.254397 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85810934-ee67-4a96-9668-60571676f6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:33.255301 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85810934-ee67-4a96-9668-60571676f6e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:33.255613 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85810934-ee67-4a96-9668-60571676f6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:33.255851 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85810934-ee67-4a96-9668-60571676f6e4 admin admin] PATH_INFO: `/v3/projects/aa3c2e0b24464e67b52e707dc7915dd2/users/4e0c63064b8d4efab074b0842e3d0914/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:33.258083 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85810934-ee67-4a96-9668-60571676f6e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa3c2e0b24464e67b52e707dc7915dd2, user_id=4e0c63064b8d4efab074b0842e3d0914, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:33.261006 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85810934-ee67-4a96-9668-60571676f6e4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:33.286379 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 919/1831] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:33 2022] PUT /identity/v3/projects/aa3c2e0b24464e67b52e707dc7915dd2/users/4e0c63064b8d4efab074b0842e3d0914/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:33.286379 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85810934-ee67-4a96-9668-60571676f6e4 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:33.288408 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-85810934-ee67-4a96-9668-60571676f6e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:33.365241 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85810934-ee67-4a96-9668-60571676f6e4 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:33.370820 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519366cb-de46-4efb-bc5c-11e89b0535cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:33.371708 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519366cb-de46-4efb-bc5c-11e89b0535cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:33.371998 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519366cb-de46-4efb-bc5c-11e89b0535cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:33.372275 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519366cb-de46-4efb-bc5c-11e89b0535cb admin admin] PATH_INFO: `/v3/users/f640d0ae6e03466ba0de6b0001ae8d2c` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:33.373551 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519366cb-de46-4efb-bc5c-11e89b0535cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f640d0ae6e03466ba0de6b0001ae8d2c)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:33.375544 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519366cb-de46-4efb-bc5c-11e89b0535cb admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:33.820070 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-429a6076-ee1e-4f5a-ab7a-6899f123db8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f1c4811f83d4eb694d1546a71626e4c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:33.824505 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-519366cb-de46-4efb-bc5c-11e89b0535cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f640d0ae6e03466ba0de6b0001ae8d2c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:33.844557 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-519366cb-de46-4efb-bc5c-11e89b0535cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f640d0ae6e03466ba0de6b0001ae8d2c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:33.851523 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-429a6076-ee1e-4f5a-ab7a-6899f123db8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f1c4811f83d4eb694d1546a71626e4c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:33.906621 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-519366cb-de46-4efb-bc5c-11e89b0535cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f640d0ae6e03466ba0de6b0001ae8d2c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:33.908121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-519366cb-de46-4efb-bc5c-11e89b0535cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f640d0ae6e03466ba0de6b0001ae8d2c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:33.923159 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-519366cb-de46-4efb-bc5c-11e89b0535cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f640d0ae6e03466ba0de6b0001ae8d2c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:33.932505 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 920/1832] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:10:33 2022] DELETE /identity/v3/users/f640d0ae6e03466ba0de6b0001ae8d2c => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:33.933273 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519366cb-de46-4efb-bc5c-11e89b0535cb admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:33.934761 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-519366cb-de46-4efb-bc5c-11e89b0535cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:33.992968 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-429a6076-ee1e-4f5a-ab7a-6899f123db8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f1c4811f83d4eb694d1546a71626e4c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:34.005424 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-429a6076-ee1e-4f5a-ab7a-6899f123db8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f1c4811f83d4eb694d1546a71626e4c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:34.006260 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-429a6076-ee1e-4f5a-ab7a-6899f123db8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f1c4811f83d4eb694d1546a71626e4c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:34.012617 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 913/1833] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:10:33 2022] DELETE /identity/v3/users/6f1c4811f83d4eb694d1546a71626e4c => generated 0 bytes in 949 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:34.014152 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9e224-f081-4801-acf1-d10fcfac77fd None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:34.014419 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9e224-f081-4801-acf1-d10fcfac77fd None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:34.014704 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9e224-f081-4801-acf1-d10fcfac77fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:34.043120 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519366cb-de46-4efb-bc5c-11e89b0535cb admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:34.059046 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-fcd9e224-f081-4801-acf1-d10fcfac77fd None None] MFA Rules not processed for user `4e0c63064b8d4efab074b0842e3d0914`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:34.062670 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-fcd9e224-f081-4801-acf1-d10fcfac77fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:34.141326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a48953-0061-426c-8aa1-0a46341a0c37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:34.142046 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a48953-0061-426c-8aa1-0a46341a0c37 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:34.142388 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a48953-0061-426c-8aa1-0a46341a0c37 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:34.142895 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a48953-0061-426c-8aa1-0a46341a0c37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:34.145000 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-70a48953-0061-426c-8aa1-0a46341a0c37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:34.160285 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 914/1834] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:34 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:34.160786 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8e60b-f110-40f1-b4bd-c6dcbffd1312 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:34.161021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8e60b-f110-40f1-b4bd-c6dcbffd1312 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:34.161306 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8e60b-f110-40f1-b4bd-c6dcbffd1312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:34.180995 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-fbb8e60b-f110-40f1-b4bd-c6dcbffd1312 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:34.182256 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-fbb8e60b-f110-40f1-b4bd-c6dcbffd1312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:34.223344 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a48953-0061-426c-8aa1-0a46341a0c37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:34.226744 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a48953-0061-426c-8aa1-0a46341a0c37 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:34.238634 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 921/1835] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:33 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:34.240181 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a48953-0061-426c-8aa1-0a46341a0c37 service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:34.241747 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-70a48953-0061-426c-8aa1-0a46341a0c37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:34.259528 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a48953-0061-426c-8aa1-0a46341a0c37 service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:34.267692 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1948b2-84cf-4f94-a3bf-57307ff3a95a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:34.268991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1948b2-84cf-4f94-a3bf-57307ff3a95a service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:34.269350 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1948b2-84cf-4f94-a3bf-57307ff3a95a service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:34.269693 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1948b2-84cf-4f94-a3bf-57307ff3a95a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:34.273606 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 915/1836] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:34.289716 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1948b2-84cf-4f94-a3bf-57307ff3a95a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:34.292020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1948b2-84cf-4f94-a3bf-57307ff3a95a service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:34.292611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb8e60b-f110-40f1-b4bd-c6dcbffd1312 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:34.295159 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-fbb8e60b-f110-40f1-b4bd-c6dcbffd1312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:34.302917 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 922/1837] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:34 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:34.335578 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1948b2-84cf-4f94-a3bf-57307ff3a95a service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:34.336997 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3c1948b2-84cf-4f94-a3bf-57307ff3a95a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:34.374445 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb8e60b-f110-40f1-b4bd-c6dcbffd1312 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:34.387730 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc82e23-8092-4814-a258-b6ceff55ea1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:34.388573 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc82e23-8092-4814-a258-b6ceff55ea1a service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:34.388922 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc82e23-8092-4814-a258-b6ceff55ea1a service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:34.389654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc82e23-8092-4814-a258-b6ceff55ea1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:34.400447 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc82e23-8092-4814-a258-b6ceff55ea1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:34.404506 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc82e23-8092-4814-a258-b6ceff55ea1a service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:34.421675 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 916/1838] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:10:34.422582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc82e23-8092-4814-a258-b6ceff55ea1a service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:34.423936 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9bc82e23-8092-4814-a258-b6ceff55ea1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:34.433463 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1948b2-84cf-4f94-a3bf-57307ff3a95a service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:34.440797 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12342ca-06f8-498f-9388-120470e7a6dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:34.442003 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc82e23-8092-4814-a258-b6ceff55ea1a service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:34.442650 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12342ca-06f8-498f-9388-120470e7a6dc service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:34.443636 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12342ca-06f8-498f-9388-120470e7a6dc service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:34.444399 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12342ca-06f8-498f-9388-120470e7a6dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:34.447283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d12342ca-06f8-498f-9388-120470e7a6dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:34.450172 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc972c-8c00-433f-a426-04c7f64445d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:34.451297 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc972c-8c00-433f-a426-04c7f64445d0 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:34.451675 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc972c-8c00-433f-a426-04c7f64445d0 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:34.452015 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc972c-8c00-433f-a426-04c7f64445d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:34.454306 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-91bc972c-8c00-433f-a426-04c7f64445d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:34.473539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12342ca-06f8-498f-9388-120470e7a6dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:34.473539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12342ca-06f8-498f-9388-120470e7a6dc service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:34.483559 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 923/1839] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:10:34.504297 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12342ca-06f8-498f-9388-120470e7a6dc service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:34.518627 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12342ca-06f8-498f-9388-120470e7a6dc service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:34.524605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f3e8b-d593-4640-86bf-4c2928a89c0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:34.525043 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f3e8b-d593-4640-86bf-4c2928a89c0f service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:34.525327 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f3e8b-d593-4640-86bf-4c2928a89c0f service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:34.525606 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f3e8b-d593-4640-86bf-4c2928a89c0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:34.527682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a12f3e8b-d593-4640-86bf-4c2928a89c0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:34.532425 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc972c-8c00-433f-a426-04c7f64445d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:34.533991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc972c-8c00-433f-a426-04c7f64445d0 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:34.543286 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 917/1840] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:34.556827 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc972c-8c00-433f-a426-04c7f64445d0 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:34.559406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-91bc972c-8c00-433f-a426-04c7f64445d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:34.584813 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc972c-8c00-433f-a426-04c7f64445d0 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:34.605657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436b69f-4f49-4361-a45c-e1cc2fddd4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:34.606585 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436b69f-4f49-4361-a45c-e1cc2fddd4f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:34.606899 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436b69f-4f49-4361-a45c-e1cc2fddd4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:34.610955 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436b69f-4f49-4361-a45c-e1cc2fddd4f6 admin admin] PATH_INFO: `/v3/projects/b829b92b4f6045e0a2f52fd5a025822f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:34.611972 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f3e8b-d593-4640-86bf-4c2928a89c0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:34.613415 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436b69f-4f49-4361-a45c-e1cc2fddd4f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b829b92b4f6045e0a2f52fd5a025822f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:34.613639 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f3e8b-d593-4640-86bf-4c2928a89c0f service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:34.615362 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436b69f-4f49-4361-a45c-e1cc2fddd4f6 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:34.625817 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 924/1841] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:34.735224 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d436b69f-4f49-4361-a45c-e1cc2fddd4f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b829b92b4f6045e0a2f52fd5a025822f', 'request_id': 'req-d436b69f-4f49-4361-a45c-e1cc2fddd4f6'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:34.740394 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d436b69f-4f49-4361-a45c-e1cc2fddd4f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b829b92b4f6045e0a2f52fd5a025822f', 'request_id': 'req-d436b69f-4f49-4361-a45c-e1cc2fddd4f6'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:34.746642 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d436b69f-4f49-4361-a45c-e1cc2fddd4f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b829b92b4f6045e0a2f52fd5a025822f', 'request_id': 'req-d436b69f-4f49-4361-a45c-e1cc2fddd4f6'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:34.838585 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d436b69f-4f49-4361-a45c-e1cc2fddd4f6 admin admin] The token cache is being invalidate because project b829b92b4f6045e0a2f52fd5a025822f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:10:34.839191 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d436b69f-4f49-4361-a45c-e1cc2fddd4f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:34.839521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d436b69f-4f49-4361-a45c-e1cc2fddd4f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:34.845946 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 918/1842] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:10:34 2022] DELETE /identity/v3/projects/b829b92b4f6045e0a2f52fd5a025822f => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:10:34.846778 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65779e-b991-4dd0-8c19-d96fb3b4145d None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:34.847210 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65779e-b991-4dd0-8c19-d96fb3b4145d None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:34.847488 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65779e-b991-4dd0-8c19-d96fb3b4145d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:34.887538 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-2e65779e-b991-4dd0-8c19-d96fb3b4145d None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:34.892839 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2e65779e-b991-4dd0-8c19-d96fb3b4145d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:35.026893 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 925/1843] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:35.035360 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c967b3-aac4-42fb-bbd8-90100ce45906 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:35.036357 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c967b3-aac4-42fb-bbd8-90100ce45906 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:35.036357 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c967b3-aac4-42fb-bbd8-90100ce45906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:35.042793 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8be827-c762-46d6-9a82-45bc8b051241 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:35.049300 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8be827-c762-46d6-9a82-45bc8b051241 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:35.049731 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8be827-c762-46d6-9a82-45bc8b051241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:35.063579 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-b7c967b3-aac4-42fb-bbd8-90100ce45906 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:35.065673 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b7c967b3-aac4-42fb-bbd8-90100ce45906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:35.085999 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-3a8be827-c762-46d6-9a82-45bc8b051241 None None] MFA Rules not processed for user `c43dab85c5b04ebcbc04c48525699dbd`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:35.092121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3a8be827-c762-46d6-9a82-45bc8b051241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:35.095019 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 919/1844] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:35.099503 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c967b3-aac4-42fb-bbd8-90100ce45906 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:35.120539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c967b3-aac4-42fb-bbd8-90100ce45906 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:35.139067 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608dedb5-c7df-4525-85e3-eaada89ff769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:35.139808 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608dedb5-c7df-4525-85e3-eaada89ff769 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:35.140154 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608dedb5-c7df-4525-85e3-eaada89ff769 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:35.140440 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608dedb5-c7df-4525-85e3-eaada89ff769 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:35.141314 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608dedb5-c7df-4525-85e3-eaada89ff769 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:10:35.141670 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608dedb5-c7df-4525-85e3-eaada89ff769 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:35.150610 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608dedb5-c7df-4525-85e3-eaada89ff769 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:35.169878 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 926/1845] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:35 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:35.178046 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 920/1846] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:10:35.186033 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8be827-c762-46d6-9a82-45bc8b051241 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:35.198784 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8be827-c762-46d6-9a82-45bc8b051241 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:35.226701 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b5923-6c2c-4528-b511-2f10c21b0aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:35.231102 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b5923-6c2c-4528-b511-2f10c21b0aa3 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:35.231102 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b5923-6c2c-4528-b511-2f10c21b0aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:35.231102 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b5923-6c2c-4528-b511-2f10c21b0aa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:35.231102 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b5923-6c2c-4528-b511-2f10c21b0aa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:35.231452 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b5923-6c2c-4528-b511-2f10c21b0aa3 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:35.262980 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608dedb5-c7df-4525-85e3-eaada89ff769 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:35.265970 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-608dedb5-c7df-4525-85e3-eaada89ff769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:35.283215 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608dedb5-c7df-4525-85e3-eaada89ff769 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:35.288791 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a87b8-68fd-4836-bbab-34bca716c729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:35.289657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a87b8-68fd-4836-bbab-34bca716c729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:35.289980 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a87b8-68fd-4836-bbab-34bca716c729 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:35.290243 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a87b8-68fd-4836-bbab-34bca716c729 admin admin] PATH_INFO: `/v3/projects/aba0b127c04d4ea595f14a5d573313b2` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:35.291507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a87b8-68fd-4836-bbab-34bca716c729 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aba0b127c04d4ea595f14a5d573313b2)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:35.293448 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a87b8-68fd-4836-bbab-34bca716c729 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:35.340700 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 927/1847] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:35 2022] POST /identity/v3/projects => generated 397 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:35.355488 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b5923-6c2c-4528-b511-2f10c21b0aa3 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:35.444845 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b5923-6c2c-4528-b511-2f10c21b0aa3 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:35.460968 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6c1a87b8-68fd-4836-bbab-34bca716c729 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aba0b127c04d4ea595f14a5d573313b2', 'request_id': 'req-6c1a87b8-68fd-4836-bbab-34bca716c729'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:35.466904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6c1a87b8-68fd-4836-bbab-34bca716c729 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aba0b127c04d4ea595f14a5d573313b2', 'request_id': 'req-6c1a87b8-68fd-4836-bbab-34bca716c729'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:35.475043 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6c1a87b8-68fd-4836-bbab-34bca716c729 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aba0b127c04d4ea595f14a5d573313b2', 'request_id': 'req-6c1a87b8-68fd-4836-bbab-34bca716c729'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:35.507994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41badb87-e8a1-4969-b92d-6e00a0bd1124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:35.508684 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41badb87-e8a1-4969-b92d-6e00a0bd1124 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:35.508973 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41badb87-e8a1-4969-b92d-6e00a0bd1124 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:35.509249 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41badb87-e8a1-4969-b92d-6e00a0bd1124 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:35.509978 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41badb87-e8a1-4969-b92d-6e00a0bd1124 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:35.512117 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41badb87-e8a1-4969-b92d-6e00a0bd1124 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:35.555044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6c1a87b8-68fd-4836-bbab-34bca716c729 admin admin] The token cache is being invalidate because project aba0b127c04d4ea595f14a5d573313b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:10:35.556004 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6c1a87b8-68fd-4836-bbab-34bca716c729 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:35.558265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6c1a87b8-68fd-4836-bbab-34bca716c729 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:35.561800 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 921/1848] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:10:35 2022] DELETE /identity/v3/projects/aba0b127c04d4ea595f14a5d573313b2 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:10:35.562851 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a87b8-68fd-4836-bbab-34bca716c729 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:35.564424 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6c1a87b8-68fd-4836-bbab-34bca716c729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:35.584818 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a87b8-68fd-4836-bbab-34bca716c729 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:35.601710 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 928/1849] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:35 2022] POST /identity/v3/users => generated 299 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:35.603689 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41badb87-e8a1-4969-b92d-6e00a0bd1124 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:35.606055 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-41badb87-e8a1-4969-b92d-6e00a0bd1124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:35.610550 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafd589-ab28-49e7-8334-6eba4d7c07fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:35.610833 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafd589-ab28-49e7-8334-6eba4d7c07fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:35.611093 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafd589-ab28-49e7-8334-6eba4d7c07fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:35.613774 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafd589-ab28-49e7-8334-6eba4d7c07fd admin admin] PATH_INFO: `/v3/users/2c3c9b45ec964cf0b7ff966cb7884b6e` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:35.615298 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bafd589-ab28-49e7-8334-6eba4d7c07fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c3c9b45ec964cf0b7ff966cb7884b6e)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:35.617295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bafd589-ab28-49e7-8334-6eba4d7c07fd admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:35.633916 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41badb87-e8a1-4969-b92d-6e00a0bd1124 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:35.650568 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b736d-d643-4e8d-af72-ab26d7f13fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:35.651368 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b736d-d643-4e8d-af72-ab26d7f13fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:35.651653 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b736d-d643-4e8d-af72-ab26d7f13fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:35.651915 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b736d-d643-4e8d-af72-ab26d7f13fcb admin admin] PATH_INFO: `/v3/users/63b5c43c308c4a57b0e7c3600f4c8806` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:35.653606 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b736d-d643-4e8d-af72-ab26d7f13fcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=63b5c43c308c4a57b0e7c3600f4c8806)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:35.655764 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b736d-d643-4e8d-af72-ab26d7f13fcb admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:35.871449 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6bafd589-ab28-49e7-8334-6eba4d7c07fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c3c9b45ec964cf0b7ff966cb7884b6e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:35.886498 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6bafd589-ab28-49e7-8334-6eba4d7c07fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c3c9b45ec964cf0b7ff966cb7884b6e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:35.907996 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-fc2b736d-d643-4e8d-af72-ab26d7f13fcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63b5c43c308c4a57b0e7c3600f4c8806'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:35.923110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-fc2b736d-d643-4e8d-af72-ab26d7f13fcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63b5c43c308c4a57b0e7c3600f4c8806'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:35.969614 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6bafd589-ab28-49e7-8334-6eba4d7c07fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c3c9b45ec964cf0b7ff966cb7884b6e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:35.978097 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6bafd589-ab28-49e7-8334-6eba4d7c07fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c3c9b45ec964cf0b7ff966cb7884b6e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:35.979286 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6bafd589-ab28-49e7-8334-6eba4d7c07fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c3c9b45ec964cf0b7ff966cb7884b6e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:35.986758 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 922/1850] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:10:35 2022] DELETE /identity/v3/users/2c3c9b45ec964cf0b7ff966cb7884b6e => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:35.988050 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafd589-ab28-49e7-8334-6eba4d7c07fd admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:35.990401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6bafd589-ab28-49e7-8334-6eba4d7c07fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:36.027416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-fc2b736d-d643-4e8d-af72-ab26d7f13fcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63b5c43c308c4a57b0e7c3600f4c8806'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:36.028047 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-fc2b736d-d643-4e8d-af72-ab26d7f13fcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63b5c43c308c4a57b0e7c3600f4c8806'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:36.039499 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-fc2b736d-d643-4e8d-af72-ab26d7f13fcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63b5c43c308c4a57b0e7c3600f4c8806'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:36.055632 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 929/1851] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:10:35 2022] DELETE /identity/v3/users/63b5c43c308c4a57b0e7c3600f4c8806 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:36.057007 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b736d-d643-4e8d-af72-ab26d7f13fcb admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:36.058931 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-fc2b736d-d643-4e8d-af72-ab26d7f13fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:36.094649 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafd589-ab28-49e7-8334-6eba4d7c07fd admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:36.139286 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b736d-d643-4e8d-af72-ab26d7f13fcb admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:36.147914 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2ef28-9177-402c-a565-e5ef94662cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:36.148640 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2ef28-9177-402c-a565-e5ef94662cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:36.148936 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2ef28-9177-402c-a565-e5ef94662cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:36.149196 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2ef28-9177-402c-a565-e5ef94662cd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:36.149944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e2ef28-9177-402c-a565-e5ef94662cd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:36.151554 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e2ef28-9177-402c-a565-e5ef94662cd2 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:36.163306 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8659423-3462-48c8-801b-4ebea97cf850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:36.164167 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 930/1852] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:36.164433 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8659423-3462-48c8-801b-4ebea97cf850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:36.164778 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8659423-3462-48c8-801b-4ebea97cf850 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:36.164875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2ef28-9177-402c-a565-e5ef94662cd2 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:36.165120 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8659423-3462-48c8-801b-4ebea97cf850 admin admin] PATH_INFO: `/v3/users/41ab105c59224bb1ad3b2f7598a40bc2` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:36.166666 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d3e2ef28-9177-402c-a565-e5ef94662cd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:36.166783 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8659423-3462-48c8-801b-4ebea97cf850 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41ab105c59224bb1ad3b2f7598a40bc2)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:36.171106 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8659423-3462-48c8-801b-4ebea97cf850 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:36.244955 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2ef28-9177-402c-a565-e5ef94662cd2 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:36.252288 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a212a5e-0227-4387-950c-60bd0c83a7e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:36.253049 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a212a5e-0227-4387-950c-60bd0c83a7e4 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:36.253521 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a212a5e-0227-4387-950c-60bd0c83a7e4 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:36.253890 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a212a5e-0227-4387-950c-60bd0c83a7e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:36.255772 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6a212a5e-0227-4387-950c-60bd0c83a7e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:36.324503 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a212a5e-0227-4387-950c-60bd0c83a7e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:36.326703 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a212a5e-0227-4387-950c-60bd0c83a7e4 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:36.335963 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 931/1853] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:36.339507 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56123705-a6fd-4702-9e56-b8bb6b4321cc None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:36.339507 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56123705-a6fd-4702-9e56-b8bb6b4321cc None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:36.339507 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56123705-a6fd-4702-9e56-b8bb6b4321cc None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:36.339507 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 932/1854] 10.222.0.23 () {54 vars in 921 bytes} [Sat Apr 30 21:10:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:10:36.340373 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2393d-9f15-48de-81e0-40fcfa339e78 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:36.340662 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2393d-9f15-48de-81e0-40fcfa339e78 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:36.340965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2393d-9f15-48de-81e0-40fcfa339e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:36.362574 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-eec2393d-9f15-48de-81e0-40fcfa339e78 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:36.362574 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-eec2393d-9f15-48de-81e0-40fcfa339e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:36.379354 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 933/1855] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:36.381227 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c9c9c-6308-4c04-b11b-8cf4c8cb265e None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:36.381582 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c9c9c-6308-4c04-b11b-8cf4c8cb265e None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:36.382282 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c9c9c-6308-4c04-b11b-8cf4c8cb265e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:36.403626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-d37c9c9c-6308-4c04-b11b-8cf4c8cb265e None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:36.405004 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d37c9c9c-6308-4c04-b11b-8cf4c8cb265e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:36.408920 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d8659423-3462-48c8-801b-4ebea97cf850 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41ab105c59224bb1ad3b2f7598a40bc2'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:36.415414 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 934/1856] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:36.425357 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c9c9c-6308-4c04-b11b-8cf4c8cb265e None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:36.429128 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c9c9c-6308-4c04-b11b-8cf4c8cb265e None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:36.434926 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4ded2-5621-4605-9864-43290ecfa298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:36.436242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4ded2-5621-4605-9864-43290ecfa298 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:36.436588 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4ded2-5621-4605-9864-43290ecfa298 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:36.436929 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4ded2-5621-4605-9864-43290ecfa298 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:36.438001 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4ded2-5621-4605-9864-43290ecfa298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:36.439862 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4ded2-5621-4605-9864-43290ecfa298 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:36.441888 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d8659423-3462-48c8-801b-4ebea97cf850 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41ab105c59224bb1ad3b2f7598a40bc2'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:36.454683 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 935/1857] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:36.456242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c35e80-070d-4cea-8145-e65349817828 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:36.456594 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c35e80-070d-4cea-8145-e65349817828 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:36.456935 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c35e80-070d-4cea-8145-e65349817828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:36.479693 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-78c35e80-070d-4cea-8145-e65349817828 None None] MFA Rules not processed for user `fca4ee1f64c8489ebe7296f9f8f0ab41`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:36.481576 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-78c35e80-070d-4cea-8145-e65349817828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:36.493914 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 936/1858] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Apr 30 21:10:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:36.494940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c35e80-070d-4cea-8145-e65349817828 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:36.496405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-78c35e80-070d-4cea-8145-e65349817828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:36.507545 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d8659423-3462-48c8-801b-4ebea97cf850 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41ab105c59224bb1ad3b2f7598a40bc2'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:36.519914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d8659423-3462-48c8-801b-4ebea97cf850 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41ab105c59224bb1ad3b2f7598a40bc2'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:36.520747 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d8659423-3462-48c8-801b-4ebea97cf850 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41ab105c59224bb1ad3b2f7598a40bc2'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:36.527643 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 923/1859] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:10:35 2022] DELETE /identity/v3/users/41ab105c59224bb1ad3b2f7598a40bc2 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:36.528551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8659423-3462-48c8-801b-4ebea97cf850 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:36.534580 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d8659423-3462-48c8-801b-4ebea97cf850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:36.585668 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c35e80-070d-4cea-8145-e65349817828 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:36.631423 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8659423-3462-48c8-801b-4ebea97cf850 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:36.638414 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f1123-7412-47e8-a326-3715142aa849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:36.639089 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f1123-7412-47e8-a326-3715142aa849 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:36.639373 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f1123-7412-47e8-a326-3715142aa849 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:36.639701 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f1123-7412-47e8-a326-3715142aa849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:36.642456 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4f9f1123-7412-47e8-a326-3715142aa849 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:36.657430 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41d434-74b3-454f-94b5-e6fbf54a1720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:36.658136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41d434-74b3-454f-94b5-e6fbf54a1720 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:36.658420 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41d434-74b3-454f-94b5-e6fbf54a1720 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:36.658695 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41d434-74b3-454f-94b5-e6fbf54a1720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:36.661982 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ef41d434-74b3-454f-94b5-e6fbf54a1720 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:36.723241 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9f1123-7412-47e8-a326-3715142aa849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:36.724741 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9f1123-7412-47e8-a326-3715142aa849 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:36.736628 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 924/1860] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:36.737473 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f1123-7412-47e8-a326-3715142aa849 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:36.738813 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4f9f1123-7412-47e8-a326-3715142aa849 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:36.751182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f1123-7412-47e8-a326-3715142aa849 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:36.756759 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9cdfe-0cc1-41e9-ac38-a69778bafd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:36.757664 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9cdfe-0cc1-41e9-ac38-a69778bafd24 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:36.757987 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9cdfe-0cc1-41e9-ac38-a69778bafd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:36.758259 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9cdfe-0cc1-41e9-ac38-a69778bafd24 admin admin] PATH_INFO: `/v3/projects/f89134e53ab740b2915cbd6b096d33c0/users/97204941595d4b758b0e9f1f0ec0d6fe/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:36.775105 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9cdfe-0cc1-41e9-ac38-a69778bafd24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f89134e53ab740b2915cbd6b096d33c0, user_id=97204941595d4b758b0e9f1f0ec0d6fe, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:36.776411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef41d434-74b3-454f-94b5-e6fbf54a1720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:36.778303 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9cdfe-0cc1-41e9-ac38-a69778bafd24 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:36.778651 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef41d434-74b3-454f-94b5-e6fbf54a1720 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:36.795553 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 937/1861] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:36.796493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41d434-74b3-454f-94b5-e6fbf54a1720 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:36.799263 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ef41d434-74b3-454f-94b5-e6fbf54a1720 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:36.871570 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 925/1862] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:36 2022] PUT /identity/v3/projects/f89134e53ab740b2915cbd6b096d33c0/users/97204941595d4b758b0e9f1f0ec0d6fe/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:36.882802 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4545f-ee26-40dd-9608-ef8ba595842f None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:36.883114 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4545f-ee26-40dd-9608-ef8ba595842f None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:36.883372 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4545f-ee26-40dd-9608-ef8ba595842f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:36.890644 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41d434-74b3-454f-94b5-e6fbf54a1720 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:36.911869 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-30e4545f-ee26-40dd-9608-ef8ba595842f None None] MFA Rules not processed for user `97204941595d4b758b0e9f1f0ec0d6fe`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:36.918929 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-30e4545f-ee26-40dd-9608-ef8ba595842f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:36.967511 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4228d7e-a45c-44d2-a320-bc37ffb91354 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:36.968668 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4228d7e-a45c-44d2-a320-bc37ffb91354 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:36.969156 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4228d7e-a45c-44d2-a320-bc37ffb91354 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:36.969502 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4228d7e-a45c-44d2-a320-bc37ffb91354 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:36.971719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a4228d7e-a45c-44d2-a320-bc37ffb91354 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:36.984877 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4228d7e-a45c-44d2-a320-bc37ffb91354 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:36.986573 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4228d7e-a45c-44d2-a320-bc37ffb91354 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:36.987803 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 926/1863] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:36.992350 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4545f-ee26-40dd-9608-ef8ba595842f None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:37.011029 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 938/1864] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:37.061429 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4545f-ee26-40dd-9608-ef8ba595842f None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:37.066618 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f37587-d0b8-4f0a-a279-d2cc63ec188b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:37.068440 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f37587-d0b8-4f0a-a279-d2cc63ec188b admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:37.068440 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f37587-d0b8-4f0a-a279-d2cc63ec188b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:37.068440 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f37587-d0b8-4f0a-a279-d2cc63ec188b admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:37.068691 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f37587-d0b8-4f0a-a279-d2cc63ec188b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:37.070462 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f37587-d0b8-4f0a-a279-d2cc63ec188b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:37.205726 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 927/1865] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:36 2022] POST /identity/v3/projects => generated 397 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:10:37.209879 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4228d7e-a45c-44d2-a320-bc37ffb91354 service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:37.224125 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4228d7e-a45c-44d2-a320-bc37ffb91354 service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:37.323475 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f138da4-34d1-45bd-9a48-939a8360aa26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:37.324155 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f138da4-34d1-45bd-9a48-939a8360aa26 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:37.324837 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f138da4-34d1-45bd-9a48-939a8360aa26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:37.324837 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f138da4-34d1-45bd-9a48-939a8360aa26 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:37.325405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f138da4-34d1-45bd-9a48-939a8360aa26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:37.328078 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f138da4-34d1-45bd-9a48-939a8360aa26 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:37.403844 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 939/1866] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:37 2022] POST /identity/v3/users => generated 305 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:10:37.404291 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f37587-d0b8-4f0a-a279-d2cc63ec188b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:37.417260 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f37587-d0b8-4f0a-a279-d2cc63ec188b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:37.423255 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94e756-932a-4093-b315-c1c27518395d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:37.424116 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94e756-932a-4093-b315-c1c27518395d admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:37.424567 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94e756-932a-4093-b315-c1c27518395d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:37.425042 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94e756-932a-4093-b315-c1c27518395d admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:37.425810 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94e756-932a-4093-b315-c1c27518395d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:37.427618 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94e756-932a-4093-b315-c1c27518395d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:37.444298 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f138da4-34d1-45bd-9a48-939a8360aa26 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:37.448711 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 928/1867] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:37.456048 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f138da4-34d1-45bd-9a48-939a8360aa26 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:37.463040 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4fbe27-e7ef-402c-9613-6d5ea9b5dcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:37.463937 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fbe27-e7ef-402c-9613-6d5ea9b5dcc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:37.464266 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fbe27-e7ef-402c-9613-6d5ea9b5dcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:37.464541 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fbe27-e7ef-402c-9613-6d5ea9b5dcc6 admin admin] PATH_INFO: `/v3/projects/12a4cb04327c4a7b89c799dd4746a402/users/5434661ccee64e0d9210fadb577b4e20/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:37.507510 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4fbe27-e7ef-402c-9613-6d5ea9b5dcc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12a4cb04327c4a7b89c799dd4746a402, user_id=5434661ccee64e0d9210fadb577b4e20, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:37.510768 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4fbe27-e7ef-402c-9613-6d5ea9b5dcc6 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:37.635098 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94e756-932a-4093-b315-c1c27518395d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:37.642026 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8d94e756-932a-4093-b315-c1c27518395d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:37.673600 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94e756-932a-4093-b315-c1c27518395d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:37.679563 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb668de8-d69e-4639-b907-c4054c4dd1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:37.680457 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb668de8-d69e-4639-b907-c4054c4dd1e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:37.680741 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb668de8-d69e-4639-b907-c4054c4dd1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:37.681017 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb668de8-d69e-4639-b907-c4054c4dd1e2 admin admin] PATH_INFO: `/v3/projects/a471a14b990c4df2985409af245452e6` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:37.685976 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb668de8-d69e-4639-b907-c4054c4dd1e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a471a14b990c4df2985409af245452e6)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:37.692898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb668de8-d69e-4639-b907-c4054c4dd1e2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:37.693178 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 940/1868] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:37 2022] PUT /identity/v3/projects/12a4cb04327c4a7b89c799dd4746a402/users/5434661ccee64e0d9210fadb577b4e20/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:37.698268 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4fbe27-e7ef-402c-9613-6d5ea9b5dcc6 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:37.703350 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6e4fbe27-e7ef-402c-9613-6d5ea9b5dcc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:37.787138 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4fbe27-e7ef-402c-9613-6d5ea9b5dcc6 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:37.791684 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca29051-ebc4-45c7-8dc7-d23a5b8ae1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:37.792553 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca29051-ebc4-45c7-8dc7-d23a5b8ae1dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:37.792834 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca29051-ebc4-45c7-8dc7-d23a5b8ae1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:37.793109 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca29051-ebc4-45c7-8dc7-d23a5b8ae1dd admin admin] PATH_INFO: `/v3/projects/02bd5a4841264531b97b5cf4e0a5acff` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:37.794929 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca29051-ebc4-45c7-8dc7-d23a5b8ae1dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=02bd5a4841264531b97b5cf4e0a5acff)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:37.797156 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca29051-ebc4-45c7-8dc7-d23a5b8ae1dd admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:37.853592 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cb668de8-d69e-4639-b907-c4054c4dd1e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a471a14b990c4df2985409af245452e6', 'request_id': 'req-cb668de8-d69e-4639-b907-c4054c4dd1e2'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:37.861011 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cb668de8-d69e-4639-b907-c4054c4dd1e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a471a14b990c4df2985409af245452e6', 'request_id': 'req-cb668de8-d69e-4639-b907-c4054c4dd1e2'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:37.867581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cb668de8-d69e-4639-b907-c4054c4dd1e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a471a14b990c4df2985409af245452e6', 'request_id': 'req-cb668de8-d69e-4639-b907-c4054c4dd1e2'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:37.971601 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-fca29051-ebc4-45c7-8dc7-d23a5b8ae1dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02bd5a4841264531b97b5cf4e0a5acff', 'request_id': 'req-fca29051-ebc4-45c7-8dc7-d23a5b8ae1dd'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:37.977605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-fca29051-ebc4-45c7-8dc7-d23a5b8ae1dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02bd5a4841264531b97b5cf4e0a5acff', 'request_id': 'req-fca29051-ebc4-45c7-8dc7-d23a5b8ae1dd'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:37.985116 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-fca29051-ebc4-45c7-8dc7-d23a5b8ae1dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02bd5a4841264531b97b5cf4e0a5acff', 'request_id': 'req-fca29051-ebc4-45c7-8dc7-d23a5b8ae1dd'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:37.986746 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cb668de8-d69e-4639-b907-c4054c4dd1e2 admin admin] The token cache is being invalidate because project a471a14b990c4df2985409af245452e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:10:37.987223 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cb668de8-d69e-4639-b907-c4054c4dd1e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:37.987767 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cb668de8-d69e-4639-b907-c4054c4dd1e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:37.999952 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 929/1869] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:10:37 2022] DELETE /identity/v3/projects/a471a14b990c4df2985409af245452e6 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:10:37.999952 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb668de8-d69e-4639-b907-c4054c4dd1e2 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:37.999952 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-cb668de8-d69e-4639-b907-c4054c4dd1e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:38.070713 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb668de8-d69e-4639-b907-c4054c4dd1e2 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:38.112210 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-fca29051-ebc4-45c7-8dc7-d23a5b8ae1dd admin admin] The token cache is being invalidate because project 02bd5a4841264531b97b5cf4e0a5acff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:10:38.112494 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-fca29051-ebc4-45c7-8dc7-d23a5b8ae1dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:38.116783 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-fca29051-ebc4-45c7-8dc7-d23a5b8ae1dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:38.116783 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 941/1870] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:10:37 2022] DELETE /identity/v3/projects/02bd5a4841264531b97b5cf4e0a5acff => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:38.116783 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca29051-ebc4-45c7-8dc7-d23a5b8ae1dd admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:38.118685 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-fca29051-ebc4-45c7-8dc7-d23a5b8ae1dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:38.127134 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d85760-c6b7-4604-ad5c-7cded6083db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:38.127880 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d85760-c6b7-4604-ad5c-7cded6083db6 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:38.128109 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d85760-c6b7-4604-ad5c-7cded6083db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:38.128386 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d85760-c6b7-4604-ad5c-7cded6083db6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:38.129104 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d85760-c6b7-4604-ad5c-7cded6083db6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:38.130718 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d85760-c6b7-4604-ad5c-7cded6083db6 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:38.140737 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 930/1871] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:38.141668 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d85760-c6b7-4604-ad5c-7cded6083db6 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:38.146540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b1d85760-c6b7-4604-ad5c-7cded6083db6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:38.161311 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d85760-c6b7-4604-ad5c-7cded6083db6 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:38.166070 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e725bd2-6466-4dd7-bbc8-88c850f8c3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:38.166923 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e725bd2-6466-4dd7-bbc8-88c850f8c3a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:38.167315 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e725bd2-6466-4dd7-bbc8-88c850f8c3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:38.167687 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e725bd2-6466-4dd7-bbc8-88c850f8c3a7 admin admin] PATH_INFO: `/v3/users/0edf5889c5684ab49edb05564134d37a` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:38.168801 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e725bd2-6466-4dd7-bbc8-88c850f8c3a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0edf5889c5684ab49edb05564134d37a)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:38.171312 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e725bd2-6466-4dd7-bbc8-88c850f8c3a7 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:38.188643 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca29051-ebc4-45c7-8dc7-d23a5b8ae1dd admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:38.194882 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082381a6-be67-463e-844d-559beaf8d9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:38.195858 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082381a6-be67-463e-844d-559beaf8d9df admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:38.196265 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082381a6-be67-463e-844d-559beaf8d9df admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:38.196640 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082381a6-be67-463e-844d-559beaf8d9df admin admin] PATH_INFO: `/v3/projects/02d4b69a8bca48c89aa72fbff5506f51` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:38.197985 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082381a6-be67-463e-844d-559beaf8d9df admin admin] RBAC: Authorizing `identity:delete_project(project_id=02d4b69a8bca48c89aa72fbff5506f51)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:38.199910 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082381a6-be67-463e-844d-559beaf8d9df admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:38.395089 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3e725bd2-6466-4dd7-bbc8-88c850f8c3a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0edf5889c5684ab49edb05564134d37a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:38.399610 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-082381a6-be67-463e-844d-559beaf8d9df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02d4b69a8bca48c89aa72fbff5506f51', 'request_id': 'req-082381a6-be67-463e-844d-559beaf8d9df'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:38.406005 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-082381a6-be67-463e-844d-559beaf8d9df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02d4b69a8bca48c89aa72fbff5506f51', 'request_id': 'req-082381a6-be67-463e-844d-559beaf8d9df'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:38.408974 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3e725bd2-6466-4dd7-bbc8-88c850f8c3a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0edf5889c5684ab49edb05564134d37a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:38.412868 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-082381a6-be67-463e-844d-559beaf8d9df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02d4b69a8bca48c89aa72fbff5506f51', 'request_id': 'req-082381a6-be67-463e-844d-559beaf8d9df'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:38.500271 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3e725bd2-6466-4dd7-bbc8-88c850f8c3a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0edf5889c5684ab49edb05564134d37a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:38.507537 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3e725bd2-6466-4dd7-bbc8-88c850f8c3a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0edf5889c5684ab49edb05564134d37a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:38.508176 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3e725bd2-6466-4dd7-bbc8-88c850f8c3a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0edf5889c5684ab49edb05564134d37a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:38.514582 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 931/1872] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:10:38 2022] DELETE /identity/v3/users/0edf5889c5684ab49edb05564134d37a => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:38.517625 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f90fb7-050d-47a5-b0f0-53e680095c7b None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:38.517625 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f90fb7-050d-47a5-b0f0-53e680095c7b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:38.517625 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f90fb7-050d-47a5-b0f0-53e680095c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:38.534966 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-32f90fb7-050d-47a5-b0f0-53e680095c7b None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:38.536118 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-32f90fb7-050d-47a5-b0f0-53e680095c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:38.597278 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-082381a6-be67-463e-844d-559beaf8d9df admin admin] The token cache is being invalidate because project 02d4b69a8bca48c89aa72fbff5506f51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:10:38.606713 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-082381a6-be67-463e-844d-559beaf8d9df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:38.607977 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-082381a6-be67-463e-844d-559beaf8d9df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:38.609706 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 942/1873] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:10:38 2022] DELETE /identity/v3/projects/02d4b69a8bca48c89aa72fbff5506f51 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:38.613748 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082381a6-be67-463e-844d-559beaf8d9df admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:38.614871 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-082381a6-be67-463e-844d-559beaf8d9df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:38.633107 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 932/1874] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:38.634180 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f90fb7-050d-47a5-b0f0-53e680095c7b None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:38.635926 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-32f90fb7-050d-47a5-b0f0-53e680095c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:38.649154 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f90fb7-050d-47a5-b0f0-53e680095c7b None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:38.655629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692abb9-f4f8-463a-83d8-c6b49ebc2f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:38.657346 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692abb9-f4f8-463a-83d8-c6b49ebc2f2d admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:38.657635 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692abb9-f4f8-463a-83d8-c6b49ebc2f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:38.657967 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692abb9-f4f8-463a-83d8-c6b49ebc2f2d admin admin] PATH_INFO: `/v3/projects/12a4cb04327c4a7b89c799dd4746a402/users/5434661ccee64e0d9210fadb577b4e20/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:38.660041 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692abb9-f4f8-463a-83d8-c6b49ebc2f2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=12a4cb04327c4a7b89c799dd4746a402, user_id=5434661ccee64e0d9210fadb577b4e20, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:38.662858 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692abb9-f4f8-463a-83d8-c6b49ebc2f2d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:38.690161 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 933/1875] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:38 2022] PUT /identity/v3/projects/12a4cb04327c4a7b89c799dd4746a402/users/5434661ccee64e0d9210fadb577b4e20/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:38.712245 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692abb9-f4f8-463a-83d8-c6b49ebc2f2d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:38.712245 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7692abb9-f4f8-463a-83d8-c6b49ebc2f2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:38.733660 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082381a6-be67-463e-844d-559beaf8d9df admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:38.796018 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f2e3f-7b9b-4c6e-bc13-2611be911fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:38.796830 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f2e3f-7b9b-4c6e-bc13-2611be911fde admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:38.797117 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f2e3f-7b9b-4c6e-bc13-2611be911fde admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:38.797237 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692abb9-f4f8-463a-83d8-c6b49ebc2f2d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:38.797425 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f2e3f-7b9b-4c6e-bc13-2611be911fde admin admin] PATH_INFO: `/v3/users/26bd0c33d8424f0bb4ec21acd7b18ee0` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:38.798651 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f2e3f-7b9b-4c6e-bc13-2611be911fde admin admin] RBAC: Authorizing `identity:delete_user(user_id=26bd0c33d8424f0bb4ec21acd7b18ee0)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:38.800946 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f2e3f-7b9b-4c6e-bc13-2611be911fde admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:38.805412 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48f873-d3e8-4da6-a6a2-1d2efb0902fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:38.806625 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48f873-d3e8-4da6-a6a2-1d2efb0902fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:38.806992 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48f873-d3e8-4da6-a6a2-1d2efb0902fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:38.807370 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48f873-d3e8-4da6-a6a2-1d2efb0902fe admin admin] PATH_INFO: `/v3/users/4e0c63064b8d4efab074b0842e3d0914` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:38.809083 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e48f873-d3e8-4da6-a6a2-1d2efb0902fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e0c63064b8d4efab074b0842e3d0914)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:38.812029 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e48f873-d3e8-4da6-a6a2-1d2efb0902fe admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:39.697210 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-df3f2e3f-7b9b-4c6e-bc13-2611be911fde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26bd0c33d8424f0bb4ec21acd7b18ee0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:39.708788 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-df3f2e3f-7b9b-4c6e-bc13-2611be911fde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26bd0c33d8424f0bb4ec21acd7b18ee0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:39.725609 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1e48f873-d3e8-4da6-a6a2-1d2efb0902fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e0c63064b8d4efab074b0842e3d0914'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:39.737599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1e48f873-d3e8-4da6-a6a2-1d2efb0902fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e0c63064b8d4efab074b0842e3d0914'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:39.805956 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-df3f2e3f-7b9b-4c6e-bc13-2611be911fde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26bd0c33d8424f0bb4ec21acd7b18ee0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:39.805956 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-df3f2e3f-7b9b-4c6e-bc13-2611be911fde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26bd0c33d8424f0bb4ec21acd7b18ee0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:39.812002 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-df3f2e3f-7b9b-4c6e-bc13-2611be911fde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26bd0c33d8424f0bb4ec21acd7b18ee0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:39.818453 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 943/1876] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:10:38 2022] DELETE /identity/v3/users/26bd0c33d8424f0bb4ec21acd7b18ee0 => generated 0 bytes in 1208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:39.820050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8c194-0502-452f-99b4-e49b02ec0c26 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:39.820341 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8c194-0502-452f-99b4-e49b02ec0c26 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:39.820610 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8c194-0502-452f-99b4-e49b02ec0c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:39.847489 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-c4b8c194-0502-452f-99b4-e49b02ec0c26 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:39.847489 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c4b8c194-0502-452f-99b4-e49b02ec0c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:39.869746 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1e48f873-d3e8-4da6-a6a2-1d2efb0902fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e0c63064b8d4efab074b0842e3d0914'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:39.878509 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1e48f873-d3e8-4da6-a6a2-1d2efb0902fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e0c63064b8d4efab074b0842e3d0914'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:39.882169 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1e48f873-d3e8-4da6-a6a2-1d2efb0902fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e0c63064b8d4efab074b0842e3d0914'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:39.888453 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 934/1877] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:10:38 2022] DELETE /identity/v3/users/4e0c63064b8d4efab074b0842e3d0914 => generated 0 bytes in 1198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:39.893474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89677600-a2a8-482c-ba40-2664c8bf9de6 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:39.893474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89677600-a2a8-482c-ba40-2664c8bf9de6 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:39.893474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89677600-a2a8-482c-ba40-2664c8bf9de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:39.953638 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-89677600-a2a8-482c-ba40-2664c8bf9de6 None None] MFA Rules not processed for user `5434661ccee64e0d9210fadb577b4e20`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:39.954919 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-89677600-a2a8-482c-ba40-2664c8bf9de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:39.961328 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 944/1878] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:39.962504 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8c194-0502-452f-99b4-e49b02ec0c26 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:39.964253 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c4b8c194-0502-452f-99b4-e49b02ec0c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:39.977308 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8c194-0502-452f-99b4-e49b02ec0c26 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:40.036436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911739e8-7aeb-4aed-bd08-7f468d1cdb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:40.037328 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911739e8-7aeb-4aed-bd08-7f468d1cdb5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:40.037610 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911739e8-7aeb-4aed-bd08-7f468d1cdb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:40.037966 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911739e8-7aeb-4aed-bd08-7f468d1cdb5f admin admin] PATH_INFO: `/v3/users/0bf48a2788554054b6d36719147ef1b4` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:40.042798 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911739e8-7aeb-4aed-bd08-7f468d1cdb5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bf48a2788554054b6d36719147ef1b4)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:40.047262 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 935/1879] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:39 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:40.049132 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89677600-a2a8-482c-ba40-2664c8bf9de6 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:40.051952 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-89677600-a2a8-482c-ba40-2664c8bf9de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:40.056353 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911739e8-7aeb-4aed-bd08-7f468d1cdb5f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:40.066734 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89677600-a2a8-482c-ba40-2664c8bf9de6 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:40.073481 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2f773-f4bd-4474-a2ae-b72c260b229b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:40.074727 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2f773-f4bd-4474-a2ae-b72c260b229b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:40.074727 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2f773-f4bd-4474-a2ae-b72c260b229b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:40.075020 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2f773-f4bd-4474-a2ae-b72c260b229b admin admin] PATH_INFO: `/v3/projects/2f4e29696e894e59bae3740046e2c292` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:40.076760 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2f773-f4bd-4474-a2ae-b72c260b229b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f4e29696e894e59bae3740046e2c292)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:40.078816 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2f773-f4bd-4474-a2ae-b72c260b229b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:40.286966 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4cc2f773-f4bd-4474-a2ae-b72c260b229b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f4e29696e894e59bae3740046e2c292', 'request_id': 'req-4cc2f773-f4bd-4474-a2ae-b72c260b229b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:40.287359 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-911739e8-7aeb-4aed-bd08-7f468d1cdb5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bf48a2788554054b6d36719147ef1b4'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:40.292537 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4cc2f773-f4bd-4474-a2ae-b72c260b229b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f4e29696e894e59bae3740046e2c292', 'request_id': 'req-4cc2f773-f4bd-4474-a2ae-b72c260b229b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:40.302097 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-911739e8-7aeb-4aed-bd08-7f468d1cdb5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bf48a2788554054b6d36719147ef1b4'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:40.308659 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4cc2f773-f4bd-4474-a2ae-b72c260b229b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f4e29696e894e59bae3740046e2c292', 'request_id': 'req-4cc2f773-f4bd-4474-a2ae-b72c260b229b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:40.379720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-911739e8-7aeb-4aed-bd08-7f468d1cdb5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bf48a2788554054b6d36719147ef1b4'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:40.382788 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-911739e8-7aeb-4aed-bd08-7f468d1cdb5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bf48a2788554054b6d36719147ef1b4'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:40.388588 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-911739e8-7aeb-4aed-bd08-7f468d1cdb5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bf48a2788554054b6d36719147ef1b4'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:40.394744 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 945/1880] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:10:39 2022] DELETE /identity/v3/users/0bf48a2788554054b6d36719147ef1b4 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:40.395530 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911739e8-7aeb-4aed-bd08-7f468d1cdb5f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:40.396860 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-911739e8-7aeb-4aed-bd08-7f468d1cdb5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:40.459219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911739e8-7aeb-4aed-bd08-7f468d1cdb5f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:40.463718 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc997e41-e5a8-4179-9a8c-18a2279d11ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:40.464371 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc997e41-e5a8-4179-9a8c-18a2279d11ff admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:40.464648 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc997e41-e5a8-4179-9a8c-18a2279d11ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:40.464779 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4cc2f773-f4bd-4474-a2ae-b72c260b229b admin admin] The token cache is being invalidate because project 2f4e29696e894e59bae3740046e2c292 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:10:40.464921 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc997e41-e5a8-4179-9a8c-18a2279d11ff admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:40.465011 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4cc2f773-f4bd-4474-a2ae-b72c260b229b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:40.465565 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4cc2f773-f4bd-4474-a2ae-b72c260b229b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:40.465669 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc997e41-e5a8-4179-9a8c-18a2279d11ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:10:40.466002 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc997e41-e5a8-4179-9a8c-18a2279d11ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:40.467188 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 936/1881] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:10:40 2022] DELETE /identity/v3/projects/2f4e29696e894e59bae3740046e2c292 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:40.468758 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc997e41-e5a8-4179-9a8c-18a2279d11ff admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:40.468854 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2f773-f4bd-4474-a2ae-b72c260b229b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:40.470291 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4cc2f773-f4bd-4474-a2ae-b72c260b229b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:40.480034 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 946/1882] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:10:40.480848 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc997e41-e5a8-4179-9a8c-18a2279d11ff admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:40.482492 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-fc997e41-e5a8-4179-9a8c-18a2279d11ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:40.494820 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc997e41-e5a8-4179-9a8c-18a2279d11ff admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:40.501116 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b26ff-8901-4a8c-83d0-c7fe59b44bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:40.507486 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b26ff-8901-4a8c-83d0-c7fe59b44bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:40.507486 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b26ff-8901-4a8c-83d0-c7fe59b44bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:40.507486 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b26ff-8901-4a8c-83d0-c7fe59b44bc9 admin admin] PATH_INFO: `/v3/projects/aa3c2e0b24464e67b52e707dc7915dd2` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:40.507486 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b26ff-8901-4a8c-83d0-c7fe59b44bc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa3c2e0b24464e67b52e707dc7915dd2)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:40.507486 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b26ff-8901-4a8c-83d0-c7fe59b44bc9 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:40.547110 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2f773-f4bd-4474-a2ae-b72c260b229b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:40.608045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617cd53c-8bc0-4090-b41b-ccfa7bc83387 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:40.608622 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cd53c-8bc0-4090-b41b-ccfa7bc83387 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:40.608909 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cd53c-8bc0-4090-b41b-ccfa7bc83387 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:40.609186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cd53c-8bc0-4090-b41b-ccfa7bc83387 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:40.611007 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-617cd53c-8bc0-4090-b41b-ccfa7bc83387 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:40.666506 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3a6b26ff-8901-4a8c-83d0-c7fe59b44bc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa3c2e0b24464e67b52e707dc7915dd2', 'request_id': 'req-3a6b26ff-8901-4a8c-83d0-c7fe59b44bc9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:40.667161 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617cd53c-8bc0-4090-b41b-ccfa7bc83387 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:40.668840 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617cd53c-8bc0-4090-b41b-ccfa7bc83387 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:40.672226 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3a6b26ff-8901-4a8c-83d0-c7fe59b44bc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa3c2e0b24464e67b52e707dc7915dd2', 'request_id': 'req-3a6b26ff-8901-4a8c-83d0-c7fe59b44bc9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:40.678041 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 937/1883] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:40 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:40.678847 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617cd53c-8bc0-4090-b41b-ccfa7bc83387 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:40.678978 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3a6b26ff-8901-4a8c-83d0-c7fe59b44bc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa3c2e0b24464e67b52e707dc7915dd2', 'request_id': 'req-3a6b26ff-8901-4a8c-83d0-c7fe59b44bc9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:40.680132 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-617cd53c-8bc0-4090-b41b-ccfa7bc83387 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:40.694109 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617cd53c-8bc0-4090-b41b-ccfa7bc83387 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:40.751339 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c46a54-cdd7-4499-a71c-735682236724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:40.752184 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c46a54-cdd7-4499-a71c-735682236724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:40.752467 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c46a54-cdd7-4499-a71c-735682236724 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:40.752738 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c46a54-cdd7-4499-a71c-735682236724 admin admin] PATH_INFO: `/v3/projects/1966d802dbb04c6ca9ff26d7e3adcb5d` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:40.753996 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c46a54-cdd7-4499-a71c-735682236724 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1966d802dbb04c6ca9ff26d7e3adcb5d)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:40.755891 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c46a54-cdd7-4499-a71c-735682236724 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:40.757454 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3a6b26ff-8901-4a8c-83d0-c7fe59b44bc9 admin admin] The token cache is being invalidate because project aa3c2e0b24464e67b52e707dc7915dd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:10:40.765219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3a6b26ff-8901-4a8c-83d0-c7fe59b44bc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:40.765219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3a6b26ff-8901-4a8c-83d0-c7fe59b44bc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:40.765219 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 947/1884] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:10:40 2022] DELETE /identity/v3/projects/aa3c2e0b24464e67b52e707dc7915dd2 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:40.765219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d2225-ca86-4929-a09a-090b66b40019 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:40.765219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d2225-ca86-4929-a09a-090b66b40019 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:40.765219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d2225-ca86-4929-a09a-090b66b40019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:40.779615 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-d12d2225-ca86-4929-a09a-090b66b40019 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:40.780808 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d12d2225-ca86-4929-a09a-090b66b40019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:40.788391 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 948/1885] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:40.789151 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d2225-ca86-4929-a09a-090b66b40019 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:40.790393 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d12d2225-ca86-4929-a09a-090b66b40019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:40.802281 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d2225-ca86-4929-a09a-090b66b40019 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:40.806938 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277c5ef-951a-4d83-b0d1-22b7f9d48438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:40.808057 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277c5ef-951a-4d83-b0d1-22b7f9d48438 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:40.808340 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277c5ef-951a-4d83-b0d1-22b7f9d48438 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:40.808614 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277c5ef-951a-4d83-b0d1-22b7f9d48438 admin admin] PATH_INFO: `/v3/users/c43dab85c5b04ebcbc04c48525699dbd` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:40.809782 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277c5ef-951a-4d83-b0d1-22b7f9d48438 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c43dab85c5b04ebcbc04c48525699dbd)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:40.812403 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277c5ef-951a-4d83-b0d1-22b7f9d48438 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:40.877434 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-93c46a54-cdd7-4499-a71c-735682236724 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1966d802dbb04c6ca9ff26d7e3adcb5d', 'request_id': 'req-93c46a54-cdd7-4499-a71c-735682236724'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:40.882943 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-93c46a54-cdd7-4499-a71c-735682236724 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1966d802dbb04c6ca9ff26d7e3adcb5d', 'request_id': 'req-93c46a54-cdd7-4499-a71c-735682236724'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:40.889056 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-93c46a54-cdd7-4499-a71c-735682236724 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1966d802dbb04c6ca9ff26d7e3adcb5d', 'request_id': 'req-93c46a54-cdd7-4499-a71c-735682236724'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:40.985635 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-93c46a54-cdd7-4499-a71c-735682236724 admin admin] The token cache is being invalidate because project 1966d802dbb04c6ca9ff26d7e3adcb5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:10:40.985959 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-93c46a54-cdd7-4499-a71c-735682236724 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:40.986614 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-93c46a54-cdd7-4499-a71c-735682236724 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:40.988184 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 938/1886] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:10:40 2022] DELETE /identity/v3/projects/1966d802dbb04c6ca9ff26d7e3adcb5d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:40.988931 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c46a54-cdd7-4499-a71c-735682236724 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:40.990344 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-93c46a54-cdd7-4499-a71c-735682236724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:41.053516 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c46a54-cdd7-4499-a71c-735682236724 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:41.058319 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a07107-7c52-4c8a-89b0-0b0cb1bb55e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:41.058976 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a07107-7c52-4c8a-89b0-0b0cb1bb55e5 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:41.059516 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a07107-7c52-4c8a-89b0-0b0cb1bb55e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:41.059794 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a07107-7c52-4c8a-89b0-0b0cb1bb55e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:41.061108 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a07107-7c52-4c8a-89b0-0b0cb1bb55e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:41.063040 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a07107-7c52-4c8a-89b0-0b0cb1bb55e5 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:41.126008 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5277c5ef-951a-4d83-b0d1-22b7f9d48438 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c43dab85c5b04ebcbc04c48525699dbd'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:41.139437 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5277c5ef-951a-4d83-b0d1-22b7f9d48438 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c43dab85c5b04ebcbc04c48525699dbd'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:41.188076 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 939/1887] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:40 2022] POST /identity/v3/projects => generated 377 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:41.196624 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a07107-7c52-4c8a-89b0-0b0cb1bb55e5 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:41.196624 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b8a07107-7c52-4c8a-89b0-0b0cb1bb55e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:41.241996 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5277c5ef-951a-4d83-b0d1-22b7f9d48438 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c43dab85c5b04ebcbc04c48525699dbd'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:41.242702 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5277c5ef-951a-4d83-b0d1-22b7f9d48438 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c43dab85c5b04ebcbc04c48525699dbd'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:41.250208 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5277c5ef-951a-4d83-b0d1-22b7f9d48438 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c43dab85c5b04ebcbc04c48525699dbd'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:41.256366 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 949/1888] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:10:40 2022] DELETE /identity/v3/users/c43dab85c5b04ebcbc04c48525699dbd => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:41.257654 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452a014-eca5-4bd0-974d-c57f22de52c5 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:41.258039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452a014-eca5-4bd0-974d-c57f22de52c5 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:41.258264 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452a014-eca5-4bd0-974d-c57f22de52c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:41.260610 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a07107-7c52-4c8a-89b0-0b0cb1bb55e5 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:41.278216 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-b452a014-eca5-4bd0-974d-c57f22de52c5 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:41.281353 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b452a014-eca5-4bd0-974d-c57f22de52c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:41.345905 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 950/1889] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:41.346862 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452a014-eca5-4bd0-974d-c57f22de52c5 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:41.348645 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b452a014-eca5-4bd0-974d-c57f22de52c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:41.365961 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90ec75-a88d-4e8b-a8ab-06ae66ad04e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:41.366350 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90ec75-a88d-4e8b-a8ab-06ae66ad04e7 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:41.366629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90ec75-a88d-4e8b-a8ab-06ae66ad04e7 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:41.366903 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90ec75-a88d-4e8b-a8ab-06ae66ad04e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:41.368740 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2f90ec75-a88d-4e8b-a8ab-06ae66ad04e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:41.417616 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452a014-eca5-4bd0-974d-c57f22de52c5 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:41.423355 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e472f7a-584a-49f4-a22e-136b2acb8c87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:41.423710 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e472f7a-584a-49f4-a22e-136b2acb8c87 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:41.424089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e472f7a-584a-49f4-a22e-136b2acb8c87 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:41.424592 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e472f7a-584a-49f4-a22e-136b2acb8c87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:41.426595 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0e472f7a-584a-49f4-a22e-136b2acb8c87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:41.437328 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f90ec75-a88d-4e8b-a8ab-06ae66ad04e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:41.439030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f90ec75-a88d-4e8b-a8ab-06ae66ad04e7 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:41.440629 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e472f7a-584a-49f4-a22e-136b2acb8c87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:41.442445 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e472f7a-584a-49f4-a22e-136b2acb8c87 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:41.449815 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 940/1890] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:41 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:41.451673 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0835a-84c8-4830-af87-ff59cdbc4414 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:41.451963 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0835a-84c8-4830-af87-ff59cdbc4414 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:41.452241 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0835a-84c8-4830-af87-ff59cdbc4414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:41.453438 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 951/1891] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:41.454439 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e472f7a-584a-49f4-a22e-136b2acb8c87 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:41.455820 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0e472f7a-584a-49f4-a22e-136b2acb8c87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:41.468440 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e472f7a-584a-49f4-a22e-136b2acb8c87 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:41.473964 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02313d00-ca81-404b-adb2-d58c19a61554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:41.474129 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-5ad0835a-84c8-4830-af87-ff59cdbc4414 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:41.474350 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02313d00-ca81-404b-adb2-d58c19a61554 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:41.474635 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02313d00-ca81-404b-adb2-d58c19a61554 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:41.475444 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02313d00-ca81-404b-adb2-d58c19a61554 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:41.475929 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5ad0835a-84c8-4830-af87-ff59cdbc4414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:41.476141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02313d00-ca81-404b-adb2-d58c19a61554 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:41.478280 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02313d00-ca81-404b-adb2-d58c19a61554 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:41.498290 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 941/1892] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:41.498290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd110395-38bf-4e25-bff4-b89f28def9da None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:41.498290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd110395-38bf-4e25-bff4-b89f28def9da None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:41.498606 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd110395-38bf-4e25-bff4-b89f28def9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:41.518826 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-cd110395-38bf-4e25-bff4-b89f28def9da None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:41.520045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-cd110395-38bf-4e25-bff4-b89f28def9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:41.528354 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 942/1893] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:41.532079 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f888d70-de7a-4140-9a44-ce75a6dbc60a None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:41.532079 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f888d70-de7a-4140-9a44-ce75a6dbc60a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:41.532079 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f888d70-de7a-4140-9a44-ce75a6dbc60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:41.553943 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-1f888d70-de7a-4140-9a44-ce75a6dbc60a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:41.555077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1f888d70-de7a-4140-9a44-ce75a6dbc60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:41.568677 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 943/1894] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:41.573350 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f888d70-de7a-4140-9a44-ce75a6dbc60a None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:41.581087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f888d70-de7a-4140-9a44-ce75a6dbc60a None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:41.586143 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cfb24-65a1-474a-9a49-098f39206e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:41.586878 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cfb24-65a1-474a-9a49-098f39206e18 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:41.587239 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cfb24-65a1-474a-9a49-098f39206e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:41.587592 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cfb24-65a1-474a-9a49-098f39206e18 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:41.588401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908cfb24-65a1-474a-9a49-098f39206e18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:10:41.588795 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908cfb24-65a1-474a-9a49-098f39206e18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:41.590604 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908cfb24-65a1-474a-9a49-098f39206e18 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:41.614294 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 952/1895] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:41 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:41.615018 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02313d00-ca81-404b-adb2-d58c19a61554 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:41.621450 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 944/1896] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:10:41.631808 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cfb24-65a1-474a-9a49-098f39206e18 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:41.633908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02313d00-ca81-404b-adb2-d58c19a61554 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:41.640691 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cfb24-65a1-474a-9a49-098f39206e18 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:41.641061 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a35fe-262e-4599-a5ba-dfcbf3aaf4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:41.642122 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a35fe-262e-4599-a5ba-dfcbf3aaf4ff admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:41.642627 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a35fe-262e-4599-a5ba-dfcbf3aaf4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:41.643106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a35fe-262e-4599-a5ba-dfcbf3aaf4ff admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:41.644170 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a35fe-262e-4599-a5ba-dfcbf3aaf4ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:10:41.644917 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a35fe-262e-4599-a5ba-dfcbf3aaf4ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:41.646447 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64470869-9863-4a08-ba2d-2c4309e6b309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:41.647110 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64470869-9863-4a08-ba2d-2c4309e6b309 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:41.647289 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a35fe-262e-4599-a5ba-dfcbf3aaf4ff admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:41.647414 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64470869-9863-4a08-ba2d-2c4309e6b309 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:41.647653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64470869-9863-4a08-ba2d-2c4309e6b309 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:41.648483 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64470869-9863-4a08-ba2d-2c4309e6b309 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:41.660940 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64470869-9863-4a08-ba2d-2c4309e6b309 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:41.665175 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 953/1897] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:10:41.666373 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a35fe-262e-4599-a5ba-dfcbf3aaf4ff admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:41.685961 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a35fe-262e-4599-a5ba-dfcbf3aaf4ff admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:41.693638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb701056-7871-4a9c-9e47-6c23df30917f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:41.693989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb701056-7871-4a9c-9e47-6c23df30917f admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:41.694336 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb701056-7871-4a9c-9e47-6c23df30917f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:41.694616 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb701056-7871-4a9c-9e47-6c23df30917f admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:41.695424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb701056-7871-4a9c-9e47-6c23df30917f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:41.697000 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb701056-7871-4a9c-9e47-6c23df30917f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:41.708191 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 954/1898] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:41.708830 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb701056-7871-4a9c-9e47-6c23df30917f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:41.710594 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-cb701056-7871-4a9c-9e47-6c23df30917f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:41.726050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb701056-7871-4a9c-9e47-6c23df30917f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:41.731218 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219b3ba-70e4-4c6b-b174-727bf5537fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:41.732651 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219b3ba-70e4-4c6b-b174-727bf5537fc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:41.733157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219b3ba-70e4-4c6b-b174-727bf5537fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:41.733437 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219b3ba-70e4-4c6b-b174-727bf5537fc8 admin admin] PATH_INFO: `/v3/projects/fdf5f626cd484dacb0d7020b27c52261` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:41.734774 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219b3ba-70e4-4c6b-b174-727bf5537fc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdf5f626cd484dacb0d7020b27c52261)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:41.736750 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219b3ba-70e4-4c6b-b174-727bf5537fc8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:41.773644 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 945/1899] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:41 2022] POST /identity/v3/projects => generated 393 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:41.773644 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64470869-9863-4a08-ba2d-2c4309e6b309 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:41.842188 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64470869-9863-4a08-ba2d-2c4309e6b309 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:41.847533 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543bffc2-5acc-4f0b-93ca-01debe74b9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:41.847952 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543bffc2-5acc-4f0b-93ca-01debe74b9e7 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:41.848185 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543bffc2-5acc-4f0b-93ca-01debe74b9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:41.848498 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543bffc2-5acc-4f0b-93ca-01debe74b9e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:41.849238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543bffc2-5acc-4f0b-93ca-01debe74b9e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:41.851227 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543bffc2-5acc-4f0b-93ca-01debe74b9e7 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:41.877607 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b219b3ba-70e4-4c6b-b174-727bf5537fc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdf5f626cd484dacb0d7020b27c52261', 'request_id': 'req-b219b3ba-70e4-4c6b-b174-727bf5537fc8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:41.883274 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b219b3ba-70e4-4c6b-b174-727bf5537fc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdf5f626cd484dacb0d7020b27c52261', 'request_id': 'req-b219b3ba-70e4-4c6b-b174-727bf5537fc8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:41.890022 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b219b3ba-70e4-4c6b-b174-727bf5537fc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdf5f626cd484dacb0d7020b27c52261', 'request_id': 'req-b219b3ba-70e4-4c6b-b174-727bf5537fc8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:41.940053 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 946/1900] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:41 2022] POST /identity/v3/projects => generated 371 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:41.940053 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543bffc2-5acc-4f0b-93ca-01debe74b9e7 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:41.941805 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-543bffc2-5acc-4f0b-93ca-01debe74b9e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:42.008365 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b219b3ba-70e4-4c6b-b174-727bf5537fc8 admin admin] The token cache is being invalidate because project fdf5f626cd484dacb0d7020b27c52261 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:10:42.008651 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b219b3ba-70e4-4c6b-b174-727bf5537fc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:42.009291 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b219b3ba-70e4-4c6b-b174-727bf5537fc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:42.010890 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 955/1901] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:10:41 2022] DELETE /identity/v3/projects/fdf5f626cd484dacb0d7020b27c52261 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:42.011241 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543bffc2-5acc-4f0b-93ca-01debe74b9e7 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:42.011757 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219b3ba-70e4-4c6b-b174-727bf5537fc8 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:42.013142 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b219b3ba-70e4-4c6b-b174-727bf5537fc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:42.016387 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a9821-0bb9-494c-b52f-36e9b179e7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:42.017352 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a9821-0bb9-494c-b52f-36e9b179e7a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:42.017641 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a9821-0bb9-494c-b52f-36e9b179e7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:42.018056 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a9821-0bb9-494c-b52f-36e9b179e7a9 admin admin] PATH_INFO: `/v3/users/97204941595d4b758b0e9f1f0ec0d6fe` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:42.019424 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a9821-0bb9-494c-b52f-36e9b179e7a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97204941595d4b758b0e9f1f0ec0d6fe)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:42.021407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a9821-0bb9-494c-b52f-36e9b179e7a9 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:42.075277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219b3ba-70e4-4c6b-b174-727bf5537fc8 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:42.080020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91af65c-d2dc-4c0b-92db-639a69a90ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:42.080687 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91af65c-d2dc-4c0b-92db-639a69a90ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:42.080967 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91af65c-d2dc-4c0b-92db-639a69a90ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:42.081241 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91af65c-d2dc-4c0b-92db-639a69a90ee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:42.081996 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91af65c-d2dc-4c0b-92db-639a69a90ee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:42.083596 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91af65c-d2dc-4c0b-92db-639a69a90ee5 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:42.093629 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 956/1902] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:42.094421 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91af65c-d2dc-4c0b-92db-639a69a90ee5 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:42.095975 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f91af65c-d2dc-4c0b-92db-639a69a90ee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:42.108633 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91af65c-d2dc-4c0b-92db-639a69a90ee5 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:42.113473 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5489055-bf05-4e66-8414-8a392688dee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:42.114192 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5489055-bf05-4e66-8414-8a392688dee4 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:42.121646 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5489055-bf05-4e66-8414-8a392688dee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:42.121646 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5489055-bf05-4e66-8414-8a392688dee4 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:42.121646 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5489055-bf05-4e66-8414-8a392688dee4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:42.121646 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5489055-bf05-4e66-8414-8a392688dee4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:42.226966 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 957/1903] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:42 2022] POST /identity/v3/users => generated 297 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:42.227884 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5489055-bf05-4e66-8414-8a392688dee4 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:42.229478 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f5489055-bf05-4e66-8414-8a392688dee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:42.241321 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5489055-bf05-4e66-8414-8a392688dee4 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:42.244836 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cc4a9821-0bb9-494c-b52f-36e9b179e7a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97204941595d4b758b0e9f1f0ec0d6fe'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:42.245899 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ba5e9-d1f5-4c76-be42-b7834aef9fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:42.246558 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ba5e9-d1f5-4c76-be42-b7834aef9fab admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:42.246846 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ba5e9-d1f5-4c76-be42-b7834aef9fab admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:42.247124 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ba5e9-d1f5-4c76-be42-b7834aef9fab admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:42.247830 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3ba5e9-d1f5-4c76-be42-b7834aef9fab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:42.249870 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3ba5e9-d1f5-4c76-be42-b7834aef9fab admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:42.256251 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cc4a9821-0bb9-494c-b52f-36e9b179e7a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97204941595d4b758b0e9f1f0ec0d6fe'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:42.335024 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cc4a9821-0bb9-494c-b52f-36e9b179e7a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97204941595d4b758b0e9f1f0ec0d6fe'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:42.342805 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cc4a9821-0bb9-494c-b52f-36e9b179e7a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97204941595d4b758b0e9f1f0ec0d6fe'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:42.343438 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cc4a9821-0bb9-494c-b52f-36e9b179e7a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97204941595d4b758b0e9f1f0ec0d6fe'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:42.349285 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 947/1904] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:10:41 2022] DELETE /identity/v3/users/97204941595d4b758b0e9f1f0ec0d6fe => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:42.350576 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a2320-450c-45dc-9c26-52fa8874fe54 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:42.354044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a2320-450c-45dc-9c26-52fa8874fe54 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:42.354166 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 958/1905] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:42 2022] POST /identity/v3/users => generated 286 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:42.354263 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5a2320-450c-45dc-9c26-52fa8874fe54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:42.354357 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ba5e9-d1f5-4c76-be42-b7834aef9fab admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:42.355773 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5a3ba5e9-d1f5-4c76-be42-b7834aef9fab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:42.367990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ba5e9-d1f5-4c76-be42-b7834aef9fab admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:42.371593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-6d5a2320-450c-45dc-9c26-52fa8874fe54 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:42.372794 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6d5a2320-450c-45dc-9c26-52fa8874fe54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:42.424105 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01bd90-c7e2-4dbd-8fa4-a7bc5b8dab49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:42.425003 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01bd90-c7e2-4dbd-8fa4-a7bc5b8dab49 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:42.425285 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01bd90-c7e2-4dbd-8fa4-a7bc5b8dab49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:42.425591 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01bd90-c7e2-4dbd-8fa4-a7bc5b8dab49 admin admin] PATH_INFO: `/v3/projects/039dadc3df264018a5bcb0ece1751446/users/eda37dd9b3304fa9a9734f12ffaea8e7/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:42.430095 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 948/1906] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:42.431333 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a2320-450c-45dc-9c26-52fa8874fe54 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:42.432734 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6d5a2320-450c-45dc-9c26-52fa8874fe54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:42.439956 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01bd90-c7e2-4dbd-8fa4-a7bc5b8dab49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=039dadc3df264018a5bcb0ece1751446, user_id=eda37dd9b3304fa9a9734f12ffaea8e7, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:42.443011 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01bd90-c7e2-4dbd-8fa4-a7bc5b8dab49 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:42.445345 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5a2320-450c-45dc-9c26-52fa8874fe54 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:42.450032 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eebce05-b67e-4263-9214-a0a3da119e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:42.451412 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebce05-b67e-4263-9214-a0a3da119e79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:42.451712 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebce05-b67e-4263-9214-a0a3da119e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:42.451982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebce05-b67e-4263-9214-a0a3da119e79 admin admin] PATH_INFO: `/v3/projects/f637293a37cf4ded88e20fae41323d1a` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:42.453154 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eebce05-b67e-4263-9214-a0a3da119e79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f637293a37cf4ded88e20fae41323d1a)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:42.455091 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eebce05-b67e-4263-9214-a0a3da119e79 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:42.564092 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 959/1907] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:42 2022] PUT /identity/v3/projects/039dadc3df264018a5bcb0ece1751446/users/eda37dd9b3304fa9a9734f12ffaea8e7/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:42.564853 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01bd90-c7e2-4dbd-8fa4-a7bc5b8dab49 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:42.566748 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-cb01bd90-c7e2-4dbd-8fa4-a7bc5b8dab49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:42.586378 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1eebce05-b67e-4263-9214-a0a3da119e79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f637293a37cf4ded88e20fae41323d1a', 'request_id': 'req-1eebce05-b67e-4263-9214-a0a3da119e79'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:42.591745 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1eebce05-b67e-4263-9214-a0a3da119e79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f637293a37cf4ded88e20fae41323d1a', 'request_id': 'req-1eebce05-b67e-4263-9214-a0a3da119e79'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:42.597710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1eebce05-b67e-4263-9214-a0a3da119e79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f637293a37cf4ded88e20fae41323d1a', 'request_id': 'req-1eebce05-b67e-4263-9214-a0a3da119e79'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:42.628708 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01bd90-c7e2-4dbd-8fa4-a7bc5b8dab49 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:42.658899 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1eebce05-b67e-4263-9214-a0a3da119e79 admin admin] The token cache is being invalidate because project f637293a37cf4ded88e20fae41323d1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:10:42.659315 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1eebce05-b67e-4263-9214-a0a3da119e79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:42.660114 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1eebce05-b67e-4263-9214-a0a3da119e79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:42.662122 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 949/1908] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:10:42 2022] DELETE /identity/v3/projects/f637293a37cf4ded88e20fae41323d1a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:42.666487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de93f6-dfe8-4fe3-9ee1-18cbdbfa159a None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:42.666845 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de93f6-dfe8-4fe3-9ee1-18cbdbfa159a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:42.667196 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de93f6-dfe8-4fe3-9ee1-18cbdbfa159a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:42.687529 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-94de93f6-dfe8-4fe3-9ee1-18cbdbfa159a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:42.689040 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-94de93f6-dfe8-4fe3-9ee1-18cbdbfa159a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:42.692319 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32598de-cbe6-4b2b-ae9c-2b86a4a03068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:42.693024 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32598de-cbe6-4b2b-ae9c-2b86a4a03068 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:42.693297 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32598de-cbe6-4b2b-ae9c-2b86a4a03068 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:42.693570 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32598de-cbe6-4b2b-ae9c-2b86a4a03068 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:42.694345 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32598de-cbe6-4b2b-ae9c-2b86a4a03068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:42.696177 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32598de-cbe6-4b2b-ae9c-2b86a4a03068 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:42.698056 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 950/1909] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:42.699448 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de93f6-dfe8-4fe3-9ee1-18cbdbfa159a None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:42.700716 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-94de93f6-dfe8-4fe3-9ee1-18cbdbfa159a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:42.709469 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 960/1910] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:42.711602 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ab85a-4f52-42d7-84da-5ce961eab52b None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:42.712076 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ab85a-4f52-42d7-84da-5ce961eab52b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:42.712499 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ab85a-4f52-42d7-84da-5ce961eab52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:42.722226 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de93f6-dfe8-4fe3-9ee1-18cbdbfa159a None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:42.727352 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521f56b-549c-468e-906a-6877bc11b526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:42.728019 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521f56b-549c-468e-906a-6877bc11b526 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:42.728407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521f56b-549c-468e-906a-6877bc11b526 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:42.728822 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521f56b-549c-468e-906a-6877bc11b526 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:42.729626 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3521f56b-549c-468e-906a-6877bc11b526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:42.731449 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3521f56b-549c-468e-906a-6877bc11b526 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:42.733520 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-ba2ab85a-4f52-42d7-84da-5ce961eab52b None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:42.734914 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ba2ab85a-4f52-42d7-84da-5ce961eab52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:42.743421 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 951/1911] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:42.744912 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124001f6-d39c-4e31-a0dd-147ac98d1da8 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:42.745289 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124001f6-d39c-4e31-a0dd-147ac98d1da8 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:42.745665 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124001f6-d39c-4e31-a0dd-147ac98d1da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:42.746930 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 961/1912] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:42.751491 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ab85a-4f52-42d7-84da-5ce961eab52b None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:42.752944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ba2ab85a-4f52-42d7-84da-5ce961eab52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:42.765185 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ab85a-4f52-42d7-84da-5ce961eab52b None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:42.770665 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e89e4-5a7b-47fd-9f5b-36eb338833c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:42.772094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e89e4-5a7b-47fd-9f5b-36eb338833c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:42.772094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e89e4-5a7b-47fd-9f5b-36eb338833c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:42.772094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e89e4-5a7b-47fd-9f5b-36eb338833c9 admin admin] PATH_INFO: `/v3/users/4ea77e4036934f6f8dea5ac65e73ada8` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:42.773367 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896e89e4-5a7b-47fd-9f5b-36eb338833c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ea77e4036934f6f8dea5ac65e73ada8)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:42.775322 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-124001f6-d39c-4e31-a0dd-147ac98d1da8 None None] MFA Rules not processed for user `eda37dd9b3304fa9a9734f12ffaea8e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:42.775801 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896e89e4-5a7b-47fd-9f5b-36eb338833c9 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:42.776742 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-124001f6-d39c-4e31-a0dd-147ac98d1da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:42.844788 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 952/1913] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:42.845933 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124001f6-d39c-4e31-a0dd-147ac98d1da8 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:42.847205 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-124001f6-d39c-4e31-a0dd-147ac98d1da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:42.907729 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124001f6-d39c-4e31-a0dd-147ac98d1da8 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:42.911684 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b5537-6cc5-4614-b55d-cf0e29e491e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:42.912343 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b5537-6cc5-4614-b55d-cf0e29e491e9 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:42.912622 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b5537-6cc5-4614-b55d-cf0e29e491e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:42.912905 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b5537-6cc5-4614-b55d-cf0e29e491e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:42.923001 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6b5537-6cc5-4614-b55d-cf0e29e491e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:42.924437 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6b5537-6cc5-4614-b55d-cf0e29e491e9 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:42.941268 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 953/1914] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:42.942365 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b5537-6cc5-4614-b55d-cf0e29e491e9 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:42.943834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3d6b5537-6cc5-4614-b55d-cf0e29e491e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:42.943964 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-896e89e4-5a7b-47fd-9f5b-36eb338833c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ea77e4036934f6f8dea5ac65e73ada8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:42.956119 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b5537-6cc5-4614-b55d-cf0e29e491e9 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:42.957069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-896e89e4-5a7b-47fd-9f5b-36eb338833c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ea77e4036934f6f8dea5ac65e73ada8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:42.964635 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a7b3a-14f8-417e-a7bd-6a8b6a33ed9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:42.965307 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a7b3a-14f8-417e-a7bd-6a8b6a33ed9f admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:42.965590 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a7b3a-14f8-417e-a7bd-6a8b6a33ed9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:42.965906 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a7b3a-14f8-417e-a7bd-6a8b6a33ed9f admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:42.966632 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a7b3a-14f8-417e-a7bd-6a8b6a33ed9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:42.968751 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a7b3a-14f8-417e-a7bd-6a8b6a33ed9f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:42.978777 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 954/1915] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:42.979598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a7b3a-14f8-417e-a7bd-6a8b6a33ed9f admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:42.991309 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a7b3a-14f8-417e-a7bd-6a8b6a33ed9f admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:42.997655 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ff7eb-efde-4034-aa83-541952730e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:42.998361 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ff7eb-efde-4034-aa83-541952730e24 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:42.998644 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ff7eb-efde-4034-aa83-541952730e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:42.998924 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ff7eb-efde-4034-aa83-541952730e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:42.999654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966ff7eb-efde-4034-aa83-541952730e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:43.001315 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966ff7eb-efde-4034-aa83-541952730e24 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:43.012388 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 955/1916] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:43.013267 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ff7eb-efde-4034-aa83-541952730e24 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:43.016840 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-896e89e4-5a7b-47fd-9f5b-36eb338833c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ea77e4036934f6f8dea5ac65e73ada8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:43.017527 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-896e89e4-5a7b-47fd-9f5b-36eb338833c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ea77e4036934f6f8dea5ac65e73ada8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:43.028922 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-896e89e4-5a7b-47fd-9f5b-36eb338833c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ea77e4036934f6f8dea5ac65e73ada8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:43.029946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ff7eb-efde-4034-aa83-541952730e24 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:43.035349 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b5323-53ec-479f-94b2-ec32c0232922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:43.036171 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b5323-53ec-479f-94b2-ec32c0232922 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:43.036460 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b5323-53ec-479f-94b2-ec32c0232922 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:43.036751 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b5323-53ec-479f-94b2-ec32c0232922 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:43.037532 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b5323-53ec-479f-94b2-ec32c0232922 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:10:43.037871 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b5323-53ec-479f-94b2-ec32c0232922 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:43.039927 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b5323-53ec-479f-94b2-ec32c0232922 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:43.043660 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 962/1917] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:10:42 2022] DELETE /identity/v3/users/4ea77e4036934f6f8dea5ac65e73ada8 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:43.044833 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e89e4-5a7b-47fd-9f5b-36eb338833c9 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:43.046956 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-896e89e4-5a7b-47fd-9f5b-36eb338833c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:43.058614 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 956/1918] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:10:43.058614 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b5323-53ec-479f-94b2-ec32c0232922 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:43.060991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-029b5323-53ec-479f-94b2-ec32c0232922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:43.074849 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b5323-53ec-479f-94b2-ec32c0232922 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:43.136293 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e89e4-5a7b-47fd-9f5b-36eb338833c9 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:43.138066 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c9c4d-8b09-4d5c-a6bb-3f1148e01e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:43.139928 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c9c4d-8b09-4d5c-a6bb-3f1148e01e74 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:43.140441 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c9c4d-8b09-4d5c-a6bb-3f1148e01e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:43.140828 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c9c4d-8b09-4d5c-a6bb-3f1148e01e74 admin admin] PATH_INFO: `/v3/projects/aa6394d55d3f442cb3f900061efff5aa/users/1c7e841a4c3d4d00bd92c2f260041504/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:43.144487 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56682e60-76fb-4e8b-b1dc-032bd2358eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:43.144487 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56682e60-76fb-4e8b-b1dc-032bd2358eee admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:43.144487 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56682e60-76fb-4e8b-b1dc-032bd2358eee admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:43.144487 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56682e60-76fb-4e8b-b1dc-032bd2358eee admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:43.147665 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56682e60-76fb-4e8b-b1dc-032bd2358eee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:43.147665 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56682e60-76fb-4e8b-b1dc-032bd2358eee admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:43.188898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c9c4d-8b09-4d5c-a6bb-3f1148e01e74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa6394d55d3f442cb3f900061efff5aa, user_id=1c7e841a4c3d4d00bd92c2f260041504, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:43.193636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c9c4d-8b09-4d5c-a6bb-3f1148e01e74 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:43.254245 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 963/1919] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:43 2022] POST /identity/v3/projects => generated 375 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:43.254245 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56682e60-76fb-4e8b-b1dc-032bd2358eee admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:43.254245 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-56682e60-76fb-4e8b-b1dc-032bd2358eee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:43.309877 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 957/1920] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:43 2022] PUT /identity/v3/projects/aa6394d55d3f442cb3f900061efff5aa/users/1c7e841a4c3d4d00bd92c2f260041504/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:43.309877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c9c4d-8b09-4d5c-a6bb-3f1148e01e74 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:43.309877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ea8c9c4d-8b09-4d5c-a6bb-3f1148e01e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:43.353049 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56682e60-76fb-4e8b-b1dc-032bd2358eee admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:43.387563 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c9c4d-8b09-4d5c-a6bb-3f1148e01e74 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:43.392977 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39316f-4518-45d6-a9b8-69f9e2e7a415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:43.393794 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39316f-4518-45d6-a9b8-69f9e2e7a415 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:43.393964 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39316f-4518-45d6-a9b8-69f9e2e7a415 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:43.394247 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39316f-4518-45d6-a9b8-69f9e2e7a415 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:43.395253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c39316f-4518-45d6-a9b8-69f9e2e7a415 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:43.397053 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c39316f-4518-45d6-a9b8-69f9e2e7a415 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:43.420609 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3584c-8904-4342-870d-67e69f891ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:43.421505 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3584c-8904-4342-870d-67e69f891ac9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:43.421822 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3584c-8904-4342-870d-67e69f891ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:43.422120 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3584c-8904-4342-870d-67e69f891ac9 admin admin] PATH_INFO: `/v3/projects/da4283a7d7fb4a4db57b5463687e0fde/users/ffc5b3de98e844fabdc2860ed218c60a/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:43.438004 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed3584c-8904-4342-870d-67e69f891ac9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da4283a7d7fb4a4db57b5463687e0fde, user_id=ffc5b3de98e844fabdc2860ed218c60a, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:43.440916 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed3584c-8904-4342-870d-67e69f891ac9 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:43.478271 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 958/1921] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:43 2022] POST /identity/v3/projects => generated 371 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:43.479119 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39316f-4518-45d6-a9b8-69f9e2e7a415 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:43.529894 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 964/1922] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:43 2022] PUT /identity/v3/projects/da4283a7d7fb4a4db57b5463687e0fde/users/ffc5b3de98e844fabdc2860ed218c60a/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:43.531241 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71307f49-fca4-45ab-99a1-374cb3842ec1 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:43.531527 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71307f49-fca4-45ab-99a1-374cb3842ec1 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:43.531803 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71307f49-fca4-45ab-99a1-374cb3842ec1 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:43.533178 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 965/1923] 10.222.0.23 () {54 vars in 921 bytes} [Sat Apr 30 21:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:10:43.534196 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374a26c-8528-4b86-b68d-3eb673a48f4c None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:43.534471 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374a26c-8528-4b86-b68d-3eb673a48f4c None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:43.534886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374a26c-8528-4b86-b68d-3eb673a48f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:43.547108 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39316f-4518-45d6-a9b8-69f9e2e7a415 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:43.564474 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-8374a26c-8528-4b86-b68d-3eb673a48f4c None None] MFA Rules not processed for user `1c7e841a4c3d4d00bd92c2f260041504`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:43.565890 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8374a26c-8528-4b86-b68d-3eb673a48f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:43.604584 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477a9b6-7892-4828-beff-71868fc1adcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:43.605255 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477a9b6-7892-4828-beff-71868fc1adcf admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:43.605530 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477a9b6-7892-4828-beff-71868fc1adcf admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:43.605854 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477a9b6-7892-4828-beff-71868fc1adcf admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:43.606563 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a477a9b6-7892-4828-beff-71868fc1adcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:43.608669 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a477a9b6-7892-4828-beff-71868fc1adcf admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:43.629029 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 966/1924] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:43.630044 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374a26c-8528-4b86-b68d-3eb673a48f4c None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:43.631384 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8374a26c-8528-4b86-b68d-3eb673a48f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:43.645715 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374a26c-8528-4b86-b68d-3eb673a48f4c None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:43.651497 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ee13b-1469-4bed-9eb9-a05f366fd82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:43.652479 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ee13b-1469-4bed-9eb9-a05f366fd82b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:43.652770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ee13b-1469-4bed-9eb9-a05f366fd82b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:43.653049 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ee13b-1469-4bed-9eb9-a05f366fd82b admin admin] PATH_INFO: `/v3/projects/f89134e53ab740b2915cbd6b096d33c0` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:43.654906 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ee13b-1469-4bed-9eb9-a05f366fd82b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f89134e53ab740b2915cbd6b096d33c0)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:43.656831 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ee13b-1469-4bed-9eb9-a05f366fd82b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:43.706982 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 959/1925] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:43 2022] POST /identity/v3/users => generated 294 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:43.707873 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477a9b6-7892-4828-beff-71868fc1adcf admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:43.717430 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477a9b6-7892-4828-beff-71868fc1adcf admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:43.722009 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a5ddb-294d-4e3d-af77-477826df0ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:43.722648 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a5ddb-294d-4e3d-af77-477826df0ccc admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:43.722923 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a5ddb-294d-4e3d-af77-477826df0ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:43.723195 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a5ddb-294d-4e3d-af77-477826df0ccc admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:43.723856 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a5ddb-294d-4e3d-af77-477826df0ccc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:43.725746 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a5ddb-294d-4e3d-af77-477826df0ccc admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:43.791931 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1b8ee13b-1469-4bed-9eb9-a05f366fd82b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f89134e53ab740b2915cbd6b096d33c0', 'request_id': 'req-1b8ee13b-1469-4bed-9eb9-a05f366fd82b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:43.797285 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1b8ee13b-1469-4bed-9eb9-a05f366fd82b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f89134e53ab740b2915cbd6b096d33c0', 'request_id': 'req-1b8ee13b-1469-4bed-9eb9-a05f366fd82b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:43.803421 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1b8ee13b-1469-4bed-9eb9-a05f366fd82b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f89134e53ab740b2915cbd6b096d33c0', 'request_id': 'req-1b8ee13b-1469-4bed-9eb9-a05f366fd82b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:43.826776 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 960/1926] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:43 2022] POST /identity/v3/users => generated 286 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:43.828065 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356c9f5-c8bd-4f55-82fb-f92080c99845 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:43.828355 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356c9f5-c8bd-4f55-82fb-f92080c99845 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:43.828631 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356c9f5-c8bd-4f55-82fb-f92080c99845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:43.854534 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-7356c9f5-c8bd-4f55-82fb-f92080c99845 None None] MFA Rules not processed for user `ffc5b3de98e844fabdc2860ed218c60a`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:43.855742 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7356c9f5-c8bd-4f55-82fb-f92080c99845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:43.899994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1b8ee13b-1469-4bed-9eb9-a05f366fd82b admin admin] The token cache is being invalidate because project f89134e53ab740b2915cbd6b096d33c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:10:43.900203 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1b8ee13b-1469-4bed-9eb9-a05f366fd82b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:43.900865 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1b8ee13b-1469-4bed-9eb9-a05f366fd82b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:43.902722 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 967/1927] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:10:43 2022] DELETE /identity/v3/projects/f89134e53ab740b2915cbd6b096d33c0 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:43.904039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87a88e-b00f-4527-a2b7-32e19f46d5c9 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:43.904328 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87a88e-b00f-4527-a2b7-32e19f46d5c9 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:43.904615 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87a88e-b00f-4527-a2b7-32e19f46d5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:43.921484 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 961/1928] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:43.922518 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356c9f5-c8bd-4f55-82fb-f92080c99845 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:43.923805 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7356c9f5-c8bd-4f55-82fb-f92080c99845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:43.926052 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-0c87a88e-b00f-4527-a2b7-32e19f46d5c9 None None] MFA Rules not processed for user `fca4ee1f64c8489ebe7296f9f8f0ab41`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:43.927232 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0c87a88e-b00f-4527-a2b7-32e19f46d5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:43.989396 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356c9f5-c8bd-4f55-82fb-f92080c99845 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:43.994253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91dba72-bcc7-46b8-a23c-bf8f687c8756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:43.994913 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91dba72-bcc7-46b8-a23c-bf8f687c8756 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:43.995198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91dba72-bcc7-46b8-a23c-bf8f687c8756 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:43.995472 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91dba72-bcc7-46b8-a23c-bf8f687c8756 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:43.996165 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91dba72-bcc7-46b8-a23c-bf8f687c8756 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:43.998639 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91dba72-bcc7-46b8-a23c-bf8f687c8756 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:44.000282 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 968/1929] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Apr 30 21:10:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:44.001190 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87a88e-b00f-4527-a2b7-32e19f46d5c9 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:44.002654 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0c87a88e-b00f-4527-a2b7-32e19f46d5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:44.017109 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87a88e-b00f-4527-a2b7-32e19f46d5c9 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:44.021837 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108f30e-75b3-4bf2-800e-f3b48b2fc57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:44.022876 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108f30e-75b3-4bf2-800e-f3b48b2fc57f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:44.023145 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108f30e-75b3-4bf2-800e-f3b48b2fc57f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:44.024636 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108f30e-75b3-4bf2-800e-f3b48b2fc57f admin admin] PATH_INFO: `/v3/projects/d06b273304514194953750d777a28a81` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:44.024636 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c108f30e-75b3-4bf2-800e-f3b48b2fc57f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d06b273304514194953750d777a28a81)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:44.026541 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c108f30e-75b3-4bf2-800e-f3b48b2fc57f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:44.106699 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 962/1930] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:43 2022] POST /identity/v3/projects => generated 393 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:44.108702 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91dba72-bcc7-46b8-a23c-bf8f687c8756 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:44.110320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b91dba72-bcc7-46b8-a23c-bf8f687c8756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:44.152031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c108f30e-75b3-4bf2-800e-f3b48b2fc57f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd06b273304514194953750d777a28a81', 'request_id': 'req-c108f30e-75b3-4bf2-800e-f3b48b2fc57f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:44.157457 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c108f30e-75b3-4bf2-800e-f3b48b2fc57f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd06b273304514194953750d777a28a81', 'request_id': 'req-c108f30e-75b3-4bf2-800e-f3b48b2fc57f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:44.163609 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c108f30e-75b3-4bf2-800e-f3b48b2fc57f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd06b273304514194953750d777a28a81', 'request_id': 'req-c108f30e-75b3-4bf2-800e-f3b48b2fc57f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:44.171828 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91dba72-bcc7-46b8-a23c-bf8f687c8756 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:44.225451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c108f30e-75b3-4bf2-800e-f3b48b2fc57f admin admin] The token cache is being invalidate because project d06b273304514194953750d777a28a81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:10:44.225746 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c108f30e-75b3-4bf2-800e-f3b48b2fc57f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:44.226432 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c108f30e-75b3-4bf2-800e-f3b48b2fc57f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:44.228119 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 969/1931] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:10:44 2022] DELETE /identity/v3/projects/d06b273304514194953750d777a28a81 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:44.236195 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108f30e-75b3-4bf2-800e-f3b48b2fc57f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:44.236195 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c108f30e-75b3-4bf2-800e-f3b48b2fc57f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:44.236396 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67dab9-547f-400a-b646-d76044a24365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:44.236396 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67dab9-547f-400a-b646-d76044a24365 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:44.236396 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67dab9-547f-400a-b646-d76044a24365 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:44.236396 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67dab9-547f-400a-b646-d76044a24365 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:44.236737 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e67dab9-547f-400a-b646-d76044a24365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:44.236737 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e67dab9-547f-400a-b646-d76044a24365 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:44.244675 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108f30e-75b3-4bf2-800e-f3b48b2fc57f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:44.249185 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 963/1932] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:44.249185 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67dab9-547f-400a-b646-d76044a24365 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:44.249185 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4e67dab9-547f-400a-b646-d76044a24365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:44.250624 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d32e88-cd83-4673-a905-3bc8ad6b9a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:44.251291 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d32e88-cd83-4673-a905-3bc8ad6b9a6b admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:44.251575 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d32e88-cd83-4673-a905-3bc8ad6b9a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:44.251851 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d32e88-cd83-4673-a905-3bc8ad6b9a6b admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:44.252583 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d32e88-cd83-4673-a905-3bc8ad6b9a6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:44.254210 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d32e88-cd83-4673-a905-3bc8ad6b9a6b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:44.261144 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67dab9-547f-400a-b646-d76044a24365 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:44.267121 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 970/1933] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:44.267121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d32e88-cd83-4673-a905-3bc8ad6b9a6b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:44.267339 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ecbefa-5d9c-4092-8962-c1f2a8c90a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:44.267339 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ecbefa-5d9c-4092-8962-c1f2a8c90a5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:44.267532 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-00d32e88-cd83-4673-a905-3bc8ad6b9a6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:44.267621 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ecbefa-5d9c-4092-8962-c1f2a8c90a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:44.269909 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ecbefa-5d9c-4092-8962-c1f2a8c90a5d admin admin] PATH_INFO: `/v3/users/5434661ccee64e0d9210fadb577b4e20` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:44.271534 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ecbefa-5d9c-4092-8962-c1f2a8c90a5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5434661ccee64e0d9210fadb577b4e20)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:44.273479 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ecbefa-5d9c-4092-8962-c1f2a8c90a5d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:44.280425 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d32e88-cd83-4673-a905-3bc8ad6b9a6b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:44.285496 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78a747-c1d9-4798-9110-f1f930531934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:44.286212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78a747-c1d9-4798-9110-f1f930531934 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:44.286500 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78a747-c1d9-4798-9110-f1f930531934 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:44.287030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78a747-c1d9-4798-9110-f1f930531934 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:44.287461 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c78a747-c1d9-4798-9110-f1f930531934 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:44.289371 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c78a747-c1d9-4798-9110-f1f930531934 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:44.387209 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 971/1934] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:44 2022] POST /identity/v3/projects => generated 371 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:44.388039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78a747-c1d9-4798-9110-f1f930531934 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:44.389602 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7c78a747-c1d9-4798-9110-f1f930531934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:44.459552 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78a747-c1d9-4798-9110-f1f930531934 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:44.465077 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b736a9af-9639-4305-9847-105a43ce4a5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:44.465791 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736a9af-9639-4305-9847-105a43ce4a5d service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:44.466086 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736a9af-9639-4305-9847-105a43ce4a5d service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:44.466365 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736a9af-9639-4305-9847-105a43ce4a5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:44.468672 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b736a9af-9639-4305-9847-105a43ce4a5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:44.480201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b736a9af-9639-4305-9847-105a43ce4a5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:44.481809 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b736a9af-9639-4305-9847-105a43ce4a5d service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:44.492713 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 972/1935] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:44.493486 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b736a9af-9639-4305-9847-105a43ce4a5d service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:44.494806 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b736a9af-9639-4305-9847-105a43ce4a5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:44.535452 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a4ecbefa-5d9c-4092-8962-c1f2a8c90a5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5434661ccee64e0d9210fadb577b4e20'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:44.549486 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a4ecbefa-5d9c-4092-8962-c1f2a8c90a5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5434661ccee64e0d9210fadb577b4e20'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:44.568408 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b736a9af-9639-4305-9847-105a43ce4a5d service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:44.573288 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7783cbdb-118c-45f9-8998-abfdf5136385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:44.574014 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783cbdb-118c-45f9-8998-abfdf5136385 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:44.574297 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783cbdb-118c-45f9-8998-abfdf5136385 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:44.574575 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7783cbdb-118c-45f9-8998-abfdf5136385 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:44.575285 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7783cbdb-118c-45f9-8998-abfdf5136385 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:44.577344 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7783cbdb-118c-45f9-8998-abfdf5136385 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:44.672204 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a4ecbefa-5d9c-4092-8962-c1f2a8c90a5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5434661ccee64e0d9210fadb577b4e20'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:44.679671 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a4ecbefa-5d9c-4092-8962-c1f2a8c90a5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5434661ccee64e0d9210fadb577b4e20'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:44.680331 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a4ecbefa-5d9c-4092-8962-c1f2a8c90a5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5434661ccee64e0d9210fadb577b4e20'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:44.689574 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 964/1936] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:10:44 2022] DELETE /identity/v3/users/5434661ccee64e0d9210fadb577b4e20 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:44.690460 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 973/1937] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:44 2022] POST /identity/v3/users => generated 303 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:44.694076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196dd19-5ed5-4575-b166-38559360d434 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:44.694076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196dd19-5ed5-4575-b166-38559360d434 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:44.694076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196dd19-5ed5-4575-b166-38559360d434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:44.694365 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7783cbdb-118c-45f9-8998-abfdf5136385 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:44.694365 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7783cbdb-118c-45f9-8998-abfdf5136385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:44.708075 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7783cbdb-118c-45f9-8998-abfdf5136385 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:44.710756 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-0196dd19-5ed5-4575-b166-38559360d434 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:44.712101 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0196dd19-5ed5-4575-b166-38559360d434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:44.785419 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 965/1938] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:44.785419 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196dd19-5ed5-4575-b166-38559360d434 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:44.786111 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0196dd19-5ed5-4575-b166-38559360d434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:44.794764 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f8975-be54-42b5-9d31-07f0c886ef16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:44.796550 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f8975-be54-42b5-9d31-07f0c886ef16 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:44.797093 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f8975-be54-42b5-9d31-07f0c886ef16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:44.797207 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f8975-be54-42b5-9d31-07f0c886ef16 admin admin] PATH_INFO: `/v3/projects/a55a9172f01d405db6b58d3b1d54283d/users/0230af12ea5b4c3b8bd6ddbedb2cc049/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:44.799095 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196dd19-5ed5-4575-b166-38559360d434 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:44.803858 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24896ce-36d7-4bc1-8ff2-08171763fd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:44.804528 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24896ce-36d7-4bc1-8ff2-08171763fd31 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:44.804812 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24896ce-36d7-4bc1-8ff2-08171763fd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:44.805091 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24896ce-36d7-4bc1-8ff2-08171763fd31 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:44.805851 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24896ce-36d7-4bc1-8ff2-08171763fd31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:44.807462 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24896ce-36d7-4bc1-8ff2-08171763fd31 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:44.813522 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f8975-be54-42b5-9d31-07f0c886ef16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a55a9172f01d405db6b58d3b1d54283d, user_id=0230af12ea5b4c3b8bd6ddbedb2cc049, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:44.816788 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f8975-be54-42b5-9d31-07f0c886ef16 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:44.817974 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 966/1939] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:44.818599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24896ce-36d7-4bc1-8ff2-08171763fd31 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:44.820507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c24896ce-36d7-4bc1-8ff2-08171763fd31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:44.833647 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24896ce-36d7-4bc1-8ff2-08171763fd31 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:44.838282 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b6ce0-8808-4f1f-9693-7db53e9db375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:44.838970 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b6ce0-8808-4f1f-9693-7db53e9db375 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:44.841325 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b6ce0-8808-4f1f-9693-7db53e9db375 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:44.841325 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b6ce0-8808-4f1f-9693-7db53e9db375 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:44.841325 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b6ce0-8808-4f1f-9693-7db53e9db375 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:44.842699 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b6ce0-8808-4f1f-9693-7db53e9db375 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:44.904849 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 974/1940] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:44 2022] PUT /identity/v3/projects/a55a9172f01d405db6b58d3b1d54283d/users/0230af12ea5b4c3b8bd6ddbedb2cc049/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:44.906137 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f8975-be54-42b5-9d31-07f0c886ef16 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:44.908322 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-aa1f8975-be54-42b5-9d31-07f0c886ef16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:44.968134 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 967/1941] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:44 2022] POST /identity/v3/users => generated 292 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:44.968134 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f48a21-3995-416a-993a-8c9da68f21e0 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:44.968134 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f48a21-3995-416a-993a-8c9da68f21e0 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:44.968134 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f48a21-3995-416a-993a-8c9da68f21e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:44.995806 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-f8f48a21-3995-416a-993a-8c9da68f21e0 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:44.996960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f8f48a21-3995-416a-993a-8c9da68f21e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:45.007554 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f8975-be54-42b5-9d31-07f0c886ef16 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:45.010309 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 968/1942] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:45.011209 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f48a21-3995-416a-993a-8c9da68f21e0 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:45.016336 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6ab09-4fb8-44ee-bca0-5b9db4e65b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:45.018135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6ab09-4fb8-44ee-bca0-5b9db4e65b2f admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:45.018681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6ab09-4fb8-44ee-bca0-5b9db4e65b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:45.019689 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f6ab09-4fb8-44ee-bca0-5b9db4e65b2f admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:45.020664 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f6ab09-4fb8-44ee-bca0-5b9db4e65b2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:45.022117 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f48a21-3995-416a-993a-8c9da68f21e0 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:45.023229 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f6ab09-4fb8-44ee-bca0-5b9db4e65b2f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:45.027544 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4832fd-79c7-4cd4-9584-b1c564dad143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:45.028421 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4832fd-79c7-4cd4-9584-b1c564dad143 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:45.028700 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4832fd-79c7-4cd4-9584-b1c564dad143 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:45.028974 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4832fd-79c7-4cd4-9584-b1c564dad143 admin admin] PATH_INFO: `/v3/projects/1a25f2505d5141c5b894bfd6515eb7f0/users/8bd54cdc115e4ae9b202bd06c7658e4a/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:45.046455 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 975/1943] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:45.049156 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4832fd-79c7-4cd4-9584-b1c564dad143 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a25f2505d5141c5b894bfd6515eb7f0, user_id=8bd54cdc115e4ae9b202bd06c7658e4a, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:45.050437 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6ab09-4fb8-44ee-bca0-5b9db4e65b2f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:45.052224 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4832fd-79c7-4cd4-9584-b1c564dad143 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:45.060223 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f6ab09-4fb8-44ee-bca0-5b9db4e65b2f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:45.064992 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f7acb-6642-4695-ba5c-dbdcd91132dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:45.065629 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f7acb-6642-4695-ba5c-dbdcd91132dc admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:45.065940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f7acb-6642-4695-ba5c-dbdcd91132dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:45.066592 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f7acb-6642-4695-ba5c-dbdcd91132dc admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:45.070382 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f7acb-6642-4695-ba5c-dbdcd91132dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:45.070382 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f7acb-6642-4695-ba5c-dbdcd91132dc admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:45.079704 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 976/1944] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:45.079704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f7acb-6642-4695-ba5c-dbdcd91132dc admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:45.090785 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f7acb-6642-4695-ba5c-dbdcd91132dc admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:45.096045 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f9388-fafd-4a95-9e98-20e64f9683d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:45.098991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f9388-fafd-4a95-9e98-20e64f9683d8 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:45.098991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f9388-fafd-4a95-9e98-20e64f9683d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:45.098991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f9388-fafd-4a95-9e98-20e64f9683d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:45.098991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f9388-fafd-4a95-9e98-20e64f9683d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:45.099601 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f9388-fafd-4a95-9e98-20e64f9683d8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:45.112344 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 977/1945] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:45.113166 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f9388-fafd-4a95-9e98-20e64f9683d8 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:45.123470 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f9388-fafd-4a95-9e98-20e64f9683d8 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:45.125854 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 969/1946] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:45 2022] PUT /identity/v3/projects/1a25f2505d5141c5b894bfd6515eb7f0/users/8bd54cdc115e4ae9b202bd06c7658e4a/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:45.130044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4832fd-79c7-4cd4-9584-b1c564dad143 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:45.195528 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588860ec-6fb8-4795-a2ac-77a6de628354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:45.196210 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588860ec-6fb8-4795-a2ac-77a6de628354 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:45.196493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588860ec-6fb8-4795-a2ac-77a6de628354 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:45.196770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588860ec-6fb8-4795-a2ac-77a6de628354 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:45.197505 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588860ec-6fb8-4795-a2ac-77a6de628354 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:10:45.197847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588860ec-6fb8-4795-a2ac-77a6de628354 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:45.199702 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588860ec-6fb8-4795-a2ac-77a6de628354 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:45.212670 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 978/1947] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:10:45.213279 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588860ec-6fb8-4795-a2ac-77a6de628354 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:45.223069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588860ec-6fb8-4795-a2ac-77a6de628354 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:45.224425 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4832fd-79c7-4cd4-9584-b1c564dad143 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:45.228700 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ee177-e0f6-4f38-92c7-6a3ac1a5c3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:45.229421 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ee177-e0f6-4f38-92c7-6a3ac1a5c3db admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:45.229863 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ee177-e0f6-4f38-92c7-6a3ac1a5c3db admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:45.230272 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ee177-e0f6-4f38-92c7-6a3ac1a5c3db admin admin] PATH_INFO: `/v3/projects/a55a9172f01d405db6b58d3b1d54283d/users/0230af12ea5b4c3b8bd6ddbedb2cc049/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:45.232065 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f805e5-25cd-464f-874e-9324d80433e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:45.232307 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ee177-e0f6-4f38-92c7-6a3ac1a5c3db admin admin] RBAC: Authorizing `identity:create_grant(project_id=a55a9172f01d405db6b58d3b1d54283d, user_id=0230af12ea5b4c3b8bd6ddbedb2cc049, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:45.233042 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f805e5-25cd-464f-874e-9324d80433e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:45.233486 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f805e5-25cd-464f-874e-9324d80433e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:45.233789 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f805e5-25cd-464f-874e-9324d80433e4 admin admin] PATH_INFO: `/v3/projects/36a50a607ccc410c9084d99d28a53a74/users/6033f637ee084d138a9e6bbd95c9094a/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:45.235117 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ee177-e0f6-4f38-92c7-6a3ac1a5c3db admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:45.247422 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 979/1948] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:45 2022] PUT /identity/v3/projects/a55a9172f01d405db6b58d3b1d54283d/users/0230af12ea5b4c3b8bd6ddbedb2cc049/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:45.248593 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ee177-e0f6-4f38-92c7-6a3ac1a5c3db admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:45.250631 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f805e5-25cd-464f-874e-9324d80433e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36a50a607ccc410c9084d99d28a53a74, user_id=6033f637ee084d138a9e6bbd95c9094a, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:45.253463 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f805e5-25cd-464f-874e-9324d80433e4 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:45.318564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ee177-e0f6-4f38-92c7-6a3ac1a5c3db admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:45.319975 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 970/1949] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:45 2022] PUT /identity/v3/projects/36a50a607ccc410c9084d99d28a53a74/users/6033f637ee084d138a9e6bbd95c9094a/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:45.321291 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984fb7e-da27-4bef-9340-73fc9765e523 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:45.321582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984fb7e-da27-4bef-9340-73fc9765e523 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:45.321904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984fb7e-da27-4bef-9340-73fc9765e523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:45.339800 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-7984fb7e-da27-4bef-9340-73fc9765e523 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:45.341023 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7984fb7e-da27-4bef-9340-73fc9765e523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:45.376146 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da54076-422d-42a8-accb-343dfce667b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:45.377046 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da54076-422d-42a8-accb-343dfce667b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:45.377331 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da54076-422d-42a8-accb-343dfce667b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:45.377723 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da54076-422d-42a8-accb-343dfce667b3 admin admin] PATH_INFO: `/v3/projects/ab10c03f4b95481fafe872abcc650720/users/fdd21038c7bf4d8298ed7cf40f142bdd/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:45.392172 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da54076-422d-42a8-accb-343dfce667b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab10c03f4b95481fafe872abcc650720, user_id=fdd21038c7bf4d8298ed7cf40f142bdd, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:45.394908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da54076-422d-42a8-accb-343dfce667b3 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:45.399769 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 971/1950] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:45.400611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984fb7e-da27-4bef-9340-73fc9765e523 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:45.401964 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7984fb7e-da27-4bef-9340-73fc9765e523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:45.413528 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984fb7e-da27-4bef-9340-73fc9765e523 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:45.418247 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035d664-2af0-443b-8f69-0dded9eaea3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:45.419088 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035d664-2af0-443b-8f69-0dded9eaea3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:45.419369 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035d664-2af0-443b-8f69-0dded9eaea3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:45.419646 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035d664-2af0-443b-8f69-0dded9eaea3e admin admin] PATH_INFO: `/v3/projects/12a4cb04327c4a7b89c799dd4746a402` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:45.420845 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035d664-2af0-443b-8f69-0dded9eaea3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=12a4cb04327c4a7b89c799dd4746a402)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:45.422809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035d664-2af0-443b-8f69-0dded9eaea3e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:45.477962 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 980/1951] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:45 2022] PUT /identity/v3/projects/ab10c03f4b95481fafe872abcc650720/users/fdd21038c7bf4d8298ed7cf40f142bdd/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:45.478792 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da54076-422d-42a8-accb-343dfce667b3 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:45.539331 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da54076-422d-42a8-accb-343dfce667b3 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:45.546320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e035d664-2af0-443b-8f69-0dded9eaea3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12a4cb04327c4a7b89c799dd4746a402', 'request_id': 'req-e035d664-2af0-443b-8f69-0dded9eaea3e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:45.551754 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e035d664-2af0-443b-8f69-0dded9eaea3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12a4cb04327c4a7b89c799dd4746a402', 'request_id': 'req-e035d664-2af0-443b-8f69-0dded9eaea3e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:45.557904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e035d664-2af0-443b-8f69-0dded9eaea3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12a4cb04327c4a7b89c799dd4746a402', 'request_id': 'req-e035d664-2af0-443b-8f69-0dded9eaea3e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:45.595118 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3c832-81ea-4135-8dc2-fb9c85741180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:45.595783 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3c832-81ea-4135-8dc2-fb9c85741180 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:45.596072 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3c832-81ea-4135-8dc2-fb9c85741180 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:45.596353 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3c832-81ea-4135-8dc2-fb9c85741180 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:45.597042 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed3c832-81ea-4135-8dc2-fb9c85741180 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:45.598997 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed3c832-81ea-4135-8dc2-fb9c85741180 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:45.635609 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e035d664-2af0-443b-8f69-0dded9eaea3e admin admin] The token cache is being invalidate because project 12a4cb04327c4a7b89c799dd4746a402 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:10:45.635901 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e035d664-2af0-443b-8f69-0dded9eaea3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:45.636666 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e035d664-2af0-443b-8f69-0dded9eaea3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:45.638284 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 972/1952] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:10:45 2022] DELETE /identity/v3/projects/12a4cb04327c4a7b89c799dd4746a402 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:45.639505 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29551efe-a3f9-44ab-86ae-b5a1afda73d3 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:45.639787 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29551efe-a3f9-44ab-86ae-b5a1afda73d3 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:45.640061 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29551efe-a3f9-44ab-86ae-b5a1afda73d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:45.664703 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-29551efe-a3f9-44ab-86ae-b5a1afda73d3 None None] MFA Rules not processed for user `0230af12ea5b4c3b8bd6ddbedb2cc049`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:45.665933 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-29551efe-a3f9-44ab-86ae-b5a1afda73d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:45.713541 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 981/1953] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:45 2022] POST /identity/v3/projects => generated 395 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:45.714459 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3c832-81ea-4135-8dc2-fb9c85741180 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:45.716009 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5ed3c832-81ea-4135-8dc2-fb9c85741180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:45.731963 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 973/1954] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:45 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:45.733234 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29551efe-a3f9-44ab-86ae-b5a1afda73d3 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:45.734668 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-29551efe-a3f9-44ab-86ae-b5a1afda73d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:45.777676 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3c832-81ea-4135-8dc2-fb9c85741180 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:45.782409 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175dfa4-7cdd-435b-9cff-3530d02cfc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:45.783068 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175dfa4-7cdd-435b-9cff-3530d02cfc38 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:45.783363 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175dfa4-7cdd-435b-9cff-3530d02cfc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:45.783616 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175dfa4-7cdd-435b-9cff-3530d02cfc38 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:45.784335 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1175dfa4-7cdd-435b-9cff-3530d02cfc38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:45.785970 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1175dfa4-7cdd-435b-9cff-3530d02cfc38 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:45.791604 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29551efe-a3f9-44ab-86ae-b5a1afda73d3 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:45.796062 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 982/1955] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:45.796846 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175dfa4-7cdd-435b-9cff-3530d02cfc38 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:45.798512 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1175dfa4-7cdd-435b-9cff-3530d02cfc38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:45.811369 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175dfa4-7cdd-435b-9cff-3530d02cfc38 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:45.816240 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b17f75-046e-49c4-a41a-c11e2319e272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:45.816894 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b17f75-046e-49c4-a41a-c11e2319e272 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:45.817171 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b17f75-046e-49c4-a41a-c11e2319e272 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:45.817445 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b17f75-046e-49c4-a41a-c11e2319e272 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:45.818187 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b17f75-046e-49c4-a41a-c11e2319e272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:45.819766 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b17f75-046e-49c4-a41a-c11e2319e272 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:45.832730 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 983/1956] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:45.832730 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618abeab-30f4-44d6-b42b-ff33d4677d86 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:45.832730 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618abeab-30f4-44d6-b42b-ff33d4677d86 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:45.832730 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618abeab-30f4-44d6-b42b-ff33d4677d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:45.839603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398b7fc-17e8-4437-a08f-a9a8313b70a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:45.840454 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398b7fc-17e8-4437-a08f-a9a8313b70a8 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:45.840733 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398b7fc-17e8-4437-a08f-a9a8313b70a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:45.841003 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398b7fc-17e8-4437-a08f-a9a8313b70a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:45.843537 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0398b7fc-17e8-4437-a08f-a9a8313b70a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:45.850226 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-618abeab-30f4-44d6-b42b-ff33d4677d86 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:45.851379 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-618abeab-30f4-44d6-b42b-ff33d4677d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:45.855323 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0398b7fc-17e8-4437-a08f-a9a8313b70a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:45.856754 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0398b7fc-17e8-4437-a08f-a9a8313b70a8 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:45.859968 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 984/1957] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:45.860488 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618abeab-30f4-44d6-b42b-ff33d4677d86 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:45.861860 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-618abeab-30f4-44d6-b42b-ff33d4677d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:45.872166 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 974/1958] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:45.874139 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29270af4-b1ef-499a-99fc-2ac68cf13ed1 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:45.874422 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29270af4-b1ef-499a-99fc-2ac68cf13ed1 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:45.874693 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29270af4-b1ef-499a-99fc-2ac68cf13ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:45.878393 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618abeab-30f4-44d6-b42b-ff33d4677d86 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:45.880251 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7f8c1-d9c1-4904-958a-dbb3980960ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:45.881688 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7f8c1-d9c1-4904-958a-dbb3980960ee admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:45.881688 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7f8c1-d9c1-4904-958a-dbb3980960ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:45.881688 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7f8c1-d9c1-4904-958a-dbb3980960ee admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:45.882439 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c7f8c1-d9c1-4904-958a-dbb3980960ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:45.884451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c7f8c1-d9c1-4904-958a-dbb3980960ee admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:45.891942 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-29270af4-b1ef-499a-99fc-2ac68cf13ed1 None None] MFA Rules not processed for user `eda37dd9b3304fa9a9734f12ffaea8e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:45.893171 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-29270af4-b1ef-499a-99fc-2ac68cf13ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:45.949116 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 975/1959] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:45.950069 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29270af4-b1ef-499a-99fc-2ac68cf13ed1 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:45.960549 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29270af4-b1ef-499a-99fc-2ac68cf13ed1 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:45.965320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34d0a7-e0d7-4c60-b458-75d29af91e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:45.966239 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34d0a7-e0d7-4c60-b458-75d29af91e39 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:45.966520 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34d0a7-e0d7-4c60-b458-75d29af91e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:45.967336 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34d0a7-e0d7-4c60-b458-75d29af91e39 admin admin] PATH_INFO: `/v3/projects/36a50a607ccc410c9084d99d28a53a74/users/6033f637ee084d138a9e6bbd95c9094a/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:45.969748 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34d0a7-e0d7-4c60-b458-75d29af91e39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36a50a607ccc410c9084d99d28a53a74, user_id=6033f637ee084d138a9e6bbd95c9094a, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:45.972457 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34d0a7-e0d7-4c60-b458-75d29af91e39 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:45.979828 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 985/1960] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:45 2022] POST /identity/v3/users => generated 298 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:45.979828 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7f8c1-d9c1-4904-958a-dbb3980960ee admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:45.991260 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 976/1961] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:45 2022] PUT /identity/v3/projects/36a50a607ccc410c9084d99d28a53a74/users/6033f637ee084d138a9e6bbd95c9094a/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:45.992263 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c526b8-ee1d-4422-bad5-186a62899f8a None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:45.992720 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c526b8-ee1d-4422-bad5-186a62899f8a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:45.993328 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c526b8-ee1d-4422-bad5-186a62899f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:46.003735 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7f8c1-d9c1-4904-958a-dbb3980960ee admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:46.024090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-70c526b8-ee1d-4422-bad5-186a62899f8a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:46.025460 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-70c526b8-ee1d-4422-bad5-186a62899f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:46.080329 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07796fab-bc2d-40dd-ab87-5b4891048aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:46.081856 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07796fab-bc2d-40dd-ab87-5b4891048aba admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:46.082197 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07796fab-bc2d-40dd-ab87-5b4891048aba admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:46.082462 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07796fab-bc2d-40dd-ab87-5b4891048aba admin admin] PATH_INFO: `/v3/projects/ab10c03f4b95481fafe872abcc650720/users/fdd21038c7bf4d8298ed7cf40f142bdd/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:46.084440 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07796fab-bc2d-40dd-ab87-5b4891048aba admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab10c03f4b95481fafe872abcc650720, user_id=fdd21038c7bf4d8298ed7cf40f142bdd, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:46.087223 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07796fab-bc2d-40dd-ab87-5b4891048aba admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:46.091079 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 977/1962] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:46.092605 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c526b8-ee1d-4422-bad5-186a62899f8a None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:46.093946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-70c526b8-ee1d-4422-bad5-186a62899f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:46.101308 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 986/1963] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:45 2022] PUT /identity/v3/projects/ab10c03f4b95481fafe872abcc650720/users/fdd21038c7bf4d8298ed7cf40f142bdd/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:46.102159 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07796fab-bc2d-40dd-ab87-5b4891048aba admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:46.174202 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c526b8-ee1d-4422-bad5-186a62899f8a None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:46.178354 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07796fab-bc2d-40dd-ab87-5b4891048aba admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:46.183054 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36c28e-cdfb-48fb-b59c-99d9b9247ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:46.183817 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36c28e-cdfb-48fb-b59c-99d9b9247ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:46.184101 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36c28e-cdfb-48fb-b59c-99d9b9247ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:46.184958 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36c28e-cdfb-48fb-b59c-99d9b9247ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:46.185716 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df36c28e-cdfb-48fb-b59c-99d9b9247ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:46.187499 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df36c28e-cdfb-48fb-b59c-99d9b9247ca8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:46.200851 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 987/1964] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:46.200851 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f0f4e-6b3f-4b78-b5f6-982c937f8958 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:46.200851 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f0f4e-6b3f-4b78-b5f6-982c937f8958 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:46.200851 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f0f4e-6b3f-4b78-b5f6-982c937f8958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:46.230068 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-ad5f0f4e-6b3f-4b78-b5f6-982c937f8958 None None] MFA Rules not processed for user `6033f637ee084d138a9e6bbd95c9094a`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:46.231467 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ad5f0f4e-6b3f-4b78-b5f6-982c937f8958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:46.248906 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b857c-995d-4259-a36e-0702a91c8dd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:46.249539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b857c-995d-4259-a36e-0702a91c8dd8 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:46.251295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b857c-995d-4259-a36e-0702a91c8dd8 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:46.251295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b857c-995d-4259-a36e-0702a91c8dd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:46.253320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f45b857c-995d-4259-a36e-0702a91c8dd8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:46.303469 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 988/1965] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:46.304414 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f0f4e-6b3f-4b78-b5f6-982c937f8958 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:46.316518 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b857c-995d-4259-a36e-0702a91c8dd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:46.318329 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b857c-995d-4259-a36e-0702a91c8dd8 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:46.332801 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 978/1966] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:46.332952 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f0f4e-6b3f-4b78-b5f6-982c937f8958 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:46.333050 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b84c4-3b30-48d3-98bc-1db6377eedc4 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:46.333050 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b84c4-3b30-48d3-98bc-1db6377eedc4 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:46.333050 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b84c4-3b30-48d3-98bc-1db6377eedc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:46.339438 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608fa403-9fd8-492a-b231-86058fc683ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:46.340555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fa403-9fd8-492a-b231-86058fc683ce admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:46.340555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fa403-9fd8-492a-b231-86058fc683ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:46.340717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fa403-9fd8-492a-b231-86058fc683ce admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:46.341373 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608fa403-9fd8-492a-b231-86058fc683ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:10:46.342333 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608fa403-9fd8-492a-b231-86058fc683ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:46.344131 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608fa403-9fd8-492a-b231-86058fc683ce admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:46.361328 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 989/1967] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:10:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:10:46.362680 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608fa403-9fd8-492a-b231-86058fc683ce admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:46.370998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-5b8b84c4-3b30-48d3-98bc-1db6377eedc4 None None] MFA Rules not processed for user `fdd21038c7bf4d8298ed7cf40f142bdd`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:46.372328 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5b8b84c4-3b30-48d3-98bc-1db6377eedc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:46.377357 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608fa403-9fd8-492a-b231-86058fc683ce admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:46.384212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f0b97-3593-414a-b3b5-1e332b556d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:46.391291 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f0b97-3593-414a-b3b5-1e332b556d70 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:46.391641 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f0b97-3593-414a-b3b5-1e332b556d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:46.391937 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f0b97-3593-414a-b3b5-1e332b556d70 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:46.392678 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f0b97-3593-414a-b3b5-1e332b556d70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:46.394350 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f0b97-3593-414a-b3b5-1e332b556d70 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:46.410154 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 990/1968] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:46.410154 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f0b97-3593-414a-b3b5-1e332b556d70 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:46.421153 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f0b97-3593-414a-b3b5-1e332b556d70 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:46.432895 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423c170-5c37-4740-bfb9-88def47aeb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:46.434401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423c170-5c37-4740-bfb9-88def47aeb19 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:46.434401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423c170-5c37-4740-bfb9-88def47aeb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:46.440853 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2423c170-5c37-4740-bfb9-88def47aeb19 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:46.440853 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423c170-5c37-4740-bfb9-88def47aeb19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:46.440853 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2423c170-5c37-4740-bfb9-88def47aeb19 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:46.462474 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 979/1969] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:46 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:46.464119 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b84c4-3b30-48d3-98bc-1db6377eedc4 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:46.480729 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b84c4-3b30-48d3-98bc-1db6377eedc4 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:46.487233 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1d0cb-b600-45e5-9d75-afab27f5c50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:46.489176 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1d0cb-b600-45e5-9d75-afab27f5c50e admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:46.489176 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1d0cb-b600-45e5-9d75-afab27f5c50e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:46.489176 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1d0cb-b600-45e5-9d75-afab27f5c50e admin admin] PATH_INFO: `/v3/projects/f95aa68d4ae04f178ec0c2539b6b81e9/users/495127048d1c4852982dfc79bbab6d46/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:46.503510 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1d0cb-b600-45e5-9d75-afab27f5c50e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f95aa68d4ae04f178ec0c2539b6b81e9, user_id=495127048d1c4852982dfc79bbab6d46, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:46.506144 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1d0cb-b600-45e5-9d75-afab27f5c50e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:46.541516 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 991/1970] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:46 2022] POST /identity/v3/projects => generated 407 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:46.546539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423c170-5c37-4740-bfb9-88def47aeb19 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:46.599517 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 980/1971] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:46 2022] PUT /identity/v3/projects/f95aa68d4ae04f178ec0c2539b6b81e9/users/495127048d1c4852982dfc79bbab6d46/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:46.611852 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d0700-3992-4086-9688-3e3d5ea1ddba None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:46.612169 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d0700-3992-4086-9688-3e3d5ea1ddba None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:46.612454 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d0700-3992-4086-9688-3e3d5ea1ddba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:46.624299 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2423c170-5c37-4740-bfb9-88def47aeb19 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:46.653851 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-2e7d0700-3992-4086-9688-3e3d5ea1ddba None None] MFA Rules not processed for user `495127048d1c4852982dfc79bbab6d46`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:46.655654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2e7d0700-3992-4086-9688-3e3d5ea1ddba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:46.707292 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0067e32-1a33-483e-b269-6365335aab83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:46.710030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0067e32-1a33-483e-b269-6365335aab83 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:46.710030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0067e32-1a33-483e-b269-6365335aab83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:46.710030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0067e32-1a33-483e-b269-6365335aab83 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:46.710030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0067e32-1a33-483e-b269-6365335aab83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:46.713884 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0067e32-1a33-483e-b269-6365335aab83 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:46.735972 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 981/1972] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:10:46.743776 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d0700-3992-4086-9688-3e3d5ea1ddba None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:46.743776 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2e7d0700-3992-4086-9688-3e3d5ea1ddba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:46.811878 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 992/1973] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:46 2022] POST /identity/v3/users => generated 304 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:46.813370 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0067e32-1a33-483e-b269-6365335aab83 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:46.822477 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d0700-3992-4086-9688-3e3d5ea1ddba None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:46.828536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0067e32-1a33-483e-b269-6365335aab83 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:46.829650 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cebf96-209e-4e6d-9bd1-d42c7dc407db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:46.830491 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cebf96-209e-4e6d-9bd1-d42c7dc407db service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:46.830755 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cebf96-209e-4e6d-9bd1-d42c7dc407db service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:46.831032 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cebf96-209e-4e6d-9bd1-d42c7dc407db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:46.835211 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acfd695-8f54-447c-b935-61b0a0f0e4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:46.835868 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfd695-8f54-447c-b935-61b0a0f0e4dd admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:46.836155 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfd695-8f54-447c-b935-61b0a0f0e4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:46.836438 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfd695-8f54-447c-b935-61b0a0f0e4dd admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:46.837137 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acfd695-8f54-447c-b935-61b0a0f0e4dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:46.839328 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acfd695-8f54-447c-b935-61b0a0f0e4dd admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:46.899812 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cebf96-209e-4e6d-9bd1-d42c7dc407db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:46.901473 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cebf96-209e-4e6d-9bd1-d42c7dc407db service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:46.913725 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 982/1974] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:46 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:46.914663 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cebf96-209e-4e6d-9bd1-d42c7dc407db service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:46.929265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cebf96-209e-4e6d-9bd1-d42c7dc407db service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:46.934160 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6c957-5929-4bf7-b181-00b7ef0bddc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:46.934956 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6c957-5929-4bf7-b181-00b7ef0bddc3 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:46.936462 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6c957-5929-4bf7-b181-00b7ef0bddc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:46.936462 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6c957-5929-4bf7-b181-00b7ef0bddc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:46.937074 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e6c957-5929-4bf7-b181-00b7ef0bddc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:46.938535 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e6c957-5929-4bf7-b181-00b7ef0bddc3 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:46.958637 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 993/1975] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:46 2022] POST /identity/v3/projects => generated 393 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:46.962429 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acfd695-8f54-447c-b935-61b0a0f0e4dd admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:46.970254 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 983/1976] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:46.977573 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6c957-5929-4bf7-b181-00b7ef0bddc3 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:46.993216 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6c957-5929-4bf7-b181-00b7ef0bddc3 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:47.089586 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acfd695-8f54-447c-b935-61b0a0f0e4dd admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:47.094985 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccdf780-dfac-4393-819b-5aa6fb9482f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:47.098232 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdf780-dfac-4393-819b-5aa6fb9482f6 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:47.098529 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdf780-dfac-4393-819b-5aa6fb9482f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:47.099537 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdf780-dfac-4393-819b-5aa6fb9482f6 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:47.100936 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccdf780-dfac-4393-819b-5aa6fb9482f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:47.101624 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3f140-152e-4198-ae37-4be3532cfc16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:47.102711 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3f140-152e-4198-ae37-4be3532cfc16 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:47.103347 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccdf780-dfac-4393-819b-5aa6fb9482f6 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:47.103609 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3f140-152e-4198-ae37-4be3532cfc16 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:47.104109 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3f140-152e-4198-ae37-4be3532cfc16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:47.198366 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c3f140-152e-4198-ae37-4be3532cfc16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:47.200145 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c3f140-152e-4198-ae37-4be3532cfc16 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:47.214379 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 984/1977] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:46 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:10:47.220464 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3f140-152e-4198-ae37-4be3532cfc16 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:47.220552 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 994/1978] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:46 2022] POST /identity/v3/users => generated 303 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:47.220552 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598d5b0-19d0-41ad-b1b1-74f632fa892d None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:47.220552 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598d5b0-19d0-41ad-b1b1-74f632fa892d None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:47.220552 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598d5b0-19d0-41ad-b1b1-74f632fa892d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:47.231083 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3f140-152e-4198-ae37-4be3532cfc16 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:47.236739 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7de279-3604-4248-a01f-b5e371bfdeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:47.237745 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7de279-3604-4248-a01f-b5e371bfdeb0 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:47.238074 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7de279-3604-4248-a01f-b5e371bfdeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:47.238357 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7de279-3604-4248-a01f-b5e371bfdeb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:47.239371 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7de279-3604-4248-a01f-b5e371bfdeb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:47.239914 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-3598d5b0-19d0-41ad-b1b1-74f632fa892d None None] MFA Rules not processed for user `eda37dd9b3304fa9a9734f12ffaea8e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:47.241075 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7de279-3604-4248-a01f-b5e371bfdeb0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:47.241322 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3598d5b0-19d0-41ad-b1b1-74f632fa892d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:47.256555 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 985/1979] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:47.257798 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7de279-3604-4248-a01f-b5e371bfdeb0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:47.273888 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7de279-3604-4248-a01f-b5e371bfdeb0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:47.275832 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a568e4d-41ef-4d99-9182-9a566f8829a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:47.276890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a568e4d-41ef-4d99-9182-9a566f8829a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:47.277144 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a568e4d-41ef-4d99-9182-9a566f8829a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:47.277430 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a568e4d-41ef-4d99-9182-9a566f8829a5 admin admin] PATH_INFO: `/v3/users/1c7e841a4c3d4d00bd92c2f260041504` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:47.306944 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a568e4d-41ef-4d99-9182-9a566f8829a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c7e841a4c3d4d00bd92c2f260041504)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:47.310779 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a568e4d-41ef-4d99-9182-9a566f8829a5 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:47.352834 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 995/1980] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:47.354119 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3598d5b0-19d0-41ad-b1b1-74f632fa892d None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:47.374288 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3598d5b0-19d0-41ad-b1b1-74f632fa892d None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:47.386765 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748c108-f668-490b-ba55-9fe78506ddfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:47.387290 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748c108-f668-490b-ba55-9fe78506ddfd admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:47.387650 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748c108-f668-490b-ba55-9fe78506ddfd admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:47.387997 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748c108-f668-490b-ba55-9fe78506ddfd admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:47.390458 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1748c108-f668-490b-ba55-9fe78506ddfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:47.398172 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1748c108-f668-490b-ba55-9fe78506ddfd admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:47.414679 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 996/1981] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:47.415650 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748c108-f668-490b-ba55-9fe78506ddfd admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:47.430956 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748c108-f668-490b-ba55-9fe78506ddfd admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:47.438475 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a5751-2308-4022-8615-f251f3d8df26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:47.441819 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a5751-2308-4022-8615-f251f3d8df26 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:47.442175 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a5751-2308-4022-8615-f251f3d8df26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:47.442530 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a5751-2308-4022-8615-f251f3d8df26 admin admin] PATH_INFO: `/v3/projects/d580c43cfbec4a03a83610ca67748abe/users/4e868be9f2a740c781ca1c9ea9fce7d2/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:47.460822 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a5751-2308-4022-8615-f251f3d8df26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d580c43cfbec4a03a83610ca67748abe, user_id=4e868be9f2a740c781ca1c9ea9fce7d2, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:47.470198 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a5751-2308-4022-8615-f251f3d8df26 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:47.559343 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4a568e4d-41ef-4d99-9182-9a566f8829a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c7e841a4c3d4d00bd92c2f260041504'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:47.568557 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 997/1982] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:47 2022] PUT /identity/v3/projects/d580c43cfbec4a03a83610ca67748abe/users/4e868be9f2a740c781ca1c9ea9fce7d2/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:47.570836 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b08cb1-a09f-4538-aebd-1e7c3f9097f4 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:47.570836 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b08cb1-a09f-4538-aebd-1e7c3f9097f4 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:47.570836 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b08cb1-a09f-4538-aebd-1e7c3f9097f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:47.583285 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4a568e4d-41ef-4d99-9182-9a566f8829a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c7e841a4c3d4d00bd92c2f260041504'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:47.599770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-16b08cb1-a09f-4538-aebd-1e7c3f9097f4 None None] MFA Rules not processed for user `8bd54cdc115e4ae9b202bd06c7658e4a`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:47.600988 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-16b08cb1-a09f-4538-aebd-1e7c3f9097f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:47.666114 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4a568e4d-41ef-4d99-9182-9a566f8829a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c7e841a4c3d4d00bd92c2f260041504'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:47.676203 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4a568e4d-41ef-4d99-9182-9a566f8829a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c7e841a4c3d4d00bd92c2f260041504'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:47.678223 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4a568e4d-41ef-4d99-9182-9a566f8829a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c7e841a4c3d4d00bd92c2f260041504'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:47.687698 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 986/1983] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:10:47 2022] DELETE /identity/v3/users/1c7e841a4c3d4d00bd92c2f260041504 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:47.688701 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 998/1984] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:47.689233 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a568e4d-41ef-4d99-9182-9a566f8829a5 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:47.690480 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3b4a3-61bf-48b1-9fcf-dd58909c0d1c None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:47.691234 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3b4a3-61bf-48b1-9fcf-dd58909c0d1c None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:47.691585 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3b4a3-61bf-48b1-9fcf-dd58909c0d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:47.692849 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4a568e4d-41ef-4d99-9182-9a566f8829a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:47.730719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-28c3b4a3-61bf-48b1-9fcf-dd58909c0d1c None None] MFA Rules not processed for user `4e868be9f2a740c781ca1c9ea9fce7d2`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:47.732836 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-28c3b4a3-61bf-48b1-9fcf-dd58909c0d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:47.772891 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a568e4d-41ef-4d99-9182-9a566f8829a5 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:47.778278 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b07d9dd-a8fc-4792-bfb3-49a9292c5fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:47.779251 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07d9dd-a8fc-4792-bfb3-49a9292c5fad admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:47.779541 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07d9dd-a8fc-4792-bfb3-49a9292c5fad admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:47.779822 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b07d9dd-a8fc-4792-bfb3-49a9292c5fad admin admin] PATH_INFO: `/v3/projects/94e28007be9645cab239078025c0bc74/users/b79707cb6e9d4104bd52e0c075ed05c5/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:47.798200 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07d9dd-a8fc-4792-bfb3-49a9292c5fad admin admin] RBAC: Authorizing `identity:create_grant(project_id=94e28007be9645cab239078025c0bc74, user_id=b79707cb6e9d4104bd52e0c075ed05c5, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:47.803410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b07d9dd-a8fc-4792-bfb3-49a9292c5fad admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:47.809600 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 999/1985] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:47 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:47.811159 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3b4a3-61bf-48b1-9fcf-dd58909c0d1c None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:47.812440 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-28c3b4a3-61bf-48b1-9fcf-dd58909c0d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:47.827119 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3b4a3-61bf-48b1-9fcf-dd58909c0d1c None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:47.837917 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b7a0a-eb6d-4988-8435-61da6393931b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:47.837917 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b7a0a-eb6d-4988-8435-61da6393931b admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:47.837917 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b7a0a-eb6d-4988-8435-61da6393931b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:47.837917 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b7a0a-eb6d-4988-8435-61da6393931b admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:47.838392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b7a0a-eb6d-4988-8435-61da6393931b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:47.838392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b7a0a-eb6d-4988-8435-61da6393931b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:47.894570 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 987/1986] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:47 2022] PUT /identity/v3/projects/94e28007be9645cab239078025c0bc74/users/b79707cb6e9d4104bd52e0c075ed05c5/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:47.894570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb2866-f450-41a6-be71-e0a423159c91 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:47.894570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb2866-f450-41a6-be71-e0a423159c91 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:47.894570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb2866-f450-41a6-be71-e0a423159c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:47.913372 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-dfeb2866-f450-41a6-be71-e0a423159c91 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:47.914707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-dfeb2866-f450-41a6-be71-e0a423159c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:47.953697 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1000/1987] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:47 2022] POST /identity/v3/projects => generated 369 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:47.954475 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b7a0a-eb6d-4988-8435-61da6393931b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:47.963553 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-809b7a0a-eb6d-4988-8435-61da6393931b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:48.031729 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 988/1988] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:48.033096 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb2866-f450-41a6-be71-e0a423159c91 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:48.044058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb2866-f450-41a6-be71-e0a423159c91 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:48.076575 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b7a0a-eb6d-4988-8435-61da6393931b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:48.083897 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e480e9-b0e0-4db5-b2ef-a7eef1438b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:48.083897 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e480e9-b0e0-4db5-b2ef-a7eef1438b7d admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:48.083897 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e480e9-b0e0-4db5-b2ef-a7eef1438b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:48.084151 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e480e9-b0e0-4db5-b2ef-a7eef1438b7d admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:48.085880 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e480e9-b0e0-4db5-b2ef-a7eef1438b7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:48.088427 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e480e9-b0e0-4db5-b2ef-a7eef1438b7d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:48.143600 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea91d2-e36c-47c4-ae51-eefc7aa5fe5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:48.144292 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea91d2-e36c-47c4-ae51-eefc7aa5fe5c admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:48.145172 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea91d2-e36c-47c4-ae51-eefc7aa5fe5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:48.145465 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea91d2-e36c-47c4-ae51-eefc7aa5fe5c admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:48.146553 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ea91d2-e36c-47c4-ae51-eefc7aa5fe5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:48.149516 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ea91d2-e36c-47c4-ae51-eefc7aa5fe5c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:48.165811 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 989/1989] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:48.165811 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea91d2-e36c-47c4-ae51-eefc7aa5fe5c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:48.180055 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea91d2-e36c-47c4-ae51-eefc7aa5fe5c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:48.183979 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1001/1990] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:47 2022] POST /identity/v3/projects => generated 407 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:48.184949 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e480e9-b0e0-4db5-b2ef-a7eef1438b7d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:48.185173 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2a5d6-4a87-49b2-bcc2-757778b43db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:48.186472 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2a5d6-4a87-49b2-bcc2-757778b43db4 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:48.186779 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2a5d6-4a87-49b2-bcc2-757778b43db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:48.187048 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2a5d6-4a87-49b2-bcc2-757778b43db4 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:48.187300 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-46e480e9-b0e0-4db5-b2ef-a7eef1438b7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:48.187727 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2a5d6-4a87-49b2-bcc2-757778b43db4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:48.189651 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2a5d6-4a87-49b2-bcc2-757778b43db4 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:48.253992 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e480e9-b0e0-4db5-b2ef-a7eef1438b7d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:48.257551 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd591fa-a715-464b-8c1e-28e224dfa773 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:48.258226 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd591fa-a715-464b-8c1e-28e224dfa773 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:48.258508 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd591fa-a715-464b-8c1e-28e224dfa773 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:48.258905 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd591fa-a715-464b-8c1e-28e224dfa773 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:48.314523 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 990/1991] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:48 2022] POST /identity/v3/users => generated 291 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:48.315302 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2a5d6-4a87-49b2-bcc2-757778b43db4 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:48.326642 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2a5d6-4a87-49b2-bcc2-757778b43db4 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:48.346841 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd591fa-a715-464b-8c1e-28e224dfa773 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:48.348908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd591fa-a715-464b-8c1e-28e224dfa773 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:48.362559 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1002/1992] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:48.364265 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd591fa-a715-464b-8c1e-28e224dfa773 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:48.386623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd591fa-a715-464b-8c1e-28e224dfa773 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:48.393572 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc47174-0443-4c10-8459-c533cff79551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:48.394565 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc47174-0443-4c10-8459-c533cff79551 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:48.395324 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc47174-0443-4c10-8459-c533cff79551 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:48.395914 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc47174-0443-4c10-8459-c533cff79551 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:48.397095 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc47174-0443-4c10-8459-c533cff79551 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:48.415372 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc47174-0443-4c10-8459-c533cff79551 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:48.437463 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73608e-50c0-4e18-9898-bcbc2a0f0efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:48.438720 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73608e-50c0-4e18-9898-bcbc2a0f0efa admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:48.440684 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73608e-50c0-4e18-9898-bcbc2a0f0efa admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:48.440684 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73608e-50c0-4e18-9898-bcbc2a0f0efa admin admin] PATH_INFO: `/v3/projects/94e28007be9645cab239078025c0bc74/users/b79707cb6e9d4104bd52e0c075ed05c5/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:48.445076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b73608e-50c0-4e18-9898-bcbc2a0f0efa admin admin] RBAC: Authorizing `identity:create_grant(project_id=94e28007be9645cab239078025c0bc74, user_id=b79707cb6e9d4104bd52e0c075ed05c5, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:48.449265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b73608e-50c0-4e18-9898-bcbc2a0f0efa admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:48.462041 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 991/1993] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:48 2022] PUT /identity/v3/projects/94e28007be9645cab239078025c0bc74/users/b79707cb6e9d4104bd52e0c075ed05c5/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:48.463472 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73608e-50c0-4e18-9898-bcbc2a0f0efa admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:48.495478 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1003/1994] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:48 2022] POST /identity/v3/users => generated 310 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:48.496778 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82442600-66ee-45c7-8c52-894f6181daa2 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:48.497073 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82442600-66ee-45c7-8c52-894f6181daa2 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:48.500297 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82442600-66ee-45c7-8c52-894f6181daa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:48.528202 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-82442600-66ee-45c7-8c52-894f6181daa2 None None] MFA Rules not processed for user `b79707cb6e9d4104bd52e0c075ed05c5`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:48.530038 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-82442600-66ee-45c7-8c52-894f6181daa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:48.553022 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73608e-50c0-4e18-9898-bcbc2a0f0efa admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:48.559119 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d61090-cec2-4822-b10b-9c64b6836722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:48.559907 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d61090-cec2-4822-b10b-9c64b6836722 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:48.560225 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d61090-cec2-4822-b10b-9c64b6836722 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:48.560552 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d61090-cec2-4822-b10b-9c64b6836722 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:48.561315 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d61090-cec2-4822-b10b-9c64b6836722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:48.562998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d61090-cec2-4822-b10b-9c64b6836722 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:48.577290 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 992/1995] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:48.577290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d61090-cec2-4822-b10b-9c64b6836722 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:48.585142 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d61090-cec2-4822-b10b-9c64b6836722 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:48.590732 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef336e8-fb64-4890-97c1-5f628b61b395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:48.591422 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef336e8-fb64-4890-97c1-5f628b61b395 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:48.592371 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef336e8-fb64-4890-97c1-5f628b61b395 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:48.592654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef336e8-fb64-4890-97c1-5f628b61b395 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:48.593390 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef336e8-fb64-4890-97c1-5f628b61b395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:48.595123 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef336e8-fb64-4890-97c1-5f628b61b395 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:48.609386 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 993/1996] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:48.610334 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef336e8-fb64-4890-97c1-5f628b61b395 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:48.629858 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef336e8-fb64-4890-97c1-5f628b61b395 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:48.642483 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaeaf99-97b8-4631-a586-e542bcc0cc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:48.643390 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaeaf99-97b8-4631-a586-e542bcc0cc9d admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:48.643672 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaeaf99-97b8-4631-a586-e542bcc0cc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:48.643947 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaeaf99-97b8-4631-a586-e542bcc0cc9d admin admin] PATH_INFO: `/v3/projects/776e7453f0ee411999b5c41374b4975b/users/9cd670be242d4dcb9f2c064b6e1426f8/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:48.656322 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1004/1997] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:48 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:48.664151 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82442600-66ee-45c7-8c52-894f6181daa2 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:48.674197 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaeaf99-97b8-4631-a586-e542bcc0cc9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=776e7453f0ee411999b5c41374b4975b, user_id=9cd670be242d4dcb9f2c064b6e1426f8, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:48.674351 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82442600-66ee-45c7-8c52-894f6181daa2 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:48.676686 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaeaf99-97b8-4631-a586-e542bcc0cc9d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:48.681789 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313f609-1065-4fd7-a9eb-3c0b268ce4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:48.682721 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313f609-1065-4fd7-a9eb-3c0b268ce4af admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:48.687103 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313f609-1065-4fd7-a9eb-3c0b268ce4af admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:48.687103 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313f609-1065-4fd7-a9eb-3c0b268ce4af admin admin] PATH_INFO: `/v3/projects/02f0450ad1af41e186b6c4d6087345cd/users/cf30e85a80614a409406a5c0fb986c38/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:48.700043 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f313f609-1065-4fd7-a9eb-3c0b268ce4af admin admin] RBAC: Authorizing `identity:create_grant(project_id=02f0450ad1af41e186b6c4d6087345cd, user_id=cf30e85a80614a409406a5c0fb986c38, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:48.703757 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f313f609-1065-4fd7-a9eb-3c0b268ce4af admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:48.778320 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 994/1998] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:48 2022] PUT /identity/v3/projects/776e7453f0ee411999b5c41374b4975b/users/9cd670be242d4dcb9f2c064b6e1426f8/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:48.779969 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaeaf99-97b8-4631-a586-e542bcc0cc9d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:48.780150 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1005/1999] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:48 2022] PUT /identity/v3/projects/02f0450ad1af41e186b6c4d6087345cd/users/cf30e85a80614a409406a5c0fb986c38/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:48.782887 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313f609-1065-4fd7-a9eb-3c0b268ce4af admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:48.849575 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaeaf99-97b8-4631-a586-e542bcc0cc9d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:48.851637 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313f609-1065-4fd7-a9eb-3c0b268ce4af admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:48.857044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96bf9e-1e1a-4176-9353-1bece8394718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:48.857044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96bf9e-1e1a-4176-9353-1bece8394718 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:48.857044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96bf9e-1e1a-4176-9353-1bece8394718 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:48.857044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96bf9e-1e1a-4176-9353-1bece8394718 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:48.857504 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d96bf9e-1e1a-4176-9353-1bece8394718 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:48.859940 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d96bf9e-1e1a-4176-9353-1bece8394718 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:48.861336 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f65262-7d43-452a-9b48-7e15d9bbbe6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:48.862156 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f65262-7d43-452a-9b48-7e15d9bbbe6c admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:48.862442 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f65262-7d43-452a-9b48-7e15d9bbbe6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:48.862716 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f65262-7d43-452a-9b48-7e15d9bbbe6c admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:48.863563 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f65262-7d43-452a-9b48-7e15d9bbbe6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:48.865277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f65262-7d43-452a-9b48-7e15d9bbbe6c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:48.890119 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1006/2000] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:10:48.890960 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f65262-7d43-452a-9b48-7e15d9bbbe6c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:48.903290 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f65262-7d43-452a-9b48-7e15d9bbbe6c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:48.909120 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61d562-14e6-4615-b321-f418c892ff23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:48.909837 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61d562-14e6-4615-b321-f418c892ff23 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:48.910373 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61d562-14e6-4615-b321-f418c892ff23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:48.910373 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61d562-14e6-4615-b321-f418c892ff23 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:48.911235 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b61d562-14e6-4615-b321-f418c892ff23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:48.912750 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b61d562-14e6-4615-b321-f418c892ff23 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:48.926557 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1007/2001] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:48.926557 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61d562-14e6-4615-b321-f418c892ff23 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:48.927580 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3b61d562-14e6-4615-b321-f418c892ff23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:48.940553 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61d562-14e6-4615-b321-f418c892ff23 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:48.946660 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fda3ce-b84e-41c2-a92e-4d613ed352ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:48.947697 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fda3ce-b84e-41c2-a92e-4d613ed352ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:48.947986 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fda3ce-b84e-41c2-a92e-4d613ed352ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:48.948268 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fda3ce-b84e-41c2-a92e-4d613ed352ee admin admin] PATH_INFO: `/v3/projects/aa6394d55d3f442cb3f900061efff5aa` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:48.949469 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fda3ce-b84e-41c2-a92e-4d613ed352ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa6394d55d3f442cb3f900061efff5aa)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:48.952069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fda3ce-b84e-41c2-a92e-4d613ed352ee admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:48.958386 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 995/2002] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:48 2022] POST /identity/v3/projects => generated 393 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:48.959786 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96bf9e-1e1a-4176-9353-1bece8394718 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:49.043761 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96bf9e-1e1a-4176-9353-1bece8394718 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:49.049102 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c4872-03b5-4d77-999c-7ae49868c85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:49.050185 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c4872-03b5-4d77-999c-7ae49868c85a admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:49.050731 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c4872-03b5-4d77-999c-7ae49868c85a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:49.051077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c4872-03b5-4d77-999c-7ae49868c85a admin admin] PATH_INFO: `/v3/projects/776e7453f0ee411999b5c41374b4975b/users/9cd670be242d4dcb9f2c064b6e1426f8/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:49.055195 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c4872-03b5-4d77-999c-7ae49868c85a admin admin] RBAC: Authorizing `identity:create_grant(project_id=776e7453f0ee411999b5c41374b4975b, user_id=9cd670be242d4dcb9f2c064b6e1426f8, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:49.058387 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c4872-03b5-4d77-999c-7ae49868c85a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:49.082647 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-69fda3ce-b84e-41c2-a92e-4d613ed352ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa6394d55d3f442cb3f900061efff5aa', 'request_id': 'req-69fda3ce-b84e-41c2-a92e-4d613ed352ee'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:49.089413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-69fda3ce-b84e-41c2-a92e-4d613ed352ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa6394d55d3f442cb3f900061efff5aa', 'request_id': 'req-69fda3ce-b84e-41c2-a92e-4d613ed352ee'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:49.090763 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 996/2003] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:48 2022] PUT /identity/v3/projects/776e7453f0ee411999b5c41374b4975b/users/9cd670be242d4dcb9f2c064b6e1426f8/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:49.091642 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c4872-03b5-4d77-999c-7ae49868c85a admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:49.125113 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-69fda3ce-b84e-41c2-a92e-4d613ed352ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa6394d55d3f442cb3f900061efff5aa', 'request_id': 'req-69fda3ce-b84e-41c2-a92e-4d613ed352ee'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:49.165932 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c4872-03b5-4d77-999c-7ae49868c85a admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:49.170710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34827c31-3b4d-4350-867d-891c043515fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:49.171592 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34827c31-3b4d-4350-867d-891c043515fc admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:49.171890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34827c31-3b4d-4350-867d-891c043515fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:49.172154 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34827c31-3b4d-4350-867d-891c043515fc admin admin] PATH_INFO: `/v3/projects/02f0450ad1af41e186b6c4d6087345cd/users/cf30e85a80614a409406a5c0fb986c38/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:49.174188 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34827c31-3b4d-4350-867d-891c043515fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=02f0450ad1af41e186b6c4d6087345cd, user_id=cf30e85a80614a409406a5c0fb986c38, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:49.176838 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34827c31-3b4d-4350-867d-891c043515fc admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:49.187719 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 997/2004] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:49 2022] PUT /identity/v3/projects/02f0450ad1af41e186b6c4d6087345cd/users/cf30e85a80614a409406a5c0fb986c38/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:49.188488 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34827c31-3b4d-4350-867d-891c043515fc admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:49.237669 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-69fda3ce-b84e-41c2-a92e-4d613ed352ee admin admin] The token cache is being invalidate because project aa6394d55d3f442cb3f900061efff5aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:10:49.238176 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-69fda3ce-b84e-41c2-a92e-4d613ed352ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:49.238749 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-69fda3ce-b84e-41c2-a92e-4d613ed352ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:49.246061 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1008/2005] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:10:48 2022] DELETE /identity/v3/projects/aa6394d55d3f442cb3f900061efff5aa => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:49.247537 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1853b-1493-45ff-b122-d662b2c1a3f4 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:49.248465 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1853b-1493-45ff-b122-d662b2c1a3f4 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:49.248799 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc1853b-1493-45ff-b122-d662b2c1a3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:49.252597 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34827c31-3b4d-4350-867d-891c043515fc admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:49.257293 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2527d-ad33-40b9-b011-ae6d8195a1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:49.257990 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2527d-ad33-40b9-b011-ae6d8195a1d8 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:49.258306 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2527d-ad33-40b9-b011-ae6d8195a1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:49.258582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2527d-ad33-40b9-b011-ae6d8195a1d8 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:49.264317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2527d-ad33-40b9-b011-ae6d8195a1d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:49.264317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2527d-ad33-40b9-b011-ae6d8195a1d8 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:49.292997 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-4cc1853b-1493-45ff-b122-d662b2c1a3f4 None None] MFA Rules not processed for user `cf30e85a80614a409406a5c0fb986c38`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:49.294395 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4cc1853b-1493-45ff-b122-d662b2c1a3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:49.368206 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1009/2006] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:49 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:49.369039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1853b-1493-45ff-b122-d662b2c1a3f4 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:49.376695 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 998/2007] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:49 2022] POST /identity/v3/users => generated 297 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:49.379363 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4cc1853b-1493-45ff-b122-d662b2c1a3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:49.380494 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2527d-ad33-40b9-b011-ae6d8195a1d8 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:49.382908 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b2e2527d-ad33-40b9-b011-ae6d8195a1d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:49.395933 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc1853b-1493-45ff-b122-d662b2c1a3f4 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:49.403871 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a3bab-510a-4448-8fc6-8597a4995724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:49.404640 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a3bab-510a-4448-8fc6-8597a4995724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:49.404925 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a3bab-510a-4448-8fc6-8597a4995724 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:49.405202 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a3bab-510a-4448-8fc6-8597a4995724 admin admin] PATH_INFO: `/v3/users/6033f637ee084d138a9e6bbd95c9094a` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:49.406518 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92a3bab-510a-4448-8fc6-8597a4995724 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6033f637ee084d138a9e6bbd95c9094a)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:49.408651 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92a3bab-510a-4448-8fc6-8597a4995724 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:49.476920 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2527d-ad33-40b9-b011-ae6d8195a1d8 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:49.483779 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a884b8-83ad-4c8e-afe3-eeb4d7632ac0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:49.484713 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a884b8-83ad-4c8e-afe3-eeb4d7632ac0 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:49.484713 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a884b8-83ad-4c8e-afe3-eeb4d7632ac0 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:49.484999 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a884b8-83ad-4c8e-afe3-eeb4d7632ac0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:49.494014 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a884b8-83ad-4c8e-afe3-eeb4d7632ac0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:49.495638 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a884b8-83ad-4c8e-afe3-eeb4d7632ac0 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:49.507409 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 999/2008] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:49 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:49.522362 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a884b8-83ad-4c8e-afe3-eeb4d7632ac0 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:49.524784 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-08a884b8-83ad-4c8e-afe3-eeb4d7632ac0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:49.543467 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a884b8-83ad-4c8e-afe3-eeb4d7632ac0 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:49.549924 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4facaf76-3e3f-44da-b73c-241914044154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:49.550726 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4facaf76-3e3f-44da-b73c-241914044154 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:49.551015 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4facaf76-3e3f-44da-b73c-241914044154 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:49.551291 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4facaf76-3e3f-44da-b73c-241914044154 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:49.552028 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4facaf76-3e3f-44da-b73c-241914044154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:49.553644 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4facaf76-3e3f-44da-b73c-241914044154 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:49.564634 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1000/2009] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:49.568752 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4facaf76-3e3f-44da-b73c-241914044154 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:49.578625 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4facaf76-3e3f-44da-b73c-241914044154 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:49.583378 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806fe5a4-d739-4a79-9ce2-6543da69c52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:49.584027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806fe5a4-d739-4a79-9ce2-6543da69c52d admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:49.584312 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806fe5a4-d739-4a79-9ce2-6543da69c52d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:49.584654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806fe5a4-d739-4a79-9ce2-6543da69c52d admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:49.585309 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806fe5a4-d739-4a79-9ce2-6543da69c52d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:49.586964 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806fe5a4-d739-4a79-9ce2-6543da69c52d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:49.588294 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d92a3bab-510a-4448-8fc6-8597a4995724 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6033f637ee084d138a9e6bbd95c9094a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:49.596789 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1001/2010] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:10:49.598035 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806fe5a4-d739-4a79-9ce2-6543da69c52d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:49.600834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-806fe5a4-d739-4a79-9ce2-6543da69c52d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:49.602465 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d92a3bab-510a-4448-8fc6-8597a4995724 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6033f637ee084d138a9e6bbd95c9094a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:49.617564 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806fe5a4-d739-4a79-9ce2-6543da69c52d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:49.624781 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f2ba2-2e9e-4747-a03b-b65d998d0c4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:49.625546 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f2ba2-2e9e-4747-a03b-b65d998d0c4e service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:49.625900 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f2ba2-2e9e-4747-a03b-b65d998d0c4e service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:49.626179 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f2ba2-2e9e-4747-a03b-b65d998d0c4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:49.628064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3c1f2ba2-2e9e-4747-a03b-b65d998d0c4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:49.698601 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f2ba2-2e9e-4747-a03b-b65d998d0c4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:49.700433 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f2ba2-2e9e-4747-a03b-b65d998d0c4e service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:49.700560 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d92a3bab-510a-4448-8fc6-8597a4995724 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6033f637ee084d138a9e6bbd95c9094a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:49.701232 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d92a3bab-510a-4448-8fc6-8597a4995724 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6033f637ee084d138a9e6bbd95c9094a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:49.708917 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d92a3bab-510a-4448-8fc6-8597a4995724 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6033f637ee084d138a9e6bbd95c9094a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:49.710847 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1002/2011] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:49 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:49.711592 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f2ba2-2e9e-4747-a03b-b65d998d0c4e service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:49.718844 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1010/2012] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:10:49 2022] DELETE /identity/v3/users/6033f637ee084d138a9e6bbd95c9094a => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:49.722562 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f2ba2-2e9e-4747-a03b-b65d998d0c4e service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:49.797552 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4580d-0238-4f7c-9942-8fd9a7ea817c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:49.798480 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4580d-0238-4f7c-9942-8fd9a7ea817c admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:49.799589 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4580d-0238-4f7c-9942-8fd9a7ea817c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:49.800238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4580d-0238-4f7c-9942-8fd9a7ea817c admin admin] PATH_INFO: `/v3/projects/1484aade54a74d308ccdd09ff23e6aa4/users/8c1c22ec323a422085b85a09246397df/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:49.820919 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4580d-0238-4f7c-9942-8fd9a7ea817c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1484aade54a74d308ccdd09ff23e6aa4, user_id=8c1c22ec323a422085b85a09246397df, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:49.823897 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4580d-0238-4f7c-9942-8fd9a7ea817c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:49.879808 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a3bab-510a-4448-8fc6-8597a4995724 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:49.881316 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d92a3bab-510a-4448-8fc6-8597a4995724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:49.894760 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a3bab-510a-4448-8fc6-8597a4995724 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:49.899296 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57671f7-d191-4cec-aa94-36409b0a4910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:49.900167 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57671f7-d191-4cec-aa94-36409b0a4910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:49.900452 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57671f7-d191-4cec-aa94-36409b0a4910 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:49.900729 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57671f7-d191-4cec-aa94-36409b0a4910 admin admin] PATH_INFO: `/v3/users/4e868be9f2a740c781ca1c9ea9fce7d2` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:49.901955 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57671f7-d191-4cec-aa94-36409b0a4910 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e868be9f2a740c781ca1c9ea9fce7d2)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:49.903884 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57671f7-d191-4cec-aa94-36409b0a4910 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:49.969598 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1003/2013] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:49 2022] PUT /identity/v3/projects/1484aade54a74d308ccdd09ff23e6aa4/users/8c1c22ec323a422085b85a09246397df/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:49.984282 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f1b50-e3df-4402-a0cc-d0783d2cf140 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:49.984565 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f1b50-e3df-4402-a0cc-d0783d2cf140 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:49.987354 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f1b50-e3df-4402-a0cc-d0783d2cf140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:50.019217 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-649f1b50-e3df-4402-a0cc-d0783d2cf140 None None] MFA Rules not processed for user `8c1c22ec323a422085b85a09246397df`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:50.021253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-649f1b50-e3df-4402-a0cc-d0783d2cf140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:50.125489 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1004/2014] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:50.164764 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b57671f7-d191-4cec-aa94-36409b0a4910 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e868be9f2a740c781ca1c9ea9fce7d2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:50.184517 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b57671f7-d191-4cec-aa94-36409b0a4910 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e868be9f2a740c781ca1c9ea9fce7d2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:50.259319 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b57671f7-d191-4cec-aa94-36409b0a4910 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e868be9f2a740c781ca1c9ea9fce7d2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:50.260289 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b57671f7-d191-4cec-aa94-36409b0a4910 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e868be9f2a740c781ca1c9ea9fce7d2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:50.285947 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b57671f7-d191-4cec-aa94-36409b0a4910 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e868be9f2a740c781ca1c9ea9fce7d2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:50.295690 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1011/2015] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:10:49 2022] DELETE /identity/v3/users/4e868be9f2a740c781ca1c9ea9fce7d2 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:10:50.300360 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bbec35-0727-402a-a860-22cca6bda1ac None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:50.300648 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bbec35-0727-402a-a860-22cca6bda1ac None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:50.300923 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bbec35-0727-402a-a860-22cca6bda1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:50.328314 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57671f7-d191-4cec-aa94-36409b0a4910 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:50.330064 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b57671f7-d191-4cec-aa94-36409b0a4910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:50.334203 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-95bbec35-0727-402a-a860-22cca6bda1ac None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:50.335401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-95bbec35-0727-402a-a860-22cca6bda1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:50.450726 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57671f7-d191-4cec-aa94-36409b0a4910 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:50.457285 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ab968-507c-4804-ae83-fc965c292ab2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:50.458015 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ab968-507c-4804-ae83-fc965c292ab2 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:50.458300 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ab968-507c-4804-ae83-fc965c292ab2 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:50.458583 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ab968-507c-4804-ae83-fc965c292ab2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:50.461382 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1005/2016] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:50.464259 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f27ab968-507c-4804-ae83-fc965c292ab2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:50.474518 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bbec35-0727-402a-a860-22cca6bda1ac None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:50.476175 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-95bbec35-0727-402a-a860-22cca6bda1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:50.531380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27ab968-507c-4804-ae83-fc965c292ab2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:50.533017 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27ab968-507c-4804-ae83-fc965c292ab2 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:50.543999 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1012/2017] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:50 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:50.546209 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bbec35-0727-402a-a860-22cca6bda1ac None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:50.553246 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b270c65-3c0b-4b97-b6f0-1d5dca40fbdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:50.553246 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b270c65-3c0b-4b97-b6f0-1d5dca40fbdb service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:50.553246 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b270c65-3c0b-4b97-b6f0-1d5dca40fbdb service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:50.553246 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b270c65-3c0b-4b97-b6f0-1d5dca40fbdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:50.565726 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b270c65-3c0b-4b97-b6f0-1d5dca40fbdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:50.567569 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b270c65-3c0b-4b97-b6f0-1d5dca40fbdb service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:50.579904 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1006/2018] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:10:50.651233 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12853fc-4424-470d-87d4-8fbe352ef108 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:50.651530 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12853fc-4424-470d-87d4-8fbe352ef108 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:50.651857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12853fc-4424-470d-87d4-8fbe352ef108 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:50.653397 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1013/2019] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:10:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:10:50.658441 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b270c65-3c0b-4b97-b6f0-1d5dca40fbdb service neutron] Authenticating service token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 30 21:10:50.672259 ncdv-master-1 devstack@keystone.service[91018]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-8b270c65-3c0b-4b97-b6f0-1d5dca40fbdb service neutron] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Apr 30 21:10:50.672563 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b270c65-3c0b-4b97-b6f0-1d5dca40fbdb service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:50.697784 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b270c65-3c0b-4b97-b6f0-1d5dca40fbdb service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:50.709039 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7cb66-7ddf-4765-82dd-e00a139879dc tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b79707cb6e9d4104bd52e0c075ed05c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e28007be9645cab239078025c0bc74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:50.710890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7cb66-7ddf-4765-82dd-e00a139879dc tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:50.711678 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7cb66-7ddf-4765-82dd-e00a139879dc tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:50.712130 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7cb66-7ddf-4765-82dd-e00a139879dc tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] PATH_INFO: `/v3/projects/f95aa68d4ae04f178ec0c2539b6b81e9` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:50.717560 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d7cb66-7ddf-4765-82dd-e00a139879dc tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] RBAC: Authorizing `identity:get_project(project_id=f95aa68d4ae04f178ec0c2539b6b81e9)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:50.720128 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d7cb66-7ddf-4765-82dd-e00a139879dc tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:50.723773 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1007/2020] 10.222.0.23 () {58 vars in 1443 bytes} [Sat Apr 30 21:10:50 2022] GET /identity/v3/projects/f95aa68d4ae04f178ec0c2539b6b81e9 => generated 395 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:10:50.823661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052e14d-cec4-4bf4-a245-a8b28cb89464 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:50.824266 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052e14d-cec4-4bf4-a245-a8b28cb89464 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:50.825413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052e14d-cec4-4bf4-a245-a8b28cb89464 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:50.830682 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1014/2021] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:10:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:10:50.834552 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7cb66-7ddf-4765-82dd-e00a139879dc tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] Authenticating service token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 30 21:10:50.836411 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-61d7cb66-7ddf-4765-82dd-e00a139879dc tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:50.858907 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7cb66-7ddf-4765-82dd-e00a139879dc tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:50.900629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7cb66-7ddf-4765-82dd-e00a139879dc tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:50.931716 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e3d7e-2489-4014-b957-eb21df9be25d tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b79707cb6e9d4104bd52e0c075ed05c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e28007be9645cab239078025c0bc74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:50.932660 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e3d7e-2489-4014-b957-eb21df9be25d tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:50.932999 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e3d7e-2489-4014-b957-eb21df9be25d tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:50.933284 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e3d7e-2489-4014-b957-eb21df9be25d tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] PATH_INFO: `/v3/projects/f95aa68d4ae04f178ec0c2539b6b81e9` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:50.934714 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e3d7e-2489-4014-b957-eb21df9be25d tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] RBAC: Authorizing `identity:get_project(project_id=f95aa68d4ae04f178ec0c2539b6b81e9)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:50.937591 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e3d7e-2489-4014-b957-eb21df9be25d tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:50.940259 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1008/2022] 10.222.0.23 () {58 vars in 1443 bytes} [Sat Apr 30 21:10:50 2022] GET /identity/v3/projects/f95aa68d4ae04f178ec0c2539b6b81e9 => generated 395 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:10:51.034431 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052e14d-cec4-4bf4-a245-a8b28cb89464 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:51.036153 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2052e14d-cec4-4bf4-a245-a8b28cb89464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:51.064146 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052e14d-cec4-4bf4-a245-a8b28cb89464 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:51.080342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d7b39-2551-43fb-95f9-9ba2f86db2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:51.081287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f309b4-0a0f-4685-9bf4-04e469701548 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:51.081881 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f309b4-0a0f-4685-9bf4-04e469701548 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:51.081881 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f309b4-0a0f-4685-9bf4-04e469701548 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:51.082431 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d7b39-2551-43fb-95f9-9ba2f86db2a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:51.082911 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d7b39-2551-43fb-95f9-9ba2f86db2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:51.083223 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1009/2023] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 21:10:51.084840 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d7b39-2551-43fb-95f9-9ba2f86db2a5 admin admin] PATH_INFO: `/v3/projects/36a50a607ccc410c9084d99d28a53a74` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:51.086499 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d7b39-2551-43fb-95f9-9ba2f86db2a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36a50a607ccc410c9084d99d28a53a74)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:51.090571 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f309b4-0a0f-4685-9bf4-04e469701548 None None] Authenticating service token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 30 21:10:51.092024 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d7b39-2551-43fb-95f9-9ba2f86db2a5 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:51.120015 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f309b4-0a0f-4685-9bf4-04e469701548 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:51.141300 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f309b4-0a0f-4685-9bf4-04e469701548 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:51.150536 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880f8ff-f2e9-4817-9a56-5a1d10e162a9 tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b79707cb6e9d4104bd52e0c075ed05c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e28007be9645cab239078025c0bc74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:51.152575 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880f8ff-f2e9-4817-9a56-5a1d10e162a9 tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:51.152920 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880f8ff-f2e9-4817-9a56-5a1d10e162a9 tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:51.154174 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880f8ff-f2e9-4817-9a56-5a1d10e162a9 tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] PATH_INFO: `/v3/projects/f95aa68d4ae04f178ec0c2539b6b81e9` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:51.156676 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e880f8ff-f2e9-4817-9a56-5a1d10e162a9 tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] RBAC: Authorizing `identity:get_project(project_id=f95aa68d4ae04f178ec0c2539b6b81e9)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:51.166981 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e880f8ff-f2e9-4817-9a56-5a1d10e162a9 tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:51.171668 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1010/2024] 10.222.0.23 () {58 vars in 1443 bytes} [Sat Apr 30 21:10:51 2022] GET /identity/v3/projects/f95aa68d4ae04f178ec0c2539b6b81e9 => generated 395 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:10:51.224468 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-728d7b39-2551-43fb-95f9-9ba2f86db2a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36a50a607ccc410c9084d99d28a53a74', 'request_id': 'req-728d7b39-2551-43fb-95f9-9ba2f86db2a5'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:51.237823 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-728d7b39-2551-43fb-95f9-9ba2f86db2a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36a50a607ccc410c9084d99d28a53a74', 'request_id': 'req-728d7b39-2551-43fb-95f9-9ba2f86db2a5'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:51.246878 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-728d7b39-2551-43fb-95f9-9ba2f86db2a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36a50a607ccc410c9084d99d28a53a74', 'request_id': 'req-728d7b39-2551-43fb-95f9-9ba2f86db2a5'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:51.343608 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-728d7b39-2551-43fb-95f9-9ba2f86db2a5 admin admin] The token cache is being invalidate because project 36a50a607ccc410c9084d99d28a53a74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:10:51.344204 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-728d7b39-2551-43fb-95f9-9ba2f86db2a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:51.345579 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-728d7b39-2551-43fb-95f9-9ba2f86db2a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:51.351533 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1015/2025] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:10:51 2022] DELETE /identity/v3/projects/36a50a607ccc410c9084d99d28a53a74 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:51.353205 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f12fc-81c0-44c1-b806-d67d7d6289aa None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:51.353523 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f12fc-81c0-44c1-b806-d67d7d6289aa None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:51.353831 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f12fc-81c0-44c1-b806-d67d7d6289aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:51.374758 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-cd0f12fc-81c0-44c1-b806-d67d7d6289aa None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:51.378268 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-cd0f12fc-81c0-44c1-b806-d67d7d6289aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:51.458977 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1011/2026] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:51.484021 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c7b36-0e5e-4f5c-9bc3-d017a5108f8b None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:51.484313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c7b36-0e5e-4f5c-9bc3-d017a5108f8b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:51.484595 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c7b36-0e5e-4f5c-9bc3-d017a5108f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:51.515238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-d92c7b36-0e5e-4f5c-9bc3-d017a5108f8b None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:51.516620 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d92c7b36-0e5e-4f5c-9bc3-d017a5108f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:51.546079 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1016/2027] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:51.547869 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f12fc-81c0-44c1-b806-d67d7d6289aa None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:51.558843 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f12fc-81c0-44c1-b806-d67d7d6289aa None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:51.574556 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268e130-b7ce-4b0d-8ea9-8def067a4dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:51.575573 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268e130-b7ce-4b0d-8ea9-8def067a4dcc admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:51.576699 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268e130-b7ce-4b0d-8ea9-8def067a4dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:51.577356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268e130-b7ce-4b0d-8ea9-8def067a4dcc admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:51.580452 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268e130-b7ce-4b0d-8ea9-8def067a4dcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:10:51.581068 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268e130-b7ce-4b0d-8ea9-8def067a4dcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:51.584002 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268e130-b7ce-4b0d-8ea9-8def067a4dcc admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:51.613132 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1012/2028] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:10:51.618032 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c7b36-0e5e-4f5c-9bc3-d017a5108f8b None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:51.631394 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c7b36-0e5e-4f5c-9bc3-d017a5108f8b None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:51.646770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1feacf-c068-4261-819f-ea3e35d3c298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:51.647898 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1feacf-c068-4261-819f-ea3e35d3c298 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:51.648204 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1feacf-c068-4261-819f-ea3e35d3c298 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:51.648537 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1feacf-c068-4261-819f-ea3e35d3c298 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:51.649686 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1feacf-c068-4261-819f-ea3e35d3c298 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:51.651852 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1feacf-c068-4261-819f-ea3e35d3c298 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:51.687640 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05f0c0-d998-49ce-86e4-da8cabac70f7 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:51.687956 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05f0c0-d998-49ce-86e4-da8cabac70f7 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:51.688238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05f0c0-d998-49ce-86e4-da8cabac70f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:51.747471 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-da05f0c0-d998-49ce-86e4-da8cabac70f7 None None] MFA Rules not processed for user `9cd670be242d4dcb9f2c064b6e1426f8`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:51.750320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-da05f0c0-d998-49ce-86e4-da8cabac70f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:51.848792 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1017/2029] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:51 2022] POST /identity/v3/projects => generated 363 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:51.857455 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1feacf-c068-4261-819f-ea3e35d3c298 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:51.860103 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-fc1feacf-c068-4261-819f-ea3e35d3c298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:51.932829 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1013/2030] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:51 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:51.932829 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05f0c0-d998-49ce-86e4-da8cabac70f7 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:51.960606 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05f0c0-d998-49ce-86e4-da8cabac70f7 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:52.073847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1feacf-c068-4261-819f-ea3e35d3c298 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:52.097942 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1931c-051e-42d3-a332-4493b0e706a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:52.098608 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1931c-051e-42d3-a332-4493b0e706a3 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:52.098999 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1931c-051e-42d3-a332-4493b0e706a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:52.099156 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1931c-051e-42d3-a332-4493b0e706a3 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:52.105033 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42687b-56ff-4cc2-aee2-1ecb25e010cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:52.106104 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42687b-56ff-4cc2-aee2-1ecb25e010cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:52.106414 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42687b-56ff-4cc2-aee2-1ecb25e010cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:52.106656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42687b-56ff-4cc2-aee2-1ecb25e010cb admin admin] PATH_INFO: `/v3/projects/d580c43cfbec4a03a83610ca67748abe` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:52.108013 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a42687b-56ff-4cc2-aee2-1ecb25e010cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d580c43cfbec4a03a83610ca67748abe)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:52.110159 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a42687b-56ff-4cc2-aee2-1ecb25e010cb admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:52.114676 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf1931c-051e-42d3-a332-4493b0e706a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:52.117376 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf1931c-051e-42d3-a332-4493b0e706a3 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:52.254700 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1014/2031] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:51 2022] POST /identity/v3/users => generated 282 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:52.256195 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba671e9-6814-4a7e-b69a-3f9988336654 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:52.256480 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba671e9-6814-4a7e-b69a-3f9988336654 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:52.256767 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba671e9-6814-4a7e-b69a-3f9988336654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:52.328573 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8a42687b-56ff-4cc2-aee2-1ecb25e010cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd580c43cfbec4a03a83610ca67748abe', 'request_id': 'req-8a42687b-56ff-4cc2-aee2-1ecb25e010cb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:52.335411 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-dba671e9-6814-4a7e-b69a-3f9988336654 None None] MFA Rules not processed for user `8bd54cdc115e4ae9b202bd06c7658e4a`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:52.336734 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-dba671e9-6814-4a7e-b69a-3f9988336654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:52.343851 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8a42687b-56ff-4cc2-aee2-1ecb25e010cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd580c43cfbec4a03a83610ca67748abe', 'request_id': 'req-8a42687b-56ff-4cc2-aee2-1ecb25e010cb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:52.359262 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8a42687b-56ff-4cc2-aee2-1ecb25e010cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd580c43cfbec4a03a83610ca67748abe', 'request_id': 'req-8a42687b-56ff-4cc2-aee2-1ecb25e010cb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:52.425156 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1015/2032] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:52.429928 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba671e9-6814-4a7e-b69a-3f9988336654 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:52.429928 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-dba671e9-6814-4a7e-b69a-3f9988336654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:52.462395 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8a42687b-56ff-4cc2-aee2-1ecb25e010cb admin admin] The token cache is being invalidate because project d580c43cfbec4a03a83610ca67748abe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:10:52.462395 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8a42687b-56ff-4cc2-aee2-1ecb25e010cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:52.463146 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8a42687b-56ff-4cc2-aee2-1ecb25e010cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:52.472462 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1018/2033] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:10:51 2022] DELETE /identity/v3/projects/d580c43cfbec4a03a83610ca67748abe => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:52.472462 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42687b-56ff-4cc2-aee2-1ecb25e010cb admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:52.472462 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8a42687b-56ff-4cc2-aee2-1ecb25e010cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:52.604410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba671e9-6814-4a7e-b69a-3f9988336654 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:52.626321 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a2e6a-4946-489b-acfa-95369f9b070b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:52.627309 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a2e6a-4946-489b-acfa-95369f9b070b service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:52.627767 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a2e6a-4946-489b-acfa-95369f9b070b service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:52.630168 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a2e6a-4946-489b-acfa-95369f9b070b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:52.634311 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42687b-56ff-4cc2-aee2-1ecb25e010cb admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:52.634906 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5c0a2e6a-4946-489b-acfa-95369f9b070b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:52.648533 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d00b2-6642-472e-b98e-3d784a9e8fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:52.654871 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d00b2-6642-472e-b98e-3d784a9e8fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:52.654871 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d00b2-6642-472e-b98e-3d784a9e8fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:52.655157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d00b2-6642-472e-b98e-3d784a9e8fc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:52.655800 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d00b2-6642-472e-b98e-3d784a9e8fc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:52.662537 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d00b2-6642-472e-b98e-3d784a9e8fc0 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:52.691428 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1019/2034] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:52.698250 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d00b2-6642-472e-b98e-3d784a9e8fc0 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:52.702001 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-288d00b2-6642-472e-b98e-3d784a9e8fc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:52.725917 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a2e6a-4946-489b-acfa-95369f9b070b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:52.728234 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a2e6a-4946-489b-acfa-95369f9b070b service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:52.734198 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d00b2-6642-472e-b98e-3d784a9e8fc0 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:52.740512 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1016/2035] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:52.741722 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a2e6a-4946-489b-acfa-95369f9b070b service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:52.743644 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5c0a2e6a-4946-489b-acfa-95369f9b070b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:52.759671 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a2e6a-4946-489b-acfa-95369f9b070b service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:52.764978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859263da-36ba-4334-be26-999faa586717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:52.765883 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859263da-36ba-4334-be26-999faa586717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:52.766139 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859263da-36ba-4334-be26-999faa586717 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:52.766485 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859263da-36ba-4334-be26-999faa586717 admin admin] PATH_INFO: `/v3/users/cf30e85a80614a409406a5c0fb986c38` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:52.767712 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859263da-36ba-4334-be26-999faa586717 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf30e85a80614a409406a5c0fb986c38)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:52.768506 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e518ac-a994-46a5-9dd5-8380b4f83f71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:52.769424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e518ac-a994-46a5-9dd5-8380b4f83f71 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:52.769654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859263da-36ba-4334-be26-999faa586717 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:52.770477 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e518ac-a994-46a5-9dd5-8380b4f83f71 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:52.770949 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e518ac-a994-46a5-9dd5-8380b4f83f71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:52.777131 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a0e518ac-a994-46a5-9dd5-8380b4f83f71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:52.796857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e518ac-a994-46a5-9dd5-8380b4f83f71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:52.796857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e518ac-a994-46a5-9dd5-8380b4f83f71 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:52.805688 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1020/2036] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:52.806643 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e518ac-a994-46a5-9dd5-8380b4f83f71 service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:52.817470 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e518ac-a994-46a5-9dd5-8380b4f83f71 service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:52.823410 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c96b806-fcbb-4151-b2e4-57b5ed498cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:52.824489 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96b806-fcbb-4151-b2e4-57b5ed498cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:52.825016 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96b806-fcbb-4151-b2e4-57b5ed498cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:52.825297 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96b806-fcbb-4151-b2e4-57b5ed498cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:52.826152 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c96b806-fcbb-4151-b2e4-57b5ed498cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:52.827759 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c96b806-fcbb-4151-b2e4-57b5ed498cb5 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:52.842926 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1021/2037] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:52.846861 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c96b806-fcbb-4151-b2e4-57b5ed498cb5 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:52.866787 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c96b806-fcbb-4151-b2e4-57b5ed498cb5 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:52.885813 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ef1ad-ba27-439d-9c15-7ad6649dcf1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:52.888841 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ef1ad-ba27-439d-9c15-7ad6649dcf1a admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:52.888841 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ef1ad-ba27-439d-9c15-7ad6649dcf1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:52.888841 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ef1ad-ba27-439d-9c15-7ad6649dcf1a admin admin] PATH_INFO: `/v3/projects/64f0bbc311b44034838e939a3c2e98ae/users/6e275a4d32754fe9a164bd79c3774b97/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:52.938891 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730ef1ad-ba27-439d-9c15-7ad6649dcf1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=64f0bbc311b44034838e939a3c2e98ae, user_id=6e275a4d32754fe9a164bd79c3774b97, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:52.942468 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730ef1ad-ba27-439d-9c15-7ad6649dcf1a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:53.012697 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-859263da-36ba-4334-be26-999faa586717 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf30e85a80614a409406a5c0fb986c38'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:53.026433 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-859263da-36ba-4334-be26-999faa586717 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf30e85a80614a409406a5c0fb986c38'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:53.055026 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1022/2038] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:52 2022] PUT /identity/v3/projects/64f0bbc311b44034838e939a3c2e98ae/users/6e275a4d32754fe9a164bd79c3774b97/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:10:53.056554 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d93584-9be3-4aa3-a302-d5f2f5340c1e None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:53.056874 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d93584-9be3-4aa3-a302-d5f2f5340c1e None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:53.057129 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d93584-9be3-4aa3-a302-d5f2f5340c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:53.080023 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-f1d93584-9be3-4aa3-a302-d5f2f5340c1e None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:53.081261 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f1d93584-9be3-4aa3-a302-d5f2f5340c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:53.132726 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-859263da-36ba-4334-be26-999faa586717 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf30e85a80614a409406a5c0fb986c38'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:53.149942 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-859263da-36ba-4334-be26-999faa586717 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf30e85a80614a409406a5c0fb986c38'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:53.150872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-859263da-36ba-4334-be26-999faa586717 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf30e85a80614a409406a5c0fb986c38'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:53.175207 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1023/2039] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:53.195770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d93584-9be3-4aa3-a302-d5f2f5340c1e None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:53.202358 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f1d93584-9be3-4aa3-a302-d5f2f5340c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:53.204038 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1017/2040] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:10:52 2022] DELETE /identity/v3/users/cf30e85a80614a409406a5c0fb986c38 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:53.352576 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc3a8c-02d4-4194-ab80-bf6994354669 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:53.353062 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc3a8c-02d4-4194-ab80-bf6994354669 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:53.353488 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc3a8c-02d4-4194-ab80-bf6994354669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:53.359157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d93584-9be3-4aa3-a302-d5f2f5340c1e None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:53.380520 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-37dc3a8c-02d4-4194-ab80-bf6994354669 None None] MFA Rules not processed for user `0b0cb145b72a492ebb8c0e9223be47a1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:53.383018 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-37dc3a8c-02d4-4194-ab80-bf6994354669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:53.443318 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c254c7e-6f56-4c93-bb7a-8c99a831cb0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:53.445088 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c254c7e-6f56-4c93-bb7a-8c99a831cb0e service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:53.445810 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c254c7e-6f56-4c93-bb7a-8c99a831cb0e service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:53.445810 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c254c7e-6f56-4c93-bb7a-8c99a831cb0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:53.488046 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1018/2041] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:10:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:10:53.517397 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc3a8c-02d4-4194-ab80-bf6994354669 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:53.526022 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-37dc3a8c-02d4-4194-ab80-bf6994354669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:53.539488 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc3a8c-02d4-4194-ab80-bf6994354669 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:53.543412 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119854e-c136-49b5-a461-a72a9171de45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:53.544081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119854e-c136-49b5-a461-a72a9171de45 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:53.544368 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119854e-c136-49b5-a461-a72a9171de45 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:53.545215 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119854e-c136-49b5-a461-a72a9171de45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:53.549227 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c254c7e-6f56-4c93-bb7a-8c99a831cb0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:53.550451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c254c7e-6f56-4c93-bb7a-8c99a831cb0e service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:53.553510 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119854e-c136-49b5-a461-a72a9171de45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:53.555898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119854e-c136-49b5-a461-a72a9171de45 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:53.567932 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1024/2042] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:10:53.574582 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1019/2043] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:53.699567 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162cf736-17ae-478d-903f-227640dfb7c4 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:53.703334 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162cf736-17ae-478d-903f-227640dfb7c4 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:53.703334 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162cf736-17ae-478d-903f-227640dfb7c4 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:53.703334 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1025/2044] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 21:10:53.708272 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119854e-c136-49b5-a461-a72a9171de45 service neutron] Authenticating service token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 30 21:10:53.710066 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7119854e-c136-49b5-a461-a72a9171de45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:53.812072 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119854e-c136-49b5-a461-a72a9171de45 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:53.814178 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7119854e-c136-49b5-a461-a72a9171de45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:53.902199 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119854e-c136-49b5-a461-a72a9171de45 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:53.911650 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d1206-7ff8-4c2c-ba5a-a110e3f995ea tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b79707cb6e9d4104bd52e0c075ed05c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e28007be9645cab239078025c0bc74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:53.912663 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d1206-7ff8-4c2c-ba5a-a110e3f995ea tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:53.913129 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d1206-7ff8-4c2c-ba5a-a110e3f995ea tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:53.913590 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d1206-7ff8-4c2c-ba5a-a110e3f995ea tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] PATH_INFO: `/v3/projects/f95aa68d4ae04f178ec0c2539b6b81e9` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:53.915797 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d1206-7ff8-4c2c-ba5a-a110e3f995ea tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] RBAC: Authorizing `identity:get_project(project_id=f95aa68d4ae04f178ec0c2539b6b81e9)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:53.918838 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d1206-7ff8-4c2c-ba5a-a110e3f995ea tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:53.920907 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1020/2045] 10.222.0.23 () {58 vars in 1443 bytes} [Sat Apr 30 21:10:53 2022] GET /identity/v3/projects/f95aa68d4ae04f178ec0c2539b6b81e9 => generated 395 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:10:53.982999 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162cf736-17ae-478d-903f-227640dfb7c4 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:53.984932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-162cf736-17ae-478d-903f-227640dfb7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:54.004066 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162cf736-17ae-478d-903f-227640dfb7c4 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:54.017832 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570e6d4-7fb0-4f9e-86ae-45e417479f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:54.018878 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570e6d4-7fb0-4f9e-86ae-45e417479f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:54.019190 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570e6d4-7fb0-4f9e-86ae-45e417479f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:54.024929 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570e6d4-7fb0-4f9e-86ae-45e417479f43 admin admin] PATH_INFO: `/v3/projects/02f0450ad1af41e186b6c4d6087345cd` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:54.024929 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570e6d4-7fb0-4f9e-86ae-45e417479f43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02f0450ad1af41e186b6c4d6087345cd)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:54.024929 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570e6d4-7fb0-4f9e-86ae-45e417479f43 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:54.067197 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95eba9-f91c-4b96-89ab-c606f44e482f None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:54.067580 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95eba9-f91c-4b96-89ab-c606f44e482f None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:54.067898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95eba9-f91c-4b96-89ab-c606f44e482f None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:54.069644 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1021/2046] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:10:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 21:10:54.076349 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95eba9-f91c-4b96-89ab-c606f44e482f None None] Authenticating service token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 30 21:10:54.099530 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95eba9-f91c-4b96-89ab-c606f44e482f None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:54.116719 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95eba9-f91c-4b96-89ab-c606f44e482f None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:54.123737 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8fdd2-2789-47df-ac78-52ba747709cd tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b79707cb6e9d4104bd52e0c075ed05c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e28007be9645cab239078025c0bc74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:54.124686 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8fdd2-2789-47df-ac78-52ba747709cd tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:54.125039 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8fdd2-2789-47df-ac78-52ba747709cd tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:54.125676 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8fdd2-2789-47df-ac78-52ba747709cd tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] PATH_INFO: `/v3/projects/f95aa68d4ae04f178ec0c2539b6b81e9` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:54.130724 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d8fdd2-2789-47df-ac78-52ba747709cd tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] RBAC: Authorizing `identity:get_project(project_id=f95aa68d4ae04f178ec0c2539b6b81e9)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:54.133711 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d8fdd2-2789-47df-ac78-52ba747709cd tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:54.136473 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1022/2047] 10.222.0.23 () {58 vars in 1443 bytes} [Sat Apr 30 21:10:54 2022] GET /identity/v3/projects/f95aa68d4ae04f178ec0c2539b6b81e9 => generated 395 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:10:54.155243 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e570e6d4-7fb0-4f9e-86ae-45e417479f43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02f0450ad1af41e186b6c4d6087345cd', 'request_id': 'req-e570e6d4-7fb0-4f9e-86ae-45e417479f43'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:54.167313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e570e6d4-7fb0-4f9e-86ae-45e417479f43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02f0450ad1af41e186b6c4d6087345cd', 'request_id': 'req-e570e6d4-7fb0-4f9e-86ae-45e417479f43'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:54.182268 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e570e6d4-7fb0-4f9e-86ae-45e417479f43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02f0450ad1af41e186b6c4d6087345cd', 'request_id': 'req-e570e6d4-7fb0-4f9e-86ae-45e417479f43'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:54.271619 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e570e6d4-7fb0-4f9e-86ae-45e417479f43 admin admin] The token cache is being invalidate because project 02f0450ad1af41e186b6c4d6087345cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:10:54.271923 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e570e6d4-7fb0-4f9e-86ae-45e417479f43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:54.272710 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e570e6d4-7fb0-4f9e-86ae-45e417479f43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:54.278866 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1026/2048] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:10:53 2022] DELETE /identity/v3/projects/02f0450ad1af41e186b6c4d6087345cd => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:54.283845 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318e392-87d3-467e-9afc-28c99b3c4e16 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:54.284862 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318e392-87d3-467e-9afc-28c99b3c4e16 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:54.284862 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318e392-87d3-467e-9afc-28c99b3c4e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:54.321181 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-4318e392-87d3-467e-9afc-28c99b3c4e16 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:54.323163 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4318e392-87d3-467e-9afc-28c99b3c4e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:54.424597 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1023/2049] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:54.433817 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e93ac5-104c-40f6-9cf2-5b05bb756bdf None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:54.434358 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e93ac5-104c-40f6-9cf2-5b05bb756bdf None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:54.434358 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e93ac5-104c-40f6-9cf2-5b05bb756bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:54.465432 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-d8e93ac5-104c-40f6-9cf2-5b05bb756bdf None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:54.466863 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d8e93ac5-104c-40f6-9cf2-5b05bb756bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:54.480238 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1027/2050] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:54.485639 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318e392-87d3-467e-9afc-28c99b3c4e16 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:54.498529 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318e392-87d3-467e-9afc-28c99b3c4e16 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:54.504375 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea5512-adb8-4eb0-9cf7-762d1f03199e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:54.507366 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea5512-adb8-4eb0-9cf7-762d1f03199e admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:54.507366 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea5512-adb8-4eb0-9cf7-762d1f03199e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:54.507366 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea5512-adb8-4eb0-9cf7-762d1f03199e admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:54.507366 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea5512-adb8-4eb0-9cf7-762d1f03199e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:10:54.507366 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea5512-adb8-4eb0-9cf7-762d1f03199e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:54.509695 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea5512-adb8-4eb0-9cf7-762d1f03199e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:54.525360 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1024/2051] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:10:54.530363 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e93ac5-104c-40f6-9cf2-5b05bb756bdf None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:54.550464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e93ac5-104c-40f6-9cf2-5b05bb756bdf None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:54.558271 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1698c5-9e85-43b2-83e1-b4e76026d966 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:54.558562 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1698c5-9e85-43b2-83e1-b4e76026d966 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:54.565177 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1698c5-9e85-43b2-83e1-b4e76026d966 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:54.565177 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1025/2052] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:10:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:10:54.565378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982dae88-6238-475e-bc83-5e7380451cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:54.565378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982dae88-6238-475e-bc83-5e7380451cd7 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:54.565378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982dae88-6238-475e-bc83-5e7380451cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:54.565378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982dae88-6238-475e-bc83-5e7380451cd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:54.565663 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982dae88-6238-475e-bc83-5e7380451cd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:54.567862 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982dae88-6238-475e-bc83-5e7380451cd7 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:54.577217 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1698c5-9e85-43b2-83e1-b4e76026d966 None None] Authenticating service token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 30 21:10:54.579986 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9a1698c5-9e85-43b2-83e1-b4e76026d966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:54.711233 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1698c5-9e85-43b2-83e1-b4e76026d966 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:54.712905 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9a1698c5-9e85-43b2-83e1-b4e76026d966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:54.719584 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1028/2053] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:54 2022] POST /identity/v3/projects => generated 373 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:54.724003 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982dae88-6238-475e-bc83-5e7380451cd7 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:54.791487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1698c5-9e85-43b2-83e1-b4e76026d966 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:54.823468 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982dae88-6238-475e-bc83-5e7380451cd7 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:54.828755 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8ee34-734d-4b74-8d57-fca6fa0094fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:54.829374 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8ee34-734d-4b74-8d57-fca6fa0094fe admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:54.829969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8ee34-734d-4b74-8d57-fca6fa0094fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:54.829969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8ee34-734d-4b74-8d57-fca6fa0094fe admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:54.834425 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8ee34-734d-4b74-8d57-fca6fa0094fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:54.834425 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8ee34-734d-4b74-8d57-fca6fa0094fe admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:54.875433 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c1323-4022-44d5-8646-9b7b751981b1 tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b79707cb6e9d4104bd52e0c075ed05c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94e28007be9645cab239078025c0bc74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:54.876344 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c1323-4022-44d5-8646-9b7b751981b1 tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:54.876643 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c1323-4022-44d5-8646-9b7b751981b1 tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:54.876900 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c1323-4022-44d5-8646-9b7b751981b1 tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] PATH_INFO: `/v3/projects/1484aade54a74d308ccdd09ff23e6aa4` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:54.878274 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c1323-4022-44d5-8646-9b7b751981b1 tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] RBAC: Authorizing `identity:get_project(project_id=1484aade54a74d308ccdd09ff23e6aa4)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:54.880377 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c1323-4022-44d5-8646-9b7b751981b1 tempest-FlavorsAccessNegativeTestJSON-504081176 tempest-FlavorsAccessNegativeTestJSON-504081176-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:54.885250 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1026/2054] 10.222.0.23 () {58 vars in 1443 bytes} [Sat Apr 30 21:10:54 2022] GET /identity/v3/projects/1484aade54a74d308ccdd09ff23e6aa4 => generated 393 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:10:54.886855 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4c94f-1713-4234-bedc-a64124f43beb None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:54.887148 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4c94f-1713-4234-bedc-a64124f43beb None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:54.887430 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4c94f-1713-4234-bedc-a64124f43beb None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:54.888858 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1027/2055] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:10:54.894987 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da9960-19fd-4616-ab34-d719330664e9 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:54.895074 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da9960-19fd-4616-ab34-d719330664e9 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:54.895473 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da9960-19fd-4616-ab34-d719330664e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:54.914036 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-20da9960-19fd-4616-ab34-d719330664e9 None None] MFA Rules not processed for user `4ad3f89b7037413a83c7905cef263b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:54.915301 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-20da9960-19fd-4616-ab34-d719330664e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:54.945708 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1029/2056] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:54 2022] POST /identity/v3/users => generated 287 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:54.947155 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8ee34-734d-4b74-8d57-fca6fa0094fe admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:54.957144 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8ee34-734d-4b74-8d57-fca6fa0094fe admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:54.962178 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443edd23-7d12-4d68-8feb-abeddc097313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:54.963052 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443edd23-7d12-4d68-8feb-abeddc097313 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:54.963295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443edd23-7d12-4d68-8feb-abeddc097313 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:54.963574 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443edd23-7d12-4d68-8feb-abeddc097313 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:54.964490 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443edd23-7d12-4d68-8feb-abeddc097313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:54.970063 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443edd23-7d12-4d68-8feb-abeddc097313 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:54.989858 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1030/2057] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:10:54.993965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443edd23-7d12-4d68-8feb-abeddc097313 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:54.997160 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1028/2058] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:10:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:10:55.005492 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443edd23-7d12-4d68-8feb-abeddc097313 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:55.013863 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe029073-e3fb-4890-917c-edd4f6cd4a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:55.013963 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe029073-e3fb-4890-917c-edd4f6cd4a0c admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:55.014247 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe029073-e3fb-4890-917c-edd4f6cd4a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:55.014533 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe029073-e3fb-4890-917c-edd4f6cd4a0c admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:55.015462 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe029073-e3fb-4890-917c-edd4f6cd4a0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:55.017251 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe029073-e3fb-4890-917c-edd4f6cd4a0c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:55.026173 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da9960-19fd-4616-ab34-d719330664e9 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:55.028255 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-20da9960-19fd-4616-ab34-d719330664e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:55.036371 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1031/2059] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:55.037597 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe029073-e3fb-4890-917c-edd4f6cd4a0c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:55.048999 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da9960-19fd-4616-ab34-d719330664e9 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:55.049200 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe029073-e3fb-4890-917c-edd4f6cd4a0c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:55.063888 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62a4e3-ac36-4997-874c-a797de7bad25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:55.064217 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b5781-a171-4fa2-bada-5a44090bc5ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:55.064313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62a4e3-ac36-4997-874c-a797de7bad25 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:55.064313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62a4e3-ac36-4997-874c-a797de7bad25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:55.064454 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b5781-a171-4fa2-bada-5a44090bc5ee service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:55.064523 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62a4e3-ac36-4997-874c-a797de7bad25 admin admin] PATH_INFO: `/v3/projects/4d8bde5d9ca44f859b5536d3398b63d4/users/cce42480cd844664991774f07ca47e79/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:55.064591 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b5781-a171-4fa2-bada-5a44090bc5ee service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:55.064591 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b5781-a171-4fa2-bada-5a44090bc5ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:55.068944 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b5781-a171-4fa2-bada-5a44090bc5ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:55.070578 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b5781-a171-4fa2-bada-5a44090bc5ee service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:55.073632 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62a4e3-ac36-4997-874c-a797de7bad25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d8bde5d9ca44f859b5536d3398b63d4, user_id=cce42480cd844664991774f07ca47e79, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:55.084066 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62a4e3-ac36-4997-874c-a797de7bad25 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:55.084584 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1029/2060] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:55.085492 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b5781-a171-4fa2-bada-5a44090bc5ee service placement] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:55.086975 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-506b5781-a171-4fa2-bada-5a44090bc5ee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:55.127021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b5781-a171-4fa2-bada-5a44090bc5ee service placement] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:55.137437 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ec12f-7b1e-408f-b634-8865a7197559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:55.139689 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ec12f-7b1e-408f-b634-8865a7197559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:55.140096 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ec12f-7b1e-408f-b634-8865a7197559 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:55.140300 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ec12f-7b1e-408f-b634-8865a7197559 admin admin] PATH_INFO: `/v3/users/495127048d1c4852982dfc79bbab6d46` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:55.141583 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ec12f-7b1e-408f-b634-8865a7197559 admin admin] RBAC: Authorizing `identity:delete_user(user_id=495127048d1c4852982dfc79bbab6d46)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:55.142491 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1032/2061] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:55 2022] PUT /identity/v3/projects/4d8bde5d9ca44f859b5536d3398b63d4/users/cce42480cd844664991774f07ca47e79/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:55.153479 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ec12f-7b1e-408f-b634-8865a7197559 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:55.156122 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9423632-06c2-475b-b428-bc749b8ea28b None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:55.156421 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9423632-06c2-475b-b428-bc749b8ea28b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:55.156700 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9423632-06c2-475b-b428-bc749b8ea28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:55.208692 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-a9423632-06c2-475b-b428-bc749b8ea28b None None] MFA Rules not processed for user `cce42480cd844664991774f07ca47e79`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:55.208692 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a9423632-06c2-475b-b428-bc749b8ea28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:55.310272 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1033/2062] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:55.312453 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee52a69-243f-43ee-b663-00a09e244443 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:55.312747 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee52a69-243f-43ee-b663-00a09e244443 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:55.313029 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee52a69-243f-43ee-b663-00a09e244443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:55.346301 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-7ee52a69-243f-43ee-b663-00a09e244443 None None] MFA Rules not processed for user `6e275a4d32754fe9a164bd79c3774b97`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:55.347368 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7ee52a69-243f-43ee-b663-00a09e244443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:55.424590 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1034/2063] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:55 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:55.425930 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee52a69-243f-43ee-b663-00a09e244443 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:55.513139 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee52a69-243f-43ee-b663-00a09e244443 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:55.519184 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a18091-35bc-4fdc-8c4e-1a0f9a7a4165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:55.519957 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a18091-35bc-4fdc-8c4e-1a0f9a7a4165 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:55.520527 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a18091-35bc-4fdc-8c4e-1a0f9a7a4165 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:55.520527 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a18091-35bc-4fdc-8c4e-1a0f9a7a4165 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:55.521241 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a18091-35bc-4fdc-8c4e-1a0f9a7a4165 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:55.523310 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a18091-35bc-4fdc-8c4e-1a0f9a7a4165 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:55.535255 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-372ec12f-7b1e-408f-b634-8865a7197559 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '495127048d1c4852982dfc79bbab6d46'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:55.548493 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-372ec12f-7b1e-408f-b634-8865a7197559 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '495127048d1c4852982dfc79bbab6d46'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:55.708936 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1035/2064] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:10:55 2022] POST /identity/v3/projects => generated 373 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:55.711211 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5410b4c-b17c-4855-ae9d-f584512aca95 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:55.711580 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5410b4c-b17c-4855-ae9d-f584512aca95 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:55.711931 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5410b4c-b17c-4855-ae9d-f584512aca95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:55.729536 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-372ec12f-7b1e-408f-b634-8865a7197559 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '495127048d1c4852982dfc79bbab6d46'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:55.739523 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-372ec12f-7b1e-408f-b634-8865a7197559 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '495127048d1c4852982dfc79bbab6d46'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:55.740577 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-372ec12f-7b1e-408f-b634-8865a7197559 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '495127048d1c4852982dfc79bbab6d46'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:55.771985 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-a5410b4c-b17c-4855-ae9d-f584512aca95 None None] MFA Rules not processed for user `6e275a4d32754fe9a164bd79c3774b97`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:55.771985 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a5410b4c-b17c-4855-ae9d-f584512aca95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:55.772210 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1030/2065] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:10:55 2022] DELETE /identity/v3/users/495127048d1c4852982dfc79bbab6d46 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:55.772210 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ec12f-7b1e-408f-b634-8865a7197559 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:55.772210 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-372ec12f-7b1e-408f-b634-8865a7197559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:55.815713 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1036/2066] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:55 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:55.815713 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5bc20-36b0-43c0-bc30-28cebde34c16 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:55.815713 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5bc20-36b0-43c0-bc30-28cebde34c16 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:55.815713 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5bc20-36b0-43c0-bc30-28cebde34c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:55.832218 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ec12f-7b1e-408f-b634-8865a7197559 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:55.834759 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-dbe5bc20-36b0-43c0-bc30-28cebde34c16 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:55.836342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-dbe5bc20-36b0-43c0-bc30-28cebde34c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:55.837842 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4aec57-9b01-4b88-98f8-4caf0b201c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:55.838634 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4aec57-9b01-4b88-98f8-4caf0b201c97 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:55.838915 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4aec57-9b01-4b88-98f8-4caf0b201c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:55.839242 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4aec57-9b01-4b88-98f8-4caf0b201c97 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:55.840174 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4aec57-9b01-4b88-98f8-4caf0b201c97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:55.842432 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4aec57-9b01-4b88-98f8-4caf0b201c97 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:55.861805 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1037/2067] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:55.871718 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5bc20-36b0-43c0-bc30-28cebde34c16 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:55.874944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-dbe5bc20-36b0-43c0-bc30-28cebde34c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:55.934972 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5bc20-36b0-43c0-bc30-28cebde34c16 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:55.939604 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fdbc70-329d-441a-aff0-ab3053408532 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:55.940432 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fdbc70-329d-441a-aff0-ab3053408532 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:55.941112 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fdbc70-329d-441a-aff0-ab3053408532 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:55.941938 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fdbc70-329d-441a-aff0-ab3053408532 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:55.945933 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1031/2068] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:10:55 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:10:55.947274 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4aec57-9b01-4b88-98f8-4caf0b201c97 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:55.959330 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4aec57-9b01-4b88-98f8-4caf0b201c97 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:55.963407 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fdbc70-329d-441a-aff0-ab3053408532 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:55.964146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08550e9f-7af4-4fbd-9b17-ecd1b449841c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:55.964809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08550e9f-7af4-4fbd-9b17-ecd1b449841c admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:55.964951 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fdbc70-329d-441a-aff0-ab3053408532 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:55.965110 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08550e9f-7af4-4fbd-9b17-ecd1b449841c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:55.965359 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08550e9f-7af4-4fbd-9b17-ecd1b449841c admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:55.966122 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08550e9f-7af4-4fbd-9b17-ecd1b449841c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:55.967751 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08550e9f-7af4-4fbd-9b17-ecd1b449841c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:55.977599 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1038/2069] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:10:55.978843 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fdbc70-329d-441a-aff0-ab3053408532 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:55.982715 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a6fdbc70-329d-441a-aff0-ab3053408532 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:55.990842 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1032/2070] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:10:55.991861 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08550e9f-7af4-4fbd-9b17-ecd1b449841c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:56.006604 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08550e9f-7af4-4fbd-9b17-ecd1b449841c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:56.018731 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886dcd8-a620-4476-b69c-7f9aebfb4ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:56.018731 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886dcd8-a620-4476-b69c-7f9aebfb4ac8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:56.018731 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886dcd8-a620-4476-b69c-7f9aebfb4ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:56.018731 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886dcd8-a620-4476-b69c-7f9aebfb4ac8 admin admin] PATH_INFO: `/v3/projects/98bd8e2e248d4b3599ea7038e73a0981/users/9ecc7fabe57e4fc9accda390efb62b24/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:56.043088 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8886dcd8-a620-4476-b69c-7f9aebfb4ac8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98bd8e2e248d4b3599ea7038e73a0981, user_id=9ecc7fabe57e4fc9accda390efb62b24, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:56.046737 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8886dcd8-a620-4476-b69c-7f9aebfb4ac8 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:56.091561 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fdbc70-329d-441a-aff0-ab3053408532 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:56.098084 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d2b15-cc9c-41b0-9ebf-d8500c35e126 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:56.098742 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d2b15-cc9c-41b0-9ebf-d8500c35e126 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:56.099023 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d2b15-cc9c-41b0-9ebf-d8500c35e126 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:56.099305 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d2b15-cc9c-41b0-9ebf-d8500c35e126 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:56.101105 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ff5d2b15-cc9c-41b0-9ebf-d8500c35e126 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:56.118592 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1033/2071] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:55 2022] PUT /identity/v3/projects/98bd8e2e248d4b3599ea7038e73a0981/users/9ecc7fabe57e4fc9accda390efb62b24/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:56.122436 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886dcd8-a620-4476-b69c-7f9aebfb4ac8 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:56.170129 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d2b15-cc9c-41b0-9ebf-d8500c35e126 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:56.172390 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d2b15-cc9c-41b0-9ebf-d8500c35e126 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:56.195136 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1039/2072] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:55 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:56.196640 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20b1da-962e-4b8a-9a0b-daeb07cc6409 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:56.196937 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20b1da-962e-4b8a-9a0b-daeb07cc6409 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:56.197223 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f20b1da-962e-4b8a-9a0b-daeb07cc6409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:56.201353 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886dcd8-a620-4476-b69c-7f9aebfb4ac8 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:56.211349 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1029b-febb-45a4-bf2e-521c6fe9708e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:56.213003 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1029b-febb-45a4-bf2e-521c6fe9708e admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:56.213505 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1029b-febb-45a4-bf2e-521c6fe9708e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:56.214022 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1029b-febb-45a4-bf2e-521c6fe9708e admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:56.215661 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f1029b-febb-45a4-bf2e-521c6fe9708e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:56.218219 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f1029b-febb-45a4-bf2e-521c6fe9708e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:56.231487 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1034/2073] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:10:56.236429 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1029b-febb-45a4-bf2e-521c6fe9708e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:56.254395 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-6f20b1da-962e-4b8a-9a0b-daeb07cc6409 None None] MFA Rules not processed for user `0b0cb145b72a492ebb8c0e9223be47a1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:56.255685 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6f20b1da-962e-4b8a-9a0b-daeb07cc6409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:56.264605 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1029b-febb-45a4-bf2e-521c6fe9708e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:56.277483 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea2119-3470-4c62-a40e-e9d3fecf0389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:56.278419 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea2119-3470-4c62-a40e-e9d3fecf0389 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:56.279161 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea2119-3470-4c62-a40e-e9d3fecf0389 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:56.279541 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea2119-3470-4c62-a40e-e9d3fecf0389 admin admin] PATH_INFO: `/v3/projects/98bd8e2e248d4b3599ea7038e73a0981/users/9ecc7fabe57e4fc9accda390efb62b24/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:56.282237 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea2119-3470-4c62-a40e-e9d3fecf0389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98bd8e2e248d4b3599ea7038e73a0981, user_id=9ecc7fabe57e4fc9accda390efb62b24, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:56.285075 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea2119-3470-4c62-a40e-e9d3fecf0389 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:56.305471 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1035/2074] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:10:56 2022] PUT /identity/v3/projects/98bd8e2e248d4b3599ea7038e73a0981/users/9ecc7fabe57e4fc9accda390efb62b24/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:56.319966 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e5bf3-d32c-48d5-b7c4-6742f0b8f952 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:56.323446 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e5bf3-d32c-48d5-b7c4-6742f0b8f952 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:56.323446 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e5bf3-d32c-48d5-b7c4-6742f0b8f952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:56.352929 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-944e5bf3-d32c-48d5-b7c4-6742f0b8f952 None None] MFA Rules not processed for user `9ecc7fabe57e4fc9accda390efb62b24`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:56.354016 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-944e5bf3-d32c-48d5-b7c4-6742f0b8f952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:56.365191 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1040/2075] 10.222.0.20 () {58 vars in 1015 bytes} [Sat Apr 30 21:10:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:56.431479 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1036/2076] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:56 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:10:56.443702 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cf441-3f56-4e84-92f8-f09ac15efb80 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:56.443997 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cf441-3f56-4e84-92f8-f09ac15efb80 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:56.444359 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cf441-3f56-4e84-92f8-f09ac15efb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:56.471631 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-318cf441-3f56-4e84-92f8-f09ac15efb80 None None] MFA Rules not processed for user `cce42480cd844664991774f07ca47e79`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:56.473016 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-318cf441-3f56-4e84-92f8-f09ac15efb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:56.483954 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e5bf3-d32c-48d5-b7c4-6742f0b8f952 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:56.537236 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1041/2077] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:56.538880 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318cf441-3f56-4e84-92f8-f09ac15efb80 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:56.540541 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-318cf441-3f56-4e84-92f8-f09ac15efb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:56.594643 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e5bf3-d32c-48d5-b7c4-6742f0b8f952 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:56.616424 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ebdab9-eaa6-4c78-ad31-934d97da51e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:56.617717 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebdab9-eaa6-4c78-ad31-934d97da51e9 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:56.618467 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebdab9-eaa6-4c78-ad31-934d97da51e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:56.618857 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebdab9-eaa6-4c78-ad31-934d97da51e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:56.624123 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318cf441-3f56-4e84-92f8-f09ac15efb80 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:56.627831 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dbf4ea-916a-4b10-aad3-7c29152ca224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:56.628520 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbf4ea-916a-4b10-aad3-7c29152ca224 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:56.628861 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbf4ea-916a-4b10-aad3-7c29152ca224 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:56.629452 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbf4ea-916a-4b10-aad3-7c29152ca224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:56.631674 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ebdab9-eaa6-4c78-ad31-934d97da51e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:56.633384 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ebdab9-eaa6-4c78-ad31-934d97da51e9 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:56.637420 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dbf4ea-916a-4b10-aad3-7c29152ca224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:56.639386 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dbf4ea-916a-4b10-aad3-7c29152ca224 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:56.644151 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1037/2078] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:56.648453 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1042/2079] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:56.715716 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ebdab9-eaa6-4c78-ad31-934d97da51e9 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:56.718078 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c4ebdab9-eaa6-4c78-ad31-934d97da51e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:56.820129 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dbf4ea-916a-4b10-aad3-7c29152ca224 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:56.823444 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-99dbf4ea-916a-4b10-aad3-7c29152ca224 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:56.848965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ebdab9-eaa6-4c78-ad31-934d97da51e9 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:56.853928 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75c591-8a84-4d10-9679-14ed5710bc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:56.854869 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75c591-8a84-4d10-9679-14ed5710bc92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:56.855069 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75c591-8a84-4d10-9679-14ed5710bc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:56.855349 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75c591-8a84-4d10-9679-14ed5710bc92 admin admin] PATH_INFO: `/v3/projects/f95aa68d4ae04f178ec0c2539b6b81e9` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:56.856625 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e75c591-8a84-4d10-9679-14ed5710bc92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f95aa68d4ae04f178ec0c2539b6b81e9)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:56.858828 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e75c591-8a84-4d10-9679-14ed5710bc92 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:56.950133 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dbf4ea-916a-4b10-aad3-7c29152ca224 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:56.971689 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003fd83e-8358-4e31-9c69-72739c7d72a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:56.973421 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003fd83e-8358-4e31-9c69-72739c7d72a5 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:56.973894 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003fd83e-8358-4e31-9c69-72739c7d72a5 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:56.974794 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003fd83e-8358-4e31-9c69-72739c7d72a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:56.977853 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-003fd83e-8358-4e31-9c69-72739c7d72a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:56.998283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003fd83e-8358-4e31-9c69-72739c7d72a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:57.000358 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003fd83e-8358-4e31-9c69-72739c7d72a5 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:57.011796 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1043/2080] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:10:57.036149 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9e75c591-8a84-4d10-9679-14ed5710bc92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f95aa68d4ae04f178ec0c2539b6b81e9', 'request_id': 'req-9e75c591-8a84-4d10-9679-14ed5710bc92'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:57.043040 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9e75c591-8a84-4d10-9679-14ed5710bc92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f95aa68d4ae04f178ec0c2539b6b81e9', 'request_id': 'req-9e75c591-8a84-4d10-9679-14ed5710bc92'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:57.052197 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9e75c591-8a84-4d10-9679-14ed5710bc92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f95aa68d4ae04f178ec0c2539b6b81e9', 'request_id': 'req-9e75c591-8a84-4d10-9679-14ed5710bc92'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:57.133337 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9e75c591-8a84-4d10-9679-14ed5710bc92 admin admin] The token cache is being invalidate because project f95aa68d4ae04f178ec0c2539b6b81e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:10:57.133772 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9e75c591-8a84-4d10-9679-14ed5710bc92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:57.134638 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9e75c591-8a84-4d10-9679-14ed5710bc92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:57.140439 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1038/2081] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:10:56 2022] DELETE /identity/v3/projects/f95aa68d4ae04f178ec0c2539b6b81e9 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:57.141158 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003fd83e-8358-4e31-9c69-72739c7d72a5 service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:57.153693 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003fd83e-8358-4e31-9c69-72739c7d72a5 service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:57.213207 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd8320-c65b-489f-b3e5-5fb38668f457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:57.214187 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd8320-c65b-489f-b3e5-5fb38668f457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:57.214631 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd8320-c65b-489f-b3e5-5fb38668f457 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:57.214898 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd8320-c65b-489f-b3e5-5fb38668f457 admin admin] PATH_INFO: `/v3/users/b79707cb6e9d4104bd52e0c075ed05c5` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:57.216099 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd8320-c65b-489f-b3e5-5fb38668f457 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b79707cb6e9d4104bd52e0c075ed05c5)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:57.218249 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd8320-c65b-489f-b3e5-5fb38668f457 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:57.465313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-30dd8320-c65b-489f-b3e5-5fb38668f457 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b79707cb6e9d4104bd52e0c075ed05c5'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:57.483775 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75c591-8a84-4d10-9679-14ed5710bc92 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:57.485383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9e75c591-8a84-4d10-9679-14ed5710bc92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:57.502067 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-30dd8320-c65b-489f-b3e5-5fb38668f457 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b79707cb6e9d4104bd52e0c075ed05c5'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:57.509830 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75c591-8a84-4d10-9679-14ed5710bc92 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:57.531594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f659c-85f3-4e66-a5a1-ee6132ece6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:57.534682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f659c-85f3-4e66-a5a1-ee6132ece6c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:57.534682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f659c-85f3-4e66-a5a1-ee6132ece6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:57.534682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f659c-85f3-4e66-a5a1-ee6132ece6c0 admin admin] PATH_INFO: `/v3/users/594762664aef4802bc81a9df93274a9d` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:57.540172 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f659c-85f3-4e66-a5a1-ee6132ece6c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=594762664aef4802bc81a9df93274a9d)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:57.542345 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f659c-85f3-4e66-a5a1-ee6132ece6c0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:57.581194 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-30dd8320-c65b-489f-b3e5-5fb38668f457 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b79707cb6e9d4104bd52e0c075ed05c5'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:57.582296 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-30dd8320-c65b-489f-b3e5-5fb38668f457 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b79707cb6e9d4104bd52e0c075ed05c5'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:57.598681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-30dd8320-c65b-489f-b3e5-5fb38668f457 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b79707cb6e9d4104bd52e0c075ed05c5'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:57.620100 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1044/2082] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:10:57 2022] DELETE /identity/v3/users/b79707cb6e9d4104bd52e0c075ed05c5 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:57.761253 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301ffdc-44d9-452b-b7aa-3bb2efacffd3 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:57.761552 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301ffdc-44d9-452b-b7aa-3bb2efacffd3 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:57.761870 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301ffdc-44d9-452b-b7aa-3bb2efacffd3 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:57.764069 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1045/2083] 10.222.0.23 () {54 vars in 921 bytes} [Sat Apr 30 21:10:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:10:57.783196 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf257f6-54f4-4c8b-a56d-13e1590c5b4d None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:57.783487 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf257f6-54f4-4c8b-a56d-13e1590c5b4d None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:57.783820 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf257f6-54f4-4c8b-a56d-13e1590c5b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:57.823891 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-ccf257f6-54f4-4c8b-a56d-13e1590c5b4d None None] MFA Rules not processed for user `fca4ee1f64c8489ebe7296f9f8f0ab41`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:57.823891 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ccf257f6-54f4-4c8b-a56d-13e1590c5b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:57.918604 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1046/2084] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Apr 30 21:10:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:57.921025 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8f3f659c-85f3-4e66-a5a1-ee6132ece6c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '594762664aef4802bc81a9df93274a9d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:57.936730 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8f3f659c-85f3-4e66-a5a1-ee6132ece6c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '594762664aef4802bc81a9df93274a9d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:58.090428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8f3f659c-85f3-4e66-a5a1-ee6132ece6c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '594762664aef4802bc81a9df93274a9d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:58.099870 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8f3f659c-85f3-4e66-a5a1-ee6132ece6c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '594762664aef4802bc81a9df93274a9d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:58.101416 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8f3f659c-85f3-4e66-a5a1-ee6132ece6c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '594762664aef4802bc81a9df93274a9d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:58.112143 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1039/2085] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:10:57 2022] DELETE /identity/v3/users/594762664aef4802bc81a9df93274a9d => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:10:58.113898 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c6d2d-5df6-469f-929d-5b8522216f8f None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:58.114212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c6d2d-5df6-469f-929d-5b8522216f8f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:58.114482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c6d2d-5df6-469f-929d-5b8522216f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:58.147699 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-e97c6d2d-5df6-469f-929d-5b8522216f8f None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:10:58.149737 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e97c6d2d-5df6-469f-929d-5b8522216f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:58.159581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f659c-85f3-4e66-a5a1-ee6132ece6c0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:58.160993 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8f3f659c-85f3-4e66-a5a1-ee6132ece6c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:58.329086 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1047/2086] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:10:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:10:58.342173 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f659c-85f3-4e66-a5a1-ee6132ece6c0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:58.350258 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739563e3-c610-41b8-ad73-e7c9623bda6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:58.351617 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739563e3-c610-41b8-ad73-e7c9623bda6f service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:58.352042 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739563e3-c610-41b8-ad73-e7c9623bda6f service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:58.352825 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739563e3-c610-41b8-ad73-e7c9623bda6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:58.358415 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-739563e3-c610-41b8-ad73-e7c9623bda6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:58.370970 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c6d2d-5df6-469f-929d-5b8522216f8f None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:58.372686 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e97c6d2d-5df6-469f-929d-5b8522216f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:58.393966 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739563e3-c610-41b8-ad73-e7c9623bda6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:58.399137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739563e3-c610-41b8-ad73-e7c9623bda6f service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:58.427845 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1040/2087] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:58.501317 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c6d2d-5df6-469f-929d-5b8522216f8f None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:58.505367 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b89ccf-1448-473b-a625-8d81c234cb5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:58.506154 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b89ccf-1448-473b-a625-8d81c234cb5b service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:58.506646 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b89ccf-1448-473b-a625-8d81c234cb5b service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:58.506991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b89ccf-1448-473b-a625-8d81c234cb5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:58.519316 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b89ccf-1448-473b-a625-8d81c234cb5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:58.520999 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b89ccf-1448-473b-a625-8d81c234cb5b service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:58.532059 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1048/2088] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:10:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:10:59.573149 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739563e3-c610-41b8-ad73-e7c9623bda6f service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:59.575181 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-739563e3-c610-41b8-ad73-e7c9623bda6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:59.599462 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b89ccf-1448-473b-a625-8d81c234cb5b service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:10:59.603260 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a9b89ccf-1448-473b-a625-8d81c234cb5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:10:59.620249 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739563e3-c610-41b8-ad73-e7c9623bda6f service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:59.638992 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b89ccf-1448-473b-a625-8d81c234cb5b service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:10:59.650031 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed135c5f-a116-4b47-99d9-2cc3a82d2b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:59.650930 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed135c5f-a116-4b47-99d9-2cc3a82d2b41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:59.658189 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed135c5f-a116-4b47-99d9-2cc3a82d2b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:59.658189 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed135c5f-a116-4b47-99d9-2cc3a82d2b41 admin admin] PATH_INFO: `/v3/projects/ecf0c72e1a9c4fe0a5c05d92f2e8b2da` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:59.660343 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed135c5f-a116-4b47-99d9-2cc3a82d2b41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecf0c72e1a9c4fe0a5c05d92f2e8b2da)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:59.662328 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed135c5f-a116-4b47-99d9-2cc3a82d2b41 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:59.671398 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f6d20-708b-405a-b18d-3c882ceaf66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:10:59.674460 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f6d20-708b-405a-b18d-3c882ceaf66e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:10:59.674784 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f6d20-708b-405a-b18d-3c882ceaf66e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:10:59.675072 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f6d20-708b-405a-b18d-3c882ceaf66e admin admin] PATH_INFO: `/v3/projects/94e28007be9645cab239078025c0bc74` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:10:59.677382 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f6d20-708b-405a-b18d-3c882ceaf66e admin admin] RBAC: Authorizing `identity:delete_project(project_id=94e28007be9645cab239078025c0bc74)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:10:59.679397 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f6d20-708b-405a-b18d-3c882ceaf66e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:10:59.846901 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ed135c5f-a116-4b47-99d9-2cc3a82d2b41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecf0c72e1a9c4fe0a5c05d92f2e8b2da', 'request_id': 'req-ed135c5f-a116-4b47-99d9-2cc3a82d2b41'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:59.857076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ed135c5f-a116-4b47-99d9-2cc3a82d2b41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecf0c72e1a9c4fe0a5c05d92f2e8b2da', 'request_id': 'req-ed135c5f-a116-4b47-99d9-2cc3a82d2b41'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:10:59.871761 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ed135c5f-a116-4b47-99d9-2cc3a82d2b41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecf0c72e1a9c4fe0a5c05d92f2e8b2da', 'request_id': 'req-ed135c5f-a116-4b47-99d9-2cc3a82d2b41'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:00.033108 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1e1f6d20-708b-405a-b18d-3c882ceaf66e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94e28007be9645cab239078025c0bc74', 'request_id': 'req-1e1f6d20-708b-405a-b18d-3c882ceaf66e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:00.038496 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1e1f6d20-708b-405a-b18d-3c882ceaf66e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94e28007be9645cab239078025c0bc74', 'request_id': 'req-1e1f6d20-708b-405a-b18d-3c882ceaf66e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:00.047100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1e1f6d20-708b-405a-b18d-3c882ceaf66e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94e28007be9645cab239078025c0bc74', 'request_id': 'req-1e1f6d20-708b-405a-b18d-3c882ceaf66e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:00.056317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ed135c5f-a116-4b47-99d9-2cc3a82d2b41 admin admin] The token cache is being invalidate because project ecf0c72e1a9c4fe0a5c05d92f2e8b2da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:11:00.056611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ed135c5f-a116-4b47-99d9-2cc3a82d2b41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:00.057449 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ed135c5f-a116-4b47-99d9-2cc3a82d2b41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:00.059245 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1041/2089] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:10:59 2022] DELETE /identity/v3/projects/ecf0c72e1a9c4fe0a5c05d92f2e8b2da => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:00.063103 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed135c5f-a116-4b47-99d9-2cc3a82d2b41 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:00.064593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ed135c5f-a116-4b47-99d9-2cc3a82d2b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:00.131142 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed135c5f-a116-4b47-99d9-2cc3a82d2b41 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:00.131296 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1e1f6d20-708b-405a-b18d-3c882ceaf66e admin admin] The token cache is being invalidate because project 94e28007be9645cab239078025c0bc74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:11:00.131438 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1e1f6d20-708b-405a-b18d-3c882ceaf66e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:00.132093 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1e1f6d20-708b-405a-b18d-3c882ceaf66e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:00.133678 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1049/2090] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:10:59 2022] DELETE /identity/v3/projects/94e28007be9645cab239078025c0bc74 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:00.139246 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f6d20-708b-405a-b18d-3c882ceaf66e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:00.140822 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1e1f6d20-708b-405a-b18d-3c882ceaf66e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:00.195000 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b50bd5-f8d8-4efa-b10b-8525db3c7518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:00.195885 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b50bd5-f8d8-4efa-b10b-8525db3c7518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:00.196398 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b50bd5-f8d8-4efa-b10b-8525db3c7518 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:00.196938 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b50bd5-f8d8-4efa-b10b-8525db3c7518 admin admin] PATH_INFO: `/v3/users/b6a6ca397aee484b93fe02aaa75890a3` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:00.198435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b50bd5-f8d8-4efa-b10b-8525db3c7518 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6a6ca397aee484b93fe02aaa75890a3)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:00.206437 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b50bd5-f8d8-4efa-b10b-8525db3c7518 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:00.218682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f6d20-708b-405a-b18d-3c882ceaf66e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:00.226156 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6eac6-23b7-4689-93cd-bc157b330488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:00.226156 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6eac6-23b7-4689-93cd-bc157b330488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:00.226156 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6eac6-23b7-4689-93cd-bc157b330488 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:00.226156 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6eac6-23b7-4689-93cd-bc157b330488 admin admin] PATH_INFO: `/v3/users/8c1c22ec323a422085b85a09246397df` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:00.228215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb6eac6-23b7-4689-93cd-bc157b330488 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c1c22ec323a422085b85a09246397df)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:00.230614 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb6eac6-23b7-4689-93cd-bc157b330488 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:00.431199 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-23b50bd5-f8d8-4efa-b10b-8525db3c7518 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6a6ca397aee484b93fe02aaa75890a3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:00.444919 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-23b50bd5-f8d8-4efa-b10b-8525db3c7518 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6a6ca397aee484b93fe02aaa75890a3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:00.445147 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0cb6eac6-23b7-4689-93cd-bc157b330488 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c1c22ec323a422085b85a09246397df'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:00.462387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0cb6eac6-23b7-4689-93cd-bc157b330488 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c1c22ec323a422085b85a09246397df'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:00.575183 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-23b50bd5-f8d8-4efa-b10b-8525db3c7518 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6a6ca397aee484b93fe02aaa75890a3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:00.585274 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-23b50bd5-f8d8-4efa-b10b-8525db3c7518 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6a6ca397aee484b93fe02aaa75890a3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:00.586590 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-23b50bd5-f8d8-4efa-b10b-8525db3c7518 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6a6ca397aee484b93fe02aaa75890a3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:00.605047 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1042/2091] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:11:00 2022] DELETE /identity/v3/users/b6a6ca397aee484b93fe02aaa75890a3 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:11:00.660372 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0cb6eac6-23b7-4689-93cd-bc157b330488 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c1c22ec323a422085b85a09246397df'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:00.661004 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0cb6eac6-23b7-4689-93cd-bc157b330488 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c1c22ec323a422085b85a09246397df'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:00.675944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0cb6eac6-23b7-4689-93cd-bc157b330488 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c1c22ec323a422085b85a09246397df'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:00.692444 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1050/2092] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:11:00 2022] DELETE /identity/v3/users/8c1c22ec323a422085b85a09246397df => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:11:02.238413 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b50bd5-f8d8-4efa-b10b-8525db3c7518 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:02.240161 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-23b50bd5-f8d8-4efa-b10b-8525db3c7518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:02.244600 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6eac6-23b7-4689-93cd-bc157b330488 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:02.246648 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0cb6eac6-23b7-4689-93cd-bc157b330488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:02.432146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b50bd5-f8d8-4efa-b10b-8525db3c7518 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:02.438942 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96d55c-86ec-4b50-801e-7ca9790850ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:02.440113 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96d55c-86ec-4b50-801e-7ca9790850ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:02.440714 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96d55c-86ec-4b50-801e-7ca9790850ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:02.441593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96d55c-86ec-4b50-801e-7ca9790850ba admin admin] PATH_INFO: `/v3/projects/cd39aa64695a4942967925e4463713bb` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:02.443180 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96d55c-86ec-4b50-801e-7ca9790850ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd39aa64695a4942967925e4463713bb)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:02.445467 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96d55c-86ec-4b50-801e-7ca9790850ba admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:02.457352 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6eac6-23b7-4689-93cd-bc157b330488 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:02.466776 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71b61b-6824-4863-ad01-ef9100509591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:02.466776 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71b61b-6824-4863-ad01-ef9100509591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:02.466776 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71b61b-6824-4863-ad01-ef9100509591 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:02.466776 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71b61b-6824-4863-ad01-ef9100509591 admin admin] PATH_INFO: `/v3/projects/1484aade54a74d308ccdd09ff23e6aa4` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:02.467102 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71b61b-6824-4863-ad01-ef9100509591 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1484aade54a74d308ccdd09ff23e6aa4)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:02.467529 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71b61b-6824-4863-ad01-ef9100509591 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:02.681287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cf96d55c-86ec-4b50-801e-7ca9790850ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd39aa64695a4942967925e4463713bb', 'request_id': 'req-cf96d55c-86ec-4b50-801e-7ca9790850ba'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:02.683212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-eb71b61b-6824-4863-ad01-ef9100509591 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1484aade54a74d308ccdd09ff23e6aa4', 'request_id': 'req-eb71b61b-6824-4863-ad01-ef9100509591'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:02.689320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cf96d55c-86ec-4b50-801e-7ca9790850ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd39aa64695a4942967925e4463713bb', 'request_id': 'req-cf96d55c-86ec-4b50-801e-7ca9790850ba'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:02.691573 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-eb71b61b-6824-4863-ad01-ef9100509591 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1484aade54a74d308ccdd09ff23e6aa4', 'request_id': 'req-eb71b61b-6824-4863-ad01-ef9100509591'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:02.698606 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cf96d55c-86ec-4b50-801e-7ca9790850ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd39aa64695a4942967925e4463713bb', 'request_id': 'req-cf96d55c-86ec-4b50-801e-7ca9790850ba'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:02.701723 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-eb71b61b-6824-4863-ad01-ef9100509591 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1484aade54a74d308ccdd09ff23e6aa4', 'request_id': 'req-eb71b61b-6824-4863-ad01-ef9100509591'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:02.780659 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-eb71b61b-6824-4863-ad01-ef9100509591 admin admin] The token cache is being invalidate because project 1484aade54a74d308ccdd09ff23e6aa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:11:02.780944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-eb71b61b-6824-4863-ad01-ef9100509591 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:02.786214 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-eb71b61b-6824-4863-ad01-ef9100509591 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:02.792754 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1051/2093] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:11:02 2022] DELETE /identity/v3/projects/1484aade54a74d308ccdd09ff23e6aa4 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:02.793740 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71b61b-6824-4863-ad01-ef9100509591 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:02.795719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-eb71b61b-6824-4863-ad01-ef9100509591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:02.827451 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cf96d55c-86ec-4b50-801e-7ca9790850ba admin admin] The token cache is being invalidate because project cd39aa64695a4942967925e4463713bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:11:02.828051 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cf96d55c-86ec-4b50-801e-7ca9790850ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:02.830105 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cf96d55c-86ec-4b50-801e-7ca9790850ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:02.835784 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1043/2094] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:11:02 2022] DELETE /identity/v3/projects/cd39aa64695a4942967925e4463713bb => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:02.838081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4aa57-7c93-40d1-91cf-83bf2284544a None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:02.840309 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4aa57-7c93-40d1-91cf-83bf2284544a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:02.840707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4aa57-7c93-40d1-91cf-83bf2284544a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:02.881637 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71b61b-6824-4863-ad01-ef9100509591 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:02.895118 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-fce4aa57-7c93-40d1-91cf-83bf2284544a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:02.898205 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-fce4aa57-7c93-40d1-91cf-83bf2284544a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:02.911380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d8f33-fc43-4666-87ac-94854de86512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:02.911380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d8f33-fc43-4666-87ac-94854de86512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:02.911380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d8f33-fc43-4666-87ac-94854de86512 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:02.911380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d8f33-fc43-4666-87ac-94854de86512 admin admin] PATH_INFO: `/v3/users/ffc5b3de98e844fabdc2860ed218c60a` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:02.912162 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d8f33-fc43-4666-87ac-94854de86512 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffc5b3de98e844fabdc2860ed218c60a)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:02.912454 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1044/2095] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:02.912454 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25645a-4ef4-4621-9b01-5fc47a77f9e9 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:02.920878 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81d8f33-fc43-4666-87ac-94854de86512 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:02.920986 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25645a-4ef4-4621-9b01-5fc47a77f9e9 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:02.920986 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25645a-4ef4-4621-9b01-5fc47a77f9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:02.941146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-0d25645a-4ef4-4621-9b01-5fc47a77f9e9 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:02.943581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0d25645a-4ef4-4621-9b01-5fc47a77f9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:02.956591 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1045/2096] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:02.958163 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48492c9-6915-417f-8f50-0e6f4190595f None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:02.958629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48492c9-6915-417f-8f50-0e6f4190595f None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:02.959059 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48492c9-6915-417f-8f50-0e6f4190595f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:02.981685 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-e48492c9-6915-417f-8f50-0e6f4190595f None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:02.983820 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e48492c9-6915-417f-8f50-0e6f4190595f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:02.995355 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1046/2097] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:03.003395 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add2240-dc44-424c-8092-3a0c66fefb2d None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:03.003920 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add2240-dc44-424c-8092-3a0c66fefb2d None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:03.004411 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add2240-dc44-424c-8092-3a0c66fefb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:03.037798 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-4add2240-dc44-424c-8092-3a0c66fefb2d None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:03.045772 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4add2240-dc44-424c-8092-3a0c66fefb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:03.063673 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1047/2098] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:03.065092 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4add2240-dc44-424c-8092-3a0c66fefb2d None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:03.092135 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4add2240-dc44-424c-8092-3a0c66fefb2d None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:03.107844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9658e01-6cbe-484f-8a2a-4eff3349a9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:03.108647 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9658e01-6cbe-484f-8a2a-4eff3349a9c3 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:03.108993 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9658e01-6cbe-484f-8a2a-4eff3349a9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:03.109357 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9658e01-6cbe-484f-8a2a-4eff3349a9c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:03.110223 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9658e01-6cbe-484f-8a2a-4eff3349a9c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:11:03.110611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9658e01-6cbe-484f-8a2a-4eff3349a9c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:03.112351 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9658e01-6cbe-484f-8a2a-4eff3349a9c3 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:03.146739 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1048/2099] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:11:03.147978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9658e01-6cbe-484f-8a2a-4eff3349a9c3 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:03.156018 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d81d8f33-fc43-4666-87ac-94854de86512 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffc5b3de98e844fabdc2860ed218c60a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:03.161674 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9658e01-6cbe-484f-8a2a-4eff3349a9c3 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:03.167457 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0be360-ef1f-4f15-b828-94a5dca6f3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:03.168360 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0be360-ef1f-4f15-b828-94a5dca6f3be admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:03.168747 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0be360-ef1f-4f15-b828-94a5dca6f3be admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:03.169651 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0be360-ef1f-4f15-b828-94a5dca6f3be admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:03.172140 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0be360-ef1f-4f15-b828-94a5dca6f3be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:11:03.172140 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0be360-ef1f-4f15-b828-94a5dca6f3be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:03.172863 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0be360-ef1f-4f15-b828-94a5dca6f3be admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:03.186053 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d81d8f33-fc43-4666-87ac-94854de86512 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffc5b3de98e844fabdc2860ed218c60a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:03.205189 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1049/2100] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:11:03.206056 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0be360-ef1f-4f15-b828-94a5dca6f3be admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:03.216960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0be360-ef1f-4f15-b828-94a5dca6f3be admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:03.230713 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13262a1b-5cb3-42f4-bfe7-9623bcce1509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:03.233630 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13262a1b-5cb3-42f4-bfe7-9623bcce1509 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:03.234430 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13262a1b-5cb3-42f4-bfe7-9623bcce1509 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:03.234430 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13262a1b-5cb3-42f4-bfe7-9623bcce1509 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:03.234987 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13262a1b-5cb3-42f4-bfe7-9623bcce1509 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:03.237026 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13262a1b-5cb3-42f4-bfe7-9623bcce1509 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:03.277928 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d81d8f33-fc43-4666-87ac-94854de86512 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffc5b3de98e844fabdc2860ed218c60a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:03.280782 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d81d8f33-fc43-4666-87ac-94854de86512 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffc5b3de98e844fabdc2860ed218c60a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:03.290061 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d81d8f33-fc43-4666-87ac-94854de86512 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffc5b3de98e844fabdc2860ed218c60a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:03.310690 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1052/2101] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:11:02 2022] DELETE /identity/v3/users/ffc5b3de98e844fabdc2860ed218c60a => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:03.312388 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d8f33-fc43-4666-87ac-94854de86512 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:03.314728 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d81d8f33-fc43-4666-87ac-94854de86512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:03.361344 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1050/2102] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:11:03 2022] POST /identity/v3/projects => generated 389 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:11:03.361344 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b577b-d323-49be-8215-aaf5b3ec33c2 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:03.361344 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b577b-d323-49be-8215-aaf5b3ec33c2 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:03.361344 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b577b-d323-49be-8215-aaf5b3ec33c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:03.382605 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-189b577b-d323-49be-8215-aaf5b3ec33c2 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:03.384707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-189b577b-d323-49be-8215-aaf5b3ec33c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:03.433403 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d8f33-fc43-4666-87ac-94854de86512 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:03.529619 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1051/2103] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:03.530718 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b577b-d323-49be-8215-aaf5b3ec33c2 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:03.534188 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-189b577b-d323-49be-8215-aaf5b3ec33c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:03.552940 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b577b-d323-49be-8215-aaf5b3ec33c2 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:03.560489 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12dfa6d-7e23-484f-86f0-a128b819b173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:03.561444 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12dfa6d-7e23-484f-86f0-a128b819b173 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:03.561871 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12dfa6d-7e23-484f-86f0-a128b819b173 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:03.562283 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12dfa6d-7e23-484f-86f0-a128b819b173 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:03.563378 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12dfa6d-7e23-484f-86f0-a128b819b173 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:03.566377 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12dfa6d-7e23-484f-86f0-a128b819b173 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:03.579978 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27797dc-fc94-4991-a679-b594d68f8c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:03.580754 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27797dc-fc94-4991-a679-b594d68f8c12 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:03.581031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27797dc-fc94-4991-a679-b594d68f8c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:03.581314 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27797dc-fc94-4991-a679-b594d68f8c12 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:03.582089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27797dc-fc94-4991-a679-b594d68f8c12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:03.587360 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27797dc-fc94-4991-a679-b594d68f8c12 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:03.772873 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1053/2104] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:11:03 2022] POST /identity/v3/projects => generated 393 bytes in 461 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:11:03.774482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27797dc-fc94-4991-a679-b594d68f8c12 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:03.776088 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1052/2105] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:11:03 2022] POST /identity/v3/users => generated 295 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:11:03.776951 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12dfa6d-7e23-484f-86f0-a128b819b173 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:03.779429 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c27797dc-fc94-4991-a679-b594d68f8c12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:03.804433 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12dfa6d-7e23-484f-86f0-a128b819b173 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:03.901137 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27797dc-fc94-4991-a679-b594d68f8c12 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:03.907278 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7cea5-4918-4bd3-b661-a06ae43bffb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:03.908028 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7cea5-4918-4bd3-b661-a06ae43bffb3 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:03.908319 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7cea5-4918-4bd3-b661-a06ae43bffb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:03.908641 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7cea5-4918-4bd3-b661-a06ae43bffb3 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:03.910521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7cea5-4918-4bd3-b661-a06ae43bffb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:03.912493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c50f6-131b-4f44-930d-8d313542f0c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:03.912975 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7cea5-4918-4bd3-b661-a06ae43bffb3 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:03.913153 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c50f6-131b-4f44-930d-8d313542f0c6 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:03.913804 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c50f6-131b-4f44-930d-8d313542f0c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:03.914228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c50f6-131b-4f44-930d-8d313542f0c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:03.936266 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c50f6-131b-4f44-930d-8d313542f0c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:03.938521 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c50f6-131b-4f44-930d-8d313542f0c6 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:03.959352 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1054/2106] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:11:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:11:03.960521 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c50f6-131b-4f44-930d-8d313542f0c6 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:03.980282 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c50f6-131b-4f44-930d-8d313542f0c6 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:03.990036 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b074e-0037-4a2f-90e9-2cef35d4c3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:03.990863 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b074e-0037-4a2f-90e9-2cef35d4c3cb admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:03.991275 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b074e-0037-4a2f-90e9-2cef35d4c3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:03.991658 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b074e-0037-4a2f-90e9-2cef35d4c3cb admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:03.992493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b074e-0037-4a2f-90e9-2cef35d4c3cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:03.994402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b074e-0037-4a2f-90e9-2cef35d4c3cb admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:04.005976 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1055/2107] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:11:04.009564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b074e-0037-4a2f-90e9-2cef35d4c3cb admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:04.022099 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b074e-0037-4a2f-90e9-2cef35d4c3cb admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:04.029157 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1053/2108] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:11:03 2022] POST /identity/v3/users => generated 297 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:11:04.032500 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8370c4-ea84-4a27-8774-20443fa417b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:04.033301 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8370c4-ea84-4a27-8774-20443fa417b4 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:04.033626 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7cea5-4918-4bd3-b661-a06ae43bffb3 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:04.033742 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8370c4-ea84-4a27-8774-20443fa417b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:04.034548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8370c4-ea84-4a27-8774-20443fa417b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:04.035069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8370c4-ea84-4a27-8774-20443fa417b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:04.037084 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8370c4-ea84-4a27-8774-20443fa417b4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:04.057839 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1056/2109] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:11:04.058033 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7cea5-4918-4bd3-b661-a06ae43bffb3 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:04.059146 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8370c4-ea84-4a27-8774-20443fa417b4 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:04.074561 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8370c4-ea84-4a27-8774-20443fa417b4 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:04.077886 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d6fa9-fe59-4889-a2e4-82ef156f4c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:04.081027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d6fa9-fe59-4889-a2e4-82ef156f4c21 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:04.081027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d6fa9-fe59-4889-a2e4-82ef156f4c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:04.081027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d6fa9-fe59-4889-a2e4-82ef156f4c21 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:04.081027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d6fa9-fe59-4889-a2e4-82ef156f4c21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:04.081668 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f3347f-bcdc-499a-a38d-649fc4196f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:04.082428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d6fa9-fe59-4889-a2e4-82ef156f4c21 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:04.082962 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3347f-bcdc-499a-a38d-649fc4196f80 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:04.083343 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3347f-bcdc-499a-a38d-649fc4196f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:04.083806 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3347f-bcdc-499a-a38d-649fc4196f80 admin admin] PATH_INFO: `/v3/projects/1116d3f443d04b31b6f74174f0427f7d/users/3478c1ac1faf4179958ac373ffafbf4b/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:04.101831 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1054/2110] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:11:04.105387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f3347f-bcdc-499a-a38d-649fc4196f80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1116d3f443d04b31b6f74174f0427f7d, user_id=3478c1ac1faf4179958ac373ffafbf4b, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:04.106259 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d6fa9-fe59-4889-a2e4-82ef156f4c21 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:04.109406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f3347f-bcdc-499a-a38d-649fc4196f80 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:04.116678 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d6fa9-fe59-4889-a2e4-82ef156f4c21 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:04.123108 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53dad01-f3de-4899-b141-11509222993d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:04.123784 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53dad01-f3de-4899-b141-11509222993d admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:04.124063 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53dad01-f3de-4899-b141-11509222993d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:04.124333 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53dad01-f3de-4899-b141-11509222993d admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:04.125058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53dad01-f3de-4899-b141-11509222993d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:04.126888 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53dad01-f3de-4899-b141-11509222993d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:04.140792 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1055/2111] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:11:04.145067 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53dad01-f3de-4899-b141-11509222993d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:04.157638 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53dad01-f3de-4899-b141-11509222993d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:04.163981 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55308dc5-e297-4e2f-b036-90572d4b6c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:04.164878 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55308dc5-e297-4e2f-b036-90572d4b6c1b admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:04.165157 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55308dc5-e297-4e2f-b036-90572d4b6c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:04.165428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55308dc5-e297-4e2f-b036-90572d4b6c1b admin admin] PATH_INFO: `/v3/projects/89d2470a634e4b3b96df66931847dae6/users/6cce227116e649da826de3541b2b2cef/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:04.181986 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55308dc5-e297-4e2f-b036-90572d4b6c1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=89d2470a634e4b3b96df66931847dae6, user_id=6cce227116e649da826de3541b2b2cef, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:04.184703 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55308dc5-e297-4e2f-b036-90572d4b6c1b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:04.275792 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1056/2112] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:11:04 2022] PUT /identity/v3/projects/89d2470a634e4b3b96df66931847dae6/users/6cce227116e649da826de3541b2b2cef/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:04.285153 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bd24b-8349-4e65-9281-3d5ce80a43e9 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:04.285494 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bd24b-8349-4e65-9281-3d5ce80a43e9 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:04.285787 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bd24b-8349-4e65-9281-3d5ce80a43e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:04.309866 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1057/2113] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:11:04 2022] PUT /identity/v3/projects/1116d3f443d04b31b6f74174f0427f7d/users/3478c1ac1faf4179958ac373ffafbf4b/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:04.319065 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23fc79-103d-4e9c-b272-bc4e1e3e29bd None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:04.319659 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23fc79-103d-4e9c-b272-bc4e1e3e29bd None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:04.319875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23fc79-103d-4e9c-b272-bc4e1e3e29bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:04.349318 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-6d2bd24b-8349-4e65-9281-3d5ce80a43e9 None None] MFA Rules not processed for user `6cce227116e649da826de3541b2b2cef`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:04.351285 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6d2bd24b-8349-4e65-9281-3d5ce80a43e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:04.360590 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-2e23fc79-103d-4e9c-b272-bc4e1e3e29bd None None] MFA Rules not processed for user `3478c1ac1faf4179958ac373ffafbf4b`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:04.363097 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2e23fc79-103d-4e9c-b272-bc4e1e3e29bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:04.438051 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1057/2114] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:11:04.441740 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2bd24b-8349-4e65-9281-3d5ce80a43e9 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:04.459791 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1058/2115] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:11:04.461075 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23fc79-103d-4e9c-b272-bc4e1e3e29bd None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:04.546039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23fc79-103d-4e9c-b272-bc4e1e3e29bd None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:04.546891 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2bd24b-8349-4e65-9281-3d5ce80a43e9 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:04.556932 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4e521-acc0-4167-b801-cfd908030183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:04.558876 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4e521-acc0-4167-b801-cfd908030183 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:04.558876 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4e521-acc0-4167-b801-cfd908030183 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:04.558876 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4e521-acc0-4167-b801-cfd908030183 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:04.559187 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d4e521-acc0-4167-b801-cfd908030183 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:04.561457 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d4e521-acc0-4167-b801-cfd908030183 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:04.565302 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f1ac9-f59a-41e0-8ee6-49a0829f6213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:04.566421 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f1ac9-f59a-41e0-8ee6-49a0829f6213 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:04.566805 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f1ac9-f59a-41e0-8ee6-49a0829f6213 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:04.567147 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f1ac9-f59a-41e0-8ee6-49a0829f6213 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:04.568555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9f1ac9-f59a-41e0-8ee6-49a0829f6213 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:04.570796 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9f1ac9-f59a-41e0-8ee6-49a0829f6213 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:04.673812 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1058/2116] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:11:04 2022] POST /identity/v3/projects => generated 397 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:11:04.678008 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4e521-acc0-4167-b801-cfd908030183 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:04.739023 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1059/2117] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:11:04 2022] POST /identity/v3/projects => generated 389 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:11:04.745681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f1ac9-f59a-41e0-8ee6-49a0829f6213 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:04.834343 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4e521-acc0-4167-b801-cfd908030183 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:04.927537 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f1ac9-f59a-41e0-8ee6-49a0829f6213 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:04.932531 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853d602-ace4-48d2-ad23-5bc88fdf489a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:04.934026 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853d602-ace4-48d2-ad23-5bc88fdf489a admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:04.934312 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853d602-ace4-48d2-ad23-5bc88fdf489a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:04.934589 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853d602-ace4-48d2-ad23-5bc88fdf489a admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:04.935816 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f853d602-ace4-48d2-ad23-5bc88fdf489a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:04.939717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f853d602-ace4-48d2-ad23-5bc88fdf489a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:04.955192 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5d5d3-4456-4a4b-9434-3928606fd849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:04.956029 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5d5d3-4456-4a4b-9434-3928606fd849 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:04.956422 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5d5d3-4456-4a4b-9434-3928606fd849 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:04.956806 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5d5d3-4456-4a4b-9434-3928606fd849 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:04.957666 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f5d5d3-4456-4a4b-9434-3928606fd849 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:04.960867 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f5d5d3-4456-4a4b-9434-3928606fd849 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:05.358673 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1060/2118] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:11:04 2022] POST /identity/v3/users => generated 301 bytes in 611 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:11:05.361227 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853d602-ace4-48d2-ad23-5bc88fdf489a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:05.368426 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1059/2119] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:11:04 2022] POST /identity/v3/users => generated 305 bytes in 688 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:11:05.370950 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5d5d3-4456-4a4b-9434-3928606fd849 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:05.388462 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853d602-ace4-48d2-ad23-5bc88fdf489a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:05.400183 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5d5d3-4456-4a4b-9434-3928606fd849 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:05.401530 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95da52-b249-4817-94ea-c878c5d3db07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:05.402245 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95da52-b249-4817-94ea-c878c5d3db07 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:05.402613 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95da52-b249-4817-94ea-c878c5d3db07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:05.402898 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95da52-b249-4817-94ea-c878c5d3db07 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:05.403678 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95da52-b249-4817-94ea-c878c5d3db07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:05.405508 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95da52-b249-4817-94ea-c878c5d3db07 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:05.416046 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa134391-5c77-452a-a682-c3dc759ca9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:05.418216 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa134391-5c77-452a-a682-c3dc759ca9a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:05.418216 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa134391-5c77-452a-a682-c3dc759ca9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:05.418216 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa134391-5c77-452a-a682-c3dc759ca9a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:05.418929 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa134391-5c77-452a-a682-c3dc759ca9a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:05.424323 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa134391-5c77-452a-a682-c3dc759ca9a1 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:05.434125 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1061/2120] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:11:05.435600 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95da52-b249-4817-94ea-c878c5d3db07 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:05.451857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95da52-b249-4817-94ea-c878c5d3db07 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:05.452308 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1060/2121] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:11:05.453225 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa134391-5c77-452a-a682-c3dc759ca9a1 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:05.455828 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657ec32-b5de-4474-91f5-3371da963fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:05.456622 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657ec32-b5de-4474-91f5-3371da963fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:05.457012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657ec32-b5de-4474-91f5-3371da963fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:05.457395 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657ec32-b5de-4474-91f5-3371da963fe4 admin admin] PATH_INFO: `/v3/projects/120d96f6b83045a4a12a55de11a098f7/users/86aeab8b9f69467691c59f25dc3a1e20/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:05.475006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa134391-5c77-452a-a682-c3dc759ca9a1 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:05.494082 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a5a6f-f7e6-4402-a08b-763fd568af5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:05.494995 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a5a6f-f7e6-4402-a08b-763fd568af5d admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:05.495278 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a5a6f-f7e6-4402-a08b-763fd568af5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:05.495556 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a5a6f-f7e6-4402-a08b-763fd568af5d admin admin] PATH_INFO: `/v3/projects/937f35996c28407caffb991b0ae4a5ce/users/b92f0b8191f746b58da4f93071b3f7fb/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:05.520141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1657ec32-b5de-4474-91f5-3371da963fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=120d96f6b83045a4a12a55de11a098f7, user_id=86aeab8b9f69467691c59f25dc3a1e20, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:05.524881 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1657ec32-b5de-4474-91f5-3371da963fe4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:05.525004 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a5a6f-f7e6-4402-a08b-763fd568af5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=937f35996c28407caffb991b0ae4a5ce, user_id=b92f0b8191f746b58da4f93071b3f7fb, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:05.526805 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a5a6f-f7e6-4402-a08b-763fd568af5d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:05.633073 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1062/2122] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:11:05 2022] PUT /identity/v3/projects/120d96f6b83045a4a12a55de11a098f7/users/86aeab8b9f69467691c59f25dc3a1e20/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:05.634832 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657ec32-b5de-4474-91f5-3371da963fe4 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:05.636849 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1657ec32-b5de-4474-91f5-3371da963fe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:05.668595 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1061/2123] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:11:05 2022] PUT /identity/v3/projects/937f35996c28407caffb991b0ae4a5ce/users/b92f0b8191f746b58da4f93071b3f7fb/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:05.668595 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a5a6f-f7e6-4402-a08b-763fd568af5d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:05.671144 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-324a5a6f-f7e6-4402-a08b-763fd568af5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:05.782543 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657ec32-b5de-4474-91f5-3371da963fe4 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:05.848730 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a5a6f-f7e6-4402-a08b-763fd568af5d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:05.855126 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1fa5a-b8bd-4faf-8b33-1a83b4fe72b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:05.856447 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1fa5a-b8bd-4faf-8b33-1a83b4fe72b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:05.857066 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1fa5a-b8bd-4faf-8b33-1a83b4fe72b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:05.867579 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1fa5a-b8bd-4faf-8b33-1a83b4fe72b1 admin admin] PATH_INFO: `/v3/projects/da4283a7d7fb4a4db57b5463687e0fde` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:05.873814 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1fa5a-b8bd-4faf-8b33-1a83b4fe72b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da4283a7d7fb4a4db57b5463687e0fde)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:05.884753 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1fa5a-b8bd-4faf-8b33-1a83b4fe72b1 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:05.929476 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce226a-eabd-4097-bdb5-a6b6f300f475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:05.931273 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce226a-eabd-4097-bdb5-a6b6f300f475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:05.931560 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce226a-eabd-4097-bdb5-a6b6f300f475 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:05.933003 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce226a-eabd-4097-bdb5-a6b6f300f475 admin admin] PATH_INFO: `/v3/users/09f28e171049411c847508fe7521b56b` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:05.936045 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce226a-eabd-4097-bdb5-a6b6f300f475 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09f28e171049411c847508fe7521b56b)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:05.941487 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce226a-eabd-4097-bdb5-a6b6f300f475 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:06.157652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7af1fa5a-b8bd-4faf-8b33-1a83b4fe72b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da4283a7d7fb4a4db57b5463687e0fde', 'request_id': 'req-7af1fa5a-b8bd-4faf-8b33-1a83b4fe72b1'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:06.164181 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7af1fa5a-b8bd-4faf-8b33-1a83b4fe72b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da4283a7d7fb4a4db57b5463687e0fde', 'request_id': 'req-7af1fa5a-b8bd-4faf-8b33-1a83b4fe72b1'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:06.172266 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7af1fa5a-b8bd-4faf-8b33-1a83b4fe72b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da4283a7d7fb4a4db57b5463687e0fde', 'request_id': 'req-7af1fa5a-b8bd-4faf-8b33-1a83b4fe72b1'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:06.224704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-95ce226a-eabd-4097-bdb5-a6b6f300f475 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09f28e171049411c847508fe7521b56b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:06.248869 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-95ce226a-eabd-4097-bdb5-a6b6f300f475 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09f28e171049411c847508fe7521b56b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:06.250590 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7af1fa5a-b8bd-4faf-8b33-1a83b4fe72b1 admin admin] The token cache is being invalidate because project da4283a7d7fb4a4db57b5463687e0fde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:11:06.250921 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7af1fa5a-b8bd-4faf-8b33-1a83b4fe72b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:06.252254 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7af1fa5a-b8bd-4faf-8b33-1a83b4fe72b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:06.258197 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1062/2124] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:11:05 2022] DELETE /identity/v3/projects/da4283a7d7fb4a4db57b5463687e0fde => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:06.259081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1fa5a-b8bd-4faf-8b33-1a83b4fe72b1 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:06.263895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7af1fa5a-b8bd-4faf-8b33-1a83b4fe72b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:06.339753 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-95ce226a-eabd-4097-bdb5-a6b6f300f475 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09f28e171049411c847508fe7521b56b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:06.340385 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-95ce226a-eabd-4097-bdb5-a6b6f300f475 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09f28e171049411c847508fe7521b56b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:06.351433 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-95ce226a-eabd-4097-bdb5-a6b6f300f475 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09f28e171049411c847508fe7521b56b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:06.356092 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1fa5a-b8bd-4faf-8b33-1a83b4fe72b1 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:06.359706 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1063/2125] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:11:05 2022] DELETE /identity/v3/users/09f28e171049411c847508fe7521b56b => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:06.360678 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce226a-eabd-4097-bdb5-a6b6f300f475 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:06.362271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-95ce226a-eabd-4097-bdb5-a6b6f300f475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:06.369950 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bbe63e-5ad6-4000-a62d-77f9c2b40225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:06.369950 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bbe63e-5ad6-4000-a62d-77f9c2b40225 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:06.369950 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bbe63e-5ad6-4000-a62d-77f9c2b40225 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:06.369950 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bbe63e-5ad6-4000-a62d-77f9c2b40225 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:06.370376 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bbe63e-5ad6-4000-a62d-77f9c2b40225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:06.370376 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bbe63e-5ad6-4000-a62d-77f9c2b40225 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:06.380809 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1063/2126] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:11:06.381788 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bbe63e-5ad6-4000-a62d-77f9c2b40225 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:06.385224 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e4bbe63e-5ad6-4000-a62d-77f9c2b40225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:06.400486 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bbe63e-5ad6-4000-a62d-77f9c2b40225 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:06.453109 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce226a-eabd-4097-bdb5-a6b6f300f475 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:06.459561 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c2c2d-917c-4f46-a7c7-0576b7f95cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:06.459718 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c2c2d-917c-4f46-a7c7-0576b7f95cef admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:06.459945 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c2c2d-917c-4f46-a7c7-0576b7f95cef admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:06.460203 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c2c2d-917c-4f46-a7c7-0576b7f95cef admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:06.460927 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1c2c2d-917c-4f46-a7c7-0576b7f95cef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:06.462601 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1c2c2d-917c-4f46-a7c7-0576b7f95cef admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:06.471681 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a31cab2-bedc-4a2a-89a6-35b2842d8528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:06.472552 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31cab2-bedc-4a2a-89a6-35b2842d8528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:06.472835 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31cab2-bedc-4a2a-89a6-35b2842d8528 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:06.473111 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31cab2-bedc-4a2a-89a6-35b2842d8528 admin admin] PATH_INFO: `/v3/users/fdd21038c7bf4d8298ed7cf40f142bdd` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:06.473855 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1064/2127] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:11:06.474795 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a31cab2-bedc-4a2a-89a6-35b2842d8528 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdd21038c7bf4d8298ed7cf40f142bdd)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:06.475016 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae2495-1b8b-4629-93b2-80879dbf3a83 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:06.475305 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae2495-1b8b-4629-93b2-80879dbf3a83 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:06.475699 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae2495-1b8b-4629-93b2-80879dbf3a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:06.477985 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a31cab2-bedc-4a2a-89a6-35b2842d8528 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:06.494665 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-49ae2495-1b8b-4629-93b2-80879dbf3a83 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:06.496001 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-49ae2495-1b8b-4629-93b2-80879dbf3a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:06.504419 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1065/2128] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:06.505276 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae2495-1b8b-4629-93b2-80879dbf3a83 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:06.506693 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-49ae2495-1b8b-4629-93b2-80879dbf3a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:06.518561 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae2495-1b8b-4629-93b2-80879dbf3a83 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:06.530968 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c53735-712d-4392-933f-929bb34327fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:06.532256 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c53735-712d-4392-933f-929bb34327fa admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:06.532256 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c53735-712d-4392-933f-929bb34327fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:06.532603 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c53735-712d-4392-933f-929bb34327fa admin admin] PATH_INFO: `/v3/projects/120d96f6b83045a4a12a55de11a098f7/users/86aeab8b9f69467691c59f25dc3a1e20/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:06.535305 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c53735-712d-4392-933f-929bb34327fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=120d96f6b83045a4a12a55de11a098f7, user_id=86aeab8b9f69467691c59f25dc3a1e20, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:06.538637 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c53735-712d-4392-933f-929bb34327fa admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:06.553156 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1066/2129] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:11:06 2022] PUT /identity/v3/projects/120d96f6b83045a4a12a55de11a098f7/users/86aeab8b9f69467691c59f25dc3a1e20/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:06.554035 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c53735-712d-4392-933f-929bb34327fa admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:06.623031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c53735-712d-4392-933f-929bb34327fa admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:06.630894 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56d9ab-bc86-49fe-9e03-9e835ab22628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:06.630894 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56d9ab-bc86-49fe-9e03-9e835ab22628 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:06.630894 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56d9ab-bc86-49fe-9e03-9e835ab22628 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:06.630894 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56d9ab-bc86-49fe-9e03-9e835ab22628 admin admin] PATH_INFO: `/v3/projects/937f35996c28407caffb991b0ae4a5ce/users/b92f0b8191f746b58da4f93071b3f7fb/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:06.631996 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56d9ab-bc86-49fe-9e03-9e835ab22628 admin admin] RBAC: Authorizing `identity:create_grant(project_id=937f35996c28407caffb991b0ae4a5ce, user_id=b92f0b8191f746b58da4f93071b3f7fb, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:06.634768 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56d9ab-bc86-49fe-9e03-9e835ab22628 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:06.646126 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1067/2130] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:11:06 2022] PUT /identity/v3/projects/937f35996c28407caffb991b0ae4a5ce/users/b92f0b8191f746b58da4f93071b3f7fb/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:06.647291 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56d9ab-bc86-49fe-9e03-9e835ab22628 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:06.650049 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2e56d9ab-bc86-49fe-9e03-9e835ab22628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:06.708617 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56d9ab-bc86-49fe-9e03-9e835ab22628 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:06.713089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f77a26c-a911-40b9-a1e5-1665b6001193 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:06.713736 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77a26c-a911-40b9-a1e5-1665b6001193 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:06.714048 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77a26c-a911-40b9-a1e5-1665b6001193 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:06.714326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77a26c-a911-40b9-a1e5-1665b6001193 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:06.720254 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8a31cab2-bedc-4a2a-89a6-35b2842d8528 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdd21038c7bf4d8298ed7cf40f142bdd'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:06.731737 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8a31cab2-bedc-4a2a-89a6-35b2842d8528 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdd21038c7bf4d8298ed7cf40f142bdd'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:06.773496 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f77a26c-a911-40b9-a1e5-1665b6001193 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:06.775035 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f77a26c-a911-40b9-a1e5-1665b6001193 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:06.785738 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1068/2131] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:11:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:11:06.787063 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b3587-dab9-43e4-99a2-f7e446d586a5 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:06.787349 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b3587-dab9-43e4-99a2-f7e446d586a5 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:06.787620 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b3587-dab9-43e4-99a2-f7e446d586a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:06.813318 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-a91b3587-dab9-43e4-99a2-f7e446d586a5 None None] MFA Rules not processed for user `86aeab8b9f69467691c59f25dc3a1e20`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:06.814542 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a91b3587-dab9-43e4-99a2-f7e446d586a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:06.820826 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8a31cab2-bedc-4a2a-89a6-35b2842d8528 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdd21038c7bf4d8298ed7cf40f142bdd'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:06.832530 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8a31cab2-bedc-4a2a-89a6-35b2842d8528 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdd21038c7bf4d8298ed7cf40f142bdd'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:06.832530 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8a31cab2-bedc-4a2a-89a6-35b2842d8528 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdd21038c7bf4d8298ed7cf40f142bdd'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:06.839394 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1064/2132] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:11:06 2022] DELETE /identity/v3/users/fdd21038c7bf4d8298ed7cf40f142bdd => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:06.840969 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6a0d6-d10f-4686-88fb-ba678f4f100b None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:06.842049 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6a0d6-d10f-4686-88fb-ba678f4f100b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:06.842432 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6a0d6-d10f-4686-88fb-ba678f4f100b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:06.873488 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-46d6a0d6-d10f-4686-88fb-ba678f4f100b None None] MFA Rules not processed for user `b92f0b8191f746b58da4f93071b3f7fb`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:06.875463 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-46d6a0d6-d10f-4686-88fb-ba678f4f100b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:06.918686 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1069/2133] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:06 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:06.931334 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b3587-dab9-43e4-99a2-f7e446d586a5 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:06.932790 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a91b3587-dab9-43e4-99a2-f7e446d586a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:06.998714 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1065/2134] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:06 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:07.003092 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6a0d6-d10f-4686-88fb-ba678f4f100b None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:07.004610 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-46d6a0d6-d10f-4686-88fb-ba678f4f100b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:07.038812 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b3587-dab9-43e4-99a2-f7e446d586a5 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:07.077942 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6a0d6-d10f-4686-88fb-ba678f4f100b None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:07.084017 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e462e4-6b50-4518-a7eb-e356dbe52857 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:07.084661 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e462e4-6b50-4518-a7eb-e356dbe52857 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:07.084948 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e462e4-6b50-4518-a7eb-e356dbe52857 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:07.085228 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e462e4-6b50-4518-a7eb-e356dbe52857 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:07.094195 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e462e4-6b50-4518-a7eb-e356dbe52857 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:07.095770 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e462e4-6b50-4518-a7eb-e356dbe52857 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:07.105794 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1066/2135] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:11:07 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:11:07.106766 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd3ce9-2a99-4c96-a3d0-9c83146d13c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:07.107865 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd3ce9-2a99-4c96-a3d0-9c83146d13c1 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:07.108291 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd3ce9-2a99-4c96-a3d0-9c83146d13c1 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:07.108574 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd3ce9-2a99-4c96-a3d0-9c83146d13c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:07.121583 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e462e4-6b50-4518-a7eb-e356dbe52857 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:07.124653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-23e462e4-6b50-4518-a7eb-e356dbe52857 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:07.203841 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd3ce9-2a99-4c96-a3d0-9c83146d13c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:07.206489 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd3ce9-2a99-4c96-a3d0-9c83146d13c1 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:07.222143 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1070/2136] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:11:06 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:11:07.320706 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e462e4-6b50-4518-a7eb-e356dbe52857 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:07.325860 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151e0cc-5f02-4129-8d26-241c461a5b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:07.326928 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151e0cc-5f02-4129-8d26-241c461a5b92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:07.327213 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151e0cc-5f02-4129-8d26-241c461a5b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:07.327490 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151e0cc-5f02-4129-8d26-241c461a5b92 admin admin] PATH_INFO: `/v3/projects/1d316cd4e4d043ba9da2707b8006acd4` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:07.329114 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2151e0cc-5f02-4129-8d26-241c461a5b92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d316cd4e4d043ba9da2707b8006acd4)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:07.335252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2151e0cc-5f02-4129-8d26-241c461a5b92 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:07.418584 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd3ce9-2a99-4c96-a3d0-9c83146d13c1 service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:07.430661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd3ce9-2a99-4c96-a3d0-9c83146d13c1 service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:07.438888 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7600a03-0e96-4487-a5de-229926b1b5e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:07.438888 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7600a03-0e96-4487-a5de-229926b1b5e4 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:07.438888 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7600a03-0e96-4487-a5de-229926b1b5e4 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:07.438888 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7600a03-0e96-4487-a5de-229926b1b5e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:07.440503 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c7600a03-0e96-4487-a5de-229926b1b5e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:07.525498 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2151e0cc-5f02-4129-8d26-241c461a5b92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d316cd4e4d043ba9da2707b8006acd4', 'request_id': 'req-2151e0cc-5f02-4129-8d26-241c461a5b92'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:07.527928 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7600a03-0e96-4487-a5de-229926b1b5e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:07.529495 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7600a03-0e96-4487-a5de-229926b1b5e4 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:07.540028 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1071/2137] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:11:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:11:07.551790 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2151e0cc-5f02-4129-8d26-241c461a5b92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d316cd4e4d043ba9da2707b8006acd4', 'request_id': 'req-2151e0cc-5f02-4129-8d26-241c461a5b92'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:07.553513 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7600a03-0e96-4487-a5de-229926b1b5e4 service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:07.556879 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c7600a03-0e96-4487-a5de-229926b1b5e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:07.565517 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2151e0cc-5f02-4129-8d26-241c461a5b92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d316cd4e4d043ba9da2707b8006acd4', 'request_id': 'req-2151e0cc-5f02-4129-8d26-241c461a5b92'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:07.573604 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7600a03-0e96-4487-a5de-229926b1b5e4 service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:07.643314 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2199464-61df-4001-b388-96c235002a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:07.644188 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2199464-61df-4001-b388-96c235002a10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:07.644467 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2199464-61df-4001-b388-96c235002a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:07.644743 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2199464-61df-4001-b388-96c235002a10 admin admin] PATH_INFO: `/v3/projects/ab10c03f4b95481fafe872abcc650720` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:07.646175 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2199464-61df-4001-b388-96c235002a10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab10c03f4b95481fafe872abcc650720)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:07.648124 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2199464-61df-4001-b388-96c235002a10 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:07.689578 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2151e0cc-5f02-4129-8d26-241c461a5b92 admin admin] The token cache is being invalidate because project 1d316cd4e4d043ba9da2707b8006acd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:11:07.689898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2151e0cc-5f02-4129-8d26-241c461a5b92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:07.690535 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2151e0cc-5f02-4129-8d26-241c461a5b92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:07.692361 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1067/2138] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:11:07 2022] DELETE /identity/v3/projects/1d316cd4e4d043ba9da2707b8006acd4 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:07.696300 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151e0cc-5f02-4129-8d26-241c461a5b92 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:07.697734 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2151e0cc-5f02-4129-8d26-241c461a5b92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:07.712546 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151e0cc-5f02-4129-8d26-241c461a5b92 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:07.718699 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f819b61-0526-4267-987f-e85696523254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:07.719652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f819b61-0526-4267-987f-e85696523254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:07.720016 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f819b61-0526-4267-987f-e85696523254 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:07.720376 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f819b61-0526-4267-987f-e85696523254 admin admin] PATH_INFO: `/v3/users/bede9e5d50f1451dabab5e15963e0492` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:07.721683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f819b61-0526-4267-987f-e85696523254 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bede9e5d50f1451dabab5e15963e0492)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:07.723743 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f819b61-0526-4267-987f-e85696523254 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:07.796800 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f2199464-61df-4001-b388-96c235002a10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab10c03f4b95481fafe872abcc650720', 'request_id': 'req-f2199464-61df-4001-b388-96c235002a10'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:07.802569 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f2199464-61df-4001-b388-96c235002a10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab10c03f4b95481fafe872abcc650720', 'request_id': 'req-f2199464-61df-4001-b388-96c235002a10'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:07.809166 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f2199464-61df-4001-b388-96c235002a10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab10c03f4b95481fafe872abcc650720', 'request_id': 'req-f2199464-61df-4001-b388-96c235002a10'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:07.911229 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f2199464-61df-4001-b388-96c235002a10 admin admin] The token cache is being invalidate because project ab10c03f4b95481fafe872abcc650720 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:11:07.913899 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f2199464-61df-4001-b388-96c235002a10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:07.913899 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f2199464-61df-4001-b388-96c235002a10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:07.919963 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1072/2139] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:11:07 2022] DELETE /identity/v3/projects/ab10c03f4b95481fafe872abcc650720 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:07.921375 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735654a-25f7-4df3-89e5-a636c818660f None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:07.921669 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735654a-25f7-4df3-89e5-a636c818660f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:07.921983 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735654a-25f7-4df3-89e5-a636c818660f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:07.941086 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-f735654a-25f7-4df3-89e5-a636c818660f None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:07.942321 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f735654a-25f7-4df3-89e5-a636c818660f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:08.019388 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1073/2140] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:08.027547 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56bda5-4640-4048-9697-4370686898f2 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:08.027905 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56bda5-4640-4048-9697-4370686898f2 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:08.028114 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56bda5-4640-4048-9697-4370686898f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:08.040636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5f819b61-0526-4267-987f-e85696523254 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bede9e5d50f1451dabab5e15963e0492'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:08.064918 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-4a56bda5-4640-4048-9697-4370686898f2 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:08.068282 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4a56bda5-4640-4048-9697-4370686898f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:08.073884 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5f819b61-0526-4267-987f-e85696523254 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bede9e5d50f1451dabab5e15963e0492'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:08.078091 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1074/2141] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:08.081510 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56bda5-4640-4048-9697-4370686898f2 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:08.096048 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56bda5-4640-4048-9697-4370686898f2 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:08.102426 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38bce6-9733-4589-8af6-6756329cf893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:08.103225 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38bce6-9733-4589-8af6-6756329cf893 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:08.103646 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38bce6-9733-4589-8af6-6756329cf893 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:08.104022 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38bce6-9733-4589-8af6-6756329cf893 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:08.104844 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38bce6-9733-4589-8af6-6756329cf893 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:11:08.105216 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38bce6-9733-4589-8af6-6756329cf893 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:08.107071 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38bce6-9733-4589-8af6-6756329cf893 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:08.126482 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1075/2142] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:11:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:11:08.130826 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38bce6-9733-4589-8af6-6756329cf893 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:08.142909 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38bce6-9733-4589-8af6-6756329cf893 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:08.148869 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0c1e4-fc14-44ee-aa28-fe5baa51683f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:08.149530 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0c1e4-fc14-44ee-aa28-fe5baa51683f admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:08.149875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0c1e4-fc14-44ee-aa28-fe5baa51683f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:08.150206 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0c1e4-fc14-44ee-aa28-fe5baa51683f admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:08.150907 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da0c1e4-fc14-44ee-aa28-fe5baa51683f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:08.153095 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da0c1e4-fc14-44ee-aa28-fe5baa51683f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:08.167679 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5f819b61-0526-4267-987f-e85696523254 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bede9e5d50f1451dabab5e15963e0492'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:08.177638 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5f819b61-0526-4267-987f-e85696523254 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bede9e5d50f1451dabab5e15963e0492'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:08.177638 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5f819b61-0526-4267-987f-e85696523254 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bede9e5d50f1451dabab5e15963e0492'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:08.185160 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1068/2143] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:11:07 2022] DELETE /identity/v3/users/bede9e5d50f1451dabab5e15963e0492 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:11:08.186145 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f819b61-0526-4267-987f-e85696523254 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:08.187662 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5f819b61-0526-4267-987f-e85696523254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:08.277345 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f819b61-0526-4267-987f-e85696523254 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:08.283399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dbe3e2-4417-484f-8897-4711892d5921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:08.284539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbe3e2-4417-484f-8897-4711892d5921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:08.284674 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1076/2144] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:11:08 2022] POST /identity/v3/projects => generated 397 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:11:08.284767 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbe3e2-4417-484f-8897-4711892d5921 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:08.284935 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbe3e2-4417-484f-8897-4711892d5921 admin admin] PATH_INFO: `/v3/users/3478c1ac1faf4179958ac373ffafbf4b` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:08.286552 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dbe3e2-4417-484f-8897-4711892d5921 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3478c1ac1faf4179958ac373ffafbf4b)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:08.288575 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0c1e4-fc14-44ee-aa28-fe5baa51683f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:08.288714 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dbe3e2-4417-484f-8897-4711892d5921 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:08.305189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6da0c1e4-fc14-44ee-aa28-fe5baa51683f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:08.446442 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0c1e4-fc14-44ee-aa28-fe5baa51683f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:08.470563 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7098554-535d-4422-b7ff-37f85cde73cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:08.471333 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7098554-535d-4422-b7ff-37f85cde73cb admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:08.473075 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7098554-535d-4422-b7ff-37f85cde73cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:08.473482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7098554-535d-4422-b7ff-37f85cde73cb admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:08.475637 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7098554-535d-4422-b7ff-37f85cde73cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:08.487895 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7098554-535d-4422-b7ff-37f85cde73cb admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:08.528128 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e7dbe3e2-4417-484f-8897-4711892d5921 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3478c1ac1faf4179958ac373ffafbf4b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:08.546230 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e7dbe3e2-4417-484f-8897-4711892d5921 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3478c1ac1faf4179958ac373ffafbf4b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:08.628638 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1077/2145] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:11:08 2022] POST /identity/v3/users => generated 299 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:11:08.628638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7098554-535d-4422-b7ff-37f85cde73cb admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:08.630666 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e7098554-535d-4422-b7ff-37f85cde73cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:08.648299 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e7dbe3e2-4417-484f-8897-4711892d5921 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3478c1ac1faf4179958ac373ffafbf4b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:08.657174 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e7dbe3e2-4417-484f-8897-4711892d5921 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3478c1ac1faf4179958ac373ffafbf4b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:08.658127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e7dbe3e2-4417-484f-8897-4711892d5921 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3478c1ac1faf4179958ac373ffafbf4b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:08.664388 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1069/2146] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:11:08 2022] DELETE /identity/v3/users/3478c1ac1faf4179958ac373ffafbf4b => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:08.665470 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dbe3e2-4417-484f-8897-4711892d5921 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:08.668882 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e7dbe3e2-4417-484f-8897-4711892d5921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:08.722675 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7098554-535d-4422-b7ff-37f85cde73cb admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:08.748083 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dbe3e2-4417-484f-8897-4711892d5921 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:08.753213 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee647c82-7e94-4f09-95a0-ee64b71c490c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:08.754175 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee647c82-7e94-4f09-95a0-ee64b71c490c admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:08.754511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee647c82-7e94-4f09-95a0-ee64b71c490c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:08.754833 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee647c82-7e94-4f09-95a0-ee64b71c490c admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:08.755573 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee647c82-7e94-4f09-95a0-ee64b71c490c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:08.757190 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee647c82-7e94-4f09-95a0-ee64b71c490c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:08.770985 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1070/2147] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:11:08.770985 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee647c82-7e94-4f09-95a0-ee64b71c490c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:08.770985 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ee647c82-7e94-4f09-95a0-ee64b71c490c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:08.783895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee647c82-7e94-4f09-95a0-ee64b71c490c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:08.790039 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc0233-126d-44fb-bbf3-207ca3c490da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:08.791008 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc0233-126d-44fb-bbf3-207ca3c490da admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:08.791358 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc0233-126d-44fb-bbf3-207ca3c490da admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:08.791710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edc0233-126d-44fb-bbf3-207ca3c490da admin admin] PATH_INFO: `/v3/projects/6aaea47ee855426a962e821881dc45e5` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:08.792979 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc0233-126d-44fb-bbf3-207ca3c490da admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aaea47ee855426a962e821881dc45e5)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:08.795556 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edc0233-126d-44fb-bbf3-207ca3c490da admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:08.801583 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba5fa9-c70b-4c3e-845f-53ba5d88e009 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:08.805858 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba5fa9-c70b-4c3e-845f-53ba5d88e009 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:08.806150 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba5fa9-c70b-4c3e-845f-53ba5d88e009 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:08.806794 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba5fa9-c70b-4c3e-845f-53ba5d88e009 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:08.813576 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0dba5fa9-c70b-4c3e-845f-53ba5d88e009 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:08.891685 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba5fa9-c70b-4c3e-845f-53ba5d88e009 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:08.893366 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba5fa9-c70b-4c3e-845f-53ba5d88e009 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:08.903301 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1078/2148] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:11:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:11:08.904702 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d08df-0779-4cd4-a7cb-32ec360c073e None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:08.905190 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d08df-0779-4cd4-a7cb-32ec360c073e None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:08.905471 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d08df-0779-4cd4-a7cb-32ec360c073e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:08.938559 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-655d08df-0779-4cd4-a7cb-32ec360c073e None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:08.940078 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-655d08df-0779-4cd4-a7cb-32ec360c073e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:08.953642 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4edc0233-126d-44fb-bbf3-207ca3c490da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aaea47ee855426a962e821881dc45e5', 'request_id': 'req-4edc0233-126d-44fb-bbf3-207ca3c490da'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:08.961564 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4edc0233-126d-44fb-bbf3-207ca3c490da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aaea47ee855426a962e821881dc45e5', 'request_id': 'req-4edc0233-126d-44fb-bbf3-207ca3c490da'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:08.968406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4edc0233-126d-44fb-bbf3-207ca3c490da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aaea47ee855426a962e821881dc45e5', 'request_id': 'req-4edc0233-126d-44fb-bbf3-207ca3c490da'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:09.014005 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1079/2149] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:09.016234 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d08df-0779-4cd4-a7cb-32ec360c073e None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:09.024787 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d08df-0779-4cd4-a7cb-32ec360c073e None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:09.029552 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca55caf-9a1f-41fb-b913-7b99c87d0f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:09.030308 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca55caf-9a1f-41fb-b913-7b99c87d0f72 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:09.030662 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca55caf-9a1f-41fb-b913-7b99c87d0f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:09.031018 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca55caf-9a1f-41fb-b913-7b99c87d0f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:09.031941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca55caf-9a1f-41fb-b913-7b99c87d0f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:09.033682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca55caf-9a1f-41fb-b913-7b99c87d0f72 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:09.043727 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1080/2150] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:11:09.045360 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca55caf-9a1f-41fb-b913-7b99c87d0f72 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:09.047601 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-fca55caf-9a1f-41fb-b913-7b99c87d0f72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:09.058325 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4edc0233-126d-44fb-bbf3-207ca3c490da admin admin] The token cache is being invalidate because project 6aaea47ee855426a962e821881dc45e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:11:09.058616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4edc0233-126d-44fb-bbf3-207ca3c490da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:09.059528 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4edc0233-126d-44fb-bbf3-207ca3c490da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:09.061959 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1071/2151] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:11:08 2022] DELETE /identity/v3/projects/6aaea47ee855426a962e821881dc45e5 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:09.068895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc0233-126d-44fb-bbf3-207ca3c490da admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:09.068895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4edc0233-126d-44fb-bbf3-207ca3c490da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:09.077290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edc0233-126d-44fb-bbf3-207ca3c490da admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:09.082411 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c66761-1ec0-49fc-9dae-823c7346d7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:09.083311 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c66761-1ec0-49fc-9dae-823c7346d7d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:09.083614 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c66761-1ec0-49fc-9dae-823c7346d7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:09.083891 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c66761-1ec0-49fc-9dae-823c7346d7d7 admin admin] PATH_INFO: `/v3/projects/77b426139c194813974502d1910c257f/users/dadac4f61fe141dba3ee726ca6cbf29a/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:09.101891 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c66761-1ec0-49fc-9dae-823c7346d7d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77b426139c194813974502d1910c257f, user_id=dadac4f61fe141dba3ee726ca6cbf29a, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:09.104503 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c66761-1ec0-49fc-9dae-823c7346d7d7 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:09.126679 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca55caf-9a1f-41fb-b913-7b99c87d0f72 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:09.130728 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a357a77-0e1a-4fda-9b60-7d85efaba972 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:09.131243 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a357a77-0e1a-4fda-9b60-7d85efaba972 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:09.131506 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a357a77-0e1a-4fda-9b60-7d85efaba972 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:09.131787 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a357a77-0e1a-4fda-9b60-7d85efaba972 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:09.133823 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7a357a77-0e1a-4fda-9b60-7d85efaba972 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:09.146658 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a357a77-0e1a-4fda-9b60-7d85efaba972 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:09.148135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a357a77-0e1a-4fda-9b60-7d85efaba972 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:09.158907 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1081/2152] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:11:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:11:09.160173 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1907ead-1ce3-4b7b-9929-96067d363b83 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:09.160528 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1907ead-1ce3-4b7b-9929-96067d363b83 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:09.160860 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1907ead-1ce3-4b7b-9929-96067d363b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:09.181651 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1072/2153] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:11:09 2022] PUT /identity/v3/projects/77b426139c194813974502d1910c257f/users/dadac4f61fe141dba3ee726ca6cbf29a/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:09.187149 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa58b88-fdab-4e1c-8272-400dba30ffcc None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:09.187435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa58b88-fdab-4e1c-8272-400dba30ffcc None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:09.187715 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa58b88-fdab-4e1c-8272-400dba30ffcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:09.192669 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-d1907ead-1ce3-4b7b-9929-96067d363b83 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:09.199698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d1907ead-1ce3-4b7b-9929-96067d363b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:09.223191 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-caa58b88-fdab-4e1c-8272-400dba30ffcc None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:09.229938 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-caa58b88-fdab-4e1c-8272-400dba30ffcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:09.348886 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1082/2154] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:09.354638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a2398-0855-438d-aaec-15e5f085c610 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:09.354943 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a2398-0855-438d-aaec-15e5f085c610 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:09.355198 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a2398-0855-438d-aaec-15e5f085c610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:09.369399 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1073/2155] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:11:09.385584 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa58b88-fdab-4e1c-8272-400dba30ffcc None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:09.387179 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-caa58b88-fdab-4e1c-8272-400dba30ffcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:09.393574 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-571a2398-0855-438d-aaec-15e5f085c610 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:09.393574 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-571a2398-0855-438d-aaec-15e5f085c610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:09.414174 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1083/2156] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:09.415676 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a2398-0855-438d-aaec-15e5f085c610 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:09.432891 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a2398-0855-438d-aaec-15e5f085c610 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:09.438751 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d28dc-a15c-4780-b045-84293669f7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:09.439706 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d28dc-a15c-4780-b045-84293669f7bb admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:09.440049 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d28dc-a15c-4780-b045-84293669f7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:09.440386 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d28dc-a15c-4780-b045-84293669f7bb admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:09.441668 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d28dc-a15c-4780-b045-84293669f7bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:11:09.441946 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d28dc-a15c-4780-b045-84293669f7bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:09.443848 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d28dc-a15c-4780-b045-84293669f7bb admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:09.461918 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1084/2157] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:11:09.463923 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d28dc-a15c-4780-b045-84293669f7bb admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:09.476121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d28dc-a15c-4780-b045-84293669f7bb admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:09.478831 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa58b88-fdab-4e1c-8272-400dba30ffcc None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:09.486109 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d5694-0163-4133-bfa4-e39730247376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:09.488344 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d5694-0163-4133-bfa4-e39730247376 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:09.488826 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d5694-0163-4133-bfa4-e39730247376 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:09.489293 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d5694-0163-4133-bfa4-e39730247376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:09.496258 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94441b-dd4e-485c-8c2e-5f79d00b03f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:09.496998 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94441b-dd4e-485c-8c2e-5f79d00b03f2 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:09.497969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94441b-dd4e-485c-8c2e-5f79d00b03f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:09.498271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94441b-dd4e-485c-8c2e-5f79d00b03f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:09.500138 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e94441b-dd4e-485c-8c2e-5f79d00b03f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:09.512247 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e94441b-dd4e-485c-8c2e-5f79d00b03f2 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:09.521357 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d5694-0163-4133-bfa4-e39730247376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:09.524359 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d5694-0163-4133-bfa4-e39730247376 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:09.553660 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1074/2158] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:11:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:11:09.642075 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d5694-0163-4133-bfa4-e39730247376 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:09.643392 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1085/2159] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:11:09 2022] POST /identity/v3/projects => generated 381 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:11:09.682579 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d5694-0163-4133-bfa4-e39730247376 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:09.793196 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22724cd9-55c0-4332-ad49-f630fb6fc7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:09.793885 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22724cd9-55c0-4332-ad49-f630fb6fc7d1 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:09.794748 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22724cd9-55c0-4332-ad49-f630fb6fc7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:09.795030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22724cd9-55c0-4332-ad49-f630fb6fc7d1 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:09.795806 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22724cd9-55c0-4332-ad49-f630fb6fc7d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:09.797853 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22724cd9-55c0-4332-ad49-f630fb6fc7d1 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:09.887034 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1075/2160] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:11:09 2022] POST /identity/v3/users => generated 291 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:11:09.887169 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94441b-dd4e-485c-8c2e-5f79d00b03f2 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:09.889516 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0e94441b-dd4e-485c-8c2e-5f79d00b03f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:09.891893 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22724cd9-55c0-4332-ad49-f630fb6fc7d1 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:09.906960 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94441b-dd4e-485c-8c2e-5f79d00b03f2 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:09.923136 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22724cd9-55c0-4332-ad49-f630fb6fc7d1 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:09.937895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4e266-bcdf-420a-a119-a4ad07271741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:09.937895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4e266-bcdf-420a-a119-a4ad07271741 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:09.937895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4e266-bcdf-420a-a119-a4ad07271741 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:09.937895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4e266-bcdf-420a-a119-a4ad07271741 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:09.938518 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619bf2e-4345-4d3c-b678-9d5bf70e8246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:09.938619 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e4e266-bcdf-420a-a119-a4ad07271741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:09.939305 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619bf2e-4345-4d3c-b678-9d5bf70e8246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:09.939684 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619bf2e-4345-4d3c-b678-9d5bf70e8246 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:09.940455 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619bf2e-4345-4d3c-b678-9d5bf70e8246 admin admin] PATH_INFO: `/v3/projects/1116d3f443d04b31b6f74174f0427f7d` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:09.944046 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8619bf2e-4345-4d3c-b678-9d5bf70e8246 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1116d3f443d04b31b6f74174f0427f7d)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:09.946173 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8619bf2e-4345-4d3c-b678-9d5bf70e8246 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:09.946629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e4e266-bcdf-420a-a119-a4ad07271741 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:09.975892 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1076/2161] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:11:09.979049 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4e266-bcdf-420a-a119-a4ad07271741 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:10.006345 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4e266-bcdf-420a-a119-a4ad07271741 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:10.012617 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259123a-b881-4da7-82c0-175cde3771aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:10.013513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259123a-b881-4da7-82c0-175cde3771aa admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:10.013824 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259123a-b881-4da7-82c0-175cde3771aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:10.014103 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259123a-b881-4da7-82c0-175cde3771aa admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:10.014995 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8259123a-b881-4da7-82c0-175cde3771aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:10.016971 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8259123a-b881-4da7-82c0-175cde3771aa admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:10.034883 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1077/2162] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:11:10.036458 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259123a-b881-4da7-82c0-175cde3771aa admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:10.048253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259123a-b881-4da7-82c0-175cde3771aa admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:10.053827 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b86178-d8ec-43f0-8107-425148dea2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:10.055290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b86178-d8ec-43f0-8107-425148dea2ab admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:10.057617 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b86178-d8ec-43f0-8107-425148dea2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:10.057617 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b86178-d8ec-43f0-8107-425148dea2ab admin admin] PATH_INFO: `/v3/projects/f08c310d04854165acadb035e9f91cdb/users/251d21fb0ae64d4d8b5e7985fe92cdcb/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:10.072559 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b86178-d8ec-43f0-8107-425148dea2ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=f08c310d04854165acadb035e9f91cdb, user_id=251d21fb0ae64d4d8b5e7985fe92cdcb, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:10.075360 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b86178-d8ec-43f0-8107-425148dea2ab admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:10.199252 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1078/2163] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:11:10 2022] PUT /identity/v3/projects/f08c310d04854165acadb035e9f91cdb/users/251d21fb0ae64d4d8b5e7985fe92cdcb/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:11:10.207094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8619bf2e-4345-4d3c-b678-9d5bf70e8246 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1116d3f443d04b31b6f74174f0427f7d', 'request_id': 'req-8619bf2e-4345-4d3c-b678-9d5bf70e8246'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:10.209811 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6b12c-9b13-4b8f-bb6a-41ab16e04688 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:10.210064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6b12c-9b13-4b8f-bb6a-41ab16e04688 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:10.210342 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6b12c-9b13-4b8f-bb6a-41ab16e04688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:10.214521 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8619bf2e-4345-4d3c-b678-9d5bf70e8246 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1116d3f443d04b31b6f74174f0427f7d', 'request_id': 'req-8619bf2e-4345-4d3c-b678-9d5bf70e8246'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:10.233643 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8619bf2e-4345-4d3c-b678-9d5bf70e8246 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1116d3f443d04b31b6f74174f0427f7d', 'request_id': 'req-8619bf2e-4345-4d3c-b678-9d5bf70e8246'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:10.238612 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-3fb6b12c-9b13-4b8f-bb6a-41ab16e04688 None None] MFA Rules not processed for user `251d21fb0ae64d4d8b5e7985fe92cdcb`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:10.239873 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3fb6b12c-9b13-4b8f-bb6a-41ab16e04688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:10.300271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8619bf2e-4345-4d3c-b678-9d5bf70e8246 admin admin] The token cache is being invalidate because project 1116d3f443d04b31b6f74174f0427f7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:11:10.300490 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8619bf2e-4345-4d3c-b678-9d5bf70e8246 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:10.301299 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8619bf2e-4345-4d3c-b678-9d5bf70e8246 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:10.303020 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1086/2164] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:11:09 2022] DELETE /identity/v3/projects/1116d3f443d04b31b6f74174f0427f7d => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:10.306830 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619bf2e-4345-4d3c-b678-9d5bf70e8246 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:10.308221 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8619bf2e-4345-4d3c-b678-9d5bf70e8246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:10.310779 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1079/2165] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:11:10.322406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6b12c-9b13-4b8f-bb6a-41ab16e04688 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:10.389670 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619bf2e-4345-4d3c-b678-9d5bf70e8246 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:10.398562 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c99e99-a510-4737-a1ca-866c3bb10b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:10.398758 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6b12c-9b13-4b8f-bb6a-41ab16e04688 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:10.399744 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c99e99-a510-4737-a1ca-866c3bb10b52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:10.400183 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c99e99-a510-4737-a1ca-866c3bb10b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:10.400349 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c99e99-a510-4737-a1ca-866c3bb10b52 admin admin] PATH_INFO: `/v3/users/86aeab8b9f69467691c59f25dc3a1e20` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:10.401608 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c99e99-a510-4737-a1ca-866c3bb10b52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86aeab8b9f69467691c59f25dc3a1e20)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:10.402534 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b180f8f-4a23-47a0-b0e0-570e8a4fb388 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:10.403183 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b180f8f-4a23-47a0-b0e0-570e8a4fb388 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:10.404043 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b180f8f-4a23-47a0-b0e0-570e8a4fb388 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:10.404336 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b180f8f-4a23-47a0-b0e0-570e8a4fb388 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:10.405189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c99e99-a510-4737-a1ca-866c3bb10b52 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:10.407657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6b180f8f-4a23-47a0-b0e0-570e8a4fb388 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:10.423199 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b180f8f-4a23-47a0-b0e0-570e8a4fb388 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:10.424662 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b180f8f-4a23-47a0-b0e0-570e8a4fb388 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:10.435456 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1080/2166] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:11:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:11:10.611131 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c2c99e99-a510-4737-a1ca-866c3bb10b52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86aeab8b9f69467691c59f25dc3a1e20'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:10.634258 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c2c99e99-a510-4737-a1ca-866c3bb10b52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86aeab8b9f69467691c59f25dc3a1e20'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:10.716758 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c2c99e99-a510-4737-a1ca-866c3bb10b52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86aeab8b9f69467691c59f25dc3a1e20'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:10.717477 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c2c99e99-a510-4737-a1ca-866c3bb10b52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86aeab8b9f69467691c59f25dc3a1e20'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:10.726335 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c2c99e99-a510-4737-a1ca-866c3bb10b52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86aeab8b9f69467691c59f25dc3a1e20'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:10.735889 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1087/2167] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:11:10 2022] DELETE /identity/v3/users/86aeab8b9f69467691c59f25dc3a1e20 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:11:10.776472 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6541c-6309-46a8-86fc-f171280c2fe6 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:10.776897 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6541c-6309-46a8-86fc-f171280c2fe6 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:10.776994 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6541c-6309-46a8-86fc-f171280c2fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:10.788749 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c99e99-a510-4737-a1ca-866c3bb10b52 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:10.790484 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c2c99e99-a510-4737-a1ca-866c3bb10b52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:10.800319 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-63e6541c-6309-46a8-86fc-f171280c2fe6 None None] MFA Rules not processed for user `eda37dd9b3304fa9a9734f12ffaea8e7`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:10.801665 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-63e6541c-6309-46a8-86fc-f171280c2fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:10.901806 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1081/2168] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:10.901806 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6541c-6309-46a8-86fc-f171280c2fe6 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:10.902919 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-63e6541c-6309-46a8-86fc-f171280c2fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:10.928079 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c99e99-a510-4737-a1ca-866c3bb10b52 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:10.934110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd9db9-95de-49ee-b534-c4f44cefcdb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:10.935293 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd9db9-95de-49ee-b534-c4f44cefcdb9 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:10.935579 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd9db9-95de-49ee-b534-c4f44cefcdb9 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:10.935855 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd9db9-95de-49ee-b534-c4f44cefcdb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:10.938026 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0acd9db9-95de-49ee-b534-c4f44cefcdb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:10.980073 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6541c-6309-46a8-86fc-f171280c2fe6 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:10.986236 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18099584-3506-490a-b678-f17c198fd590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:10.987119 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18099584-3506-490a-b678-f17c198fd590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:10.987399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18099584-3506-490a-b678-f17c198fd590 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:10.987675 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18099584-3506-490a-b678-f17c198fd590 admin admin] PATH_INFO: `/v3/users/251d21fb0ae64d4d8b5e7985fe92cdcb` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:10.989546 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18099584-3506-490a-b678-f17c198fd590 admin admin] RBAC: Authorizing `identity:delete_user(user_id=251d21fb0ae64d4d8b5e7985fe92cdcb)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:10.991615 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18099584-3506-490a-b678-f17c198fd590 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:11.018960 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd9db9-95de-49ee-b534-c4f44cefcdb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:11.022132 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd9db9-95de-49ee-b534-c4f44cefcdb9 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:11.057899 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1088/2169] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:11:10 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:11:11.198955 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-18099584-3506-490a-b678-f17c198fd590 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '251d21fb0ae64d4d8b5e7985fe92cdcb'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:11.214673 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-18099584-3506-490a-b678-f17c198fd590 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '251d21fb0ae64d4d8b5e7985fe92cdcb'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:11.305927 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-18099584-3506-490a-b678-f17c198fd590 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '251d21fb0ae64d4d8b5e7985fe92cdcb'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:11.314125 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-18099584-3506-490a-b678-f17c198fd590 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '251d21fb0ae64d4d8b5e7985fe92cdcb'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:11.314874 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-18099584-3506-490a-b678-f17c198fd590 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '251d21fb0ae64d4d8b5e7985fe92cdcb'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:11.321296 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1082/2170] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:11:10 2022] DELETE /identity/v3/users/251d21fb0ae64d4d8b5e7985fe92cdcb => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:11.326717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d126aca-2f8d-4f76-aa09-d397df0f67c7 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:11.328569 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d126aca-2f8d-4f76-aa09-d397df0f67c7 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:11.328858 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d126aca-2f8d-4f76-aa09-d397df0f67c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:11.348145 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14bdbc-9312-4c3c-8011-7b74aac2ef21 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:11.348445 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14bdbc-9312-4c3c-8011-7b74aac2ef21 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:11.348656 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14bdbc-9312-4c3c-8011-7b74aac2ef21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:11.352506 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-1d126aca-2f8d-4f76-aa09-d397df0f67c7 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:11.354286 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1d126aca-2f8d-4f76-aa09-d397df0f67c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:11.398377 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-0c14bdbc-9312-4c3c-8011-7b74aac2ef21 None None] MFA Rules not processed for user `dadac4f61fe141dba3ee726ca6cbf29a`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:11.399955 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0c14bdbc-9312-4c3c-8011-7b74aac2ef21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:11.482658 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1089/2171] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:11:11.482658 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d126aca-2f8d-4f76-aa09-d397df0f67c7 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:11.502373 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1d126aca-2f8d-4f76-aa09-d397df0f67c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:11.510849 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1083/2172] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:11:11.511739 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14bdbc-9312-4c3c-8011-7b74aac2ef21 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:11.513803 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0c14bdbc-9312-4c3c-8011-7b74aac2ef21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:11.522254 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d126aca-2f8d-4f76-aa09-d397df0f67c7 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:11.527983 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d3388-5bf8-4bfb-b575-403c364266f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:11.528792 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d3388-5bf8-4bfb-b575-403c364266f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:11.529078 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d3388-5bf8-4bfb-b575-403c364266f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:11.529354 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d3388-5bf8-4bfb-b575-403c364266f7 admin admin] PATH_INFO: `/v3/projects/120d96f6b83045a4a12a55de11a098f7` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:11.530754 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d3388-5bf8-4bfb-b575-403c364266f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=120d96f6b83045a4a12a55de11a098f7)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:11.532705 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d3388-5bf8-4bfb-b575-403c364266f7 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:11.584412 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14bdbc-9312-4c3c-8011-7b74aac2ef21 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:11.588349 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfcb1b-2ee7-4c20-9676-760e12662e83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:11.588999 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfcb1b-2ee7-4c20-9676-760e12662e83 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:11.589282 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfcb1b-2ee7-4c20-9676-760e12662e83 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:11.589561 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfcb1b-2ee7-4c20-9676-760e12662e83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:11.599768 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bfcb1b-2ee7-4c20-9676-760e12662e83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:11.601159 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bfcb1b-2ee7-4c20-9676-760e12662e83 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:11.612065 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1084/2173] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:11:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:11:11.612897 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfcb1b-2ee7-4c20-9676-760e12662e83 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:11.616183 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e3bfcb1b-2ee7-4c20-9676-760e12662e83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:11.628050 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfcb1b-2ee7-4c20-9676-760e12662e83 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:11.633364 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31eb00-af70-4882-a944-ce7868e4cc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:11.634065 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31eb00-af70-4882-a944-ce7868e4cc5d admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:11.634347 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31eb00-af70-4882-a944-ce7868e4cc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:11.634622 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31eb00-af70-4882-a944-ce7868e4cc5d admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:11.635317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31eb00-af70-4882-a944-ce7868e4cc5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:11.637448 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31eb00-af70-4882-a944-ce7868e4cc5d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:11.661852 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1e7d3388-5bf8-4bfb-b575-403c364266f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '120d96f6b83045a4a12a55de11a098f7', 'request_id': 'req-1e7d3388-5bf8-4bfb-b575-403c364266f7'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:11.672213 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1e7d3388-5bf8-4bfb-b575-403c364266f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '120d96f6b83045a4a12a55de11a098f7', 'request_id': 'req-1e7d3388-5bf8-4bfb-b575-403c364266f7'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:11.690132 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1e7d3388-5bf8-4bfb-b575-403c364266f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '120d96f6b83045a4a12a55de11a098f7', 'request_id': 'req-1e7d3388-5bf8-4bfb-b575-403c364266f7'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:11.748671 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1085/2174] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:11:11 2022] POST /identity/v3/projects => generated 395 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:11:11.753124 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31eb00-af70-4882-a944-ce7868e4cc5d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:11.768577 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1e7d3388-5bf8-4bfb-b575-403c364266f7 admin admin] The token cache is being invalidate because project 120d96f6b83045a4a12a55de11a098f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:11:11.769176 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1e7d3388-5bf8-4bfb-b575-403c364266f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:11.775904 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1e7d3388-5bf8-4bfb-b575-403c364266f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:11.776172 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1090/2175] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:11:11 2022] DELETE /identity/v3/projects/120d96f6b83045a4a12a55de11a098f7 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:11.783771 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7842d-33e8-4428-82d1-76804875ffdc None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:11.784303 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7842d-33e8-4428-82d1-76804875ffdc None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:11.784670 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7842d-33e8-4428-82d1-76804875ffdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:11.840229 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-bcb7842d-33e8-4428-82d1-76804875ffdc None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:11.843434 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-bcb7842d-33e8-4428-82d1-76804875ffdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:11.936154 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31eb00-af70-4882-a944-ce7868e4cc5d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:11.942153 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d82f68-f941-4486-8d36-da90ac542c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:11.943047 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d82f68-f941-4486-8d36-da90ac542c8e admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:11.943819 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d82f68-f941-4486-8d36-da90ac542c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:11.944529 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d82f68-f941-4486-8d36-da90ac542c8e admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:11.946350 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d82f68-f941-4486-8d36-da90ac542c8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:11.951453 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d82f68-f941-4486-8d36-da90ac542c8e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:11.958714 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1091/2176] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:11.968068 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169f9e5-9809-4529-b4c2-b6eb7d68f782 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:11.968364 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169f9e5-9809-4529-b4c2-b6eb7d68f782 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:11.968824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169f9e5-9809-4529-b4c2-b6eb7d68f782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:11.992540 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-c169f9e5-9809-4529-b4c2-b6eb7d68f782 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:11.994306 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c169f9e5-9809-4529-b4c2-b6eb7d68f782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:12.006722 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1092/2177] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:11:12.009911 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169f9e5-9809-4529-b4c2-b6eb7d68f782 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:12.023220 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169f9e5-9809-4529-b4c2-b6eb7d68f782 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:12.030286 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5fea30-dca3-4153-a4fa-b142d5dea38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:12.031153 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5fea30-dca3-4153-a4fa-b142d5dea38d admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:12.031508 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5fea30-dca3-4153-a4fa-b142d5dea38d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:12.032492 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5fea30-dca3-4153-a4fa-b142d5dea38d admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:12.034735 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5fea30-dca3-4153-a4fa-b142d5dea38d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:11:12.035117 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5fea30-dca3-4153-a4fa-b142d5dea38d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:12.037946 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5fea30-dca3-4153-a4fa-b142d5dea38d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:12.057803 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1093/2178] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:11:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:11:12.061896 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5fea30-dca3-4153-a4fa-b142d5dea38d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:12.113918 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1086/2179] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:11:11 2022] POST /identity/v3/users => generated 304 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:11:12.119796 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d82f68-f941-4486-8d36-da90ac542c8e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:12.127492 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-67d82f68-f941-4486-8d36-da90ac542c8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:12.132739 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5fea30-dca3-4153-a4fa-b142d5dea38d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:12.152075 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1fb966-e918-48eb-a06e-6299a42be68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:12.152761 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1fb966-e918-48eb-a06e-6299a42be68c admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:12.154242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1fb966-e918-48eb-a06e-6299a42be68c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:12.154594 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1fb966-e918-48eb-a06e-6299a42be68c admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:12.155267 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1fb966-e918-48eb-a06e-6299a42be68c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:12.158655 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1fb966-e918-48eb-a06e-6299a42be68c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:12.166093 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d82f68-f941-4486-8d36-da90ac542c8e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:12.182720 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86904380-2405-414b-bd79-dbe118d14756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:12.183416 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86904380-2405-414b-bd79-dbe118d14756 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:12.183692 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86904380-2405-414b-bd79-dbe118d14756 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:12.184436 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86904380-2405-414b-bd79-dbe118d14756 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:12.185719 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86904380-2405-414b-bd79-dbe118d14756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:12.190294 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86904380-2405-414b-bd79-dbe118d14756 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:12.218147 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1087/2180] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:11:12.224161 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86904380-2405-414b-bd79-dbe118d14756 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:12.248965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86904380-2405-414b-bd79-dbe118d14756 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:12.269602 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1094/2181] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:11:12 2022] POST /identity/v3/projects => generated 383 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:11:12.284116 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1fb966-e918-48eb-a06e-6299a42be68c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:12.290862 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95347c-6812-4a96-943e-a5758030fa8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:12.293541 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95347c-6812-4a96-943e-a5758030fa8e admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:12.296734 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95347c-6812-4a96-943e-a5758030fa8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:12.296734 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95347c-6812-4a96-943e-a5758030fa8e admin admin] PATH_INFO: `/v3/projects/1d2ee2a196af4bf7874f40a1c1a22a7a/users/f959a8c0b64c4f6cb172a496b8c91f57/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:12.331687 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f95347c-6812-4a96-943e-a5758030fa8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d2ee2a196af4bf7874f40a1c1a22a7a, user_id=f959a8c0b64c4f6cb172a496b8c91f57, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:12.335365 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f95347c-6812-4a96-943e-a5758030fa8e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:12.415473 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1fb966-e918-48eb-a06e-6299a42be68c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:12.422770 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1088/2182] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:11:12 2022] PUT /identity/v3/projects/1d2ee2a196af4bf7874f40a1c1a22a7a/users/f959a8c0b64c4f6cb172a496b8c91f57/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:12.424838 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95347c-6812-4a96-943e-a5758030fa8e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:12.428346 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5f95347c-6812-4a96-943e-a5758030fa8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:12.494694 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34667817-eb33-4c55-b82c-7e6c3407abe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:12.495481 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34667817-eb33-4c55-b82c-7e6c3407abe1 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:12.495828 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34667817-eb33-4c55-b82c-7e6c3407abe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:12.496333 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34667817-eb33-4c55-b82c-7e6c3407abe1 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:12.497132 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34667817-eb33-4c55-b82c-7e6c3407abe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:12.499231 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34667817-eb33-4c55-b82c-7e6c3407abe1 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:12.507894 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95347c-6812-4a96-943e-a5758030fa8e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:12.513556 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9690ab-1eb2-468e-b6f3-3c2f6d5a5e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:12.514527 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9690ab-1eb2-468e-b6f3-3c2f6d5a5e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:12.514877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9690ab-1eb2-468e-b6f3-3c2f6d5a5e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:12.520294 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9690ab-1eb2-468e-b6f3-3c2f6d5a5e77 admin admin] PATH_INFO: `/v3/projects/f08c310d04854165acadb035e9f91cdb` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:12.520294 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9690ab-1eb2-468e-b6f3-3c2f6d5a5e77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f08c310d04854165acadb035e9f91cdb)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:12.520294 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9690ab-1eb2-468e-b6f3-3c2f6d5a5e77 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:12.623256 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1095/2183] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:11:12 2022] POST /identity/v3/users => generated 292 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:11:12.624300 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34667817-eb33-4c55-b82c-7e6c3407abe1 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:12.634887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5b9690ab-1eb2-468e-b6f3-3c2f6d5a5e77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f08c310d04854165acadb035e9f91cdb', 'request_id': 'req-5b9690ab-1eb2-468e-b6f3-3c2f6d5a5e77'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:12.635983 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34667817-eb33-4c55-b82c-7e6c3407abe1 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:12.640399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5b9690ab-1eb2-468e-b6f3-3c2f6d5a5e77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f08c310d04854165acadb035e9f91cdb', 'request_id': 'req-5b9690ab-1eb2-468e-b6f3-3c2f6d5a5e77'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:12.646525 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5b9690ab-1eb2-468e-b6f3-3c2f6d5a5e77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f08c310d04854165acadb035e9f91cdb', 'request_id': 'req-5b9690ab-1eb2-468e-b6f3-3c2f6d5a5e77'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:12.692172 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e094a7-2d3f-4145-964c-2db7ff26781d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:12.692844 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e094a7-2d3f-4145-964c-2db7ff26781d admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:12.693182 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e094a7-2d3f-4145-964c-2db7ff26781d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:12.694126 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e094a7-2d3f-4145-964c-2db7ff26781d admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:12.695598 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e094a7-2d3f-4145-964c-2db7ff26781d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:12.697301 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e094a7-2d3f-4145-964c-2db7ff26781d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:12.708547 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1096/2184] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:11:12.709427 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e094a7-2d3f-4145-964c-2db7ff26781d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:12.726601 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e094a7-2d3f-4145-964c-2db7ff26781d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:12.736845 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf78287-68f6-4b48-a42f-872a1a537bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:12.736845 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf78287-68f6-4b48-a42f-872a1a537bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:12.736845 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf78287-68f6-4b48-a42f-872a1a537bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:12.736845 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf78287-68f6-4b48-a42f-872a1a537bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:12.737255 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf78287-68f6-4b48-a42f-872a1a537bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:12.737255 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf78287-68f6-4b48-a42f-872a1a537bc5 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:12.745904 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1097/2185] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:11:12.746753 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf78287-68f6-4b48-a42f-872a1a537bc5 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:12.757156 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf78287-68f6-4b48-a42f-872a1a537bc5 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:12.762021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5b9690ab-1eb2-468e-b6f3-3c2f6d5a5e77 admin admin] The token cache is being invalidate because project f08c310d04854165acadb035e9f91cdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:11:12.762149 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce0780-54b1-47c2-84e1-a42911428324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:12.771173 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5b9690ab-1eb2-468e-b6f3-3c2f6d5a5e77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:12.771309 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce0780-54b1-47c2-84e1-a42911428324 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:12.771405 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5b9690ab-1eb2-468e-b6f3-3c2f6d5a5e77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:12.771492 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce0780-54b1-47c2-84e1-a42911428324 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:12.771492 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce0780-54b1-47c2-84e1-a42911428324 admin admin] PATH_INFO: `/v3/projects/1d2ee2a196af4bf7874f40a1c1a22a7a/users/f959a8c0b64c4f6cb172a496b8c91f57/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:12.771658 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1089/2186] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:11:12 2022] DELETE /identity/v3/projects/f08c310d04854165acadb035e9f91cdb => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:12.771658 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9690ab-1eb2-468e-b6f3-3c2f6d5a5e77 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:12.771658 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5b9690ab-1eb2-468e-b6f3-3c2f6d5a5e77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:12.771876 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce0780-54b1-47c2-84e1-a42911428324 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d2ee2a196af4bf7874f40a1c1a22a7a, user_id=f959a8c0b64c4f6cb172a496b8c91f57, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:12.771876 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce0780-54b1-47c2-84e1-a42911428324 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:12.787950 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1098/2187] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:11:12 2022] PUT /identity/v3/projects/1d2ee2a196af4bf7874f40a1c1a22a7a/users/f959a8c0b64c4f6cb172a496b8c91f57/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:12.788113 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9690ab-1eb2-468e-b6f3-3c2f6d5a5e77 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:12.788219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64119fe-9565-4d2d-bdd2-ad496991d431 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:12.788219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64119fe-9565-4d2d-bdd2-ad496991d431 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:12.788219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64119fe-9565-4d2d-bdd2-ad496991d431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:12.813629 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-e64119fe-9565-4d2d-bdd2-ad496991d431 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:12.815328 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e64119fe-9565-4d2d-bdd2-ad496991d431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:12.861739 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf507c7d-fdc9-4022-8e4a-e24d6c294da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:12.862543 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf507c7d-fdc9-4022-8e4a-e24d6c294da8 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:12.862892 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf507c7d-fdc9-4022-8e4a-e24d6c294da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:12.863235 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf507c7d-fdc9-4022-8e4a-e24d6c294da8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:12.864019 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf507c7d-fdc9-4022-8e4a-e24d6c294da8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:12.865694 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf507c7d-fdc9-4022-8e4a-e24d6c294da8 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:12.880354 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1090/2188] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:11:12.880932 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf507c7d-fdc9-4022-8e4a-e24d6c294da8 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:12.885567 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1099/2189] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:12.891628 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf507c7d-fdc9-4022-8e4a-e24d6c294da8 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:12.894336 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca503d-8fc2-4d11-92e5-9187fe5f358b None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:12.894961 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca503d-8fc2-4d11-92e5-9187fe5f358b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:12.895538 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca503d-8fc2-4d11-92e5-9187fe5f358b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:12.896827 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecbf7f7-20dc-4358-b8a4-84c0d6fac31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:12.897719 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecbf7f7-20dc-4358-b8a4-84c0d6fac31b admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:12.898030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecbf7f7-20dc-4358-b8a4-84c0d6fac31b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:12.898306 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecbf7f7-20dc-4358-b8a4-84c0d6fac31b admin admin] PATH_INFO: `/v3/projects/469150330fd54b36bbf28289432c350b/users/b60e9b56c5314da18a16cc7ed04d964e/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:12.923756 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecbf7f7-20dc-4358-b8a4-84c0d6fac31b admin admin] RBAC: Authorizing `identity:create_grant(project_id=469150330fd54b36bbf28289432c350b, user_id=b60e9b56c5314da18a16cc7ed04d964e, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:12.923925 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-cfca503d-8fc2-4d11-92e5-9187fe5f358b None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:12.926185 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-cfca503d-8fc2-4d11-92e5-9187fe5f358b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:12.928989 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecbf7f7-20dc-4358-b8a4-84c0d6fac31b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:12.936009 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1100/2190] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:12.940535 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca503d-8fc2-4d11-92e5-9187fe5f358b None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:12.952027 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca503d-8fc2-4d11-92e5-9187fe5f358b None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:12.957088 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba9153-38a5-483e-b4cd-7d26d6f45f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:12.964480 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba9153-38a5-483e-b4cd-7d26d6f45f2c admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:12.964480 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba9153-38a5-483e-b4cd-7d26d6f45f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:12.964480 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba9153-38a5-483e-b4cd-7d26d6f45f2c admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:12.964480 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba9153-38a5-483e-b4cd-7d26d6f45f2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:11:12.964480 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba9153-38a5-483e-b4cd-7d26d6f45f2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:12.964480 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba9153-38a5-483e-b4cd-7d26d6f45f2c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:12.974033 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1101/2191] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:11:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:11:12.978370 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba9153-38a5-483e-b4cd-7d26d6f45f2c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:12.988515 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba9153-38a5-483e-b4cd-7d26d6f45f2c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:12.993372 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77aac2-703a-4a33-b271-547e50ab2b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:12.998543 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77aac2-703a-4a33-b271-547e50ab2b3f admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:12.998543 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77aac2-703a-4a33-b271-547e50ab2b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:12.998543 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77aac2-703a-4a33-b271-547e50ab2b3f admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:12.998543 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e77aac2-703a-4a33-b271-547e50ab2b3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:12.998543 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e77aac2-703a-4a33-b271-547e50ab2b3f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:13.084852 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1091/2192] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:11:12 2022] PUT /identity/v3/projects/469150330fd54b36bbf28289432c350b/users/b60e9b56c5314da18a16cc7ed04d964e/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:13.087197 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828dc783-b36a-422a-97b5-12616a20e136 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:13.087571 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828dc783-b36a-422a-97b5-12616a20e136 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:13.087847 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828dc783-b36a-422a-97b5-12616a20e136 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:13.089836 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1092/2193] 10.222.0.23 () {54 vars in 921 bytes} [Sat Apr 30 21:11:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:11:13.095591 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86dc1a1-74fd-47fd-a20b-7c2258cdaf36 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:13.104156 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86dc1a1-74fd-47fd-a20b-7c2258cdaf36 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:13.104156 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86dc1a1-74fd-47fd-a20b-7c2258cdaf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:13.129320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-e86dc1a1-74fd-47fd-a20b-7c2258cdaf36 None None] MFA Rules not processed for user `b60e9b56c5314da18a16cc7ed04d964e`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:13.130608 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e86dc1a1-74fd-47fd-a20b-7c2258cdaf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:13.179951 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1102/2194] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:11:12 2022] POST /identity/v3/projects => generated 399 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:11:13.181470 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b43d5-04d6-47ee-81c6-7c1a9797b180 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:13.182049 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b43d5-04d6-47ee-81c6-7c1a9797b180 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:13.182049 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b43d5-04d6-47ee-81c6-7c1a9797b180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:13.205456 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-2c7b43d5-04d6-47ee-81c6-7c1a9797b180 None None] MFA Rules not processed for user `4ad3f89b7037413a83c7905cef263b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:13.206769 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2c7b43d5-04d6-47ee-81c6-7c1a9797b180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:13.207640 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1093/2195] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:13.208752 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86dc1a1-74fd-47fd-a20b-7c2258cdaf36 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:13.321856 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1103/2196] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Apr 30 21:11:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:13.322329 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86dc1a1-74fd-47fd-a20b-7c2258cdaf36 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:13.322830 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b43d5-04d6-47ee-81c6-7c1a9797b180 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:13.407185 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee9cca-c924-4370-9a00-1084c4f016f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:13.408146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee9cca-c924-4370-9a00-1084c4f016f1 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:13.408546 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee9cca-c924-4370-9a00-1084c4f016f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:13.410154 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee9cca-c924-4370-9a00-1084c4f016f1 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:13.411390 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee9cca-c924-4370-9a00-1084c4f016f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:13.413930 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee9cca-c924-4370-9a00-1084c4f016f1 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:13.434207 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b43d5-04d6-47ee-81c6-7c1a9797b180 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:13.439412 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc19d1-a95b-4f6e-947d-8839193126a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:13.440105 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc19d1-a95b-4f6e-947d-8839193126a2 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:13.440390 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc19d1-a95b-4f6e-947d-8839193126a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:13.440937 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc19d1-a95b-4f6e-947d-8839193126a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:13.441619 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc19d1-a95b-4f6e-947d-8839193126a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:13.443814 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc19d1-a95b-4f6e-947d-8839193126a2 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:13.516121 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1094/2197] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:11:13 2022] POST /identity/v3/users => generated 300 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:11:13.516121 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee9cca-c924-4370-9a00-1084c4f016f1 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:13.518497 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5aee9cca-c924-4370-9a00-1084c4f016f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:13.542077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee9cca-c924-4370-9a00-1084c4f016f1 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:13.542077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dcda58-68c9-4252-8498-9b2035f96d18 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:13.542077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcda58-68c9-4252-8498-9b2035f96d18 service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:13.542077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcda58-68c9-4252-8498-9b2035f96d18 service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:13.542631 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcda58-68c9-4252-8498-9b2035f96d18 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:13.551770 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dcda58-68c9-4252-8498-9b2035f96d18 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:13.553399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dcda58-68c9-4252-8498-9b2035f96d18 service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:13.566590 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1095/2198] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:11:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:11:13.567435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dcda58-68c9-4252-8498-9b2035f96d18 service placement] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:13.569704 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1104/2199] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:11:13 2022] POST /identity/v3/projects => generated 383 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:11:13.573503 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc19d1-a95b-4f6e-947d-8839193126a2 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:13.581168 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dcda58-68c9-4252-8498-9b2035f96d18 service placement] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:13.656785 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06152e5-29f3-40f0-99cd-2a6d43b99d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:13.657662 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06152e5-29f3-40f0-99cd-2a6d43b99d0f admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:13.658010 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06152e5-29f3-40f0-99cd-2a6d43b99d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:13.658646 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06152e5-29f3-40f0-99cd-2a6d43b99d0f admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:13.659630 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06152e5-29f3-40f0-99cd-2a6d43b99d0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:13.661914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06152e5-29f3-40f0-99cd-2a6d43b99d0f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:13.683666 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1096/2200] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:11:13.687504 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06152e5-29f3-40f0-99cd-2a6d43b99d0f admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:13.700417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06152e5-29f3-40f0-99cd-2a6d43b99d0f admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:13.707692 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc19d1-a95b-4f6e-947d-8839193126a2 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:13.715534 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad6690-e2b6-4df3-ae4b-78357e103a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:13.717015 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1451656-72ed-421a-b686-6eea7a1cbfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:13.718020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1451656-72ed-421a-b686-6eea7a1cbfe0 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:13.718132 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad6690-e2b6-4df3-ae4b-78357e103a93 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:13.718348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad6690-e2b6-4df3-ae4b-78357e103a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:13.718628 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad6690-e2b6-4df3-ae4b-78357e103a93 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:13.720826 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1451656-72ed-421a-b686-6eea7a1cbfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:13.721515 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1451656-72ed-421a-b686-6eea7a1cbfe0 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:13.721712 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ad6690-e2b6-4df3-ae4b-78357e103a93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:13.722927 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1451656-72ed-421a-b686-6eea7a1cbfe0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:13.723482 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ad6690-e2b6-4df3-ae4b-78357e103a93 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:13.725426 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1451656-72ed-421a-b686-6eea7a1cbfe0 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:13.740666 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1097/2201] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:11:13.760447 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad6690-e2b6-4df3-ae4b-78357e103a93 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:13.760447 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad6690-e2b6-4df3-ae4b-78357e103a93 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:13.760447 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f6965-b632-4bd2-90f0-c2f225a7f169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:13.760752 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f6965-b632-4bd2-90f0-c2f225a7f169 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:13.761036 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f6965-b632-4bd2-90f0-c2f225a7f169 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:13.761319 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f6965-b632-4bd2-90f0-c2f225a7f169 admin admin] PATH_INFO: `/v3/projects/7710d2f3153e440ab46c2d89ce24c4cb/users/c816e51510ac44c9a2b3f5c022b5a3c3/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:13.776274 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f6965-b632-4bd2-90f0-c2f225a7f169 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7710d2f3153e440ab46c2d89ce24c4cb, user_id=c816e51510ac44c9a2b3f5c022b5a3c3, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:13.779570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f6965-b632-4bd2-90f0-c2f225a7f169 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:13.895520 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1105/2202] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:11:13 2022] POST /identity/v3/users => generated 298 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:11:13.900647 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1098/2203] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:11:13 2022] PUT /identity/v3/projects/7710d2f3153e440ab46c2d89ce24c4cb/users/c816e51510ac44c9a2b3f5c022b5a3c3/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:11:13.901185 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1451656-72ed-421a-b686-6eea7a1cbfe0 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:13.906854 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fd306-1452-42ed-bde4-c0c9e33d04c4 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:13.907142 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fd306-1452-42ed-bde4-c0c9e33d04c4 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:13.907421 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fd306-1452-42ed-bde4-c0c9e33d04c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:13.926829 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1451656-72ed-421a-b686-6eea7a1cbfe0 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:13.942728 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-232fd306-1452-42ed-bde4-c0c9e33d04c4 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:13.943987 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-232fd306-1452-42ed-bde4-c0c9e33d04c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:14.005732 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026b24b-f675-4444-bd3c-941a23a9c412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:14.006715 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026b24b-f675-4444-bd3c-941a23a9c412 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:14.007191 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026b24b-f675-4444-bd3c-941a23a9c412 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:14.007471 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026b24b-f675-4444-bd3c-941a23a9c412 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:14.008199 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b026b24b-f675-4444-bd3c-941a23a9c412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:14.009832 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b026b24b-f675-4444-bd3c-941a23a9c412 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:14.021841 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1106/2204] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:11:14.024129 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026b24b-f675-4444-bd3c-941a23a9c412 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:14.025559 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1099/2205] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:14.035219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026b24b-f675-4444-bd3c-941a23a9c412 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:14.038067 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232fd306-1452-42ed-bde4-c0c9e33d04c4 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:14.039497 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-232fd306-1452-42ed-bde4-c0c9e33d04c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:14.040909 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd82e265-2415-408e-a1a3-e3e6213221b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:14.041932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82e265-2415-408e-a1a3-e3e6213221b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:14.042296 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82e265-2415-408e-a1a3-e3e6213221b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:14.042655 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82e265-2415-408e-a1a3-e3e6213221b1 admin admin] PATH_INFO: `/v3/projects/91f8cc46e09d41709aebb2e7be527c5c/users/e8c4f13edbfe45e3b6b457ccb4ea8fa6/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:14.064118 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd82e265-2415-408e-a1a3-e3e6213221b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91f8cc46e09d41709aebb2e7be527c5c, user_id=e8c4f13edbfe45e3b6b457ccb4ea8fa6, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:14.074973 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd82e265-2415-408e-a1a3-e3e6213221b1 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:14.131254 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232fd306-1452-42ed-bde4-c0c9e33d04c4 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:14.135278 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1aa647-e8e2-43a4-b02b-9c56aa9a5939 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:14.135930 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1aa647-e8e2-43a4-b02b-9c56aa9a5939 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:14.136211 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1aa647-e8e2-43a4-b02b-9c56aa9a5939 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:14.136485 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1aa647-e8e2-43a4-b02b-9c56aa9a5939 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:14.146542 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1aa647-e8e2-43a4-b02b-9c56aa9a5939 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:14.148014 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1aa647-e8e2-43a4-b02b-9c56aa9a5939 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:14.158229 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1100/2206] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:11:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:11:14.166743 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1aa647-e8e2-43a4-b02b-9c56aa9a5939 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:14.232874 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1107/2207] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:11:14 2022] PUT /identity/v3/projects/91f8cc46e09d41709aebb2e7be527c5c/users/e8c4f13edbfe45e3b6b457ccb4ea8fa6/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:14.238014 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd82e265-2415-408e-a1a3-e3e6213221b1 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:14.276593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1aa647-e8e2-43a4-b02b-9c56aa9a5939 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:14.344262 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd82e265-2415-408e-a1a3-e3e6213221b1 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:14.349165 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6541ab-218b-4611-9165-753f05533595 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:14.349353 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d29d70-6fce-466f-af7b-ae979117d179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:14.349848 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6541ab-218b-4611-9165-753f05533595 service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:14.349999 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d29d70-6fce-466f-af7b-ae979117d179 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:14.350284 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6541ab-218b-4611-9165-753f05533595 service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:14.350423 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d29d70-6fce-466f-af7b-ae979117d179 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:14.350555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d29d70-6fce-466f-af7b-ae979117d179 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:14.350648 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6541ab-218b-4611-9165-753f05533595 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:14.351282 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d29d70-6fce-466f-af7b-ae979117d179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:14.352442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ab6541ab-218b-4611-9165-753f05533595 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:14.352904 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d29d70-6fce-466f-af7b-ae979117d179 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:14.363550 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1108/2208] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:11:14.366652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6541ab-218b-4611-9165-753f05533595 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:14.368058 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d29d70-6fce-466f-af7b-ae979117d179 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:14.368575 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6541ab-218b-4611-9165-753f05533595 service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:14.378215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d29d70-6fce-466f-af7b-ae979117d179 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:14.379221 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1101/2209] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:11:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:11:14.383902 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d82870-ef11-4bd5-93bd-922c69f6713e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:14.384807 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d82870-ef11-4bd5-93bd-922c69f6713e admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:14.385058 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d82870-ef11-4bd5-93bd-922c69f6713e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:14.385333 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d82870-ef11-4bd5-93bd-922c69f6713e admin admin] PATH_INFO: `/v3/projects/91f8cc46e09d41709aebb2e7be527c5c/users/e8c4f13edbfe45e3b6b457ccb4ea8fa6/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:14.387398 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d82870-ef11-4bd5-93bd-922c69f6713e admin admin] RBAC: Authorizing `identity:create_grant(project_id=91f8cc46e09d41709aebb2e7be527c5c, user_id=e8c4f13edbfe45e3b6b457ccb4ea8fa6, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:14.390907 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d82870-ef11-4bd5-93bd-922c69f6713e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:14.402182 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1109/2210] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:11:14 2022] PUT /identity/v3/projects/91f8cc46e09d41709aebb2e7be527c5c/users/e8c4f13edbfe45e3b6b457ccb4ea8fa6/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:11:14.413875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2083f3-85ad-46b2-af9f-e40a8a4b9202 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:14.414180 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2083f3-85ad-46b2-af9f-e40a8a4b9202 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:14.414440 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2083f3-85ad-46b2-af9f-e40a8a4b9202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:14.448794 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-1f2083f3-85ad-46b2-af9f-e40a8a4b9202 None None] MFA Rules not processed for user `e8c4f13edbfe45e3b6b457ccb4ea8fa6`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:14.450041 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1f2083f3-85ad-46b2-af9f-e40a8a4b9202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:14.531843 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1102/2211] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:11:14.659796 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08919812-17f6-4269-ac87-ddf8794a272d None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:14.660088 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08919812-17f6-4269-ac87-ddf8794a272d None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:14.660366 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08919812-17f6-4269-ac87-ddf8794a272d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:14.708119 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-08919812-17f6-4269-ac87-ddf8794a272d None None] MFA Rules not processed for user `f959a8c0b64c4f6cb172a496b8c91f57`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:14.716243 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-08919812-17f6-4269-ac87-ddf8794a272d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:14.871549 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fa40d-5cb9-4234-bb70-9f0e58cd8be2 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:14.871862 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fa40d-5cb9-4234-bb70-9f0e58cd8be2 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:14.872694 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fa40d-5cb9-4234-bb70-9f0e58cd8be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:14.876150 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1110/2212] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:14 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:14.892159 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-eb8fa40d-5cb9-4234-bb70-9f0e58cd8be2 None None] MFA Rules not processed for user `dadac4f61fe141dba3ee726ca6cbf29a`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:14.893614 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-eb8fa40d-5cb9-4234-bb70-9f0e58cd8be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:14.974507 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1103/2213] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:15.168009 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08919812-17f6-4269-ac87-ddf8794a272d None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:15.172159 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-08919812-17f6-4269-ac87-ddf8794a272d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:15.330050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08919812-17f6-4269-ac87-ddf8794a272d None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:15.335705 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c8bcf-badc-4b58-a334-66e6e194d82d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:15.336356 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c8bcf-badc-4b58-a334-66e6e194d82d service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:15.336644 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c8bcf-badc-4b58-a334-66e6e194d82d service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:15.336921 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c8bcf-badc-4b58-a334-66e6e194d82d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:15.346280 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c8bcf-badc-4b58-a334-66e6e194d82d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:15.347938 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c8bcf-badc-4b58-a334-66e6e194d82d service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:15.358983 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1111/2214] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:11:15 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:11:15.548139 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2cae2-45bd-4fff-ada7-6fff31cc7a76 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:15.548748 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2cae2-45bd-4fff-ada7-6fff31cc7a76 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:15.548748 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2cae2-45bd-4fff-ada7-6fff31cc7a76 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:15.550410 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1104/2215] 10.222.0.23 () {54 vars in 921 bytes} [Sat Apr 30 21:11:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:11:15.556360 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1f8df-a236-4953-9aed-df0f8aa0bc1c None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:15.556673 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1f8df-a236-4953-9aed-df0f8aa0bc1c None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:15.560926 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1f8df-a236-4953-9aed-df0f8aa0bc1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:15.577310 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-f5b1f8df-a236-4953-9aed-df0f8aa0bc1c None None] MFA Rules not processed for user `fca4ee1f64c8489ebe7296f9f8f0ab41`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:15.578636 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f5b1f8df-a236-4953-9aed-df0f8aa0bc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:15.588143 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1112/2216] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Apr 30 21:11:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:15.599100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2cae2-45bd-4fff-ada7-6fff31cc7a76 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:15.625622 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1f8df-a236-4953-9aed-df0f8aa0bc1c None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:15.633052 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1f8df-a236-4953-9aed-df0f8aa0bc1c None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:15.639657 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f0a7d-b909-46dd-b70b-c2bd6fce6f50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:15.640307 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f0a7d-b909-46dd-b70b-c2bd6fce6f50 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:15.640593 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f0a7d-b909-46dd-b70b-c2bd6fce6f50 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:15.640870 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f0a7d-b909-46dd-b70b-c2bd6fce6f50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:15.642681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-666f0a7d-b909-46dd-b70b-c2bd6fce6f50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:15.654059 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f0a7d-b909-46dd-b70b-c2bd6fce6f50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:15.655688 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f0a7d-b909-46dd-b70b-c2bd6fce6f50 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:15.659694 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2cae2-45bd-4fff-ada7-6fff31cc7a76 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:15.663327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4364a-5b60-4cae-b45c-79f57243e75d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:15.664030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4364a-5b60-4cae-b45c-79f57243e75d service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:15.664404 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4364a-5b60-4cae-b45c-79f57243e75d service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:15.665009 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4364a-5b60-4cae-b45c-79f57243e75d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:15.665134 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1113/2217] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:11:15 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:11:15.675381 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e4364a-5b60-4cae-b45c-79f57243e75d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:15.676884 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e4364a-5b60-4cae-b45c-79f57243e75d service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:15.690135 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1105/2218] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:11:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:11:15.709469 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec90bd5-51af-4565-96a2-9b7821244db7 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:15.710035 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec90bd5-51af-4565-96a2-9b7821244db7 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:15.710698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec90bd5-51af-4565-96a2-9b7821244db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:15.734896 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-6ec90bd5-51af-4565-96a2-9b7821244db7 None None] MFA Rules not processed for user `0b0cb145b72a492ebb8c0e9223be47a1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:15.736051 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6ec90bd5-51af-4565-96a2-9b7821244db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:15.746740 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1114/2219] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Apr 30 21:11:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:15.769634 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4364a-5b60-4cae-b45c-79f57243e75d service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:15.779904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4364a-5b60-4cae-b45c-79f57243e75d service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:15.783761 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7aed7e-c9a2-4814-b146-069912a55c65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:15.784473 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7aed7e-c9a2-4814-b146-069912a55c65 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:15.784822 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7aed7e-c9a2-4814-b146-069912a55c65 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:15.785167 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7aed7e-c9a2-4814-b146-069912a55c65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:15.793375 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7aed7e-c9a2-4814-b146-069912a55c65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:15.795020 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7aed7e-c9a2-4814-b146-069912a55c65 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:15.804562 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1106/2220] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:11:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:11:16.203104 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54218c42-b5d4-48d7-a894-0c8c15c16db9 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:16.203392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54218c42-b5d4-48d7-a894-0c8c15c16db9 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:16.203654 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54218c42-b5d4-48d7-a894-0c8c15c16db9 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:16.205328 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1115/2221] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:11:16.214640 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf77c0-9d9a-4031-bff7-1242c2929223 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:16.214820 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf77c0-9d9a-4031-bff7-1242c2929223 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:16.215259 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf77c0-9d9a-4031-bff7-1242c2929223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:16.264470 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-5acf77c0-9d9a-4031-bff7-1242c2929223 None None] MFA Rules not processed for user `0b0cb145b72a492ebb8c0e9223be47a1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:16.267393 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5acf77c0-9d9a-4031-bff7-1242c2929223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:16.287334 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1107/2222] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:11:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:16.311605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54218c42-b5d4-48d7-a894-0c8c15c16db9 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:16.319299 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-54218c42-b5d4-48d7-a894-0c8c15c16db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:16.336852 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54218c42-b5d4-48d7-a894-0c8c15c16db9 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:16.339824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd5a62-49e8-41a7-84a8-19376914400d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:16.340500 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd5a62-49e8-41a7-84a8-19376914400d service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:16.340800 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd5a62-49e8-41a7-84a8-19376914400d service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:16.341080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd5a62-49e8-41a7-84a8-19376914400d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:16.348884 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd5a62-49e8-41a7-84a8-19376914400d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:16.350466 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd5a62-49e8-41a7-84a8-19376914400d service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:16.373115 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1116/2223] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:11:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:11:17.795723 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf77c0-9d9a-4031-bff7-1242c2929223 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:17.797611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5acf77c0-9d9a-4031-bff7-1242c2929223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:17.885496 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd5a62-49e8-41a7-84a8-19376914400d service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:17.887224 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f9bd5a62-49e8-41a7-84a8-19376914400d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:17.917234 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd5a62-49e8-41a7-84a8-19376914400d service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:17.931096 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4997d546-c4cc-4231-8382-d132e3a6a1b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:17.931873 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997d546-c4cc-4231-8382-d132e3a6a1b1 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:17.932260 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997d546-c4cc-4231-8382-d132e3a6a1b1 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:17.932651 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997d546-c4cc-4231-8382-d132e3a6a1b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:17.936957 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4997d546-c4cc-4231-8382-d132e3a6a1b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:17.963248 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf77c0-9d9a-4031-bff7-1242c2929223 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:17.975782 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d9efb-1b17-48f3-9b12-dd2383ff3cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:17.976951 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d9efb-1b17-48f3-9b12-dd2383ff3cd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:17.977560 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d9efb-1b17-48f3-9b12-dd2383ff3cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:17.978029 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d9efb-1b17-48f3-9b12-dd2383ff3cd6 admin admin] PATH_INFO: `/v3/users/6cce227116e649da826de3541b2b2cef` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:17.980017 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d9efb-1b17-48f3-9b12-dd2383ff3cd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cce227116e649da826de3541b2b2cef)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:17.982311 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d9efb-1b17-48f3-9b12-dd2383ff3cd6 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:18.053259 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4997d546-c4cc-4231-8382-d132e3a6a1b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:18.054971 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4997d546-c4cc-4231-8382-d132e3a6a1b1 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:18.086586 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1117/2224] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:11:17 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:11:18.257619 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c56d9efb-1b17-48f3-9b12-dd2383ff3cd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cce227116e649da826de3541b2b2cef'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:18.273606 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c56d9efb-1b17-48f3-9b12-dd2383ff3cd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cce227116e649da826de3541b2b2cef'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:18.342286 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c56d9efb-1b17-48f3-9b12-dd2383ff3cd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cce227116e649da826de3541b2b2cef'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:18.351198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c56d9efb-1b17-48f3-9b12-dd2383ff3cd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cce227116e649da826de3541b2b2cef'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:18.352810 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c56d9efb-1b17-48f3-9b12-dd2383ff3cd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cce227116e649da826de3541b2b2cef'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:18.360836 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1108/2225] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:11:17 2022] DELETE /identity/v3/users/6cce227116e649da826de3541b2b2cef => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:18.365331 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f67a45-9f1a-4091-bef6-4c10d41cc1d8 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:18.365882 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f67a45-9f1a-4091-bef6-4c10d41cc1d8 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:18.366165 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f67a45-9f1a-4091-bef6-4c10d41cc1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:18.387304 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-08f67a45-9f1a-4091-bef6-4c10d41cc1d8 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:18.389330 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-08f67a45-9f1a-4091-bef6-4c10d41cc1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:18.508699 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1118/2226] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:18.546305 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d9efb-1b17-48f3-9b12-dd2383ff3cd6 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:18.550110 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c56d9efb-1b17-48f3-9b12-dd2383ff3cd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:18.603891 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f67a45-9f1a-4091-bef6-4c10d41cc1d8 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:18.605434 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-08f67a45-9f1a-4091-bef6-4c10d41cc1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:18.627911 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f67a45-9f1a-4091-bef6-4c10d41cc1d8 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:18.641192 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d8408-709d-4c1e-912b-3e4b89d3bc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:18.642424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d8408-709d-4c1e-912b-3e4b89d3bc49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:18.642710 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d8408-709d-4c1e-912b-3e4b89d3bc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:18.642985 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d8408-709d-4c1e-912b-3e4b89d3bc49 admin admin] PATH_INFO: `/v3/users/b60e9b56c5314da18a16cc7ed04d964e` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:18.649080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d8408-709d-4c1e-912b-3e4b89d3bc49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b60e9b56c5314da18a16cc7ed04d964e)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:18.651708 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d8408-709d-4c1e-912b-3e4b89d3bc49 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:18.666168 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d9efb-1b17-48f3-9b12-dd2383ff3cd6 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:18.670441 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529769b4-c150-4fc6-8771-2171ad7d7aa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:18.671348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529769b4-c150-4fc6-8771-2171ad7d7aa9 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:18.671702 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529769b4-c150-4fc6-8771-2171ad7d7aa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:18.672062 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529769b4-c150-4fc6-8771-2171ad7d7aa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:18.693253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529769b4-c150-4fc6-8771-2171ad7d7aa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:18.695094 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529769b4-c150-4fc6-8771-2171ad7d7aa9 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:18.721830 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1109/2227] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:11:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:11:18.968964 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-680d8408-709d-4c1e-912b-3e4b89d3bc49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b60e9b56c5314da18a16cc7ed04d964e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:18.984466 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-680d8408-709d-4c1e-912b-3e4b89d3bc49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b60e9b56c5314da18a16cc7ed04d964e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:19.095118 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-680d8408-709d-4c1e-912b-3e4b89d3bc49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b60e9b56c5314da18a16cc7ed04d964e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:19.095799 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-680d8408-709d-4c1e-912b-3e4b89d3bc49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b60e9b56c5314da18a16cc7ed04d964e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:19.104346 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-680d8408-709d-4c1e-912b-3e4b89d3bc49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b60e9b56c5314da18a16cc7ed04d964e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:19.123548 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1119/2228] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:11:18 2022] DELETE /identity/v3/users/b60e9b56c5314da18a16cc7ed04d964e => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:19.128117 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8aeab-7135-4ede-8c92-9540419f7e6c None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:19.129023 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8aeab-7135-4ede-8c92-9540419f7e6c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:19.129514 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8aeab-7135-4ede-8c92-9540419f7e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:19.161647 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-39e8aeab-7135-4ede-8c92-9540419f7e6c None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:19.163266 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-39e8aeab-7135-4ede-8c92-9540419f7e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:19.331410 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1110/2229] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:19.345398 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81bf0d-c885-4d83-8679-047c7d7549a0 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:19.345695 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81bf0d-c885-4d83-8679-047c7d7549a0 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:19.346010 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81bf0d-c885-4d83-8679-047c7d7549a0 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:19.347552 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1120/2230] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:11:19.353869 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b6b91-91a0-4d7b-8e14-2578a48b724c None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:19.354950 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b6b91-91a0-4d7b-8e14-2578a48b724c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:19.355449 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b6b91-91a0-4d7b-8e14-2578a48b724c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:19.369414 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81bf0d-c885-4d83-8679-047c7d7549a0 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:19.373998 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8d81bf0d-c885-4d83-8679-047c7d7549a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:19.399230 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-bb9b6b91-91a0-4d7b-8e14-2578a48b724c None None] MFA Rules not processed for user `4ad3f89b7037413a83c7905cef263b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:19.399230 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-bb9b6b91-91a0-4d7b-8e14-2578a48b724c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:19.499454 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81bf0d-c885-4d83-8679-047c7d7549a0 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:19.504519 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f274c1d-000b-4ba6-967f-aebe7500dd22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:19.505387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f274c1d-000b-4ba6-967f-aebe7500dd22 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:19.505863 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f274c1d-000b-4ba6-967f-aebe7500dd22 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:19.506318 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f274c1d-000b-4ba6-967f-aebe7500dd22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:19.519574 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f274c1d-000b-4ba6-967f-aebe7500dd22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:19.521367 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f274c1d-000b-4ba6-967f-aebe7500dd22 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:19.539633 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1111/2231] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:11:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:11:19.558098 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1121/2232] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:11:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:11:19.575739 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b6b91-91a0-4d7b-8e14-2578a48b724c None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:19.577295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-bb9b6b91-91a0-4d7b-8e14-2578a48b724c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:19.604406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b6b91-91a0-4d7b-8e14-2578a48b724c None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:19.612295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa61a0-2695-42a2-ab9f-7c61c690a5c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:19.614600 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa61a0-2695-42a2-ab9f-7c61c690a5c9 service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:19.614600 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa61a0-2695-42a2-ab9f-7c61c690a5c9 service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:19.614600 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa61a0-2695-42a2-ab9f-7c61c690a5c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:19.628097 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fa61a0-2695-42a2-ab9f-7c61c690a5c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:19.632512 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fa61a0-2695-42a2-ab9f-7c61c690a5c9 service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:19.658170 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1112/2233] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:11:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:11:19.795121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f274c1d-000b-4ba6-967f-aebe7500dd22 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:19.796598 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3f274c1d-000b-4ba6-967f-aebe7500dd22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:19.817240 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f274c1d-000b-4ba6-967f-aebe7500dd22 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:19.830970 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c03da-8386-431d-a41c-f19286de6868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:19.831866 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c03da-8386-431d-a41c-f19286de6868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:19.832148 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c03da-8386-431d-a41c-f19286de6868 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:19.832699 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c03da-8386-431d-a41c-f19286de6868 admin admin] PATH_INFO: `/v3/projects/89d2470a634e4b3b96df66931847dae6` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:19.837101 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c03da-8386-431d-a41c-f19286de6868 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89d2470a634e4b3b96df66931847dae6)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:19.839103 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c03da-8386-431d-a41c-f19286de6868 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:19.996333 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6b0c03da-8386-431d-a41c-f19286de6868 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89d2470a634e4b3b96df66931847dae6', 'request_id': 'req-6b0c03da-8386-431d-a41c-f19286de6868'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:20.004299 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6b0c03da-8386-431d-a41c-f19286de6868 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89d2470a634e4b3b96df66931847dae6', 'request_id': 'req-6b0c03da-8386-431d-a41c-f19286de6868'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:20.011314 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6b0c03da-8386-431d-a41c-f19286de6868 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89d2470a634e4b3b96df66931847dae6', 'request_id': 'req-6b0c03da-8386-431d-a41c-f19286de6868'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:20.104998 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6b0c03da-8386-431d-a41c-f19286de6868 admin admin] The token cache is being invalidate because project 89d2470a634e4b3b96df66931847dae6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:11:20.108824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6b0c03da-8386-431d-a41c-f19286de6868 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:20.108824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6b0c03da-8386-431d-a41c-f19286de6868 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:20.113448 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1122/2234] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:11:19 2022] DELETE /identity/v3/projects/89d2470a634e4b3b96df66931847dae6 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:20.114336 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa61a0-2695-42a2-ab9f-7c61c690a5c9 service placement] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:20.140633 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa61a0-2695-42a2-ab9f-7c61c690a5c9 service placement] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:20.251507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf95ef-506e-4122-8c5c-e53229e26452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:20.263923 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf95ef-506e-4122-8c5c-e53229e26452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:20.264704 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf95ef-506e-4122-8c5c-e53229e26452 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:20.265732 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf95ef-506e-4122-8c5c-e53229e26452 admin admin] PATH_INFO: `/v3/users/b92f0b8191f746b58da4f93071b3f7fb` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:20.270723 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf95ef-506e-4122-8c5c-e53229e26452 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b92f0b8191f746b58da4f93071b3f7fb)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:20.293209 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf95ef-506e-4122-8c5c-e53229e26452 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:20.546177 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-42bf95ef-506e-4122-8c5c-e53229e26452 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b92f0b8191f746b58da4f93071b3f7fb'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:20.579223 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-42bf95ef-506e-4122-8c5c-e53229e26452 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b92f0b8191f746b58da4f93071b3f7fb'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:20.618953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae4704-6ceb-4656-9bdf-c87a3f9da813 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:20.619828 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae4704-6ceb-4656-9bdf-c87a3f9da813 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:20.620110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae4704-6ceb-4656-9bdf-c87a3f9da813 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:20.622536 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1123/2235] 10.222.0.23 () {54 vars in 921 bytes} [Sat Apr 30 21:11:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 21:11:20.641304 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a4bf5-2303-40cc-b961-f3518797f7c1 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:20.642447 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a4bf5-2303-40cc-b961-f3518797f7c1 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:20.642889 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a4bf5-2303-40cc-b961-f3518797f7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:20.672698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-665a4bf5-2303-40cc-b961-f3518797f7c1 None None] MFA Rules not processed for user `4ad3f89b7037413a83c7905cef263b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:20.675803 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-665a4bf5-2303-40cc-b961-f3518797f7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:20.693150 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-42bf95ef-506e-4122-8c5c-e53229e26452 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b92f0b8191f746b58da4f93071b3f7fb'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:20.720646 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-42bf95ef-506e-4122-8c5c-e53229e26452 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b92f0b8191f746b58da4f93071b3f7fb'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:20.724450 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-42bf95ef-506e-4122-8c5c-e53229e26452 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b92f0b8191f746b58da4f93071b3f7fb'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:20.740692 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1113/2236] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:11:20 2022] DELETE /identity/v3/users/b92f0b8191f746b58da4f93071b3f7fb => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:20.867757 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1124/2237] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Apr 30 21:11:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:11:20.896925 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf95ef-506e-4122-8c5c-e53229e26452 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:20.898616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-42bf95ef-506e-4122-8c5c-e53229e26452 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:20.946236 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a45efb-52c6-4598-84b8-8e025334beff None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:20.946917 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a45efb-52c6-4598-84b8-8e025334beff None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:20.947204 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a45efb-52c6-4598-84b8-8e025334beff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:21.026099 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf95ef-506e-4122-8c5c-e53229e26452 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:21.026350 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-32a45efb-52c6-4598-84b8-8e025334beff None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:21.028999 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-32a45efb-52c6-4598-84b8-8e025334beff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:21.040965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55b52e-b8a9-4d7f-9150-6cc1f7b3b2bf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:21.043954 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55b52e-b8a9-4d7f-9150-6cc1f7b3b2bf service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:21.045894 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55b52e-b8a9-4d7f-9150-6cc1f7b3b2bf service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:21.046409 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55b52e-b8a9-4d7f-9150-6cc1f7b3b2bf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:21.093965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55b52e-b8a9-4d7f-9150-6cc1f7b3b2bf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:21.095646 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55b52e-b8a9-4d7f-9150-6cc1f7b3b2bf service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:21.145390 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1114/2238] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:11:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:11:21.146435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55b52e-b8a9-4d7f-9150-6cc1f7b3b2bf service placement] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:21.149662 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2d55b52e-b8a9-4d7f-9150-6cc1f7b3b2bf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:21.258060 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1125/2239] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:11:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:11:21.279549 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a45efb-52c6-4598-84b8-8e025334beff None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:21.280987 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-32a45efb-52c6-4598-84b8-8e025334beff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:21.336152 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55b52e-b8a9-4d7f-9150-6cc1f7b3b2bf service placement] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:21.353587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886f54f-434f-44e8-9563-197c0e2a563a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:21.355000 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886f54f-434f-44e8-9563-197c0e2a563a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:21.355470 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886f54f-434f-44e8-9563-197c0e2a563a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:21.355948 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886f54f-434f-44e8-9563-197c0e2a563a admin admin] PATH_INFO: `/v3/projects/469150330fd54b36bbf28289432c350b` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:21.359845 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9886f54f-434f-44e8-9563-197c0e2a563a admin admin] RBAC: Authorizing `identity:delete_project(project_id=469150330fd54b36bbf28289432c350b)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:21.362081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9886f54f-434f-44e8-9563-197c0e2a563a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:21.547469 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a45efb-52c6-4598-84b8-8e025334beff None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:21.555051 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9886f54f-434f-44e8-9563-197c0e2a563a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '469150330fd54b36bbf28289432c350b', 'request_id': 'req-9886f54f-434f-44e8-9563-197c0e2a563a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:21.565782 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9886f54f-434f-44e8-9563-197c0e2a563a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '469150330fd54b36bbf28289432c350b', 'request_id': 'req-9886f54f-434f-44e8-9563-197c0e2a563a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:21.578844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9886f54f-434f-44e8-9563-197c0e2a563a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '469150330fd54b36bbf28289432c350b', 'request_id': 'req-9886f54f-434f-44e8-9563-197c0e2a563a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:21.665835 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9886f54f-434f-44e8-9563-197c0e2a563a admin admin] The token cache is being invalidate because project 469150330fd54b36bbf28289432c350b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:11:21.666124 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9886f54f-434f-44e8-9563-197c0e2a563a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:21.666902 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9886f54f-434f-44e8-9563-197c0e2a563a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:21.669893 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1115/2240] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:11:21 2022] DELETE /identity/v3/projects/469150330fd54b36bbf28289432c350b => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:21.671331 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4ac06-7e04-41b8-bf76-852e65f02470 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:21.671599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4ac06-7e04-41b8-bf76-852e65f02470 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:21.671860 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4ac06-7e04-41b8-bf76-852e65f02470 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:21.673153 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1116/2241] 10.222.0.23 () {54 vars in 921 bytes} [Sat Apr 30 21:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:11:21.673873 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4ac06-7e04-41b8-bf76-852e65f02470 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:21.677840 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-84b4ac06-7e04-41b8-bf76-852e65f02470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:21.687339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627d010-7604-4439-8b1d-ee08b15aaf6e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:21.695363 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627d010-7604-4439-8b1d-ee08b15aaf6e service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:21.695363 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627d010-7604-4439-8b1d-ee08b15aaf6e service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:21.695363 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627d010-7604-4439-8b1d-ee08b15aaf6e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:21.696447 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e627d010-7604-4439-8b1d-ee08b15aaf6e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:21.874589 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4ac06-7e04-41b8-bf76-852e65f02470 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:21.880283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627d010-7604-4439-8b1d-ee08b15aaf6e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:21.884365 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627d010-7604-4439-8b1d-ee08b15aaf6e service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:21.886529 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdac63c-4ecf-4cd3-b40a-e234f7f09f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:21.889263 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdac63c-4ecf-4cd3-b40a-e234f7f09f3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:21.889556 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdac63c-4ecf-4cd3-b40a-e234f7f09f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:21.889865 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdac63c-4ecf-4cd3-b40a-e234f7f09f3d admin admin] PATH_INFO: `/v3/users/e8c4f13edbfe45e3b6b457ccb4ea8fa6` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:21.892728 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdac63c-4ecf-4cd3-b40a-e234f7f09f3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8c4f13edbfe45e3b6b457ccb4ea8fa6)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:21.899773 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdac63c-4ecf-4cd3-b40a-e234f7f09f3d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:21.909012 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1126/2242] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:11:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:11:21.909012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7c990-2697-413f-882e-2a77d669d3a5 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:21.909012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7c990-2697-413f-882e-2a77d669d3a5 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:21.909012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7c990-2697-413f-882e-2a77d669d3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:21.930205 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-fef7c990-2697-413f-882e-2a77d669d3a5 None None] MFA Rules not processed for user `fca4ee1f64c8489ebe7296f9f8f0ab41`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:21.931479 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-fef7c990-2697-413f-882e-2a77d669d3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:22.078564 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1127/2243] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Apr 30 21:11:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:22.115088 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7c990-2697-413f-882e-2a77d669d3a5 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:22.117347 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-fef7c990-2697-413f-882e-2a77d669d3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:22.215268 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8bdac63c-4ecf-4cd3-b40a-e234f7f09f3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8c4f13edbfe45e3b6b457ccb4ea8fa6'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:22.222819 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7c990-2697-413f-882e-2a77d669d3a5 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:22.230185 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406f232-5e18-4965-b49b-c6de5509ca0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:22.231182 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406f232-5e18-4965-b49b-c6de5509ca0f service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:22.232121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406f232-5e18-4965-b49b-c6de5509ca0f service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:22.232664 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406f232-5e18-4965-b49b-c6de5509ca0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:22.239337 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8bdac63c-4ecf-4cd3-b40a-e234f7f09f3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8c4f13edbfe45e3b6b457ccb4ea8fa6'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:22.246531 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406f232-5e18-4965-b49b-c6de5509ca0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:22.249403 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406f232-5e18-4965-b49b-c6de5509ca0f service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:22.269047 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1128/2244] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:11:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:11:22.319563 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8bdac63c-4ecf-4cd3-b40a-e234f7f09f3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8c4f13edbfe45e3b6b457ccb4ea8fa6'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:22.384499 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8bdac63c-4ecf-4cd3-b40a-e234f7f09f3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8c4f13edbfe45e3b6b457ccb4ea8fa6'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:22.387137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8bdac63c-4ecf-4cd3-b40a-e234f7f09f3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8c4f13edbfe45e3b6b457ccb4ea8fa6'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:22.415416 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1117/2245] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:11:21 2022] DELETE /identity/v3/users/e8c4f13edbfe45e3b6b457ccb4ea8fa6 => generated 0 bytes in 741 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:22.789649 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406f232-5e18-4965-b49b-c6de5509ca0f service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:22.792424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3406f232-5e18-4965-b49b-c6de5509ca0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:22.856052 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406f232-5e18-4965-b49b-c6de5509ca0f service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:23.071014 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d53e8-91fc-4470-9e81-899af7375707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:23.073393 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d53e8-91fc-4470-9e81-899af7375707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:23.073878 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d53e8-91fc-4470-9e81-899af7375707 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:23.074473 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d53e8-91fc-4470-9e81-899af7375707 admin admin] PATH_INFO: `/v3/projects/937f35996c28407caffb991b0ae4a5ce` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:23.077003 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d53e8-91fc-4470-9e81-899af7375707 admin admin] RBAC: Authorizing `identity:delete_project(project_id=937f35996c28407caffb991b0ae4a5ce)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:23.084307 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d53e8-91fc-4470-9e81-899af7375707 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:23.261078 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-222d53e8-91fc-4470-9e81-899af7375707 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '937f35996c28407caffb991b0ae4a5ce', 'request_id': 'req-222d53e8-91fc-4470-9e81-899af7375707'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:23.276712 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-222d53e8-91fc-4470-9e81-899af7375707 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '937f35996c28407caffb991b0ae4a5ce', 'request_id': 'req-222d53e8-91fc-4470-9e81-899af7375707'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:23.291829 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-222d53e8-91fc-4470-9e81-899af7375707 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '937f35996c28407caffb991b0ae4a5ce', 'request_id': 'req-222d53e8-91fc-4470-9e81-899af7375707'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:23.456863 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdac63c-4ecf-4cd3-b40a-e234f7f09f3d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:23.457448 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-222d53e8-91fc-4470-9e81-899af7375707 admin admin] The token cache is being invalidate because project 937f35996c28407caffb991b0ae4a5ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:11:23.457879 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-222d53e8-91fc-4470-9e81-899af7375707 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:23.459690 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8bdac63c-4ecf-4cd3-b40a-e234f7f09f3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:23.460485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-222d53e8-91fc-4470-9e81-899af7375707 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:23.465379 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1129/2246] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:11:22 2022] DELETE /identity/v3/projects/937f35996c28407caffb991b0ae4a5ce => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:23.467743 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e4b35-5a18-4ddf-86bc-f6cfe1d46d77 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:23.468133 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e4b35-5a18-4ddf-86bc-f6cfe1d46d77 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:23.468540 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e4b35-5a18-4ddf-86bc-f6cfe1d46d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:23.519067 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdac63c-4ecf-4cd3-b40a-e234f7f09f3d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:23.553632 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-fd5e4b35-5a18-4ddf-86bc-f6cfe1d46d77 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:23.557198 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-fd5e4b35-5a18-4ddf-86bc-f6cfe1d46d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:23.648173 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114273d-4bd1-4d81-a3b8-fe8b6d77cd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:23.649605 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114273d-4bd1-4d81-a3b8-fe8b6d77cd64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:23.650367 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114273d-4bd1-4d81-a3b8-fe8b6d77cd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:23.650804 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114273d-4bd1-4d81-a3b8-fe8b6d77cd64 admin admin] PATH_INFO: `/v3/projects/91f8cc46e09d41709aebb2e7be527c5c` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:23.654194 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114273d-4bd1-4d81-a3b8-fe8b6d77cd64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91f8cc46e09d41709aebb2e7be527c5c)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:23.695441 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114273d-4bd1-4d81-a3b8-fe8b6d77cd64 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:23.829523 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1130/2247] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:11:23.847457 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78358423-423b-4cb3-afe6-8c9e8bc9e9c7 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:23.847851 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78358423-423b-4cb3-afe6-8c9e8bc9e9c7 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:23.848206 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78358423-423b-4cb3-afe6-8c9e8bc9e9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:23.889080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-78358423-423b-4cb3-afe6-8c9e8bc9e9c7 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:23.892485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-78358423-423b-4cb3-afe6-8c9e8bc9e9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:23.924662 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1131/2248] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:11:23.930941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78358423-423b-4cb3-afe6-8c9e8bc9e9c7 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:23.943295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78358423-423b-4cb3-afe6-8c9e8bc9e9c7 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:23.963812 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1972c-a67c-4bd8-b2d9-f582f0c1b19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:23.964508 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1972c-a67c-4bd8-b2d9-f582f0c1b19a admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:23.967503 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1972c-a67c-4bd8-b2d9-f582f0c1b19a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:23.967865 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1972c-a67c-4bd8-b2d9-f582f0c1b19a admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:23.970947 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a1972c-a67c-4bd8-b2d9-f582f0c1b19a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:11:23.973632 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a1972c-a67c-4bd8-b2d9-f582f0c1b19a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:23.980559 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a1972c-a67c-4bd8-b2d9-f582f0c1b19a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:24.025568 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1132/2249] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:11:24.034065 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1972c-a67c-4bd8-b2d9-f582f0c1b19a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:24.071815 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1972c-a67c-4bd8-b2d9-f582f0c1b19a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:24.098763 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58451be-0d16-4cb7-8e91-72ed4e017221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:24.099321 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58451be-0d16-4cb7-8e91-72ed4e017221 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:24.099422 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58451be-0d16-4cb7-8e91-72ed4e017221 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:24.099666 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58451be-0d16-4cb7-8e91-72ed4e017221 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:24.100368 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58451be-0d16-4cb7-8e91-72ed4e017221 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:24.102351 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58451be-0d16-4cb7-8e91-72ed4e017221 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:24.286186 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1133/2250] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:11:24 2022] POST /identity/v3/projects => generated 389 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:11:24.291738 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58451be-0d16-4cb7-8e91-72ed4e017221 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:24.313132 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a114273d-4bd1-4d81-a3b8-fe8b6d77cd64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91f8cc46e09d41709aebb2e7be527c5c', 'request_id': 'req-a114273d-4bd1-4d81-a3b8-fe8b6d77cd64'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:24.352319 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a114273d-4bd1-4d81-a3b8-fe8b6d77cd64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91f8cc46e09d41709aebb2e7be527c5c', 'request_id': 'req-a114273d-4bd1-4d81-a3b8-fe8b6d77cd64'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:24.385513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a114273d-4bd1-4d81-a3b8-fe8b6d77cd64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91f8cc46e09d41709aebb2e7be527c5c', 'request_id': 'req-a114273d-4bd1-4d81-a3b8-fe8b6d77cd64'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:24.468707 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58451be-0d16-4cb7-8e91-72ed4e017221 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:24.487632 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a426e-0d04-4fef-bb40-e57fe9391815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:24.488362 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a426e-0d04-4fef-bb40-e57fe9391815 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:24.488657 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a426e-0d04-4fef-bb40-e57fe9391815 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:24.488940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a426e-0d04-4fef-bb40-e57fe9391815 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:24.490590 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a426e-0d04-4fef-bb40-e57fe9391815 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:24.493285 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a426e-0d04-4fef-bb40-e57fe9391815 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:24.509307 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a114273d-4bd1-4d81-a3b8-fe8b6d77cd64 admin admin] The token cache is being invalidate because project 91f8cc46e09d41709aebb2e7be527c5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:11:24.510258 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a114273d-4bd1-4d81-a3b8-fe8b6d77cd64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:24.511582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a114273d-4bd1-4d81-a3b8-fe8b6d77cd64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:24.513541 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1118/2251] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:11:23 2022] DELETE /identity/v3/projects/91f8cc46e09d41709aebb2e7be527c5c => generated 0 bytes in 1058 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:11:24.519324 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09a84e-324f-4d22-9038-597a13837670 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:24.520551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09a84e-324f-4d22-9038-597a13837670 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:24.521425 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09a84e-324f-4d22-9038-597a13837670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:24.598076 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1134/2252] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:11:24 2022] POST /identity/v3/users => generated 295 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:11:24.601504 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a426e-0d04-4fef-bb40-e57fe9391815 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:24.613050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-047a426e-0d04-4fef-bb40-e57fe9391815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:24.637993 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-0e09a84e-324f-4d22-9038-597a13837670 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:24.643924 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0e09a84e-324f-4d22-9038-597a13837670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:24.645299 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a426e-0d04-4fef-bb40-e57fe9391815 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:24.656993 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb02d3c-036e-4d23-8646-112441d241e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:24.657690 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb02d3c-036e-4d23-8646-112441d241e3 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:24.658003 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb02d3c-036e-4d23-8646-112441d241e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:24.658289 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb02d3c-036e-4d23-8646-112441d241e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:24.659481 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb02d3c-036e-4d23-8646-112441d241e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:24.660679 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb02d3c-036e-4d23-8646-112441d241e3 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:24.681134 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1119/2253] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:24.685519 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1135/2254] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:11:24.689450 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb02d3c-036e-4d23-8646-112441d241e3 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:24.689880 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939923a0-96ba-408d-9ee4-b40f889ee5b6 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:24.690743 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939923a0-96ba-408d-9ee4-b40f889ee5b6 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:24.693063 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939923a0-96ba-408d-9ee4-b40f889ee5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:24.709400 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb02d3c-036e-4d23-8646-112441d241e3 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:24.724439 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe6ea8-d03e-4e4a-bf57-261400aa9d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:24.725380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe6ea8-d03e-4e4a-bf57-261400aa9d39 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:24.725990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe6ea8-d03e-4e4a-bf57-261400aa9d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:24.726460 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe6ea8-d03e-4e4a-bf57-261400aa9d39 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:24.727356 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe6ea8-d03e-4e4a-bf57-261400aa9d39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:24.729169 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe6ea8-d03e-4e4a-bf57-261400aa9d39 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:24.753491 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1136/2255] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:11:24.754739 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe6ea8-d03e-4e4a-bf57-261400aa9d39 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:24.779249 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe6ea8-d03e-4e4a-bf57-261400aa9d39 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:24.780255 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-939923a0-96ba-408d-9ee4-b40f889ee5b6 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:24.789924 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-939923a0-96ba-408d-9ee4-b40f889ee5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:24.800932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb76ea-3f16-4d12-ac93-78d6443ea163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:24.810406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb76ea-3f16-4d12-ac93-78d6443ea163 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:24.810406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb76ea-3f16-4d12-ac93-78d6443ea163 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:24.810406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb76ea-3f16-4d12-ac93-78d6443ea163 admin admin] PATH_INFO: `/v3/projects/f727d5639c624deeba0d0d7a7d08810e/users/6a8350c0cb814c66b94775110721dee4/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:24.827880 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb76ea-3f16-4d12-ac93-78d6443ea163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f727d5639c624deeba0d0d7a7d08810e, user_id=6a8350c0cb814c66b94775110721dee4, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:24.830795 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb76ea-3f16-4d12-ac93-78d6443ea163 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:24.849455 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1120/2256] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:24.850482 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939923a0-96ba-408d-9ee4-b40f889ee5b6 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:24.860877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939923a0-96ba-408d-9ee4-b40f889ee5b6 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:24.872885 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0c995-9b86-4851-8d45-98023fe6eb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:24.873575 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0c995-9b86-4851-8d45-98023fe6eb26 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:24.873893 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0c995-9b86-4851-8d45-98023fe6eb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:24.874175 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0c995-9b86-4851-8d45-98023fe6eb26 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:24.874991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d0c995-9b86-4851-8d45-98023fe6eb26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:11:24.875337 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d0c995-9b86-4851-8d45-98023fe6eb26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:24.877195 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d0c995-9b86-4851-8d45-98023fe6eb26 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:24.896004 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1121/2257] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:11:24.896960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0c995-9b86-4851-8d45-98023fe6eb26 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:24.922005 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0c995-9b86-4851-8d45-98023fe6eb26 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:24.928521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44b291-1640-4b4c-a1b9-efe4fd9d27de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:24.930778 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44b291-1640-4b4c-a1b9-efe4fd9d27de admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:24.943137 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1137/2258] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:11:24 2022] PUT /identity/v3/projects/f727d5639c624deeba0d0d7a7d08810e/users/6a8350c0cb814c66b94775110721dee4/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:24.943312 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44b291-1640-4b4c-a1b9-efe4fd9d27de admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:24.943806 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44b291-1640-4b4c-a1b9-efe4fd9d27de admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:24.944538 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f44b291-1640-4b4c-a1b9-efe4fd9d27de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:24.948479 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f44b291-1640-4b4c-a1b9-efe4fd9d27de admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:24.954802 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd9273-aca3-4d18-b8c8-7e3b13ca4ebf None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:24.955091 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd9273-aca3-4d18-b8c8-7e3b13ca4ebf None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:24.960905 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd9273-aca3-4d18-b8c8-7e3b13ca4ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:25.019595 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-71bd9273-aca3-4d18-b8c8-7e3b13ca4ebf None None] MFA Rules not processed for user `6a8350c0cb814c66b94775110721dee4`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:25.021176 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-71bd9273-aca3-4d18-b8c8-7e3b13ca4ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:25.174438 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1122/2259] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:11:24 2022] POST /identity/v3/projects => generated 411 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:11:25.175757 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44b291-1640-4b4c-a1b9-efe4fd9d27de admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:25.192079 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1138/2260] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:11:25.193351 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd9273-aca3-4d18-b8c8-7e3b13ca4ebf None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:25.340212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd9273-aca3-4d18-b8c8-7e3b13ca4ebf None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:25.429413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c021280-a447-4371-908a-65b822bd3d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:25.432027 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c021280-a447-4371-908a-65b822bd3d44 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:25.432555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c021280-a447-4371-908a-65b822bd3d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:25.433006 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c021280-a447-4371-908a-65b822bd3d44 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:25.458405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c021280-a447-4371-908a-65b822bd3d44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:25.471462 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c021280-a447-4371-908a-65b822bd3d44 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:25.495134 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44b291-1640-4b4c-a1b9-efe4fd9d27de admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:25.519164 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e6a67-8dbb-43f1-9a4b-ac079618cd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:25.519857 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e6a67-8dbb-43f1-9a4b-ac079618cd8d admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:25.523799 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e6a67-8dbb-43f1-9a4b-ac079618cd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:25.524147 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e6a67-8dbb-43f1-9a4b-ac079618cd8d admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:25.524886 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e6a67-8dbb-43f1-9a4b-ac079618cd8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:25.531892 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e6a67-8dbb-43f1-9a4b-ac079618cd8d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:25.640816 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1139/2261] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:11:25 2022] POST /identity/v3/projects => generated 389 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:11:25.641596 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c021280-a447-4371-908a-65b822bd3d44 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:25.678468 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1123/2262] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:11:25 2022] POST /identity/v3/users => generated 306 bytes in 503 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:11:25.682505 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e6a67-8dbb-43f1-9a4b-ac079618cd8d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:25.707928 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e6a67-8dbb-43f1-9a4b-ac079618cd8d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:25.797556 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c021280-a447-4371-908a-65b822bd3d44 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:25.805303 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4f1a6-3416-4c40-9369-e8683dd7f98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:25.806031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4f1a6-3416-4c40-9369-e8683dd7f98a admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:25.806314 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4f1a6-3416-4c40-9369-e8683dd7f98a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:25.806587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4f1a6-3416-4c40-9369-e8683dd7f98a admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:25.807284 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e4f1a6-3416-4c40-9369-e8683dd7f98a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:25.809367 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e4f1a6-3416-4c40-9369-e8683dd7f98a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:25.936961 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1140/2263] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:11:25 2022] POST /identity/v3/users => generated 301 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:11:25.939923 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4f1a6-3416-4c40-9369-e8683dd7f98a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:25.958530 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3cfc72-e242-4c12-b0f6-1872461b9d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:25.959380 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cfc72-e242-4c12-b0f6-1872461b9d3c admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:25.959915 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cfc72-e242-4c12-b0f6-1872461b9d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:25.960410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cfc72-e242-4c12-b0f6-1872461b9d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:25.961381 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3cfc72-e242-4c12-b0f6-1872461b9d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:25.963518 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3cfc72-e242-4c12-b0f6-1872461b9d3c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:25.980250 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4f1a6-3416-4c40-9369-e8683dd7f98a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:26.003419 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171edb1-52af-40c8-8ca1-1238d27680a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:26.010274 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171edb1-52af-40c8-8ca1-1238d27680a0 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:26.010787 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171edb1-52af-40c8-8ca1-1238d27680a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:26.011232 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171edb1-52af-40c8-8ca1-1238d27680a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:26.012158 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b171edb1-52af-40c8-8ca1-1238d27680a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:26.016719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b171edb1-52af-40c8-8ca1-1238d27680a0 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:26.027162 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1124/2264] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:11:26.028642 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3cfc72-e242-4c12-b0f6-1872461b9d3c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:26.055953 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3cfc72-e242-4c12-b0f6-1872461b9d3c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:26.058324 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1141/2265] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:11:26.063864 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171edb1-52af-40c8-8ca1-1238d27680a0 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:26.078911 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3fdf4-3a35-4952-a476-b315d4d9a5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:26.080298 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3fdf4-3a35-4952-a476-b315d4d9a5dc admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:26.080698 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3fdf4-3a35-4952-a476-b315d4d9a5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:26.081098 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3fdf4-3a35-4952-a476-b315d4d9a5dc admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:26.082102 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3fdf4-3a35-4952-a476-b315d4d9a5dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:26.082772 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171edb1-52af-40c8-8ca1-1238d27680a0 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:26.084526 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3fdf4-3a35-4952-a476-b315d4d9a5dc admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:26.089169 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e2e14-34e9-42cd-9127-254c137a32fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:26.092322 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e2e14-34e9-42cd-9127-254c137a32fb admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:26.092925 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e2e14-34e9-42cd-9127-254c137a32fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:26.093402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e2e14-34e9-42cd-9127-254c137a32fb admin admin] PATH_INFO: `/v3/projects/9ce06bffca1a469194ba7e945510f424/users/bd57b47fc89748b1bc8a0083873ff7a0/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:26.107084 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1125/2266] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:11:26.111079 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3fdf4-3a35-4952-a476-b315d4d9a5dc admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:26.117193 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41e2e14-34e9-42cd-9127-254c137a32fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ce06bffca1a469194ba7e945510f424, user_id=bd57b47fc89748b1bc8a0083873ff7a0, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:26.120519 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41e2e14-34e9-42cd-9127-254c137a32fb admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:26.146015 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3fdf4-3a35-4952-a476-b315d4d9a5dc admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:26.158414 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c85a88-78f4-4949-9a2a-778ad02c5625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:26.160941 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c85a88-78f4-4949-9a2a-778ad02c5625 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:26.161454 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c85a88-78f4-4949-9a2a-778ad02c5625 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:26.162036 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c85a88-78f4-4949-9a2a-778ad02c5625 admin admin] PATH_INFO: `/v3/projects/0b878828e8e3444bb5fc5ef22593d450/users/8c89d96727ad45f397a2b6e9f0f3f729/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:26.203616 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1142/2267] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:11:26 2022] PUT /identity/v3/projects/9ce06bffca1a469194ba7e945510f424/users/bd57b47fc89748b1bc8a0083873ff7a0/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:11:26.210826 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e2e14-34e9-42cd-9127-254c137a32fb admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:26.226556 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c85a88-78f4-4949-9a2a-778ad02c5625 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b878828e8e3444bb5fc5ef22593d450, user_id=8c89d96727ad45f397a2b6e9f0f3f729, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:26.229522 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c85a88-78f4-4949-9a2a-778ad02c5625 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:26.318704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e2e14-34e9-42cd-9127-254c137a32fb admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:26.327316 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1126/2268] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:11:26 2022] PUT /identity/v3/projects/0b878828e8e3444bb5fc5ef22593d450/users/8c89d96727ad45f397a2b6e9f0f3f729/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:26.337595 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530f605-de28-426c-9c5a-350bcc1c1508 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:26.338336 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530f605-de28-426c-9c5a-350bcc1c1508 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:26.338901 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530f605-de28-426c-9c5a-350bcc1c1508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:26.438540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-6530f605-de28-426c-9c5a-350bcc1c1508 None None] MFA Rules not processed for user `8c89d96727ad45f397a2b6e9f0f3f729`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:26.439778 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6530f605-de28-426c-9c5a-350bcc1c1508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:26.442035 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7a5e9-92c5-4e99-a803-a5c034d48445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:26.444505 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7a5e9-92c5-4e99-a803-a5c034d48445 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:26.444800 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7a5e9-92c5-4e99-a803-a5c034d48445 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:26.445083 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7a5e9-92c5-4e99-a803-a5c034d48445 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:26.445860 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7a5e9-92c5-4e99-a803-a5c034d48445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:26.449488 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7a5e9-92c5-4e99-a803-a5c034d48445 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:26.476466 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1143/2269] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:11:26.483576 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7a5e9-92c5-4e99-a803-a5c034d48445 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:26.521177 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7a5e9-92c5-4e99-a803-a5c034d48445 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:26.537720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5b8b8-b53f-48e5-9c7b-9924f3427529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:26.538652 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5b8b8-b53f-48e5-9c7b-9924f3427529 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:26.540577 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5b8b8-b53f-48e5-9c7b-9924f3427529 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:26.540876 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5b8b8-b53f-48e5-9c7b-9924f3427529 admin admin] PATH_INFO: `/v3/projects/9ce06bffca1a469194ba7e945510f424/users/bd57b47fc89748b1bc8a0083873ff7a0/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:26.550458 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b5b8b8-b53f-48e5-9c7b-9924f3427529 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ce06bffca1a469194ba7e945510f424, user_id=bd57b47fc89748b1bc8a0083873ff7a0, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:26.553178 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b5b8b8-b53f-48e5-9c7b-9924f3427529 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:26.584524 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1144/2270] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:11:26 2022] PUT /identity/v3/projects/9ce06bffca1a469194ba7e945510f424/users/bd57b47fc89748b1bc8a0083873ff7a0/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:26.595846 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddacb3-42d1-47a9-8d51-70e874144e28 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:26.596413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddacb3-42d1-47a9-8d51-70e874144e28 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:26.596857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddacb3-42d1-47a9-8d51-70e874144e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:26.620201 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1127/2271] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:26 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:26.623481 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6530f605-de28-426c-9c5a-350bcc1c1508 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:26.636370 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6530f605-de28-426c-9c5a-350bcc1c1508 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:26.657611 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-f0ddacb3-42d1-47a9-8d51-70e874144e28 None None] MFA Rules not processed for user `bd57b47fc89748b1bc8a0083873ff7a0`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:26.659466 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f0ddacb3-42d1-47a9-8d51-70e874144e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:26.763361 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fefc084-7520-41c0-9d1d-1a639ec1b55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:26.764079 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefc084-7520-41c0-9d1d-1a639ec1b55c admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:26.764434 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefc084-7520-41c0-9d1d-1a639ec1b55c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:26.764792 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefc084-7520-41c0-9d1d-1a639ec1b55c admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:26.767793 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fefc084-7520-41c0-9d1d-1a639ec1b55c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:26.771911 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fefc084-7520-41c0-9d1d-1a639ec1b55c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:26.828199 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1145/2272] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:26 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:26.844085 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4b621-df8f-4813-ac54-4bec6a754730 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:26.844675 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4b621-df8f-4813-ac54-4bec6a754730 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:26.845163 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4b621-df8f-4813-ac54-4bec6a754730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:26.877486 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-5fd4b621-df8f-4813-ac54-4bec6a754730 None None] MFA Rules not processed for user `6a8350c0cb814c66b94775110721dee4`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:26.878896 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5fd4b621-df8f-4813-ac54-4bec6a754730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:26.975612 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1128/2273] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:11:26 2022] POST /identity/v3/projects => generated 409 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:11:26.988266 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fefc084-7520-41c0-9d1d-1a639ec1b55c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:26.990303 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1146/2274] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:27.014806 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4b621-df8f-4813-ac54-4bec6a754730 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:27.014806 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5fd4b621-df8f-4813-ac54-4bec6a754730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:27.171815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fefc084-7520-41c0-9d1d-1a639ec1b55c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:27.183652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17770ceb-dcda-438e-82d9-a1bcc23faef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:27.185214 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17770ceb-dcda-438e-82d9-a1bcc23faef3 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:27.185807 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17770ceb-dcda-438e-82d9-a1bcc23faef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:27.186237 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17770ceb-dcda-438e-82d9-a1bcc23faef3 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:27.187148 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17770ceb-dcda-438e-82d9-a1bcc23faef3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:27.189328 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17770ceb-dcda-438e-82d9-a1bcc23faef3 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:27.193712 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4b621-df8f-4813-ac54-4bec6a754730 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:27.302583 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62400a79-a3f8-4438-aea7-f56531901437 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:27.303481 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1129/2275] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:11:26 2022] POST /identity/v3/users => generated 311 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:11:27.304326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62400a79-a3f8-4438-aea7-f56531901437 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:27.304458 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17770ceb-dcda-438e-82d9-a1bcc23faef3 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:27.304989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62400a79-a3f8-4438-aea7-f56531901437 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:27.305428 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62400a79-a3f8-4438-aea7-f56531901437 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:27.331606 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17770ceb-dcda-438e-82d9-a1bcc23faef3 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:27.354733 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175312e-2f32-422a-9243-60a3ec019ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:27.355442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175312e-2f32-422a-9243-60a3ec019ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:27.357636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175312e-2f32-422a-9243-60a3ec019ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:27.357636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175312e-2f32-422a-9243-60a3ec019ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:27.357636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c175312e-2f32-422a-9243-60a3ec019ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:27.363258 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c175312e-2f32-422a-9243-60a3ec019ac6 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:27.399328 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1130/2276] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:11:27.409819 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175312e-2f32-422a-9243-60a3ec019ac6 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:27.417729 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62400a79-a3f8-4438-aea7-f56531901437 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:27.426250 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62400a79-a3f8-4438-aea7-f56531901437 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:27.432052 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175312e-2f32-422a-9243-60a3ec019ac6 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:27.452118 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1147/2277] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:11:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:11:27.455218 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e59fd-183f-4f08-95af-0b264a374c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:27.456691 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e59fd-183f-4f08-95af-0b264a374c2d admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:27.456981 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e59fd-183f-4f08-95af-0b264a374c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:27.457266 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e59fd-183f-4f08-95af-0b264a374c2d admin admin] PATH_INFO: `/v3/projects/e3a21d19725c4c1b973bc885455c1ad9/users/5ee2d6d603a04732904d2891ce42f9f9/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:27.494963 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718e59fd-183f-4f08-95af-0b264a374c2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3a21d19725c4c1b973bc885455c1ad9, user_id=5ee2d6d603a04732904d2891ce42f9f9, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:27.497324 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718e59fd-183f-4f08-95af-0b264a374c2d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:27.573570 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1131/2278] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:11:27 2022] PUT /identity/v3/projects/e3a21d19725c4c1b973bc885455c1ad9/users/5ee2d6d603a04732904d2891ce42f9f9/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:27.575795 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62400a79-a3f8-4438-aea7-f56531901437 service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:27.593539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62400a79-a3f8-4438-aea7-f56531901437 service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:27.742464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40d83b-4f52-4c00-9a8e-1498b6e69738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:27.743172 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40d83b-4f52-4c00-9a8e-1498b6e69738 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:27.743460 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40d83b-4f52-4c00-9a8e-1498b6e69738 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:27.743736 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40d83b-4f52-4c00-9a8e-1498b6e69738 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:27.744466 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40d83b-4f52-4c00-9a8e-1498b6e69738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:27.746175 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40d83b-4f52-4c00-9a8e-1498b6e69738 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:27.770956 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1148/2279] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:11:27.774993 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e59fd-183f-4f08-95af-0b264a374c2d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:27.789066 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e59fd-183f-4f08-95af-0b264a374c2d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:27.802350 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddde1ad-a54a-4e49-8ecc-564f788f5dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:27.803539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddde1ad-a54a-4e49-8ecc-564f788f5dbe admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:27.803980 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddde1ad-a54a-4e49-8ecc-564f788f5dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:27.804409 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddde1ad-a54a-4e49-8ecc-564f788f5dbe admin admin] PATH_INFO: `/v3/projects/e3a21d19725c4c1b973bc885455c1ad9/users/5ee2d6d603a04732904d2891ce42f9f9/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:27.811954 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddde1ad-a54a-4e49-8ecc-564f788f5dbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3a21d19725c4c1b973bc885455c1ad9, user_id=5ee2d6d603a04732904d2891ce42f9f9, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:27.818634 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddde1ad-a54a-4e49-8ecc-564f788f5dbe admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:27.861952 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1132/2280] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:11:27 2022] PUT /identity/v3/projects/e3a21d19725c4c1b973bc885455c1ad9/users/5ee2d6d603a04732904d2891ce42f9f9/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:27.876281 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d6943-227d-4e20-85e8-ae49ac3499dc None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:27.881896 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d6943-227d-4e20-85e8-ae49ac3499dc None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:27.881896 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d6943-227d-4e20-85e8-ae49ac3499dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:27.942637 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-4f4d6943-227d-4e20-85e8-ae49ac3499dc None None] MFA Rules not processed for user `5ee2d6d603a04732904d2891ce42f9f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:27.944275 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4f4d6943-227d-4e20-85e8-ae49ac3499dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:28.052101 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1149/2281] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:27 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:28.338637 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddde1ad-a54a-4e49-8ecc-564f788f5dbe admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:28.346158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3ddde1ad-a54a-4e49-8ecc-564f788f5dbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:28.545071 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddde1ad-a54a-4e49-8ecc-564f788f5dbe admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:28.553552 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b1b40-35b6-4a5a-a9ee-3306e8b799de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:28.554559 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b1b40-35b6-4a5a-a9ee-3306e8b799de service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:28.554850 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b1b40-35b6-4a5a-a9ee-3306e8b799de service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:28.555132 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b1b40-35b6-4a5a-a9ee-3306e8b799de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:28.569934 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b1b40-35b6-4a5a-a9ee-3306e8b799de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:28.576531 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b1b40-35b6-4a5a-a9ee-3306e8b799de service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:28.587535 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1133/2282] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:11:28 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:11:28.710189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7e5da-3d0e-4131-973f-f700a9ee9de1 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:28.710773 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7e5da-3d0e-4131-973f-f700a9ee9de1 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:28.710773 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7e5da-3d0e-4131-973f-f700a9ee9de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:28.766714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-b4a7e5da-3d0e-4131-973f-f700a9ee9de1 None None] MFA Rules not processed for user `c816e51510ac44c9a2b3f5c022b5a3c3`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:28.767940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b4a7e5da-3d0e-4131-973f-f700a9ee9de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:28.851614 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b1b40-35b6-4a5a-a9ee-3306e8b799de service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:28.877906 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b1b40-35b6-4a5a-a9ee-3306e8b799de service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:28.900506 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d1472-b40f-4680-b767-9f997e54c205 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:28.902939 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d1472-b40f-4680-b767-9f997e54c205 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:28.903724 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d1472-b40f-4680-b767-9f997e54c205 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:28.904539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d1472-b40f-4680-b767-9f997e54c205 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:29.023107 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1150/2283] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:28 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:29.024209 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7e5da-3d0e-4131-973f-f700a9ee9de1 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:29.027942 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b4a7e5da-3d0e-4131-973f-f700a9ee9de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:29.122849 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d1472-b40f-4680-b767-9f997e54c205 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:29.123162 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d1472-b40f-4680-b767-9f997e54c205 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:29.148128 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1134/2284] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:11:28 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:11:29.213902 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7e5da-3d0e-4131-973f-f700a9ee9de1 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:29.227355 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9355c-4d15-486d-869c-c7ea601643e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:29.227355 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9355c-4d15-486d-869c-c7ea601643e4 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:29.227355 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9355c-4d15-486d-869c-c7ea601643e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:29.227355 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9355c-4d15-486d-869c-c7ea601643e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:29.229316 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae9355c-4d15-486d-869c-c7ea601643e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:29.232096 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae9355c-4d15-486d-869c-c7ea601643e4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:29.496115 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1151/2285] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:11:29 2022] POST /identity/v3/projects => generated 403 bytes in 472 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:11:29.533945 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d1472-b40f-4680-b767-9f997e54c205 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:29.534279 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9355c-4d15-486d-869c-c7ea601643e4 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:29.548894 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d1472-b40f-4680-b767-9f997e54c205 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:29.643918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a0b9f-4761-4e68-a43a-720e3dcff7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:29.643918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a0b9f-4761-4e68-a43a-720e3dcff7af admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:29.643918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a0b9f-4761-4e68-a43a-720e3dcff7af admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:29.652181 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9355c-4d15-486d-869c-c7ea601643e4 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:29.659550 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6dfec0-00f0-4526-98d0-a148a25debe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:29.660973 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6dfec0-00f0-4526-98d0-a148a25debe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:29.661415 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6dfec0-00f0-4526-98d0-a148a25debe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:29.661884 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6dfec0-00f0-4526-98d0-a148a25debe0 admin admin] PATH_INFO: `/v3/users/8c89d96727ad45f397a2b6e9f0f3f729` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:29.663333 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6dfec0-00f0-4526-98d0-a148a25debe0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c89d96727ad45f397a2b6e9f0f3f729)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:29.682339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6dfec0-00f0-4526-98d0-a148a25debe0 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:29.683699 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a0b9f-4761-4e68-a43a-720e3dcff7af admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:29.684634 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a0b9f-4761-4e68-a43a-720e3dcff7af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:29.692743 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a0b9f-4761-4e68-a43a-720e3dcff7af admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:29.833331 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1135/2286] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:11:29 2022] POST /identity/v3/users => generated 308 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:11:29.847663 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a0b9f-4761-4e68-a43a-720e3dcff7af admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:29.876482 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a0b9f-4761-4e68-a43a-720e3dcff7af admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:29.894085 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803ebed-6716-4936-b6eb-848802d104fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:29.897809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803ebed-6716-4936-b6eb-848802d104fe admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:29.898310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803ebed-6716-4936-b6eb-848802d104fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:29.898773 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803ebed-6716-4936-b6eb-848802d104fe admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:29.900635 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803ebed-6716-4936-b6eb-848802d104fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:29.906716 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803ebed-6716-4936-b6eb-848802d104fe admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:29.938899 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1136/2287] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:11:29.940193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803ebed-6716-4936-b6eb-848802d104fe admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:29.959520 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803ebed-6716-4936-b6eb-848802d104fe admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:29.967610 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac85bab-5fed-4218-b59b-a427bfc68b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:29.968798 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac85bab-5fed-4218-b59b-a427bfc68b4c admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:29.969365 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac85bab-5fed-4218-b59b-a427bfc68b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:29.969825 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac85bab-5fed-4218-b59b-a427bfc68b4c admin admin] PATH_INFO: `/v3/projects/df8aff4feefd46bba10664568c0433bf/users/fb80b52ef36a45a889c79e8e766b20ae/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:29.986586 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8d6dfec0-00f0-4526-98d0-a148a25debe0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c89d96727ad45f397a2b6e9f0f3f729'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:30.016663 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac85bab-5fed-4218-b59b-a427bfc68b4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=df8aff4feefd46bba10664568c0433bf, user_id=fb80b52ef36a45a889c79e8e766b20ae, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:30.017083 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8d6dfec0-00f0-4526-98d0-a148a25debe0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c89d96727ad45f397a2b6e9f0f3f729'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:30.029963 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac85bab-5fed-4218-b59b-a427bfc68b4c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:30.128422 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8d6dfec0-00f0-4526-98d0-a148a25debe0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c89d96727ad45f397a2b6e9f0f3f729'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:30.129049 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8d6dfec0-00f0-4526-98d0-a148a25debe0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c89d96727ad45f397a2b6e9f0f3f729'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:30.137049 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8d6dfec0-00f0-4526-98d0-a148a25debe0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c89d96727ad45f397a2b6e9f0f3f729'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:30.149789 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1137/2288] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:11:29 2022] PUT /identity/v3/projects/df8aff4feefd46bba10664568c0433bf/users/fb80b52ef36a45a889c79e8e766b20ae/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:30.151556 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1152/2289] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:11:29 2022] DELETE /identity/v3/users/8c89d96727ad45f397a2b6e9f0f3f729 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:11:30.158320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040974e5-7593-4d1b-a225-52538113c9fd None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:30.158819 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040974e5-7593-4d1b-a225-52538113c9fd None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:30.158961 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6dfec0-00f0-4526-98d0-a148a25debe0 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:30.159357 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040974e5-7593-4d1b-a225-52538113c9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:30.160707 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8d6dfec0-00f0-4526-98d0-a148a25debe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:30.218250 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-040974e5-7593-4d1b-a225-52538113c9fd None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:30.219783 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-040974e5-7593-4d1b-a225-52538113c9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:30.305850 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6dfec0-00f0-4526-98d0-a148a25debe0 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:30.318242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc22c5-6884-4377-a20b-05501ffa5f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:30.323603 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc22c5-6884-4377-a20b-05501ffa5f55 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:30.323603 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc22c5-6884-4377-a20b-05501ffa5f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:30.323603 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc22c5-6884-4377-a20b-05501ffa5f55 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:30.323603 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc22c5-6884-4377-a20b-05501ffa5f55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:30.323603 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc22c5-6884-4377-a20b-05501ffa5f55 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:30.337109 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1153/2290] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:11:30.341710 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc22c5-6884-4377-a20b-05501ffa5f55 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:30.367967 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc22c5-6884-4377-a20b-05501ffa5f55 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:30.383231 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5ce57-c0c0-465d-add7-b22a2822603c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:30.383231 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5ce57-c0c0-465d-add7-b22a2822603c admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:30.383231 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5ce57-c0c0-465d-add7-b22a2822603c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:30.383231 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5ce57-c0c0-465d-add7-b22a2822603c admin admin] PATH_INFO: `/v3/projects/df8aff4feefd46bba10664568c0433bf/users/fb80b52ef36a45a889c79e8e766b20ae/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:30.385544 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f5ce57-c0c0-465d-add7-b22a2822603c admin admin] RBAC: Authorizing `identity:create_grant(project_id=df8aff4feefd46bba10664568c0433bf, user_id=fb80b52ef36a45a889c79e8e766b20ae, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:30.388602 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f5ce57-c0c0-465d-add7-b22a2822603c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:30.425024 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1154/2291] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:11:30 2022] PUT /identity/v3/projects/df8aff4feefd46bba10664568c0433bf/users/fb80b52ef36a45a889c79e8e766b20ae/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:30.506470 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1138/2292] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:30.522570 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5ce57-c0c0-465d-add7-b22a2822603c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:30.524428 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c2f5ce57-c0c0-465d-add7-b22a2822603c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:30.682934 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5ce57-c0c0-465d-add7-b22a2822603c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:30.693505 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d40685-df83-4f60-9dff-e305f9f6735b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:30.694610 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d40685-df83-4f60-9dff-e305f9f6735b service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:30.695120 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d40685-df83-4f60-9dff-e305f9f6735b service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:30.695417 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d40685-df83-4f60-9dff-e305f9f6735b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:30.853953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d40685-df83-4f60-9dff-e305f9f6735b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:30.853953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d40685-df83-4f60-9dff-e305f9f6735b service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:30.877282 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1155/2293] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:11:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:11:31.112316 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040974e5-7593-4d1b-a225-52538113c9fd None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:31.113974 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-040974e5-7593-4d1b-a225-52538113c9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:31.252748 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040974e5-7593-4d1b-a225-52538113c9fd None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:31.390459 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf97f5f-156f-43bd-aeeb-a0c532e4115a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:31.391906 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf97f5f-156f-43bd-aeeb-a0c532e4115a service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:31.392236 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf97f5f-156f-43bd-aeeb-a0c532e4115a service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:31.392521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf97f5f-156f-43bd-aeeb-a0c532e4115a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:31.395152 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-faf97f5f-156f-43bd-aeeb-a0c532e4115a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:31.558746 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf97f5f-156f-43bd-aeeb-a0c532e4115a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:31.561352 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf97f5f-156f-43bd-aeeb-a0c532e4115a service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:31.582537 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1139/2294] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:11:31 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:11:33.008545 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d40685-df83-4f60-9dff-e305f9f6735b service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:33.010411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-30d40685-df83-4f60-9dff-e305f9f6735b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:33.049903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d40685-df83-4f60-9dff-e305f9f6735b service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:33.063622 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32850edc-1a9e-4d8f-9706-a52e12c83cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:33.064712 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32850edc-1a9e-4d8f-9706-a52e12c83cb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:33.065152 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32850edc-1a9e-4d8f-9706-a52e12c83cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:33.065883 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32850edc-1a9e-4d8f-9706-a52e12c83cb6 admin admin] PATH_INFO: `/v3/projects/0b878828e8e3444bb5fc5ef22593d450` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:33.068537 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32850edc-1a9e-4d8f-9706-a52e12c83cb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b878828e8e3444bb5fc5ef22593d450)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:33.073273 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32850edc-1a9e-4d8f-9706-a52e12c83cb6 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:33.230083 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-32850edc-1a9e-4d8f-9706-a52e12c83cb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b878828e8e3444bb5fc5ef22593d450', 'request_id': 'req-32850edc-1a9e-4d8f-9706-a52e12c83cb6'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:33.247165 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-32850edc-1a9e-4d8f-9706-a52e12c83cb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b878828e8e3444bb5fc5ef22593d450', 'request_id': 'req-32850edc-1a9e-4d8f-9706-a52e12c83cb6'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:33.273166 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-32850edc-1a9e-4d8f-9706-a52e12c83cb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b878828e8e3444bb5fc5ef22593d450', 'request_id': 'req-32850edc-1a9e-4d8f-9706-a52e12c83cb6'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:33.365556 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-32850edc-1a9e-4d8f-9706-a52e12c83cb6 admin admin] The token cache is being invalidate because project 0b878828e8e3444bb5fc5ef22593d450 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:11:33.365895 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-32850edc-1a9e-4d8f-9706-a52e12c83cb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:33.366989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-32850edc-1a9e-4d8f-9706-a52e12c83cb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:33.370034 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1156/2295] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:11:33 2022] DELETE /identity/v3/projects/0b878828e8e3444bb5fc5ef22593d450 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:33.374504 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf97f5f-156f-43bd-aeeb-a0c532e4115a service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:33.393795 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf97f5f-156f-43bd-aeeb-a0c532e4115a service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:33.688456 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de13f5a-d51b-4fff-880d-2c58161c50e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:33.690229 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de13f5a-d51b-4fff-880d-2c58161c50e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:33.691600 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de13f5a-d51b-4fff-880d-2c58161c50e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:33.691883 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de13f5a-d51b-4fff-880d-2c58161c50e2 admin admin] PATH_INFO: `/v3/users/5ee2d6d603a04732904d2891ce42f9f9` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:33.697803 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de13f5a-d51b-4fff-880d-2c58161c50e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ee2d6d603a04732904d2891ce42f9f9)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:33.702624 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de13f5a-d51b-4fff-880d-2c58161c50e2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:34.143762 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7de13f5a-d51b-4fff-880d-2c58161c50e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ee2d6d603a04732904d2891ce42f9f9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:34.187193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7de13f5a-d51b-4fff-880d-2c58161c50e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ee2d6d603a04732904d2891ce42f9f9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:34.313490 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7de13f5a-d51b-4fff-880d-2c58161c50e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ee2d6d603a04732904d2891ce42f9f9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:34.325460 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7de13f5a-d51b-4fff-880d-2c58161c50e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ee2d6d603a04732904d2891ce42f9f9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:34.326250 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7de13f5a-d51b-4fff-880d-2c58161c50e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ee2d6d603a04732904d2891ce42f9f9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:34.348149 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1140/2296] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:11:33 2022] DELETE /identity/v3/users/5ee2d6d603a04732904d2891ce42f9f9 => generated 0 bytes in 971 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:35.650960 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32850edc-1a9e-4d8f-9706-a52e12c83cb6 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:35.652490 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-32850edc-1a9e-4d8f-9706-a52e12c83cb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:35.671266 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32850edc-1a9e-4d8f-9706-a52e12c83cb6 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:35.827753 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b361e4-83b4-4e63-bc22-e83ee9a61103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:35.829941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b361e4-83b4-4e63-bc22-e83ee9a61103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:35.830382 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b361e4-83b4-4e63-bc22-e83ee9a61103 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:35.832686 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b361e4-83b4-4e63-bc22-e83ee9a61103 admin admin] PATH_INFO: `/v3/projects/e3a21d19725c4c1b973bc885455c1ad9` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:35.835191 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b361e4-83b4-4e63-bc22-e83ee9a61103 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3a21d19725c4c1b973bc885455c1ad9)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:35.861320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b361e4-83b4-4e63-bc22-e83ee9a61103 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:36.326653 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-80b361e4-83b4-4e63-bc22-e83ee9a61103 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3a21d19725c4c1b973bc885455c1ad9', 'request_id': 'req-80b361e4-83b4-4e63-bc22-e83ee9a61103'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:36.370452 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-80b361e4-83b4-4e63-bc22-e83ee9a61103 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3a21d19725c4c1b973bc885455c1ad9', 'request_id': 'req-80b361e4-83b4-4e63-bc22-e83ee9a61103'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:36.388393 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-80b361e4-83b4-4e63-bc22-e83ee9a61103 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3a21d19725c4c1b973bc885455c1ad9', 'request_id': 'req-80b361e4-83b4-4e63-bc22-e83ee9a61103'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:36.485477 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-80b361e4-83b4-4e63-bc22-e83ee9a61103 admin admin] The token cache is being invalidate because project e3a21d19725c4c1b973bc885455c1ad9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:11:36.485817 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-80b361e4-83b4-4e63-bc22-e83ee9a61103 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:36.486770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-80b361e4-83b4-4e63-bc22-e83ee9a61103 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:36.491952 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1157/2297] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:11:35 2022] DELETE /identity/v3/projects/e3a21d19725c4c1b973bc885455c1ad9 => generated 0 bytes in 838 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:36.493406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08167259-dfa8-48e6-8ab1-7291ab20602c None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:36.493944 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08167259-dfa8-48e6-8ab1-7291ab20602c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:36.494030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08167259-dfa8-48e6-8ab1-7291ab20602c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:36.520587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-08167259-dfa8-48e6-8ab1-7291ab20602c None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:36.522284 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-08167259-dfa8-48e6-8ab1-7291ab20602c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:36.686364 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1141/2298] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:11:36.686972 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4484f-cf4d-4a1d-aff6-93b39728e4c9 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:36.687428 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4484f-cf4d-4a1d-aff6-93b39728e4c9 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:36.687550 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4484f-cf4d-4a1d-aff6-93b39728e4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:36.702563 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b09f6c-08f4-4e3c-9ac5-6c1e57b07dc0 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:36.703157 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b09f6c-08f4-4e3c-9ac5-6c1e57b07dc0 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:36.703543 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b09f6c-08f4-4e3c-9ac5-6c1e57b07dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:36.717411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-cfd4484f-cf4d-4a1d-aff6-93b39728e4c9 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:36.719157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-cfd4484f-cf4d-4a1d-aff6-93b39728e4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:36.726619 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-c2b09f6c-08f4-4e3c-9ac5-6c1e57b07dc0 None None] MFA Rules not processed for user `8bd54cdc115e4ae9b202bd06c7658e4a`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:36.727992 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c2b09f6c-08f4-4e3c-9ac5-6c1e57b07dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:36.731871 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1158/2299] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:36.733017 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4484f-cf4d-4a1d-aff6-93b39728e4c9 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:36.743253 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4484f-cf4d-4a1d-aff6-93b39728e4c9 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:36.749484 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0e76c-2b6b-4b5f-841f-a06971308742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:36.750374 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0e76c-2b6b-4b5f-841f-a06971308742 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:36.750706 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0e76c-2b6b-4b5f-841f-a06971308742 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:36.751232 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0e76c-2b6b-4b5f-841f-a06971308742 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:36.752097 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b0e76c-2b6b-4b5f-841f-a06971308742 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:11:36.752477 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b0e76c-2b6b-4b5f-841f-a06971308742 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:36.754563 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b0e76c-2b6b-4b5f-841f-a06971308742 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:36.778778 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1159/2300] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:11:36.782831 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0e76c-2b6b-4b5f-841f-a06971308742 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:36.793974 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0e76c-2b6b-4b5f-841f-a06971308742 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:36.798252 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1142/2301] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:11:36.809012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56059cec-5334-43ae-8642-aca4f1995e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:36.809706 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56059cec-5334-43ae-8642-aca4f1995e0a admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:36.810160 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56059cec-5334-43ae-8642-aca4f1995e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:36.810445 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56059cec-5334-43ae-8642-aca4f1995e0a admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:36.811179 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56059cec-5334-43ae-8642-aca4f1995e0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:36.813704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56059cec-5334-43ae-8642-aca4f1995e0a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:36.985977 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1160/2302] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:11:36 2022] POST /identity/v3/projects => generated 375 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:11:36.990528 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b09f6c-08f4-4e3c-9ac5-6c1e57b07dc0 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:37.009111 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b09f6c-08f4-4e3c-9ac5-6c1e57b07dc0 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:37.190869 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7884611-3547-472a-aa3a-eb627083449b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:37.191635 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7884611-3547-472a-aa3a-eb627083449b admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:37.191920 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7884611-3547-472a-aa3a-eb627083449b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:37.192192 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7884611-3547-472a-aa3a-eb627083449b admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:37.192890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7884611-3547-472a-aa3a-eb627083449b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:37.195055 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7884611-3547-472a-aa3a-eb627083449b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:37.329218 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1143/2303] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:11:36 2022] POST /identity/v3/users => generated 288 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:11:37.333613 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56059cec-5334-43ae-8642-aca4f1995e0a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:37.366042 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56059cec-5334-43ae-8642-aca4f1995e0a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:37.381213 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97461f3d-28ff-4291-b34d-acff8af421e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:37.381873 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97461f3d-28ff-4291-b34d-acff8af421e7 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:37.382196 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97461f3d-28ff-4291-b34d-acff8af421e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:37.388068 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97461f3d-28ff-4291-b34d-acff8af421e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:37.388866 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97461f3d-28ff-4291-b34d-acff8af421e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:37.391045 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97461f3d-28ff-4291-b34d-acff8af421e7 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:37.438561 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7884611-3547-472a-aa3a-eb627083449b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:37.447110 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1161/2304] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:11:37.453350 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7884611-3547-472a-aa3a-eb627083449b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:37.477729 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a10b1-dde1-43f3-8a41-4f9f6880367b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:37.478691 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a10b1-dde1-43f3-8a41-4f9f6880367b admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:37.479142 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a10b1-dde1-43f3-8a41-4f9f6880367b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:37.479571 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a10b1-dde1-43f3-8a41-4f9f6880367b admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:37.480455 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3a10b1-dde1-43f3-8a41-4f9f6880367b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:37.482431 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3a10b1-dde1-43f3-8a41-4f9f6880367b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:37.512612 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97461f3d-28ff-4291-b34d-acff8af421e7 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:37.515344 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1144/2305] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:11:37.524041 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97461f3d-28ff-4291-b34d-acff8af421e7 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:37.535571 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcafeac6-e141-4cfc-8b35-2ed1b94a2dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:37.539717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafeac6-e141-4cfc-8b35-2ed1b94a2dee admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:37.539717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafeac6-e141-4cfc-8b35-2ed1b94a2dee admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:37.539717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafeac6-e141-4cfc-8b35-2ed1b94a2dee admin admin] PATH_INFO: `/v3/projects/752069cc7ddd43bbb82e22c42f32b482/users/57ae5450bfe2441885e623b19c6bd7ce/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:37.603578 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcafeac6-e141-4cfc-8b35-2ed1b94a2dee admin admin] RBAC: Authorizing `identity:create_grant(project_id=752069cc7ddd43bbb82e22c42f32b482, user_id=57ae5450bfe2441885e623b19c6bd7ce, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:37.606930 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcafeac6-e141-4cfc-8b35-2ed1b94a2dee admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:37.784945 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1162/2306] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:11:37 2022] PUT /identity/v3/projects/752069cc7ddd43bbb82e22c42f32b482/users/57ae5450bfe2441885e623b19c6bd7ce/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:11:37.787302 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244791f0-8474-48e1-9859-e2a547d6e684 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:37.787602 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244791f0-8474-48e1-9859-e2a547d6e684 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:37.787889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244791f0-8474-48e1-9859-e2a547d6e684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:37.855312 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-244791f0-8474-48e1-9859-e2a547d6e684 None None] MFA Rules not processed for user `57ae5450bfe2441885e623b19c6bd7ce`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:37.856636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-244791f0-8474-48e1-9859-e2a547d6e684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:38.050519 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1145/2307] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:38.055291 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcafeac6-e141-4cfc-8b35-2ed1b94a2dee admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:38.289211 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcafeac6-e141-4cfc-8b35-2ed1b94a2dee admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:38.301493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071dca44-2a52-4727-ba84-8a4d324fd033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:38.302451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071dca44-2a52-4727-ba84-8a4d324fd033 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:38.302902 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071dca44-2a52-4727-ba84-8a4d324fd033 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:38.308120 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071dca44-2a52-4727-ba84-8a4d324fd033 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:38.310965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071dca44-2a52-4727-ba84-8a4d324fd033 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:38.315843 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071dca44-2a52-4727-ba84-8a4d324fd033 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:38.451283 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1163/2308] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:11:38 2022] POST /identity/v3/projects => generated 377 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:11:38.455076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244791f0-8474-48e1-9859-e2a547d6e684 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:38.479341 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244791f0-8474-48e1-9859-e2a547d6e684 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:38.569112 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb88d5-135c-4071-9f3d-5ca34b3cbc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:38.569890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb88d5-135c-4071-9f3d-5ca34b3cbc35 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:38.570176 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb88d5-135c-4071-9f3d-5ca34b3cbc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:38.570522 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb88d5-135c-4071-9f3d-5ca34b3cbc35 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:38.571146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffb88d5-135c-4071-9f3d-5ca34b3cbc35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:38.573089 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffb88d5-135c-4071-9f3d-5ca34b3cbc35 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:38.712294 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1146/2309] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:11:38 2022] POST /identity/v3/users => generated 295 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:11:38.716999 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071dca44-2a52-4727-ba84-8a4d324fd033 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:38.746948 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071dca44-2a52-4727-ba84-8a4d324fd033 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:38.764168 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb053e13-6a5c-4841-8985-b46ce55ff96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:38.767352 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb053e13-6a5c-4841-8985-b46ce55ff96b admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:38.767677 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb053e13-6a5c-4841-8985-b46ce55ff96b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:38.767968 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb053e13-6a5c-4841-8985-b46ce55ff96b admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:38.768741 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb053e13-6a5c-4841-8985-b46ce55ff96b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:38.772575 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb053e13-6a5c-4841-8985-b46ce55ff96b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:38.790396 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1164/2310] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:11:38.796032 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb88d5-135c-4071-9f3d-5ca34b3cbc35 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:38.897310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb88d5-135c-4071-9f3d-5ca34b3cbc35 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:38.924823 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85aa5e3-5257-4564-93ce-c5d876dab107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:38.925742 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85aa5e3-5257-4564-93ce-c5d876dab107 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:38.926054 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85aa5e3-5257-4564-93ce-c5d876dab107 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:38.926329 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85aa5e3-5257-4564-93ce-c5d876dab107 admin admin] PATH_INFO: `/v3/projects/663dac500bee407cba883268de6ff8cf/users/a392e31a13bb403da7f9bb2261b9d9a4/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:38.971176 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85aa5e3-5257-4564-93ce-c5d876dab107 admin admin] RBAC: Authorizing `identity:create_grant(project_id=663dac500bee407cba883268de6ff8cf, user_id=a392e31a13bb403da7f9bb2261b9d9a4, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:38.976529 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85aa5e3-5257-4564-93ce-c5d876dab107 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:39.127048 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1147/2311] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:11:38 2022] PUT /identity/v3/projects/663dac500bee407cba883268de6ff8cf/users/a392e31a13bb403da7f9bb2261b9d9a4/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:39.131436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb053e13-6a5c-4841-8985-b46ce55ff96b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:39.147465 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb053e13-6a5c-4841-8985-b46ce55ff96b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:39.256605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16dc58-3892-42d4-97ef-b842e2b95d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:39.257591 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16dc58-3892-42d4-97ef-b842e2b95d8a admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:39.258095 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16dc58-3892-42d4-97ef-b842e2b95d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:39.258677 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16dc58-3892-42d4-97ef-b842e2b95d8a admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:39.259742 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16dc58-3892-42d4-97ef-b842e2b95d8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:39.261613 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16dc58-3892-42d4-97ef-b842e2b95d8a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:39.282890 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1165/2312] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:11:39.287105 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85aa5e3-5257-4564-93ce-c5d876dab107 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:39.307440 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85aa5e3-5257-4564-93ce-c5d876dab107 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:39.326175 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8572850-cf44-427f-8bd9-e80c332e75b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:39.327266 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8572850-cf44-427f-8bd9-e80c332e75b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:39.327797 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8572850-cf44-427f-8bd9-e80c332e75b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:39.328350 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8572850-cf44-427f-8bd9-e80c332e75b8 admin admin] PATH_INFO: `/v3/projects/663dac500bee407cba883268de6ff8cf/users/a392e31a13bb403da7f9bb2261b9d9a4/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:39.335929 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8572850-cf44-427f-8bd9-e80c332e75b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=663dac500bee407cba883268de6ff8cf, user_id=a392e31a13bb403da7f9bb2261b9d9a4, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:39.338574 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8572850-cf44-427f-8bd9-e80c332e75b8 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:39.369273 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1148/2313] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:11:39 2022] PUT /identity/v3/projects/663dac500bee407cba883268de6ff8cf/users/a392e31a13bb403da7f9bb2261b9d9a4/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:11:39.382013 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a5bf6-ca8d-40cf-a89e-9bec3aef6e45 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:39.387046 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a5bf6-ca8d-40cf-a89e-9bec3aef6e45 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:39.387046 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a5bf6-ca8d-40cf-a89e-9bec3aef6e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:39.414347 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-163a5bf6-ca8d-40cf-a89e-9bec3aef6e45 None None] MFA Rules not processed for user `a392e31a13bb403da7f9bb2261b9d9a4`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:39.415890 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-163a5bf6-ca8d-40cf-a89e-9bec3aef6e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:39.543609 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1166/2314] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:39 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:39.655397 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8572850-cf44-427f-8bd9-e80c332e75b8 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:39.657930 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a8572850-cf44-427f-8bd9-e80c332e75b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:39.808997 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8572850-cf44-427f-8bd9-e80c332e75b8 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:39.817009 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1842901-97db-42bd-847c-5ae7853d3be7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:39.818201 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1842901-97db-42bd-847c-5ae7853d3be7 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:39.818660 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1842901-97db-42bd-847c-5ae7853d3be7 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:39.819093 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1842901-97db-42bd-847c-5ae7853d3be7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:39.830654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1842901-97db-42bd-847c-5ae7853d3be7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:39.833833 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1842901-97db-42bd-847c-5ae7853d3be7 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:39.876022 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1149/2315] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:11:39 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:11:42.075303 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a5bf6-ca8d-40cf-a89e-9bec3aef6e45 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:42.101194 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a5bf6-ca8d-40cf-a89e-9bec3aef6e45 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:42.117459 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252af97-feba-4dc8-b571-70216bfe9332 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:42.118969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252af97-feba-4dc8-b571-70216bfe9332 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:42.119474 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252af97-feba-4dc8-b571-70216bfe9332 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:42.119736 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252af97-feba-4dc8-b571-70216bfe9332 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:42.122011 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5252af97-feba-4dc8-b571-70216bfe9332 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:42.348168 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252af97-feba-4dc8-b571-70216bfe9332 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:42.354226 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252af97-feba-4dc8-b571-70216bfe9332 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:42.376987 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1167/2316] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:11:42 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:11:44.198027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1842901-97db-42bd-847c-5ae7853d3be7 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:44.390795 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1842901-97db-42bd-847c-5ae7853d3be7 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:44.406781 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c5bad1-7c6f-4d03-b2ad-db679a4ca4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:44.408532 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5bad1-7c6f-4d03-b2ad-db679a4ca4fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:44.412442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5bad1-7c6f-4d03-b2ad-db679a4ca4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:44.413102 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5bad1-7c6f-4d03-b2ad-db679a4ca4fa admin admin] PATH_INFO: `/v3/users/57ae5450bfe2441885e623b19c6bd7ce` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:44.417164 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c5bad1-7c6f-4d03-b2ad-db679a4ca4fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=57ae5450bfe2441885e623b19c6bd7ce)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:44.420468 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c5bad1-7c6f-4d03-b2ad-db679a4ca4fa admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:44.645180 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-31c5bad1-7c6f-4d03-b2ad-db679a4ca4fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57ae5450bfe2441885e623b19c6bd7ce'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:44.699895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-31c5bad1-7c6f-4d03-b2ad-db679a4ca4fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57ae5450bfe2441885e623b19c6bd7ce'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:44.786262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-31c5bad1-7c6f-4d03-b2ad-db679a4ca4fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57ae5450bfe2441885e623b19c6bd7ce'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:44.794690 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-31c5bad1-7c6f-4d03-b2ad-db679a4ca4fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57ae5450bfe2441885e623b19c6bd7ce'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:44.796840 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-31c5bad1-7c6f-4d03-b2ad-db679a4ca4fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57ae5450bfe2441885e623b19c6bd7ce'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:44.806642 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1150/2317] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:11:44 2022] DELETE /identity/v3/users/57ae5450bfe2441885e623b19c6bd7ce => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:44.814132 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497a828-f019-481f-a2e8-e9fc083c70be None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:44.814642 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497a828-f019-481f-a2e8-e9fc083c70be None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:44.814747 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497a828-f019-481f-a2e8-e9fc083c70be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:44.843637 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-5497a828-f019-481f-a2e8-e9fc083c70be None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:44.851262 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5497a828-f019-481f-a2e8-e9fc083c70be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:44.933102 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14611782-9da2-42a3-88bc-2a64cd0ce757 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:44.933448 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14611782-9da2-42a3-88bc-2a64cd0ce757 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:44.933880 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14611782-9da2-42a3-88bc-2a64cd0ce757 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:44.935905 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1151/2318] 10.222.0.23 () {54 vars in 921 bytes} [Sat Apr 30 21:11:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:11:44.942603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c826b2d-6bfa-419d-8402-9a568a6e4102 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:44.943018 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c826b2d-6bfa-419d-8402-9a568a6e4102 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:44.943401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c826b2d-6bfa-419d-8402-9a568a6e4102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:44.982508 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1168/2319] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:44.992731 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-8c826b2d-6bfa-419d-8402-9a568a6e4102 None None] MFA Rules not processed for user `4ad3f89b7037413a83c7905cef263b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:44.993253 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497a828-f019-481f-a2e8-e9fc083c70be None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:44.994815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8c826b2d-6bfa-419d-8402-9a568a6e4102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:45.000426 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5497a828-f019-481f-a2e8-e9fc083c70be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:45.102675 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497a828-f019-481f-a2e8-e9fc083c70be None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:45.107232 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9841036-e556-48e3-8bb6-35033deace78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:45.108315 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9841036-e556-48e3-8bb6-35033deace78 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:45.108765 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9841036-e556-48e3-8bb6-35033deace78 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:45.109201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9841036-e556-48e3-8bb6-35033deace78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:45.122104 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9841036-e556-48e3-8bb6-35033deace78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:45.123317 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1152/2320] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Apr 30 21:11:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Apr 30 21:11:45.124433 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9841036-e556-48e3-8bb6-35033deace78 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:45.140800 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1169/2321] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:11:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:11:45.154590 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c826b2d-6bfa-419d-8402-9a568a6e4102 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:45.156885 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8c826b2d-6bfa-419d-8402-9a568a6e4102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:45.173607 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c826b2d-6bfa-419d-8402-9a568a6e4102 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:45.179539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d2325-2bc8-43c4-93f2-6603c6797161 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:45.180324 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d2325-2bc8-43c4-93f2-6603c6797161 service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:45.180677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d2325-2bc8-43c4-93f2-6603c6797161 service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:45.181027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d2325-2bc8-43c4-93f2-6603c6797161 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:45.195198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d2325-2bc8-43c4-93f2-6603c6797161 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:45.195198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d2325-2bc8-43c4-93f2-6603c6797161 service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:45.205503 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1153/2322] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:11:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:11:45.248259 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6141f9-ed77-46a3-8e80-4cfd3ba1e4c4 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:45.248990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6141f9-ed77-46a3-8e80-4cfd3ba1e4c4 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:45.249471 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6141f9-ed77-46a3-8e80-4cfd3ba1e4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:45.327724 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-da6141f9-ed77-46a3-8e80-4cfd3ba1e4c4 None None] MFA Rules not processed for user `fb80b52ef36a45a889c79e8e766b20ae`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:45.329054 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-da6141f9-ed77-46a3-8e80-4cfd3ba1e4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:45.475717 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1170/2323] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:45 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:45.613531 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d2325-2bc8-43c4-93f2-6603c6797161 service placement] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:45.618733 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-068d2325-2bc8-43c4-93f2-6603c6797161 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:45.775650 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d2325-2bc8-43c4-93f2-6603c6797161 service placement] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:45.784779 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23b59e-dd2d-4ad7-b441-51696aa8aa92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:45.785975 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23b59e-dd2d-4ad7-b441-51696aa8aa92 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:45.786491 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23b59e-dd2d-4ad7-b441-51696aa8aa92 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:45.786985 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23b59e-dd2d-4ad7-b441-51696aa8aa92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:45.792285 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-db23b59e-dd2d-4ad7-b441-51696aa8aa92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:45.889295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db23b59e-dd2d-4ad7-b441-51696aa8aa92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:45.892259 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db23b59e-dd2d-4ad7-b441-51696aa8aa92 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:45.905230 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1154/2324] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:11:45 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:11:46.012468 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6141f9-ed77-46a3-8e80-4cfd3ba1e4c4 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:46.014674 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-da6141f9-ed77-46a3-8e80-4cfd3ba1e4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:46.033561 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6141f9-ed77-46a3-8e80-4cfd3ba1e4c4 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:46.038717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d930299-1ff6-458f-a470-dbfc8b4052db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:46.039608 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d930299-1ff6-458f-a470-dbfc8b4052db admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:46.039965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d930299-1ff6-458f-a470-dbfc8b4052db admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:46.040387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d930299-1ff6-458f-a470-dbfc8b4052db admin admin] PATH_INFO: `/v3/projects/752069cc7ddd43bbb82e22c42f32b482` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:46.041602 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d930299-1ff6-458f-a470-dbfc8b4052db admin admin] RBAC: Authorizing `identity:delete_project(project_id=752069cc7ddd43bbb82e22c42f32b482)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:46.043670 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d930299-1ff6-458f-a470-dbfc8b4052db admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:46.198982 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3d930299-1ff6-458f-a470-dbfc8b4052db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '752069cc7ddd43bbb82e22c42f32b482', 'request_id': 'req-3d930299-1ff6-458f-a470-dbfc8b4052db'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:46.208890 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3d930299-1ff6-458f-a470-dbfc8b4052db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '752069cc7ddd43bbb82e22c42f32b482', 'request_id': 'req-3d930299-1ff6-458f-a470-dbfc8b4052db'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:46.218403 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3d930299-1ff6-458f-a470-dbfc8b4052db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '752069cc7ddd43bbb82e22c42f32b482', 'request_id': 'req-3d930299-1ff6-458f-a470-dbfc8b4052db'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:46.229426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23b59e-dd2d-4ad7-b441-51696aa8aa92 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:46.240344 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23b59e-dd2d-4ad7-b441-51696aa8aa92 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:46.330604 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49730d-a6cc-40dc-a853-95ba54f2a349 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:46.331579 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49730d-a6cc-40dc-a853-95ba54f2a349 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:46.332053 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49730d-a6cc-40dc-a853-95ba54f2a349 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:46.332586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49730d-a6cc-40dc-a853-95ba54f2a349 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:46.370234 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3d930299-1ff6-458f-a470-dbfc8b4052db admin admin] The token cache is being invalidate because project 752069cc7ddd43bbb82e22c42f32b482 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:11:46.370828 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3d930299-1ff6-458f-a470-dbfc8b4052db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:46.374098 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3d930299-1ff6-458f-a470-dbfc8b4052db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:46.376687 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1171/2325] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:11:46 2022] DELETE /identity/v3/projects/752069cc7ddd43bbb82e22c42f32b482 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:46.380915 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d930299-1ff6-458f-a470-dbfc8b4052db admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:46.383966 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3d930299-1ff6-458f-a470-dbfc8b4052db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:46.406105 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e49730d-a6cc-40dc-a853-95ba54f2a349 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:46.407939 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e49730d-a6cc-40dc-a853-95ba54f2a349 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:46.422307 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1155/2326] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:11:46 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:11:46.484059 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d930299-1ff6-458f-a470-dbfc8b4052db admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:46.489512 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48653f-e6be-40e8-a5a4-68c0e694fe47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:46.490763 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48653f-e6be-40e8-a5a4-68c0e694fe47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:46.491198 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48653f-e6be-40e8-a5a4-68c0e694fe47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:46.491718 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48653f-e6be-40e8-a5a4-68c0e694fe47 admin admin] PATH_INFO: `/v3/users/a392e31a13bb403da7f9bb2261b9d9a4` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:46.492974 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a48653f-e6be-40e8-a5a4-68c0e694fe47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a392e31a13bb403da7f9bb2261b9d9a4)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:46.495220 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a48653f-e6be-40e8-a5a4-68c0e694fe47 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:46.751734 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7a48653f-e6be-40e8-a5a4-68c0e694fe47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a392e31a13bb403da7f9bb2261b9d9a4'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:46.765447 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7a48653f-e6be-40e8-a5a4-68c0e694fe47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a392e31a13bb403da7f9bb2261b9d9a4'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:46.854940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7a48653f-e6be-40e8-a5a4-68c0e694fe47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a392e31a13bb403da7f9bb2261b9d9a4'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:46.856444 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7a48653f-e6be-40e8-a5a4-68c0e694fe47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a392e31a13bb403da7f9bb2261b9d9a4'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:46.865137 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7a48653f-e6be-40e8-a5a4-68c0e694fe47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a392e31a13bb403da7f9bb2261b9d9a4'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:46.873144 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1172/2327] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:11:46 2022] DELETE /identity/v3/users/a392e31a13bb403da7f9bb2261b9d9a4 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:11:47.250355 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d47fd-e1b6-4838-aa3a-4658719aaa82 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:47.250846 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d47fd-e1b6-4838-aa3a-4658719aaa82 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:47.251047 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d47fd-e1b6-4838-aa3a-4658719aaa82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:47.278971 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-c28d47fd-e1b6-4838-aa3a-4658719aaa82 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:47.278971 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c28d47fd-e1b6-4838-aa3a-4658719aaa82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:47.332473 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1156/2328] 10.222.0.23 () {58 vars in 967 bytes} [Sat Apr 30 21:11:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:47.345988 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48653f-e6be-40e8-a5a4-68c0e694fe47 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:47.347500 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7a48653f-e6be-40e8-a5a4-68c0e694fe47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:47.371594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d47fd-e1b6-4838-aa3a-4658719aaa82 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:47.373502 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c28d47fd-e1b6-4838-aa3a-4658719aaa82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:47.431365 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48653f-e6be-40e8-a5a4-68c0e694fe47 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:47.438742 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48d10f-4819-4b51-8bdf-93c4605120a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:47.439520 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48d10f-4819-4b51-8bdf-93c4605120a5 service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:47.439903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48d10f-4819-4b51-8bdf-93c4605120a5 service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:47.440522 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48d10f-4819-4b51-8bdf-93c4605120a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:47.448146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d47fd-e1b6-4838-aa3a-4658719aaa82 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:47.450620 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d48d10f-4819-4b51-8bdf-93c4605120a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:47.452241 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d48d10f-4819-4b51-8bdf-93c4605120a5 service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:47.455986 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f891d-d53f-4610-98c3-86f9c89fa3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:47.456965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f891d-d53f-4610-98c3-86f9c89fa3b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:47.457345 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f891d-d53f-4610-98c3-86f9c89fa3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:47.457715 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f891d-d53f-4610-98c3-86f9c89fa3b5 admin admin] PATH_INFO: `/v3/projects/663dac500bee407cba883268de6ff8cf` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:47.459026 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797f891d-d53f-4610-98c3-86f9c89fa3b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=663dac500bee407cba883268de6ff8cf)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:47.461038 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797f891d-d53f-4610-98c3-86f9c89fa3b5 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:47.461932 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1173/2329] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:11:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:11:47.597091 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-797f891d-d53f-4610-98c3-86f9c89fa3b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '663dac500bee407cba883268de6ff8cf', 'request_id': 'req-797f891d-d53f-4610-98c3-86f9c89fa3b5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:47.604027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-797f891d-d53f-4610-98c3-86f9c89fa3b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '663dac500bee407cba883268de6ff8cf', 'request_id': 'req-797f891d-d53f-4610-98c3-86f9c89fa3b5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:47.620690 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-797f891d-d53f-4610-98c3-86f9c89fa3b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '663dac500bee407cba883268de6ff8cf', 'request_id': 'req-797f891d-d53f-4610-98c3-86f9c89fa3b5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:47.789492 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-797f891d-d53f-4610-98c3-86f9c89fa3b5 admin admin] The token cache is being invalidate because project 663dac500bee407cba883268de6ff8cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:11:47.790042 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-797f891d-d53f-4610-98c3-86f9c89fa3b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:47.790763 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-797f891d-d53f-4610-98c3-86f9c89fa3b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:47.794092 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1157/2330] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:11:47 2022] DELETE /identity/v3/projects/663dac500bee407cba883268de6ff8cf => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:47.798631 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145461c3-d0be-4e0c-8ef4-064e7749b86a None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:47.798884 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145461c3-d0be-4e0c-8ef4-064e7749b86a None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:47.799270 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145461c3-d0be-4e0c-8ef4-064e7749b86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:47.833407 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-145461c3-d0be-4e0c-8ef4-064e7749b86a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:47.835141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-145461c3-d0be-4e0c-8ef4-064e7749b86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:47.917010 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1174/2331] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:47.920146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d96f3-2c8b-41c4-9d97-6a12268cfac4 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:47.920481 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d96f3-2c8b-41c4-9d97-6a12268cfac4 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:47.920820 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d96f3-2c8b-41c4-9d97-6a12268cfac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:47.944138 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-ba9d96f3-2c8b-41c4-9d97-6a12268cfac4 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:47.945485 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ba9d96f3-2c8b-41c4-9d97-6a12268cfac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:47.961550 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1158/2332] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:47.963426 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145461c3-d0be-4e0c-8ef4-064e7749b86a None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:47.976504 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145461c3-d0be-4e0c-8ef4-064e7749b86a None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:47.989129 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cea02d-1248-455a-82e5-e0323c5a50d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:47.992762 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cea02d-1248-455a-82e5-e0323c5a50d8 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:47.992762 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cea02d-1248-455a-82e5-e0323c5a50d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:47.992762 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cea02d-1248-455a-82e5-e0323c5a50d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:47.992762 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cea02d-1248-455a-82e5-e0323c5a50d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:11:47.992762 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cea02d-1248-455a-82e5-e0323c5a50d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:47.994020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cea02d-1248-455a-82e5-e0323c5a50d8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:48.008130 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1175/2333] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:11:48.014006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d96f3-2c8b-41c4-9d97-6a12268cfac4 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:48.026749 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d96f3-2c8b-41c4-9d97-6a12268cfac4 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:48.031565 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5bd31-e597-4a3e-93bd-b2505bb915e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:48.032441 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5bd31-e597-4a3e-93bd-b2505bb915e2 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:48.032558 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5bd31-e597-4a3e-93bd-b2505bb915e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:48.032768 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5bd31-e597-4a3e-93bd-b2505bb915e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:48.033456 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf5bd31-e597-4a3e-93bd-b2505bb915e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:48.044259 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf5bd31-e597-4a3e-93bd-b2505bb915e2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:48.166465 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1159/2334] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:11:48 2022] POST /identity/v3/projects => generated 375 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:11:48.170939 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cea02d-1248-455a-82e5-e0323c5a50d8 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:48.181579 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cea02d-1248-455a-82e5-e0323c5a50d8 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:48.246008 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7a131-9a94-4508-849f-6bbb31fcb13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:48.246569 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7a131-9a94-4508-849f-6bbb31fcb13f admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:48.246740 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7a131-9a94-4508-849f-6bbb31fcb13f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:48.247020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7a131-9a94-4508-849f-6bbb31fcb13f admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:48.247732 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade7a131-9a94-4508-849f-6bbb31fcb13f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:48.249799 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade7a131-9a94-4508-849f-6bbb31fcb13f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:48.323413 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1176/2335] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:11:48 2022] POST /identity/v3/users => generated 288 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:11:48.327768 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5bd31-e597-4a3e-93bd-b2505bb915e2 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:48.338871 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5bd31-e597-4a3e-93bd-b2505bb915e2 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:48.344497 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac1183-259a-482f-b559-25ea352d68f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:48.345237 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac1183-259a-482f-b559-25ea352d68f1 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:48.345586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac1183-259a-482f-b559-25ea352d68f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:48.345962 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac1183-259a-482f-b559-25ea352d68f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:48.346899 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac1183-259a-482f-b559-25ea352d68f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:48.348577 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac1183-259a-482f-b559-25ea352d68f1 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:48.363314 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1160/2336] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:11:48.367555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7a131-9a94-4508-849f-6bbb31fcb13f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:48.379083 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7a131-9a94-4508-849f-6bbb31fcb13f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:48.383830 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0776f2-a8d3-4c0c-b945-3b5e076b15c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:48.384485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0776f2-a8d3-4c0c-b945-3b5e076b15c0 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:48.384936 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0776f2-a8d3-4c0c-b945-3b5e076b15c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:48.385225 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0776f2-a8d3-4c0c-b945-3b5e076b15c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:48.385968 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0776f2-a8d3-4c0c-b945-3b5e076b15c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:48.387594 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0776f2-a8d3-4c0c-b945-3b5e076b15c0 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:48.400177 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1177/2337] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:11:48.405153 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac1183-259a-482f-b559-25ea352d68f1 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:48.416599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac1183-259a-482f-b559-25ea352d68f1 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:48.423450 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e9e83-1d49-4155-9bcb-98c5d93e48e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:48.424462 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e9e83-1d49-4155-9bcb-98c5d93e48e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:48.424895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e9e83-1d49-4155-9bcb-98c5d93e48e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:48.425269 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e9e83-1d49-4155-9bcb-98c5d93e48e1 admin admin] PATH_INFO: `/v3/projects/bf65819be9e34f9b9da693b96daf4b58/users/343effb31078468aa12fa7693f7620c6/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:48.451811 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e9e83-1d49-4155-9bcb-98c5d93e48e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf65819be9e34f9b9da693b96daf4b58, user_id=343effb31078468aa12fa7693f7620c6, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:48.454693 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e9e83-1d49-4155-9bcb-98c5d93e48e1 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:48.541325 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1161/2338] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:11:48 2022] PUT /identity/v3/projects/bf65819be9e34f9b9da693b96daf4b58/users/343effb31078468aa12fa7693f7620c6/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:48.558363 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bfc5fe-507a-4561-b3b4-6d4d29b805b1 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:48.558657 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bfc5fe-507a-4561-b3b4-6d4d29b805b1 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:48.559123 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bfc5fe-507a-4561-b3b4-6d4d29b805b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:48.589486 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-f0bfc5fe-507a-4561-b3b4-6d4d29b805b1 None None] MFA Rules not processed for user `343effb31078468aa12fa7693f7620c6`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:48.591362 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f0bfc5fe-507a-4561-b3b4-6d4d29b805b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:48.681791 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1178/2339] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:48.683143 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e9e83-1d49-4155-9bcb-98c5d93e48e1 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:48.765427 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e9e83-1d49-4155-9bcb-98c5d93e48e1 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:48.770559 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499efdb7-2b80-4236-ba8b-81d4634005f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:48.773497 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499efdb7-2b80-4236-ba8b-81d4634005f6 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:48.773497 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499efdb7-2b80-4236-ba8b-81d4634005f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:48.773497 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499efdb7-2b80-4236-ba8b-81d4634005f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:48.773497 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499efdb7-2b80-4236-ba8b-81d4634005f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:48.775445 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499efdb7-2b80-4236-ba8b-81d4634005f6 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:48.875731 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1162/2340] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:11:48 2022] POST /identity/v3/projects => generated 373 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:11:48.879985 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bfc5fe-507a-4561-b3b4-6d4d29b805b1 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:48.891863 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bfc5fe-507a-4561-b3b4-6d4d29b805b1 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:48.977382 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d6942-c385-447c-a29a-ef16357ce669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:48.977382 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d6942-c385-447c-a29a-ef16357ce669 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:48.977382 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d6942-c385-447c-a29a-ef16357ce669 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:48.977382 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d6942-c385-447c-a29a-ef16357ce669 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:48.977675 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d6942-c385-447c-a29a-ef16357ce669 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:48.979631 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d6942-c385-447c-a29a-ef16357ce669 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:49.080220 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1179/2341] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:11:48 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:11:49.080766 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499efdb7-2b80-4236-ba8b-81d4634005f6 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:49.091806 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499efdb7-2b80-4236-ba8b-81d4634005f6 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:49.097877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1be02-5341-4aca-b0b1-60714efd61af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:49.098643 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1be02-5341-4aca-b0b1-60714efd61af admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:49.098995 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1be02-5341-4aca-b0b1-60714efd61af admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:49.099347 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1be02-5341-4aca-b0b1-60714efd61af admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:49.100151 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe1be02-5341-4aca-b0b1-60714efd61af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:49.101917 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe1be02-5341-4aca-b0b1-60714efd61af admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:49.112799 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1163/2342] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:11:49.117113 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d6942-c385-447c-a29a-ef16357ce669 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:49.130791 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d6942-c385-447c-a29a-ef16357ce669 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:49.136348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf48260-2dc4-4e03-93f5-2654e29d2f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:49.138135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf48260-2dc4-4e03-93f5-2654e29d2f59 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:49.138488 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf48260-2dc4-4e03-93f5-2654e29d2f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:49.138771 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf48260-2dc4-4e03-93f5-2654e29d2f59 admin admin] PATH_INFO: `/v3/projects/e9c65ac2147f434ea314e30ee57f7940/users/03089eed63c74169b11806528df268e6/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:49.155219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf48260-2dc4-4e03-93f5-2654e29d2f59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9c65ac2147f434ea314e30ee57f7940, user_id=03089eed63c74169b11806528df268e6, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:49.158314 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf48260-2dc4-4e03-93f5-2654e29d2f59 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:49.250123 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1180/2343] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:11:49 2022] PUT /identity/v3/projects/e9c65ac2147f434ea314e30ee57f7940/users/03089eed63c74169b11806528df268e6/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:49.254863 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1be02-5341-4aca-b0b1-60714efd61af admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:49.270588 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1be02-5341-4aca-b0b1-60714efd61af admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:49.349815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbfc07d-6755-427e-8407-a8405e8089c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:49.349815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbfc07d-6755-427e-8407-a8405e8089c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:49.349815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbfc07d-6755-427e-8407-a8405e8089c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:49.349815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbfc07d-6755-427e-8407-a8405e8089c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:49.350764 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbfc07d-6755-427e-8407-a8405e8089c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:49.351998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbfc07d-6755-427e-8407-a8405e8089c5 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:49.363100 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1164/2344] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:11:49.367069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf48260-2dc4-4e03-93f5-2654e29d2f59 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:49.381693 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf48260-2dc4-4e03-93f5-2654e29d2f59 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:49.389036 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d84598-7e27-4d69-9cf5-d6e0140dfc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:49.390190 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d84598-7e27-4d69-9cf5-d6e0140dfc13 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:49.390645 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d84598-7e27-4d69-9cf5-d6e0140dfc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:49.391082 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d84598-7e27-4d69-9cf5-d6e0140dfc13 admin admin] PATH_INFO: `/v3/projects/e9c65ac2147f434ea314e30ee57f7940/users/03089eed63c74169b11806528df268e6/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:49.393244 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d84598-7e27-4d69-9cf5-d6e0140dfc13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9c65ac2147f434ea314e30ee57f7940, user_id=03089eed63c74169b11806528df268e6, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:49.396224 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d84598-7e27-4d69-9cf5-d6e0140dfc13 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:49.415573 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1181/2345] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:11:49 2022] PUT /identity/v3/projects/e9c65ac2147f434ea314e30ee57f7940/users/03089eed63c74169b11806528df268e6/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:49.427344 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340d9e5-a232-4a9f-bac1-78f476e77384 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:49.427922 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340d9e5-a232-4a9f-bac1-78f476e77384 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:49.428058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340d9e5-a232-4a9f-bac1-78f476e77384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:49.460883 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-b340d9e5-a232-4a9f-bac1-78f476e77384 None None] MFA Rules not processed for user `03089eed63c74169b11806528df268e6`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:49.462828 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b340d9e5-a232-4a9f-bac1-78f476e77384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:49.547857 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1165/2346] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:49 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:49.554348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d84598-7e27-4d69-9cf5-d6e0140dfc13 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:49.566558 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d84598-7e27-4d69-9cf5-d6e0140dfc13 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:49.571250 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6081191-9acb-4b6b-8a6f-080a683c8d58 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03089eed63c74169b11806528df268e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9c65ac2147f434ea314e30ee57f7940', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:49.571908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6081191-9acb-4b6b-8a6f-080a683c8d58 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:49.572187 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6081191-9acb-4b6b-8a6f-080a683c8d58 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:49.572663 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6081191-9acb-4b6b-8a6f-080a683c8d58 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:49.573534 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6081191-9acb-4b6b-8a6f-080a683c8d58 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:11:49.574064 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6081191-9acb-4b6b-8a6f-080a683c8d58 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:49.575861 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6081191-9acb-4b6b-8a6f-080a683c8d58 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:49.601475 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1182/2347] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:11:49.602192 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340d9e5-a232-4a9f-bac1-78f476e77384 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:49.609440 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afcec7-49b1-4b60-b890-9c3f8abb2d7b None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:49.609738 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afcec7-49b1-4b60-b890-9c3f8abb2d7b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:49.610055 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afcec7-49b1-4b60-b890-9c3f8abb2d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:49.630279 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340d9e5-a232-4a9f-bac1-78f476e77384 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:49.640354 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-86afcec7-49b1-4b60-b890-9c3f8abb2d7b None None] MFA Rules not processed for user `6e275a4d32754fe9a164bd79c3774b97`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:49.642416 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b6d45-9014-4fc1-942c-dbbbd47cfb55 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03089eed63c74169b11806528df268e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9c65ac2147f434ea314e30ee57f7940', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:49.647078 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b6d45-9014-4fc1-942c-dbbbd47cfb55 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:49.647181 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-86afcec7-49b1-4b60-b890-9c3f8abb2d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:49.647274 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b6d45-9014-4fc1-942c-dbbbd47cfb55 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:49.647274 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b6d45-9014-4fc1-942c-dbbbd47cfb55 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:49.647274 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4b6d45-9014-4fc1-942c-dbbbd47cfb55 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:49.647274 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4b6d45-9014-4fc1-942c-dbbbd47cfb55 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:49.734630 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1166/2348] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:11:49 2022] POST /identity/v3/projects => generated 371 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:11:49.735867 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b6d45-9014-4fc1-942c-dbbbd47cfb55 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:49.760787 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1183/2349] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:49 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:49.823162 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b6d45-9014-4fc1-942c-dbbbd47cfb55 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:49.831031 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3885b25-4a35-498d-9432-f1d8ab0dd77d tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03089eed63c74169b11806528df268e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9c65ac2147f434ea314e30ee57f7940', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:49.831700 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3885b25-4a35-498d-9432-f1d8ab0dd77d tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:49.831990 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3885b25-4a35-498d-9432-f1d8ab0dd77d tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:49.832715 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3885b25-4a35-498d-9432-f1d8ab0dd77d tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:49.833849 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3885b25-4a35-498d-9432-f1d8ab0dd77d tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:11:49.834154 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3885b25-4a35-498d-9432-f1d8ab0dd77d tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:49.835996 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3885b25-4a35-498d-9432-f1d8ab0dd77d tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:49.875283 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1167/2350] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:11:50.115395 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86afcec7-49b1-4b60-b890-9c3f8abb2d7b None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:50.117142 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-86afcec7-49b1-4b60-b890-9c3f8abb2d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:50.203659 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86afcec7-49b1-4b60-b890-9c3f8abb2d7b None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:50.280498 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36fb4c-e82f-47ac-840b-369eda672e70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:50.281197 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36fb4c-e82f-47ac-840b-369eda672e70 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:50.281482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36fb4c-e82f-47ac-840b-369eda672e70 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:50.281779 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36fb4c-e82f-47ac-840b-369eda672e70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:50.290926 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36fb4c-e82f-47ac-840b-369eda672e70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:50.292544 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36fb4c-e82f-47ac-840b-369eda672e70 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:50.303007 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1184/2351] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:11:50 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:11:50.320067 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ef65b-9fba-4005-af71-661aeebd6b39 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:50.320636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ef65b-9fba-4005-af71-661aeebd6b39 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:50.321104 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ef65b-9fba-4005-af71-661aeebd6b39 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:50.322767 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1168/2352] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:11:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:11:50.328434 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36fb4c-e82f-47ac-840b-369eda672e70 service nova] Authenticating service token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 30 21:11:50.340929 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36fb4c-e82f-47ac-840b-369eda672e70 service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:50.356148 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36fb4c-e82f-47ac-840b-369eda672e70 service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:50.361403 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78eb78-ac5a-4ea1-939c-9d8ae43cafaa tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03089eed63c74169b11806528df268e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9c65ac2147f434ea314e30ee57f7940', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:50.362339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78eb78-ac5a-4ea1-939c-9d8ae43cafaa tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:50.362627 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78eb78-ac5a-4ea1-939c-9d8ae43cafaa tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:50.362905 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78eb78-ac5a-4ea1-939c-9d8ae43cafaa tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] PATH_INFO: `/v3/projects/49d9f141c66b43f694edf7f94e1dafe3` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:50.364138 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78eb78-ac5a-4ea1-939c-9d8ae43cafaa tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] RBAC: Authorizing `identity:get_project(project_id=49d9f141c66b43f694edf7f94e1dafe3)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:50.366352 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78eb78-ac5a-4ea1-939c-9d8ae43cafaa tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:50.368075 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1185/2353] 10.222.0.23 () {58 vars in 1443 bytes} [Sat Apr 30 21:11:50 2022] GET /identity/v3/projects/49d9f141c66b43f694edf7f94e1dafe3 => generated 371 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:11:51.524945 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24013a3a-8e07-4b03-b2c3-a3a59e1dfdfb None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:51.525427 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24013a3a-8e07-4b03-b2c3-a3a59e1dfdfb None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:51.525588 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24013a3a-8e07-4b03-b2c3-a3a59e1dfdfb None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:51.527312 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1169/2354] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:11:51.535085 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78eb78-ac5a-4ea1-939c-9d8ae43cafaa tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Authenticating service token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 30 21:11:51.539029 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7a78eb78-ac5a-4ea1-939c-9d8ae43cafaa tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:51.580857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78eb78-ac5a-4ea1-939c-9d8ae43cafaa tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:51.604287 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78eb78-ac5a-4ea1-939c-9d8ae43cafaa tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:51.611649 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f5fb9-ed35-484e-a2e0-511fa4f0610a tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03089eed63c74169b11806528df268e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9c65ac2147f434ea314e30ee57f7940', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:51.613356 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f5fb9-ed35-484e-a2e0-511fa4f0610a tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:51.614270 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f5fb9-ed35-484e-a2e0-511fa4f0610a tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:51.615141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f5fb9-ed35-484e-a2e0-511fa4f0610a tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] PATH_INFO: `/v3/projects/49d9f141c66b43f694edf7f94e1dafe3` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:51.634452 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0f5fb9-ed35-484e-a2e0-511fa4f0610a tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] RBAC: Authorizing `identity:get_project(project_id=49d9f141c66b43f694edf7f94e1dafe3)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:51.636994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0f5fb9-ed35-484e-a2e0-511fa4f0610a tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:51.639877 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1186/2355] 10.222.0.23 () {58 vars in 1443 bytes} [Sat Apr 30 21:11:51 2022] GET /identity/v3/projects/49d9f141c66b43f694edf7f94e1dafe3 => generated 371 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:11:51.719263 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24013a3a-8e07-4b03-b2c3-a3a59e1dfdfb None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:51.727811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f5fb9-ed35-484e-a2e0-511fa4f0610a tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:51.747022 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24013a3a-8e07-4b03-b2c3-a3a59e1dfdfb None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:51.747534 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f5fb9-ed35-484e-a2e0-511fa4f0610a tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:51.756664 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c7dd4-3a58-4820-bce9-542566799842 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03089eed63c74169b11806528df268e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9c65ac2147f434ea314e30ee57f7940', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:51.758307 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c7dd4-3a58-4820-bce9-542566799842 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:51.759133 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffba276-e86d-426c-bb22-54d4ea948940 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:51.759616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c7dd4-3a58-4820-bce9-542566799842 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:51.760431 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffba276-e86d-426c-bb22-54d4ea948940 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:51.760907 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c7dd4-3a58-4820-bce9-542566799842 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:51.761879 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c7dd4-3a58-4820-bce9-542566799842 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:11:51.762370 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffba276-e86d-426c-bb22-54d4ea948940 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:51.762934 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffba276-e86d-426c-bb22-54d4ea948940 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:51.763461 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c7dd4-3a58-4820-bce9-542566799842 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:51.766694 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c7dd4-3a58-4820-bce9-542566799842 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:51.767727 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-bffba276-e86d-426c-bb22-54d4ea948940 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:51.795990 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1170/2356] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:11:51.798914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c7dd4-3a58-4820-bce9-542566799842 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:51.821694 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c7dd4-3a58-4820-bce9-542566799842 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:51.832550 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e3779-5b8e-4b12-934a-190c6a98e06e tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03089eed63c74169b11806528df268e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9c65ac2147f434ea314e30ee57f7940', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:51.834337 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e3779-5b8e-4b12-934a-190c6a98e06e tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:51.835024 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e3779-5b8e-4b12-934a-190c6a98e06e tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:51.836334 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e3779-5b8e-4b12-934a-190c6a98e06e tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:51.838044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e3779-5b8e-4b12-934a-190c6a98e06e tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:51.843363 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e3779-5b8e-4b12-934a-190c6a98e06e tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:51.899234 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffba276-e86d-426c-bb22-54d4ea948940 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:51.901632 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffba276-e86d-426c-bb22-54d4ea948940 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:51.914663 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1187/2357] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:11:51 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:11:51.953132 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1171/2358] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:11:51 2022] POST /identity/v3/users => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:11:51.959189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffba276-e86d-426c-bb22-54d4ea948940 service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:52.014658 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffba276-e86d-426c-bb22-54d4ea948940 service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:52.024688 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b0a04-9859-4121-ab6c-7b34843073fd tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03089eed63c74169b11806528df268e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9c65ac2147f434ea314e30ee57f7940', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:52.025568 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b0a04-9859-4121-ab6c-7b34843073fd tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:52.026041 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b0a04-9859-4121-ab6c-7b34843073fd tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:52.026493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b0a04-9859-4121-ab6c-7b34843073fd tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:52.028718 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b0a04-9859-4121-ab6c-7b34843073fd tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:11:52.029220 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b0a04-9859-4121-ab6c-7b34843073fd tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:52.033524 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b0a04-9859-4121-ab6c-7b34843073fd tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:52.063198 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1188/2359] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:11:52.502800 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac50c09-cf53-4f4a-8a10-54160ca46eee None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:52.503464 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac50c09-cf53-4f4a-8a10-54160ca46eee None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:52.504535 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac50c09-cf53-4f4a-8a10-54160ca46eee None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:52.506500 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1172/2360] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:11:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:11:52.517970 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b0a04-9859-4121-ab6c-7b34843073fd tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Authenticating service token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 30 21:11:52.533446 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b0a04-9859-4121-ab6c-7b34843073fd tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:52.544463 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b0a04-9859-4121-ab6c-7b34843073fd tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:52.551045 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441df5f6-7ce9-49da-9894-a9ea02e1a33d tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03089eed63c74169b11806528df268e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9c65ac2147f434ea314e30ee57f7940', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:52.551953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441df5f6-7ce9-49da-9894-a9ea02e1a33d tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:52.552274 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441df5f6-7ce9-49da-9894-a9ea02e1a33d tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:52.552558 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441df5f6-7ce9-49da-9894-a9ea02e1a33d tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] PATH_INFO: `/v3/projects/49d9f141c66b43f694edf7f94e1dafe3` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:52.556463 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441df5f6-7ce9-49da-9894-a9ea02e1a33d tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] RBAC: Authorizing `identity:get_project(project_id=49d9f141c66b43f694edf7f94e1dafe3)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:52.559188 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441df5f6-7ce9-49da-9894-a9ea02e1a33d tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:52.579468 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1189/2361] 10.222.0.23 () {58 vars in 1443 bytes} [Sat Apr 30 21:11:52 2022] GET /identity/v3/projects/49d9f141c66b43f694edf7f94e1dafe3 => generated 371 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:11:53.049785 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99ece2-1396-4e05-8592-bcf3a146d5ec None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:53.050311 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99ece2-1396-4e05-8592-bcf3a146d5ec None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:53.050311 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99ece2-1396-4e05-8592-bcf3a146d5ec None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:53.052617 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1173/2362] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:11:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:11:53.058034 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441df5f6-7ce9-49da-9894-a9ea02e1a33d tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Authenticating service token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 30 21:11:53.073116 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441df5f6-7ce9-49da-9894-a9ea02e1a33d tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:53.083055 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441df5f6-7ce9-49da-9894-a9ea02e1a33d tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:53.088889 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5abc9-68d0-4cba-886c-e35bf151a7a7 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03089eed63c74169b11806528df268e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9c65ac2147f434ea314e30ee57f7940', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:53.090042 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5abc9-68d0-4cba-886c-e35bf151a7a7 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:53.090326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5abc9-68d0-4cba-886c-e35bf151a7a7 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:53.090646 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5abc9-68d0-4cba-886c-e35bf151a7a7 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] PATH_INFO: `/v3/projects/49d9f141c66b43f694edf7f94e1dafe3` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:53.091892 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b5abc9-68d0-4cba-886c-e35bf151a7a7 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] RBAC: Authorizing `identity:get_project(project_id=49d9f141c66b43f694edf7f94e1dafe3)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:53.093965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b5abc9-68d0-4cba-886c-e35bf151a7a7 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:53.095983 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1190/2363] 10.222.0.23 () {58 vars in 1443 bytes} [Sat Apr 30 21:11:53 2022] GET /identity/v3/projects/49d9f141c66b43f694edf7f94e1dafe3 => generated 371 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:11:53.125351 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99ece2-1396-4e05-8592-bcf3a146d5ec None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:53.146480 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99ece2-1396-4e05-8592-bcf3a146d5ec None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:53.152473 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411076d-26cf-4706-a69a-370937e51306 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03089eed63c74169b11806528df268e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9c65ac2147f434ea314e30ee57f7940', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:53.153633 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411076d-26cf-4706-a69a-370937e51306 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:53.154185 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411076d-26cf-4706-a69a-370937e51306 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:53.154674 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411076d-26cf-4706-a69a-370937e51306 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] PATH_INFO: `/v3/users/7ef839c4037b4c73bacf6559b86da0d9` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:53.177025 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2411076d-26cf-4706-a69a-370937e51306 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7ef839c4037b4c73bacf6559b86da0d9)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:53.179264 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2411076d-26cf-4706-a69a-370937e51306 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:53.323254 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2411076d-26cf-4706-a69a-370937e51306 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ef839c4037b4c73bacf6559b86da0d9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:53.334822 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2411076d-26cf-4706-a69a-370937e51306 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ef839c4037b4c73bacf6559b86da0d9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:53.420258 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2411076d-26cf-4706-a69a-370937e51306 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ef839c4037b4c73bacf6559b86da0d9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:53.429548 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2411076d-26cf-4706-a69a-370937e51306 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ef839c4037b4c73bacf6559b86da0d9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:53.430289 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2411076d-26cf-4706-a69a-370937e51306 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ef839c4037b4c73bacf6559b86da0d9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:53.437120 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1174/2364] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:11:53 2022] DELETE /identity/v3/users/7ef839c4037b4c73bacf6559b86da0d9 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:53.441582 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5abc9-68d0-4cba-886c-e35bf151a7a7 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:53.443615 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-77b5abc9-68d0-4cba-886c-e35bf151a7a7 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:53.458840 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5abc9-68d0-4cba-886c-e35bf151a7a7 tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:53.557926 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12902ac-0135-4a30-b901-ec2907e6efed tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03089eed63c74169b11806528df268e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9c65ac2147f434ea314e30ee57f7940', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:53.558998 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12902ac-0135-4a30-b901-ec2907e6efed tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:53.559471 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12902ac-0135-4a30-b901-ec2907e6efed tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:53.559754 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12902ac-0135-4a30-b901-ec2907e6efed tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] PATH_INFO: `/v3/projects/49d9f141c66b43f694edf7f94e1dafe3` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:53.561091 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12902ac-0135-4a30-b901-ec2907e6efed tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] RBAC: Authorizing `identity:delete_project(project_id=49d9f141c66b43f694edf7f94e1dafe3)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:53.563246 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12902ac-0135-4a30-b901-ec2907e6efed tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:53.643740 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ab073-bae2-4ca1-80d9-6af193f1a397 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:53.644025 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ab073-bae2-4ca1-80d9-6af193f1a397 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:53.644301 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ab073-bae2-4ca1-80d9-6af193f1a397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:53.664192 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-4c4ab073-bae2-4ca1-80d9-6af193f1a397 None None] MFA Rules not processed for user `c816e51510ac44c9a2b3f5c022b5a3c3`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:53.665413 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4c4ab073-bae2-4ca1-80d9-6af193f1a397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:53.727335 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a12902ac-0135-4a30-b901-ec2907e6efed tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49d9f141c66b43f694edf7f94e1dafe3', 'request_id': 'req-a12902ac-0135-4a30-b901-ec2907e6efed'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:53.735634 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1175/2365] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:53 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:53.735824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a12902ac-0135-4a30-b901-ec2907e6efed tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49d9f141c66b43f694edf7f94e1dafe3', 'request_id': 'req-a12902ac-0135-4a30-b901-ec2907e6efed'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:53.741252 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a12902ac-0135-4a30-b901-ec2907e6efed tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49d9f141c66b43f694edf7f94e1dafe3', 'request_id': 'req-a12902ac-0135-4a30-b901-ec2907e6efed'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:53.881238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a12902ac-0135-4a30-b901-ec2907e6efed tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] The token cache is being invalidate because project 49d9f141c66b43f694edf7f94e1dafe3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:11:53.881746 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a12902ac-0135-4a30-b901-ec2907e6efed tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:53.882732 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a12902ac-0135-4a30-b901-ec2907e6efed tempest-QuotasAdminTestV257-711775263 tempest-QuotasAdminTestV257-711775263-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:53.884507 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1191/2366] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:11:53 2022] DELETE /identity/v3/projects/49d9f141c66b43f694edf7f94e1dafe3 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:53.890980 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ab073-bae2-4ca1-80d9-6af193f1a397 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:53.892748 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4c4ab073-bae2-4ca1-80d9-6af193f1a397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:53.976387 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ab073-bae2-4ca1-80d9-6af193f1a397 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:54.059184 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f1507-f15f-41c5-bfd4-f42e67f1222a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:54.060486 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f1507-f15f-41c5-bfd4-f42e67f1222a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:54.060877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f1507-f15f-41c5-bfd4-f42e67f1222a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:54.061237 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f1507-f15f-41c5-bfd4-f42e67f1222a admin admin] PATH_INFO: `/v3/users/343effb31078468aa12fa7693f7620c6` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:54.062742 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f1507-f15f-41c5-bfd4-f42e67f1222a admin admin] RBAC: Authorizing `identity:delete_user(user_id=343effb31078468aa12fa7693f7620c6)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:54.064747 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f1507-f15f-41c5-bfd4-f42e67f1222a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:54.254758 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8a6f1507-f15f-41c5-bfd4-f42e67f1222a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '343effb31078468aa12fa7693f7620c6'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:54.314651 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8a6f1507-f15f-41c5-bfd4-f42e67f1222a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '343effb31078468aa12fa7693f7620c6'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:54.435932 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8a6f1507-f15f-41c5-bfd4-f42e67f1222a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '343effb31078468aa12fa7693f7620c6'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:54.445918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8a6f1507-f15f-41c5-bfd4-f42e67f1222a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '343effb31078468aa12fa7693f7620c6'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:54.448433 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8a6f1507-f15f-41c5-bfd4-f42e67f1222a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '343effb31078468aa12fa7693f7620c6'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:54.478308 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1176/2367] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:11:53 2022] DELETE /identity/v3/users/343effb31078468aa12fa7693f7620c6 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:11:54.482419 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20be12-5a63-4e3e-be92-1f4b3c4ef4f5 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:54.482928 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20be12-5a63-4e3e-be92-1f4b3c4ef4f5 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:54.483357 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20be12-5a63-4e3e-be92-1f4b3c4ef4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:54.539140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-5d20be12-5a63-4e3e-be92-1f4b3c4ef4f5 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:54.540473 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5d20be12-5a63-4e3e-be92-1f4b3c4ef4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:54.621094 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1192/2368] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:11:54.672291 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f1507-f15f-41c5-bfd4-f42e67f1222a admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:54.673803 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8a6f1507-f15f-41c5-bfd4-f42e67f1222a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:54.758064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f1507-f15f-41c5-bfd4-f42e67f1222a admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:54.763897 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22185442-6d23-4bef-be23-33a8509e6901 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:54.764565 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22185442-6d23-4bef-be23-33a8509e6901 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:54.764856 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22185442-6d23-4bef-be23-33a8509e6901 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:54.765124 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22185442-6d23-4bef-be23-33a8509e6901 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:54.783616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22185442-6d23-4bef-be23-33a8509e6901 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:54.784883 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22185442-6d23-4bef-be23-33a8509e6901 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:54.810635 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1177/2369] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:11:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:11:56.369009 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20be12-5a63-4e3e-be92-1f4b3c4ef4f5 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:56.370613 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5d20be12-5a63-4e3e-be92-1f4b3c4ef4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:56.397115 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20be12-5a63-4e3e-be92-1f4b3c4ef4f5 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:56.410564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774eb2bc-deb8-40c5-9390-c69b1073c120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:56.411446 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774eb2bc-deb8-40c5-9390-c69b1073c120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:56.411732 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774eb2bc-deb8-40c5-9390-c69b1073c120 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:56.412021 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774eb2bc-deb8-40c5-9390-c69b1073c120 admin admin] PATH_INFO: `/v3/projects/bf65819be9e34f9b9da693b96daf4b58` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:56.413314 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774eb2bc-deb8-40c5-9390-c69b1073c120 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf65819be9e34f9b9da693b96daf4b58)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:56.416079 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774eb2bc-deb8-40c5-9390-c69b1073c120 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:56.589610 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-774eb2bc-deb8-40c5-9390-c69b1073c120 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf65819be9e34f9b9da693b96daf4b58', 'request_id': 'req-774eb2bc-deb8-40c5-9390-c69b1073c120'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:56.595004 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-774eb2bc-deb8-40c5-9390-c69b1073c120 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf65819be9e34f9b9da693b96daf4b58', 'request_id': 'req-774eb2bc-deb8-40c5-9390-c69b1073c120'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:56.601779 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-774eb2bc-deb8-40c5-9390-c69b1073c120 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf65819be9e34f9b9da693b96daf4b58', 'request_id': 'req-774eb2bc-deb8-40c5-9390-c69b1073c120'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:56.680671 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-774eb2bc-deb8-40c5-9390-c69b1073c120 admin admin] The token cache is being invalidate because project bf65819be9e34f9b9da693b96daf4b58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:11:56.681146 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-774eb2bc-deb8-40c5-9390-c69b1073c120 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:56.682552 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-774eb2bc-deb8-40c5-9390-c69b1073c120 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:56.685120 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1193/2370] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:11:56 2022] DELETE /identity/v3/projects/bf65819be9e34f9b9da693b96daf4b58 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:56.689139 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22185442-6d23-4bef-be23-33a8509e6901 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:56.704706 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22185442-6d23-4bef-be23-33a8509e6901 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:56.787233 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef35c5-68fc-4788-b098-d5cefe1383c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:56.788316 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef35c5-68fc-4788-b098-d5cefe1383c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:56.788611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef35c5-68fc-4788-b098-d5cefe1383c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:56.788960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef35c5-68fc-4788-b098-d5cefe1383c5 admin admin] PATH_INFO: `/v3/users/03089eed63c74169b11806528df268e6` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:56.790285 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef35c5-68fc-4788-b098-d5cefe1383c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03089eed63c74169b11806528df268e6)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:56.792966 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef35c5-68fc-4788-b098-d5cefe1383c5 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:57.040993 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-34ef35c5-68fc-4788-b098-d5cefe1383c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03089eed63c74169b11806528df268e6'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:57.052581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-34ef35c5-68fc-4788-b098-d5cefe1383c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03089eed63c74169b11806528df268e6'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:57.162820 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-34ef35c5-68fc-4788-b098-d5cefe1383c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03089eed63c74169b11806528df268e6'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:57.172458 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-34ef35c5-68fc-4788-b098-d5cefe1383c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03089eed63c74169b11806528df268e6'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:57.173789 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-34ef35c5-68fc-4788-b098-d5cefe1383c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03089eed63c74169b11806528df268e6'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:57.183606 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1178/2371] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:11:56 2022] DELETE /identity/v3/users/03089eed63c74169b11806528df268e6 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:57.740460 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e7b7e-c21a-40ea-87cd-3a0de26f1d25 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:57.740973 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e7b7e-c21a-40ea-87cd-3a0de26f1d25 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:57.741053 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e7b7e-c21a-40ea-87cd-3a0de26f1d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:57.768612 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-010e7b7e-c21a-40ea-87cd-3a0de26f1d25 None None] MFA Rules not processed for user `6a8350c0cb814c66b94775110721dee4`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:57.771044 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-010e7b7e-c21a-40ea-87cd-3a0de26f1d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:57.840800 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1194/2372] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:57.969781 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef35c5-68fc-4788-b098-d5cefe1383c5 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:57.971318 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-34ef35c5-68fc-4788-b098-d5cefe1383c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:58.067063 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef35c5-68fc-4788-b098-d5cefe1383c5 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:58.072077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be720e8c-c424-4fd6-b048-6991742150d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:58.072937 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be720e8c-c424-4fd6-b048-6991742150d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:58.073211 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be720e8c-c424-4fd6-b048-6991742150d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:58.073867 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be720e8c-c424-4fd6-b048-6991742150d4 admin admin] PATH_INFO: `/v3/projects/e9c65ac2147f434ea314e30ee57f7940` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:58.078507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be720e8c-c424-4fd6-b048-6991742150d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9c65ac2147f434ea314e30ee57f7940)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:58.080832 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be720e8c-c424-4fd6-b048-6991742150d4 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:58.245397 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-be720e8c-c424-4fd6-b048-6991742150d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9c65ac2147f434ea314e30ee57f7940', 'request_id': 'req-be720e8c-c424-4fd6-b048-6991742150d4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:58.251149 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-be720e8c-c424-4fd6-b048-6991742150d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9c65ac2147f434ea314e30ee57f7940', 'request_id': 'req-be720e8c-c424-4fd6-b048-6991742150d4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:58.257555 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-be720e8c-c424-4fd6-b048-6991742150d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9c65ac2147f434ea314e30ee57f7940', 'request_id': 'req-be720e8c-c424-4fd6-b048-6991742150d4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:58.311235 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-be720e8c-c424-4fd6-b048-6991742150d4 admin admin] The token cache is being invalidate because project e9c65ac2147f434ea314e30ee57f7940 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:11:58.311543 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-be720e8c-c424-4fd6-b048-6991742150d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:58.312602 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-be720e8c-c424-4fd6-b048-6991742150d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:11:58.313963 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1179/2373] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:11:57 2022] DELETE /identity/v3/projects/e9c65ac2147f434ea314e30ee57f7940 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:11:58.322647 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11ecf8-672b-4fe0-8bd6-fc7bf3f92e38 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:58.323053 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11ecf8-672b-4fe0-8bd6-fc7bf3f92e38 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:58.323405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11ecf8-672b-4fe0-8bd6-fc7bf3f92e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:58.343857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-3f11ecf8-672b-4fe0-8bd6-fc7bf3f92e38 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:58.345208 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3f11ecf8-672b-4fe0-8bd6-fc7bf3f92e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:58.426152 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1195/2374] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:58.428450 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff29124-df48-4d2b-85b9-85c13f3d9191 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:58.428990 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff29124-df48-4d2b-85b9-85c13f3d9191 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:58.430165 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff29124-df48-4d2b-85b9-85c13f3d9191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:58.452657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-2ff29124-df48-4d2b-85b9-85c13f3d9191 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:58.453940 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2ff29124-df48-4d2b-85b9-85c13f3d9191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:58.469010 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f11ecf8-672b-4fe0-8bd6-fc7bf3f92e38 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:58.475368 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1180/2375] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:58.480107 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f11ecf8-672b-4fe0-8bd6-fc7bf3f92e38 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:58.486197 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6e8f9-f733-40e7-83d8-eeba91fc9860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:58.491175 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6e8f9-f733-40e7-83d8-eeba91fc9860 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:58.492117 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6e8f9-f733-40e7-83d8-eeba91fc9860 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:58.492420 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd6e8f9-f733-40e7-83d8-eeba91fc9860 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:58.493204 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6e8f9-f733-40e7-83d8-eeba91fc9860 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:11:58.493533 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6e8f9-f733-40e7-83d8-eeba91fc9860 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:58.495243 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd6e8f9-f733-40e7-83d8-eeba91fc9860 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:58.510456 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1196/2376] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:11:58.517391 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff29124-df48-4d2b-85b9-85c13f3d9191 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:58.529472 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff29124-df48-4d2b-85b9-85c13f3d9191 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:58.534293 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69f268-2701-4284-bd37-cc9333b6d43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:58.535026 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69f268-2701-4284-bd37-cc9333b6d43d admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:58.535380 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69f268-2701-4284-bd37-cc9333b6d43d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:58.535724 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69f268-2701-4284-bd37-cc9333b6d43d admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:58.536588 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69f268-2701-4284-bd37-cc9333b6d43d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:58.538721 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69f268-2701-4284-bd37-cc9333b6d43d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:58.638242 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1181/2377] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:11:58 2022] POST /identity/v3/projects => generated 393 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:11:58.641999 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6e8f9-f733-40e7-83d8-eeba91fc9860 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:58.657534 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd6e8f9-f733-40e7-83d8-eeba91fc9860 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:58.766094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd32a1-4c29-4ecc-9367-2bee61493789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:58.766883 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd32a1-4c29-4ecc-9367-2bee61493789 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:58.767182 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd32a1-4c29-4ecc-9367-2bee61493789 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:58.767453 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd32a1-4c29-4ecc-9367-2bee61493789 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:58.768168 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd32a1-4c29-4ecc-9367-2bee61493789 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:58.770363 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd32a1-4c29-4ecc-9367-2bee61493789 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:58.895634 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1197/2378] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:11:58 2022] POST /identity/v3/users => generated 297 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:11:58.899336 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69f268-2701-4284-bd37-cc9333b6d43d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:58.914292 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69f268-2701-4284-bd37-cc9333b6d43d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:58.928644 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea39f1c9-2a5a-4d8f-876d-866521281797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:58.930076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39f1c9-2a5a-4d8f-876d-866521281797 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:58.930861 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39f1c9-2a5a-4d8f-876d-866521281797 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:58.930861 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39f1c9-2a5a-4d8f-876d-866521281797 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:58.931420 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea39f1c9-2a5a-4d8f-876d-866521281797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:58.933972 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea39f1c9-2a5a-4d8f-876d-866521281797 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:58.947836 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1182/2379] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:11:58.952284 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd32a1-4c29-4ecc-9367-2bee61493789 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:58.965538 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd32a1-4c29-4ecc-9367-2bee61493789 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:58.972443 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288cb339-6649-41e5-8ba2-141e194be698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:58.978045 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288cb339-6649-41e5-8ba2-141e194be698 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:58.978045 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288cb339-6649-41e5-8ba2-141e194be698 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:58.978045 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288cb339-6649-41e5-8ba2-141e194be698 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:58.978045 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288cb339-6649-41e5-8ba2-141e194be698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:58.978045 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288cb339-6649-41e5-8ba2-141e194be698 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:58.988475 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1198/2380] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:11:58.992926 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea39f1c9-2a5a-4d8f-876d-866521281797 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:59.017516 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea39f1c9-2a5a-4d8f-876d-866521281797 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:59.027553 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa850c2-3315-4cff-94a0-c1271584edc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:59.028450 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa850c2-3315-4cff-94a0-c1271584edc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:59.028727 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa850c2-3315-4cff-94a0-c1271584edc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:59.028999 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa850c2-3315-4cff-94a0-c1271584edc6 admin admin] PATH_INFO: `/v3/projects/fdb41e2c2c9d41a9836e14924a739d3d/users/dfb76ad566b645c4a19f647585449972/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:59.060184 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa850c2-3315-4cff-94a0-c1271584edc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdb41e2c2c9d41a9836e14924a739d3d, user_id=dfb76ad566b645c4a19f647585449972, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:59.064329 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa850c2-3315-4cff-94a0-c1271584edc6 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:59.145369 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1183/2381] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:11:58 2022] PUT /identity/v3/projects/fdb41e2c2c9d41a9836e14924a739d3d/users/dfb76ad566b645c4a19f647585449972/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:11:59.230736 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136da58-ccb5-45d5-ba3d-3c7bbd3aecfb None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:59.231014 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136da58-ccb5-45d5-ba3d-3c7bbd3aecfb None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:59.231292 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136da58-ccb5-45d5-ba3d-3c7bbd3aecfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:59.307221 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-d136da58-ccb5-45d5-ba3d-3c7bbd3aecfb None None] MFA Rules not processed for user `dfb76ad566b645c4a19f647585449972`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:11:59.308632 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d136da58-ccb5-45d5-ba3d-3c7bbd3aecfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:11:59.387870 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1199/2382] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:11:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:11:59.392621 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa850c2-3315-4cff-94a0-c1271584edc6 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:59.485004 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa850c2-3315-4cff-94a0-c1271584edc6 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:59.490915 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a58b2-9793-4b30-838c-404d10fb82ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:59.491778 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a58b2-9793-4b30-838c-404d10fb82ae admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:59.492211 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a58b2-9793-4b30-838c-404d10fb82ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:59.500648 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a58b2-9793-4b30-838c-404d10fb82ae admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:59.500648 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a58b2-9793-4b30-838c-404d10fb82ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:59.500648 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a58b2-9793-4b30-838c-404d10fb82ae admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:59.622104 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1184/2383] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:11:59 2022] POST /identity/v3/projects => generated 393 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:11:59.622963 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136da58-ccb5-45d5-ba3d-3c7bbd3aecfb None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:59.641986 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136da58-ccb5-45d5-ba3d-3c7bbd3aecfb None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:59.740492 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95711b0-c74c-471b-9eda-f30afd568ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:59.741419 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95711b0-c74c-471b-9eda-f30afd568ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:59.741793 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95711b0-c74c-471b-9eda-f30afd568ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:59.742081 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95711b0-c74c-471b-9eda-f30afd568ea4 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:59.742788 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95711b0-c74c-471b-9eda-f30afd568ea4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:59.746917 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95711b0-c74c-471b-9eda-f30afd568ea4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:59.896588 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1200/2384] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:11:59 2022] POST /identity/v3/users => generated 303 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:11:59.900892 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a58b2-9793-4b30-838c-404d10fb82ae admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:59.912486 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a58b2-9793-4b30-838c-404d10fb82ae admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:59.920505 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72637d-33bd-4a27-891c-a2dd8c3cb465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:59.921251 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72637d-33bd-4a27-891c-a2dd8c3cb465 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:59.921591 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72637d-33bd-4a27-891c-a2dd8c3cb465 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:59.921916 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72637d-33bd-4a27-891c-a2dd8c3cb465 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:11:59.923227 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d72637d-33bd-4a27-891c-a2dd8c3cb465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:11:59.925065 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d72637d-33bd-4a27-891c-a2dd8c3cb465 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:11:59.954249 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1185/2385] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:11:59.955741 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95711b0-c74c-471b-9eda-f30afd568ea4 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:11:59.969193 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95711b0-c74c-471b-9eda-f30afd568ea4 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:11:59.986951 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03c5221-1e7f-459b-908a-2644f6e357a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:11:59.988328 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c5221-1e7f-459b-908a-2644f6e357a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:11:59.988988 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c5221-1e7f-459b-908a-2644f6e357a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:11:59.989388 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c5221-1e7f-459b-908a-2644f6e357a8 admin admin] PATH_INFO: `/v3/projects/4860de9410494884aafea52798527174/users/10869192363240a6a023cb670d0ef8f9/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:00.030209 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03c5221-1e7f-459b-908a-2644f6e357a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4860de9410494884aafea52798527174, user_id=10869192363240a6a023cb670d0ef8f9, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:00.034038 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03c5221-1e7f-459b-908a-2644f6e357a8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:00.156143 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1201/2386] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:11:59 2022] PUT /identity/v3/projects/4860de9410494884aafea52798527174/users/10869192363240a6a023cb670d0ef8f9/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:12:00.159961 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72637d-33bd-4a27-891c-a2dd8c3cb465 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:00.172123 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72637d-33bd-4a27-891c-a2dd8c3cb465 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:00.281736 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d80507-ca55-4bb8-b0e1-ff1e3754782c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:00.282881 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d80507-ca55-4bb8-b0e1-ff1e3754782c admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:00.283371 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d80507-ca55-4bb8-b0e1-ff1e3754782c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:00.283716 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d80507-ca55-4bb8-b0e1-ff1e3754782c admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:00.284675 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d80507-ca55-4bb8-b0e1-ff1e3754782c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:00.286617 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d80507-ca55-4bb8-b0e1-ff1e3754782c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:00.298767 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1186/2387] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:12:00.302761 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03c5221-1e7f-459b-908a-2644f6e357a8 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:00.316251 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03c5221-1e7f-459b-908a-2644f6e357a8 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:00.328432 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88dc5fa-1152-435a-b17a-f5d5072a56e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:00.329665 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88dc5fa-1152-435a-b17a-f5d5072a56e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:00.330293 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88dc5fa-1152-435a-b17a-f5d5072a56e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:00.330718 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88dc5fa-1152-435a-b17a-f5d5072a56e7 admin admin] PATH_INFO: `/v3/projects/4860de9410494884aafea52798527174/users/10869192363240a6a023cb670d0ef8f9/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:00.333433 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88dc5fa-1152-435a-b17a-f5d5072a56e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4860de9410494884aafea52798527174, user_id=10869192363240a6a023cb670d0ef8f9, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:00.336550 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88dc5fa-1152-435a-b17a-f5d5072a56e7 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:00.367914 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1202/2388] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:12:00 2022] PUT /identity/v3/projects/4860de9410494884aafea52798527174/users/10869192363240a6a023cb670d0ef8f9/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:12:00.371763 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf42564-36f9-4ce9-97f9-a9a6881b2217 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:00.371763 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf42564-36f9-4ce9-97f9-a9a6881b2217 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:00.371763 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf42564-36f9-4ce9-97f9-a9a6881b2217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:00.411101 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-2bf42564-36f9-4ce9-97f9-a9a6881b2217 None None] MFA Rules not processed for user `10869192363240a6a023cb670d0ef8f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:00.418912 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2bf42564-36f9-4ce9-97f9-a9a6881b2217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:00.598675 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1187/2389] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:12:00 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:12:00.941119 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88dc5fa-1152-435a-b17a-f5d5072a56e7 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:00.943021 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a88dc5fa-1152-435a-b17a-f5d5072a56e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:01.026006 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88dc5fa-1152-435a-b17a-f5d5072a56e7 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:01.032425 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08d732-f4b0-4f70-9845-d9598bf68add service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:01.033119 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08d732-f4b0-4f70-9845-d9598bf68add service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:01.033401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08d732-f4b0-4f70-9845-d9598bf68add service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:01.033678 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08d732-f4b0-4f70-9845-d9598bf68add service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:01.043350 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc08d732-f4b0-4f70-9845-d9598bf68add service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:01.045055 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc08d732-f4b0-4f70-9845-d9598bf68add service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:01.055820 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1203/2390] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:12:00 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:12:01.113741 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e68f7-5ac0-4ed2-a426-f93c461a1f00 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:01.114153 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e68f7-5ac0-4ed2-a426-f93c461a1f00 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:01.114473 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e68f7-5ac0-4ed2-a426-f93c461a1f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:01.158874 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-844e68f7-5ac0-4ed2-a426-f93c461a1f00 None None] MFA Rules not processed for user `cce42480cd844664991774f07ca47e79`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:01.160375 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-844e68f7-5ac0-4ed2-a426-f93c461a1f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:01.244411 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1188/2391] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:12:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:12:01.740758 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08d732-f4b0-4f70-9845-d9598bf68add service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:01.758465 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08d732-f4b0-4f70-9845-d9598bf68add service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:01.768453 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f362ed-7d58-4ca1-a197-8d3e7caa265f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:01.769275 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f362ed-7d58-4ca1-a197-8d3e7caa265f service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:01.769512 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f362ed-7d58-4ca1-a197-8d3e7caa265f service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:01.770063 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f362ed-7d58-4ca1-a197-8d3e7caa265f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:01.841612 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f362ed-7d58-4ca1-a197-8d3e7caa265f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:01.843642 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f362ed-7d58-4ca1-a197-8d3e7caa265f service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:01.854929 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1204/2392] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:12:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:12:01.870179 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e68f7-5ac0-4ed2-a426-f93c461a1f00 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:01.964234 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e68f7-5ac0-4ed2-a426-f93c461a1f00 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:01.969034 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30915a-e271-43da-81c1-f13f0101f41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:01.970244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30915a-e271-43da-81c1-f13f0101f41e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:01.970244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30915a-e271-43da-81c1-f13f0101f41e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:01.970521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30915a-e271-43da-81c1-f13f0101f41e admin admin] PATH_INFO: `/v3/users/dfb76ad566b645c4a19f647585449972` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:01.971700 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30915a-e271-43da-81c1-f13f0101f41e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfb76ad566b645c4a19f647585449972)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:01.973638 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30915a-e271-43da-81c1-f13f0101f41e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:02.249460 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8b30915a-e271-43da-81c1-f13f0101f41e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfb76ad566b645c4a19f647585449972'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:02.288643 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8b30915a-e271-43da-81c1-f13f0101f41e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfb76ad566b645c4a19f647585449972'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:02.346372 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8b30915a-e271-43da-81c1-f13f0101f41e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfb76ad566b645c4a19f647585449972'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:02.358983 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8b30915a-e271-43da-81c1-f13f0101f41e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfb76ad566b645c4a19f647585449972'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:02.358983 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8b30915a-e271-43da-81c1-f13f0101f41e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfb76ad566b645c4a19f647585449972'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:02.374106 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1189/2393] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:12:01 2022] DELETE /identity/v3/users/dfb76ad566b645c4a19f647585449972 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:12:02.378735 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f7ef11-7576-4578-b358-98c9a503e53a None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:02.379266 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f7ef11-7576-4578-b358-98c9a503e53a None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:02.379266 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f7ef11-7576-4578-b358-98c9a503e53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:02.409204 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-40f7ef11-7576-4578-b358-98c9a503e53a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:02.413500 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-40f7ef11-7576-4578-b358-98c9a503e53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:02.491420 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1205/2394] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:12:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:12:02.504087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30915a-e271-43da-81c1-f13f0101f41e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:02.505870 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8b30915a-e271-43da-81c1-f13f0101f41e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:02.588564 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30915a-e271-43da-81c1-f13f0101f41e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:02.588564 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d17712-7519-40bc-957c-581df7a6fa3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:02.588849 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d17712-7519-40bc-957c-581df7a6fa3e service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:02.589905 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d17712-7519-40bc-957c-581df7a6fa3e service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:02.590258 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d17712-7519-40bc-957c-581df7a6fa3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:02.600031 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d17712-7519-40bc-957c-581df7a6fa3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:02.601702 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d17712-7519-40bc-957c-581df7a6fa3e service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:02.613920 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1190/2395] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:12:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:12:03.344940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df0898-e5ce-4ac2-bca9-24e1a8e6093d None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:03.345626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df0898-e5ce-4ac2-bca9-24e1a8e6093d None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:03.346416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df0898-e5ce-4ac2-bca9-24e1a8e6093d None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:03.348390 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1206/2396] 10.222.0.23 () {54 vars in 921 bytes} [Sat Apr 30 21:12:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:12:03.361671 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a0c25-5d57-4b9b-9cb5-d4f77148d11d None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:03.362239 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a0c25-5d57-4b9b-9cb5-d4f77148d11d None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:03.362364 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a0c25-5d57-4b9b-9cb5-d4f77148d11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:03.389026 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-de9a0c25-5d57-4b9b-9cb5-d4f77148d11d None None] MFA Rules not processed for user `4ad3f89b7037413a83c7905cef263b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:03.390289 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-de9a0c25-5d57-4b9b-9cb5-d4f77148d11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:03.503877 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1191/2397] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Apr 30 21:12:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:12:03.531316 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df0898-e5ce-4ac2-bca9-24e1a8e6093d None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:03.534235 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f4df0898-e5ce-4ac2-bca9-24e1a8e6093d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:03.561386 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df0898-e5ce-4ac2-bca9-24e1a8e6093d None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:03.571668 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb222c-4a8b-460d-8c85-346f3f8c6615 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:03.572351 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb222c-4a8b-460d-8c85-346f3f8c6615 service placement] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:03.572679 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb222c-4a8b-460d-8c85-346f3f8c6615 service placement] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:03.573006 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb222c-4a8b-460d-8c85-346f3f8c6615 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:03.584965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb222c-4a8b-460d-8c85-346f3f8c6615 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:03.587820 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb222c-4a8b-460d-8c85-346f3f8c6615 service placement] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:03.611248 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1207/2398] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:12:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:12:03.659755 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a0c25-5d57-4b9b-9cb5-d4f77148d11d None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:03.661709 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-de9a0c25-5d57-4b9b-9cb5-d4f77148d11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:03.695776 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a0c25-5d57-4b9b-9cb5-d4f77148d11d None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:03.713066 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f8971-338a-4ddc-a239-770cc3e10e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:03.715441 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f8971-338a-4ddc-a239-770cc3e10e46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:03.715730 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f8971-338a-4ddc-a239-770cc3e10e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:03.716063 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f8971-338a-4ddc-a239-770cc3e10e46 admin admin] PATH_INFO: `/v3/projects/fdb41e2c2c9d41a9836e14924a739d3d` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:03.720739 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f8971-338a-4ddc-a239-770cc3e10e46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdb41e2c2c9d41a9836e14924a739d3d)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:03.722901 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f8971-338a-4ddc-a239-770cc3e10e46 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:03.881168 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d79f8971-338a-4ddc-a239-770cc3e10e46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdb41e2c2c9d41a9836e14924a739d3d', 'request_id': 'req-d79f8971-338a-4ddc-a239-770cc3e10e46'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:03.888088 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d79f8971-338a-4ddc-a239-770cc3e10e46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdb41e2c2c9d41a9836e14924a739d3d', 'request_id': 'req-d79f8971-338a-4ddc-a239-770cc3e10e46'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:03.894731 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d79f8971-338a-4ddc-a239-770cc3e10e46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdb41e2c2c9d41a9836e14924a739d3d', 'request_id': 'req-d79f8971-338a-4ddc-a239-770cc3e10e46'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:04.002388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d79f8971-338a-4ddc-a239-770cc3e10e46 admin admin] The token cache is being invalidate because project fdb41e2c2c9d41a9836e14924a739d3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:12:04.002674 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d79f8971-338a-4ddc-a239-770cc3e10e46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:04.003447 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d79f8971-338a-4ddc-a239-770cc3e10e46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:04.005457 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1192/2399] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:12:03 2022] DELETE /identity/v3/projects/fdb41e2c2c9d41a9836e14924a739d3d => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:12:04.009599 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb222c-4a8b-460d-8c85-346f3f8c6615 service placement] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:04.020524 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb222c-4a8b-460d-8c85-346f3f8c6615 service placement] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:04.087820 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b24cd4-3468-4628-ac84-1646a46adcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:04.094550 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b24cd4-3468-4628-ac84-1646a46adcc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:04.094550 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b24cd4-3468-4628-ac84-1646a46adcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:04.094550 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b24cd4-3468-4628-ac84-1646a46adcc8 admin admin] PATH_INFO: `/v3/users/10869192363240a6a023cb670d0ef8f9` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:04.094550 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b24cd4-3468-4628-ac84-1646a46adcc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10869192363240a6a023cb670d0ef8f9)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:04.098105 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b24cd4-3468-4628-ac84-1646a46adcc8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:04.297253 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e0b24cd4-3468-4628-ac84-1646a46adcc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10869192363240a6a023cb670d0ef8f9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:04.308981 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e0b24cd4-3468-4628-ac84-1646a46adcc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10869192363240a6a023cb670d0ef8f9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:04.395931 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e0b24cd4-3468-4628-ac84-1646a46adcc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10869192363240a6a023cb670d0ef8f9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:04.398427 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e0b24cd4-3468-4628-ac84-1646a46adcc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10869192363240a6a023cb670d0ef8f9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:04.422482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e0b24cd4-3468-4628-ac84-1646a46adcc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10869192363240a6a023cb670d0ef8f9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:04.447401 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1208/2400] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:12:04 2022] DELETE /identity/v3/users/10869192363240a6a023cb670d0ef8f9 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:12:05.106794 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b05d23-4fda-49fd-83fb-c0f963b110cb None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:05.107245 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b05d23-4fda-49fd-83fb-c0f963b110cb None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:05.107522 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b05d23-4fda-49fd-83fb-c0f963b110cb None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:05.109465 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1193/2401] 10.222.0.23 () {54 vars in 921 bytes} [Sat Apr 30 21:12:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:12:05.115451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f99c43c-5c28-4af0-a3a8-2ff558cb2034 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:05.120240 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f99c43c-5c28-4af0-a3a8-2ff558cb2034 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:05.120240 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f99c43c-5c28-4af0-a3a8-2ff558cb2034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:05.138843 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-2f99c43c-5c28-4af0-a3a8-2ff558cb2034 None None] MFA Rules not processed for user `fca4ee1f64c8489ebe7296f9f8f0ab41`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:05.140423 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2f99c43c-5c28-4af0-a3a8-2ff558cb2034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:05.299001 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1209/2402] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Apr 30 21:12:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:12:05.316089 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b05d23-4fda-49fd-83fb-c0f963b110cb None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:05.318321 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-30b05d23-4fda-49fd-83fb-c0f963b110cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:05.353839 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f99c43c-5c28-4af0-a3a8-2ff558cb2034 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:05.358622 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2f99c43c-5c28-4af0-a3a8-2ff558cb2034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:05.477655 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b05d23-4fda-49fd-83fb-c0f963b110cb None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:05.501827 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691852b-f338-4eed-b789-4f74785e0eed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:05.502499 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691852b-f338-4eed-b789-4f74785e0eed service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:05.502781 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691852b-f338-4eed-b789-4f74785e0eed service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:05.503059 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691852b-f338-4eed-b789-4f74785e0eed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:05.520120 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f99c43c-5c28-4af0-a3a8-2ff558cb2034 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:05.522034 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0691852b-f338-4eed-b789-4f74785e0eed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:05.523498 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0691852b-f338-4eed-b789-4f74785e0eed service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:05.533333 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f9120-b7cf-4392-bd77-876e21a6c648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:05.534548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f9120-b7cf-4392-bd77-876e21a6c648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:05.534982 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f9120-b7cf-4392-bd77-876e21a6c648 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:05.535408 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f9120-b7cf-4392-bd77-876e21a6c648 admin admin] PATH_INFO: `/v3/projects/4860de9410494884aafea52798527174` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:05.538417 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f9120-b7cf-4392-bd77-876e21a6c648 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4860de9410494884aafea52798527174)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:05.542509 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f9120-b7cf-4392-bd77-876e21a6c648 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:05.550914 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1194/2403] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:12:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:12:05.582500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d02540-e018-40a3-b962-18b799adeacd None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:05.582785 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d02540-e018-40a3-b962-18b799adeacd None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:05.583403 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d02540-e018-40a3-b962-18b799adeacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:05.626696 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-77d02540-e018-40a3-b962-18b799adeacd None None] MFA Rules not processed for user `0b0cb145b72a492ebb8c0e9223be47a1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:05.629149 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-77d02540-e018-40a3-b962-18b799adeacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:05.640495 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1195/2404] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Apr 30 21:12:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:12:05.668675 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d02540-e018-40a3-b962-18b799adeacd None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:05.686064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d02540-e018-40a3-b962-18b799adeacd None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:05.720186 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-df3f9120-b7cf-4392-bd77-876e21a6c648 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4860de9410494884aafea52798527174', 'request_id': 'req-df3f9120-b7cf-4392-bd77-876e21a6c648'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:05.735086 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-df3f9120-b7cf-4392-bd77-876e21a6c648 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4860de9410494884aafea52798527174', 'request_id': 'req-df3f9120-b7cf-4392-bd77-876e21a6c648'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:05.747310 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-df3f9120-b7cf-4392-bd77-876e21a6c648 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4860de9410494884aafea52798527174', 'request_id': 'req-df3f9120-b7cf-4392-bd77-876e21a6c648'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:05.809245 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2725d-4a6b-4bee-97e6-691ffef3585a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:05.810816 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2725d-4a6b-4bee-97e6-691ffef3585a service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:05.811207 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2725d-4a6b-4bee-97e6-691ffef3585a service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:05.811594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2725d-4a6b-4bee-97e6-691ffef3585a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:05.831205 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2725d-4a6b-4bee-97e6-691ffef3585a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:05.832890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2725d-4a6b-4bee-97e6-691ffef3585a service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:05.853957 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1196/2405] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:12:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:12:05.866896 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-df3f9120-b7cf-4392-bd77-876e21a6c648 admin admin] The token cache is being invalidate because project 4860de9410494884aafea52798527174 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:12:05.867191 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-df3f9120-b7cf-4392-bd77-876e21a6c648 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:05.867858 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-df3f9120-b7cf-4392-bd77-876e21a6c648 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:05.869926 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1210/2406] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:12:05 2022] DELETE /identity/v3/projects/4860de9410494884aafea52798527174 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:12:05.878821 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc07a0-dfb8-4f6f-8dba-19f17d173804 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:05.880134 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc07a0-dfb8-4f6f-8dba-19f17d173804 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:05.880702 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc07a0-dfb8-4f6f-8dba-19f17d173804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:05.941368 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-7bcc07a0-dfb8-4f6f-8dba-19f17d173804 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:05.943017 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7bcc07a0-dfb8-4f6f-8dba-19f17d173804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:06.114100 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1197/2407] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:12:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:12:06.116083 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3475f22-d9b9-42f0-99d8-25e9281e3688 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:06.116871 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3475f22-d9b9-42f0-99d8-25e9281e3688 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:06.117355 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3475f22-d9b9-42f0-99d8-25e9281e3688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:06.178827 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-e3475f22-d9b9-42f0-99d8-25e9281e3688 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:06.180072 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e3475f22-d9b9-42f0-99d8-25e9281e3688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:06.218096 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1211/2408] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:12:06.221774 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc07a0-dfb8-4f6f-8dba-19f17d173804 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:06.231906 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc07a0-dfb8-4f6f-8dba-19f17d173804 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:06.241748 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080eb1e8-2207-4be3-a85d-d77653efdfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:06.242479 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080eb1e8-2207-4be3-a85d-d77653efdfcb admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:06.243341 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080eb1e8-2207-4be3-a85d-d77653efdfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:06.243640 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080eb1e8-2207-4be3-a85d-d77653efdfcb admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:06.245850 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080eb1e8-2207-4be3-a85d-d77653efdfcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:12:06.246374 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080eb1e8-2207-4be3-a85d-d77653efdfcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:06.248237 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080eb1e8-2207-4be3-a85d-d77653efdfcb admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:06.268198 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1198/2409] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:12:06.280835 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3475f22-d9b9-42f0-99d8-25e9281e3688 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:06.296079 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3475f22-d9b9-42f0-99d8-25e9281e3688 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:06.302116 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22621709-b07d-4c90-8cee-3ba8d9ce740e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:06.303242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22621709-b07d-4c90-8cee-3ba8d9ce740e admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:06.303531 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22621709-b07d-4c90-8cee-3ba8d9ce740e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:06.303811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22621709-b07d-4c90-8cee-3ba8d9ce740e admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:06.304576 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22621709-b07d-4c90-8cee-3ba8d9ce740e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:06.306647 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22621709-b07d-4c90-8cee-3ba8d9ce740e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:06.443746 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080eb1e8-2207-4be3-a85d-d77653efdfcb admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:06.445900 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1212/2410] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:12:06 2022] POST /identity/v3/projects => generated 371 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:12:06.455895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080eb1e8-2207-4be3-a85d-d77653efdfcb admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:06.546084 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3de90c-1dfd-425f-a3e8-2f42412542ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:06.546937 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3de90c-1dfd-425f-a3e8-2f42412542ea admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:06.550333 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3de90c-1dfd-425f-a3e8-2f42412542ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:06.550333 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3de90c-1dfd-425f-a3e8-2f42412542ea admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:06.550333 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3de90c-1dfd-425f-a3e8-2f42412542ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:06.550842 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3de90c-1dfd-425f-a3e8-2f42412542ea admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:06.642321 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1199/2411] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:12:06 2022] POST /identity/v3/users => generated 286 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:12:06.646162 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22621709-b07d-4c90-8cee-3ba8d9ce740e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:06.658015 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22621709-b07d-4c90-8cee-3ba8d9ce740e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:06.663345 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34221e4f-a83b-419d-aa2b-99bfb3b5b873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:06.664093 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34221e4f-a83b-419d-aa2b-99bfb3b5b873 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:06.664449 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34221e4f-a83b-419d-aa2b-99bfb3b5b873 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:06.664907 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34221e4f-a83b-419d-aa2b-99bfb3b5b873 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:06.665583 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34221e4f-a83b-419d-aa2b-99bfb3b5b873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:06.667464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34221e4f-a83b-419d-aa2b-99bfb3b5b873 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:06.679282 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1213/2412] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:12:06.684240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3de90c-1dfd-425f-a3e8-2f42412542ea admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:06.695454 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3de90c-1dfd-425f-a3e8-2f42412542ea admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:06.701591 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae853d6-798e-48be-b82a-7e5e62257a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:06.702564 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae853d6-798e-48be-b82a-7e5e62257a1f admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:06.702956 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae853d6-798e-48be-b82a-7e5e62257a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:06.703367 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae853d6-798e-48be-b82a-7e5e62257a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:06.704106 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae853d6-798e-48be-b82a-7e5e62257a1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:06.705744 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae853d6-798e-48be-b82a-7e5e62257a1f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:06.719100 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1200/2413] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:12:06.722914 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34221e4f-a83b-419d-aa2b-99bfb3b5b873 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:06.735926 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34221e4f-a83b-419d-aa2b-99bfb3b5b873 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:06.744737 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219bbaa-d5f4-4386-91be-7f04f55bce4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:06.745859 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219bbaa-d5f4-4386-91be-7f04f55bce4f admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:06.746148 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219bbaa-d5f4-4386-91be-7f04f55bce4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:06.746426 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219bbaa-d5f4-4386-91be-7f04f55bce4f admin admin] PATH_INFO: `/v3/projects/82c4966a4956403f813f0550c9da2385/users/ff156c62ef8343d089e64648b4b231d2/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:06.766336 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9219bbaa-d5f4-4386-91be-7f04f55bce4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=82c4966a4956403f813f0550c9da2385, user_id=ff156c62ef8343d089e64648b4b231d2, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:06.768961 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9219bbaa-d5f4-4386-91be-7f04f55bce4f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:06.869073 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1214/2414] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:12:06 2022] PUT /identity/v3/projects/82c4966a4956403f813f0550c9da2385/users/ff156c62ef8343d089e64648b4b231d2/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:12:06.882056 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fcf25d-5c41-4b13-97e7-50d001a24352 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:06.882349 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fcf25d-5c41-4b13-97e7-50d001a24352 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:06.882943 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fcf25d-5c41-4b13-97e7-50d001a24352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:06.938039 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-c1fcf25d-5c41-4b13-97e7-50d001a24352 None None] MFA Rules not processed for user `ff156c62ef8343d089e64648b4b231d2`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:06.939301 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c1fcf25d-5c41-4b13-97e7-50d001a24352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:07.013305 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1201/2415] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:12:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:12:07.406760 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219bbaa-d5f4-4386-91be-7f04f55bce4f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:07.408981 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-9219bbaa-d5f4-4386-91be-7f04f55bce4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:07.536089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219bbaa-d5f4-4386-91be-7f04f55bce4f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:07.549306 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47211cab-c420-4bfa-8028-e80df8146efb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:07.552621 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47211cab-c420-4bfa-8028-e80df8146efb service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:07.555617 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47211cab-c420-4bfa-8028-e80df8146efb service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:07.556191 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47211cab-c420-4bfa-8028-e80df8146efb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:07.567397 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47211cab-c420-4bfa-8028-e80df8146efb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:07.569408 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47211cab-c420-4bfa-8028-e80df8146efb service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:07.579846 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1215/2416] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:12:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:12:08.350057 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66c19f-2a94-45cb-b197-5d3c33a0162a None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:08.350057 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66c19f-2a94-45cb-b197-5d3c33a0162a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:08.350057 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66c19f-2a94-45cb-b197-5d3c33a0162a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:08.373694 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-4f66c19f-2a94-45cb-b197-5d3c33a0162a None None] MFA Rules not processed for user `dadac4f61fe141dba3ee726ca6cbf29a`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:08.375111 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4f66c19f-2a94-45cb-b197-5d3c33a0162a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:08.474895 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1202/2417] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:12:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:12:13.239760 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47211cab-c420-4bfa-8028-e80df8146efb service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:13.312875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47211cab-c420-4bfa-8028-e80df8146efb service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:13.318865 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064144f-cfb1-45f0-afad-d4d10d8eca9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:13.319867 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064144f-cfb1-45f0-afad-d4d10d8eca9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:13.320220 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064144f-cfb1-45f0-afad-d4d10d8eca9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:13.320826 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064144f-cfb1-45f0-afad-d4d10d8eca9e admin admin] PATH_INFO: `/v3/users/ff156c62ef8343d089e64648b4b231d2` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:13.322193 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a064144f-cfb1-45f0-afad-d4d10d8eca9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff156c62ef8343d089e64648b4b231d2)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:13.328360 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a064144f-cfb1-45f0-afad-d4d10d8eca9e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:13.490383 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a064144f-cfb1-45f0-afad-d4d10d8eca9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff156c62ef8343d089e64648b4b231d2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:13.502226 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a064144f-cfb1-45f0-afad-d4d10d8eca9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff156c62ef8343d089e64648b4b231d2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:13.574567 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a064144f-cfb1-45f0-afad-d4d10d8eca9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff156c62ef8343d089e64648b4b231d2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:13.575433 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a064144f-cfb1-45f0-afad-d4d10d8eca9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff156c62ef8343d089e64648b4b231d2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:13.584023 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a064144f-cfb1-45f0-afad-d4d10d8eca9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff156c62ef8343d089e64648b4b231d2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:13.593318 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1216/2418] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:12:13 2022] DELETE /identity/v3/users/ff156c62ef8343d089e64648b4b231d2 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:12:13.597749 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6472c-6b58-49a1-b6b2-ddff423bfced None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:13.598555 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6472c-6b58-49a1-b6b2-ddff423bfced None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:13.598868 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6472c-6b58-49a1-b6b2-ddff423bfced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:13.620865 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-f3e6472c-6b58-49a1-b6b2-ddff423bfced None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:13.622757 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f3e6472c-6b58-49a1-b6b2-ddff423bfced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:13.730733 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1203/2419] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:12:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:12:13.747034 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064144f-cfb1-45f0-afad-d4d10d8eca9e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:13.748849 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a064144f-cfb1-45f0-afad-d4d10d8eca9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:13.838893 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064144f-cfb1-45f0-afad-d4d10d8eca9e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:13.846141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b57f7-7ec1-44b2-815b-a779c6e15880 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:13.847136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b57f7-7ec1-44b2-815b-a779c6e15880 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:13.848513 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b57f7-7ec1-44b2-815b-a779c6e15880 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:13.848977 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b57f7-7ec1-44b2-815b-a779c6e15880 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:13.876157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677b57f7-7ec1-44b2-815b-a779c6e15880 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:13.880309 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677b57f7-7ec1-44b2-815b-a779c6e15880 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:13.903456 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1217/2420] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:12:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:12:14.539264 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6472c-6b58-49a1-b6b2-ddff423bfced None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:14.541262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f3e6472c-6b58-49a1-b6b2-ddff423bfced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:14.554355 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6472c-6b58-49a1-b6b2-ddff423bfced None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:14.560306 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf32529-465d-4010-b2e3-eccb913bf945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:14.561182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf32529-465d-4010-b2e3-eccb913bf945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:14.561649 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf32529-465d-4010-b2e3-eccb913bf945 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:14.562106 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf32529-465d-4010-b2e3-eccb913bf945 admin admin] PATH_INFO: `/v3/projects/82c4966a4956403f813f0550c9da2385` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:14.563500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf32529-465d-4010-b2e3-eccb913bf945 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82c4966a4956403f813f0550c9da2385)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:14.569043 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf32529-465d-4010-b2e3-eccb913bf945 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:14.669951 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0bf32529-465d-4010-b2e3-eccb913bf945 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82c4966a4956403f813f0550c9da2385', 'request_id': 'req-0bf32529-465d-4010-b2e3-eccb913bf945'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:14.675434 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0bf32529-465d-4010-b2e3-eccb913bf945 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82c4966a4956403f813f0550c9da2385', 'request_id': 'req-0bf32529-465d-4010-b2e3-eccb913bf945'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:14.682378 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0bf32529-465d-4010-b2e3-eccb913bf945 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82c4966a4956403f813f0550c9da2385', 'request_id': 'req-0bf32529-465d-4010-b2e3-eccb913bf945'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:14.749581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0bf32529-465d-4010-b2e3-eccb913bf945 admin admin] The token cache is being invalidate because project 82c4966a4956403f813f0550c9da2385 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:12:14.749940 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0bf32529-465d-4010-b2e3-eccb913bf945 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:14.750650 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0bf32529-465d-4010-b2e3-eccb913bf945 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:14.752439 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1204/2421] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:12:14 2022] DELETE /identity/v3/projects/82c4966a4956403f813f0550c9da2385 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:12:14.757626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742fee2-82cc-4005-aa08-b75055058834 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:14.758155 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742fee2-82cc-4005-aa08-b75055058834 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:14.758264 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742fee2-82cc-4005-aa08-b75055058834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:14.777116 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-d742fee2-82cc-4005-aa08-b75055058834 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:14.778326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d742fee2-82cc-4005-aa08-b75055058834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:14.838420 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1218/2422] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:12:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:12:14.847042 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fa487-8d58-4fdc-ad3c-7d9cdc52466e None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:14.847337 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fa487-8d58-4fdc-ad3c-7d9cdc52466e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:14.850723 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fa487-8d58-4fdc-ad3c-7d9cdc52466e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:14.866382 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-051fa487-8d58-4fdc-ad3c-7d9cdc52466e None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:14.867723 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-051fa487-8d58-4fdc-ad3c-7d9cdc52466e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:14.876098 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1205/2423] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:12:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:12:14.880684 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742fee2-82cc-4005-aa08-b75055058834 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:14.891322 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742fee2-82cc-4005-aa08-b75055058834 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:14.896080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ada4d-58a4-4bc8-b994-12e6d1671949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:14.896771 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ada4d-58a4-4bc8-b994-12e6d1671949 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:14.897059 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ada4d-58a4-4bc8-b994-12e6d1671949 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:14.897341 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ada4d-58a4-4bc8-b994-12e6d1671949 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:14.898111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ada4d-58a4-4bc8-b994-12e6d1671949 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:12:14.898421 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ada4d-58a4-4bc8-b994-12e6d1671949 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:14.900040 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ada4d-58a4-4bc8-b994-12e6d1671949 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:14.913821 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1219/2424] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:12:14.922739 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fa487-8d58-4fdc-ad3c-7d9cdc52466e None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:14.931966 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fa487-8d58-4fdc-ad3c-7d9cdc52466e None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:14.936689 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c125e0-a30e-48c2-8237-5fccf064861c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:14.937342 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c125e0-a30e-48c2-8237-5fccf064861c admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:14.937628 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c125e0-a30e-48c2-8237-5fccf064861c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:14.938062 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c125e0-a30e-48c2-8237-5fccf064861c admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:14.938998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c125e0-a30e-48c2-8237-5fccf064861c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:14.941188 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c125e0-a30e-48c2-8237-5fccf064861c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:15.050722 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1206/2425] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:12:14 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:12:15.054656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ada4d-58a4-4bc8-b994-12e6d1671949 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:15.065184 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ada4d-58a4-4bc8-b994-12e6d1671949 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:15.123769 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f25c31-c8d9-4920-8bd9-a74da8b609f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:15.124462 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f25c31-c8d9-4920-8bd9-a74da8b609f0 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:15.124740 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f25c31-c8d9-4920-8bd9-a74da8b609f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:15.125019 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f25c31-c8d9-4920-8bd9-a74da8b609f0 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:15.125710 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f25c31-c8d9-4920-8bd9-a74da8b609f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:15.127771 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f25c31-c8d9-4920-8bd9-a74da8b609f0 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:15.214550 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1220/2426] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:12:15 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:12:15.218485 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c125e0-a30e-48c2-8237-5fccf064861c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:15.230136 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c125e0-a30e-48c2-8237-5fccf064861c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:15.236640 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5f654-e099-4d6a-8412-aaf4192e2fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:15.237539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5f654-e099-4d6a-8412-aaf4192e2fef admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:15.237680 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5f654-e099-4d6a-8412-aaf4192e2fef admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:15.237920 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5f654-e099-4d6a-8412-aaf4192e2fef admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:15.238658 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c5f654-e099-4d6a-8412-aaf4192e2fef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:15.240293 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c5f654-e099-4d6a-8412-aaf4192e2fef admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:15.252195 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1207/2427] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:12:15.261808 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f25c31-c8d9-4920-8bd9-a74da8b609f0 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:15.277072 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f25c31-c8d9-4920-8bd9-a74da8b609f0 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:15.290928 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0668b3f-9e12-4d8f-929b-3a5f229aa056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:15.291670 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0668b3f-9e12-4d8f-929b-3a5f229aa056 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:15.292008 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0668b3f-9e12-4d8f-929b-3a5f229aa056 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:15.292284 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0668b3f-9e12-4d8f-929b-3a5f229aa056 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:15.293014 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0668b3f-9e12-4d8f-929b-3a5f229aa056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:15.298601 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0668b3f-9e12-4d8f-929b-3a5f229aa056 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:15.313183 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1221/2428] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:12:15.317531 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5f654-e099-4d6a-8412-aaf4192e2fef admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:15.328426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5f654-e099-4d6a-8412-aaf4192e2fef admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:15.333237 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098721f-182b-41de-895d-2c7ab2a885ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:15.334157 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098721f-182b-41de-895d-2c7ab2a885ce admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:15.334445 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098721f-182b-41de-895d-2c7ab2a885ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:15.334726 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098721f-182b-41de-895d-2c7ab2a885ce admin admin] PATH_INFO: `/v3/projects/9284e1c76f5a41ea9da1eb011943eb8a/users/74c331c48d20422492001f71f0672885/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:15.351766 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098721f-182b-41de-895d-2c7ab2a885ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=9284e1c76f5a41ea9da1eb011943eb8a, user_id=74c331c48d20422492001f71f0672885, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:15.354682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098721f-182b-41de-895d-2c7ab2a885ce admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:15.461988 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1208/2429] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:12:15 2022] PUT /identity/v3/projects/9284e1c76f5a41ea9da1eb011943eb8a/users/74c331c48d20422492001f71f0672885/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:12:15.473037 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2b521-3cb6-4609-bf36-f5c4f0553e61 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:15.473878 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2b521-3cb6-4609-bf36-f5c4f0553e61 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:15.474464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2b521-3cb6-4609-bf36-f5c4f0553e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:15.506076 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-22a2b521-3cb6-4609-bf36-f5c4f0553e61 None None] MFA Rules not processed for user `74c331c48d20422492001f71f0672885`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:15.507463 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-22a2b521-3cb6-4609-bf36-f5c4f0553e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:15.607587 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1222/2430] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:12:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:12:15.608343 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80bee8-65be-480e-8cae-5832521346be None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:15.608641 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80bee8-65be-480e-8cae-5832521346be None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:15.608925 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80bee8-65be-480e-8cae-5832521346be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:15.627588 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-9c80bee8-65be-480e-8cae-5832521346be None None] MFA Rules not processed for user `74c331c48d20422492001f71f0672885`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:15.634525 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9c80bee8-65be-480e-8cae-5832521346be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:15.638814 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1209/2431] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:12:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:12:15.650435 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2b521-3cb6-4609-bf36-f5c4f0553e61 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:15.651915 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-22a2b521-3cb6-4609-bf36-f5c4f0553e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:15.759511 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2b521-3cb6-4609-bf36-f5c4f0553e61 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:15.768746 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa001d-39f7-4962-b62e-4fd41a865662 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:15.769540 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa001d-39f7-4962-b62e-4fd41a865662 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:15.769855 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa001d-39f7-4962-b62e-4fd41a865662 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:15.771368 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa001d-39f7-4962-b62e-4fd41a865662 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:15.782762 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa001d-39f7-4962-b62e-4fd41a865662 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:15.785387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa001d-39f7-4962-b62e-4fd41a865662 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:15.798016 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1223/2432] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:12:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:12:22.587882 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315864a-da72-43c0-967f-cb736ec14f51 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:22.588747 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315864a-da72-43c0-967f-cb736ec14f51 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:22.589425 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315864a-da72-43c0-967f-cb736ec14f51 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:22.591823 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1210/2433] 10.222.0.23 () {54 vars in 921 bytes} [Sat Apr 30 21:12:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:12:22.597965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb4962-c92d-44ee-baa3-4f9ae3388465 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:22.602754 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb4962-c92d-44ee-baa3-4f9ae3388465 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:22.603480 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb4962-c92d-44ee-baa3-4f9ae3388465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:22.647366 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-e7eb4962-c92d-44ee-baa3-4f9ae3388465 None None] MFA Rules not processed for user `4ad3f89b7037413a83c7905cef263b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:22.648929 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e7eb4962-c92d-44ee-baa3-4f9ae3388465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:22.736137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4e67e-bbec-4f5e-89e1-7e39098a94e8 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:22.736427 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4e67e-bbec-4f5e-89e1-7e39098a94e8 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:22.736706 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4e67e-bbec-4f5e-89e1-7e39098a94e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:22.743058 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1224/2434] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Apr 30 21:12:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:12:22.787373 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-76c4e67e-bbec-4f5e-89e1-7e39098a94e8 None None] MFA Rules not processed for user `8bd54cdc115e4ae9b202bd06c7658e4a`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:22.790748 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-76c4e67e-bbec-4f5e-89e1-7e39098a94e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:22.795384 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb4962-c92d-44ee-baa3-4f9ae3388465 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:22.797561 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e7eb4962-c92d-44ee-baa3-4f9ae3388465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:22.812027 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb4962-c92d-44ee-baa3-4f9ae3388465 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:22.828847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8948a1d8-66e8-495d-8a2e-713b4c0e412c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:22.829525 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948a1d8-66e8-495d-8a2e-713b4c0e412c service placement] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:22.829820 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948a1d8-66e8-495d-8a2e-713b4c0e412c service placement] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:22.830101 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948a1d8-66e8-495d-8a2e-713b4c0e412c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:22.841238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8948a1d8-66e8-495d-8a2e-713b4c0e412c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:22.841713 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8948a1d8-66e8-495d-8a2e-713b4c0e412c service placement] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:22.852903 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1225/2435] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:12:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:12:22.860004 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1211/2436] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:12:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:12:23.329185 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e30c6-a157-418d-9d50-4898a781b011 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:23.330310 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e30c6-a157-418d-9d50-4898a781b011 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:23.331150 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e30c6-a157-418d-9d50-4898a781b011 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:23.335004 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1226/2437] 10.222.0.23 () {54 vars in 921 bytes} [Sat Apr 30 21:12:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:12:23.341283 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da92d8-de19-4166-a424-324abb3aab49 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:23.341623 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da92d8-de19-4166-a424-324abb3aab49 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:23.341987 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da92d8-de19-4166-a424-324abb3aab49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:23.363051 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-c9da92d8-de19-4166-a424-324abb3aab49 None None] MFA Rules not processed for user `fca4ee1f64c8489ebe7296f9f8f0ab41`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:23.365176 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c9da92d8-de19-4166-a424-324abb3aab49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:23.382311 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1212/2438] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Apr 30 21:12:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:12:23.395943 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e30c6-a157-418d-9d50-4898a781b011 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:23.402625 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-cd9e30c6-a157-418d-9d50-4898a781b011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:23.498771 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e30c6-a157-418d-9d50-4898a781b011 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:23.503431 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acdff57-58f4-4071-a004-941a9edd50d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:23.505460 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdff57-58f4-4071-a004-941a9edd50d5 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:23.505981 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdff57-58f4-4071-a004-941a9edd50d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:23.506266 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acdff57-58f4-4071-a004-941a9edd50d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:23.521493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acdff57-58f4-4071-a004-941a9edd50d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:23.523484 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acdff57-58f4-4071-a004-941a9edd50d5 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:23.544295 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1227/2439] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:12:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:12:24.405777 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da92d8-de19-4166-a424-324abb3aab49 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:24.415827 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c9da92d8-de19-4166-a424-324abb3aab49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:24.492869 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da92d8-de19-4166-a424-324abb3aab49 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:24.501440 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd8372d-8a2b-49ff-87db-872e5543d165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:24.503038 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8372d-8a2b-49ff-87db-872e5543d165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:24.504091 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8372d-8a2b-49ff-87db-872e5543d165 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:24.504540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8372d-8a2b-49ff-87db-872e5543d165 admin admin] PATH_INFO: `/v3/users/6a8350c0cb814c66b94775110721dee4` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:24.506599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd8372d-8a2b-49ff-87db-872e5543d165 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a8350c0cb814c66b94775110721dee4)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:24.509551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd8372d-8a2b-49ff-87db-872e5543d165 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:24.755150 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5dd8372d-8a2b-49ff-87db-872e5543d165 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a8350c0cb814c66b94775110721dee4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:24.779106 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5dd8372d-8a2b-49ff-87db-872e5543d165 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a8350c0cb814c66b94775110721dee4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:24.871107 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5dd8372d-8a2b-49ff-87db-872e5543d165 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a8350c0cb814c66b94775110721dee4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:24.879301 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5dd8372d-8a2b-49ff-87db-872e5543d165 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a8350c0cb814c66b94775110721dee4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:24.879942 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5dd8372d-8a2b-49ff-87db-872e5543d165 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a8350c0cb814c66b94775110721dee4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:24.886685 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1213/2440] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:12:24 2022] DELETE /identity/v3/users/6a8350c0cb814c66b94775110721dee4 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:12:24.892638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c468709-c2fa-45f0-8284-b825c5484de4 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:24.893115 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c468709-c2fa-45f0-8284-b825c5484de4 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:24.893445 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c468709-c2fa-45f0-8284-b825c5484de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:24.911233 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-8c468709-c2fa-45f0-8284-b825c5484de4 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:24.912436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8c468709-c2fa-45f0-8284-b825c5484de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:24.979179 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1228/2441] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:12:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:12:24.993192 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd8372d-8a2b-49ff-87db-872e5543d165 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:24.993192 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5dd8372d-8a2b-49ff-87db-872e5543d165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:25.049242 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd8372d-8a2b-49ff-87db-872e5543d165 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:25.053019 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4fb934-6c8b-4df3-adc8-9af42bc52a73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:25.053662 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4fb934-6c8b-4df3-adc8-9af42bc52a73 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:25.053974 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4fb934-6c8b-4df3-adc8-9af42bc52a73 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:25.054251 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4fb934-6c8b-4df3-adc8-9af42bc52a73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:25.064314 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4fb934-6c8b-4df3-adc8-9af42bc52a73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:25.066106 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4fb934-6c8b-4df3-adc8-9af42bc52a73 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:25.076645 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1214/2442] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:12:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:12:25.327679 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c468709-c2fa-45f0-8284-b825c5484de4 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:25.329111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8c468709-c2fa-45f0-8284-b825c5484de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:25.348926 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c468709-c2fa-45f0-8284-b825c5484de4 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:25.369793 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10434e-306d-4d52-99dd-b6ab93ce36b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:25.371122 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10434e-306d-4d52-99dd-b6ab93ce36b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:25.371410 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10434e-306d-4d52-99dd-b6ab93ce36b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:25.371687 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10434e-306d-4d52-99dd-b6ab93ce36b8 admin admin] PATH_INFO: `/v3/projects/f727d5639c624deeba0d0d7a7d08810e` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:25.372926 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10434e-306d-4d52-99dd-b6ab93ce36b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f727d5639c624deeba0d0d7a7d08810e)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:25.374891 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10434e-306d-4d52-99dd-b6ab93ce36b8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:25.530084 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3d10434e-306d-4d52-99dd-b6ab93ce36b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f727d5639c624deeba0d0d7a7d08810e', 'request_id': 'req-3d10434e-306d-4d52-99dd-b6ab93ce36b8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:25.536244 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3d10434e-306d-4d52-99dd-b6ab93ce36b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f727d5639c624deeba0d0d7a7d08810e', 'request_id': 'req-3d10434e-306d-4d52-99dd-b6ab93ce36b8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:25.549247 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3d10434e-306d-4d52-99dd-b6ab93ce36b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f727d5639c624deeba0d0d7a7d08810e', 'request_id': 'req-3d10434e-306d-4d52-99dd-b6ab93ce36b8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:25.652202 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3d10434e-306d-4d52-99dd-b6ab93ce36b8 admin admin] The token cache is being invalidate because project f727d5639c624deeba0d0d7a7d08810e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:12:25.652491 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3d10434e-306d-4d52-99dd-b6ab93ce36b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:25.653131 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3d10434e-306d-4d52-99dd-b6ab93ce36b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:25.654977 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1229/2443] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:12:25 2022] DELETE /identity/v3/projects/f727d5639c624deeba0d0d7a7d08810e => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:12:25.658911 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4fb934-6c8b-4df3-adc8-9af42bc52a73 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:25.669398 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4fb934-6c8b-4df3-adc8-9af42bc52a73 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:25.728332 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778ced6-76fe-424f-a98f-7e745c94544d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:25.729751 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778ced6-76fe-424f-a98f-7e745c94544d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:25.730051 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778ced6-76fe-424f-a98f-7e745c94544d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:25.730867 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778ced6-76fe-424f-a98f-7e745c94544d admin admin] PATH_INFO: `/v3/users/bd57b47fc89748b1bc8a0083873ff7a0` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:25.732111 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d778ced6-76fe-424f-a98f-7e745c94544d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd57b47fc89748b1bc8a0083873ff7a0)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:25.734099 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d778ced6-76fe-424f-a98f-7e745c94544d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:25.942250 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d778ced6-76fe-424f-a98f-7e745c94544d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd57b47fc89748b1bc8a0083873ff7a0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:25.954076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d778ced6-76fe-424f-a98f-7e745c94544d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd57b47fc89748b1bc8a0083873ff7a0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:26.065266 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d778ced6-76fe-424f-a98f-7e745c94544d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd57b47fc89748b1bc8a0083873ff7a0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:26.073408 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d778ced6-76fe-424f-a98f-7e745c94544d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd57b47fc89748b1bc8a0083873ff7a0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:26.074112 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d778ced6-76fe-424f-a98f-7e745c94544d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd57b47fc89748b1bc8a0083873ff7a0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:26.080278 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1215/2444] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:12:25 2022] DELETE /identity/v3/users/bd57b47fc89748b1bc8a0083873ff7a0 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:12:26.600982 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10434e-306d-4d52-99dd-b6ab93ce36b8 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:26.602457 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3d10434e-306d-4d52-99dd-b6ab93ce36b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:26.618957 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10434e-306d-4d52-99dd-b6ab93ce36b8 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:26.728865 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6917e0-113a-43b7-b68c-9daa2f418033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:26.729856 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6917e0-113a-43b7-b68c-9daa2f418033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:26.733099 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6917e0-113a-43b7-b68c-9daa2f418033 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:26.733099 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6917e0-113a-43b7-b68c-9daa2f418033 admin admin] PATH_INFO: `/v3/projects/9ce06bffca1a469194ba7e945510f424` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:26.733099 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6917e0-113a-43b7-b68c-9daa2f418033 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ce06bffca1a469194ba7e945510f424)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:26.734954 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6917e0-113a-43b7-b68c-9daa2f418033 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:26.883231 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6e6917e0-113a-43b7-b68c-9daa2f418033 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ce06bffca1a469194ba7e945510f424', 'request_id': 'req-6e6917e0-113a-43b7-b68c-9daa2f418033'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:26.889284 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6e6917e0-113a-43b7-b68c-9daa2f418033 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ce06bffca1a469194ba7e945510f424', 'request_id': 'req-6e6917e0-113a-43b7-b68c-9daa2f418033'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:26.895949 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6e6917e0-113a-43b7-b68c-9daa2f418033 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ce06bffca1a469194ba7e945510f424', 'request_id': 'req-6e6917e0-113a-43b7-b68c-9daa2f418033'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:26.987461 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6e6917e0-113a-43b7-b68c-9daa2f418033 admin admin] The token cache is being invalidate because project 9ce06bffca1a469194ba7e945510f424 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:12:26.987766 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6e6917e0-113a-43b7-b68c-9daa2f418033 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:26.988491 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6e6917e0-113a-43b7-b68c-9daa2f418033 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:26.990297 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1230/2445] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:12:26 2022] DELETE /identity/v3/projects/9ce06bffca1a469194ba7e945510f424 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:12:26.996028 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8864f0-6ad6-4780-a4e4-1bb7ed1f1918 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:26.996546 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8864f0-6ad6-4780-a4e4-1bb7ed1f1918 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:26.996718 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8864f0-6ad6-4780-a4e4-1bb7ed1f1918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:27.019243 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-dd8864f0-6ad6-4780-a4e4-1bb7ed1f1918 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:27.021335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-dd8864f0-6ad6-4780-a4e4-1bb7ed1f1918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:27.104598 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1216/2446] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:12:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:12:27.113547 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2a4c0-fb8a-4a12-a0fd-ba3f99b3c655 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:27.113955 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2a4c0-fb8a-4a12-a0fd-ba3f99b3c655 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:27.114257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2a4c0-fb8a-4a12-a0fd-ba3f99b3c655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:27.135109 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-93b2a4c0-fb8a-4a12-a0fd-ba3f99b3c655 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:27.136749 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-93b2a4c0-fb8a-4a12-a0fd-ba3f99b3c655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:27.145296 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1231/2447] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:12:27.149616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8864f0-6ad6-4780-a4e4-1bb7ed1f1918 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:27.159490 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8864f0-6ad6-4780-a4e4-1bb7ed1f1918 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:27.164827 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ca63a-bb74-48fe-a654-58e0beba1e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:27.165579 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ca63a-bb74-48fe-a654-58e0beba1e00 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:27.165896 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ca63a-bb74-48fe-a654-58e0beba1e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:27.170614 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ca63a-bb74-48fe-a654-58e0beba1e00 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:27.170614 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ca63a-bb74-48fe-a654-58e0beba1e00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:12:27.170614 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ca63a-bb74-48fe-a654-58e0beba1e00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:27.170614 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ca63a-bb74-48fe-a654-58e0beba1e00 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:27.184356 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1217/2448] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:12:27.187212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2a4c0-fb8a-4a12-a0fd-ba3f99b3c655 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:27.196525 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2a4c0-fb8a-4a12-a0fd-ba3f99b3c655 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:27.202405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238515f9-183f-4642-b90a-542666239c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:27.203055 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238515f9-183f-4642-b90a-542666239c7d admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:27.203332 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238515f9-183f-4642-b90a-542666239c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:27.203601 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238515f9-183f-4642-b90a-542666239c7d admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:27.204283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238515f9-183f-4642-b90a-542666239c7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:27.206230 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238515f9-183f-4642-b90a-542666239c7d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:27.384557 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1232/2449] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:12:27 2022] POST /identity/v3/projects => generated 387 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:12:27.385881 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ca63a-bb74-48fe-a654-58e0beba1e00 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:27.396143 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ca63a-bb74-48fe-a654-58e0beba1e00 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:27.458522 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea704152-e22a-4fd4-a961-d36ad76ed696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:27.459356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea704152-e22a-4fd4-a961-d36ad76ed696 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:27.459702 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea704152-e22a-4fd4-a961-d36ad76ed696 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:27.460084 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea704152-e22a-4fd4-a961-d36ad76ed696 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:27.460772 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea704152-e22a-4fd4-a961-d36ad76ed696 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:27.462754 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea704152-e22a-4fd4-a961-d36ad76ed696 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:27.534788 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1218/2450] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:12:27 2022] POST /identity/v3/users => generated 294 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:12:27.539034 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238515f9-183f-4642-b90a-542666239c7d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:27.551151 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238515f9-183f-4642-b90a-542666239c7d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:27.555968 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da9be6-b51b-4b19-85ef-302989d85dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:27.556635 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da9be6-b51b-4b19-85ef-302989d85dfe admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:27.556924 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da9be6-b51b-4b19-85ef-302989d85dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:27.557836 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da9be6-b51b-4b19-85ef-302989d85dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:27.558572 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da9be6-b51b-4b19-85ef-302989d85dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:27.560268 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da9be6-b51b-4b19-85ef-302989d85dfe admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:27.571138 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1233/2451] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:12:27.576634 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea704152-e22a-4fd4-a961-d36ad76ed696 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:27.586665 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea704152-e22a-4fd4-a961-d36ad76ed696 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:27.591345 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8af6d-a0f1-477c-9130-d9158c721b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:27.592005 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8af6d-a0f1-477c-9130-d9158c721b14 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:27.592296 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8af6d-a0f1-477c-9130-d9158c721b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:27.592575 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8af6d-a0f1-477c-9130-d9158c721b14 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:27.593302 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d8af6d-a0f1-477c-9130-d9158c721b14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:27.594929 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d8af6d-a0f1-477c-9130-d9158c721b14 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:27.605385 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1219/2452] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:12:27.609860 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da9be6-b51b-4b19-85ef-302989d85dfe admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:27.620738 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da9be6-b51b-4b19-85ef-302989d85dfe admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:27.625610 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8209cc8-2c89-4be9-8033-1d20f66ceba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:27.629494 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8209cc8-2c89-4be9-8033-1d20f66ceba6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:27.629494 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8209cc8-2c89-4be9-8033-1d20f66ceba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:27.629494 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8209cc8-2c89-4be9-8033-1d20f66ceba6 admin admin] PATH_INFO: `/v3/projects/79d98df5e1db40b8ab29ebf5123e3fcc/users/b8aaacba2fc24344875defadf442100b/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:27.642866 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8209cc8-2c89-4be9-8033-1d20f66ceba6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79d98df5e1db40b8ab29ebf5123e3fcc, user_id=b8aaacba2fc24344875defadf442100b, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:27.645574 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8209cc8-2c89-4be9-8033-1d20f66ceba6 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:27.719766 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1234/2453] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:12:27 2022] PUT /identity/v3/projects/79d98df5e1db40b8ab29ebf5123e3fcc/users/b8aaacba2fc24344875defadf442100b/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:12:27.729963 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d273a2-1ae9-4e85-a76d-a67ac02abb85 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:27.730773 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d273a2-1ae9-4e85-a76d-a67ac02abb85 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:27.730773 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d273a2-1ae9-4e85-a76d-a67ac02abb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:27.762843 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-11d273a2-1ae9-4e85-a76d-a67ac02abb85 None None] MFA Rules not processed for user `b8aaacba2fc24344875defadf442100b`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:27.764283 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-11d273a2-1ae9-4e85-a76d-a67ac02abb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:27.837516 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1220/2454] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:12:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:12:27.842228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8209cc8-2c89-4be9-8033-1d20f66ceba6 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:27.905178 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8209cc8-2c89-4be9-8033-1d20f66ceba6 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:27.909879 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af18de-3bfd-4e89-98cd-dfcbd6182ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:27.910550 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af18de-3bfd-4e89-98cd-dfcbd6182ff2 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:27.910835 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af18de-3bfd-4e89-98cd-dfcbd6182ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:27.911114 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af18de-3bfd-4e89-98cd-dfcbd6182ff2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:27.911811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af18de-3bfd-4e89-98cd-dfcbd6182ff2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:27.913741 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af18de-3bfd-4e89-98cd-dfcbd6182ff2 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:28.018677 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1235/2455] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:12:27 2022] POST /identity/v3/projects => generated 387 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:12:28.020038 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d273a2-1ae9-4e85-a76d-a67ac02abb85 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:28.043596 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d273a2-1ae9-4e85-a76d-a67ac02abb85 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:28.128963 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b22c6-e6ef-44ee-a735-f2b5776135ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:28.129641 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b22c6-e6ef-44ee-a735-f2b5776135ec admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:28.129963 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b22c6-e6ef-44ee-a735-f2b5776135ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:28.130242 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b22c6-e6ef-44ee-a735-f2b5776135ec admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:28.130931 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b22c6-e6ef-44ee-a735-f2b5776135ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:28.135819 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b22c6-e6ef-44ee-a735-f2b5776135ec admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:28.209649 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1221/2456] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:12:28 2022] POST /identity/v3/users => generated 300 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:12:28.210954 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af18de-3bfd-4e89-98cd-dfcbd6182ff2 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:28.221747 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af18de-3bfd-4e89-98cd-dfcbd6182ff2 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:28.226903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f787aa6-8c82-478b-8ef9-52769e977041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:28.227560 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f787aa6-8c82-478b-8ef9-52769e977041 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:28.227848 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f787aa6-8c82-478b-8ef9-52769e977041 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:28.228120 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f787aa6-8c82-478b-8ef9-52769e977041 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:28.229714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f787aa6-8c82-478b-8ef9-52769e977041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:28.231422 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f787aa6-8c82-478b-8ef9-52769e977041 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:28.242532 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1236/2457] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:12:28.246996 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b22c6-e6ef-44ee-a735-f2b5776135ec admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:28.257003 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b22c6-e6ef-44ee-a735-f2b5776135ec admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:28.261815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9038c-0443-4d9b-8588-f14cf54e7ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:28.262694 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9038c-0443-4d9b-8588-f14cf54e7ebf admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:28.262990 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9038c-0443-4d9b-8588-f14cf54e7ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:28.263250 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9038c-0443-4d9b-8588-f14cf54e7ebf admin admin] PATH_INFO: `/v3/projects/1b863d7386fc4134a734d98c227fafa5/users/17aa79da4a724cd8bedbcab6d6977042/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:28.281574 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9038c-0443-4d9b-8588-f14cf54e7ebf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b863d7386fc4134a734d98c227fafa5, user_id=17aa79da4a724cd8bedbcab6d6977042, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:28.284201 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9038c-0443-4d9b-8588-f14cf54e7ebf admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:28.348041 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1222/2458] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:12:28 2022] PUT /identity/v3/projects/1b863d7386fc4134a734d98c227fafa5/users/17aa79da4a724cd8bedbcab6d6977042/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:12:28.349274 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f787aa6-8c82-478b-8ef9-52769e977041 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:28.360183 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f787aa6-8c82-478b-8ef9-52769e977041 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:28.432695 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0d5926-bd47-45bb-bb1d-612f865d121a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:28.433367 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d5926-bd47-45bb-bb1d-612f865d121a admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:28.433652 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d5926-bd47-45bb-bb1d-612f865d121a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:28.434111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0d5926-bd47-45bb-bb1d-612f865d121a admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:28.434847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d5926-bd47-45bb-bb1d-612f865d121a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:28.436451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0d5926-bd47-45bb-bb1d-612f865d121a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:28.447057 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1237/2459] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:12:28.451862 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9038c-0443-4d9b-8588-f14cf54e7ebf admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:28.463018 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9038c-0443-4d9b-8588-f14cf54e7ebf admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:28.468696 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e8896-73db-44c5-91bc-08028d15e194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:28.469609 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e8896-73db-44c5-91bc-08028d15e194 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:28.469933 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e8896-73db-44c5-91bc-08028d15e194 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:28.470282 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e8896-73db-44c5-91bc-08028d15e194 admin admin] PATH_INFO: `/v3/projects/1b863d7386fc4134a734d98c227fafa5/users/17aa79da4a724cd8bedbcab6d6977042/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:28.472293 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e8896-73db-44c5-91bc-08028d15e194 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b863d7386fc4134a734d98c227fafa5, user_id=17aa79da4a724cd8bedbcab6d6977042, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:28.475024 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e8896-73db-44c5-91bc-08028d15e194 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:28.486144 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1223/2460] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:12:28 2022] PUT /identity/v3/projects/1b863d7386fc4134a734d98c227fafa5/users/17aa79da4a724cd8bedbcab6d6977042/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:12:28.496082 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35235919-8a95-477e-adaf-bcfbebe6e533 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:28.496377 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35235919-8a95-477e-adaf-bcfbebe6e533 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:28.496660 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35235919-8a95-477e-adaf-bcfbebe6e533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:28.524585 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-35235919-8a95-477e-adaf-bcfbebe6e533 None None] MFA Rules not processed for user `17aa79da4a724cd8bedbcab6d6977042`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:28.526406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-35235919-8a95-477e-adaf-bcfbebe6e533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:28.613047 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1238/2461] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:12:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:12:28.623138 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e8896-73db-44c5-91bc-08028d15e194 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:28.624841 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b41e8896-73db-44c5-91bc-08028d15e194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:28.705901 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e8896-73db-44c5-91bc-08028d15e194 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:28.711907 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70666a21-ca61-4304-8cfd-5967c5bdcf89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:28.712556 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70666a21-ca61-4304-8cfd-5967c5bdcf89 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:28.712838 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70666a21-ca61-4304-8cfd-5967c5bdcf89 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:28.713117 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70666a21-ca61-4304-8cfd-5967c5bdcf89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:28.722448 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70666a21-ca61-4304-8cfd-5967c5bdcf89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:28.724059 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70666a21-ca61-4304-8cfd-5967c5bdcf89 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:28.738669 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1224/2462] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:12:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:12:28.999421 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35235919-8a95-477e-adaf-bcfbebe6e533 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:29.001077 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-35235919-8a95-477e-adaf-bcfbebe6e533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:29.018186 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35235919-8a95-477e-adaf-bcfbebe6e533 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:29.023910 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba28dac-e188-4de1-adcc-854f22613322 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:29.024564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba28dac-e188-4de1-adcc-854f22613322 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:29.024848 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba28dac-e188-4de1-adcc-854f22613322 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:29.025121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba28dac-e188-4de1-adcc-854f22613322 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:29.083104 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba28dac-e188-4de1-adcc-854f22613322 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:29.084808 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba28dac-e188-4de1-adcc-854f22613322 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:29.093795 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1239/2463] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:12:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:12:30.727229 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70666a21-ca61-4304-8cfd-5967c5bdcf89 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:30.788060 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70666a21-ca61-4304-8cfd-5967c5bdcf89 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:30.792597 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b1f8f-941e-4f4b-bef8-5c59e50d1429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:30.793461 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b1f8f-941e-4f4b-bef8-5c59e50d1429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:30.793747 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b1f8f-941e-4f4b-bef8-5c59e50d1429 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:30.794083 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b1f8f-941e-4f4b-bef8-5c59e50d1429 admin admin] PATH_INFO: `/v3/users/b8aaacba2fc24344875defadf442100b` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:30.798249 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b1f8f-941e-4f4b-bef8-5c59e50d1429 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8aaacba2fc24344875defadf442100b)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:30.798249 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b1f8f-941e-4f4b-bef8-5c59e50d1429 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:30.999058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d97b1f8f-941e-4f4b-bef8-5c59e50d1429 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8aaacba2fc24344875defadf442100b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:31.012040 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d97b1f8f-941e-4f4b-bef8-5c59e50d1429 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8aaacba2fc24344875defadf442100b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:31.116574 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d97b1f8f-941e-4f4b-bef8-5c59e50d1429 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8aaacba2fc24344875defadf442100b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:31.124937 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d97b1f8f-941e-4f4b-bef8-5c59e50d1429 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8aaacba2fc24344875defadf442100b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:31.125608 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d97b1f8f-941e-4f4b-bef8-5c59e50d1429 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8aaacba2fc24344875defadf442100b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:31.131755 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1225/2464] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:12:30 2022] DELETE /identity/v3/users/b8aaacba2fc24344875defadf442100b => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:12:31.137044 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43ca95-71c8-461a-b3dc-90d4b34e0295 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:31.143569 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43ca95-71c8-461a-b3dc-90d4b34e0295 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:31.143569 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43ca95-71c8-461a-b3dc-90d4b34e0295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:31.154562 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-2c43ca95-71c8-461a-b3dc-90d4b34e0295 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:31.155806 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2c43ca95-71c8-461a-b3dc-90d4b34e0295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:31.184275 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a14bff-6d44-4b08-b789-ec9659fc1d89 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:31.184480 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a14bff-6d44-4b08-b789-ec9659fc1d89 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:31.184754 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a14bff-6d44-4b08-b789-ec9659fc1d89 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:31.186184 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1226/2465] 10.222.0.23 () {54 vars in 921 bytes} [Sat Apr 30 21:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 21:12:31.191087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a37e7-b285-4fcf-8013-78baa1f19cbc None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:31.191372 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a37e7-b285-4fcf-8013-78baa1f19cbc None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:31.191649 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a37e7-b285-4fcf-8013-78baa1f19cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:31.209805 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-891a37e7-b285-4fcf-8013-78baa1f19cbc None None] MFA Rules not processed for user `4ad3f89b7037413a83c7905cef263b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:31.211035 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-891a37e7-b285-4fcf-8013-78baa1f19cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:31.214370 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1240/2466] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:12:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:12:31.224237 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43ca95-71c8-461a-b3dc-90d4b34e0295 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:31.225581 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2c43ca95-71c8-461a-b3dc-90d4b34e0295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:31.276163 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1227/2467] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Apr 30 21:12:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:12:31.286794 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43ca95-71c8-461a-b3dc-90d4b34e0295 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:31.291955 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1e8f8-092b-4b31-8eaf-4180479fb9da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:31.292638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1e8f8-092b-4b31-8eaf-4180479fb9da service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:31.293020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1e8f8-092b-4b31-8eaf-4180479fb9da service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:31.293305 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa1e8f8-092b-4b31-8eaf-4180479fb9da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:31.297515 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a37e7-b285-4fcf-8013-78baa1f19cbc None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:31.298899 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-891a37e7-b285-4fcf-8013-78baa1f19cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:31.303492 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa1e8f8-092b-4b31-8eaf-4180479fb9da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:31.305003 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa1e8f8-092b-4b31-8eaf-4180479fb9da service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:31.311946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a37e7-b285-4fcf-8013-78baa1f19cbc None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:31.317375 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feace027-ed74-4361-8c9d-276c3ebb84f2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:31.317939 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1241/2468] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:12:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:12:31.318146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feace027-ed74-4361-8c9d-276c3ebb84f2 service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:31.318444 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feace027-ed74-4361-8c9d-276c3ebb84f2 service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:31.318723 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feace027-ed74-4361-8c9d-276c3ebb84f2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:31.328393 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feace027-ed74-4361-8c9d-276c3ebb84f2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:31.330227 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feace027-ed74-4361-8c9d-276c3ebb84f2 service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:31.341041 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1228/2469] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:12:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:12:31.769486 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1e8f8-092b-4b31-8eaf-4180479fb9da service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:31.770970 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3fa1e8f8-092b-4b31-8eaf-4180479fb9da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:31.794321 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa1e8f8-092b-4b31-8eaf-4180479fb9da service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:31.799556 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc262a-afe0-4376-a860-3f8546a6fda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:31.800655 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc262a-afe0-4376-a860-3f8546a6fda3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:31.801625 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc262a-afe0-4376-a860-3f8546a6fda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:31.802209 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc262a-afe0-4376-a860-3f8546a6fda3 admin admin] PATH_INFO: `/v3/projects/79d98df5e1db40b8ab29ebf5123e3fcc` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:31.803681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc262a-afe0-4376-a860-3f8546a6fda3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79d98df5e1db40b8ab29ebf5123e3fcc)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:31.811611 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc262a-afe0-4376-a860-3f8546a6fda3 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:31.961193 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d9cc262a-afe0-4376-a860-3f8546a6fda3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79d98df5e1db40b8ab29ebf5123e3fcc', 'request_id': 'req-d9cc262a-afe0-4376-a860-3f8546a6fda3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:31.967913 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d9cc262a-afe0-4376-a860-3f8546a6fda3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79d98df5e1db40b8ab29ebf5123e3fcc', 'request_id': 'req-d9cc262a-afe0-4376-a860-3f8546a6fda3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:31.976075 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d9cc262a-afe0-4376-a860-3f8546a6fda3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79d98df5e1db40b8ab29ebf5123e3fcc', 'request_id': 'req-d9cc262a-afe0-4376-a860-3f8546a6fda3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:32.087303 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d9cc262a-afe0-4376-a860-3f8546a6fda3 admin admin] The token cache is being invalidate because project 79d98df5e1db40b8ab29ebf5123e3fcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:12:32.087592 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d9cc262a-afe0-4376-a860-3f8546a6fda3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:32.092418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d9cc262a-afe0-4376-a860-3f8546a6fda3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:32.094317 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1242/2470] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:12:31 2022] DELETE /identity/v3/projects/79d98df5e1db40b8ab29ebf5123e3fcc => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:12:32.103305 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feace027-ed74-4361-8c9d-276c3ebb84f2 service placement] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:32.120391 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feace027-ed74-4361-8c9d-276c3ebb84f2 service placement] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:32.189775 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30acfcee-def9-414a-873c-5becb22c0c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:32.194214 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acfcee-def9-414a-873c-5becb22c0c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:32.194214 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acfcee-def9-414a-873c-5becb22c0c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:32.194214 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30acfcee-def9-414a-873c-5becb22c0c14 admin admin] PATH_INFO: `/v3/users/17aa79da4a724cd8bedbcab6d6977042` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:32.194214 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30acfcee-def9-414a-873c-5becb22c0c14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17aa79da4a724cd8bedbcab6d6977042)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:32.194967 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30acfcee-def9-414a-873c-5becb22c0c14 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:32.373592 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-30acfcee-def9-414a-873c-5becb22c0c14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17aa79da4a724cd8bedbcab6d6977042'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:32.385119 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-30acfcee-def9-414a-873c-5becb22c0c14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17aa79da4a724cd8bedbcab6d6977042'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:32.457523 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-30acfcee-def9-414a-873c-5becb22c0c14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17aa79da4a724cd8bedbcab6d6977042'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:32.466915 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-30acfcee-def9-414a-873c-5becb22c0c14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17aa79da4a724cd8bedbcab6d6977042'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:32.468010 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-30acfcee-def9-414a-873c-5becb22c0c14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17aa79da4a724cd8bedbcab6d6977042'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:32.475321 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1229/2471] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:12:32 2022] DELETE /identity/v3/users/17aa79da4a724cd8bedbcab6d6977042 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:12:32.975475 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc262a-afe0-4376-a860-3f8546a6fda3 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:32.977946 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d9cc262a-afe0-4376-a860-3f8546a6fda3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:32.998151 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc262a-afe0-4376-a860-3f8546a6fda3 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:33.059673 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51262131-0768-4f93-b377-319641a78d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:33.061055 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51262131-0768-4f93-b377-319641a78d64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:33.061486 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51262131-0768-4f93-b377-319641a78d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:33.061948 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51262131-0768-4f93-b377-319641a78d64 admin admin] PATH_INFO: `/v3/projects/1b863d7386fc4134a734d98c227fafa5` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:33.063745 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51262131-0768-4f93-b377-319641a78d64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b863d7386fc4134a734d98c227fafa5)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:33.067490 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51262131-0768-4f93-b377-319641a78d64 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:33.175945 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-51262131-0768-4f93-b377-319641a78d64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b863d7386fc4134a734d98c227fafa5', 'request_id': 'req-51262131-0768-4f93-b377-319641a78d64'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:33.181528 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-51262131-0768-4f93-b377-319641a78d64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b863d7386fc4134a734d98c227fafa5', 'request_id': 'req-51262131-0768-4f93-b377-319641a78d64'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:33.190413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-51262131-0768-4f93-b377-319641a78d64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b863d7386fc4134a734d98c227fafa5', 'request_id': 'req-51262131-0768-4f93-b377-319641a78d64'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:33.259135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-51262131-0768-4f93-b377-319641a78d64 admin admin] The token cache is being invalidate because project 1b863d7386fc4134a734d98c227fafa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:12:33.259426 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-51262131-0768-4f93-b377-319641a78d64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:33.260271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-51262131-0768-4f93-b377-319641a78d64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:33.262247 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1243/2472] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:12:32 2022] DELETE /identity/v3/projects/1b863d7386fc4134a734d98c227fafa5 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:12:33.267218 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2550cc-c489-4113-b0aa-5190c360fb41 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:33.273774 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2550cc-c489-4113-b0aa-5190c360fb41 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:33.274295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2550cc-c489-4113-b0aa-5190c360fb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:33.293878 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-7f2550cc-c489-4113-b0aa-5190c360fb41 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:33.295093 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7f2550cc-c489-4113-b0aa-5190c360fb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:33.362935 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1230/2473] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:12:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:12:33.371016 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9eb4e-1f85-4c9d-988f-49b464f5a08d None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:33.371226 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9eb4e-1f85-4c9d-988f-49b464f5a08d None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:33.371554 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9eb4e-1f85-4c9d-988f-49b464f5a08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:33.404545 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-2ee9eb4e-1f85-4c9d-988f-49b464f5a08d None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:33.405981 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2ee9eb4e-1f85-4c9d-988f-49b464f5a08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:33.424346 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1244/2474] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:12:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:12:33.428844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2550cc-c489-4113-b0aa-5190c360fb41 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:33.439106 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2550cc-c489-4113-b0aa-5190c360fb41 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:33.444467 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4778bbc-054f-4997-8ef6-a23e51f90384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:33.445153 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4778bbc-054f-4997-8ef6-a23e51f90384 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:33.445442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4778bbc-054f-4997-8ef6-a23e51f90384 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:33.445740 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4778bbc-054f-4997-8ef6-a23e51f90384 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:33.446492 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4778bbc-054f-4997-8ef6-a23e51f90384 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:12:33.446889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4778bbc-054f-4997-8ef6-a23e51f90384 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:33.448512 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4778bbc-054f-4997-8ef6-a23e51f90384 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:33.460230 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1231/2475] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:12:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:12:33.465429 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee9eb4e-1f85-4c9d-988f-49b464f5a08d None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:33.474845 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee9eb4e-1f85-4c9d-988f-49b464f5a08d None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:33.480216 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045565c-bbdf-4db2-9aee-a34b83e649e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:33.480872 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045565c-bbdf-4db2-9aee-a34b83e649e3 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:33.481221 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045565c-bbdf-4db2-9aee-a34b83e649e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:33.481457 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045565c-bbdf-4db2-9aee-a34b83e649e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:33.483469 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045565c-bbdf-4db2-9aee-a34b83e649e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:33.485038 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045565c-bbdf-4db2-9aee-a34b83e649e3 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:33.638749 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1245/2476] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:12:33 2022] POST /identity/v3/projects => generated 359 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:12:33.645124 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4778bbc-054f-4997-8ef6-a23e51f90384 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:33.659448 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4778bbc-054f-4997-8ef6-a23e51f90384 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:33.728034 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ec818-765e-49ef-b1c0-e2f286a4b533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:33.729196 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ec818-765e-49ef-b1c0-e2f286a4b533 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:33.729551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ec818-765e-49ef-b1c0-e2f286a4b533 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:33.729937 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ec818-765e-49ef-b1c0-e2f286a4b533 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:33.730900 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ec818-765e-49ef-b1c0-e2f286a4b533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:33.733237 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ec818-765e-49ef-b1c0-e2f286a4b533 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:33.841004 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1232/2477] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:12:33 2022] POST /identity/v3/users => generated 280 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:12:33.841942 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045565c-bbdf-4db2-9aee-a34b83e649e3 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:33.856988 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045565c-bbdf-4db2-9aee-a34b83e649e3 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:33.863194 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581b56f-88dd-4a02-8be7-aea23d0a6b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:33.863799 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581b56f-88dd-4a02-8be7-aea23d0a6b69 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:33.864157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581b56f-88dd-4a02-8be7-aea23d0a6b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:33.864449 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581b56f-88dd-4a02-8be7-aea23d0a6b69 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:33.865812 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1581b56f-88dd-4a02-8be7-aea23d0a6b69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:33.868872 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1581b56f-88dd-4a02-8be7-aea23d0a6b69 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:33.883790 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1246/2478] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:12:33.888308 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ec818-765e-49ef-b1c0-e2f286a4b533 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:33.900250 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ec818-765e-49ef-b1c0-e2f286a4b533 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:33.906582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3432f-d07e-4336-8280-453bc52d445a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:33.907493 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3432f-d07e-4336-8280-453bc52d445a admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:33.907846 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3432f-d07e-4336-8280-453bc52d445a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:33.908338 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3432f-d07e-4336-8280-453bc52d445a admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:33.909137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3432f-d07e-4336-8280-453bc52d445a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:33.914768 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3432f-d07e-4336-8280-453bc52d445a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:33.927598 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1233/2479] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:12:33.930018 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581b56f-88dd-4a02-8be7-aea23d0a6b69 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:33.941190 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581b56f-88dd-4a02-8be7-aea23d0a6b69 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:33.946113 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b35bf9-928d-4a17-b67a-732e4836c2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:33.947002 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b35bf9-928d-4a17-b67a-732e4836c2b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:33.947287 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b35bf9-928d-4a17-b67a-732e4836c2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:33.948186 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b35bf9-928d-4a17-b67a-732e4836c2b2 admin admin] PATH_INFO: `/v3/projects/5894f2f274dc428b9687919e2c487f12/users/8bf78afc3bd749e986309aab03236365/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:33.963850 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b35bf9-928d-4a17-b67a-732e4836c2b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5894f2f274dc428b9687919e2c487f12, user_id=8bf78afc3bd749e986309aab03236365, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:33.966775 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b35bf9-928d-4a17-b67a-732e4836c2b2 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:34.048797 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1247/2480] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:12:33 2022] PUT /identity/v3/projects/5894f2f274dc428b9687919e2c487f12/users/8bf78afc3bd749e986309aab03236365/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:12:34.062339 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f318e-6043-4f87-aea6-e357aa43cf3e None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:34.062633 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f318e-6043-4f87-aea6-e357aa43cf3e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:34.062921 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f318e-6043-4f87-aea6-e357aa43cf3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:34.094016 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-921f318e-6043-4f87-aea6-e357aa43cf3e None None] MFA Rules not processed for user `8bf78afc3bd749e986309aab03236365`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:34.095328 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-921f318e-6043-4f87-aea6-e357aa43cf3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:34.173914 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1234/2481] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:12:34 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:12:34.176604 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b35bf9-928d-4a17-b67a-732e4836c2b2 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:34.254085 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b35bf9-928d-4a17-b67a-732e4836c2b2 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:34.259945 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447481e-2a70-4c78-8707-b0b94fd2c240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:34.261167 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447481e-2a70-4c78-8707-b0b94fd2c240 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:34.261450 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447481e-2a70-4c78-8707-b0b94fd2c240 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:34.261724 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447481e-2a70-4c78-8707-b0b94fd2c240 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:34.262451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d447481e-2a70-4c78-8707-b0b94fd2c240 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:34.264391 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d447481e-2a70-4c78-8707-b0b94fd2c240 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:34.384723 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1248/2482] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:12:34 2022] POST /identity/v3/projects => generated 361 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:12:34.385905 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f318e-6043-4f87-aea6-e357aa43cf3e None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:34.404034 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f318e-6043-4f87-aea6-e357aa43cf3e None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:34.474577 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b142c7-1d0a-41cf-89a1-28f368c69fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:34.475294 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b142c7-1d0a-41cf-89a1-28f368c69fcc admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:34.475582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b142c7-1d0a-41cf-89a1-28f368c69fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:34.475925 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b142c7-1d0a-41cf-89a1-28f368c69fcc admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:34.476804 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b142c7-1d0a-41cf-89a1-28f368c69fcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:34.479821 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b142c7-1d0a-41cf-89a1-28f368c69fcc admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:34.578457 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1235/2483] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:12:34 2022] POST /identity/v3/users => generated 287 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:12:34.582686 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447481e-2a70-4c78-8707-b0b94fd2c240 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:34.594614 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447481e-2a70-4c78-8707-b0b94fd2c240 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:34.600064 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401041b-edc0-47dd-81a7-41365da2e192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:34.600850 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401041b-edc0-47dd-81a7-41365da2e192 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:34.610218 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401041b-edc0-47dd-81a7-41365da2e192 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:34.610504 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401041b-edc0-47dd-81a7-41365da2e192 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:34.611842 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d401041b-edc0-47dd-81a7-41365da2e192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:34.615436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d401041b-edc0-47dd-81a7-41365da2e192 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:34.625347 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1249/2484] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:12:34.629783 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b142c7-1d0a-41cf-89a1-28f368c69fcc admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:34.639985 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b142c7-1d0a-41cf-89a1-28f368c69fcc admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:34.645095 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8bd16-1541-44b7-8203-6a462c9fbfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:34.646042 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8bd16-1541-44b7-8203-6a462c9fbfc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:34.646323 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8bd16-1541-44b7-8203-6a462c9fbfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:34.646595 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8bd16-1541-44b7-8203-6a462c9fbfc7 admin admin] PATH_INFO: `/v3/projects/3c9235da42e74677b918b6b6fa2f6dcb/users/92f5a699bc364610856be285fa220bc1/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:34.662314 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd8bd16-1541-44b7-8203-6a462c9fbfc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c9235da42e74677b918b6b6fa2f6dcb, user_id=92f5a699bc364610856be285fa220bc1, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:34.664967 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd8bd16-1541-44b7-8203-6a462c9fbfc7 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:34.742184 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1236/2485] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:12:34 2022] PUT /identity/v3/projects/3c9235da42e74677b918b6b6fa2f6dcb/users/92f5a699bc364610856be285fa220bc1/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:12:34.746233 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401041b-edc0-47dd-81a7-41365da2e192 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:34.760616 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401041b-edc0-47dd-81a7-41365da2e192 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:34.823458 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e5c85-4ab1-4d25-bcae-49e0c31d3938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:34.824134 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e5c85-4ab1-4d25-bcae-49e0c31d3938 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:34.824421 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e5c85-4ab1-4d25-bcae-49e0c31d3938 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:34.824702 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e5c85-4ab1-4d25-bcae-49e0c31d3938 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:34.825424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e5c85-4ab1-4d25-bcae-49e0c31d3938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:34.827069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e5c85-4ab1-4d25-bcae-49e0c31d3938 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:34.836985 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1250/2486] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:12:34.841981 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8bd16-1541-44b7-8203-6a462c9fbfc7 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:34.852624 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8bd16-1541-44b7-8203-6a462c9fbfc7 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:34.858284 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41daf44-9d02-4205-925e-86e67828f76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:34.859161 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41daf44-9d02-4205-925e-86e67828f76d admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:34.859435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41daf44-9d02-4205-925e-86e67828f76d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:34.859708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41daf44-9d02-4205-925e-86e67828f76d admin admin] PATH_INFO: `/v3/projects/3c9235da42e74677b918b6b6fa2f6dcb/users/92f5a699bc364610856be285fa220bc1/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:34.862131 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41daf44-9d02-4205-925e-86e67828f76d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c9235da42e74677b918b6b6fa2f6dcb, user_id=92f5a699bc364610856be285fa220bc1, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:34.864832 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41daf44-9d02-4205-925e-86e67828f76d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:34.875628 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1237/2487] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:12:34 2022] PUT /identity/v3/projects/3c9235da42e74677b918b6b6fa2f6dcb/users/92f5a699bc364610856be285fa220bc1/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:12:34.887133 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4816b-dc99-47ee-bf51-c98326ef28f2 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:34.887430 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4816b-dc99-47ee-bf51-c98326ef28f2 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:34.887714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4816b-dc99-47ee-bf51-c98326ef28f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:34.915728 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-2ee4816b-dc99-47ee-bf51-c98326ef28f2 None None] MFA Rules not processed for user `92f5a699bc364610856be285fa220bc1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:34.917558 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2ee4816b-dc99-47ee-bf51-c98326ef28f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:34.987478 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1251/2488] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:12:34 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:12:34.998715 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41daf44-9d02-4205-925e-86e67828f76d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:35.000396 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b41daf44-9d02-4205-925e-86e67828f76d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:35.075063 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41daf44-9d02-4205-925e-86e67828f76d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:35.080693 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d505598-d864-427b-ae8c-3e56e7d2362c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:35.081336 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d505598-d864-427b-ae8c-3e56e7d2362c service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:35.081621 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d505598-d864-427b-ae8c-3e56e7d2362c service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:35.082008 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d505598-d864-427b-ae8c-3e56e7d2362c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:35.090689 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d505598-d864-427b-ae8c-3e56e7d2362c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:35.092270 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d505598-d864-427b-ae8c-3e56e7d2362c service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:35.102015 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1238/2489] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:12:34 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:12:36.526049 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee4816b-dc99-47ee-bf51-c98326ef28f2 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:36.596488 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee4816b-dc99-47ee-bf51-c98326ef28f2 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:36.601051 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb35cf7-de88-4011-8db8-b1de3a72db73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:36.601940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb35cf7-de88-4011-8db8-b1de3a72db73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:36.602235 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb35cf7-de88-4011-8db8-b1de3a72db73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:36.602491 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb35cf7-de88-4011-8db8-b1de3a72db73 admin admin] PATH_INFO: `/v3/users/8bf78afc3bd749e986309aab03236365` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:36.603648 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb35cf7-de88-4011-8db8-b1de3a72db73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bf78afc3bd749e986309aab03236365)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:36.605564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb35cf7-de88-4011-8db8-b1de3a72db73 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:36.821330 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-abb35cf7-de88-4011-8db8-b1de3a72db73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bf78afc3bd749e986309aab03236365'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:36.834180 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-abb35cf7-de88-4011-8db8-b1de3a72db73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bf78afc3bd749e986309aab03236365'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:36.916600 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-abb35cf7-de88-4011-8db8-b1de3a72db73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bf78afc3bd749e986309aab03236365'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:36.917217 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-abb35cf7-de88-4011-8db8-b1de3a72db73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bf78afc3bd749e986309aab03236365'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:36.924997 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-abb35cf7-de88-4011-8db8-b1de3a72db73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bf78afc3bd749e986309aab03236365'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:36.931201 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1252/2490] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:12:36 2022] DELETE /identity/v3/users/8bf78afc3bd749e986309aab03236365 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:12:36.936337 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c48bb-7adf-42f9-bcac-195e01e210a1 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:36.936807 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c48bb-7adf-42f9-bcac-195e01e210a1 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:36.936945 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c48bb-7adf-42f9-bcac-195e01e210a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:36.955961 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-936c48bb-7adf-42f9-bcac-195e01e210a1 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:36.957175 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-936c48bb-7adf-42f9-bcac-195e01e210a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:37.026855 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1239/2491] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:12:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:12:37.036326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb35cf7-de88-4011-8db8-b1de3a72db73 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:37.037830 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-abb35cf7-de88-4011-8db8-b1de3a72db73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:37.110124 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb35cf7-de88-4011-8db8-b1de3a72db73 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:37.113804 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f498e43b-0cc2-42fc-8d00-2bce98fd414d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:37.114458 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498e43b-0cc2-42fc-8d00-2bce98fd414d service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:37.114743 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498e43b-0cc2-42fc-8d00-2bce98fd414d service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:37.115021 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498e43b-0cc2-42fc-8d00-2bce98fd414d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:37.124085 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f498e43b-0cc2-42fc-8d00-2bce98fd414d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:37.125533 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f498e43b-0cc2-42fc-8d00-2bce98fd414d service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:37.135015 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1253/2492] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:12:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:12:37.535198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c48bb-7adf-42f9-bcac-195e01e210a1 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:37.536538 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-936c48bb-7adf-42f9-bcac-195e01e210a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:37.550226 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c48bb-7adf-42f9-bcac-195e01e210a1 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:37.554994 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d6f52-7638-4b90-97c9-bbb0943b4655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:37.555858 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d6f52-7638-4b90-97c9-bbb0943b4655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:37.556141 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d6f52-7638-4b90-97c9-bbb0943b4655 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:37.556418 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d6f52-7638-4b90-97c9-bbb0943b4655 admin admin] PATH_INFO: `/v3/projects/5894f2f274dc428b9687919e2c487f12` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:37.557698 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85d6f52-7638-4b90-97c9-bbb0943b4655 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5894f2f274dc428b9687919e2c487f12)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:37.559577 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85d6f52-7638-4b90-97c9-bbb0943b4655 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:37.691353 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b85d6f52-7638-4b90-97c9-bbb0943b4655 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5894f2f274dc428b9687919e2c487f12', 'request_id': 'req-b85d6f52-7638-4b90-97c9-bbb0943b4655'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:37.698275 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b85d6f52-7638-4b90-97c9-bbb0943b4655 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5894f2f274dc428b9687919e2c487f12', 'request_id': 'req-b85d6f52-7638-4b90-97c9-bbb0943b4655'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:37.705135 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b85d6f52-7638-4b90-97c9-bbb0943b4655 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5894f2f274dc428b9687919e2c487f12', 'request_id': 'req-b85d6f52-7638-4b90-97c9-bbb0943b4655'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:37.819262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b85d6f52-7638-4b90-97c9-bbb0943b4655 admin admin] The token cache is being invalidate because project 5894f2f274dc428b9687919e2c487f12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:12:37.819555 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b85d6f52-7638-4b90-97c9-bbb0943b4655 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:37.820238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b85d6f52-7638-4b90-97c9-bbb0943b4655 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:37.821838 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1240/2493] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:12:37 2022] DELETE /identity/v3/projects/5894f2f274dc428b9687919e2c487f12 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:12:37.826411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f498e43b-0cc2-42fc-8d00-2bce98fd414d service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:37.836744 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f498e43b-0cc2-42fc-8d00-2bce98fd414d service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:37.896356 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d7200-ad3d-4ea6-8ca6-ac48640a01c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:37.897327 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d7200-ad3d-4ea6-8ca6-ac48640a01c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:37.897812 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d7200-ad3d-4ea6-8ca6-ac48640a01c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:37.898116 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d7200-ad3d-4ea6-8ca6-ac48640a01c4 admin admin] PATH_INFO: `/v3/users/92f5a699bc364610856be285fa220bc1` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:37.899738 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d7200-ad3d-4ea6-8ca6-ac48640a01c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92f5a699bc364610856be285fa220bc1)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:37.901662 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d7200-ad3d-4ea6-8ca6-ac48640a01c4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:38.159036 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-628d7200-ad3d-4ea6-8ca6-ac48640a01c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92f5a699bc364610856be285fa220bc1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:38.172406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-628d7200-ad3d-4ea6-8ca6-ac48640a01c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92f5a699bc364610856be285fa220bc1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:38.257180 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-628d7200-ad3d-4ea6-8ca6-ac48640a01c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92f5a699bc364610856be285fa220bc1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:38.257832 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-628d7200-ad3d-4ea6-8ca6-ac48640a01c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92f5a699bc364610856be285fa220bc1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:38.266096 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-628d7200-ad3d-4ea6-8ca6-ac48640a01c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92f5a699bc364610856be285fa220bc1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:38.275504 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1254/2494] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:12:37 2022] DELETE /identity/v3/users/92f5a699bc364610856be285fa220bc1 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:12:38.685098 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c96df-f2a6-4fbc-ba35-bc8bcaf61799 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:38.685584 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c96df-f2a6-4fbc-ba35-bc8bcaf61799 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:38.685705 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c96df-f2a6-4fbc-ba35-bc8bcaf61799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:38.705200 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-fb1c96df-f2a6-4fbc-ba35-bc8bcaf61799 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:38.706454 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-fb1c96df-f2a6-4fbc-ba35-bc8bcaf61799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:38.823623 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1241/2495] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:12:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:12:38.859728 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d7200-ad3d-4ea6-8ca6-ac48640a01c4 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:38.861281 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-628d7200-ad3d-4ea6-8ca6-ac48640a01c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:38.975136 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c96df-f2a6-4fbc-ba35-bc8bcaf61799 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:38.976610 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-fb1c96df-f2a6-4fbc-ba35-bc8bcaf61799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:38.977861 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d7200-ad3d-4ea6-8ca6-ac48640a01c4 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:38.985218 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7528d27-a42d-43d5-a952-768aedb13436 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:38.986902 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7528d27-a42d-43d5-a952-768aedb13436 service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:38.987513 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7528d27-a42d-43d5-a952-768aedb13436 service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:38.988022 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7528d27-a42d-43d5-a952-768aedb13436 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:38.999267 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7528d27-a42d-43d5-a952-768aedb13436 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:39.001323 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7528d27-a42d-43d5-a952-768aedb13436 service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:39.021166 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1255/2496] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:12:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:12:39.079683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c96df-f2a6-4fbc-ba35-bc8bcaf61799 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:39.085356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b3a3f3-4827-4841-a052-c84e952c6b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:39.086831 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3a3f3-4827-4841-a052-c84e952c6b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:39.087542 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3a3f3-4827-4841-a052-c84e952c6b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:39.088637 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3a3f3-4827-4841-a052-c84e952c6b5e admin admin] PATH_INFO: `/v3/projects/3c9235da42e74677b918b6b6fa2f6dcb` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:39.090211 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b3a3f3-4827-4841-a052-c84e952c6b5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c9235da42e74677b918b6b6fa2f6dcb)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:39.095744 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b3a3f3-4827-4841-a052-c84e952c6b5e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:39.233517 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-43b3a3f3-4827-4841-a052-c84e952c6b5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c9235da42e74677b918b6b6fa2f6dcb', 'request_id': 'req-43b3a3f3-4827-4841-a052-c84e952c6b5e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:39.260750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-43b3a3f3-4827-4841-a052-c84e952c6b5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c9235da42e74677b918b6b6fa2f6dcb', 'request_id': 'req-43b3a3f3-4827-4841-a052-c84e952c6b5e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:39.297904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-43b3a3f3-4827-4841-a052-c84e952c6b5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c9235da42e74677b918b6b6fa2f6dcb', 'request_id': 'req-43b3a3f3-4827-4841-a052-c84e952c6b5e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:39.377425 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-43b3a3f3-4827-4841-a052-c84e952c6b5e admin admin] The token cache is being invalidate because project 3c9235da42e74677b918b6b6fa2f6dcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:12:39.377802 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-43b3a3f3-4827-4841-a052-c84e952c6b5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:39.378503 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-43b3a3f3-4827-4841-a052-c84e952c6b5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:39.382609 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1242/2497] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:12:38 2022] DELETE /identity/v3/projects/3c9235da42e74677b918b6b6fa2f6dcb => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:12:39.387745 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b38da-ba98-476a-bc57-25dafd6c89dc None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:39.388480 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b38da-ba98-476a-bc57-25dafd6c89dc None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:39.388977 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b38da-ba98-476a-bc57-25dafd6c89dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:39.418629 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-bf3b38da-ba98-476a-bc57-25dafd6c89dc None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:39.420280 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-bf3b38da-ba98-476a-bc57-25dafd6c89dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:39.530001 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1256/2498] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:12:39.537796 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee953ca-5187-4bbd-ba13-4f59689b9bc8 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:39.538170 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee953ca-5187-4bbd-ba13-4f59689b9bc8 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:39.538398 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee953ca-5187-4bbd-ba13-4f59689b9bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:39.572753 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-1ee953ca-5187-4bbd-ba13-4f59689b9bc8 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:39.574414 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1ee953ca-5187-4bbd-ba13-4f59689b9bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:39.593053 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1243/2499] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:12:39.594979 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b38da-ba98-476a-bc57-25dafd6c89dc None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:39.610136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b38da-ba98-476a-bc57-25dafd6c89dc None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:39.619473 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e881ea-8c33-4dc0-a3e5-cd8f452a80d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:39.621470 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e881ea-8c33-4dc0-a3e5-cd8f452a80d2 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:39.621800 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e881ea-8c33-4dc0-a3e5-cd8f452a80d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:39.622080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e881ea-8c33-4dc0-a3e5-cd8f452a80d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:39.624523 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e881ea-8c33-4dc0-a3e5-cd8f452a80d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:12:39.624849 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e881ea-8c33-4dc0-a3e5-cd8f452a80d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:39.632590 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e881ea-8c33-4dc0-a3e5-cd8f452a80d2 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:39.680559 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1257/2500] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:12:39.681506 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee953ca-5187-4bbd-ba13-4f59689b9bc8 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:39.700258 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee953ca-5187-4bbd-ba13-4f59689b9bc8 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:39.718752 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ab36c-79b9-4806-a260-ef444def6315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:39.719494 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ab36c-79b9-4806-a260-ef444def6315 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:39.720236 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ab36c-79b9-4806-a260-ef444def6315 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:39.720642 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ab36c-79b9-4806-a260-ef444def6315 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:39.721350 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ab36c-79b9-4806-a260-ef444def6315 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:39.723937 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ab36c-79b9-4806-a260-ef444def6315 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:39.840341 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1244/2501] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:12:39 2022] POST /identity/v3/projects => generated 379 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:12:39.844596 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e881ea-8c33-4dc0-a3e5-cd8f452a80d2 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:39.856880 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e881ea-8c33-4dc0-a3e5-cd8f452a80d2 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:39.994564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b80ac-dd86-4e83-ad00-5a571cf863fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:39.999122 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b80ac-dd86-4e83-ad00-5a571cf863fe admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:39.999672 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b80ac-dd86-4e83-ad00-5a571cf863fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:40.000109 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b80ac-dd86-4e83-ad00-5a571cf863fe admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:40.000996 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b80ac-dd86-4e83-ad00-5a571cf863fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:40.004089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b80ac-dd86-4e83-ad00-5a571cf863fe admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:40.175687 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1258/2502] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:12:39 2022] POST /identity/v3/users => generated 290 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:12:40.179844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ab36c-79b9-4806-a260-ef444def6315 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:40.204457 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ab36c-79b9-4806-a260-ef444def6315 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:40.219106 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f3021-0335-4b2c-a11f-6324809b95fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:40.224195 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f3021-0335-4b2c-a11f-6324809b95fd admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:40.224487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f3021-0335-4b2c-a11f-6324809b95fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:40.224764 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f3021-0335-4b2c-a11f-6324809b95fd admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:40.225507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f3021-0335-4b2c-a11f-6324809b95fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:40.227181 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f3021-0335-4b2c-a11f-6324809b95fd admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:40.259466 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1245/2503] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:12:40.265734 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b80ac-dd86-4e83-ad00-5a571cf863fe admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:40.288959 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b80ac-dd86-4e83-ad00-5a571cf863fe admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:40.294489 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc5d2f-fe8d-465b-b686-6651a14f7e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:40.295172 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc5d2f-fe8d-465b-b686-6651a14f7e25 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:40.295457 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc5d2f-fe8d-465b-b686-6651a14f7e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:40.295741 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc5d2f-fe8d-465b-b686-6651a14f7e25 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:40.296720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc5d2f-fe8d-465b-b686-6651a14f7e25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:40.299033 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc5d2f-fe8d-465b-b686-6651a14f7e25 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:40.320388 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1259/2504] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:12:40.324817 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f3021-0335-4b2c-a11f-6324809b95fd admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:40.337874 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f3021-0335-4b2c-a11f-6324809b95fd admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:40.377837 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d51d45-6ade-4d22-bed0-f7035b905b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:40.380586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d51d45-6ade-4d22-bed0-f7035b905b2b admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:40.383155 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d51d45-6ade-4d22-bed0-f7035b905b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:40.388397 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d51d45-6ade-4d22-bed0-f7035b905b2b admin admin] PATH_INFO: `/v3/projects/2bd152bf91f74b3e8ccdb9267c35366a/users/8457aee26f2948a3864d66b628f75360/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:40.441680 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d51d45-6ade-4d22-bed0-f7035b905b2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bd152bf91f74b3e8ccdb9267c35366a, user_id=8457aee26f2948a3864d66b628f75360, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:40.444562 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d51d45-6ade-4d22-bed0-f7035b905b2b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:40.554604 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1246/2505] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:12:40 2022] PUT /identity/v3/projects/2bd152bf91f74b3e8ccdb9267c35366a/users/8457aee26f2948a3864d66b628f75360/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:12:40.605734 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e505e81-8718-4ce7-a305-4824239ad7a5 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:40.606218 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e505e81-8718-4ce7-a305-4824239ad7a5 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:40.606659 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e505e81-8718-4ce7-a305-4824239ad7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:40.645331 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-2e505e81-8718-4ce7-a305-4824239ad7a5 None None] MFA Rules not processed for user `8457aee26f2948a3864d66b628f75360`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:40.647186 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2e505e81-8718-4ce7-a305-4824239ad7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:40.742286 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1260/2506] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:12:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:12:40.868602 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d51d45-6ade-4d22-bed0-f7035b905b2b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:40.868602 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-86d51d45-6ade-4d22-bed0-f7035b905b2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:40.977215 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d51d45-6ade-4d22-bed0-f7035b905b2b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:40.987980 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80611eb-297c-45de-ada6-a05b2bffb23f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:40.988745 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80611eb-297c-45de-ada6-a05b2bffb23f service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:40.989966 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80611eb-297c-45de-ada6-a05b2bffb23f service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:40.989966 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80611eb-297c-45de-ada6-a05b2bffb23f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:41.008502 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80611eb-297c-45de-ada6-a05b2bffb23f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:41.010896 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80611eb-297c-45de-ada6-a05b2bffb23f service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:41.022578 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1247/2507] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:12:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:12:41.469227 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff70dff-3e98-44c2-8d80-186c7b699be3 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:41.473900 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff70dff-3e98-44c2-8d80-186c7b699be3 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:41.473900 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff70dff-3e98-44c2-8d80-186c7b699be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:41.514636 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-eff70dff-3e98-44c2-8d80-186c7b699be3 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:41.516199 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-eff70dff-3e98-44c2-8d80-186c7b699be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:41.591963 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1261/2508] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:12:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:12:41.615006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80611eb-297c-45de-ada6-a05b2bffb23f service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:41.616479 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e80611eb-297c-45de-ada6-a05b2bffb23f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:41.734801 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80611eb-297c-45de-ada6-a05b2bffb23f service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:41.741430 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51059b18-d2f1-41d5-9428-c31215e47332 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:41.742725 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51059b18-d2f1-41d5-9428-c31215e47332 service swift] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:41.743010 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51059b18-d2f1-41d5-9428-c31215e47332 service swift] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:41.743325 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51059b18-d2f1-41d5-9428-c31215e47332 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:41.757516 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51059b18-d2f1-41d5-9428-c31215e47332 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:41.759410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51059b18-d2f1-41d5-9428-c31215e47332 service swift] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:41.773748 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1248/2509] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:12:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:12:42.340286 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595b78f-5417-4d75-94f3-9b7d54f0c0b1 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:42.340586 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595b78f-5417-4d75-94f3-9b7d54f0c0b1 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:42.340866 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595b78f-5417-4d75-94f3-9b7d54f0c0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:42.376798 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-6595b78f-5417-4d75-94f3-9b7d54f0c0b1 None None] MFA Rules not processed for user `8457aee26f2948a3864d66b628f75360`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:42.389645 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6595b78f-5417-4d75-94f3-9b7d54f0c0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:42.403230 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1262/2510] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:12:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:12:42.973377 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626773a8-c755-4902-b75e-54975fa8b33b None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:42.973952 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626773a8-c755-4902-b75e-54975fa8b33b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:42.974048 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626773a8-c755-4902-b75e-54975fa8b33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:42.992882 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-626773a8-c755-4902-b75e-54975fa8b33b None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:42.994719 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-626773a8-c755-4902-b75e-54975fa8b33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:43.002454 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1249/2511] 10.222.0.23 () {58 vars in 967 bytes} [Sat Apr 30 21:12:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:12:43.016024 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595b78f-5417-4d75-94f3-9b7d54f0c0b1 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:43.027947 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595b78f-5417-4d75-94f3-9b7d54f0c0b1 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:43.032920 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c90161-9618-4581-ada3-d8ce8a054642 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:43.033561 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c90161-9618-4581-ada3-d8ce8a054642 service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:43.033893 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c90161-9618-4581-ada3-d8ce8a054642 service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:43.034170 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c90161-9618-4581-ada3-d8ce8a054642 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:43.043171 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c90161-9618-4581-ada3-d8ce8a054642 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:43.044821 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c90161-9618-4581-ada3-d8ce8a054642 service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:43.054518 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1263/2512] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:12:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:12:43.595628 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626773a8-c755-4902-b75e-54975fa8b33b None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:43.709065 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626773a8-c755-4902-b75e-54975fa8b33b None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:43.717100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017a36e-99d3-44a7-a702-370c0e4349fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:43.719076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017a36e-99d3-44a7-a702-370c0e4349fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:43.719766 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017a36e-99d3-44a7-a702-370c0e4349fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:43.720468 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017a36e-99d3-44a7-a702-370c0e4349fc admin admin] PATH_INFO: `/v3/users/8457aee26f2948a3864d66b628f75360` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:43.722664 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3017a36e-99d3-44a7-a702-370c0e4349fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8457aee26f2948a3864d66b628f75360)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:43.724883 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3017a36e-99d3-44a7-a702-370c0e4349fc admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:44.065139 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3017a36e-99d3-44a7-a702-370c0e4349fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8457aee26f2948a3864d66b628f75360'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:44.084743 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3017a36e-99d3-44a7-a702-370c0e4349fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8457aee26f2948a3864d66b628f75360'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:44.173439 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3017a36e-99d3-44a7-a702-370c0e4349fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8457aee26f2948a3864d66b628f75360'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:44.184263 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3017a36e-99d3-44a7-a702-370c0e4349fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8457aee26f2948a3864d66b628f75360'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:44.185600 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3017a36e-99d3-44a7-a702-370c0e4349fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8457aee26f2948a3864d66b628f75360'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:44.196598 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1250/2513] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:12:43 2022] DELETE /identity/v3/users/8457aee26f2948a3864d66b628f75360 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:12:44.198877 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b56620-efdd-4c99-acd9-74def5f70acc None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:44.199352 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b56620-efdd-4c99-acd9-74def5f70acc None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:44.199447 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b56620-efdd-4c99-acd9-74def5f70acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:44.259298 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-17b56620-efdd-4c99-acd9-74def5f70acc None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:44.267476 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-17b56620-efdd-4c99-acd9-74def5f70acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:44.467478 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1264/2514] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:12:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:12:44.501481 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017a36e-99d3-44a7-a702-370c0e4349fc admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:44.503312 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3017a36e-99d3-44a7-a702-370c0e4349fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:44.647480 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017a36e-99d3-44a7-a702-370c0e4349fc admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:44.651145 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26eeda0-9268-4387-a037-30812b4ffdea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:44.651780 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26eeda0-9268-4387-a037-30812b4ffdea service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:44.652061 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26eeda0-9268-4387-a037-30812b4ffdea service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:44.657852 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26eeda0-9268-4387-a037-30812b4ffdea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:44.702790 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26eeda0-9268-4387-a037-30812b4ffdea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:44.707499 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26eeda0-9268-4387-a037-30812b4ffdea service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:44.725646 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1251/2515] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:12:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:12:45.525693 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b56620-efdd-4c99-acd9-74def5f70acc None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:45.527156 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-17b56620-efdd-4c99-acd9-74def5f70acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:45.543877 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b56620-efdd-4c99-acd9-74def5f70acc None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:45.565383 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e8e359-6f11-4da9-8a4a-15e34c411cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:45.566431 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e8e359-6f11-4da9-8a4a-15e34c411cbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:45.566604 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e8e359-6f11-4da9-8a4a-15e34c411cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:45.567088 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e8e359-6f11-4da9-8a4a-15e34c411cbd admin admin] PATH_INFO: `/v3/projects/2bd152bf91f74b3e8ccdb9267c35366a` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:45.568345 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e8e359-6f11-4da9-8a4a-15e34c411cbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bd152bf91f74b3e8ccdb9267c35366a)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:45.570305 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e8e359-6f11-4da9-8a4a-15e34c411cbd admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:45.639792 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142782ff-166c-44f4-9b4a-15af4990901e None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:45.640939 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142782ff-166c-44f4-9b4a-15af4990901e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:45.641215 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142782ff-166c-44f4-9b4a-15af4990901e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:45.668721 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-142782ff-166c-44f4-9b4a-15af4990901e None None] MFA Rules not processed for user `dadac4f61fe141dba3ee726ca6cbf29a`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:45.670288 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-142782ff-166c-44f4-9b4a-15af4990901e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:45.771662 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-02e8e359-6f11-4da9-8a4a-15e34c411cbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bd152bf91f74b3e8ccdb9267c35366a', 'request_id': 'req-02e8e359-6f11-4da9-8a4a-15e34c411cbd'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:45.780678 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1252/2516] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:12:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:12:45.785777 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-02e8e359-6f11-4da9-8a4a-15e34c411cbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bd152bf91f74b3e8ccdb9267c35366a', 'request_id': 'req-02e8e359-6f11-4da9-8a4a-15e34c411cbd'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:45.798818 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-02e8e359-6f11-4da9-8a4a-15e34c411cbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bd152bf91f74b3e8ccdb9267c35366a', 'request_id': 'req-02e8e359-6f11-4da9-8a4a-15e34c411cbd'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:45.879847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-02e8e359-6f11-4da9-8a4a-15e34c411cbd admin admin] The token cache is being invalidate because project 2bd152bf91f74b3e8ccdb9267c35366a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:12:45.880230 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-02e8e359-6f11-4da9-8a4a-15e34c411cbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:45.881125 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-02e8e359-6f11-4da9-8a4a-15e34c411cbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:12:45.883596 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1265/2517] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:12:45 2022] DELETE /identity/v3/projects/2bd152bf91f74b3e8ccdb9267c35366a => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:12:45.888613 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26dbce-f726-444d-a18e-a5e08c76bebe None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:45.888904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26dbce-f726-444d-a18e-a5e08c76bebe None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:45.889186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26dbce-f726-444d-a18e-a5e08c76bebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:45.933390 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-bc26dbce-f726-444d-a18e-a5e08c76bebe None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:45.934793 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-bc26dbce-f726-444d-a18e-a5e08c76bebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:46.068581 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1253/2518] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:12:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:12:46.078544 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d0751-76c0-46e1-8537-3a0d520b5cbf None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:46.078944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d0751-76c0-46e1-8537-3a0d520b5cbf None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:46.079303 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d0751-76c0-46e1-8537-3a0d520b5cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:46.099586 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-ec3d0751-76c0-46e1-8537-3a0d520b5cbf None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:46.101175 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ec3d0751-76c0-46e1-8537-3a0d520b5cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:46.112981 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1266/2519] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:12:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:12:46.118563 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26dbce-f726-444d-a18e-a5e08c76bebe None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:46.133313 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26dbce-f726-444d-a18e-a5e08c76bebe None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:46.142703 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913ba3e-b22b-4eda-b4df-98e7e42cf2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:46.143494 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913ba3e-b22b-4eda-b4df-98e7e42cf2db admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:46.143887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913ba3e-b22b-4eda-b4df-98e7e42cf2db admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:46.144294 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913ba3e-b22b-4eda-b4df-98e7e42cf2db admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:46.145199 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913ba3e-b22b-4eda-b4df-98e7e42cf2db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:12:46.145601 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913ba3e-b22b-4eda-b4df-98e7e42cf2db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:46.147645 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913ba3e-b22b-4eda-b4df-98e7e42cf2db admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:46.173051 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1254/2520] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:12:46.173709 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d0751-76c0-46e1-8537-3a0d520b5cbf None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:46.193365 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d0751-76c0-46e1-8537-3a0d520b5cbf None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:46.202889 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd41c0-56ff-4471-a113-ee3d30fb94f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:46.204816 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd41c0-56ff-4471-a113-ee3d30fb94f6 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:46.213268 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd41c0-56ff-4471-a113-ee3d30fb94f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:46.213967 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd41c0-56ff-4471-a113-ee3d30fb94f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:46.214940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd41c0-56ff-4471-a113-ee3d30fb94f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:46.217146 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd41c0-56ff-4471-a113-ee3d30fb94f6 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:46.325380 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1267/2521] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:12:46 2022] POST /identity/v3/projects => generated 371 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:12:46.329220 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913ba3e-b22b-4eda-b4df-98e7e42cf2db admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:46.348079 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913ba3e-b22b-4eda-b4df-98e7e42cf2db admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:46.441926 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267b985-a723-4c4d-bfc3-219ded7c47a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:46.442599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267b985-a723-4c4d-bfc3-219ded7c47a3 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:46.443027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267b985-a723-4c4d-bfc3-219ded7c47a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:46.443296 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267b985-a723-4c4d-bfc3-219ded7c47a3 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:46.443988 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e267b985-a723-4c4d-bfc3-219ded7c47a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:46.446238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e267b985-a723-4c4d-bfc3-219ded7c47a3 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:46.534014 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1255/2522] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:12:46 2022] POST /identity/v3/users => generated 286 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:12:46.537860 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd41c0-56ff-4471-a113-ee3d30fb94f6 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:46.551025 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd41c0-56ff-4471-a113-ee3d30fb94f6 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:46.556324 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e90a5b-7ddc-495c-a001-e6461fa81f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:46.557345 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e90a5b-7ddc-495c-a001-e6461fa81f83 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:46.557646 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e90a5b-7ddc-495c-a001-e6461fa81f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:46.558058 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e90a5b-7ddc-495c-a001-e6461fa81f83 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:46.558989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e90a5b-7ddc-495c-a001-e6461fa81f83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:46.560848 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e90a5b-7ddc-495c-a001-e6461fa81f83 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:46.577960 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1268/2523] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:12:46.580077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267b985-a723-4c4d-bfc3-219ded7c47a3 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:46.606680 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267b985-a723-4c4d-bfc3-219ded7c47a3 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:46.612117 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344a1ce-6108-4678-b687-0a138e542faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:46.616839 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344a1ce-6108-4678-b687-0a138e542faf admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:46.616839 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344a1ce-6108-4678-b687-0a138e542faf admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:46.616839 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344a1ce-6108-4678-b687-0a138e542faf admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:46.616839 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344a1ce-6108-4678-b687-0a138e542faf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:46.616839 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344a1ce-6108-4678-b687-0a138e542faf admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:46.641871 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1256/2524] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:12:46.645506 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e90a5b-7ddc-495c-a001-e6461fa81f83 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:46.655341 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e90a5b-7ddc-495c-a001-e6461fa81f83 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:46.667897 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3620e00a-5b64-4964-8428-7f725bbc0190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:46.669152 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620e00a-5b64-4964-8428-7f725bbc0190 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:46.669445 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620e00a-5b64-4964-8428-7f725bbc0190 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:46.669728 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620e00a-5b64-4964-8428-7f725bbc0190 admin admin] PATH_INFO: `/v3/projects/0e2d36f1ee8d4945a59a8c2a0088306e/users/1d742edf519e4554850b8a0c4457f4ce/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:46.696089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3620e00a-5b64-4964-8428-7f725bbc0190 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e2d36f1ee8d4945a59a8c2a0088306e, user_id=1d742edf519e4554850b8a0c4457f4ce, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:46.699536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3620e00a-5b64-4964-8428-7f725bbc0190 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:46.990685 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1269/2525] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:12:46 2022] PUT /identity/v3/projects/0e2d36f1ee8d4945a59a8c2a0088306e/users/1d742edf519e4554850b8a0c4457f4ce/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:12:47.011740 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896ef3d-7d98-434b-a83d-46e956629025 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:47.012025 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896ef3d-7d98-434b-a83d-46e956629025 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:47.012310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896ef3d-7d98-434b-a83d-46e956629025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:47.067236 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-3896ef3d-7d98-434b-a83d-46e956629025 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:47.067646 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3896ef3d-7d98-434b-a83d-46e956629025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:47.170383 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1257/2526] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:12:47.188914 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3620e00a-5b64-4964-8428-7f725bbc0190 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:47.191020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3620e00a-5b64-4964-8428-7f725bbc0190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:47.258264 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3620e00a-5b64-4964-8428-7f725bbc0190 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:47.262067 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59127ba-b4c5-460b-b8ba-d38fc06a9f0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:47.262737 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59127ba-b4c5-460b-b8ba-d38fc06a9f0d service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:47.263055 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59127ba-b4c5-460b-b8ba-d38fc06a9f0d service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:47.263373 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59127ba-b4c5-460b-b8ba-d38fc06a9f0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:47.277413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59127ba-b4c5-460b-b8ba-d38fc06a9f0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:47.279181 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59127ba-b4c5-460b-b8ba-d38fc06a9f0d service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:47.291992 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1270/2527] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:12:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:12:51.247926 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d3530-22ab-42d1-a755-eab48e5e7bea None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:51.257073 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d3530-22ab-42d1-a755-eab48e5e7bea None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:51.257073 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d3530-22ab-42d1-a755-eab48e5e7bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:51.284173 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-539d3530-22ab-42d1-a755-eab48e5e7bea None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:51.285718 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-539d3530-22ab-42d1-a755-eab48e5e7bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:51.437401 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1258/2528] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:12:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:12:51.457009 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59127ba-b4c5-460b-b8ba-d38fc06a9f0d service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:51.458871 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f59127ba-b4c5-460b-b8ba-d38fc06a9f0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:51.550885 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59127ba-b4c5-460b-b8ba-d38fc06a9f0d service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:51.557411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1f5c0-3f61-449e-9e13-e02c933bd536 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:51.558587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1f5c0-3f61-449e-9e13-e02c933bd536 service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:51.558972 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1f5c0-3f61-449e-9e13-e02c933bd536 service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:51.559452 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1f5c0-3f61-449e-9e13-e02c933bd536 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:51.569123 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff1f5c0-3f61-449e-9e13-e02c933bd536 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:51.571057 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff1f5c0-3f61-449e-9e13-e02c933bd536 service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:51.583578 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1271/2529] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:12:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:12:56.218168 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85f627-6022-4d62-a543-3431b72c6491 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:56.218762 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85f627-6022-4d62-a543-3431b72c6491 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:56.218762 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85f627-6022-4d62-a543-3431b72c6491 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:56.220071 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1259/2530] 10.222.0.23 () {54 vars in 921 bytes} [Sat Apr 30 21:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:12:56.231776 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa40d5f-c8ba-4323-8f49-21a5a20e7a56 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:56.232909 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa40d5f-c8ba-4323-8f49-21a5a20e7a56 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:56.233346 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa40d5f-c8ba-4323-8f49-21a5a20e7a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:56.259479 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-6aa40d5f-c8ba-4323-8f49-21a5a20e7a56 None None] MFA Rules not processed for user `4ad3f89b7037413a83c7905cef263b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:56.262438 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6aa40d5f-c8ba-4323-8f49-21a5a20e7a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:56.455632 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1272/2531] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Apr 30 21:12:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:12:56.493081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85f627-6022-4d62-a543-3431b72c6491 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:56.496369 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8d85f627-6022-4d62-a543-3431b72c6491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:56.531004 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85f627-6022-4d62-a543-3431b72c6491 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:56.541358 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406251b-2cb7-46be-8749-8038f29394e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:56.542766 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406251b-2cb7-46be-8749-8038f29394e4 service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:56.543214 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406251b-2cb7-46be-8749-8038f29394e4 service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:56.543667 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406251b-2cb7-46be-8749-8038f29394e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:56.566741 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406251b-2cb7-46be-8749-8038f29394e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:56.569320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406251b-2cb7-46be-8749-8038f29394e4 service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:56.608843 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1260/2532] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:12:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:12:57.101308 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa40d5f-c8ba-4323-8f49-21a5a20e7a56 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:57.120194 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa40d5f-c8ba-4323-8f49-21a5a20e7a56 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:57.137062 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddbb3be-0e3d-4359-bd3d-a3f10723d4b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:57.138088 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbb3be-0e3d-4359-bd3d-a3f10723d4b7 service placement] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:57.138616 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbb3be-0e3d-4359-bd3d-a3f10723d4b7 service placement] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:57.139975 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbb3be-0e3d-4359-bd3d-a3f10723d4b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:57.142416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-bddbb3be-0e3d-4359-bd3d-a3f10723d4b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:57.165640 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddbb3be-0e3d-4359-bd3d-a3f10723d4b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:57.168615 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddbb3be-0e3d-4359-bd3d-a3f10723d4b7 service placement] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:57.207006 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1273/2533] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:12:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:12:58.066699 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd987bb-08fd-4a5b-a33b-28821bea9d74 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:58.067257 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd987bb-08fd-4a5b-a33b-28821bea9d74 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:58.067257 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd987bb-08fd-4a5b-a33b-28821bea9d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:58.086238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-9dd987bb-08fd-4a5b-a33b-28821bea9d74 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:58.087465 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9dd987bb-08fd-4a5b-a33b-28821bea9d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:58.094776 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1261/2534] 10.222.0.23 () {58 vars in 967 bytes} [Sat Apr 30 21:12:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:12:58.110537 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddbb3be-0e3d-4359-bd3d-a3f10723d4b7 service placement] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:58.122404 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddbb3be-0e3d-4359-bd3d-a3f10723d4b7 service placement] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:58.127331 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6f66a-438b-443c-881d-98a3d3b5b4a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:58.127968 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6f66a-438b-443c-881d-98a3d3b5b4a6 service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:58.128252 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6f66a-438b-443c-881d-98a3d3b5b4a6 service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:58.128531 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6f66a-438b-443c-881d-98a3d3b5b4a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:58.140920 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd987bb-08fd-4a5b-a33b-28821bea9d74 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:12:58.142914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9dd987bb-08fd-4a5b-a33b-28821bea9d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:58.143764 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a6f66a-438b-443c-881d-98a3d3b5b4a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:58.145390 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a6f66a-438b-443c-881d-98a3d3b5b4a6 service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:58.157647 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1274/2535] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:12:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:12:58.234051 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd987bb-08fd-4a5b-a33b-28821bea9d74 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:12:58.242750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6fd0d-04d3-4654-9fe0-f9ad296e451b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:12:58.244306 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6fd0d-04d3-4654-9fe0-f9ad296e451b service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:58.253551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6fd0d-04d3-4654-9fe0-f9ad296e451b service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:58.254105 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6fd0d-04d3-4654-9fe0-f9ad296e451b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:58.267352 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-70d6fd0d-04d3-4654-9fe0-f9ad296e451b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:58.289591 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d6fd0d-04d3-4654-9fe0-f9ad296e451b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:12:58.292838 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d6fd0d-04d3-4654-9fe0-f9ad296e451b service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:12:58.334316 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1262/2536] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:12:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:12:59.803262 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61610231-3927-4942-a9cd-e44df838a30e None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:12:59.804204 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61610231-3927-4942-a9cd-e44df838a30e None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:12:59.804663 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61610231-3927-4942-a9cd-e44df838a30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:12:59.859933 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-61610231-3927-4942-a9cd-e44df838a30e None None] MFA Rules not processed for user `1d742edf519e4554850b8a0c4457f4ce`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:12:59.862115 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-61610231-3927-4942-a9cd-e44df838a30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:12:59.958860 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1275/2537] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:12:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:13:01.518946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6fd0d-04d3-4654-9fe0-f9ad296e451b service placement] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:01.520399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-70d6fd0d-04d3-4654-9fe0-f9ad296e451b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:01.802620 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d6fd0d-04d3-4654-9fe0-f9ad296e451b service placement] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:01.828459 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01dbe7b-131a-4b1c-ae11-5067afdece27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:01.829145 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01dbe7b-131a-4b1c-ae11-5067afdece27 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:01.829433 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01dbe7b-131a-4b1c-ae11-5067afdece27 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:01.829717 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01dbe7b-131a-4b1c-ae11-5067afdece27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:01.857005 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01dbe7b-131a-4b1c-ae11-5067afdece27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:01.858985 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01dbe7b-131a-4b1c-ae11-5067afdece27 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:01.871493 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1263/2538] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:13:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:13:03.146360 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70b322-74ab-486d-9929-aac1b546a561 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:03.149748 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70b322-74ab-486d-9929-aac1b546a561 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:03.149748 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70b322-74ab-486d-9929-aac1b546a561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:03.206219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-4c70b322-74ab-486d-9929-aac1b546a561 None None] MFA Rules not processed for user `c816e51510ac44c9a2b3f5c022b5a3c3`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:13:03.209828 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4c70b322-74ab-486d-9929-aac1b546a561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:03.386742 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1276/2539] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:13:03 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:13:12.636775 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd091f-1cb1-413a-ab95-c606ff9884cb None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:12.637318 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd091f-1cb1-413a-ab95-c606ff9884cb None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:12.637493 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd091f-1cb1-413a-ab95-c606ff9884cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:12.657168 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-f3fd091f-1cb1-413a-ab95-c606ff9884cb None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:13:12.658627 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f3fd091f-1cb1-413a-ab95-c606ff9884cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:12.669719 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1264/2540] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:13:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:13:12.686301 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70b322-74ab-486d-9929-aac1b546a561 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:12.697230 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70b322-74ab-486d-9929-aac1b546a561 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:12.703115 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d33497d-e434-46b3-aa37-37557b495906 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:12.703784 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33497d-e434-46b3-aa37-37557b495906 service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:12.704058 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33497d-e434-46b3-aa37-37557b495906 service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:12.704518 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33497d-e434-46b3-aa37-37557b495906 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:12.719317 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d33497d-e434-46b3-aa37-37557b495906 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:12.721268 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d33497d-e434-46b3-aa37-37557b495906 service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:12.749877 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1277/2541] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:13:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:13:13.576388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce86af-fdb3-4928-ae6c-8778a5407cd1 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:13.576676 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce86af-fdb3-4928-ae6c-8778a5407cd1 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:13.576961 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce86af-fdb3-4928-ae6c-8778a5407cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:13.646242 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-5dce86af-fdb3-4928-ae6c-8778a5407cd1 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:13:13.647412 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5dce86af-fdb3-4928-ae6c-8778a5407cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:13.685212 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1265/2542] 10.222.0.23 () {58 vars in 967 bytes} [Sat Apr 30 21:13:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:13:13.703380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d33497d-e434-46b3-aa37-37557b495906 service swift] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:13.722940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d33497d-e434-46b3-aa37-37557b495906 service swift] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:13.775803 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2f5de-e29a-4571-b8a0-84c3030baa7a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:13.776753 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2f5de-e29a-4571-b8a0-84c3030baa7a service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:13.777198 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2f5de-e29a-4571-b8a0-84c3030baa7a service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:13.777740 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2f5de-e29a-4571-b8a0-84c3030baa7a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:13.812587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2f5de-e29a-4571-b8a0-84c3030baa7a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:13.818992 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2f5de-e29a-4571-b8a0-84c3030baa7a service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:13.847471 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1278/2543] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:13:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:13:16.217192 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095a4b1-5203-4e94-84d2-b960d26c63e1 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:16.219204 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095a4b1-5203-4e94-84d2-b960d26c63e1 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:16.219833 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095a4b1-5203-4e94-84d2-b960d26c63e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:16.248143 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-1095a4b1-5203-4e94-84d2-b960d26c63e1 None None] MFA Rules not processed for user `6e275a4d32754fe9a164bd79c3774b97`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:13:16.256576 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1095a4b1-5203-4e94-84d2-b960d26c63e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:16.343971 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1266/2544] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:13:16 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:13:18.040779 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8bfe3e-6a98-4dc5-be8a-8e7de7a51333 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:18.041303 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8bfe3e-6a98-4dc5-be8a-8e7de7a51333 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:18.041399 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8bfe3e-6a98-4dc5-be8a-8e7de7a51333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:18.083245 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-1f8bfe3e-6a98-4dc5-be8a-8e7de7a51333 None None] MFA Rules not processed for user `cce42480cd844664991774f07ca47e79`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:13:18.084492 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1f8bfe3e-6a98-4dc5-be8a-8e7de7a51333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:18.249727 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1279/2545] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:13:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:13:22.683100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095a4b1-5203-4e94-84d2-b960d26c63e1 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:22.686367 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1095a4b1-5203-4e94-84d2-b960d26c63e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:22.703850 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095a4b1-5203-4e94-84d2-b960d26c63e1 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:22.710635 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50fb659-ca29-448a-971b-36ab200beef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:22.715421 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50fb659-ca29-448a-971b-36ab200beef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:22.715421 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50fb659-ca29-448a-971b-36ab200beef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:22.715421 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50fb659-ca29-448a-971b-36ab200beef6 admin admin] PATH_INFO: `/v3/users/eda37dd9b3304fa9a9734f12ffaea8e7` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:22.716676 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50fb659-ca29-448a-971b-36ab200beef6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eda37dd9b3304fa9a9734f12ffaea8e7)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:22.719518 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50fb659-ca29-448a-971b-36ab200beef6 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:23.062847 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d50fb659-ca29-448a-971b-36ab200beef6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eda37dd9b3304fa9a9734f12ffaea8e7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:23.082608 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d50fb659-ca29-448a-971b-36ab200beef6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eda37dd9b3304fa9a9734f12ffaea8e7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:23.174513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d50fb659-ca29-448a-971b-36ab200beef6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eda37dd9b3304fa9a9734f12ffaea8e7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:23.183928 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d50fb659-ca29-448a-971b-36ab200beef6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eda37dd9b3304fa9a9734f12ffaea8e7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:23.185156 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d50fb659-ca29-448a-971b-36ab200beef6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eda37dd9b3304fa9a9734f12ffaea8e7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:23.194762 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1267/2546] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:13:22 2022] DELETE /identity/v3/users/eda37dd9b3304fa9a9734f12ffaea8e7 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:13:23.200068 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca12cc-bff6-474b-8847-a16774601092 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:23.200987 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca12cc-bff6-474b-8847-a16774601092 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:23.201457 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca12cc-bff6-474b-8847-a16774601092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:23.224337 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-94ca12cc-bff6-474b-8847-a16774601092 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:13:23.230234 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-94ca12cc-bff6-474b-8847-a16774601092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:23.387763 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1280/2547] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:13:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:13:23.418746 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50fb659-ca29-448a-971b-36ab200beef6 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:23.421383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d50fb659-ca29-448a-971b-36ab200beef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:23.565044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50fb659-ca29-448a-971b-36ab200beef6 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:23.573536 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e340294-30cf-4488-b1ce-263575ac6354 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:23.574503 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e340294-30cf-4488-b1ce-263575ac6354 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:23.576087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e340294-30cf-4488-b1ce-263575ac6354 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:23.577254 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e340294-30cf-4488-b1ce-263575ac6354 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:23.603617 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e340294-30cf-4488-b1ce-263575ac6354 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:23.605367 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e340294-30cf-4488-b1ce-263575ac6354 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:23.627337 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1268/2548] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:13:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:13:25.107193 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca12cc-bff6-474b-8847-a16774601092 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:25.108584 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-94ca12cc-bff6-474b-8847-a16774601092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:25.129626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca12cc-bff6-474b-8847-a16774601092 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:25.147284 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d30a2-951d-4d89-a2e5-64b585f537cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:25.150718 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d30a2-951d-4d89-a2e5-64b585f537cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:25.151671 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d30a2-951d-4d89-a2e5-64b585f537cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:25.152129 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d30a2-951d-4d89-a2e5-64b585f537cf admin admin] PATH_INFO: `/v3/projects/039dadc3df264018a5bcb0ece1751446` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:25.155899 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d30a2-951d-4d89-a2e5-64b585f537cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=039dadc3df264018a5bcb0ece1751446)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:25.161106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d30a2-951d-4d89-a2e5-64b585f537cf admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:25.372007 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-739d30a2-951d-4d89-a2e5-64b585f537cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '039dadc3df264018a5bcb0ece1751446', 'request_id': 'req-739d30a2-951d-4d89-a2e5-64b585f537cf'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:25.386837 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-739d30a2-951d-4d89-a2e5-64b585f537cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '039dadc3df264018a5bcb0ece1751446', 'request_id': 'req-739d30a2-951d-4d89-a2e5-64b585f537cf'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:25.406859 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-739d30a2-951d-4d89-a2e5-64b585f537cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '039dadc3df264018a5bcb0ece1751446', 'request_id': 'req-739d30a2-951d-4d89-a2e5-64b585f537cf'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:25.510878 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-739d30a2-951d-4d89-a2e5-64b585f537cf admin admin] The token cache is being invalidate because project 039dadc3df264018a5bcb0ece1751446 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:13:25.511165 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-739d30a2-951d-4d89-a2e5-64b585f537cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:25.516313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-739d30a2-951d-4d89-a2e5-64b585f537cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:25.518429 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1281/2549] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:13:25 2022] DELETE /identity/v3/projects/039dadc3df264018a5bcb0ece1751446 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:13:25.522254 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e340294-30cf-4488-b1ce-263575ac6354 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:25.540257 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e340294-30cf-4488-b1ce-263575ac6354 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:25.627147 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c20365-453c-475a-a973-51988ab4cd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:25.628317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c20365-453c-475a-a973-51988ab4cd9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:25.628684 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c20365-453c-475a-a973-51988ab4cd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:25.629044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c20365-453c-475a-a973-51988ab4cd9b admin admin] PATH_INFO: `/v3/users/0230af12ea5b4c3b8bd6ddbedb2cc049` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:25.630365 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c20365-453c-475a-a973-51988ab4cd9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0230af12ea5b4c3b8bd6ddbedb2cc049)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:25.632374 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c20365-453c-475a-a973-51988ab4cd9b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:25.850240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c1c20365-453c-475a-a973-51988ab4cd9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0230af12ea5b4c3b8bd6ddbedb2cc049'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:25.874841 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c1c20365-453c-475a-a973-51988ab4cd9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0230af12ea5b4c3b8bd6ddbedb2cc049'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:25.963121 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c1c20365-453c-475a-a973-51988ab4cd9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0230af12ea5b4c3b8bd6ddbedb2cc049'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:25.977996 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c1c20365-453c-475a-a973-51988ab4cd9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0230af12ea5b4c3b8bd6ddbedb2cc049'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:25.981333 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c1c20365-453c-475a-a973-51988ab4cd9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0230af12ea5b4c3b8bd6ddbedb2cc049'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:26.006432 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1269/2550] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:13:25 2022] DELETE /identity/v3/users/0230af12ea5b4c3b8bd6ddbedb2cc049 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:13:27.226919 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d30a2-951d-4d89-a2e5-64b585f537cf admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:27.228277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-739d30a2-951d-4d89-a2e5-64b585f537cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:27.293512 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d30a2-951d-4d89-a2e5-64b585f537cf admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:27.529548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e4b3d-66a8-4666-a9d3-ec7e7820c053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:27.550355 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e4b3d-66a8-4666-a9d3-ec7e7820c053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:27.550355 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e4b3d-66a8-4666-a9d3-ec7e7820c053 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:27.550605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e4b3d-66a8-4666-a9d3-ec7e7820c053 admin admin] PATH_INFO: `/v3/projects/a55a9172f01d405db6b58d3b1d54283d` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:27.564871 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960e4b3d-66a8-4666-a9d3-ec7e7820c053 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a55a9172f01d405db6b58d3b1d54283d)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:27.566936 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960e4b3d-66a8-4666-a9d3-ec7e7820c053 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:27.783307 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-960e4b3d-66a8-4666-a9d3-ec7e7820c053 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a55a9172f01d405db6b58d3b1d54283d', 'request_id': 'req-960e4b3d-66a8-4666-a9d3-ec7e7820c053'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:27.795314 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-960e4b3d-66a8-4666-a9d3-ec7e7820c053 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a55a9172f01d405db6b58d3b1d54283d', 'request_id': 'req-960e4b3d-66a8-4666-a9d3-ec7e7820c053'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:27.802624 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-960e4b3d-66a8-4666-a9d3-ec7e7820c053 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a55a9172f01d405db6b58d3b1d54283d', 'request_id': 'req-960e4b3d-66a8-4666-a9d3-ec7e7820c053'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:27.945131 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-960e4b3d-66a8-4666-a9d3-ec7e7820c053 admin admin] The token cache is being invalidate because project a55a9172f01d405db6b58d3b1d54283d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:13:27.945131 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-960e4b3d-66a8-4666-a9d3-ec7e7820c053 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:27.945131 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-960e4b3d-66a8-4666-a9d3-ec7e7820c053 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:27.951651 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1282/2551] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:13:27 2022] DELETE /identity/v3/projects/a55a9172f01d405db6b58d3b1d54283d => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:13:27.956290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bdfb6-fe53-41bb-a654-a59a1b67de72 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:27.957302 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bdfb6-fe53-41bb-a654-a59a1b67de72 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:27.957746 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bdfb6-fe53-41bb-a654-a59a1b67de72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:28.024403 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-549bdfb6-fe53-41bb-a654-a59a1b67de72 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:13:28.025276 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-549bdfb6-fe53-41bb-a654-a59a1b67de72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:28.198499 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1270/2552] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:13:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:13:28.207435 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19292151-d664-4db7-9356-aa0fe47169f4 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:28.210054 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19292151-d664-4db7-9356-aa0fe47169f4 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:28.210054 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19292151-d664-4db7-9356-aa0fe47169f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:28.240016 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-19292151-d664-4db7-9356-aa0fe47169f4 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:13:28.241559 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-19292151-d664-4db7-9356-aa0fe47169f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:28.257873 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1283/2553] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:13:28.259377 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549bdfb6-fe53-41bb-a654-a59a1b67de72 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:28.275211 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549bdfb6-fe53-41bb-a654-a59a1b67de72 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:28.298326 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969a934-6e6e-4c37-9fd5-51f5596e2f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:28.299190 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969a934-6e6e-4c37-9fd5-51f5596e2f0b admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:28.299480 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969a934-6e6e-4c37-9fd5-51f5596e2f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:28.299758 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969a934-6e6e-4c37-9fd5-51f5596e2f0b admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:28.302231 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8969a934-6e6e-4c37-9fd5-51f5596e2f0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:13:28.303903 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8969a934-6e6e-4c37-9fd5-51f5596e2f0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:28.306860 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8969a934-6e6e-4c37-9fd5-51f5596e2f0b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:28.331597 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1271/2554] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:13:28.346100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19292151-d664-4db7-9356-aa0fe47169f4 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:28.362350 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19292151-d664-4db7-9356-aa0fe47169f4 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:28.370522 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706bc560-c31c-4a93-a5ac-3d7c48980a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:28.371635 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bc560-c31c-4a93-a5ac-3d7c48980a6d admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:28.372166 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bc560-c31c-4a93-a5ac-3d7c48980a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:28.372679 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bc560-c31c-4a93-a5ac-3d7c48980a6d admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:28.374612 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706bc560-c31c-4a93-a5ac-3d7c48980a6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:28.377460 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706bc560-c31c-4a93-a5ac-3d7c48980a6d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:28.531977 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1284/2555] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:13:28 2022] POST /identity/v3/projects => generated 377 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:13:28.536637 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969a934-6e6e-4c37-9fd5-51f5596e2f0b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:28.552598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969a934-6e6e-4c37-9fd5-51f5596e2f0b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:28.769370 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd38b1-196c-465f-9f6b-913aeb444603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:28.770070 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd38b1-196c-465f-9f6b-913aeb444603 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:28.770358 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd38b1-196c-465f-9f6b-913aeb444603 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:28.770644 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd38b1-196c-465f-9f6b-913aeb444603 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:28.771355 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd38b1-196c-465f-9f6b-913aeb444603 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:28.774229 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd38b1-196c-465f-9f6b-913aeb444603 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:29.011246 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1272/2556] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:13:28 2022] POST /identity/v3/users => generated 289 bytes in 475 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:13:29.015495 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706bc560-c31c-4a93-a5ac-3d7c48980a6d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:29.034156 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706bc560-c31c-4a93-a5ac-3d7c48980a6d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:29.046010 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26609fa3-70a5-4e95-97fe-2b412806a225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:29.046680 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26609fa3-70a5-4e95-97fe-2b412806a225 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:29.049198 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26609fa3-70a5-4e95-97fe-2b412806a225 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:29.049198 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26609fa3-70a5-4e95-97fe-2b412806a225 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:29.049198 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26609fa3-70a5-4e95-97fe-2b412806a225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:29.051925 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26609fa3-70a5-4e95-97fe-2b412806a225 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:29.092256 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1285/2557] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:13:29.092677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd38b1-196c-465f-9f6b-913aeb444603 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:29.107268 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd38b1-196c-465f-9f6b-913aeb444603 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:29.113394 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9708c0-b6f9-4d6b-8dd2-b4cea1540cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:29.114610 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9708c0-b6f9-4d6b-8dd2-b4cea1540cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:29.116885 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9708c0-b6f9-4d6b-8dd2-b4cea1540cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:29.117422 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9708c0-b6f9-4d6b-8dd2-b4cea1540cd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:29.118379 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9708c0-b6f9-4d6b-8dd2-b4cea1540cd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:29.120275 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9708c0-b6f9-4d6b-8dd2-b4cea1540cd0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:29.136028 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1273/2558] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:13:29.140639 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26609fa3-70a5-4e95-97fe-2b412806a225 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:29.155404 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26609fa3-70a5-4e95-97fe-2b412806a225 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:29.161372 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa63181-299d-4246-b1fa-085e4970348f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:29.163030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa63181-299d-4246-b1fa-085e4970348f admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:29.163453 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa63181-299d-4246-b1fa-085e4970348f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:29.163807 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa63181-299d-4246-b1fa-085e4970348f admin admin] PATH_INFO: `/v3/projects/3efa080ffdce44ca8221e42cb523f346/users/c778c87f930b4705a541decc3e6147c2/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:29.186583 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa63181-299d-4246-b1fa-085e4970348f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3efa080ffdce44ca8221e42cb523f346, user_id=c778c87f930b4705a541decc3e6147c2, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:29.190885 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa63181-299d-4246-b1fa-085e4970348f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:29.336572 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1286/2559] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:13:29 2022] PUT /identity/v3/projects/3efa080ffdce44ca8221e42cb523f346/users/c778c87f930b4705a541decc3e6147c2/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:13:29.348191 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9e276-a8ac-40e6-825f-e93723808a77 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:29.348799 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9e276-a8ac-40e6-825f-e93723808a77 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:29.349265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9e276-a8ac-40e6-825f-e93723808a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:29.406897 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-fbd9e276-a8ac-40e6-825f-e93723808a77 None None] MFA Rules not processed for user `c778c87f930b4705a541decc3e6147c2`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:13:29.409145 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-fbd9e276-a8ac-40e6-825f-e93723808a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:29.560886 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1274/2560] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:13:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:13:29.561347 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa63181-299d-4246-b1fa-085e4970348f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:29.652914 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa63181-299d-4246-b1fa-085e4970348f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:29.658203 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5945fd-4371-420c-97f6-35cdc62107e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:29.659043 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5945fd-4371-420c-97f6-35cdc62107e1 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:29.659627 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5945fd-4371-420c-97f6-35cdc62107e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:29.659984 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5945fd-4371-420c-97f6-35cdc62107e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:29.660761 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5945fd-4371-420c-97f6-35cdc62107e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:29.663677 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5945fd-4371-420c-97f6-35cdc62107e1 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:29.799670 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1287/2561] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:13:29 2022] POST /identity/v3/projects => generated 379 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:13:29.800918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9e276-a8ac-40e6-825f-e93723808a77 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:29.824867 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9e276-a8ac-40e6-825f-e93723808a77 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:29.979037 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5912c8-e2d7-462a-9f0e-c81ee6d6da19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:29.983214 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5912c8-e2d7-462a-9f0e-c81ee6d6da19 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:29.983214 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5912c8-e2d7-462a-9f0e-c81ee6d6da19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:29.983214 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5912c8-e2d7-462a-9f0e-c81ee6d6da19 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:29.983214 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5912c8-e2d7-462a-9f0e-c81ee6d6da19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:29.986598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5912c8-e2d7-462a-9f0e-c81ee6d6da19 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:30.104457 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1275/2562] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:13:29 2022] POST /identity/v3/users => generated 296 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:13:30.108381 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5945fd-4371-420c-97f6-35cdc62107e1 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:30.123517 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5945fd-4371-420c-97f6-35cdc62107e1 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:30.129446 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b017eff-b2e5-4261-b601-e037784e0b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:30.132661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b017eff-b2e5-4261-b601-e037784e0b66 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:30.132661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b017eff-b2e5-4261-b601-e037784e0b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:30.132661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b017eff-b2e5-4261-b601-e037784e0b66 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:30.132661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b017eff-b2e5-4261-b601-e037784e0b66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:30.134541 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b017eff-b2e5-4261-b601-e037784e0b66 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:30.151004 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1288/2563] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:13:30.152646 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5912c8-e2d7-462a-9f0e-c81ee6d6da19 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:30.166283 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5912c8-e2d7-462a-9f0e-c81ee6d6da19 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:30.171706 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa5330-2691-4b1c-a3f5-1b196769fe4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:30.172953 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa5330-2691-4b1c-a3f5-1b196769fe4e admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:30.173475 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa5330-2691-4b1c-a3f5-1b196769fe4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:30.173992 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa5330-2691-4b1c-a3f5-1b196769fe4e admin admin] PATH_INFO: `/v3/projects/53f6ab879012445aac4561c350d86e95/users/7a4ddf2bfb2f405bb9bc9e0c71aa89c1/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:30.196939 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa5330-2691-4b1c-a3f5-1b196769fe4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=53f6ab879012445aac4561c350d86e95, user_id=7a4ddf2bfb2f405bb9bc9e0c71aa89c1, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:30.201271 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa5330-2691-4b1c-a3f5-1b196769fe4e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:30.376859 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1276/2564] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:13:30 2022] PUT /identity/v3/projects/53f6ab879012445aac4561c350d86e95/users/7a4ddf2bfb2f405bb9bc9e0c71aa89c1/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:13:30.378222 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b017eff-b2e5-4261-b601-e037784e0b66 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:30.389578 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b017eff-b2e5-4261-b601-e037784e0b66 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:30.518679 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f7712-7167-4917-8d87-12533d9afd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:30.519514 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f7712-7167-4917-8d87-12533d9afd07 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:30.519865 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f7712-7167-4917-8d87-12533d9afd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:30.520216 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f7712-7167-4917-8d87-12533d9afd07 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:30.521548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f7712-7167-4917-8d87-12533d9afd07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:30.525157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f7712-7167-4917-8d87-12533d9afd07 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:30.544663 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1289/2565] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:13:30.545952 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa5330-2691-4b1c-a3f5-1b196769fe4e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:30.559734 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa5330-2691-4b1c-a3f5-1b196769fe4e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:30.566652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea2446-2dc6-438d-955b-602b14fd74af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:30.568046 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea2446-2dc6-438d-955b-602b14fd74af admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:30.568158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea2446-2dc6-438d-955b-602b14fd74af admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:30.568610 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea2446-2dc6-438d-955b-602b14fd74af admin admin] PATH_INFO: `/v3/projects/53f6ab879012445aac4561c350d86e95/users/7a4ddf2bfb2f405bb9bc9e0c71aa89c1/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:30.571136 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea2446-2dc6-438d-955b-602b14fd74af admin admin] RBAC: Authorizing `identity:create_grant(project_id=53f6ab879012445aac4561c350d86e95, user_id=7a4ddf2bfb2f405bb9bc9e0c71aa89c1, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:30.573965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea2446-2dc6-438d-955b-602b14fd74af admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:30.594117 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1277/2566] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:13:30 2022] PUT /identity/v3/projects/53f6ab879012445aac4561c350d86e95/users/7a4ddf2bfb2f405bb9bc9e0c71aa89c1/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:13:30.605602 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d893a3-4be8-4247-8a17-8b559d5b9d85 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:30.605920 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d893a3-4be8-4247-8a17-8b559d5b9d85 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:30.606200 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d893a3-4be8-4247-8a17-8b559d5b9d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:30.682260 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-35d893a3-4be8-4247-8a17-8b559d5b9d85 None None] MFA Rules not processed for user `7a4ddf2bfb2f405bb9bc9e0c71aa89c1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:13:30.684546 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-35d893a3-4be8-4247-8a17-8b559d5b9d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:30.703267 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199831c-ae32-48f5-b4f9-08d1eaf0bc77 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:30.703945 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199831c-ae32-48f5-b4f9-08d1eaf0bc77 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:30.704400 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199831c-ae32-48f5-b4f9-08d1eaf0bc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:30.747597 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-7199831c-ae32-48f5-b4f9-08d1eaf0bc77 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:13:30.751604 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7199831c-ae32-48f5-b4f9-08d1eaf0bc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:30.779230 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1290/2567] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:13:30 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:13:30.780932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e6a17-55a3-46c5-88c7-8df18fefc992 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:30.781223 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e6a17-55a3-46c5-88c7-8df18fefc992 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:30.781680 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e6a17-55a3-46c5-88c7-8df18fefc992 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:30.783297 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1291/2568] 10.222.0.23 () {54 vars in 921 bytes} [Sat Apr 30 21:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:13:30.790913 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eaffee-e573-40b6-b562-182f37505fc6 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:30.791199 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eaffee-e573-40b6-b562-182f37505fc6 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:30.791476 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eaffee-e573-40b6-b562-182f37505fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:30.820692 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-59eaffee-e573-40b6-b562-182f37505fc6 None None] MFA Rules not processed for user `4ad3f89b7037413a83c7905cef263b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:13:30.822299 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-59eaffee-e573-40b6-b562-182f37505fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:30.834950 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1278/2569] 10.222.0.23 () {58 vars in 967 bytes} [Sat Apr 30 21:13:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:13:30.851435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199831c-ae32-48f5-b4f9-08d1eaf0bc77 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:30.854203 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7199831c-ae32-48f5-b4f9-08d1eaf0bc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:30.923668 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1292/2570] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Apr 30 21:13:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:13:30.948047 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eaffee-e573-40b6-b562-182f37505fc6 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:30.950076 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-59eaffee-e573-40b6-b562-182f37505fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:30.958413 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199831c-ae32-48f5-b4f9-08d1eaf0bc77 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:30.965556 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80728f94-3c85-42c9-b6a3-8ef0420ac427 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:30.966796 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80728f94-3c85-42c9-b6a3-8ef0420ac427 service swift] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:30.967242 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80728f94-3c85-42c9-b6a3-8ef0420ac427 service swift] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:30.967679 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80728f94-3c85-42c9-b6a3-8ef0420ac427 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:30.971470 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eaffee-e573-40b6-b562-182f37505fc6 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:30.978111 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80728f94-3c85-42c9-b6a3-8ef0420ac427 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:30.979162 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf5afd-b444-4053-8645-8b08faba7a29 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:30.979933 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf5afd-b444-4053-8645-8b08faba7a29 service placement] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:30.980319 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf5afd-b444-4053-8645-8b08faba7a29 service placement] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:30.980633 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80728f94-3c85-42c9-b6a3-8ef0420ac427 service swift] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:30.980766 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf5afd-b444-4053-8645-8b08faba7a29 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:30.991462 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1279/2571] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:13:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:13:30.992948 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf5afd-b444-4053-8645-8b08faba7a29 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:30.995965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf5afd-b444-4053-8645-8b08faba7a29 service placement] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:31.014769 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1293/2572] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:13:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:13:31.039126 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80728f94-3c85-42c9-b6a3-8ef0420ac427 service swift] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:31.041231 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-80728f94-3c85-42c9-b6a3-8ef0420ac427 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:31.153705 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80728f94-3c85-42c9-b6a3-8ef0420ac427 service swift] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:31.158852 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d17e35-c25c-406a-a300-3e9d4475b7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:31.159730 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d17e35-c25c-406a-a300-3e9d4475b7b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:31.160024 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d17e35-c25c-406a-a300-3e9d4475b7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:31.160299 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d17e35-c25c-406a-a300-3e9d4475b7b1 admin admin] PATH_INFO: `/v3/users/1d742edf519e4554850b8a0c4457f4ce` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:31.161572 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d17e35-c25c-406a-a300-3e9d4475b7b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d742edf519e4554850b8a0c4457f4ce)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:31.163604 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d17e35-c25c-406a-a300-3e9d4475b7b1 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:31.404984 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-69d17e35-c25c-406a-a300-3e9d4475b7b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d742edf519e4554850b8a0c4457f4ce'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:31.425434 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-69d17e35-c25c-406a-a300-3e9d4475b7b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d742edf519e4554850b8a0c4457f4ce'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:31.553503 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-69d17e35-c25c-406a-a300-3e9d4475b7b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d742edf519e4554850b8a0c4457f4ce'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:31.561738 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-69d17e35-c25c-406a-a300-3e9d4475b7b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d742edf519e4554850b8a0c4457f4ce'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:31.562470 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-69d17e35-c25c-406a-a300-3e9d4475b7b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d742edf519e4554850b8a0c4457f4ce'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:31.568837 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1280/2573] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:13:31 2022] DELETE /identity/v3/users/1d742edf519e4554850b8a0c4457f4ce => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:13:31.892430 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf5afd-b444-4053-8645-8b08faba7a29 service placement] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:31.906742 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf5afd-b444-4053-8645-8b08faba7a29 service placement] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:31.980071 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea9839-5733-463b-a511-f089ca208c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:31.980932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea9839-5733-463b-a511-f089ca208c09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:31.981215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea9839-5733-463b-a511-f089ca208c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:31.981498 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea9839-5733-463b-a511-f089ca208c09 admin admin] PATH_INFO: `/v3/projects/0e2d36f1ee8d4945a59a8c2a0088306e` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:31.982759 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea9839-5733-463b-a511-f089ca208c09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e2d36f1ee8d4945a59a8c2a0088306e)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:31.984668 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea9839-5733-463b-a511-f089ca208c09 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:32.138890 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5eea9839-5733-463b-a511-f089ca208c09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e2d36f1ee8d4945a59a8c2a0088306e', 'request_id': 'req-5eea9839-5733-463b-a511-f089ca208c09'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:32.144781 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5eea9839-5733-463b-a511-f089ca208c09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e2d36f1ee8d4945a59a8c2a0088306e', 'request_id': 'req-5eea9839-5733-463b-a511-f089ca208c09'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:32.151760 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5eea9839-5733-463b-a511-f089ca208c09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e2d36f1ee8d4945a59a8c2a0088306e', 'request_id': 'req-5eea9839-5733-463b-a511-f089ca208c09'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:32.196757 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d17e35-c25c-406a-a300-3e9d4475b7b1 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:32.198775 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-69d17e35-c25c-406a-a300-3e9d4475b7b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:32.221111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5eea9839-5733-463b-a511-f089ca208c09 admin admin] The token cache is being invalidate because project 0e2d36f1ee8d4945a59a8c2a0088306e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:13:32.221818 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5eea9839-5733-463b-a511-f089ca208c09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:32.224258 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5eea9839-5733-463b-a511-f089ca208c09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:32.226638 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1294/2574] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:13:31 2022] DELETE /identity/v3/projects/0e2d36f1ee8d4945a59a8c2a0088306e => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:13:32.231689 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89f47d-5091-462b-8fee-89b25533d11f None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:32.232053 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89f47d-5091-462b-8fee-89b25533d11f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:32.232519 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89f47d-5091-462b-8fee-89b25533d11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:32.261169 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-1f89f47d-5091-462b-8fee-89b25533d11f None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:13:32.263154 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1f89f47d-5091-462b-8fee-89b25533d11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:32.293472 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d17e35-c25c-406a-a300-3e9d4475b7b1 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:32.370035 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1295/2575] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:13:32.380148 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aeb677-21fb-4744-9693-49267eb222c8 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:32.380613 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aeb677-21fb-4744-9693-49267eb222c8 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:32.380963 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aeb677-21fb-4744-9693-49267eb222c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:32.406078 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-52aeb677-21fb-4744-9693-49267eb222c8 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:13:32.407251 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa9ccb-3f48-4edb-907d-3dc040e36a56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:32.408669 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-52aeb677-21fb-4744-9693-49267eb222c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:32.409637 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa9ccb-3f48-4edb-907d-3dc040e36a56 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:32.410436 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa9ccb-3f48-4edb-907d-3dc040e36a56 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:32.410970 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa9ccb-3f48-4edb-907d-3dc040e36a56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:32.415551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0faa9ccb-3f48-4edb-907d-3dc040e36a56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:32.426101 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1296/2576] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:13:32.431235 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aeb677-21fb-4744-9693-49267eb222c8 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:32.448009 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aeb677-21fb-4744-9693-49267eb222c8 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:32.455596 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6b2df-586b-4060-b4fe-1d27f6145cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:32.456791 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6b2df-586b-4060-b4fe-1d27f6145cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:32.457251 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6b2df-586b-4060-b4fe-1d27f6145cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:32.457888 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6b2df-586b-4060-b4fe-1d27f6145cc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:32.459699 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa6b2df-586b-4060-b4fe-1d27f6145cc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:13:32.460263 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa6b2df-586b-4060-b4fe-1d27f6145cc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:32.462241 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa6b2df-586b-4060-b4fe-1d27f6145cc5 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:32.476639 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1297/2577] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:13:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:13:32.482124 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6b2df-586b-4060-b4fe-1d27f6145cc5 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:32.493496 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6b2df-586b-4060-b4fe-1d27f6145cc5 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:32.499431 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd813e2e-4176-4ae5-9f6d-45f99d324e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:32.500200 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd813e2e-4176-4ae5-9f6d-45f99d324e00 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:32.500380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd813e2e-4176-4ae5-9f6d-45f99d324e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:32.500663 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd813e2e-4176-4ae5-9f6d-45f99d324e00 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:32.501351 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd813e2e-4176-4ae5-9f6d-45f99d324e00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:32.504371 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd813e2e-4176-4ae5-9f6d-45f99d324e00 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:32.505221 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa9ccb-3f48-4edb-907d-3dc040e36a56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:32.507198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa9ccb-3f48-4edb-907d-3dc040e36a56 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:32.526431 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1281/2578] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:13:32 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:13:32.605282 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1298/2579] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:13:32 2022] POST /identity/v3/projects => generated 403 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:13:32.609522 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa9ccb-3f48-4edb-907d-3dc040e36a56 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:32.621700 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa9ccb-3f48-4edb-907d-3dc040e36a56 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:32.678814 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3953f2-99a2-428b-815a-cf10d474a5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:32.679487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3953f2-99a2-428b-815a-cf10d474a5ef admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:32.679773 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3953f2-99a2-428b-815a-cf10d474a5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:32.680050 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3953f2-99a2-428b-815a-cf10d474a5ef admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:32.680749 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3953f2-99a2-428b-815a-cf10d474a5ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:32.683287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3953f2-99a2-428b-815a-cf10d474a5ef admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:32.774110 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1282/2580] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:13:32 2022] POST /identity/v3/users => generated 302 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:13:32.778711 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd813e2e-4176-4ae5-9f6d-45f99d324e00 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:32.791837 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd813e2e-4176-4ae5-9f6d-45f99d324e00 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:32.797840 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06abaf5-9c01-4d6f-8df1-f06519b06572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:32.798707 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06abaf5-9c01-4d6f-8df1-f06519b06572 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:32.799065 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06abaf5-9c01-4d6f-8df1-f06519b06572 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:32.799472 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06abaf5-9c01-4d6f-8df1-f06519b06572 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:32.800349 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06abaf5-9c01-4d6f-8df1-f06519b06572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:32.802121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06abaf5-9c01-4d6f-8df1-f06519b06572 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:32.813502 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1299/2581] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:13:32.817406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3953f2-99a2-428b-815a-cf10d474a5ef admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:32.827479 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3953f2-99a2-428b-815a-cf10d474a5ef admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:32.832362 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a5c1c-723a-4da1-953e-b523b76103bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:32.832918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a5c1c-723a-4da1-953e-b523b76103bd admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:32.833204 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a5c1c-723a-4da1-953e-b523b76103bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:32.833480 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a5c1c-723a-4da1-953e-b523b76103bd admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:32.834232 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278a5c1c-723a-4da1-953e-b523b76103bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:32.835926 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278a5c1c-723a-4da1-953e-b523b76103bd admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:32.854473 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1283/2582] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:13:32.860693 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06abaf5-9c01-4d6f-8df1-f06519b06572 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:32.878482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06abaf5-9c01-4d6f-8df1-f06519b06572 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:32.890492 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75825acb-d92b-4287-8858-cd240cb82495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:32.893248 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75825acb-d92b-4287-8858-cd240cb82495 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:32.894600 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75825acb-d92b-4287-8858-cd240cb82495 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:32.909961 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75825acb-d92b-4287-8858-cd240cb82495 admin admin] PATH_INFO: `/v3/projects/a1c2ee9a249541aa99783095b6154dde/users/c3a0b7af3d2947189fb1deb6065d3a77/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:32.921881 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75825acb-d92b-4287-8858-cd240cb82495 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1c2ee9a249541aa99783095b6154dde, user_id=c3a0b7af3d2947189fb1deb6065d3a77, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:32.927193 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75825acb-d92b-4287-8858-cd240cb82495 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:33.042602 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1300/2583] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:13:32 2022] PUT /identity/v3/projects/a1c2ee9a249541aa99783095b6154dde/users/c3a0b7af3d2947189fb1deb6065d3a77/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:13:33.057977 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d3524-165d-4a8b-b0ad-15133ceae8e3 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:33.057977 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d3524-165d-4a8b-b0ad-15133ceae8e3 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:33.057977 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d3524-165d-4a8b-b0ad-15133ceae8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:33.069541 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-3b5d3524-165d-4a8b-b0ad-15133ceae8e3 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:13:33.070844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3b5d3524-165d-4a8b-b0ad-15133ceae8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:33.149342 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1284/2584] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:13:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:13:33.162505 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75825acb-d92b-4287-8858-cd240cb82495 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:33.164740 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-75825acb-d92b-4287-8858-cd240cb82495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:33.245279 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75825acb-d92b-4287-8858-cd240cb82495 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:33.249723 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f4922-9e52-4d69-b071-783a60cb8766 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:33.250431 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f4922-9e52-4d69-b071-783a60cb8766 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:33.250717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f4922-9e52-4d69-b071-783a60cb8766 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:33.250996 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f4922-9e52-4d69-b071-783a60cb8766 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:33.267361 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f4922-9e52-4d69-b071-783a60cb8766 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:33.269238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f4922-9e52-4d69-b071-783a60cb8766 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:33.284134 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1301/2585] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:13:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:13:33.531887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d3524-165d-4a8b-b0ad-15133ceae8e3 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:33.533570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3b5d3524-165d-4a8b-b0ad-15133ceae8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:33.558236 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d3524-165d-4a8b-b0ad-15133ceae8e3 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:33.558236 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139403f-e604-4146-ae48-755fdd56b889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:33.558236 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139403f-e604-4146-ae48-755fdd56b889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:33.558236 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139403f-e604-4146-ae48-755fdd56b889 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:33.562687 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139403f-e604-4146-ae48-755fdd56b889 admin admin] PATH_INFO: `/v3/users/c778c87f930b4705a541decc3e6147c2` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:33.562687 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139403f-e604-4146-ae48-755fdd56b889 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c778c87f930b4705a541decc3e6147c2)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:33.564760 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139403f-e604-4146-ae48-755fdd56b889 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:33.779376 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1139403f-e604-4146-ae48-755fdd56b889 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c778c87f930b4705a541decc3e6147c2'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:33.796524 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1139403f-e604-4146-ae48-755fdd56b889 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c778c87f930b4705a541decc3e6147c2'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:33.947891 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1139403f-e604-4146-ae48-755fdd56b889 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c778c87f930b4705a541decc3e6147c2'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:33.956413 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1139403f-e604-4146-ae48-755fdd56b889 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c778c87f930b4705a541decc3e6147c2'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:33.956989 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1139403f-e604-4146-ae48-755fdd56b889 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c778c87f930b4705a541decc3e6147c2'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:33.963613 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1285/2586] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:13:33 2022] DELETE /identity/v3/users/c778c87f930b4705a541decc3e6147c2 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:13:33.967838 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f743e3-fa90-4933-980e-7d7dbb9f4938 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:33.968305 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f743e3-fa90-4933-980e-7d7dbb9f4938 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:33.968419 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f743e3-fa90-4933-980e-7d7dbb9f4938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:33.988138 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-c3f743e3-fa90-4933-980e-7d7dbb9f4938 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:13:33.989474 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c3f743e3-fa90-4933-980e-7d7dbb9f4938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:34.055239 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1302/2587] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:13:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:13:34.065909 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139403f-e604-4146-ae48-755fdd56b889 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:34.067949 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1139403f-e604-4146-ae48-755fdd56b889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:34.139462 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139403f-e604-4146-ae48-755fdd56b889 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:34.143708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c093617-f28f-45a1-86f5-4dbf5ea4c6e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:34.144584 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c093617-f28f-45a1-86f5-4dbf5ea4c6e0 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:34.145232 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c093617-f28f-45a1-86f5-4dbf5ea4c6e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:34.145673 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c093617-f28f-45a1-86f5-4dbf5ea4c6e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:34.156374 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c093617-f28f-45a1-86f5-4dbf5ea4c6e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:34.158626 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c093617-f28f-45a1-86f5-4dbf5ea4c6e0 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:34.169515 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1286/2588] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:13:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:13:34.761397 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f743e3-fa90-4933-980e-7d7dbb9f4938 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:34.763067 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c3f743e3-fa90-4933-980e-7d7dbb9f4938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:34.775930 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f743e3-fa90-4933-980e-7d7dbb9f4938 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:34.782664 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86871e0b-30cd-4f4b-a5fd-4841f8af5286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:34.783666 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86871e0b-30cd-4f4b-a5fd-4841f8af5286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:34.784053 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86871e0b-30cd-4f4b-a5fd-4841f8af5286 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:34.784441 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86871e0b-30cd-4f4b-a5fd-4841f8af5286 admin admin] PATH_INFO: `/v3/projects/3efa080ffdce44ca8221e42cb523f346` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:34.785974 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86871e0b-30cd-4f4b-a5fd-4841f8af5286 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3efa080ffdce44ca8221e42cb523f346)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:34.788327 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86871e0b-30cd-4f4b-a5fd-4841f8af5286 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:34.976208 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-86871e0b-30cd-4f4b-a5fd-4841f8af5286 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3efa080ffdce44ca8221e42cb523f346', 'request_id': 'req-86871e0b-30cd-4f4b-a5fd-4841f8af5286'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:34.988403 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-86871e0b-30cd-4f4b-a5fd-4841f8af5286 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3efa080ffdce44ca8221e42cb523f346', 'request_id': 'req-86871e0b-30cd-4f4b-a5fd-4841f8af5286'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:34.998683 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-86871e0b-30cd-4f4b-a5fd-4841f8af5286 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3efa080ffdce44ca8221e42cb523f346', 'request_id': 'req-86871e0b-30cd-4f4b-a5fd-4841f8af5286'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:35.130950 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-86871e0b-30cd-4f4b-a5fd-4841f8af5286 admin admin] The token cache is being invalidate because project 3efa080ffdce44ca8221e42cb523f346 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:13:35.131240 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-86871e0b-30cd-4f4b-a5fd-4841f8af5286 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:35.131942 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-86871e0b-30cd-4f4b-a5fd-4841f8af5286 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:35.133561 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1303/2589] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:13:34 2022] DELETE /identity/v3/projects/3efa080ffdce44ca8221e42cb523f346 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:13:35.137632 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c093617-f28f-45a1-86f5-4dbf5ea4c6e0 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:35.147932 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c093617-f28f-45a1-86f5-4dbf5ea4c6e0 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:35.213460 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf970dd6-58e2-4a10-98b3-5e7c45305433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:35.217485 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf970dd6-58e2-4a10-98b3-5e7c45305433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:35.217485 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf970dd6-58e2-4a10-98b3-5e7c45305433 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:35.217485 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf970dd6-58e2-4a10-98b3-5e7c45305433 admin admin] PATH_INFO: `/v3/users/7a4ddf2bfb2f405bb9bc9e0c71aa89c1` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:35.217485 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf970dd6-58e2-4a10-98b3-5e7c45305433 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a4ddf2bfb2f405bb9bc9e0c71aa89c1)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:35.218163 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf970dd6-58e2-4a10-98b3-5e7c45305433 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:35.488175 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bf970dd6-58e2-4a10-98b3-5e7c45305433 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a4ddf2bfb2f405bb9bc9e0c71aa89c1'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:35.532094 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bf970dd6-58e2-4a10-98b3-5e7c45305433 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a4ddf2bfb2f405bb9bc9e0c71aa89c1'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:35.622166 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bf970dd6-58e2-4a10-98b3-5e7c45305433 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a4ddf2bfb2f405bb9bc9e0c71aa89c1'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:35.630238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bf970dd6-58e2-4a10-98b3-5e7c45305433 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a4ddf2bfb2f405bb9bc9e0c71aa89c1'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:35.632157 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bf970dd6-58e2-4a10-98b3-5e7c45305433 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a4ddf2bfb2f405bb9bc9e0c71aa89c1'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:35.648284 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1287/2590] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:13:35 2022] DELETE /identity/v3/users/7a4ddf2bfb2f405bb9bc9e0c71aa89c1 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:13:37.036789 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86871e0b-30cd-4f4b-a5fd-4841f8af5286 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:37.038302 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-86871e0b-30cd-4f4b-a5fd-4841f8af5286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:37.052920 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86871e0b-30cd-4f4b-a5fd-4841f8af5286 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:37.204285 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a421f5-7474-44e2-9eef-260836851fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:37.205432 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a421f5-7474-44e2-9eef-260836851fa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:37.205904 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a421f5-7474-44e2-9eef-260836851fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:37.206339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a421f5-7474-44e2-9eef-260836851fa2 admin admin] PATH_INFO: `/v3/projects/53f6ab879012445aac4561c350d86e95` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:37.210738 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a421f5-7474-44e2-9eef-260836851fa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53f6ab879012445aac4561c350d86e95)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:37.210738 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a421f5-7474-44e2-9eef-260836851fa2 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:37.379589 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-13a421f5-7474-44e2-9eef-260836851fa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53f6ab879012445aac4561c350d86e95', 'request_id': 'req-13a421f5-7474-44e2-9eef-260836851fa2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:37.389378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-13a421f5-7474-44e2-9eef-260836851fa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53f6ab879012445aac4561c350d86e95', 'request_id': 'req-13a421f5-7474-44e2-9eef-260836851fa2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:37.415695 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-13a421f5-7474-44e2-9eef-260836851fa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53f6ab879012445aac4561c350d86e95', 'request_id': 'req-13a421f5-7474-44e2-9eef-260836851fa2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:37.537845 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-13a421f5-7474-44e2-9eef-260836851fa2 admin admin] The token cache is being invalidate because project 53f6ab879012445aac4561c350d86e95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:13:37.538462 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-13a421f5-7474-44e2-9eef-260836851fa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:37.539822 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-13a421f5-7474-44e2-9eef-260836851fa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:37.541969 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1304/2591] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:13:37 2022] DELETE /identity/v3/projects/53f6ab879012445aac4561c350d86e95 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:13:37.547265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227690fc-ea0d-4e83-9ab3-2348b4a35048 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:37.547743 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227690fc-ea0d-4e83-9ab3-2348b4a35048 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:37.547917 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227690fc-ea0d-4e83-9ab3-2348b4a35048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:37.607735 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-227690fc-ea0d-4e83-9ab3-2348b4a35048 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:13:37.612437 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-227690fc-ea0d-4e83-9ab3-2348b4a35048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:37.713203 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1288/2592] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:13:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:13:37.722540 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf14f77-8977-46d7-8a52-090850841d2d None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:37.722962 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf14f77-8977-46d7-8a52-090850841d2d None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:37.723445 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf14f77-8977-46d7-8a52-090850841d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:37.752809 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-0bf14f77-8977-46d7-8a52-090850841d2d None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:13:37.754543 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0bf14f77-8977-46d7-8a52-090850841d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:37.770520 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1305/2593] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:13:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:13:37.774994 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227690fc-ea0d-4e83-9ab3-2348b4a35048 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:37.790440 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227690fc-ea0d-4e83-9ab3-2348b4a35048 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:37.800604 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62630dbe-c50e-4b8d-a475-07b19f36ef04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:37.801663 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62630dbe-c50e-4b8d-a475-07b19f36ef04 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:37.801999 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62630dbe-c50e-4b8d-a475-07b19f36ef04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:37.802277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62630dbe-c50e-4b8d-a475-07b19f36ef04 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:37.803008 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62630dbe-c50e-4b8d-a475-07b19f36ef04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:13:37.803453 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62630dbe-c50e-4b8d-a475-07b19f36ef04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:37.805614 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62630dbe-c50e-4b8d-a475-07b19f36ef04 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:37.825112 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1289/2594] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:13:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:13:37.829133 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf14f77-8977-46d7-8a52-090850841d2d None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:37.847542 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf14f77-8977-46d7-8a52-090850841d2d None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:37.879496 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f60760-285b-4111-ae2d-7ec4dbc60e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:37.880338 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f60760-285b-4111-ae2d-7ec4dbc60e71 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:37.880824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f60760-285b-4111-ae2d-7ec4dbc60e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:37.881275 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f60760-285b-4111-ae2d-7ec4dbc60e71 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:37.884883 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f60760-285b-4111-ae2d-7ec4dbc60e71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:37.887627 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f60760-285b-4111-ae2d-7ec4dbc60e71 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:37.949730 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19609535-5c0c-4d36-a7a4-7c46b772582b None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:37.950338 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19609535-5c0c-4d36-a7a4-7c46b772582b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:37.950824 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19609535-5c0c-4d36-a7a4-7c46b772582b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:37.998048 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-19609535-5c0c-4d36-a7a4-7c46b772582b None None] MFA Rules not processed for user `8bd54cdc115e4ae9b202bd06c7658e4a`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:13:38.001176 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-19609535-5c0c-4d36-a7a4-7c46b772582b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:38.101907 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1290/2595] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:13:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:13:38.127100 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1306/2596] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:13:37 2022] POST /identity/v3/projects => generated 403 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:13:38.130769 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19609535-5c0c-4d36-a7a4-7c46b772582b None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:38.148048 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19609535-5c0c-4d36-a7a4-7c46b772582b None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:38.290895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4f937-8b61-449d-b37f-4bcd3eec4241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:38.298461 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4f937-8b61-449d-b37f-4bcd3eec4241 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:38.300535 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4f937-8b61-449d-b37f-4bcd3eec4241 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:38.300535 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4f937-8b61-449d-b37f-4bcd3eec4241 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:38.301106 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4f937-8b61-449d-b37f-4bcd3eec4241 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:38.303367 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4f937-8b61-449d-b37f-4bcd3eec4241 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:38.442173 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1291/2597] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:13:38 2022] POST /identity/v3/users => generated 302 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:13:38.447040 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f60760-285b-4111-ae2d-7ec4dbc60e71 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:38.464399 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f60760-285b-4111-ae2d-7ec4dbc60e71 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:38.476026 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009f899-7dc8-47d3-b22e-8b7b504c08cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:38.477188 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009f899-7dc8-47d3-b22e-8b7b504c08cc admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:38.477787 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009f899-7dc8-47d3-b22e-8b7b504c08cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:38.478275 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009f899-7dc8-47d3-b22e-8b7b504c08cc admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:38.479338 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e009f899-7dc8-47d3-b22e-8b7b504c08cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:38.481065 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e009f899-7dc8-47d3-b22e-8b7b504c08cc admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:38.505970 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1307/2598] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:13:38.508637 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4f937-8b61-449d-b37f-4bcd3eec4241 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:38.524344 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4f937-8b61-449d-b37f-4bcd3eec4241 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:38.541442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517de5bc-234b-44ea-9058-a51ce95e7217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:38.542135 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517de5bc-234b-44ea-9058-a51ce95e7217 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:38.542417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517de5bc-234b-44ea-9058-a51ce95e7217 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:38.542689 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517de5bc-234b-44ea-9058-a51ce95e7217 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:38.543511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517de5bc-234b-44ea-9058-a51ce95e7217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:38.556108 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517de5bc-234b-44ea-9058-a51ce95e7217 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:38.591214 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1292/2599] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:13:38.592607 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009f899-7dc8-47d3-b22e-8b7b504c08cc admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:38.614285 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009f899-7dc8-47d3-b22e-8b7b504c08cc admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:38.627090 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4372e-ed94-4a9d-b5cf-d0e77a789064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:38.628115 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4372e-ed94-4a9d-b5cf-d0e77a789064 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:38.628576 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4372e-ed94-4a9d-b5cf-d0e77a789064 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:38.628951 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4372e-ed94-4a9d-b5cf-d0e77a789064 admin admin] PATH_INFO: `/v3/projects/b494a426f9d74c94b7c7e5e630bc5da1/users/b4da9575aafc490b908379ddcbcde906/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:38.669262 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4372e-ed94-4a9d-b5cf-d0e77a789064 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b494a426f9d74c94b7c7e5e630bc5da1, user_id=b4da9575aafc490b908379ddcbcde906, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:38.674973 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4372e-ed94-4a9d-b5cf-d0e77a789064 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:38.762050 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1308/2600] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:13:38 2022] PUT /identity/v3/projects/b494a426f9d74c94b7c7e5e630bc5da1/users/b4da9575aafc490b908379ddcbcde906/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:13:38.772946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532e9e5-237d-450f-9c70-46efb7b01dc2 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:38.773264 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532e9e5-237d-450f-9c70-46efb7b01dc2 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:38.773560 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532e9e5-237d-450f-9c70-46efb7b01dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:38.823519 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-8532e9e5-237d-450f-9c70-46efb7b01dc2 None None] MFA Rules not processed for user `b4da9575aafc490b908379ddcbcde906`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:13:38.824753 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8532e9e5-237d-450f-9c70-46efb7b01dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:38.921319 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1293/2601] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:13:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:13:38.925573 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4372e-ed94-4a9d-b5cf-d0e77a789064 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:39.009606 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4372e-ed94-4a9d-b5cf-d0e77a789064 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:39.014662 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed257b66-d406-4bc1-964b-a57641ca4e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:39.015508 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed257b66-d406-4bc1-964b-a57641ca4e4f admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:39.016188 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed257b66-d406-4bc1-964b-a57641ca4e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:39.016307 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed257b66-d406-4bc1-964b-a57641ca4e4f admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:39.016921 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed257b66-d406-4bc1-964b-a57641ca4e4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:39.019095 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed257b66-d406-4bc1-964b-a57641ca4e4f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:39.152679 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1309/2602] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:13:38 2022] POST /identity/v3/projects => generated 401 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:13:39.155002 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532e9e5-237d-450f-9c70-46efb7b01dc2 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:39.168676 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532e9e5-237d-450f-9c70-46efb7b01dc2 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:39.202043 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed257b66-d406-4bc1-964b-a57641ca4e4f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:39.207843 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ed257b66-d406-4bc1-964b-a57641ca4e4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:39.314208 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c00894-acad-43ff-acf5-fa0e47634224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:39.316265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c00894-acad-43ff-acf5-fa0e47634224 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:39.317598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c00894-acad-43ff-acf5-fa0e47634224 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:39.317923 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c00894-acad-43ff-acf5-fa0e47634224 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:39.318874 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c00894-acad-43ff-acf5-fa0e47634224 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:39.320829 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c00894-acad-43ff-acf5-fa0e47634224 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:39.346868 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed257b66-d406-4bc1-964b-a57641ca4e4f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:39.353972 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0eed0-6d89-4f43-b002-045acd8a8c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:39.355730 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0eed0-6d89-4f43-b002-045acd8a8c29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:39.356340 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0eed0-6d89-4f43-b002-045acd8a8c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:39.356722 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0eed0-6d89-4f43-b002-045acd8a8c29 admin admin] PATH_INFO: `/v3/users/74c331c48d20422492001f71f0672885` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:39.358247 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0eed0-6d89-4f43-b002-045acd8a8c29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74c331c48d20422492001f71f0672885)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:39.360337 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0eed0-6d89-4f43-b002-045acd8a8c29 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:39.502528 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1294/2603] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:13:39 2022] POST /identity/v3/users => generated 307 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:13:39.520266 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c00894-acad-43ff-acf5-fa0e47634224 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:39.532460 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c00894-acad-43ff-acf5-fa0e47634224 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:39.538299 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185b648-77e7-4230-bc7f-bbc914c26b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:39.539602 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185b648-77e7-4230-bc7f-bbc914c26b28 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:39.539982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185b648-77e7-4230-bc7f-bbc914c26b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:39.540255 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185b648-77e7-4230-bc7f-bbc914c26b28 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:39.540984 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f185b648-77e7-4230-bc7f-bbc914c26b28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:39.542666 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f185b648-77e7-4230-bc7f-bbc914c26b28 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:39.553370 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1295/2604] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:13:39.558469 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185b648-77e7-4230-bc7f-bbc914c26b28 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:39.572646 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185b648-77e7-4230-bc7f-bbc914c26b28 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:39.577645 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73387ba-9e98-467b-b836-8d4fa1ec48bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:39.578778 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73387ba-9e98-467b-b836-8d4fa1ec48bc admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:39.579061 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73387ba-9e98-467b-b836-8d4fa1ec48bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:39.579500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73387ba-9e98-467b-b836-8d4fa1ec48bc admin admin] PATH_INFO: `/v3/projects/bfe52cd401084f7abf4955477f238341/users/95a64100715b490794d4509b5316c3ed/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:39.600922 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73387ba-9e98-467b-b836-8d4fa1ec48bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfe52cd401084f7abf4955477f238341, user_id=95a64100715b490794d4509b5316c3ed, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:39.600922 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73387ba-9e98-467b-b836-8d4fa1ec48bc admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:39.663054 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-05f0eed0-6d89-4f43-b002-045acd8a8c29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74c331c48d20422492001f71f0672885'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:39.697656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-05f0eed0-6d89-4f43-b002-045acd8a8c29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74c331c48d20422492001f71f0672885'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:39.715432 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1296/2605] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:13:39 2022] PUT /identity/v3/projects/bfe52cd401084f7abf4955477f238341/users/95a64100715b490794d4509b5316c3ed/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:13:39.720520 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73387ba-9e98-467b-b836-8d4fa1ec48bc admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:39.793398 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-05f0eed0-6d89-4f43-b002-045acd8a8c29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74c331c48d20422492001f71f0672885'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:39.794369 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-05f0eed0-6d89-4f43-b002-045acd8a8c29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74c331c48d20422492001f71f0672885'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:39.802432 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-05f0eed0-6d89-4f43-b002-045acd8a8c29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74c331c48d20422492001f71f0672885'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:39.823932 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1310/2606] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:13:39 2022] DELETE /identity/v3/users/74c331c48d20422492001f71f0672885 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:13:39.832104 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfbf52a-968b-4b76-bc60-6d31044e06c8 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:39.832104 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfbf52a-968b-4b76-bc60-6d31044e06c8 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:39.832104 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfbf52a-968b-4b76-bc60-6d31044e06c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:39.875694 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-6cfbf52a-968b-4b76-bc60-6d31044e06c8 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:13:39.876872 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6cfbf52a-968b-4b76-bc60-6d31044e06c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:39.912594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73387ba-9e98-467b-b836-8d4fa1ec48bc admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:39.953318 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1311/2607] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:13:39.964344 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfbf52a-968b-4b76-bc60-6d31044e06c8 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:39.967288 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6cfbf52a-968b-4b76-bc60-6d31044e06c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:40.040604 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ad2d6-935e-4849-9c98-9a7f9e0a8f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:40.042211 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ad2d6-935e-4849-9c98-9a7f9e0a8f0b admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:40.044521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ad2d6-935e-4849-9c98-9a7f9e0a8f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:40.045019 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ad2d6-935e-4849-9c98-9a7f9e0a8f0b admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:40.046263 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ad2d6-935e-4849-9c98-9a7f9e0a8f0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:40.050320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ad2d6-935e-4849-9c98-9a7f9e0a8f0b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:40.088091 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1297/2608] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:13:40.090898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ad2d6-935e-4849-9c98-9a7f9e0a8f0b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:40.094939 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-835ad2d6-935e-4849-9c98-9a7f9e0a8f0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:40.107680 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfbf52a-968b-4b76-bc60-6d31044e06c8 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:40.115324 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e4306-1275-463a-be40-b01895bc5ab5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:40.116839 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e4306-1275-463a-be40-b01895bc5ab5 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:40.120092 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e4306-1275-463a-be40-b01895bc5ab5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:40.120579 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e4306-1275-463a-be40-b01895bc5ab5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:40.127353 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ad2d6-935e-4849-9c98-9a7f9e0a8f0b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:40.140111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1e4306-1275-463a-be40-b01895bc5ab5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:40.141059 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b42d6e-326d-4c38-bfaa-ece0da2d675f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:40.143424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1e4306-1275-463a-be40-b01895bc5ab5 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:40.144394 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b42d6e-326d-4c38-bfaa-ece0da2d675f admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:40.145061 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b42d6e-326d-4c38-bfaa-ece0da2d675f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:40.146544 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b42d6e-326d-4c38-bfaa-ece0da2d675f admin admin] PATH_INFO: `/v3/projects/bfe52cd401084f7abf4955477f238341/users/95a64100715b490794d4509b5316c3ed/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:40.152673 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b42d6e-326d-4c38-bfaa-ece0da2d675f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfe52cd401084f7abf4955477f238341, user_id=95a64100715b490794d4509b5316c3ed, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:40.163076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b42d6e-326d-4c38-bfaa-ece0da2d675f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:40.176409 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1312/2609] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:13:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:13:40.196772 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1298/2610] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:13:40 2022] PUT /identity/v3/projects/bfe52cd401084f7abf4955477f238341/users/95a64100715b490794d4509b5316c3ed/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:13:40.208982 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276b461-ff19-4e05-9d1a-a7d0464c4fd7 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:40.209275 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276b461-ff19-4e05-9d1a-a7d0464c4fd7 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:40.209558 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276b461-ff19-4e05-9d1a-a7d0464c4fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:40.264064 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-2276b461-ff19-4e05-9d1a-a7d0464c4fd7 None None] MFA Rules not processed for user `95a64100715b490794d4509b5316c3ed`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:13:40.265536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2276b461-ff19-4e05-9d1a-a7d0464c4fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:40.397207 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1313/2611] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:13:40 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:13:40.408889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b42d6e-326d-4c38-bfaa-ece0da2d675f admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:40.410912 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c9b42d6e-326d-4c38-bfaa-ece0da2d675f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:40.525433 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b42d6e-326d-4c38-bfaa-ece0da2d675f admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:40.541213 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec4309-ff4d-4dec-ab6e-2985c429f15b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:40.542160 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec4309-ff4d-4dec-ab6e-2985c429f15b service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:40.542551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec4309-ff4d-4dec-ab6e-2985c429f15b service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:40.543246 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec4309-ff4d-4dec-ab6e-2985c429f15b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:40.555871 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ec4309-ff4d-4dec-ab6e-2985c429f15b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:40.561291 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ec4309-ff4d-4dec-ab6e-2985c429f15b service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:40.598841 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1299/2612] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:13:40 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:13:40.688761 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276b461-ff19-4e05-9d1a-a7d0464c4fd7 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:40.690215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2276b461-ff19-4e05-9d1a-a7d0464c4fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:40.850432 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276b461-ff19-4e05-9d1a-a7d0464c4fd7 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:40.857892 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b4299-0c6e-42af-ac86-ea6a152ab0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:40.858946 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b4299-0c6e-42af-ac86-ea6a152ab0c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:40.859360 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b4299-0c6e-42af-ac86-ea6a152ab0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:40.859718 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b4299-0c6e-42af-ac86-ea6a152ab0c2 admin admin] PATH_INFO: `/v3/projects/9284e1c76f5a41ea9da1eb011943eb8a` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:40.861627 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b4299-0c6e-42af-ac86-ea6a152ab0c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9284e1c76f5a41ea9da1eb011943eb8a)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:40.864354 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b4299-0c6e-42af-ac86-ea6a152ab0c2 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:41.058772 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-798b4299-0c6e-42af-ac86-ea6a152ab0c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9284e1c76f5a41ea9da1eb011943eb8a', 'request_id': 'req-798b4299-0c6e-42af-ac86-ea6a152ab0c2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:41.072772 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-798b4299-0c6e-42af-ac86-ea6a152ab0c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9284e1c76f5a41ea9da1eb011943eb8a', 'request_id': 'req-798b4299-0c6e-42af-ac86-ea6a152ab0c2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:41.086389 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-798b4299-0c6e-42af-ac86-ea6a152ab0c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9284e1c76f5a41ea9da1eb011943eb8a', 'request_id': 'req-798b4299-0c6e-42af-ac86-ea6a152ab0c2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:41.213012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-798b4299-0c6e-42af-ac86-ea6a152ab0c2 admin admin] The token cache is being invalidate because project 9284e1c76f5a41ea9da1eb011943eb8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:13:41.214069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-798b4299-0c6e-42af-ac86-ea6a152ab0c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:41.214964 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-798b4299-0c6e-42af-ac86-ea6a152ab0c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:41.216592 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1314/2613] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:13:40 2022] DELETE /identity/v3/projects/9284e1c76f5a41ea9da1eb011943eb8a => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:13:41.221595 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e7723-14a8-4a6d-a398-e7bd4335db6c None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:41.226060 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e7723-14a8-4a6d-a398-e7bd4335db6c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:41.227126 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e7723-14a8-4a6d-a398-e7bd4335db6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:41.259865 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-bc7e7723-14a8-4a6d-a398-e7bd4335db6c None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:13:41.262079 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-bc7e7723-14a8-4a6d-a398-e7bd4335db6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:41.454463 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbababc-5d46-4622-a0d2-6b45f878c4e5 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:41.455222 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbababc-5d46-4622-a0d2-6b45f878c4e5 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:41.455682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbababc-5d46-4622-a0d2-6b45f878c4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:41.459060 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1300/2614] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:13:41.503686 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-bdbababc-5d46-4622-a0d2-6b45f878c4e5 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:13:41.505426 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-bdbababc-5d46-4622-a0d2-6b45f878c4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:41.532815 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1315/2615] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:13:41.535083 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e7723-14a8-4a6d-a398-e7bd4335db6c None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:41.547477 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e7723-14a8-4a6d-a398-e7bd4335db6c None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:41.557998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b1b4b-3b37-43c5-8710-ae04d9c727c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:41.558690 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b1b4b-3b37-43c5-8710-ae04d9c727c2 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:41.558970 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b1b4b-3b37-43c5-8710-ae04d9c727c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:41.559246 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b1b4b-3b37-43c5-8710-ae04d9c727c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:41.562632 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b1b4b-3b37-43c5-8710-ae04d9c727c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:13:41.564067 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b1b4b-3b37-43c5-8710-ae04d9c727c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:41.573650 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b1b4b-3b37-43c5-8710-ae04d9c727c2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:41.622887 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1301/2616] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:13:41.624306 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbababc-5d46-4622-a0d2-6b45f878c4e5 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:41.651222 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbababc-5d46-4622-a0d2-6b45f878c4e5 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:41.657784 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704507f2-e45c-4ebd-ad0c-d1851003f7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:41.659291 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704507f2-e45c-4ebd-ad0c-d1851003f7eb admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:41.659578 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704507f2-e45c-4ebd-ad0c-d1851003f7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:41.659854 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704507f2-e45c-4ebd-ad0c-d1851003f7eb admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:41.664407 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704507f2-e45c-4ebd-ad0c-d1851003f7eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:41.670322 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704507f2-e45c-4ebd-ad0c-d1851003f7eb admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:41.881885 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1316/2617] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:13:41 2022] POST /identity/v3/projects => generated 385 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:13:41.883427 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b1b4b-3b37-43c5-8710-ae04d9c727c2 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:41.895050 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b1b4b-3b37-43c5-8710-ae04d9c727c2 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:41.940190 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704507f2-e45c-4ebd-ad0c-d1851003f7eb admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:41.942660 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-704507f2-e45c-4ebd-ad0c-d1851003f7eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:42.011413 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2c8fb-4a72-4af9-a855-ee9b4ea46b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:42.012487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2c8fb-4a72-4af9-a855-ee9b4ea46b16 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:42.015023 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2c8fb-4a72-4af9-a855-ee9b4ea46b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:42.015750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2c8fb-4a72-4af9-a855-ee9b4ea46b16 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:42.016500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe2c8fb-4a72-4af9-a855-ee9b4ea46b16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:42.018815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe2c8fb-4a72-4af9-a855-ee9b4ea46b16 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:42.131960 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1302/2618] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:13:41 2022] POST /identity/v3/users => generated 293 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:13:42.136223 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2c8fb-4a72-4af9-a855-ee9b4ea46b16 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:42.137905 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704507f2-e45c-4ebd-ad0c-d1851003f7eb admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:42.153855 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2c8fb-4a72-4af9-a855-ee9b4ea46b16 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:42.156998 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d14105-cdd5-4a25-9367-7b8e5a30463a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:42.157991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d14105-cdd5-4a25-9367-7b8e5a30463a service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:42.158976 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d14105-cdd5-4a25-9367-7b8e5a30463a service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:42.158976 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d14105-cdd5-4a25-9367-7b8e5a30463a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:42.165339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-87d14105-cdd5-4a25-9367-7b8e5a30463a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:42.170329 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd98a96-c5f2-49ea-ad4b-39cef7859c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:42.173523 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd98a96-c5f2-49ea-ad4b-39cef7859c39 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:42.173898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd98a96-c5f2-49ea-ad4b-39cef7859c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:42.175020 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd98a96-c5f2-49ea-ad4b-39cef7859c39 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:42.176663 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd98a96-c5f2-49ea-ad4b-39cef7859c39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:42.183076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd98a96-c5f2-49ea-ad4b-39cef7859c39 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:42.201813 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1303/2619] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:13:42.204581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd98a96-c5f2-49ea-ad4b-39cef7859c39 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:42.227629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd98a96-c5f2-49ea-ad4b-39cef7859c39 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:42.239072 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e91b96d-7ba2-48f0-b8c8-8a941e35cb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:42.242853 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91b96d-7ba2-48f0-b8c8-8a941e35cb3c admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:42.243148 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91b96d-7ba2-48f0-b8c8-8a941e35cb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:42.243434 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91b96d-7ba2-48f0-b8c8-8a941e35cb3c admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:42.244260 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e91b96d-7ba2-48f0-b8c8-8a941e35cb3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:42.245817 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e91b96d-7ba2-48f0-b8c8-8a941e35cb3c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:42.281706 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d14105-cdd5-4a25-9367-7b8e5a30463a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:42.283566 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d14105-cdd5-4a25-9367-7b8e5a30463a service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:42.288688 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1304/2620] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:13:42.294405 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e91b96d-7ba2-48f0-b8c8-8a941e35cb3c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:42.316563 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e91b96d-7ba2-48f0-b8c8-8a941e35cb3c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:42.321590 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1317/2621] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:13:41 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:13:42.339593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfb8a5-ff61-4fa6-89e8-f49f3cb53db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:42.342069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d14105-cdd5-4a25-9367-7b8e5a30463a service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:42.343720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-87d14105-cdd5-4a25-9367-7b8e5a30463a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:42.345742 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfb8a5-ff61-4fa6-89e8-f49f3cb53db0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:42.346152 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfb8a5-ff61-4fa6-89e8-f49f3cb53db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:42.347163 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfb8a5-ff61-4fa6-89e8-f49f3cb53db0 admin admin] PATH_INFO: `/v3/projects/a33635f00a9e48818fe1081019a2ceb5/users/eb2cc38da7684af39aed81a0e05d60a7/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:42.397516 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d14105-cdd5-4a25-9367-7b8e5a30463a service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:42.411898 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6f1bf-5466-4cec-8ffa-17291c387eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:42.413301 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6f1bf-5466-4cec-8ffa-17291c387eaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:42.413791 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6f1bf-5466-4cec-8ffa-17291c387eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:42.414257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6f1bf-5466-4cec-8ffa-17291c387eaa admin admin] PATH_INFO: `/v3/users/b4da9575aafc490b908379ddcbcde906` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:42.416256 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e6f1bf-5466-4cec-8ffa-17291c387eaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4da9575aafc490b908379ddcbcde906)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:42.419260 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e6f1bf-5466-4cec-8ffa-17291c387eaa admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:42.423441 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccfb8a5-ff61-4fa6-89e8-f49f3cb53db0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a33635f00a9e48818fe1081019a2ceb5, user_id=eb2cc38da7684af39aed81a0e05d60a7, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:42.430734 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccfb8a5-ff61-4fa6-89e8-f49f3cb53db0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:42.506834 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1305/2622] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:13:42 2022] PUT /identity/v3/projects/a33635f00a9e48818fe1081019a2ceb5/users/eb2cc38da7684af39aed81a0e05d60a7/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:13:42.518561 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644399c-312f-47d2-9746-fa280ac43ec7 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:42.519207 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644399c-312f-47d2-9746-fa280ac43ec7 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:42.519653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644399c-312f-47d2-9746-fa280ac43ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:42.559347 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-a644399c-312f-47d2-9746-fa280ac43ec7 None None] MFA Rules not processed for user `eb2cc38da7684af39aed81a0e05d60a7`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:13:42.561245 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a644399c-312f-47d2-9746-fa280ac43ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:42.687746 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1306/2623] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:13:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:13:42.696318 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a4e6f1bf-5466-4cec-8ffa-17291c387eaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4da9575aafc490b908379ddcbcde906'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:42.700276 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a644399c-312f-47d2-9746-fa280ac43ec7 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:42.702147 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a644399c-312f-47d2-9746-fa280ac43ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:42.726869 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a4e6f1bf-5466-4cec-8ffa-17291c387eaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4da9575aafc490b908379ddcbcde906'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:42.836578 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a644399c-312f-47d2-9746-fa280ac43ec7 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:42.840936 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090702e5-97cb-421d-bd86-534d41f69549 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e302b1298dd04d6590e3d079f7b13b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:42.841893 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090702e5-97cb-421d-bd86-534d41f69549 service glance] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:42.842497 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090702e5-97cb-421d-bd86-534d41f69549 service glance] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:42.842976 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090702e5-97cb-421d-bd86-534d41f69549 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:42.850844 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a4e6f1bf-5466-4cec-8ffa-17291c387eaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4da9575aafc490b908379ddcbcde906'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:42.851858 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a4e6f1bf-5466-4cec-8ffa-17291c387eaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4da9575aafc490b908379ddcbcde906'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:42.854090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090702e5-97cb-421d-bd86-534d41f69549 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:42.855885 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090702e5-97cb-421d-bd86-534d41f69549 service glance] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:42.862851 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a4e6f1bf-5466-4cec-8ffa-17291c387eaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4da9575aafc490b908379ddcbcde906'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:42.867431 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1307/2624] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:13:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:13:42.883139 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1318/2625] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:13:42 2022] DELETE /identity/v3/users/b4da9575aafc490b908379ddcbcde906 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:13:42.885080 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07158de3-9704-41a9-92db-b7991d931b9b None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:42.885535 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07158de3-9704-41a9-92db-b7991d931b9b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:42.886007 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07158de3-9704-41a9-92db-b7991d931b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:42.911463 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-07158de3-9704-41a9-92db-b7991d931b9b None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:13:42.913501 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-07158de3-9704-41a9-92db-b7991d931b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:43.022141 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1308/2626] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:13:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:13:43.119092 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6f1bf-5466-4cec-8ffa-17291c387eaa admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:43.120989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a4e6f1bf-5466-4cec-8ffa-17291c387eaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:43.183366 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03a7d2-54e3-42e4-bbb2-6dd2309450dd None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:43.184565 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03a7d2-54e3-42e4-bbb2-6dd2309450dd None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:43.184955 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03a7d2-54e3-42e4-bbb2-6dd2309450dd None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:43.186921 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1309/2627] 10.222.0.23 () {54 vars in 921 bytes} [Sat Apr 30 21:13:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:13:43.192433 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32d399-6dfe-4a28-bb13-b2677d5f6cf1 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:43.192862 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32d399-6dfe-4a28-bb13-b2677d5f6cf1 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:43.193242 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32d399-6dfe-4a28-bb13-b2677d5f6cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:43.255349 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-7a32d399-6dfe-4a28-bb13-b2677d5f6cf1 None None] MFA Rules not processed for user `4ad3f89b7037413a83c7905cef263b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:13:43.259163 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7a32d399-6dfe-4a28-bb13-b2677d5f6cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:43.284262 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6f1bf-5466-4cec-8ffa-17291c387eaa admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:43.291225 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d540d1-f419-46d5-b550-9833c81bc933 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:43.293031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d540d1-f419-46d5-b550-9833c81bc933 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:43.293690 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d540d1-f419-46d5-b550-9833c81bc933 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:43.294243 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d540d1-f419-46d5-b550-9833c81bc933 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:43.327163 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d540d1-f419-46d5-b550-9833c81bc933 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:43.327163 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d540d1-f419-46d5-b550-9833c81bc933 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:43.340714 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1319/2628] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:13:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:13:43.408531 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1310/2629] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Apr 30 21:13:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:13:43.431644 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d540d1-f419-46d5-b550-9833c81bc933 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:43.433622 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-50d540d1-f419-46d5-b550-9833c81bc933 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:43.454293 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d540d1-f419-46d5-b550-9833c81bc933 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:43.467729 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19146c6c-3694-455f-b171-1cfffa66b018 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:43.468866 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19146c6c-3694-455f-b171-1cfffa66b018 service placement] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:43.469623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19146c6c-3694-455f-b171-1cfffa66b018 service placement] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:43.470086 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19146c6c-3694-455f-b171-1cfffa66b018 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:43.482520 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19146c6c-3694-455f-b171-1cfffa66b018 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:43.484430 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19146c6c-3694-455f-b171-1cfffa66b018 service placement] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:43.510482 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1320/2630] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:13:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:13:44.183458 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a133f-0ca0-4d98-9680-8fcda4b91be3 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:44.184095 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a133f-0ca0-4d98-9680-8fcda4b91be3 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:44.184095 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a133f-0ca0-4d98-9680-8fcda4b91be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:44.227095 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-176a133f-0ca0-4d98-9680-8fcda4b91be3 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:13:44.235012 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-176a133f-0ca0-4d98-9680-8fcda4b91be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:44.270324 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab635127-7c2d-4335-b2f0-b4e0d1d64e4e None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:44.283031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab635127-7c2d-4335-b2f0-b4e0d1d64e4e None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:44.283649 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab635127-7c2d-4335-b2f0-b4e0d1d64e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:44.364591 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-ab635127-7c2d-4335-b2f0-b4e0d1d64e4e None None] MFA Rules not processed for user `c3a0b7af3d2947189fb1deb6065d3a77`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:13:44.365887 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ab635127-7c2d-4335-b2f0-b4e0d1d64e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:44.458707 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1311/2631] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:13:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:13:44.461558 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a133f-0ca0-4d98-9680-8fcda4b91be3 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:44.464378 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-176a133f-0ca0-4d98-9680-8fcda4b91be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:44.515892 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a133f-0ca0-4d98-9680-8fcda4b91be3 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:44.530522 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fba288-d2e5-4d7d-993e-4f797a658537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:44.531842 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fba288-d2e5-4d7d-993e-4f797a658537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:44.532131 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fba288-d2e5-4d7d-993e-4f797a658537 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:44.536847 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fba288-d2e5-4d7d-993e-4f797a658537 admin admin] PATH_INFO: `/v3/projects/b494a426f9d74c94b7c7e5e630bc5da1` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:44.554166 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fba288-d2e5-4d7d-993e-4f797a658537 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b494a426f9d74c94b7c7e5e630bc5da1)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:44.564218 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fba288-d2e5-4d7d-993e-4f797a658537 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:44.610282 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1321/2632] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:13:44 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:13:44.619250 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab635127-7c2d-4335-b2f0-b4e0d1d64e4e None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:44.624383 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ab635127-7c2d-4335-b2f0-b4e0d1d64e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:44.765285 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-24fba288-d2e5-4d7d-993e-4f797a658537 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b494a426f9d74c94b7c7e5e630bc5da1', 'request_id': 'req-24fba288-d2e5-4d7d-993e-4f797a658537'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:44.773991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab635127-7c2d-4335-b2f0-b4e0d1d64e4e None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:44.777286 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-24fba288-d2e5-4d7d-993e-4f797a658537 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b494a426f9d74c94b7c7e5e630bc5da1', 'request_id': 'req-24fba288-d2e5-4d7d-993e-4f797a658537'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:44.793287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-24fba288-d2e5-4d7d-993e-4f797a658537 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b494a426f9d74c94b7c7e5e630bc5da1', 'request_id': 'req-24fba288-d2e5-4d7d-993e-4f797a658537'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:44.865203 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362caa3b-22ac-4b96-9c8e-4701eed08d1d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:44.865943 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362caa3b-22ac-4b96-9c8e-4701eed08d1d service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:44.866232 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362caa3b-22ac-4b96-9c8e-4701eed08d1d service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:44.866515 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362caa3b-22ac-4b96-9c8e-4701eed08d1d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:44.914586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-24fba288-d2e5-4d7d-993e-4f797a658537 admin admin] The token cache is being invalidate because project b494a426f9d74c94b7c7e5e630bc5da1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:13:44.920846 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-24fba288-d2e5-4d7d-993e-4f797a658537 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:44.920846 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-24fba288-d2e5-4d7d-993e-4f797a658537 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:44.920846 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1312/2633] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:13:44 2022] DELETE /identity/v3/projects/b494a426f9d74c94b7c7e5e630bc5da1 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:13:44.922799 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fba288-d2e5-4d7d-993e-4f797a658537 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:44.927781 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-24fba288-d2e5-4d7d-993e-4f797a658537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:45.083466 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fba288-d2e5-4d7d-993e-4f797a658537 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:45.090218 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ddae7-277f-4fc4-974d-f6ce31584359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:45.091329 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ddae7-277f-4fc4-974d-f6ce31584359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:45.091709 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ddae7-277f-4fc4-974d-f6ce31584359 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:45.092080 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ddae7-277f-4fc4-974d-f6ce31584359 admin admin] PATH_INFO: `/v3/users/95a64100715b490794d4509b5316c3ed` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:45.093788 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ddae7-277f-4fc4-974d-f6ce31584359 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95a64100715b490794d4509b5316c3ed)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:45.096018 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ddae7-277f-4fc4-974d-f6ce31584359 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:45.108602 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362caa3b-22ac-4b96-9c8e-4701eed08d1d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:45.114790 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362caa3b-22ac-4b96-9c8e-4701eed08d1d service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:45.135757 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1322/2634] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:13:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:13:45.138057 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362caa3b-22ac-4b96-9c8e-4701eed08d1d service swift] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:45.139512 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-362caa3b-22ac-4b96-9c8e-4701eed08d1d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:45.299739 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362caa3b-22ac-4b96-9c8e-4701eed08d1d service swift] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:45.307754 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab065331-29c5-4c36-bd49-bcd3c583ca13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:45.308830 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab065331-29c5-4c36-bd49-bcd3c583ca13 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:45.309376 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab065331-29c5-4c36-bd49-bcd3c583ca13 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:45.310751 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab065331-29c5-4c36-bd49-bcd3c583ca13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:45.313374 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ab065331-29c5-4c36-bd49-bcd3c583ca13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:45.316767 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-187ddae7-277f-4fc4-974d-f6ce31584359 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95a64100715b490794d4509b5316c3ed'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:45.334189 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-187ddae7-277f-4fc4-974d-f6ce31584359 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95a64100715b490794d4509b5316c3ed'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:45.423353 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab065331-29c5-4c36-bd49-bcd3c583ca13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:45.424988 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab065331-29c5-4c36-bd49-bcd3c583ca13 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:45.433653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-187ddae7-277f-4fc4-974d-f6ce31584359 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95a64100715b490794d4509b5316c3ed'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:45.435641 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1323/2635] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:13:45 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:13:45.455525 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-187ddae7-277f-4fc4-974d-f6ce31584359 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95a64100715b490794d4509b5316c3ed'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:45.456878 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-187ddae7-277f-4fc4-974d-f6ce31584359 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95a64100715b490794d4509b5316c3ed'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:45.468541 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1313/2636] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:13:44 2022] DELETE /identity/v3/users/95a64100715b490794d4509b5316c3ed => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:13:46.875050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab065331-29c5-4c36-bd49-bcd3c583ca13 service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:46.878011 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f152aa-5be2-4557-87cd-aa0b65a70c39 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:46.878838 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f152aa-5be2-4557-87cd-aa0b65a70c39 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:46.879124 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f152aa-5be2-4557-87cd-aa0b65a70c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:46.920393 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab065331-29c5-4c36-bd49-bcd3c583ca13 service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:46.950359 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-a1f152aa-5be2-4557-87cd-aa0b65a70c39 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:13:46.957642 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a1f152aa-5be2-4557-87cd-aa0b65a70c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:47.180455 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1314/2637] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:13:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:13:47.195367 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f152aa-5be2-4557-87cd-aa0b65a70c39 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:47.196822 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a1f152aa-5be2-4557-87cd-aa0b65a70c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:47.197186 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbdb2f7-7fc1-463f-be54-03086e0d7d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:47.198294 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbdb2f7-7fc1-463f-be54-03086e0d7d7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:47.199267 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbdb2f7-7fc1-463f-be54-03086e0d7d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:47.199730 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbdb2f7-7fc1-463f-be54-03086e0d7d7e admin admin] PATH_INFO: `/v3/projects/bfe52cd401084f7abf4955477f238341` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:47.206204 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbdb2f7-7fc1-463f-be54-03086e0d7d7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfe52cd401084f7abf4955477f238341)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:47.208360 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbdb2f7-7fc1-463f-be54-03086e0d7d7e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:47.370140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-cbbdb2f7-7fc1-463f-be54-03086e0d7d7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfe52cd401084f7abf4955477f238341', 'request_id': 'req-cbbdb2f7-7fc1-463f-be54-03086e0d7d7e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:47.384507 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-cbbdb2f7-7fc1-463f-be54-03086e0d7d7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfe52cd401084f7abf4955477f238341', 'request_id': 'req-cbbdb2f7-7fc1-463f-be54-03086e0d7d7e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:47.402926 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-cbbdb2f7-7fc1-463f-be54-03086e0d7d7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfe52cd401084f7abf4955477f238341', 'request_id': 'req-cbbdb2f7-7fc1-463f-be54-03086e0d7d7e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:47.412723 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f152aa-5be2-4557-87cd-aa0b65a70c39 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:47.497594 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-cbbdb2f7-7fc1-463f-be54-03086e0d7d7e admin admin] The token cache is being invalidate because project bfe52cd401084f7abf4955477f238341 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:13:47.504651 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-cbbdb2f7-7fc1-463f-be54-03086e0d7d7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:47.504651 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-cbbdb2f7-7fc1-463f-be54-03086e0d7d7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:47.505512 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1324/2638] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:13:46 2022] DELETE /identity/v3/projects/bfe52cd401084f7abf4955477f238341 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:13:47.511241 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd237fb-b190-49ba-b054-387e6b0f8a9f None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:47.511537 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd237fb-b190-49ba-b054-387e6b0f8a9f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:47.511818 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd237fb-b190-49ba-b054-387e6b0f8a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:47.561769 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-9fd237fb-b190-49ba-b054-387e6b0f8a9f None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:13:47.566175 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-9fd237fb-b190-49ba-b054-387e6b0f8a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:47.611168 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78116bd-1906-40e9-82a5-a3721969b252 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:47.612180 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78116bd-1906-40e9-82a5-a3721969b252 service swift] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:47.612632 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78116bd-1906-40e9-82a5-a3721969b252 service swift] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:47.613075 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78116bd-1906-40e9-82a5-a3721969b252 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:47.619554 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f78116bd-1906-40e9-82a5-a3721969b252 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:47.710554 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1325/2639] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:13:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:13:47.712089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c603350-a09a-431b-83df-3fd2f5e3d5d0 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:47.712436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c603350-a09a-431b-83df-3fd2f5e3d5d0 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:47.712661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c603350-a09a-431b-83df-3fd2f5e3d5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:47.734387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-2c603350-a09a-431b-83df-3fd2f5e3d5d0 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:13:47.740963 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2c603350-a09a-431b-83df-3fd2f5e3d5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:47.741137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78116bd-1906-40e9-82a5-a3721969b252 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:47.743045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78116bd-1906-40e9-82a5-a3721969b252 service swift] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:47.750997 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1326/2640] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:13:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:13:47.756215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c603350-a09a-431b-83df-3fd2f5e3d5d0 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:47.776721 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1315/2641] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:13:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 30 21:13:47.777077 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c603350-a09a-431b-83df-3fd2f5e3d5d0 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:47.783083 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0613532-e3ac-401d-a9fa-dd46c2609466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:47.784765 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0613532-e3ac-401d-a9fa-dd46c2609466 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:47.785132 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0613532-e3ac-401d-a9fa-dd46c2609466 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:47.785617 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0613532-e3ac-401d-a9fa-dd46c2609466 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:47.786565 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0613532-e3ac-401d-a9fa-dd46c2609466 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:13:47.787110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0613532-e3ac-401d-a9fa-dd46c2609466 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:47.790846 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0613532-e3ac-401d-a9fa-dd46c2609466 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:47.811692 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1327/2642] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:13:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:13:47.815479 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78116bd-1906-40e9-82a5-a3721969b252 service swift] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:47.826942 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78116bd-1906-40e9-82a5-a3721969b252 service swift] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:47.841745 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f458927-deb2-4f02-9d2e-d240cb14ee82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:47.842784 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f458927-deb2-4f02-9d2e-d240cb14ee82 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:47.843255 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f458927-deb2-4f02-9d2e-d240cb14ee82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:47.848062 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f458927-deb2-4f02-9d2e-d240cb14ee82 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:47.848833 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f458927-deb2-4f02-9d2e-d240cb14ee82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:47.854815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f458927-deb2-4f02-9d2e-d240cb14ee82 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:47.985055 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1316/2643] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:13:47 2022] POST /identity/v3/projects => generated 377 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:13:47.986552 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0613532-e3ac-401d-a9fa-dd46c2609466 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:48.006716 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0613532-e3ac-401d-a9fa-dd46c2609466 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:48.172556 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e8bf6-a1f4-42bd-96fa-bbaf9802a32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:48.172556 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e8bf6-a1f4-42bd-96fa-bbaf9802a32e admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:48.172556 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e8bf6-a1f4-42bd-96fa-bbaf9802a32e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:48.172891 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e8bf6-a1f4-42bd-96fa-bbaf9802a32e admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:48.176786 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e8bf6-a1f4-42bd-96fa-bbaf9802a32e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:48.181941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e8bf6-a1f4-42bd-96fa-bbaf9802a32e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:48.305074 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1328/2644] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:13:47 2022] POST /identity/v3/users => generated 289 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:13:48.307802 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f458927-deb2-4f02-9d2e-d240cb14ee82 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:48.321787 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f458927-deb2-4f02-9d2e-d240cb14ee82 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:48.339661 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c444a-f063-4a3e-86fa-4996db09ed5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:48.340529 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c444a-f063-4a3e-86fa-4996db09ed5e admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:48.341105 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c444a-f063-4a3e-86fa-4996db09ed5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:48.341429 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c444a-f063-4a3e-86fa-4996db09ed5e admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:48.342251 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c444a-f063-4a3e-86fa-4996db09ed5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:48.348869 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c444a-f063-4a3e-86fa-4996db09ed5e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:48.361885 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1317/2645] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:13:48.366461 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e8bf6-a1f4-42bd-96fa-bbaf9802a32e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:48.390904 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e8bf6-a1f4-42bd-96fa-bbaf9802a32e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:48.408653 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12cf957-4573-4ed2-9b52-fe34c03c8a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:48.411045 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12cf957-4573-4ed2-9b52-fe34c03c8a36 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:48.412023 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12cf957-4573-4ed2-9b52-fe34c03c8a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:48.413003 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12cf957-4573-4ed2-9b52-fe34c03c8a36 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:48.413906 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12cf957-4573-4ed2-9b52-fe34c03c8a36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:48.417326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12cf957-4573-4ed2-9b52-fe34c03c8a36 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:48.443991 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1329/2646] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:13:48.450507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c444a-f063-4a3e-86fa-4996db09ed5e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:48.470332 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c444a-f063-4a3e-86fa-4996db09ed5e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:48.498550 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c48b8f-39da-4d51-a680-8dae4977ed32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:48.499740 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c48b8f-39da-4d51-a680-8dae4977ed32 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:48.502142 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c48b8f-39da-4d51-a680-8dae4977ed32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:48.502638 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c48b8f-39da-4d51-a680-8dae4977ed32 admin admin] PATH_INFO: `/v3/projects/4be651a660d6452e9c0bfeece7227370/users/3914f1552b63492b820beb7096278c39/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:48.574779 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c48b8f-39da-4d51-a680-8dae4977ed32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4be651a660d6452e9c0bfeece7227370, user_id=3914f1552b63492b820beb7096278c39, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:48.582694 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c48b8f-39da-4d51-a680-8dae4977ed32 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:48.697862 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d9478-0dab-4092-a191-239e99b664dd None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:48.698529 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d9478-0dab-4092-a191-239e99b664dd None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:48.699035 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d9478-0dab-4092-a191-239e99b664dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:48.702302 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1318/2647] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:13:48 2022] PUT /identity/v3/projects/4be651a660d6452e9c0bfeece7227370/users/3914f1552b63492b820beb7096278c39/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:13:48.762706 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-ce4d9478-0dab-4092-a191-239e99b664dd None None] MFA Rules not processed for user `3914f1552b63492b820beb7096278c39`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:13:48.764740 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ce4d9478-0dab-4092-a191-239e99b664dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:48.996936 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1330/2648] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:13:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:13:48.998681 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c48b8f-39da-4d51-a680-8dae4977ed32 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:49.165800 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c48b8f-39da-4d51-a680-8dae4977ed32 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:49.171576 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909c535-de52-4aba-9208-72ac5c804f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:49.172272 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909c535-de52-4aba-9208-72ac5c804f5d admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:49.172950 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909c535-de52-4aba-9208-72ac5c804f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:49.173440 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909c535-de52-4aba-9208-72ac5c804f5d admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:49.174195 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d909c535-de52-4aba-9208-72ac5c804f5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:49.176525 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d909c535-de52-4aba-9208-72ac5c804f5d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:49.544277 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1319/2649] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:13:48 2022] POST /identity/v3/projects => generated 375 bytes in 546 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:13:49.548167 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d9478-0dab-4092-a191-239e99b664dd None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:49.569470 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d9478-0dab-4092-a191-239e99b664dd None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:49.669634 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c0082-403f-4e8c-b899-ab8f9c7415e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:49.670389 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c0082-403f-4e8c-b899-ab8f9c7415e9 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:49.670673 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c0082-403f-4e8c-b899-ab8f9c7415e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:49.670959 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c0082-403f-4e8c-b899-ab8f9c7415e9 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:49.671781 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c0082-403f-4e8c-b899-ab8f9c7415e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:49.674566 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c0082-403f-4e8c-b899-ab8f9c7415e9 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:49.778407 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1331/2650] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:13:49 2022] POST /identity/v3/users => generated 294 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:13:49.782930 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909c535-de52-4aba-9208-72ac5c804f5d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:49.795139 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909c535-de52-4aba-9208-72ac5c804f5d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:49.801739 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987fef4e-4641-4a78-8636-f612ac449c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:49.803061 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987fef4e-4641-4a78-8636-f612ac449c2d admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:49.803358 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987fef4e-4641-4a78-8636-f612ac449c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:49.803728 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987fef4e-4641-4a78-8636-f612ac449c2d admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:49.805460 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987fef4e-4641-4a78-8636-f612ac449c2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:49.808073 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987fef4e-4641-4a78-8636-f612ac449c2d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:49.845158 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1320/2651] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:13:49.846407 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c0082-403f-4e8c-b899-ab8f9c7415e9 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:49.862337 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c0082-403f-4e8c-b899-ab8f9c7415e9 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:49.891057 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc7ae90-e829-4bab-b7b9-0e1acc70edd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:49.891978 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7ae90-e829-4bab-b7b9-0e1acc70edd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:49.892264 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7ae90-e829-4bab-b7b9-0e1acc70edd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:49.892540 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7ae90-e829-4bab-b7b9-0e1acc70edd2 admin admin] PATH_INFO: `/v3/projects/4cc97b777b2d4b258227d93fe9c11cfa/users/3e53037089134165a05e36696c2cdfb8/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:49.926397 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc7ae90-e829-4bab-b7b9-0e1acc70edd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cc97b777b2d4b258227d93fe9c11cfa, user_id=3e53037089134165a05e36696c2cdfb8, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:49.936951 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc7ae90-e829-4bab-b7b9-0e1acc70edd2 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:50.058292 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1332/2652] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:13:49 2022] PUT /identity/v3/projects/4cc97b777b2d4b258227d93fe9c11cfa/users/3e53037089134165a05e36696c2cdfb8/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:13:50.062323 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987fef4e-4641-4a78-8636-f612ac449c2d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:50.104256 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987fef4e-4641-4a78-8636-f612ac449c2d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:50.251067 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce0df67-d49f-4a6a-ac1a-02792efa391c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:50.252632 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0df67-d49f-4a6a-ac1a-02792efa391c admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:50.253135 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0df67-d49f-4a6a-ac1a-02792efa391c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:50.253414 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0df67-d49f-4a6a-ac1a-02792efa391c admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:50.263374 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce0df67-d49f-4a6a-ac1a-02792efa391c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:50.266011 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce0df67-d49f-4a6a-ac1a-02792efa391c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:50.287321 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1321/2653] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:13:50.290141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc7ae90-e829-4bab-b7b9-0e1acc70edd2 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:50.304793 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc7ae90-e829-4bab-b7b9-0e1acc70edd2 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:50.310693 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a1db2-d55f-4122-a1f6-082e6665e6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:50.311864 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a1db2-d55f-4122-a1f6-082e6665e6bf admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:50.312311 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a1db2-d55f-4122-a1f6-082e6665e6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:50.313196 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a1db2-d55f-4122-a1f6-082e6665e6bf admin admin] PATH_INFO: `/v3/projects/4cc97b777b2d4b258227d93fe9c11cfa/users/3e53037089134165a05e36696c2cdfb8/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:50.315857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565a1db2-d55f-4122-a1f6-082e6665e6bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cc97b777b2d4b258227d93fe9c11cfa, user_id=3e53037089134165a05e36696c2cdfb8, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:50.319345 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565a1db2-d55f-4122-a1f6-082e6665e6bf admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:50.332812 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1333/2654] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:13:50 2022] PUT /identity/v3/projects/4cc97b777b2d4b258227d93fe9c11cfa/users/3e53037089134165a05e36696c2cdfb8/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:13:50.343790 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51803804-23de-44c9-a18f-7ea9aced051f None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:50.344091 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51803804-23de-44c9-a18f-7ea9aced051f None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:50.344374 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51803804-23de-44c9-a18f-7ea9aced051f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:50.414266 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-51803804-23de-44c9-a18f-7ea9aced051f None None] MFA Rules not processed for user `3e53037089134165a05e36696c2cdfb8`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:13:50.416091 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-51803804-23de-44c9-a18f-7ea9aced051f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:50.614091 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1322/2655] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:13:50 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:13:50.630006 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078aa81e-6df4-4763-853d-d7040b9eff24 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:50.630522 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078aa81e-6df4-4763-853d-d7040b9eff24 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:50.630964 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078aa81e-6df4-4763-853d-d7040b9eff24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:50.660340 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-078aa81e-6df4-4763-853d-d7040b9eff24 None None] MFA Rules not processed for user `3914f1552b63492b820beb7096278c39`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:13:50.663339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-078aa81e-6df4-4763-853d-d7040b9eff24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:50.822777 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1334/2656] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:13:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:13:51.151211 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51803804-23de-44c9-a18f-7ea9aced051f None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:51.155303 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-51803804-23de-44c9-a18f-7ea9aced051f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:51.337148 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51803804-23de-44c9-a18f-7ea9aced051f None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:51.359108 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7eef1-fbfc-47ff-9a57-6e02f16467ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:51.359108 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7eef1-fbfc-47ff-9a57-6e02f16467ca service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:51.359108 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7eef1-fbfc-47ff-9a57-6e02f16467ca service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:51.359108 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7eef1-fbfc-47ff-9a57-6e02f16467ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:51.375600 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd7eef1-fbfc-47ff-9a57-6e02f16467ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:51.383508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd7eef1-fbfc-47ff-9a57-6e02f16467ca service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:51.408238 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1323/2657] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:13:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:13:53.219881 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078aa81e-6df4-4763-853d-d7040b9eff24 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:53.222995 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-078aa81e-6df4-4763-853d-d7040b9eff24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:53.334981 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078aa81e-6df4-4763-853d-d7040b9eff24 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:53.342696 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd079a-e809-47dc-923e-dfff2e243344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:53.344021 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd079a-e809-47dc-923e-dfff2e243344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:53.344735 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd079a-e809-47dc-923e-dfff2e243344 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:53.345057 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd079a-e809-47dc-923e-dfff2e243344 admin admin] PATH_INFO: `/v3/users/c3a0b7af3d2947189fb1deb6065d3a77` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:53.347143 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd079a-e809-47dc-923e-dfff2e243344 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3a0b7af3d2947189fb1deb6065d3a77)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:53.349912 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd079a-e809-47dc-923e-dfff2e243344 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:53.673189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0ecd079a-e809-47dc-923e-dfff2e243344 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3a0b7af3d2947189fb1deb6065d3a77'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:53.691682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0ecd079a-e809-47dc-923e-dfff2e243344 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3a0b7af3d2947189fb1deb6065d3a77'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:53.779172 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0ecd079a-e809-47dc-923e-dfff2e243344 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3a0b7af3d2947189fb1deb6065d3a77'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:53.780313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0ecd079a-e809-47dc-923e-dfff2e243344 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3a0b7af3d2947189fb1deb6065d3a77'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:53.806053 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0ecd079a-e809-47dc-923e-dfff2e243344 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3a0b7af3d2947189fb1deb6065d3a77'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:53.829031 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1335/2658] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:13:53 2022] DELETE /identity/v3/users/c3a0b7af3d2947189fb1deb6065d3a77 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:13:54.242863 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7eef1-fbfc-47ff-9a57-6e02f16467ca service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:54.256093 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7eef1-fbfc-47ff-9a57-6e02f16467ca service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:54.380379 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b38da-5270-4257-b821-764c8a6b368e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:54.381417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b38da-5270-4257-b821-764c8a6b368e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:54.381965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b38da-5270-4257-b821-764c8a6b368e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:54.382491 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b38da-5270-4257-b821-764c8a6b368e admin admin] PATH_INFO: `/v3/projects/a1c2ee9a249541aa99783095b6154dde` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:54.384197 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b38da-5270-4257-b821-764c8a6b368e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1c2ee9a249541aa99783095b6154dde)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:54.386442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b38da-5270-4257-b821-764c8a6b368e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:54.513946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-af1b38da-5270-4257-b821-764c8a6b368e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1c2ee9a249541aa99783095b6154dde', 'request_id': 'req-af1b38da-5270-4257-b821-764c8a6b368e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:54.521588 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-af1b38da-5270-4257-b821-764c8a6b368e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1c2ee9a249541aa99783095b6154dde', 'request_id': 'req-af1b38da-5270-4257-b821-764c8a6b368e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:54.544789 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-af1b38da-5270-4257-b821-764c8a6b368e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1c2ee9a249541aa99783095b6154dde', 'request_id': 'req-af1b38da-5270-4257-b821-764c8a6b368e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:54.640403 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-af1b38da-5270-4257-b821-764c8a6b368e admin admin] The token cache is being invalidate because project a1c2ee9a249541aa99783095b6154dde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:13:54.640403 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-af1b38da-5270-4257-b821-764c8a6b368e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:54.641612 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-af1b38da-5270-4257-b821-764c8a6b368e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:13:54.649823 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1324/2659] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:13:54 2022] DELETE /identity/v3/projects/a1c2ee9a249541aa99783095b6154dde => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:13:54.652061 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce423b-b555-4b2d-8290-b8af3bd98679 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:54.656401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce423b-b555-4b2d-8290-b8af3bd98679 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:54.656401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce423b-b555-4b2d-8290-b8af3bd98679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:54.691768 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-ccce423b-b555-4b2d-8290-b8af3bd98679 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:13:54.695292 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ccce423b-b555-4b2d-8290-b8af3bd98679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:54.828044 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1336/2660] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:13:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:13:54.835992 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7a07f-ea4d-46e5-b25a-c3fcba314970 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:54.836661 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7a07f-ea4d-46e5-b25a-c3fcba314970 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:54.837148 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7a07f-ea4d-46e5-b25a-c3fcba314970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:54.867696 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-f7b7a07f-ea4d-46e5-b25a-c3fcba314970 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:13:54.881009 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f7b7a07f-ea4d-46e5-b25a-c3fcba314970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:54.898873 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1325/2661] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:13:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:13:54.902048 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce423b-b555-4b2d-8290-b8af3bd98679 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:54.915113 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce423b-b555-4b2d-8290-b8af3bd98679 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:54.920228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90130c4e-de22-4be5-9383-c23379a36952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:54.920981 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90130c4e-de22-4be5-9383-c23379a36952 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:54.921325 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90130c4e-de22-4be5-9383-c23379a36952 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:54.921681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90130c4e-de22-4be5-9383-c23379a36952 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:54.922628 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90130c4e-de22-4be5-9383-c23379a36952 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:13:54.923133 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90130c4e-de22-4be5-9383-c23379a36952 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:54.925200 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90130c4e-de22-4be5-9383-c23379a36952 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:54.948159 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1337/2662] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:13:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:13:54.949465 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b7a07f-ea4d-46e5-b25a-c3fcba314970 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:54.960978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b7a07f-ea4d-46e5-b25a-c3fcba314970 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:54.974978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1a445-01fc-4dfe-be6f-290fbc847182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:54.976764 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1a445-01fc-4dfe-be6f-290fbc847182 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:54.977050 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1a445-01fc-4dfe-be6f-290fbc847182 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:54.977330 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1a445-01fc-4dfe-be6f-290fbc847182 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:54.978990 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b1a445-01fc-4dfe-be6f-290fbc847182 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:54.980903 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b1a445-01fc-4dfe-be6f-290fbc847182 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:55.092264 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1326/2663] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:13:54 2022] POST /identity/v3/projects => generated 399 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:13:55.093420 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90130c4e-de22-4be5-9383-c23379a36952 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:55.106026 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90130c4e-de22-4be5-9383-c23379a36952 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:55.177558 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2897dadb-0843-4141-a6e6-0ca0bd54a8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:55.181424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897dadb-0843-4141-a6e6-0ca0bd54a8d1 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:55.181424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897dadb-0843-4141-a6e6-0ca0bd54a8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:55.181424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897dadb-0843-4141-a6e6-0ca0bd54a8d1 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:55.181424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2897dadb-0843-4141-a6e6-0ca0bd54a8d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:55.181809 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2897dadb-0843-4141-a6e6-0ca0bd54a8d1 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:55.266465 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1338/2664] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:13:55 2022] POST /identity/v3/users => generated 300 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:13:55.275618 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1a445-01fc-4dfe-be6f-290fbc847182 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:55.308252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1a445-01fc-4dfe-be6f-290fbc847182 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:55.316090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1de0ed-7fb0-4352-9390-8efcedae393d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:55.316423 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1de0ed-7fb0-4352-9390-8efcedae393d admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:55.316857 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1de0ed-7fb0-4352-9390-8efcedae393d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:55.317353 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1de0ed-7fb0-4352-9390-8efcedae393d admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:55.318830 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1de0ed-7fb0-4352-9390-8efcedae393d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:55.321257 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1de0ed-7fb0-4352-9390-8efcedae393d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:55.337441 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1327/2665] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:13:55.341484 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2897dadb-0843-4141-a6e6-0ca0bd54a8d1 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:55.381915 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2897dadb-0843-4141-a6e6-0ca0bd54a8d1 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:55.381915 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a385c85-ab0a-438c-8bc6-6da722dbd43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:55.381915 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a385c85-ab0a-438c-8bc6-6da722dbd43b admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:55.381915 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a385c85-ab0a-438c-8bc6-6da722dbd43b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:55.382422 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a385c85-ab0a-438c-8bc6-6da722dbd43b admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:55.382422 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a385c85-ab0a-438c-8bc6-6da722dbd43b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:55.392021 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a385c85-ab0a-438c-8bc6-6da722dbd43b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:55.421135 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1339/2666] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:13:55.427317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1de0ed-7fb0-4352-9390-8efcedae393d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:55.442712 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1de0ed-7fb0-4352-9390-8efcedae393d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:55.472484 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fbc07f-f92c-4855-95da-28c9f3512230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:55.477893 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fbc07f-f92c-4855-95da-28c9f3512230 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:55.478173 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fbc07f-f92c-4855-95da-28c9f3512230 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:55.478475 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fbc07f-f92c-4855-95da-28c9f3512230 admin admin] PATH_INFO: `/v3/projects/711cc97213824857927f7626b41012cb/users/ddcc9f1b17c94698a5df6ffc6482149f/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:55.516299 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fbc07f-f92c-4855-95da-28c9f3512230 admin admin] RBAC: Authorizing `identity:create_grant(project_id=711cc97213824857927f7626b41012cb, user_id=ddcc9f1b17c94698a5df6ffc6482149f, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:55.519960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fbc07f-f92c-4855-95da-28c9f3512230 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:56.420982 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1328/2667] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:13:55 2022] PUT /identity/v3/projects/711cc97213824857927f7626b41012cb/users/ddcc9f1b17c94698a5df6ffc6482149f/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 994 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:13:56.434187 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170bb37b-895a-4aec-b7ac-6e112c216b9e None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:56.434799 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170bb37b-895a-4aec-b7ac-6e112c216b9e None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:56.435259 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170bb37b-895a-4aec-b7ac-6e112c216b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:56.480911 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-170bb37b-895a-4aec-b7ac-6e112c216b9e None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:13:56.482328 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-170bb37b-895a-4aec-b7ac-6e112c216b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:56.658497 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1340/2668] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:13:56.682557 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fbc07f-f92c-4855-95da-28c9f3512230 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:13:56.685321 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-71fbc07f-f92c-4855-95da-28c9f3512230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:56.757193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fbc07f-f92c-4855-95da-28c9f3512230 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:13:56.760948 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec79e5-db53-43ad-904a-cdde2292bb5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:13:56.761866 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec79e5-db53-43ad-904a-cdde2292bb5f service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:56.762313 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec79e5-db53-43ad-904a-cdde2292bb5f service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:56.762735 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec79e5-db53-43ad-904a-cdde2292bb5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:56.772471 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec79e5-db53-43ad-904a-cdde2292bb5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:13:56.774485 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec79e5-db53-43ad-904a-cdde2292bb5f service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:13:56.784658 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1329/2669] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:13:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:13:58.620109 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da2bc3-45c4-477f-a0d2-66739209290d None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:58.620602 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da2bc3-45c4-477f-a0d2-66739209290d None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:58.620695 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da2bc3-45c4-477f-a0d2-66739209290d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:58.673675 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-c8da2bc3-45c4-477f-a0d2-66739209290d None None] MFA Rules not processed for user `ddcc9f1b17c94698a5df6ffc6482149f`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:13:58.675294 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c8da2bc3-45c4-477f-a0d2-66739209290d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:58.842499 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1341/2670] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:13:58 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:13:58.854872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c355cf-725d-4d23-8267-38580be07bb1 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:13:58.871908 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c355cf-725d-4d23-8267-38580be07bb1 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:13:58.871908 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c355cf-725d-4d23-8267-38580be07bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:13:58.910993 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-54c355cf-725d-4d23-8267-38580be07bb1 None None] MFA Rules not processed for user `ddcc9f1b17c94698a5df6ffc6482149f`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:13:58.912641 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-54c355cf-725d-4d23-8267-38580be07bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:13:58.921336 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1330/2671] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:13:58 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:14:00.336124 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da2bc3-45c4-477f-a0d2-66739209290d None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:00.337531 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c8da2bc3-45c4-477f-a0d2-66739209290d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:00.430976 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da2bc3-45c4-477f-a0d2-66739209290d None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:00.437972 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a983325-aee5-415f-9377-6745d90a5d5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:00.439022 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a983325-aee5-415f-9377-6745d90a5d5d service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:00.439472 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a983325-aee5-415f-9377-6745d90a5d5d service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:00.439969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a983325-aee5-415f-9377-6745d90a5d5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:00.450360 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a983325-aee5-415f-9377-6745d90a5d5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:00.451994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a983325-aee5-415f-9377-6745d90a5d5d service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:00.463597 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1342/2672] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:14:00 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:14:00.903609 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fe1d6-3e7b-4a02-adf1-6ecedc56910c None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:00.909030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fe1d6-3e7b-4a02-adf1-6ecedc56910c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:00.909030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fe1d6-3e7b-4a02-adf1-6ecedc56910c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:00.949833 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-5a5fe1d6-3e7b-4a02-adf1-6ecedc56910c None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:14:00.951583 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5a5fe1d6-3e7b-4a02-adf1-6ecedc56910c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:01.114488 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1331/2673] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:14:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:14:01.128651 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a983325-aee5-415f-9377-6745d90a5d5d service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:01.133130 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4a983325-aee5-415f-9377-6745d90a5d5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:01.324531 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a983325-aee5-415f-9377-6745d90a5d5d service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:01.330657 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b90add-4c3a-4d81-845b-59c73e46f8b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:01.331920 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b90add-4c3a-4d81-845b-59c73e46f8b7 service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:01.332348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b90add-4c3a-4d81-845b-59c73e46f8b7 service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:01.332967 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b90add-4c3a-4d81-845b-59c73e46f8b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:01.344062 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b90add-4c3a-4d81-845b-59c73e46f8b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:01.346649 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b90add-4c3a-4d81-845b-59c73e46f8b7 service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:01.357645 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1343/2674] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:14:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:14:03.228373 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135ac13-c514-45ff-9f80-609396bf2aeb None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:03.228844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135ac13-c514-45ff-9f80-609396bf2aeb None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:03.229076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135ac13-c514-45ff-9f80-609396bf2aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:03.247835 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-5135ac13-c514-45ff-9f80-609396bf2aeb None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:14:03.250616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5135ac13-c514-45ff-9f80-609396bf2aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:03.256607 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1332/2675] 10.222.0.23 () {58 vars in 967 bytes} [Sat Apr 30 21:14:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:14:03.271805 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b90add-4c3a-4d81-845b-59c73e46f8b7 service swift] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:03.285245 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b90add-4c3a-4d81-845b-59c73e46f8b7 service swift] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:03.290769 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed2dba-8055-43c3-ae5d-91312040e987 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:03.291525 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed2dba-8055-43c3-ae5d-91312040e987 service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:03.291876 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed2dba-8055-43c3-ae5d-91312040e987 service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:03.292226 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed2dba-8055-43c3-ae5d-91312040e987 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:03.300987 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed2dba-8055-43c3-ae5d-91312040e987 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:03.302731 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed2dba-8055-43c3-ae5d-91312040e987 service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:03.312163 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1344/2676] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:14:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:14:03.749138 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c6fc2-b207-4e72-b93c-56fe403f3586 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:03.749413 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c6fc2-b207-4e72-b93c-56fe403f3586 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:03.749695 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c6fc2-b207-4e72-b93c-56fe403f3586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:03.769786 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-cd5c6fc2-b207-4e72-b93c-56fe403f3586 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:14:03.770993 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-cd5c6fc2-b207-4e72-b93c-56fe403f3586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:03.790836 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1333/2677] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:14:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:14:03.802691 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed2dba-8055-43c3-ae5d-91312040e987 service swift] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:03.816033 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed2dba-8055-43c3-ae5d-91312040e987 service swift] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:03.822986 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201054a5-0265-43f8-9e39-de0de670583f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:03.823824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201054a5-0265-43f8-9e39-de0de670583f service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:03.824182 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201054a5-0265-43f8-9e39-de0de670583f service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:03.824522 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201054a5-0265-43f8-9e39-de0de670583f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:03.833806 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201054a5-0265-43f8-9e39-de0de670583f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:03.835463 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201054a5-0265-43f8-9e39-de0de670583f service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:03.844208 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1345/2678] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:14:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:14:04.406640 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f52882-1beb-4c6c-b1e9-675d21ca31a9 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:04.407139 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f52882-1beb-4c6c-b1e9-675d21ca31a9 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:04.407236 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f52882-1beb-4c6c-b1e9-675d21ca31a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:04.425301 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-e8f52882-1beb-4c6c-b1e9-675d21ca31a9 None None] MFA Rules not processed for user `eb2cc38da7684af39aed81a0e05d60a7`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:14:04.426541 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e8f52882-1beb-4c6c-b1e9-675d21ca31a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:04.481942 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1334/2679] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:14:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:14:05.111153 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bc87c-bc13-432a-9c82-d32d0ddd48f0 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:05.111620 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bc87c-bc13-432a-9c82-d32d0ddd48f0 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:05.111741 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bc87c-bc13-432a-9c82-d32d0ddd48f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:05.139790 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-511bc87c-bc13-432a-9c82-d32d0ddd48f0 None None] MFA Rules not processed for user `eb2cc38da7684af39aed81a0e05d60a7`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:14:05.141957 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-511bc87c-bc13-432a-9c82-d32d0ddd48f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:05.164760 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c5f27-2de9-45ea-baa4-b9829512b8aa None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:05.165063 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c5f27-2de9-45ea-baa4-b9829512b8aa None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:05.165321 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c5f27-2de9-45ea-baa4-b9829512b8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:05.165950 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1346/2680] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:14:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:14:05.207825 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-0c4c5f27-2de9-45ea-baa4-b9829512b8aa None None] MFA Rules not processed for user `6e275a4d32754fe9a164bd79c3774b97`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:14:05.212383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0c4c5f27-2de9-45ea-baa4-b9829512b8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:05.348409 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1335/2681] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:14:05 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:14:05.667053 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cbfbba-c804-47a4-933d-53c7f83da28a None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:05.667617 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cbfbba-c804-47a4-933d-53c7f83da28a None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:05.668063 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cbfbba-c804-47a4-933d-53c7f83da28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:05.688883 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-d0cbfbba-c804-47a4-933d-53c7f83da28a None None] MFA Rules not processed for user `dadac4f61fe141dba3ee726ca6cbf29a`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:14:05.690393 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d0cbfbba-c804-47a4-933d-53c7f83da28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:05.763752 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1347/2682] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:14:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:14:21.323675 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c5f27-2de9-45ea-baa4-b9829512b8aa None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:21.346090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c5f27-2de9-45ea-baa4-b9829512b8aa None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:21.346090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3782bc-92f3-48ab-b110-bb868e6ec6c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:21.347067 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3782bc-92f3-48ab-b110-bb868e6ec6c7 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:21.347451 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3782bc-92f3-48ab-b110-bb868e6ec6c7 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:21.347830 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3782bc-92f3-48ab-b110-bb868e6ec6c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:21.350015 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2c3782bc-92f3-48ab-b110-bb868e6ec6c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:21.444006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3782bc-92f3-48ab-b110-bb868e6ec6c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:21.445956 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3782bc-92f3-48ab-b110-bb868e6ec6c7 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:21.458674 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1336/2683] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:14:21 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:14:28.023160 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cbfbba-c804-47a4-933d-53c7f83da28a None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:28.032987 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d0cbfbba-c804-47a4-933d-53c7f83da28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:28.047390 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cbfbba-c804-47a4-933d-53c7f83da28a None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:28.053139 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725e42f-8b2d-4460-a6c0-11074504745d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:28.054827 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725e42f-8b2d-4460-a6c0-11074504745d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:28.055268 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725e42f-8b2d-4460-a6c0-11074504745d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:28.066767 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725e42f-8b2d-4460-a6c0-11074504745d admin admin] PATH_INFO: `/v3/users/3914f1552b63492b820beb7096278c39` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:28.066767 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e725e42f-8b2d-4460-a6c0-11074504745d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3914f1552b63492b820beb7096278c39)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:28.066767 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e725e42f-8b2d-4460-a6c0-11074504745d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:28.343044 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e725e42f-8b2d-4460-a6c0-11074504745d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3914f1552b63492b820beb7096278c39'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:28.381435 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e725e42f-8b2d-4460-a6c0-11074504745d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3914f1552b63492b820beb7096278c39'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:28.504315 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e725e42f-8b2d-4460-a6c0-11074504745d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3914f1552b63492b820beb7096278c39'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:28.505154 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e725e42f-8b2d-4460-a6c0-11074504745d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3914f1552b63492b820beb7096278c39'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:28.514970 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e725e42f-8b2d-4460-a6c0-11074504745d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3914f1552b63492b820beb7096278c39'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:28.529269 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1348/2684] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:14:28 2022] DELETE /identity/v3/users/3914f1552b63492b820beb7096278c39 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:14:28.534515 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176eb1f-8967-4a62-8f03-15945cfa31e1 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:28.535006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176eb1f-8967-4a62-8f03-15945cfa31e1 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:28.535006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176eb1f-8967-4a62-8f03-15945cfa31e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:28.557165 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-9176eb1f-8967-4a62-8f03-15945cfa31e1 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:14:28.558618 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9176eb1f-8967-4a62-8f03-15945cfa31e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:28.649997 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1337/2685] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:14:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:14:28.663362 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725e42f-8b2d-4460-a6c0-11074504745d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:28.665262 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e725e42f-8b2d-4460-a6c0-11074504745d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:28.786597 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725e42f-8b2d-4460-a6c0-11074504745d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:28.791737 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f96e7e-c421-4072-b358-e86b8fd70c9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:28.792478 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f96e7e-c421-4072-b358-e86b8fd70c9c service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:28.792828 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f96e7e-c421-4072-b358-e86b8fd70c9c service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:28.793175 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f96e7e-c421-4072-b358-e86b8fd70c9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:28.804651 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f96e7e-c421-4072-b358-e86b8fd70c9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:28.806507 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f96e7e-c421-4072-b358-e86b8fd70c9c service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:28.818515 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1349/2686] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:14:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:14:29.155377 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176eb1f-8967-4a62-8f03-15945cfa31e1 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:29.156789 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9176eb1f-8967-4a62-8f03-15945cfa31e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:29.178047 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176eb1f-8967-4a62-8f03-15945cfa31e1 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:29.184605 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c7ff6-825a-43a0-8c21-1628b6efaef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:29.185794 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c7ff6-825a-43a0-8c21-1628b6efaef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:29.186081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c7ff6-825a-43a0-8c21-1628b6efaef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:29.186358 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c7ff6-825a-43a0-8c21-1628b6efaef3 admin admin] PATH_INFO: `/v3/users/c816e51510ac44c9a2b3f5c022b5a3c3` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:29.188098 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c7ff6-825a-43a0-8c21-1628b6efaef3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c816e51510ac44c9a2b3f5c022b5a3c3)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:29.190323 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c7ff6-825a-43a0-8c21-1628b6efaef3 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:29.248312 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f96e7e-c421-4072-b358-e86b8fd70c9c service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:29.249749 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-26f96e7e-c421-4072-b358-e86b8fd70c9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:29.268294 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f96e7e-c421-4072-b358-e86b8fd70c9c service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:29.274116 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed9a1fb-e9b8-4712-8f96-6f263dcfd078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:29.275398 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9a1fb-e9b8-4712-8f96-6f263dcfd078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:29.275835 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9a1fb-e9b8-4712-8f96-6f263dcfd078 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:29.276437 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9a1fb-e9b8-4712-8f96-6f263dcfd078 admin admin] PATH_INFO: `/v3/projects/4be651a660d6452e9c0bfeece7227370` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:29.278060 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed9a1fb-e9b8-4712-8f96-6f263dcfd078 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4be651a660d6452e9c0bfeece7227370)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:29.280266 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed9a1fb-e9b8-4712-8f96-6f263dcfd078 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:29.483896 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6ed9a1fb-e9b8-4712-8f96-6f263dcfd078 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4be651a660d6452e9c0bfeece7227370', 'request_id': 'req-6ed9a1fb-e9b8-4712-8f96-6f263dcfd078'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:29.499411 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1a2c7ff6-825a-43a0-8c21-1628b6efaef3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c816e51510ac44c9a2b3f5c022b5a3c3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:29.503419 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6ed9a1fb-e9b8-4712-8f96-6f263dcfd078 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4be651a660d6452e9c0bfeece7227370', 'request_id': 'req-6ed9a1fb-e9b8-4712-8f96-6f263dcfd078'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:29.516666 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6ed9a1fb-e9b8-4712-8f96-6f263dcfd078 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4be651a660d6452e9c0bfeece7227370', 'request_id': 'req-6ed9a1fb-e9b8-4712-8f96-6f263dcfd078'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:29.518220 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1a2c7ff6-825a-43a0-8c21-1628b6efaef3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c816e51510ac44c9a2b3f5c022b5a3c3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:29.640021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1a2c7ff6-825a-43a0-8c21-1628b6efaef3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c816e51510ac44c9a2b3f5c022b5a3c3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:29.648855 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1a2c7ff6-825a-43a0-8c21-1628b6efaef3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c816e51510ac44c9a2b3f5c022b5a3c3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:29.649823 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1a2c7ff6-825a-43a0-8c21-1628b6efaef3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c816e51510ac44c9a2b3f5c022b5a3c3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:29.660518 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1338/2687] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:14:29 2022] DELETE /identity/v3/users/c816e51510ac44c9a2b3f5c022b5a3c3 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:14:29.754098 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6ed9a1fb-e9b8-4712-8f96-6f263dcfd078 admin admin] The token cache is being invalidate because project 4be651a660d6452e9c0bfeece7227370 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:14:29.754683 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6ed9a1fb-e9b8-4712-8f96-6f263dcfd078 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:29.761948 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6ed9a1fb-e9b8-4712-8f96-6f263dcfd078 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:29.761948 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1350/2688] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:14:29 2022] DELETE /identity/v3/projects/4be651a660d6452e9c0bfeece7227370 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:14:29.765251 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c7ff6-825a-43a0-8c21-1628b6efaef3 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:29.770542 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1a2c7ff6-825a-43a0-8c21-1628b6efaef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:29.857338 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c7ff6-825a-43a0-8c21-1628b6efaef3 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:29.862671 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514048a7-efe7-4a9e-8b4a-f24ef32a105a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:29.863553 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514048a7-efe7-4a9e-8b4a-f24ef32a105a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:29.864097 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514048a7-efe7-4a9e-8b4a-f24ef32a105a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:29.864097 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514048a7-efe7-4a9e-8b4a-f24ef32a105a admin admin] PATH_INFO: `/v3/users/3e53037089134165a05e36696c2cdfb8` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:29.865403 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514048a7-efe7-4a9e-8b4a-f24ef32a105a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e53037089134165a05e36696c2cdfb8)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:29.868012 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514048a7-efe7-4a9e-8b4a-f24ef32a105a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:30.027127 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed9a1fb-e9b8-4712-8f96-6f263dcfd078 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:30.029002 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6ed9a1fb-e9b8-4712-8f96-6f263dcfd078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:30.127567 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed9a1fb-e9b8-4712-8f96-6f263dcfd078 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:30.136796 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8d9e5-3985-4cee-9fda-899e572fe171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:30.137856 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8d9e5-3985-4cee-9fda-899e572fe171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:30.138038 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-514048a7-efe7-4a9e-8b4a-f24ef32a105a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e53037089134165a05e36696c2cdfb8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:30.138389 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8d9e5-3985-4cee-9fda-899e572fe171 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:30.138903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8d9e5-3985-4cee-9fda-899e572fe171 admin admin] PATH_INFO: `/v3/projects/7710d2f3153e440ab46c2d89ce24c4cb` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:30.141090 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a8d9e5-3985-4cee-9fda-899e572fe171 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7710d2f3153e440ab46c2d89ce24c4cb)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:30.143369 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a8d9e5-3985-4cee-9fda-899e572fe171 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:30.164270 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-514048a7-efe7-4a9e-8b4a-f24ef32a105a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e53037089134165a05e36696c2cdfb8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:30.313646 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-514048a7-efe7-4a9e-8b4a-f24ef32a105a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e53037089134165a05e36696c2cdfb8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:30.326786 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-514048a7-efe7-4a9e-8b4a-f24ef32a105a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e53037089134165a05e36696c2cdfb8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:30.327691 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-514048a7-efe7-4a9e-8b4a-f24ef32a105a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e53037089134165a05e36696c2cdfb8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:30.334411 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1339/2689] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:14:29 2022] DELETE /identity/v3/users/3e53037089134165a05e36696c2cdfb8 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:14:30.340521 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f4a8d9e5-3985-4cee-9fda-899e572fe171 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7710d2f3153e440ab46c2d89ce24c4cb', 'request_id': 'req-f4a8d9e5-3985-4cee-9fda-899e572fe171'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:30.347100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f4a8d9e5-3985-4cee-9fda-899e572fe171 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7710d2f3153e440ab46c2d89ce24c4cb', 'request_id': 'req-f4a8d9e5-3985-4cee-9fda-899e572fe171'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:30.356153 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f4a8d9e5-3985-4cee-9fda-899e572fe171 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7710d2f3153e440ab46c2d89ce24c4cb', 'request_id': 'req-f4a8d9e5-3985-4cee-9fda-899e572fe171'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:30.483312 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f4a8d9e5-3985-4cee-9fda-899e572fe171 admin admin] The token cache is being invalidate because project 7710d2f3153e440ab46c2d89ce24c4cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:14:30.483733 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f4a8d9e5-3985-4cee-9fda-899e572fe171 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:30.484490 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f4a8d9e5-3985-4cee-9fda-899e572fe171 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:30.486267 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1351/2690] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:14:30 2022] DELETE /identity/v3/projects/7710d2f3153e440ab46c2d89ce24c4cb => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:14:30.490629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514048a7-efe7-4a9e-8b4a-f24ef32a105a admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:30.492132 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-514048a7-efe7-4a9e-8b4a-f24ef32a105a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:30.578726 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514048a7-efe7-4a9e-8b4a-f24ef32a105a admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:30.583474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc932f40-58b3-4940-8378-f89538913bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:30.586678 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc932f40-58b3-4940-8378-f89538913bd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:30.586678 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc932f40-58b3-4940-8378-f89538913bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:30.586678 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc932f40-58b3-4940-8378-f89538913bd4 admin admin] PATH_INFO: `/v3/users/fb80b52ef36a45a889c79e8e766b20ae` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:30.586945 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc932f40-58b3-4940-8378-f89538913bd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb80b52ef36a45a889c79e8e766b20ae)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:30.588790 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc932f40-58b3-4940-8378-f89538913bd4 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:30.861585 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e8b9b-e562-4d36-ae27-98a79b74b0ce None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:30.863892 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e8b9b-e562-4d36-ae27-98a79b74b0ce None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:30.864394 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e8b9b-e562-4d36-ae27-98a79b74b0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:30.895142 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-023e8b9b-e562-4d36-ae27-98a79b74b0ce None None] MFA Rules not processed for user `cce42480cd844664991774f07ca47e79`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:14:30.896461 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-023e8b9b-e562-4d36-ae27-98a79b74b0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:30.899772 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cc932f40-58b3-4940-8378-f89538913bd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb80b52ef36a45a889c79e8e766b20ae'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:30.915706 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cc932f40-58b3-4940-8378-f89538913bd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb80b52ef36a45a889c79e8e766b20ae'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:30.955212 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1352/2691] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:14:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:14:30.989594 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e8b9b-e562-4d36-ae27-98a79b74b0ce None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:30.992412 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-023e8b9b-e562-4d36-ae27-98a79b74b0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:31.022357 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cc932f40-58b3-4940-8378-f89538913bd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb80b52ef36a45a889c79e8e766b20ae'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:31.036161 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cc932f40-58b3-4940-8378-f89538913bd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb80b52ef36a45a889c79e8e766b20ae'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:31.036392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e8b9b-e562-4d36-ae27-98a79b74b0ce None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:31.036489 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cc932f40-58b3-4940-8378-f89538913bd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb80b52ef36a45a889c79e8e766b20ae'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:31.043760 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821c950-b504-4e1c-b2e3-cec16fe8c064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:31.044639 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821c950-b504-4e1c-b2e3-cec16fe8c064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:31.044917 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821c950-b504-4e1c-b2e3-cec16fe8c064 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:31.045357 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821c950-b504-4e1c-b2e3-cec16fe8c064 admin admin] PATH_INFO: `/v3/projects/4cc97b777b2d4b258227d93fe9c11cfa` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:31.046629 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821c950-b504-4e1c-b2e3-cec16fe8c064 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cc97b777b2d4b258227d93fe9c11cfa)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:31.048559 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821c950-b504-4e1c-b2e3-cec16fe8c064 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:31.051864 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1340/2692] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:14:30 2022] DELETE /identity/v3/users/fb80b52ef36a45a889c79e8e766b20ae => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:14:31.205789 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1821c950-b504-4e1c-b2e3-cec16fe8c064 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cc97b777b2d4b258227d93fe9c11cfa', 'request_id': 'req-1821c950-b504-4e1c-b2e3-cec16fe8c064'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:31.214532 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1821c950-b504-4e1c-b2e3-cec16fe8c064 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cc97b777b2d4b258227d93fe9c11cfa', 'request_id': 'req-1821c950-b504-4e1c-b2e3-cec16fe8c064'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:31.226166 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1821c950-b504-4e1c-b2e3-cec16fe8c064 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cc97b777b2d4b258227d93fe9c11cfa', 'request_id': 'req-1821c950-b504-4e1c-b2e3-cec16fe8c064'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:31.348037 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1821c950-b504-4e1c-b2e3-cec16fe8c064 admin admin] The token cache is being invalidate because project 4cc97b777b2d4b258227d93fe9c11cfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:14:31.348716 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1821c950-b504-4e1c-b2e3-cec16fe8c064 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:31.348994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1821c950-b504-4e1c-b2e3-cec16fe8c064 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:31.351228 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1353/2693] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:14:30 2022] DELETE /identity/v3/projects/4cc97b777b2d4b258227d93fe9c11cfa => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:14:31.357506 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c099a-1e19-44da-9920-8373c1a9963c None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:31.357798 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c099a-1e19-44da-9920-8373c1a9963c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:31.358077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c099a-1e19-44da-9920-8373c1a9963c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:31.382531 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-d23c099a-1e19-44da-9920-8373c1a9963c None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:14:31.383034 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d23c099a-1e19-44da-9920-8373c1a9963c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:31.385388 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821c950-b504-4e1c-b2e3-cec16fe8c064 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:31.387266 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1821c950-b504-4e1c-b2e3-cec16fe8c064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:31.487571 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1341/2694] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:14:31.497471 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb627dbc-23d9-456c-9d8b-4a28ebf62f2c None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:31.497471 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb627dbc-23d9-456c-9d8b-4a28ebf62f2c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:31.497471 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb627dbc-23d9-456c-9d8b-4a28ebf62f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:31.507897 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821c950-b504-4e1c-b2e3-cec16fe8c064 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:31.512943 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b134ca-cd8a-43ce-b4ab-5fbce341e7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:31.514090 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b134ca-cd8a-43ce-b4ab-5fbce341e7b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:31.514524 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b134ca-cd8a-43ce-b4ab-5fbce341e7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:31.514803 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b134ca-cd8a-43ce-b4ab-5fbce341e7b2 admin admin] PATH_INFO: `/v3/projects/df8aff4feefd46bba10664568c0433bf` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:31.516109 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b134ca-cd8a-43ce-b4ab-5fbce341e7b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df8aff4feefd46bba10664568c0433bf)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:31.518065 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b134ca-cd8a-43ce-b4ab-5fbce341e7b2 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:31.520269 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-eb627dbc-23d9-456c-9d8b-4a28ebf62f2c None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:14:31.521997 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-eb627dbc-23d9-456c-9d8b-4a28ebf62f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:31.531241 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1342/2695] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:14:31.535069 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb627dbc-23d9-456c-9d8b-4a28ebf62f2c None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:31.545309 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb627dbc-23d9-456c-9d8b-4a28ebf62f2c None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:31.552841 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26747fbb-3fa1-4593-95ed-87acfa5b376b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:31.554409 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26747fbb-3fa1-4593-95ed-87acfa5b376b admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:31.554702 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26747fbb-3fa1-4593-95ed-87acfa5b376b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:31.554982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26747fbb-3fa1-4593-95ed-87acfa5b376b admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:31.555715 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26747fbb-3fa1-4593-95ed-87acfa5b376b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:14:31.556026 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26747fbb-3fa1-4593-95ed-87acfa5b376b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:31.557654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26747fbb-3fa1-4593-95ed-87acfa5b376b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:31.573398 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1343/2696] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:14:31.574428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26747fbb-3fa1-4593-95ed-87acfa5b376b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:31.585524 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26747fbb-3fa1-4593-95ed-87acfa5b376b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:31.592011 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a1546-acce-4159-8a80-545e1ecd18a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:31.597178 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a1546-acce-4159-8a80-545e1ecd18a9 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:31.597178 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a1546-acce-4159-8a80-545e1ecd18a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:31.597178 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a1546-acce-4159-8a80-545e1ecd18a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:31.597178 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a1546-acce-4159-8a80-545e1ecd18a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:31.597178 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a1546-acce-4159-8a80-545e1ecd18a9 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:31.645402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-92b134ca-cd8a-43ce-b4ab-5fbce341e7b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df8aff4feefd46bba10664568c0433bf', 'request_id': 'req-92b134ca-cd8a-43ce-b4ab-5fbce341e7b2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:31.651946 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-92b134ca-cd8a-43ce-b4ab-5fbce341e7b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df8aff4feefd46bba10664568c0433bf', 'request_id': 'req-92b134ca-cd8a-43ce-b4ab-5fbce341e7b2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:31.660181 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-92b134ca-cd8a-43ce-b4ab-5fbce341e7b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df8aff4feefd46bba10664568c0433bf', 'request_id': 'req-92b134ca-cd8a-43ce-b4ab-5fbce341e7b2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:31.738065 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1344/2697] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:14:31 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:14:31.743881 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a1546-acce-4159-8a80-545e1ecd18a9 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:31.781477 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-92b134ca-cd8a-43ce-b4ab-5fbce341e7b2 admin admin] The token cache is being invalidate because project df8aff4feefd46bba10664568c0433bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:14:31.781799 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-92b134ca-cd8a-43ce-b4ab-5fbce341e7b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:31.782787 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-92b134ca-cd8a-43ce-b4ab-5fbce341e7b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:31.785707 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1354/2698] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:14:31 2022] DELETE /identity/v3/projects/df8aff4feefd46bba10664568c0433bf => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:14:31.790370 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d9713-fbd6-4b4f-a5d3-3d7a81185c07 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:31.790666 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d9713-fbd6-4b4f-a5d3-3d7a81185c07 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:31.790939 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d9713-fbd6-4b4f-a5d3-3d7a81185c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:31.827095 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-c32d9713-fbd6-4b4f-a5d3-3d7a81185c07 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:14:31.828331 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c32d9713-fbd6-4b4f-a5d3-3d7a81185c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:31.883099 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a1546-acce-4159-8a80-545e1ecd18a9 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:31.889192 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531a918-8bc8-4a21-a92a-afd9d3023762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:31.890836 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531a918-8bc8-4a21-a92a-afd9d3023762 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:31.891453 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531a918-8bc8-4a21-a92a-afd9d3023762 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:31.891944 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531a918-8bc8-4a21-a92a-afd9d3023762 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:31.893141 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531a918-8bc8-4a21-a92a-afd9d3023762 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:31.897527 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531a918-8bc8-4a21-a92a-afd9d3023762 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:31.905222 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1355/2699] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:14:31.906862 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159d68d-57f1-4257-9629-48868ba8c946 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:31.911031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159d68d-57f1-4257-9629-48868ba8c946 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:31.911031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159d68d-57f1-4257-9629-48868ba8c946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:31.927979 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-e159d68d-57f1-4257-9629-48868ba8c946 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:14:31.929809 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e159d68d-57f1-4257-9629-48868ba8c946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:31.939400 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1356/2700] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:14:31.943506 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159d68d-57f1-4257-9629-48868ba8c946 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:31.954061 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159d68d-57f1-4257-9629-48868ba8c946 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:31.959200 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759ce5a-816c-4463-aef3-9246c30c1deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:31.959898 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759ce5a-816c-4463-aef3-9246c30c1deb admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:31.960179 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759ce5a-816c-4463-aef3-9246c30c1deb admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:31.960778 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759ce5a-816c-4463-aef3-9246c30c1deb admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:31.961171 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f759ce5a-816c-4463-aef3-9246c30c1deb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:14:31.961480 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f759ce5a-816c-4463-aef3-9246c30c1deb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:31.963216 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f759ce5a-816c-4463-aef3-9246c30c1deb admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:31.975486 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1357/2701] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:14:31.979809 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759ce5a-816c-4463-aef3-9246c30c1deb admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:32.010336 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759ce5a-816c-4463-aef3-9246c30c1deb admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:32.017042 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1345/2702] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:14:31 2022] POST /identity/v3/users => generated 293 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:14:32.018643 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531a918-8bc8-4a21-a92a-afd9d3023762 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:32.020360 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f531a918-8bc8-4a21-a92a-afd9d3023762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:32.042424 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531a918-8bc8-4a21-a92a-afd9d3023762 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:32.045141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c4fac-8a68-4b46-b80f-9a6f69af833c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:32.045850 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c4fac-8a68-4b46-b80f-9a6f69af833c admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:32.046122 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c4fac-8a68-4b46-b80f-9a6f69af833c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:32.046395 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c4fac-8a68-4b46-b80f-9a6f69af833c admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:32.047095 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c4fac-8a68-4b46-b80f-9a6f69af833c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:32.049395 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c4fac-8a68-4b46-b80f-9a6f69af833c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:32.070623 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cd248-0874-42b8-b3e7-c0164905ba81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:32.071444 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cd248-0874-42b8-b3e7-c0164905ba81 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:32.071965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cd248-0874-42b8-b3e7-c0164905ba81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:32.072378 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cd248-0874-42b8-b3e7-c0164905ba81 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:32.073215 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87cd248-0874-42b8-b3e7-c0164905ba81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:32.075544 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87cd248-0874-42b8-b3e7-c0164905ba81 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:32.088323 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1346/2703] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:14:32.092651 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cd248-0874-42b8-b3e7-c0164905ba81 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:32.107263 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cd248-0874-42b8-b3e7-c0164905ba81 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:32.112537 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec392be3-0ecf-4e69-9177-9eb9893b3d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:32.113603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec392be3-0ecf-4e69-9177-9eb9893b3d15 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:32.114145 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec392be3-0ecf-4e69-9177-9eb9893b3d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:32.114699 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec392be3-0ecf-4e69-9177-9eb9893b3d15 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:32.115545 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec392be3-0ecf-4e69-9177-9eb9893b3d15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:32.118710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec392be3-0ecf-4e69-9177-9eb9893b3d15 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:32.131518 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1347/2704] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:14:32.137833 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec392be3-0ecf-4e69-9177-9eb9893b3d15 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:32.163109 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec392be3-0ecf-4e69-9177-9eb9893b3d15 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:32.170644 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e5d69-f416-4ed4-b134-f82f86121971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:32.171763 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e5d69-f416-4ed4-b134-f82f86121971 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:32.172687 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e5d69-f416-4ed4-b134-f82f86121971 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:32.173122 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e5d69-f416-4ed4-b134-f82f86121971 admin admin] PATH_INFO: `/v3/projects/6309fd24cb2e4a5d8fde4f457d529d68/users/8c1eeba696174da1be8aba8dcce6b112/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:32.189268 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1358/2705] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:14:31 2022] POST /identity/v3/projects => generated 391 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:14:32.195111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c4fac-8a68-4b46-b80f-9a6f69af833c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:32.195357 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e5d69-f416-4ed4-b134-f82f86121971 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6309fd24cb2e4a5d8fde4f457d529d68, user_id=8c1eeba696174da1be8aba8dcce6b112, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:32.198462 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e5d69-f416-4ed4-b134-f82f86121971 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:32.298015 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1348/2706] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:14:32 2022] PUT /identity/v3/projects/6309fd24cb2e4a5d8fde4f457d529d68/users/8c1eeba696174da1be8aba8dcce6b112/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:14:32.300923 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c9dd7-df2c-4380-b6f0-d81aeec8c829 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:32.304241 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c9dd7-df2c-4380-b6f0-d81aeec8c829 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:32.304241 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c9dd7-df2c-4380-b6f0-d81aeec8c829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:32.313972 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c4fac-8a68-4b46-b80f-9a6f69af833c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:32.347256 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-906c9dd7-df2c-4380-b6f0-d81aeec8c829 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:14:32.347256 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-906c9dd7-df2c-4380-b6f0-d81aeec8c829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:32.418725 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c88a28-f3b8-4206-ad3e-545223829440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:32.420457 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c88a28-f3b8-4206-ad3e-545223829440 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:32.420919 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c88a28-f3b8-4206-ad3e-545223829440 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:32.421196 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c88a28-f3b8-4206-ad3e-545223829440 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:32.422422 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c88a28-f3b8-4206-ad3e-545223829440 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:32.425771 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c88a28-f3b8-4206-ad3e-545223829440 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:32.438656 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1349/2707] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:14:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:14:32.445594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c9dd7-df2c-4380-b6f0-d81aeec8c829 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:32.447246 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-906c9dd7-df2c-4380-b6f0-d81aeec8c829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:32.547017 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c9dd7-df2c-4380-b6f0-d81aeec8c829 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:32.551512 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77da5d-9275-401f-a80a-1ebebcc11416 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:32.552216 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77da5d-9275-401f-a80a-1ebebcc11416 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:32.552513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77da5d-9275-401f-a80a-1ebebcc11416 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:32.552807 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77da5d-9275-401f-a80a-1ebebcc11416 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:32.563423 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1359/2708] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:14:32 2022] POST /identity/v3/users => generated 296 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:14:32.569708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb77da5d-9275-401f-a80a-1ebebcc11416 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:32.569708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb77da5d-9275-401f-a80a-1ebebcc11416 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:32.572617 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c88a28-f3b8-4206-ad3e-545223829440 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:32.583489 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1350/2709] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:14:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:14:32.585904 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c88a28-f3b8-4206-ad3e-545223829440 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:32.590894 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed29a20-6cc1-44c6-9769-8c7e0d33631e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:32.591566 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed29a20-6cc1-44c6-9769-8c7e0d33631e admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:32.591852 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed29a20-6cc1-44c6-9769-8c7e0d33631e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:32.592265 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed29a20-6cc1-44c6-9769-8c7e0d33631e admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:32.593033 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed29a20-6cc1-44c6-9769-8c7e0d33631e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:32.594719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed29a20-6cc1-44c6-9769-8c7e0d33631e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:32.605798 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1360/2710] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:14:32.608755 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77da5d-9275-401f-a80a-1ebebcc11416 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:32.618699 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77da5d-9275-401f-a80a-1ebebcc11416 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:32.623279 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ba2d6-bac5-4415-b870-566b0926c7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:32.623922 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ba2d6-bac5-4415-b870-566b0926c7a0 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:32.624200 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ba2d6-bac5-4415-b870-566b0926c7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:32.624469 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ba2d6-bac5-4415-b870-566b0926c7a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:32.625176 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ba2d6-bac5-4415-b870-566b0926c7a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:32.626921 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ba2d6-bac5-4415-b870-566b0926c7a0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:32.637245 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1351/2711] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:14:32.641541 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed29a20-6cc1-44c6-9769-8c7e0d33631e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:32.651621 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed29a20-6cc1-44c6-9769-8c7e0d33631e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:32.656289 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c570d2fb-6d76-4079-8436-b0cc28e0d9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:32.657160 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570d2fb-6d76-4079-8436-b0cc28e0d9b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:32.657442 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570d2fb-6d76-4079-8436-b0cc28e0d9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:32.657716 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570d2fb-6d76-4079-8436-b0cc28e0d9b6 admin admin] PATH_INFO: `/v3/projects/35fbee96191d4baab63d33c188de37a2/users/ccc9322b29b74fc1839dc079b3e4a938/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:32.672707 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c570d2fb-6d76-4079-8436-b0cc28e0d9b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35fbee96191d4baab63d33c188de37a2, user_id=ccc9322b29b74fc1839dc079b3e4a938, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:32.675464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c570d2fb-6d76-4079-8436-b0cc28e0d9b6 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:32.795334 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1361/2712] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:14:32 2022] PUT /identity/v3/projects/35fbee96191d4baab63d33c188de37a2/users/ccc9322b29b74fc1839dc079b3e4a938/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:14:32.807332 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9b185-3032-417f-89dc-6909b7de9b0b None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:32.807796 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9b185-3032-417f-89dc-6909b7de9b0b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:32.808143 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9b185-3032-417f-89dc-6909b7de9b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:32.871972 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-81c9b185-3032-417f-89dc-6909b7de9b0b None None] MFA Rules not processed for user `ccc9322b29b74fc1839dc079b3e4a938`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:14:32.873408 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-81c9b185-3032-417f-89dc-6909b7de9b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:32.957803 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1352/2713] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:14:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:14:32.960495 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c570d2fb-6d76-4079-8436-b0cc28e0d9b6 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:33.035158 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c570d2fb-6d76-4079-8436-b0cc28e0d9b6 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:33.041123 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d33c53-38d2-4a0d-8752-b4c982e1b681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:33.042679 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d33c53-38d2-4a0d-8752-b4c982e1b681 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:33.043184 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d33c53-38d2-4a0d-8752-b4c982e1b681 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:33.043708 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d33c53-38d2-4a0d-8752-b4c982e1b681 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:33.044937 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d33c53-38d2-4a0d-8752-b4c982e1b681 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:33.046919 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d33c53-38d2-4a0d-8752-b4c982e1b681 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:33.159259 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1362/2714] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:14:32 2022] POST /identity/v3/projects => generated 393 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:14:33.163149 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9b185-3032-417f-89dc-6909b7de9b0b None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:33.176175 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9b185-3032-417f-89dc-6909b7de9b0b None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:33.305334 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b3c11-ce10-4e7d-ba90-6793df779668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:33.306040 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b3c11-ce10-4e7d-ba90-6793df779668 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:33.309317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b3c11-ce10-4e7d-ba90-6793df779668 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:33.309317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b3c11-ce10-4e7d-ba90-6793df779668 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:33.309317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b3c11-ce10-4e7d-ba90-6793df779668 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:33.310297 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b3c11-ce10-4e7d-ba90-6793df779668 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:33.494244 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1353/2715] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:14:33 2022] POST /identity/v3/users => generated 303 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:14:33.499335 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d33c53-38d2-4a0d-8752-b4c982e1b681 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:33.515297 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d33c53-38d2-4a0d-8752-b4c982e1b681 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:33.522792 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a5c90-f3ba-4b21-8d72-3b3b5f3c6186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:33.524074 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a5c90-f3ba-4b21-8d72-3b3b5f3c6186 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:33.524554 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a5c90-f3ba-4b21-8d72-3b3b5f3c6186 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:33.524923 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a5c90-f3ba-4b21-8d72-3b3b5f3c6186 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:33.526470 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a5c90-f3ba-4b21-8d72-3b3b5f3c6186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:33.528886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a5c90-f3ba-4b21-8d72-3b3b5f3c6186 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:33.550104 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1363/2716] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:14:33.554787 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b3c11-ce10-4e7d-ba90-6793df779668 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:33.573127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b3c11-ce10-4e7d-ba90-6793df779668 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:33.589788 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14bb57-520a-4a0a-ac26-5732b72d6cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:33.590677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14bb57-520a-4a0a-ac26-5732b72d6cd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:33.590988 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14bb57-520a-4a0a-ac26-5732b72d6cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:33.591228 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14bb57-520a-4a0a-ac26-5732b72d6cd8 admin admin] PATH_INFO: `/v3/projects/5c00dbe3b8dc4a6ba8d815640691ff5e/users/610b7564740140189977a5c4132b3706/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:33.615104 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc14bb57-520a-4a0a-ac26-5732b72d6cd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c00dbe3b8dc4a6ba8d815640691ff5e, user_id=610b7564740140189977a5c4132b3706, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:33.618272 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc14bb57-520a-4a0a-ac26-5732b72d6cd8 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:33.814524 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1354/2717] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:14:33 2022] PUT /identity/v3/projects/5c00dbe3b8dc4a6ba8d815640691ff5e/users/610b7564740140189977a5c4132b3706/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:14:33.819260 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a5c90-f3ba-4b21-8d72-3b3b5f3c6186 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:33.829676 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a5c90-f3ba-4b21-8d72-3b3b5f3c6186 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:33.890500 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f3edd-4e2c-473e-b7a2-b7c7c185a43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:33.891285 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f3edd-4e2c-473e-b7a2-b7c7c185a43b admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:33.891589 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f3edd-4e2c-473e-b7a2-b7c7c185a43b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:33.891938 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f3edd-4e2c-473e-b7a2-b7c7c185a43b admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:33.892879 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727f3edd-4e2c-473e-b7a2-b7c7c185a43b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:33.894606 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727f3edd-4e2c-473e-b7a2-b7c7c185a43b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:33.914331 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1364/2718] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:14:33.918321 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14bb57-520a-4a0a-ac26-5732b72d6cd8 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:33.929265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14bb57-520a-4a0a-ac26-5732b72d6cd8 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:33.934324 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e7583-f5f8-4e59-96da-41012fae7eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:33.935325 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e7583-f5f8-4e59-96da-41012fae7eb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:33.935611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e7583-f5f8-4e59-96da-41012fae7eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:33.935886 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e7583-f5f8-4e59-96da-41012fae7eb0 admin admin] PATH_INFO: `/v3/projects/5c00dbe3b8dc4a6ba8d815640691ff5e/users/610b7564740140189977a5c4132b3706/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:33.938282 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4e7583-f5f8-4e59-96da-41012fae7eb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c00dbe3b8dc4a6ba8d815640691ff5e, user_id=610b7564740140189977a5c4132b3706, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:33.941195 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4e7583-f5f8-4e59-96da-41012fae7eb0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:33.964851 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1355/2719] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:14:33 2022] PUT /identity/v3/projects/5c00dbe3b8dc4a6ba8d815640691ff5e/users/610b7564740140189977a5c4132b3706/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:14:33.985565 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8bb7e-af17-4540-83bf-cc610d108778 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:33.986104 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8bb7e-af17-4540-83bf-cc610d108778 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:33.986554 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8bb7e-af17-4540-83bf-cc610d108778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:34.013363 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-70f8bb7e-af17-4540-83bf-cc610d108778 None None] MFA Rules not processed for user `610b7564740140189977a5c4132b3706`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:14:34.014595 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-70f8bb7e-af17-4540-83bf-cc610d108778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:34.084699 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1365/2720] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:14:33 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:14:34.097111 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e7583-f5f8-4e59-96da-41012fae7eb0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:34.098847 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-fc4e7583-f5f8-4e59-96da-41012fae7eb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:34.175114 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e7583-f5f8-4e59-96da-41012fae7eb0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:34.181508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440cb4cf-28ee-48d3-ab8a-b328891aba35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:34.182175 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440cb4cf-28ee-48d3-ab8a-b328891aba35 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:34.182458 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440cb4cf-28ee-48d3-ab8a-b328891aba35 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:34.182732 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440cb4cf-28ee-48d3-ab8a-b328891aba35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:34.192090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440cb4cf-28ee-48d3-ab8a-b328891aba35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:34.193692 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440cb4cf-28ee-48d3-ab8a-b328891aba35 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:34.203936 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1356/2721] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:14:34 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:14:34.414146 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f8bb7e-af17-4540-83bf-cc610d108778 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:34.501513 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f8bb7e-af17-4540-83bf-cc610d108778 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:34.506345 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb169c-4114-44e8-a8ce-63211628b212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:34.507239 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb169c-4114-44e8-a8ce-63211628b212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:34.507804 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb169c-4114-44e8-a8ce-63211628b212 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:34.508070 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb169c-4114-44e8-a8ce-63211628b212 admin admin] PATH_INFO: `/v3/users/ccc9322b29b74fc1839dc079b3e4a938` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:34.509514 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb169c-4114-44e8-a8ce-63211628b212 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccc9322b29b74fc1839dc079b3e4a938)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:34.511584 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb169c-4114-44e8-a8ce-63211628b212 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:34.812766 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-75bb169c-4114-44e8-a8ce-63211628b212 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccc9322b29b74fc1839dc079b3e4a938'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:34.842648 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-75bb169c-4114-44e8-a8ce-63211628b212 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccc9322b29b74fc1839dc079b3e4a938'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:34.993024 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-75bb169c-4114-44e8-a8ce-63211628b212 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccc9322b29b74fc1839dc079b3e4a938'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:34.994111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-75bb169c-4114-44e8-a8ce-63211628b212 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccc9322b29b74fc1839dc079b3e4a938'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:35.003609 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-75bb169c-4114-44e8-a8ce-63211628b212 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccc9322b29b74fc1839dc079b3e4a938'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:35.020813 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1366/2722] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:14:34 2022] DELETE /identity/v3/users/ccc9322b29b74fc1839dc079b3e4a938 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:14:35.026590 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f552e4e-4286-4ef3-a2dc-63786224aaaf None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:35.027116 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f552e4e-4286-4ef3-a2dc-63786224aaaf None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:35.027663 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f552e4e-4286-4ef3-a2dc-63786224aaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:35.071100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-6f552e4e-4286-4ef3-a2dc-63786224aaaf None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:14:35.074456 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6f552e4e-4286-4ef3-a2dc-63786224aaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:35.169897 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1357/2723] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:14:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:14:35.214237 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb169c-4114-44e8-a8ce-63211628b212 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:35.216575 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-75bb169c-4114-44e8-a8ce-63211628b212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:35.336503 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb169c-4114-44e8-a8ce-63211628b212 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:35.340409 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb5b6f-fa48-41a0-9a0f-8bd88ac45642 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:35.341226 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb5b6f-fa48-41a0-9a0f-8bd88ac45642 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:35.341517 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb5b6f-fa48-41a0-9a0f-8bd88ac45642 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:35.341825 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb5b6f-fa48-41a0-9a0f-8bd88ac45642 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:35.355247 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fb5b6f-fa48-41a0-9a0f-8bd88ac45642 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:35.372586 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fb5b6f-fa48-41a0-9a0f-8bd88ac45642 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:35.389394 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1367/2724] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:14:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:14:36.340323 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f552e4e-4286-4ef3-a2dc-63786224aaaf None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:36.341853 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6f552e4e-4286-4ef3-a2dc-63786224aaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:36.363832 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f552e4e-4286-4ef3-a2dc-63786224aaaf None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:36.373529 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f93a48-8e8a-4e27-8463-98c5fcc2e9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:36.374591 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f93a48-8e8a-4e27-8463-98c5fcc2e9b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:36.375555 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f93a48-8e8a-4e27-8463-98c5fcc2e9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:36.375962 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f93a48-8e8a-4e27-8463-98c5fcc2e9b3 admin admin] PATH_INFO: `/v3/projects/35fbee96191d4baab63d33c188de37a2` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:36.383211 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f93a48-8e8a-4e27-8463-98c5fcc2e9b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35fbee96191d4baab63d33c188de37a2)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:36.385589 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f93a48-8e8a-4e27-8463-98c5fcc2e9b3 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:36.633897 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-74f93a48-8e8a-4e27-8463-98c5fcc2e9b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35fbee96191d4baab63d33c188de37a2', 'request_id': 'req-74f93a48-8e8a-4e27-8463-98c5fcc2e9b3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:36.667242 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-74f93a48-8e8a-4e27-8463-98c5fcc2e9b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35fbee96191d4baab63d33c188de37a2', 'request_id': 'req-74f93a48-8e8a-4e27-8463-98c5fcc2e9b3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:36.684863 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-74f93a48-8e8a-4e27-8463-98c5fcc2e9b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35fbee96191d4baab63d33c188de37a2', 'request_id': 'req-74f93a48-8e8a-4e27-8463-98c5fcc2e9b3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:36.753649 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-74f93a48-8e8a-4e27-8463-98c5fcc2e9b3 admin admin] The token cache is being invalidate because project 35fbee96191d4baab63d33c188de37a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:14:36.754222 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-74f93a48-8e8a-4e27-8463-98c5fcc2e9b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:36.756861 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-74f93a48-8e8a-4e27-8463-98c5fcc2e9b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:36.766247 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1358/2725] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:14:36 2022] DELETE /identity/v3/projects/35fbee96191d4baab63d33c188de37a2 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:14:36.774299 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb5b6f-fa48-41a0-9a0f-8bd88ac45642 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:36.801541 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb5b6f-fa48-41a0-9a0f-8bd88ac45642 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:37.023536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e198a-700b-4533-9d20-e9b95f7360dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:37.024941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e198a-700b-4533-9d20-e9b95f7360dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:37.025417 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e198a-700b-4533-9d20-e9b95f7360dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:37.025878 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e198a-700b-4533-9d20-e9b95f7360dd admin admin] PATH_INFO: `/v3/users/610b7564740140189977a5c4132b3706` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:37.029283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9e198a-700b-4533-9d20-e9b95f7360dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=610b7564740140189977a5c4132b3706)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:37.031482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9e198a-700b-4533-9d20-e9b95f7360dd admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:37.346850 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-db9e198a-700b-4533-9d20-e9b95f7360dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '610b7564740140189977a5c4132b3706'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:37.362578 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-db9e198a-700b-4533-9d20-e9b95f7360dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '610b7564740140189977a5c4132b3706'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:37.492873 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-db9e198a-700b-4533-9d20-e9b95f7360dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '610b7564740140189977a5c4132b3706'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:37.493855 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-db9e198a-700b-4533-9d20-e9b95f7360dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '610b7564740140189977a5c4132b3706'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:37.502211 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-db9e198a-700b-4533-9d20-e9b95f7360dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '610b7564740140189977a5c4132b3706'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:37.519318 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1368/2726] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:14:36 2022] DELETE /identity/v3/users/610b7564740140189977a5c4132b3706 => generated 0 bytes in 749 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:14:37.585695 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4237bfe-d45a-47ca-b132-ca4231ce62ae None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:37.586280 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4237bfe-d45a-47ca-b132-ca4231ce62ae None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:37.586829 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4237bfe-d45a-47ca-b132-ca4231ce62ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:37.619164 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-e4237bfe-d45a-47ca-b132-ca4231ce62ae None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:14:37.620575 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e4237bfe-d45a-47ca-b132-ca4231ce62ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:37.727074 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1359/2727] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:14:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:14:37.733806 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e198a-700b-4533-9d20-e9b95f7360dd admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:37.735072 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-db9e198a-700b-4533-9d20-e9b95f7360dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:37.891629 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e198a-700b-4533-9d20-e9b95f7360dd admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:37.905625 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57081ac1-6686-44cc-864e-488081469f8a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:37.906396 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57081ac1-6686-44cc-864e-488081469f8a service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:37.906814 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57081ac1-6686-44cc-864e-488081469f8a service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:37.907095 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57081ac1-6686-44cc-864e-488081469f8a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:37.925698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57081ac1-6686-44cc-864e-488081469f8a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:37.932552 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57081ac1-6686-44cc-864e-488081469f8a service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:37.958577 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1369/2728] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:14:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:14:38.924225 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4237bfe-d45a-47ca-b132-ca4231ce62ae None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:38.926529 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e4237bfe-d45a-47ca-b132-ca4231ce62ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:39.238652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4237bfe-d45a-47ca-b132-ca4231ce62ae None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:39.251086 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ee4ae-5108-4b06-ac69-f588af010dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:39.251965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ee4ae-5108-4b06-ac69-f588af010dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:39.252440 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ee4ae-5108-4b06-ac69-f588af010dce admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:39.252912 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ee4ae-5108-4b06-ac69-f588af010dce admin admin] PATH_INFO: `/v3/projects/5c00dbe3b8dc4a6ba8d815640691ff5e` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:39.257421 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ee4ae-5108-4b06-ac69-f588af010dce admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c00dbe3b8dc4a6ba8d815640691ff5e)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:39.259677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ee4ae-5108-4b06-ac69-f588af010dce admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:39.538755 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-378ee4ae-5108-4b06-ac69-f588af010dce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c00dbe3b8dc4a6ba8d815640691ff5e', 'request_id': 'req-378ee4ae-5108-4b06-ac69-f588af010dce'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:39.560171 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-378ee4ae-5108-4b06-ac69-f588af010dce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c00dbe3b8dc4a6ba8d815640691ff5e', 'request_id': 'req-378ee4ae-5108-4b06-ac69-f588af010dce'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:39.572947 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-378ee4ae-5108-4b06-ac69-f588af010dce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c00dbe3b8dc4a6ba8d815640691ff5e', 'request_id': 'req-378ee4ae-5108-4b06-ac69-f588af010dce'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:39.751321 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-378ee4ae-5108-4b06-ac69-f588af010dce admin admin] The token cache is being invalidate because project 5c00dbe3b8dc4a6ba8d815640691ff5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:14:39.751638 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-378ee4ae-5108-4b06-ac69-f588af010dce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:39.753092 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-378ee4ae-5108-4b06-ac69-f588af010dce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:39.756240 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1360/2729] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:14:38 2022] DELETE /identity/v3/projects/5c00dbe3b8dc4a6ba8d815640691ff5e => generated 0 bytes in 833 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:14:39.761409 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0778f1-d063-4593-9778-01ce45e48a20 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:39.761948 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0778f1-d063-4593-9778-01ce45e48a20 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:39.762054 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0778f1-d063-4593-9778-01ce45e48a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:39.800941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-6b0778f1-d063-4593-9778-01ce45e48a20 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:14:39.802236 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6b0778f1-d063-4593-9778-01ce45e48a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:39.997352 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1370/2730] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:14:40.000816 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403acb8-d601-47f8-b8ac-5a617e53f901 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:40.001251 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403acb8-d601-47f8-b8ac-5a617e53f901 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:40.001445 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403acb8-d601-47f8-b8ac-5a617e53f901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:40.046919 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-a403acb8-d601-47f8-b8ac-5a617e53f901 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:14:40.048197 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a403acb8-d601-47f8-b8ac-5a617e53f901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:40.070951 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1361/2731] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:14:40.075564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0778f1-d063-4593-9778-01ce45e48a20 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:40.097951 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0778f1-d063-4593-9778-01ce45e48a20 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:40.104601 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e339909-4a8a-4935-bbcc-73bb22677330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:40.105541 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e339909-4a8a-4935-bbcc-73bb22677330 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:40.106670 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e339909-4a8a-4935-bbcc-73bb22677330 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:40.107158 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e339909-4a8a-4935-bbcc-73bb22677330 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:40.108062 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e339909-4a8a-4935-bbcc-73bb22677330 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:14:40.108682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e339909-4a8a-4935-bbcc-73bb22677330 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:40.110904 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e339909-4a8a-4935-bbcc-73bb22677330 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:40.154493 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1371/2732] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:14:40.156503 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a403acb8-d601-47f8-b8ac-5a617e53f901 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:40.175637 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a403acb8-d601-47f8-b8ac-5a617e53f901 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:40.192472 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21302078-42cf-4976-bf0c-1530e2cf5fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:40.193163 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21302078-42cf-4976-bf0c-1530e2cf5fbd admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:40.193474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21302078-42cf-4976-bf0c-1530e2cf5fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:40.195714 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21302078-42cf-4976-bf0c-1530e2cf5fbd admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:40.196494 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21302078-42cf-4976-bf0c-1530e2cf5fbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:40.198486 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21302078-42cf-4976-bf0c-1530e2cf5fbd admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:40.319280 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1362/2733] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:14:40 2022] POST /identity/v3/projects => generated 387 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:14:40.323700 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e339909-4a8a-4935-bbcc-73bb22677330 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:40.335987 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e339909-4a8a-4935-bbcc-73bb22677330 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:40.530579 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4586a-222d-4943-ad49-06a1ba77c074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:40.531668 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4586a-222d-4943-ad49-06a1ba77c074 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:40.532121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4586a-222d-4943-ad49-06a1ba77c074 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:40.532563 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4586a-222d-4943-ad49-06a1ba77c074 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:40.533488 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d4586a-222d-4943-ad49-06a1ba77c074 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:40.538527 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d4586a-222d-4943-ad49-06a1ba77c074 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:40.621427 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1372/2734] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:14:40 2022] POST /identity/v3/users => generated 294 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:14:40.625749 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21302078-42cf-4976-bf0c-1530e2cf5fbd admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:40.656582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21302078-42cf-4976-bf0c-1530e2cf5fbd admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:40.677273 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e730be-64a0-4e3e-a438-90e9e0ed846a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:40.678862 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e730be-64a0-4e3e-a438-90e9e0ed846a admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:40.679354 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e730be-64a0-4e3e-a438-90e9e0ed846a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:40.679813 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e730be-64a0-4e3e-a438-90e9e0ed846a admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:40.681309 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e730be-64a0-4e3e-a438-90e9e0ed846a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:40.683292 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e730be-64a0-4e3e-a438-90e9e0ed846a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:40.704531 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1363/2735] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:14:40.710540 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4586a-222d-4943-ad49-06a1ba77c074 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:40.729620 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4586a-222d-4943-ad49-06a1ba77c074 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:40.736607 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0f278-8e82-42ba-8ed1-cd6e95fa14a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:40.738415 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0f278-8e82-42ba-8ed1-cd6e95fa14a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:40.739384 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0f278-8e82-42ba-8ed1-cd6e95fa14a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:40.739832 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0f278-8e82-42ba-8ed1-cd6e95fa14a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:40.741439 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c0f278-8e82-42ba-8ed1-cd6e95fa14a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:40.743934 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c0f278-8e82-42ba-8ed1-cd6e95fa14a1 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:40.773712 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e730be-64a0-4e3e-a438-90e9e0ed846a admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:40.774573 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1373/2736] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:14:40.787204 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e730be-64a0-4e3e-a438-90e9e0ed846a admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:40.808641 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d6ad56-3141-4e65-b442-587479004fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:40.809561 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6ad56-3141-4e65-b442-587479004fee admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:40.809963 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6ad56-3141-4e65-b442-587479004fee admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:40.810312 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6ad56-3141-4e65-b442-587479004fee admin admin] PATH_INFO: `/v3/projects/1a2d262c5cf4435aa19253f70823433f/users/d57b97f51d2f4aa6869b41518f14d3aa/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:40.851913 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d6ad56-3141-4e65-b442-587479004fee admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a2d262c5cf4435aa19253f70823433f, user_id=d57b97f51d2f4aa6869b41518f14d3aa, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:40.856009 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d6ad56-3141-4e65-b442-587479004fee admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:40.925671 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1364/2737] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:14:40 2022] PUT /identity/v3/projects/1a2d262c5cf4435aa19253f70823433f/users/d57b97f51d2f4aa6869b41518f14d3aa/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:14:40.937703 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94c694-398b-4154-8d10-701187378a3c None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:40.938289 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94c694-398b-4154-8d10-701187378a3c None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:40.938735 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94c694-398b-4154-8d10-701187378a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:41.007321 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-8a94c694-398b-4154-8d10-701187378a3c None None] MFA Rules not processed for user `d57b97f51d2f4aa6869b41518f14d3aa`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:14:41.009202 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8a94c694-398b-4154-8d10-701187378a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:41.232834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d6ad56-3141-4e65-b442-587479004fee admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:41.239594 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1374/2738] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:14:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:14:41.438676 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d6ad56-3141-4e65-b442-587479004fee admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:41.452618 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929b21a-5300-477d-ab79-419966bfdca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:41.453797 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929b21a-5300-477d-ab79-419966bfdca0 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:41.454334 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929b21a-5300-477d-ab79-419966bfdca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:41.454922 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929b21a-5300-477d-ab79-419966bfdca0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:41.456998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929b21a-5300-477d-ab79-419966bfdca0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:41.460388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929b21a-5300-477d-ab79-419966bfdca0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:41.568173 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1365/2739] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:14:41 2022] POST /identity/v3/projects => generated 385 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:14:41.572844 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a94c694-398b-4154-8d10-701187378a3c None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:41.592441 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a94c694-398b-4154-8d10-701187378a3c None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:41.753213 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450457b-261b-401f-9108-df5198315aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:41.754927 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450457b-261b-401f-9108-df5198315aca admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:41.755723 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450457b-261b-401f-9108-df5198315aca admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:41.756424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450457b-261b-401f-9108-df5198315aca admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:41.761504 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a450457b-261b-401f-9108-df5198315aca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:41.764287 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a450457b-261b-401f-9108-df5198315aca admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:41.970287 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1375/2740] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:14:41 2022] POST /identity/v3/users => generated 299 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:14:41.973276 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929b21a-5300-477d-ab79-419966bfdca0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:41.991553 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929b21a-5300-477d-ab79-419966bfdca0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:42.004796 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b5fd6-b7fb-4ae3-a6f2-b0bcc4f89597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:42.006712 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b5fd6-b7fb-4ae3-a6f2-b0bcc4f89597 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:42.007907 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b5fd6-b7fb-4ae3-a6f2-b0bcc4f89597 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:42.009701 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b5fd6-b7fb-4ae3-a6f2-b0bcc4f89597 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:42.011317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b5fd6-b7fb-4ae3-a6f2-b0bcc4f89597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:42.013442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b5fd6-b7fb-4ae3-a6f2-b0bcc4f89597 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:42.040192 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1366/2741] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:14:42.044489 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450457b-261b-401f-9108-df5198315aca admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:42.060834 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450457b-261b-401f-9108-df5198315aca admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:42.072896 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360bf5cb-da5d-4017-871b-98f9314e33fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:42.074401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bf5cb-da5d-4017-871b-98f9314e33fc admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:42.075305 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bf5cb-da5d-4017-871b-98f9314e33fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:42.077068 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bf5cb-da5d-4017-871b-98f9314e33fc admin admin] PATH_INFO: `/v3/projects/e949efb64ca944159dd74eda0fcafdba/users/f1b74ca4407849a392fe4d2898613875/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:42.153564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360bf5cb-da5d-4017-871b-98f9314e33fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e949efb64ca944159dd74eda0fcafdba, user_id=f1b74ca4407849a392fe4d2898613875, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:42.156606 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360bf5cb-da5d-4017-871b-98f9314e33fc admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:42.342118 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1376/2742] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:14:42 2022] PUT /identity/v3/projects/e949efb64ca944159dd74eda0fcafdba/users/f1b74ca4407849a392fe4d2898613875/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:14:42.346214 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b5fd6-b7fb-4ae3-a6f2-b0bcc4f89597 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:42.360732 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b5fd6-b7fb-4ae3-a6f2-b0bcc4f89597 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:42.564130 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afbedf8-674d-41a1-836e-73689ae001c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:42.566295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbedf8-674d-41a1-836e-73689ae001c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:42.566779 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbedf8-674d-41a1-836e-73689ae001c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:42.569290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbedf8-674d-41a1-836e-73689ae001c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:42.570338 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afbedf8-674d-41a1-836e-73689ae001c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:42.574711 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afbedf8-674d-41a1-836e-73689ae001c7 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:42.610889 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360bf5cb-da5d-4017-871b-98f9314e33fc admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:42.619165 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1367/2743] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:14:42.627387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360bf5cb-da5d-4017-871b-98f9314e33fc admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:42.639911 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a335359-8cdb-4c6e-af10-edf3aee78a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:42.641920 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a335359-8cdb-4c6e-af10-edf3aee78a08 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:42.641920 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a335359-8cdb-4c6e-af10-edf3aee78a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:42.641920 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a335359-8cdb-4c6e-af10-edf3aee78a08 admin admin] PATH_INFO: `/v3/projects/e949efb64ca944159dd74eda0fcafdba/users/f1b74ca4407849a392fe4d2898613875/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:42.643813 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a335359-8cdb-4c6e-af10-edf3aee78a08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e949efb64ca944159dd74eda0fcafdba, user_id=f1b74ca4407849a392fe4d2898613875, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:42.647431 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a335359-8cdb-4c6e-af10-edf3aee78a08 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:42.662052 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1377/2744] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:14:42 2022] PUT /identity/v3/projects/e949efb64ca944159dd74eda0fcafdba/users/f1b74ca4407849a392fe4d2898613875/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:14:42.673017 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf7cd6-af6a-4f2d-b228-456364090d56 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:42.676417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf7cd6-af6a-4f2d-b228-456364090d56 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:42.676417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf7cd6-af6a-4f2d-b228-456364090d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:42.776462 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-c0bf7cd6-af6a-4f2d-b228-456364090d56 None None] MFA Rules not processed for user `f1b74ca4407849a392fe4d2898613875`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:14:42.778426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c0bf7cd6-af6a-4f2d-b228-456364090d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:42.983971 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca7a00-ab0c-4676-b30f-daa1f08e38e2 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:42.984564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca7a00-ab0c-4676-b30f-daa1f08e38e2 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:42.984564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca7a00-ab0c-4676-b30f-daa1f08e38e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:43.060429 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1368/2745] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:14:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:14:43.072792 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429bcff-9b1b-454e-b91d-06e49e8b6db5 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:43.073105 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429bcff-9b1b-454e-b91d-06e49e8b6db5 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:43.073389 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429bcff-9b1b-454e-b91d-06e49e8b6db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:43.078627 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-c5ca7a00-ab0c-4676-b30f-daa1f08e38e2 None None] MFA Rules not processed for user `8c1eeba696174da1be8aba8dcce6b112`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:14:43.080062 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c5ca7a00-ab0c-4676-b30f-daa1f08e38e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:43.125372 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-1429bcff-9b1b-454e-b91d-06e49e8b6db5 None None] MFA Rules not processed for user `d57b97f51d2f4aa6869b41518f14d3aa`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:14:43.132508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1429bcff-9b1b-454e-b91d-06e49e8b6db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:43.270491 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1378/2746] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:14:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:14:43.275302 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca7a00-ab0c-4676-b30f-daa1f08e38e2 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:43.277013 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c5ca7a00-ab0c-4676-b30f-daa1f08e38e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:43.280511 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1369/2747] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:14:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:14:43.304289 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429bcff-9b1b-454e-b91d-06e49e8b6db5 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:43.304837 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1429bcff-9b1b-454e-b91d-06e49e8b6db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:43.415091 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca7a00-ab0c-4676-b30f-daa1f08e38e2 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:43.420391 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1f10b-94d0-4109-9ae3-8dc4e017e07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:43.421056 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1f10b-94d0-4109-9ae3-8dc4e017e07e admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:43.421529 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1f10b-94d0-4109-9ae3-8dc4e017e07e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:43.422013 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1f10b-94d0-4109-9ae3-8dc4e017e07e admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:43.423007 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1f10b-94d0-4109-9ae3-8dc4e017e07e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:43.425212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1f10b-94d0-4109-9ae3-8dc4e017e07e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:43.439423 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429bcff-9b1b-454e-b91d-06e49e8b6db5 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:43.446131 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3515a-4a92-4319-97f5-500c1ef162ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:43.446877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3515a-4a92-4319-97f5-500c1ef162ec service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:43.447377 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3515a-4a92-4319-97f5-500c1ef162ec service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:43.447862 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3515a-4a92-4319-97f5-500c1ef162ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:43.457852 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f3515a-4a92-4319-97f5-500c1ef162ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:43.461527 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f3515a-4a92-4319-97f5-500c1ef162ec service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:43.472603 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1370/2748] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:14:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:14:43.542285 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1379/2749] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:14:43 2022] POST /identity/v3/projects => generated 385 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:14:43.546369 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3515a-4a92-4319-97f5-500c1ef162ec service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:43.562607 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3515a-4a92-4319-97f5-500c1ef162ec service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:43.655818 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc46c02-ef2b-47c5-9353-22b4d5e521b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:43.656622 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc46c02-ef2b-47c5-9353-22b4d5e521b4 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:43.656977 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc46c02-ef2b-47c5-9353-22b4d5e521b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:43.657351 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc46c02-ef2b-47c5-9353-22b4d5e521b4 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:43.658337 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc46c02-ef2b-47c5-9353-22b4d5e521b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:43.660376 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc46c02-ef2b-47c5-9353-22b4d5e521b4 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:43.810584 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1371/2750] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:14:43 2022] POST /identity/v3/users => generated 299 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:14:43.814598 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1f10b-94d0-4109-9ae3-8dc4e017e07e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:43.828642 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1f10b-94d0-4109-9ae3-8dc4e017e07e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:43.839171 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95995e-4e34-44ec-bd38-8c4318cc839d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:43.839317 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95995e-4e34-44ec-bd38-8c4318cc839d admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:43.839622 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95995e-4e34-44ec-bd38-8c4318cc839d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:43.840175 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95995e-4e34-44ec-bd38-8c4318cc839d admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:43.841119 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe95995e-4e34-44ec-bd38-8c4318cc839d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:43.846409 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe95995e-4e34-44ec-bd38-8c4318cc839d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:43.876807 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1380/2751] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:14:43.881061 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc46c02-ef2b-47c5-9353-22b4d5e521b4 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:43.902132 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc46c02-ef2b-47c5-9353-22b4d5e521b4 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:43.913515 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab789b-9e6b-41bb-b7b3-4ac90da8db33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:43.915103 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab789b-9e6b-41bb-b7b3-4ac90da8db33 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:43.921588 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab789b-9e6b-41bb-b7b3-4ac90da8db33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:43.921986 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab789b-9e6b-41bb-b7b3-4ac90da8db33 admin admin] PATH_INFO: `/v3/projects/0ab6eb1e1c1e41dfb10c95d4b11e4f42/users/664c0809d310462a8376b932c1f99aa1/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:43.957733 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab789b-9e6b-41bb-b7b3-4ac90da8db33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ab6eb1e1c1e41dfb10c95d4b11e4f42, user_id=664c0809d310462a8376b932c1f99aa1, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:43.965535 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab789b-9e6b-41bb-b7b3-4ac90da8db33 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:44.058717 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1372/2752] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:14:43 2022] PUT /identity/v3/projects/0ab6eb1e1c1e41dfb10c95d4b11e4f42/users/664c0809d310462a8376b932c1f99aa1/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:14:44.063326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95995e-4e34-44ec-bd38-8c4318cc839d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:44.088782 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95995e-4e34-44ec-bd38-8c4318cc839d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:44.268144 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530841dd-7d7b-4904-bae1-374ac2e67752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:44.269290 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530841dd-7d7b-4904-bae1-374ac2e67752 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:44.271313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530841dd-7d7b-4904-bae1-374ac2e67752 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:44.273647 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530841dd-7d7b-4904-bae1-374ac2e67752 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:44.274911 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530841dd-7d7b-4904-bae1-374ac2e67752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:44.277463 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530841dd-7d7b-4904-bae1-374ac2e67752 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:44.294981 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1381/2753] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:14:44 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:14:44.298548 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab789b-9e6b-41bb-b7b3-4ac90da8db33 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:44.314060 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab789b-9e6b-41bb-b7b3-4ac90da8db33 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:44.320418 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c5e94-3f38-4330-b09f-b7250803bff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:44.326978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c5e94-3f38-4330-b09f-b7250803bff7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:44.326978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c5e94-3f38-4330-b09f-b7250803bff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:44.326978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c5e94-3f38-4330-b09f-b7250803bff7 admin admin] PATH_INFO: `/v3/projects/0ab6eb1e1c1e41dfb10c95d4b11e4f42/users/664c0809d310462a8376b932c1f99aa1/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:44.326978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81c5e94-3f38-4330-b09f-b7250803bff7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ab6eb1e1c1e41dfb10c95d4b11e4f42, user_id=664c0809d310462a8376b932c1f99aa1, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:44.328240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81c5e94-3f38-4330-b09f-b7250803bff7 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:44.341126 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1373/2754] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:14:44 2022] PUT /identity/v3/projects/0ab6eb1e1c1e41dfb10c95d4b11e4f42/users/664c0809d310462a8376b932c1f99aa1/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:14:46.660644 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530841dd-7d7b-4904-bae1-374ac2e67752 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:46.662499 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-530841dd-7d7b-4904-bae1-374ac2e67752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:46.691336 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530841dd-7d7b-4904-bae1-374ac2e67752 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:46.915119 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac0269-a8a5-40f4-a1f2-6dadecbe75ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:46.919560 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac0269-a8a5-40f4-a1f2-6dadecbe75ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:46.919560 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac0269-a8a5-40f4-a1f2-6dadecbe75ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:46.919560 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac0269-a8a5-40f4-a1f2-6dadecbe75ce admin admin] PATH_INFO: `/v3/users/6e275a4d32754fe9a164bd79c3774b97` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:46.919560 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac0269-a8a5-40f4-a1f2-6dadecbe75ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e275a4d32754fe9a164bd79c3774b97)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:46.922894 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac0269-a8a5-40f4-a1f2-6dadecbe75ce admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:47.309712 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f4ac0269-a8a5-40f4-a1f2-6dadecbe75ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e275a4d32754fe9a164bd79c3774b97'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:47.333001 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f4ac0269-a8a5-40f4-a1f2-6dadecbe75ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e275a4d32754fe9a164bd79c3774b97'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:47.415414 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f4ac0269-a8a5-40f4-a1f2-6dadecbe75ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e275a4d32754fe9a164bd79c3774b97'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:47.416497 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f4ac0269-a8a5-40f4-a1f2-6dadecbe75ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e275a4d32754fe9a164bd79c3774b97'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:47.426866 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f4ac0269-a8a5-40f4-a1f2-6dadecbe75ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e275a4d32754fe9a164bd79c3774b97'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:47.434117 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1382/2755] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:14:46 2022] DELETE /identity/v3/users/6e275a4d32754fe9a164bd79c3774b97 => generated 0 bytes in 774 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:14:48.020018 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c5e94-3f38-4330-b09f-b7250803bff7 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:48.022641 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b81c5e94-3f38-4330-b09f-b7250803bff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:48.067749 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9ee36-8759-46b9-8489-b75a7877bd23 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:48.068130 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9ee36-8759-46b9-8489-b75a7877bd23 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:48.068130 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9ee36-8759-46b9-8489-b75a7877bd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:48.069183 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c5e94-3f38-4330-b09f-b7250803bff7 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:48.099759 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-eeb9ee36-8759-46b9-8489-b75a7877bd23 None None] MFA Rules not processed for user `ddcc9f1b17c94698a5df6ffc6482149f`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:14:48.101420 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-eeb9ee36-8759-46b9-8489-b75a7877bd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:48.217160 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1383/2756] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:14:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:14:48.243892 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ff7e3-33e9-4718-b50c-f5f4dd957d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:48.244778 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ff7e3-33e9-4718-b50c-f5f4dd957d5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:48.245060 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ff7e3-33e9-4718-b50c-f5f4dd957d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:48.245340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ff7e3-33e9-4718-b50c-f5f4dd957d5d admin admin] PATH_INFO: `/v3/projects/64f0bbc311b44034838e939a3c2e98ae` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:48.247612 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ff7e3-33e9-4718-b50c-f5f4dd957d5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=64f0bbc311b44034838e939a3c2e98ae)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:48.249313 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ff7e3-33e9-4718-b50c-f5f4dd957d5d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:48.446227 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-601ff7e3-33e9-4718-b50c-f5f4dd957d5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64f0bbc311b44034838e939a3c2e98ae', 'request_id': 'req-601ff7e3-33e9-4718-b50c-f5f4dd957d5d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:48.452947 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-601ff7e3-33e9-4718-b50c-f5f4dd957d5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64f0bbc311b44034838e939a3c2e98ae', 'request_id': 'req-601ff7e3-33e9-4718-b50c-f5f4dd957d5d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:48.461508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-601ff7e3-33e9-4718-b50c-f5f4dd957d5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64f0bbc311b44034838e939a3c2e98ae', 'request_id': 'req-601ff7e3-33e9-4718-b50c-f5f4dd957d5d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:48.547156 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-601ff7e3-33e9-4718-b50c-f5f4dd957d5d admin admin] The token cache is being invalidate because project 64f0bbc311b44034838e939a3c2e98ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:14:48.547452 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-601ff7e3-33e9-4718-b50c-f5f4dd957d5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:48.549030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-601ff7e3-33e9-4718-b50c-f5f4dd957d5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:48.558534 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1374/2757] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:14:48 2022] DELETE /identity/v3/projects/64f0bbc311b44034838e939a3c2e98ae => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:14:48.559273 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa08ea3-8371-4c9d-a6cf-5457350d62ee None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:48.559568 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa08ea3-8371-4c9d-a6cf-5457350d62ee None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:48.559849 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa08ea3-8371-4c9d-a6cf-5457350d62ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:48.592954 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-5aa08ea3-8371-4c9d-a6cf-5457350d62ee None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:14:48.594229 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5aa08ea3-8371-4c9d-a6cf-5457350d62ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:48.744388 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1384/2758] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:14:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:14:48.756281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d315ad-2966-4dad-abda-e4e77ab524f9 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:48.756866 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d315ad-2966-4dad-abda-e4e77ab524f9 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:48.757310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d315ad-2966-4dad-abda-e4e77ab524f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:48.823767 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-a4d315ad-2966-4dad-abda-e4e77ab524f9 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:14:48.825117 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a4d315ad-2966-4dad-abda-e4e77ab524f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:48.843336 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1375/2759] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:14:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:14:48.843636 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa08ea3-8371-4c9d-a6cf-5457350d62ee None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:48.856035 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa08ea3-8371-4c9d-a6cf-5457350d62ee None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:48.870713 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10411b-bd7b-4268-a069-7020edd573f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:48.871665 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10411b-bd7b-4268-a069-7020edd573f1 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:48.872207 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10411b-bd7b-4268-a069-7020edd573f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:48.872687 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10411b-bd7b-4268-a069-7020edd573f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:48.873668 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10411b-bd7b-4268-a069-7020edd573f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:14:48.874224 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10411b-bd7b-4268-a069-7020edd573f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:48.876069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10411b-bd7b-4268-a069-7020edd573f1 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:48.921792 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1385/2760] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:14:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:14:48.926194 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d315ad-2966-4dad-abda-e4e77ab524f9 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:48.939459 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d315ad-2966-4dad-abda-e4e77ab524f9 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:48.958180 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3078fc5-df06-4277-9de5-71e4e232a3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:48.960266 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3078fc5-df06-4277-9de5-71e4e232a3f9 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:48.962826 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3078fc5-df06-4277-9de5-71e4e232a3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:48.966091 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3078fc5-df06-4277-9de5-71e4e232a3f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:48.966961 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3078fc5-df06-4277-9de5-71e4e232a3f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:48.974282 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3078fc5-df06-4277-9de5-71e4e232a3f9 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:49.135354 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1376/2761] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:14:48 2022] POST /identity/v3/projects => generated 397 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:14:49.136791 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10411b-bd7b-4268-a069-7020edd573f1 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:49.152738 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10411b-bd7b-4268-a069-7020edd573f1 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:49.353058 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d5544-9bd2-4f11-a255-701276517f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:49.354889 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d5544-9bd2-4f11-a255-701276517f06 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:49.355330 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d5544-9bd2-4f11-a255-701276517f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:49.355763 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d5544-9bd2-4f11-a255-701276517f06 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:49.356835 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d5544-9bd2-4f11-a255-701276517f06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:49.359163 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d5544-9bd2-4f11-a255-701276517f06 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:49.488107 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1386/2762] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:14:49 2022] POST /identity/v3/users => generated 299 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:14:49.492700 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3078fc5-df06-4277-9de5-71e4e232a3f9 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:49.521090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3078fc5-df06-4277-9de5-71e4e232a3f9 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:49.526412 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a7f82-9a56-4236-952f-56464501f62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:49.527328 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a7f82-9a56-4236-952f-56464501f62e admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:49.527791 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a7f82-9a56-4236-952f-56464501f62e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:49.528223 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a7f82-9a56-4236-952f-56464501f62e admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:49.529303 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a7f82-9a56-4236-952f-56464501f62e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:49.531146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a7f82-9a56-4236-952f-56464501f62e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:49.558489 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1377/2763] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:14:49.562470 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d5544-9bd2-4f11-a255-701276517f06 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:49.594937 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d5544-9bd2-4f11-a255-701276517f06 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:49.615610 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a1947-fb5a-45b3-bca7-acd72bd95972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:49.619763 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a1947-fb5a-45b3-bca7-acd72bd95972 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:49.619763 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a1947-fb5a-45b3-bca7-acd72bd95972 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:49.619763 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a1947-fb5a-45b3-bca7-acd72bd95972 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:49.619763 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44a1947-fb5a-45b3-bca7-acd72bd95972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:49.620234 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44a1947-fb5a-45b3-bca7-acd72bd95972 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:49.669323 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a7f82-9a56-4236-952f-56464501f62e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:49.673976 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1387/2764] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:14:49.680370 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a7f82-9a56-4236-952f-56464501f62e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:49.694658 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0395b2a4-954d-48ce-a0ba-e6e53dbb8e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:49.695558 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395b2a4-954d-48ce-a0ba-e6e53dbb8e06 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:49.696031 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395b2a4-954d-48ce-a0ba-e6e53dbb8e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:49.696460 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395b2a4-954d-48ce-a0ba-e6e53dbb8e06 admin admin] PATH_INFO: `/v3/projects/6b8dcbd007194e4896da66708312f275/users/a97f31a7823845bea098470fa3a448cb/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:49.730824 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0395b2a4-954d-48ce-a0ba-e6e53dbb8e06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b8dcbd007194e4896da66708312f275, user_id=a97f31a7823845bea098470fa3a448cb, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:49.734039 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0395b2a4-954d-48ce-a0ba-e6e53dbb8e06 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:49.835258 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1378/2765] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:14:49 2022] PUT /identity/v3/projects/6b8dcbd007194e4896da66708312f275/users/a97f31a7823845bea098470fa3a448cb/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:14:49.863555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3538b2-302d-402b-85cc-ad310d9b1508 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:49.864016 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3538b2-302d-402b-85cc-ad310d9b1508 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:49.864305 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3538b2-302d-402b-85cc-ad310d9b1508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:49.929855 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-fe3538b2-302d-402b-85cc-ad310d9b1508 None None] MFA Rules not processed for user `a97f31a7823845bea098470fa3a448cb`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:14:49.931861 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-fe3538b2-302d-402b-85cc-ad310d9b1508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:50.069399 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1388/2766] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:14:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:14:50.705110 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0395b2a4-954d-48ce-a0ba-e6e53dbb8e06 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:50.713088 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0395b2a4-954d-48ce-a0ba-e6e53dbb8e06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:50.964281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0395b2a4-954d-48ce-a0ba-e6e53dbb8e06 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:50.982394 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473b593-268d-4493-b4b7-79640ff97b14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:50.983203 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473b593-268d-4493-b4b7-79640ff97b14 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:50.983588 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473b593-268d-4493-b4b7-79640ff97b14 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:50.983960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a473b593-268d-4493-b4b7-79640ff97b14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:51.007888 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473b593-268d-4493-b4b7-79640ff97b14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:51.009656 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a473b593-268d-4493-b4b7-79640ff97b14 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:51.034898 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1379/2767] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:14:50 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:14:51.208009 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2d307-dfb2-4728-a2bd-69d673f10f66 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:51.212773 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2d307-dfb2-4728-a2bd-69d673f10f66 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:51.212773 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2d307-dfb2-4728-a2bd-69d673f10f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:51.282083 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-56a2d307-dfb2-4728-a2bd-69d673f10f66 None None] MFA Rules not processed for user `a97f31a7823845bea098470fa3a448cb`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:14:51.287546 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-56a2d307-dfb2-4728-a2bd-69d673f10f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:51.322857 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1389/2768] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:14:51 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:14:52.139841 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473b593-268d-4493-b4b7-79640ff97b14 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:52.212817 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a473b593-268d-4493-b4b7-79640ff97b14 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:52.219251 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51324fdd-ba97-4a80-aa2c-973798f01b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:52.220369 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51324fdd-ba97-4a80-aa2c-973798f01b83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:52.220828 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51324fdd-ba97-4a80-aa2c-973798f01b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:52.221253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51324fdd-ba97-4a80-aa2c-973798f01b83 admin admin] PATH_INFO: `/v3/users/a97f31a7823845bea098470fa3a448cb` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:52.230049 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51324fdd-ba97-4a80-aa2c-973798f01b83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a97f31a7823845bea098470fa3a448cb)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:52.230049 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51324fdd-ba97-4a80-aa2c-973798f01b83 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:52.525006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-51324fdd-ba97-4a80-aa2c-973798f01b83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a97f31a7823845bea098470fa3a448cb'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:52.579467 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-51324fdd-ba97-4a80-aa2c-973798f01b83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a97f31a7823845bea098470fa3a448cb'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:52.740510 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-51324fdd-ba97-4a80-aa2c-973798f01b83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a97f31a7823845bea098470fa3a448cb'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:52.756756 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-51324fdd-ba97-4a80-aa2c-973798f01b83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a97f31a7823845bea098470fa3a448cb'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:52.757511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-51324fdd-ba97-4a80-aa2c-973798f01b83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a97f31a7823845bea098470fa3a448cb'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:52.769872 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1380/2769] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:14:52 2022] DELETE /identity/v3/users/a97f31a7823845bea098470fa3a448cb => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:14:52.774982 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392635dc-dd23-422e-b2cd-22f55d45cbb8 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:52.775527 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392635dc-dd23-422e-b2cd-22f55d45cbb8 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:52.777913 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392635dc-dd23-422e-b2cd-22f55d45cbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:52.812606 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-392635dc-dd23-422e-b2cd-22f55d45cbb8 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:14:52.818646 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-392635dc-dd23-422e-b2cd-22f55d45cbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:53.008278 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1390/2770] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:14:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:14:53.020783 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51324fdd-ba97-4a80-aa2c-973798f01b83 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:53.024232 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-51324fdd-ba97-4a80-aa2c-973798f01b83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:53.147751 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51324fdd-ba97-4a80-aa2c-973798f01b83 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:53.176896 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818d661-1f4e-4e7c-bb1f-d70453552c38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:53.176896 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818d661-1f4e-4e7c-bb1f-d70453552c38 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:53.176896 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818d661-1f4e-4e7c-bb1f-d70453552c38 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:53.176896 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818d661-1f4e-4e7c-bb1f-d70453552c38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:53.217845 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b818d661-1f4e-4e7c-bb1f-d70453552c38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:53.252707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b818d661-1f4e-4e7c-bb1f-d70453552c38 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:53.302535 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1381/2771] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:14:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:14:57.276454 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6ed65-bba1-42eb-9a45-43f529a1ae8e None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:57.277376 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6ed65-bba1-42eb-9a45-43f529a1ae8e None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:57.277841 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6ed65-bba1-42eb-9a45-43f529a1ae8e None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:57.279382 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1391/2772] 10.222.0.23 () {54 vars in 921 bytes} [Sat Apr 30 21:14:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:14:57.284989 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5781cf-036b-492d-b927-d787aade3386 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:57.286041 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5781cf-036b-492d-b927-d787aade3386 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:57.286497 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5781cf-036b-492d-b927-d787aade3386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:57.327895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-9d5781cf-036b-492d-b927-d787aade3386 None None] MFA Rules not processed for user `4ad3f89b7037413a83c7905cef263b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:14:57.329127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9d5781cf-036b-492d-b927-d787aade3386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:57.389493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6ed65-bba1-42eb-9a45-43f529a1ae8e None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:57.391275 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-27f6ed65-bba1-42eb-9a45-43f529a1ae8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:57.433449 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6ed65-bba1-42eb-9a45-43f529a1ae8e None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:57.445555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e60de-063e-4865-818c-28513dd957b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:57.446324 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e60de-063e-4865-818c-28513dd957b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:57.446780 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e60de-063e-4865-818c-28513dd957b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:57.447241 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e60de-063e-4865-818c-28513dd957b9 admin admin] PATH_INFO: `/v3/projects/6b8dcbd007194e4896da66708312f275` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:57.449809 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6e60de-063e-4865-818c-28513dd957b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b8dcbd007194e4896da66708312f275)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:57.456519 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6e60de-063e-4865-818c-28513dd957b9 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:57.508233 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1382/2773] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Apr 30 21:14:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:14:57.548621 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5781cf-036b-492d-b927-d787aade3386 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:57.554694 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9d5781cf-036b-492d-b927-d787aade3386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:57.595182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5781cf-036b-492d-b927-d787aade3386 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:57.604863 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b1ac5-bec8-4e35-b2c6-89e82dddde4b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:57.606361 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b1ac5-bec8-4e35-b2c6-89e82dddde4b service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:57.607442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b1ac5-bec8-4e35-b2c6-89e82dddde4b service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:57.608063 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b1ac5-bec8-4e35-b2c6-89e82dddde4b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:57.621895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b1ac5-bec8-4e35-b2c6-89e82dddde4b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:57.623973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b1ac5-bec8-4e35-b2c6-89e82dddde4b service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:57.641006 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1383/2774] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:14:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:14:57.679318 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8a6e60de-063e-4865-818c-28513dd957b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b8dcbd007194e4896da66708312f275', 'request_id': 'req-8a6e60de-063e-4865-818c-28513dd957b9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:57.758564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8a6e60de-063e-4865-818c-28513dd957b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b8dcbd007194e4896da66708312f275', 'request_id': 'req-8a6e60de-063e-4865-818c-28513dd957b9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:57.773618 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8a6e60de-063e-4865-818c-28513dd957b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b8dcbd007194e4896da66708312f275', 'request_id': 'req-8a6e60de-063e-4865-818c-28513dd957b9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:57.885469 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8a6e60de-063e-4865-818c-28513dd957b9 admin admin] The token cache is being invalidate because project 6b8dcbd007194e4896da66708312f275 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:14:57.885794 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8a6e60de-063e-4865-818c-28513dd957b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:57.887496 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8a6e60de-063e-4865-818c-28513dd957b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:14:57.892587 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1392/2775] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:14:57 2022] DELETE /identity/v3/projects/6b8dcbd007194e4896da66708312f275 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:14:57.898282 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9743a-030c-4414-9698-1ada57f3e8d0 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:57.898939 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9743a-030c-4414-9698-1ada57f3e8d0 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:57.899377 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9743a-030c-4414-9698-1ada57f3e8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:57.938404 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-cfa9743a-030c-4414-9698-1ada57f3e8d0 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:14:57.940827 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-cfa9743a-030c-4414-9698-1ada57f3e8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:58.175848 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1384/2776] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:14:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:14:58.233540 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d40c01-bb71-4c60-a93d-9e3de59401b3 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:58.244308 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d40c01-bb71-4c60-a93d-9e3de59401b3 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:58.244308 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d40c01-bb71-4c60-a93d-9e3de59401b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:58.317110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-c1d40c01-bb71-4c60-a93d-9e3de59401b3 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:14:58.317110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c1d40c01-bb71-4c60-a93d-9e3de59401b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:58.328547 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1393/2777] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:14:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:14:58.332599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9743a-030c-4414-9698-1ada57f3e8d0 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:58.356136 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9743a-030c-4414-9698-1ada57f3e8d0 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:58.366999 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac5495-3ebc-4427-a207-910b4fe7ddf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:58.368747 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac5495-3ebc-4427-a207-910b4fe7ddf7 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:58.369097 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac5495-3ebc-4427-a207-910b4fe7ddf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:58.369508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac5495-3ebc-4427-a207-910b4fe7ddf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:58.372315 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac5495-3ebc-4427-a207-910b4fe7ddf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:14:58.372767 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac5495-3ebc-4427-a207-910b4fe7ddf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:58.378837 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac5495-3ebc-4427-a207-910b4fe7ddf7 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:58.410468 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1385/2778] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:14:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:14:58.415363 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d40c01-bb71-4c60-a93d-9e3de59401b3 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:58.430076 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d40c01-bb71-4c60-a93d-9e3de59401b3 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:58.446638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e60e8e-3979-4b0e-aff5-bcf5be3187e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:58.448033 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e60e8e-3979-4b0e-aff5-bcf5be3187e6 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:58.449893 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e60e8e-3979-4b0e-aff5-bcf5be3187e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:58.450198 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e60e8e-3979-4b0e-aff5-bcf5be3187e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:58.452927 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e60e8e-3979-4b0e-aff5-bcf5be3187e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:58.461820 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e60e8e-3979-4b0e-aff5-bcf5be3187e6 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:58.626936 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1394/2779] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:14:58 2022] POST /identity/v3/projects => generated 389 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:14:58.631574 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac5495-3ebc-4427-a207-910b4fe7ddf7 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:58.645261 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac5495-3ebc-4427-a207-910b4fe7ddf7 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:58.799707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae1e56-eac2-4c5b-8c15-77621d1c57b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:58.800391 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae1e56-eac2-4c5b-8c15-77621d1c57b0 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:58.800672 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae1e56-eac2-4c5b-8c15-77621d1c57b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:58.800949 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae1e56-eac2-4c5b-8c15-77621d1c57b0 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:58.801650 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae1e56-eac2-4c5b-8c15-77621d1c57b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:58.804163 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae1e56-eac2-4c5b-8c15-77621d1c57b0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:58.917056 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1386/2780] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:14:58 2022] POST /identity/v3/users => generated 295 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:14:58.920857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e60e8e-3979-4b0e-aff5-bcf5be3187e6 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:58.940966 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e60e8e-3979-4b0e-aff5-bcf5be3187e6 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:58.948488 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ad281-6211-47aa-9098-8f64db4fcaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:58.949677 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ad281-6211-47aa-9098-8f64db4fcaab admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:58.950229 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ad281-6211-47aa-9098-8f64db4fcaab admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:58.950717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ad281-6211-47aa-9098-8f64db4fcaab admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:58.953794 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ad281-6211-47aa-9098-8f64db4fcaab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:58.956218 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ad281-6211-47aa-9098-8f64db4fcaab admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:59.021601 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1395/2781] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:14:59.025112 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae1e56-eac2-4c5b-8c15-77621d1c57b0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:59.042583 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae1e56-eac2-4c5b-8c15-77621d1c57b0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:59.052123 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c492e5-d707-4bb9-94a1-62d9a01a5e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:59.053905 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c492e5-d707-4bb9-94a1-62d9a01a5e4d admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:59.054210 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c492e5-d707-4bb9-94a1-62d9a01a5e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:59.054502 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c492e5-d707-4bb9-94a1-62d9a01a5e4d admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:59.055251 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c492e5-d707-4bb9-94a1-62d9a01a5e4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:59.057039 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c492e5-d707-4bb9-94a1-62d9a01a5e4d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:59.085797 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1387/2782] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:14:59.091094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ad281-6211-47aa-9098-8f64db4fcaab admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:59.106686 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ad281-6211-47aa-9098-8f64db4fcaab admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:59.147903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f06b2-bb98-42fa-ba83-09eadd7502b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:59.150221 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f06b2-bb98-42fa-ba83-09eadd7502b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:59.150521 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f06b2-bb98-42fa-ba83-09eadd7502b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:59.150809 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f06b2-bb98-42fa-ba83-09eadd7502b9 admin admin] PATH_INFO: `/v3/projects/5bef6edb2a2643058fb3a949e2a7b8d5/users/968effb522784ff2825a24cfdf19a666/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:59.239938 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f06b2-bb98-42fa-ba83-09eadd7502b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bef6edb2a2643058fb3a949e2a7b8d5, user_id=968effb522784ff2825a24cfdf19a666, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:59.256784 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f06b2-bb98-42fa-ba83-09eadd7502b9 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:59.393958 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1396/2783] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:14:59 2022] PUT /identity/v3/projects/5bef6edb2a2643058fb3a949e2a7b8d5/users/968effb522784ff2825a24cfdf19a666/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:14:59.399060 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4fe63d-d125-4324-9b91-92f350260c8b None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:59.399574 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4fe63d-d125-4324-9b91-92f350260c8b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:59.399690 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4fe63d-d125-4324-9b91-92f350260c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:59.441668 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-ed4fe63d-d125-4324-9b91-92f350260c8b None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:14:59.446185 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ed4fe63d-d125-4324-9b91-92f350260c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:59.516360 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cd903-0d22-4da7-b8bb-3b0b5b165c7b None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:59.516645 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cd903-0d22-4da7-b8bb-3b0b5b165c7b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:59.517218 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cd903-0d22-4da7-b8bb-3b0b5b165c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:59.575422 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1388/2784] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:14:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:14:59.576505 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4fe63d-d125-4324-9b91-92f350260c8b None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:59.581794 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ed4fe63d-d125-4324-9b91-92f350260c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:59.600407 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-c16cd903-0d22-4da7-b8bb-3b0b5b165c7b None None] MFA Rules not processed for user `664c0809d310462a8376b932c1f99aa1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:14:59.602986 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c16cd903-0d22-4da7-b8bb-3b0b5b165c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:14:59.726123 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4fe63d-d125-4324-9b91-92f350260c8b None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:14:59.739359 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e864254-8d65-4adf-878c-4440bc36b235 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:14:59.747411 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e864254-8d65-4adf-878c-4440bc36b235 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:14:59.747411 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e864254-8d65-4adf-878c-4440bc36b235 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:14:59.747411 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e864254-8d65-4adf-878c-4440bc36b235 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:14:59.794263 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e864254-8d65-4adf-878c-4440bc36b235 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:14:59.803959 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e864254-8d65-4adf-878c-4440bc36b235 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:14:59.819549 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1389/2785] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:14:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:14:59.896440 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1397/2786] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:14:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:14:59.957525 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e864254-8d65-4adf-878c-4440bc36b235 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:14:59.961089 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1e864254-8d65-4adf-878c-4440bc36b235 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:15:00.087630 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e864254-8d65-4adf-878c-4440bc36b235 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:15:00.096233 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e618e7a-d4ad-428c-b3cd-49d32cf104f2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e302b1298dd04d6590e3d079f7b13b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:15:00.101399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e618e7a-d4ad-428c-b3cd-49d32cf104f2 service glance] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:00.101399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e618e7a-d4ad-428c-b3cd-49d32cf104f2 service glance] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:00.101399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e618e7a-d4ad-428c-b3cd-49d32cf104f2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:00.118810 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e618e7a-d4ad-428c-b3cd-49d32cf104f2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:15:00.120499 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e618e7a-d4ad-428c-b3cd-49d32cf104f2 service glance] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:15:00.155885 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1390/2787] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:14:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:15:03.319443 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b7cdb-2b43-4ae6-ac61-cbad4a43f901 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:03.320016 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b7cdb-2b43-4ae6-ac61-cbad4a43f901 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:03.320016 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b7cdb-2b43-4ae6-ac61-cbad4a43f901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:03.379906 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-a21b7cdb-2b43-4ae6-ac61-cbad4a43f901 None None] MFA Rules not processed for user `968effb522784ff2825a24cfdf19a666`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:15:03.379906 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a21b7cdb-2b43-4ae6-ac61-cbad4a43f901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:15:03.486185 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1398/2788] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:15:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:15:03.499119 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e618e7a-d4ad-428c-b3cd-49d32cf104f2 service glance] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:15:03.500563 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1e618e7a-d4ad-428c-b3cd-49d32cf104f2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:15:03.667063 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e618e7a-d4ad-428c-b3cd-49d32cf104f2 service glance] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:15:03.680194 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0bfa3-d9fd-4035-a117-9aa900fcea4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:15:03.684907 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0bfa3-d9fd-4035-a117-9aa900fcea4c service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:03.685139 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0bfa3-d9fd-4035-a117-9aa900fcea4c service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:03.686726 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0bfa3-d9fd-4035-a117-9aa900fcea4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:03.709539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d0bfa3-d9fd-4035-a117-9aa900fcea4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:15:03.709539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d0bfa3-d9fd-4035-a117-9aa900fcea4c service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:15:03.734488 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1391/2789] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:15:03 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:15:08.055044 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b7cdb-2b43-4ae6-ac61-cbad4a43f901 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:15:08.056671 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a21b7cdb-2b43-4ae6-ac61-cbad4a43f901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:15:08.073389 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b7cdb-2b43-4ae6-ac61-cbad4a43f901 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:15:08.079136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f58e2-22a9-4b63-aa2a-767d9786ad3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:15:08.079775 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f58e2-22a9-4b63-aa2a-767d9786ad3f service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:08.080061 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f58e2-22a9-4b63-aa2a-767d9786ad3f service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:08.080334 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f58e2-22a9-4b63-aa2a-767d9786ad3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:08.082109 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2c9f58e2-22a9-4b63-aa2a-767d9786ad3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:15:08.145045 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f58e2-22a9-4b63-aa2a-767d9786ad3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:15:08.146721 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f58e2-22a9-4b63-aa2a-767d9786ad3f service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:15:08.157302 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1399/2790] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:15:08 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:15:08.493150 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137b58f-5e29-4d76-b6c5-2b0378b7d4f4 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:08.494390 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137b58f-5e29-4d76-b6c5-2b0378b7d4f4 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:08.494850 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137b58f-5e29-4d76-b6c5-2b0378b7d4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:08.513802 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-4137b58f-5e29-4d76-b6c5-2b0378b7d4f4 None None] MFA Rules not processed for user `d57b97f51d2f4aa6869b41518f14d3aa`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:15:08.515694 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4137b58f-5e29-4d76-b6c5-2b0378b7d4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:15:08.604833 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1392/2791] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:15:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:15:12.110107 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1eded-ebe3-44c2-8bd7-933137c08732 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:12.110910 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1eded-ebe3-44c2-8bd7-933137c08732 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:12.111429 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1eded-ebe3-44c2-8bd7-933137c08732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:12.134261 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-0fa1eded-ebe3-44c2-8bd7-933137c08732 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:15:12.135882 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0fa1eded-ebe3-44c2-8bd7-933137c08732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:15:12.218265 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1400/2792] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:15:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:15:12.236710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137b58f-5e29-4d76-b6c5-2b0378b7d4f4 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:15:12.239440 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4137b58f-5e29-4d76-b6c5-2b0378b7d4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:15:12.347584 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137b58f-5e29-4d76-b6c5-2b0378b7d4f4 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:15:12.354267 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280a00e-5414-45a1-a557-350fd24502bd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:15:12.354942 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280a00e-5414-45a1-a557-350fd24502bd service swift] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:12.355232 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280a00e-5414-45a1-a557-350fd24502bd service swift] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:12.355528 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280a00e-5414-45a1-a557-350fd24502bd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:12.376184 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280a00e-5414-45a1-a557-350fd24502bd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:15:12.377957 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280a00e-5414-45a1-a557-350fd24502bd service swift] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:15:12.401648 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1393/2793] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:15:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:15:15.121331 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc433e-908e-4839-a8ec-834d065354c0 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:15.122356 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc433e-908e-4839-a8ec-834d065354c0 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:15.122956 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc433e-908e-4839-a8ec-834d065354c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:15.148268 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-35dc433e-908e-4839-a8ec-834d065354c0 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:15:15.150090 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-35dc433e-908e-4839-a8ec-834d065354c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:15:15.160477 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1401/2794] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:15:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:15:15.183490 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280a00e-5414-45a1-a557-350fd24502bd service swift] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:15:15.195554 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280a00e-5414-45a1-a557-350fd24502bd service swift] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:15:15.201749 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e68745e-e7a5-4be7-8055-ef982ce23da1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:15:15.202581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68745e-e7a5-4be7-8055-ef982ce23da1 service swift] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:15.202862 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68745e-e7a5-4be7-8055-ef982ce23da1 service swift] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:15.203135 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68745e-e7a5-4be7-8055-ef982ce23da1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:15.213121 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e68745e-e7a5-4be7-8055-ef982ce23da1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:15:15.217400 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e68745e-e7a5-4be7-8055-ef982ce23da1 service swift] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:15:15.229172 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1394/2795] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:15:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:15:20.169103 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc433e-908e-4839-a8ec-834d065354c0 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:15:20.180193 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc433e-908e-4839-a8ec-834d065354c0 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:15:20.185348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb772b-f6ab-4d05-a56a-3c95f9c8070f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:15:20.190720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb772b-f6ab-4d05-a56a-3c95f9c8070f service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:20.190720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb772b-f6ab-4d05-a56a-3c95f9c8070f service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:20.190720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb772b-f6ab-4d05-a56a-3c95f9c8070f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:20.190720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c5bb772b-f6ab-4d05-a56a-3c95f9c8070f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:15:20.207334 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb772b-f6ab-4d05-a56a-3c95f9c8070f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:15:20.209790 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb772b-f6ab-4d05-a56a-3c95f9c8070f service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:15:20.231930 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1402/2796] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:15:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:15:24.383778 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e68745e-e7a5-4be7-8055-ef982ce23da1 service swift] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:15:24.419284 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e68745e-e7a5-4be7-8055-ef982ce23da1 service swift] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:15:24.419284 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5fb721-61e1-403a-b78c-1025fcdac92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:15:24.419284 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fb721-61e1-403a-b78c-1025fcdac92a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:24.419284 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fb721-61e1-403a-b78c-1025fcdac92a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:24.419734 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fb721-61e1-403a-b78c-1025fcdac92a admin admin] PATH_INFO: `/v3/users/968effb522784ff2825a24cfdf19a666` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:24.419734 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5fb721-61e1-403a-b78c-1025fcdac92a admin admin] RBAC: Authorizing `identity:delete_user(user_id=968effb522784ff2825a24cfdf19a666)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:15:24.429940 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5fb721-61e1-403a-b78c-1025fcdac92a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:15:24.661671 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4c5fb721-61e1-403a-b78c-1025fcdac92a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '968effb522784ff2825a24cfdf19a666'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:15:24.700063 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4c5fb721-61e1-403a-b78c-1025fcdac92a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '968effb522784ff2825a24cfdf19a666'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:15:24.850594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4c5fb721-61e1-403a-b78c-1025fcdac92a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '968effb522784ff2825a24cfdf19a666'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:15:24.860623 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4c5fb721-61e1-403a-b78c-1025fcdac92a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '968effb522784ff2825a24cfdf19a666'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:15:24.861409 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4c5fb721-61e1-403a-b78c-1025fcdac92a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '968effb522784ff2825a24cfdf19a666'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:15:24.878009 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1395/2797] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:15:24 2022] DELETE /identity/v3/users/968effb522784ff2825a24cfdf19a666 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:15:25.295422 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb772b-f6ab-4d05-a56a-3c95f9c8070f service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:15:25.308169 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5fb721-61e1-403a-b78c-1025fcdac92a admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:15:25.310283 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4c5fb721-61e1-403a-b78c-1025fcdac92a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:15:25.315807 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb772b-f6ab-4d05-a56a-3c95f9c8070f service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:15:25.438011 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5fb721-61e1-403a-b78c-1025fcdac92a admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:15:25.447417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e972f6-b7cd-4fcf-b28a-6e80064a6e22 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:15:25.448339 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e972f6-b7cd-4fcf-b28a-6e80064a6e22 service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:25.448880 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e972f6-b7cd-4fcf-b28a-6e80064a6e22 service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:25.450002 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e972f6-b7cd-4fcf-b28a-6e80064a6e22 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:25.452833 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-44e972f6-b7cd-4fcf-b28a-6e80064a6e22 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:15:25.468577 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e972f6-b7cd-4fcf-b28a-6e80064a6e22 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:15:25.470854 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e972f6-b7cd-4fcf-b28a-6e80064a6e22 service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:15:25.485693 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1396/2798] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:15:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:15:25.486308 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4d9d4-2112-4221-8202-0ad2e6f57e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:15:25.487191 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4d9d4-2112-4221-8202-0ad2e6f57e2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:25.487477 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4d9d4-2112-4221-8202-0ad2e6f57e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:25.487751 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4d9d4-2112-4221-8202-0ad2e6f57e2e admin admin] PATH_INFO: `/v3/projects/5bef6edb2a2643058fb3a949e2a7b8d5` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:25.490485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4d9d4-2112-4221-8202-0ad2e6f57e2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bef6edb2a2643058fb3a949e2a7b8d5)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:15:25.495129 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4d9d4-2112-4221-8202-0ad2e6f57e2e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:15:25.690669 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e0a4d9d4-2112-4221-8202-0ad2e6f57e2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bef6edb2a2643058fb3a949e2a7b8d5', 'request_id': 'req-e0a4d9d4-2112-4221-8202-0ad2e6f57e2e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:15:25.703666 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e0a4d9d4-2112-4221-8202-0ad2e6f57e2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bef6edb2a2643058fb3a949e2a7b8d5', 'request_id': 'req-e0a4d9d4-2112-4221-8202-0ad2e6f57e2e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:15:25.715833 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e0a4d9d4-2112-4221-8202-0ad2e6f57e2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bef6edb2a2643058fb3a949e2a7b8d5', 'request_id': 'req-e0a4d9d4-2112-4221-8202-0ad2e6f57e2e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:15:25.817319 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e0a4d9d4-2112-4221-8202-0ad2e6f57e2e admin admin] The token cache is being invalidate because project 5bef6edb2a2643058fb3a949e2a7b8d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:15:25.817582 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e0a4d9d4-2112-4221-8202-0ad2e6f57e2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:15:25.819012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e0a4d9d4-2112-4221-8202-0ad2e6f57e2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:15:25.820613 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1403/2799] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:15:25 2022] DELETE /identity/v3/projects/5bef6edb2a2643058fb3a949e2a7b8d5 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:15:25.827142 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97ff80-3084-4156-9c09-471977ca0edd None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:25.827723 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97ff80-3084-4156-9c09-471977ca0edd None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:25.828194 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97ff80-3084-4156-9c09-471977ca0edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:25.857708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-1d97ff80-3084-4156-9c09-471977ca0edd None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:15:25.859379 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1d97ff80-3084-4156-9c09-471977ca0edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:15:25.957196 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1397/2800] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:15:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:15:25.978235 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3ba14-14fa-4825-96b0-52f2136cd70a None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:25.978881 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3ba14-14fa-4825-96b0-52f2136cd70a None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:25.979775 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3ba14-14fa-4825-96b0-52f2136cd70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:26.008121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-02e3ba14-14fa-4825-96b0-52f2136cd70a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:15:26.010918 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-02e3ba14-14fa-4825-96b0-52f2136cd70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:15:26.024424 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1404/2801] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:15:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:15:26.028257 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97ff80-3084-4156-9c09-471977ca0edd None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:15:26.045512 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97ff80-3084-4156-9c09-471977ca0edd None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:15:26.064321 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb8daba-926b-4545-b3e3-354908b22438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:15:26.068137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8daba-926b-4545-b3e3-354908b22438 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:26.068137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8daba-926b-4545-b3e3-354908b22438 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:26.068137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8daba-926b-4545-b3e3-354908b22438 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:26.068137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb8daba-926b-4545-b3e3-354908b22438 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:15:26.068137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb8daba-926b-4545-b3e3-354908b22438 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:15:26.127011 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb8daba-926b-4545-b3e3-354908b22438 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:15:26.165214 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1398/2802] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:15:26.179265 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e3ba14-14fa-4825-96b0-52f2136cd70a None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:15:26.192496 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e3ba14-14fa-4825-96b0-52f2136cd70a None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:15:26.202754 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02dd7d-0cd0-4b68-8009-809fd0b66bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:15:26.204043 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02dd7d-0cd0-4b68-8009-809fd0b66bfe admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:26.204537 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02dd7d-0cd0-4b68-8009-809fd0b66bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:26.205041 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02dd7d-0cd0-4b68-8009-809fd0b66bfe admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:26.206226 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff02dd7d-0cd0-4b68-8009-809fd0b66bfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:15:26.209683 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff02dd7d-0cd0-4b68-8009-809fd0b66bfe admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:15:26.777822 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1405/2803] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:15:26 2022] POST /identity/v3/projects => generated 405 bytes in 599 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:15:26.781941 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb8daba-926b-4545-b3e3-354908b22438 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:15:26.794020 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb8daba-926b-4545-b3e3-354908b22438 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:15:26.891023 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad4617-505a-45b9-a578-a55f3c412fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:15:26.891699 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad4617-505a-45b9-a578-a55f3c412fa5 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:26.891984 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad4617-505a-45b9-a578-a55f3c412fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:26.892261 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad4617-505a-45b9-a578-a55f3c412fa5 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:26.893095 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad4617-505a-45b9-a578-a55f3c412fa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:15:26.895108 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad4617-505a-45b9-a578-a55f3c412fa5 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:15:27.032746 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1399/2804] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:15:26 2022] POST /identity/v3/users => generated 303 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:15:27.040459 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02dd7d-0cd0-4b68-8009-809fd0b66bfe admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:15:27.068888 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02dd7d-0cd0-4b68-8009-809fd0b66bfe admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:15:27.093119 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef062abd-5f63-4278-91ea-763c52434cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:15:27.094263 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef062abd-5f63-4278-91ea-763c52434cac admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:27.094790 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef062abd-5f63-4278-91ea-763c52434cac admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:27.095310 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef062abd-5f63-4278-91ea-763c52434cac admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:27.096446 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef062abd-5f63-4278-91ea-763c52434cac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:15:27.098889 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef062abd-5f63-4278-91ea-763c52434cac admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:15:27.140652 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1406/2805] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:15:27.144759 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad4617-505a-45b9-a578-a55f3c412fa5 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:15:27.156171 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad4617-505a-45b9-a578-a55f3c412fa5 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:15:27.174898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f1d7f-73d2-4be2-900f-118c2b1a9a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:15:27.175603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f1d7f-73d2-4be2-900f-118c2b1a9a47 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:27.175887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f1d7f-73d2-4be2-900f-118c2b1a9a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:27.176284 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f1d7f-73d2-4be2-900f-118c2b1a9a47 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:27.177035 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f1d7f-73d2-4be2-900f-118c2b1a9a47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:15:27.178843 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f1d7f-73d2-4be2-900f-118c2b1a9a47 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:15:27.199102 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1400/2806] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:15:27.203438 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef062abd-5f63-4278-91ea-763c52434cac admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:15:27.235345 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef062abd-5f63-4278-91ea-763c52434cac admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:15:27.271084 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0daa87-dbf8-411f-9d08-b1508177ae7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:15:27.272402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0daa87-dbf8-411f-9d08-b1508177ae7f admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:27.273354 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0daa87-dbf8-411f-9d08-b1508177ae7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:27.274011 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0daa87-dbf8-411f-9d08-b1508177ae7f admin admin] PATH_INFO: `/v3/projects/9c1c7ed40c5a481b8c2792b7e13a09d9/users/86aa08b473554c2fa06442cbb10d5808/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:27.315417 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0daa87-dbf8-411f-9d08-b1508177ae7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c1c7ed40c5a481b8c2792b7e13a09d9, user_id=86aa08b473554c2fa06442cbb10d5808, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:15:27.322098 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0daa87-dbf8-411f-9d08-b1508177ae7f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:15:27.427520 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1407/2807] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:15:27 2022] PUT /identity/v3/projects/9c1c7ed40c5a481b8c2792b7e13a09d9/users/86aa08b473554c2fa06442cbb10d5808/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:15:27.435587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f0dee-8f1f-4e0e-949e-f52b08973295 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:27.436301 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f0dee-8f1f-4e0e-949e-f52b08973295 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:27.436589 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f0dee-8f1f-4e0e-949e-f52b08973295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:27.481104 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-4f7f0dee-8f1f-4e0e-949e-f52b08973295 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:15:27.485300 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4f7f0dee-8f1f-4e0e-949e-f52b08973295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:15:27.628672 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1401/2808] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:15:27.636217 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0daa87-dbf8-411f-9d08-b1508177ae7f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:15:27.638801 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8f0daa87-dbf8-411f-9d08-b1508177ae7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:15:27.753093 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0daa87-dbf8-411f-9d08-b1508177ae7f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:15:27.764212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd6558-d7e4-43e3-9ba0-99d656e23637 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:15:27.764943 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd6558-d7e4-43e3-9ba0-99d656e23637 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:27.765235 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd6558-d7e4-43e3-9ba0-99d656e23637 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:27.765567 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd6558-d7e4-43e3-9ba0-99d656e23637 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:27.779775 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cd6558-d7e4-43e3-9ba0-99d656e23637 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:15:27.787322 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cd6558-d7e4-43e3-9ba0-99d656e23637 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:15:27.864434 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1408/2809] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:15:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:15:29.468229 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f0dee-8f1f-4e0e-949e-f52b08973295 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:15:29.469680 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4f7f0dee-8f1f-4e0e-949e-f52b08973295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:15:29.630516 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f0dee-8f1f-4e0e-949e-f52b08973295 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:15:29.637500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25b114-6bb4-4ef5-b877-a6029fee29f5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e302b1298dd04d6590e3d079f7b13b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:15:29.640919 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25b114-6bb4-4ef5-b877-a6029fee29f5 service glance] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:29.641872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25b114-6bb4-4ef5-b877-a6029fee29f5 service glance] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:29.642348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25b114-6bb4-4ef5-b877-a6029fee29f5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:29.648859 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1e25b114-6bb4-4ef5-b877-a6029fee29f5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:15:29.852632 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25b114-6bb4-4ef5-b877-a6029fee29f5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:15:29.855593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25b114-6bb4-4ef5-b877-a6029fee29f5 service glance] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:15:29.891294 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1402/2810] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:15:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:15:30.968357 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b774447-5090-4dec-b55f-e6a40bfd34ee None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:30.968357 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b774447-5090-4dec-b55f-e6a40bfd34ee None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:30.968357 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b774447-5090-4dec-b55f-e6a40bfd34ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:31.000255 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-7b774447-5090-4dec-b55f-e6a40bfd34ee None None] MFA Rules not processed for user `86aa08b473554c2fa06442cbb10d5808`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:15:31.017387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7b774447-5090-4dec-b55f-e6a40bfd34ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:15:31.175326 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1409/2811] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:15:30 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:15:31.193423 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25b114-6bb4-4ef5-b877-a6029fee29f5 service glance] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:15:31.196141 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1e25b114-6bb4-4ef5-b877-a6029fee29f5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:15:31.216785 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25b114-6bb4-4ef5-b877-a6029fee29f5 service glance] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:15:31.227798 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ab7f6-3be9-47ae-90bc-c5b1ee47f8be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:15:31.227798 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ab7f6-3be9-47ae-90bc-c5b1ee47f8be service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:31.227798 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ab7f6-3be9-47ae-90bc-c5b1ee47f8be service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:31.227798 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ab7f6-3be9-47ae-90bc-c5b1ee47f8be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:31.229561 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ea9ab7f6-3be9-47ae-90bc-c5b1ee47f8be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:15:31.291770 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ab7f6-3be9-47ae-90bc-c5b1ee47f8be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:15:31.293373 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ab7f6-3be9-47ae-90bc-c5b1ee47f8be service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:15:31.302833 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1403/2812] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:15:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:15:31.429225 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b774447-5090-4dec-b55f-e6a40bfd34ee None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:15:31.430930 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7b774447-5090-4dec-b55f-e6a40bfd34ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:15:31.449709 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b774447-5090-4dec-b55f-e6a40bfd34ee None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:15:31.455413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2c634-6053-47fa-bbf0-1cf392263ec1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:15:31.456169 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2c634-6053-47fa-bbf0-1cf392263ec1 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:31.456455 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2c634-6053-47fa-bbf0-1cf392263ec1 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:31.456731 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2c634-6053-47fa-bbf0-1cf392263ec1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:31.466356 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2c634-6053-47fa-bbf0-1cf392263ec1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:15:31.467992 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2c634-6053-47fa-bbf0-1cf392263ec1 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:15:31.481112 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1410/2813] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:15:31 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:15:34.610018 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ab7f6-3be9-47ae-90bc-c5b1ee47f8be service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:15:34.625511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ab7f6-3be9-47ae-90bc-c5b1ee47f8be service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:15:34.630425 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694c94f-c6f6-40e8-8013-16b8b967d129 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:15:34.631374 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694c94f-c6f6-40e8-8013-16b8b967d129 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:34.631838 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694c94f-c6f6-40e8-8013-16b8b967d129 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:34.632282 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694c94f-c6f6-40e8-8013-16b8b967d129 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:34.644332 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d694c94f-c6f6-40e8-8013-16b8b967d129 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:15:34.649559 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d694c94f-c6f6-40e8-8013-16b8b967d129 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:15:34.652020 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d694c94f-c6f6-40e8-8013-16b8b967d129 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:15:34.663948 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1404/2814] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:15:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:15:35.545794 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1d039-f491-47bd-bbe2-db5a25c8525a None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:35.548875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1d039-f491-47bd-bbe2-db5a25c8525a None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:35.549099 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1d039-f491-47bd-bbe2-db5a25c8525a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:35.573719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-27a1d039-f491-47bd-bbe2-db5a25c8525a None None] MFA Rules not processed for user `8c1eeba696174da1be8aba8dcce6b112`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:15:35.575326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-27a1d039-f491-47bd-bbe2-db5a25c8525a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:15:35.583213 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1411/2815] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:15:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:15:36.818287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd19aa1-c97a-4112-846b-2d932c5110ab None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:36.818801 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd19aa1-c97a-4112-846b-2d932c5110ab None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:36.819237 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd19aa1-c97a-4112-846b-2d932c5110ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:36.849957 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-0fd19aa1-c97a-4112-846b-2d932c5110ab None None] MFA Rules not processed for user `ddcc9f1b17c94698a5df6ffc6482149f`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:15:36.851412 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0fd19aa1-c97a-4112-846b-2d932c5110ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:15:36.907731 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1405/2816] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:15:36 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:15:40.922303 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba7128-8598-42f2-83e5-a1fee058b9ec None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:40.932447 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba7128-8598-42f2-83e5-a1fee058b9ec None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:40.932447 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba7128-8598-42f2-83e5-a1fee058b9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:40.948235 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-a3ba7128-8598-42f2-83e5-a1fee058b9ec None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:15:40.949645 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a3ba7128-8598-42f2-83e5-a1fee058b9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:15:41.020549 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1412/2817] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:15:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:15:41.033542 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd19aa1-c97a-4112-846b-2d932c5110ab None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:15:41.035729 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0fd19aa1-c97a-4112-846b-2d932c5110ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:15:41.134487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd19aa1-c97a-4112-846b-2d932c5110ab None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:15:41.153701 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4395e07-3502-4299-8fd8-cc2e4783fa93 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:15:41.155646 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4395e07-3502-4299-8fd8-cc2e4783fa93 service swift] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:41.155646 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4395e07-3502-4299-8fd8-cc2e4783fa93 service swift] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:41.155646 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4395e07-3502-4299-8fd8-cc2e4783fa93 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:41.166067 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4395e07-3502-4299-8fd8-cc2e4783fa93 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:15:41.167985 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4395e07-3502-4299-8fd8-cc2e4783fa93 service swift] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:15:41.188022 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1406/2818] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:15:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:15:44.975729 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2ac58-1e82-4196-8a19-4a05a591fcec None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:44.976719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2ac58-1e82-4196-8a19-4a05a591fcec None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:44.977177 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2ac58-1e82-4196-8a19-4a05a591fcec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:45.010869 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-aca2ac58-1e82-4196-8a19-4a05a591fcec None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:15:45.012428 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-aca2ac58-1e82-4196-8a19-4a05a591fcec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:15:45.029463 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1413/2819] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:15:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:15:45.052685 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4395e07-3502-4299-8fd8-cc2e4783fa93 service swift] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:15:45.064898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4395e07-3502-4299-8fd8-cc2e4783fa93 service swift] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:15:45.072801 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2ac58-1e82-4196-8a19-4a05a591fcec None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:15:45.086688 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e37141-72ba-4d93-bd7b-b070d0a63b6f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:15:45.086855 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e37141-72ba-4d93-bd7b-b070d0a63b6f service swift] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:45.087099 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e37141-72ba-4d93-bd7b-b070d0a63b6f service swift] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:45.087574 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e37141-72ba-4d93-bd7b-b070d0a63b6f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:45.104392 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e37141-72ba-4d93-bd7b-b070d0a63b6f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:15:45.107987 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e37141-72ba-4d93-bd7b-b070d0a63b6f service swift] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:15:45.110517 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2ac58-1e82-4196-8a19-4a05a591fcec None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:15:45.122029 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc4152-6d96-414f-b78d-78336ad68e33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:15:45.123183 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc4152-6d96-414f-b78d-78336ad68e33 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:45.123711 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc4152-6d96-414f-b78d-78336ad68e33 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:45.124217 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc4152-6d96-414f-b78d-78336ad68e33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:45.124600 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1407/2820] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:15:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:15:45.127588 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b8cc4152-6d96-414f-b78d-78336ad68e33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:15:45.205553 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc4152-6d96-414f-b78d-78336ad68e33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:15:45.212343 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc4152-6d96-414f-b78d-78336ad68e33 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:15:45.249214 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1414/2821] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:15:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:15:47.323116 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e37141-72ba-4d93-bd7b-b070d0a63b6f service swift] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:15:47.340829 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e37141-72ba-4d93-bd7b-b070d0a63b6f service swift] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:15:47.347970 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb6420-e432-4524-a367-ab8149ef48d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:15:47.349081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb6420-e432-4524-a367-ab8149ef48d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:47.349538 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb6420-e432-4524-a367-ab8149ef48d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:47.350013 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb6420-e432-4524-a367-ab8149ef48d9 admin admin] PATH_INFO: `/v3/users/86aa08b473554c2fa06442cbb10d5808` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:47.351423 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb6420-e432-4524-a367-ab8149ef48d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86aa08b473554c2fa06442cbb10d5808)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:15:47.354036 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb6420-e432-4524-a367-ab8149ef48d9 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:15:47.560157 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ecfb6420-e432-4524-a367-ab8149ef48d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86aa08b473554c2fa06442cbb10d5808'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:15:47.582415 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ecfb6420-e432-4524-a367-ab8149ef48d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86aa08b473554c2fa06442cbb10d5808'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:15:47.605807 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc4152-6d96-414f-b78d-78336ad68e33 service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:15:47.619221 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc4152-6d96-414f-b78d-78336ad68e33 service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:15:47.629814 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54deb85a-c5a8-4d21-a767-f90889c65f53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:15:47.630791 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54deb85a-c5a8-4d21-a767-f90889c65f53 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:47.631169 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54deb85a-c5a8-4d21-a767-f90889c65f53 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:47.631583 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54deb85a-c5a8-4d21-a767-f90889c65f53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:47.633538 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-54deb85a-c5a8-4d21-a767-f90889c65f53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:15:47.649605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54deb85a-c5a8-4d21-a767-f90889c65f53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:15:47.651608 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54deb85a-c5a8-4d21-a767-f90889c65f53 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:15:47.665950 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1415/2822] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:15:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:15:47.670560 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ecfb6420-e432-4524-a367-ab8149ef48d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86aa08b473554c2fa06442cbb10d5808'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:15:47.680076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ecfb6420-e432-4524-a367-ab8149ef48d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86aa08b473554c2fa06442cbb10d5808'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:15:47.681070 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ecfb6420-e432-4524-a367-ab8149ef48d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86aa08b473554c2fa06442cbb10d5808'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:15:47.690072 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1408/2823] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:15:47 2022] DELETE /identity/v3/users/86aa08b473554c2fa06442cbb10d5808 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:15:48.382869 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54deb85a-c5a8-4d21-a767-f90889c65f53 service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:15:48.444660 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54deb85a-c5a8-4d21-a767-f90889c65f53 service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:15:48.645342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8a6ff-c013-4606-a6bb-65e1c6c2a957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:15:48.645342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8a6ff-c013-4606-a6bb-65e1c6c2a957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:48.645342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8a6ff-c013-4606-a6bb-65e1c6c2a957 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:48.645342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8a6ff-c013-4606-a6bb-65e1c6c2a957 admin admin] PATH_INFO: `/v3/projects/9c1c7ed40c5a481b8c2792b7e13a09d9` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:48.647330 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea8a6ff-c013-4606-a6bb-65e1c6c2a957 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c1c7ed40c5a481b8c2792b7e13a09d9)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:15:48.647330 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea8a6ff-c013-4606-a6bb-65e1c6c2a957 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:15:49.438576 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-eea8a6ff-c013-4606-a6bb-65e1c6c2a957 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c1c7ed40c5a481b8c2792b7e13a09d9', 'request_id': 'req-eea8a6ff-c013-4606-a6bb-65e1c6c2a957'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:15:49.447568 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-eea8a6ff-c013-4606-a6bb-65e1c6c2a957 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c1c7ed40c5a481b8c2792b7e13a09d9', 'request_id': 'req-eea8a6ff-c013-4606-a6bb-65e1c6c2a957'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:15:49.455412 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-eea8a6ff-c013-4606-a6bb-65e1c6c2a957 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c1c7ed40c5a481b8c2792b7e13a09d9', 'request_id': 'req-eea8a6ff-c013-4606-a6bb-65e1c6c2a957'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:15:49.635112 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-eea8a6ff-c013-4606-a6bb-65e1c6c2a957 admin admin] The token cache is being invalidate because project 9c1c7ed40c5a481b8c2792b7e13a09d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:15:49.635112 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-eea8a6ff-c013-4606-a6bb-65e1c6c2a957 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:15:49.636371 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-eea8a6ff-c013-4606-a6bb-65e1c6c2a957 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:15:49.636778 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1416/2824] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:15:48 2022] DELETE /identity/v3/projects/9c1c7ed40c5a481b8c2792b7e13a09d9 => generated 0 bytes in 1255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:15:49.642133 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824efb1-970c-4dfd-b897-ce24f17bf0cf None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:49.642663 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824efb1-970c-4dfd-b897-ce24f17bf0cf None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:49.642663 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824efb1-970c-4dfd-b897-ce24f17bf0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:49.664246 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-3824efb1-970c-4dfd-b897-ce24f17bf0cf None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:15:49.664973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3824efb1-970c-4dfd-b897-ce24f17bf0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:15:49.827966 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1409/2825] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:15:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:15:49.836554 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f0ce1-6c70-444c-8eb6-de91bc782799 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:49.837140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f0ce1-6c70-444c-8eb6-de91bc782799 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:49.843622 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f0ce1-6c70-444c-8eb6-de91bc782799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:49.890465 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-c49f0ce1-6c70-444c-8eb6-de91bc782799 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:15:49.897460 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c49f0ce1-6c70-444c-8eb6-de91bc782799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:15:49.922920 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1417/2826] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:15:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:15:49.924137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824efb1-970c-4dfd-b897-ce24f17bf0cf None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:15:49.935547 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824efb1-970c-4dfd-b897-ce24f17bf0cf None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:15:49.956234 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c717329-fea9-4133-b3b5-f1ca7e623c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:15:49.957444 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c717329-fea9-4133-b3b5-f1ca7e623c55 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:49.958139 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c717329-fea9-4133-b3b5-f1ca7e623c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:49.958600 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c717329-fea9-4133-b3b5-f1ca7e623c55 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:49.959500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c717329-fea9-4133-b3b5-f1ca7e623c55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:15:49.960110 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c717329-fea9-4133-b3b5-f1ca7e623c55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:15:49.962175 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c717329-fea9-4133-b3b5-f1ca7e623c55 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:15:50.004340 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1410/2827] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:15:50.008429 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f0ce1-6c70-444c-8eb6-de91bc782799 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:15:50.024171 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f0ce1-6c70-444c-8eb6-de91bc782799 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:15:50.032501 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76e9f2-4f26-44dd-8343-47118f14e13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:15:50.034031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76e9f2-4f26-44dd-8343-47118f14e13c admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:50.034500 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76e9f2-4f26-44dd-8343-47118f14e13c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:50.035659 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76e9f2-4f26-44dd-8343-47118f14e13c admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:50.036583 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76e9f2-4f26-44dd-8343-47118f14e13c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:15:50.048579 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76e9f2-4f26-44dd-8343-47118f14e13c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:15:50.205567 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1418/2828] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:15:50 2022] POST /identity/v3/projects => generated 385 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:15:50.210022 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c717329-fea9-4133-b3b5-f1ca7e623c55 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:15:50.221160 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c717329-fea9-4133-b3b5-f1ca7e623c55 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:15:50.346419 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf10104-3b0b-48e3-b4af-b76f828f97c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:15:50.347630 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf10104-3b0b-48e3-b4af-b76f828f97c6 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:50.348141 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf10104-3b0b-48e3-b4af-b76f828f97c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:50.348620 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf10104-3b0b-48e3-b4af-b76f828f97c6 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:50.349878 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf10104-3b0b-48e3-b4af-b76f828f97c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:15:50.353365 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf10104-3b0b-48e3-b4af-b76f828f97c6 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:15:50.454926 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1411/2829] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:15:50 2022] POST /identity/v3/users => generated 293 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:15:50.459078 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76e9f2-4f26-44dd-8343-47118f14e13c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:15:50.472111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76e9f2-4f26-44dd-8343-47118f14e13c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:15:50.478881 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903e00d-c22f-444e-9309-53c7549b0929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:15:50.479577 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903e00d-c22f-444e-9309-53c7549b0929 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:50.479860 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903e00d-c22f-444e-9309-53c7549b0929 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:50.480139 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903e00d-c22f-444e-9309-53c7549b0929 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:50.480899 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f903e00d-c22f-444e-9309-53c7549b0929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:15:50.482577 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f903e00d-c22f-444e-9309-53c7549b0929 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:15:50.494867 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1419/2830] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:15:50.498936 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf10104-3b0b-48e3-b4af-b76f828f97c6 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:15:50.512458 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf10104-3b0b-48e3-b4af-b76f828f97c6 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:15:50.519274 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa46281-98d2-4f86-b480-a44cc6db487f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:15:50.520161 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa46281-98d2-4f86-b480-a44cc6db487f admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:50.520416 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa46281-98d2-4f86-b480-a44cc6db487f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:50.520748 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa46281-98d2-4f86-b480-a44cc6db487f admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:50.521484 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa46281-98d2-4f86-b480-a44cc6db487f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:15:50.523220 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa46281-98d2-4f86-b480-a44cc6db487f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:15:50.540833 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1412/2831] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:15:50.544635 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903e00d-c22f-444e-9309-53c7549b0929 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:15:50.558786 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903e00d-c22f-444e-9309-53c7549b0929 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:15:50.565188 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fabc6e-3769-46a7-9d01-195c45cbf66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:15:50.565447 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fabc6e-3769-46a7-9d01-195c45cbf66f admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:50.565869 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fabc6e-3769-46a7-9d01-195c45cbf66f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:50.566719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fabc6e-3769-46a7-9d01-195c45cbf66f admin admin] PATH_INFO: `/v3/projects/e06b74e20cb74d5f9eb71ef0ad13dc99/users/58114c225ebe4062af97802f266bbd6f/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:50.592125 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fabc6e-3769-46a7-9d01-195c45cbf66f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e06b74e20cb74d5f9eb71ef0ad13dc99, user_id=58114c225ebe4062af97802f266bbd6f, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:15:50.594209 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fabc6e-3769-46a7-9d01-195c45cbf66f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:15:50.696110 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1420/2832] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:15:50 2022] PUT /identity/v3/projects/e06b74e20cb74d5f9eb71ef0ad13dc99/users/58114c225ebe4062af97802f266bbd6f/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:15:50.700865 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d75a19-884a-4748-a584-016e074bfc60 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:50.701549 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d75a19-884a-4748-a584-016e074bfc60 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:50.701674 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d75a19-884a-4748-a584-016e074bfc60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:50.723867 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-a8d75a19-884a-4748-a584-016e074bfc60 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:15:50.725491 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a8d75a19-884a-4748-a584-016e074bfc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:15:50.864111 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1413/2833] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:15:50.874524 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fabc6e-3769-46a7-9d01-195c45cbf66f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:15:50.878829 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-88fabc6e-3769-46a7-9d01-195c45cbf66f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:15:51.039610 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fabc6e-3769-46a7-9d01-195c45cbf66f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:15:51.049111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a49071-a84b-4959-9af5-c7c592dbec3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:15:51.050165 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a49071-a84b-4959-9af5-c7c592dbec3c service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:51.051371 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a49071-a84b-4959-9af5-c7c592dbec3c service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:51.051835 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a49071-a84b-4959-9af5-c7c592dbec3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:51.078802 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a49071-a84b-4959-9af5-c7c592dbec3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:15:51.081155 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a49071-a84b-4959-9af5-c7c592dbec3c service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:15:51.115901 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1421/2834] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:15:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:15:53.173113 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d75a19-884a-4748-a584-016e074bfc60 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:15:53.178007 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a8d75a19-884a-4748-a584-016e074bfc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:15:53.388515 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d75a19-884a-4748-a584-016e074bfc60 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:15:53.397911 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9daab-5f1f-4b0f-8bfc-aae08646fb2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:15:53.398588 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9daab-5f1f-4b0f-8bfc-aae08646fb2b service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:53.398872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9daab-5f1f-4b0f-8bfc-aae08646fb2b service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:53.399702 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9daab-5f1f-4b0f-8bfc-aae08646fb2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:53.402733 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-05f9daab-5f1f-4b0f-8bfc-aae08646fb2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:15:53.495182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9daab-5f1f-4b0f-8bfc-aae08646fb2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:15:53.497298 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9daab-5f1f-4b0f-8bfc-aae08646fb2b service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:15:53.521318 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1414/2835] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:15:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:15:58.036006 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a49071-a84b-4959-9af5-c7c592dbec3c service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:15:58.038106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a7a49071-a84b-4959-9af5-c7c592dbec3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:15:58.055777 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9daab-5f1f-4b0f-8bfc-aae08646fb2b service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:15:58.057474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-05f9daab-5f1f-4b0f-8bfc-aae08646fb2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:15:58.063749 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a49071-a84b-4959-9af5-c7c592dbec3c service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:15:58.073928 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e864e-767d-47e6-bf8b-dcc59e8d8361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:15:58.075605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e864e-767d-47e6-bf8b-dcc59e8d8361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:58.076113 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e864e-767d-47e6-bf8b-dcc59e8d8361 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:58.076907 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e864e-767d-47e6-bf8b-dcc59e8d8361 admin admin] PATH_INFO: `/v3/users/d57b97f51d2f4aa6869b41518f14d3aa` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:58.078483 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994e864e-767d-47e6-bf8b-dcc59e8d8361 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d57b97f51d2f4aa6869b41518f14d3aa)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:15:58.081455 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994e864e-767d-47e6-bf8b-dcc59e8d8361 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:15:58.098940 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9daab-5f1f-4b0f-8bfc-aae08646fb2b service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:15:58.113653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f996ee-d2ad-46ac-9530-c2c22250fadb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:15:58.114541 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f996ee-d2ad-46ac-9530-c2c22250fadb service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:58.115006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f996ee-d2ad-46ac-9530-c2c22250fadb service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:58.117008 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f996ee-d2ad-46ac-9530-c2c22250fadb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:58.122670 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-44f996ee-d2ad-46ac-9530-c2c22250fadb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:15:58.306329 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f996ee-d2ad-46ac-9530-c2c22250fadb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:15:58.308081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f996ee-d2ad-46ac-9530-c2c22250fadb service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:15:58.336936 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-994e864e-767d-47e6-bf8b-dcc59e8d8361 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd57b97f51d2f4aa6869b41518f14d3aa'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:15:58.346114 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1415/2836] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:15:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:15:58.400256 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-994e864e-767d-47e6-bf8b-dcc59e8d8361 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd57b97f51d2f4aa6869b41518f14d3aa'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:15:58.473975 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-994e864e-767d-47e6-bf8b-dcc59e8d8361 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd57b97f51d2f4aa6869b41518f14d3aa'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:15:58.474681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-994e864e-767d-47e6-bf8b-dcc59e8d8361 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd57b97f51d2f4aa6869b41518f14d3aa'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:15:58.484845 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-994e864e-767d-47e6-bf8b-dcc59e8d8361 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd57b97f51d2f4aa6869b41518f14d3aa'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:15:58.497751 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1422/2837] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:15:58 2022] DELETE /identity/v3/users/d57b97f51d2f4aa6869b41518f14d3aa => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:15:58.502466 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24be178-05fd-4192-909f-f55c0972af85 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:58.507388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24be178-05fd-4192-909f-f55c0972af85 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:58.507971 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24be178-05fd-4192-909f-f55c0972af85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:58.555742 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-c24be178-05fd-4192-909f-f55c0972af85 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:15:58.565283 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c24be178-05fd-4192-909f-f55c0972af85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:15:58.769993 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1416/2838] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:15:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:15:58.780045 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e864e-767d-47e6-bf8b-dcc59e8d8361 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:15:58.787987 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-994e864e-767d-47e6-bf8b-dcc59e8d8361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:15:58.921620 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e864e-767d-47e6-bf8b-dcc59e8d8361 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:15:58.925852 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c2ec7-6656-4619-a083-4e26028e6c73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:15:58.926711 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c2ec7-6656-4619-a083-4e26028e6c73 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:58.928780 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c2ec7-6656-4619-a083-4e26028e6c73 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:58.929487 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c2ec7-6656-4619-a083-4e26028e6c73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:58.951653 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c2ec7-6656-4619-a083-4e26028e6c73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:15:58.953151 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c2ec7-6656-4619-a083-4e26028e6c73 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:15:59.005430 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24be178-05fd-4192-909f-f55c0972af85 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:15:59.005733 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1423/2839] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:15:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:15:59.006657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24be178-05fd-4192-909f-f55c0972af85 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:15:59.006657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e53e43f-2eef-4997-84a6-b9072572c56c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:15:59.006657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53e43f-2eef-4997-84a6-b9072572c56c service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:59.006657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53e43f-2eef-4997-84a6-b9072572c56c service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:59.007809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53e43f-2eef-4997-84a6-b9072572c56c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:59.010305 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0e53e43f-2eef-4997-84a6-b9072572c56c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:15:59.023739 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e53e43f-2eef-4997-84a6-b9072572c56c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:15:59.025972 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e53e43f-2eef-4997-84a6-b9072572c56c service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:15:59.057850 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1417/2840] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:15:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:15:59.412925 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c2ec7-6656-4619-a083-4e26028e6c73 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:15:59.419464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-773c2ec7-6656-4619-a083-4e26028e6c73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:15:59.449794 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c2ec7-6656-4619-a083-4e26028e6c73 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:15:59.510993 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce853008-1456-4efd-a410-a47a2278fba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:15:59.514678 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce853008-1456-4efd-a410-a47a2278fba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:59.516976 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce853008-1456-4efd-a410-a47a2278fba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:59.517618 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce853008-1456-4efd-a410-a47a2278fba8 admin admin] PATH_INFO: `/v3/projects/1a2d262c5cf4435aa19253f70823433f` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:59.520145 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce853008-1456-4efd-a410-a47a2278fba8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a2d262c5cf4435aa19253f70823433f)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:15:59.523042 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce853008-1456-4efd-a410-a47a2278fba8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:15:59.688265 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ce853008-1456-4efd-a410-a47a2278fba8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a2d262c5cf4435aa19253f70823433f', 'request_id': 'req-ce853008-1456-4efd-a410-a47a2278fba8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:15:59.708675 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ce853008-1456-4efd-a410-a47a2278fba8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a2d262c5cf4435aa19253f70823433f', 'request_id': 'req-ce853008-1456-4efd-a410-a47a2278fba8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:15:59.717607 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ce853008-1456-4efd-a410-a47a2278fba8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a2d262c5cf4435aa19253f70823433f', 'request_id': 'req-ce853008-1456-4efd-a410-a47a2278fba8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:15:59.823037 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ce853008-1456-4efd-a410-a47a2278fba8 admin admin] The token cache is being invalidate because project 1a2d262c5cf4435aa19253f70823433f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:15:59.824907 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ce853008-1456-4efd-a410-a47a2278fba8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:15:59.829969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ce853008-1456-4efd-a410-a47a2278fba8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:15:59.841244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e53e43f-2eef-4997-84a6-b9072572c56c service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:15:59.841451 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1424/2841] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:15:59 2022] DELETE /identity/v3/projects/1a2d262c5cf4435aa19253f70823433f => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:15:59.859367 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e53e43f-2eef-4997-84a6-b9072572c56c service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:15:59.930004 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90e7fe-4220-4479-a278-41bdd55eb70b None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:59.931764 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90e7fe-4220-4479-a278-41bdd55eb70b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:59.933723 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90e7fe-4220-4479-a278-41bdd55eb70b None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:15:59.938629 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1425/2842] 10.222.0.23 () {54 vars in 921 bytes} [Sat Apr 30 21:15:59 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 21:15:59.958806 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43890ab-6c03-48a9-bf3d-04bfe315d373 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:15:59.959509 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43890ab-6c03-48a9-bf3d-04bfe315d373 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:15:59.960031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43890ab-6c03-48a9-bf3d-04bfe315d373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:00.030563 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-f43890ab-6c03-48a9-bf3d-04bfe315d373 None None] MFA Rules not processed for user `4ad3f89b7037413a83c7905cef263b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:00.033060 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f43890ab-6c03-48a9-bf3d-04bfe315d373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:00.058701 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483338ee-bb69-4cf8-96e2-e913a36f8ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:00.060831 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483338ee-bb69-4cf8-96e2-e913a36f8ff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:00.061377 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483338ee-bb69-4cf8-96e2-e913a36f8ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:00.062511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483338ee-bb69-4cf8-96e2-e913a36f8ff8 admin admin] PATH_INFO: `/v3/users/f1b74ca4407849a392fe4d2898613875` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:00.064141 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483338ee-bb69-4cf8-96e2-e913a36f8ff8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1b74ca4407849a392fe4d2898613875)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:00.068986 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483338ee-bb69-4cf8-96e2-e913a36f8ff8 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:00.206091 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1426/2843] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Apr 30 21:15:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:16:00.228001 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43890ab-6c03-48a9-bf3d-04bfe315d373 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:00.229496 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f43890ab-6c03-48a9-bf3d-04bfe315d373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:00.251924 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43890ab-6c03-48a9-bf3d-04bfe315d373 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:00.281425 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae55f6-922b-4590-849d-b73167a30a12 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:00.282110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae55f6-922b-4590-849d-b73167a30a12 service placement] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:00.282429 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae55f6-922b-4590-849d-b73167a30a12 service placement] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:00.282663 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae55f6-922b-4590-849d-b73167a30a12 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:00.304761 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae55f6-922b-4590-849d-b73167a30a12 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:00.314146 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae55f6-922b-4590-849d-b73167a30a12 service placement] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:00.337885 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-483338ee-bb69-4cf8-96e2-e913a36f8ff8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1b74ca4407849a392fe4d2898613875'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:00.348705 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1427/2844] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:16:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:16:00.390387 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-483338ee-bb69-4cf8-96e2-e913a36f8ff8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1b74ca4407849a392fe4d2898613875'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:00.468495 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-483338ee-bb69-4cf8-96e2-e913a36f8ff8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1b74ca4407849a392fe4d2898613875'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:00.477394 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-483338ee-bb69-4cf8-96e2-e913a36f8ff8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1b74ca4407849a392fe4d2898613875'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:00.479967 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-483338ee-bb69-4cf8-96e2-e913a36f8ff8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1b74ca4407849a392fe4d2898613875'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:00.495601 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1418/2845] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:15:59 2022] DELETE /identity/v3/users/f1b74ca4407849a392fe4d2898613875 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:00.552485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32385e-fa67-4bd7-a3c5-e2942de847a9 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:00.553056 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32385e-fa67-4bd7-a3c5-e2942de847a9 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:00.553056 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32385e-fa67-4bd7-a3c5-e2942de847a9 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:00.554438 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1428/2846] 10.222.0.23 () {54 vars in 921 bytes} [Sat Apr 30 21:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:16:00.567324 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987ce83-c16f-42f1-a3e2-475cc402f5cd None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:00.567639 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987ce83-c16f-42f1-a3e2-475cc402f5cd None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:00.567917 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987ce83-c16f-42f1-a3e2-475cc402f5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:00.606103 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-9987ce83-c16f-42f1-a3e2-475cc402f5cd None None] MFA Rules not processed for user `4ad3f89b7037413a83c7905cef263b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:00.608493 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9987ce83-c16f-42f1-a3e2-475cc402f5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:00.763466 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1419/2847] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Apr 30 21:16:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:16:00.813336 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32385e-fa67-4bd7-a3c5-e2942de847a9 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:00.822730 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8d32385e-fa67-4bd7-a3c5-e2942de847a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:00.861286 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32385e-fa67-4bd7-a3c5-e2942de847a9 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:00.872976 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ddc95-6349-4b71-a798-49566cc7166b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:00.873660 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ddc95-6349-4b71-a798-49566cc7166b service placement] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:00.873982 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ddc95-6349-4b71-a798-49566cc7166b service placement] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:00.874261 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ddc95-6349-4b71-a798-49566cc7166b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:00.885046 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ddc95-6349-4b71-a798-49566cc7166b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:00.888492 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ddc95-6349-4b71-a798-49566cc7166b service placement] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:00.904925 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1429/2848] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:16:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:16:00.943503 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9987ce83-c16f-42f1-a3e2-475cc402f5cd None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:00.946323 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9987ce83-c16f-42f1-a3e2-475cc402f5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:01.078322 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9987ce83-c16f-42f1-a3e2-475cc402f5cd None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:01.085707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60501a83-d2cf-4413-aa34-b8326b978168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:01.087071 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60501a83-d2cf-4413-aa34-b8326b978168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:01.087359 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60501a83-d2cf-4413-aa34-b8326b978168 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:01.087678 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60501a83-d2cf-4413-aa34-b8326b978168 admin admin] PATH_INFO: `/v3/projects/e949efb64ca944159dd74eda0fcafdba` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:01.089638 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60501a83-d2cf-4413-aa34-b8326b978168 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e949efb64ca944159dd74eda0fcafdba)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:01.093457 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60501a83-d2cf-4413-aa34-b8326b978168 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:01.266423 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-60501a83-d2cf-4413-aa34-b8326b978168 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e949efb64ca944159dd74eda0fcafdba', 'request_id': 'req-60501a83-d2cf-4413-aa34-b8326b978168'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:01.281886 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-60501a83-d2cf-4413-aa34-b8326b978168 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e949efb64ca944159dd74eda0fcafdba', 'request_id': 'req-60501a83-d2cf-4413-aa34-b8326b978168'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:01.295141 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-60501a83-d2cf-4413-aa34-b8326b978168 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e949efb64ca944159dd74eda0fcafdba', 'request_id': 'req-60501a83-d2cf-4413-aa34-b8326b978168'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:01.452135 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-60501a83-d2cf-4413-aa34-b8326b978168 admin admin] The token cache is being invalidate because project e949efb64ca944159dd74eda0fcafdba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:16:01.452318 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-60501a83-d2cf-4413-aa34-b8326b978168 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:01.458559 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-60501a83-d2cf-4413-aa34-b8326b978168 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:01.462314 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1420/2849] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:16:00 2022] DELETE /identity/v3/projects/e949efb64ca944159dd74eda0fcafdba => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:01.467384 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e96cc-9163-4853-a65b-33af5788c9af None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:01.467893 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e96cc-9163-4853-a65b-33af5788c9af None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:01.468380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e96cc-9163-4853-a65b-33af5788c9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:01.515966 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-315e96cc-9163-4853-a65b-33af5788c9af None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:01.520255 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-315e96cc-9163-4853-a65b-33af5788c9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:01.614073 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1430/2850] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:01.622704 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f00a66-2ecb-4e0e-87a3-6ce7e224f8ec None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:01.622995 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f00a66-2ecb-4e0e-87a3-6ce7e224f8ec None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:01.623325 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f00a66-2ecb-4e0e-87a3-6ce7e224f8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:01.647475 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-39f00a66-2ecb-4e0e-87a3-6ce7e224f8ec None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:01.648687 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-39f00a66-2ecb-4e0e-87a3-6ce7e224f8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:01.657663 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1421/2851] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:01.662025 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e96cc-9163-4853-a65b-33af5788c9af None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:01.672645 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e96cc-9163-4853-a65b-33af5788c9af None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:01.678295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a17a6f-21f4-4317-96a9-8a67061ab240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:01.678999 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a17a6f-21f4-4317-96a9-8a67061ab240 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:01.679443 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a17a6f-21f4-4317-96a9-8a67061ab240 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:01.679742 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a17a6f-21f4-4317-96a9-8a67061ab240 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:01.680664 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a17a6f-21f4-4317-96a9-8a67061ab240 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:16:01.680969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a17a6f-21f4-4317-96a9-8a67061ab240 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:01.682610 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a17a6f-21f4-4317-96a9-8a67061ab240 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:01.695736 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1431/2852] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:16:01.700164 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f00a66-2ecb-4e0e-87a3-6ce7e224f8ec None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:01.709967 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f00a66-2ecb-4e0e-87a3-6ce7e224f8ec None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:01.715088 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d111a4b-44b1-4102-8254-7dbc3adb5674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:01.715745 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d111a4b-44b1-4102-8254-7dbc3adb5674 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:01.719771 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d111a4b-44b1-4102-8254-7dbc3adb5674 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:01.719771 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d111a4b-44b1-4102-8254-7dbc3adb5674 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:01.719771 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d111a4b-44b1-4102-8254-7dbc3adb5674 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:01.719771 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d111a4b-44b1-4102-8254-7dbc3adb5674 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:01.858402 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1422/2853] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:16:01 2022] POST /identity/v3/projects => generated 375 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:16:01.863158 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a17a6f-21f4-4317-96a9-8a67061ab240 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:01.876423 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a17a6f-21f4-4317-96a9-8a67061ab240 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:01.959135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2db93-e5f0-4641-ae5c-8a4cc65611ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:01.960059 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2db93-e5f0-4641-ae5c-8a4cc65611ef admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:01.960346 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2db93-e5f0-4641-ae5c-8a4cc65611ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:01.960655 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2db93-e5f0-4641-ae5c-8a4cc65611ef admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:01.961352 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2db93-e5f0-4641-ae5c-8a4cc65611ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:01.963400 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2db93-e5f0-4641-ae5c-8a4cc65611ef admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:02.075228 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1432/2854] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:16:01 2022] POST /identity/v3/users => generated 288 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:16:02.082118 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d111a4b-44b1-4102-8254-7dbc3adb5674 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:02.091256 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d111a4b-44b1-4102-8254-7dbc3adb5674 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:02.104740 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7eda1-7c12-4292-bf96-9a516ec4bf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:02.105567 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7eda1-7c12-4292-bf96-9a516ec4bf22 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:02.105997 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7eda1-7c12-4292-bf96-9a516ec4bf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:02.106646 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7eda1-7c12-4292-bf96-9a516ec4bf22 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:02.107660 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7eda1-7c12-4292-bf96-9a516ec4bf22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:02.109672 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7eda1-7c12-4292-bf96-9a516ec4bf22 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:02.129425 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1423/2855] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:16:02.130616 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2db93-e5f0-4641-ae5c-8a4cc65611ef admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:02.142979 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2db93-e5f0-4641-ae5c-8a4cc65611ef admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:02.150007 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf12b49c-6966-4cca-a87c-0b400516a72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:02.150691 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf12b49c-6966-4cca-a87c-0b400516a72c admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:02.150980 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf12b49c-6966-4cca-a87c-0b400516a72c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:02.151267 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf12b49c-6966-4cca-a87c-0b400516a72c admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:02.152905 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf12b49c-6966-4cca-a87c-0b400516a72c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:02.155200 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf12b49c-6966-4cca-a87c-0b400516a72c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:02.169215 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1433/2856] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:16:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:16:02.174401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7eda1-7c12-4292-bf96-9a516ec4bf22 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:02.191996 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7eda1-7c12-4292-bf96-9a516ec4bf22 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:02.200621 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230fbc5-5dfe-4494-a99d-18153ad22500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:02.202089 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230fbc5-5dfe-4494-a99d-18153ad22500 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:02.202608 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230fbc5-5dfe-4494-a99d-18153ad22500 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:02.203116 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230fbc5-5dfe-4494-a99d-18153ad22500 admin admin] PATH_INFO: `/v3/projects/c94e34a3041e471c92d5e3e4ea8da107/users/86ca2b1a64364c0a8a816e6f657ffa90/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:02.232133 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6230fbc5-5dfe-4494-a99d-18153ad22500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c94e34a3041e471c92d5e3e4ea8da107, user_id=86ca2b1a64364c0a8a816e6f657ffa90, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:02.235282 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6230fbc5-5dfe-4494-a99d-18153ad22500 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:02.357390 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1424/2857] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:16:02 2022] PUT /identity/v3/projects/c94e34a3041e471c92d5e3e4ea8da107/users/86ca2b1a64364c0a8a816e6f657ffa90/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:02.369088 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb60940-85b9-4bdb-afef-084953366535 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:02.369374 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb60940-85b9-4bdb-afef-084953366535 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:02.369649 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb60940-85b9-4bdb-afef-084953366535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:02.414772 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-fcb60940-85b9-4bdb-afef-084953366535 None None] MFA Rules not processed for user `86ca2b1a64364c0a8a816e6f657ffa90`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:02.416052 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-fcb60940-85b9-4bdb-afef-084953366535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:02.629459 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1434/2858] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:02.633786 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230fbc5-5dfe-4494-a99d-18153ad22500 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:02.820971 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230fbc5-5dfe-4494-a99d-18153ad22500 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:02.838729 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9533cdd-b1ba-4027-8096-5a587361b6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:02.839504 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9533cdd-b1ba-4027-8096-5a587361b6b1 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:02.839950 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9533cdd-b1ba-4027-8096-5a587361b6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:02.840239 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9533cdd-b1ba-4027-8096-5a587361b6b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:02.841057 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9533cdd-b1ba-4027-8096-5a587361b6b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:02.850791 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9533cdd-b1ba-4027-8096-5a587361b6b1 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:02.997437 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1425/2859] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:16:02 2022] POST /identity/v3/projects => generated 373 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:16:03.002038 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb60940-85b9-4bdb-afef-084953366535 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:03.022278 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb60940-85b9-4bdb-afef-084953366535 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:03.158587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa39c1d-36da-485e-b754-4d9aeabe62df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:03.160982 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa39c1d-36da-485e-b754-4d9aeabe62df admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:03.161463 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa39c1d-36da-485e-b754-4d9aeabe62df admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:03.161845 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa39c1d-36da-485e-b754-4d9aeabe62df admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:03.168347 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa39c1d-36da-485e-b754-4d9aeabe62df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:03.171161 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa39c1d-36da-485e-b754-4d9aeabe62df admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:03.262306 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed4f1e-c3b4-4ef4-878a-b545a8f392b4 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:03.262916 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed4f1e-c3b4-4ef4-878a-b545a8f392b4 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:03.262916 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed4f1e-c3b4-4ef4-878a-b545a8f392b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:03.280591 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1435/2860] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:16:02 2022] POST /identity/v3/users => generated 293 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:16:03.284515 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa39c1d-36da-485e-b754-4d9aeabe62df admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:03.296365 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa39c1d-36da-485e-b754-4d9aeabe62df admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:03.304451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c864af71-540a-4a6e-8e45-3850b693f7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:03.305201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864af71-540a-4a6e-8e45-3850b693f7f7 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:03.305540 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864af71-540a-4a6e-8e45-3850b693f7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:03.306035 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864af71-540a-4a6e-8e45-3850b693f7f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:03.307697 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c864af71-540a-4a6e-8e45-3850b693f7f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:03.309741 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c864af71-540a-4a6e-8e45-3850b693f7f7 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:03.313526 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-53ed4f1e-c3b4-4ef4-878a-b545a8f392b4 None None] MFA Rules not processed for user `58114c225ebe4062af97802f266bbd6f`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:03.315204 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-53ed4f1e-c3b4-4ef4-878a-b545a8f392b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:03.348801 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1436/2861] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:16:03.359731 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c864af71-540a-4a6e-8e45-3850b693f7f7 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:03.397675 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c864af71-540a-4a6e-8e45-3850b693f7f7 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:03.412329 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa24727-a13f-4e17-9016-a89e39d8e0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:03.413660 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa24727-a13f-4e17-9016-a89e39d8e0ca admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:03.414007 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa24727-a13f-4e17-9016-a89e39d8e0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:03.415132 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa24727-a13f-4e17-9016-a89e39d8e0ca admin admin] PATH_INFO: `/v3/projects/d0baf2b945474b5bbe5194bf714a0032/users/669dc413f7084f93b1b983936ff6d5d0/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:03.418368 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1426/2862] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:03.457593 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa24727-a13f-4e17-9016-a89e39d8e0ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0baf2b945474b5bbe5194bf714a0032, user_id=669dc413f7084f93b1b983936ff6d5d0, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:03.464586 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa24727-a13f-4e17-9016-a89e39d8e0ca admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:03.577371 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1437/2863] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:16:03 2022] PUT /identity/v3/projects/d0baf2b945474b5bbe5194bf714a0032/users/669dc413f7084f93b1b983936ff6d5d0/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:03.578771 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed4f1e-c3b4-4ef4-878a-b545a8f392b4 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:03.594984 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed4f1e-c3b4-4ef4-878a-b545a8f392b4 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:03.666204 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ac797-f8f7-4f15-be2f-416075488b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:03.666738 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ac797-f8f7-4f15-be2f-416075488b64 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:03.667341 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ac797-f8f7-4f15-be2f-416075488b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:03.667341 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ac797-f8f7-4f15-be2f-416075488b64 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:03.668356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ac797-f8f7-4f15-be2f-416075488b64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:03.670087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ac797-f8f7-4f15-be2f-416075488b64 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:03.684076 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1427/2864] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:16:03.688420 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa24727-a13f-4e17-9016-a89e39d8e0ca admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:03.700667 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa24727-a13f-4e17-9016-a89e39d8e0ca admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:03.707663 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eda3ff-c17b-486f-b50d-142ab2650f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:03.708931 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eda3ff-c17b-486f-b50d-142ab2650f9f admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:03.709783 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eda3ff-c17b-486f-b50d-142ab2650f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:03.710242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eda3ff-c17b-486f-b50d-142ab2650f9f admin admin] PATH_INFO: `/v3/projects/d0baf2b945474b5bbe5194bf714a0032/users/669dc413f7084f93b1b983936ff6d5d0/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:03.712468 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eda3ff-c17b-486f-b50d-142ab2650f9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0baf2b945474b5bbe5194bf714a0032, user_id=669dc413f7084f93b1b983936ff6d5d0, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:03.715847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eda3ff-c17b-486f-b50d-142ab2650f9f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:03.732981 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1438/2865] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:16:03 2022] PUT /identity/v3/projects/d0baf2b945474b5bbe5194bf714a0032/users/669dc413f7084f93b1b983936ff6d5d0/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:16:03.745036 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7da203-04ba-4c93-b18e-f23403320013 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:03.745354 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7da203-04ba-4c93-b18e-f23403320013 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:03.746118 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7da203-04ba-4c93-b18e-f23403320013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:03.783939 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-0b7da203-04ba-4c93-b18e-f23403320013 None None] MFA Rules not processed for user `669dc413f7084f93b1b983936ff6d5d0`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:03.785359 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0b7da203-04ba-4c93-b18e-f23403320013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:03.886384 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1428/2866] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:03 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:03.886929 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eda3ff-c17b-486f-b50d-142ab2650f9f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:03.909212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eda3ff-c17b-486f-b50d-142ab2650f9f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:03.921215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170fffba-14b0-467f-83c6-528eb0043a4a tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '669dc413f7084f93b1b983936ff6d5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0baf2b945474b5bbe5194bf714a0032', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:03.922132 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fffba-14b0-467f-83c6-528eb0043a4a tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:03.922544 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fffba-14b0-467f-83c6-528eb0043a4a tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:03.922954 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fffba-14b0-467f-83c6-528eb0043a4a tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:03.923774 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170fffba-14b0-467f-83c6-528eb0043a4a tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:16:03.924093 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170fffba-14b0-467f-83c6-528eb0043a4a tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:03.926723 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170fffba-14b0-467f-83c6-528eb0043a4a tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:03.943522 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1439/2867] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:16:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:16:03.948769 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7da203-04ba-4c93-b18e-f23403320013 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:03.963880 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7da203-04ba-4c93-b18e-f23403320013 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:03.969826 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af970d-b925-4b18-b1df-d89ccccafe41 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '669dc413f7084f93b1b983936ff6d5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0baf2b945474b5bbe5194bf714a0032', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:03.969826 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af970d-b925-4b18-b1df-d89ccccafe41 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:03.970128 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af970d-b925-4b18-b1df-d89ccccafe41 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:03.970451 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af970d-b925-4b18-b1df-d89ccccafe41 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:03.971147 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af970d-b925-4b18-b1df-d89ccccafe41 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:03.973136 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21af970d-b925-4b18-b1df-d89ccccafe41 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:04.091490 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1429/2868] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:16:03 2022] POST /identity/v3/projects => generated 369 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:16:04.093149 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170fffba-14b0-467f-83c6-528eb0043a4a tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:04.104059 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170fffba-14b0-467f-83c6-528eb0043a4a tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:04.207660 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d6f99-4174-48e4-bbab-907fb1336041 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '669dc413f7084f93b1b983936ff6d5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0baf2b945474b5bbe5194bf714a0032', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:04.208724 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d6f99-4174-48e4-bbab-907fb1336041 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:04.209158 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d6f99-4174-48e4-bbab-907fb1336041 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:04.209594 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d6f99-4174-48e4-bbab-907fb1336041 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:04.210708 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d6f99-4174-48e4-bbab-907fb1336041 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:16:04.211135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d6f99-4174-48e4-bbab-907fb1336041 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:04.213352 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d6f99-4174-48e4-bbab-907fb1336041 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:04.230270 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1440/2869] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:16:04.525540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af970d-b925-4b18-b1df-d89ccccafe41 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:04.535695 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-21af970d-b925-4b18-b1df-d89ccccafe41 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:04.633844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af970d-b925-4b18-b1df-d89ccccafe41 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:04.640683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1591d30d-3c7f-462c-8c5d-f56403e487fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:04.641368 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591d30d-3c7f-462c-8c5d-f56403e487fc service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:04.641720 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591d30d-3c7f-462c-8c5d-f56403e487fc service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:04.642038 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591d30d-3c7f-462c-8c5d-f56403e487fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:04.705668 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1591d30d-3c7f-462c-8c5d-f56403e487fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:04.707465 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1591d30d-3c7f-462c-8c5d-f56403e487fc service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:04.719369 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1430/2870] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:16:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:16:04.900531 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d6f99-4174-48e4-bbab-907fb1336041 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:04.900531 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5e3d6f99-4174-48e4-bbab-907fb1336041 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:04.920651 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d6f99-4174-48e4-bbab-907fb1336041 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:04.927382 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5862cd93-017d-48ab-8cd1-3a11adb7de94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:04.928088 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862cd93-017d-48ab-8cd1-3a11adb7de94 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:04.928377 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862cd93-017d-48ab-8cd1-3a11adb7de94 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:04.928656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862cd93-017d-48ab-8cd1-3a11adb7de94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:04.938023 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5862cd93-017d-48ab-8cd1-3a11adb7de94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:04.939680 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5862cd93-017d-48ab-8cd1-3a11adb7de94 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:04.962701 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1441/2871] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:16:04 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:16:04.977498 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b590f-a1e6-4492-8f9f-8448ba2173c1 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:04.978081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b590f-a1e6-4492-8f9f-8448ba2173c1 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:04.980918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b590f-a1e6-4492-8f9f-8448ba2173c1 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:04.980918 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1431/2872] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:16:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:16:04.985834 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5862cd93-017d-48ab-8cd1-3a11adb7de94 service nova] Authenticating service token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 30 21:16:04.998948 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5862cd93-017d-48ab-8cd1-3a11adb7de94 service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:05.014449 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5862cd93-017d-48ab-8cd1-3a11adb7de94 service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:05.019682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1fe71-cafa-4930-8f30-9d3bae27099e tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '669dc413f7084f93b1b983936ff6d5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0baf2b945474b5bbe5194bf714a0032', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:05.020833 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1fe71-cafa-4930-8f30-9d3bae27099e tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:05.021284 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1fe71-cafa-4930-8f30-9d3bae27099e tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:05.021714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1fe71-cafa-4930-8f30-9d3bae27099e tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] PATH_INFO: `/v3/projects/b10d40a3f3b64a0f9052b75936cb0c35` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:05.023312 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf1fe71-cafa-4930-8f30-9d3bae27099e tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorizing `identity:get_project(project_id=b10d40a3f3b64a0f9052b75936cb0c35)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:05.025714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf1fe71-cafa-4930-8f30-9d3bae27099e tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:05.039533 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1442/2873] 10.222.0.23 () {58 vars in 1443 bytes} [Sat Apr 30 21:16:04 2022] GET /identity/v3/projects/b10d40a3f3b64a0f9052b75936cb0c35 => generated 369 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:16:05.691378 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d31ccb-addf-4ad3-8d7a-bc372e2bc910 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:05.691951 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d31ccb-addf-4ad3-8d7a-bc372e2bc910 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:05.692211 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d31ccb-addf-4ad3-8d7a-bc372e2bc910 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:05.695321 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1432/2874] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:16:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:16:05.700776 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1fe71-cafa-4930-8f30-9d3bae27099e tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Authenticating service token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 30 21:16:05.720630 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1fe71-cafa-4930-8f30-9d3bae27099e tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:05.736166 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1fe71-cafa-4930-8f30-9d3bae27099e tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:05.741796 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d74a75a-0460-4db1-afdf-1812b59cda80 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '669dc413f7084f93b1b983936ff6d5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0baf2b945474b5bbe5194bf714a0032', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:05.742619 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74a75a-0460-4db1-afdf-1812b59cda80 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:05.743246 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74a75a-0460-4db1-afdf-1812b59cda80 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:05.743246 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74a75a-0460-4db1-afdf-1812b59cda80 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] PATH_INFO: `/v3/projects/b10d40a3f3b64a0f9052b75936cb0c35` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:05.744372 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d74a75a-0460-4db1-afdf-1812b59cda80 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorizing `identity:get_project(project_id=b10d40a3f3b64a0f9052b75936cb0c35)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:05.746632 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d74a75a-0460-4db1-afdf-1812b59cda80 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:05.761908 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1443/2875] 10.222.0.23 () {58 vars in 1443 bytes} [Sat Apr 30 21:16:05 2022] GET /identity/v3/projects/b10d40a3f3b64a0f9052b75936cb0c35 => generated 369 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:16:07.251033 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b06350-8251-40d3-b2c5-7e9bb9703d60 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:07.251530 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b06350-8251-40d3-b2c5-7e9bb9703d60 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:07.251655 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b06350-8251-40d3-b2c5-7e9bb9703d60 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:07.253504 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1433/2876] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:16:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:16:07.261271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d74a75a-0460-4db1-afdf-1812b59cda80 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Authenticating service token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 30 21:16:07.278974 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d74a75a-0460-4db1-afdf-1812b59cda80 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:07.297888 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d74a75a-0460-4db1-afdf-1812b59cda80 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:07.317112 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34dcdfc-a8f6-4729-88bf-9a20c4758589 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '669dc413f7084f93b1b983936ff6d5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0baf2b945474b5bbe5194bf714a0032', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:07.318280 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34dcdfc-a8f6-4729-88bf-9a20c4758589 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:07.318776 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34dcdfc-a8f6-4729-88bf-9a20c4758589 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:07.319246 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34dcdfc-a8f6-4729-88bf-9a20c4758589 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] PATH_INFO: `/v3/projects/b10d40a3f3b64a0f9052b75936cb0c35` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:07.323514 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34dcdfc-a8f6-4729-88bf-9a20c4758589 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorizing `identity:get_project(project_id=b10d40a3f3b64a0f9052b75936cb0c35)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:07.326108 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34dcdfc-a8f6-4729-88bf-9a20c4758589 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:07.334013 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1444/2877] 10.222.0.23 () {58 vars in 1443 bytes} [Sat Apr 30 21:16:07 2022] GET /identity/v3/projects/b10d40a3f3b64a0f9052b75936cb0c35 => generated 369 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:16:07.360560 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b06350-8251-40d3-b2c5-7e9bb9703d60 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:07.383918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b06350-8251-40d3-b2c5-7e9bb9703d60 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:07.396773 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28e264-02d0-4643-bc5d-26029af5edff tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '669dc413f7084f93b1b983936ff6d5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0baf2b945474b5bbe5194bf714a0032', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:07.397892 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28e264-02d0-4643-bc5d-26029af5edff tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:07.398337 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28e264-02d0-4643-bc5d-26029af5edff tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:07.398805 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28e264-02d0-4643-bc5d-26029af5edff tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] PATH_INFO: `/v3/projects/b10d40a3f3b64a0f9052b75936cb0c35` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:07.400961 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b28e264-02d0-4643-bc5d-26029af5edff tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b10d40a3f3b64a0f9052b75936cb0c35)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:07.403878 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b28e264-02d0-4643-bc5d-26029af5edff tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:07.572100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7b28e264-02d0-4643-bc5d-26029af5edff tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b10d40a3f3b64a0f9052b75936cb0c35', 'request_id': 'req-7b28e264-02d0-4643-bc5d-26029af5edff'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:07.582426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7b28e264-02d0-4643-bc5d-26029af5edff tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b10d40a3f3b64a0f9052b75936cb0c35', 'request_id': 'req-7b28e264-02d0-4643-bc5d-26029af5edff'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:07.590806 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7b28e264-02d0-4643-bc5d-26029af5edff tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b10d40a3f3b64a0f9052b75936cb0c35', 'request_id': 'req-7b28e264-02d0-4643-bc5d-26029af5edff'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:07.667803 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7b28e264-02d0-4643-bc5d-26029af5edff tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] The token cache is being invalidate because project b10d40a3f3b64a0f9052b75936cb0c35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:16:07.669435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7b28e264-02d0-4643-bc5d-26029af5edff tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:07.670587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7b28e264-02d0-4643-bc5d-26029af5edff tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:07.674898 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1434/2878] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:16:07 2022] DELETE /identity/v3/projects/b10d40a3f3b64a0f9052b75936cb0c35 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:07.697459 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8880ec4-329f-4e70-8ab7-3742de7b828f None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:07.716242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8880ec4-329f-4e70-8ab7-3742de7b828f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:07.716242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8880ec4-329f-4e70-8ab7-3742de7b828f None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:07.716242 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1445/2879] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:16:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:16:07.717342 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28e264-02d0-4643-bc5d-26029af5edff tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Authenticating service token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 30 21:16:07.717342 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7b28e264-02d0-4643-bc5d-26029af5edff tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:07.854594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28e264-02d0-4643-bc5d-26029af5edff tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:07.865132 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7b28e264-02d0-4643-bc5d-26029af5edff tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:08.060583 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28e264-02d0-4643-bc5d-26029af5edff tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:08.079951 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b264d2-97f0-4b63-a2fc-729f504b28e2 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '669dc413f7084f93b1b983936ff6d5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0baf2b945474b5bbe5194bf714a0032', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:08.084004 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b264d2-97f0-4b63-a2fc-729f504b28e2 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:08.084004 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b264d2-97f0-4b63-a2fc-729f504b28e2 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:08.084004 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b264d2-97f0-4b63-a2fc-729f504b28e2 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] PATH_INFO: `/v3/projects/c94e34a3041e471c92d5e3e4ea8da107` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:08.095435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b264d2-97f0-4b63-a2fc-729f504b28e2 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorizing `identity:get_project(project_id=c94e34a3041e471c92d5e3e4ea8da107)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:08.104891 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b264d2-97f0-4b63-a2fc-729f504b28e2 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:08.126953 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1435/2880] 10.222.0.23 () {58 vars in 1443 bytes} [Sat Apr 30 21:16:07 2022] GET /identity/v3/projects/c94e34a3041e471c92d5e3e4ea8da107 => generated 375 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:16:08.129840 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8880ec4-329f-4e70-8ab7-3742de7b828f None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:08.160630 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8880ec4-329f-4e70-8ab7-3742de7b828f None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:08.172014 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e80d22-46bf-45a2-90d9-d936e6c7e91b tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '669dc413f7084f93b1b983936ff6d5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0baf2b945474b5bbe5194bf714a0032', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:08.173052 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e80d22-46bf-45a2-90d9-d936e6c7e91b tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:08.173567 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e80d22-46bf-45a2-90d9-d936e6c7e91b tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:08.174235 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e80d22-46bf-45a2-90d9-d936e6c7e91b tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:08.176947 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e80d22-46bf-45a2-90d9-d936e6c7e91b tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:16:08.177477 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e80d22-46bf-45a2-90d9-d936e6c7e91b tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:08.185837 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e80d22-46bf-45a2-90d9-d936e6c7e91b tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:08.203620 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1446/2881] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:16:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:16:08.207525 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b264d2-97f0-4b63-a2fc-729f504b28e2 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:08.242733 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b264d2-97f0-4b63-a2fc-729f504b28e2 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:08.260758 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af94fe-1311-4ca8-b4a5-c9aa1d7039e2 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '669dc413f7084f93b1b983936ff6d5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0baf2b945474b5bbe5194bf714a0032', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:08.260758 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af94fe-1311-4ca8-b4a5-c9aa1d7039e2 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:08.262672 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af94fe-1311-4ca8-b4a5-c9aa1d7039e2 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:08.264340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af94fe-1311-4ca8-b4a5-c9aa1d7039e2 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:08.265153 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0af94fe-1311-4ca8-b4a5-c9aa1d7039e2 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:08.293111 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0af94fe-1311-4ca8-b4a5-c9aa1d7039e2 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:08.444180 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1436/2882] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:16:08 2022] POST /identity/v3/projects => generated 371 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:16:08.448510 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e80d22-46bf-45a2-90d9-d936e6c7e91b tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:08.464740 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e80d22-46bf-45a2-90d9-d936e6c7e91b tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:08.584929 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbdc14-a3d5-48ed-9b75-bc894f1970cd tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '669dc413f7084f93b1b983936ff6d5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0baf2b945474b5bbe5194bf714a0032', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:08.586087 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbdc14-a3d5-48ed-9b75-bc894f1970cd tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:08.586807 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbdc14-a3d5-48ed-9b75-bc894f1970cd tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:08.587278 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbdc14-a3d5-48ed-9b75-bc894f1970cd tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:08.588358 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffbdc14-a3d5-48ed-9b75-bc894f1970cd tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:16:08.589065 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffbdc14-a3d5-48ed-9b75-bc894f1970cd tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:08.591243 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffbdc14-a3d5-48ed-9b75-bc894f1970cd tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:08.610814 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1447/2883] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:16:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:16:08.637833 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b595d2-5f04-4daa-8d18-a8c346bd68b8 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:08.638498 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b595d2-5f04-4daa-8d18-a8c346bd68b8 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:08.639026 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b595d2-5f04-4daa-8d18-a8c346bd68b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:08.661211 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-12b595d2-5f04-4daa-8d18-a8c346bd68b8 None None] MFA Rules not processed for user `58114c225ebe4062af97802f266bbd6f`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:08.662602 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-12b595d2-5f04-4daa-8d18-a8c346bd68b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:08.761594 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1437/2884] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:08.872857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9d671-f5bb-49b6-bb3d-1382a00619a2 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:08.874080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9d671-f5bb-49b6-bb3d-1382a00619a2 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:08.874585 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9d671-f5bb-49b6-bb3d-1382a00619a2 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:08.878641 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1448/2885] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:16:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:16:08.887947 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b595d2-5f04-4daa-8d18-a8c346bd68b8 None None] Authenticating service token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 30 21:16:09.027555 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b595d2-5f04-4daa-8d18-a8c346bd68b8 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:09.049092 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b595d2-5f04-4daa-8d18-a8c346bd68b8 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:09.053814 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e77b05b-6e9e-43a3-b1de-c0d36099cabb tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '669dc413f7084f93b1b983936ff6d5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0baf2b945474b5bbe5194bf714a0032', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:09.054773 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77b05b-6e9e-43a3-b1de-c0d36099cabb tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:09.055410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77b05b-6e9e-43a3-b1de-c0d36099cabb tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:09.062428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77b05b-6e9e-43a3-b1de-c0d36099cabb tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] PATH_INFO: `/v3/projects/a4181df959bf41a0ac303ffa81490f12` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:09.065605 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e77b05b-6e9e-43a3-b1de-c0d36099cabb tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorizing `identity:get_project(project_id=a4181df959bf41a0ac303ffa81490f12)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:09.069214 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e77b05b-6e9e-43a3-b1de-c0d36099cabb tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:09.072434 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1438/2886] 10.222.0.23 () {58 vars in 1443 bytes} [Sat Apr 30 21:16:08 2022] GET /identity/v3/projects/a4181df959bf41a0ac303ffa81490f12 => generated 371 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:16:09.850452 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63424fd0-4534-4687-a4ec-c1c8ec91f95d None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:09.850990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63424fd0-4534-4687-a4ec-c1c8ec91f95d None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:09.851327 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63424fd0-4534-4687-a4ec-c1c8ec91f95d None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:09.852946 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1449/2887] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:16:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:16:09.857839 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e77b05b-6e9e-43a3-b1de-c0d36099cabb tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Authenticating service token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 30 21:16:09.863457 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3e77b05b-6e9e-43a3-b1de-c0d36099cabb tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:09.884294 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e77b05b-6e9e-43a3-b1de-c0d36099cabb tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:09.894417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e77b05b-6e9e-43a3-b1de-c0d36099cabb tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:09.902451 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb909f7-16e2-4a5e-89f7-b6f5bae57ab5 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '669dc413f7084f93b1b983936ff6d5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0baf2b945474b5bbe5194bf714a0032', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:09.903318 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb909f7-16e2-4a5e-89f7-b6f5bae57ab5 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:09.904064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb909f7-16e2-4a5e-89f7-b6f5bae57ab5 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:09.904353 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb909f7-16e2-4a5e-89f7-b6f5bae57ab5 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] PATH_INFO: `/v3/projects/a4181df959bf41a0ac303ffa81490f12` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:09.905659 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb909f7-16e2-4a5e-89f7-b6f5bae57ab5 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorizing `identity:get_project(project_id=a4181df959bf41a0ac303ffa81490f12)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:09.908880 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb909f7-16e2-4a5e-89f7-b6f5bae57ab5 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:09.913189 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1439/2888] 10.222.0.23 () {58 vars in 1443 bytes} [Sat Apr 30 21:16:09 2022] GET /identity/v3/projects/a4181df959bf41a0ac303ffa81490f12 => generated 371 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:16:09.961840 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63424fd0-4534-4687-a4ec-c1c8ec91f95d None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:09.982523 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63424fd0-4534-4687-a4ec-c1c8ec91f95d None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:09.989083 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1764cf-1ed7-4b07-9671-55e821454abb tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '669dc413f7084f93b1b983936ff6d5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0baf2b945474b5bbe5194bf714a0032', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:09.990468 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1764cf-1ed7-4b07-9671-55e821454abb tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:09.991247 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1764cf-1ed7-4b07-9671-55e821454abb tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:09.992018 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1764cf-1ed7-4b07-9671-55e821454abb tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:09.993293 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1764cf-1ed7-4b07-9671-55e821454abb tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:16:09.993955 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1764cf-1ed7-4b07-9671-55e821454abb tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:09.996164 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1764cf-1ed7-4b07-9671-55e821454abb tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:10.051264 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1450/2889] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:16:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:16:10.052087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb909f7-16e2-4a5e-89f7-b6f5bae57ab5 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:10.064797 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb909f7-16e2-4a5e-89f7-b6f5bae57ab5 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:10.073221 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b79784-a033-401f-b981-6851e0922e39 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '669dc413f7084f93b1b983936ff6d5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0baf2b945474b5bbe5194bf714a0032', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:10.074454 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b79784-a033-401f-b981-6851e0922e39 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:10.078738 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b79784-a033-401f-b981-6851e0922e39 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:10.078738 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b79784-a033-401f-b981-6851e0922e39 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:10.078738 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b79784-a033-401f-b981-6851e0922e39 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:10.080052 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b79784-a033-401f-b981-6851e0922e39 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:10.208215 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1440/2890] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:16:10 2022] POST /identity/v3/users => generated 381 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:16:10.212584 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1764cf-1ed7-4b07-9671-55e821454abb tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:10.223911 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1764cf-1ed7-4b07-9671-55e821454abb tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:10.228577 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5d090-7d54-402f-9ce6-c1131936a99a tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '669dc413f7084f93b1b983936ff6d5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0baf2b945474b5bbe5194bf714a0032', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:10.229236 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5d090-7d54-402f-9ce6-c1131936a99a tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:10.229527 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5d090-7d54-402f-9ce6-c1131936a99a tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:10.230090 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5d090-7d54-402f-9ce6-c1131936a99a tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:10.231012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b5d090-7d54-402f-9ce6-c1131936a99a tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:16:10.231328 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b5d090-7d54-402f-9ce6-c1131936a99a tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:10.232950 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b5d090-7d54-402f-9ce6-c1131936a99a tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:10.249635 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1451/2891] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:16:10.328339 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b79784-a033-401f-b981-6851e0922e39 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:10.330182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c1b79784-a033-401f-b981-6851e0922e39 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:10.414966 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba22f2e-93f0-4593-970c-99d40ed1ab4f None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:10.415262 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba22f2e-93f0-4593-970c-99d40ed1ab4f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:10.415552 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba22f2e-93f0-4593-970c-99d40ed1ab4f None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:10.417198 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1452/2892] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:16:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 21:16:10.421899 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba22f2e-93f0-4593-970c-99d40ed1ab4f None None] Authenticating service token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 30 21:16:10.423503 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b79784-a033-401f-b981-6851e0922e39 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:10.428993 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d629d0-7793-42d3-a58a-1b917db07158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:10.430120 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d629d0-7793-42d3-a58a-1b917db07158 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:10.430605 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d629d0-7793-42d3-a58a-1b917db07158 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:10.430935 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d629d0-7793-42d3-a58a-1b917db07158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:10.434158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d1d629d0-7793-42d3-a58a-1b917db07158 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:10.446819 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba22f2e-93f0-4593-970c-99d40ed1ab4f None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:10.465103 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba22f2e-93f0-4593-970c-99d40ed1ab4f None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:10.472003 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a45e901-ad26-47b8-8ef5-eb925d9ed894 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '669dc413f7084f93b1b983936ff6d5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0baf2b945474b5bbe5194bf714a0032', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:10.472905 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45e901-ad26-47b8-8ef5-eb925d9ed894 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:10.473195 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45e901-ad26-47b8-8ef5-eb925d9ed894 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:10.473470 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45e901-ad26-47b8-8ef5-eb925d9ed894 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] PATH_INFO: `/v3/projects/a4181df959bf41a0ac303ffa81490f12` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:10.474703 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a45e901-ad26-47b8-8ef5-eb925d9ed894 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorizing `identity:get_project(project_id=a4181df959bf41a0ac303ffa81490f12)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:10.482625 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a45e901-ad26-47b8-8ef5-eb925d9ed894 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:10.482625 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1453/2893] 10.222.0.23 () {58 vars in 1443 bytes} [Sat Apr 30 21:16:10 2022] GET /identity/v3/projects/a4181df959bf41a0ac303ffa81490f12 => generated 371 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:16:10.522809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d629d0-7793-42d3-a58a-1b917db07158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:10.524787 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d629d0-7793-42d3-a58a-1b917db07158 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:10.535911 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1441/2894] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:16:10 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:16:10.813039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c55c0-0fc3-4b9d-aa8f-dc2e7d7ac585 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:10.813592 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c55c0-0fc3-4b9d-aa8f-dc2e7d7ac585 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:10.814223 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c55c0-0fc3-4b9d-aa8f-dc2e7d7ac585 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:10.816458 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1454/2895] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:16:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:16:10.825050 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d629d0-7793-42d3-a58a-1b917db07158 service neutron] Authenticating service token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 30 21:16:10.856132 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d629d0-7793-42d3-a58a-1b917db07158 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:10.870757 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d629d0-7793-42d3-a58a-1b917db07158 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:10.878311 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffeb0f8-dc77-4be4-b12f-8e45cb12b3e6 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '669dc413f7084f93b1b983936ff6d5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0baf2b945474b5bbe5194bf714a0032', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:10.880133 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffeb0f8-dc77-4be4-b12f-8e45cb12b3e6 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:10.880589 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffeb0f8-dc77-4be4-b12f-8e45cb12b3e6 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:10.881027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffeb0f8-dc77-4be4-b12f-8e45cb12b3e6 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] PATH_INFO: `/v3/projects/a4181df959bf41a0ac303ffa81490f12` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:10.882773 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffeb0f8-dc77-4be4-b12f-8e45cb12b3e6 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorizing `identity:get_project(project_id=a4181df959bf41a0ac303ffa81490f12)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:10.885016 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffeb0f8-dc77-4be4-b12f-8e45cb12b3e6 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:10.897974 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1442/2896] 10.222.0.23 () {58 vars in 1443 bytes} [Sat Apr 30 21:16:10 2022] GET /identity/v3/projects/a4181df959bf41a0ac303ffa81490f12 => generated 371 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:16:10.948005 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c55c0-0fc3-4b9d-aa8f-dc2e7d7ac585 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:10.967178 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c55c0-0fc3-4b9d-aa8f-dc2e7d7ac585 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:10.975995 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30f34a-ffb6-41ae-b0e7-44503a28a2e8 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '669dc413f7084f93b1b983936ff6d5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0baf2b945474b5bbe5194bf714a0032', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:10.977136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30f34a-ffb6-41ae-b0e7-44503a28a2e8 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:10.977441 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30f34a-ffb6-41ae-b0e7-44503a28a2e8 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:10.977710 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30f34a-ffb6-41ae-b0e7-44503a28a2e8 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] PATH_INFO: `/v3/users/10ff20f9eceb4fc3931d65d8145351da` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:10.995170 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb30f34a-ffb6-41ae-b0e7-44503a28a2e8 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorizing `identity:delete_user(user_id=10ff20f9eceb4fc3931d65d8145351da)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:10.997179 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb30f34a-ffb6-41ae-b0e7-44503a28a2e8 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:11.201934 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-cb30f34a-ffb6-41ae-b0e7-44503a28a2e8 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10ff20f9eceb4fc3931d65d8145351da'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:11.226315 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-cb30f34a-ffb6-41ae-b0e7-44503a28a2e8 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10ff20f9eceb4fc3931d65d8145351da'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:11.317161 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-cb30f34a-ffb6-41ae-b0e7-44503a28a2e8 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10ff20f9eceb4fc3931d65d8145351da'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:11.318362 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-cb30f34a-ffb6-41ae-b0e7-44503a28a2e8 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10ff20f9eceb4fc3931d65d8145351da'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:11.331932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-cb30f34a-ffb6-41ae-b0e7-44503a28a2e8 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10ff20f9eceb4fc3931d65d8145351da'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:11.347994 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1455/2897] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:16:10 2022] DELETE /identity/v3/users/10ff20f9eceb4fc3931d65d8145351da => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:11.352284 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffeb0f8-dc77-4be4-b12f-8e45cb12b3e6 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:11.354719 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2ffeb0f8-dc77-4be4-b12f-8e45cb12b3e6 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:11.379851 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffeb0f8-dc77-4be4-b12f-8e45cb12b3e6 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:11.533834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1a847-4de2-41ee-bc1c-d74885734c62 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '669dc413f7084f93b1b983936ff6d5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0baf2b945474b5bbe5194bf714a0032', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:11.534959 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1a847-4de2-41ee-bc1c-d74885734c62 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:11.535482 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1a847-4de2-41ee-bc1c-d74885734c62 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:11.535840 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1a847-4de2-41ee-bc1c-d74885734c62 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] PATH_INFO: `/v3/projects/a4181df959bf41a0ac303ffa81490f12` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:11.537352 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be1a847-4de2-41ee-bc1c-d74885734c62 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a4181df959bf41a0ac303ffa81490f12)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:11.539519 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be1a847-4de2-41ee-bc1c-d74885734c62 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:11.625578 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30f34a-ffb6-41ae-b0e7-44503a28a2e8 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:11.627410 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-cb30f34a-ffb6-41ae-b0e7-44503a28a2e8 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:11.696937 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2be1a847-4de2-41ee-bc1c-d74885734c62 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4181df959bf41a0ac303ffa81490f12', 'request_id': 'req-2be1a847-4de2-41ee-bc1c-d74885734c62'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:11.725900 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2be1a847-4de2-41ee-bc1c-d74885734c62 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4181df959bf41a0ac303ffa81490f12', 'request_id': 'req-2be1a847-4de2-41ee-bc1c-d74885734c62'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:11.733391 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2be1a847-4de2-41ee-bc1c-d74885734c62 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4181df959bf41a0ac303ffa81490f12', 'request_id': 'req-2be1a847-4de2-41ee-bc1c-d74885734c62'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:11.761362 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30f34a-ffb6-41ae-b0e7-44503a28a2e8 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:11.825460 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2be1a847-4de2-41ee-bc1c-d74885734c62 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] The token cache is being invalidate because project a4181df959bf41a0ac303ffa81490f12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:16:11.825460 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2be1a847-4de2-41ee-bc1c-d74885734c62 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:11.825460 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2be1a847-4de2-41ee-bc1c-d74885734c62 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:11.832647 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1443/2898] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:16:11 2022] DELETE /identity/v3/projects/a4181df959bf41a0ac303ffa81490f12 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:11.897020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87872bfd-6171-4fae-8c6a-d44d347c72a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:11.899032 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87872bfd-6171-4fae-8c6a-d44d347c72a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:11.899032 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87872bfd-6171-4fae-8c6a-d44d347c72a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:11.899032 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87872bfd-6171-4fae-8c6a-d44d347c72a5 admin admin] PATH_INFO: `/v3/users/ddcc9f1b17c94698a5df6ffc6482149f` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:11.900298 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87872bfd-6171-4fae-8c6a-d44d347c72a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddcc9f1b17c94698a5df6ffc6482149f)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:11.913011 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87872bfd-6171-4fae-8c6a-d44d347c72a5 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:11.964850 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fc695-d86c-4f52-bc2e-762c0fa7b8f8 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:11.965425 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fc695-d86c-4f52-bc2e-762c0fa7b8f8 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:11.965513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fc695-d86c-4f52-bc2e-762c0fa7b8f8 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:11.967808 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1444/2899] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:16:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:16:11.974905 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625fc695-d86c-4f52-bc2e-762c0fa7b8f8 None None] Authenticating service token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 30 21:16:11.976813 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-625fc695-d86c-4f52-bc2e-762c0fa7b8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:12.088118 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625fc695-d86c-4f52-bc2e-762c0fa7b8f8 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:12.089342 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-625fc695-d86c-4f52-bc2e-762c0fa7b8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:12.176708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625fc695-d86c-4f52-bc2e-762c0fa7b8f8 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:12.182069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-87872bfd-6171-4fae-8c6a-d44d347c72a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddcc9f1b17c94698a5df6ffc6482149f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:12.185141 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44adefc-b660-40f7-a808-cfcf5ee57e4e tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '669dc413f7084f93b1b983936ff6d5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0baf2b945474b5bbe5194bf714a0032', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:12.186008 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44adefc-b660-40f7-a808-cfcf5ee57e4e tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:12.186504 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44adefc-b660-40f7-a808-cfcf5ee57e4e tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:12.187181 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44adefc-b660-40f7-a808-cfcf5ee57e4e tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] PATH_INFO: `/v3/projects/c94e34a3041e471c92d5e3e4ea8da107` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:12.188706 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44adefc-b660-40f7-a808-cfcf5ee57e4e tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorizing `identity:get_project(project_id=c94e34a3041e471c92d5e3e4ea8da107)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:12.191861 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44adefc-b660-40f7-a808-cfcf5ee57e4e tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:12.193939 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1445/2900] 10.222.0.23 () {58 vars in 1443 bytes} [Sat Apr 30 21:16:11 2022] GET /identity/v3/projects/c94e34a3041e471c92d5e3e4ea8da107 => generated 375 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:16:12.212190 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-87872bfd-6171-4fae-8c6a-d44d347c72a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddcc9f1b17c94698a5df6ffc6482149f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:12.284981 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-87872bfd-6171-4fae-8c6a-d44d347c72a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddcc9f1b17c94698a5df6ffc6482149f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:12.286242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-87872bfd-6171-4fae-8c6a-d44d347c72a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddcc9f1b17c94698a5df6ffc6482149f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:12.300231 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-87872bfd-6171-4fae-8c6a-d44d347c72a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddcc9f1b17c94698a5df6ffc6482149f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:12.308347 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1456/2901] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:16:11 2022] DELETE /identity/v3/users/ddcc9f1b17c94698a5df6ffc6482149f => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:16:12.458488 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437af442-a229-49b0-b510-b6de13101067 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:12.458877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437af442-a229-49b0-b510-b6de13101067 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:12.459284 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437af442-a229-49b0-b510-b6de13101067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:12.483556 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-437af442-a229-49b0-b510-b6de13101067 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:12.485729 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-437af442-a229-49b0-b510-b6de13101067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:12.573366 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1446/2902] 10.222.0.23 () {58 vars in 967 bytes} [Sat Apr 30 21:16:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:12.593130 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87872bfd-6171-4fae-8c6a-d44d347c72a5 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:12.594988 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-87872bfd-6171-4fae-8c6a-d44d347c72a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:12.608274 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae979f-eee5-4c5b-b038-57ec92680302 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:12.608708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae979f-eee5-4c5b-b038-57ec92680302 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:12.609156 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae979f-eee5-4c5b-b038-57ec92680302 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:12.614306 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1447/2903] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:16:12 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:16:12.616208 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae979f-eee5-4c5b-b038-57ec92680302 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:12.625087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-85ae979f-eee5-4c5b-b038-57ec92680302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:12.719207 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87872bfd-6171-4fae-8c6a-d44d347c72a5 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:12.730599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae979f-eee5-4c5b-b038-57ec92680302 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:12.732221 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad94498-ecc0-4c12-adcd-ff9f03901169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:12.734073 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad94498-ecc0-4c12-adcd-ff9f03901169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:12.734461 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad94498-ecc0-4c12-adcd-ff9f03901169 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:12.734978 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad94498-ecc0-4c12-adcd-ff9f03901169 admin admin] PATH_INFO: `/v3/projects/711cc97213824857927f7626b41012cb` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:12.738454 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad94498-ecc0-4c12-adcd-ff9f03901169 admin admin] RBAC: Authorizing `identity:delete_project(project_id=711cc97213824857927f7626b41012cb)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:12.740993 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad94498-ecc0-4c12-adcd-ff9f03901169 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:12.744083 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e6768-fa28-4de0-a8f4-319cc3c35aaa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:12.744742 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e6768-fa28-4de0-a8f4-319cc3c35aaa service swift] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:12.746022 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e6768-fa28-4de0-a8f4-319cc3c35aaa service swift] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:12.746022 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e6768-fa28-4de0-a8f4-319cc3c35aaa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:12.771778 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69e6768-fa28-4de0-a8f4-319cc3c35aaa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:12.776610 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69e6768-fa28-4de0-a8f4-319cc3c35aaa service swift] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:12.802902 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1448/2904] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:16:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:16:12.804384 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e6768-fa28-4de0-a8f4-319cc3c35aaa service swift] Authenticating service token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 30 21:16:12.815519 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a69e6768-fa28-4de0-a8f4-319cc3c35aaa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:12.888959 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-cad94498-ecc0-4c12-adcd-ff9f03901169 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '711cc97213824857927f7626b41012cb', 'request_id': 'req-cad94498-ecc0-4c12-adcd-ff9f03901169'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:12.896630 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-cad94498-ecc0-4c12-adcd-ff9f03901169 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '711cc97213824857927f7626b41012cb', 'request_id': 'req-cad94498-ecc0-4c12-adcd-ff9f03901169'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:12.903293 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e6768-fa28-4de0-a8f4-319cc3c35aaa service swift] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:12.903493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-cad94498-ecc0-4c12-adcd-ff9f03901169 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '711cc97213824857927f7626b41012cb', 'request_id': 'req-cad94498-ecc0-4c12-adcd-ff9f03901169'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:12.904605 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a69e6768-fa28-4de0-a8f4-319cc3c35aaa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:12.982463 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e6768-fa28-4de0-a8f4-319cc3c35aaa service swift] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:12.996501 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-cad94498-ecc0-4c12-adcd-ff9f03901169 admin admin] The token cache is being invalidate because project 711cc97213824857927f7626b41012cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:16:12.996501 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-cad94498-ecc0-4c12-adcd-ff9f03901169 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:12.996501 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-cad94498-ecc0-4c12-adcd-ff9f03901169 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:13.004057 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1457/2905] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:16:12 2022] DELETE /identity/v3/projects/711cc97213824857927f7626b41012cb => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:13.005775 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d202f-120c-4641-9f6b-44f61e68fd06 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:13.006156 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d202f-120c-4641-9f6b-44f61e68fd06 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:13.006320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d202f-120c-4641-9f6b-44f61e68fd06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:13.039046 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-f01d202f-120c-4641-9f6b-44f61e68fd06 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:13.040471 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f01d202f-120c-4641-9f6b-44f61e68fd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:13.055995 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72c562-5902-41e6-852d-add1f8aa1149 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '669dc413f7084f93b1b983936ff6d5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0baf2b945474b5bbe5194bf714a0032', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:13.057250 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72c562-5902-41e6-852d-add1f8aa1149 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:13.058060 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72c562-5902-41e6-852d-add1f8aa1149 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:13.058450 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72c562-5902-41e6-852d-add1f8aa1149 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] PATH_INFO: `/v3/projects/c94e34a3041e471c92d5e3e4ea8da107` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:13.060502 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72c562-5902-41e6-852d-add1f8aa1149 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorizing `identity:get_project(project_id=c94e34a3041e471c92d5e3e4ea8da107)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:13.063693 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72c562-5902-41e6-852d-add1f8aa1149 tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:13.066697 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1449/2906] 10.222.0.23 () {58 vars in 1443 bytes} [Sat Apr 30 21:16:12 2022] GET /identity/v3/projects/c94e34a3041e471c92d5e3e4ea8da107 => generated 375 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:16:13.139443 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1458/2907] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:13.147975 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f986d98-49e5-4269-b683-7994a72edd52 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:13.148298 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f986d98-49e5-4269-b683-7994a72edd52 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:13.148575 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f986d98-49e5-4269-b683-7994a72edd52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:13.167987 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-4f986d98-49e5-4269-b683-7994a72edd52 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:13.169699 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4f986d98-49e5-4269-b683-7994a72edd52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:13.180468 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1450/2908] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:13.183954 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d202f-120c-4641-9f6b-44f61e68fd06 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:13.195696 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d202f-120c-4641-9f6b-44f61e68fd06 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:13.200677 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708388ba-ba87-49c6-a94c-b7e08a5dccea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:13.201342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708388ba-ba87-49c6-a94c-b7e08a5dccea admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:13.201626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708388ba-ba87-49c6-a94c-b7e08a5dccea admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:13.201942 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708388ba-ba87-49c6-a94c-b7e08a5dccea admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:13.202649 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708388ba-ba87-49c6-a94c-b7e08a5dccea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:16:13.202950 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708388ba-ba87-49c6-a94c-b7e08a5dccea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:13.204802 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708388ba-ba87-49c6-a94c-b7e08a5dccea admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:13.219842 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1459/2909] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:16:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:16:13.229193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f986d98-49e5-4269-b683-7994a72edd52 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:13.240827 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f986d98-49e5-4269-b683-7994a72edd52 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:13.245947 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c552f2f-8c65-4ea4-9b22-acdfd4430d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:13.247175 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c552f2f-8c65-4ea4-9b22-acdfd4430d43 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:13.247467 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c552f2f-8c65-4ea4-9b22-acdfd4430d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:13.247887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c552f2f-8c65-4ea4-9b22-acdfd4430d43 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:13.248717 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c552f2f-8c65-4ea4-9b22-acdfd4430d43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:13.251119 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c552f2f-8c65-4ea4-9b22-acdfd4430d43 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:13.374570 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1451/2910] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:16:13 2022] POST /identity/v3/projects => generated 375 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:16:13.379203 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708388ba-ba87-49c6-a94c-b7e08a5dccea admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:13.389135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708388ba-ba87-49c6-a94c-b7e08a5dccea admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:13.453746 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e468cd9-1a48-482c-aeb8-48aa2af0bcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:13.454465 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e468cd9-1a48-482c-aeb8-48aa2af0bcf9 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:13.455081 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e468cd9-1a48-482c-aeb8-48aa2af0bcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:13.456168 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e468cd9-1a48-482c-aeb8-48aa2af0bcf9 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:13.456964 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e468cd9-1a48-482c-aeb8-48aa2af0bcf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:13.459134 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e468cd9-1a48-482c-aeb8-48aa2af0bcf9 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:13.556804 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1460/2911] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:16:13 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:16:13.561371 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c552f2f-8c65-4ea4-9b22-acdfd4430d43 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:13.574079 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c552f2f-8c65-4ea4-9b22-acdfd4430d43 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:13.581258 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffb468-ad74-4d0d-8817-993896f3f92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:13.582579 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffb468-ad74-4d0d-8817-993896f3f92f admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:13.583112 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffb468-ad74-4d0d-8817-993896f3f92f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:13.583464 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffb468-ad74-4d0d-8817-993896f3f92f admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:13.584428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ffb468-ad74-4d0d-8817-993896f3f92f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:13.587100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ffb468-ad74-4d0d-8817-993896f3f92f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:13.603645 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1452/2912] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:16:13.608096 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e468cd9-1a48-482c-aeb8-48aa2af0bcf9 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:13.619105 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e468cd9-1a48-482c-aeb8-48aa2af0bcf9 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:13.624441 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a8d07-3dab-4f4d-9386-3ecef1ad15fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:13.625373 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a8d07-3dab-4f4d-9386-3ecef1ad15fd admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:13.625666 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a8d07-3dab-4f4d-9386-3ecef1ad15fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:13.625965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a8d07-3dab-4f4d-9386-3ecef1ad15fd admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:13.634054 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a8d07-3dab-4f4d-9386-3ecef1ad15fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:13.634054 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a8d07-3dab-4f4d-9386-3ecef1ad15fd admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:13.644186 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1461/2913] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:16:13.648670 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffb468-ad74-4d0d-8817-993896f3f92f admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:13.659494 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffb468-ad74-4d0d-8817-993896f3f92f admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:13.664109 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb67d89-57b7-418d-9a72-7f5ce079f3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:13.664981 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb67d89-57b7-418d-9a72-7f5ce079f3dc admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:13.665261 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb67d89-57b7-418d-9a72-7f5ce079f3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:13.665536 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb67d89-57b7-418d-9a72-7f5ce079f3dc admin admin] PATH_INFO: `/v3/projects/0f441a03b7f34ed8844de96c148d37a9/users/758c281bb61043f1a7d743fb11071944/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:13.680410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb67d89-57b7-418d-9a72-7f5ce079f3dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f441a03b7f34ed8844de96c148d37a9, user_id=758c281bb61043f1a7d743fb11071944, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:13.683149 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb67d89-57b7-418d-9a72-7f5ce079f3dc admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:13.767045 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1453/2914] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:16:13 2022] PUT /identity/v3/projects/0f441a03b7f34ed8844de96c148d37a9/users/758c281bb61043f1a7d743fb11071944/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:13.778153 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228c026-f02d-4940-9c9e-9f3fcaae8273 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:13.778447 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228c026-f02d-4940-9c9e-9f3fcaae8273 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:13.778725 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228c026-f02d-4940-9c9e-9f3fcaae8273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:13.807699 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-d228c026-f02d-4940-9c9e-9f3fcaae8273 None None] MFA Rules not processed for user `758c281bb61043f1a7d743fb11071944`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:13.809958 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d228c026-f02d-4940-9c9e-9f3fcaae8273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:13.888422 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1462/2915] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:14.743180 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb67d89-57b7-418d-9a72-7f5ce079f3dc admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:14.745613 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ecb67d89-57b7-418d-9a72-7f5ce079f3dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:14.830044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb67d89-57b7-418d-9a72-7f5ce079f3dc admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:14.836041 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b891d-6de0-411a-99a2-3a0da2220078 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:14.837154 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b891d-6de0-411a-99a2-3a0da2220078 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:14.837414 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b891d-6de0-411a-99a2-3a0da2220078 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:14.837733 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b891d-6de0-411a-99a2-3a0da2220078 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:14.846732 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892b891d-6de0-411a-99a2-3a0da2220078 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:14.849274 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892b891d-6de0-411a-99a2-3a0da2220078 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:14.861518 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1454/2916] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:16:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:16:14.971089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e0fa0-1362-45c5-ac0f-32749d967623 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:14.972637 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e0fa0-1362-45c5-ac0f-32749d967623 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:14.973202 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e0fa0-1362-45c5-ac0f-32749d967623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:14.999105 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-564e0fa0-1362-45c5-ac0f-32749d967623 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:15.000377 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-564e0fa0-1362-45c5-ac0f-32749d967623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:15.068085 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1463/2917] 10.222.0.23 () {58 vars in 967 bytes} [Sat Apr 30 21:16:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:15.083254 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b891d-6de0-411a-99a2-3a0da2220078 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:15.084917 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-892b891d-6de0-411a-99a2-3a0da2220078 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:15.234645 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b891d-6de0-411a-99a2-3a0da2220078 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:15.242486 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2c6c1-89e9-48a0-9d73-976108aa9ad4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:15.243325 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2c6c1-89e9-48a0-9d73-976108aa9ad4 service swift] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:15.243623 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2c6c1-89e9-48a0-9d73-976108aa9ad4 service swift] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:15.243904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2c6c1-89e9-48a0-9d73-976108aa9ad4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:15.256748 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b2c6c1-89e9-48a0-9d73-976108aa9ad4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:15.270687 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b2c6c1-89e9-48a0-9d73-976108aa9ad4 service swift] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:15.292530 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1455/2918] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:16:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 30 21:16:15.348934 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662c162-e961-4b14-9ab8-c7262d0fd086 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:15.349584 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662c162-e961-4b14-9ab8-c7262d0fd086 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:15.350175 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662c162-e961-4b14-9ab8-c7262d0fd086 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:15.352216 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1464/2919] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:16:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:16:15.358034 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2c6c1-89e9-48a0-9d73-976108aa9ad4 service swift] Authenticating service token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 30 21:16:15.375174 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2c6c1-89e9-48a0-9d73-976108aa9ad4 service swift] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:15.382529 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-65b2c6c1-89e9-48a0-9d73-976108aa9ad4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:15.542161 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2c6c1-89e9-48a0-9d73-976108aa9ad4 service swift] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:15.546969 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c088b-675e-4b46-9bd1-4a61653f36eb tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '669dc413f7084f93b1b983936ff6d5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0baf2b945474b5bbe5194bf714a0032', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:15.547942 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c088b-675e-4b46-9bd1-4a61653f36eb tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:15.548311 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c088b-675e-4b46-9bd1-4a61653f36eb tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:15.548628 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c088b-675e-4b46-9bd1-4a61653f36eb tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] PATH_INFO: `/v3/projects/c94e34a3041e471c92d5e3e4ea8da107` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:15.550804 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c088b-675e-4b46-9bd1-4a61653f36eb tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorizing `identity:get_project(project_id=c94e34a3041e471c92d5e3e4ea8da107)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:15.554196 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c088b-675e-4b46-9bd1-4a61653f36eb tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:15.560009 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1456/2920] 10.222.0.23 () {58 vars in 1443 bytes} [Sat Apr 30 21:16:15 2022] GET /identity/v3/projects/c94e34a3041e471c92d5e3e4ea8da107 => generated 375 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:16:17.219121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662c162-e961-4b14-9ab8-c7262d0fd086 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:17.221290 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-9662c162-e961-4b14-9ab8-c7262d0fd086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:17.256689 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662c162-e961-4b14-9ab8-c7262d0fd086 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:17.267088 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb1cd0-04b3-464e-a949-6e237877aef7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:17.268153 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb1cd0-04b3-464e-a949-6e237877aef7 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:17.280327 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb1cd0-04b3-464e-a949-6e237877aef7 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:17.280641 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb1cd0-04b3-464e-a949-6e237877aef7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:17.283572 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-82fb1cd0-04b3-464e-a949-6e237877aef7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:17.371574 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fb1cd0-04b3-464e-a949-6e237877aef7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:17.373399 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fb1cd0-04b3-464e-a949-6e237877aef7 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:17.388942 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1465/2921] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:16:17 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:16:17.609198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c088b-675e-4b46-9bd1-4a61653f36eb tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:17.626457 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c088b-675e-4b46-9bd1-4a61653f36eb tempest-QuotasAdminTestJSON-146538377 tempest-QuotasAdminTestJSON-146538377-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:17.633445 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb417e8-a7c7-415c-a132-582d865fa7aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:17.634414 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb417e8-a7c7-415c-a132-582d865fa7aa service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:17.634934 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb417e8-a7c7-415c-a132-582d865fa7aa service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:17.640118 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb417e8-a7c7-415c-a132-582d865fa7aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:17.640118 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-abb417e8-a7c7-415c-a132-582d865fa7aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:17.652547 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb417e8-a7c7-415c-a132-582d865fa7aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:17.654226 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb417e8-a7c7-415c-a132-582d865fa7aa service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:17.668268 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1457/2922] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:16:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:16:17.790807 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7f97f-c9e7-48bc-b499-95feff6f46ad None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:17.791512 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7f97f-c9e7-48bc-b499-95feff6f46ad None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:17.797570 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7f97f-c9e7-48bc-b499-95feff6f46ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:17.819087 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-d5a7f97f-c9e7-48bc-b499-95feff6f46ad None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:17.820748 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d5a7f97f-c9e7-48bc-b499-95feff6f46ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:17.838361 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1466/2923] 10.222.0.23 () {58 vars in 967 bytes} [Sat Apr 30 21:16:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:17.851522 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb417e8-a7c7-415c-a132-582d865fa7aa service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:17.873918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb417e8-a7c7-415c-a132-582d865fa7aa service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:17.890879 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09805270-69d0-4f18-afa4-d15eb2af62c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:17.891557 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09805270-69d0-4f18-afa4-d15eb2af62c0 service swift] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:17.891841 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09805270-69d0-4f18-afa4-d15eb2af62c0 service swift] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:17.892118 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09805270-69d0-4f18-afa4-d15eb2af62c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:17.901384 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09805270-69d0-4f18-afa4-d15eb2af62c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:17.903038 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09805270-69d0-4f18-afa4-d15eb2af62c0 service swift] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:17.913034 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1458/2924] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:16:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:16:18.147803 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7f97f-c9e7-48bc-b499-95feff6f46ad None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:18.149201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d5a7f97f-c9e7-48bc-b499-95feff6f46ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:18.259685 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7f97f-c9e7-48bc-b499-95feff6f46ad None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:18.271578 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f62c574-bd68-40b5-ab46-4ecb7bf4f098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:18.274064 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62c574-bd68-40b5-ab46-4ecb7bf4f098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:18.274563 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62c574-bd68-40b5-ab46-4ecb7bf4f098 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:18.274860 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62c574-bd68-40b5-ab46-4ecb7bf4f098 admin admin] PATH_INFO: `/v3/users/86ca2b1a64364c0a8a816e6f657ffa90` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:18.276403 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f62c574-bd68-40b5-ab46-4ecb7bf4f098 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86ca2b1a64364c0a8a816e6f657ffa90)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:18.278819 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f62c574-bd68-40b5-ab46-4ecb7bf4f098 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:18.520634 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7f62c574-bd68-40b5-ab46-4ecb7bf4f098 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86ca2b1a64364c0a8a816e6f657ffa90'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:18.532900 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7f62c574-bd68-40b5-ab46-4ecb7bf4f098 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86ca2b1a64364c0a8a816e6f657ffa90'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:18.756590 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7f62c574-bd68-40b5-ab46-4ecb7bf4f098 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86ca2b1a64364c0a8a816e6f657ffa90'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:18.757221 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7f62c574-bd68-40b5-ab46-4ecb7bf4f098 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86ca2b1a64364c0a8a816e6f657ffa90'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:18.764901 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7f62c574-bd68-40b5-ab46-4ecb7bf4f098 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86ca2b1a64364c0a8a816e6f657ffa90'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:18.770998 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1467/2925] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:16:18 2022] DELETE /identity/v3/users/86ca2b1a64364c0a8a816e6f657ffa90 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:18.775484 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838be72-2ee0-4a2c-b7ec-34c98c2ce34f None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:18.775981 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838be72-2ee0-4a2c-b7ec-34c98c2ce34f None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:18.776094 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838be72-2ee0-4a2c-b7ec-34c98c2ce34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:18.797932 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-1838be72-2ee0-4a2c-b7ec-34c98c2ce34f None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:18.797932 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1838be72-2ee0-4a2c-b7ec-34c98c2ce34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:18.860806 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1459/2926] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:18.868754 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f62c574-bd68-40b5-ab46-4ecb7bf4f098 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:18.870291 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7f62c574-bd68-40b5-ab46-4ecb7bf4f098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:18.935048 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f62c574-bd68-40b5-ab46-4ecb7bf4f098 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:18.938787 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79875d-0bc8-4f3d-be38-5955b2d9f6e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:18.939442 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79875d-0bc8-4f3d-be38-5955b2d9f6e6 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:18.942623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79875d-0bc8-4f3d-be38-5955b2d9f6e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:18.942623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79875d-0bc8-4f3d-be38-5955b2d9f6e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:18.949431 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed79875d-0bc8-4f3d-be38-5955b2d9f6e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:18.950915 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed79875d-0bc8-4f3d-be38-5955b2d9f6e6 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:18.961449 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1468/2927] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:16:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:16:19.485585 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838be72-2ee0-4a2c-b7ec-34c98c2ce34f None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:19.487035 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1838be72-2ee0-4a2c-b7ec-34c98c2ce34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:19.504273 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838be72-2ee0-4a2c-b7ec-34c98c2ce34f None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:19.514277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809b292-1cb3-42cd-9adb-968c5fa1d8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:19.514277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809b292-1cb3-42cd-9adb-968c5fa1d8a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:19.514570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809b292-1cb3-42cd-9adb-968c5fa1d8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:19.515064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809b292-1cb3-42cd-9adb-968c5fa1d8a0 admin admin] PATH_INFO: `/v3/projects/c94e34a3041e471c92d5e3e4ea8da107` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:19.516731 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0809b292-1cb3-42cd-9adb-968c5fa1d8a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c94e34a3041e471c92d5e3e4ea8da107)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:19.519595 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0809b292-1cb3-42cd-9adb-968c5fa1d8a0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:19.634223 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0809b292-1cb3-42cd-9adb-968c5fa1d8a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c94e34a3041e471c92d5e3e4ea8da107', 'request_id': 'req-0809b292-1cb3-42cd-9adb-968c5fa1d8a0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:19.640378 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0809b292-1cb3-42cd-9adb-968c5fa1d8a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c94e34a3041e471c92d5e3e4ea8da107', 'request_id': 'req-0809b292-1cb3-42cd-9adb-968c5fa1d8a0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:19.647585 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0809b292-1cb3-42cd-9adb-968c5fa1d8a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c94e34a3041e471c92d5e3e4ea8da107', 'request_id': 'req-0809b292-1cb3-42cd-9adb-968c5fa1d8a0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:19.776508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0809b292-1cb3-42cd-9adb-968c5fa1d8a0 admin admin] The token cache is being invalidate because project c94e34a3041e471c92d5e3e4ea8da107 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:16:19.776508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0809b292-1cb3-42cd-9adb-968c5fa1d8a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:19.776508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0809b292-1cb3-42cd-9adb-968c5fa1d8a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:19.780059 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1460/2928] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:16:19 2022] DELETE /identity/v3/projects/c94e34a3041e471c92d5e3e4ea8da107 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:19.781015 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79875d-0bc8-4f3d-be38-5955b2d9f6e6 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:19.791381 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79875d-0bc8-4f3d-be38-5955b2d9f6e6 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:19.865211 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53776c43-6a4d-45ed-9d84-a07de53e72b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:19.866137 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53776c43-6a4d-45ed-9d84-a07de53e72b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:19.866421 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53776c43-6a4d-45ed-9d84-a07de53e72b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:19.866698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53776c43-6a4d-45ed-9d84-a07de53e72b4 admin admin] PATH_INFO: `/v3/users/669dc413f7084f93b1b983936ff6d5d0` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:19.867922 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53776c43-6a4d-45ed-9d84-a07de53e72b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=669dc413f7084f93b1b983936ff6d5d0)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:19.869927 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53776c43-6a4d-45ed-9d84-a07de53e72b4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:20.203708 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-53776c43-6a4d-45ed-9d84-a07de53e72b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '669dc413f7084f93b1b983936ff6d5d0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:20.217511 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-53776c43-6a4d-45ed-9d84-a07de53e72b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '669dc413f7084f93b1b983936ff6d5d0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:20.302520 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-53776c43-6a4d-45ed-9d84-a07de53e72b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '669dc413f7084f93b1b983936ff6d5d0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:20.306764 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-53776c43-6a4d-45ed-9d84-a07de53e72b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '669dc413f7084f93b1b983936ff6d5d0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:20.311266 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-53776c43-6a4d-45ed-9d84-a07de53e72b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '669dc413f7084f93b1b983936ff6d5d0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:20.317893 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1469/2929] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:16:19 2022] DELETE /identity/v3/users/669dc413f7084f93b1b983936ff6d5d0 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:16:20.783802 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809b292-1cb3-42cd-9adb-968c5fa1d8a0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:20.785904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0809b292-1cb3-42cd-9adb-968c5fa1d8a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:20.838574 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809b292-1cb3-42cd-9adb-968c5fa1d8a0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:20.966846 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f296c5a-a096-4464-a82d-9241cde7b331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:20.968101 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f296c5a-a096-4464-a82d-9241cde7b331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:20.968542 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f296c5a-a096-4464-a82d-9241cde7b331 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:20.969136 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f296c5a-a096-4464-a82d-9241cde7b331 admin admin] PATH_INFO: `/v3/projects/d0baf2b945474b5bbe5194bf714a0032` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:20.970711 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f296c5a-a096-4464-a82d-9241cde7b331 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0baf2b945474b5bbe5194bf714a0032)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:20.973725 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f296c5a-a096-4464-a82d-9241cde7b331 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:21.103710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2f296c5a-a096-4464-a82d-9241cde7b331 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0baf2b945474b5bbe5194bf714a0032', 'request_id': 'req-2f296c5a-a096-4464-a82d-9241cde7b331'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:21.110156 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2f296c5a-a096-4464-a82d-9241cde7b331 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0baf2b945474b5bbe5194bf714a0032', 'request_id': 'req-2f296c5a-a096-4464-a82d-9241cde7b331'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:21.118228 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2f296c5a-a096-4464-a82d-9241cde7b331 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0baf2b945474b5bbe5194bf714a0032', 'request_id': 'req-2f296c5a-a096-4464-a82d-9241cde7b331'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:21.304015 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2f296c5a-a096-4464-a82d-9241cde7b331 admin admin] The token cache is being invalidate because project d0baf2b945474b5bbe5194bf714a0032 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:16:21.304994 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2f296c5a-a096-4464-a82d-9241cde7b331 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:21.305960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2f296c5a-a096-4464-a82d-9241cde7b331 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:21.314540 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1461/2930] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:16:20 2022] DELETE /identity/v3/projects/d0baf2b945474b5bbe5194bf714a0032 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:21.315137 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aeb288-3e13-4858-8b03-9fba33426b3f None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:21.316701 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aeb288-3e13-4858-8b03-9fba33426b3f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:21.319457 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aeb288-3e13-4858-8b03-9fba33426b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:21.347412 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-65aeb288-3e13-4858-8b03-9fba33426b3f None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:21.349416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-65aeb288-3e13-4858-8b03-9fba33426b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:21.488571 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344dba09-cc3b-47fe-9c6e-da0d1ea116cf None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:21.489354 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344dba09-cc3b-47fe-9c6e-da0d1ea116cf None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:21.492984 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344dba09-cc3b-47fe-9c6e-da0d1ea116cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:21.493110 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1470/2931] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:21.524776 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-344dba09-cc3b-47fe-9c6e-da0d1ea116cf None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:21.526481 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-344dba09-cc3b-47fe-9c6e-da0d1ea116cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:21.543314 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1462/2932] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:21.544161 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aeb288-3e13-4858-8b03-9fba33426b3f None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:21.560795 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aeb288-3e13-4858-8b03-9fba33426b3f None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:21.568298 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba0dee-3f3c-452a-8f34-0844927f7a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:21.569917 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba0dee-3f3c-452a-8f34-0844927f7a41 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:21.570568 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba0dee-3f3c-452a-8f34-0844927f7a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:21.573569 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba0dee-3f3c-452a-8f34-0844927f7a41 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:21.574638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba0dee-3f3c-452a-8f34-0844927f7a41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:16:21.574918 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba0dee-3f3c-452a-8f34-0844927f7a41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:21.581058 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba0dee-3f3c-452a-8f34-0844927f7a41 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:21.604321 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344dba09-cc3b-47fe-9c6e-da0d1ea116cf None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:21.615682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344dba09-cc3b-47fe-9c6e-da0d1ea116cf None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:21.616301 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1471/2933] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:16:21.622681 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3744c6-f357-437d-a37f-84998acae6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:21.624063 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3744c6-f357-437d-a37f-84998acae6ee admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:21.624524 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3744c6-f357-437d-a37f-84998acae6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:21.624907 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3744c6-f357-437d-a37f-84998acae6ee admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:21.625715 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3744c6-f357-437d-a37f-84998acae6ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:21.628519 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3744c6-f357-437d-a37f-84998acae6ee admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:21.754817 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba0dee-3f3c-452a-8f34-0844927f7a41 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:21.761697 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1463/2934] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:16:21 2022] POST /identity/v3/projects => generated 375 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:16:21.765626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba0dee-3f3c-452a-8f34-0844927f7a41 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:21.872477 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfcce8-0f45-49db-8f41-5c29f5bf0a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:21.873342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfcce8-0f45-49db-8f41-5c29f5bf0a76 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:21.873642 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfcce8-0f45-49db-8f41-5c29f5bf0a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:21.873949 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfcce8-0f45-49db-8f41-5c29f5bf0a76 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:21.874647 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cfcce8-0f45-49db-8f41-5c29f5bf0a76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:21.879335 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cfcce8-0f45-49db-8f41-5c29f5bf0a76 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:21.989444 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1472/2935] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:16:21 2022] POST /identity/v3/users => generated 288 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:16:21.993305 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3744c6-f357-437d-a37f-84998acae6ee admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:22.004203 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3744c6-f357-437d-a37f-84998acae6ee admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:22.010624 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6982e65-af53-435a-a15e-93d7041922db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:22.011489 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6982e65-af53-435a-a15e-93d7041922db admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:22.012675 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6982e65-af53-435a-a15e-93d7041922db admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:22.014415 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6982e65-af53-435a-a15e-93d7041922db admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:22.014415 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6982e65-af53-435a-a15e-93d7041922db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:22.016140 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6982e65-af53-435a-a15e-93d7041922db admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:22.041559 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1464/2936] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:16:22.042444 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfcce8-0f45-49db-8f41-5c29f5bf0a76 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:22.057290 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfcce8-0f45-49db-8f41-5c29f5bf0a76 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:22.068089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cdbcb9-64be-4ff7-a709-d9acd0682d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:22.069116 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cdbcb9-64be-4ff7-a709-d9acd0682d33 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:22.069591 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cdbcb9-64be-4ff7-a709-d9acd0682d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:22.070105 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cdbcb9-64be-4ff7-a709-d9acd0682d33 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:22.071613 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cdbcb9-64be-4ff7-a709-d9acd0682d33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:22.074271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cdbcb9-64be-4ff7-a709-d9acd0682d33 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:22.091348 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1473/2937] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:16:22.093338 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6982e65-af53-435a-a15e-93d7041922db admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:22.116455 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6982e65-af53-435a-a15e-93d7041922db admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:22.135849 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89fbac-aa7a-4706-b456-0bb80a3250b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:22.135849 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89fbac-aa7a-4706-b456-0bb80a3250b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:22.135849 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89fbac-aa7a-4706-b456-0bb80a3250b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:22.136124 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89fbac-aa7a-4706-b456-0bb80a3250b0 admin admin] PATH_INFO: `/v3/projects/f8c321556e674332869a5a14027cb2ae/users/05bad6ce98d545adbe2343a969a33a9c/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:22.167733 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed89fbac-aa7a-4706-b456-0bb80a3250b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8c321556e674332869a5a14027cb2ae, user_id=05bad6ce98d545adbe2343a969a33a9c, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:22.170759 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed89fbac-aa7a-4706-b456-0bb80a3250b0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:22.255206 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1465/2938] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:16:22 2022] PUT /identity/v3/projects/f8c321556e674332869a5a14027cb2ae/users/05bad6ce98d545adbe2343a969a33a9c/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:22.267170 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3982df-7d7d-4f12-ab86-57fadee54ca5 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:22.267456 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3982df-7d7d-4f12-ab86-57fadee54ca5 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:22.267739 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3982df-7d7d-4f12-ab86-57fadee54ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:22.325990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-0e3982df-7d7d-4f12-ab86-57fadee54ca5 None None] MFA Rules not processed for user `05bad6ce98d545adbe2343a969a33a9c`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:22.327290 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0e3982df-7d7d-4f12-ab86-57fadee54ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:22.459409 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1474/2939] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:22.463685 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89fbac-aa7a-4706-b456-0bb80a3250b0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:22.592686 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89fbac-aa7a-4706-b456-0bb80a3250b0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:22.601398 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb654a6-0220-4d0e-a5a9-a0fb3168651d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:22.603065 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb654a6-0220-4d0e-a5a9-a0fb3168651d admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:22.604022 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb654a6-0220-4d0e-a5a9-a0fb3168651d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:22.606858 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb654a6-0220-4d0e-a5a9-a0fb3168651d admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:22.607847 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb654a6-0220-4d0e-a5a9-a0fb3168651d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:22.611599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb654a6-0220-4d0e-a5a9-a0fb3168651d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:22.800070 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1466/2940] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:16:22 2022] POST /identity/v3/projects => generated 373 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:16:22.803638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3982df-7d7d-4f12-ab86-57fadee54ca5 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:22.822319 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3982df-7d7d-4f12-ab86-57fadee54ca5 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:22.918138 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe74a4-b1a4-49bb-847f-3ce7fc305892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:22.919792 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe74a4-b1a4-49bb-847f-3ce7fc305892 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:22.920610 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe74a4-b1a4-49bb-847f-3ce7fc305892 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:22.921139 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe74a4-b1a4-49bb-847f-3ce7fc305892 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:22.923775 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe74a4-b1a4-49bb-847f-3ce7fc305892 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:22.926698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe74a4-b1a4-49bb-847f-3ce7fc305892 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:23.064773 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1475/2941] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:16:22 2022] POST /identity/v3/users => generated 293 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:16:23.068175 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb654a6-0220-4d0e-a5a9-a0fb3168651d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:23.101152 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb654a6-0220-4d0e-a5a9-a0fb3168651d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:23.113996 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50d6a8-db45-48e5-980f-cb4c4a198882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:23.116294 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50d6a8-db45-48e5-980f-cb4c4a198882 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:23.116803 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50d6a8-db45-48e5-980f-cb4c4a198882 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:23.117285 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50d6a8-db45-48e5-980f-cb4c4a198882 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:23.118230 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc50d6a8-db45-48e5-980f-cb4c4a198882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:23.120791 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc50d6a8-db45-48e5-980f-cb4c4a198882 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:23.150817 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1467/2942] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:16:23.154724 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe74a4-b1a4-49bb-847f-3ce7fc305892 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:23.166192 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe74a4-b1a4-49bb-847f-3ce7fc305892 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:23.171158 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35de427-d50d-4150-96f7-bf44147b4810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:23.172204 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35de427-d50d-4150-96f7-bf44147b4810 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:23.172491 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35de427-d50d-4150-96f7-bf44147b4810 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:23.172772 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35de427-d50d-4150-96f7-bf44147b4810 admin admin] PATH_INFO: `/v3/projects/362866a41b8c4e98becd7806f19c9c6c/users/e2bc0d89f037486c9045c77d49413d0c/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:23.193241 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35de427-d50d-4150-96f7-bf44147b4810 admin admin] RBAC: Authorizing `identity:create_grant(project_id=362866a41b8c4e98becd7806f19c9c6c, user_id=e2bc0d89f037486c9045c77d49413d0c, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:23.196456 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35de427-d50d-4150-96f7-bf44147b4810 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:23.363651 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1476/2943] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:16:23 2022] PUT /identity/v3/projects/362866a41b8c4e98becd7806f19c9c6c/users/e2bc0d89f037486c9045c77d49413d0c/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:16:23.368056 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50d6a8-db45-48e5-980f-cb4c4a198882 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:23.384987 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50d6a8-db45-48e5-980f-cb4c4a198882 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:23.503953 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf2290-10b2-4a79-8b1a-3863fbd96387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:23.504752 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf2290-10b2-4a79-8b1a-3863fbd96387 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:23.505098 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf2290-10b2-4a79-8b1a-3863fbd96387 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:23.505449 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf2290-10b2-4a79-8b1a-3863fbd96387 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:23.506311 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf2290-10b2-4a79-8b1a-3863fbd96387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:23.509045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf2290-10b2-4a79-8b1a-3863fbd96387 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:23.526218 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1468/2944] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:16:23.529076 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35de427-d50d-4150-96f7-bf44147b4810 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:23.543776 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35de427-d50d-4150-96f7-bf44147b4810 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:23.551177 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd602186-8755-47c2-a384-2694fe9d332d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:23.552448 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd602186-8755-47c2-a384-2694fe9d332d admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:23.553079 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd602186-8755-47c2-a384-2694fe9d332d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:23.553633 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd602186-8755-47c2-a384-2694fe9d332d admin admin] PATH_INFO: `/v3/projects/362866a41b8c4e98becd7806f19c9c6c/users/e2bc0d89f037486c9045c77d49413d0c/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:23.556092 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd602186-8755-47c2-a384-2694fe9d332d admin admin] RBAC: Authorizing `identity:create_grant(project_id=362866a41b8c4e98becd7806f19c9c6c, user_id=e2bc0d89f037486c9045c77d49413d0c, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:23.564786 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd602186-8755-47c2-a384-2694fe9d332d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:23.619952 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1477/2945] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:16:23 2022] PUT /identity/v3/projects/362866a41b8c4e98becd7806f19c9c6c/users/e2bc0d89f037486c9045c77d49413d0c/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:23.630068 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809c2d1-e173-4471-a824-541813ec4f53 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:23.630528 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809c2d1-e173-4471-a824-541813ec4f53 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:23.630740 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809c2d1-e173-4471-a824-541813ec4f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:23.668608 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-a809c2d1-e173-4471-a824-541813ec4f53 None None] MFA Rules not processed for user `e2bc0d89f037486c9045c77d49413d0c`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:23.669977 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a809c2d1-e173-4471-a824-541813ec4f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:23.769911 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1469/2946] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:23 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:16:23.774041 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd602186-8755-47c2-a384-2694fe9d332d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:23.785311 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd602186-8755-47c2-a384-2694fe9d332d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:23.790172 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0e34e-d913-4a6b-9519-e992d6ae7f94 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2bc0d89f037486c9045c77d49413d0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '362866a41b8c4e98becd7806f19c9c6c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:23.791139 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0e34e-d913-4a6b-9519-e992d6ae7f94 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:23.791487 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0e34e-d913-4a6b-9519-e992d6ae7f94 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:23.792031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0e34e-d913-4a6b-9519-e992d6ae7f94 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:23.792823 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f0e34e-d913-4a6b-9519-e992d6ae7f94 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:16:23.793383 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f0e34e-d913-4a6b-9519-e992d6ae7f94 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:23.795216 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f0e34e-d913-4a6b-9519-e992d6ae7f94 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:23.807490 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1478/2947] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:16:23.812031 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809c2d1-e173-4471-a824-541813ec4f53 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:23.823006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809c2d1-e173-4471-a824-541813ec4f53 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:23.828848 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2f47e-22dc-430e-8a7e-41590cd4cdf6 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2bc0d89f037486c9045c77d49413d0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '362866a41b8c4e98becd7806f19c9c6c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:23.829576 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2f47e-22dc-430e-8a7e-41590cd4cdf6 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:23.829959 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2f47e-22dc-430e-8a7e-41590cd4cdf6 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:23.830308 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2f47e-22dc-430e-8a7e-41590cd4cdf6 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:23.831683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc2f47e-22dc-430e-8a7e-41590cd4cdf6 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:23.834457 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc2f47e-22dc-430e-8a7e-41590cd4cdf6 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:24.299305 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1470/2948] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:16:23 2022] POST /identity/v3/projects => generated 371 bytes in 485 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:16:24.303587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0e34e-d913-4a6b-9519-e992d6ae7f94 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:24.312811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0e34e-d913-4a6b-9519-e992d6ae7f94 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:24.387592 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c186f-7475-484f-87b5-2d6cf621a79b tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2bc0d89f037486c9045c77d49413d0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '362866a41b8c4e98becd7806f19c9c6c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:24.388327 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c186f-7475-484f-87b5-2d6cf621a79b tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:24.388807 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c186f-7475-484f-87b5-2d6cf621a79b tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:24.389263 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c186f-7475-484f-87b5-2d6cf621a79b tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:24.390257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3c186f-7475-484f-87b5-2d6cf621a79b tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:16:24.390761 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3c186f-7475-484f-87b5-2d6cf621a79b tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:24.394829 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3c186f-7475-484f-87b5-2d6cf621a79b tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:24.419773 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1479/2949] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:16:24.827352 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2f47e-22dc-430e-8a7e-41590cd4cdf6 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:24.829098 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0bc2f47e-22dc-430e-8a7e-41590cd4cdf6 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:24.905679 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2f47e-22dc-430e-8a7e-41590cd4cdf6 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:24.911989 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5575279-fdb4-41eb-a292-3913a260b939 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:24.912637 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5575279-fdb4-41eb-a292-3913a260b939 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:24.912922 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5575279-fdb4-41eb-a292-3913a260b939 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:24.913194 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5575279-fdb4-41eb-a292-3913a260b939 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:24.923217 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5575279-fdb4-41eb-a292-3913a260b939 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:24.924767 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5575279-fdb4-41eb-a292-3913a260b939 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:24.946759 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1471/2950] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:16:24 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:16:24.961716 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec3dd4-794c-46f6-8a83-0c20c671c231 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:24.962045 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec3dd4-794c-46f6-8a83-0c20c671c231 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:24.962329 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec3dd4-794c-46f6-8a83-0c20c671c231 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:24.963939 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1480/2951] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:16:24.968568 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5575279-fdb4-41eb-a292-3913a260b939 service nova] Authenticating service token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 30 21:16:24.986254 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5575279-fdb4-41eb-a292-3913a260b939 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:24.989733 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5575279-fdb4-41eb-a292-3913a260b939 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:24.994949 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91711604-fb50-4b9b-9d7e-7655f6525c38 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2bc0d89f037486c9045c77d49413d0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '362866a41b8c4e98becd7806f19c9c6c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:24.996011 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91711604-fb50-4b9b-9d7e-7655f6525c38 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:24.996319 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91711604-fb50-4b9b-9d7e-7655f6525c38 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:24.996564 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91711604-fb50-4b9b-9d7e-7655f6525c38 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] PATH_INFO: `/v3/projects/2490d5f1ec364da1829500bfa3c79b20` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:24.997942 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91711604-fb50-4b9b-9d7e-7655f6525c38 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] RBAC: Authorizing `identity:get_project(project_id=2490d5f1ec364da1829500bfa3c79b20)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:25.003596 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91711604-fb50-4b9b-9d7e-7655f6525c38 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:25.003596 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1472/2952] 10.222.0.23 () {58 vars in 1443 bytes} [Sat Apr 30 21:16:24 2022] GET /identity/v3/projects/2490d5f1ec364da1829500bfa3c79b20 => generated 371 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:16:25.092394 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec3dd4-794c-46f6-8a83-0c20c671c231 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:25.094188 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-96ec3dd4-794c-46f6-8a83-0c20c671c231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:25.163256 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec3dd4-794c-46f6-8a83-0c20c671c231 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:25.168013 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada19e7-3cc6-4a70-a285-104b908efbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:25.168888 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada19e7-3cc6-4a70-a285-104b908efbbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:25.169174 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada19e7-3cc6-4a70-a285-104b908efbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:25.169466 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada19e7-3cc6-4a70-a285-104b908efbbb admin admin] PATH_INFO: `/v3/users/758c281bb61043f1a7d743fb11071944` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:25.170756 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada19e7-3cc6-4a70-a285-104b908efbbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=758c281bb61043f1a7d743fb11071944)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:25.172694 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada19e7-3cc6-4a70-a285-104b908efbbb admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:25.222579 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92148f-816b-4e53-b1a6-9079a7faf0d7 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:25.222888 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92148f-816b-4e53-b1a6-9079a7faf0d7 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:25.223151 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92148f-816b-4e53-b1a6-9079a7faf0d7 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:25.224741 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1473/2953] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:16:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 21:16:25.229199 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92148f-816b-4e53-b1a6-9079a7faf0d7 None None] Authenticating service token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 30 21:16:25.230921 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4d92148f-816b-4e53-b1a6-9079a7faf0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:25.249045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92148f-816b-4e53-b1a6-9079a7faf0d7 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:25.258928 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92148f-816b-4e53-b1a6-9079a7faf0d7 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:25.264299 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a148e9-cad1-4f02-942a-9790e18b8996 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2bc0d89f037486c9045c77d49413d0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '362866a41b8c4e98becd7806f19c9c6c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:25.265139 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a148e9-cad1-4f02-942a-9790e18b8996 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:25.265424 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a148e9-cad1-4f02-942a-9790e18b8996 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:25.265701 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a148e9-cad1-4f02-942a-9790e18b8996 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] PATH_INFO: `/v3/projects/2490d5f1ec364da1829500bfa3c79b20` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:25.266941 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a148e9-cad1-4f02-942a-9790e18b8996 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] RBAC: Authorizing `identity:get_project(project_id=2490d5f1ec364da1829500bfa3c79b20)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:25.269849 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a148e9-cad1-4f02-942a-9790e18b8996 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:25.273919 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1474/2954] 10.222.0.23 () {58 vars in 1443 bytes} [Sat Apr 30 21:16:25 2022] GET /identity/v3/projects/2490d5f1ec364da1829500bfa3c79b20 => generated 371 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:16:25.323886 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a148e9-cad1-4f02-942a-9790e18b8996 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:25.334242 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a148e9-cad1-4f02-942a-9790e18b8996 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:25.335550 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0ada19e7-3cc6-4a70-a285-104b908efbbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '758c281bb61043f1a7d743fb11071944'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:25.339070 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4477635-8f81-4b3e-a64f-7ea59d494c75 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2bc0d89f037486c9045c77d49413d0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '362866a41b8c4e98becd7806f19c9c6c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:25.339661 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4477635-8f81-4b3e-a64f-7ea59d494c75 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:25.339945 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4477635-8f81-4b3e-a64f-7ea59d494c75 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:25.340224 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4477635-8f81-4b3e-a64f-7ea59d494c75 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:25.340982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4477635-8f81-4b3e-a64f-7ea59d494c75 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:16:25.341292 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4477635-8f81-4b3e-a64f-7ea59d494c75 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:25.342916 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4477635-8f81-4b3e-a64f-7ea59d494c75 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:25.348895 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0ada19e7-3cc6-4a70-a285-104b908efbbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '758c281bb61043f1a7d743fb11071944'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:25.357749 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1475/2955] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:16:25.361984 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4477635-8f81-4b3e-a64f-7ea59d494c75 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:25.372404 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4477635-8f81-4b3e-a64f-7ea59d494c75 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:25.377175 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131188de-fc13-409c-82a7-6ebfd0f72ebc tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2bc0d89f037486c9045c77d49413d0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '362866a41b8c4e98becd7806f19c9c6c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:25.377852 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131188de-fc13-409c-82a7-6ebfd0f72ebc tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:25.378171 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131188de-fc13-409c-82a7-6ebfd0f72ebc tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:25.378443 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131188de-fc13-409c-82a7-6ebfd0f72ebc tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:25.379126 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131188de-fc13-409c-82a7-6ebfd0f72ebc tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:25.381021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131188de-fc13-409c-82a7-6ebfd0f72ebc tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:25.461607 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0ada19e7-3cc6-4a70-a285-104b908efbbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '758c281bb61043f1a7d743fb11071944'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:25.462285 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0ada19e7-3cc6-4a70-a285-104b908efbbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '758c281bb61043f1a7d743fb11071944'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:25.470035 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0ada19e7-3cc6-4a70-a285-104b908efbbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '758c281bb61043f1a7d743fb11071944'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:25.476581 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1481/2956] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:16:25 2022] DELETE /identity/v3/users/758c281bb61043f1a7d743fb11071944 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:25.480802 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48512a-f81d-4e59-8172-e444fcf9f452 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:25.481109 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48512a-f81d-4e59-8172-e444fcf9f452 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:25.481384 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48512a-f81d-4e59-8172-e444fcf9f452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:25.495147 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1476/2957] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:16:25 2022] POST /identity/v3/users => generated 381 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:16:25.502660 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-bb48512a-f81d-4e59-8172-e444fcf9f452 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:25.504359 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-bb48512a-f81d-4e59-8172-e444fcf9f452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:25.504549 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131188de-fc13-409c-82a7-6ebfd0f72ebc tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:25.506299 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-131188de-fc13-409c-82a7-6ebfd0f72ebc tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:25.520128 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131188de-fc13-409c-82a7-6ebfd0f72ebc tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:25.586034 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1482/2958] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:25.590821 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ecff48-e4b7-4118-92fb-793e0244c036 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2bc0d89f037486c9045c77d49413d0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '362866a41b8c4e98becd7806f19c9c6c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:25.591527 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecff48-e4b7-4118-92fb-793e0244c036 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:25.593800 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecff48-e4b7-4118-92fb-793e0244c036 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:25.594155 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecff48-e4b7-4118-92fb-793e0244c036 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:25.594926 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ecff48-e4b7-4118-92fb-793e0244c036 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:16:25.595247 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ecff48-e4b7-4118-92fb-793e0244c036 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:25.595793 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48512a-f81d-4e59-8172-e444fcf9f452 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:25.597008 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ecff48-e4b7-4118-92fb-793e0244c036 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:25.597698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-bb48512a-f81d-4e59-8172-e444fcf9f452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:25.610598 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1477/2959] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:16:25.669204 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48512a-f81d-4e59-8172-e444fcf9f452 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:25.675567 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a33a5-6c2b-47c0-851c-d013f88f6d1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:25.676351 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a33a5-6c2b-47c0-851c-d013f88f6d1b service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:25.676735 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a33a5-6c2b-47c0-851c-d013f88f6d1b service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:25.677109 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a33a5-6c2b-47c0-851c-d013f88f6d1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:25.690107 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a33a5-6c2b-47c0-851c-d013f88f6d1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:25.702490 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a33a5-6c2b-47c0-851c-d013f88f6d1b service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:25.706179 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1483/2960] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:16:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:16:25.726060 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80604f28-5cb8-480a-90c9-12ce92e26651 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:25.726606 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80604f28-5cb8-480a-90c9-12ce92e26651 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:25.726896 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80604f28-5cb8-480a-90c9-12ce92e26651 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:25.728677 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1478/2961] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:16:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:16:25.736253 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a33a5-6c2b-47c0-851c-d013f88f6d1b service neutron] Authenticating service token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 30 21:16:25.738953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-996a33a5-6c2b-47c0-851c-d013f88f6d1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:25.834414 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a33a5-6c2b-47c0-851c-d013f88f6d1b service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:25.852945 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a33a5-6c2b-47c0-851c-d013f88f6d1b service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:25.852945 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf3ba2-0fc0-4ae7-8435-f9b52fdd723c tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2bc0d89f037486c9045c77d49413d0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '362866a41b8c4e98becd7806f19c9c6c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:25.852945 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf3ba2-0fc0-4ae7-8435-f9b52fdd723c tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:25.853368 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf3ba2-0fc0-4ae7-8435-f9b52fdd723c tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:25.853368 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf3ba2-0fc0-4ae7-8435-f9b52fdd723c tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] PATH_INFO: `/v3/projects/2490d5f1ec364da1829500bfa3c79b20` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:25.853547 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaf3ba2-0fc0-4ae7-8435-f9b52fdd723c tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] RBAC: Authorizing `identity:get_project(project_id=2490d5f1ec364da1829500bfa3c79b20)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:25.855608 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaf3ba2-0fc0-4ae7-8435-f9b52fdd723c tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:25.857621 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1484/2962] 10.222.0.23 () {58 vars in 1443 bytes} [Sat Apr 30 21:16:25 2022] GET /identity/v3/projects/2490d5f1ec364da1829500bfa3c79b20 => generated 371 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:16:26.094310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d30e49-dcbb-4cdc-9d2d-356faeff6c80 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:26.094598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d30e49-dcbb-4cdc-9d2d-356faeff6c80 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:26.094869 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d30e49-dcbb-4cdc-9d2d-356faeff6c80 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:26.097382 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1479/2963] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:16:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:16:26.103435 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf3ba2-0fc0-4ae7-8435-f9b52fdd723c tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Authenticating service token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 30 21:16:26.104832 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-bfaf3ba2-0fc0-4ae7-8435-f9b52fdd723c tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:26.129675 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf3ba2-0fc0-4ae7-8435-f9b52fdd723c tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:26.145893 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf3ba2-0fc0-4ae7-8435-f9b52fdd723c tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:26.151358 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2d4a7-f423-4c29-a89d-9feaa99eb108 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2bc0d89f037486c9045c77d49413d0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '362866a41b8c4e98becd7806f19c9c6c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:26.152220 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2d4a7-f423-4c29-a89d-9feaa99eb108 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:26.152507 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2d4a7-f423-4c29-a89d-9feaa99eb108 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:26.152772 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2d4a7-f423-4c29-a89d-9feaa99eb108 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] PATH_INFO: `/v3/projects/2490d5f1ec364da1829500bfa3c79b20` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:26.154087 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a2d4a7-f423-4c29-a89d-9feaa99eb108 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] RBAC: Authorizing `identity:get_project(project_id=2490d5f1ec364da1829500bfa3c79b20)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:26.157085 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a2d4a7-f423-4c29-a89d-9feaa99eb108 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:26.170849 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1485/2964] 10.222.0.23 () {58 vars in 1443 bytes} [Sat Apr 30 21:16:26 2022] GET /identity/v3/projects/2490d5f1ec364da1829500bfa3c79b20 => generated 371 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:16:26.198059 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d30e49-dcbb-4cdc-9d2d-356faeff6c80 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:26.218683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d30e49-dcbb-4cdc-9d2d-356faeff6c80 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:26.229133 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d4f00-2061-4340-8c70-b766349d1144 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2bc0d89f037486c9045c77d49413d0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '362866a41b8c4e98becd7806f19c9c6c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:26.230106 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d4f00-2061-4340-8c70-b766349d1144 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:26.230388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d4f00-2061-4340-8c70-b766349d1144 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:26.230662 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d4f00-2061-4340-8c70-b766349d1144 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] PATH_INFO: `/v3/users/18a05a12418f437cb6590d22f27ebf9e` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:26.264078 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d4f00-2061-4340-8c70-b766349d1144 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] RBAC: Authorizing `identity:delete_user(user_id=18a05a12418f437cb6590d22f27ebf9e)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:26.266270 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d4f00-2061-4340-8c70-b766349d1144 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:26.424196 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2d4a7-f423-4c29-a89d-9feaa99eb108 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:26.427357 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a0a2d4a7-f423-4c29-a89d-9feaa99eb108 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:26.430205 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ec4d4f00-2061-4340-8c70-b766349d1144 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18a05a12418f437cb6590d22f27ebf9e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:26.464214 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2d4a7-f423-4c29-a89d-9feaa99eb108 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:26.481395 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ec4d4f00-2061-4340-8c70-b766349d1144 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18a05a12418f437cb6590d22f27ebf9e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:26.483164 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da9d8c-8795-4306-9204-de18e582facf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:26.484330 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da9d8c-8795-4306-9204-de18e582facf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:26.484803 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da9d8c-8795-4306-9204-de18e582facf admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:26.485287 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da9d8c-8795-4306-9204-de18e582facf admin admin] PATH_INFO: `/v3/projects/0f441a03b7f34ed8844de96c148d37a9` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:26.486768 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da9d8c-8795-4306-9204-de18e582facf admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f441a03b7f34ed8844de96c148d37a9)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:26.490606 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da9d8c-8795-4306-9204-de18e582facf admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:26.559033 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ec4d4f00-2061-4340-8c70-b766349d1144 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18a05a12418f437cb6590d22f27ebf9e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:26.568576 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ec4d4f00-2061-4340-8c70-b766349d1144 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18a05a12418f437cb6590d22f27ebf9e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:26.569540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ec4d4f00-2061-4340-8c70-b766349d1144 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18a05a12418f437cb6590d22f27ebf9e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:26.576260 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1480/2965] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:16:26 2022] DELETE /identity/v3/users/18a05a12418f437cb6590d22f27ebf9e => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:26.580538 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d4f00-2061-4340-8c70-b766349d1144 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:26.594008 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ec4d4f00-2061-4340-8c70-b766349d1144 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:26.676167 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d4f00-2061-4340-8c70-b766349d1144 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:26.682869 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-12da9d8c-8795-4306-9204-de18e582facf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f441a03b7f34ed8844de96c148d37a9', 'request_id': 'req-12da9d8c-8795-4306-9204-de18e582facf'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:26.689573 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-12da9d8c-8795-4306-9204-de18e582facf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f441a03b7f34ed8844de96c148d37a9', 'request_id': 'req-12da9d8c-8795-4306-9204-de18e582facf'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:26.697290 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-12da9d8c-8795-4306-9204-de18e582facf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f441a03b7f34ed8844de96c148d37a9', 'request_id': 'req-12da9d8c-8795-4306-9204-de18e582facf'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:26.744546 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7898b3-023e-4f56-88e5-26f0325ca726 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2bc0d89f037486c9045c77d49413d0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '362866a41b8c4e98becd7806f19c9c6c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:26.745526 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7898b3-023e-4f56-88e5-26f0325ca726 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:26.745915 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7898b3-023e-4f56-88e5-26f0325ca726 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:26.746261 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7898b3-023e-4f56-88e5-26f0325ca726 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] PATH_INFO: `/v3/projects/2490d5f1ec364da1829500bfa3c79b20` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:26.747549 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7898b3-023e-4f56-88e5-26f0325ca726 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2490d5f1ec364da1829500bfa3c79b20)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:26.749734 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7898b3-023e-4f56-88e5-26f0325ca726 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:26.810769 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-12da9d8c-8795-4306-9204-de18e582facf admin admin] The token cache is being invalidate because project 0f441a03b7f34ed8844de96c148d37a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:16:26.811249 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-12da9d8c-8795-4306-9204-de18e582facf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:26.812125 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-12da9d8c-8795-4306-9204-de18e582facf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:26.813935 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1486/2966] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:16:26 2022] DELETE /identity/v3/projects/0f441a03b7f34ed8844de96c148d37a9 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:26.820435 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a6a63-262b-4771-9e2b-0bb3db83836d None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:26.822080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a6a63-262b-4771-9e2b-0bb3db83836d None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:26.822449 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a6a63-262b-4771-9e2b-0bb3db83836d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:26.845539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-6f7a6a63-262b-4771-9e2b-0bb3db83836d None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:26.846875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6f7a6a63-262b-4771-9e2b-0bb3db83836d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:26.915112 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1487/2967] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:26.924454 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d6fa2-ff1f-442f-86f1-072b07949cc7 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:26.924705 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d6fa2-ff1f-442f-86f1-072b07949cc7 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:26.924993 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d6fa2-ff1f-442f-86f1-072b07949cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:26.944279 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-c48d6fa2-ff1f-442f-86f1-072b07949cc7 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:26.945561 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c48d6fa2-ff1f-442f-86f1-072b07949cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:26.960927 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1488/2968] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:26.964987 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d6fa2-ff1f-442f-86f1-072b07949cc7 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:26.977545 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d6fa2-ff1f-442f-86f1-072b07949cc7 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:26.982430 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce0cbe-0c07-43b1-ae94-b270476eca04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:26.983123 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce0cbe-0c07-43b1-ae94-b270476eca04 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:26.983433 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce0cbe-0c07-43b1-ae94-b270476eca04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:26.983711 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce0cbe-0c07-43b1-ae94-b270476eca04 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:26.984433 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce0cbe-0c07-43b1-ae94-b270476eca04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:16:26.984742 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce0cbe-0c07-43b1-ae94-b270476eca04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:26.986394 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce0cbe-0c07-43b1-ae94-b270476eca04 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:26.999341 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1489/2969] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:16:27.003686 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce0cbe-0c07-43b1-ae94-b270476eca04 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:27.027246 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bf7898b3-023e-4f56-88e5-26f0325ca726 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2490d5f1ec364da1829500bfa3c79b20', 'request_id': 'req-bf7898b3-023e-4f56-88e5-26f0325ca726'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:27.032634 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce0cbe-0c07-43b1-ae94-b270476eca04 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:27.038618 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bf7898b3-023e-4f56-88e5-26f0325ca726 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2490d5f1ec364da1829500bfa3c79b20', 'request_id': 'req-bf7898b3-023e-4f56-88e5-26f0325ca726'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:27.047155 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bf7898b3-023e-4f56-88e5-26f0325ca726 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2490d5f1ec364da1829500bfa3c79b20', 'request_id': 'req-bf7898b3-023e-4f56-88e5-26f0325ca726'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:27.122489 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dfaed1-f630-476b-8d5a-9423666bdbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:27.122884 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dfaed1-f630-476b-8d5a-9423666bdbf9 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:27.123368 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dfaed1-f630-476b-8d5a-9423666bdbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:27.123710 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dfaed1-f630-476b-8d5a-9423666bdbf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:27.124474 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dfaed1-f630-476b-8d5a-9423666bdbf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:27.126967 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dfaed1-f630-476b-8d5a-9423666bdbf9 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:27.178385 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bf7898b3-023e-4f56-88e5-26f0325ca726 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] The token cache is being invalidate because project 2490d5f1ec364da1829500bfa3c79b20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:16:27.178385 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bf7898b3-023e-4f56-88e5-26f0325ca726 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:27.178385 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bf7898b3-023e-4f56-88e5-26f0325ca726 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:27.179432 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1481/2970] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:16:26 2022] DELETE /identity/v3/projects/2490d5f1ec364da1829500bfa3c79b20 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:16:27.185356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7898b3-023e-4f56-88e5-26f0325ca726 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:27.189916 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-bf7898b3-023e-4f56-88e5-26f0325ca726 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:27.211412 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7898b3-023e-4f56-88e5-26f0325ca726 tempest-QuotasAdminTestV236-444823186 tempest-QuotasAdminTestV236-444823186-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:27.216299 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0a3f5-42a8-45d3-8b7b-42f0149b8c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:27.217277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0a3f5-42a8-45d3-8b7b-42f0149b8c40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:27.217550 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0a3f5-42a8-45d3-8b7b-42f0149b8c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:27.217857 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0a3f5-42a8-45d3-8b7b-42f0149b8c40 admin admin] PATH_INFO: `/v3/users/05bad6ce98d545adbe2343a969a33a9c` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:27.219404 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0a3f5-42a8-45d3-8b7b-42f0149b8c40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05bad6ce98d545adbe2343a969a33a9c)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:27.221361 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0a3f5-42a8-45d3-8b7b-42f0149b8c40 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:27.240524 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1490/2971] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:16:27 2022] POST /identity/v3/projects => generated 385 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:16:27.240524 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dfaed1-f630-476b-8d5a-9423666bdbf9 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:27.240524 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d2dfaed1-f630-476b-8d5a-9423666bdbf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:27.339473 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dfaed1-f630-476b-8d5a-9423666bdbf9 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:27.353246 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5aee0d-881f-4abe-a7ce-0de363ae77e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:27.353884 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5aee0d-881f-4abe-a7ce-0de363ae77e3 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:27.354210 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5aee0d-881f-4abe-a7ce-0de363ae77e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:27.354498 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5aee0d-881f-4abe-a7ce-0de363ae77e3 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:27.355200 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5aee0d-881f-4abe-a7ce-0de363ae77e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:27.357966 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5aee0d-881f-4abe-a7ce-0de363ae77e3 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:27.540649 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1491/2972] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:16:27 2022] POST /identity/v3/users => generated 293 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:16:27.543176 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5aee0d-881f-4abe-a7ce-0de363ae77e3 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:27.554297 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-79a0a3f5-42a8-45d3-8b7b-42f0149b8c40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05bad6ce98d545adbe2343a969a33a9c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:27.575372 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5aee0d-881f-4abe-a7ce-0de363ae77e3 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:27.584836 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd7680-df27-4e34-8a81-ee337acf6a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:27.586358 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd7680-df27-4e34-8a81-ee337acf6a30 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:27.586731 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd7680-df27-4e34-8a81-ee337acf6a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:27.593175 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd7680-df27-4e34-8a81-ee337acf6a30 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:27.593175 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd7680-df27-4e34-8a81-ee337acf6a30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:27.593175 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd7680-df27-4e34-8a81-ee337acf6a30 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:27.602555 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1492/2973] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:16:27.607845 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd7680-df27-4e34-8a81-ee337acf6a30 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:27.609924 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-79a0a3f5-42a8-45d3-8b7b-42f0149b8c40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05bad6ce98d545adbe2343a969a33a9c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:27.622118 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd7680-df27-4e34-8a81-ee337acf6a30 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:27.628548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14768e-602c-4029-81a1-6ca629ceb5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:27.629490 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14768e-602c-4029-81a1-6ca629ceb5a2 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:27.630013 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14768e-602c-4029-81a1-6ca629ceb5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:27.630635 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14768e-602c-4029-81a1-6ca629ceb5a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:27.631843 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14768e-602c-4029-81a1-6ca629ceb5a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:27.633668 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14768e-602c-4029-81a1-6ca629ceb5a2 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:27.648065 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1493/2974] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:16:27.652097 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14768e-602c-4029-81a1-6ca629ceb5a2 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:27.668380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14768e-602c-4029-81a1-6ca629ceb5a2 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:27.670615 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5f78e-5ef1-4b52-b16d-4367a7011504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:27.671639 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5f78e-5ef1-4b52-b16d-4367a7011504 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:27.672148 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5f78e-5ef1-4b52-b16d-4367a7011504 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:27.672543 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5f78e-5ef1-4b52-b16d-4367a7011504 admin admin] PATH_INFO: `/v3/projects/b9c121a94ec3445baa05dcaa3dc22af2/users/5df6ea2992c04a97af023bfb428ac44e/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:27.703730 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c5f78e-5ef1-4b52-b16d-4367a7011504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9c121a94ec3445baa05dcaa3dc22af2, user_id=5df6ea2992c04a97af023bfb428ac44e, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:27.708285 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c5f78e-5ef1-4b52-b16d-4367a7011504 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:27.727313 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-79a0a3f5-42a8-45d3-8b7b-42f0149b8c40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05bad6ce98d545adbe2343a969a33a9c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:27.738863 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-79a0a3f5-42a8-45d3-8b7b-42f0149b8c40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05bad6ce98d545adbe2343a969a33a9c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:27.739603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-79a0a3f5-42a8-45d3-8b7b-42f0149b8c40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05bad6ce98d545adbe2343a969a33a9c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:27.745780 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1482/2975] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:16:27 2022] DELETE /identity/v3/users/05bad6ce98d545adbe2343a969a33a9c => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:27.750511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489dbe3-20e1-460e-887a-ec439ac36c28 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:27.750859 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489dbe3-20e1-460e-887a-ec439ac36c28 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:27.751140 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489dbe3-20e1-460e-887a-ec439ac36c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:27.769425 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-c489dbe3-20e1-460e-887a-ec439ac36c28 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:27.770680 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c489dbe3-20e1-460e-887a-ec439ac36c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:27.824058 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1494/2976] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:16:27 2022] PUT /identity/v3/projects/b9c121a94ec3445baa05dcaa3dc22af2/users/5df6ea2992c04a97af023bfb428ac44e/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:16:27.830238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77770518-0da0-4b11-944b-37e88f0f8092 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:27.830749 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77770518-0da0-4b11-944b-37e88f0f8092 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:27.831898 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77770518-0da0-4b11-944b-37e88f0f8092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:27.833483 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1483/2977] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:16:27.843361 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489dbe3-20e1-460e-887a-ec439ac36c28 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:27.844946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c489dbe3-20e1-460e-887a-ec439ac36c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:27.858156 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-77770518-0da0-4b11-944b-37e88f0f8092 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:27.859578 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-77770518-0da0-4b11-944b-37e88f0f8092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:27.932487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489dbe3-20e1-460e-887a-ec439ac36c28 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:27.943621 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1495/2978] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:27.962430 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77770518-0da0-4b11-944b-37e88f0f8092 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:28.000764 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eaa3d5-3abb-451b-8c6e-4cf4e8ec4f90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:28.002216 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eaa3d5-3abb-451b-8c6e-4cf4e8ec4f90 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:28.009200 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eaa3d5-3abb-451b-8c6e-4cf4e8ec4f90 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:28.009200 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eaa3d5-3abb-451b-8c6e-4cf4e8ec4f90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:28.016370 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eaa3d5-3abb-451b-8c6e-4cf4e8ec4f90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:28.017885 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eaa3d5-3abb-451b-8c6e-4cf4e8ec4f90 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:28.036991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77770518-0da0-4b11-944b-37e88f0f8092 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:28.046203 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1484/2979] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:16:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:16:28.046378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e50a65-b9df-474c-9f21-02aabf9f2c7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:28.047401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e50a65-b9df-474c-9f21-02aabf9f2c7a service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:28.047614 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e50a65-b9df-474c-9f21-02aabf9f2c7a service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:28.047902 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e50a65-b9df-474c-9f21-02aabf9f2c7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:28.066761 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e50a65-b9df-474c-9f21-02aabf9f2c7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:28.069705 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e50a65-b9df-474c-9f21-02aabf9f2c7a service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:28.085099 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1496/2980] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:16:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:16:28.642606 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eaa3d5-3abb-451b-8c6e-4cf4e8ec4f90 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:28.645512 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f4eaa3d5-3abb-451b-8c6e-4cf4e8ec4f90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:28.687001 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eaa3d5-3abb-451b-8c6e-4cf4e8ec4f90 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:28.706713 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2abe9c-5a7c-459f-9bd2-38720ba73e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:28.707956 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2abe9c-5a7c-459f-9bd2-38720ba73e32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:28.709889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2abe9c-5a7c-459f-9bd2-38720ba73e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:28.710198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2abe9c-5a7c-459f-9bd2-38720ba73e32 admin admin] PATH_INFO: `/v3/projects/f8c321556e674332869a5a14027cb2ae` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:28.714492 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2abe9c-5a7c-459f-9bd2-38720ba73e32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8c321556e674332869a5a14027cb2ae)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:28.717294 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2abe9c-5a7c-459f-9bd2-38720ba73e32 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:28.998834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6c2abe9c-5a7c-459f-9bd2-38720ba73e32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8c321556e674332869a5a14027cb2ae', 'request_id': 'req-6c2abe9c-5a7c-459f-9bd2-38720ba73e32'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:29.006459 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6c2abe9c-5a7c-459f-9bd2-38720ba73e32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8c321556e674332869a5a14027cb2ae', 'request_id': 'req-6c2abe9c-5a7c-459f-9bd2-38720ba73e32'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:29.019435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6c2abe9c-5a7c-459f-9bd2-38720ba73e32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8c321556e674332869a5a14027cb2ae', 'request_id': 'req-6c2abe9c-5a7c-459f-9bd2-38720ba73e32'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:29.178266 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6c2abe9c-5a7c-459f-9bd2-38720ba73e32 admin admin] The token cache is being invalidate because project f8c321556e674332869a5a14027cb2ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:16:29.181318 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6c2abe9c-5a7c-459f-9bd2-38720ba73e32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:29.181318 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6c2abe9c-5a7c-459f-9bd2-38720ba73e32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:29.181318 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1485/2981] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:16:28 2022] DELETE /identity/v3/projects/f8c321556e674332869a5a14027cb2ae => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:29.185334 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e50a65-b9df-474c-9f21-02aabf9f2c7a service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:29.196422 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e50a65-b9df-474c-9f21-02aabf9f2c7a service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:29.264936 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feeaf43-ee59-408d-9280-ab5c3a0e78d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:29.267970 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feeaf43-ee59-408d-9280-ab5c3a0e78d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:29.269019 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feeaf43-ee59-408d-9280-ab5c3a0e78d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:29.269512 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feeaf43-ee59-408d-9280-ab5c3a0e78d4 admin admin] PATH_INFO: `/v3/users/e2bc0d89f037486c9045c77d49413d0c` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:29.274866 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feeaf43-ee59-408d-9280-ab5c3a0e78d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2bc0d89f037486c9045c77d49413d0c)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:29.276840 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feeaf43-ee59-408d-9280-ab5c3a0e78d4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:29.633354 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8feeaf43-ee59-408d-9280-ab5c3a0e78d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2bc0d89f037486c9045c77d49413d0c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:29.646591 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8feeaf43-ee59-408d-9280-ab5c3a0e78d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2bc0d89f037486c9045c77d49413d0c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:29.755807 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8feeaf43-ee59-408d-9280-ab5c3a0e78d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2bc0d89f037486c9045c77d49413d0c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:29.756998 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8feeaf43-ee59-408d-9280-ab5c3a0e78d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2bc0d89f037486c9045c77d49413d0c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:29.767761 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8feeaf43-ee59-408d-9280-ab5c3a0e78d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2bc0d89f037486c9045c77d49413d0c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:29.775209 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1497/2982] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:16:29 2022] DELETE /identity/v3/users/e2bc0d89f037486c9045c77d49413d0c => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:16:30.993239 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2abe9c-5a7c-459f-9bd2-38720ba73e32 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:30.995986 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6c2abe9c-5a7c-459f-9bd2-38720ba73e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:31.013375 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2abe9c-5a7c-459f-9bd2-38720ba73e32 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:31.126084 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c307f694-dc5f-4aa3-bad1-b68cc4d98927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:31.127401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307f694-dc5f-4aa3-bad1-b68cc4d98927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:31.128249 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307f694-dc5f-4aa3-bad1-b68cc4d98927 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:31.128673 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307f694-dc5f-4aa3-bad1-b68cc4d98927 admin admin] PATH_INFO: `/v3/users/cce42480cd844664991774f07ca47e79` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:31.130006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c307f694-dc5f-4aa3-bad1-b68cc4d98927 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cce42480cd844664991774f07ca47e79)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:31.132325 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c307f694-dc5f-4aa3-bad1-b68cc4d98927 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:31.352066 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c307f694-dc5f-4aa3-bad1-b68cc4d98927 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cce42480cd844664991774f07ca47e79'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:31.367253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c307f694-dc5f-4aa3-bad1-b68cc4d98927 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cce42480cd844664991774f07ca47e79'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:31.469698 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c307f694-dc5f-4aa3-bad1-b68cc4d98927 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cce42480cd844664991774f07ca47e79'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:31.478551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c307f694-dc5f-4aa3-bad1-b68cc4d98927 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cce42480cd844664991774f07ca47e79'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:31.479416 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c307f694-dc5f-4aa3-bad1-b68cc4d98927 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cce42480cd844664991774f07ca47e79'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:31.496130 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1486/2983] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:16:30 2022] DELETE /identity/v3/users/cce42480cd844664991774f07ca47e79 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:31.500794 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4503800-8d42-488b-979c-20dddf93b44a None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:31.503486 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4503800-8d42-488b-979c-20dddf93b44a None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:31.503938 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4503800-8d42-488b-979c-20dddf93b44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:31.541148 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c307f694-dc5f-4aa3-bad1-b68cc4d98927 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:31.543409 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c307f694-dc5f-4aa3-bad1-b68cc4d98927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:31.544301 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-b4503800-8d42-488b-979c-20dddf93b44a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:31.546977 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b4503800-8d42-488b-979c-20dddf93b44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:31.681103 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1498/2984] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:31.692776 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4503800-8d42-488b-979c-20dddf93b44a None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:31.695316 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b4503800-8d42-488b-979c-20dddf93b44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:31.722497 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c307f694-dc5f-4aa3-bad1-b68cc4d98927 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:31.730875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a0cfe-6f2d-45c2-bd87-79dc29efe0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:31.731767 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a0cfe-6f2d-45c2-bd87-79dc29efe0af admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:31.743552 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a0cfe-6f2d-45c2-bd87-79dc29efe0af admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:31.744819 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a0cfe-6f2d-45c2-bd87-79dc29efe0af admin admin] PATH_INFO: `/v3/projects/362866a41b8c4e98becd7806f19c9c6c` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:31.746499 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a0cfe-6f2d-45c2-bd87-79dc29efe0af admin admin] RBAC: Authorizing `identity:delete_project(project_id=362866a41b8c4e98becd7806f19c9c6c)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:31.750109 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a0cfe-6f2d-45c2-bd87-79dc29efe0af admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:31.796556 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4503800-8d42-488b-979c-20dddf93b44a None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:31.803348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03445f09-76b1-4d50-9f78-20e4d37fc9e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:31.804010 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03445f09-76b1-4d50-9f78-20e4d37fc9e1 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:31.804344 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03445f09-76b1-4d50-9f78-20e4d37fc9e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:31.804626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03445f09-76b1-4d50-9f78-20e4d37fc9e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:31.829224 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03445f09-76b1-4d50-9f78-20e4d37fc9e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:31.834804 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03445f09-76b1-4d50-9f78-20e4d37fc9e1 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:31.864205 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1499/2985] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:16:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:16:31.909898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7c7a0cfe-6f2d-45c2-bd87-79dc29efe0af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '362866a41b8c4e98becd7806f19c9c6c', 'request_id': 'req-7c7a0cfe-6f2d-45c2-bd87-79dc29efe0af'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:31.923053 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7c7a0cfe-6f2d-45c2-bd87-79dc29efe0af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '362866a41b8c4e98becd7806f19c9c6c', 'request_id': 'req-7c7a0cfe-6f2d-45c2-bd87-79dc29efe0af'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:31.933028 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7c7a0cfe-6f2d-45c2-bd87-79dc29efe0af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '362866a41b8c4e98becd7806f19c9c6c', 'request_id': 'req-7c7a0cfe-6f2d-45c2-bd87-79dc29efe0af'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:32.075095 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7c7a0cfe-6f2d-45c2-bd87-79dc29efe0af admin admin] The token cache is being invalidate because project 362866a41b8c4e98becd7806f19c9c6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:16:32.076599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7c7a0cfe-6f2d-45c2-bd87-79dc29efe0af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:32.077469 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7c7a0cfe-6f2d-45c2-bd87-79dc29efe0af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:32.086532 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc32ce5-8bca-4cf8-a700-17d84c1313ad None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:32.091089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc32ce5-8bca-4cf8-a700-17d84c1313ad None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:32.091829 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1487/2986] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:16:31 2022] DELETE /identity/v3/projects/362866a41b8c4e98becd7806f19c9c6c => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:32.091927 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc32ce5-8bca-4cf8-a700-17d84c1313ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:32.140857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-dfc32ce5-8bca-4cf8-a700-17d84c1313ad None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:32.144303 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-dfc32ce5-8bca-4cf8-a700-17d84c1313ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:32.257453 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1500/2987] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:16:32.269327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9b9a0-266f-4fce-afe3-0814c149d430 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:32.269941 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9b9a0-266f-4fce-afe3-0814c149d430 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:32.270591 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9b9a0-266f-4fce-afe3-0814c149d430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:32.316195 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-f4d9b9a0-266f-4fce-afe3-0814c149d430 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:32.319318 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f4d9b9a0-266f-4fce-afe3-0814c149d430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:32.351180 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1488/2988] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:32.358679 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc32ce5-8bca-4cf8-a700-17d84c1313ad None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:32.381705 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc32ce5-8bca-4cf8-a700-17d84c1313ad None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:32.395115 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3745081-c7d7-423e-bb97-1bd6fd2260e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:32.398816 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3745081-c7d7-423e-bb97-1bd6fd2260e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:32.398816 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3745081-c7d7-423e-bb97-1bd6fd2260e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:32.398816 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3745081-c7d7-423e-bb97-1bd6fd2260e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:32.398816 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3745081-c7d7-423e-bb97-1bd6fd2260e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:16:32.398816 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3745081-c7d7-423e-bb97-1bd6fd2260e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:32.402566 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3745081-c7d7-423e-bb97-1bd6fd2260e8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:32.428760 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1501/2989] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:16:32.429788 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9b9a0-266f-4fce-afe3-0814c149d430 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:32.454093 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9b9a0-266f-4fce-afe3-0814c149d430 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:32.472728 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd79df-a46b-45b3-8889-8dbfcd726de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:32.473705 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd79df-a46b-45b3-8889-8dbfcd726de6 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:32.475073 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd79df-a46b-45b3-8889-8dbfcd726de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:32.475659 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd79df-a46b-45b3-8889-8dbfcd726de6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:32.477884 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd79df-a46b-45b3-8889-8dbfcd726de6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:32.485677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd79df-a46b-45b3-8889-8dbfcd726de6 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:32.620677 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1489/2990] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:16:32 2022] POST /identity/v3/projects => generated 407 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:16:32.626606 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3745081-c7d7-423e-bb97-1bd6fd2260e8 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:32.650716 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3745081-c7d7-423e-bb97-1bd6fd2260e8 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:32.842796 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef065bc5-c5b6-4aba-89f1-682678a10f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:32.845957 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef065bc5-c5b6-4aba-89f1-682678a10f4a admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:32.849142 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef065bc5-c5b6-4aba-89f1-682678a10f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:32.851207 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef065bc5-c5b6-4aba-89f1-682678a10f4a admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:32.851207 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef065bc5-c5b6-4aba-89f1-682678a10f4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:32.858148 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef065bc5-c5b6-4aba-89f1-682678a10f4a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:32.923957 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd79df-a46b-45b3-8889-8dbfcd726de6 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:32.928808 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-08cd79df-a46b-45b3-8889-8dbfcd726de6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:32.974898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd79df-a46b-45b3-8889-8dbfcd726de6 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:32.992339 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1502/2991] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:16:32 2022] POST /identity/v3/users => generated 304 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:16:32.993533 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef065bc5-c5b6-4aba-89f1-682678a10f4a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:33.011126 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd806e29-974b-44f4-b332-4a9e0048e1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:33.018287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd806e29-974b-44f4-b332-4a9e0048e1ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:33.019004 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd806e29-974b-44f4-b332-4a9e0048e1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:33.019488 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd806e29-974b-44f4-b332-4a9e0048e1ca admin admin] PATH_INFO: `/v3/projects/4d8bde5d9ca44f859b5536d3398b63d4` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:33.026173 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef065bc5-c5b6-4aba-89f1-682678a10f4a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:33.026664 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd806e29-974b-44f4-b332-4a9e0048e1ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d8bde5d9ca44f859b5536d3398b63d4)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:33.028617 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd806e29-974b-44f4-b332-4a9e0048e1ca admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:33.061619 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b0211-19be-406c-b3bb-4138d11ecd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:33.062428 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b0211-19be-406c-b3bb-4138d11ecd69 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:33.062775 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b0211-19be-406c-b3bb-4138d11ecd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:33.063065 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b0211-19be-406c-b3bb-4138d11ecd69 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:33.063812 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b0211-19be-406c-b3bb-4138d11ecd69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:33.070848 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b0211-19be-406c-b3bb-4138d11ecd69 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:33.085335 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1503/2992] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:16:33.091613 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b0211-19be-406c-b3bb-4138d11ecd69 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:33.114611 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b0211-19be-406c-b3bb-4138d11ecd69 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:33.126096 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0a261-7b90-4922-9a79-bba7f11043cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:33.126865 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0a261-7b90-4922-9a79-bba7f11043cb admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:33.127224 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0a261-7b90-4922-9a79-bba7f11043cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:33.129628 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0a261-7b90-4922-9a79-bba7f11043cb admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:33.130616 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0a261-7b90-4922-9a79-bba7f11043cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:33.132323 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0a261-7b90-4922-9a79-bba7f11043cb admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:33.157815 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1504/2993] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:16:33.162373 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0a261-7b90-4922-9a79-bba7f11043cb admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:33.172624 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0a261-7b90-4922-9a79-bba7f11043cb admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:33.181633 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa675fc-885d-455a-8b40-2ede9367f491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:33.183228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa675fc-885d-455a-8b40-2ede9367f491 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:33.184061 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa675fc-885d-455a-8b40-2ede9367f491 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:33.184888 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa675fc-885d-455a-8b40-2ede9367f491 admin admin] PATH_INFO: `/v3/projects/fe2f4895e8b946c2a7c18a86ae56fcea/users/35b431713dd0426c8e6306ab64f9bd86/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:33.222216 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa675fc-885d-455a-8b40-2ede9367f491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe2f4895e8b946c2a7c18a86ae56fcea, user_id=35b431713dd0426c8e6306ab64f9bd86, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:33.226837 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa675fc-885d-455a-8b40-2ede9367f491 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:33.228675 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-dd806e29-974b-44f4-b332-4a9e0048e1ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d8bde5d9ca44f859b5536d3398b63d4', 'request_id': 'req-dd806e29-974b-44f4-b332-4a9e0048e1ca'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:33.247866 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-dd806e29-974b-44f4-b332-4a9e0048e1ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d8bde5d9ca44f859b5536d3398b63d4', 'request_id': 'req-dd806e29-974b-44f4-b332-4a9e0048e1ca'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:33.265287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-dd806e29-974b-44f4-b332-4a9e0048e1ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d8bde5d9ca44f859b5536d3398b63d4', 'request_id': 'req-dd806e29-974b-44f4-b332-4a9e0048e1ca'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:33.390706 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-dd806e29-974b-44f4-b332-4a9e0048e1ca admin admin] The token cache is being invalidate because project 4d8bde5d9ca44f859b5536d3398b63d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:16:33.391350 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-dd806e29-974b-44f4-b332-4a9e0048e1ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:33.401283 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-dd806e29-974b-44f4-b332-4a9e0048e1ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:33.408461 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1490/2995] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:16:32 2022] DELETE /identity/v3/projects/4d8bde5d9ca44f859b5536d3398b63d4 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:33.412747 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1505/2995] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:16:33 2022] PUT /identity/v3/projects/fe2f4895e8b946c2a7c18a86ae56fcea/users/35b431713dd0426c8e6306ab64f9bd86/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:33.418761 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd806e29-974b-44f4-b332-4a9e0048e1ca admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:33.426856 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-dd806e29-974b-44f4-b332-4a9e0048e1ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:33.456749 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6520e-bc73-4073-9306-217c91a202c4 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:33.458078 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6520e-bc73-4073-9306-217c91a202c4 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:33.458078 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6520e-bc73-4073-9306-217c91a202c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:33.555925 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-5ec6520e-bc73-4073-9306-217c91a202c4 None None] MFA Rules not processed for user `35b431713dd0426c8e6306ab64f9bd86`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:33.557998 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5ec6520e-bc73-4073-9306-217c91a202c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:33.672986 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd806e29-974b-44f4-b332-4a9e0048e1ca admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:33.736636 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1506/2996] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:33 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:33.742123 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6520e-bc73-4073-9306-217c91a202c4 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:33.743937 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5ec6520e-bc73-4073-9306-217c91a202c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:33.787297 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53b308-3a77-48ff-8b88-04ab5e8503dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:33.788551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53b308-3a77-48ff-8b88-04ab5e8503dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:33.788896 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53b308-3a77-48ff-8b88-04ab5e8503dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:33.789244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53b308-3a77-48ff-8b88-04ab5e8503dc admin admin] PATH_INFO: `/v3/users/9ecc7fabe57e4fc9accda390efb62b24` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:33.791634 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53b308-3a77-48ff-8b88-04ab5e8503dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ecc7fabe57e4fc9accda390efb62b24)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:33.793850 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53b308-3a77-48ff-8b88-04ab5e8503dc admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:33.857940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6520e-bc73-4073-9306-217c91a202c4 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:33.884905 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7ea3d-7458-49ad-8b5b-c13e590a9d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:33.885891 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7ea3d-7458-49ad-8b5b-c13e590a9d91 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:33.886713 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7ea3d-7458-49ad-8b5b-c13e590a9d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:33.887179 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7ea3d-7458-49ad-8b5b-c13e590a9d91 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:33.888271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7ea3d-7458-49ad-8b5b-c13e590a9d91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:33.894162 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7ea3d-7458-49ad-8b5b-c13e590a9d91 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:34.226173 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5b53b308-3a77-48ff-8b88-04ab5e8503dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ecc7fabe57e4fc9accda390efb62b24'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:34.238477 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5b53b308-3a77-48ff-8b88-04ab5e8503dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ecc7fabe57e4fc9accda390efb62b24'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:34.248237 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1507/2997] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:16:33 2022] POST /identity/v3/projects => generated 407 bytes in 504 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:16:34.248237 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb971c6-8f50-4517-98a1-3a2dd1d642ec None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:34.248237 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb971c6-8f50-4517-98a1-3a2dd1d642ec None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:34.248237 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb971c6-8f50-4517-98a1-3a2dd1d642ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:34.292046 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-7eb971c6-8f50-4517-98a1-3a2dd1d642ec None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:34.293319 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7eb971c6-8f50-4517-98a1-3a2dd1d642ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:34.315851 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5b53b308-3a77-48ff-8b88-04ab5e8503dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ecc7fabe57e4fc9accda390efb62b24'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:34.326758 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5b53b308-3a77-48ff-8b88-04ab5e8503dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ecc7fabe57e4fc9accda390efb62b24'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:34.328235 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5b53b308-3a77-48ff-8b88-04ab5e8503dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ecc7fabe57e4fc9accda390efb62b24'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:34.341074 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1491/2998] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:16:33 2022] DELETE /identity/v3/users/9ecc7fabe57e4fc9accda390efb62b24 => generated 0 bytes in 921 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:34.342836 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53b308-3a77-48ff-8b88-04ab5e8503dc admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:34.344693 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5b53b308-3a77-48ff-8b88-04ab5e8503dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:34.404765 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1508/2999] 10.222.0.23 () {58 vars in 967 bytes} [Sat Apr 30 21:16:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:34.420160 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb971c6-8f50-4517-98a1-3a2dd1d642ec None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:34.423498 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7eb971c6-8f50-4517-98a1-3a2dd1d642ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:34.431126 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53b308-3a77-48ff-8b88-04ab5e8503dc admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:34.436519 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8cd0e-d07b-4463-b346-5077cae7dba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:34.437314 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8cd0e-d07b-4463-b346-5077cae7dba3 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:34.439226 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8cd0e-d07b-4463-b346-5077cae7dba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:34.439226 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8cd0e-d07b-4463-b346-5077cae7dba3 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:34.439226 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb8cd0e-d07b-4463-b346-5077cae7dba3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:34.441783 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb8cd0e-d07b-4463-b346-5077cae7dba3 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:34.512267 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb971c6-8f50-4517-98a1-3a2dd1d642ec None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:34.550533 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1492/3000] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:16:34 2022] POST /identity/v3/users => generated 310 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:16:34.554500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8cd0e-d07b-4463-b346-5077cae7dba3 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:34.568206 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8cd0e-d07b-4463-b346-5077cae7dba3 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:34.576092 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b1432-063c-484e-8791-1d6b2fa558e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:34.577233 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b1432-063c-484e-8791-1d6b2fa558e6 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:34.577849 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b1432-063c-484e-8791-1d6b2fa558e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:34.578365 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b1432-063c-484e-8791-1d6b2fa558e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:34.579948 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b1432-063c-484e-8791-1d6b2fa558e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:34.582962 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b1432-063c-484e-8791-1d6b2fa558e6 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:34.591108 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c270a-877e-429d-8eab-3c0efcf32194 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:34.593747 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c270a-877e-429d-8eab-3c0efcf32194 service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:34.593747 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c270a-877e-429d-8eab-3c0efcf32194 service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:34.593747 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c270a-877e-429d-8eab-3c0efcf32194 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:34.597008 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1493/3001] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:16:34.600804 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b1432-063c-484e-8791-1d6b2fa558e6 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:34.612829 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b1432-063c-484e-8791-1d6b2fa558e6 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:34.618152 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518419a-497a-4c01-97a8-55b63b0a7e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:34.619408 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518419a-497a-4c01-97a8-55b63b0a7e84 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:34.619408 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518419a-497a-4c01-97a8-55b63b0a7e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:34.619660 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518419a-497a-4c01-97a8-55b63b0a7e84 admin admin] PATH_INFO: `/v3/projects/66cbdee548eb4888ac929f6282660cf7/users/96a0c93fa3f24b05879848bef449d46c/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:34.641240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518419a-497a-4c01-97a8-55b63b0a7e84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66cbdee548eb4888ac929f6282660cf7, user_id=96a0c93fa3f24b05879848bef449d46c, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:34.646670 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518419a-497a-4c01-97a8-55b63b0a7e84 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:34.664414 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c270a-877e-429d-8eab-3c0efcf32194 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:34.666141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c270a-877e-429d-8eab-3c0efcf32194 service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:34.675297 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1509/3002] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:16:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:16:34.744950 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1494/3003] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:16:34 2022] PUT /identity/v3/projects/66cbdee548eb4888ac929f6282660cf7/users/96a0c93fa3f24b05879848bef449d46c/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:34.749452 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c270a-877e-429d-8eab-3c0efcf32194 service swift] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:34.760866 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c270a-877e-429d-8eab-3c0efcf32194 service swift] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:34.793221 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518419a-497a-4c01-97a8-55b63b0a7e84 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:34.797612 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a518419a-497a-4c01-97a8-55b63b0a7e84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:34.864483 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d08c8-3147-49ea-99f7-eeae174efe1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:34.865166 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d08c8-3147-49ea-99f7-eeae174efe1d admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:34.866594 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d08c8-3147-49ea-99f7-eeae174efe1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:34.866594 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d08c8-3147-49ea-99f7-eeae174efe1d admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:34.866594 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d08c8-3147-49ea-99f7-eeae174efe1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:34.872522 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d08c8-3147-49ea-99f7-eeae174efe1d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:34.891565 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1510/3004] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:16:34.896081 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d08c8-3147-49ea-99f7-eeae174efe1d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:34.907331 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d08c8-3147-49ea-99f7-eeae174efe1d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:34.911707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518419a-497a-4c01-97a8-55b63b0a7e84 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:34.915651 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d61dc8e-b48f-4cc8-a3e0-c1628232bd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:34.916770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61dc8e-b48f-4cc8-a3e0-c1628232bd58 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:34.917210 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61dc8e-b48f-4cc8-a3e0-c1628232bd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:34.917493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61dc8e-b48f-4cc8-a3e0-c1628232bd58 admin admin] PATH_INFO: `/v3/projects/66cbdee548eb4888ac929f6282660cf7/users/96a0c93fa3f24b05879848bef449d46c/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:34.919544 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d61dc8e-b48f-4cc8-a3e0-c1628232bd58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66cbdee548eb4888ac929f6282660cf7, user_id=96a0c93fa3f24b05879848bef449d46c, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:34.920687 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d79479-18c1-4ac5-b531-28d16fca4126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:34.921942 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d79479-18c1-4ac5-b531-28d16fca4126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:34.922389 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d79479-18c1-4ac5-b531-28d16fca4126 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:34.922829 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d79479-18c1-4ac5-b531-28d16fca4126 admin admin] PATH_INFO: `/v3/projects/98bd8e2e248d4b3599ea7038e73a0981` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:34.924043 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d61dc8e-b48f-4cc8-a3e0-c1628232bd58 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:34.925259 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d79479-18c1-4ac5-b531-28d16fca4126 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98bd8e2e248d4b3599ea7038e73a0981)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:34.927568 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d79479-18c1-4ac5-b531-28d16fca4126 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:34.947609 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1511/3005] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:16:34 2022] PUT /identity/v3/projects/66cbdee548eb4888ac929f6282660cf7/users/96a0c93fa3f24b05879848bef449d46c/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:34.956857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c6535-46be-43ae-b6e0-991f60800fec None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:34.958854 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c6535-46be-43ae-b6e0-991f60800fec None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:34.959440 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c6535-46be-43ae-b6e0-991f60800fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:34.995922 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-447c6535-46be-43ae-b6e0-991f60800fec None None] MFA Rules not processed for user `96a0c93fa3f24b05879848bef449d46c`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:34.997154 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-447c6535-46be-43ae-b6e0-991f60800fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:35.085470 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a1d79479-18c1-4ac5-b531-28d16fca4126 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98bd8e2e248d4b3599ea7038e73a0981', 'request_id': 'req-a1d79479-18c1-4ac5-b531-28d16fca4126'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:35.089204 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1512/3006] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:34 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:35.091047 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c6535-46be-43ae-b6e0-991f60800fec None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:35.092892 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a1d79479-18c1-4ac5-b531-28d16fca4126 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98bd8e2e248d4b3599ea7038e73a0981', 'request_id': 'req-a1d79479-18c1-4ac5-b531-28d16fca4126'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:35.101832 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a1d79479-18c1-4ac5-b531-28d16fca4126 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98bd8e2e248d4b3599ea7038e73a0981', 'request_id': 'req-a1d79479-18c1-4ac5-b531-28d16fca4126'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:35.190383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a1d79479-18c1-4ac5-b531-28d16fca4126 admin admin] The token cache is being invalidate because project 98bd8e2e248d4b3599ea7038e73a0981 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:16:35.190686 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a1d79479-18c1-4ac5-b531-28d16fca4126 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:35.191896 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c6535-46be-43ae-b6e0-991f60800fec None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:35.192863 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a1d79479-18c1-4ac5-b531-28d16fca4126 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:35.194692 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1495/3007] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:16:34 2022] DELETE /identity/v3/projects/98bd8e2e248d4b3599ea7038e73a0981 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:35.200212 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9255e-49bd-4793-a850-36a1c7765d6c None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:35.200714 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9255e-49bd-4793-a850-36a1c7765d6c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:35.201203 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e9255e-49bd-4793-a850-36a1c7765d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:35.234161 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-68e9255e-49bd-4793-a850-36a1c7765d6c None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:35.235670 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-68e9255e-49bd-4793-a850-36a1c7765d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:35.288731 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be391bc-d344-489c-9b1a-6d0bc622f753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:35.290006 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be391bc-d344-489c-9b1a-6d0bc622f753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:35.290422 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be391bc-d344-489c-9b1a-6d0bc622f753 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:35.290809 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be391bc-d344-489c-9b1a-6d0bc622f753 admin admin] PATH_INFO: `/v3/users/35b431713dd0426c8e6306ab64f9bd86` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:35.292675 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be391bc-d344-489c-9b1a-6d0bc622f753 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35b431713dd0426c8e6306ab64f9bd86)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:35.295879 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be391bc-d344-489c-9b1a-6d0bc622f753 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:35.343484 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1496/3008] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:35.346262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0991df8-562f-407f-9620-e8c99ef82f5a None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:35.346715 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0991df8-562f-407f-9620-e8c99ef82f5a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:35.347153 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0991df8-562f-407f-9620-e8c99ef82f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:35.373336 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-d0991df8-562f-407f-9620-e8c99ef82f5a None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:35.390655 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d0991df8-562f-407f-9620-e8c99ef82f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:35.477287 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1497/3009] 10.222.0.23 () {58 vars in 967 bytes} [Sat Apr 30 21:16:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:35.479042 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161a70b-4355-4f0c-b1d6-b66a2552eb36 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:35.479401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161a70b-4355-4f0c-b1d6-b66a2552eb36 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:35.479753 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161a70b-4355-4f0c-b1d6-b66a2552eb36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:35.505309 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-7161a70b-4355-4f0c-b1d6-b66a2552eb36 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:35.506838 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7161a70b-4355-4f0c-b1d6-b66a2552eb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:35.528402 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1498/3010] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:35.536385 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161a70b-4355-4f0c-b1d6-b66a2552eb36 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:35.539429 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7161a70b-4355-4f0c-b1d6-b66a2552eb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:35.547614 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3be391bc-d344-489c-9b1a-6d0bc622f753 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35b431713dd0426c8e6306ab64f9bd86'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:35.567050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3be391bc-d344-489c-9b1a-6d0bc622f753 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35b431713dd0426c8e6306ab64f9bd86'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:35.634857 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161a70b-4355-4f0c-b1d6-b66a2552eb36 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:35.639982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c0b52-1bd9-4e9a-86e5-8b32b46c1f29 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:35.640652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c0b52-1bd9-4e9a-86e5-8b32b46c1f29 service swift] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:35.640933 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c0b52-1bd9-4e9a-86e5-8b32b46c1f29 service swift] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:35.641208 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c0b52-1bd9-4e9a-86e5-8b32b46c1f29 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:35.650127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c0b52-1bd9-4e9a-86e5-8b32b46c1f29 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:35.662855 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c0b52-1bd9-4e9a-86e5-8b32b46c1f29 service swift] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:35.667579 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3be391bc-d344-489c-9b1a-6d0bc622f753 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35b431713dd0426c8e6306ab64f9bd86'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:35.668638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3be391bc-d344-489c-9b1a-6d0bc622f753 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35b431713dd0426c8e6306ab64f9bd86'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:35.673928 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1499/3011] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:16:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:16:35.674886 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c0b52-1bd9-4e9a-86e5-8b32b46c1f29 service swift] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:35.689569 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c0b52-1bd9-4e9a-86e5-8b32b46c1f29 service swift] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:35.695034 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf41e3a-cbc5-41c5-b5b3-23e6ae61dc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:35.696508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf41e3a-cbc5-41c5-b5b3-23e6ae61dc65 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:35.696508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf41e3a-cbc5-41c5-b5b3-23e6ae61dc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:35.696508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf41e3a-cbc5-41c5-b5b3-23e6ae61dc65 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:35.697629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf41e3a-cbc5-41c5-b5b3-23e6ae61dc65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:16:35.698223 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf41e3a-cbc5-41c5-b5b3-23e6ae61dc65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:35.700042 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf41e3a-cbc5-41c5-b5b3-23e6ae61dc65 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:35.717373 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1500/3012] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:16:35.718484 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf41e3a-cbc5-41c5-b5b3-23e6ae61dc65 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:35.727257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3be391bc-d344-489c-9b1a-6d0bc622f753 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35b431713dd0426c8e6306ab64f9bd86'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:35.730898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf41e3a-cbc5-41c5-b5b3-23e6ae61dc65 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:35.738157 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd9741-da01-424b-a762-33a6e49fedea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:35.738989 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd9741-da01-424b-a762-33a6e49fedea admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:35.739495 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd9741-da01-424b-a762-33a6e49fedea admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:35.739625 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd9741-da01-424b-a762-33a6e49fedea admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:35.740241 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd9741-da01-424b-a762-33a6e49fedea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:35.742595 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd9741-da01-424b-a762-33a6e49fedea admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:35.757476 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1513/3013] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:16:35 2022] DELETE /identity/v3/users/35b431713dd0426c8e6306ab64f9bd86 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:35.759487 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1969d-c0b6-4480-b200-2cce627d631f None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:35.760499 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1969d-c0b6-4480-b200-2cce627d631f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:35.760795 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1969d-c0b6-4480-b200-2cce627d631f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:35.779907 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-2cd1969d-c0b6-4480-b200-2cce627d631f None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:35.781699 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2cd1969d-c0b6-4480-b200-2cce627d631f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:35.841090 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1514/3014] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:16:35.856365 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1969d-c0b6-4480-b200-2cce627d631f None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:35.856365 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2cd1969d-c0b6-4480-b200-2cce627d631f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:35.886741 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1501/3015] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:16:35 2022] POST /identity/v3/projects => generated 383 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:16:35.890925 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd9741-da01-424b-a762-33a6e49fedea admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:35.892736 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6bfd9741-da01-424b-a762-33a6e49fedea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:35.916418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1969d-c0b6-4480-b200-2cce627d631f None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:35.973452 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd9741-da01-424b-a762-33a6e49fedea admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:35.978526 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38cd30a-d7e2-4261-8923-e3f9a500b809 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:35.978897 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca54342-48a8-49e8-8a5a-1cad4236a2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:35.979644 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca54342-48a8-49e8-8a5a-1cad4236a2d9 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:35.979835 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cd30a-d7e2-4261-8923-e3f9a500b809 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:35.980128 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca54342-48a8-49e8-8a5a-1cad4236a2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:35.980283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cd30a-d7e2-4261-8923-e3f9a500b809 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:35.980464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cd30a-d7e2-4261-8923-e3f9a500b809 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:35.980592 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca54342-48a8-49e8-8a5a-1cad4236a2d9 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:35.981432 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca54342-48a8-49e8-8a5a-1cad4236a2d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:35.983764 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca54342-48a8-49e8-8a5a-1cad4236a2d9 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:36.007119 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38cd30a-d7e2-4261-8923-e3f9a500b809 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:36.007119 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38cd30a-d7e2-4261-8923-e3f9a500b809 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:36.023274 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1515/3016] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:16:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:16:36.100586 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1502/3017] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:16:35 2022] POST /identity/v3/users => generated 292 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:16:36.111196 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38cd30a-d7e2-4261-8923-e3f9a500b809 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:36.129672 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38cd30a-d7e2-4261-8923-e3f9a500b809 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:36.137472 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63fe51-040d-4d64-aa5c-7e0a2d457f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:36.140020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63fe51-040d-4d64-aa5c-7e0a2d457f9d admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:36.140350 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63fe51-040d-4d64-aa5c-7e0a2d457f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:36.142375 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63fe51-040d-4d64-aa5c-7e0a2d457f9d admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:36.145101 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63fe51-040d-4d64-aa5c-7e0a2d457f9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:36.148324 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63fe51-040d-4d64-aa5c-7e0a2d457f9d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:36.166607 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1516/3018] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:16:36.167176 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca54342-48a8-49e8-8a5a-1cad4236a2d9 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:36.183789 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca54342-48a8-49e8-8a5a-1cad4236a2d9 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:36.194443 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c5c86-c7e3-4a87-afa9-75468afcb40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:36.195142 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c5c86-c7e3-4a87-afa9-75468afcb40d admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:36.195426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c5c86-c7e3-4a87-afa9-75468afcb40d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:36.195758 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c5c86-c7e3-4a87-afa9-75468afcb40d admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:36.196506 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274c5c86-c7e3-4a87-afa9-75468afcb40d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:36.198309 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274c5c86-c7e3-4a87-afa9-75468afcb40d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:36.214722 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1503/3019] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:16:36.214879 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63fe51-040d-4d64-aa5c-7e0a2d457f9d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:36.225797 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63fe51-040d-4d64-aa5c-7e0a2d457f9d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:36.231224 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b102198-0cc9-4a6f-be35-6a1cec860aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:36.232215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b102198-0cc9-4a6f-be35-6a1cec860aff admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:36.232576 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b102198-0cc9-4a6f-be35-6a1cec860aff admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:36.232922 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b102198-0cc9-4a6f-be35-6a1cec860aff admin admin] PATH_INFO: `/v3/projects/cf92e5aab5164a259043531a9d3ca6d0/users/0927ef875bcf467fa08ff7d44b48f309/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:36.257454 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b102198-0cc9-4a6f-be35-6a1cec860aff admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf92e5aab5164a259043531a9d3ca6d0, user_id=0927ef875bcf467fa08ff7d44b48f309, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:36.278975 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b102198-0cc9-4a6f-be35-6a1cec860aff admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:36.358347 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1517/3020] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:16:36 2022] PUT /identity/v3/projects/cf92e5aab5164a259043531a9d3ca6d0/users/0927ef875bcf467fa08ff7d44b48f309/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:36.368976 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de7943-5443-435e-847c-d5b0f6dad681 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:36.370079 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de7943-5443-435e-847c-d5b0f6dad681 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:36.371862 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de7943-5443-435e-847c-d5b0f6dad681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:36.406481 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e9bb1-bd76-4ee5-922c-7db2d69fce1f None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:36.406744 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e9bb1-bd76-4ee5-922c-7db2d69fce1f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:36.407027 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e9bb1-bd76-4ee5-922c-7db2d69fce1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:36.431692 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-c4de7943-5443-435e-847c-d5b0f6dad681 None None] MFA Rules not processed for user `0927ef875bcf467fa08ff7d44b48f309`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:36.432951 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c4de7943-5443-435e-847c-d5b0f6dad681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:36.438803 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-376e9bb1-bd76-4ee5-922c-7db2d69fce1f None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:36.441815 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-376e9bb1-bd76-4ee5-922c-7db2d69fce1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:36.565707 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1518/3021] 10.222.0.23 () {58 vars in 967 bytes} [Sat Apr 30 21:16:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:36.579936 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e9bb1-bd76-4ee5-922c-7db2d69fce1f None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:36.581839 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1504/3022] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:36.582925 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de7943-5443-435e-847c-d5b0f6dad681 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:36.584540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c4de7943-5443-435e-847c-d5b0f6dad681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:36.670237 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de7943-5443-435e-847c-d5b0f6dad681 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:36.675968 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ec227-6025-49ed-b920-8ae8ad7f0068 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:36.676294 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e9bb1-bd76-4ee5-922c-7db2d69fce1f None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:36.676975 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ec227-6025-49ed-b920-8ae8ad7f0068 service swift] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:36.677346 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ec227-6025-49ed-b920-8ae8ad7f0068 service swift] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:36.677880 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ec227-6025-49ed-b920-8ae8ad7f0068 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:36.681449 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7839cf23-fb34-466a-b77c-741d9b758c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:36.682237 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839cf23-fb34-466a-b77c-741d9b758c4a admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:36.682642 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839cf23-fb34-466a-b77c-741d9b758c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:36.682950 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839cf23-fb34-466a-b77c-741d9b758c4a admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:36.683652 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7839cf23-fb34-466a-b77c-741d9b758c4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:36.685910 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7839cf23-fb34-466a-b77c-741d9b758c4a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:36.687713 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9ec227-6025-49ed-b920-8ae8ad7f0068 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:36.689345 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9ec227-6025-49ed-b920-8ae8ad7f0068 service swift] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:36.699263 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1505/3023] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:16:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:16:36.727103 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ec227-6025-49ed-b920-8ae8ad7f0068 service swift] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:36.729256 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-cd9ec227-6025-49ed-b920-8ae8ad7f0068 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:36.745992 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ec227-6025-49ed-b920-8ae8ad7f0068 service swift] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:36.757064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da73e9b-bb5a-40cf-89f2-43087bd4dc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:36.757064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da73e9b-bb5a-40cf-89f2-43087bd4dc3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:36.757064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da73e9b-bb5a-40cf-89f2-43087bd4dc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:36.757064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da73e9b-bb5a-40cf-89f2-43087bd4dc3c admin admin] PATH_INFO: `/v3/projects/fe2f4895e8b946c2a7c18a86ae56fcea` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:36.757532 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da73e9b-bb5a-40cf-89f2-43087bd4dc3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe2f4895e8b946c2a7c18a86ae56fcea)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:36.758196 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da73e9b-bb5a-40cf-89f2-43087bd4dc3c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:36.813210 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1519/3024] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:16:36 2022] POST /identity/v3/projects => generated 383 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:16:36.822938 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7839cf23-fb34-466a-b77c-741d9b758c4a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:36.926968 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6da73e9b-bb5a-40cf-89f2-43087bd4dc3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe2f4895e8b946c2a7c18a86ae56fcea', 'request_id': 'req-6da73e9b-bb5a-40cf-89f2-43087bd4dc3c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:36.941494 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6da73e9b-bb5a-40cf-89f2-43087bd4dc3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe2f4895e8b946c2a7c18a86ae56fcea', 'request_id': 'req-6da73e9b-bb5a-40cf-89f2-43087bd4dc3c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:36.956667 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6da73e9b-bb5a-40cf-89f2-43087bd4dc3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe2f4895e8b946c2a7c18a86ae56fcea', 'request_id': 'req-6da73e9b-bb5a-40cf-89f2-43087bd4dc3c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:36.968360 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7839cf23-fb34-466a-b77c-741d9b758c4a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:37.060092 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d0b2fa-09ea-4e2e-9b3f-f90af269fffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:37.061108 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0b2fa-09ea-4e2e-9b3f-f90af269fffb admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:37.061569 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0b2fa-09ea-4e2e-9b3f-f90af269fffb admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:37.063003 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0b2fa-09ea-4e2e-9b3f-f90af269fffb admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:37.064170 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d0b2fa-09ea-4e2e-9b3f-f90af269fffb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:37.066836 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d0b2fa-09ea-4e2e-9b3f-f90af269fffb admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:37.072446 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6da73e9b-bb5a-40cf-89f2-43087bd4dc3c admin admin] The token cache is being invalidate because project fe2f4895e8b946c2a7c18a86ae56fcea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:16:37.072847 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6da73e9b-bb5a-40cf-89f2-43087bd4dc3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:37.076212 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6da73e9b-bb5a-40cf-89f2-43087bd4dc3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:37.080188 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1506/3025] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:16:36 2022] DELETE /identity/v3/projects/fe2f4895e8b946c2a7c18a86ae56fcea => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:16:37.086483 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da73e9b-bb5a-40cf-89f2-43087bd4dc3c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:37.089706 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6da73e9b-bb5a-40cf-89f2-43087bd4dc3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:37.110731 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da73e9b-bb5a-40cf-89f2-43087bd4dc3c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:37.116711 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d9739-2730-49d8-b5ec-16b0750b0828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:37.117647 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d9739-2730-49d8-b5ec-16b0750b0828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:37.117967 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d9739-2730-49d8-b5ec-16b0750b0828 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:37.118258 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d9739-2730-49d8-b5ec-16b0750b0828 admin admin] PATH_INFO: `/v3/users/96a0c93fa3f24b05879848bef449d46c` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:37.120175 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d9739-2730-49d8-b5ec-16b0750b0828 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96a0c93fa3f24b05879848bef449d46c)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:37.123991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d9739-2730-49d8-b5ec-16b0750b0828 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:37.237937 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1520/3026] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:16:36 2022] POST /identity/v3/users => generated 298 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:16:37.239294 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d0b2fa-09ea-4e2e-9b3f-f90af269fffb admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:37.248851 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-30d0b2fa-09ea-4e2e-9b3f-f90af269fffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:37.276190 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d0b2fa-09ea-4e2e-9b3f-f90af269fffb admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:37.293051 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34348998-98f0-4131-982f-fa992ae4925d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:37.300344 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34348998-98f0-4131-982f-fa992ae4925d admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:37.300344 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34348998-98f0-4131-982f-fa992ae4925d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:37.300344 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34348998-98f0-4131-982f-fa992ae4925d admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:37.300344 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34348998-98f0-4131-982f-fa992ae4925d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:37.300344 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34348998-98f0-4131-982f-fa992ae4925d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:37.313240 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1521/3027] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:16:37.317735 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34348998-98f0-4131-982f-fa992ae4925d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:37.330606 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34348998-98f0-4131-982f-fa992ae4925d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:37.354462 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af02c4b-eeab-495a-857b-8dbfbb76d24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:37.355391 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af02c4b-eeab-495a-857b-8dbfbb76d24f admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:37.355730 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af02c4b-eeab-495a-857b-8dbfbb76d24f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:37.355954 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af02c4b-eeab-495a-857b-8dbfbb76d24f admin admin] PATH_INFO: `/v3/projects/f1207102c9ec475daec870dcc3c9d099/users/29bab5abe6264ff499ed4f775ef5acee/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:37.373114 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-068d9739-2730-49d8-b5ec-16b0750b0828 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96a0c93fa3f24b05879848bef449d46c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:37.390167 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af02c4b-eeab-495a-857b-8dbfbb76d24f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1207102c9ec475daec870dcc3c9d099, user_id=29bab5abe6264ff499ed4f775ef5acee, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:37.390489 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-068d9739-2730-49d8-b5ec-16b0750b0828 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96a0c93fa3f24b05879848bef449d46c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:37.392957 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af02c4b-eeab-495a-857b-8dbfbb76d24f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:37.486701 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-068d9739-2730-49d8-b5ec-16b0750b0828 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96a0c93fa3f24b05879848bef449d46c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:37.495234 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1522/3028] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:16:37 2022] PUT /identity/v3/projects/f1207102c9ec475daec870dcc3c9d099/users/29bab5abe6264ff499ed4f775ef5acee/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:37.496067 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af02c4b-eeab-495a-857b-8dbfbb76d24f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:37.497057 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-068d9739-2730-49d8-b5ec-16b0750b0828 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96a0c93fa3f24b05879848bef449d46c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:37.499000 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3af02c4b-eeab-495a-857b-8dbfbb76d24f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:37.499431 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-068d9739-2730-49d8-b5ec-16b0750b0828 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96a0c93fa3f24b05879848bef449d46c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:37.507277 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1507/3029] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:16:37 2022] DELETE /identity/v3/users/96a0c93fa3f24b05879848bef449d46c => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:37.508909 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a69f4f-596c-420a-a57d-6b7c08205edb None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:37.512339 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a69f4f-596c-420a-a57d-6b7c08205edb None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:37.512339 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a69f4f-596c-420a-a57d-6b7c08205edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:37.584490 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-d2a69f4f-596c-420a-a57d-6b7c08205edb None None] MFA Rules not processed for user `5df6ea2992c04a97af023bfb428ac44e`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:37.585735 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d2a69f4f-596c-420a-a57d-6b7c08205edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:37.623941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af02c4b-eeab-495a-857b-8dbfbb76d24f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:37.692225 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1508/3030] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:37.693204 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a69f4f-596c-420a-a57d-6b7c08205edb None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:37.694672 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d2a69f4f-596c-420a-a57d-6b7c08205edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:37.715847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a4e3cb-406f-4d05-8343-543a6f3a8ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:37.716818 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4e3cb-406f-4d05-8343-543a6f3a8ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:37.717171 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4e3cb-406f-4d05-8343-543a6f3a8ced admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:37.717543 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4e3cb-406f-4d05-8343-543a6f3a8ced admin admin] PATH_INFO: `/v3/users/eb2cc38da7684af39aed81a0e05d60a7` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:37.719215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a4e3cb-406f-4d05-8343-543a6f3a8ced admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb2cc38da7684af39aed81a0e05d60a7)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:37.722019 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a4e3cb-406f-4d05-8343-543a6f3a8ced admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:37.773427 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a69f4f-596c-420a-a57d-6b7c08205edb None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:37.778756 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd651ffc-05b1-4731-866a-64777f461781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:37.779702 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd651ffc-05b1-4731-866a-64777f461781 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:37.779994 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd651ffc-05b1-4731-866a-64777f461781 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:37.780273 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd651ffc-05b1-4731-866a-64777f461781 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:37.781003 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd651ffc-05b1-4731-866a-64777f461781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:37.782952 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd651ffc-05b1-4731-866a-64777f461781 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:37.797291 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1509/3031] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:16:37.797291 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd651ffc-05b1-4731-866a-64777f461781 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:37.799247 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-fd651ffc-05b1-4731-866a-64777f461781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:37.890124 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd651ffc-05b1-4731-866a-64777f461781 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:37.898269 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c1307-0251-4750-9034-eded48e7ff12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:37.898920 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c1307-0251-4750-9034-eded48e7ff12 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:37.899444 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c1307-0251-4750-9034-eded48e7ff12 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:37.899666 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c1307-0251-4750-9034-eded48e7ff12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:37.912435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c1307-0251-4750-9034-eded48e7ff12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:37.914450 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c1307-0251-4750-9034-eded48e7ff12 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:37.918675 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e1a4e3cb-406f-4d05-8343-543a6f3a8ced admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb2cc38da7684af39aed81a0e05d60a7'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:37.934401 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1510/3032] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:16:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:16:37.937387 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c1307-0251-4750-9034-eded48e7ff12 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:37.943019 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e1a4e3cb-406f-4d05-8343-543a6f3a8ced admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb2cc38da7684af39aed81a0e05d60a7'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:37.960127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c1307-0251-4750-9034-eded48e7ff12 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:37.970478 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b5e2d7-bdb9-4189-9412-865e9865ee3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:37.972922 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5e2d7-bdb9-4189-9412-865e9865ee3e admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:37.973562 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5e2d7-bdb9-4189-9412-865e9865ee3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:37.974151 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5e2d7-bdb9-4189-9412-865e9865ee3e admin admin] PATH_INFO: `/v3/projects/f1207102c9ec475daec870dcc3c9d099/users/29bab5abe6264ff499ed4f775ef5acee/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:37.977645 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b5e2d7-bdb9-4189-9412-865e9865ee3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1207102c9ec475daec870dcc3c9d099, user_id=29bab5abe6264ff499ed4f775ef5acee, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:37.980540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b5e2d7-bdb9-4189-9412-865e9865ee3e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:37.994147 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1511/3033] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:16:37 2022] PUT /identity/v3/projects/f1207102c9ec475daec870dcc3c9d099/users/29bab5abe6264ff499ed4f775ef5acee/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:38.006948 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e370fc5-bf39-4bfd-9ce4-91f5a1f8e385 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:38.007378 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e370fc5-bf39-4bfd-9ce4-91f5a1f8e385 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:38.007763 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e370fc5-bf39-4bfd-9ce4-91f5a1f8e385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:38.041979 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-1e370fc5-bf39-4bfd-9ce4-91f5a1f8e385 None None] MFA Rules not processed for user `29bab5abe6264ff499ed4f775ef5acee`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:38.043243 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1e370fc5-bf39-4bfd-9ce4-91f5a1f8e385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:38.079230 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e1a4e3cb-406f-4d05-8343-543a6f3a8ced admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb2cc38da7684af39aed81a0e05d60a7'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:38.079904 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e1a4e3cb-406f-4d05-8343-543a6f3a8ced admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb2cc38da7684af39aed81a0e05d60a7'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:38.090700 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e1a4e3cb-406f-4d05-8343-543a6f3a8ced admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb2cc38da7684af39aed81a0e05d60a7'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:38.100984 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1523/3034] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:16:37 2022] DELETE /identity/v3/users/eb2cc38da7684af39aed81a0e05d60a7 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:38.105584 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d560407-1727-4fb4-98e8-fc8044bbb4f6 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:38.106620 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d560407-1727-4fb4-98e8-fc8044bbb4f6 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:38.107444 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d560407-1727-4fb4-98e8-fc8044bbb4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:38.146779 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1512/3035] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:16:38.147861 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e370fc5-bf39-4bfd-9ce4-91f5a1f8e385 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:38.154081 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-7d560407-1727-4fb4-98e8-fc8044bbb4f6 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:38.157610 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7d560407-1727-4fb4-98e8-fc8044bbb4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:38.158202 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1e370fc5-bf39-4bfd-9ce4-91f5a1f8e385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:38.245693 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1524/3036] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:38.256597 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e370fc5-bf39-4bfd-9ce4-91f5a1f8e385 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:38.257383 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d560407-1727-4fb4-98e8-fc8044bbb4f6 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:38.258969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7d560407-1727-4fb4-98e8-fc8044bbb4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:38.262031 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836a91b-1927-4ca3-96a7-fca1a928975c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:38.262977 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836a91b-1927-4ca3-96a7-fca1a928975c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:38.263363 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836a91b-1927-4ca3-96a7-fca1a928975c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:38.263742 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836a91b-1927-4ca3-96a7-fca1a928975c admin admin] PATH_INFO: `/v3/projects/66cbdee548eb4888ac929f6282660cf7` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:38.265064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b836a91b-1927-4ca3-96a7-fca1a928975c admin admin] RBAC: Authorizing `identity:delete_project(project_id=66cbdee548eb4888ac929f6282660cf7)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:38.267377 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b836a91b-1927-4ca3-96a7-fca1a928975c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:38.366106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d560407-1727-4fb4-98e8-fc8044bbb4f6 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:38.372468 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91744f7-d373-4b93-8ebe-2a448ff8edca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:38.373146 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91744f7-d373-4b93-8ebe-2a448ff8edca service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:38.373414 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91744f7-d373-4b93-8ebe-2a448ff8edca service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:38.373701 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91744f7-d373-4b93-8ebe-2a448ff8edca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:38.385392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91744f7-d373-4b93-8ebe-2a448ff8edca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:38.387081 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91744f7-d373-4b93-8ebe-2a448ff8edca service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:38.406761 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1525/3037] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:16:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:16:38.407524 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91744f7-d373-4b93-8ebe-2a448ff8edca service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:38.411409 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f91744f7-d373-4b93-8ebe-2a448ff8edca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:38.421481 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b836a91b-1927-4ca3-96a7-fca1a928975c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66cbdee548eb4888ac929f6282660cf7', 'request_id': 'req-b836a91b-1927-4ca3-96a7-fca1a928975c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:38.429027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b836a91b-1927-4ca3-96a7-fca1a928975c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66cbdee548eb4888ac929f6282660cf7', 'request_id': 'req-b836a91b-1927-4ca3-96a7-fca1a928975c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:38.438576 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b836a91b-1927-4ca3-96a7-fca1a928975c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66cbdee548eb4888ac929f6282660cf7', 'request_id': 'req-b836a91b-1927-4ca3-96a7-fca1a928975c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:38.516570 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91744f7-d373-4b93-8ebe-2a448ff8edca service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:38.530708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b836a91b-1927-4ca3-96a7-fca1a928975c admin admin] The token cache is being invalidate because project 66cbdee548eb4888ac929f6282660cf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:16:38.531138 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b836a91b-1927-4ca3-96a7-fca1a928975c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:38.532469 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b836a91b-1927-4ca3-96a7-fca1a928975c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:38.534278 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1513/3038] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:16:38 2022] DELETE /identity/v3/projects/66cbdee548eb4888ac929f6282660cf7 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:38.540836 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403a699-dd6e-4e3b-81bd-ebee392be31c None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:38.540836 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403a699-dd6e-4e3b-81bd-ebee392be31c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:38.541907 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403a699-dd6e-4e3b-81bd-ebee392be31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:38.571908 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-6403a699-dd6e-4e3b-81bd-ebee392be31c None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:38.572856 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6403a699-dd6e-4e3b-81bd-ebee392be31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:38.633372 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891902d8-698d-4c9b-9b49-277a3ea08bc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:38.634090 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891902d8-698d-4c9b-9b49-277a3ea08bc6 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:38.634378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891902d8-698d-4c9b-9b49-277a3ea08bc6 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:38.634662 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891902d8-698d-4c9b-9b49-277a3ea08bc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:38.636723 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-891902d8-698d-4c9b-9b49-277a3ea08bc6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:38.704278 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1514/3039] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:16:38.714487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e397e-4c71-48e1-9da8-93ada30cd066 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:38.714783 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e397e-4c71-48e1-9da8-93ada30cd066 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:38.715205 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e397e-4c71-48e1-9da8-93ada30cd066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:38.715319 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891902d8-698d-4c9b-9b49-277a3ea08bc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:38.717177 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891902d8-698d-4c9b-9b49-277a3ea08bc6 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:38.740755 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1526/3040] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:16:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:16:38.741922 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891902d8-698d-4c9b-9b49-277a3ea08bc6 service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:38.743357 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-891902d8-698d-4c9b-9b49-277a3ea08bc6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:38.753618 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-f99e397e-4c71-48e1-9da8-93ada30cd066 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:38.755775 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f99e397e-4c71-48e1-9da8-93ada30cd066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:38.770904 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1515/3041] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:38.774577 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e397e-4c71-48e1-9da8-93ada30cd066 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:38.784465 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891902d8-698d-4c9b-9b49-277a3ea08bc6 service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:38.798745 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f5bd5d-593e-489d-bb40-78079514b0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:38.800130 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5bd5d-593e-489d-bb40-78079514b0e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:38.803466 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5bd5d-593e-489d-bb40-78079514b0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:38.804093 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5bd5d-593e-489d-bb40-78079514b0e4 admin admin] PATH_INFO: `/v3/projects/a33635f00a9e48818fe1081019a2ceb5` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:38.804717 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e397e-4c71-48e1-9da8-93ada30cd066 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:38.805897 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f5bd5d-593e-489d-bb40-78079514b0e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a33635f00a9e48818fe1081019a2ceb5)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:38.812689 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f5bd5d-593e-489d-bb40-78079514b0e4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:38.816942 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89e07b-3d65-43a2-b550-7fea79228e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:38.817622 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89e07b-3d65-43a2-b550-7fea79228e58 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:38.817934 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89e07b-3d65-43a2-b550-7fea79228e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:38.818212 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89e07b-3d65-43a2-b550-7fea79228e58 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:38.819276 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f89e07b-3d65-43a2-b550-7fea79228e58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:16:38.819276 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f89e07b-3d65-43a2-b550-7fea79228e58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:38.820888 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f89e07b-3d65-43a2-b550-7fea79228e58 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:38.850985 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1516/3042] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:16:38.855526 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89e07b-3d65-43a2-b550-7fea79228e58 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:38.866937 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89e07b-3d65-43a2-b550-7fea79228e58 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:38.872133 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f46cb-2c96-4fc1-9fe6-2800682edb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:38.872962 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f46cb-2c96-4fc1-9fe6-2800682edb7d admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:38.873358 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f46cb-2c96-4fc1-9fe6-2800682edb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:38.873793 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f46cb-2c96-4fc1-9fe6-2800682edb7d admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:38.874624 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f46cb-2c96-4fc1-9fe6-2800682edb7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:38.876907 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f46cb-2c96-4fc1-9fe6-2800682edb7d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:39.003622 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1517/3043] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:16:38 2022] POST /identity/v3/projects => generated 393 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:16:39.004648 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-80f5bd5d-593e-489d-bb40-78079514b0e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a33635f00a9e48818fe1081019a2ceb5', 'request_id': 'req-80f5bd5d-593e-489d-bb40-78079514b0e4'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:39.014924 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-80f5bd5d-593e-489d-bb40-78079514b0e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a33635f00a9e48818fe1081019a2ceb5', 'request_id': 'req-80f5bd5d-593e-489d-bb40-78079514b0e4'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:39.016466 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f46cb-2c96-4fc1-9fe6-2800682edb7d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:39.027948 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-80f5bd5d-593e-489d-bb40-78079514b0e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a33635f00a9e48818fe1081019a2ceb5', 'request_id': 'req-80f5bd5d-593e-489d-bb40-78079514b0e4'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:39.110182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f46cb-2c96-4fc1-9fe6-2800682edb7d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:39.116428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56361b57-b908-4af7-acf4-c591614a146f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:39.117181 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56361b57-b908-4af7-acf4-c591614a146f admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:39.117531 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56361b57-b908-4af7-acf4-c591614a146f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:39.117907 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56361b57-b908-4af7-acf4-c591614a146f admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:39.118798 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56361b57-b908-4af7-acf4-c591614a146f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:39.120878 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56361b57-b908-4af7-acf4-c591614a146f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:39.145186 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-80f5bd5d-593e-489d-bb40-78079514b0e4 admin admin] The token cache is being invalidate because project a33635f00a9e48818fe1081019a2ceb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:16:39.145817 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-80f5bd5d-593e-489d-bb40-78079514b0e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:39.146668 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-80f5bd5d-593e-489d-bb40-78079514b0e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:39.148505 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1527/3044] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:16:38 2022] DELETE /identity/v3/projects/a33635f00a9e48818fe1081019a2ceb5 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:39.153935 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a1355-6dc9-48cc-91b8-54df2c8eebee None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:39.154438 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a1355-6dc9-48cc-91b8-54df2c8eebee None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:39.154720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a1355-6dc9-48cc-91b8-54df2c8eebee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:39.177393 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-ae3a1355-6dc9-48cc-91b8-54df2c8eebee None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:39.179316 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ae3a1355-6dc9-48cc-91b8-54df2c8eebee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:39.196968 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1528/3045] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:39.198750 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb68175-27d3-4e96-a3c4-1fda2db85766 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:39.199284 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb68175-27d3-4e96-a3c4-1fda2db85766 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:39.199948 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb68175-27d3-4e96-a3c4-1fda2db85766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:39.222689 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-afb68175-27d3-4e96-a3c4-1fda2db85766 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:39.223830 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-afb68175-27d3-4e96-a3c4-1fda2db85766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:39.235369 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1529/3046] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:39.239347 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb68175-27d3-4e96-a3c4-1fda2db85766 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:39.242518 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1518/3047] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:16:39 2022] POST /identity/v3/users => generated 297 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:16:39.249279 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56361b57-b908-4af7-acf4-c591614a146f admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:39.251115 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-56361b57-b908-4af7-acf4-c591614a146f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:39.251615 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb68175-27d3-4e96-a3c4-1fda2db85766 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:39.257035 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab5ed7-cc65-40e6-8b85-2a6bb7a4b6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:39.257694 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab5ed7-cc65-40e6-8b85-2a6bb7a4b6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:39.258055 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab5ed7-cc65-40e6-8b85-2a6bb7a4b6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:39.258331 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab5ed7-cc65-40e6-8b85-2a6bb7a4b6a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:39.259058 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ab5ed7-cc65-40e6-8b85-2a6bb7a4b6a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:16:39.259363 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ab5ed7-cc65-40e6-8b85-2a6bb7a4b6a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:39.261603 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ab5ed7-cc65-40e6-8b85-2a6bb7a4b6a3 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:39.265480 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56361b57-b908-4af7-acf4-c591614a146f admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:39.275268 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964fa011-3033-4893-be03-e0ae4f8c4cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:39.276001 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964fa011-3033-4893-be03-e0ae4f8c4cbc admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:39.276601 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964fa011-3033-4893-be03-e0ae4f8c4cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:39.276789 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964fa011-3033-4893-be03-e0ae4f8c4cbc admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:39.277687 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964fa011-3033-4893-be03-e0ae4f8c4cbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:39.278896 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1530/3048] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:16:39.279558 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964fa011-3033-4893-be03-e0ae4f8c4cbc admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:39.279751 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab5ed7-cc65-40e6-8b85-2a6bb7a4b6a3 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:39.293608 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab5ed7-cc65-40e6-8b85-2a6bb7a4b6a3 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:39.296324 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1519/3049] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:16:39.301991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8a2f8-7249-4d4f-8f31-3b18a3d1d462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:39.302683 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8a2f8-7249-4d4f-8f31-3b18a3d1d462 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:39.303016 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8a2f8-7249-4d4f-8f31-3b18a3d1d462 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:39.303303 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8a2f8-7249-4d4f-8f31-3b18a3d1d462 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:39.303998 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8a2f8-7249-4d4f-8f31-3b18a3d1d462 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:39.304363 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964fa011-3033-4893-be03-e0ae4f8c4cbc admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:39.306182 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8a2f8-7249-4d4f-8f31-3b18a3d1d462 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:39.317916 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964fa011-3033-4893-be03-e0ae4f8c4cbc admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:39.324048 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81d592-1139-47e2-be26-896585808cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:39.324909 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81d592-1139-47e2-be26-896585808cde admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:39.325225 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81d592-1139-47e2-be26-896585808cde admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:39.325486 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81d592-1139-47e2-be26-896585808cde admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:39.326495 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81d592-1139-47e2-be26-896585808cde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:39.329716 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81d592-1139-47e2-be26-896585808cde admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:39.346032 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1520/3050] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:16:39.347347 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81d592-1139-47e2-be26-896585808cde admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:39.361778 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81d592-1139-47e2-be26-896585808cde admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:39.375922 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149bf296-bd4d-4524-8702-955aa148ed00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:39.378015 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bf296-bd4d-4524-8702-955aa148ed00 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:39.378650 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bf296-bd4d-4524-8702-955aa148ed00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:39.379084 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bf296-bd4d-4524-8702-955aa148ed00 admin admin] PATH_INFO: `/v3/projects/25bcc72715fa4ba88d3ca6b371eb1f93/users/0067ff081d1946149db58fd383e81bff/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:39.410815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149bf296-bd4d-4524-8702-955aa148ed00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25bcc72715fa4ba88d3ca6b371eb1f93, user_id=0067ff081d1946149db58fd383e81bff, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:39.415868 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149bf296-bd4d-4524-8702-955aa148ed00 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:39.445806 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1531/3051] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:16:39 2022] POST /identity/v3/projects => generated 379 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:16:39.449821 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8a2f8-7249-4d4f-8f31-3b18a3d1d462 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:39.528228 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1521/3052] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:16:39 2022] PUT /identity/v3/projects/25bcc72715fa4ba88d3ca6b371eb1f93/users/0067ff081d1946149db58fd383e81bff/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:39.528785 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8a2f8-7249-4d4f-8f31-3b18a3d1d462 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:39.538079 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48128c1-dd4c-466d-be50-19925ad18f05 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:39.538362 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48128c1-dd4c-466d-be50-19925ad18f05 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:39.538642 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48128c1-dd4c-466d-be50-19925ad18f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:39.580892 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-e48128c1-dd4c-466d-be50-19925ad18f05 None None] MFA Rules not processed for user `0067ff081d1946149db58fd383e81bff`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:39.580892 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e48128c1-dd4c-466d-be50-19925ad18f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:39.594932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a12ab-47d1-430e-91d0-7efe6bbd1016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:39.595732 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a12ab-47d1-430e-91d0-7efe6bbd1016 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:39.596919 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a12ab-47d1-430e-91d0-7efe6bbd1016 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:39.598108 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a12ab-47d1-430e-91d0-7efe6bbd1016 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:39.598331 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01a12ab-47d1-430e-91d0-7efe6bbd1016 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:39.600383 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01a12ab-47d1-430e-91d0-7efe6bbd1016 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:39.671752 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1522/3053] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:39.672317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48128c1-dd4c-466d-be50-19925ad18f05 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:39.702388 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1532/3054] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:16:39 2022] POST /identity/v3/users => generated 290 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:16:39.704027 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a12ab-47d1-430e-91d0-7efe6bbd1016 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:39.707505 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48128c1-dd4c-466d-be50-19925ad18f05 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:39.733942 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a12ab-47d1-430e-91d0-7efe6bbd1016 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:39.736244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc224a-efad-4a8d-b030-4a1f1e9d6d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:39.737482 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc224a-efad-4a8d-b030-4a1f1e9d6d13 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:39.740019 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc224a-efad-4a8d-b030-4a1f1e9d6d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:39.741403 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc224a-efad-4a8d-b030-4a1f1e9d6d13 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:39.743780 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc224a-efad-4a8d-b030-4a1f1e9d6d13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:39.744849 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11324602-8018-4788-a9e5-39e63916eaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:39.745800 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11324602-8018-4788-a9e5-39e63916eaef admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:39.746328 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11324602-8018-4788-a9e5-39e63916eaef admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:39.746820 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11324602-8018-4788-a9e5-39e63916eaef admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:39.748087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc224a-efad-4a8d-b030-4a1f1e9d6d13 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:39.750002 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11324602-8018-4788-a9e5-39e63916eaef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:39.752922 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11324602-8018-4788-a9e5-39e63916eaef admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:39.770495 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1533/3055] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:16:39.772007 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11324602-8018-4788-a9e5-39e63916eaef admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:39.786077 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11324602-8018-4788-a9e5-39e63916eaef admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:39.790556 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e447af-2f7a-402a-bbec-2541bfaa903b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:39.791247 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e447af-2f7a-402a-bbec-2541bfaa903b admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:39.791531 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e447af-2f7a-402a-bbec-2541bfaa903b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:39.791807 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e447af-2f7a-402a-bbec-2541bfaa903b admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:39.792554 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e447af-2f7a-402a-bbec-2541bfaa903b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:39.794229 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e447af-2f7a-402a-bbec-2541bfaa903b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:39.806788 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1534/3056] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:16:39.811431 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e447af-2f7a-402a-bbec-2541bfaa903b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:39.824678 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e447af-2f7a-402a-bbec-2541bfaa903b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:39.832089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f77b9-2f95-429d-8a49-cd87c6822632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:39.833565 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f77b9-2f95-429d-8a49-cd87c6822632 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:39.834125 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f77b9-2f95-429d-8a49-cd87c6822632 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:39.834592 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f77b9-2f95-429d-8a49-cd87c6822632 admin admin] PATH_INFO: `/v3/projects/b57cf4c7f250443a8afd9460085f6951/users/f0c43fdc22254d7f9c5999e044c4f844/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:39.858198 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612f77b9-2f95-429d-8a49-cd87c6822632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b57cf4c7f250443a8afd9460085f6951, user_id=f0c43fdc22254d7f9c5999e044c4f844, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:39.858198 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612f77b9-2f95-429d-8a49-cd87c6822632 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:39.932821 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1523/3057] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:16:39 2022] POST /identity/v3/projects => generated 393 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:16:39.933901 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc224a-efad-4a8d-b030-4a1f1e9d6d13 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:39.962642 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1535/3058] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:16:39 2022] PUT /identity/v3/projects/b57cf4c7f250443a8afd9460085f6951/users/f0c43fdc22254d7f9c5999e044c4f844/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:16:39.972618 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4306b-9628-4bc1-b514-c6314d52adc4 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:39.973308 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4306b-9628-4bc1-b514-c6314d52adc4 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:39.973587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4306b-9628-4bc1-b514-c6314d52adc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:40.009791 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-6dc4306b-9628-4bc1-b514-c6314d52adc4 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:40.011078 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6dc4306b-9628-4bc1-b514-c6314d52adc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:40.027552 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc224a-efad-4a8d-b030-4a1f1e9d6d13 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:40.133664 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48074531-a423-45c9-b97e-1c4488c6d434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:40.136253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48074531-a423-45c9-b97e-1c4488c6d434 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:40.136834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48074531-a423-45c9-b97e-1c4488c6d434 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:40.137944 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48074531-a423-45c9-b97e-1c4488c6d434 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:40.138831 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48074531-a423-45c9-b97e-1c4488c6d434 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:40.140730 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1536/3059] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:40.142173 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48074531-a423-45c9-b97e-1c4488c6d434 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:40.155059 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4306b-9628-4bc1-b514-c6314d52adc4 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:40.156621 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6dc4306b-9628-4bc1-b514-c6314d52adc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:40.253552 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4306b-9628-4bc1-b514-c6314d52adc4 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:40.259183 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71258a95-17e7-4382-93dc-809b66caae13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:40.263680 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71258a95-17e7-4382-93dc-809b66caae13 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:40.263680 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71258a95-17e7-4382-93dc-809b66caae13 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:40.263680 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71258a95-17e7-4382-93dc-809b66caae13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:40.286342 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1524/3060] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:16:39 2022] POST /identity/v3/users => generated 303 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:16:40.287611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48074531-a423-45c9-b97e-1c4488c6d434 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:40.293464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71258a95-17e7-4382-93dc-809b66caae13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:40.296141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71258a95-17e7-4382-93dc-809b66caae13 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:40.305952 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48074531-a423-45c9-b97e-1c4488c6d434 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:40.314487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9949b8-71e2-4a1a-9b33-e447660bb58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:40.316105 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9949b8-71e2-4a1a-9b33-e447660bb58f admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:40.316586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9949b8-71e2-4a1a-9b33-e447660bb58f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:40.317128 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9949b8-71e2-4a1a-9b33-e447660bb58f admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:40.318108 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9949b8-71e2-4a1a-9b33-e447660bb58f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:40.321423 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9949b8-71e2-4a1a-9b33-e447660bb58f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:40.328908 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1537/3061] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:16:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:16:40.339055 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1525/3062] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:16:40.342633 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71258a95-17e7-4382-93dc-809b66caae13 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:40.356766 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71258a95-17e7-4382-93dc-809b66caae13 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:40.365580 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2daef-adf7-4957-8906-2588e95ee3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:40.367478 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2daef-adf7-4957-8906-2588e95ee3e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:40.367478 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2daef-adf7-4957-8906-2588e95ee3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:40.367478 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2daef-adf7-4957-8906-2588e95ee3e1 admin admin] PATH_INFO: `/v3/projects/48518dbb4d334be888e8fb66834043b7/users/03734747015c4c078ceb369a72804b96/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:40.388187 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2daef-adf7-4957-8906-2588e95ee3e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48518dbb4d334be888e8fb66834043b7, user_id=03734747015c4c078ceb369a72804b96, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:40.392383 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2daef-adf7-4957-8906-2588e95ee3e1 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:40.561711 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1538/3063] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:16:40 2022] PUT /identity/v3/projects/48518dbb4d334be888e8fb66834043b7/users/03734747015c4c078ceb369a72804b96/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:16:40.562185 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9949b8-71e2-4a1a-9b33-e447660bb58f admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:40.593616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9949b8-71e2-4a1a-9b33-e447660bb58f admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:40.661827 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2daef-adf7-4957-8906-2588e95ee3e1 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:40.663779 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b1c2daef-adf7-4957-8906-2588e95ee3e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:40.666439 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6cd0f-cd22-4277-b706-5edb133386c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:40.667319 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6cd0f-cd22-4277-b706-5edb133386c2 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:40.667701 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6cd0f-cd22-4277-b706-5edb133386c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:40.668161 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6cd0f-cd22-4277-b706-5edb133386c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:40.669219 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c6cd0f-cd22-4277-b706-5edb133386c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:40.675922 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c6cd0f-cd22-4277-b706-5edb133386c2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:40.684975 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1526/3064] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:16:40.689625 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6cd0f-cd22-4277-b706-5edb133386c2 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:40.708157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2daef-adf7-4957-8906-2588e95ee3e1 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:40.721415 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6cd0f-cd22-4277-b706-5edb133386c2 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:40.727438 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3201efc-0c26-4f21-9f0d-d1ae0d3cf5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:40.728648 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3201efc-0c26-4f21-9f0d-d1ae0d3cf5c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:40.729084 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3201efc-0c26-4f21-9f0d-d1ae0d3cf5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:40.730002 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3201efc-0c26-4f21-9f0d-d1ae0d3cf5c0 admin admin] PATH_INFO: `/v3/users/0927ef875bcf467fa08ff7d44b48f309` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:40.731661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3201efc-0c26-4f21-9f0d-d1ae0d3cf5c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0927ef875bcf467fa08ff7d44b48f309)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:40.735712 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3201efc-0c26-4f21-9f0d-d1ae0d3cf5c0 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:40.736529 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97704870-7c59-46d0-acc3-7e0d647347a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:40.741303 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97704870-7c59-46d0-acc3-7e0d647347a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:40.744288 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97704870-7c59-46d0-acc3-7e0d647347a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:40.744841 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97704870-7c59-46d0-acc3-7e0d647347a8 admin admin] PATH_INFO: `/v3/projects/48518dbb4d334be888e8fb66834043b7/users/03734747015c4c078ceb369a72804b96/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:40.753151 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97704870-7c59-46d0-acc3-7e0d647347a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48518dbb4d334be888e8fb66834043b7, user_id=03734747015c4c078ceb369a72804b96, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:40.760976 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97704870-7c59-46d0-acc3-7e0d647347a8 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:40.800834 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1527/3065] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:16:40 2022] PUT /identity/v3/projects/48518dbb4d334be888e8fb66834043b7/users/03734747015c4c078ceb369a72804b96/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:40.811442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3911065-aae3-4838-9dc3-a9660cd35bf4 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:40.811737 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3911065-aae3-4838-9dc3-a9660cd35bf4 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:40.812020 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3911065-aae3-4838-9dc3-a9660cd35bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:40.850965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-a3911065-aae3-4838-9dc3-a9660cd35bf4 None None] MFA Rules not processed for user `03734747015c4c078ceb369a72804b96`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:40.856234 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a3911065-aae3-4838-9dc3-a9660cd35bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:40.949898 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1528/3066] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:40 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:40.966847 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95014a-4e08-47b7-829e-36a1254998ee None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:40.967146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95014a-4e08-47b7-829e-36a1254998ee None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:40.967434 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95014a-4e08-47b7-829e-36a1254998ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:41.018420 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-9b95014a-4e08-47b7-829e-36a1254998ee None None] MFA Rules not processed for user `0067ff081d1946149db58fd383e81bff`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:41.019736 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9b95014a-4e08-47b7-829e-36a1254998ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:41.090079 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b3201efc-0c26-4f21-9f0d-d1ae0d3cf5c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0927ef875bcf467fa08ff7d44b48f309'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:41.113690 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b3201efc-0c26-4f21-9f0d-d1ae0d3cf5c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0927ef875bcf467fa08ff7d44b48f309'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:41.117594 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1529/3067] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:41.131016 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95014a-4e08-47b7-829e-36a1254998ee None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:41.132735 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9b95014a-4e08-47b7-829e-36a1254998ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:41.235512 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b3201efc-0c26-4f21-9f0d-d1ae0d3cf5c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0927ef875bcf467fa08ff7d44b48f309'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:41.236220 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b3201efc-0c26-4f21-9f0d-d1ae0d3cf5c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0927ef875bcf467fa08ff7d44b48f309'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:41.249353 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b3201efc-0c26-4f21-9f0d-d1ae0d3cf5c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0927ef875bcf467fa08ff7d44b48f309'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:41.250426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95014a-4e08-47b7-829e-36a1254998ee None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:41.256518 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447965df-e37c-4e2d-af4e-1e9cf4a41142 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:41.257186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447965df-e37c-4e2d-af4e-1e9cf4a41142 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:41.260472 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447965df-e37c-4e2d-af4e-1e9cf4a41142 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:41.260472 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447965df-e37c-4e2d-af4e-1e9cf4a41142 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:41.260778 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1539/3068] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:16:40 2022] DELETE /identity/v3/users/0927ef875bcf467fa08ff7d44b48f309 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:16:41.260998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-447965df-e37c-4e2d-af4e-1e9cf4a41142 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:41.262652 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07faf004-864f-4ba1-aecc-72031b8c0b91 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:41.263042 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07faf004-864f-4ba1-aecc-72031b8c0b91 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:41.263719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07faf004-864f-4ba1-aecc-72031b8c0b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:41.282967 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447965df-e37c-4e2d-af4e-1e9cf4a41142 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:41.285566 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447965df-e37c-4e2d-af4e-1e9cf4a41142 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:41.295645 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1530/3069] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:16:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:16:41.298524 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-07faf004-864f-4ba1-aecc-72031b8c0b91 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:41.298524 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-07faf004-864f-4ba1-aecc-72031b8c0b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:41.368099 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ba5c0-071b-4fa7-a1b5-b58cde8510db None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:41.369245 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ba5c0-071b-4fa7-a1b5-b58cde8510db None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:41.369690 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ba5c0-071b-4fa7-a1b5-b58cde8510db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:41.372663 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1540/3070] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:41.396478 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-916ba5c0-071b-4fa7-a1b5-b58cde8510db None None] MFA Rules not processed for user `5df6ea2992c04a97af023bfb428ac44e`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:41.397807 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-916ba5c0-071b-4fa7-a1b5-b58cde8510db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:41.473059 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1531/3071] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:16:41.723132 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07faf004-864f-4ba1-aecc-72031b8c0b91 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:41.725588 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-07faf004-864f-4ba1-aecc-72031b8c0b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:41.837528 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07faf004-864f-4ba1-aecc-72031b8c0b91 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:41.889385 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94665df5-52a7-467d-ba65-915bc638d194 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:41.891287 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94665df5-52a7-467d-ba65-915bc638d194 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:41.899046 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94665df5-52a7-467d-ba65-915bc638d194 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:41.899046 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94665df5-52a7-467d-ba65-915bc638d194 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:41.908589 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94665df5-52a7-467d-ba65-915bc638d194 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:41.911118 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94665df5-52a7-467d-ba65-915bc638d194 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:41.929011 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1541/3072] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:16:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:16:42.572105 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ba5c0-071b-4fa7-a1b5-b58cde8510db None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:42.574126 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-916ba5c0-071b-4fa7-a1b5-b58cde8510db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:42.602138 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ba5c0-071b-4fa7-a1b5-b58cde8510db None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:42.608275 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2af13a-a7df-4c1c-be95-232d78572fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:42.610265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2af13a-a7df-4c1c-be95-232d78572fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:42.610265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2af13a-a7df-4c1c-be95-232d78572fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:42.610663 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2af13a-a7df-4c1c-be95-232d78572fb2 admin admin] PATH_INFO: `/v3/projects/cf92e5aab5164a259043531a9d3ca6d0` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:42.612705 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2af13a-a7df-4c1c-be95-232d78572fb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf92e5aab5164a259043531a9d3ca6d0)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:42.614870 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2af13a-a7df-4c1c-be95-232d78572fb2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:42.829350 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3f2af13a-a7df-4c1c-be95-232d78572fb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf92e5aab5164a259043531a9d3ca6d0', 'request_id': 'req-3f2af13a-a7df-4c1c-be95-232d78572fb2'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:42.854554 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3f2af13a-a7df-4c1c-be95-232d78572fb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf92e5aab5164a259043531a9d3ca6d0', 'request_id': 'req-3f2af13a-a7df-4c1c-be95-232d78572fb2'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:42.865310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3f2af13a-a7df-4c1c-be95-232d78572fb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf92e5aab5164a259043531a9d3ca6d0', 'request_id': 'req-3f2af13a-a7df-4c1c-be95-232d78572fb2'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:42.989853 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3f2af13a-a7df-4c1c-be95-232d78572fb2 admin admin] The token cache is being invalidate because project cf92e5aab5164a259043531a9d3ca6d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:16:42.991463 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3f2af13a-a7df-4c1c-be95-232d78572fb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:42.991463 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3f2af13a-a7df-4c1c-be95-232d78572fb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:42.995239 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1532/3073] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:16:42 2022] DELETE /identity/v3/projects/cf92e5aab5164a259043531a9d3ca6d0 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:42.996507 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94665df5-52a7-467d-ba65-915bc638d194 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:43.016459 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94665df5-52a7-467d-ba65-915bc638d194 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:43.129216 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1289c7f3-1119-409f-a1f1-271a1f3a2363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:43.130221 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289c7f3-1119-409f-a1f1-271a1f3a2363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:43.130508 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289c7f3-1119-409f-a1f1-271a1f3a2363 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:43.131152 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289c7f3-1119-409f-a1f1-271a1f3a2363 admin admin] PATH_INFO: `/v3/users/29bab5abe6264ff499ed4f775ef5acee` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:43.132403 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1289c7f3-1119-409f-a1f1-271a1f3a2363 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29bab5abe6264ff499ed4f775ef5acee)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:43.134740 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1289c7f3-1119-409f-a1f1-271a1f3a2363 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:43.399042 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1289c7f3-1119-409f-a1f1-271a1f3a2363 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29bab5abe6264ff499ed4f775ef5acee'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:43.411571 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1289c7f3-1119-409f-a1f1-271a1f3a2363 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29bab5abe6264ff499ed4f775ef5acee'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:43.532792 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1289c7f3-1119-409f-a1f1-271a1f3a2363 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29bab5abe6264ff499ed4f775ef5acee'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:43.540631 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1289c7f3-1119-409f-a1f1-271a1f3a2363 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29bab5abe6264ff499ed4f775ef5acee'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:43.544077 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1289c7f3-1119-409f-a1f1-271a1f3a2363 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29bab5abe6264ff499ed4f775ef5acee'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:43.558348 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1542/3074] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:16:42 2022] DELETE /identity/v3/users/29bab5abe6264ff499ed4f775ef5acee => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:44.320515 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2af13a-a7df-4c1c-be95-232d78572fb2 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:44.322953 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3f2af13a-a7df-4c1c-be95-232d78572fb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:44.337362 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2af13a-a7df-4c1c-be95-232d78572fb2 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:44.414189 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada1845-bf0d-49de-9cf9-f2b7f02e330b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:44.415342 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada1845-bf0d-49de-9cf9-f2b7f02e330b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:44.415629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada1845-bf0d-49de-9cf9-f2b7f02e330b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:44.415911 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada1845-bf0d-49de-9cf9-f2b7f02e330b admin admin] PATH_INFO: `/v3/projects/f1207102c9ec475daec870dcc3c9d099` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:44.417439 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada1845-bf0d-49de-9cf9-f2b7f02e330b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1207102c9ec475daec870dcc3c9d099)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:44.419617 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada1845-bf0d-49de-9cf9-f2b7f02e330b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:44.556544 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-eada1845-bf0d-49de-9cf9-f2b7f02e330b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1207102c9ec475daec870dcc3c9d099', 'request_id': 'req-eada1845-bf0d-49de-9cf9-f2b7f02e330b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:44.563791 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-eada1845-bf0d-49de-9cf9-f2b7f02e330b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1207102c9ec475daec870dcc3c9d099', 'request_id': 'req-eada1845-bf0d-49de-9cf9-f2b7f02e330b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:44.571192 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-eada1845-bf0d-49de-9cf9-f2b7f02e330b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1207102c9ec475daec870dcc3c9d099', 'request_id': 'req-eada1845-bf0d-49de-9cf9-f2b7f02e330b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:44.687411 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-eada1845-bf0d-49de-9cf9-f2b7f02e330b admin admin] The token cache is being invalidate because project f1207102c9ec475daec870dcc3c9d099 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:16:44.687706 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-eada1845-bf0d-49de-9cf9-f2b7f02e330b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:44.688368 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-eada1845-bf0d-49de-9cf9-f2b7f02e330b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:44.690987 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1533/3075] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:16:44 2022] DELETE /identity/v3/projects/f1207102c9ec475daec870dcc3c9d099 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:44.696169 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae96ab-c0f3-4504-a01d-75711bafeb50 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:44.697308 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae96ab-c0f3-4504-a01d-75711bafeb50 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:44.698228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae96ab-c0f3-4504-a01d-75711bafeb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:44.723825 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-35ae96ab-c0f3-4504-a01d-75711bafeb50 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:44.727278 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-35ae96ab-c0f3-4504-a01d-75711bafeb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:44.865638 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1543/3076] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:44.865864 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a8e75-4127-46bf-b240-683621c940f9 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:44.866022 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a8e75-4127-46bf-b240-683621c940f9 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:44.866651 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a8e75-4127-46bf-b240-683621c940f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:44.900270 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-c87a8e75-4127-46bf-b240-683621c940f9 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:44.904314 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c87a8e75-4127-46bf-b240-683621c940f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:44.924053 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1534/3077] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:16:44.932139 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae96ab-c0f3-4504-a01d-75711bafeb50 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:44.947468 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae96ab-c0f3-4504-a01d-75711bafeb50 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:44.954555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1d8c0-5569-4f80-ae42-e4e1a597ebb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:44.956887 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1d8c0-5569-4f80-ae42-e4e1a597ebb6 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:44.957508 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1d8c0-5569-4f80-ae42-e4e1a597ebb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:44.957967 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1d8c0-5569-4f80-ae42-e4e1a597ebb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:44.959235 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1d8c0-5569-4f80-ae42-e4e1a597ebb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:16:44.959704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1d8c0-5569-4f80-ae42-e4e1a597ebb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:44.962752 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1d8c0-5569-4f80-ae42-e4e1a597ebb6 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:44.981998 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1544/3078] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:16:44.992567 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a8e75-4127-46bf-b240-683621c940f9 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:45.002965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a8e75-4127-46bf-b240-683621c940f9 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:45.008634 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa82125-e6a4-46e6-896a-6a842e40ec43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:45.009536 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa82125-e6a4-46e6-896a-6a842e40ec43 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:45.010016 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa82125-e6a4-46e6-896a-6a842e40ec43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:45.015521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa82125-e6a4-46e6-896a-6a842e40ec43 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:45.015521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa82125-e6a4-46e6-896a-6a842e40ec43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:45.015521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa82125-e6a4-46e6-896a-6a842e40ec43 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:45.107363 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1535/3079] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:16:44 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:16:45.112666 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1d8c0-5569-4f80-ae42-e4e1a597ebb6 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:45.128834 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1d8c0-5569-4f80-ae42-e4e1a597ebb6 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:45.283157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797af049-2454-41c3-a6d1-8e886a63b709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:45.285474 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797af049-2454-41c3-a6d1-8e886a63b709 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:45.285750 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797af049-2454-41c3-a6d1-8e886a63b709 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:45.286052 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797af049-2454-41c3-a6d1-8e886a63b709 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:45.286754 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797af049-2454-41c3-a6d1-8e886a63b709 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:45.288757 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797af049-2454-41c3-a6d1-8e886a63b709 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:45.418448 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1545/3080] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:16:45 2022] POST /identity/v3/users => generated 292 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:16:45.423007 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa82125-e6a4-46e6-896a-6a842e40ec43 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:45.440473 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa82125-e6a4-46e6-896a-6a842e40ec43 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:45.446612 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbebd38-ef80-44e9-97bf-c69f0e281749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:45.447510 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbebd38-ef80-44e9-97bf-c69f0e281749 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:45.447956 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbebd38-ef80-44e9-97bf-c69f0e281749 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:45.448394 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbebd38-ef80-44e9-97bf-c69f0e281749 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:45.449305 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbebd38-ef80-44e9-97bf-c69f0e281749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:45.451492 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbebd38-ef80-44e9-97bf-c69f0e281749 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:45.464479 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1536/3081] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:16:45.469628 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797af049-2454-41c3-a6d1-8e886a63b709 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:45.484676 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797af049-2454-41c3-a6d1-8e886a63b709 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:45.490892 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360642ce-d5f7-4004-beb7-4e64d4ea7501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:45.491837 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360642ce-d5f7-4004-beb7-4e64d4ea7501 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:45.493918 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360642ce-d5f7-4004-beb7-4e64d4ea7501 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:45.494367 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360642ce-d5f7-4004-beb7-4e64d4ea7501 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:45.495817 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360642ce-d5f7-4004-beb7-4e64d4ea7501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:45.500751 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360642ce-d5f7-4004-beb7-4e64d4ea7501 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:45.516332 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1546/3082] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:16:45.520867 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbebd38-ef80-44e9-97bf-c69f0e281749 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:45.537474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbebd38-ef80-44e9-97bf-c69f0e281749 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:45.549666 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71aa6cc-6676-42df-b154-4f12cf4e421e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:45.551074 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71aa6cc-6676-42df-b154-4f12cf4e421e admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:45.551553 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71aa6cc-6676-42df-b154-4f12cf4e421e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:45.552092 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71aa6cc-6676-42df-b154-4f12cf4e421e admin admin] PATH_INFO: `/v3/projects/5782d01316e94d33b40d6d00fd572811/users/435506a91f1a4e4eae6ecdc81c9bec8c/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:45.577681 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71aa6cc-6676-42df-b154-4f12cf4e421e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5782d01316e94d33b40d6d00fd572811, user_id=435506a91f1a4e4eae6ecdc81c9bec8c, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:45.582442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71aa6cc-6676-42df-b154-4f12cf4e421e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:45.692596 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1537/3083] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:16:45 2022] PUT /identity/v3/projects/5782d01316e94d33b40d6d00fd572811/users/435506a91f1a4e4eae6ecdc81c9bec8c/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:45.694160 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4502304-aa4b-4312-8afb-f7a4a759f0a0 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:45.704059 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4502304-aa4b-4312-8afb-f7a4a759f0a0 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:45.704059 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4502304-aa4b-4312-8afb-f7a4a759f0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:45.738886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-c4502304-aa4b-4312-8afb-f7a4a759f0a0 None None] MFA Rules not processed for user `435506a91f1a4e4eae6ecdc81c9bec8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:45.740167 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c4502304-aa4b-4312-8afb-f7a4a759f0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:45.833352 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1547/3084] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:45.837846 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71aa6cc-6676-42df-b154-4f12cf4e421e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:45.938745 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71aa6cc-6676-42df-b154-4f12cf4e421e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:45.951438 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc970106-ca3d-41a8-a376-7bc0cd6ca742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:45.952582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc970106-ca3d-41a8-a376-7bc0cd6ca742 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:45.953049 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc970106-ca3d-41a8-a376-7bc0cd6ca742 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:45.953891 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc970106-ca3d-41a8-a376-7bc0cd6ca742 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:45.954776 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc970106-ca3d-41a8-a376-7bc0cd6ca742 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:45.959479 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc970106-ca3d-41a8-a376-7bc0cd6ca742 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:46.112512 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1538/3085] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:16:45 2022] POST /identity/v3/projects => generated 381 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:16:46.116518 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4502304-aa4b-4312-8afb-f7a4a759f0a0 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:46.132452 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4502304-aa4b-4312-8afb-f7a4a759f0a0 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:46.215249 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578ebd6-6ffa-49c9-8f64-49866321b6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:46.216465 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578ebd6-6ffa-49c9-8f64-49866321b6bc admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:46.216911 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578ebd6-6ffa-49c9-8f64-49866321b6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:46.217352 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578ebd6-6ffa-49c9-8f64-49866321b6bc admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:46.218275 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578ebd6-6ffa-49c9-8f64-49866321b6bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:46.220464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578ebd6-6ffa-49c9-8f64-49866321b6bc admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:46.354846 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1548/3086] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:16:46 2022] POST /identity/v3/users => generated 297 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:16:46.356393 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc970106-ca3d-41a8-a376-7bc0cd6ca742 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:46.383856 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc970106-ca3d-41a8-a376-7bc0cd6ca742 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:46.398687 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b4d8d-bebb-424b-aaaf-9a7074464600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:46.399400 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b4d8d-bebb-424b-aaaf-9a7074464600 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:46.399769 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b4d8d-bebb-424b-aaaf-9a7074464600 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:46.400052 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b4d8d-bebb-424b-aaaf-9a7074464600 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:46.400838 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448b4d8d-bebb-424b-aaaf-9a7074464600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:46.402444 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448b4d8d-bebb-424b-aaaf-9a7074464600 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:46.416138 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1539/3087] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:16:46.420126 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578ebd6-6ffa-49c9-8f64-49866321b6bc admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:46.449318 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578ebd6-6ffa-49c9-8f64-49866321b6bc admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:46.467598 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32746e3d-ce85-49fc-a6be-52d666838030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:46.472114 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32746e3d-ce85-49fc-a6be-52d666838030 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:46.474826 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32746e3d-ce85-49fc-a6be-52d666838030 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:46.475734 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32746e3d-ce85-49fc-a6be-52d666838030 admin admin] PATH_INFO: `/v3/projects/5da5012537c54ba196dc10425d6a8da2/users/a7150ce4da6748d7b5f90ce72a82bae4/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:46.513893 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32746e3d-ce85-49fc-a6be-52d666838030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5da5012537c54ba196dc10425d6a8da2, user_id=a7150ce4da6748d7b5f90ce72a82bae4, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:46.519225 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32746e3d-ce85-49fc-a6be-52d666838030 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:46.618115 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1549/3088] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:16:46 2022] PUT /identity/v3/projects/5da5012537c54ba196dc10425d6a8da2/users/a7150ce4da6748d7b5f90ce72a82bae4/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:46.622321 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b4d8d-bebb-424b-aaaf-9a7074464600 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:46.638924 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b4d8d-bebb-424b-aaaf-9a7074464600 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:46.835669 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde60133-67de-4a15-8e37-07d8fa00aac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:46.836629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde60133-67de-4a15-8e37-07d8fa00aac2 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:46.837070 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde60133-67de-4a15-8e37-07d8fa00aac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:46.837696 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde60133-67de-4a15-8e37-07d8fa00aac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:46.838816 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde60133-67de-4a15-8e37-07d8fa00aac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:46.840833 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde60133-67de-4a15-8e37-07d8fa00aac2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:46.868201 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1540/3089] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:16:46.872193 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32746e3d-ce85-49fc-a6be-52d666838030 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:46.893803 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32746e3d-ce85-49fc-a6be-52d666838030 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:46.910727 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d149b-97de-48f2-9762-2859ab64da02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:46.911678 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d149b-97de-48f2-9762-2859ab64da02 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:46.912030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d149b-97de-48f2-9762-2859ab64da02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:46.912310 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d149b-97de-48f2-9762-2859ab64da02 admin admin] PATH_INFO: `/v3/projects/5da5012537c54ba196dc10425d6a8da2/users/a7150ce4da6748d7b5f90ce72a82bae4/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:46.915854 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d149b-97de-48f2-9762-2859ab64da02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5da5012537c54ba196dc10425d6a8da2, user_id=a7150ce4da6748d7b5f90ce72a82bae4, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:46.918586 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d149b-97de-48f2-9762-2859ab64da02 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:46.946414 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1550/3090] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:16:46 2022] PUT /identity/v3/projects/5da5012537c54ba196dc10425d6a8da2/users/a7150ce4da6748d7b5f90ce72a82bae4/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:46.958326 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f69c14-1e9a-490d-8a46-15f91f5bc5fd None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:46.959774 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f69c14-1e9a-490d-8a46-15f91f5bc5fd None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:46.960271 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f69c14-1e9a-490d-8a46-15f91f5bc5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:47.050569 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-b7f69c14-1e9a-490d-8a46-15f91f5bc5fd None None] MFA Rules not processed for user `a7150ce4da6748d7b5f90ce72a82bae4`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:47.054335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b7f69c14-1e9a-490d-8a46-15f91f5bc5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:47.235287 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1541/3091] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:47.468611 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d149b-97de-48f2-9762-2859ab64da02 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:47.474593 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-eb9d149b-97de-48f2-9762-2859ab64da02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:47.647390 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d149b-97de-48f2-9762-2859ab64da02 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:47.659560 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847aa53-cfb4-4a68-951d-e7bb0e0646ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:47.660378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847aa53-cfb4-4a68-951d-e7bb0e0646ed service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:47.660664 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847aa53-cfb4-4a68-951d-e7bb0e0646ed service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:47.660943 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847aa53-cfb4-4a68-951d-e7bb0e0646ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:47.682501 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b847aa53-cfb4-4a68-951d-e7bb0e0646ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:47.684528 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b847aa53-cfb4-4a68-951d-e7bb0e0646ed service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:47.698141 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1551/3092] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:16:47 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:16:47.726438 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19ac92-01a6-48b6-bcdd-7bc6f9278d73 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:47.727428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19ac92-01a6-48b6-bcdd-7bc6f9278d73 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:47.727929 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19ac92-01a6-48b6-bcdd-7bc6f9278d73 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:47.729743 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1542/3093] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:16:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 21:16:47.744635 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847aa53-cfb4-4a68-951d-e7bb0e0646ed service nova] Authenticating service token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 30 21:16:47.769367 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847aa53-cfb4-4a68-951d-e7bb0e0646ed service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:47.789050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847aa53-cfb4-4a68-951d-e7bb0e0646ed service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:47.800348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abae610-aa19-4772-a9a0-e33075d768dd tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7150ce4da6748d7b5f90ce72a82bae4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da5012537c54ba196dc10425d6a8da2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:47.801221 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abae610-aa19-4772-a9a0-e33075d768dd tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:47.801509 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abae610-aa19-4772-a9a0-e33075d768dd tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:47.801878 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abae610-aa19-4772-a9a0-e33075d768dd tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] PATH_INFO: `/v3/projects/5782d01316e94d33b40d6d00fd572811` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:47.803228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abae610-aa19-4772-a9a0-e33075d768dd tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] RBAC: Authorizing `identity:get_project(project_id=5782d01316e94d33b40d6d00fd572811)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:47.805389 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abae610-aa19-4772-a9a0-e33075d768dd tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:47.807567 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1552/3094] 10.222.0.23 () {58 vars in 1443 bytes} [Sat Apr 30 21:16:47 2022] GET /identity/v3/projects/5782d01316e94d33b40d6d00fd572811 => generated 383 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:16:47.836769 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425b4f2-b59b-420d-9f08-e4bc95f6dffb None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:47.840284 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425b4f2-b59b-420d-9f08-e4bc95f6dffb None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:47.840807 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425b4f2-b59b-420d-9f08-e4bc95f6dffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:47.905511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-2425b4f2-b59b-420d-9f08-e4bc95f6dffb None None] MFA Rules not processed for user `f0c43fdc22254d7f9c5999e044c4f844`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:47.907181 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2425b4f2-b59b-420d-9f08-e4bc95f6dffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:47.913212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6056717-3557-472c-a71c-b1d4dbe9181d None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:47.913953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6056717-3557-472c-a71c-b1d4dbe9181d None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:47.913953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6056717-3557-472c-a71c-b1d4dbe9181d None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:47.920254 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1553/3095] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:16:47 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:16:47.926108 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6056717-3557-472c-a71c-b1d4dbe9181d None None] Authenticating service token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 30 21:16:47.942740 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6056717-3557-472c-a71c-b1d4dbe9181d None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:47.954388 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6056717-3557-472c-a71c-b1d4dbe9181d None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:47.961180 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5511a1-d7e8-4265-a3e9-e3eb91a28c86 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7150ce4da6748d7b5f90ce72a82bae4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da5012537c54ba196dc10425d6a8da2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:47.962079 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5511a1-d7e8-4265-a3e9-e3eb91a28c86 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:47.962369 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5511a1-d7e8-4265-a3e9-e3eb91a28c86 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:47.962642 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5511a1-d7e8-4265-a3e9-e3eb91a28c86 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] PATH_INFO: `/v3/projects/5782d01316e94d33b40d6d00fd572811` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:47.966793 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5511a1-d7e8-4265-a3e9-e3eb91a28c86 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] RBAC: Authorizing `identity:get_project(project_id=5782d01316e94d33b40d6d00fd572811)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:47.969081 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5511a1-d7e8-4265-a3e9-e3eb91a28c86 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:47.978139 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1554/3096] 10.222.0.23 () {58 vars in 1443 bytes} [Sat Apr 30 21:16:47 2022] GET /identity/v3/projects/5782d01316e94d33b40d6d00fd572811 => generated 383 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:16:48.072400 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1543/3097] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:16:48.076605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5511a1-d7e8-4265-a3e9-e3eb91a28c86 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:48.079001 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8c5511a1-d7e8-4265-a3e9-e3eb91a28c86 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:48.170792 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5511a1-d7e8-4265-a3e9-e3eb91a28c86 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:48.182208 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d69a0-2d88-4708-8bfa-67780c577835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:48.182887 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d69a0-2d88-4708-8bfa-67780c577835 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:48.183174 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d69a0-2d88-4708-8bfa-67780c577835 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:48.183451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d69a0-2d88-4708-8bfa-67780c577835 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:48.184516 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1d69a0-2d88-4708-8bfa-67780c577835 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:48.191587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1d69a0-2d88-4708-8bfa-67780c577835 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:48.312052 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1555/3098] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:16:48 2022] POST /identity/v3/projects => generated 379 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:16:48.316920 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425b4f2-b59b-420d-9f08-e4bc95f6dffb None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:48.324435 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33565a81-5901-4164-9d92-f0fe48db670f None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:48.328260 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33565a81-5901-4164-9d92-f0fe48db670f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:48.328260 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33565a81-5901-4164-9d92-f0fe48db670f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:48.330409 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425b4f2-b59b-420d-9f08-e4bc95f6dffb None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:48.364281 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-33565a81-5901-4164-9d92-f0fe48db670f None None] MFA Rules not processed for user `435506a91f1a4e4eae6ecdc81c9bec8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:48.365802 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-33565a81-5901-4164-9d92-f0fe48db670f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:48.430869 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927e691-75ce-4edc-84a1-d9299ac49029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:48.431681 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927e691-75ce-4edc-84a1-d9299ac49029 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:48.432357 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927e691-75ce-4edc-84a1-d9299ac49029 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:48.432993 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927e691-75ce-4edc-84a1-d9299ac49029 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:48.433482 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927e691-75ce-4edc-84a1-d9299ac49029 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:48.436189 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927e691-75ce-4edc-84a1-d9299ac49029 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:48.468825 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1556/3099] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:48.545673 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1544/3100] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:16:48 2022] POST /identity/v3/users => generated 296 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:16:48.546989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33565a81-5901-4164-9d92-f0fe48db670f None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:48.559231 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33565a81-5901-4164-9d92-f0fe48db670f None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:48.566997 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5e625-22f8-48eb-9773-f091e1f4b6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:48.567726 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5e625-22f8-48eb-9773-f091e1f4b6be admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:48.568745 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5e625-22f8-48eb-9773-f091e1f4b6be admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:48.570373 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5e625-22f8-48eb-9773-f091e1f4b6be admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:48.575809 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a5e625-22f8-48eb-9773-f091e1f4b6be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:48.575809 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a5e625-22f8-48eb-9773-f091e1f4b6be admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:48.576734 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927e691-75ce-4edc-84a1-d9299ac49029 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:48.578711 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4927e691-75ce-4edc-84a1-d9299ac49029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:48.588093 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1557/3101] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:16:48.595231 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5e625-22f8-48eb-9773-f091e1f4b6be admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:48.608603 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5e625-22f8-48eb-9773-f091e1f4b6be admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:48.615282 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b2c18-3c90-4ba4-bedf-13e1d913a574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:48.616315 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b2c18-3c90-4ba4-bedf-13e1d913a574 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:48.616702 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b2c18-3c90-4ba4-bedf-13e1d913a574 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:48.617111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b2c18-3c90-4ba4-bedf-13e1d913a574 admin admin] PATH_INFO: `/v3/projects/25711370e9804af8b0f59257b0c23162/users/a64f9942c2914a5c9cc12dbe617ee325/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:48.641261 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b2c18-3c90-4ba4-bedf-13e1d913a574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25711370e9804af8b0f59257b0c23162, user_id=a64f9942c2914a5c9cc12dbe617ee325, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:48.644727 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b2c18-3c90-4ba4-bedf-13e1d913a574 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:48.675639 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927e691-75ce-4edc-84a1-d9299ac49029 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:48.681856 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2027e7d3-0fbc-43c0-91c8-894eea0d73a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:48.682769 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027e7d3-0fbc-43c0-91c8-894eea0d73a1 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:48.683170 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027e7d3-0fbc-43c0-91c8-894eea0d73a1 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:48.688574 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027e7d3-0fbc-43c0-91c8-894eea0d73a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:48.692508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2027e7d3-0fbc-43c0-91c8-894eea0d73a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:48.694310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2027e7d3-0fbc-43c0-91c8-894eea0d73a1 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:48.703426 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1545/3102] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:16:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:16:48.753955 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1558/3103] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:16:48 2022] PUT /identity/v3/projects/25711370e9804af8b0f59257b0c23162/users/a64f9942c2914a5c9cc12dbe617ee325/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:48.757995 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2027e7d3-0fbc-43c0-91c8-894eea0d73a1 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:48.772975 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2027e7d3-0fbc-43c0-91c8-894eea0d73a1 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:48.835606 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14939d29-5a53-4074-9d06-a8815a98b8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:48.836375 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14939d29-5a53-4074-9d06-a8815a98b8cf admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:48.836913 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14939d29-5a53-4074-9d06-a8815a98b8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:48.837270 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14939d29-5a53-4074-9d06-a8815a98b8cf admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:48.838100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14939d29-5a53-4074-9d06-a8815a98b8cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:48.839780 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14939d29-5a53-4074-9d06-a8815a98b8cf admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:48.852657 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1546/3104] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:16:48.856914 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b2c18-3c90-4ba4-bedf-13e1d913a574 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:48.873766 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b2c18-3c90-4ba4-bedf-13e1d913a574 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:48.891442 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20d0c9-5834-41bd-b9e4-76f725938ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:48.893154 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20d0c9-5834-41bd-b9e4-76f725938ab6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:48.893662 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20d0c9-5834-41bd-b9e4-76f725938ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:48.894569 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20d0c9-5834-41bd-b9e4-76f725938ab6 admin admin] PATH_INFO: `/v3/projects/25711370e9804af8b0f59257b0c23162/users/a64f9942c2914a5c9cc12dbe617ee325/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:48.896748 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a20d0c9-5834-41bd-b9e4-76f725938ab6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25711370e9804af8b0f59257b0c23162, user_id=a64f9942c2914a5c9cc12dbe617ee325, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:48.901493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a20d0c9-5834-41bd-b9e4-76f725938ab6 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:48.924791 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1559/3105] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:16:48 2022] PUT /identity/v3/projects/25711370e9804af8b0f59257b0c23162/users/a64f9942c2914a5c9cc12dbe617ee325/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:49.506777 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db9a58-d293-425f-9b95-f13138ca6532 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:49.507933 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db9a58-d293-425f-9b95-f13138ca6532 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:49.508946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db9a58-d293-425f-9b95-f13138ca6532 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:49.510974 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1547/3106] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:16:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:16:49.518457 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20d0c9-5834-41bd-b9e4-76f725938ab6 admin admin] Authenticating service token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 30 21:16:49.626267 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20d0c9-5834-41bd-b9e4-76f725938ab6 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:49.751606 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20d0c9-5834-41bd-b9e4-76f725938ab6 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:49.758955 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1696f2-3a76-4197-a8e0-5177c604dd32 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7150ce4da6748d7b5f90ce72a82bae4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da5012537c54ba196dc10425d6a8da2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:49.762372 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1696f2-3a76-4197-a8e0-5177c604dd32 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:49.778131 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1696f2-3a76-4197-a8e0-5177c604dd32 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:49.778131 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1696f2-3a76-4197-a8e0-5177c604dd32 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] PATH_INFO: `/v3/projects/5782d01316e94d33b40d6d00fd572811` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:49.778131 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1696f2-3a76-4197-a8e0-5177c604dd32 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] RBAC: Authorizing `identity:get_project(project_id=5782d01316e94d33b40d6d00fd572811)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:49.778131 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1696f2-3a76-4197-a8e0-5177c604dd32 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:49.778131 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1560/3107] 10.222.0.23 () {58 vars in 1443 bytes} [Sat Apr 30 21:16:49 2022] GET /identity/v3/projects/5782d01316e94d33b40d6d00fd572811 => generated 383 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:16:50.153569 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983ea4d-2be3-499e-a80e-3d49ba612af8 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:50.155584 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983ea4d-2be3-499e-a80e-3d49ba612af8 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:50.155584 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983ea4d-2be3-499e-a80e-3d49ba612af8 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:50.156028 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1548/3108] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:16:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:16:50.168734 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1696f2-3a76-4197-a8e0-5177c604dd32 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Authenticating service token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 30 21:16:50.217116 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1696f2-3a76-4197-a8e0-5177c604dd32 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:50.235526 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1696f2-3a76-4197-a8e0-5177c604dd32 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:50.245120 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62247516-0d33-4ba4-9c39-2cd18737b20b tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7150ce4da6748d7b5f90ce72a82bae4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da5012537c54ba196dc10425d6a8da2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:50.246274 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62247516-0d33-4ba4-9c39-2cd18737b20b tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:50.246746 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62247516-0d33-4ba4-9c39-2cd18737b20b tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:50.247182 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62247516-0d33-4ba4-9c39-2cd18737b20b tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] PATH_INFO: `/v3/projects/5782d01316e94d33b40d6d00fd572811` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:50.248931 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62247516-0d33-4ba4-9c39-2cd18737b20b tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] RBAC: Authorizing `identity:get_project(project_id=5782d01316e94d33b40d6d00fd572811)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:50.252288 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62247516-0d33-4ba4-9c39-2cd18737b20b tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:50.257024 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1561/3109] 10.222.0.23 () {58 vars in 1443 bytes} [Sat Apr 30 21:16:50 2022] GET /identity/v3/projects/5782d01316e94d33b40d6d00fd572811 => generated 383 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:16:50.455438 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18908928-da30-4ad2-b35e-99822301d5f6 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:50.456212 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18908928-da30-4ad2-b35e-99822301d5f6 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:50.456813 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18908928-da30-4ad2-b35e-99822301d5f6 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:50.458932 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1549/3110] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:16:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:16:50.474215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62247516-0d33-4ba4-9c39-2cd18737b20b tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Authenticating service token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 30 21:16:50.502700 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62247516-0d33-4ba4-9c39-2cd18737b20b tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:50.508498 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18908928-da30-4ad2-b35e-99822301d5f6 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:50.510763 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-18908928-da30-4ad2-b35e-99822301d5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:50.514523 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62247516-0d33-4ba4-9c39-2cd18737b20b tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:50.523245 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeee8e1-3d0c-447c-9fb8-1d1df8b3e0d5 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7150ce4da6748d7b5f90ce72a82bae4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da5012537c54ba196dc10425d6a8da2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:50.524482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeee8e1-3d0c-447c-9fb8-1d1df8b3e0d5 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:50.524991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeee8e1-3d0c-447c-9fb8-1d1df8b3e0d5 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:50.525579 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeee8e1-3d0c-447c-9fb8-1d1df8b3e0d5 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] PATH_INFO: `/v3/projects/5782d01316e94d33b40d6d00fd572811` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:50.530030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeee8e1-3d0c-447c-9fb8-1d1df8b3e0d5 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] RBAC: Authorizing `identity:get_project(project_id=5782d01316e94d33b40d6d00fd572811)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:50.538008 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeee8e1-3d0c-447c-9fb8-1d1df8b3e0d5 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:50.540896 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1562/3111] 10.222.0.23 () {58 vars in 1443 bytes} [Sat Apr 30 21:16:50 2022] GET /identity/v3/projects/5782d01316e94d33b40d6d00fd572811 => generated 383 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:16:50.613815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18908928-da30-4ad2-b35e-99822301d5f6 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:50.618697 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335afb8c-2583-4d92-b0c8-9f60e5f61cc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:50.620982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335afb8c-2583-4d92-b0c8-9f60e5f61cc5 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:50.622128 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335afb8c-2583-4d92-b0c8-9f60e5f61cc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:50.622635 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335afb8c-2583-4d92-b0c8-9f60e5f61cc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:50.624998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-335afb8c-2583-4d92-b0c8-9f60e5f61cc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:50.740410 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3144f8-3676-48f1-a986-32a5a6b5f346 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:50.740744 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3144f8-3676-48f1-a986-32a5a6b5f346 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:50.741360 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3144f8-3676-48f1-a986-32a5a6b5f346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:50.761043 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-2b3144f8-3676-48f1-a986-32a5a6b5f346 None None] MFA Rules not processed for user `435506a91f1a4e4eae6ecdc81c9bec8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:50.762343 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2b3144f8-3676-48f1-a986-32a5a6b5f346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:50.768712 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335afb8c-2583-4d92-b0c8-9f60e5f61cc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:50.770224 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335afb8c-2583-4d92-b0c8-9f60e5f61cc5 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:50.781144 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1550/3112] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:16:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:16:50.826653 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1563/3113] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:16:51.423627 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61036f-f644-4615-9525-7e592c881413 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:51.424609 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61036f-f644-4615-9525-7e592c881413 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:51.424852 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61036f-f644-4615-9525-7e592c881413 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:51.426262 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1551/3114] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:16:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:16:51.432146 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3144f8-3676-48f1-a986-32a5a6b5f346 None None] Authenticating service token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 30 21:16:51.451014 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3144f8-3676-48f1-a986-32a5a6b5f346 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:51.474848 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3144f8-3676-48f1-a986-32a5a6b5f346 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:51.488175 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e076e83-1635-4b19-b56e-58aa208813ec tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7150ce4da6748d7b5f90ce72a82bae4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da5012537c54ba196dc10425d6a8da2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:51.489073 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e076e83-1635-4b19-b56e-58aa208813ec tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:51.489366 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e076e83-1635-4b19-b56e-58aa208813ec tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:51.489650 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e076e83-1635-4b19-b56e-58aa208813ec tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] PATH_INFO: `/v3/projects/5782d01316e94d33b40d6d00fd572811` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:51.492871 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e076e83-1635-4b19-b56e-58aa208813ec tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] RBAC: Authorizing `identity:get_project(project_id=5782d01316e94d33b40d6d00fd572811)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:51.497522 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e076e83-1635-4b19-b56e-58aa208813ec tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:51.504459 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1564/3115] 10.222.0.23 () {58 vars in 1443 bytes} [Sat Apr 30 21:16:51 2022] GET /identity/v3/projects/5782d01316e94d33b40d6d00fd572811 => generated 383 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:16:52.272668 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d926927-631e-473c-a416-bcaef103b6e8 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:52.272947 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d926927-631e-473c-a416-bcaef103b6e8 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:52.273917 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d926927-631e-473c-a416-bcaef103b6e8 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:52.275888 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1552/3116] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:16:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:16:52.283943 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e076e83-1635-4b19-b56e-58aa208813ec tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Authenticating service token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 30 21:16:52.323894 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e076e83-1635-4b19-b56e-58aa208813ec tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:52.334974 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e076e83-1635-4b19-b56e-58aa208813ec tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:52.340093 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4418ec-d22b-4f13-885c-f52f7a3043dc tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7150ce4da6748d7b5f90ce72a82bae4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da5012537c54ba196dc10425d6a8da2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:52.341360 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4418ec-d22b-4f13-885c-f52f7a3043dc tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:52.341722 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4418ec-d22b-4f13-885c-f52f7a3043dc tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:52.342068 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4418ec-d22b-4f13-885c-f52f7a3043dc tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] PATH_INFO: `/v3/projects/5782d01316e94d33b40d6d00fd572811` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:52.343313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4418ec-d22b-4f13-885c-f52f7a3043dc tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] RBAC: Authorizing `identity:get_project(project_id=5782d01316e94d33b40d6d00fd572811)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:52.345379 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4418ec-d22b-4f13-885c-f52f7a3043dc tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:52.347508 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1565/3117] 10.222.0.23 () {58 vars in 1443 bytes} [Sat Apr 30 21:16:52 2022] GET /identity/v3/projects/5782d01316e94d33b40d6d00fd572811 => generated 383 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:16:52.497968 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc23bb-e238-406c-a5c4-67521d2f1654 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:52.497968 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc23bb-e238-406c-a5c4-67521d2f1654 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:52.497968 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc23bb-e238-406c-a5c4-67521d2f1654 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:52.499864 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1553/3118] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:16:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:16:52.505018 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4418ec-d22b-4f13-885c-f52f7a3043dc tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Authenticating service token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 30 21:16:52.521241 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4418ec-d22b-4f13-885c-f52f7a3043dc tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:52.531930 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4418ec-d22b-4f13-885c-f52f7a3043dc tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:52.537949 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d26b8-4b8a-4b55-b91b-e4b271fa37a6 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7150ce4da6748d7b5f90ce72a82bae4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da5012537c54ba196dc10425d6a8da2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:52.539562 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d26b8-4b8a-4b55-b91b-e4b271fa37a6 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:52.540023 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d26b8-4b8a-4b55-b91b-e4b271fa37a6 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:52.540465 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d26b8-4b8a-4b55-b91b-e4b271fa37a6 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] PATH_INFO: `/v3/projects/5782d01316e94d33b40d6d00fd572811` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:52.542036 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d26b8-4b8a-4b55-b91b-e4b271fa37a6 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] RBAC: Authorizing `identity:get_project(project_id=5782d01316e94d33b40d6d00fd572811)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:52.544431 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d26b8-4b8a-4b55-b91b-e4b271fa37a6 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:52.560087 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1566/3119] 10.222.0.23 () {58 vars in 1443 bytes} [Sat Apr 30 21:16:52 2022] GET /identity/v3/projects/5782d01316e94d33b40d6d00fd572811 => generated 383 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:16:52.744228 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c96ed-3e0f-44fc-81c5-09a3bfbb41f6 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:52.744672 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c96ed-3e0f-44fc-81c5-09a3bfbb41f6 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:52.745202 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c96ed-3e0f-44fc-81c5-09a3bfbb41f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:52.795551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-9a1c96ed-3e0f-44fc-81c5-09a3bfbb41f6 None None] MFA Rules not processed for user `435506a91f1a4e4eae6ecdc81c9bec8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:52.796798 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9a1c96ed-3e0f-44fc-81c5-09a3bfbb41f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:52.813344 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1554/3120] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:53.176104 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d26b8-4b8a-4b55-b91b-e4b271fa37a6 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:53.185825 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1f7d26b8-4b8a-4b55-b91b-e4b271fa37a6 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:53.201918 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d26b8-4b8a-4b55-b91b-e4b271fa37a6 tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:53.212122 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff9f98-9018-48bb-9fd1-8256405e0f41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:53.212800 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff9f98-9018-48bb-9fd1-8256405e0f41 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:53.213089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff9f98-9018-48bb-9fd1-8256405e0f41 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:53.213367 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff9f98-9018-48bb-9fd1-8256405e0f41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:53.215697 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c0ff9f98-9018-48bb-9fd1-8256405e0f41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:53.229883 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff9f98-9018-48bb-9fd1-8256405e0f41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:53.231599 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff9f98-9018-48bb-9fd1-8256405e0f41 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:53.248296 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1567/3121] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:16:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:16:53.588469 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c96ed-3e0f-44fc-81c5-09a3bfbb41f6 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:53.590815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9a1c96ed-3e0f-44fc-81c5-09a3bfbb41f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:53.623481 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c96ed-3e0f-44fc-81c5-09a3bfbb41f6 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:53.637241 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d4101-47b6-47d3-9d46-2d858d6896cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:53.638951 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d4101-47b6-47d3-9d46-2d858d6896cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:53.642101 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d4101-47b6-47d3-9d46-2d858d6896cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:53.643110 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d4101-47b6-47d3-9d46-2d858d6896cc admin admin] PATH_INFO: `/v3/users/8bd54cdc115e4ae9b202bd06c7658e4a` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:53.645986 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d4101-47b6-47d3-9d46-2d858d6896cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bd54cdc115e4ae9b202bd06c7658e4a)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:53.647625 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d4101-47b6-47d3-9d46-2d858d6896cc admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:53.886252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3d9d4101-47b6-47d3-9d46-2d858d6896cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bd54cdc115e4ae9b202bd06c7658e4a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:53.915895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3d9d4101-47b6-47d3-9d46-2d858d6896cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bd54cdc115e4ae9b202bd06c7658e4a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:54.056285 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3d9d4101-47b6-47d3-9d46-2d858d6896cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bd54cdc115e4ae9b202bd06c7658e4a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:54.069376 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3d9d4101-47b6-47d3-9d46-2d858d6896cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bd54cdc115e4ae9b202bd06c7658e4a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:54.071623 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3d9d4101-47b6-47d3-9d46-2d858d6896cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bd54cdc115e4ae9b202bd06c7658e4a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:54.104673 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1555/3122] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:16:53 2022] DELETE /identity/v3/users/8bd54cdc115e4ae9b202bd06c7658e4a => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:54.776004 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff9f98-9018-48bb-9fd1-8256405e0f41 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:54.795705 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff9f98-9018-48bb-9fd1-8256405e0f41 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:54.904661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e856a7-348a-4089-89af-2554cde314c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:54.906739 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e856a7-348a-4089-89af-2554cde314c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:54.907311 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e856a7-348a-4089-89af-2554cde314c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:54.908736 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e856a7-348a-4089-89af-2554cde314c8 admin admin] PATH_INFO: `/v3/projects/1a25f2505d5141c5b894bfd6515eb7f0` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:54.911654 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e856a7-348a-4089-89af-2554cde314c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a25f2505d5141c5b894bfd6515eb7f0)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:54.914744 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e856a7-348a-4089-89af-2554cde314c8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:55.077205 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d8cf7-7689-4d1f-b7ed-99c316ab3ea4 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:55.077779 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d8cf7-7689-4d1f-b7ed-99c316ab3ea4 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:55.077912 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d8cf7-7689-4d1f-b7ed-99c316ab3ea4 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:55.079767 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1556/3123] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:16:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 21:16:55.088394 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d8cf7-7689-4d1f-b7ed-99c316ab3ea4 None None] Authenticating service token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 30 21:16:55.090565 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e55d8cf7-7689-4d1f-b7ed-99c316ab3ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:55.129531 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c7e856a7-348a-4089-89af-2554cde314c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a25f2505d5141c5b894bfd6515eb7f0', 'request_id': 'req-c7e856a7-348a-4089-89af-2554cde314c8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:55.142040 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c7e856a7-348a-4089-89af-2554cde314c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a25f2505d5141c5b894bfd6515eb7f0', 'request_id': 'req-c7e856a7-348a-4089-89af-2554cde314c8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:55.151175 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c7e856a7-348a-4089-89af-2554cde314c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a25f2505d5141c5b894bfd6515eb7f0', 'request_id': 'req-c7e856a7-348a-4089-89af-2554cde314c8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:55.234943 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d8cf7-7689-4d1f-b7ed-99c316ab3ea4 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:55.239455 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e55d8cf7-7689-4d1f-b7ed-99c316ab3ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:55.266049 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c7e856a7-348a-4089-89af-2554cde314c8 admin admin] The token cache is being invalidate because project 1a25f2505d5141c5b894bfd6515eb7f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:16:55.266049 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c7e856a7-348a-4089-89af-2554cde314c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:55.266049 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c7e856a7-348a-4089-89af-2554cde314c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:55.266049 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1568/3124] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:16:54 2022] DELETE /identity/v3/projects/1a25f2505d5141c5b894bfd6515eb7f0 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:55.266722 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e856a7-348a-4089-89af-2554cde314c8 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:55.283361 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c7e856a7-348a-4089-89af-2554cde314c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:55.420582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d8cf7-7689-4d1f-b7ed-99c316ab3ea4 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:55.426217 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a99350-f3a7-4b5b-acb3-2e230a0bf6be tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7150ce4da6748d7b5f90ce72a82bae4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5da5012537c54ba196dc10425d6a8da2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:55.427316 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a99350-f3a7-4b5b-acb3-2e230a0bf6be tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:55.427749 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a99350-f3a7-4b5b-acb3-2e230a0bf6be tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:55.428175 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a99350-f3a7-4b5b-acb3-2e230a0bf6be tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] PATH_INFO: `/v3/projects/5782d01316e94d33b40d6d00fd572811` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:55.430252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a99350-f3a7-4b5b-acb3-2e230a0bf6be tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] RBAC: Authorizing `identity:get_project(project_id=5782d01316e94d33b40d6d00fd572811)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:55.435893 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e856a7-348a-4089-89af-2554cde314c8 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:55.436197 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a99350-f3a7-4b5b-acb3-2e230a0bf6be tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:55.437172 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1557/3125] 10.222.0.23 () {58 vars in 1443 bytes} [Sat Apr 30 21:16:55 2022] GET /identity/v3/projects/5782d01316e94d33b40d6d00fd572811 => generated 383 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:16:55.438988 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f4b08-dd12-4240-98a8-223715a31191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:55.440448 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f4b08-dd12-4240-98a8-223715a31191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:55.441107 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f4b08-dd12-4240-98a8-223715a31191 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:55.441391 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f4b08-dd12-4240-98a8-223715a31191 admin admin] PATH_INFO: `/v3/users/9cd670be242d4dcb9f2c064b6e1426f8` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:55.443339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f4b08-dd12-4240-98a8-223715a31191 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cd670be242d4dcb9f2c064b6e1426f8)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:55.445898 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f4b08-dd12-4240-98a8-223715a31191 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:55.737212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d57f4b08-dd12-4240-98a8-223715a31191 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cd670be242d4dcb9f2c064b6e1426f8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:55.751102 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d57f4b08-dd12-4240-98a8-223715a31191 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cd670be242d4dcb9f2c064b6e1426f8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:55.886942 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d57f4b08-dd12-4240-98a8-223715a31191 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cd670be242d4dcb9f2c064b6e1426f8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:55.890958 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d57f4b08-dd12-4240-98a8-223715a31191 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cd670be242d4dcb9f2c064b6e1426f8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:55.899035 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d57f4b08-dd12-4240-98a8-223715a31191 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cd670be242d4dcb9f2c064b6e1426f8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:55.911805 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1569/3126] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:16:55 2022] DELETE /identity/v3/users/9cd670be242d4dcb9f2c064b6e1426f8 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:56.162513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a99350-f3a7-4b5b-acb3-2e230a0bf6be tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:56.166625 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-19a99350-f3a7-4b5b-acb3-2e230a0bf6be tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:56.196015 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f4b08-dd12-4240-98a8-223715a31191 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:56.197859 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d57f4b08-dd12-4240-98a8-223715a31191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:56.238489 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a99350-f3a7-4b5b-acb3-2e230a0bf6be tempest-QuotasAdminNegativeTest-322207435 tempest-QuotasAdminNegativeTest-322207435-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:56.348793 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f4b08-dd12-4240-98a8-223715a31191 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:56.353933 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f52f6d-bd19-4cf1-bfea-b21e4a47ae93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:56.354863 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f52f6d-bd19-4cf1-bfea-b21e4a47ae93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:56.355234 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f52f6d-bd19-4cf1-bfea-b21e4a47ae93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:56.355695 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f52f6d-bd19-4cf1-bfea-b21e4a47ae93 admin admin] PATH_INFO: `/v3/projects/776e7453f0ee411999b5c41374b4975b` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:56.357349 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f52f6d-bd19-4cf1-bfea-b21e4a47ae93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=776e7453f0ee411999b5c41374b4975b)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:56.360570 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f52f6d-bd19-4cf1-bfea-b21e4a47ae93 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:56.373607 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80dcfc-cc48-450e-8873-569ea44dba57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:56.377204 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80dcfc-cc48-450e-8873-569ea44dba57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:56.378186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80dcfc-cc48-450e-8873-569ea44dba57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:56.378516 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80dcfc-cc48-450e-8873-569ea44dba57 admin admin] PATH_INFO: `/v3/users/435506a91f1a4e4eae6ecdc81c9bec8c` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:56.380241 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da80dcfc-cc48-450e-8873-569ea44dba57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=435506a91f1a4e4eae6ecdc81c9bec8c)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:56.402941 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da80dcfc-cc48-450e-8873-569ea44dba57 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:56.640740 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-da80dcfc-cc48-450e-8873-569ea44dba57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '435506a91f1a4e4eae6ecdc81c9bec8c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:56.644392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-55f52f6d-bd19-4cf1-bfea-b21e4a47ae93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '776e7453f0ee411999b5c41374b4975b', 'request_id': 'req-55f52f6d-bd19-4cf1-bfea-b21e4a47ae93'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:56.659189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-55f52f6d-bd19-4cf1-bfea-b21e4a47ae93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '776e7453f0ee411999b5c41374b4975b', 'request_id': 'req-55f52f6d-bd19-4cf1-bfea-b21e4a47ae93'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:56.672285 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-da80dcfc-cc48-450e-8873-569ea44dba57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '435506a91f1a4e4eae6ecdc81c9bec8c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:56.679620 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-55f52f6d-bd19-4cf1-bfea-b21e4a47ae93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '776e7453f0ee411999b5c41374b4975b', 'request_id': 'req-55f52f6d-bd19-4cf1-bfea-b21e4a47ae93'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:56.739022 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-da80dcfc-cc48-450e-8873-569ea44dba57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '435506a91f1a4e4eae6ecdc81c9bec8c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:56.746770 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-da80dcfc-cc48-450e-8873-569ea44dba57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '435506a91f1a4e4eae6ecdc81c9bec8c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:56.749328 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-da80dcfc-cc48-450e-8873-569ea44dba57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '435506a91f1a4e4eae6ecdc81c9bec8c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:56.757623 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1558/3127] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:16:56 2022] DELETE /identity/v3/users/435506a91f1a4e4eae6ecdc81c9bec8c => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:56.774957 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2300f2-a775-40f9-8d64-690b5af533a5 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:56.774957 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2300f2-a775-40f9-8d64-690b5af533a5 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:56.774957 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2300f2-a775-40f9-8d64-690b5af533a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:56.790409 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-cc2300f2-a775-40f9-8d64-690b5af533a5 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:56.791974 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-cc2300f2-a775-40f9-8d64-690b5af533a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:56.826904 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-55f52f6d-bd19-4cf1-bfea-b21e4a47ae93 admin admin] The token cache is being invalidate because project 776e7453f0ee411999b5c41374b4975b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:16:56.827193 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-55f52f6d-bd19-4cf1-bfea-b21e4a47ae93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:56.828899 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-55f52f6d-bd19-4cf1-bfea-b21e4a47ae93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:56.834969 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1570/3128] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:16:56 2022] DELETE /identity/v3/projects/776e7453f0ee411999b5c41374b4975b => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:16:56.836491 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83714b1a-943e-4a6a-ab8d-96baeeb23c23 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:56.836926 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83714b1a-943e-4a6a-ab8d-96baeeb23c23 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:56.837266 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83714b1a-943e-4a6a-ab8d-96baeeb23c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:56.872251 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1559/3129] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:56.874827 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-83714b1a-943e-4a6a-ab8d-96baeeb23c23 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:56.876074 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-83714b1a-943e-4a6a-ab8d-96baeeb23c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:56.884251 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2300f2-a775-40f9-8d64-690b5af533a5 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:56.885840 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-cc2300f2-a775-40f9-8d64-690b5af533a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:56.898592 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1571/3130] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:16:56.908298 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a098c3-2a1f-4e93-af30-17083d4eea5a None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:56.908603 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a098c3-2a1f-4e93-af30-17083d4eea5a None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:56.910914 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a098c3-2a1f-4e93-af30-17083d4eea5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:56.956361 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-b7a098c3-2a1f-4e93-af30-17083d4eea5a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:56.958903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b7a098c3-2a1f-4e93-af30-17083d4eea5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:56.969295 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1572/3131] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:16:56.973630 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a098c3-2a1f-4e93-af30-17083d4eea5a None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:57.003865 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a098c3-2a1f-4e93-af30-17083d4eea5a None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:57.016235 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb972edc-b829-4b3f-a896-1f104fe17891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:57.017920 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb972edc-b829-4b3f-a896-1f104fe17891 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:57.018373 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb972edc-b829-4b3f-a896-1f104fe17891 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:57.018758 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2300f2-a775-40f9-8d64-690b5af533a5 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:57.019454 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb972edc-b829-4b3f-a896-1f104fe17891 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:57.020402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb972edc-b829-4b3f-a896-1f104fe17891 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:16:57.022302 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb972edc-b829-4b3f-a896-1f104fe17891 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:57.025811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb972edc-b829-4b3f-a896-1f104fe17891 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:57.030980 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94860ae7-9c56-4bfc-b18e-79a9800507db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:57.030980 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94860ae7-9c56-4bfc-b18e-79a9800507db service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:57.030980 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94860ae7-9c56-4bfc-b18e-79a9800507db service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:57.031460 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94860ae7-9c56-4bfc-b18e-79a9800507db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:57.043088 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94860ae7-9c56-4bfc-b18e-79a9800507db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:57.044795 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94860ae7-9c56-4bfc-b18e-79a9800507db service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:57.056646 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1573/3132] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:16:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:16:57.061242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb972edc-b829-4b3f-a896-1f104fe17891 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:57.083911 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1560/3133] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:16:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:16:57.085169 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb972edc-b829-4b3f-a896-1f104fe17891 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:57.100265 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f624b-6c51-436b-9a51-f79cc6239692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:57.100997 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f624b-6c51-436b-9a51-f79cc6239692 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:57.101281 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f624b-6c51-436b-9a51-f79cc6239692 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:57.109325 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f624b-6c51-436b-9a51-f79cc6239692 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:57.109325 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2f624b-6c51-436b-9a51-f79cc6239692 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:57.109325 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2f624b-6c51-436b-9a51-f79cc6239692 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:57.233293 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1574/3134] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:16:57 2022] POST /identity/v3/projects => generated 393 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:16:57.235054 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94860ae7-9c56-4bfc-b18e-79a9800507db service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:57.252398 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94860ae7-9c56-4bfc-b18e-79a9800507db service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:57.379793 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9cad19-4350-47b9-874c-78fb1665c705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:57.380640 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9cad19-4350-47b9-874c-78fb1665c705 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:57.380992 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9cad19-4350-47b9-874c-78fb1665c705 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:57.381368 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9cad19-4350-47b9-874c-78fb1665c705 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:57.382233 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9cad19-4350-47b9-874c-78fb1665c705 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:57.386238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9cad19-4350-47b9-874c-78fb1665c705 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:57.532899 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1561/3135] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:16:57 2022] POST /identity/v3/users => generated 297 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:16:57.540718 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f624b-6c51-436b-9a51-f79cc6239692 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:57.611356 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f624b-6c51-436b-9a51-f79cc6239692 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:57.629956 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3939ecb-67d2-4b8e-82d3-f8a80a1b4eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:57.638186 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3939ecb-67d2-4b8e-82d3-f8a80a1b4eee admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:57.638698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3939ecb-67d2-4b8e-82d3-f8a80a1b4eee admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:57.639205 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3939ecb-67d2-4b8e-82d3-f8a80a1b4eee admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:57.640532 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3939ecb-67d2-4b8e-82d3-f8a80a1b4eee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:57.643621 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3939ecb-67d2-4b8e-82d3-f8a80a1b4eee admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:57.660043 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1575/3136] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:16:57.669525 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9cad19-4350-47b9-874c-78fb1665c705 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:57.680948 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9cad19-4350-47b9-874c-78fb1665c705 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:57.688319 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263b7b4-b91e-46a2-a98a-b3a3cda5192c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:57.689780 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263b7b4-b91e-46a2-a98a-b3a3cda5192c admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:57.690325 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263b7b4-b91e-46a2-a98a-b3a3cda5192c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:57.690823 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263b7b4-b91e-46a2-a98a-b3a3cda5192c admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:57.692414 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5263b7b4-b91e-46a2-a98a-b3a3cda5192c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:57.694512 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5263b7b4-b91e-46a2-a98a-b3a3cda5192c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:57.706127 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3939ecb-67d2-4b8e-82d3-f8a80a1b4eee admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:57.713304 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d3939ecb-67d2-4b8e-82d3-f8a80a1b4eee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:57.729585 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1562/3137] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:16:57.737732 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263b7b4-b91e-46a2-a98a-b3a3cda5192c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:57.760117 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263b7b4-b91e-46a2-a98a-b3a3cda5192c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:57.772750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac90c6-849d-43ed-86dd-c1c3ddb8a8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:57.772750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac90c6-849d-43ed-86dd-c1c3ddb8a8ed admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:57.772750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac90c6-849d-43ed-86dd-c1c3ddb8a8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:57.773120 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac90c6-849d-43ed-86dd-c1c3ddb8a8ed admin admin] PATH_INFO: `/v3/projects/246c0a9cc007483ab7bd3cd40249f291/users/1886e7319ac64348a1b019b9329a92de/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:57.773498 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3939ecb-67d2-4b8e-82d3-f8a80a1b4eee admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:57.789800 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee10d7-1087-48f3-95f7-a7e5152110a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:57.791086 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee10d7-1087-48f3-95f7-a7e5152110a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:57.792900 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee10d7-1087-48f3-95f7-a7e5152110a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:57.792900 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee10d7-1087-48f3-95f7-a7e5152110a0 admin admin] PATH_INFO: `/v3/projects/5782d01316e94d33b40d6d00fd572811` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:57.795654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac90c6-849d-43ed-86dd-c1c3ddb8a8ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=246c0a9cc007483ab7bd3cd40249f291, user_id=1886e7319ac64348a1b019b9329a92de, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:57.796717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee10d7-1087-48f3-95f7-a7e5152110a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5782d01316e94d33b40d6d00fd572811)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:57.800739 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac90c6-849d-43ed-86dd-c1c3ddb8a8ed admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:57.801887 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee10d7-1087-48f3-95f7-a7e5152110a0 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:57.956790 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1563/3138] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:16:57 2022] PUT /identity/v3/projects/246c0a9cc007483ab7bd3cd40249f291/users/1886e7319ac64348a1b019b9329a92de/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:57.967253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e251df2-a4d1-40b8-a2a2-2d38b7557f2d None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:57.970034 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e251df2-a4d1-40b8-a2a2-2d38b7557f2d None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:57.971109 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e251df2-a4d1-40b8-a2a2-2d38b7557f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:58.010428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-2e251df2-a4d1-40b8-a2a2-2d38b7557f2d None None] MFA Rules not processed for user `1886e7319ac64348a1b019b9329a92de`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:58.011939 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2e251df2-a4d1-40b8-a2a2-2d38b7557f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:58.057278 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-15ee10d7-1087-48f3-95f7-a7e5152110a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5782d01316e94d33b40d6d00fd572811', 'request_id': 'req-15ee10d7-1087-48f3-95f7-a7e5152110a0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:58.087656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-15ee10d7-1087-48f3-95f7-a7e5152110a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5782d01316e94d33b40d6d00fd572811', 'request_id': 'req-15ee10d7-1087-48f3-95f7-a7e5152110a0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:58.099015 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-15ee10d7-1087-48f3-95f7-a7e5152110a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5782d01316e94d33b40d6d00fd572811', 'request_id': 'req-15ee10d7-1087-48f3-95f7-a7e5152110a0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:58.147819 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1564/3139] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:58.158242 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e251df2-a4d1-40b8-a2a2-2d38b7557f2d None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:58.183012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-15ee10d7-1087-48f3-95f7-a7e5152110a0 admin admin] The token cache is being invalidate because project 5782d01316e94d33b40d6d00fd572811 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:16:58.183583 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-15ee10d7-1087-48f3-95f7-a7e5152110a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:58.185943 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-15ee10d7-1087-48f3-95f7-a7e5152110a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:58.190487 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1576/3140] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:16:57 2022] DELETE /identity/v3/projects/5782d01316e94d33b40d6d00fd572811 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:58.195944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee10d7-1087-48f3-95f7-a7e5152110a0 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:58.200737 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-15ee10d7-1087-48f3-95f7-a7e5152110a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:58.276351 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e251df2-a4d1-40b8-a2a2-2d38b7557f2d None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:58.293053 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb45fa-9735-42e6-bf44-4579eede75f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:58.293728 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb45fa-9735-42e6-bf44-4579eede75f8 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:58.294044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb45fa-9735-42e6-bf44-4579eede75f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:58.294325 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb45fa-9735-42e6-bf44-4579eede75f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:58.295022 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb45fa-9735-42e6-bf44-4579eede75f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:58.296981 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb45fa-9735-42e6-bf44-4579eede75f8 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:58.382373 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee10d7-1087-48f3-95f7-a7e5152110a0 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:58.400644 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be154af6-8930-4f31-b323-b0db28cdaee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:58.401563 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be154af6-8930-4f31-b323-b0db28cdaee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:58.401935 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be154af6-8930-4f31-b323-b0db28cdaee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:58.402301 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be154af6-8930-4f31-b323-b0db28cdaee4 admin admin] PATH_INFO: `/v3/users/a7150ce4da6748d7b5f90ce72a82bae4` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:58.403661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be154af6-8930-4f31-b323-b0db28cdaee4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7150ce4da6748d7b5f90ce72a82bae4)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:58.406947 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be154af6-8930-4f31-b323-b0db28cdaee4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:58.429247 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1565/3141] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:16:58 2022] POST /identity/v3/projects => generated 393 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:16:58.430425 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb45fa-9735-42e6-bf44-4579eede75f8 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:58.435934 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-09cb45fa-9735-42e6-bf44-4579eede75f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:58.616337 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb45fa-9735-42e6-bf44-4579eede75f8 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:58.621603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf51b7-2d4c-4a59-a576-1544446898a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:58.622541 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf51b7-2d4c-4a59-a576-1544446898a9 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:58.623295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf51b7-2d4c-4a59-a576-1544446898a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:58.623578 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf51b7-2d4c-4a59-a576-1544446898a9 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:58.624448 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf51b7-2d4c-4a59-a576-1544446898a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:58.627215 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf51b7-2d4c-4a59-a576-1544446898a9 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:58.674362 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-be154af6-8930-4f31-b323-b0db28cdaee4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7150ce4da6748d7b5f90ce72a82bae4'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:58.694676 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-be154af6-8930-4f31-b323-b0db28cdaee4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7150ce4da6748d7b5f90ce72a82bae4'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:58.749743 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1566/3142] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:16:58 2022] POST /identity/v3/users => generated 303 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:16:58.753914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf51b7-2d4c-4a59-a576-1544446898a9 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:58.769426 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-be154af6-8930-4f31-b323-b0db28cdaee4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7150ce4da6748d7b5f90ce72a82bae4'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:58.770387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-be154af6-8930-4f31-b323-b0db28cdaee4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7150ce4da6748d7b5f90ce72a82bae4'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:58.794383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf51b7-2d4c-4a59-a576-1544446898a9 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:58.800100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-be154af6-8930-4f31-b323-b0db28cdaee4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7150ce4da6748d7b5f90ce72a82bae4'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:16:58.811565 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1577/3143] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:16:58 2022] DELETE /identity/v3/users/a7150ce4da6748d7b5f90ce72a82bae4 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:58.816891 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7cc580-9d14-45ab-b9fa-8c4ea342128c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:58.818327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7cc580-9d14-45ab-b9fa-8c4ea342128c admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:58.819505 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7cc580-9d14-45ab-b9fa-8c4ea342128c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:58.820169 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7cc580-9d14-45ab-b9fa-8c4ea342128c admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:58.821450 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7cc580-9d14-45ab-b9fa-8c4ea342128c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:58.823427 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7cc580-9d14-45ab-b9fa-8c4ea342128c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:58.856618 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1567/3144] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:16:58.861640 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be154af6-8930-4f31-b323-b0db28cdaee4 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:58.863362 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-be154af6-8930-4f31-b323-b0db28cdaee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:59.044059 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be154af6-8930-4f31-b323-b0db28cdaee4 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:59.051739 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4af80c-fbd3-48fe-af25-4f21b3b6b075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:59.053308 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4af80c-fbd3-48fe-af25-4f21b3b6b075 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:59.053799 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4af80c-fbd3-48fe-af25-4f21b3b6b075 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:59.054250 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4af80c-fbd3-48fe-af25-4f21b3b6b075 admin admin] PATH_INFO: `/v3/projects/07454c56f64844ddaa569ae7058349ec/users/0a5faa83cd3c400799d4bb1137fda749/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:59.081013 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4af80c-fbd3-48fe-af25-4f21b3b6b075 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07454c56f64844ddaa569ae7058349ec, user_id=0a5faa83cd3c400799d4bb1137fda749, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:59.084967 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4af80c-fbd3-48fe-af25-4f21b3b6b075 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:59.199686 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1578/3145] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:16:58 2022] PUT /identity/v3/projects/07454c56f64844ddaa569ae7058349ec/users/0a5faa83cd3c400799d4bb1137fda749/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:59.203612 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7cc580-9d14-45ab-b9fa-8c4ea342128c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:59.226903 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7cc580-9d14-45ab-b9fa-8c4ea342128c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:59.381026 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50194708-a6a2-4f6a-9929-64bfcf8f6294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:59.382626 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50194708-a6a2-4f6a-9929-64bfcf8f6294 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:59.383281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50194708-a6a2-4f6a-9929-64bfcf8f6294 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:59.383969 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50194708-a6a2-4f6a-9929-64bfcf8f6294 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:59.385025 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50194708-a6a2-4f6a-9929-64bfcf8f6294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:59.387072 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50194708-a6a2-4f6a-9929-64bfcf8f6294 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:59.420106 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1568/3146] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:16:59.421360 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4af80c-fbd3-48fe-af25-4f21b3b6b075 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:59.443967 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4af80c-fbd3-48fe-af25-4f21b3b6b075 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:16:59.455940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43623d8-06f3-434f-aaaf-35305f1f2366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:16:59.456863 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43623d8-06f3-434f-aaaf-35305f1f2366 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:59.457149 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43623d8-06f3-434f-aaaf-35305f1f2366 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:59.457422 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43623d8-06f3-434f-aaaf-35305f1f2366 admin admin] PATH_INFO: `/v3/projects/07454c56f64844ddaa569ae7058349ec/users/0a5faa83cd3c400799d4bb1137fda749/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:59.460161 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43623d8-06f3-434f-aaaf-35305f1f2366 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07454c56f64844ddaa569ae7058349ec, user_id=0a5faa83cd3c400799d4bb1137fda749, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:16:59.462940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43623d8-06f3-434f-aaaf-35305f1f2366 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:16:59.513092 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1579/3147] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:16:59 2022] PUT /identity/v3/projects/07454c56f64844ddaa569ae7058349ec/users/0a5faa83cd3c400799d4bb1137fda749/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:16:59.518987 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbdaa8-17f1-49c1-94d0-10a20cb57aa8 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:59.519280 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbdaa8-17f1-49c1-94d0-10a20cb57aa8 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:59.519566 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbdaa8-17f1-49c1-94d0-10a20cb57aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:59.601401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-c7bbdaa8-17f1-49c1-94d0-10a20cb57aa8 None None] MFA Rules not processed for user `0a5faa83cd3c400799d4bb1137fda749`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:59.602979 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c7bbdaa8-17f1-49c1-94d0-10a20cb57aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:59.751233 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1569/3148] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:59 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:59.764880 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365eeab2-62d5-4c10-8da6-5980c9e902fb None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:16:59.770414 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365eeab2-62d5-4c10-8da6-5980c9e902fb None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:16:59.771377 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365eeab2-62d5-4c10-8da6-5980c9e902fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:16:59.821523 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-365eeab2-62d5-4c10-8da6-5980c9e902fb None None] MFA Rules not processed for user `1886e7319ac64348a1b019b9329a92de`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:16:59.823549 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-365eeab2-62d5-4c10-8da6-5980c9e902fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:16:59.911823 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1580/3149] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:16:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:16:59.972815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbdaa8-17f1-49c1-94d0-10a20cb57aa8 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:16:59.974399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c7bbdaa8-17f1-49c1-94d0-10a20cb57aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:00.067268 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365eeab2-62d5-4c10-8da6-5980c9e902fb None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:00.069162 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-365eeab2-62d5-4c10-8da6-5980c9e902fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:00.169014 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbdaa8-17f1-49c1-94d0-10a20cb57aa8 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:00.194711 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699292c-2a2c-4ba6-89fc-928c39313d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:00.195686 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699292c-2a2c-4ba6-89fc-928c39313d94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:00.196069 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699292c-2a2c-4ba6-89fc-928c39313d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:00.196460 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699292c-2a2c-4ba6-89fc-928c39313d94 admin admin] PATH_INFO: `/v3/projects/5da5012537c54ba196dc10425d6a8da2` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:00.206712 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699292c-2a2c-4ba6-89fc-928c39313d94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5da5012537c54ba196dc10425d6a8da2)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:00.214296 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699292c-2a2c-4ba6-89fc-928c39313d94 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:00.236502 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365eeab2-62d5-4c10-8da6-5980c9e902fb None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:00.256240 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f039e1c-35f1-4485-99be-d584d0764d94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:00.257059 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f039e1c-35f1-4485-99be-d584d0764d94 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:00.257345 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f039e1c-35f1-4485-99be-d584d0764d94 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:00.257620 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f039e1c-35f1-4485-99be-d584d0764d94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:00.259546 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7f039e1c-35f1-4485-99be-d584d0764d94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:00.284199 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f039e1c-35f1-4485-99be-d584d0764d94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:00.286846 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f039e1c-35f1-4485-99be-d584d0764d94 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:00.309391 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1581/3150] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:17:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:17:00.413440 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b699292c-2a2c-4ba6-89fc-928c39313d94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5da5012537c54ba196dc10425d6a8da2', 'request_id': 'req-b699292c-2a2c-4ba6-89fc-928c39313d94'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:00.421109 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b699292c-2a2c-4ba6-89fc-928c39313d94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5da5012537c54ba196dc10425d6a8da2', 'request_id': 'req-b699292c-2a2c-4ba6-89fc-928c39313d94'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:00.431844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b699292c-2a2c-4ba6-89fc-928c39313d94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5da5012537c54ba196dc10425d6a8da2', 'request_id': 'req-b699292c-2a2c-4ba6-89fc-928c39313d94'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:00.522853 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b699292c-2a2c-4ba6-89fc-928c39313d94 admin admin] The token cache is being invalidate because project 5da5012537c54ba196dc10425d6a8da2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:17:00.523766 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b699292c-2a2c-4ba6-89fc-928c39313d94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:00.524583 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b699292c-2a2c-4ba6-89fc-928c39313d94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:00.533845 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1570/3151] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:16:59 2022] DELETE /identity/v3/projects/5da5012537c54ba196dc10425d6a8da2 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:17:00.534932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bc43e-fb5f-49af-89bb-bef119e01dcc None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:00.535228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bc43e-fb5f-49af-89bb-bef119e01dcc None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:00.535505 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bc43e-fb5f-49af-89bb-bef119e01dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:00.559625 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-6c0bc43e-fb5f-49af-89bb-bef119e01dcc None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:00.561251 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6c0bc43e-fb5f-49af-89bb-bef119e01dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:00.643056 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1582/3152] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:17:00.651412 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad4620-b719-421b-9705-1e037c108717 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:00.651700 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad4620-b719-421b-9705-1e037c108717 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:00.651983 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad4620-b719-421b-9705-1e037c108717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:00.705876 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-82ad4620-b719-421b-9705-1e037c108717 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:00.707501 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-82ad4620-b719-421b-9705-1e037c108717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:00.726449 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1571/3153] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:17:00.730698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0bc43e-fb5f-49af-89bb-bef119e01dcc None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:00.747230 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0bc43e-fb5f-49af-89bb-bef119e01dcc None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:00.786163 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988fcd22-ae5b-4edf-af5b-e09d79727fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:00.788725 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fcd22-ae5b-4edf-af5b-e09d79727fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:00.789284 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fcd22-ae5b-4edf-af5b-e09d79727fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:00.789670 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fcd22-ae5b-4edf-af5b-e09d79727fe2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:00.793481 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988fcd22-ae5b-4edf-af5b-e09d79727fe2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:17:00.794088 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988fcd22-ae5b-4edf-af5b-e09d79727fe2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:00.797749 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988fcd22-ae5b-4edf-af5b-e09d79727fe2 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:00.825157 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1583/3154] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:17:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:17:00.827169 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad4620-b719-421b-9705-1e037c108717 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:00.843754 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad4620-b719-421b-9705-1e037c108717 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:00.854996 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9fd4d-f5b4-4ed7-a07d-e1714c0efe8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:00.855891 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9fd4d-f5b4-4ed7-a07d-e1714c0efe8a admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:00.856245 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9fd4d-f5b4-4ed7-a07d-e1714c0efe8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:00.856592 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9fd4d-f5b4-4ed7-a07d-e1714c0efe8a admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:00.857952 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9fd4d-f5b4-4ed7-a07d-e1714c0efe8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:00.863679 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9fd4d-f5b4-4ed7-a07d-e1714c0efe8a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:01.019964 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1572/3155] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:17:00 2022] POST /identity/v3/projects => generated 389 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:17:01.022849 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988fcd22-ae5b-4edf-af5b-e09d79727fe2 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:01.038612 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988fcd22-ae5b-4edf-af5b-e09d79727fe2 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:01.194033 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee937945-9bfa-4d2e-ba0a-80728bd70a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:01.194736 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee937945-9bfa-4d2e-ba0a-80728bd70a71 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:01.195022 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee937945-9bfa-4d2e-ba0a-80728bd70a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:01.195302 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee937945-9bfa-4d2e-ba0a-80728bd70a71 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:01.196001 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee937945-9bfa-4d2e-ba0a-80728bd70a71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:01.209881 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee937945-9bfa-4d2e-ba0a-80728bd70a71 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:01.346633 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1584/3156] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:17:01 2022] POST /identity/v3/users => generated 295 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:17:01.351889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9fd4d-f5b4-4ed7-a07d-e1714c0efe8a admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:01.369666 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9fd4d-f5b4-4ed7-a07d-e1714c0efe8a admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:01.400576 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d2a24-2280-4a52-b62f-60341d80d57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:01.401510 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d2a24-2280-4a52-b62f-60341d80d57e admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:01.402709 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d2a24-2280-4a52-b62f-60341d80d57e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:01.403443 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d2a24-2280-4a52-b62f-60341d80d57e admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:01.404398 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956d2a24-2280-4a52-b62f-60341d80d57e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:01.409470 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956d2a24-2280-4a52-b62f-60341d80d57e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:01.444829 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1573/3157] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:17:01.446560 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee937945-9bfa-4d2e-ba0a-80728bd70a71 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:01.467924 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee937945-9bfa-4d2e-ba0a-80728bd70a71 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:01.480714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a9cc7-f807-4133-9196-a33d3ad06504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:01.483339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a9cc7-f807-4133-9196-a33d3ad06504 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:01.483933 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a9cc7-f807-4133-9196-a33d3ad06504 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:01.485240 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a9cc7-f807-4133-9196-a33d3ad06504 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:01.486879 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a9cc7-f807-4133-9196-a33d3ad06504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:01.493311 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a9cc7-f807-4133-9196-a33d3ad06504 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:01.531130 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1585/3158] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:17:01.531713 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d2a24-2280-4a52-b62f-60341d80d57e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:01.546657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d2a24-2280-4a52-b62f-60341d80d57e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:01.557961 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c50596-2213-4ad9-9905-6f91de83fd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:01.559394 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c50596-2213-4ad9-9905-6f91de83fd9e admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:01.559835 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c50596-2213-4ad9-9905-6f91de83fd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:01.560280 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c50596-2213-4ad9-9905-6f91de83fd9e admin admin] PATH_INFO: `/v3/projects/a5f1dfb583df447096024572a27dc5cf/users/3c1807db50564832a0c8df860642e3d1/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:01.602552 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c50596-2213-4ad9-9905-6f91de83fd9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5f1dfb583df447096024572a27dc5cf, user_id=3c1807db50564832a0c8df860642e3d1, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:01.606012 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c50596-2213-4ad9-9905-6f91de83fd9e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:01.729825 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1574/3159] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:17:01 2022] PUT /identity/v3/projects/a5f1dfb583df447096024572a27dc5cf/users/3c1807db50564832a0c8df860642e3d1/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:17:01.733024 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590cb0f-ebfd-4104-95f6-30b7f07cf9ad None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:01.733318 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590cb0f-ebfd-4104-95f6-30b7f07cf9ad None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:01.733596 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590cb0f-ebfd-4104-95f6-30b7f07cf9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:01.791831 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-e590cb0f-ebfd-4104-95f6-30b7f07cf9ad None None] MFA Rules not processed for user `3c1807db50564832a0c8df860642e3d1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:01.793534 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e590cb0f-ebfd-4104-95f6-30b7f07cf9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:01.958859 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1586/3160] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:17:01.966057 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c50596-2213-4ad9-9905-6f91de83fd9e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:02.107199 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c50596-2213-4ad9-9905-6f91de83fd9e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:02.113983 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d76ad9c-7276-42e8-ae38-2b9deabdb598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:02.115137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76ad9c-7276-42e8-ae38-2b9deabdb598 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:02.115663 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76ad9c-7276-42e8-ae38-2b9deabdb598 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:02.115947 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76ad9c-7276-42e8-ae38-2b9deabdb598 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:02.116898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d76ad9c-7276-42e8-ae38-2b9deabdb598 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:02.119784 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d76ad9c-7276-42e8-ae38-2b9deabdb598 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:02.270842 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1575/3161] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:17:01 2022] POST /identity/v3/projects => generated 391 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:17:02.277433 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590cb0f-ebfd-4104-95f6-30b7f07cf9ad None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:02.310891 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590cb0f-ebfd-4104-95f6-30b7f07cf9ad None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:02.387492 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae50eb7-e064-4c08-8c18-82a4362190c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:02.397397 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae50eb7-e064-4c08-8c18-82a4362190c2 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:02.397397 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae50eb7-e064-4c08-8c18-82a4362190c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:02.397397 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae50eb7-e064-4c08-8c18-82a4362190c2 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:02.397397 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae50eb7-e064-4c08-8c18-82a4362190c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:02.397397 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae50eb7-e064-4c08-8c18-82a4362190c2 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:02.481232 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1587/3162] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:17:02 2022] POST /identity/v3/users => generated 302 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:17:02.485158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d76ad9c-7276-42e8-ae38-2b9deabdb598 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:02.499102 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d76ad9c-7276-42e8-ae38-2b9deabdb598 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:02.504765 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b0490-a1d8-4111-9941-91d23209b24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:02.506085 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b0490-a1d8-4111-9941-91d23209b24c admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:02.506974 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b0490-a1d8-4111-9941-91d23209b24c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:02.507428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b0490-a1d8-4111-9941-91d23209b24c admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:02.508800 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7b0490-a1d8-4111-9941-91d23209b24c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:02.511227 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7b0490-a1d8-4111-9941-91d23209b24c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:02.523538 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1576/3163] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:17:02.532783 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae50eb7-e064-4c08-8c18-82a4362190c2 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:02.543218 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae50eb7-e064-4c08-8c18-82a4362190c2 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:02.548674 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ce6f3-32db-4529-8855-68e1fa7a76c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:02.549642 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ce6f3-32db-4529-8855-68e1fa7a76c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:02.550024 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ce6f3-32db-4529-8855-68e1fa7a76c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:02.550368 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ce6f3-32db-4529-8855-68e1fa7a76c4 admin admin] PATH_INFO: `/v3/projects/7b08617ff8814408b9c3347beacc6c7a/users/d431f3a35a6f4be8bdc01964913efa84/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:02.566695 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ce6f3-32db-4529-8855-68e1fa7a76c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b08617ff8814408b9c3347beacc6c7a, user_id=d431f3a35a6f4be8bdc01964913efa84, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:02.569524 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ce6f3-32db-4529-8855-68e1fa7a76c4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:02.644014 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1588/3164] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:17:02 2022] PUT /identity/v3/projects/7b08617ff8814408b9c3347beacc6c7a/users/d431f3a35a6f4be8bdc01964913efa84/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:17:02.648259 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b0490-a1d8-4111-9941-91d23209b24c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:02.668322 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b0490-a1d8-4111-9941-91d23209b24c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:02.779129 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f508b5-d66d-41a2-9d34-b727ba102d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:02.780004 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f508b5-d66d-41a2-9d34-b727ba102d28 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:02.780296 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f508b5-d66d-41a2-9d34-b727ba102d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:02.780573 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f508b5-d66d-41a2-9d34-b727ba102d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:02.781469 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f508b5-d66d-41a2-9d34-b727ba102d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:02.783672 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f508b5-d66d-41a2-9d34-b727ba102d28 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:02.800779 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1577/3165] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:17:02.801972 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ce6f3-32db-4529-8855-68e1fa7a76c4 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:02.826850 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ce6f3-32db-4529-8855-68e1fa7a76c4 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:02.840236 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3abdd8-6cd5-4819-9c0f-8b5bd018a559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:02.840236 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3abdd8-6cd5-4819-9c0f-8b5bd018a559 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:02.840236 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3abdd8-6cd5-4819-9c0f-8b5bd018a559 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:02.840236 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3abdd8-6cd5-4819-9c0f-8b5bd018a559 admin admin] PATH_INFO: `/v3/projects/7b08617ff8814408b9c3347beacc6c7a/users/d431f3a35a6f4be8bdc01964913efa84/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:02.840620 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3abdd8-6cd5-4819-9c0f-8b5bd018a559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b08617ff8814408b9c3347beacc6c7a, user_id=d431f3a35a6f4be8bdc01964913efa84, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:02.842987 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3abdd8-6cd5-4819-9c0f-8b5bd018a559 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:02.858034 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1589/3166] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:17:02 2022] PUT /identity/v3/projects/7b08617ff8814408b9c3347beacc6c7a/users/d431f3a35a6f4be8bdc01964913efa84/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:17:02.867003 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb017e-f181-4b5c-816e-f2a242067326 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:02.868897 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb017e-f181-4b5c-816e-f2a242067326 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:02.868897 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb017e-f181-4b5c-816e-f2a242067326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:02.910640 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-ecbb017e-f181-4b5c-816e-f2a242067326 None None] MFA Rules not processed for user `d431f3a35a6f4be8bdc01964913efa84`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:02.911875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ecbb017e-f181-4b5c-816e-f2a242067326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:02.967841 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e507d-2f8f-4294-b993-d66b7250967e None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:02.968130 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e507d-2f8f-4294-b993-d66b7250967e None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:02.968775 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e507d-2f8f-4294-b993-d66b7250967e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:03.040363 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-642e507d-2f8f-4294-b993-d66b7250967e None None] MFA Rules not processed for user `a64f9942c2914a5c9cc12dbe617ee325`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:03.044681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-642e507d-2f8f-4294-b993-d66b7250967e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:03.077484 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1578/3167] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:02 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:17:03.090007 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb017e-f181-4b5c-816e-f2a242067326 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:03.092246 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ecbb017e-f181-4b5c-816e-f2a242067326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:03.178603 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1590/3168] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:02 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:17:03.191165 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e507d-2f8f-4294-b993-d66b7250967e None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:03.193861 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-642e507d-2f8f-4294-b993-d66b7250967e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:03.214178 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb017e-f181-4b5c-816e-f2a242067326 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:03.226500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3ce01-7f1b-4bf7-88a3-649be9c353b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:03.227272 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3ce01-7f1b-4bf7-88a3-649be9c353b2 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:03.227560 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3ce01-7f1b-4bf7-88a3-649be9c353b2 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:03.227868 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3ce01-7f1b-4bf7-88a3-649be9c353b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:03.300068 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e507d-2f8f-4294-b993-d66b7250967e None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:03.305551 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d3560-2e0b-432c-861e-ba34efa4e3d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:03.306345 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d3560-2e0b-432c-861e-ba34efa4e3d6 service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:03.306954 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d3560-2e0b-432c-861e-ba34efa4e3d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:03.307413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d3560-2e0b-432c-861e-ba34efa4e3d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:03.310310 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4b5d3560-2e0b-432c-861e-ba34efa4e3d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:03.322028 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f3ce01-7f1b-4bf7-88a3-649be9c353b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:03.323922 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f3ce01-7f1b-4bf7-88a3-649be9c353b2 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:03.350027 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1579/3169] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:17:03 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:17:03.432855 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d3560-2e0b-432c-861e-ba34efa4e3d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:03.435039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d3560-2e0b-432c-861e-ba34efa4e3d6 service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:03.469150 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1591/3170] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:17:03 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:17:05.535733 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3ce01-7f1b-4bf7-88a3-649be9c353b2 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:05.537291 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a3f3ce01-7f1b-4bf7-88a3-649be9c353b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:05.669405 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3ce01-7f1b-4bf7-88a3-649be9c353b2 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:05.681163 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d5025-65ba-43a8-8fd3-cbb4340612e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:05.683788 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d5025-65ba-43a8-8fd3-cbb4340612e5 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:05.684140 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d5025-65ba-43a8-8fd3-cbb4340612e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:05.684485 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d5025-65ba-43a8-8fd3-cbb4340612e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:05.691916 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-782d5025-65ba-43a8-8fd3-cbb4340612e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:05.822131 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d5025-65ba-43a8-8fd3-cbb4340612e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:05.823881 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d5025-65ba-43a8-8fd3-cbb4340612e5 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:05.839521 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1580/3171] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:17:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:17:06.050290 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d3560-2e0b-432c-861e-ba34efa4e3d6 service cinder] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:06.051719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4b5d3560-2e0b-432c-861e-ba34efa4e3d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:06.105860 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d3560-2e0b-432c-861e-ba34efa4e3d6 service cinder] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:06.121242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a82fa-63d4-45d1-aab0-036bee95d180 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:06.122712 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a82fa-63d4-45d1-aab0-036bee95d180 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:06.123003 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a82fa-63d4-45d1-aab0-036bee95d180 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:06.123780 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a82fa-63d4-45d1-aab0-036bee95d180 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:06.138925 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a82fa-63d4-45d1-aab0-036bee95d180 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:06.138925 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a82fa-63d4-45d1-aab0-036bee95d180 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:06.178557 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1592/3172] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:17:06 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:17:07.086979 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d5025-65ba-43a8-8fd3-cbb4340612e5 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:07.088632 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-782d5025-65ba-43a8-8fd3-cbb4340612e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:07.103091 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d5025-65ba-43a8-8fd3-cbb4340612e5 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:07.108629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec168f-9286-4b9b-b26d-908702e0ee2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:07.109736 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec168f-9286-4b9b-b26d-908702e0ee2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:07.110116 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec168f-9286-4b9b-b26d-908702e0ee2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:07.110514 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec168f-9286-4b9b-b26d-908702e0ee2a admin admin] PATH_INFO: `/v3/users/0067ff081d1946149db58fd383e81bff` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:07.111853 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec168f-9286-4b9b-b26d-908702e0ee2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0067ff081d1946149db58fd383e81bff)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:07.114413 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec168f-9286-4b9b-b26d-908702e0ee2a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:07.306496 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-66ec168f-9286-4b9b-b26d-908702e0ee2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0067ff081d1946149db58fd383e81bff'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:07.319021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-66ec168f-9286-4b9b-b26d-908702e0ee2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0067ff081d1946149db58fd383e81bff'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:07.395475 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-66ec168f-9286-4b9b-b26d-908702e0ee2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0067ff081d1946149db58fd383e81bff'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:07.403287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-66ec168f-9286-4b9b-b26d-908702e0ee2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0067ff081d1946149db58fd383e81bff'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:07.406810 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-66ec168f-9286-4b9b-b26d-908702e0ee2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0067ff081d1946149db58fd383e81bff'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:07.411466 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1581/3173] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:17:07 2022] DELETE /identity/v3/users/0067ff081d1946149db58fd383e81bff => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:17:07.416035 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4768aa-f8b2-4775-8285-1bce6bcf9d22 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:07.416520 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4768aa-f8b2-4775-8285-1bce6bcf9d22 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:07.416623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4768aa-f8b2-4775-8285-1bce6bcf9d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:07.457024 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-eb4768aa-f8b2-4775-8285-1bce6bcf9d22 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:07.458670 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-eb4768aa-f8b2-4775-8285-1bce6bcf9d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:07.546879 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1593/3174] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:17:07.557975 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec168f-9286-4b9b-b26d-908702e0ee2a admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:07.559773 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-66ec168f-9286-4b9b-b26d-908702e0ee2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:07.635427 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec168f-9286-4b9b-b26d-908702e0ee2a admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:07.643258 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb407f-ccec-46ef-ae15-02a938231c82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:07.644045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb407f-ccec-46ef-ae15-02a938231c82 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:07.644398 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb407f-ccec-46ef-ae15-02a938231c82 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:07.645368 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb407f-ccec-46ef-ae15-02a938231c82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:07.655958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb407f-ccec-46ef-ae15-02a938231c82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:07.657547 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb407f-ccec-46ef-ae15-02a938231c82 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:07.669628 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1582/3175] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:17:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:17:07.893716 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4768aa-f8b2-4775-8285-1bce6bcf9d22 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:07.897436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-eb4768aa-f8b2-4775-8285-1bce6bcf9d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:07.916666 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4768aa-f8b2-4775-8285-1bce6bcf9d22 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:07.921940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3fec41-3872-4a3f-b247-e67c5173da6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:07.923652 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fec41-3872-4a3f-b247-e67c5173da6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:07.924142 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fec41-3872-4a3f-b247-e67c5173da6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:07.924615 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fec41-3872-4a3f-b247-e67c5173da6c admin admin] PATH_INFO: `/v3/users/dadac4f61fe141dba3ee726ca6cbf29a` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:07.925916 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3fec41-3872-4a3f-b247-e67c5173da6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dadac4f61fe141dba3ee726ca6cbf29a)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:07.929605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3fec41-3872-4a3f-b247-e67c5173da6c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:08.130130 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1f3fec41-3872-4a3f-b247-e67c5173da6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dadac4f61fe141dba3ee726ca6cbf29a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:08.165582 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1f3fec41-3872-4a3f-b247-e67c5173da6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dadac4f61fe141dba3ee726ca6cbf29a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:08.257375 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1f3fec41-3872-4a3f-b247-e67c5173da6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dadac4f61fe141dba3ee726ca6cbf29a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:08.258218 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1f3fec41-3872-4a3f-b247-e67c5173da6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dadac4f61fe141dba3ee726ca6cbf29a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:08.266273 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1f3fec41-3872-4a3f-b247-e67c5173da6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dadac4f61fe141dba3ee726ca6cbf29a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:08.278268 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1594/3176] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:17:07 2022] DELETE /identity/v3/users/dadac4f61fe141dba3ee726ca6cbf29a => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:17:08.605471 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb407f-ccec-46ef-ae15-02a938231c82 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:08.618077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb407f-ccec-46ef-ae15-02a938231c82 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:08.667828 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3fec41-3872-4a3f-b247-e67c5173da6c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:08.669851 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1f3fec41-3872-4a3f-b247-e67c5173da6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:08.759287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243ed45-5574-4280-99cd-863197fac46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:08.760560 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243ed45-5574-4280-99cd-863197fac46f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:08.761053 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243ed45-5574-4280-99cd-863197fac46f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:08.761523 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243ed45-5574-4280-99cd-863197fac46f admin admin] PATH_INFO: `/v3/projects/77b426139c194813974502d1910c257f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:08.763780 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243ed45-5574-4280-99cd-863197fac46f admin admin] RBAC: Authorizing `identity:delete_project(project_id=77b426139c194813974502d1910c257f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:08.765627 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3fec41-3872-4a3f-b247-e67c5173da6c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:08.767034 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243ed45-5574-4280-99cd-863197fac46f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:08.771540 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2672965-4941-42f9-aa65-0f66aefe7173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:08.772530 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2672965-4941-42f9-aa65-0f66aefe7173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:08.773284 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2672965-4941-42f9-aa65-0f66aefe7173 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:08.774244 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2672965-4941-42f9-aa65-0f66aefe7173 admin admin] PATH_INFO: `/v3/projects/25bcc72715fa4ba88d3ca6b371eb1f93` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:08.775749 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2672965-4941-42f9-aa65-0f66aefe7173 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25bcc72715fa4ba88d3ca6b371eb1f93)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:08.779117 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2672965-4941-42f9-aa65-0f66aefe7173 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:08.926142 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a243ed45-5574-4280-99cd-863197fac46f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77b426139c194813974502d1910c257f', 'request_id': 'req-a243ed45-5574-4280-99cd-863197fac46f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:08.932840 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c2672965-4941-42f9-aa65-0f66aefe7173 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25bcc72715fa4ba88d3ca6b371eb1f93', 'request_id': 'req-c2672965-4941-42f9-aa65-0f66aefe7173'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:08.947177 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a243ed45-5574-4280-99cd-863197fac46f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77b426139c194813974502d1910c257f', 'request_id': 'req-a243ed45-5574-4280-99cd-863197fac46f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:08.950179 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c2672965-4941-42f9-aa65-0f66aefe7173 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25bcc72715fa4ba88d3ca6b371eb1f93', 'request_id': 'req-c2672965-4941-42f9-aa65-0f66aefe7173'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:08.957216 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a243ed45-5574-4280-99cd-863197fac46f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77b426139c194813974502d1910c257f', 'request_id': 'req-a243ed45-5574-4280-99cd-863197fac46f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:08.959898 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c2672965-4941-42f9-aa65-0f66aefe7173 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25bcc72715fa4ba88d3ca6b371eb1f93', 'request_id': 'req-c2672965-4941-42f9-aa65-0f66aefe7173'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:09.043386 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a243ed45-5574-4280-99cd-863197fac46f admin admin] The token cache is being invalidate because project 77b426139c194813974502d1910c257f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:17:09.049711 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a243ed45-5574-4280-99cd-863197fac46f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:09.049711 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a243ed45-5574-4280-99cd-863197fac46f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:09.049711 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1583/3177] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:17:08 2022] DELETE /identity/v3/projects/77b426139c194813974502d1910c257f => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:17:09.050568 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243ed45-5574-4280-99cd-863197fac46f admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:09.051916 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a243ed45-5574-4280-99cd-863197fac46f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:09.133004 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243ed45-5574-4280-99cd-863197fac46f admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:09.156673 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c2672965-4941-42f9-aa65-0f66aefe7173 admin admin] The token cache is being invalidate because project 25bcc72715fa4ba88d3ca6b371eb1f93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:17:09.156673 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c2672965-4941-42f9-aa65-0f66aefe7173 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:09.156967 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c2672965-4941-42f9-aa65-0f66aefe7173 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:09.159098 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1595/3178] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:17:08 2022] DELETE /identity/v3/projects/25bcc72715fa4ba88d3ca6b371eb1f93 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:17:09.164421 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2672965-4941-42f9-aa65-0f66aefe7173 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:09.167233 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c2672965-4941-42f9-aa65-0f66aefe7173 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:09.247522 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e8759-3e84-4002-9dea-ae6187f80965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:09.248414 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e8759-3e84-4002-9dea-ae6187f80965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:09.248807 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e8759-3e84-4002-9dea-ae6187f80965 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:09.249089 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e8759-3e84-4002-9dea-ae6187f80965 admin admin] PATH_INFO: `/v3/users/f959a8c0b64c4f6cb172a496b8c91f57` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:09.250421 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e8759-3e84-4002-9dea-ae6187f80965 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f959a8c0b64c4f6cb172a496b8c91f57)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:09.252810 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e8759-3e84-4002-9dea-ae6187f80965 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:09.295412 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2672965-4941-42f9-aa65-0f66aefe7173 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:09.301965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9659b3e-9d80-4bce-82c3-93a7d692371e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:09.303185 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9659b3e-9d80-4bce-82c3-93a7d692371e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:09.303745 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9659b3e-9d80-4bce-82c3-93a7d692371e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:09.304028 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9659b3e-9d80-4bce-82c3-93a7d692371e admin admin] PATH_INFO: `/v3/users/03734747015c4c078ceb369a72804b96` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:09.307942 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9659b3e-9d80-4bce-82c3-93a7d692371e admin admin] RBAC: Authorizing `identity:delete_user(user_id=03734747015c4c078ceb369a72804b96)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:09.312842 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9659b3e-9d80-4bce-82c3-93a7d692371e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:09.500774 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-360e8759-3e84-4002-9dea-ae6187f80965 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f959a8c0b64c4f6cb172a496b8c91f57'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:09.519007 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-360e8759-3e84-4002-9dea-ae6187f80965 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f959a8c0b64c4f6cb172a496b8c91f57'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:09.583057 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f9659b3e-9d80-4bce-82c3-93a7d692371e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03734747015c4c078ceb369a72804b96'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:09.596985 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f9659b3e-9d80-4bce-82c3-93a7d692371e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03734747015c4c078ceb369a72804b96'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:09.624318 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-360e8759-3e84-4002-9dea-ae6187f80965 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f959a8c0b64c4f6cb172a496b8c91f57'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:09.632590 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-360e8759-3e84-4002-9dea-ae6187f80965 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f959a8c0b64c4f6cb172a496b8c91f57'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:09.634065 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-360e8759-3e84-4002-9dea-ae6187f80965 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f959a8c0b64c4f6cb172a496b8c91f57'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:09.644614 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1584/3179] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:17:09 2022] DELETE /identity/v3/users/f959a8c0b64c4f6cb172a496b8c91f57 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:17:09.695845 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f9659b3e-9d80-4bce-82c3-93a7d692371e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03734747015c4c078ceb369a72804b96'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:09.696851 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f9659b3e-9d80-4bce-82c3-93a7d692371e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03734747015c4c078ceb369a72804b96'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:09.706019 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f9659b3e-9d80-4bce-82c3-93a7d692371e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03734747015c4c078ceb369a72804b96'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:09.713994 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1596/3180] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:17:09 2022] DELETE /identity/v3/users/03734747015c4c078ceb369a72804b96 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:17:10.140961 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e8759-3e84-4002-9dea-ae6187f80965 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:10.143404 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-360e8759-3e84-4002-9dea-ae6187f80965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:10.296916 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e8759-3e84-4002-9dea-ae6187f80965 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:10.372455 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e6678-8d83-40b8-ab0e-974f686c5e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:10.374204 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e6678-8d83-40b8-ab0e-974f686c5e50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:10.374751 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e6678-8d83-40b8-ab0e-974f686c5e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:10.375256 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e6678-8d83-40b8-ab0e-974f686c5e50 admin admin] PATH_INFO: `/v3/projects/1d2ee2a196af4bf7874f40a1c1a22a7a` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:10.377389 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7e6678-8d83-40b8-ab0e-974f686c5e50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d2ee2a196af4bf7874f40a1c1a22a7a)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:10.380137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7e6678-8d83-40b8-ab0e-974f686c5e50 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:10.597508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ff7e6678-8d83-40b8-ab0e-974f686c5e50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d2ee2a196af4bf7874f40a1c1a22a7a', 'request_id': 'req-ff7e6678-8d83-40b8-ab0e-974f686c5e50'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:10.605281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ff7e6678-8d83-40b8-ab0e-974f686c5e50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d2ee2a196af4bf7874f40a1c1a22a7a', 'request_id': 'req-ff7e6678-8d83-40b8-ab0e-974f686c5e50'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:10.613313 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ff7e6678-8d83-40b8-ab0e-974f686c5e50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d2ee2a196af4bf7874f40a1c1a22a7a', 'request_id': 'req-ff7e6678-8d83-40b8-ab0e-974f686c5e50'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:10.727717 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ff7e6678-8d83-40b8-ab0e-974f686c5e50 admin admin] The token cache is being invalidate because project 1d2ee2a196af4bf7874f40a1c1a22a7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:17:10.728328 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ff7e6678-8d83-40b8-ab0e-974f686c5e50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:10.728759 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ff7e6678-8d83-40b8-ab0e-974f686c5e50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:10.736030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201e6ad-30c0-41c6-887b-6bf52c2f174f None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:10.736548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201e6ad-30c0-41c6-887b-6bf52c2f174f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:10.736674 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1585/3181] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:17:10 2022] DELETE /identity/v3/projects/1d2ee2a196af4bf7874f40a1c1a22a7a => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:17:10.736787 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201e6ad-30c0-41c6-887b-6bf52c2f174f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:10.782920 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-4201e6ad-30c0-41c6-887b-6bf52c2f174f None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:10.786661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4201e6ad-30c0-41c6-887b-6bf52c2f174f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:10.885529 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1597/3182] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:17:10.893716 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88069705-4a06-4805-85d8-4e3f550a8a8d None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:10.895069 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88069705-4a06-4805-85d8-4e3f550a8a8d None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:10.896745 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88069705-4a06-4805-85d8-4e3f550a8a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:10.923753 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-88069705-4a06-4805-85d8-4e3f550a8a8d None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:10.925136 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-88069705-4a06-4805-85d8-4e3f550a8a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:10.934745 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1586/3183] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:17:10.939777 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201e6ad-30c0-41c6-887b-6bf52c2f174f None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:10.951353 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201e6ad-30c0-41c6-887b-6bf52c2f174f None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:10.959409 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c843d-1d17-46d2-a73a-c0b62e81bc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:10.960416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c843d-1d17-46d2-a73a-c0b62e81bc3a admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:10.968827 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c843d-1d17-46d2-a73a-c0b62e81bc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:10.968827 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c843d-1d17-46d2-a73a-c0b62e81bc3a admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:10.968827 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c843d-1d17-46d2-a73a-c0b62e81bc3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:17:10.968827 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c843d-1d17-46d2-a73a-c0b62e81bc3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:10.968827 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c843d-1d17-46d2-a73a-c0b62e81bc3a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:10.978467 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1598/3184] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:17:10.982600 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88069705-4a06-4805-85d8-4e3f550a8a8d None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:10.997878 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88069705-4a06-4805-85d8-4e3f550a8a8d None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:11.006880 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd23d3b-2e52-48da-bd72-f6570581f5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:11.007898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd23d3b-2e52-48da-bd72-f6570581f5a4 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:11.008451 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd23d3b-2e52-48da-bd72-f6570581f5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:11.008941 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd23d3b-2e52-48da-bd72-f6570581f5a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:11.010131 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd23d3b-2e52-48da-bd72-f6570581f5a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:11.012467 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd23d3b-2e52-48da-bd72-f6570581f5a4 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:11.165485 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1587/3185] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:17:10 2022] POST /identity/v3/projects => generated 387 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:17:11.168094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c843d-1d17-46d2-a73a-c0b62e81bc3a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:11.185991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c843d-1d17-46d2-a73a-c0b62e81bc3a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:11.223363 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd23d3b-2e52-48da-bd72-f6570581f5a4 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:11.225365 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2dd23d3b-2e52-48da-bd72-f6570581f5a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:11.349962 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84177868-3442-4142-a5b9-9f19d3ef05a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:11.350656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84177868-3442-4142-a5b9-9f19d3ef05a5 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:11.350942 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84177868-3442-4142-a5b9-9f19d3ef05a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:11.351219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84177868-3442-4142-a5b9-9f19d3ef05a5 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:11.351907 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84177868-3442-4142-a5b9-9f19d3ef05a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:11.354527 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84177868-3442-4142-a5b9-9f19d3ef05a5 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:11.441409 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd23d3b-2e52-48da-bd72-f6570581f5a4 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:11.478141 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1599/3186] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:17:11 2022] POST /identity/v3/users => generated 294 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:17:11.480410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4418e3-a96f-4588-a438-2ad8dabd97f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:11.481297 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4418e3-a96f-4588-a438-2ad8dabd97f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:11.481872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4418e3-a96f-4588-a438-2ad8dabd97f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:11.482161 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4418e3-a96f-4588-a438-2ad8dabd97f4 admin admin] PATH_INFO: `/v3/projects/48518dbb4d334be888e8fb66834043b7` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:11.483162 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84177868-3442-4142-a5b9-9f19d3ef05a5 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:11.486086 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4418e3-a96f-4588-a438-2ad8dabd97f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48518dbb4d334be888e8fb66834043b7)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:11.488023 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4418e3-a96f-4588-a438-2ad8dabd97f4 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:11.497000 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84177868-3442-4142-a5b9-9f19d3ef05a5 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:11.537157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6752f0d-d1db-4316-a8de-c73346373e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:11.538247 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6752f0d-d1db-4316-a8de-c73346373e01 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:11.538746 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6752f0d-d1db-4316-a8de-c73346373e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:11.539188 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6752f0d-d1db-4316-a8de-c73346373e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:11.540169 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6752f0d-d1db-4316-a8de-c73346373e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:11.541985 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6752f0d-d1db-4316-a8de-c73346373e01 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:11.561316 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1600/3187] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:17:11.571088 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6752f0d-d1db-4316-a8de-c73346373e01 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:11.583805 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6752f0d-d1db-4316-a8de-c73346373e01 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:11.590330 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5fc14-2334-4c6f-ba53-aada4701fbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:11.591098 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5fc14-2334-4c6f-ba53-aada4701fbc7 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:11.591457 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5fc14-2334-4c6f-ba53-aada4701fbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:11.591802 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5fc14-2334-4c6f-ba53-aada4701fbc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:11.592799 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5fc14-2334-4c6f-ba53-aada4701fbc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:11.594742 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5fc14-2334-4c6f-ba53-aada4701fbc7 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:11.608743 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1601/3188] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:17:11.613395 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5fc14-2334-4c6f-ba53-aada4701fbc7 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:11.626737 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5fc14-2334-4c6f-ba53-aada4701fbc7 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:11.633418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0b7a9-ac68-47df-91a6-5b5a7cb4df82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:11.637363 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0b7a9-ac68-47df-91a6-5b5a7cb4df82 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:11.637363 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0b7a9-ac68-47df-91a6-5b5a7cb4df82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:11.637363 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0b7a9-ac68-47df-91a6-5b5a7cb4df82 admin admin] PATH_INFO: `/v3/projects/4c676e3c2e8c409e8cf460d850f19142/users/2bb9b1d33b924f9fb7d7f265fa7098fb/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:11.655594 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f0b7a9-ac68-47df-91a6-5b5a7cb4df82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c676e3c2e8c409e8cf460d850f19142, user_id=2bb9b1d33b924f9fb7d7f265fa7098fb, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:11.667568 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f0b7a9-ac68-47df-91a6-5b5a7cb4df82 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:11.690903 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4e4418e3-a96f-4588-a438-2ad8dabd97f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48518dbb4d334be888e8fb66834043b7', 'request_id': 'req-4e4418e3-a96f-4588-a438-2ad8dabd97f4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:11.696999 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4e4418e3-a96f-4588-a438-2ad8dabd97f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48518dbb4d334be888e8fb66834043b7', 'request_id': 'req-4e4418e3-a96f-4588-a438-2ad8dabd97f4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:11.710659 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4e4418e3-a96f-4588-a438-2ad8dabd97f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48518dbb4d334be888e8fb66834043b7', 'request_id': 'req-4e4418e3-a96f-4588-a438-2ad8dabd97f4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:11.793525 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1602/3189] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:17:11 2022] PUT /identity/v3/projects/4c676e3c2e8c409e8cf460d850f19142/users/2bb9b1d33b924f9fb7d7f265fa7098fb/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:17:11.806668 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f0e4c-2a12-416f-a334-d8e40812f062 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:11.806956 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f0e4c-2a12-416f-a334-d8e40812f062 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:11.807242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f0e4c-2a12-416f-a334-d8e40812f062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:11.868448 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4e4418e3-a96f-4588-a438-2ad8dabd97f4 admin admin] The token cache is being invalidate because project 48518dbb4d334be888e8fb66834043b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:17:11.868913 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4e4418e3-a96f-4588-a438-2ad8dabd97f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:11.871374 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4e4418e3-a96f-4588-a438-2ad8dabd97f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:11.872300 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-8f3f0e4c-2a12-416f-a334-d8e40812f062 None None] MFA Rules not processed for user `2bb9b1d33b924f9fb7d7f265fa7098fb`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:11.873622 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8f3f0e4c-2a12-416f-a334-d8e40812f062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:11.875090 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1588/3190] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:17:11 2022] DELETE /identity/v3/projects/48518dbb4d334be888e8fb66834043b7 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:17:11.880033 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a974b-5de9-4ff6-b11c-8ccf74736c27 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:11.880326 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a974b-5de9-4ff6-b11c-8ccf74736c27 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:11.880606 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a974b-5de9-4ff6-b11c-8ccf74736c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:11.942722 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-d77a974b-5de9-4ff6-b11c-8ccf74736c27 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:11.947059 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d77a974b-5de9-4ff6-b11c-8ccf74736c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:12.086255 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1603/3191] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:17:12.094562 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f0e4c-2a12-416f-a334-d8e40812f062 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:12.103625 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8f3f0e4c-2a12-416f-a334-d8e40812f062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:12.140137 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1589/3192] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:17:12.149008 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5497cfb-8444-4f69-9c69-9f32f3dccacd None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:12.149707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5497cfb-8444-4f69-9c69-9f32f3dccacd None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:12.150381 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5497cfb-8444-4f69-9c69-9f32f3dccacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:12.204126 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-f5497cfb-8444-4f69-9c69-9f32f3dccacd None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:12.210149 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f5497cfb-8444-4f69-9c69-9f32f3dccacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:12.222842 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1590/3193] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:17:12.226591 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5497cfb-8444-4f69-9c69-9f32f3dccacd None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:12.248696 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f0e4c-2a12-416f-a334-d8e40812f062 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:12.255401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b151e44-e2c3-46dc-b49a-8ddc6238a20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:12.256567 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b151e44-e2c3-46dc-b49a-8ddc6238a20e admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:12.257043 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b151e44-e2c3-46dc-b49a-8ddc6238a20e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:12.257551 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b151e44-e2c3-46dc-b49a-8ddc6238a20e admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:12.258738 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b151e44-e2c3-46dc-b49a-8ddc6238a20e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:12.262873 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b151e44-e2c3-46dc-b49a-8ddc6238a20e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:12.269021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5497cfb-8444-4f69-9c69-9f32f3dccacd None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:12.282897 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdf6af-1b96-4d11-93e2-0ce75c6d16c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:12.283572 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdf6af-1b96-4d11-93e2-0ce75c6d16c6 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:12.287025 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdf6af-1b96-4d11-93e2-0ce75c6d16c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:12.287025 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdf6af-1b96-4d11-93e2-0ce75c6d16c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:12.287025 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cdf6af-1b96-4d11-93e2-0ce75c6d16c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:17:12.287025 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cdf6af-1b96-4d11-93e2-0ce75c6d16c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:12.299682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cdf6af-1b96-4d11-93e2-0ce75c6d16c6 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:12.318675 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1591/3194] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:17:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:17:12.319619 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdf6af-1b96-4d11-93e2-0ce75c6d16c6 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:12.332003 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdf6af-1b96-4d11-93e2-0ce75c6d16c6 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:12.347265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f9459-e723-4867-a863-ea346753905b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:12.347946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f9459-e723-4867-a863-ea346753905b admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:12.348227 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f9459-e723-4867-a863-ea346753905b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:12.348510 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f9459-e723-4867-a863-ea346753905b admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:12.349367 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f9459-e723-4867-a863-ea346753905b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:12.354413 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f9459-e723-4867-a863-ea346753905b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:12.388372 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1604/3195] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:17:12 2022] POST /identity/v3/projects => generated 387 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:17:12.391093 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b151e44-e2c3-46dc-b49a-8ddc6238a20e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:12.511066 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b151e44-e2c3-46dc-b49a-8ddc6238a20e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:12.517866 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1592/3196] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:17:12 2022] POST /identity/v3/projects => generated 395 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:17:12.519682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f9459-e723-4867-a863-ea346753905b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:12.524831 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0464b22-9028-4466-8413-a673ecdf9ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:12.527421 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0464b22-9028-4466-8413-a673ecdf9ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:12.527966 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0464b22-9028-4466-8413-a673ecdf9ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:12.528655 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0464b22-9028-4466-8413-a673ecdf9ef7 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:12.529607 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0464b22-9028-4466-8413-a673ecdf9ef7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:12.533071 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0464b22-9028-4466-8413-a673ecdf9ef7 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:12.605500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f9459-e723-4867-a863-ea346753905b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:12.618240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61fae6-dd62-4c16-bef2-4c063e3dd3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:12.619279 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61fae6-dd62-4c16-bef2-4c063e3dd3aa admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:12.619570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61fae6-dd62-4c16-bef2-4c063e3dd3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:12.619849 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61fae6-dd62-4c16-bef2-4c063e3dd3aa admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:12.620602 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61fae6-dd62-4c16-bef2-4c063e3dd3aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:12.622616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61fae6-dd62-4c16-bef2-4c063e3dd3aa admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:12.681801 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1605/3197] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:17:12 2022] POST /identity/v3/users => generated 300 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:17:12.683994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0464b22-9028-4466-8413-a673ecdf9ef7 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:12.696582 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0464b22-9028-4466-8413-a673ecdf9ef7 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:12.703852 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21325ba9-80b3-44bc-89fa-7ca30ec3625f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:12.704625 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21325ba9-80b3-44bc-89fa-7ca30ec3625f admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:12.704976 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21325ba9-80b3-44bc-89fa-7ca30ec3625f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:12.705327 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21325ba9-80b3-44bc-89fa-7ca30ec3625f admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:12.706172 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21325ba9-80b3-44bc-89fa-7ca30ec3625f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:12.707918 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21325ba9-80b3-44bc-89fa-7ca30ec3625f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:12.721811 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1606/3198] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:17:12.728146 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21325ba9-80b3-44bc-89fa-7ca30ec3625f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:12.744165 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21325ba9-80b3-44bc-89fa-7ca30ec3625f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:12.749854 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad3689-ad39-42b2-9d2f-1331881398df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:12.758640 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1593/3199] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:17:12 2022] POST /identity/v3/users => generated 298 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:17:12.761975 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad3689-ad39-42b2-9d2f-1331881398df admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:12.761975 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad3689-ad39-42b2-9d2f-1331881398df admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:12.761975 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad3689-ad39-42b2-9d2f-1331881398df admin admin] PATH_INFO: `/v3/projects/706d0d52baa84890a5a3cb856e4681fe/users/4812ee7defdc4a4295d8122665167559/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:12.766206 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61fae6-dd62-4c16-bef2-4c063e3dd3aa admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:12.784397 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61fae6-dd62-4c16-bef2-4c063e3dd3aa admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:12.795565 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d31e3-dce3-42ea-9aa3-364ce3042f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:12.796526 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d31e3-dce3-42ea-9aa3-364ce3042f25 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:12.796999 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d31e3-dce3-42ea-9aa3-364ce3042f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:12.797461 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d31e3-dce3-42ea-9aa3-364ce3042f25 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:12.798975 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d31e3-dce3-42ea-9aa3-364ce3042f25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:12.802435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d31e3-dce3-42ea-9aa3-364ce3042f25 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:12.820328 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad3689-ad39-42b2-9d2f-1331881398df admin admin] RBAC: Authorizing `identity:create_grant(project_id=706d0d52baa84890a5a3cb856e4681fe, user_id=4812ee7defdc4a4295d8122665167559, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:12.826944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad3689-ad39-42b2-9d2f-1331881398df admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:12.833264 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1594/3200] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:17:12.837429 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d31e3-dce3-42ea-9aa3-364ce3042f25 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:12.862163 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d31e3-dce3-42ea-9aa3-364ce3042f25 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:12.869142 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158feddf-e4b2-41e8-abc0-f3b165cf0b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:12.870599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158feddf-e4b2-41e8-abc0-f3b165cf0b81 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:12.871040 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158feddf-e4b2-41e8-abc0-f3b165cf0b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:12.871700 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158feddf-e4b2-41e8-abc0-f3b165cf0b81 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:12.873845 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158feddf-e4b2-41e8-abc0-f3b165cf0b81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:12.875769 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158feddf-e4b2-41e8-abc0-f3b165cf0b81 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:12.889991 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1595/3201] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:17:12.897202 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158feddf-e4b2-41e8-abc0-f3b165cf0b81 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:12.910348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158feddf-e4b2-41e8-abc0-f3b165cf0b81 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:12.916033 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b790a-047d-4807-b83a-afd8d4b99b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:12.917032 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b790a-047d-4807-b83a-afd8d4b99b84 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:12.921620 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b790a-047d-4807-b83a-afd8d4b99b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:12.922058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b790a-047d-4807-b83a-afd8d4b99b84 admin admin] PATH_INFO: `/v3/projects/9cda5776322242b285e71514efc4f9d5/users/0456dee72dcd4379ada78762526035e8/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:12.941210 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1607/3202] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:17:12 2022] PUT /identity/v3/projects/706d0d52baa84890a5a3cb856e4681fe/users/4812ee7defdc4a4295d8122665167559/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:17:12.949445 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad3689-ad39-42b2-9d2f-1331881398df admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:12.966617 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b790a-047d-4807-b83a-afd8d4b99b84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cda5776322242b285e71514efc4f9d5, user_id=0456dee72dcd4379ada78762526035e8, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:12.968101 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b790a-047d-4807-b83a-afd8d4b99b84 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:13.043265 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad3689-ad39-42b2-9d2f-1331881398df admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:13.049826 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af1ae5-e380-4879-864d-402f5dd2d9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:13.050524 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af1ae5-e380-4879-864d-402f5dd2d9b3 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:13.050829 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af1ae5-e380-4879-864d-402f5dd2d9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:13.051303 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af1ae5-e380-4879-864d-402f5dd2d9b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:13.052060 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63af1ae5-e380-4879-864d-402f5dd2d9b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:13.053947 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63af1ae5-e380-4879-864d-402f5dd2d9b3 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:13.067170 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1608/3203] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:17:13.071435 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af1ae5-e380-4879-864d-402f5dd2d9b3 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:13.072417 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1596/3204] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:17:12 2022] PUT /identity/v3/projects/9cda5776322242b285e71514efc4f9d5/users/0456dee72dcd4379ada78762526035e8/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:17:13.083719 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814e1bc-f76e-48c7-9e0a-808e71a7b014 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:13.084115 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814e1bc-f76e-48c7-9e0a-808e71a7b014 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:13.084473 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814e1bc-f76e-48c7-9e0a-808e71a7b014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:13.096176 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af1ae5-e380-4879-864d-402f5dd2d9b3 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:13.123403 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-b814e1bc-f76e-48c7-9e0a-808e71a7b014 None None] MFA Rules not processed for user `0456dee72dcd4379ada78762526035e8`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:13.124677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b814e1bc-f76e-48c7-9e0a-808e71a7b014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:13.204676 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3829ff-be07-4a0e-9201-9956d9871e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:13.216079 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3829ff-be07-4a0e-9201-9956d9871e6c admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:13.216079 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3829ff-be07-4a0e-9201-9956d9871e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:13.216079 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3829ff-be07-4a0e-9201-9956d9871e6c admin admin] PATH_INFO: `/v3/projects/706d0d52baa84890a5a3cb856e4681fe/users/4812ee7defdc4a4295d8122665167559/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:13.225932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3829ff-be07-4a0e-9201-9956d9871e6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=706d0d52baa84890a5a3cb856e4681fe, user_id=4812ee7defdc4a4295d8122665167559, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:13.229458 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3829ff-be07-4a0e-9201-9956d9871e6c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:13.239043 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1597/3205] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:17:13.244265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814e1bc-f76e-48c7-9e0a-808e71a7b014 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:13.262937 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814e1bc-f76e-48c7-9e0a-808e71a7b014 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:13.264504 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1609/3206] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:17:13 2022] PUT /identity/v3/projects/706d0d52baa84890a5a3cb856e4681fe/users/4812ee7defdc4a4295d8122665167559/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:17:13.274246 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cff34-a0c1-4610-991a-32e338dac980 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:13.274246 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cff34-a0c1-4610-991a-32e338dac980 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:13.274246 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cff34-a0c1-4610-991a-32e338dac980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:13.367321 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-444cff34-a0c1-4610-991a-32e338dac980 None None] MFA Rules not processed for user `4812ee7defdc4a4295d8122665167559`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:13.370029 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-444cff34-a0c1-4610-991a-32e338dac980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:13.409221 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1478fa5-a234-42aa-af44-032c4c00c176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:13.409977 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1478fa5-a234-42aa-af44-032c4c00c176 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:13.410201 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1478fa5-a234-42aa-af44-032c4c00c176 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:13.410487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1478fa5-a234-42aa-af44-032c4c00c176 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:13.411181 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1478fa5-a234-42aa-af44-032c4c00c176 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:13.413113 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1478fa5-a234-42aa-af44-032c4c00c176 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:13.497832 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1610/3207] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:13 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:17:13.545988 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1598/3208] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:17:13 2022] POST /identity/v3/projects => generated 395 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:17:13.550974 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cff34-a0c1-4610-991a-32e338dac980 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:13.561678 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cff34-a0c1-4610-991a-32e338dac980 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:13.645968 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6c850-25fd-4b66-9331-e88739a23d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:13.647594 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6c850-25fd-4b66-9331-e88739a23d37 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:13.648172 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6c850-25fd-4b66-9331-e88739a23d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:13.648506 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6c850-25fd-4b66-9331-e88739a23d37 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:13.649295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f6c850-25fd-4b66-9331-e88739a23d37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:13.651480 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f6c850-25fd-4b66-9331-e88739a23d37 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:13.685916 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1478fa5-a234-42aa-af44-032c4c00c176 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:13.687958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a1478fa5-a234-42aa-af44-032c4c00c176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:13.750288 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1611/3209] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:17:13 2022] POST /identity/v3/users => generated 304 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:17:13.751788 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6c850-25fd-4b66-9331-e88739a23d37 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:13.772908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6c850-25fd-4b66-9331-e88739a23d37 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:13.790485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890d045-d72e-4cd6-adeb-49bc5602d9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:13.791176 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890d045-d72e-4cd6-adeb-49bc5602d9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:13.791461 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890d045-d72e-4cd6-adeb-49bc5602d9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:13.791738 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890d045-d72e-4cd6-adeb-49bc5602d9f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:13.793047 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890d045-d72e-4cd6-adeb-49bc5602d9f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:13.797872 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890d045-d72e-4cd6-adeb-49bc5602d9f1 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:13.806327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1478fa5-a234-42aa-af44-032c4c00c176 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:13.813497 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308975c5-1a38-4015-80b2-5b9ada9ae04d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:13.814211 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308975c5-1a38-4015-80b2-5b9ada9ae04d service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:13.814479 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308975c5-1a38-4015-80b2-5b9ada9ae04d service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:13.814755 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308975c5-1a38-4015-80b2-5b9ada9ae04d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:13.832642 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1612/3210] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:17:13.834552 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890d045-d72e-4cd6-adeb-49bc5602d9f1 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:13.855161 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890d045-d72e-4cd6-adeb-49bc5602d9f1 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:13.871740 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b16b0-1b67-477d-880b-e604bee7fa8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:13.872648 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b16b0-1b67-477d-880b-e604bee7fa8a admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:13.872977 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b16b0-1b67-477d-880b-e604bee7fa8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:13.873186 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b16b0-1b67-477d-880b-e604bee7fa8a admin admin] PATH_INFO: `/v3/projects/7d814affb19041f296fb365025aae272/users/3f011aa08b4746fa81b5c4ea4308708e/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:13.905620 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b16b0-1b67-477d-880b-e604bee7fa8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d814affb19041f296fb365025aae272, user_id=3f011aa08b4746fa81b5c4ea4308708e, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:13.908550 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b16b0-1b67-477d-880b-e604bee7fa8a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:13.909313 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308975c5-1a38-4015-80b2-5b9ada9ae04d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:13.911177 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308975c5-1a38-4015-80b2-5b9ada9ae04d service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:13.924045 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1599/3211] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:17:13 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:17:14.020155 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1613/3212] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:17:13 2022] PUT /identity/v3/projects/7d814affb19041f296fb365025aae272/users/3f011aa08b4746fa81b5c4ea4308708e/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:17:14.024487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308975c5-1a38-4015-80b2-5b9ada9ae04d service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:14.037321 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308975c5-1a38-4015-80b2-5b9ada9ae04d service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:14.158443 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0927b84a-1dbd-4afe-ad27-6fe13352a38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:14.159270 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927b84a-1dbd-4afe-ad27-6fe13352a38d admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:14.159618 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927b84a-1dbd-4afe-ad27-6fe13352a38d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:14.160013 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0927b84a-1dbd-4afe-ad27-6fe13352a38d admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:14.161179 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0927b84a-1dbd-4afe-ad27-6fe13352a38d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:14.163455 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0927b84a-1dbd-4afe-ad27-6fe13352a38d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:14.175511 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1600/3213] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:17:14.183838 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b16b0-1b67-477d-880b-e604bee7fa8a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:14.208514 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b16b0-1b67-477d-880b-e604bee7fa8a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:14.215945 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235b674-b45d-45e7-a1e1-848d38f45aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:14.216825 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235b674-b45d-45e7-a1e1-848d38f45aa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:14.217155 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235b674-b45d-45e7-a1e1-848d38f45aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:14.217601 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235b674-b45d-45e7-a1e1-848d38f45aa5 admin admin] PATH_INFO: `/v3/projects/7d814affb19041f296fb365025aae272/users/3f011aa08b4746fa81b5c4ea4308708e/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:14.220115 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235b674-b45d-45e7-a1e1-848d38f45aa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d814affb19041f296fb365025aae272, user_id=3f011aa08b4746fa81b5c4ea4308708e, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:14.222886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235b674-b45d-45e7-a1e1-848d38f45aa5 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:14.240056 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1614/3214] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:17:14 2022] PUT /identity/v3/projects/7d814affb19041f296fb365025aae272/users/3f011aa08b4746fa81b5c4ea4308708e/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:17:14.256488 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c52da-422f-4752-b186-36c394403edf None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:14.256880 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c52da-422f-4752-b186-36c394403edf None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:14.257237 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c52da-422f-4752-b186-36c394403edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:14.296145 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-ab7c52da-422f-4752-b186-36c394403edf None None] MFA Rules not processed for user `3f011aa08b4746fa81b5c4ea4308708e`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:14.297407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ab7c52da-422f-4752-b186-36c394403edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:14.382948 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1601/3215] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:14 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:17:15.069841 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235b674-b45d-45e7-a1e1-848d38f45aa5 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:15.077123 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0235b674-b45d-45e7-a1e1-848d38f45aa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:15.081045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661cbc1c-93b0-462e-b517-b7589e255f93 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:15.081938 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661cbc1c-93b0-462e-b517-b7589e255f93 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:15.082404 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661cbc1c-93b0-462e-b517-b7589e255f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:15.110238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-661cbc1c-93b0-462e-b517-b7589e255f93 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:15.111815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-661cbc1c-93b0-462e-b517-b7589e255f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:15.189426 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1602/3216] 10.222.0.23 () {58 vars in 967 bytes} [Sat Apr 30 21:17:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:17:15.208132 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235b674-b45d-45e7-a1e1-848d38f45aa5 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:15.227638 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661cbc1c-93b0-462e-b517-b7589e255f93 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:15.231871 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b687fa-fc7f-448e-8ca9-88d449c310c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:15.232035 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-661cbc1c-93b0-462e-b517-b7589e255f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:15.232140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b687fa-fc7f-448e-8ca9-88d449c310c2 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:15.232140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b687fa-fc7f-448e-8ca9-88d449c310c2 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:15.232140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b687fa-fc7f-448e-8ca9-88d449c310c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:15.241323 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b687fa-fc7f-448e-8ca9-88d449c310c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:15.243111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b687fa-fc7f-448e-8ca9-88d449c310c2 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:15.255545 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1615/3217] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:17:15 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:17:15.393661 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661cbc1c-93b0-462e-b517-b7589e255f93 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:15.410183 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a6c29-88ed-4cfb-b123-68622f4bba70 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:15.410183 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a6c29-88ed-4cfb-b123-68622f4bba70 service swift] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:15.410438 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a6c29-88ed-4cfb-b123-68622f4bba70 service swift] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:15.410832 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a6c29-88ed-4cfb-b123-68622f4bba70 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:15.432943 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a6c29-88ed-4cfb-b123-68622f4bba70 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:15.436990 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a6c29-88ed-4cfb-b123-68622f4bba70 service swift] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:15.444590 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1603/3218] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:17:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:17:16.738144 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b687fa-fc7f-448e-8ca9-88d449c310c2 service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:16.839532 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b687fa-fc7f-448e-8ca9-88d449c310c2 service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:16.847653 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595e450-762c-4ae8-9ec3-029256fca1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:16.849537 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595e450-762c-4ae8-9ec3-029256fca1bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:16.849932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595e450-762c-4ae8-9ec3-029256fca1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:16.850208 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595e450-762c-4ae8-9ec3-029256fca1bc admin admin] PATH_INFO: `/v3/users/2bb9b1d33b924f9fb7d7f265fa7098fb` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:16.851884 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595e450-762c-4ae8-9ec3-029256fca1bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bb9b1d33b924f9fb7d7f265fa7098fb)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:16.854235 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595e450-762c-4ae8-9ec3-029256fca1bc admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:17.102827 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2595e450-762c-4ae8-9ec3-029256fca1bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bb9b1d33b924f9fb7d7f265fa7098fb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:17.130819 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2595e450-762c-4ae8-9ec3-029256fca1bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bb9b1d33b924f9fb7d7f265fa7098fb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:17.152648 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a6c29-88ed-4cfb-b123-68622f4bba70 service swift] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:17.176132 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a6c29-88ed-4cfb-b123-68622f4bba70 service swift] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:17.191236 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e94ab5-4c89-43ed-ad86-ec50a7403c29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:17.191995 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e94ab5-4c89-43ed-ad86-ec50a7403c29 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:17.192346 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e94ab5-4c89-43ed-ad86-ec50a7403c29 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:17.192694 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e94ab5-4c89-43ed-ad86-ec50a7403c29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:17.257374 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2595e450-762c-4ae8-9ec3-029256fca1bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bb9b1d33b924f9fb7d7f265fa7098fb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:17.258485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2595e450-762c-4ae8-9ec3-029256fca1bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bb9b1d33b924f9fb7d7f265fa7098fb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:17.274288 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2595e450-762c-4ae8-9ec3-029256fca1bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bb9b1d33b924f9fb7d7f265fa7098fb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:17.283750 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1616/3219] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:17:16 2022] DELETE /identity/v3/users/2bb9b1d33b924f9fb7d7f265fa7098fb => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:17:17.300026 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc018d-871e-44bd-90f0-68cdfa01703c None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:17.300317 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc018d-871e-44bd-90f0-68cdfa01703c None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:17.300594 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc018d-871e-44bd-90f0-68cdfa01703c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:17.309356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e94ab5-4c89-43ed-ad86-ec50a7403c29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:17.311082 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e94ab5-4c89-43ed-ad86-ec50a7403c29 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:17.338235 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1604/3220] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:17:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:17:17.357452 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e94ab5-4c89-43ed-ad86-ec50a7403c29 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:17.374349 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-8acc018d-871e-44bd-90f0-68cdfa01703c None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:17.375564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8acc018d-871e-44bd-90f0-68cdfa01703c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:17.379080 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e94ab5-4c89-43ed-ad86-ec50a7403c29 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:17.495888 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2027a7fb-5a89-4cf9-bbbf-0afdaf3d2e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:17.496810 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027a7fb-5a89-4cf9-bbbf-0afdaf3d2e97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:17.497097 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027a7fb-5a89-4cf9-bbbf-0afdaf3d2e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:17.497376 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027a7fb-5a89-4cf9-bbbf-0afdaf3d2e97 admin admin] PATH_INFO: `/v3/users/0456dee72dcd4379ada78762526035e8` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:17.498812 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2027a7fb-5a89-4cf9-bbbf-0afdaf3d2e97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0456dee72dcd4379ada78762526035e8)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:17.501554 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2027a7fb-5a89-4cf9-bbbf-0afdaf3d2e97 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:17.505086 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1617/3221] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:17:17.587549 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc018d-871e-44bd-90f0-68cdfa01703c None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:17.590007 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8acc018d-871e-44bd-90f0-68cdfa01703c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:17.716324 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc018d-871e-44bd-90f0-68cdfa01703c None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:17.721187 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec95454-4512-4632-96d2-977e9b5b3d54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:17.722058 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec95454-4512-4632-96d2-977e9b5b3d54 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:17.722347 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec95454-4512-4632-96d2-977e9b5b3d54 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:17.722629 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec95454-4512-4632-96d2-977e9b5b3d54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:17.762280 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec95454-4512-4632-96d2-977e9b5b3d54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:17.766063 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec95454-4512-4632-96d2-977e9b5b3d54 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:17.788219 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1618/3222] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:17:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:17:17.851000 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2027a7fb-5a89-4cf9-bbbf-0afdaf3d2e97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0456dee72dcd4379ada78762526035e8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:17.881974 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2027a7fb-5a89-4cf9-bbbf-0afdaf3d2e97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0456dee72dcd4379ada78762526035e8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:18.024157 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2027a7fb-5a89-4cf9-bbbf-0afdaf3d2e97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0456dee72dcd4379ada78762526035e8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:18.037025 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2027a7fb-5a89-4cf9-bbbf-0afdaf3d2e97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0456dee72dcd4379ada78762526035e8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:18.038319 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2027a7fb-5a89-4cf9-bbbf-0afdaf3d2e97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0456dee72dcd4379ada78762526035e8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:18.047961 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1605/3223] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:17:17 2022] DELETE /identity/v3/users/0456dee72dcd4379ada78762526035e8 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:17:18.049815 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73076263-e477-45b6-a573-bb77c5d4edda None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:18.050843 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73076263-e477-45b6-a573-bb77c5d4edda None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:18.050843 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73076263-e477-45b6-a573-bb77c5d4edda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:18.074700 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-73076263-e477-45b6-a573-bb77c5d4edda None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:18.079639 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-73076263-e477-45b6-a573-bb77c5d4edda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:18.146846 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2027a7fb-5a89-4cf9-bbbf-0afdaf3d2e97 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:18.148372 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2027a7fb-5a89-4cf9-bbbf-0afdaf3d2e97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:18.161719 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1619/3224] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:17:18.163421 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2027a7fb-5a89-4cf9-bbbf-0afdaf3d2e97 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:18.169318 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72c868-4b38-484c-b75d-7ce34fa669db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:18.170394 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72c868-4b38-484c-b75d-7ce34fa669db admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:18.170912 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72c868-4b38-484c-b75d-7ce34fa669db admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:18.171420 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72c868-4b38-484c-b75d-7ce34fa669db admin admin] PATH_INFO: `/v3/users/3c1807db50564832a0c8df860642e3d1` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:18.172908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73076263-e477-45b6-a573-bb77c5d4edda None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:18.173227 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa72c868-4b38-484c-b75d-7ce34fa669db admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c1807db50564832a0c8df860642e3d1)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:18.178532 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa72c868-4b38-484c-b75d-7ce34fa669db admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:18.178904 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-73076263-e477-45b6-a573-bb77c5d4edda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:18.304993 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73076263-e477-45b6-a573-bb77c5d4edda None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:18.309664 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fb9e1-8383-4066-a9a8-eb11d080bfc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:18.310450 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fb9e1-8383-4066-a9a8-eb11d080bfc6 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:18.310809 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fb9e1-8383-4066-a9a8-eb11d080bfc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:18.311157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fb9e1-8383-4066-a9a8-eb11d080bfc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:18.322308 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9fb9e1-8383-4066-a9a8-eb11d080bfc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:18.323720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9fb9e1-8383-4066-a9a8-eb11d080bfc6 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:18.335728 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1620/3225] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:17:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:17:18.336660 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fb9e1-8383-4066-a9a8-eb11d080bfc6 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:18.338687 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7f9fb9e1-8383-4066-a9a8-eb11d080bfc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:18.427848 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-fa72c868-4b38-484c-b75d-7ce34fa669db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c1807db50564832a0c8df860642e3d1'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:18.446860 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-fa72c868-4b38-484c-b75d-7ce34fa669db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c1807db50564832a0c8df860642e3d1'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:18.475630 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fb9e1-8383-4066-a9a8-eb11d080bfc6 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:18.482218 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c54f1a-3456-4ee1-a99b-a38b6418884a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:18.482946 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c54f1a-3456-4ee1-a99b-a38b6418884a service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:18.483284 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c54f1a-3456-4ee1-a99b-a38b6418884a service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:18.483570 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c54f1a-3456-4ee1-a99b-a38b6418884a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:18.487289 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-95c54f1a-3456-4ee1-a99b-a38b6418884a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:18.553995 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-fa72c868-4b38-484c-b75d-7ce34fa669db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c1807db50564832a0c8df860642e3d1'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:18.564195 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-fa72c868-4b38-484c-b75d-7ce34fa669db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c1807db50564832a0c8df860642e3d1'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:18.565553 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-fa72c868-4b38-484c-b75d-7ce34fa669db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c1807db50564832a0c8df860642e3d1'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:18.578411 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1606/3226] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:17:18 2022] DELETE /identity/v3/users/3c1807db50564832a0c8df860642e3d1 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:17:18.585036 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8848cd-9659-4b98-b282-c477b556da37 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:18.585319 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8848cd-9659-4b98-b282-c477b556da37 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:18.587083 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8848cd-9659-4b98-b282-c477b556da37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:18.602291 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c54f1a-3456-4ee1-a99b-a38b6418884a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:18.604371 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c54f1a-3456-4ee1-a99b-a38b6418884a service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:18.615872 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1621/3227] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:17:18 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:17:18.616330 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-cf8848cd-9659-4b98-b282-c477b556da37 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:18.619033 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-cf8848cd-9659-4b98-b282-c477b556da37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:18.647999 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33208bb5-0316-48e2-b0d9-69e641e8c478 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:18.648313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33208bb5-0316-48e2-b0d9-69e641e8c478 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:18.648514 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33208bb5-0316-48e2-b0d9-69e641e8c478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:18.688259 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-33208bb5-0316-48e2-b0d9-69e641e8c478 None None] MFA Rules not processed for user `1886e7319ac64348a1b019b9329a92de`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:18.690058 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-33208bb5-0316-48e2-b0d9-69e641e8c478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:18.781380 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1607/3228] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:17:18.782990 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8848cd-9659-4b98-b282-c477b556da37 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:18.785711 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-cf8848cd-9659-4b98-b282-c477b556da37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:18.802902 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8848cd-9659-4b98-b282-c477b556da37 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:18.810397 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d65326-fe4b-45c0-82fc-386599cf1cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:18.811474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d65326-fe4b-45c0-82fc-386599cf1cae admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:18.812259 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d65326-fe4b-45c0-82fc-386599cf1cae admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:18.812523 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d65326-fe4b-45c0-82fc-386599cf1cae admin admin] PATH_INFO: `/v3/projects/4c676e3c2e8c409e8cf460d850f19142` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:18.814704 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d65326-fe4b-45c0-82fc-386599cf1cae admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c676e3c2e8c409e8cf460d850f19142)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:18.817619 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d65326-fe4b-45c0-82fc-386599cf1cae admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:18.831523 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1622/3229] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:17:18.832491 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33208bb5-0316-48e2-b0d9-69e641e8c478 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:18.834710 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-33208bb5-0316-48e2-b0d9-69e641e8c478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:18.915075 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33208bb5-0316-48e2-b0d9-69e641e8c478 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:18.919718 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96cf7e-cb2a-4ac7-81f3-d6771c4aab60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:18.920585 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96cf7e-cb2a-4ac7-81f3-d6771c4aab60 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:18.921245 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96cf7e-cb2a-4ac7-81f3-d6771c4aab60 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:18.921532 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96cf7e-cb2a-4ac7-81f3-d6771c4aab60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:18.933857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d96cf7e-cb2a-4ac7-81f3-d6771c4aab60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:18.935931 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d96cf7e-cb2a-4ac7-81f3-d6771c4aab60 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:18.948823 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1623/3230] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:17:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:17:19.063820 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-10d65326-fe4b-45c0-82fc-386599cf1cae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c676e3c2e8c409e8cf460d850f19142', 'request_id': 'req-10d65326-fe4b-45c0-82fc-386599cf1cae'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:19.076239 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-10d65326-fe4b-45c0-82fc-386599cf1cae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c676e3c2e8c409e8cf460d850f19142', 'request_id': 'req-10d65326-fe4b-45c0-82fc-386599cf1cae'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:19.083676 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96cf7e-cb2a-4ac7-81f3-d6771c4aab60 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:19.086042 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2d96cf7e-cb2a-4ac7-81f3-d6771c4aab60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:19.088769 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-10d65326-fe4b-45c0-82fc-386599cf1cae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c676e3c2e8c409e8cf460d850f19142', 'request_id': 'req-10d65326-fe4b-45c0-82fc-386599cf1cae'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:19.103432 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96cf7e-cb2a-4ac7-81f3-d6771c4aab60 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:19.205383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-10d65326-fe4b-45c0-82fc-386599cf1cae admin admin] The token cache is being invalidate because project 4c676e3c2e8c409e8cf460d850f19142 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:17:19.205914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-10d65326-fe4b-45c0-82fc-386599cf1cae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:19.206719 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-10d65326-fe4b-45c0-82fc-386599cf1cae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:19.212112 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1608/3231] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:17:18 2022] DELETE /identity/v3/projects/4c676e3c2e8c409e8cf460d850f19142 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:17:19.213620 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d65326-fe4b-45c0-82fc-386599cf1cae admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:19.215547 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-10d65326-fe4b-45c0-82fc-386599cf1cae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:19.269378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776de78-a4a6-42f5-bd3e-66a722b1562d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:19.270994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776de78-a4a6-42f5-bd3e-66a722b1562d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:19.272973 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776de78-a4a6-42f5-bd3e-66a722b1562d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:19.273353 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776de78-a4a6-42f5-bd3e-66a722b1562d admin admin] PATH_INFO: `/v3/projects/9cda5776322242b285e71514efc4f9d5` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:19.275626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0776de78-a4a6-42f5-bd3e-66a722b1562d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cda5776322242b285e71514efc4f9d5)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:19.288250 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0776de78-a4a6-42f5-bd3e-66a722b1562d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:19.357363 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d65326-fe4b-45c0-82fc-386599cf1cae admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:19.365582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbfaae-16e4-425b-8055-d96e8fd0aae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:19.368725 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbfaae-16e4-425b-8055-d96e8fd0aae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:19.368725 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbfaae-16e4-425b-8055-d96e8fd0aae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:19.368725 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbfaae-16e4-425b-8055-d96e8fd0aae1 admin admin] PATH_INFO: `/v3/users/4812ee7defdc4a4295d8122665167559` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:19.369222 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbfaae-16e4-425b-8055-d96e8fd0aae1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4812ee7defdc4a4295d8122665167559)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:19.371485 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbfaae-16e4-425b-8055-d96e8fd0aae1 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:19.466038 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0776de78-a4a6-42f5-bd3e-66a722b1562d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cda5776322242b285e71514efc4f9d5', 'request_id': 'req-0776de78-a4a6-42f5-bd3e-66a722b1562d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:19.472558 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0776de78-a4a6-42f5-bd3e-66a722b1562d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cda5776322242b285e71514efc4f9d5', 'request_id': 'req-0776de78-a4a6-42f5-bd3e-66a722b1562d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:19.479886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0776de78-a4a6-42f5-bd3e-66a722b1562d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cda5776322242b285e71514efc4f9d5', 'request_id': 'req-0776de78-a4a6-42f5-bd3e-66a722b1562d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:19.640248 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0776de78-a4a6-42f5-bd3e-66a722b1562d admin admin] The token cache is being invalidate because project 9cda5776322242b285e71514efc4f9d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:17:19.641326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0776de78-a4a6-42f5-bd3e-66a722b1562d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:19.642509 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0776de78-a4a6-42f5-bd3e-66a722b1562d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:19.648336 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1624/3232] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:17:19 2022] DELETE /identity/v3/projects/9cda5776322242b285e71514efc4f9d5 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:17:19.654823 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776de78-a4a6-42f5-bd3e-66a722b1562d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:19.664723 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0776de78-a4a6-42f5-bd3e-66a722b1562d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:19.706661 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-86dbfaae-16e4-425b-8055-d96e8fd0aae1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4812ee7defdc4a4295d8122665167559'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:19.732787 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-86dbfaae-16e4-425b-8055-d96e8fd0aae1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4812ee7defdc4a4295d8122665167559'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:19.803703 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-86dbfaae-16e4-425b-8055-d96e8fd0aae1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4812ee7defdc4a4295d8122665167559'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:19.806402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776de78-a4a6-42f5-bd3e-66a722b1562d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:19.816529 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-86dbfaae-16e4-425b-8055-d96e8fd0aae1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4812ee7defdc4a4295d8122665167559'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:19.820830 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-86dbfaae-16e4-425b-8055-d96e8fd0aae1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4812ee7defdc4a4295d8122665167559'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:19.821354 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046926d-0282-43ee-b86c-4c0f960d096a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:19.822464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046926d-0282-43ee-b86c-4c0f960d096a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:19.822933 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046926d-0282-43ee-b86c-4c0f960d096a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:19.823358 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046926d-0282-43ee-b86c-4c0f960d096a admin admin] PATH_INFO: `/v3/projects/a5f1dfb583df447096024572a27dc5cf` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:19.824837 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046926d-0282-43ee-b86c-4c0f960d096a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5f1dfb583df447096024572a27dc5cf)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:19.827820 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e046926d-0282-43ee-b86c-4c0f960d096a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:19.838985 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1609/3233] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:17:19 2022] DELETE /identity/v3/users/4812ee7defdc4a4295d8122665167559 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:17:19.839873 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbfaae-16e4-425b-8055-d96e8fd0aae1 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:19.845095 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-86dbfaae-16e4-425b-8055-d96e8fd0aae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:19.998765 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbfaae-16e4-425b-8055-d96e8fd0aae1 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:20.021878 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e046926d-0282-43ee-b86c-4c0f960d096a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5f1dfb583df447096024572a27dc5cf', 'request_id': 'req-e046926d-0282-43ee-b86c-4c0f960d096a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:20.036349 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e046926d-0282-43ee-b86c-4c0f960d096a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5f1dfb583df447096024572a27dc5cf', 'request_id': 'req-e046926d-0282-43ee-b86c-4c0f960d096a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:20.052016 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e046926d-0282-43ee-b86c-4c0f960d096a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5f1dfb583df447096024572a27dc5cf', 'request_id': 'req-e046926d-0282-43ee-b86c-4c0f960d096a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:20.104329 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ad6f5-f959-44ee-936f-51c33388a5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:20.107385 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ad6f5-f959-44ee-936f-51c33388a5b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:20.107385 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ad6f5-f959-44ee-936f-51c33388a5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:20.107385 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ad6f5-f959-44ee-936f-51c33388a5b5 admin admin] PATH_INFO: `/v3/users/3f011aa08b4746fa81b5c4ea4308708e` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:20.108760 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ad6f5-f959-44ee-936f-51c33388a5b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f011aa08b4746fa81b5c4ea4308708e)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:20.111526 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ad6f5-f959-44ee-936f-51c33388a5b5 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:20.191615 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e046926d-0282-43ee-b86c-4c0f960d096a admin admin] The token cache is being invalidate because project a5f1dfb583df447096024572a27dc5cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:17:20.192689 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e046926d-0282-43ee-b86c-4c0f960d096a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:20.193655 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e046926d-0282-43ee-b86c-4c0f960d096a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:20.198057 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1625/3234] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:17:19 2022] DELETE /identity/v3/projects/a5f1dfb583df447096024572a27dc5cf => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:17:20.201707 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046926d-0282-43ee-b86c-4c0f960d096a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:20.211043 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e046926d-0282-43ee-b86c-4c0f960d096a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:20.243946 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046926d-0282-43ee-b86c-4c0f960d096a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:20.249699 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf660bd0-a387-45b9-8a3f-433bddba2242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:20.250401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf660bd0-a387-45b9-8a3f-433bddba2242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:20.250781 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf660bd0-a387-45b9-8a3f-433bddba2242 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:20.251441 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf660bd0-a387-45b9-8a3f-433bddba2242 admin admin] PATH_INFO: `/v3/users/d431f3a35a6f4be8bdc01964913efa84` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:20.252445 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf660bd0-a387-45b9-8a3f-433bddba2242 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d431f3a35a6f4be8bdc01964913efa84)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:20.255606 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf660bd0-a387-45b9-8a3f-433bddba2242 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:20.448637 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-972ad6f5-f959-44ee-936f-51c33388a5b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f011aa08b4746fa81b5c4ea4308708e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:20.466690 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-972ad6f5-f959-44ee-936f-51c33388a5b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f011aa08b4746fa81b5c4ea4308708e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:20.641905 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-972ad6f5-f959-44ee-936f-51c33388a5b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f011aa08b4746fa81b5c4ea4308708e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:20.658799 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-972ad6f5-f959-44ee-936f-51c33388a5b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f011aa08b4746fa81b5c4ea4308708e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:20.660313 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-972ad6f5-f959-44ee-936f-51c33388a5b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f011aa08b4746fa81b5c4ea4308708e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:20.676843 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1610/3235] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:17:19 2022] DELETE /identity/v3/users/3f011aa08b4746fa81b5c4ea4308708e => generated 0 bytes in 834 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:17:20.680511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ad6f5-f959-44ee-936f-51c33388a5b5 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:20.703346 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-972ad6f5-f959-44ee-936f-51c33388a5b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:20.706392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-cf660bd0-a387-45b9-8a3f-433bddba2242 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd431f3a35a6f4be8bdc01964913efa84'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:20.748286 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-cf660bd0-a387-45b9-8a3f-433bddba2242 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd431f3a35a6f4be8bdc01964913efa84'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:20.839891 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ad6f5-f959-44ee-936f-51c33388a5b5 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:20.846424 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd28a91-419b-41bd-903b-16191fcb122f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:20.849702 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd28a91-419b-41bd-903b-16191fcb122f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:20.849702 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd28a91-419b-41bd-903b-16191fcb122f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:20.849702 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd28a91-419b-41bd-903b-16191fcb122f admin admin] PATH_INFO: `/v3/projects/706d0d52baa84890a5a3cb856e4681fe` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:20.849702 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd28a91-419b-41bd-903b-16191fcb122f admin admin] RBAC: Authorizing `identity:delete_project(project_id=706d0d52baa84890a5a3cb856e4681fe)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:20.852985 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd28a91-419b-41bd-903b-16191fcb122f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:21.005297 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-cf660bd0-a387-45b9-8a3f-433bddba2242 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd431f3a35a6f4be8bdc01964913efa84'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:21.005297 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-cf660bd0-a387-45b9-8a3f-433bddba2242 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd431f3a35a6f4be8bdc01964913efa84'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:21.020829 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-cf660bd0-a387-45b9-8a3f-433bddba2242 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd431f3a35a6f4be8bdc01964913efa84'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:21.035056 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1626/3236] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:17:20 2022] DELETE /identity/v3/users/d431f3a35a6f4be8bdc01964913efa84 => generated 0 bytes in 834 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:17:21.058688 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cdd28a91-419b-41bd-903b-16191fcb122f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '706d0d52baa84890a5a3cb856e4681fe', 'request_id': 'req-cdd28a91-419b-41bd-903b-16191fcb122f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:21.068008 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cdd28a91-419b-41bd-903b-16191fcb122f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '706d0d52baa84890a5a3cb856e4681fe', 'request_id': 'req-cdd28a91-419b-41bd-903b-16191fcb122f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:21.080612 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cdd28a91-419b-41bd-903b-16191fcb122f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '706d0d52baa84890a5a3cb856e4681fe', 'request_id': 'req-cdd28a91-419b-41bd-903b-16191fcb122f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:21.162845 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cdd28a91-419b-41bd-903b-16191fcb122f admin admin] The token cache is being invalidate because project 706d0d52baa84890a5a3cb856e4681fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:17:21.163194 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cdd28a91-419b-41bd-903b-16191fcb122f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:21.163864 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cdd28a91-419b-41bd-903b-16191fcb122f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:21.165955 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1611/3237] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:17:20 2022] DELETE /identity/v3/projects/706d0d52baa84890a5a3cb856e4681fe => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:17:21.171676 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7674544-9a46-42a5-962a-933aa1321c8a None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:21.172094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7674544-9a46-42a5-962a-933aa1321c8a None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:21.172555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7674544-9a46-42a5-962a-933aa1321c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:21.201378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-d7674544-9a46-42a5-962a-933aa1321c8a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:21.202806 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d7674544-9a46-42a5-962a-933aa1321c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:21.312100 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1627/3238] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:17:21.332189 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76938532-e1ee-4e67-8680-e619085e83b4 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:21.337016 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76938532-e1ee-4e67-8680-e619085e83b4 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:21.337472 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76938532-e1ee-4e67-8680-e619085e83b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:21.391997 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-76938532-e1ee-4e67-8680-e619085e83b4 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:21.399526 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-76938532-e1ee-4e67-8680-e619085e83b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:21.421866 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1612/3239] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:17:21.423338 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7674544-9a46-42a5-962a-933aa1321c8a None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:21.445522 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7674544-9a46-42a5-962a-933aa1321c8a None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:21.459905 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6850e48-c011-448b-bf4c-f06401310004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:21.461425 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6850e48-c011-448b-bf4c-f06401310004 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:21.463238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6850e48-c011-448b-bf4c-f06401310004 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:21.464298 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6850e48-c011-448b-bf4c-f06401310004 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:21.467196 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6850e48-c011-448b-bf4c-f06401310004 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:17:21.467621 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6850e48-c011-448b-bf4c-f06401310004 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:21.471199 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6850e48-c011-448b-bf4c-f06401310004 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:21.510025 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76938532-e1ee-4e67-8680-e619085e83b4 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:21.520191 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1628/3240] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:17:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:17:21.521414 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76938532-e1ee-4e67-8680-e619085e83b4 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:21.534228 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdfd6a5-8ece-4c4b-8d31-47a0af45449e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:21.540027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdfd6a5-8ece-4c4b-8d31-47a0af45449e admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:21.543481 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdfd6a5-8ece-4c4b-8d31-47a0af45449e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:21.543481 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdfd6a5-8ece-4c4b-8d31-47a0af45449e admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:21.543481 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdfd6a5-8ece-4c4b-8d31-47a0af45449e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:21.545914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdfd6a5-8ece-4c4b-8d31-47a0af45449e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:21.667633 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1613/3241] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:17:21 2022] POST /identity/v3/projects => generated 383 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:17:21.671874 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6850e48-c011-448b-bf4c-f06401310004 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:21.684092 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6850e48-c011-448b-bf4c-f06401310004 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:21.816239 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262eaf9-f438-4010-883c-1437e24fbaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:21.817237 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262eaf9-f438-4010-883c-1437e24fbaae admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:21.817719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262eaf9-f438-4010-883c-1437e24fbaae admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:21.818182 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262eaf9-f438-4010-883c-1437e24fbaae admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:21.819048 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262eaf9-f438-4010-883c-1437e24fbaae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:21.821196 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262eaf9-f438-4010-883c-1437e24fbaae admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:21.837163 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdfd6a5-8ece-4c4b-8d31-47a0af45449e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:21.840107 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6cdfd6a5-8ece-4c4b-8d31-47a0af45449e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:21.879760 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdfd6a5-8ece-4c4b-8d31-47a0af45449e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:21.893623 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11d0bd-cf95-421a-83a1-e217ddbbd757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:21.893867 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11d0bd-cf95-421a-83a1-e217ddbbd757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:21.893985 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11d0bd-cf95-421a-83a1-e217ddbbd757 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:21.894294 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11d0bd-cf95-421a-83a1-e217ddbbd757 admin admin] PATH_INFO: `/v3/projects/7b08617ff8814408b9c3347beacc6c7a` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:21.896005 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11d0bd-cf95-421a-83a1-e217ddbbd757 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b08617ff8814408b9c3347beacc6c7a)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:21.900286 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11d0bd-cf95-421a-83a1-e217ddbbd757 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:21.963300 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1629/3242] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:17:21 2022] POST /identity/v3/users => generated 292 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:17:21.963300 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262eaf9-f438-4010-883c-1437e24fbaae admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:21.984399 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262eaf9-f438-4010-883c-1437e24fbaae admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:22.006456 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac884eb-0bb3-460b-8a88-702604ea43e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:22.007358 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac884eb-0bb3-460b-8a88-702604ea43e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:22.007761 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac884eb-0bb3-460b-8a88-702604ea43e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:22.008143 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac884eb-0bb3-460b-8a88-702604ea43e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:22.008988 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac884eb-0bb3-460b-8a88-702604ea43e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:22.026015 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac884eb-0bb3-460b-8a88-702604ea43e0 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:22.044096 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1630/3243] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:17:22.051300 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac884eb-0bb3-460b-8a88-702604ea43e0 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:22.071784 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac884eb-0bb3-460b-8a88-702604ea43e0 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:22.085730 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21464a0-0026-4e69-bb10-383e60d8044f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:22.086666 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21464a0-0026-4e69-bb10-383e60d8044f admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:22.087539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21464a0-0026-4e69-bb10-383e60d8044f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:22.087539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21464a0-0026-4e69-bb10-383e60d8044f admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:22.087961 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21464a0-0026-4e69-bb10-383e60d8044f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:22.090131 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21464a0-0026-4e69-bb10-383e60d8044f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:22.101834 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1631/3244] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:17:22.106179 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21464a0-0026-4e69-bb10-383e60d8044f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:22.120256 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21464a0-0026-4e69-bb10-383e60d8044f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:22.134745 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bea94c-5041-41a8-a036-295747820a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:22.142865 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bea94c-5041-41a8-a036-295747820a22 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:22.143509 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bea94c-5041-41a8-a036-295747820a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:22.146825 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bea94c-5041-41a8-a036-295747820a22 admin admin] PATH_INFO: `/v3/projects/327a580f2f8645c28e9590806928ed91/users/1961bb1779214710bc073d188262f1fb/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:22.165416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bea94c-5041-41a8-a036-295747820a22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=327a580f2f8645c28e9590806928ed91, user_id=1961bb1779214710bc073d188262f1fb, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:22.168343 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bea94c-5041-41a8-a036-295747820a22 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:22.319451 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1632/3245] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:17:22 2022] PUT /identity/v3/projects/327a580f2f8645c28e9590806928ed91/users/1961bb1779214710bc073d188262f1fb/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:17:22.332555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bea94c-5041-41a8-a036-295747820a22 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:22.335881 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d2bea94c-5041-41a8-a036-295747820a22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:22.341435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ed11d0bd-cf95-421a-83a1-e217ddbbd757 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b08617ff8814408b9c3347beacc6c7a', 'request_id': 'req-ed11d0bd-cf95-421a-83a1-e217ddbbd757'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:22.355523 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ed11d0bd-cf95-421a-83a1-e217ddbbd757 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b08617ff8814408b9c3347beacc6c7a', 'request_id': 'req-ed11d0bd-cf95-421a-83a1-e217ddbbd757'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:22.375801 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ed11d0bd-cf95-421a-83a1-e217ddbbd757 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b08617ff8814408b9c3347beacc6c7a', 'request_id': 'req-ed11d0bd-cf95-421a-83a1-e217ddbbd757'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:22.444728 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bea94c-5041-41a8-a036-295747820a22 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:22.475281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ed11d0bd-cf95-421a-83a1-e217ddbbd757 admin admin] The token cache is being invalidate because project 7b08617ff8814408b9c3347beacc6c7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:17:22.475717 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ed11d0bd-cf95-421a-83a1-e217ddbbd757 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:22.480502 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ed11d0bd-cf95-421a-83a1-e217ddbbd757 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:22.482647 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1614/3246] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:17:21 2022] DELETE /identity/v3/projects/7b08617ff8814408b9c3347beacc6c7a => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:17:22.484241 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d390fb-6cde-442d-9fff-6de6dae87fd9 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:22.484766 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d390fb-6cde-442d-9fff-6de6dae87fd9 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:22.485173 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d390fb-6cde-442d-9fff-6de6dae87fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:22.550500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-16d390fb-6cde-442d-9fff-6de6dae87fd9 None None] MFA Rules not processed for user `1961bb1779214710bc073d188262f1fb`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:22.551575 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-16d390fb-6cde-442d-9fff-6de6dae87fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:22.580221 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23907c0-2fc6-4a10-8da4-108cf95fe605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:22.581518 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23907c0-2fc6-4a10-8da4-108cf95fe605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:22.581829 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23907c0-2fc6-4a10-8da4-108cf95fe605 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:22.583079 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23907c0-2fc6-4a10-8da4-108cf95fe605 admin admin] PATH_INFO: `/v3/projects/7d814affb19041f296fb365025aae272` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:22.588769 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23907c0-2fc6-4a10-8da4-108cf95fe605 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d814affb19041f296fb365025aae272)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:22.602599 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23907c0-2fc6-4a10-8da4-108cf95fe605 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:22.766032 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1615/3247] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:17:22.771951 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a53b3e-8cb8-4a4b-82cc-6346a354a123 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:22.773470 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a53b3e-8cb8-4a4b-82cc-6346a354a123 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:22.774731 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a53b3e-8cb8-4a4b-82cc-6346a354a123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:22.805961 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c23907c0-2fc6-4a10-8da4-108cf95fe605 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d814affb19041f296fb365025aae272', 'request_id': 'req-c23907c0-2fc6-4a10-8da4-108cf95fe605'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:22.824308 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c23907c0-2fc6-4a10-8da4-108cf95fe605 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d814affb19041f296fb365025aae272', 'request_id': 'req-c23907c0-2fc6-4a10-8da4-108cf95fe605'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:22.850873 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c23907c0-2fc6-4a10-8da4-108cf95fe605 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d814affb19041f296fb365025aae272', 'request_id': 'req-c23907c0-2fc6-4a10-8da4-108cf95fe605'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:22.874386 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-37a53b3e-8cb8-4a4b-82cc-6346a354a123 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:22.876113 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-37a53b3e-8cb8-4a4b-82cc-6346a354a123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:22.955690 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c23907c0-2fc6-4a10-8da4-108cf95fe605 admin admin] The token cache is being invalidate because project 7d814affb19041f296fb365025aae272 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:17:22.955690 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c23907c0-2fc6-4a10-8da4-108cf95fe605 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:22.956679 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c23907c0-2fc6-4a10-8da4-108cf95fe605 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:22.962313 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1633/3248] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:17:22 2022] DELETE /identity/v3/projects/7d814affb19041f296fb365025aae272 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:17:22.963381 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23907c0-2fc6-4a10-8da4-108cf95fe605 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:22.968171 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c23907c0-2fc6-4a10-8da4-108cf95fe605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:23.032326 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1616/3249] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:17:23.033928 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a53b3e-8cb8-4a4b-82cc-6346a354a123 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:23.035424 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-37a53b3e-8cb8-4a4b-82cc-6346a354a123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:23.053126 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a53b3e-8cb8-4a4b-82cc-6346a354a123 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:23.095143 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f4588f-f341-4333-bbf7-c2578c0aa1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:23.095944 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4588f-f341-4333-bbf7-c2578c0aa1da admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:23.096412 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4588f-f341-4333-bbf7-c2578c0aa1da admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:23.096703 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4588f-f341-4333-bbf7-c2578c0aa1da admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:23.099182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f4588f-f341-4333-bbf7-c2578c0aa1da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:23.101729 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f4588f-f341-4333-bbf7-c2578c0aa1da admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:23.179876 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23907c0-2fc6-4a10-8da4-108cf95fe605 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:23.202686 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464b0db-6f97-4ec8-9a75-4263c3780a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:23.203892 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464b0db-6f97-4ec8-9a75-4263c3780a7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:23.204779 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464b0db-6f97-4ec8-9a75-4263c3780a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:23.205290 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464b0db-6f97-4ec8-9a75-4263c3780a7e admin admin] PATH_INFO: `/v3/users/58114c225ebe4062af97802f266bbd6f` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:23.209976 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4464b0db-6f97-4ec8-9a75-4263c3780a7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=58114c225ebe4062af97802f266bbd6f)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:23.212524 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4464b0db-6f97-4ec8-9a75-4263c3780a7e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:23.224267 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1617/3250] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:17:23 2022] POST /identity/v3/projects => generated 381 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:17:23.226543 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360897f6-71eb-42f9-a2ef-063cc0daea02 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:23.243571 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360897f6-71eb-42f9-a2ef-063cc0daea02 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:23.257720 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360897f6-71eb-42f9-a2ef-063cc0daea02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:23.329275 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-360897f6-71eb-42f9-a2ef-063cc0daea02 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:23.331302 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-360897f6-71eb-42f9-a2ef-063cc0daea02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:23.507049 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1618/3251] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:17:23.517790 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64268dc4-f815-4724-85ca-60f506ecded9 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:23.518419 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64268dc4-f815-4724-85ca-60f506ecded9 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:23.518915 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64268dc4-f815-4724-85ca-60f506ecded9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:23.524165 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4464b0db-6f97-4ec8-9a75-4263c3780a7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58114c225ebe4062af97802f266bbd6f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:23.546250 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4464b0db-6f97-4ec8-9a75-4263c3780a7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58114c225ebe4062af97802f266bbd6f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:23.549212 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-64268dc4-f815-4724-85ca-60f506ecded9 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:23.550969 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-64268dc4-f815-4724-85ca-60f506ecded9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:23.580625 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1619/3252] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:17:23.580625 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64268dc4-f815-4724-85ca-60f506ecded9 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:23.594465 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64268dc4-f815-4724-85ca-60f506ecded9 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:23.601687 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209cf87-7445-4d7c-99d6-bded6398ddcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:23.601687 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209cf87-7445-4d7c-99d6-bded6398ddcc admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:23.603429 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209cf87-7445-4d7c-99d6-bded6398ddcc admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:23.603429 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209cf87-7445-4d7c-99d6-bded6398ddcc admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:23.603710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9209cf87-7445-4d7c-99d6-bded6398ddcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:23.608572 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9209cf87-7445-4d7c-99d6-bded6398ddcc admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:23.657602 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4464b0db-6f97-4ec8-9a75-4263c3780a7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58114c225ebe4062af97802f266bbd6f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:23.658720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4464b0db-6f97-4ec8-9a75-4263c3780a7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58114c225ebe4062af97802f266bbd6f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:23.671080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4464b0db-6f97-4ec8-9a75-4263c3780a7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58114c225ebe4062af97802f266bbd6f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:23.686461 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1634/3253] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:17:22 2022] DELETE /identity/v3/users/58114c225ebe4062af97802f266bbd6f => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:17:23.688546 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a79c88-28a8-497a-8973-d0b99ed09f67 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:23.688839 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a79c88-28a8-497a-8973-d0b99ed09f67 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:23.689158 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a79c88-28a8-497a-8973-d0b99ed09f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:23.710698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-63a79c88-28a8-497a-8973-d0b99ed09f67 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:23.711937 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-63a79c88-28a8-497a-8973-d0b99ed09f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:23.761567 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1620/3254] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:17:23 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:17:23.762555 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209cf87-7445-4d7c-99d6-bded6398ddcc admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:23.764302 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9209cf87-7445-4d7c-99d6-bded6398ddcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:23.781063 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209cf87-7445-4d7c-99d6-bded6398ddcc admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:23.813376 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1635/3255] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:17:23.815880 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a79c88-28a8-497a-8973-d0b99ed09f67 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:23.819994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-63a79c88-28a8-497a-8973-d0b99ed09f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:23.840590 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a79c88-28a8-497a-8973-d0b99ed09f67 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:23.855319 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83414d1d-2e16-48fd-9ea1-f4dda2f3d625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:23.857050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83414d1d-2e16-48fd-9ea1-f4dda2f3d625 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:23.857833 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83414d1d-2e16-48fd-9ea1-f4dda2f3d625 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:23.860081 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83414d1d-2e16-48fd-9ea1-f4dda2f3d625 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:23.861215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83414d1d-2e16-48fd-9ea1-f4dda2f3d625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:23.873606 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83414d1d-2e16-48fd-9ea1-f4dda2f3d625 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:23.873923 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1842f-0c20-4ae1-ac46-a190217bcdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:23.873923 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1842f-0c20-4ae1-ac46-a190217bcdc4 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:23.873923 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1842f-0c20-4ae1-ac46-a190217bcdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:23.873923 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1842f-0c20-4ae1-ac46-a190217bcdc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:23.874319 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb1842f-0c20-4ae1-ac46-a190217bcdc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:17:23.874973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb1842f-0c20-4ae1-ac46-a190217bcdc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:23.877154 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb1842f-0c20-4ae1-ac46-a190217bcdc4 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:23.880885 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1636/3256] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:17:23 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:17:23.890497 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83414d1d-2e16-48fd-9ea1-f4dda2f3d625 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:23.892395 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1621/3257] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:17:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:17:23.893394 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1842f-0c20-4ae1-ac46-a190217bcdc4 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:23.904244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1842f-0c20-4ae1-ac46-a190217bcdc4 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:23.905854 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83414d1d-2e16-48fd-9ea1-f4dda2f3d625 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:23.911100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ce74f-54de-4990-b888-5bc18c2259f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:23.912401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ce74f-54de-4990-b888-5bc18c2259f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:23.912845 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ce74f-54de-4990-b888-5bc18c2259f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:23.913266 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ce74f-54de-4990-b888-5bc18c2259f9 admin admin] PATH_INFO: `/v3/projects/e6cffe1eb35d4bd7b646d590aa056a0c/users/004b17a911d1414599dec4c0f3ced227/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:23.915998 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b239555-bd08-4f4c-94af-4eb504accdd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:23.925627 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b239555-bd08-4f4c-94af-4eb504accdd0 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:23.930726 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b239555-bd08-4f4c-94af-4eb504accdd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:23.932667 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b239555-bd08-4f4c-94af-4eb504accdd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:23.933947 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b239555-bd08-4f4c-94af-4eb504accdd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:17:23.935534 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b239555-bd08-4f4c-94af-4eb504accdd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:23.938690 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b239555-bd08-4f4c-94af-4eb504accdd0 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:23.945338 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ce74f-54de-4990-b888-5bc18c2259f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6cffe1eb35d4bd7b646d590aa056a0c, user_id=004b17a911d1414599dec4c0f3ced227, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:23.948363 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ce74f-54de-4990-b888-5bc18c2259f9 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:23.985734 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1637/3258] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:17:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:17:23.987344 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b239555-bd08-4f4c-94af-4eb504accdd0 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:24.002840 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b239555-bd08-4f4c-94af-4eb504accdd0 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:24.008981 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc54391-9030-4ceb-8587-086c719f5f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:24.009655 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc54391-9030-4ceb-8587-086c719f5f58 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:24.009976 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc54391-9030-4ceb-8587-086c719f5f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:24.010254 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc54391-9030-4ceb-8587-086c719f5f58 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:24.011445 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc54391-9030-4ceb-8587-086c719f5f58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:24.013795 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc54391-9030-4ceb-8587-086c719f5f58 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:24.029634 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1622/3259] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:17:23 2022] PUT /identity/v3/projects/e6cffe1eb35d4bd7b646d590aa056a0c/users/004b17a911d1414599dec4c0f3ced227/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:17:24.030428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ce74f-54de-4990-b888-5bc18c2259f9 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:24.142006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ce74f-54de-4990-b888-5bc18c2259f9 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:24.148543 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf2c61-55b7-4a84-8c01-2e6f209ac974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:24.149356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf2c61-55b7-4a84-8c01-2e6f209ac974 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:24.149647 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf2c61-55b7-4a84-8c01-2e6f209ac974 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:24.149973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf2c61-55b7-4a84-8c01-2e6f209ac974 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:24.150681 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaf2c61-55b7-4a84-8c01-2e6f209ac974 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:24.153167 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaf2c61-55b7-4a84-8c01-2e6f209ac974 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:24.193430 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1638/3260] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:17:23 2022] POST /identity/v3/projects => generated 375 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:17:24.195137 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc54391-9030-4ceb-8587-086c719f5f58 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:24.287959 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1623/3261] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:17:24 2022] POST /identity/v3/projects => generated 387 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:17:24.288837 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf2c61-55b7-4a84-8c01-2e6f209ac974 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:24.310523 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc54391-9030-4ceb-8587-086c719f5f58 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:24.432932 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf2c61-55b7-4a84-8c01-2e6f209ac974 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:24.446619 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344c79d-fe78-408b-b081-7faa7cfbb3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:24.446619 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344c79d-fe78-408b-b081-7faa7cfbb3f9 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:24.446619 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344c79d-fe78-408b-b081-7faa7cfbb3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:24.446619 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344c79d-fe78-408b-b081-7faa7cfbb3f9 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:24.446978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344c79d-fe78-408b-b081-7faa7cfbb3f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:24.446978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344c79d-fe78-408b-b081-7faa7cfbb3f9 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:24.482703 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14680ea2-e170-495d-a2a9-59d637d7a271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:24.482703 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14680ea2-e170-495d-a2a9-59d637d7a271 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:24.482703 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14680ea2-e170-495d-a2a9-59d637d7a271 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:24.482703 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14680ea2-e170-495d-a2a9-59d637d7a271 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:24.483184 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14680ea2-e170-495d-a2a9-59d637d7a271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:24.483184 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14680ea2-e170-495d-a2a9-59d637d7a271 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:24.499214 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1639/3262] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:17:24.499214 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14680ea2-e170-495d-a2a9-59d637d7a271 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:24.499531 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-14680ea2-e170-495d-a2a9-59d637d7a271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:24.527229 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14680ea2-e170-495d-a2a9-59d637d7a271 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:24.535370 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71662aad-646e-4f90-a469-f6877c404636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:24.536577 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71662aad-646e-4f90-a469-f6877c404636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:24.536942 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71662aad-646e-4f90-a469-f6877c404636 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:24.537295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71662aad-646e-4f90-a469-f6877c404636 admin admin] PATH_INFO: `/v3/projects/e06b74e20cb74d5f9eb71ef0ad13dc99` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:24.539885 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71662aad-646e-4f90-a469-f6877c404636 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e06b74e20cb74d5f9eb71ef0ad13dc99)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:24.542720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71662aad-646e-4f90-a469-f6877c404636 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:24.560348 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1624/3263] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:17:24 2022] POST /identity/v3/users => generated 288 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:17:24.561332 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344c79d-fe78-408b-b081-7faa7cfbb3f9 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:24.573505 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344c79d-fe78-408b-b081-7faa7cfbb3f9 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:24.583253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59290d-f3a0-4a4c-8210-8a30df48db83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:24.585235 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59290d-f3a0-4a4c-8210-8a30df48db83 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:24.585235 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59290d-f3a0-4a4c-8210-8a30df48db83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:24.585235 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59290d-f3a0-4a4c-8210-8a30df48db83 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:24.586190 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59290d-f3a0-4a4c-8210-8a30df48db83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:24.592769 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59290d-f3a0-4a4c-8210-8a30df48db83 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:24.710636 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-71662aad-646e-4f90-a469-f6877c404636 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e06b74e20cb74d5f9eb71ef0ad13dc99', 'request_id': 'req-71662aad-646e-4f90-a469-f6877c404636'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:24.718970 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-71662aad-646e-4f90-a469-f6877c404636 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e06b74e20cb74d5f9eb71ef0ad13dc99', 'request_id': 'req-71662aad-646e-4f90-a469-f6877c404636'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:24.732583 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1625/3264] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:17:24 2022] POST /identity/v3/users => generated 294 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:17:24.745184 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59290d-f3a0-4a4c-8210-8a30df48db83 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:24.745443 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-71662aad-646e-4f90-a469-f6877c404636 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e06b74e20cb74d5f9eb71ef0ad13dc99', 'request_id': 'req-71662aad-646e-4f90-a469-f6877c404636'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:24.757344 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59290d-f3a0-4a4c-8210-8a30df48db83 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:24.835314 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-71662aad-646e-4f90-a469-f6877c404636 admin admin] The token cache is being invalidate because project e06b74e20cb74d5f9eb71ef0ad13dc99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:17:24.835598 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-71662aad-646e-4f90-a469-f6877c404636 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:24.836770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-71662aad-646e-4f90-a469-f6877c404636 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:24.839110 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1640/3265] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:17:24 2022] DELETE /identity/v3/projects/e06b74e20cb74d5f9eb71ef0ad13dc99 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:17:24.842653 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71662aad-646e-4f90-a469-f6877c404636 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:24.845090 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-71662aad-646e-4f90-a469-f6877c404636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:24.848561 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd85e8a-6b03-4239-981f-32c8ab88b666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:24.850429 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd85e8a-6b03-4239-981f-32c8ab88b666 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:24.850710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd85e8a-6b03-4239-981f-32c8ab88b666 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:24.852610 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd85e8a-6b03-4239-981f-32c8ab88b666 admin admin] PATH_INFO: `/v3/projects/e6cffe1eb35d4bd7b646d590aa056a0c/users/004b17a911d1414599dec4c0f3ced227/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:24.857635 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd85e8a-6b03-4239-981f-32c8ab88b666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6cffe1eb35d4bd7b646d590aa056a0c, user_id=004b17a911d1414599dec4c0f3ced227, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:24.868264 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd85e8a-6b03-4239-981f-32c8ab88b666 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:24.876917 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71662aad-646e-4f90-a469-f6877c404636 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:24.894212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86674185-c8d6-47a1-917d-3a88c15f33a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:24.896629 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86674185-c8d6-47a1-917d-3a88c15f33a7 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:24.897181 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86674185-c8d6-47a1-917d-3a88c15f33a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:24.897765 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86674185-c8d6-47a1-917d-3a88c15f33a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:24.898790 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86674185-c8d6-47a1-917d-3a88c15f33a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:24.901680 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86674185-c8d6-47a1-917d-3a88c15f33a7 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:24.903770 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1626/3266] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:17:24 2022] PUT /identity/v3/projects/e6cffe1eb35d4bd7b646d590aa056a0c/users/004b17a911d1414599dec4c0f3ced227/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:17:24.904883 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd85e8a-6b03-4239-981f-32c8ab88b666 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:24.916246 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3bd85e8a-6b03-4239-981f-32c8ab88b666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:24.925204 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1641/3267] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:17:24.931404 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea26bd-6611-4555-9c48-79caf3a65294 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:24.932506 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea26bd-6611-4555-9c48-79caf3a65294 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:24.932994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea26bd-6611-4555-9c48-79caf3a65294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:24.961135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-49ea26bd-6611-4555-9c48-79caf3a65294 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:24.963021 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-49ea26bd-6611-4555-9c48-79caf3a65294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:25.022815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd85e8a-6b03-4239-981f-32c8ab88b666 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:25.038086 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ced1d-8429-41a1-93d4-8cf146e0b444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:25.039035 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ced1d-8429-41a1-93d4-8cf146e0b444 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:25.039484 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ced1d-8429-41a1-93d4-8cf146e0b444 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:25.039947 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ced1d-8429-41a1-93d4-8cf146e0b444 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:25.040853 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ced1d-8429-41a1-93d4-8cf146e0b444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:25.043026 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ced1d-8429-41a1-93d4-8cf146e0b444 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:25.069530 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1642/3268] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:17:25.071337 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9f37e-ade9-4b7a-ade7-818652ce3e90 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:25.073344 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9f37e-ade9-4b7a-ade7-818652ce3e90 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:25.073891 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9f37e-ade9-4b7a-ade7-818652ce3e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:25.078018 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1627/3269] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:17:25.079804 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ced1d-8429-41a1-93d4-8cf146e0b444 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:25.115367 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-c2d9f37e-ade9-4b7a-ade7-818652ce3e90 None None] MFA Rules not processed for user `004b17a911d1414599dec4c0f3ced227`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:25.115605 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ced1d-8429-41a1-93d4-8cf146e0b444 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:25.117555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c2d9f37e-ade9-4b7a-ade7-818652ce3e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:25.122681 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd4c20-47e8-4655-87f9-840551d839dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:25.123338 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd4c20-47e8-4655-87f9-840551d839dc admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:25.123624 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd4c20-47e8-4655-87f9-840551d839dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:25.124162 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd4c20-47e8-4655-87f9-840551d839dc admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:25.124913 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd4c20-47e8-4655-87f9-840551d839dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:25.127320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd4c20-47e8-4655-87f9-840551d839dc admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:25.147813 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1628/3270] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:17:25.149434 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96de49-5f70-4a49-aa57-dc1803f41750 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:25.149725 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96de49-5f70-4a49-aa57-dc1803f41750 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:25.149934 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96de49-5f70-4a49-aa57-dc1803f41750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:25.176771 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-be96de49-5f70-4a49-aa57-dc1803f41750 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:25.178189 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-be96de49-5f70-4a49-aa57-dc1803f41750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:25.191072 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1629/3271] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:17:25.196662 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be96de49-5f70-4a49-aa57-dc1803f41750 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:25.240832 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be96de49-5f70-4a49-aa57-dc1803f41750 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:25.246994 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56927ef-2a16-41a7-921f-cf39037b0dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:25.247688 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56927ef-2a16-41a7-921f-cf39037b0dcf admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:25.248195 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56927ef-2a16-41a7-921f-cf39037b0dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:25.248485 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56927ef-2a16-41a7-921f-cf39037b0dcf admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:25.249889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56927ef-2a16-41a7-921f-cf39037b0dcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:25.252854 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56927ef-2a16-41a7-921f-cf39037b0dcf admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:25.264492 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1643/3272] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:25 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:17:25.265793 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9f37e-ade9-4b7a-ade7-818652ce3e90 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:25.290765 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1630/3273] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:17:25.291762 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56927ef-2a16-41a7-921f-cf39037b0dcf admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:25.302371 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9f37e-ade9-4b7a-ade7-818652ce3e90 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:25.304715 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56927ef-2a16-41a7-921f-cf39037b0dcf admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:25.312658 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c7455-f748-4356-a564-8696db100f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:25.313910 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e647d9d-04c7-4e00-a888-c7e464c76f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:25.314677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e647d9d-04c7-4e00-a888-c7e464c76f93 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:25.314957 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c7455-f748-4356-a564-8696db100f9f admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:25.315074 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e647d9d-04c7-4e00-a888-c7e464c76f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:25.315546 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e647d9d-04c7-4e00-a888-c7e464c76f93 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:25.315982 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c7455-f748-4356-a564-8696db100f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:25.316297 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e647d9d-04c7-4e00-a888-c7e464c76f93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:17:25.316722 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e647d9d-04c7-4e00-a888-c7e464c76f93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:25.317583 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c7455-f748-4356-a564-8696db100f9f admin admin] PATH_INFO: `/v3/projects/7eac2a1411444a6293feba25da6fead3/users/6a323f0848cb404092fe96f6c4168468/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:25.319642 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e647d9d-04c7-4e00-a888-c7e464c76f93 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:25.334465 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1631/3274] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:17:25.336378 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0443901b-0a7a-493a-a076-cd16713e7dbb None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:25.336791 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0443901b-0a7a-493a-a076-cd16713e7dbb None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:25.337089 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0443901b-0a7a-493a-a076-cd16713e7dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:25.343713 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c7455-f748-4356-a564-8696db100f9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eac2a1411444a6293feba25da6fead3, user_id=6a323f0848cb404092fe96f6c4168468, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:25.348556 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c7455-f748-4356-a564-8696db100f9f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:25.359515 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-0443901b-0a7a-493a-a076-cd16713e7dbb None None] MFA Rules not processed for user `1961bb1779214710bc073d188262f1fb`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:25.361314 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0443901b-0a7a-493a-a076-cd16713e7dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:25.434636 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1644/3275] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:17:25 2022] PUT /identity/v3/projects/7eac2a1411444a6293feba25da6fead3/users/6a323f0848cb404092fe96f6c4168468/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:17:25.436216 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c7455-f748-4356-a564-8696db100f9f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:25.455489 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1632/3276] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:17:25.456362 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0443901b-0a7a-493a-a076-cd16713e7dbb None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:25.479952 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0443901b-0a7a-493a-a076-cd16713e7dbb None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:25.533685 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c7455-f748-4356-a564-8696db100f9f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:25.539157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05b488-a4d9-4366-9482-cdcf53025f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:25.540180 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05b488-a4d9-4366-9482-cdcf53025f96 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:25.540477 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05b488-a4d9-4366-9482-cdcf53025f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:25.540742 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05b488-a4d9-4366-9482-cdcf53025f96 admin admin] PATH_INFO: `/v3/projects/4b8bfd0b09264e32a4ded1046a12619d/users/93ef60674ddb4b588503c4111fbc3c3c/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:25.556965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e88b4-e1b9-4a26-9805-7d991a9cd36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:25.557625 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05b488-a4d9-4366-9482-cdcf53025f96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b8bfd0b09264e32a4ded1046a12619d, user_id=93ef60674ddb4b588503c4111fbc3c3c, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:25.558772 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e88b4-e1b9-4a26-9805-7d991a9cd36f admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:25.558904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e88b4-e1b9-4a26-9805-7d991a9cd36f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:25.559165 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e88b4-e1b9-4a26-9805-7d991a9cd36f admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:25.559854 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e88b4-e1b9-4a26-9805-7d991a9cd36f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:25.561130 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05b488-a4d9-4366-9482-cdcf53025f96 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:25.561998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e88b4-e1b9-4a26-9805-7d991a9cd36f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:25.668303 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1645/3277] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:17:25 2022] PUT /identity/v3/projects/4b8bfd0b09264e32a4ded1046a12619d/users/93ef60674ddb4b588503c4111fbc3c3c/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:17:25.669781 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42edb2-0718-45e9-9e2e-aad66bc4c5d8 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:25.670140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42edb2-0718-45e9-9e2e-aad66bc4c5d8 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:25.670355 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42edb2-0718-45e9-9e2e-aad66bc4c5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:25.695612 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1633/3278] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:17:25 2022] POST /identity/v3/projects => generated 367 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:17:25.696900 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e88b4-e1b9-4a26-9805-7d991a9cd36f admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:25.700616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1c4e88b4-e1b9-4a26-9805-7d991a9cd36f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:25.705367 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-2f42edb2-0718-45e9-9e2e-aad66bc4c5d8 None None] MFA Rules not processed for user `6a323f0848cb404092fe96f6c4168468`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:25.706983 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2f42edb2-0718-45e9-9e2e-aad66bc4c5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:25.800018 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e88b4-e1b9-4a26-9805-7d991a9cd36f admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:25.803130 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1646/3279] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:17:25.804641 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8a996-20b3-4726-a2ad-4ed03271f937 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:25.805000 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8a996-20b3-4726-a2ad-4ed03271f937 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:25.805339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8a996-20b3-4726-a2ad-4ed03271f937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:25.818493 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10cbf8a-4875-4daa-ab07-345e9c330b08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:25.819636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cbf8a-4875-4daa-ab07-345e9c330b08 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:25.820107 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cbf8a-4875-4daa-ab07-345e9c330b08 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:25.820540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cbf8a-4875-4daa-ab07-345e9c330b08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:25.822875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a10cbf8a-4875-4daa-ab07-345e9c330b08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:25.825804 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-01d8a996-20b3-4726-a2ad-4ed03271f937 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:25.827295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-01d8a996-20b3-4726-a2ad-4ed03271f937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:25.904134 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10cbf8a-4875-4daa-ab07-345e9c330b08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:25.906164 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10cbf8a-4875-4daa-ab07-345e9c330b08 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:25.907202 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1647/3280] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:17:25.908111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8a996-20b3-4726-a2ad-4ed03271f937 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:25.927579 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1634/3281] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:17:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:17:25.928508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10cbf8a-4875-4daa-ab07-345e9c330b08 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:25.938475 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8a996-20b3-4726-a2ad-4ed03271f937 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:25.945590 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d1550-8c22-46b6-b204-ad0e4c1e0bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:25.947673 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d1550-8c22-46b6-b204-ad0e4c1e0bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:25.948140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d1550-8c22-46b6-b204-ad0e4c1e0bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:25.948580 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d1550-8c22-46b6-b204-ad0e4c1e0bc9 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:25.950160 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d1550-8c22-46b6-b204-ad0e4c1e0bc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:25.952297 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d1550-8c22-46b6-b204-ad0e4c1e0bc9 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:25.975628 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10cbf8a-4875-4daa-ab07-345e9c330b08 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:25.983383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d895f-3bdc-4dc3-bf23-ed1d904f278a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:25.983805 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d895f-3bdc-4dc3-bf23-ed1d904f278a admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:25.984386 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d895f-3bdc-4dc3-bf23-ed1d904f278a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:25.985928 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d895f-3bdc-4dc3-bf23-ed1d904f278a admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:25.986720 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2d895f-3bdc-4dc3-bf23-ed1d904f278a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:25.988741 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2d895f-3bdc-4dc3-bf23-ed1d904f278a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:26.148575 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1648/3282] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:17:25 2022] POST /identity/v3/users => generated 284 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:17:26.148815 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1635/3283] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:17:25 2022] POST /identity/v3/projects => generated 375 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:17:26.148815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d895f-3bdc-4dc3-bf23-ed1d904f278a admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:26.150921 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d1550-8c22-46b6-b204-ad0e4c1e0bc9 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:26.151130 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2a2d895f-3bdc-4dc3-bf23-ed1d904f278a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:26.167914 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d1550-8c22-46b6-b204-ad0e4c1e0bc9 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:26.239861 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d895f-3bdc-4dc3-bf23-ed1d904f278a admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:26.243811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df2a5f-9c1d-4c8b-9404-42cddb4a5d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:26.244485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df2a5f-9c1d-4c8b-9404-42cddb4a5d28 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:26.244767 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df2a5f-9c1d-4c8b-9404-42cddb4a5d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:26.245041 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df2a5f-9c1d-4c8b-9404-42cddb4a5d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:26.246149 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df2a5f-9c1d-4c8b-9404-42cddb4a5d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:26.246303 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046550e-2470-488f-8047-d5436f416834 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:26.246906 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046550e-2470-488f-8047-d5436f416834 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:26.247454 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df2a5f-9c1d-4c8b-9404-42cddb4a5d28 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:26.248048 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046550e-2470-488f-8047-d5436f416834 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:26.251386 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046550e-2470-488f-8047-d5436f416834 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:26.264407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046550e-2470-488f-8047-d5436f416834 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:26.265060 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1649/3284] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:17:26.266001 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046550e-2470-488f-8047-d5436f416834 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:26.267250 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df2a5f-9c1d-4c8b-9404-42cddb4a5d28 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:26.285315 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df2a5f-9c1d-4c8b-9404-42cddb4a5d28 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:26.293730 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1a6ad-dfd9-406c-a31a-f7acf172463a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:26.295712 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1a6ad-dfd9-406c-a31a-f7acf172463a admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:26.296073 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1a6ad-dfd9-406c-a31a-f7acf172463a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:26.296299 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1636/3285] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:17:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:17:26.296437 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1a6ad-dfd9-406c-a31a-f7acf172463a admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:26.297816 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a1a6ad-dfd9-406c-a31a-f7acf172463a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:26.298389 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046550e-2470-488f-8047-d5436f416834 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:26.299893 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a1a6ad-dfd9-406c-a31a-f7acf172463a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:26.310742 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046550e-2470-488f-8047-d5436f416834 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:26.316382 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3cbdde-4378-4e37-aeef-441ca9f2a004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:26.317105 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3cbdde-4378-4e37-aeef-441ca9f2a004 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:26.317415 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3cbdde-4378-4e37-aeef-441ca9f2a004 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:26.319573 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3cbdde-4378-4e37-aeef-441ca9f2a004 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:26.319573 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3cbdde-4378-4e37-aeef-441ca9f2a004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:26.322322 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3cbdde-4378-4e37-aeef-441ca9f2a004 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:26.335339 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1637/3286] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:17:26.339515 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3cbdde-4378-4e37-aeef-441ca9f2a004 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:26.352085 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3cbdde-4378-4e37-aeef-441ca9f2a004 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:26.358277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a1cc0-786f-4a1d-850a-56d49e3ee4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:26.359439 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a1cc0-786f-4a1d-850a-56d49e3ee4c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:26.360419 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a1cc0-786f-4a1d-850a-56d49e3ee4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:26.361079 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a1cc0-786f-4a1d-850a-56d49e3ee4c1 admin admin] PATH_INFO: `/v3/projects/7c032d189cb14ea297194dffa380eae5/users/bfe17212ef4a49fd954bbf17317ccd67/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:26.385416 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14a1cc0-786f-4a1d-850a-56d49e3ee4c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c032d189cb14ea297194dffa380eae5, user_id=bfe17212ef4a49fd954bbf17317ccd67, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:26.388856 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14a1cc0-786f-4a1d-850a-56d49e3ee4c1 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:26.428241 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1650/3287] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:17:26 2022] POST /identity/v3/users => generated 294 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:17:26.432102 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1a6ad-dfd9-406c-a31a-f7acf172463a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:26.448048 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1a6ad-dfd9-406c-a31a-f7acf172463a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:26.454459 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351a103-003f-46a2-9c59-46ce3ad5cec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:26.457830 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351a103-003f-46a2-9c59-46ce3ad5cec0 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:26.457830 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351a103-003f-46a2-9c59-46ce3ad5cec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:26.457830 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351a103-003f-46a2-9c59-46ce3ad5cec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:26.457830 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3351a103-003f-46a2-9c59-46ce3ad5cec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:26.458662 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3351a103-003f-46a2-9c59-46ce3ad5cec0 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:26.477047 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1651/3288] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:17:26.478315 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351a103-003f-46a2-9c59-46ce3ad5cec0 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:26.490916 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351a103-003f-46a2-9c59-46ce3ad5cec0 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:26.497220 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bed348-bdba-4f0b-a3bb-2bc4dd4b051a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:26.498485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bed348-bdba-4f0b-a3bb-2bc4dd4b051a admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:26.498770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bed348-bdba-4f0b-a3bb-2bc4dd4b051a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:26.499767 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bed348-bdba-4f0b-a3bb-2bc4dd4b051a admin admin] PATH_INFO: `/v3/projects/4255d81171bc4214abc58ec087bc8237/users/04b1d648bf5549249e4be31cd46419f1/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:26.524136 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1638/3289] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:17:26 2022] PUT /identity/v3/projects/7c032d189cb14ea297194dffa380eae5/users/bfe17212ef4a49fd954bbf17317ccd67/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:17:26.527465 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bed348-bdba-4f0b-a3bb-2bc4dd4b051a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4255d81171bc4214abc58ec087bc8237, user_id=04b1d648bf5549249e4be31cd46419f1, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:26.532463 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358756a8-eb15-4f18-bd61-fff60226950a None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:26.532753 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358756a8-eb15-4f18-bd61-fff60226950a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:26.533035 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358756a8-eb15-4f18-bd61-fff60226950a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:26.534023 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bed348-bdba-4f0b-a3bb-2bc4dd4b051a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:26.585226 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-358756a8-eb15-4f18-bd61-fff60226950a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:26.600851 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-358756a8-eb15-4f18-bd61-fff60226950a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:26.695748 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1652/3290] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:17:26 2022] PUT /identity/v3/projects/4255d81171bc4214abc58ec087bc8237/users/04b1d648bf5549249e4be31cd46419f1/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:17:26.702375 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bed348-bdba-4f0b-a3bb-2bc4dd4b051a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:26.709354 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1639/3291] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:17:26.744977 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358756a8-eb15-4f18-bd61-fff60226950a None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:26.747429 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-358756a8-eb15-4f18-bd61-fff60226950a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:26.919525 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358756a8-eb15-4f18-bd61-fff60226950a None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:26.968453 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bed348-bdba-4f0b-a3bb-2bc4dd4b051a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:27.002794 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329a268-a932-48d3-a1e7-ad42d7c87f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:27.004083 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329a268-a932-48d3-a1e7-ad42d7c87f6b admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:27.004606 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329a268-a932-48d3-a1e7-ad42d7c87f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:27.004969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329a268-a932-48d3-a1e7-ad42d7c87f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:27.005717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329a268-a932-48d3-a1e7-ad42d7c87f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:27.017885 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329a268-a932-48d3-a1e7-ad42d7c87f6b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:27.021182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196f217-d676-4437-b790-a1842fc05c4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:27.025715 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196f217-d676-4437-b790-a1842fc05c4d service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:27.025715 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196f217-d676-4437-b790-a1842fc05c4d service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:27.025715 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196f217-d676-4437-b790-a1842fc05c4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:27.052172 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1196f217-d676-4437-b790-a1842fc05c4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:27.056974 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1196f217-d676-4437-b790-a1842fc05c4d service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:27.067747 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1653/3292] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:17:27.077774 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329a268-a932-48d3-a1e7-ad42d7c87f6b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:27.089086 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1640/3293] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:17:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:17:27.133059 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329a268-a932-48d3-a1e7-ad42d7c87f6b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:27.141380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd9e89-2819-46ea-ac1d-55fc05aa7b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:27.142316 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd9e89-2819-46ea-ac1d-55fc05aa7b2f admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:27.142598 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd9e89-2819-46ea-ac1d-55fc05aa7b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:27.142870 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd9e89-2819-46ea-ac1d-55fc05aa7b2f admin admin] PATH_INFO: `/v3/projects/4255d81171bc4214abc58ec087bc8237/users/04b1d648bf5549249e4be31cd46419f1/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:27.155451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd9e89-2819-46ea-ac1d-55fc05aa7b2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4255d81171bc4214abc58ec087bc8237, user_id=04b1d648bf5549249e4be31cd46419f1, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:27.158232 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd9e89-2819-46ea-ac1d-55fc05aa7b2f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:27.189194 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1654/3294] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:17:27 2022] PUT /identity/v3/projects/4255d81171bc4214abc58ec087bc8237/users/04b1d648bf5549249e4be31cd46419f1/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:17:27.196013 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd360df-80d8-4568-92ab-aab665756410 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:27.196568 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd360df-80d8-4568-92ab-aab665756410 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:27.197025 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd360df-80d8-4568-92ab-aab665756410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:27.245343 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-bbd360df-80d8-4568-92ab-aab665756410 None None] MFA Rules not processed for user `04b1d648bf5549249e4be31cd46419f1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:27.246762 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-bbd360df-80d8-4568-92ab-aab665756410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:27.393379 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1641/3295] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:27 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:17:27.404852 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6d860-cea7-412b-a838-960761f8b533 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:27.405800 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6d860-cea7-412b-a838-960761f8b533 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:27.405800 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6d860-cea7-412b-a838-960761f8b533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:27.432576 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-f6c6d860-cea7-412b-a838-960761f8b533 None None] MFA Rules not processed for user `6a323f0848cb404092fe96f6c4168468`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:27.434242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f6c6d860-cea7-412b-a838-960761f8b533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:27.504578 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1655/3296] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:17:27.516454 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd360df-80d8-4568-92ab-aab665756410 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:27.521300 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-bbd360df-80d8-4568-92ab-aab665756410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:27.615432 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd360df-80d8-4568-92ab-aab665756410 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:27.623150 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ce2f1-217b-42a9-bb58-51cbaeba1c11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:27.623916 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ce2f1-217b-42a9-bb58-51cbaeba1c11 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:27.624204 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ce2f1-217b-42a9-bb58-51cbaeba1c11 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:27.624483 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ce2f1-217b-42a9-bb58-51cbaeba1c11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:27.634659 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ce2f1-217b-42a9-bb58-51cbaeba1c11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:27.636502 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ce2f1-217b-42a9-bb58-51cbaeba1c11 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:27.646809 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1642/3297] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:17:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:17:33.542532 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c950aa5-7b96-44d5-8aa3-ec71c4f529c7 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:33.546829 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c950aa5-7b96-44d5-8aa3-ec71c4f529c7 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:33.546829 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c950aa5-7b96-44d5-8aa3-ec71c4f529c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:33.566952 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-5c950aa5-7b96-44d5-8aa3-ec71c4f529c7 None None] MFA Rules not processed for user `f0c43fdc22254d7f9c5999e044c4f844`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:33.572430 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5c950aa5-7b96-44d5-8aa3-ec71c4f529c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:33.719653 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1656/3298] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:17:33.731504 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e0d77-4e7d-48e6-94af-4665aee4af5d None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:33.732035 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e0d77-4e7d-48e6-94af-4665aee4af5d None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:33.732142 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e0d77-4e7d-48e6-94af-4665aee4af5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:33.768185 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-d01e0d77-4e7d-48e6-94af-4665aee4af5d None None] MFA Rules not processed for user `f0c43fdc22254d7f9c5999e044c4f844`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:33.769721 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d01e0d77-4e7d-48e6-94af-4665aee4af5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:33.803985 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1643/3299] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:17:39.230171 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c950aa5-7b96-44d5-8aa3-ec71c4f529c7 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:39.232132 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5c950aa5-7b96-44d5-8aa3-ec71c4f529c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:39.366966 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c950aa5-7b96-44d5-8aa3-ec71c4f529c7 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:39.372227 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d563f-3ebd-4b41-b3df-97896c8faf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:39.373099 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d563f-3ebd-4b41-b3df-97896c8faf19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:39.373681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d563f-3ebd-4b41-b3df-97896c8faf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:39.374800 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d563f-3ebd-4b41-b3df-97896c8faf19 admin admin] PATH_INFO: `/v3/users/8c1eeba696174da1be8aba8dcce6b112` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:39.376783 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d563f-3ebd-4b41-b3df-97896c8faf19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c1eeba696174da1be8aba8dcce6b112)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:39.379013 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d563f-3ebd-4b41-b3df-97896c8faf19 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:39.590669 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d56d563f-3ebd-4b41-b3df-97896c8faf19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c1eeba696174da1be8aba8dcce6b112'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:39.604910 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d56d563f-3ebd-4b41-b3df-97896c8faf19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c1eeba696174da1be8aba8dcce6b112'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:39.707663 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d56d563f-3ebd-4b41-b3df-97896c8faf19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c1eeba696174da1be8aba8dcce6b112'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:39.708285 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d56d563f-3ebd-4b41-b3df-97896c8faf19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c1eeba696174da1be8aba8dcce6b112'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:39.716161 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d56d563f-3ebd-4b41-b3df-97896c8faf19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c1eeba696174da1be8aba8dcce6b112'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:39.724448 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1657/3300] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:17:39 2022] DELETE /identity/v3/users/8c1eeba696174da1be8aba8dcce6b112 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:17:40.042766 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e0d77-4e7d-48e6-94af-4665aee4af5d None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:40.064273 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e0d77-4e7d-48e6-94af-4665aee4af5d None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:40.148403 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0679524-17a6-40f2-aa91-a071e1ec1e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:40.149410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0679524-17a6-40f2-aa91-a071e1ec1e0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:40.149699 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0679524-17a6-40f2-aa91-a071e1ec1e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:40.150098 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0679524-17a6-40f2-aa91-a071e1ec1e0e admin admin] PATH_INFO: `/v3/projects/6309fd24cb2e4a5d8fde4f457d529d68` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:40.151391 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0679524-17a6-40f2-aa91-a071e1ec1e0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6309fd24cb2e4a5d8fde4f457d529d68)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:40.153745 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0679524-17a6-40f2-aa91-a071e1ec1e0e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:40.347537 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c0679524-17a6-40f2-aa91-a071e1ec1e0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6309fd24cb2e4a5d8fde4f457d529d68', 'request_id': 'req-c0679524-17a6-40f2-aa91-a071e1ec1e0e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:40.382339 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c0679524-17a6-40f2-aa91-a071e1ec1e0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6309fd24cb2e4a5d8fde4f457d529d68', 'request_id': 'req-c0679524-17a6-40f2-aa91-a071e1ec1e0e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:40.410021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c0679524-17a6-40f2-aa91-a071e1ec1e0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6309fd24cb2e4a5d8fde4f457d529d68', 'request_id': 'req-c0679524-17a6-40f2-aa91-a071e1ec1e0e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:40.534837 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c0679524-17a6-40f2-aa91-a071e1ec1e0e admin admin] The token cache is being invalidate because project 6309fd24cb2e4a5d8fde4f457d529d68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:17:40.535351 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c0679524-17a6-40f2-aa91-a071e1ec1e0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:40.536708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c0679524-17a6-40f2-aa91-a071e1ec1e0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:40.538708 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1644/3301] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:17:40 2022] DELETE /identity/v3/projects/6309fd24cb2e4a5d8fde4f457d529d68 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:17:40.543397 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d563f-3ebd-4b41-b3df-97896c8faf19 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:40.545041 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d56d563f-3ebd-4b41-b3df-97896c8faf19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:40.571917 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d563f-3ebd-4b41-b3df-97896c8faf19 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:40.646515 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c4e4e-ead5-4703-b009-07ea9301cb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:40.647694 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c4e4e-ead5-4703-b009-07ea9301cb23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:40.648250 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c4e4e-ead5-4703-b009-07ea9301cb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:40.648740 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c4e4e-ead5-4703-b009-07ea9301cb23 admin admin] PATH_INFO: `/v3/users/664c0809d310462a8376b932c1f99aa1` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:40.651484 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c4e4e-ead5-4703-b009-07ea9301cb23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=664c0809d310462a8376b932c1f99aa1)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:40.653673 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c4e4e-ead5-4703-b009-07ea9301cb23 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:40.848313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ff6c4e4e-ead5-4703-b009-07ea9301cb23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '664c0809d310462a8376b932c1f99aa1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:40.864045 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ff6c4e4e-ead5-4703-b009-07ea9301cb23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '664c0809d310462a8376b932c1f99aa1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:40.996491 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ff6c4e4e-ead5-4703-b009-07ea9301cb23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '664c0809d310462a8376b932c1f99aa1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:40.996491 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ff6c4e4e-ead5-4703-b009-07ea9301cb23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '664c0809d310462a8376b932c1f99aa1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:41.006683 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ff6c4e4e-ead5-4703-b009-07ea9301cb23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '664c0809d310462a8376b932c1f99aa1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:41.013798 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1658/3302] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:17:40 2022] DELETE /identity/v3/users/664c0809d310462a8376b932c1f99aa1 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:17:41.261616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0679524-17a6-40f2-aa91-a071e1ec1e0e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:41.263145 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c0679524-17a6-40f2-aa91-a071e1ec1e0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:41.278780 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0679524-17a6-40f2-aa91-a071e1ec1e0e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:41.369383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca235a-ed44-41d8-86c6-714b0ecaa5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:41.370367 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca235a-ed44-41d8-86c6-714b0ecaa5ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:41.372811 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca235a-ed44-41d8-86c6-714b0ecaa5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:41.372811 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca235a-ed44-41d8-86c6-714b0ecaa5ce admin admin] PATH_INFO: `/v3/projects/0ab6eb1e1c1e41dfb10c95d4b11e4f42` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:41.372811 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca235a-ed44-41d8-86c6-714b0ecaa5ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ab6eb1e1c1e41dfb10c95d4b11e4f42)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:41.375454 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca235a-ed44-41d8-86c6-714b0ecaa5ce admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:41.519296 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5eca235a-ed44-41d8-86c6-714b0ecaa5ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ab6eb1e1c1e41dfb10c95d4b11e4f42', 'request_id': 'req-5eca235a-ed44-41d8-86c6-714b0ecaa5ce'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:41.526080 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5eca235a-ed44-41d8-86c6-714b0ecaa5ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ab6eb1e1c1e41dfb10c95d4b11e4f42', 'request_id': 'req-5eca235a-ed44-41d8-86c6-714b0ecaa5ce'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:41.533032 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5eca235a-ed44-41d8-86c6-714b0ecaa5ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ab6eb1e1c1e41dfb10c95d4b11e4f42', 'request_id': 'req-5eca235a-ed44-41d8-86c6-714b0ecaa5ce'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:41.631926 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5eca235a-ed44-41d8-86c6-714b0ecaa5ce admin admin] The token cache is being invalidate because project 0ab6eb1e1c1e41dfb10c95d4b11e4f42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:17:41.632215 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5eca235a-ed44-41d8-86c6-714b0ecaa5ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:41.632841 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5eca235a-ed44-41d8-86c6-714b0ecaa5ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:41.634461 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1645/3303] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:17:41 2022] DELETE /identity/v3/projects/0ab6eb1e1c1e41dfb10c95d4b11e4f42 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:17:41.639857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8f951-ece8-4f5e-b7c4-86abc200e35e None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:41.640934 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8f951-ece8-4f5e-b7c4-86abc200e35e None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:41.642958 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8f951-ece8-4f5e-b7c4-86abc200e35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:41.665492 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-b3b8f951-ece8-4f5e-b7c4-86abc200e35e None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:41.666756 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b3b8f951-ece8-4f5e-b7c4-86abc200e35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:41.726880 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1659/3304] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:17:41.735336 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348cd39-90f0-47b3-97f4-76e1cb3e4106 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:41.735916 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348cd39-90f0-47b3-97f4-76e1cb3e4106 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:41.742646 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348cd39-90f0-47b3-97f4-76e1cb3e4106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:41.762814 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-5348cd39-90f0-47b3-97f4-76e1cb3e4106 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:41.764064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5348cd39-90f0-47b3-97f4-76e1cb3e4106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:41.773865 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1646/3305] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:17:41.780712 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8f951-ece8-4f5e-b7c4-86abc200e35e None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:41.791884 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8f951-ece8-4f5e-b7c4-86abc200e35e None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:41.798277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab7f24-34e5-4233-b30e-0ad9f653c48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:41.799623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab7f24-34e5-4233-b30e-0ad9f653c48b admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:41.799623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab7f24-34e5-4233-b30e-0ad9f653c48b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:41.799623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab7f24-34e5-4233-b30e-0ad9f653c48b admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:41.801523 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab7f24-34e5-4233-b30e-0ad9f653c48b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:17:41.801523 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab7f24-34e5-4233-b30e-0ad9f653c48b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:41.802744 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab7f24-34e5-4233-b30e-0ad9f653c48b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:41.818750 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1660/3306] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:17:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:17:41.819927 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348cd39-90f0-47b3-97f4-76e1cb3e4106 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:41.830061 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348cd39-90f0-47b3-97f4-76e1cb3e4106 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:41.834749 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf77cf3-d875-4685-95bc-07e8d7fbec67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:41.835408 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf77cf3-d875-4685-95bc-07e8d7fbec67 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:41.835693 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf77cf3-d875-4685-95bc-07e8d7fbec67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:41.835969 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf77cf3-d875-4685-95bc-07e8d7fbec67 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:41.836700 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf77cf3-d875-4685-95bc-07e8d7fbec67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:41.838818 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf77cf3-d875-4685-95bc-07e8d7fbec67 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:41.957895 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1647/3307] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:17:41 2022] POST /identity/v3/projects => generated 413 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:17:41.960791 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab7f24-34e5-4233-b30e-0ad9f653c48b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:41.974351 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab7f24-34e5-4233-b30e-0ad9f653c48b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:42.053070 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd55d8-c08a-4baf-9d04-7932a6c6f1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:42.053849 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd55d8-c08a-4baf-9d04-7932a6c6f1ae admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:42.054238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd55d8-c08a-4baf-9d04-7932a6c6f1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:42.054480 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd55d8-c08a-4baf-9d04-7932a6c6f1ae admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:42.055274 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd55d8-c08a-4baf-9d04-7932a6c6f1ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:42.057317 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd55d8-c08a-4baf-9d04-7932a6c6f1ae admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:42.199935 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1661/3308] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:17:41 2022] POST /identity/v3/users => generated 307 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:17:42.204587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf77cf3-d875-4685-95bc-07e8d7fbec67 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:42.215963 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf77cf3-d875-4685-95bc-07e8d7fbec67 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:42.222188 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1274bf-6f91-40f4-b49a-300588d6bfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:42.223010 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1274bf-6f91-40f4-b49a-300588d6bfbd admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:42.223300 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1274bf-6f91-40f4-b49a-300588d6bfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:42.223581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1274bf-6f91-40f4-b49a-300588d6bfbd admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:42.224353 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1274bf-6f91-40f4-b49a-300588d6bfbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:42.226086 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1274bf-6f91-40f4-b49a-300588d6bfbd admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:42.242411 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1648/3309] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:17:42.244068 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd55d8-c08a-4baf-9d04-7932a6c6f1ae admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:42.261701 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd55d8-c08a-4baf-9d04-7932a6c6f1ae admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:42.270864 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be108208-8abf-4329-b185-5bed2fae052f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:42.270864 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be108208-8abf-4329-b185-5bed2fae052f admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:42.270864 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be108208-8abf-4329-b185-5bed2fae052f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:42.270864 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be108208-8abf-4329-b185-5bed2fae052f admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:42.271363 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be108208-8abf-4329-b185-5bed2fae052f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:42.273421 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be108208-8abf-4329-b185-5bed2fae052f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:42.296104 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1662/3310] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:17:42.300777 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1274bf-6f91-40f4-b49a-300588d6bfbd admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:42.311922 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1274bf-6f91-40f4-b49a-300588d6bfbd admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:42.316713 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ce857-fc36-4c95-a13c-f5a213590426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:42.317613 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ce857-fc36-4c95-a13c-f5a213590426 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:42.318106 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ce857-fc36-4c95-a13c-f5a213590426 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:42.318864 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ce857-fc36-4c95-a13c-f5a213590426 admin admin] PATH_INFO: `/v3/projects/14cb627425b94ce890bd232988d4f051/users/0140b2412e3b455eabd9ce46e39027e2/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:42.339919 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ce857-fc36-4c95-a13c-f5a213590426 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14cb627425b94ce890bd232988d4f051, user_id=0140b2412e3b455eabd9ce46e39027e2, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:42.345352 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ce857-fc36-4c95-a13c-f5a213590426 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:42.486450 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1649/3311] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:17:42 2022] PUT /identity/v3/projects/14cb627425b94ce890bd232988d4f051/users/0140b2412e3b455eabd9ce46e39027e2/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:17:42.491775 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560d887-2e46-43ad-a741-26d0dec20468 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:42.492239 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560d887-2e46-43ad-a741-26d0dec20468 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:42.492490 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560d887-2e46-43ad-a741-26d0dec20468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:42.512780 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-7560d887-2e46-43ad-a741-26d0dec20468 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:42.514335 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7560d887-2e46-43ad-a741-26d0dec20468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:42.588623 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1663/3312] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:17:42.600104 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ce857-fc36-4c95-a13c-f5a213590426 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:42.602320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-107ce857-fc36-4c95-a13c-f5a213590426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:42.684297 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ce857-fc36-4c95-a13c-f5a213590426 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:42.690311 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76997e-e251-481a-bd21-c86dd2ac550c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:42.691744 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76997e-e251-481a-bd21-c86dd2ac550c service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:42.692050 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76997e-e251-481a-bd21-c86dd2ac550c service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:42.692407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76997e-e251-481a-bd21-c86dd2ac550c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:42.702411 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec76997e-e251-481a-bd21-c86dd2ac550c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:42.704225 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec76997e-e251-481a-bd21-c86dd2ac550c service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:42.732990 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1650/3313] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:17:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:17:43.621061 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b64150-d198-4e68-a29a-9b9718a99e10 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:43.621578 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b64150-d198-4e68-a29a-9b9718a99e10 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:43.621666 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b64150-d198-4e68-a29a-9b9718a99e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:43.701505 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-a1b64150-d198-4e68-a29a-9b9718a99e10 None None] MFA Rules not processed for user `93ef60674ddb4b588503c4111fbc3c3c`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:43.706344 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a1b64150-d198-4e68-a29a-9b9718a99e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:43.840678 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1664/3314] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:17:43.861170 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76997e-e251-481a-bd21-c86dd2ac550c service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:43.863125 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ec76997e-e251-481a-bd21-c86dd2ac550c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:43.955762 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76997e-e251-481a-bd21-c86dd2ac550c service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:43.961512 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa946d-0f8a-46db-b31c-d122a52791e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:43.962238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa946d-0f8a-46db-b31c-d122a52791e0 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:43.962529 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa946d-0f8a-46db-b31c-d122a52791e0 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:43.962809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa946d-0f8a-46db-b31c-d122a52791e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:43.972937 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa946d-0f8a-46db-b31c-d122a52791e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:43.974630 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa946d-0f8a-46db-b31c-d122a52791e0 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:43.993485 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1651/3315] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:17:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:17:45.096070 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a4b71-8a26-4984-8145-fd32e1725fad None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:45.096070 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a4b71-8a26-4984-8145-fd32e1725fad None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:45.096070 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a4b71-8a26-4984-8145-fd32e1725fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:45.181048 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-746a4b71-8a26-4984-8145-fd32e1725fad None None] MFA Rules not processed for user `bfe17212ef4a49fd954bbf17317ccd67`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:45.182522 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-746a4b71-8a26-4984-8145-fd32e1725fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:45.196127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa946d-0f8a-46db-b31c-d122a52791e0 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:45.219661 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa946d-0f8a-46db-b31c-d122a52791e0 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:45.241399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721cb56b-8c72-432f-8212-7817b2a62e04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:45.242545 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721cb56b-8c72-432f-8212-7817b2a62e04 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:45.244190 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721cb56b-8c72-432f-8212-7817b2a62e04 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:45.245589 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721cb56b-8c72-432f-8212-7817b2a62e04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:45.254325 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-721cb56b-8c72-432f-8212-7817b2a62e04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:45.292918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721cb56b-8c72-432f-8212-7817b2a62e04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:45.295665 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721cb56b-8c72-432f-8212-7817b2a62e04 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:45.346267 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1652/3316] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:17:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:17:45.416354 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1665/3317] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:45 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:17:47.016908 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721cb56b-8c72-432f-8212-7817b2a62e04 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:47.018643 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-721cb56b-8c72-432f-8212-7817b2a62e04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:47.052163 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721cb56b-8c72-432f-8212-7817b2a62e04 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:47.071404 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3430b-a748-4a70-9cf0-39013bda1d43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:47.072078 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3430b-a748-4a70-9cf0-39013bda1d43 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:47.072411 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3430b-a748-4a70-9cf0-39013bda1d43 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:47.072694 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3430b-a748-4a70-9cf0-39013bda1d43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:47.094711 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe3430b-a748-4a70-9cf0-39013bda1d43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:47.096472 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe3430b-a748-4a70-9cf0-39013bda1d43 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:47.115302 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1653/3318] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:17:47 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:17:52.841022 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ab622-bbfd-451f-a6e3-c1fcc6fd18bd None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:52.841550 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ab622-bbfd-451f-a6e3-c1fcc6fd18bd None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:52.841653 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ab622-bbfd-451f-a6e3-c1fcc6fd18bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:52.879565 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-003ab622-bbfd-451f-a6e3-c1fcc6fd18bd None None] MFA Rules not processed for user `bfe17212ef4a49fd954bbf17317ccd67`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:52.884436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-003ab622-bbfd-451f-a6e3-c1fcc6fd18bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:52.931882 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1666/3319] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:52 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:17:53.763228 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3430b-a748-4a70-9cf0-39013bda1d43 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:53.779193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3430b-a748-4a70-9cf0-39013bda1d43 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:53.790231 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36361a68-3869-44ad-adff-654e78f62d76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:53.791422 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36361a68-3869-44ad-adff-654e78f62d76 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:53.792122 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36361a68-3869-44ad-adff-654e78f62d76 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:53.792651 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36361a68-3869-44ad-adff-654e78f62d76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:53.795513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-36361a68-3869-44ad-adff-654e78f62d76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:53.902179 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36361a68-3869-44ad-adff-654e78f62d76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:53.904724 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36361a68-3869-44ad-adff-654e78f62d76 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:53.935811 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1654/3320] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:17:53 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:17:54.750601 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ab622-bbfd-451f-a6e3-c1fcc6fd18bd None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:54.752199 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-003ab622-bbfd-451f-a6e3-c1fcc6fd18bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:54.794091 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ab622-bbfd-451f-a6e3-c1fcc6fd18bd None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:54.813614 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f6ea3-5ccd-4c3a-8f45-9d59902ee0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:54.815911 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f6ea3-5ccd-4c3a-8f45-9d59902ee0b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:54.816962 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f6ea3-5ccd-4c3a-8f45-9d59902ee0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:54.816962 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f6ea3-5ccd-4c3a-8f45-9d59902ee0b9 admin admin] PATH_INFO: `/v3/users/1886e7319ac64348a1b019b9329a92de` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:54.820355 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f6ea3-5ccd-4c3a-8f45-9d59902ee0b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1886e7319ac64348a1b019b9329a92de)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:54.827402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f6ea3-5ccd-4c3a-8f45-9d59902ee0b9 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:55.167631 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-189f6ea3-5ccd-4c3a-8f45-9d59902ee0b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1886e7319ac64348a1b019b9329a92de'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:55.183155 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-189f6ea3-5ccd-4c3a-8f45-9d59902ee0b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1886e7319ac64348a1b019b9329a92de'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:55.290681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-189f6ea3-5ccd-4c3a-8f45-9d59902ee0b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1886e7319ac64348a1b019b9329a92de'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:55.293643 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-189f6ea3-5ccd-4c3a-8f45-9d59902ee0b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1886e7319ac64348a1b019b9329a92de'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:55.309795 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-189f6ea3-5ccd-4c3a-8f45-9d59902ee0b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1886e7319ac64348a1b019b9329a92de'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:55.323781 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1667/3321] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:17:54 2022] DELETE /identity/v3/users/1886e7319ac64348a1b019b9329a92de => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:17:55.326438 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f50827-edd9-49d4-b45e-1473064b7bd9 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:55.326896 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f50827-edd9-49d4-b45e-1473064b7bd9 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:55.327196 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f50827-edd9-49d4-b45e-1473064b7bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:55.356558 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-a6f50827-edd9-49d4-b45e-1473064b7bd9 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:55.358400 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a6f50827-edd9-49d4-b45e-1473064b7bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:55.504009 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1655/3322] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:17:55.521278 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f6ea3-5ccd-4c3a-8f45-9d59902ee0b9 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:55.524144 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-189f6ea3-5ccd-4c3a-8f45-9d59902ee0b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:55.651125 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f6ea3-5ccd-4c3a-8f45-9d59902ee0b9 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:55.656639 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eef60d-eda8-441b-8276-be5a5b704a12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:55.657527 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eef60d-eda8-441b-8276-be5a5b704a12 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:55.659032 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eef60d-eda8-441b-8276-be5a5b704a12 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:55.659032 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eef60d-eda8-441b-8276-be5a5b704a12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:55.688243 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eef60d-eda8-441b-8276-be5a5b704a12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:55.688243 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eef60d-eda8-441b-8276-be5a5b704a12 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:55.696755 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1668/3323] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:17:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:17:56.243475 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c2aba-f713-402f-8062-3506d8834038 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:56.243865 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c2aba-f713-402f-8062-3506d8834038 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:56.244645 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c2aba-f713-402f-8062-3506d8834038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:56.265687 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-0b5c2aba-f713-402f-8062-3506d8834038 None None] MFA Rules not processed for user `1961bb1779214710bc073d188262f1fb`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:56.278001 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0b5c2aba-f713-402f-8062-3506d8834038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:56.351671 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eef60d-eda8-441b-8276-be5a5b704a12 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:56.354960 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-42eef60d-eda8-441b-8276-be5a5b704a12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:56.386853 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1656/3324] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:17:56.393100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eef60d-eda8-441b-8276-be5a5b704a12 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:56.419195 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e4a2d-0db7-49ec-a4f7-ede6ddc9ac24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:56.422891 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e4a2d-0db7-49ec-a4f7-ede6ddc9ac24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:56.423451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e4a2d-0db7-49ec-a4f7-ede6ddc9ac24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:56.425197 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e4a2d-0db7-49ec-a4f7-ede6ddc9ac24 admin admin] PATH_INFO: `/v3/projects/246c0a9cc007483ab7bd3cd40249f291` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:56.434461 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e4a2d-0db7-49ec-a4f7-ede6ddc9ac24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=246c0a9cc007483ab7bd3cd40249f291)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:56.435544 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e4a2d-0db7-49ec-a4f7-ede6ddc9ac24 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:56.528501 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb84a1-89ec-45dc-9444-32cab68a4124 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:56.529150 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb84a1-89ec-45dc-9444-32cab68a4124 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:56.529150 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb84a1-89ec-45dc-9444-32cab68a4124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:56.612235 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-d5eb84a1-89ec-45dc-9444-32cab68a4124 None None] MFA Rules not processed for user `0140b2412e3b455eabd9ce46e39027e2`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:56.614475 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d5eb84a1-89ec-45dc-9444-32cab68a4124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:56.665194 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a40e4a2d-0db7-49ec-a4f7-ede6ddc9ac24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '246c0a9cc007483ab7bd3cd40249f291', 'request_id': 'req-a40e4a2d-0db7-49ec-a4f7-ede6ddc9ac24'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:56.707153 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a40e4a2d-0db7-49ec-a4f7-ede6ddc9ac24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '246c0a9cc007483ab7bd3cd40249f291', 'request_id': 'req-a40e4a2d-0db7-49ec-a4f7-ede6ddc9ac24'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:56.724021 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a40e4a2d-0db7-49ec-a4f7-ede6ddc9ac24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '246c0a9cc007483ab7bd3cd40249f291', 'request_id': 'req-a40e4a2d-0db7-49ec-a4f7-ede6ddc9ac24'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:56.797974 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1657/3325] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:56 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:17:56.809638 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1aecf-8e15-407b-a4c8-ae5b11a66cf3 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:56.810102 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1aecf-8e15-407b-a4c8-ae5b11a66cf3 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:56.810775 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1aecf-8e15-407b-a4c8-ae5b11a66cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:56.828471 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a40e4a2d-0db7-49ec-a4f7-ede6ddc9ac24 admin admin] The token cache is being invalidate because project 246c0a9cc007483ab7bd3cd40249f291 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:17:56.828767 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a40e4a2d-0db7-49ec-a4f7-ede6ddc9ac24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:56.831001 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a40e4a2d-0db7-49ec-a4f7-ede6ddc9ac24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:56.833621 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1669/3326] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:17:56 2022] DELETE /identity/v3/projects/246c0a9cc007483ab7bd3cd40249f291 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:17:56.837578 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e4a2d-0db7-49ec-a4f7-ede6ddc9ac24 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:56.840436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a40e4a2d-0db7-49ec-a4f7-ede6ddc9ac24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:56.843815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-0df1aecf-8e15-407b-a4c8-ae5b11a66cf3 None None] MFA Rules not processed for user `0140b2412e3b455eabd9ce46e39027e2`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:56.845284 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0df1aecf-8e15-407b-a4c8-ae5b11a66cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:56.911015 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1658/3327] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:56 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:17:56.947017 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e4a2d-0db7-49ec-a4f7-ede6ddc9ac24 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:56.953628 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4f537-d5cd-4913-8b46-774046ada10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:56.954629 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4f537-d5cd-4913-8b46-774046ada10a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:56.954987 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4f537-d5cd-4913-8b46-774046ada10a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:56.955332 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4f537-d5cd-4913-8b46-774046ada10a admin admin] PATH_INFO: `/v3/users/0a5faa83cd3c400799d4bb1137fda749` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:56.956776 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4f537-d5cd-4913-8b46-774046ada10a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a5faa83cd3c400799d4bb1137fda749)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:56.958844 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4f537-d5cd-4913-8b46-774046ada10a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:57.199972 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1bf4f537-d5cd-4913-8b46-774046ada10a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a5faa83cd3c400799d4bb1137fda749'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:57.218944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1bf4f537-d5cd-4913-8b46-774046ada10a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a5faa83cd3c400799d4bb1137fda749'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:57.307110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1bf4f537-d5cd-4913-8b46-774046ada10a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a5faa83cd3c400799d4bb1137fda749'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:57.307110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1bf4f537-d5cd-4913-8b46-774046ada10a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a5faa83cd3c400799d4bb1137fda749'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:57.317841 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1bf4f537-d5cd-4913-8b46-774046ada10a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a5faa83cd3c400799d4bb1137fda749'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:57.330781 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1670/3328] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:17:56 2022] DELETE /identity/v3/users/0a5faa83cd3c400799d4bb1137fda749 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:17:57.796517 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1aecf-8e15-407b-a4c8-ae5b11a66cf3 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:57.812643 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1aecf-8e15-407b-a4c8-ae5b11a66cf3 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:57.944478 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f180d6c-e616-418a-8beb-8b64fcf19563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:57.945502 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f180d6c-e616-418a-8beb-8b64fcf19563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:57.946558 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f180d6c-e616-418a-8beb-8b64fcf19563 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:57.947223 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f180d6c-e616-418a-8beb-8b64fcf19563 admin admin] PATH_INFO: `/v3/projects/07454c56f64844ddaa569ae7058349ec` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:57.948575 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f180d6c-e616-418a-8beb-8b64fcf19563 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07454c56f64844ddaa569ae7058349ec)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:57.950721 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f180d6c-e616-418a-8beb-8b64fcf19563 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:58.017530 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4f537-d5cd-4913-8b46-774046ada10a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:58.019634 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1bf4f537-d5cd-4913-8b46-774046ada10a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:58.142115 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2f180d6c-e616-418a-8beb-8b64fcf19563 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07454c56f64844ddaa569ae7058349ec', 'request_id': 'req-2f180d6c-e616-418a-8beb-8b64fcf19563'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:58.156231 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2f180d6c-e616-418a-8beb-8b64fcf19563 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07454c56f64844ddaa569ae7058349ec', 'request_id': 'req-2f180d6c-e616-418a-8beb-8b64fcf19563'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:58.164607 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2f180d6c-e616-418a-8beb-8b64fcf19563 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07454c56f64844ddaa569ae7058349ec', 'request_id': 'req-2f180d6c-e616-418a-8beb-8b64fcf19563'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:58.180708 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4f537-d5cd-4913-8b46-774046ada10a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:58.264115 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d7cb7-9ed9-44df-9b76-ab637ef371fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:58.265353 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d7cb7-9ed9-44df-9b76-ab637ef371fc service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:58.266191 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d7cb7-9ed9-44df-9b76-ab637ef371fc service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:58.266625 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d7cb7-9ed9-44df-9b76-ab637ef371fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:58.288676 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b93d7cb7-9ed9-44df-9b76-ab637ef371fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:58.344371 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2f180d6c-e616-418a-8beb-8b64fcf19563 admin admin] The token cache is being invalidate because project 07454c56f64844ddaa569ae7058349ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:17:58.345051 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2f180d6c-e616-418a-8beb-8b64fcf19563 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:58.345855 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2f180d6c-e616-418a-8beb-8b64fcf19563 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:17:58.348629 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1659/3329] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:17:57 2022] DELETE /identity/v3/projects/07454c56f64844ddaa569ae7058349ec => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:17:58.356798 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e36fe-7dc5-4e62-bb92-fea13ec11f46 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:58.357084 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e36fe-7dc5-4e62-bb92-fea13ec11f46 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:58.357451 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e36fe-7dc5-4e62-bb92-fea13ec11f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:58.381441 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-8a9e36fe-7dc5-4e62-bb92-fea13ec11f46 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:58.382731 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8a9e36fe-7dc5-4e62-bb92-fea13ec11f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:58.449279 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d7cb7-9ed9-44df-9b76-ab637ef371fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:58.450975 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d7cb7-9ed9-44df-9b76-ab637ef371fc service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:58.494988 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1671/3330] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:17:58 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:17:58.531361 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1660/3331] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:17:58.532061 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04790e-e7ef-4c6e-887f-924420f6b7da None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:58.532061 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04790e-e7ef-4c6e-887f-924420f6b7da None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:58.532061 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04790e-e7ef-4c6e-887f-924420f6b7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:58.570822 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-aa04790e-e7ef-4c6e-887f-924420f6b7da None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:58.572533 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-aa04790e-e7ef-4c6e-887f-924420f6b7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:58.611183 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1672/3332] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:17:58.612336 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e36fe-7dc5-4e62-bb92-fea13ec11f46 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:58.630710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e36fe-7dc5-4e62-bb92-fea13ec11f46 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:58.637287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2541f-d5c9-4994-8161-1fb4fa707360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:58.638240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2541f-d5c9-4994-8161-1fb4fa707360 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:58.638594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2541f-d5c9-4994-8161-1fb4fa707360 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:58.638940 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2541f-d5c9-4994-8161-1fb4fa707360 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:58.640310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d2541f-d5c9-4994-8161-1fb4fa707360 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:17:58.640685 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d2541f-d5c9-4994-8161-1fb4fa707360 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:58.642760 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d2541f-d5c9-4994-8161-1fb4fa707360 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:58.661081 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1661/3333] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:17:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:17:58.662074 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04790e-e7ef-4c6e-887f-924420f6b7da None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:58.677370 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04790e-e7ef-4c6e-887f-924420f6b7da None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:58.690008 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf1d93-3e62-469c-b90a-45a2be936ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:58.691475 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf1d93-3e62-469c-b90a-45a2be936ae6 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:58.692010 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf1d93-3e62-469c-b90a-45a2be936ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:58.692531 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf1d93-3e62-469c-b90a-45a2be936ae6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:58.693451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cf1d93-3e62-469c-b90a-45a2be936ae6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:58.698386 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cf1d93-3e62-469c-b90a-45a2be936ae6 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:58.935342 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1673/3334] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:17:58 2022] POST /identity/v3/projects => generated 385 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:17:58.939770 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2541f-d5c9-4994-8161-1fb4fa707360 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:58.961516 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2541f-d5c9-4994-8161-1fb4fa707360 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:59.138400 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0601228-2f2f-4fd8-8332-183847fa1355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:59.141190 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0601228-2f2f-4fd8-8332-183847fa1355 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:59.141476 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0601228-2f2f-4fd8-8332-183847fa1355 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:59.142143 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0601228-2f2f-4fd8-8332-183847fa1355 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:59.142866 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0601228-2f2f-4fd8-8332-183847fa1355 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:59.151867 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0601228-2f2f-4fd8-8332-183847fa1355 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:59.260662 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf1d93-3e62-469c-b90a-45a2be936ae6 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:59.260662 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-58cf1d93-3e62-469c-b90a-45a2be936ae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:59.512658 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1662/3335] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:17:58 2022] POST /identity/v3/users => generated 293 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:17:59.512658 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0601228-2f2f-4fd8-8332-183847fa1355 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:59.512658 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0601228-2f2f-4fd8-8332-183847fa1355 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:59.512658 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3eda95-fc88-4e18-94e2-ec049c68b6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:59.513634 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3eda95-fc88-4e18-94e2-ec049c68b6fc admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:59.513634 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3eda95-fc88-4e18-94e2-ec049c68b6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:59.513634 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3eda95-fc88-4e18-94e2-ec049c68b6fc admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:59.513634 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3eda95-fc88-4e18-94e2-ec049c68b6fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:59.513634 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3eda95-fc88-4e18-94e2-ec049c68b6fc admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:59.513634 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1663/3336] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:17:59.514136 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3eda95-fc88-4e18-94e2-ec049c68b6fc admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:59.514136 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3eda95-fc88-4e18-94e2-ec049c68b6fc admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:59.514136 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0532af-d759-41fd-8150-970d04040393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:59.514136 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0532af-d759-41fd-8150-970d04040393 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:59.514469 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0532af-d759-41fd-8150-970d04040393 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:59.514469 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0532af-d759-41fd-8150-970d04040393 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:59.514469 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0532af-d759-41fd-8150-970d04040393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:59.514469 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0532af-d759-41fd-8150-970d04040393 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:59.515355 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf1d93-3e62-469c-b90a-45a2be936ae6 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:59.515355 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d582e-35a4-4bdc-afe7-4f20b5c6c685 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:59.515355 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d582e-35a4-4bdc-afe7-4f20b5c6c685 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:59.515355 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d582e-35a4-4bdc-afe7-4f20b5c6c685 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:59.515714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d582e-35a4-4bdc-afe7-4f20b5c6c685 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:59.515714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c37d582e-35a4-4bdc-afe7-4f20b5c6c685 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:59.516127 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1664/3337] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:17:59.516127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0532af-d759-41fd-8150-970d04040393 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:59.516307 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37d582e-35a4-4bdc-afe7-4f20b5c6c685 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:59.516396 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0532af-d759-41fd-8150-970d04040393 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:59.516495 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37d582e-35a4-4bdc-afe7-4f20b5c6c685 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:59.516577 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87ffc8-d5b1-45c5-81ff-d983cd7cd268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:59.516577 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87ffc8-d5b1-45c5-81ff-d983cd7cd268 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:59.516577 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87ffc8-d5b1-45c5-81ff-d983cd7cd268 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:59.516577 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87ffc8-d5b1-45c5-81ff-d983cd7cd268 admin admin] PATH_INFO: `/v3/projects/6c823086e6504aa0ac38c2b9b86970b2/users/993cfa563e564a5f924d7e75d118f1d8/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:59.516908 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1674/3338] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:17:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:17:59.516999 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87ffc8-d5b1-45c5-81ff-d983cd7cd268 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c823086e6504aa0ac38c2b9b86970b2, user_id=993cfa563e564a5f924d7e75d118f1d8, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:17:59.516999 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87ffc8-d5b1-45c5-81ff-d983cd7cd268 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:17:59.607407 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1665/3339] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:17:59 2022] PUT /identity/v3/projects/6c823086e6504aa0ac38c2b9b86970b2/users/993cfa563e564a5f924d7e75d118f1d8/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:17:59.610009 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690e105-5398-43b2-b181-c72e3049d575 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:59.610929 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690e105-5398-43b2-b181-c72e3049d575 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:59.611057 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c690e105-5398-43b2-b181-c72e3049d575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:17:59.639193 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-c690e105-5398-43b2-b181-c72e3049d575 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:17:59.641003 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c690e105-5398-43b2-b181-c72e3049d575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:59.738855 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1675/3340] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:17:59.781000 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87ffc8-d5b1-45c5-81ff-d983cd7cd268 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:59.873485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690e105-5398-43b2-b181-c72e3049d575 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:17:59.875122 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c690e105-5398-43b2-b181-c72e3049d575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:17:59.962647 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87ffc8-d5b1-45c5-81ff-d983cd7cd268 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:17:59.977877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105d898-8777-4f78-85dc-831b4236b2b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:17:59.979167 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105d898-8777-4f78-85dc-831b4236b2b4 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:17:59.979729 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105d898-8777-4f78-85dc-831b4236b2b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:17:59.980658 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105d898-8777-4f78-85dc-831b4236b2b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:00.004683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1105d898-8777-4f78-85dc-831b4236b2b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:00.014237 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1105d898-8777-4f78-85dc-831b4236b2b4 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:00.033946 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1666/3341] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:17:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:18:00.076588 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c690e105-5398-43b2-b181-c72e3049d575 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:00.077025 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae7348-2916-4efb-8bfa-c1d6f7009a96 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:00.078673 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae7348-2916-4efb-8bfa-c1d6f7009a96 service placement] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:00.079036 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae7348-2916-4efb-8bfa-c1d6f7009a96 service placement] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:00.079387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae7348-2916-4efb-8bfa-c1d6f7009a96 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:00.081429 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e1ae7348-2916-4efb-8bfa-c1d6f7009a96 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:00.103100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae7348-2916-4efb-8bfa-c1d6f7009a96 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:00.112407 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae7348-2916-4efb-8bfa-c1d6f7009a96 service placement] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:00.133570 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1676/3342] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:17:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:18:02.177639 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105d898-8777-4f78-85dc-831b4236b2b4 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:02.184044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1105d898-8777-4f78-85dc-831b4236b2b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:02.212083 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105d898-8777-4f78-85dc-831b4236b2b4 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:02.220064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968c4be-3e96-4d38-baf7-ede40bda3dd5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:02.220877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968c4be-3e96-4d38-baf7-ede40bda3dd5 service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:02.221301 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968c4be-3e96-4d38-baf7-ede40bda3dd5 service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:02.221857 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968c4be-3e96-4d38-baf7-ede40bda3dd5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:02.228620 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2968c4be-3e96-4d38-baf7-ede40bda3dd5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:02.256507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2968c4be-3e96-4d38-baf7-ede40bda3dd5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:02.258715 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2968c4be-3e96-4d38-baf7-ede40bda3dd5 service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:02.285492 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1667/3343] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:18:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:18:03.777825 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2252c-b413-40d5-9fc6-438f5757d76d None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:03.780853 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2252c-b413-40d5-9fc6-438f5757d76d None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:03.780853 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2252c-b413-40d5-9fc6-438f5757d76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:03.829458 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-09d2252c-b413-40d5-9fc6-438f5757d76d None None] MFA Rules not processed for user `993cfa563e564a5f924d7e75d118f1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:18:03.831628 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-09d2252c-b413-40d5-9fc6-438f5757d76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:03.912286 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968c4be-3e96-4d38-baf7-ede40bda3dd5 service placement] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:03.923242 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1677/3344] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:18:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:18:03.924968 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968c4be-3e96-4d38-baf7-ede40bda3dd5 service placement] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:03.951627 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23005ce-608c-49ea-8b7d-ff49c995dd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:03.957292 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23005ce-608c-49ea-8b7d-ff49c995dd16 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:03.957292 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23005ce-608c-49ea-8b7d-ff49c995dd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:03.957292 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23005ce-608c-49ea-8b7d-ff49c995dd16 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:03.957292 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23005ce-608c-49ea-8b7d-ff49c995dd16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:03.957292 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23005ce-608c-49ea-8b7d-ff49c995dd16 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:04.173824 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1668/3345] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:18:03 2022] POST /identity/v3/projects => generated 385 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:18:04.178206 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2252c-b413-40d5-9fc6-438f5757d76d None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:04.193198 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2252c-b413-40d5-9fc6-438f5757d76d None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:04.261976 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849a8b5-ceb2-465c-bc99-432798732780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:04.262587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849a8b5-ceb2-465c-bc99-432798732780 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:04.263072 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849a8b5-ceb2-465c-bc99-432798732780 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:04.263351 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849a8b5-ceb2-465c-bc99-432798732780 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:04.264064 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4849a8b5-ceb2-465c-bc99-432798732780 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:04.266242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4849a8b5-ceb2-465c-bc99-432798732780 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:04.429365 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1678/3346] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:18:04 2022] POST /identity/v3/users => generated 299 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:18:04.430554 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23005ce-608c-49ea-8b7d-ff49c995dd16 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:04.441309 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23005ce-608c-49ea-8b7d-ff49c995dd16 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:04.446763 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f876a-72a4-4519-bbdb-d0a4a7858353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:04.447938 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f876a-72a4-4519-bbdb-d0a4a7858353 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:04.448374 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f876a-72a4-4519-bbdb-d0a4a7858353 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:04.448662 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f876a-72a4-4519-bbdb-d0a4a7858353 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:04.449818 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f876a-72a4-4519-bbdb-d0a4a7858353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:04.451484 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f876a-72a4-4519-bbdb-d0a4a7858353 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:04.463561 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1669/3347] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:18:04.470663 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849a8b5-ceb2-465c-bc99-432798732780 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:04.498131 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849a8b5-ceb2-465c-bc99-432798732780 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:04.508161 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aedb87-7603-4610-ac86-6ec2ff8c0ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:04.509171 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aedb87-7603-4610-ac86-6ec2ff8c0ec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:04.509530 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aedb87-7603-4610-ac86-6ec2ff8c0ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:04.510100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aedb87-7603-4610-ac86-6ec2ff8c0ec7 admin admin] PATH_INFO: `/v3/projects/2432bcdc57d144238ffb934fd4530483/users/a117a0336489441b81fcd7aed67da6a9/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:04.533710 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aedb87-7603-4610-ac86-6ec2ff8c0ec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2432bcdc57d144238ffb934fd4530483, user_id=a117a0336489441b81fcd7aed67da6a9, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:04.537497 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aedb87-7603-4610-ac86-6ec2ff8c0ec7 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:04.666262 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1679/3348] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:18:04 2022] PUT /identity/v3/projects/2432bcdc57d144238ffb934fd4530483/users/a117a0336489441b81fcd7aed67da6a9/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:18:04.668682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f876a-72a4-4519-bbdb-d0a4a7858353 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:04.685005 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f876a-72a4-4519-bbdb-d0a4a7858353 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:04.784289 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996fa0f-69a1-4b49-8882-061cf94d4b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:04.784989 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996fa0f-69a1-4b49-8882-061cf94d4b43 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:04.785277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996fa0f-69a1-4b49-8882-061cf94d4b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:04.785554 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996fa0f-69a1-4b49-8882-061cf94d4b43 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:04.787759 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996fa0f-69a1-4b49-8882-061cf94d4b43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:04.789442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996fa0f-69a1-4b49-8882-061cf94d4b43 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:04.819110 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1670/3349] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:18:04.823936 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aedb87-7603-4610-ac86-6ec2ff8c0ec7 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:04.837100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aedb87-7603-4610-ac86-6ec2ff8c0ec7 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:04.846682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b148a62-55b7-48b3-adbf-bea47fca4417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:04.846682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b148a62-55b7-48b3-adbf-bea47fca4417 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:04.846682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b148a62-55b7-48b3-adbf-bea47fca4417 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:04.846682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b148a62-55b7-48b3-adbf-bea47fca4417 admin admin] PATH_INFO: `/v3/projects/2432bcdc57d144238ffb934fd4530483/users/a117a0336489441b81fcd7aed67da6a9/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:04.861965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b148a62-55b7-48b3-adbf-bea47fca4417 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2432bcdc57d144238ffb934fd4530483, user_id=a117a0336489441b81fcd7aed67da6a9, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:04.866434 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b148a62-55b7-48b3-adbf-bea47fca4417 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:04.886063 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1680/3350] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:18:04 2022] PUT /identity/v3/projects/2432bcdc57d144238ffb934fd4530483/users/a117a0336489441b81fcd7aed67da6a9/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:18:07.566325 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35daaf-f501-4c09-9d56-a4a2d0a1f912 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:07.567479 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35daaf-f501-4c09-9d56-a4a2d0a1f912 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:07.567762 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35daaf-f501-4c09-9d56-a4a2d0a1f912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:07.635159 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-fa35daaf-f501-4c09-9d56-a4a2d0a1f912 None None] MFA Rules not processed for user `a117a0336489441b81fcd7aed67da6a9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:18:07.636710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-fa35daaf-f501-4c09-9d56-a4a2d0a1f912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:07.742409 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1671/3351] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:18:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:18:07.756537 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dea6c-0918-452c-82bb-53c9f32e2f27 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:07.757184 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dea6c-0918-452c-82bb-53c9f32e2f27 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:07.757184 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dea6c-0918-452c-82bb-53c9f32e2f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:07.791847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-f40dea6c-0918-452c-82bb-53c9f32e2f27 None None] MFA Rules not processed for user `993cfa563e564a5f924d7e75d118f1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:18:07.793380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f40dea6c-0918-452c-82bb-53c9f32e2f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:07.882065 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1681/3352] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:18:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:18:09.041837 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35daaf-f501-4c09-9d56-a4a2d0a1f912 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:09.042536 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-fa35daaf-f501-4c09-9d56-a4a2d0a1f912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:09.153081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35daaf-f501-4c09-9d56-a4a2d0a1f912 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:09.159475 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25e150-b499-43a3-ba11-217e63b113e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:09.162989 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25e150-b499-43a3-ba11-217e63b113e9 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:09.162989 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25e150-b499-43a3-ba11-217e63b113e9 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:09.162989 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25e150-b499-43a3-ba11-217e63b113e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:09.169064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25e150-b499-43a3-ba11-217e63b113e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:09.170887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25e150-b499-43a3-ba11-217e63b113e9 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:09.186268 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1672/3353] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:18:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:18:11.784765 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40dea6c-0918-452c-82bb-53c9f32e2f27 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:11.786372 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f40dea6c-0918-452c-82bb-53c9f32e2f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:11.806082 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40dea6c-0918-452c-82bb-53c9f32e2f27 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:11.812416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ce512-2fff-4528-9e23-5cb38222a4e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:11.813080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ce512-2fff-4528-9e23-5cb38222a4e1 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:11.813365 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ce512-2fff-4528-9e23-5cb38222a4e1 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:11.813734 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ce512-2fff-4528-9e23-5cb38222a4e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:11.815893 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8e1ce512-2fff-4528-9e23-5cb38222a4e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:11.904551 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ce512-2fff-4528-9e23-5cb38222a4e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:11.911964 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ce512-2fff-4528-9e23-5cb38222a4e1 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:11.925953 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1682/3354] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:18:11 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:18:25.773196 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25e150-b499-43a3-ba11-217e63b113e9 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:25.775131 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1d25e150-b499-43a3-ba11-217e63b113e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:25.877741 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25e150-b499-43a3-ba11-217e63b113e9 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:25.886085 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca1da0-352c-4a00-8a7d-9bf529ada1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:25.887768 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca1da0-352c-4a00-8a7d-9bf529ada1fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:25.888279 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca1da0-352c-4a00-8a7d-9bf529ada1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:25.889460 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca1da0-352c-4a00-8a7d-9bf529ada1fd admin admin] PATH_INFO: `/v3/users/93ef60674ddb4b588503c4111fbc3c3c` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:25.891188 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ca1da0-352c-4a00-8a7d-9bf529ada1fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=93ef60674ddb4b588503c4111fbc3c3c)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:25.893388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ca1da0-352c-4a00-8a7d-9bf529ada1fd admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:26.230416 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d3ca1da0-352c-4a00-8a7d-9bf529ada1fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93ef60674ddb4b588503c4111fbc3c3c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:26.248279 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d3ca1da0-352c-4a00-8a7d-9bf529ada1fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93ef60674ddb4b588503c4111fbc3c3c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:26.324178 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d3ca1da0-352c-4a00-8a7d-9bf529ada1fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93ef60674ddb4b588503c4111fbc3c3c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:26.338398 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d3ca1da0-352c-4a00-8a7d-9bf529ada1fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93ef60674ddb4b588503c4111fbc3c3c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:26.339419 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d3ca1da0-352c-4a00-8a7d-9bf529ada1fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93ef60674ddb4b588503c4111fbc3c3c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:26.346906 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1673/3355] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:18:25 2022] DELETE /identity/v3/users/93ef60674ddb4b588503c4111fbc3c3c => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:18:26.691801 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ce512-2fff-4528-9e23-5cb38222a4e1 service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:26.705595 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ce512-2fff-4528-9e23-5cb38222a4e1 service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:26.786437 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d7dc8-22b2-433a-8170-2940cb9d1bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:26.794623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d7dc8-22b2-433a-8170-2940cb9d1bc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:26.794623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d7dc8-22b2-433a-8170-2940cb9d1bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:26.794623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d7dc8-22b2-433a-8170-2940cb9d1bc8 admin admin] PATH_INFO: `/v3/projects/4b8bfd0b09264e32a4ded1046a12619d` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:26.794623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d7dc8-22b2-433a-8170-2940cb9d1bc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b8bfd0b09264e32a4ded1046a12619d)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:26.794623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d7dc8-22b2-433a-8170-2940cb9d1bc8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:26.937668 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-cb2d7dc8-22b2-433a-8170-2940cb9d1bc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b8bfd0b09264e32a4ded1046a12619d', 'request_id': 'req-cb2d7dc8-22b2-433a-8170-2940cb9d1bc8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:26.943428 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-cb2d7dc8-22b2-433a-8170-2940cb9d1bc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b8bfd0b09264e32a4ded1046a12619d', 'request_id': 'req-cb2d7dc8-22b2-433a-8170-2940cb9d1bc8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:26.949934 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-cb2d7dc8-22b2-433a-8170-2940cb9d1bc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b8bfd0b09264e32a4ded1046a12619d', 'request_id': 'req-cb2d7dc8-22b2-433a-8170-2940cb9d1bc8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:27.096180 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-cb2d7dc8-22b2-433a-8170-2940cb9d1bc8 admin admin] The token cache is being invalidate because project 4b8bfd0b09264e32a4ded1046a12619d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:18:27.096881 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-cb2d7dc8-22b2-433a-8170-2940cb9d1bc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:27.097792 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-cb2d7dc8-22b2-433a-8170-2940cb9d1bc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:27.100111 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1683/3356] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:18:26 2022] DELETE /identity/v3/projects/4b8bfd0b09264e32a4ded1046a12619d => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:18:27.105423 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368b8df-0f7e-4ee9-a200-ed02f6c36779 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:27.106354 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368b8df-0f7e-4ee9-a200-ed02f6c36779 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:27.106813 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368b8df-0f7e-4ee9-a200-ed02f6c36779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:27.128393 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-a368b8df-0f7e-4ee9-a200-ed02f6c36779 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:18:27.129923 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a368b8df-0f7e-4ee9-a200-ed02f6c36779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:27.203781 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1674/3357] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:18:27.212191 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e9415-6762-4d70-a41b-f17d1e8a5738 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:27.214934 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e9415-6762-4d70-a41b-f17d1e8a5738 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:27.214934 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e9415-6762-4d70-a41b-f17d1e8a5738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:27.234707 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-324e9415-6762-4d70-a41b-f17d1e8a5738 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:18:27.236146 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-324e9415-6762-4d70-a41b-f17d1e8a5738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:27.247720 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1684/3358] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:18:27.249542 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368b8df-0f7e-4ee9-a200-ed02f6c36779 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:27.261302 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368b8df-0f7e-4ee9-a200-ed02f6c36779 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:27.268524 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253b665-9af5-4acc-8eb8-9031e4b3c99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:27.272406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253b665-9af5-4acc-8eb8-9031e4b3c99e admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:27.272406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253b665-9af5-4acc-8eb8-9031e4b3c99e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:27.272406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253b665-9af5-4acc-8eb8-9031e4b3c99e admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:27.272406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f253b665-9af5-4acc-8eb8-9031e4b3c99e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:18:27.272406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f253b665-9af5-4acc-8eb8-9031e4b3c99e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:27.274401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f253b665-9af5-4acc-8eb8-9031e4b3c99e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:27.294773 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1675/3359] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:18:27.300683 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e9415-6762-4d70-a41b-f17d1e8a5738 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:27.308676 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e9415-6762-4d70-a41b-f17d1e8a5738 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:27.318963 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147280c-cfda-4941-aa42-36571e28d42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:27.319927 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147280c-cfda-4941-aa42-36571e28d42c admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:27.320221 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147280c-cfda-4941-aa42-36571e28d42c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:27.320678 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147280c-cfda-4941-aa42-36571e28d42c admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:27.321562 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e147280c-cfda-4941-aa42-36571e28d42c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:27.323576 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e147280c-cfda-4941-aa42-36571e28d42c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:27.441502 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1685/3360] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:18:27 2022] POST /identity/v3/projects => generated 379 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:18:27.445236 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253b665-9af5-4acc-8eb8-9031e4b3c99e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:27.457088 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253b665-9af5-4acc-8eb8-9031e4b3c99e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:27.533632 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e471c-9830-461b-8173-0a03a7037708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:27.541109 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e471c-9830-461b-8173-0a03a7037708 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:27.541594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e471c-9830-461b-8173-0a03a7037708 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:27.542905 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e471c-9830-461b-8173-0a03a7037708 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:27.544405 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2e471c-9830-461b-8173-0a03a7037708 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:27.548777 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2e471c-9830-461b-8173-0a03a7037708 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:27.624152 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1676/3361] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:18:27 2022] POST /identity/v3/users => generated 290 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:18:27.625393 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147280c-cfda-4941-aa42-36571e28d42c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:27.637193 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147280c-cfda-4941-aa42-36571e28d42c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:27.642648 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639db98-bbe7-4d4a-953e-7c809dcd88e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:27.643364 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639db98-bbe7-4d4a-953e-7c809dcd88e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:27.643902 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639db98-bbe7-4d4a-953e-7c809dcd88e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:27.644204 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639db98-bbe7-4d4a-953e-7c809dcd88e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:27.644930 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2639db98-bbe7-4d4a-953e-7c809dcd88e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:27.646595 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2639db98-bbe7-4d4a-953e-7c809dcd88e0 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:27.658082 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1686/3362] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:18:27.662299 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e471c-9830-461b-8173-0a03a7037708 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:27.675484 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e471c-9830-461b-8173-0a03a7037708 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:27.682263 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477041d5-b334-4894-881e-6653b1f1a92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:27.682944 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477041d5-b334-4894-881e-6653b1f1a92e admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:27.683227 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477041d5-b334-4894-881e-6653b1f1a92e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:27.683501 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477041d5-b334-4894-881e-6653b1f1a92e admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:27.684284 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477041d5-b334-4894-881e-6653b1f1a92e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:27.686571 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477041d5-b334-4894-881e-6653b1f1a92e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:27.699567 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1677/3363] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:18:27.704208 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639db98-bbe7-4d4a-953e-7c809dcd88e0 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:27.715752 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639db98-bbe7-4d4a-953e-7c809dcd88e0 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:27.723727 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b392a-0a3d-4ee4-878e-db8c9cd8903e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:27.724698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b392a-0a3d-4ee4-878e-db8c9cd8903e admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:27.725204 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b392a-0a3d-4ee4-878e-db8c9cd8903e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:27.725696 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b392a-0a3d-4ee4-878e-db8c9cd8903e admin admin] PATH_INFO: `/v3/projects/bd9b9e36a1b4428db16cd3e98c0a8fd6/users/26500e8b27394e0cb8f28316158ff433/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:27.756177 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b392a-0a3d-4ee4-878e-db8c9cd8903e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd9b9e36a1b4428db16cd3e98c0a8fd6, user_id=26500e8b27394e0cb8f28316158ff433, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:27.759513 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5b392a-0a3d-4ee4-878e-db8c9cd8903e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:27.854586 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1687/3364] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:18:27 2022] PUT /identity/v3/projects/bd9b9e36a1b4428db16cd3e98c0a8fd6/users/26500e8b27394e0cb8f28316158ff433/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:18:27.865600 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377e368-006b-444a-b7c2-006613600417 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:27.865841 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377e368-006b-444a-b7c2-006613600417 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:27.866104 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377e368-006b-444a-b7c2-006613600417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:27.914769 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-b377e368-006b-444a-b7c2-006613600417 None None] MFA Rules not processed for user `26500e8b27394e0cb8f28316158ff433`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:18:27.916974 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b377e368-006b-444a-b7c2-006613600417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:28.018650 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1678/3365] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:18:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:18:28.515409 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b392a-0a3d-4ee4-878e-db8c9cd8903e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:28.517168 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-da5b392a-0a3d-4ee4-878e-db8c9cd8903e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:28.576446 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a43b7f-fba4-4cb4-844c-1b45393b57a3 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:28.577379 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a43b7f-fba4-4cb4-844c-1b45393b57a3 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:28.577667 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a43b7f-fba4-4cb4-844c-1b45393b57a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:28.596743 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-f0a43b7f-fba4-4cb4-844c-1b45393b57a3 None None] MFA Rules not processed for user `1961bb1779214710bc073d188262f1fb`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:18:28.598087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f0a43b7f-fba4-4cb4-844c-1b45393b57a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:28.604088 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b392a-0a3d-4ee4-878e-db8c9cd8903e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:28.611324 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789714e-bb7a-4000-861b-82b4f046f25b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:28.612080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789714e-bb7a-4000-861b-82b4f046f25b service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:28.612467 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789714e-bb7a-4000-861b-82b4f046f25b service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:28.612828 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789714e-bb7a-4000-861b-82b4f046f25b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:28.621813 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c789714e-bb7a-4000-861b-82b4f046f25b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:28.624284 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c789714e-bb7a-4000-861b-82b4f046f25b service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:28.634782 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1688/3366] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:18:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:18:28.685187 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1679/3367] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:18:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:18:28.704729 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789714e-bb7a-4000-861b-82b4f046f25b service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:28.787410 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789714e-bb7a-4000-861b-82b4f046f25b service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:28.792572 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca6986-eec4-49df-b1be-f9fb52b3336f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:28.793455 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca6986-eec4-49df-b1be-f9fb52b3336f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:28.793734 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca6986-eec4-49df-b1be-f9fb52b3336f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:28.794041 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca6986-eec4-49df-b1be-f9fb52b3336f admin admin] PATH_INFO: `/v3/users/26500e8b27394e0cb8f28316158ff433` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:28.795490 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca6986-eec4-49df-b1be-f9fb52b3336f admin admin] RBAC: Authorizing `identity:delete_user(user_id=26500e8b27394e0cb8f28316158ff433)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:28.797445 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca6986-eec4-49df-b1be-f9fb52b3336f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:29.050377 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-36ca6986-eec4-49df-b1be-f9fb52b3336f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26500e8b27394e0cb8f28316158ff433'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:29.077498 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-36ca6986-eec4-49df-b1be-f9fb52b3336f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26500e8b27394e0cb8f28316158ff433'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:29.198511 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-36ca6986-eec4-49df-b1be-f9fb52b3336f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26500e8b27394e0cb8f28316158ff433'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:29.199656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-36ca6986-eec4-49df-b1be-f9fb52b3336f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26500e8b27394e0cb8f28316158ff433'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:29.208326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-36ca6986-eec4-49df-b1be-f9fb52b3336f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26500e8b27394e0cb8f28316158ff433'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:29.214836 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1689/3368] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:18:28 2022] DELETE /identity/v3/users/26500e8b27394e0cb8f28316158ff433 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:18:29.224889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f504d8-014a-4b00-ab60-d7d099348277 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:29.224889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f504d8-014a-4b00-ab60-d7d099348277 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:29.224889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f504d8-014a-4b00-ab60-d7d099348277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:29.238491 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-89f504d8-014a-4b00-ab60-d7d099348277 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:18:29.239689 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-89f504d8-014a-4b00-ab60-d7d099348277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:29.325903 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1680/3369] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:18:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:18:29.332239 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca6986-eec4-49df-b1be-f9fb52b3336f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:29.334667 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-36ca6986-eec4-49df-b1be-f9fb52b3336f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:29.408896 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca6986-eec4-49df-b1be-f9fb52b3336f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:29.418480 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e606a4c-ae06-4c42-b521-e6e7ba23f63b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:29.419151 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e606a4c-ae06-4c42-b521-e6e7ba23f63b service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:29.419438 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e606a4c-ae06-4c42-b521-e6e7ba23f63b service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:29.419761 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e606a4c-ae06-4c42-b521-e6e7ba23f63b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:29.439334 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e606a4c-ae06-4c42-b521-e6e7ba23f63b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:29.440821 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e606a4c-ae06-4c42-b521-e6e7ba23f63b service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:29.452390 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1690/3370] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:18:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:18:30.000664 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f504d8-014a-4b00-ab60-d7d099348277 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:30.002784 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-89f504d8-014a-4b00-ab60-d7d099348277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:30.022285 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f504d8-014a-4b00-ab60-d7d099348277 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:30.045900 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c194ad-64e1-40d9-9d26-25d05a525d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:30.047969 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c194ad-64e1-40d9-9d26-25d05a525d0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:30.047969 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c194ad-64e1-40d9-9d26-25d05a525d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:30.052511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c194ad-64e1-40d9-9d26-25d05a525d0c admin admin] PATH_INFO: `/v3/projects/bd9b9e36a1b4428db16cd3e98c0a8fd6` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:30.056025 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c194ad-64e1-40d9-9d26-25d05a525d0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd9b9e36a1b4428db16cd3e98c0a8fd6)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:30.065396 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c194ad-64e1-40d9-9d26-25d05a525d0c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:30.206339 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-10c194ad-64e1-40d9-9d26-25d05a525d0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd9b9e36a1b4428db16cd3e98c0a8fd6', 'request_id': 'req-10c194ad-64e1-40d9-9d26-25d05a525d0c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:30.206339 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-10c194ad-64e1-40d9-9d26-25d05a525d0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd9b9e36a1b4428db16cd3e98c0a8fd6', 'request_id': 'req-10c194ad-64e1-40d9-9d26-25d05a525d0c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:30.212382 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-10c194ad-64e1-40d9-9d26-25d05a525d0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd9b9e36a1b4428db16cd3e98c0a8fd6', 'request_id': 'req-10c194ad-64e1-40d9-9d26-25d05a525d0c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:30.342412 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-10c194ad-64e1-40d9-9d26-25d05a525d0c admin admin] The token cache is being invalidate because project bd9b9e36a1b4428db16cd3e98c0a8fd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:18:30.344507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-10c194ad-64e1-40d9-9d26-25d05a525d0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:30.344507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-10c194ad-64e1-40d9-9d26-25d05a525d0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:30.344896 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1681/3371] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:18:29 2022] DELETE /identity/v3/projects/bd9b9e36a1b4428db16cd3e98c0a8fd6 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:18:30.350189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9ba59-eb19-4eab-bd0d-8fb3ea3b4d9a None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:30.350713 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9ba59-eb19-4eab-bd0d-8fb3ea3b4d9a None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:30.350713 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9ba59-eb19-4eab-bd0d-8fb3ea3b4d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:30.368827 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-b6e9ba59-eb19-4eab-bd0d-8fb3ea3b4d9a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:18:30.370066 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b6e9ba59-eb19-4eab-bd0d-8fb3ea3b4d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:30.441163 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1691/3372] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:18:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:18:30.451896 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365a3e5-a64d-44dd-8332-12440d220173 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:30.452184 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365a3e5-a64d-44dd-8332-12440d220173 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:30.452464 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365a3e5-a64d-44dd-8332-12440d220173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:30.496007 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-7365a3e5-a64d-44dd-8332-12440d220173 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:18:30.499741 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7365a3e5-a64d-44dd-8332-12440d220173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:30.531829 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1682/3373] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:18:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:18:30.536491 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9ba59-eb19-4eab-bd0d-8fb3ea3b4d9a None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:30.549605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9ba59-eb19-4eab-bd0d-8fb3ea3b4d9a None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:30.564769 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f59802-9441-4e7f-9f4a-896368775105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:30.565451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f59802-9441-4e7f-9f4a-896368775105 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:30.566000 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f59802-9441-4e7f-9f4a-896368775105 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:30.566464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f59802-9441-4e7f-9f4a-896368775105 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:30.567649 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f59802-9441-4e7f-9f4a-896368775105 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:18:30.568293 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f59802-9441-4e7f-9f4a-896368775105 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:30.571070 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f59802-9441-4e7f-9f4a-896368775105 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:30.589590 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1692/3374] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:18:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:18:30.594747 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365a3e5-a64d-44dd-8332-12440d220173 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:30.620024 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365a3e5-a64d-44dd-8332-12440d220173 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:30.632697 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697d036-2b8b-4f90-9119-27ad18cfdfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:30.636067 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697d036-2b8b-4f90-9119-27ad18cfdfd8 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:30.636727 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697d036-2b8b-4f90-9119-27ad18cfdfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:30.637173 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697d036-2b8b-4f90-9119-27ad18cfdfd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:30.641444 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4697d036-2b8b-4f90-9119-27ad18cfdfd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:30.643348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4697d036-2b8b-4f90-9119-27ad18cfdfd8 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:30.796781 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1683/3375] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:18:30 2022] POST /identity/v3/projects => generated 397 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:18:30.797318 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f59802-9441-4e7f-9f4a-896368775105 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:30.810335 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f59802-9441-4e7f-9f4a-896368775105 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:30.886692 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e750295-16e3-48ae-8731-8b893f72e2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:30.887490 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e750295-16e3-48ae-8731-8b893f72e2f2 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:30.887921 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e750295-16e3-48ae-8731-8b893f72e2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:30.889588 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e750295-16e3-48ae-8731-8b893f72e2f2 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:30.889588 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e750295-16e3-48ae-8731-8b893f72e2f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:30.891674 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e750295-16e3-48ae-8731-8b893f72e2f2 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:30.973828 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1693/3376] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:18:30 2022] POST /identity/v3/users => generated 299 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:18:30.976379 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697d036-2b8b-4f90-9119-27ad18cfdfd8 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:30.987317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697d036-2b8b-4f90-9119-27ad18cfdfd8 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:30.991877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b32d70-7131-49a0-ac17-895b34499bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:30.992560 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b32d70-7131-49a0-ac17-895b34499bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:30.992859 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b32d70-7131-49a0-ac17-895b34499bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:30.993149 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b32d70-7131-49a0-ac17-895b34499bf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:30.994022 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b32d70-7131-49a0-ac17-895b34499bf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:30.995659 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b32d70-7131-49a0-ac17-895b34499bf9 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:31.006860 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1684/3377] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:18:31.010788 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e750295-16e3-48ae-8731-8b893f72e2f2 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:31.021869 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e750295-16e3-48ae-8731-8b893f72e2f2 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:31.026798 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dece28b-cc2e-4408-a4e3-d26e1dc5c1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:31.027469 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dece28b-cc2e-4408-a4e3-d26e1dc5c1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:31.027817 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dece28b-cc2e-4408-a4e3-d26e1dc5c1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:31.028157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dece28b-cc2e-4408-a4e3-d26e1dc5c1d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:31.029500 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dece28b-cc2e-4408-a4e3-d26e1dc5c1d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:31.031208 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dece28b-cc2e-4408-a4e3-d26e1dc5c1d7 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:31.041838 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1694/3378] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:18:31.049888 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b32d70-7131-49a0-ac17-895b34499bf9 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:31.060150 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b32d70-7131-49a0-ac17-895b34499bf9 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:31.064803 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf691f1e-a9a1-4cb6-b263-8707747c1169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:31.065720 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf691f1e-a9a1-4cb6-b263-8707747c1169 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:31.066221 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf691f1e-a9a1-4cb6-b263-8707747c1169 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:31.066655 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf691f1e-a9a1-4cb6-b263-8707747c1169 admin admin] PATH_INFO: `/v3/projects/255b50a552f641e9b4dc427206e9f3c0/users/600ca5c4eacc4ea6ad4e0fad5d293386/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:31.083915 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf691f1e-a9a1-4cb6-b263-8707747c1169 admin admin] RBAC: Authorizing `identity:create_grant(project_id=255b50a552f641e9b4dc427206e9f3c0, user_id=600ca5c4eacc4ea6ad4e0fad5d293386, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:31.086606 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf691f1e-a9a1-4cb6-b263-8707747c1169 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:31.191267 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1685/3379] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:18:31 2022] PUT /identity/v3/projects/255b50a552f641e9b4dc427206e9f3c0/users/600ca5c4eacc4ea6ad4e0fad5d293386/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:18:31.192958 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d20fb8-bf29-45bb-8f20-a82fc50efecf None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:31.192958 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d20fb8-bf29-45bb-8f20-a82fc50efecf None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:31.192958 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d20fb8-bf29-45bb-8f20-a82fc50efecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:31.240530 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-e9d20fb8-bf29-45bb-8f20-a82fc50efecf None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:18:31.242160 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e9d20fb8-bf29-45bb-8f20-a82fc50efecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:31.333738 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1695/3380] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:18:31.342402 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf691f1e-a9a1-4cb6-b263-8707747c1169 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:31.344498 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-bf691f1e-a9a1-4cb6-b263-8707747c1169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:31.416352 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf691f1e-a9a1-4cb6-b263-8707747c1169 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:31.425998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358f077-6e1e-4e21-b188-ebe7e9f0f1b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:31.426824 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358f077-6e1e-4e21-b188-ebe7e9f0f1b3 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:31.427311 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358f077-6e1e-4e21-b188-ebe7e9f0f1b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:31.427762 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358f077-6e1e-4e21-b188-ebe7e9f0f1b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:31.439285 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358f077-6e1e-4e21-b188-ebe7e9f0f1b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:31.441001 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358f077-6e1e-4e21-b188-ebe7e9f0f1b3 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:31.464093 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1686/3381] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:18:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:18:33.605583 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314226b-95c0-4d26-8b16-62a9e17b3e5f None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:33.606179 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314226b-95c0-4d26-8b16-62a9e17b3e5f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:33.606296 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314226b-95c0-4d26-8b16-62a9e17b3e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:33.706024 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-a314226b-95c0-4d26-8b16-62a9e17b3e5f None None] MFA Rules not processed for user `600ca5c4eacc4ea6ad4e0fad5d293386`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:18:33.710171 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a314226b-95c0-4d26-8b16-62a9e17b3e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:33.909266 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1696/3382] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:18:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:18:34.471802 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358f077-6e1e-4e21-b188-ebe7e9f0f1b3 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:34.474294 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6358f077-6e1e-4e21-b188-ebe7e9f0f1b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:34.642635 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358f077-6e1e-4e21-b188-ebe7e9f0f1b3 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:34.658911 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac2312-b10e-4d74-be91-5fc28d92596d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:34.662138 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac2312-b10e-4d74-be91-5fc28d92596d service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:34.663318 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac2312-b10e-4d74-be91-5fc28d92596d service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:34.663318 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac2312-b10e-4d74-be91-5fc28d92596d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:34.693172 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac2312-b10e-4d74-be91-5fc28d92596d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:34.699627 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac2312-b10e-4d74-be91-5fc28d92596d service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:34.757506 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1687/3383] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:18:34 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:18:38.303247 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314226b-95c0-4d26-8b16-62a9e17b3e5f None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:38.319959 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314226b-95c0-4d26-8b16-62a9e17b3e5f None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:38.321607 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b8374-7c02-41bd-8553-e84009f45bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:38.322538 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b8374-7c02-41bd-8553-e84009f45bf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:38.322830 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b8374-7c02-41bd-8553-e84009f45bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:38.323108 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b8374-7c02-41bd-8553-e84009f45bf9 admin admin] PATH_INFO: `/v3/users/600ca5c4eacc4ea6ad4e0fad5d293386` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:38.324314 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40b8374-7c02-41bd-8553-e84009f45bf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=600ca5c4eacc4ea6ad4e0fad5d293386)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:38.326833 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40b8374-7c02-41bd-8553-e84009f45bf9 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:38.590661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f40b8374-7c02-41bd-8553-e84009f45bf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '600ca5c4eacc4ea6ad4e0fad5d293386'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:38.612094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f40b8374-7c02-41bd-8553-e84009f45bf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '600ca5c4eacc4ea6ad4e0fad5d293386'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:38.689212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f40b8374-7c02-41bd-8553-e84009f45bf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '600ca5c4eacc4ea6ad4e0fad5d293386'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:38.690046 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f40b8374-7c02-41bd-8553-e84009f45bf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '600ca5c4eacc4ea6ad4e0fad5d293386'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:38.698493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f40b8374-7c02-41bd-8553-e84009f45bf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '600ca5c4eacc4ea6ad4e0fad5d293386'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:38.706144 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1697/3384] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:18:38 2022] DELETE /identity/v3/users/600ca5c4eacc4ea6ad4e0fad5d293386 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:18:39.177475 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac2312-b10e-4d74-be91-5fc28d92596d service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:39.193023 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac2312-b10e-4d74-be91-5fc28d92596d service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:39.280643 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bbbcd8-af5d-4d5a-abf5-bc7142ecb1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:39.281888 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbbcd8-af5d-4d5a-abf5-bc7142ecb1fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:39.282337 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbbcd8-af5d-4d5a-abf5-bc7142ecb1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:39.282595 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbbcd8-af5d-4d5a-abf5-bc7142ecb1fa admin admin] PATH_INFO: `/v3/projects/255b50a552f641e9b4dc427206e9f3c0` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:39.283922 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bbbcd8-af5d-4d5a-abf5-bc7142ecb1fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=255b50a552f641e9b4dc427206e9f3c0)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:39.286041 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bbbcd8-af5d-4d5a-abf5-bc7142ecb1fa admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:39.461807 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c6bbbcd8-af5d-4d5a-abf5-bc7142ecb1fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '255b50a552f641e9b4dc427206e9f3c0', 'request_id': 'req-c6bbbcd8-af5d-4d5a-abf5-bc7142ecb1fa'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:39.467953 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c6bbbcd8-af5d-4d5a-abf5-bc7142ecb1fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '255b50a552f641e9b4dc427206e9f3c0', 'request_id': 'req-c6bbbcd8-af5d-4d5a-abf5-bc7142ecb1fa'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:39.474999 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c6bbbcd8-af5d-4d5a-abf5-bc7142ecb1fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '255b50a552f641e9b4dc427206e9f3c0', 'request_id': 'req-c6bbbcd8-af5d-4d5a-abf5-bc7142ecb1fa'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:39.563267 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c6bbbcd8-af5d-4d5a-abf5-bc7142ecb1fa admin admin] The token cache is being invalidate because project 255b50a552f641e9b4dc427206e9f3c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:18:39.563646 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c6bbbcd8-af5d-4d5a-abf5-bc7142ecb1fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:39.567165 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c6bbbcd8-af5d-4d5a-abf5-bc7142ecb1fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:39.567165 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1688/3385] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:18:39 2022] DELETE /identity/v3/projects/255b50a552f641e9b4dc427206e9f3c0 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:18:39.572578 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb7f42-5b09-475d-a367-a90b32274ad9 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:39.573148 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb7f42-5b09-475d-a367-a90b32274ad9 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:39.573148 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb7f42-5b09-475d-a367-a90b32274ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:39.594043 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-91fb7f42-5b09-475d-a367-a90b32274ad9 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:18:39.595343 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-91fb7f42-5b09-475d-a367-a90b32274ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:39.654980 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1698/3386] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:18:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:18:39.663063 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02625b96-4ea4-48e7-add2-f90019de466c None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:39.663687 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02625b96-4ea4-48e7-add2-f90019de466c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:39.664380 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02625b96-4ea4-48e7-add2-f90019de466c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:39.684188 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-02625b96-4ea4-48e7-add2-f90019de466c None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:18:39.685436 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-02625b96-4ea4-48e7-add2-f90019de466c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:39.694333 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1689/3387] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:18:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:18:39.698436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fb7f42-5b09-475d-a367-a90b32274ad9 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:39.710380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fb7f42-5b09-475d-a367-a90b32274ad9 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:39.715208 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1859c4f-99ef-42d8-ae43-3dde97146ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:39.715835 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1859c4f-99ef-42d8-ae43-3dde97146ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:39.716181 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1859c4f-99ef-42d8-ae43-3dde97146ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:39.716976 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1859c4f-99ef-42d8-ae43-3dde97146ca6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:39.717733 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1859c4f-99ef-42d8-ae43-3dde97146ca6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:18:39.718073 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1859c4f-99ef-42d8-ae43-3dde97146ca6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:39.719698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1859c4f-99ef-42d8-ae43-3dde97146ca6 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:39.740982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02625b96-4ea4-48e7-add2-f90019de466c None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:39.742791 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-02625b96-4ea4-48e7-add2-f90019de466c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:39.743458 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1699/3388] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:18:39.748759 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1859c4f-99ef-42d8-ae43-3dde97146ca6 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:39.761241 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1859c4f-99ef-42d8-ae43-3dde97146ca6 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:39.777613 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b9c9c-2880-4eea-bc28-e5129a677427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:39.779297 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b9c9c-2880-4eea-bc28-e5129a677427 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:39.779980 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b9c9c-2880-4eea-bc28-e5129a677427 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:39.780292 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b9c9c-2880-4eea-bc28-e5129a677427 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:39.781775 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b9c9c-2880-4eea-bc28-e5129a677427 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:39.784318 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b9c9c-2880-4eea-bc28-e5129a677427 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:39.840152 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02625b96-4ea4-48e7-add2-f90019de466c None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:39.847018 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f863a13-07e8-4e6a-8e21-809f8a8140e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:39.847814 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f863a13-07e8-4e6a-8e21-809f8a8140e9 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:39.853492 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f863a13-07e8-4e6a-8e21-809f8a8140e9 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:39.853492 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f863a13-07e8-4e6a-8e21-809f8a8140e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:39.853492 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4f863a13-07e8-4e6a-8e21-809f8a8140e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:39.928816 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1700/3389] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:18:39 2022] POST /identity/v3/projects => generated 373 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:18:39.932864 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b9c9c-2880-4eea-bc28-e5129a677427 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:39.934317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f863a13-07e8-4e6a-8e21-809f8a8140e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:39.937286 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f863a13-07e8-4e6a-8e21-809f8a8140e9 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:39.969909 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1690/3390] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:18:39 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:18:40.038022 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b9c9c-2880-4eea-bc28-e5129a677427 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:40.044294 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc848a96-f035-4f5b-a6d3-8b9411603200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:40.045495 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc848a96-f035-4f5b-a6d3-8b9411603200 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:40.046002 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc848a96-f035-4f5b-a6d3-8b9411603200 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:40.046299 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc848a96-f035-4f5b-a6d3-8b9411603200 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:40.046997 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc848a96-f035-4f5b-a6d3-8b9411603200 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:40.049277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc848a96-f035-4f5b-a6d3-8b9411603200 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:40.156594 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1701/3391] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:18:39 2022] POST /identity/v3/users => generated 287 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:18:40.157903 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f863a13-07e8-4e6a-8e21-809f8a8140e9 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:40.171838 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f863a13-07e8-4e6a-8e21-809f8a8140e9 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:40.177474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ececd0d7-aeea-4e33-adec-242218d56e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:40.179399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececd0d7-aeea-4e33-adec-242218d56e52 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:40.179399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececd0d7-aeea-4e33-adec-242218d56e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:40.179399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececd0d7-aeea-4e33-adec-242218d56e52 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:40.180771 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ececd0d7-aeea-4e33-adec-242218d56e52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:40.182698 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ececd0d7-aeea-4e33-adec-242218d56e52 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:40.194834 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1691/3392] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:18:40.198509 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc848a96-f035-4f5b-a6d3-8b9411603200 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:40.210766 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc848a96-f035-4f5b-a6d3-8b9411603200 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:40.216707 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a09626-2e79-469f-8ee6-2d6fbcce446d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:40.217496 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a09626-2e79-469f-8ee6-2d6fbcce446d admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:40.217887 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a09626-2e79-469f-8ee6-2d6fbcce446d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:40.218236 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a09626-2e79-469f-8ee6-2d6fbcce446d admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:40.219045 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a09626-2e79-469f-8ee6-2d6fbcce446d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:40.220890 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a09626-2e79-469f-8ee6-2d6fbcce446d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:40.235892 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1702/3393] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:18:40.238862 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ececd0d7-aeea-4e33-adec-242218d56e52 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:40.250678 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ececd0d7-aeea-4e33-adec-242218d56e52 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:40.256594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34609c35-8f72-4600-b818-4ea8dd03e25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:40.257558 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34609c35-8f72-4600-b818-4ea8dd03e25f admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:40.257894 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34609c35-8f72-4600-b818-4ea8dd03e25f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:40.258176 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34609c35-8f72-4600-b818-4ea8dd03e25f admin admin] PATH_INFO: `/v3/projects/692585b32bd44ddb8ab633a1f1842d5f/users/f3e57c830031491a9d8fd6b3664b4390/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:40.282215 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34609c35-8f72-4600-b818-4ea8dd03e25f admin admin] RBAC: Authorizing `identity:create_grant(project_id=692585b32bd44ddb8ab633a1f1842d5f, user_id=f3e57c830031491a9d8fd6b3664b4390, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:40.290022 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34609c35-8f72-4600-b818-4ea8dd03e25f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:40.392661 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1692/3394] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:18:40 2022] PUT /identity/v3/projects/692585b32bd44ddb8ab633a1f1842d5f/users/f3e57c830031491a9d8fd6b3664b4390/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:18:40.398277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4a071-205e-4ef3-b513-a3d2dc32ca7e None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:40.398573 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4a071-205e-4ef3-b513-a3d2dc32ca7e None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:40.398857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4a071-205e-4ef3-b513-a3d2dc32ca7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:40.418128 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-5cc4a071-205e-4ef3-b513-a3d2dc32ca7e None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:18:40.419891 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5cc4a071-205e-4ef3-b513-a3d2dc32ca7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:40.485865 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1703/3395] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:18:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:18:40.494762 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34609c35-8f72-4600-b818-4ea8dd03e25f admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:40.496659 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-34609c35-8f72-4600-b818-4ea8dd03e25f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:40.569981 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34609c35-8f72-4600-b818-4ea8dd03e25f admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:40.575242 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af7902-337a-4e24-9081-c487275c833f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:40.576622 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af7902-337a-4e24-9081-c487275c833f service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:40.577062 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af7902-337a-4e24-9081-c487275c833f service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:40.578438 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af7902-337a-4e24-9081-c487275c833f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:40.590147 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38af7902-337a-4e24-9081-c487275c833f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:40.592441 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38af7902-337a-4e24-9081-c487275c833f service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:40.621356 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1693/3396] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:18:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:18:48.835372 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4a071-205e-4ef3-b513-a3d2dc32ca7e None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:48.837025 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5cc4a071-205e-4ef3-b513-a3d2dc32ca7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:48.864672 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4a071-205e-4ef3-b513-a3d2dc32ca7e None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:48.864672 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a78f3-27ec-49e5-8640-d7948bf46281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:48.864672 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a78f3-27ec-49e5-8640-d7948bf46281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:48.864672 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a78f3-27ec-49e5-8640-d7948bf46281 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:48.865133 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a78f3-27ec-49e5-8640-d7948bf46281 admin admin] PATH_INFO: `/v3/users/0140b2412e3b455eabd9ce46e39027e2` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:48.865133 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a78f3-27ec-49e5-8640-d7948bf46281 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0140b2412e3b455eabd9ce46e39027e2)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:48.866997 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a78f3-27ec-49e5-8640-d7948bf46281 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:49.113302 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b36a78f3-27ec-49e5-8640-d7948bf46281 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0140b2412e3b455eabd9ce46e39027e2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:49.143539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b36a78f3-27ec-49e5-8640-d7948bf46281 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0140b2412e3b455eabd9ce46e39027e2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:49.210012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b36a78f3-27ec-49e5-8640-d7948bf46281 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0140b2412e3b455eabd9ce46e39027e2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:49.210941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b36a78f3-27ec-49e5-8640-d7948bf46281 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0140b2412e3b455eabd9ce46e39027e2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:49.221609 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b36a78f3-27ec-49e5-8640-d7948bf46281 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0140b2412e3b455eabd9ce46e39027e2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:49.237972 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1704/3397] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:18:48 2022] DELETE /identity/v3/users/0140b2412e3b455eabd9ce46e39027e2 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:18:49.897146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af7902-337a-4e24-9081-c487275c833f service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:49.912006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af7902-337a-4e24-9081-c487275c833f service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:50.066708 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117df888-3e7f-4b54-8257-f79c8ae1bd17 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:50.067522 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117df888-3e7f-4b54-8257-f79c8ae1bd17 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:50.067971 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117df888-3e7f-4b54-8257-f79c8ae1bd17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:50.071417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2fbf5-9d24-427b-ace1-59334191b286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:50.078513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2fbf5-9d24-427b-ace1-59334191b286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:50.078513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2fbf5-9d24-427b-ace1-59334191b286 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:50.078513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2fbf5-9d24-427b-ace1-59334191b286 admin admin] PATH_INFO: `/v3/projects/14cb627425b94ce890bd232988d4f051` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:50.079400 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa2fbf5-9d24-427b-ace1-59334191b286 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14cb627425b94ce890bd232988d4f051)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:50.081555 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa2fbf5-9d24-427b-ace1-59334191b286 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:50.139959 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-117df888-3e7f-4b54-8257-f79c8ae1bd17 None None] MFA Rules not processed for user `f3e57c830031491a9d8fd6b3664b4390`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:18:50.141086 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-117df888-3e7f-4b54-8257-f79c8ae1bd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:50.261243 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6fa2fbf5-9d24-427b-ace1-59334191b286 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14cb627425b94ce890bd232988d4f051', 'request_id': 'req-6fa2fbf5-9d24-427b-ace1-59334191b286'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:50.269206 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6fa2fbf5-9d24-427b-ace1-59334191b286 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14cb627425b94ce890bd232988d4f051', 'request_id': 'req-6fa2fbf5-9d24-427b-ace1-59334191b286'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:50.286666 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1705/3398] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:18:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:18:50.296774 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6fa2fbf5-9d24-427b-ace1-59334191b286 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14cb627425b94ce890bd232988d4f051', 'request_id': 'req-6fa2fbf5-9d24-427b-ace1-59334191b286'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:50.316512 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117df888-3e7f-4b54-8257-f79c8ae1bd17 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:50.318659 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-117df888-3e7f-4b54-8257-f79c8ae1bd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:50.376490 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6fa2fbf5-9d24-427b-ace1-59334191b286 admin admin] The token cache is being invalidate because project 14cb627425b94ce890bd232988d4f051 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:18:50.377887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6fa2fbf5-9d24-427b-ace1-59334191b286 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:50.382541 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6fa2fbf5-9d24-427b-ace1-59334191b286 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:50.390670 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1694/3399] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:18:49 2022] DELETE /identity/v3/projects/14cb627425b94ce890bd232988d4f051 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:18:50.395520 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676fb2a-fdd2-4979-9bef-aedce8c5ae58 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:50.396073 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676fb2a-fdd2-4979-9bef-aedce8c5ae58 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:50.396538 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676fb2a-fdd2-4979-9bef-aedce8c5ae58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:50.432151 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-c676fb2a-fdd2-4979-9bef-aedce8c5ae58 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:18:50.437027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c676fb2a-fdd2-4979-9bef-aedce8c5ae58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:50.457169 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117df888-3e7f-4b54-8257-f79c8ae1bd17 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:50.576680 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81814f5a-112d-445b-8d71-4e8b654af4a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:50.578448 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81814f5a-112d-445b-8d71-4e8b654af4a7 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:50.579059 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81814f5a-112d-445b-8d71-4e8b654af4a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:50.579524 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81814f5a-112d-445b-8d71-4e8b654af4a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:50.582374 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-81814f5a-112d-445b-8d71-4e8b654af4a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:50.603999 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1695/3400] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:18:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:18:50.612567 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd9c38-9d80-4a97-a369-3ab1f339f363 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:50.612976 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd9c38-9d80-4a97-a369-3ab1f339f363 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:50.613347 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd9c38-9d80-4a97-a369-3ab1f339f363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:50.669812 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-83fd9c38-9d80-4a97-a369-3ab1f339f363 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:18:50.669812 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-83fd9c38-9d80-4a97-a369-3ab1f339f363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:50.674750 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81814f5a-112d-445b-8d71-4e8b654af4a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:50.676523 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81814f5a-112d-445b-8d71-4e8b654af4a7 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:50.688047 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1706/3401] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:18:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:18:50.688442 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1696/3402] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:18:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:18:50.695335 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81814f5a-112d-445b-8d71-4e8b654af4a7 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:50.715520 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81814f5a-112d-445b-8d71-4e8b654af4a7 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:50.736562 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0667b1f-73d3-4c9b-be9b-d1feb54d4f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:50.737407 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0667b1f-73d3-4c9b-be9b-d1feb54d4f28 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:50.738157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0667b1f-73d3-4c9b-be9b-d1feb54d4f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:50.738742 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0667b1f-73d3-4c9b-be9b-d1feb54d4f28 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:50.739582 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0667b1f-73d3-4c9b-be9b-d1feb54d4f28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:18:50.739988 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0667b1f-73d3-4c9b-be9b-d1feb54d4f28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:50.743998 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0667b1f-73d3-4c9b-be9b-d1feb54d4f28 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:50.777578 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1707/3403] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:18:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:18:50.782343 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd9c38-9d80-4a97-a369-3ab1f339f363 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:50.795522 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd9c38-9d80-4a97-a369-3ab1f339f363 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:50.807545 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed383b97-69e6-414a-90d4-b3c4f7533890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:50.808271 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed383b97-69e6-414a-90d4-b3c4f7533890 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:50.808553 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed383b97-69e6-414a-90d4-b3c4f7533890 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:50.808829 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed383b97-69e6-414a-90d4-b3c4f7533890 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:50.810093 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed383b97-69e6-414a-90d4-b3c4f7533890 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:50.812031 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed383b97-69e6-414a-90d4-b3c4f7533890 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:50.939327 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1697/3404] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:18:50 2022] POST /identity/v3/projects => generated 397 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:18:50.943637 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0667b1f-73d3-4c9b-be9b-d1feb54d4f28 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:50.959813 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0667b1f-73d3-4c9b-be9b-d1feb54d4f28 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:51.030334 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc90fc-34b7-4be2-bd72-5df5b4fc6cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:51.031793 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc90fc-34b7-4be2-bd72-5df5b4fc6cbf admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:51.038638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc90fc-34b7-4be2-bd72-5df5b4fc6cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:51.038638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc90fc-34b7-4be2-bd72-5df5b4fc6cbf admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:51.038638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc90fc-34b7-4be2-bd72-5df5b4fc6cbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:51.038638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc90fc-34b7-4be2-bd72-5df5b4fc6cbf admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:51.136164 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1708/3405] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:18:50 2022] POST /identity/v3/users => generated 299 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:18:51.141196 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed383b97-69e6-414a-90d4-b3c4f7533890 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:51.154393 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed383b97-69e6-414a-90d4-b3c4f7533890 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:51.159539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40025b-15ed-472e-a7c5-9596302b96f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:51.160220 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40025b-15ed-472e-a7c5-9596302b96f6 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:51.160500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40025b-15ed-472e-a7c5-9596302b96f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:51.160778 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40025b-15ed-472e-a7c5-9596302b96f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:51.161508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40025b-15ed-472e-a7c5-9596302b96f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:51.163178 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40025b-15ed-472e-a7c5-9596302b96f6 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:51.179475 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1698/3406] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:18:51.183309 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc90fc-34b7-4be2-bd72-5df5b4fc6cbf admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:51.197334 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc90fc-34b7-4be2-bd72-5df5b4fc6cbf admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:51.213797 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e6b45-e74b-4fa3-90e0-b38e78d14fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:51.214932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e6b45-e74b-4fa3-90e0-b38e78d14fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:51.214932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e6b45-e74b-4fa3-90e0-b38e78d14fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:51.215135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e6b45-e74b-4fa3-90e0-b38e78d14fe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:51.216273 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e6b45-e74b-4fa3-90e0-b38e78d14fe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:51.218171 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e6b45-e74b-4fa3-90e0-b38e78d14fe5 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:51.246288 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1709/3407] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:18:51.250471 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40025b-15ed-472e-a7c5-9596302b96f6 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:51.264802 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40025b-15ed-472e-a7c5-9596302b96f6 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:51.283322 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cff5a0-1252-48b9-98c0-627ef0dc683f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:51.284229 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cff5a0-1252-48b9-98c0-627ef0dc683f admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:51.284699 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cff5a0-1252-48b9-98c0-627ef0dc683f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:51.285166 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cff5a0-1252-48b9-98c0-627ef0dc683f admin admin] PATH_INFO: `/v3/projects/c4256d368ce04e07b4bb7b52fe2e763e/users/435450aebd8549d4bdd41d4bd0dc3805/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:51.319405 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cff5a0-1252-48b9-98c0-627ef0dc683f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4256d368ce04e07b4bb7b52fe2e763e, user_id=435450aebd8549d4bdd41d4bd0dc3805, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:51.322687 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cff5a0-1252-48b9-98c0-627ef0dc683f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:51.399359 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1699/3408] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:18:51 2022] PUT /identity/v3/projects/c4256d368ce04e07b4bb7b52fe2e763e/users/435450aebd8549d4bdd41d4bd0dc3805/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:18:51.411353 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f28f1-48b2-40f0-990a-e7e3b277f107 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:51.412225 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f28f1-48b2-40f0-990a-e7e3b277f107 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:51.413292 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f28f1-48b2-40f0-990a-e7e3b277f107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:51.448772 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-305f28f1-48b2-40f0-990a-e7e3b277f107 None None] MFA Rules not processed for user `435450aebd8549d4bdd41d4bd0dc3805`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:18:51.450094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-305f28f1-48b2-40f0-990a-e7e3b277f107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:51.545220 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1710/3409] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:18:51 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:18:51.561598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cff5a0-1252-48b9-98c0-627ef0dc683f admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:51.563844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-12cff5a0-1252-48b9-98c0-627ef0dc683f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:51.600077 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ca9bb-35d5-4efe-89c8-b5da3cd9adc8 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:51.600396 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ca9bb-35d5-4efe-89c8-b5da3cd9adc8 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:51.600683 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ca9bb-35d5-4efe-89c8-b5da3cd9adc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:51.630021 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-657ca9bb-35d5-4efe-89c8-b5da3cd9adc8 None None] MFA Rules not processed for user `1961bb1779214710bc073d188262f1fb`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:18:51.643217 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-657ca9bb-35d5-4efe-89c8-b5da3cd9adc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:51.724100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cff5a0-1252-48b9-98c0-627ef0dc683f admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:51.764488 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc64c67e-a343-4a66-9ad8-3d6c720cefff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:51.765247 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64c67e-a343-4a66-9ad8-3d6c720cefff service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:51.765528 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64c67e-a343-4a66-9ad8-3d6c720cefff service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:51.765832 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64c67e-a343-4a66-9ad8-3d6c720cefff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:51.769279 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1711/3410] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:18:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:18:51.795169 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc64c67e-a343-4a66-9ad8-3d6c720cefff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:51.796954 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc64c67e-a343-4a66-9ad8-3d6c720cefff service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:51.819527 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1700/3411] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:18:51 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:18:52.174922 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ca9bb-35d5-4efe-89c8-b5da3cd9adc8 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:52.248246 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ca9bb-35d5-4efe-89c8-b5da3cd9adc8 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:52.253234 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12d6a9-fe95-44bd-af5a-c3252881fea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:52.254356 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12d6a9-fe95-44bd-af5a-c3252881fea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:52.254645 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12d6a9-fe95-44bd-af5a-c3252881fea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:52.254910 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12d6a9-fe95-44bd-af5a-c3252881fea4 admin admin] PATH_INFO: `/v3/users/435450aebd8549d4bdd41d4bd0dc3805` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:52.256268 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd12d6a9-fe95-44bd-af5a-c3252881fea4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=435450aebd8549d4bdd41d4bd0dc3805)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:52.258236 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd12d6a9-fe95-44bd-af5a-c3252881fea4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:52.477020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-bd12d6a9-fe95-44bd-af5a-c3252881fea4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '435450aebd8549d4bdd41d4bd0dc3805'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:52.496097 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-bd12d6a9-fe95-44bd-af5a-c3252881fea4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '435450aebd8549d4bdd41d4bd0dc3805'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:52.566205 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-bd12d6a9-fe95-44bd-af5a-c3252881fea4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '435450aebd8549d4bdd41d4bd0dc3805'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:52.569850 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-bd12d6a9-fe95-44bd-af5a-c3252881fea4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '435450aebd8549d4bdd41d4bd0dc3805'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:52.594984 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-bd12d6a9-fe95-44bd-af5a-c3252881fea4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '435450aebd8549d4bdd41d4bd0dc3805'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:52.610327 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1712/3412] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:18:52 2022] DELETE /identity/v3/users/435450aebd8549d4bdd41d4bd0dc3805 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:18:52.615556 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51584495-0194-4179-82bd-586f7b4a70b6 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:52.616081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51584495-0194-4179-82bd-586f7b4a70b6 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:52.616217 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51584495-0194-4179-82bd-586f7b4a70b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:52.636203 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-51584495-0194-4179-82bd-586f7b4a70b6 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:18:52.645869 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-51584495-0194-4179-82bd-586f7b4a70b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:52.783350 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1701/3413] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:18:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:18:52.803098 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12d6a9-fe95-44bd-af5a-c3252881fea4 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:52.805634 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-bd12d6a9-fe95-44bd-af5a-c3252881fea4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:52.890918 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12d6a9-fe95-44bd-af5a-c3252881fea4 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:52.895487 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4d6f9-919f-469f-902f-a1f9a13e4335 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:52.896159 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4d6f9-919f-469f-902f-a1f9a13e4335 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:52.896499 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4d6f9-919f-469f-902f-a1f9a13e4335 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:52.896787 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4d6f9-919f-469f-902f-a1f9a13e4335 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:52.909127 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4d6f9-919f-469f-902f-a1f9a13e4335 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:52.910923 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4d6f9-919f-469f-902f-a1f9a13e4335 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:52.939688 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1713/3414] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:18:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:18:53.745918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51584495-0194-4179-82bd-586f7b4a70b6 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:53.745918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-51584495-0194-4179-82bd-586f7b4a70b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:53.764253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51584495-0194-4179-82bd-586f7b4a70b6 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:53.769081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d099ee2-5d24-4ac4-af92-003e248d8bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:53.770400 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d099ee2-5d24-4ac4-af92-003e248d8bee admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:53.770678 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d099ee2-5d24-4ac4-af92-003e248d8bee admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:53.771139 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d099ee2-5d24-4ac4-af92-003e248d8bee admin admin] PATH_INFO: `/v3/projects/c4256d368ce04e07b4bb7b52fe2e763e` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:53.772494 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d099ee2-5d24-4ac4-af92-003e248d8bee admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4256d368ce04e07b4bb7b52fe2e763e)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:53.774444 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d099ee2-5d24-4ac4-af92-003e248d8bee admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:53.936950 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5d099ee2-5d24-4ac4-af92-003e248d8bee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4256d368ce04e07b4bb7b52fe2e763e', 'request_id': 'req-5d099ee2-5d24-4ac4-af92-003e248d8bee'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:53.945111 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5d099ee2-5d24-4ac4-af92-003e248d8bee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4256d368ce04e07b4bb7b52fe2e763e', 'request_id': 'req-5d099ee2-5d24-4ac4-af92-003e248d8bee'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:53.956409 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5d099ee2-5d24-4ac4-af92-003e248d8bee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4256d368ce04e07b4bb7b52fe2e763e', 'request_id': 'req-5d099ee2-5d24-4ac4-af92-003e248d8bee'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:54.099392 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5d099ee2-5d24-4ac4-af92-003e248d8bee admin admin] The token cache is being invalidate because project c4256d368ce04e07b4bb7b52fe2e763e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:18:54.099928 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5d099ee2-5d24-4ac4-af92-003e248d8bee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:54.101045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5d099ee2-5d24-4ac4-af92-003e248d8bee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:54.103138 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1702/3415] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:18:53 2022] DELETE /identity/v3/projects/c4256d368ce04e07b4bb7b52fe2e763e => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:18:54.108897 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7ed14-9d5a-4cd1-b717-463af28b30cc None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:54.108897 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7ed14-9d5a-4cd1-b717-463af28b30cc None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:54.108897 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7ed14-9d5a-4cd1-b717-463af28b30cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:54.133358 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-f6b7ed14-9d5a-4cd1-b717-463af28b30cc None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:18:54.138079 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f6b7ed14-9d5a-4cd1-b717-463af28b30cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:54.227780 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1714/3416] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:18:54.228506 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea59dba-5201-46d7-9ffe-4acf8dea7545 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:54.228794 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea59dba-5201-46d7-9ffe-4acf8dea7545 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:54.229317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea59dba-5201-46d7-9ffe-4acf8dea7545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:54.236196 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7ed14-9d5a-4cd1-b717-463af28b30cc None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:54.238212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f6b7ed14-9d5a-4cd1-b717-463af28b30cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:54.256632 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-9ea59dba-5201-46d7-9ffe-4acf8dea7545 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:18:54.258998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9ea59dba-5201-46d7-9ffe-4acf8dea7545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:54.276582 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7ed14-9d5a-4cd1-b717-463af28b30cc None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:54.282271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec320841-021a-47f4-9b53-a7971dda51d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:54.283215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec320841-021a-47f4-9b53-a7971dda51d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:54.283532 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec320841-021a-47f4-9b53-a7971dda51d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:54.283810 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec320841-021a-47f4-9b53-a7971dda51d6 admin admin] PATH_INFO: `/v3/users/6a323f0848cb404092fe96f6c4168468` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:54.285049 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec320841-021a-47f4-9b53-a7971dda51d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a323f0848cb404092fe96f6c4168468)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:54.287199 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec320841-021a-47f4-9b53-a7971dda51d6 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:54.322284 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1703/3417] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:18:54.328207 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902249d-5b2d-4887-8d7c-a5c198cdc70e None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:54.328691 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902249d-5b2d-4887-8d7c-a5c198cdc70e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:54.329159 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902249d-5b2d-4887-8d7c-a5c198cdc70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:54.355842 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-a902249d-5b2d-4887-8d7c-a5c198cdc70e None None] MFA Rules not processed for user `f3e57c830031491a9d8fd6b3664b4390`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:18:54.357769 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a902249d-5b2d-4887-8d7c-a5c198cdc70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:54.431860 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1704/3418] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:18:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:18:54.433112 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902249d-5b2d-4887-8d7c-a5c198cdc70e None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:54.455391 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902249d-5b2d-4887-8d7c-a5c198cdc70e None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:54.461746 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8cfeee-349c-480b-a401-1872daaa0145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:54.462517 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8cfeee-349c-480b-a401-1872daaa0145 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:54.462870 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8cfeee-349c-480b-a401-1872daaa0145 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:54.463231 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8cfeee-349c-480b-a401-1872daaa0145 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:54.464028 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8cfeee-349c-480b-a401-1872daaa0145 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:18:54.464439 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8cfeee-349c-480b-a401-1872daaa0145 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:54.466799 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8cfeee-349c-480b-a401-1872daaa0145 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:54.485646 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1705/3419] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:18:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:18:54.493443 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8cfeee-349c-480b-a401-1872daaa0145 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:54.513811 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8cfeee-349c-480b-a401-1872daaa0145 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:54.525933 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1894c-7017-4457-91e3-ff43b51802c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:54.526753 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1894c-7017-4457-91e3-ff43b51802c0 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:54.527170 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1894c-7017-4457-91e3-ff43b51802c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:54.527544 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1894c-7017-4457-91e3-ff43b51802c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:54.530759 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a1894c-7017-4457-91e3-ff43b51802c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:54.532908 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a1894c-7017-4457-91e3-ff43b51802c0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:54.582208 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ec320841-021a-47f4-9b53-a7971dda51d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a323f0848cb404092fe96f6c4168468'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:54.604941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ec320841-021a-47f4-9b53-a7971dda51d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a323f0848cb404092fe96f6c4168468'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:54.693341 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ec320841-021a-47f4-9b53-a7971dda51d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a323f0848cb404092fe96f6c4168468'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:54.701071 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ec320841-021a-47f4-9b53-a7971dda51d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a323f0848cb404092fe96f6c4168468'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:54.715276 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1706/3420] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:18:54 2022] POST /identity/v3/projects => generated 379 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:18:54.720011 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1894c-7017-4457-91e3-ff43b51802c0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:54.720689 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ec320841-021a-47f4-9b53-a7971dda51d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a323f0848cb404092fe96f6c4168468'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:54.734493 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1715/3421] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:18:54 2022] DELETE /identity/v3/users/6a323f0848cb404092fe96f6c4168468 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:18:54.748870 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c6423-01e4-40d4-8016-d6ea33a68683 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:54.749454 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c6423-01e4-40d4-8016-d6ea33a68683 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:54.749994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c6423-01e4-40d4-8016-d6ea33a68683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:54.786163 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-784c6423-01e4-40d4-8016-d6ea33a68683 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:18:54.787427 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-784c6423-01e4-40d4-8016-d6ea33a68683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:54.846724 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1894c-7017-4457-91e3-ff43b51802c0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:54.900788 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1716/3422] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:18:54.917675 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c6423-01e4-40d4-8016-d6ea33a68683 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:54.919649 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-784c6423-01e4-40d4-8016-d6ea33a68683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:54.930107 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def0ed5-52cd-4d58-be43-1d142cae228c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:54.931738 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def0ed5-52cd-4d58-be43-1d142cae228c admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:54.932228 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def0ed5-52cd-4d58-be43-1d142cae228c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:54.934378 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def0ed5-52cd-4d58-be43-1d142cae228c admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:54.937386 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def0ed5-52cd-4d58-be43-1d142cae228c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:54.941441 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def0ed5-52cd-4d58-be43-1d142cae228c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:55.046666 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c6423-01e4-40d4-8016-d6ea33a68683 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:55.058969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6312fd3-c4d1-4766-b42f-e08c51a96409 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:55.059840 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6312fd3-c4d1-4766-b42f-e08c51a96409 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:55.060161 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6312fd3-c4d1-4766-b42f-e08c51a96409 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:55.061925 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6312fd3-c4d1-4766-b42f-e08c51a96409 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:55.082987 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6312fd3-c4d1-4766-b42f-e08c51a96409 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:55.089896 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6312fd3-c4d1-4766-b42f-e08c51a96409 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:55.101625 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1707/3423] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:18:54 2022] POST /identity/v3/users => generated 290 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:18:55.106118 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def0ed5-52cd-4d58-be43-1d142cae228c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:55.109351 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2def0ed5-52cd-4d58-be43-1d142cae228c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:55.128598 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1717/3424] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:18:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:18:55.140444 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def0ed5-52cd-4d58-be43-1d142cae228c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:55.146281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf4d07-f7ab-43d7-b4df-a26c8306fcb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:55.148047 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf4d07-f7ab-43d7-b4df-a26c8306fcb7 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:55.148330 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf4d07-f7ab-43d7-b4df-a26c8306fcb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:55.148606 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf4d07-f7ab-43d7-b4df-a26c8306fcb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:55.151786 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebf4d07-f7ab-43d7-b4df-a26c8306fcb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:55.151786 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebf4d07-f7ab-43d7-b4df-a26c8306fcb7 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:55.180764 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1708/3425] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:18:55.183052 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6312fd3-c4d1-4766-b42f-e08c51a96409 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:55.207840 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6312fd3-c4d1-4766-b42f-e08c51a96409 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:55.222624 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c4a43-4b30-4199-9557-c55435732521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:55.223460 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c4a43-4b30-4199-9557-c55435732521 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:55.224633 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c4a43-4b30-4199-9557-c55435732521 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:55.226456 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c4a43-4b30-4199-9557-c55435732521 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:55.227402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301c4a43-4b30-4199-9557-c55435732521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:55.230123 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301c4a43-4b30-4199-9557-c55435732521 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:55.250827 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1718/3426] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:18:55.252422 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf4d07-f7ab-43d7-b4df-a26c8306fcb7 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:55.270891 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf4d07-f7ab-43d7-b4df-a26c8306fcb7 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:55.279814 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0e170-28c1-4281-9699-2f0a288fdf43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:55.280473 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0e170-28c1-4281-9699-2f0a288fdf43 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:55.280831 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0e170-28c1-4281-9699-2f0a288fdf43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:55.281180 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0e170-28c1-4281-9699-2f0a288fdf43 admin admin] PATH_INFO: `/v3/projects/65633a0f121948df985e316e3b459970/users/cbaa860b758b49e78d244970875e509d/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:55.320744 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f0e170-28c1-4281-9699-2f0a288fdf43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65633a0f121948df985e316e3b459970, user_id=cbaa860b758b49e78d244970875e509d, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:55.324348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f0e170-28c1-4281-9699-2f0a288fdf43 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:55.520194 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1709/3427] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:18:55 2022] PUT /identity/v3/projects/65633a0f121948df985e316e3b459970/users/cbaa860b758b49e78d244970875e509d/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:18:55.531726 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fb4a2-0a36-46d4-9f4c-610d68d3fc19 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:55.532023 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fb4a2-0a36-46d4-9f4c-610d68d3fc19 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:55.532326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fb4a2-0a36-46d4-9f4c-610d68d3fc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:55.583355 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-397fb4a2-0a36-46d4-9f4c-610d68d3fc19 None None] MFA Rules not processed for user `cbaa860b758b49e78d244970875e509d`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:18:55.587811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-397fb4a2-0a36-46d4-9f4c-610d68d3fc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:55.757712 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1719/3428] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:18:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:18:55.769546 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89190f5-4bdc-44b7-8b35-ecbe357d11ff None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:55.770130 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89190f5-4bdc-44b7-8b35-ecbe357d11ff None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:55.770302 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89190f5-4bdc-44b7-8b35-ecbe357d11ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:55.816570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-a89190f5-4bdc-44b7-8b35-ecbe357d11ff None None] MFA Rules not processed for user `cbaa860b758b49e78d244970875e509d`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:18:55.817851 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a89190f5-4bdc-44b7-8b35-ecbe357d11ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:55.834343 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1710/3429] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:18:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:18:55.844441 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397fb4a2-0a36-46d4-9f4c-610d68d3fc19 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:55.845995 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-397fb4a2-0a36-46d4-9f4c-610d68d3fc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:55.975373 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397fb4a2-0a36-46d4-9f4c-610d68d3fc19 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:55.986221 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165c74d-83b8-4dbc-bcbc-d4dd81668eb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:55.995845 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165c74d-83b8-4dbc-bcbc-d4dd81668eb5 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:55.996185 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165c74d-83b8-4dbc-bcbc-d4dd81668eb5 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:55.996509 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165c74d-83b8-4dbc-bcbc-d4dd81668eb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:56.021411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165c74d-83b8-4dbc-bcbc-d4dd81668eb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:56.026297 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165c74d-83b8-4dbc-bcbc-d4dd81668eb5 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:56.067151 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1720/3430] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:18:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:18:56.734670 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89190f5-4bdc-44b7-8b35-ecbe357d11ff None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:56.736785 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a89190f5-4bdc-44b7-8b35-ecbe357d11ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:56.989908 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89190f5-4bdc-44b7-8b35-ecbe357d11ff None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:56.996564 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109dd8f-e255-4d2c-aeeb-44502fe980ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:56.998579 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109dd8f-e255-4d2c-aeeb-44502fe980ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:57.002381 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109dd8f-e255-4d2c-aeeb-44502fe980ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:57.002381 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109dd8f-e255-4d2c-aeeb-44502fe980ee admin admin] PATH_INFO: `/v3/projects/7eac2a1411444a6293feba25da6fead3` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:57.002381 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109dd8f-e255-4d2c-aeeb-44502fe980ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=7eac2a1411444a6293feba25da6fead3)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:57.005240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109dd8f-e255-4d2c-aeeb-44502fe980ee admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:57.157941 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3109dd8f-e255-4d2c-aeeb-44502fe980ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7eac2a1411444a6293feba25da6fead3', 'request_id': 'req-3109dd8f-e255-4d2c-aeeb-44502fe980ee'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:57.165508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3109dd8f-e255-4d2c-aeeb-44502fe980ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7eac2a1411444a6293feba25da6fead3', 'request_id': 'req-3109dd8f-e255-4d2c-aeeb-44502fe980ee'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:57.178701 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3109dd8f-e255-4d2c-aeeb-44502fe980ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7eac2a1411444a6293feba25da6fead3', 'request_id': 'req-3109dd8f-e255-4d2c-aeeb-44502fe980ee'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:57.307459 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3109dd8f-e255-4d2c-aeeb-44502fe980ee admin admin] The token cache is being invalidate because project 7eac2a1411444a6293feba25da6fead3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:18:57.307909 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3109dd8f-e255-4d2c-aeeb-44502fe980ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:57.309604 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3109dd8f-e255-4d2c-aeeb-44502fe980ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:57.314435 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1711/3431] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:18:56 2022] DELETE /identity/v3/projects/7eac2a1411444a6293feba25da6fead3 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:18:57.319112 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165c74d-83b8-4dbc-bcbc-d4dd81668eb5 service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:57.334203 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165c74d-83b8-4dbc-bcbc-d4dd81668eb5 service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:57.433241 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d5155-35c4-496f-8e28-71e981c604b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:57.439687 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d5155-35c4-496f-8e28-71e981c604b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:57.440286 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d5155-35c4-496f-8e28-71e981c604b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:57.440611 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d5155-35c4-496f-8e28-71e981c604b0 admin admin] PATH_INFO: `/v3/users/04b1d648bf5549249e4be31cd46419f1` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:57.442551 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d5155-35c4-496f-8e28-71e981c604b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04b1d648bf5549249e4be31cd46419f1)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:57.448257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d5155-35c4-496f-8e28-71e981c604b0 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:57.701647 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-9e9d5155-35c4-496f-8e28-71e981c604b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04b1d648bf5549249e4be31cd46419f1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:57.720208 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-9e9d5155-35c4-496f-8e28-71e981c604b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04b1d648bf5549249e4be31cd46419f1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:57.783787 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-9e9d5155-35c4-496f-8e28-71e981c604b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04b1d648bf5549249e4be31cd46419f1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:57.784698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-9e9d5155-35c4-496f-8e28-71e981c604b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04b1d648bf5549249e4be31cd46419f1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:57.796901 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-9e9d5155-35c4-496f-8e28-71e981c604b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04b1d648bf5549249e4be31cd46419f1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:57.804911 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1721/3432] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:18:57 2022] DELETE /identity/v3/users/04b1d648bf5549249e4be31cd46419f1 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:18:58.822749 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109dd8f-e255-4d2c-aeeb-44502fe980ee admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:58.825700 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3109dd8f-e255-4d2c-aeeb-44502fe980ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:58.847826 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109dd8f-e255-4d2c-aeeb-44502fe980ee admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:58.964284 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a1271-adf2-47dd-87c0-0eaa6fa97e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:58.966172 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a1271-adf2-47dd-87c0-0eaa6fa97e37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:58.966619 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a1271-adf2-47dd-87c0-0eaa6fa97e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:58.967055 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a1271-adf2-47dd-87c0-0eaa6fa97e37 admin admin] PATH_INFO: `/v3/projects/4255d81171bc4214abc58ec087bc8237` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:58.968451 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a1271-adf2-47dd-87c0-0eaa6fa97e37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4255d81171bc4214abc58ec087bc8237)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:58.971188 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a1271-adf2-47dd-87c0-0eaa6fa97e37 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:59.125784 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-315a1271-adf2-47dd-87c0-0eaa6fa97e37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4255d81171bc4214abc58ec087bc8237', 'request_id': 'req-315a1271-adf2-47dd-87c0-0eaa6fa97e37'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:59.135585 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-315a1271-adf2-47dd-87c0-0eaa6fa97e37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4255d81171bc4214abc58ec087bc8237', 'request_id': 'req-315a1271-adf2-47dd-87c0-0eaa6fa97e37'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:59.165869 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-315a1271-adf2-47dd-87c0-0eaa6fa97e37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4255d81171bc4214abc58ec087bc8237', 'request_id': 'req-315a1271-adf2-47dd-87c0-0eaa6fa97e37'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:59.291062 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-315a1271-adf2-47dd-87c0-0eaa6fa97e37 admin admin] The token cache is being invalidate because project 4255d81171bc4214abc58ec087bc8237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:18:59.291354 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-315a1271-adf2-47dd-87c0-0eaa6fa97e37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:59.294030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-315a1271-adf2-47dd-87c0-0eaa6fa97e37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:18:59.299316 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1712/3433] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:18:58 2022] DELETE /identity/v3/projects/4255d81171bc4214abc58ec087bc8237 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:18:59.300899 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95fed6-2974-4105-87f3-39176565da38 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:59.301358 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95fed6-2974-4105-87f3-39176565da38 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:59.301555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95fed6-2974-4105-87f3-39176565da38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:59.332400 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-5e95fed6-2974-4105-87f3-39176565da38 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:18:59.335584 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5e95fed6-2974-4105-87f3-39176565da38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:59.422031 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1722/3434] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:18:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:18:59.432711 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65419bf2-9590-41d3-a43a-bded2b06b828 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:59.432953 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65419bf2-9590-41d3-a43a-bded2b06b828 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:59.433421 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65419bf2-9590-41d3-a43a-bded2b06b828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:59.463059 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-65419bf2-9590-41d3-a43a-bded2b06b828 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:18:59.464718 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-65419bf2-9590-41d3-a43a-bded2b06b828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:18:59.478146 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1713/3435] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:18:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:18:59.479131 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95fed6-2974-4105-87f3-39176565da38 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:59.495975 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95fed6-2974-4105-87f3-39176565da38 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:59.506431 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d6a81-e81a-448b-8d05-71ea51f3e30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:59.507718 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d6a81-e81a-448b-8d05-71ea51f3e30f admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:59.508823 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d6a81-e81a-448b-8d05-71ea51f3e30f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:59.509512 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d6a81-e81a-448b-8d05-71ea51f3e30f admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:59.510513 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d6a81-e81a-448b-8d05-71ea51f3e30f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:18:59.511596 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d6a81-e81a-448b-8d05-71ea51f3e30f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:59.514742 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d6a81-e81a-448b-8d05-71ea51f3e30f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:59.540003 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1723/3436] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:18:59.544976 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65419bf2-9590-41d3-a43a-bded2b06b828 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:59.579890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65419bf2-9590-41d3-a43a-bded2b06b828 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:59.588081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70642e64-a878-429b-8f2f-f7e17b61f82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:59.589951 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70642e64-a878-429b-8f2f-f7e17b61f82e admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:59.590471 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70642e64-a878-429b-8f2f-f7e17b61f82e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:59.591410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70642e64-a878-429b-8f2f-f7e17b61f82e admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:59.592359 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70642e64-a878-429b-8f2f-f7e17b61f82e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:59.595083 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70642e64-a878-429b-8f2f-f7e17b61f82e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:18:59.735584 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1714/3437] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:18:59 2022] POST /identity/v3/projects => generated 389 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:18:59.739372 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d6a81-e81a-448b-8d05-71ea51f3e30f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:18:59.760817 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d6a81-e81a-448b-8d05-71ea51f3e30f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:18:59.946193 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339e4ad-199d-4907-8ac4-240ba88f777c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:18:59.947016 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339e4ad-199d-4907-8ac4-240ba88f777c admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:18:59.947406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339e4ad-199d-4907-8ac4-240ba88f777c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:18:59.948107 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339e4ad-199d-4907-8ac4-240ba88f777c admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:18:59.948941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339e4ad-199d-4907-8ac4-240ba88f777c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:18:59.951963 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339e4ad-199d-4907-8ac4-240ba88f777c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:00.071898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70642e64-a878-429b-8f2f-f7e17b61f82e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:00.074947 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1724/3438] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:18:59 2022] POST /identity/v3/users => generated 295 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:19:00.085346 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70642e64-a878-429b-8f2f-f7e17b61f82e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:00.102686 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba602c-4d10-49c4-aa92-154090376490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:00.103377 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba602c-4d10-49c4-aa92-154090376490 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:00.103664 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba602c-4d10-49c4-aa92-154090376490 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:00.103976 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba602c-4d10-49c4-aa92-154090376490 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:00.104721 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba602c-4d10-49c4-aa92-154090376490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:00.109940 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba602c-4d10-49c4-aa92-154090376490 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:00.126004 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1715/3439] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:19:00.129659 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339e4ad-199d-4907-8ac4-240ba88f777c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:00.140264 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339e4ad-199d-4907-8ac4-240ba88f777c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:00.145902 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72245e1-df7f-492d-80d5-a7baa1b33bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:00.146685 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72245e1-df7f-492d-80d5-a7baa1b33bae admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:00.147046 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72245e1-df7f-492d-80d5-a7baa1b33bae admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:00.147408 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72245e1-df7f-492d-80d5-a7baa1b33bae admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:00.148217 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72245e1-df7f-492d-80d5-a7baa1b33bae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:00.150774 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72245e1-df7f-492d-80d5-a7baa1b33bae admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:00.162137 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1725/3440] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:19:00.169043 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba602c-4d10-49c4-aa92-154090376490 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:00.179671 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba602c-4d10-49c4-aa92-154090376490 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:00.185905 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc6389-8fb4-45e9-8486-8976b8203555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:00.187149 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc6389-8fb4-45e9-8486-8976b8203555 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:00.187526 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc6389-8fb4-45e9-8486-8976b8203555 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:00.188044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc6389-8fb4-45e9-8486-8976b8203555 admin admin] PATH_INFO: `/v3/projects/1e69326c6cf545c8a8dba6af0a5d3a0b/users/352ee1d894f0482e8a65330be637de6f/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:00.205585 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc6389-8fb4-45e9-8486-8976b8203555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e69326c6cf545c8a8dba6af0a5d3a0b, user_id=352ee1d894f0482e8a65330be637de6f, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:00.208674 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc6389-8fb4-45e9-8486-8976b8203555 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:00.329664 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1716/3441] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:19:00 2022] PUT /identity/v3/projects/1e69326c6cf545c8a8dba6af0a5d3a0b/users/352ee1d894f0482e8a65330be637de6f/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:19:00.334398 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb507c3-4605-4f38-95bb-58e2d7ac1859 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:00.334957 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb507c3-4605-4f38-95bb-58e2d7ac1859 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:00.335171 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb507c3-4605-4f38-95bb-58e2d7ac1859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:00.358814 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-abb507c3-4605-4f38-95bb-58e2d7ac1859 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:19:00.364050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-abb507c3-4605-4f38-95bb-58e2d7ac1859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:00.502662 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1726/3442] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:19:00.535895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc6389-8fb4-45e9-8486-8976b8203555 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:00.543292 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c6fc6389-8fb4-45e9-8486-8976b8203555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:00.655856 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc6389-8fb4-45e9-8486-8976b8203555 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:00.660097 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d532d-e242-4a50-bf3d-24c6f363a290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:00.660745 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d532d-e242-4a50-bf3d-24c6f363a290 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:00.661197 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d532d-e242-4a50-bf3d-24c6f363a290 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:00.661671 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d532d-e242-4a50-bf3d-24c6f363a290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:00.682243 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8d532d-e242-4a50-bf3d-24c6f363a290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:00.682243 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8d532d-e242-4a50-bf3d-24c6f363a290 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:00.689952 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1717/3443] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:19:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:19:09.402824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea22b2-8563-4baf-b645-720707a063f7 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:09.410670 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea22b2-8563-4baf-b645-720707a063f7 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:09.410670 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea22b2-8563-4baf-b645-720707a063f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:09.426545 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-eeea22b2-8563-4baf-b645-720707a063f7 None None] MFA Rules not processed for user `1961bb1779214710bc073d188262f1fb`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:19:09.428018 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-eeea22b2-8563-4baf-b645-720707a063f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:09.549749 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1727/3444] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:19:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:19:14.854663 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5784232-599a-4a9c-9a01-8099ce26b650 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:14.857971 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5784232-599a-4a9c-9a01-8099ce26b650 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:14.858465 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5784232-599a-4a9c-9a01-8099ce26b650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:14.914397 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-b5784232-599a-4a9c-9a01-8099ce26b650 None None] MFA Rules not processed for user `352ee1d894f0482e8a65330be637de6f`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:19:14.919877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b5784232-599a-4a9c-9a01-8099ce26b650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:15.095842 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1718/3445] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:19:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:19:15.387933 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea22b2-8563-4baf-b645-720707a063f7 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:15.390480 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-eeea22b2-8563-4baf-b645-720707a063f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:15.551744 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea22b2-8563-4baf-b645-720707a063f7 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:15.563854 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5784232-599a-4a9c-9a01-8099ce26b650 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:15.566352 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b5784232-599a-4a9c-9a01-8099ce26b650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:15.572511 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e600edc-4c32-4878-8cad-dced726bf675 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:15.573489 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e600edc-4c32-4878-8cad-dced726bf675 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:15.574555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e600edc-4c32-4878-8cad-dced726bf675 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:15.576960 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e600edc-4c32-4878-8cad-dced726bf675 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:15.597406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5784232-599a-4a9c-9a01-8099ce26b650 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:15.609607 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e600edc-4c32-4878-8cad-dced726bf675 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:15.611675 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e600edc-4c32-4878-8cad-dced726bf675 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:15.632775 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a365d-79b6-4223-9785-fa2df2c3decd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:15.632775 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a365d-79b6-4223-9785-fa2df2c3decd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:15.632775 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a365d-79b6-4223-9785-fa2df2c3decd admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:15.632775 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a365d-79b6-4223-9785-fa2df2c3decd admin admin] PATH_INFO: `/v3/users/993cfa563e564a5f924d7e75d118f1d8` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:15.633482 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a365d-79b6-4223-9785-fa2df2c3decd admin admin] RBAC: Authorizing `identity:delete_user(user_id=993cfa563e564a5f924d7e75d118f1d8)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:15.633584 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1728/3446] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:19:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:19:15.633700 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a365d-79b6-4223-9785-fa2df2c3decd admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:15.873528 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-694a365d-79b6-4223-9785-fa2df2c3decd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '993cfa563e564a5f924d7e75d118f1d8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:15.888596 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-694a365d-79b6-4223-9785-fa2df2c3decd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '993cfa563e564a5f924d7e75d118f1d8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:15.974039 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-694a365d-79b6-4223-9785-fa2df2c3decd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '993cfa563e564a5f924d7e75d118f1d8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:15.983244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-694a365d-79b6-4223-9785-fa2df2c3decd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '993cfa563e564a5f924d7e75d118f1d8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:15.984350 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-694a365d-79b6-4223-9785-fa2df2c3decd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '993cfa563e564a5f924d7e75d118f1d8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:15.991456 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1719/3447] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:19:15 2022] DELETE /identity/v3/users/993cfa563e564a5f924d7e75d118f1d8 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:19:16.677604 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e600edc-4c32-4878-8cad-dced726bf675 service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:16.680118 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4e600edc-4c32-4878-8cad-dced726bf675 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:16.705040 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e600edc-4c32-4878-8cad-dced726bf675 service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:16.735406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a365d-79b6-4223-9785-fa2df2c3decd admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:16.737386 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-694a365d-79b6-4223-9785-fa2df2c3decd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:16.859634 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac19bb3-d4d2-4d79-b65a-eddfd8b86dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:16.861046 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac19bb3-d4d2-4d79-b65a-eddfd8b86dbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:16.861587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac19bb3-d4d2-4d79-b65a-eddfd8b86dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:16.862057 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac19bb3-d4d2-4d79-b65a-eddfd8b86dbb admin admin] PATH_INFO: `/v3/users/cbaa860b758b49e78d244970875e509d` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:16.863763 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac19bb3-d4d2-4d79-b65a-eddfd8b86dbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbaa860b758b49e78d244970875e509d)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:16.866536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac19bb3-d4d2-4d79-b65a-eddfd8b86dbb admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:16.886438 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a365d-79b6-4223-9785-fa2df2c3decd admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:16.904217 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988288ec-0010-42a7-9697-6f6b81552e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:16.905108 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988288ec-0010-42a7-9697-6f6b81552e36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:16.905396 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988288ec-0010-42a7-9697-6f6b81552e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:16.906495 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988288ec-0010-42a7-9697-6f6b81552e36 admin admin] PATH_INFO: `/v3/users/bfe17212ef4a49fd954bbf17317ccd67` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:16.907290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988288ec-0010-42a7-9697-6f6b81552e36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfe17212ef4a49fd954bbf17317ccd67)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:16.916486 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988288ec-0010-42a7-9697-6f6b81552e36 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:17.125262 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5ac19bb3-d4d2-4d79-b65a-eddfd8b86dbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbaa860b758b49e78d244970875e509d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:17.126283 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-988288ec-0010-42a7-9697-6f6b81552e36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfe17212ef4a49fd954bbf17317ccd67'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:17.146411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5ac19bb3-d4d2-4d79-b65a-eddfd8b86dbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbaa860b758b49e78d244970875e509d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:17.154946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-988288ec-0010-42a7-9697-6f6b81552e36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfe17212ef4a49fd954bbf17317ccd67'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:17.291155 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5ac19bb3-d4d2-4d79-b65a-eddfd8b86dbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbaa860b758b49e78d244970875e509d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:17.294978 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5ac19bb3-d4d2-4d79-b65a-eddfd8b86dbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbaa860b758b49e78d244970875e509d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:17.312744 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5ac19bb3-d4d2-4d79-b65a-eddfd8b86dbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbaa860b758b49e78d244970875e509d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:17.323222 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1729/3448] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:19:16 2022] DELETE /identity/v3/users/cbaa860b758b49e78d244970875e509d => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:19:17.325587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac19bb3-d4d2-4d79-b65a-eddfd8b86dbb admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:17.328079 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5ac19bb3-d4d2-4d79-b65a-eddfd8b86dbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:17.356129 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-988288ec-0010-42a7-9697-6f6b81552e36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfe17212ef4a49fd954bbf17317ccd67'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:17.363820 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-988288ec-0010-42a7-9697-6f6b81552e36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfe17212ef4a49fd954bbf17317ccd67'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:17.367069 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-988288ec-0010-42a7-9697-6f6b81552e36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfe17212ef4a49fd954bbf17317ccd67'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:17.378474 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1720/3449] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:19:16 2022] DELETE /identity/v3/users/bfe17212ef4a49fd954bbf17317ccd67 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:19:17.385093 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba31915-c953-41aa-9085-895d0696de41 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:17.385093 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba31915-c953-41aa-9085-895d0696de41 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:17.385093 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba31915-c953-41aa-9085-895d0696de41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:17.417559 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-5ba31915-c953-41aa-9085-895d0696de41 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:19:17.421539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5ba31915-c953-41aa-9085-895d0696de41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:17.423285 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac19bb3-d4d2-4d79-b65a-eddfd8b86dbb admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:17.530502 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff171d4-aecf-43f9-8a39-d3065075976f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:17.531554 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff171d4-aecf-43f9-8a39-d3065075976f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:17.533608 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff171d4-aecf-43f9-8a39-d3065075976f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:17.534230 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff171d4-aecf-43f9-8a39-d3065075976f admin admin] PATH_INFO: `/v3/projects/6c823086e6504aa0ac38c2b9b86970b2` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:17.541828 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff171d4-aecf-43f9-8a39-d3065075976f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c823086e6504aa0ac38c2b9b86970b2)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:17.544096 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff171d4-aecf-43f9-8a39-d3065075976f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:17.554549 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1721/3450] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:19:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:19:17.571286 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba31915-c953-41aa-9085-895d0696de41 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:17.572905 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5ba31915-c953-41aa-9085-895d0696de41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:17.651834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba31915-c953-41aa-9085-895d0696de41 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:17.660317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea1a74-122e-4c13-9477-37837de2373c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:17.661301 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea1a74-122e-4c13-9477-37837de2373c service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:17.661601 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea1a74-122e-4c13-9477-37837de2373c service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:17.661913 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea1a74-122e-4c13-9477-37837de2373c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:17.682439 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea1a74-122e-4c13-9477-37837de2373c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:17.685649 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea1a74-122e-4c13-9477-37837de2373c service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:17.705559 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1722/3451] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:19:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:19:17.723030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0ff171d4-aecf-43f9-8a39-d3065075976f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c823086e6504aa0ac38c2b9b86970b2', 'request_id': 'req-0ff171d4-aecf-43f9-8a39-d3065075976f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:17.735314 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0ff171d4-aecf-43f9-8a39-d3065075976f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c823086e6504aa0ac38c2b9b86970b2', 'request_id': 'req-0ff171d4-aecf-43f9-8a39-d3065075976f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:17.752501 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0ff171d4-aecf-43f9-8a39-d3065075976f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c823086e6504aa0ac38c2b9b86970b2', 'request_id': 'req-0ff171d4-aecf-43f9-8a39-d3065075976f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:17.919044 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0ff171d4-aecf-43f9-8a39-d3065075976f admin admin] The token cache is being invalidate because project 6c823086e6504aa0ac38c2b9b86970b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:19:17.919520 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0ff171d4-aecf-43f9-8a39-d3065075976f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:17.920310 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0ff171d4-aecf-43f9-8a39-d3065075976f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:17.922698 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1730/3452] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:19:17 2022] DELETE /identity/v3/projects/6c823086e6504aa0ac38c2b9b86970b2 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:19:17.927733 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea1a74-122e-4c13-9477-37837de2373c service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:17.929969 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-fcea1a74-122e-4c13-9477-37837de2373c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:17.945960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea1a74-122e-4c13-9477-37837de2373c service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:17.967772 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff171d4-aecf-43f9-8a39-d3065075976f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:17.969292 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0ff171d4-aecf-43f9-8a39-d3065075976f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:18.094979 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ffc4c-925c-4b16-8423-4fa25836a8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:18.096347 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ffc4c-925c-4b16-8423-4fa25836a8d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:18.098051 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ffc4c-925c-4b16-8423-4fa25836a8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:18.098051 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ffc4c-925c-4b16-8423-4fa25836a8d2 admin admin] PATH_INFO: `/v3/users/a117a0336489441b81fcd7aed67da6a9` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:18.104017 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ffc4c-925c-4b16-8423-4fa25836a8d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a117a0336489441b81fcd7aed67da6a9)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:18.108764 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ffc4c-925c-4b16-8423-4fa25836a8d2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:18.139194 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff171d4-aecf-43f9-8a39-d3065075976f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:18.157796 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e5f7a-110d-47a6-a744-3ebf07cf1f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:18.159292 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e5f7a-110d-47a6-a744-3ebf07cf1f0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:18.161732 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e5f7a-110d-47a6-a744-3ebf07cf1f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:18.165019 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e5f7a-110d-47a6-a744-3ebf07cf1f0b admin admin] PATH_INFO: `/v3/projects/7c032d189cb14ea297194dffa380eae5` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:18.169398 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e5f7a-110d-47a6-a744-3ebf07cf1f0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c032d189cb14ea297194dffa380eae5)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:18.174630 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e5f7a-110d-47a6-a744-3ebf07cf1f0b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:18.426699 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-826e5f7a-110d-47a6-a744-3ebf07cf1f0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c032d189cb14ea297194dffa380eae5', 'request_id': 'req-826e5f7a-110d-47a6-a744-3ebf07cf1f0b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:18.429285 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d60ffc4c-925c-4b16-8423-4fa25836a8d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a117a0336489441b81fcd7aed67da6a9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:18.447710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d60ffc4c-925c-4b16-8423-4fa25836a8d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a117a0336489441b81fcd7aed67da6a9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:18.451611 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-826e5f7a-110d-47a6-a744-3ebf07cf1f0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c032d189cb14ea297194dffa380eae5', 'request_id': 'req-826e5f7a-110d-47a6-a744-3ebf07cf1f0b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:18.465216 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-826e5f7a-110d-47a6-a744-3ebf07cf1f0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c032d189cb14ea297194dffa380eae5', 'request_id': 'req-826e5f7a-110d-47a6-a744-3ebf07cf1f0b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:18.578143 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d60ffc4c-925c-4b16-8423-4fa25836a8d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a117a0336489441b81fcd7aed67da6a9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:18.589956 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d60ffc4c-925c-4b16-8423-4fa25836a8d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a117a0336489441b81fcd7aed67da6a9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:18.591240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d60ffc4c-925c-4b16-8423-4fa25836a8d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a117a0336489441b81fcd7aed67da6a9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:18.609124 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1723/3453] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:19:17 2022] DELETE /identity/v3/users/a117a0336489441b81fcd7aed67da6a9 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:19:18.613543 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ffc4c-925c-4b16-8423-4fa25836a8d2 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:18.618297 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d60ffc4c-925c-4b16-8423-4fa25836a8d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:18.716140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-826e5f7a-110d-47a6-a744-3ebf07cf1f0b admin admin] The token cache is being invalidate because project 7c032d189cb14ea297194dffa380eae5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:19:18.720318 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-826e5f7a-110d-47a6-a744-3ebf07cf1f0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:18.720318 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-826e5f7a-110d-47a6-a744-3ebf07cf1f0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:18.724801 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1731/3454] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:19:17 2022] DELETE /identity/v3/projects/7c032d189cb14ea297194dffa380eae5 => generated 0 bytes in 758 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:19:18.729563 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f83ee-c794-4226-81e0-ed6511332d7f None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:18.729898 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f83ee-c794-4226-81e0-ed6511332d7f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:18.730723 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f83ee-c794-4226-81e0-ed6511332d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:18.761499 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-e18f83ee-c794-4226-81e0-ed6511332d7f None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:19:18.765356 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e18f83ee-c794-4226-81e0-ed6511332d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:18.832679 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ffc4c-925c-4b16-8423-4fa25836a8d2 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:18.848232 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953fe0d-42af-4107-b59d-3ca6565f8d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:18.849027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953fe0d-42af-4107-b59d-3ca6565f8d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:18.849255 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953fe0d-42af-4107-b59d-3ca6565f8d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:18.849482 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953fe0d-42af-4107-b59d-3ca6565f8d22 admin admin] PATH_INFO: `/v3/projects/65633a0f121948df985e316e3b459970` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:18.851318 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1953fe0d-42af-4107-b59d-3ca6565f8d22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65633a0f121948df985e316e3b459970)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:18.855919 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1953fe0d-42af-4107-b59d-3ca6565f8d22 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:18.905784 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1732/3455] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:19:18.914824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81b2c3-7468-4ca2-8e12-5d41d612eb6e None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:18.915109 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81b2c3-7468-4ca2-8e12-5d41d612eb6e None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:18.915472 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81b2c3-7468-4ca2-8e12-5d41d612eb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:18.937175 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-9f81b2c3-7468-4ca2-8e12-5d41d612eb6e None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:19:18.938666 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-9f81b2c3-7468-4ca2-8e12-5d41d612eb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:18.949798 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1733/3456] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:19:18.955113 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f81b2c3-7468-4ca2-8e12-5d41d612eb6e None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:18.976183 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f81b2c3-7468-4ca2-8e12-5d41d612eb6e None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:18.982270 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51308cd9-309a-4238-af88-62d4bd0bffc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:18.982941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51308cd9-309a-4238-af88-62d4bd0bffc4 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:18.983276 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51308cd9-309a-4238-af88-62d4bd0bffc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:18.983558 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51308cd9-309a-4238-af88-62d4bd0bffc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:18.984417 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51308cd9-309a-4238-af88-62d4bd0bffc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:19:18.985058 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51308cd9-309a-4238-af88-62d4bd0bffc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:18.986894 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51308cd9-309a-4238-af88-62d4bd0bffc4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:19.013650 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1953fe0d-42af-4107-b59d-3ca6565f8d22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65633a0f121948df985e316e3b459970', 'request_id': 'req-1953fe0d-42af-4107-b59d-3ca6565f8d22'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:19.016556 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1734/3457] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:19:19.022371 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1953fe0d-42af-4107-b59d-3ca6565f8d22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65633a0f121948df985e316e3b459970', 'request_id': 'req-1953fe0d-42af-4107-b59d-3ca6565f8d22'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:19.029083 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51308cd9-309a-4238-af88-62d4bd0bffc4 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:19.038676 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1953fe0d-42af-4107-b59d-3ca6565f8d22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65633a0f121948df985e316e3b459970', 'request_id': 'req-1953fe0d-42af-4107-b59d-3ca6565f8d22'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:19.047393 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51308cd9-309a-4238-af88-62d4bd0bffc4 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:19.140584 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1953fe0d-42af-4107-b59d-3ca6565f8d22 admin admin] The token cache is being invalidate because project 65633a0f121948df985e316e3b459970 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:19:19.141429 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1953fe0d-42af-4107-b59d-3ca6565f8d22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:19.144205 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1953fe0d-42af-4107-b59d-3ca6565f8d22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:19.150394 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2013d3-0743-4683-9fa1-ab680384006a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:19.151082 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2013d3-0743-4683-9fa1-ab680384006a admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:19.151372 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2013d3-0743-4683-9fa1-ab680384006a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:19.151654 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2013d3-0743-4683-9fa1-ab680384006a admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:19.152408 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2013d3-0743-4683-9fa1-ab680384006a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:19.154397 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2013d3-0743-4683-9fa1-ab680384006a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:19.156874 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1724/3458] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:19:18 2022] DELETE /identity/v3/projects/65633a0f121948df985e316e3b459970 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:19:19.161980 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b85d01-0080-4087-bd67-3b483b4761a9 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:19.162552 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b85d01-0080-4087-bd67-3b483b4761a9 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:19.163280 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b85d01-0080-4087-bd67-3b483b4761a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:19.209499 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-c2b85d01-0080-4087-bd67-3b483b4761a9 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:19:19.212635 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c2b85d01-0080-4087-bd67-3b483b4761a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:19.232239 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1725/3459] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:19:19.243127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f0dc4-0004-4376-aadc-8208bfe6e346 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:19.243421 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f0dc4-0004-4376-aadc-8208bfe6e346 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:19.243699 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f0dc4-0004-4376-aadc-8208bfe6e346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:19.265829 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-1d7f0dc4-0004-4376-aadc-8208bfe6e346 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:19:19.267064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1d7f0dc4-0004-4376-aadc-8208bfe6e346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:19.297081 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1726/3460] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:19:19.298160 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f0dc4-0004-4376-aadc-8208bfe6e346 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:19.301114 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1d7f0dc4-0004-4376-aadc-8208bfe6e346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:19.316446 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f0dc4-0004-4376-aadc-8208bfe6e346 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:19.323644 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57599a-e382-4bba-8398-98d66de583e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:19.325339 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57599a-e382-4bba-8398-98d66de583e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:19.325853 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57599a-e382-4bba-8398-98d66de583e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:19.326706 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57599a-e382-4bba-8398-98d66de583e0 admin admin] PATH_INFO: `/v3/projects/2432bcdc57d144238ffb934fd4530483` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:19.329069 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce57599a-e382-4bba-8398-98d66de583e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2432bcdc57d144238ffb934fd4530483)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:19.332761 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce57599a-e382-4bba-8398-98d66de583e0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:19.370667 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1735/3461] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:19:19 2022] POST /identity/v3/projects => generated 377 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:19:19.371956 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2013d3-0743-4683-9fa1-ab680384006a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:19.453815 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2013d3-0743-4683-9fa1-ab680384006a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:19.459230 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd851c0-5fdd-4dd7-82a3-c1545fd72a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:19.465497 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd851c0-5fdd-4dd7-82a3-c1545fd72a9c admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:19.465816 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd851c0-5fdd-4dd7-82a3-c1545fd72a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:19.466108 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd851c0-5fdd-4dd7-82a3-c1545fd72a9c admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:19.467283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd851c0-5fdd-4dd7-82a3-c1545fd72a9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:19:19.474264 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd851c0-5fdd-4dd7-82a3-c1545fd72a9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:19.474264 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd851c0-5fdd-4dd7-82a3-c1545fd72a9c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:19.479593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ce57599a-e382-4bba-8398-98d66de583e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2432bcdc57d144238ffb934fd4530483', 'request_id': 'req-ce57599a-e382-4bba-8398-98d66de583e0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:19.485374 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ce57599a-e382-4bba-8398-98d66de583e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2432bcdc57d144238ffb934fd4530483', 'request_id': 'req-ce57599a-e382-4bba-8398-98d66de583e0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:19.495013 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1736/3462] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:19:19.495883 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ce57599a-e382-4bba-8398-98d66de583e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2432bcdc57d144238ffb934fd4530483', 'request_id': 'req-ce57599a-e382-4bba-8398-98d66de583e0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:19.499295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd851c0-5fdd-4dd7-82a3-c1545fd72a9c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:19.503911 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3dd851c0-5fdd-4dd7-82a3-c1545fd72a9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:19.515813 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd851c0-5fdd-4dd7-82a3-c1545fd72a9c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:19.580209 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ce57599a-e382-4bba-8398-98d66de583e0 admin admin] The token cache is being invalidate because project 2432bcdc57d144238ffb934fd4530483 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:19:19.580572 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ce57599a-e382-4bba-8398-98d66de583e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:19.581192 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ce57599a-e382-4bba-8398-98d66de583e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:19.584446 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1727/3463] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:19:19 2022] DELETE /identity/v3/projects/2432bcdc57d144238ffb934fd4530483 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:19:19.584991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57599a-e382-4bba-8398-98d66de583e0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:19.587190 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ce57599a-e382-4bba-8398-98d66de583e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:19.611169 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c62eab-f805-426e-9179-08058c170570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:19.611785 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c62eab-f805-426e-9179-08058c170570 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:19.612068 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c62eab-f805-426e-9179-08058c170570 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:19.612490 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c62eab-f805-426e-9179-08058c170570 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:19.613186 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c62eab-f805-426e-9179-08058c170570 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:19.615375 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c62eab-f805-426e-9179-08058c170570 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:19.696374 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57599a-e382-4bba-8398-98d66de583e0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:19.701651 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa112b5-3d8c-4b49-87fb-020eb9a59bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:19.702089 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa112b5-3d8c-4b49-87fb-020eb9a59bf8 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:19.702514 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa112b5-3d8c-4b49-87fb-020eb9a59bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:19.702763 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa112b5-3d8c-4b49-87fb-020eb9a59bf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:19.703474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa112b5-3d8c-4b49-87fb-020eb9a59bf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:19.705589 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa112b5-3d8c-4b49-87fb-020eb9a59bf8 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:19.715178 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1737/3464] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:19:19 2022] POST /identity/v3/users => generated 289 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:19:19.717065 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7914bf-7360-4044-afc9-cb8c2d97dbf2 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:19.717584 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7914bf-7360-4044-afc9-cb8c2d97dbf2 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:19.718188 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7914bf-7360-4044-afc9-cb8c2d97dbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:19.745709 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-fb7914bf-7360-4044-afc9-cb8c2d97dbf2 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:19:19.747092 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-fb7914bf-7360-4044-afc9-cb8c2d97dbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:19.759986 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1738/3465] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:19:19.761103 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7914bf-7360-4044-afc9-cb8c2d97dbf2 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:19.762671 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-fb7914bf-7360-4044-afc9-cb8c2d97dbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:19.775109 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7914bf-7360-4044-afc9-cb8c2d97dbf2 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:19.780706 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15558c2f-8e08-4f17-9394-c4f31df55bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:19.781373 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15558c2f-8e08-4f17-9394-c4f31df55bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:19.781655 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15558c2f-8e08-4f17-9394-c4f31df55bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:19.781956 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15558c2f-8e08-4f17-9394-c4f31df55bc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:19.782742 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15558c2f-8e08-4f17-9394-c4f31df55bc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:19.784402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15558c2f-8e08-4f17-9394-c4f31df55bc2 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:19.798471 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1739/3466] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:19:19.798897 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1728/3467] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:19:19 2022] POST /identity/v3/projects => generated 373 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:19:19.800151 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15558c2f-8e08-4f17-9394-c4f31df55bc2 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:19.801197 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d9754-7ca0-47af-b4b6-fee9a84f428c None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:19.801502 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d9754-7ca0-47af-b4b6-fee9a84f428c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:19.801805 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d9754-7ca0-47af-b4b6-fee9a84f428c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:19.816416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15558c2f-8e08-4f17-9394-c4f31df55bc2 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:19.826652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-e99d9754-7ca0-47af-b4b6-fee9a84f428c None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:19:19.827966 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e99d9754-7ca0-47af-b4b6-fee9a84f428c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:19.902095 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303514ee-8d1f-4fd1-9c6d-56ed9fe16c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:19.903035 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1729/3468] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:19:19.903808 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303514ee-8d1f-4fd1-9c6d-56ed9fe16c3d admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:19.903930 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d9754-7ca0-47af-b4b6-fee9a84f428c None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:19.904339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303514ee-8d1f-4fd1-9c6d-56ed9fe16c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:19.904787 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303514ee-8d1f-4fd1-9c6d-56ed9fe16c3d admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:19.905514 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303514ee-8d1f-4fd1-9c6d-56ed9fe16c3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:19.910687 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303514ee-8d1f-4fd1-9c6d-56ed9fe16c3d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:19.913366 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d9754-7ca0-47af-b4b6-fee9a84f428c None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:19.919532 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb66563-c89d-4193-8893-a38fb0b516d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:19.920264 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb66563-c89d-4193-8893-a38fb0b516d3 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:19.920560 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb66563-c89d-4193-8893-a38fb0b516d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:19.920826 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb66563-c89d-4193-8893-a38fb0b516d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:19.921551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb66563-c89d-4193-8893-a38fb0b516d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:19.923235 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb66563-c89d-4193-8893-a38fb0b516d3 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:19.934364 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1730/3469] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:19:19.935204 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb66563-c89d-4193-8893-a38fb0b516d3 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:19.944959 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb66563-c89d-4193-8893-a38fb0b516d3 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:19.950488 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692794a8-8bba-423c-b93a-20850d557782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:19.951128 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692794a8-8bba-423c-b93a-20850d557782 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:19.951409 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692794a8-8bba-423c-b93a-20850d557782 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:19.951682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692794a8-8bba-423c-b93a-20850d557782 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:19.952401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692794a8-8bba-423c-b93a-20850d557782 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:19:19.952712 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692794a8-8bba-423c-b93a-20850d557782 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:19.954338 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692794a8-8bba-423c-b93a-20850d557782 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:19.967624 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1731/3470] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:19:19.968541 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692794a8-8bba-423c-b93a-20850d557782 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:19.978957 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692794a8-8bba-423c-b93a-20850d557782 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:19.984790 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52235b-94b0-4c55-8b19-5a47f6317250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:19.985937 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52235b-94b0-4c55-8b19-5a47f6317250 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:19.988708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52235b-94b0-4c55-8b19-5a47f6317250 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:19.988708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52235b-94b0-4c55-8b19-5a47f6317250 admin admin] PATH_INFO: `/v3/projects/713c8f2f4e2141f18904b10656eaf37f/users/2f5eafa970bd4247bdaef1cda747c3fc/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:19.998337 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1740/3471] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:19:19 2022] POST /identity/v3/users => generated 287 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:19:19.999225 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303514ee-8d1f-4fd1-9c6d-56ed9fe16c3d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:20.007977 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52235b-94b0-4c55-8b19-5a47f6317250 admin admin] RBAC: Authorizing `identity:create_grant(project_id=713c8f2f4e2141f18904b10656eaf37f, user_id=2f5eafa970bd4247bdaef1cda747c3fc, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:20.015789 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303514ee-8d1f-4fd1-9c6d-56ed9fe16c3d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:20.023145 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b467687-d765-4227-a1e1-fd47cf577946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:20.024116 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b467687-d765-4227-a1e1-fd47cf577946 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:20.024406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b467687-d765-4227-a1e1-fd47cf577946 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:20.024693 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b467687-d765-4227-a1e1-fd47cf577946 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:20.025112 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52235b-94b0-4c55-8b19-5a47f6317250 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:20.025612 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b467687-d765-4227-a1e1-fd47cf577946 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:20.028714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b467687-d765-4227-a1e1-fd47cf577946 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:20.145376 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1732/3472] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:19:19 2022] PUT /identity/v3/projects/713c8f2f4e2141f18904b10656eaf37f/users/2f5eafa970bd4247bdaef1cda747c3fc/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:19:20.146611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52235b-94b0-4c55-8b19-5a47f6317250 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:20.149933 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1741/3473] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:19:19 2022] POST /identity/v3/projects => generated 393 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:19:20.151231 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c9925-e9fb-4f8f-8b80-83ad2f7b2fb1 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:20.151994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c9925-e9fb-4f8f-8b80-83ad2f7b2fb1 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:20.151994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c9925-e9fb-4f8f-8b80-83ad2f7b2fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:20.220237 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-0d3c9925-e9fb-4f8f-8b80-83ad2f7b2fb1 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:19:20.221558 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0d3c9925-e9fb-4f8f-8b80-83ad2f7b2fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:20.307074 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52235b-94b0-4c55-8b19-5a47f6317250 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:20.343713 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1742/3474] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:19:20.345401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c9925-e9fb-4f8f-8b80-83ad2f7b2fb1 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:20.366451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c9925-e9fb-4f8f-8b80-83ad2f7b2fb1 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:20.395397 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13a00b-2c94-48be-bafa-48b3bf55d048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:20.395397 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13a00b-2c94-48be-bafa-48b3bf55d048 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:20.395397 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13a00b-2c94-48be-bafa-48b3bf55d048 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:20.395397 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13a00b-2c94-48be-bafa-48b3bf55d048 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:20.396172 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13a00b-2c94-48be-bafa-48b3bf55d048 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:20.396172 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13a00b-2c94-48be-bafa-48b3bf55d048 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:20.454313 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b33a25-3667-4db6-93d7-46f55045187b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:20.455080 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b33a25-3667-4db6-93d7-46f55045187b admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:20.455589 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b33a25-3667-4db6-93d7-46f55045187b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:20.456081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b33a25-3667-4db6-93d7-46f55045187b admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:20.457090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b33a25-3667-4db6-93d7-46f55045187b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:20.458966 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b33a25-3667-4db6-93d7-46f55045187b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:20.470441 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1733/3475] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:19:20.471671 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b33a25-3667-4db6-93d7-46f55045187b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:20.474388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-28b33a25-3667-4db6-93d7-46f55045187b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:20.529019 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1743/3476] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:19:20 2022] POST /identity/v3/users => generated 297 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:19:20.529019 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13a00b-2c94-48be-bafa-48b3bf55d048 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:20.563058 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13a00b-2c94-48be-bafa-48b3bf55d048 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:20.569832 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc1e68-7d4c-482a-8389-5113975b849d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:20.572070 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc1e68-7d4c-482a-8389-5113975b849d admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:20.573479 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc1e68-7d4c-482a-8389-5113975b849d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:20.574650 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc1e68-7d4c-482a-8389-5113975b849d admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:20.575863 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc1e68-7d4c-482a-8389-5113975b849d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:20.577454 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc1e68-7d4c-482a-8389-5113975b849d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:20.579267 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b33a25-3667-4db6-93d7-46f55045187b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:20.583339 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a37ca-2fc1-4c62-b966-17df2f2b73fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:20.584153 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a37ca-2fc1-4c62-b966-17df2f2b73fa service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:20.584558 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a37ca-2fc1-4c62-b966-17df2f2b73fa service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:20.584938 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a37ca-2fc1-4c62-b966-17df2f2b73fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:20.602696 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1744/3477] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:19:20.603744 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc1e68-7d4c-482a-8389-5113975b849d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:20.605712 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a37ca-2fc1-4c62-b966-17df2f2b73fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:20.610868 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a37ca-2fc1-4c62-b966-17df2f2b73fa service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:20.627011 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc1e68-7d4c-482a-8389-5113975b849d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:20.635415 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1734/3478] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:19:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:19:20.636362 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a37ca-2fc1-4c62-b966-17df2f2b73fa service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:20.637745 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a594ecd-6958-447f-9729-a4e534fd722b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:20.638453 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a594ecd-6958-447f-9729-a4e534fd722b admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:20.638736 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a594ecd-6958-447f-9729-a4e534fd722b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:20.639013 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a594ecd-6958-447f-9729-a4e534fd722b admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:20.639739 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a594ecd-6958-447f-9729-a4e534fd722b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:20.641442 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a594ecd-6958-447f-9729-a4e534fd722b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:20.659200 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a37ca-2fc1-4c62-b966-17df2f2b73fa service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:20.667212 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1745/3479] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:19:20.668997 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e751c-19bf-4bde-ac98-7fafecf05c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:20.670381 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e751c-19bf-4bde-ac98-7fafecf05c80 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:20.670381 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e751c-19bf-4bde-ac98-7fafecf05c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:20.670585 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e751c-19bf-4bde-ac98-7fafecf05c80 admin admin] PATH_INFO: `/v3/projects/1ccfd8608a3848688dd16c89d054011d/users/9fd9d23535c74127a6758a9653515e78/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:20.673513 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a594ecd-6958-447f-9729-a4e534fd722b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:20.692978 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a594ecd-6958-447f-9729-a4e534fd722b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:20.704579 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97372052-d31b-4967-84eb-636310229188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:20.705268 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97372052-d31b-4967-84eb-636310229188 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:20.705550 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97372052-d31b-4967-84eb-636310229188 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:20.705857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97372052-d31b-4967-84eb-636310229188 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:20.707502 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97372052-d31b-4967-84eb-636310229188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:20.709144 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97372052-d31b-4967-84eb-636310229188 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:20.711958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e751c-19bf-4bde-ac98-7fafecf05c80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ccfd8608a3848688dd16c89d054011d, user_id=9fd9d23535c74127a6758a9653515e78, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:20.715743 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e751c-19bf-4bde-ac98-7fafecf05c80 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:20.740603 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1746/3480] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:19:20.745257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97372052-d31b-4967-84eb-636310229188 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:20.767620 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97372052-d31b-4967-84eb-636310229188 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:20.797301 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f82ce4-9964-42e3-a768-80db6e3994e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:20.798450 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f82ce4-9964-42e3-a768-80db6e3994e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:20.798901 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f82ce4-9964-42e3-a768-80db6e3994e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:20.799360 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f82ce4-9964-42e3-a768-80db6e3994e1 admin admin] PATH_INFO: `/v3/projects/6cebc4a4f75349b09fd03f67d0207875/users/a75959d37cbf4c9b8482e480a0888246/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:20.811454 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1735/3481] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:19:20 2022] PUT /identity/v3/projects/1ccfd8608a3848688dd16c89d054011d/users/9fd9d23535c74127a6758a9653515e78/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:19:20.821465 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeaffbb-9679-4ccc-a05d-d501eb359d22 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:20.821973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeaffbb-9679-4ccc-a05d-d501eb359d22 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:20.822417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeaffbb-9679-4ccc-a05d-d501eb359d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:20.833834 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f82ce4-9964-42e3-a768-80db6e3994e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cebc4a4f75349b09fd03f67d0207875, user_id=a75959d37cbf4c9b8482e480a0888246, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:20.836618 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f82ce4-9964-42e3-a768-80db6e3994e1 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:20.867448 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-cfeaffbb-9679-4ccc-a05d-d501eb359d22 None None] MFA Rules not processed for user `9fd9d23535c74127a6758a9653515e78`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:19:20.868973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-cfeaffbb-9679-4ccc-a05d-d501eb359d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:20.930918 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1747/3482] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:19:20 2022] PUT /identity/v3/projects/6cebc4a4f75349b09fd03f67d0207875/users/a75959d37cbf4c9b8482e480a0888246/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:19:20.936251 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0a017-db58-41f2-9ad2-6d144ce79aea None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:20.936806 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0a017-db58-41f2-9ad2-6d144ce79aea None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:20.937345 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0a017-db58-41f2-9ad2-6d144ce79aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:20.973554 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-7ae0a017-db58-41f2-9ad2-6d144ce79aea None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:19:20.976131 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7ae0a017-db58-41f2-9ad2-6d144ce79aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:20.976550 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1736/3483] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:19:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:19:20.987915 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeaffbb-9679-4ccc-a05d-d501eb359d22 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:20.989340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-cfeaffbb-9679-4ccc-a05d-d501eb359d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:21.056718 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1748/3484] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:19:21.073350 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0a017-db58-41f2-9ad2-6d144ce79aea None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:21.075486 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7ae0a017-db58-41f2-9ad2-6d144ce79aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:21.091548 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeaffbb-9679-4ccc-a05d-d501eb359d22 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:21.184486 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f034c-ac20-4c97-877f-f30c0988f759 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:21.186787 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f034c-ac20-4c97-877f-f30c0988f759 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:21.187173 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f034c-ac20-4c97-877f-f30c0988f759 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:21.187578 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f034c-ac20-4c97-877f-f30c0988f759 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:21.327227 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f034c-ac20-4c97-877f-f30c0988f759 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:21.330380 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f034c-ac20-4c97-877f-f30c0988f759 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:21.362829 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1737/3485] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:19:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:19:21.413532 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0a017-db58-41f2-9ad2-6d144ce79aea None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:21.436667 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af72c22-20e1-41c9-bcd3-f5fa2d7a266a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:21.440089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af72c22-20e1-41c9-bcd3-f5fa2d7a266a service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:21.440089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af72c22-20e1-41c9-bcd3-f5fa2d7a266a service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:21.440089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af72c22-20e1-41c9-bcd3-f5fa2d7a266a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:21.467323 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af72c22-20e1-41c9-bcd3-f5fa2d7a266a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:21.468825 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af72c22-20e1-41c9-bcd3-f5fa2d7a266a service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:21.503176 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1749/3486] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:19:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:19:22.945480 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8e6a4-54ed-49f4-8a8f-addcf5744162 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:22.946109 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8e6a4-54ed-49f4-8a8f-addcf5744162 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:22.946109 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8e6a4-54ed-49f4-8a8f-addcf5744162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:22.989625 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af72c22-20e1-41c9-bcd3-f5fa2d7a266a service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:22.991940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1af72c22-20e1-41c9-bcd3-f5fa2d7a266a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:23.007113 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-85b8e6a4-54ed-49f4-8a8f-addcf5744162 None None] MFA Rules not processed for user `2f5eafa970bd4247bdaef1cda747c3fc`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:19:23.008897 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-85b8e6a4-54ed-49f4-8a8f-addcf5744162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:23.037555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af72c22-20e1-41c9-bcd3-f5fa2d7a266a service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:23.050305 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c2ab2-2b3e-41d4-9204-0140a6a79ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:23.053583 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c2ab2-2b3e-41d4-9204-0140a6a79ba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:23.053972 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c2ab2-2b3e-41d4-9204-0140a6a79ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:23.054720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c2ab2-2b3e-41d4-9204-0140a6a79ba1 admin admin] PATH_INFO: `/v3/users/352ee1d894f0482e8a65330be637de6f` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:23.057182 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412c2ab2-2b3e-41d4-9204-0140a6a79ba1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=352ee1d894f0482e8a65330be637de6f)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:23.095656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412c2ab2-2b3e-41d4-9204-0140a6a79ba1 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:23.164455 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1738/3487] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:19:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:19:23.176029 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2240267-1eba-4837-ad8c-58ad5373a0a7 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:23.176658 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2240267-1eba-4837-ad8c-58ad5373a0a7 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:23.176658 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2240267-1eba-4837-ad8c-58ad5373a0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:23.197482 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-a2240267-1eba-4837-ad8c-58ad5373a0a7 None None] MFA Rules not processed for user `2f5eafa970bd4247bdaef1cda747c3fc`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:19:23.197482 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a2240267-1eba-4837-ad8c-58ad5373a0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:23.205808 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1739/3488] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:19:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:19:23.257067 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2240267-1eba-4837-ad8c-58ad5373a0a7 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:23.274188 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2240267-1eba-4837-ad8c-58ad5373a0a7 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:23.284231 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b73eb4-1b37-4b93-b1ff-70bd83a593c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:23.285150 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b73eb4-1b37-4b93-b1ff-70bd83a593c1 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:23.285437 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b73eb4-1b37-4b93-b1ff-70bd83a593c1 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:23.285717 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b73eb4-1b37-4b93-b1ff-70bd83a593c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:23.295768 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b73eb4-1b37-4b93-b1ff-70bd83a593c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:23.297482 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b73eb4-1b37-4b93-b1ff-70bd83a593c1 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:23.308005 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1740/3489] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:19:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:19:23.387426 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-412c2ab2-2b3e-41d4-9204-0140a6a79ba1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '352ee1d894f0482e8a65330be637de6f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:23.408723 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-412c2ab2-2b3e-41d4-9204-0140a6a79ba1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '352ee1d894f0482e8a65330be637de6f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:23.487486 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-412c2ab2-2b3e-41d4-9204-0140a6a79ba1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '352ee1d894f0482e8a65330be637de6f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:23.488272 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-412c2ab2-2b3e-41d4-9204-0140a6a79ba1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '352ee1d894f0482e8a65330be637de6f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:23.498577 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-412c2ab2-2b3e-41d4-9204-0140a6a79ba1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '352ee1d894f0482e8a65330be637de6f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:23.507598 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1750/3490] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:19:22 2022] DELETE /identity/v3/users/352ee1d894f0482e8a65330be637de6f => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:19:23.812969 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b73eb4-1b37-4b93-b1ff-70bd83a593c1 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:23.822901 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b73eb4-1b37-4b93-b1ff-70bd83a593c1 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:23.957912 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9c1d0-d92b-4717-afd9-2d42e12b2c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:23.959622 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9c1d0-d92b-4717-afd9-2d42e12b2c8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:23.960154 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9c1d0-d92b-4717-afd9-2d42e12b2c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:23.960684 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9c1d0-d92b-4717-afd9-2d42e12b2c8e admin admin] PATH_INFO: `/v3/projects/1e69326c6cf545c8a8dba6af0a5d3a0b` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:23.966134 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9c1d0-d92b-4717-afd9-2d42e12b2c8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e69326c6cf545c8a8dba6af0a5d3a0b)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:23.966134 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9c1d0-d92b-4717-afd9-2d42e12b2c8e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:24.127893 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-64e9c1d0-d92b-4717-afd9-2d42e12b2c8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e69326c6cf545c8a8dba6af0a5d3a0b', 'request_id': 'req-64e9c1d0-d92b-4717-afd9-2d42e12b2c8e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:24.133485 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-64e9c1d0-d92b-4717-afd9-2d42e12b2c8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e69326c6cf545c8a8dba6af0a5d3a0b', 'request_id': 'req-64e9c1d0-d92b-4717-afd9-2d42e12b2c8e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:24.141509 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-64e9c1d0-d92b-4717-afd9-2d42e12b2c8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e69326c6cf545c8a8dba6af0a5d3a0b', 'request_id': 'req-64e9c1d0-d92b-4717-afd9-2d42e12b2c8e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:24.287421 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-64e9c1d0-d92b-4717-afd9-2d42e12b2c8e admin admin] The token cache is being invalidate because project 1e69326c6cf545c8a8dba6af0a5d3a0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:19:24.287740 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-64e9c1d0-d92b-4717-afd9-2d42e12b2c8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:24.288759 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-64e9c1d0-d92b-4717-afd9-2d42e12b2c8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:24.291784 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1741/3491] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:19:23 2022] DELETE /identity/v3/projects/1e69326c6cf545c8a8dba6af0a5d3a0b => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:19:24.297048 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ead85c-aea1-44dc-97c8-3d3eb68852f1 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:24.297516 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ead85c-aea1-44dc-97c8-3d3eb68852f1 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:24.297609 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ead85c-aea1-44dc-97c8-3d3eb68852f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:24.334626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-82ead85c-aea1-44dc-97c8-3d3eb68852f1 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:19:24.335741 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-82ead85c-aea1-44dc-97c8-3d3eb68852f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:24.454071 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1751/3492] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:19:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:19:24.461843 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476fe70-7c06-410d-babb-4910a72dc03e None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:24.462129 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476fe70-7c06-410d-babb-4910a72dc03e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:24.462741 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476fe70-7c06-410d-babb-4910a72dc03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:24.495412 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-9476fe70-7c06-410d-babb-4910a72dc03e None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:19:24.498467 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9476fe70-7c06-410d-babb-4910a72dc03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:24.513023 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1742/3493] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:19:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:19:24.517220 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ead85c-aea1-44dc-97c8-3d3eb68852f1 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:24.532203 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ead85c-aea1-44dc-97c8-3d3eb68852f1 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:24.538262 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff950c8d-5ee4-4ea7-b4a5-4e1b5398e99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:24.539026 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff950c8d-5ee4-4ea7-b4a5-4e1b5398e99a admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:24.539526 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff950c8d-5ee4-4ea7-b4a5-4e1b5398e99a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:24.540356 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff950c8d-5ee4-4ea7-b4a5-4e1b5398e99a admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:24.541265 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff950c8d-5ee4-4ea7-b4a5-4e1b5398e99a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:19:24.541770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff950c8d-5ee4-4ea7-b4a5-4e1b5398e99a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:24.544834 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff950c8d-5ee4-4ea7-b4a5-4e1b5398e99a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:24.573242 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1752/3494] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:19:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:19:24.579761 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476fe70-7c06-410d-babb-4910a72dc03e None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:24.599177 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476fe70-7c06-410d-babb-4910a72dc03e None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:24.614854 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee19e96-1087-4791-b326-70a13189e61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:24.615544 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee19e96-1087-4791-b326-70a13189e61b admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:24.615825 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee19e96-1087-4791-b326-70a13189e61b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:24.616098 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee19e96-1087-4791-b326-70a13189e61b admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:24.616805 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee19e96-1087-4791-b326-70a13189e61b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:24.623244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee19e96-1087-4791-b326-70a13189e61b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:24.766359 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1743/3495] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:19:24 2022] POST /identity/v3/projects => generated 383 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:19:24.770054 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff950c8d-5ee4-4ea7-b4a5-4e1b5398e99a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:24.781372 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff950c8d-5ee4-4ea7-b4a5-4e1b5398e99a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:24.885723 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1683dac-85bb-4a72-9ddd-815e6b61e897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:24.886472 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1683dac-85bb-4a72-9ddd-815e6b61e897 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:24.886726 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1683dac-85bb-4a72-9ddd-815e6b61e897 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:24.886995 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1683dac-85bb-4a72-9ddd-815e6b61e897 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:24.887688 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1683dac-85bb-4a72-9ddd-815e6b61e897 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:24.889727 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1683dac-85bb-4a72-9ddd-815e6b61e897 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:24.974058 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1753/3496] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:19:24 2022] POST /identity/v3/users => generated 292 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:19:24.975535 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee19e96-1087-4791-b326-70a13189e61b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:24.991967 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee19e96-1087-4791-b326-70a13189e61b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:24.999294 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4c6ae-635a-4081-bb8e-c83c7e864b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:25.001379 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4c6ae-635a-4081-bb8e-c83c7e864b57 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:25.001379 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4c6ae-635a-4081-bb8e-c83c7e864b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:25.002250 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4c6ae-635a-4081-bb8e-c83c7e864b57 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:25.003684 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab4c6ae-635a-4081-bb8e-c83c7e864b57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:25.007398 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab4c6ae-635a-4081-bb8e-c83c7e864b57 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:25.048859 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1683dac-85bb-4a72-9ddd-815e6b61e897 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:25.049836 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1744/3497] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:19:24 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:19:25.059931 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1683dac-85bb-4a72-9ddd-815e6b61e897 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:25.067893 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b42a1df-4755-4225-b470-ebf91efae377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:25.068577 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42a1df-4755-4225-b470-ebf91efae377 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:25.068858 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42a1df-4755-4225-b470-ebf91efae377 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:25.069139 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b42a1df-4755-4225-b470-ebf91efae377 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:25.070459 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42a1df-4755-4225-b470-ebf91efae377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:25.072078 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b42a1df-4755-4225-b470-ebf91efae377 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:25.087761 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1754/3498] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:19:25.088572 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4c6ae-635a-4081-bb8e-c83c7e864b57 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:25.101600 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4c6ae-635a-4081-bb8e-c83c7e864b57 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:25.108088 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f409a-ca5a-4c1c-802f-97cefdf643a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:25.109136 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f409a-ca5a-4c1c-802f-97cefdf643a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:25.109412 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f409a-ca5a-4c1c-802f-97cefdf643a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:25.109688 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f409a-ca5a-4c1c-802f-97cefdf643a3 admin admin] PATH_INFO: `/v3/projects/397b6d767bff4e108a34ab76861ac5e0/users/e37a7aec6d1c407aa24173ef6edc51f5/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:25.143970 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f409a-ca5a-4c1c-802f-97cefdf643a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=397b6d767bff4e108a34ab76861ac5e0, user_id=e37a7aec6d1c407aa24173ef6edc51f5, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:25.147346 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f409a-ca5a-4c1c-802f-97cefdf643a3 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:25.233064 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1745/3499] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:19:25 2022] PUT /identity/v3/projects/397b6d767bff4e108a34ab76861ac5e0/users/e37a7aec6d1c407aa24173ef6edc51f5/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:19:25.244648 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28103bb0-7bb4-4742-83d3-506be6f8cb8d None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:25.244944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28103bb0-7bb4-4742-83d3-506be6f8cb8d None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:25.245227 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28103bb0-7bb4-4742-83d3-506be6f8cb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:25.304652 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-28103bb0-7bb4-4742-83d3-506be6f8cb8d None None] MFA Rules not processed for user `e37a7aec6d1c407aa24173ef6edc51f5`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:19:25.311857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-28103bb0-7bb4-4742-83d3-506be6f8cb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:25.451192 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1755/3500] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:19:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:19:25.496506 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f409a-ca5a-4c1c-802f-97cefdf643a3 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:25.499735 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2c1f409a-ca5a-4c1c-802f-97cefdf643a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:25.778909 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f409a-ca5a-4c1c-802f-97cefdf643a3 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:25.790720 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d37ae7-cc6e-4c58-9c03-3961923df0bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:25.791663 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d37ae7-cc6e-4c58-9c03-3961923df0bc service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:25.792131 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d37ae7-cc6e-4c58-9c03-3961923df0bc service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:25.793413 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d37ae7-cc6e-4c58-9c03-3961923df0bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:25.807792 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d37ae7-cc6e-4c58-9c03-3961923df0bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:25.810302 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d37ae7-cc6e-4c58-9c03-3961923df0bc service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:25.836657 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1746/3501] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:19:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:19:25.968747 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28103bb0-7bb4-4742-83d3-506be6f8cb8d None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:25.972050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-28103bb0-7bb4-4742-83d3-506be6f8cb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:26.087016 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28103bb0-7bb4-4742-83d3-506be6f8cb8d None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:26.117996 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199baf3-1f23-4653-9586-02eec871c76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:26.117996 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199baf3-1f23-4653-9586-02eec871c76d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:26.117996 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199baf3-1f23-4653-9586-02eec871c76d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:26.117996 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199baf3-1f23-4653-9586-02eec871c76d admin admin] PATH_INFO: `/v3/users/9fd9d23535c74127a6758a9653515e78` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:26.124119 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9199baf3-1f23-4653-9586-02eec871c76d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fd9d23535c74127a6758a9653515e78)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:26.128610 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9199baf3-1f23-4653-9586-02eec871c76d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:26.408959 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-9199baf3-1f23-4653-9586-02eec871c76d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fd9d23535c74127a6758a9653515e78'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:26.434671 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-9199baf3-1f23-4653-9586-02eec871c76d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fd9d23535c74127a6758a9653515e78'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:26.504697 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-9199baf3-1f23-4653-9586-02eec871c76d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fd9d23535c74127a6758a9653515e78'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:26.505837 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-9199baf3-1f23-4653-9586-02eec871c76d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fd9d23535c74127a6758a9653515e78'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:26.521608 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-9199baf3-1f23-4653-9586-02eec871c76d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fd9d23535c74127a6758a9653515e78'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:26.534755 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1756/3502] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:19:25 2022] DELETE /identity/v3/users/9fd9d23535c74127a6758a9653515e78 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:19:26.539280 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15264d-03ea-45ec-8bbd-aca07ceb7f81 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:26.539791 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15264d-03ea-45ec-8bbd-aca07ceb7f81 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:26.539909 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15264d-03ea-45ec-8bbd-aca07ceb7f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:26.567247 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-1b15264d-03ea-45ec-8bbd-aca07ceb7f81 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:19:26.568703 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1b15264d-03ea-45ec-8bbd-aca07ceb7f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:26.701036 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1747/3503] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:19:26.711083 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199baf3-1f23-4653-9586-02eec871c76d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:26.716020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-9199baf3-1f23-4653-9586-02eec871c76d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:26.818752 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199baf3-1f23-4653-9586-02eec871c76d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:26.822822 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e6f35-9c12-4ef6-a0a5-ebd49cc9a9bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:26.824504 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e6f35-9c12-4ef6-a0a5-ebd49cc9a9bc service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:26.824875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e6f35-9c12-4ef6-a0a5-ebd49cc9a9bc service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:26.825257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e6f35-9c12-4ef6-a0a5-ebd49cc9a9bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:26.836197 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e6f35-9c12-4ef6-a0a5-ebd49cc9a9bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:26.837689 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e6f35-9c12-4ef6-a0a5-ebd49cc9a9bc service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:26.849638 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1757/3504] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:19:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:19:27.395895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15264d-03ea-45ec-8bbd-aca07ceb7f81 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:27.398234 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1b15264d-03ea-45ec-8bbd-aca07ceb7f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:27.420169 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15264d-03ea-45ec-8bbd-aca07ceb7f81 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:27.436039 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327ff4c-e2ec-4a40-a1a8-f828018281f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:27.440663 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327ff4c-e2ec-4a40-a1a8-f828018281f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:27.440663 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327ff4c-e2ec-4a40-a1a8-f828018281f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:27.440663 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327ff4c-e2ec-4a40-a1a8-f828018281f7 admin admin] PATH_INFO: `/v3/users/e37a7aec6d1c407aa24173ef6edc51f5` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:27.443959 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3327ff4c-e2ec-4a40-a1a8-f828018281f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e37a7aec6d1c407aa24173ef6edc51f5)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:27.448340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3327ff4c-e2ec-4a40-a1a8-f828018281f7 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:27.617446 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3327ff4c-e2ec-4a40-a1a8-f828018281f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e37a7aec6d1c407aa24173ef6edc51f5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:27.635817 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3327ff4c-e2ec-4a40-a1a8-f828018281f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e37a7aec6d1c407aa24173ef6edc51f5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:27.669933 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e6f35-9c12-4ef6-a0a5-ebd49cc9a9bc service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:27.671390 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f93e6f35-9c12-4ef6-a0a5-ebd49cc9a9bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:27.690064 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e6f35-9c12-4ef6-a0a5-ebd49cc9a9bc service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:27.700133 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed8b45-659c-4cd3-9960-cbaa8aee8802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:27.700918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3327ff4c-e2ec-4a40-a1a8-f828018281f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e37a7aec6d1c407aa24173ef6edc51f5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:27.718891 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed8b45-659c-4cd3-9960-cbaa8aee8802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:27.719510 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed8b45-659c-4cd3-9960-cbaa8aee8802 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:27.720297 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed8b45-659c-4cd3-9960-cbaa8aee8802 admin admin] PATH_INFO: `/v3/projects/1ccfd8608a3848688dd16c89d054011d` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:27.720650 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3327ff4c-e2ec-4a40-a1a8-f828018281f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e37a7aec6d1c407aa24173ef6edc51f5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:27.721585 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3327ff4c-e2ec-4a40-a1a8-f828018281f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e37a7aec6d1c407aa24173ef6edc51f5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:27.722770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ed8b45-659c-4cd3-9960-cbaa8aee8802 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ccfd8608a3848688dd16c89d054011d)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:27.727740 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ed8b45-659c-4cd3-9960-cbaa8aee8802 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:27.749633 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1748/3505] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:19:27 2022] DELETE /identity/v3/users/e37a7aec6d1c407aa24173ef6edc51f5 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:19:27.752301 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6a60b-167b-4c21-8053-8b597420e433 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:27.754089 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6a60b-167b-4c21-8053-8b597420e433 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:27.754643 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6a60b-167b-4c21-8053-8b597420e433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:27.790351 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-4bb6a60b-167b-4c21-8053-8b597420e433 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:19:27.790351 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4bb6a60b-167b-4c21-8053-8b597420e433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:27.873724 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-68ed8b45-659c-4cd3-9960-cbaa8aee8802 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ccfd8608a3848688dd16c89d054011d', 'request_id': 'req-68ed8b45-659c-4cd3-9960-cbaa8aee8802'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:27.875811 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1749/3506] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:19:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:19:27.885794 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-68ed8b45-659c-4cd3-9960-cbaa8aee8802 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ccfd8608a3848688dd16c89d054011d', 'request_id': 'req-68ed8b45-659c-4cd3-9960-cbaa8aee8802'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:27.893190 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6a60b-167b-4c21-8053-8b597420e433 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:27.895265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4bb6a60b-167b-4c21-8053-8b597420e433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:27.898169 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-68ed8b45-659c-4cd3-9960-cbaa8aee8802 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ccfd8608a3848688dd16c89d054011d', 'request_id': 'req-68ed8b45-659c-4cd3-9960-cbaa8aee8802'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:27.975159 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6a60b-167b-4c21-8053-8b597420e433 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:27.992928 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-68ed8b45-659c-4cd3-9960-cbaa8aee8802 admin admin] The token cache is being invalidate because project 1ccfd8608a3848688dd16c89d054011d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:19:27.993487 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-68ed8b45-659c-4cd3-9960-cbaa8aee8802 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:27.997233 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-68ed8b45-659c-4cd3-9960-cbaa8aee8802 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:27.998893 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1758/3507] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:19:27 2022] DELETE /identity/v3/projects/1ccfd8608a3848688dd16c89d054011d => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:19:28.018969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8eb101-4c13-472f-a84f-b67d966ccd0c None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:28.022096 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8eb101-4c13-472f-a84f-b67d966ccd0c None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:28.022934 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8eb101-4c13-472f-a84f-b67d966ccd0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:28.068883 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633d330-1cce-4e80-946a-401dbc007701 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:28.070145 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633d330-1cce-4e80-946a-401dbc007701 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:28.070968 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633d330-1cce-4e80-946a-401dbc007701 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:28.071597 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633d330-1cce-4e80-946a-401dbc007701 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:28.075569 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d633d330-1cce-4e80-946a-401dbc007701 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:28.086858 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-1d8eb101-4c13-472f-a84f-b67d966ccd0c None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:19:28.088507 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1d8eb101-4c13-472f-a84f-b67d966ccd0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:28.157308 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d633d330-1cce-4e80-946a-401dbc007701 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:28.159690 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d633d330-1cce-4e80-946a-401dbc007701 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:28.170193 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1759/3508] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:19:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:19:28.179507 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb82daf-31a3-4bdf-ae54-7ec5e28666a2 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:28.179792 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb82daf-31a3-4bdf-ae54-7ec5e28666a2 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:28.180522 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb82daf-31a3-4bdf-ae54-7ec5e28666a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:28.196120 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1750/3509] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:19:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:19:28.222021 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-bfb82daf-31a3-4bdf-ae54-7ec5e28666a2 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:19:28.224023 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-bfb82daf-31a3-4bdf-ae54-7ec5e28666a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:28.234020 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1760/3510] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:19:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:19:28.238055 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633d330-1cce-4e80-946a-401dbc007701 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:28.253108 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633d330-1cce-4e80-946a-401dbc007701 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:28.259358 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0d6db-ff07-449a-a26b-8d09a3f396d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:28.260208 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0d6db-ff07-449a-a26b-8d09a3f396d1 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:28.260456 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0d6db-ff07-449a-a26b-8d09a3f396d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:28.260808 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0d6db-ff07-449a-a26b-8d09a3f396d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:28.262563 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0d6db-ff07-449a-a26b-8d09a3f396d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:19:28.262973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0d6db-ff07-449a-a26b-8d09a3f396d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:28.265721 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0d6db-ff07-449a-a26b-8d09a3f396d1 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:28.290004 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1751/3511] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:19:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:19:28.293838 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb82daf-31a3-4bdf-ae54-7ec5e28666a2 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:28.314458 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb82daf-31a3-4bdf-ae54-7ec5e28666a2 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:28.321949 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937a5cd-ea66-4e73-8613-5944b76a7450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:28.322685 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937a5cd-ea66-4e73-8613-5944b76a7450 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:28.324127 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937a5cd-ea66-4e73-8613-5944b76a7450 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:28.324416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937a5cd-ea66-4e73-8613-5944b76a7450 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:28.325215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4937a5cd-ea66-4e73-8613-5944b76a7450 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:28.328227 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4937a5cd-ea66-4e73-8613-5944b76a7450 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:28.422287 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1761/3512] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:19:28 2022] POST /identity/v3/projects => generated 379 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:19:28.426731 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0d6db-ff07-449a-a26b-8d09a3f396d1 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:28.443275 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0d6db-ff07-449a-a26b-8d09a3f396d1 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:28.556913 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eace12-f8fb-4219-a010-aee64aff334a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:28.558875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eace12-f8fb-4219-a010-aee64aff334a admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:28.559320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eace12-f8fb-4219-a010-aee64aff334a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:28.559757 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eace12-f8fb-4219-a010-aee64aff334a admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:28.561626 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eace12-f8fb-4219-a010-aee64aff334a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:28.564133 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eace12-f8fb-4219-a010-aee64aff334a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:28.689864 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1752/3513] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:19:28 2022] POST /identity/v3/users => generated 290 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:19:28.694780 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937a5cd-ea66-4e73-8613-5944b76a7450 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:28.705568 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937a5cd-ea66-4e73-8613-5944b76a7450 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:28.711759 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a50716-3639-43b2-9de2-f7d2ccfc2c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:28.712461 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a50716-3639-43b2-9de2-f7d2ccfc2c31 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:28.712773 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a50716-3639-43b2-9de2-f7d2ccfc2c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:28.713064 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a50716-3639-43b2-9de2-f7d2ccfc2c31 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:28.713923 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a50716-3639-43b2-9de2-f7d2ccfc2c31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:28.716174 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a50716-3639-43b2-9de2-f7d2ccfc2c31 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:28.728860 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1762/3514] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:19:28.733906 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eace12-f8fb-4219-a010-aee64aff334a admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:28.748455 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eace12-f8fb-4219-a010-aee64aff334a admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:28.757225 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eeb9d4-c741-47fe-8e8a-c77ae928909d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:28.757968 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eeb9d4-c741-47fe-8e8a-c77ae928909d admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:28.758317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eeb9d4-c741-47fe-8e8a-c77ae928909d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:28.758602 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eeb9d4-c741-47fe-8e8a-c77ae928909d admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:28.759393 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eeb9d4-c741-47fe-8e8a-c77ae928909d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:28.763158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eeb9d4-c741-47fe-8e8a-c77ae928909d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:28.778193 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1753/3515] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:19:28.780430 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a50716-3639-43b2-9de2-f7d2ccfc2c31 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:28.782633 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-90a50716-3639-43b2-9de2-f7d2ccfc2c31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:28.791405 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eeb9d4-c741-47fe-8e8a-c77ae928909d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:28.806350 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a50716-3639-43b2-9de2-f7d2ccfc2c31 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:28.816351 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eeb9d4-c741-47fe-8e8a-c77ae928909d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:28.820938 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2cad48-e813-4e03-8404-933c18affdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:28.822167 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2cad48-e813-4e03-8404-933c18affdfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:28.823282 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2cad48-e813-4e03-8404-933c18affdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:28.825487 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2cad48-e813-4e03-8404-933c18affdfa admin admin] PATH_INFO: `/v3/projects/397b6d767bff4e108a34ab76861ac5e0` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:28.827707 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2cad48-e813-4e03-8404-933c18affdfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=397b6d767bff4e108a34ab76861ac5e0)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:28.831748 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b59a1-0261-42e6-82cc-b4ef03de88b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:28.848872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b59a1-0261-42e6-82cc-b4ef03de88b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:28.848872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b59a1-0261-42e6-82cc-b4ef03de88b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:28.848872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b59a1-0261-42e6-82cc-b4ef03de88b9 admin admin] PATH_INFO: `/v3/projects/c91284d0547c4c8a9d99f57d0a43f98b/users/0a426fa7ed504002881521b1e820e359/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:28.849393 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2cad48-e813-4e03-8404-933c18affdfa admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:28.878427 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990b59a1-0261-42e6-82cc-b4ef03de88b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c91284d0547c4c8a9d99f57d0a43f98b, user_id=0a426fa7ed504002881521b1e820e359, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:28.885805 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990b59a1-0261-42e6-82cc-b4ef03de88b9 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:28.968924 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1754/3516] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:19:28 2022] PUT /identity/v3/projects/c91284d0547c4c8a9d99f57d0a43f98b/users/0a426fa7ed504002881521b1e820e359/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:19:28.978465 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f574a4-505d-46e8-bbc8-b65d47b36965 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:28.979001 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f574a4-505d-46e8-bbc8-b65d47b36965 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:28.979488 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f574a4-505d-46e8-bbc8-b65d47b36965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:29.012729 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-28f574a4-505d-46e8-bbc8-b65d47b36965 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:19:29.014270 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2e2cad48-e813-4e03-8404-933c18affdfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '397b6d767bff4e108a34ab76861ac5e0', 'request_id': 'req-2e2cad48-e813-4e03-8404-933c18affdfa'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:29.015708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-28f574a4-505d-46e8-bbc8-b65d47b36965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:29.024313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2e2cad48-e813-4e03-8404-933c18affdfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '397b6d767bff4e108a34ab76861ac5e0', 'request_id': 'req-2e2cad48-e813-4e03-8404-933c18affdfa'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:29.034967 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2e2cad48-e813-4e03-8404-933c18affdfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '397b6d767bff4e108a34ab76861ac5e0', 'request_id': 'req-2e2cad48-e813-4e03-8404-933c18affdfa'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:29.103579 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1755/3517] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:19:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:19:29.114922 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f574a4-505d-46e8-bbc8-b65d47b36965 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:29.116894 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-28f574a4-505d-46e8-bbc8-b65d47b36965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:29.146357 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2e2cad48-e813-4e03-8404-933c18affdfa admin admin] The token cache is being invalidate because project 397b6d767bff4e108a34ab76861ac5e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:19:29.146650 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2e2cad48-e813-4e03-8404-933c18affdfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:29.147591 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2e2cad48-e813-4e03-8404-933c18affdfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:19:29.149466 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1763/3518] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:19:28 2022] DELETE /identity/v3/projects/397b6d767bff4e108a34ab76861ac5e0 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:19:29.155632 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8b682-fcf6-40f8-9534-a02f93e19853 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:29.156142 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8b682-fcf6-40f8-9534-a02f93e19853 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:29.156422 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8b682-fcf6-40f8-9534-a02f93e19853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:29.176410 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-cfb8b682-fcf6-40f8-9534-a02f93e19853 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:19:29.178132 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-cfb8b682-fcf6-40f8-9534-a02f93e19853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:29.186110 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f574a4-505d-46e8-bbc8-b65d47b36965 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:29.188635 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1764/3519] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:19:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:19:29.191403 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc181c5-d4c1-4250-829a-3685294ff63f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:29.194908 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc181c5-d4c1-4250-829a-3685294ff63f service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:29.194908 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc181c5-d4c1-4250-829a-3685294ff63f service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:29.194908 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc181c5-d4c1-4250-829a-3685294ff63f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:29.196399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-cdc181c5-d4c1-4250-829a-3685294ff63f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:29.197110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992c95e-2f60-4f54-af08-9f68daccf1d7 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:29.197507 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992c95e-2f60-4f54-af08-9f68daccf1d7 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:29.198643 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992c95e-2f60-4f54-af08-9f68daccf1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:29.209940 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc181c5-d4c1-4250-829a-3685294ff63f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:29.211654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc181c5-d4c1-4250-829a-3685294ff63f service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:29.217846 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-b992c95e-2f60-4f54-af08-9f68daccf1d7 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:19:29.219169 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b992c95e-2f60-4f54-af08-9f68daccf1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:29.224098 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1756/3520] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:19:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:19:29.227932 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1765/3521] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:19:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:19:29.232550 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc181c5-d4c1-4250-829a-3685294ff63f service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:29.243893 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc181c5-d4c1-4250-829a-3685294ff63f service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:29.250685 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97e094-e481-4a09-a803-8e91406f9cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:29.251466 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97e094-e481-4a09-a803-8e91406f9cdc admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:29.251920 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97e094-e481-4a09-a803-8e91406f9cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:29.252404 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97e094-e481-4a09-a803-8e91406f9cdc admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:29.253253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b97e094-e481-4a09-a803-8e91406f9cdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:19:29.253626 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b97e094-e481-4a09-a803-8e91406f9cdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:29.255388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b97e094-e481-4a09-a803-8e91406f9cdc admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:29.271453 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1757/3522] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:19:29.273050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992c95e-2f60-4f54-af08-9f68daccf1d7 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:29.290137 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992c95e-2f60-4f54-af08-9f68daccf1d7 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:29.299214 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3d40c-fba0-4276-9d73-5d7b6955a204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:29.300191 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3d40c-fba0-4276-9d73-5d7b6955a204 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:29.301006 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3d40c-fba0-4276-9d73-5d7b6955a204 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:29.301497 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3d40c-fba0-4276-9d73-5d7b6955a204 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:29.303102 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c3d40c-fba0-4276-9d73-5d7b6955a204 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:29.306813 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c3d40c-fba0-4276-9d73-5d7b6955a204 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:29.434665 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1766/3523] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:19:29 2022] POST /identity/v3/projects => generated 389 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:19:29.438568 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97e094-e481-4a09-a803-8e91406f9cdc admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:29.471275 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97e094-e481-4a09-a803-8e91406f9cdc admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:29.605503 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25665fc3-91bc-4ee8-939b-2c373b2c87bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:29.606563 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25665fc3-91bc-4ee8-939b-2c373b2c87bc admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:29.607165 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25665fc3-91bc-4ee8-939b-2c373b2c87bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:29.607665 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25665fc3-91bc-4ee8-939b-2c373b2c87bc admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:29.608613 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25665fc3-91bc-4ee8-939b-2c373b2c87bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:29.611078 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25665fc3-91bc-4ee8-939b-2c373b2c87bc admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:29.725334 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3d40c-fba0-4276-9d73-5d7b6955a204 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:29.725989 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1758/3524] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:19:29 2022] POST /identity/v3/users => generated 295 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:19:29.749063 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3d40c-fba0-4276-9d73-5d7b6955a204 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:29.766683 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9212e7-6edb-4e15-b1fa-d3242cfbaf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:29.768400 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9212e7-6edb-4e15-b1fa-d3242cfbaf54 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:29.768894 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9212e7-6edb-4e15-b1fa-d3242cfbaf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:29.769338 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9212e7-6edb-4e15-b1fa-d3242cfbaf54 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:29.770318 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9212e7-6edb-4e15-b1fa-d3242cfbaf54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:29.778597 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9212e7-6edb-4e15-b1fa-d3242cfbaf54 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:29.815472 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1767/3525] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:19:29.820739 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25665fc3-91bc-4ee8-939b-2c373b2c87bc admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:29.857719 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25665fc3-91bc-4ee8-939b-2c373b2c87bc admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:29.866697 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79653562-d984-4b1d-b4c6-33ec3dbf6f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:29.867390 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79653562-d984-4b1d-b4c6-33ec3dbf6f0b admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:29.867674 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79653562-d984-4b1d-b4c6-33ec3dbf6f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:29.867948 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79653562-d984-4b1d-b4c6-33ec3dbf6f0b admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:29.868674 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79653562-d984-4b1d-b4c6-33ec3dbf6f0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:29.871723 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79653562-d984-4b1d-b4c6-33ec3dbf6f0b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:29.885243 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1759/3526] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:19:29.889121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9212e7-6edb-4e15-b1fa-d3242cfbaf54 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:29.904724 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9212e7-6edb-4e15-b1fa-d3242cfbaf54 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:29.911890 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bca7f2-1309-45fc-a536-993241ce47e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:29.914053 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bca7f2-1309-45fc-a536-993241ce47e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:29.914475 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bca7f2-1309-45fc-a536-993241ce47e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:29.914767 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bca7f2-1309-45fc-a536-993241ce47e7 admin admin] PATH_INFO: `/v3/projects/b81eb3fcf4664f479119191dbc28bf07/users/af1585cd61ba445eba82fb0b5c74a460/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:29.970612 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bca7f2-1309-45fc-a536-993241ce47e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b81eb3fcf4664f479119191dbc28bf07, user_id=af1585cd61ba445eba82fb0b5c74a460, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:29.979216 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bca7f2-1309-45fc-a536-993241ce47e7 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:30.064083 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1768/3527] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:19:29 2022] PUT /identity/v3/projects/b81eb3fcf4664f479119191dbc28bf07/users/af1585cd61ba445eba82fb0b5c74a460/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:19:30.069476 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b39c32-670c-4010-affb-d8e66eb7494e None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:30.070243 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b39c32-670c-4010-affb-d8e66eb7494e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:30.070385 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b39c32-670c-4010-affb-d8e66eb7494e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:30.090208 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-18b39c32-670c-4010-affb-d8e66eb7494e None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:19:30.091488 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-18b39c32-670c-4010-affb-d8e66eb7494e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:30.172088 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1760/3528] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:19:30.197420 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bca7f2-1309-45fc-a536-993241ce47e7 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:30.199600 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b1bca7f2-1309-45fc-a536-993241ce47e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:30.319272 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bca7f2-1309-45fc-a536-993241ce47e7 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:30.336625 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c7cd4-5079-4a64-a312-1d4eeb2b167d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:30.337429 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c7cd4-5079-4a64-a312-1d4eeb2b167d service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:30.337825 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c7cd4-5079-4a64-a312-1d4eeb2b167d service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:30.338130 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c7cd4-5079-4a64-a312-1d4eeb2b167d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:30.366795 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c7cd4-5079-4a64-a312-1d4eeb2b167d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:30.370125 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c7cd4-5079-4a64-a312-1d4eeb2b167d service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:30.391091 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1769/3529] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:19:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:19:30.779559 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57d60f-f087-4e8e-81d2-909153cb8de0 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:30.780134 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57d60f-f087-4e8e-81d2-909153cb8de0 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:30.780134 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57d60f-f087-4e8e-81d2-909153cb8de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:30.831851 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-da57d60f-f087-4e8e-81d2-909153cb8de0 None None] MFA Rules not processed for user `1961bb1779214710bc073d188262f1fb`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:19:30.836937 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-da57d60f-f087-4e8e-81d2-909153cb8de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:30.925574 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1761/3530] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:19:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:19:31.696272 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ab06d-00e3-41e0-bcfd-00d038e3cf2d None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:31.696769 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ab06d-00e3-41e0-bcfd-00d038e3cf2d None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:31.696875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ab06d-00e3-41e0-bcfd-00d038e3cf2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:31.731612 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-f26ab06d-00e3-41e0-bcfd-00d038e3cf2d None None] MFA Rules not processed for user `a75959d37cbf4c9b8482e480a0888246`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:19:31.732881 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f26ab06d-00e3-41e0-bcfd-00d038e3cf2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:31.829788 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1770/3531] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:19:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:19:31.889831 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181369ef-8e66-49b1-b9d5-6f86a18ae07b None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:31.890325 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181369ef-8e66-49b1-b9d5-6f86a18ae07b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:31.890538 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181369ef-8e66-49b1-b9d5-6f86a18ae07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:31.920158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-181369ef-8e66-49b1-b9d5-6f86a18ae07b None None] MFA Rules not processed for user `a75959d37cbf4c9b8482e480a0888246`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:19:31.921494 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-181369ef-8e66-49b1-b9d5-6f86a18ae07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:31.934245 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1762/3532] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:19:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:19:32.172651 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ab06d-00e3-41e0-bcfd-00d038e3cf2d None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:32.174191 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f26ab06d-00e3-41e0-bcfd-00d038e3cf2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:32.288385 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ab06d-00e3-41e0-bcfd-00d038e3cf2d None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:32.295030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71bdc25-f296-4c42-8b5d-b003c480100e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:32.295687 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71bdc25-f296-4c42-8b5d-b003c480100e service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:32.295966 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71bdc25-f296-4c42-8b5d-b003c480100e service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:32.296240 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71bdc25-f296-4c42-8b5d-b003c480100e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:32.305532 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71bdc25-f296-4c42-8b5d-b003c480100e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:32.307150 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71bdc25-f296-4c42-8b5d-b003c480100e service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:32.319346 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1771/3533] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:19:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:19:44.155869 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bd4e1-adb5-478f-b411-b18f98126642 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:44.158197 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bd4e1-adb5-478f-b411-b18f98126642 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:44.158649 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5bd4e1-adb5-478f-b411-b18f98126642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:44.211662 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-1f5bd4e1-adb5-478f-b411-b18f98126642 None None] MFA Rules not processed for user `0a426fa7ed504002881521b1e820e359`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:19:44.212943 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1f5bd4e1-adb5-478f-b411-b18f98126642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:44.293877 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1763/3534] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:19:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:19:44.306211 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71bdc25-f296-4c42-8b5d-b003c480100e service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:44.323852 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71bdc25-f296-4c42-8b5d-b003c480100e service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:44.344298 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc425f-01e1-4ceb-a53a-3df503567dd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:44.345332 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc425f-01e1-4ceb-a53a-3df503567dd5 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:44.345332 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc425f-01e1-4ceb-a53a-3df503567dd5 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:44.345567 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc425f-01e1-4ceb-a53a-3df503567dd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:44.372405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc425f-01e1-4ceb-a53a-3df503567dd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:44.374627 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc425f-01e1-4ceb-a53a-3df503567dd5 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:44.395978 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1772/3535] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:19:44 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:19:44.638103 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36127843-a7ce-44d8-87c4-6869313c10dc None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:44.638399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36127843-a7ce-44d8-87c4-6869313c10dc None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:44.638682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36127843-a7ce-44d8-87c4-6869313c10dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:44.696860 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-36127843-a7ce-44d8-87c4-6869313c10dc None None] MFA Rules not processed for user `af1585cd61ba445eba82fb0b5c74a460`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:19:44.698941 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-36127843-a7ce-44d8-87c4-6869313c10dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:44.846109 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1764/3536] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:19:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:19:44.847385 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc425f-01e1-4ceb-a53a-3df503567dd5 service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:44.863310 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc425f-01e1-4ceb-a53a-3df503567dd5 service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:44.880209 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f00a72-e4b2-404d-b40e-e7e79ca59b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:44.882563 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f00a72-e4b2-404d-b40e-e7e79ca59b2b admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:44.883281 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f00a72-e4b2-404d-b40e-e7e79ca59b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:44.883741 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f00a72-e4b2-404d-b40e-e7e79ca59b2b admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:44.886132 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f00a72-e4b2-404d-b40e-e7e79ca59b2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:44.891012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f00a72-e4b2-404d-b40e-e7e79ca59b2b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:44.997560 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1773/3537] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:19:44 2022] POST /identity/v3/projects => generated 387 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:19:45.001706 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36127843-a7ce-44d8-87c4-6869313c10dc None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:45.018964 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36127843-a7ce-44d8-87c4-6869313c10dc None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:45.183373 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf09463-436b-4f56-b5ef-e5f729934256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:45.183373 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf09463-436b-4f56-b5ef-e5f729934256 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:45.183373 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf09463-436b-4f56-b5ef-e5f729934256 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:45.183373 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf09463-436b-4f56-b5ef-e5f729934256 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:45.184212 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf09463-436b-4f56-b5ef-e5f729934256 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:45.186837 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf09463-436b-4f56-b5ef-e5f729934256 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:45.375721 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1765/3538] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:19:45 2022] POST /identity/v3/users => generated 300 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:19:45.379276 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f00a72-e4b2-404d-b40e-e7e79ca59b2b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:45.390031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f00a72-e4b2-404d-b40e-e7e79ca59b2b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:45.403652 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b45ab-07d8-4caa-b921-b2cfe0a8b480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:45.404577 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b45ab-07d8-4caa-b921-b2cfe0a8b480 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:45.405018 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b45ab-07d8-4caa-b921-b2cfe0a8b480 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:45.405462 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b45ab-07d8-4caa-b921-b2cfe0a8b480 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:45.406439 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773b45ab-07d8-4caa-b921-b2cfe0a8b480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:45.408258 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773b45ab-07d8-4caa-b921-b2cfe0a8b480 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:45.426597 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1774/3539] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:19:45.432977 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf09463-436b-4f56-b5ef-e5f729934256 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:45.450434 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf09463-436b-4f56-b5ef-e5f729934256 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:45.474883 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a43067-08cc-45b6-bf28-942fc4eb5c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:45.476398 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a43067-08cc-45b6-bf28-942fc4eb5c46 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:45.477061 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a43067-08cc-45b6-bf28-942fc4eb5c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:45.478053 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a43067-08cc-45b6-bf28-942fc4eb5c46 admin admin] PATH_INFO: `/v3/projects/304c976f80084864bd575fad9d2fbf90/users/6d4baa7f101f47abb43077f08e5bcc49/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:45.500195 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a43067-08cc-45b6-bf28-942fc4eb5c46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=304c976f80084864bd575fad9d2fbf90, user_id=6d4baa7f101f47abb43077f08e5bcc49, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:45.504567 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a43067-08cc-45b6-bf28-942fc4eb5c46 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:45.674322 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1766/3540] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:19:45 2022] PUT /identity/v3/projects/304c976f80084864bd575fad9d2fbf90/users/6d4baa7f101f47abb43077f08e5bcc49/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:19:45.680209 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b45ab-07d8-4caa-b921-b2cfe0a8b480 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:45.694788 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b45ab-07d8-4caa-b921-b2cfe0a8b480 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:45.812558 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d763a-d7d0-484a-af42-b557c3e80de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:45.813237 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d763a-d7d0-484a-af42-b557c3e80de9 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:45.813520 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d763a-d7d0-484a-af42-b557c3e80de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:45.813945 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d763a-d7d0-484a-af42-b557c3e80de9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:45.814969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153d763a-d7d0-484a-af42-b557c3e80de9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:45.816743 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153d763a-d7d0-484a-af42-b557c3e80de9 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:45.828510 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1775/3541] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:19:45.832985 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a43067-08cc-45b6-bf28-942fc4eb5c46 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:45.849884 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a43067-08cc-45b6-bf28-942fc4eb5c46 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:45.857786 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5c029-efad-4cec-8982-994eea04fe25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:45.857786 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5c029-efad-4cec-8982-994eea04fe25 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:45.857786 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5c029-efad-4cec-8982-994eea04fe25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:45.857786 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5c029-efad-4cec-8982-994eea04fe25 admin admin] PATH_INFO: `/v3/projects/304c976f80084864bd575fad9d2fbf90/users/6d4baa7f101f47abb43077f08e5bcc49/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:45.859159 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d5c029-efad-4cec-8982-994eea04fe25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=304c976f80084864bd575fad9d2fbf90, user_id=6d4baa7f101f47abb43077f08e5bcc49, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:45.861800 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d5c029-efad-4cec-8982-994eea04fe25 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:45.874981 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1767/3542] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:19:45 2022] PUT /identity/v3/projects/304c976f80084864bd575fad9d2fbf90/users/6d4baa7f101f47abb43077f08e5bcc49/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:19:50.827130 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad088ea-5283-431d-a6c4-b6d2883f2a7b None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:50.827670 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad088ea-5283-431d-a6c4-b6d2883f2a7b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:50.827670 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad088ea-5283-431d-a6c4-b6d2883f2a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:50.859733 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-9ad088ea-5283-431d-a6c4-b6d2883f2a7b None None] MFA Rules not processed for user `0a426fa7ed504002881521b1e820e359`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:19:50.861348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-9ad088ea-5283-431d-a6c4-b6d2883f2a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:50.957681 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1776/3543] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:19:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:19:51.844557 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9a96d-ac62-4084-88f5-3034fbe3d1e4 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:51.845157 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9a96d-ac62-4084-88f5-3034fbe3d1e4 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:51.845391 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9a96d-ac62-4084-88f5-3034fbe3d1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:51.883929 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-f7a9a96d-ac62-4084-88f5-3034fbe3d1e4 None None] MFA Rules not processed for user `2f5eafa970bd4247bdaef1cda747c3fc`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:19:51.888423 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f7a9a96d-ac62-4084-88f5-3034fbe3d1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:52.001735 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1768/3544] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:19:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:19:52.791918 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d827cb1-aa3d-43be-a765-55ceaeafab54 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:52.793583 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d827cb1-aa3d-43be-a765-55ceaeafab54 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:52.794140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d827cb1-aa3d-43be-a765-55ceaeafab54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:52.833069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-0d827cb1-aa3d-43be-a765-55ceaeafab54 None None] MFA Rules not processed for user `f3e57c830031491a9d8fd6b3664b4390`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:19:52.834305 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0d827cb1-aa3d-43be-a765-55ceaeafab54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:52.964057 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1777/3545] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:19:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:19:57.892594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7024362-f175-483b-b8a0-4bb120479992 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:57.893164 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7024362-f175-483b-b8a0-4bb120479992 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:57.893164 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7024362-f175-483b-b8a0-4bb120479992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:57.952042 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-a7024362-f175-483b-b8a0-4bb120479992 None None] MFA Rules not processed for user `6d4baa7f101f47abb43077f08e5bcc49`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:19:57.953339 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a7024362-f175-483b-b8a0-4bb120479992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:58.099147 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1769/3546] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:19:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:19:58.112849 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d827cb1-aa3d-43be-a765-55ceaeafab54 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:19:58.114658 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0d827cb1-aa3d-43be-a765-55ceaeafab54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:58.208629 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d827cb1-aa3d-43be-a765-55ceaeafab54 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:19:58.213121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b594f-22e6-47df-a339-c1309029a77f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:19:58.214818 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b594f-22e6-47df-a339-c1309029a77f service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:58.215278 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b594f-22e6-47df-a339-c1309029a77f service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:58.216006 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b594f-22e6-47df-a339-c1309029a77f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:58.317233 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b594f-22e6-47df-a339-c1309029a77f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:19:58.320133 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b594f-22e6-47df-a339-c1309029a77f service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:19:58.366249 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1778/3547] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:19:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:19:59.735326 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803fbff-e718-4d8b-b638-775ab57888c8 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:19:59.735326 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803fbff-e718-4d8b-b638-775ab57888c8 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:19:59.735326 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803fbff-e718-4d8b-b638-775ab57888c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:19:59.798447 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-2803fbff-e718-4d8b-b638-775ab57888c8 None None] MFA Rules not processed for user `a75959d37cbf4c9b8482e480a0888246`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:19:59.801160 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2803fbff-e718-4d8b-b638-775ab57888c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:19:59.969414 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1770/3548] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:19:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:20:21.074658 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b594f-22e6-47df-a339-c1309029a77f service cinder] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:20:21.214051 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b594f-22e6-47df-a339-c1309029a77f service cinder] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:20:21.218158 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404fe5d-0e50-4ef7-a8fa-6d8c438c22fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:20:21.219013 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404fe5d-0e50-4ef7-a8fa-6d8c438c22fa service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:21.219467 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404fe5d-0e50-4ef7-a8fa-6d8c438c22fa service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:21.219889 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404fe5d-0e50-4ef7-a8fa-6d8c438c22fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:21.222113 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f404fe5d-0e50-4ef7-a8fa-6d8c438c22fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:20:21.438194 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404fe5d-0e50-4ef7-a8fa-6d8c438c22fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:20:21.440003 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404fe5d-0e50-4ef7-a8fa-6d8c438c22fa service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:20:21.470465 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1779/3549] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:20:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:20:25.073603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952f7b1-3da3-4547-8f17-04bdf5983c09 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:25.074172 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952f7b1-3da3-4547-8f17-04bdf5983c09 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:25.074258 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952f7b1-3da3-4547-8f17-04bdf5983c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:25.092558 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-4952f7b1-3da3-4547-8f17-04bdf5983c09 None None] MFA Rules not processed for user `af1585cd61ba445eba82fb0b5c74a460`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:20:25.093828 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4952f7b1-3da3-4547-8f17-04bdf5983c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:20:25.100925 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1771/3550] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:20:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:20:25.111929 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1c25e-20ff-4ac7-bce0-a9ac3a749b47 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:25.112401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1c25e-20ff-4ac7-bce0-a9ac3a749b47 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:25.112539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1c25e-20ff-4ac7-bce0-a9ac3a749b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:25.130650 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-d4c1c25e-20ff-4ac7-bce0-a9ac3a749b47 None None] MFA Rules not processed for user `af1585cd61ba445eba82fb0b5c74a460`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:20:25.131995 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d4c1c25e-20ff-4ac7-bce0-a9ac3a749b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:20:25.139625 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1780/3551] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:20:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:20:30.172500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952f7b1-3da3-4547-8f17-04bdf5983c09 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:20:30.183352 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952f7b1-3da3-4547-8f17-04bdf5983c09 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:20:30.187935 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7925abf-90cb-4dad-b8db-ba03e2b07486 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:20:30.188831 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7925abf-90cb-4dad-b8db-ba03e2b07486 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:30.189202 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7925abf-90cb-4dad-b8db-ba03e2b07486 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:30.189483 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7925abf-90cb-4dad-b8db-ba03e2b07486 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:30.191307 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e7925abf-90cb-4dad-b8db-ba03e2b07486 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:20:30.205844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7925abf-90cb-4dad-b8db-ba03e2b07486 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:20:30.207706 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7925abf-90cb-4dad-b8db-ba03e2b07486 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:20:30.221313 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1772/3552] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:20:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:20:31.676075 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c1c25e-20ff-4ac7-bce0-a9ac3a749b47 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:20:31.677597 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d4c1c25e-20ff-4ac7-bce0-a9ac3a749b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:20:31.714888 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c1c25e-20ff-4ac7-bce0-a9ac3a749b47 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:20:31.720042 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29297e1c-38a6-4981-a7d3-b6cf161e37da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:20:31.721506 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29297e1c-38a6-4981-a7d3-b6cf161e37da service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:31.722176 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29297e1c-38a6-4981-a7d3-b6cf161e37da service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:31.722924 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29297e1c-38a6-4981-a7d3-b6cf161e37da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:31.725439 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-29297e1c-38a6-4981-a7d3-b6cf161e37da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:20:31.743814 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29297e1c-38a6-4981-a7d3-b6cf161e37da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:20:31.745417 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29297e1c-38a6-4981-a7d3-b6cf161e37da service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:20:31.757812 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1781/3553] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:20:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:20:31.890189 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7925abf-90cb-4dad-b8db-ba03e2b07486 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:20:31.892155 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e7925abf-90cb-4dad-b8db-ba03e2b07486 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:20:32.021981 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7925abf-90cb-4dad-b8db-ba03e2b07486 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:20:32.028193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04310d3-3d73-4e0c-a312-db2bbb3af9c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:20:32.028923 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04310d3-3d73-4e0c-a312-db2bbb3af9c3 service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:32.029282 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04310d3-3d73-4e0c-a312-db2bbb3af9c3 service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:32.029536 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04310d3-3d73-4e0c-a312-db2bbb3af9c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:32.031567 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d04310d3-3d73-4e0c-a312-db2bbb3af9c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:20:32.045253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04310d3-3d73-4e0c-a312-db2bbb3af9c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:20:32.046933 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04310d3-3d73-4e0c-a312-db2bbb3af9c3 service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:20:32.064836 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1773/3554] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:20:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:20:41.443112 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29297e1c-38a6-4981-a7d3-b6cf161e37da service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:20:41.444647 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-29297e1c-38a6-4981-a7d3-b6cf161e37da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:20:41.603198 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29297e1c-38a6-4981-a7d3-b6cf161e37da service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:20:41.612450 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5a458-e4d2-4452-8f58-14be3f830563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:20:41.612450 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5a458-e4d2-4452-8f58-14be3f830563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:41.612450 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5a458-e4d2-4452-8f58-14be3f830563 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:41.612450 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5a458-e4d2-4452-8f58-14be3f830563 admin admin] PATH_INFO: `/v3/users/1961bb1779214710bc073d188262f1fb` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:41.613109 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a5a458-e4d2-4452-8f58-14be3f830563 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1961bb1779214710bc073d188262f1fb)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:20:41.614840 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a5a458-e4d2-4452-8f58-14be3f830563 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:20:41.819578 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b68f15-bc54-466f-bd4b-f5859fb35173 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:41.821283 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b68f15-bc54-466f-bd4b-f5859fb35173 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:41.821729 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b68f15-bc54-466f-bd4b-f5859fb35173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:41.841823 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-75b68f15-bc54-466f-bd4b-f5859fb35173 None None] MFA Rules not processed for user `2f5eafa970bd4247bdaef1cda747c3fc`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:20:41.843346 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-75b68f15-bc54-466f-bd4b-f5859fb35173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:20:41.843589 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-75a5a458-e4d2-4452-8f58-14be3f830563 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1961bb1779214710bc073d188262f1fb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:20:41.852368 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1774/3555] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:20:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:20:41.878753 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-75a5a458-e4d2-4452-8f58-14be3f830563 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1961bb1779214710bc073d188262f1fb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:20:41.978269 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-75a5a458-e4d2-4452-8f58-14be3f830563 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1961bb1779214710bc073d188262f1fb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:20:41.981125 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-75a5a458-e4d2-4452-8f58-14be3f830563 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1961bb1779214710bc073d188262f1fb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:20:41.986254 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-75a5a458-e4d2-4452-8f58-14be3f830563 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1961bb1779214710bc073d188262f1fb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:20:41.992983 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1782/3556] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:20:41 2022] DELETE /identity/v3/users/1961bb1779214710bc073d188262f1fb => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:20:41.997639 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1eddd-2540-4714-9a08-0ea0b1b98d90 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:41.997959 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1eddd-2540-4714-9a08-0ea0b1b98d90 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:41.998235 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1eddd-2540-4714-9a08-0ea0b1b98d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:42.026186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-88a1eddd-2540-4714-9a08-0ea0b1b98d90 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:20:42.027739 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-88a1eddd-2540-4714-9a08-0ea0b1b98d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:20:42.111591 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1775/3557] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:20:42.130444 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5a458-e4d2-4452-8f58-14be3f830563 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:20:42.132456 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-75a5a458-e4d2-4452-8f58-14be3f830563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:20:42.237044 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5a458-e4d2-4452-8f58-14be3f830563 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:20:42.241354 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc552b7-4e91-46ce-bd20-fb685de0c411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:20:42.243189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc552b7-4e91-46ce-bd20-fb685de0c411 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:42.243641 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc552b7-4e91-46ce-bd20-fb685de0c411 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:42.244072 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc552b7-4e91-46ce-bd20-fb685de0c411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:42.261942 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc552b7-4e91-46ce-bd20-fb685de0c411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:20:42.264182 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc552b7-4e91-46ce-bd20-fb685de0c411 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:20:42.276231 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1783/3558] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:20:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:20:42.708070 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1eddd-2540-4714-9a08-0ea0b1b98d90 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:20:42.709555 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-88a1eddd-2540-4714-9a08-0ea0b1b98d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:20:42.736732 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1eddd-2540-4714-9a08-0ea0b1b98d90 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:20:42.772402 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a4e89-a2ac-4e5b-bcc2-a43bba8bdd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:20:42.775410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a4e89-a2ac-4e5b-bcc2-a43bba8bdd13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:42.775410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a4e89-a2ac-4e5b-bcc2-a43bba8bdd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:42.775410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a4e89-a2ac-4e5b-bcc2-a43bba8bdd13 admin admin] PATH_INFO: `/v3/projects/327a580f2f8645c28e9590806928ed91` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:42.775775 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a4e89-a2ac-4e5b-bcc2-a43bba8bdd13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=327a580f2f8645c28e9590806928ed91)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:20:42.780490 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a4e89-a2ac-4e5b-bcc2-a43bba8bdd13 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:20:42.959601 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-329a4e89-a2ac-4e5b-bcc2-a43bba8bdd13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '327a580f2f8645c28e9590806928ed91', 'request_id': 'req-329a4e89-a2ac-4e5b-bcc2-a43bba8bdd13'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:20:42.968249 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-329a4e89-a2ac-4e5b-bcc2-a43bba8bdd13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '327a580f2f8645c28e9590806928ed91', 'request_id': 'req-329a4e89-a2ac-4e5b-bcc2-a43bba8bdd13'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:20:42.983081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-329a4e89-a2ac-4e5b-bcc2-a43bba8bdd13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '327a580f2f8645c28e9590806928ed91', 'request_id': 'req-329a4e89-a2ac-4e5b-bcc2-a43bba8bdd13'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:20:43.052791 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-329a4e89-a2ac-4e5b-bcc2-a43bba8bdd13 admin admin] The token cache is being invalidate because project 327a580f2f8645c28e9590806928ed91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:20:43.053825 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-329a4e89-a2ac-4e5b-bcc2-a43bba8bdd13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:20:43.054960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-329a4e89-a2ac-4e5b-bcc2-a43bba8bdd13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:20:43.057996 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1776/3559] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:20:42 2022] DELETE /identity/v3/projects/327a580f2f8645c28e9590806928ed91 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:20:43.061468 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc552b7-4e91-46ce-bd20-fb685de0c411 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:20:43.071622 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc552b7-4e91-46ce-bd20-fb685de0c411 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:20:43.138567 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092abb99-2b63-4a58-8886-a75ed05874b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:20:43.139755 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092abb99-2b63-4a58-8886-a75ed05874b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:43.140238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092abb99-2b63-4a58-8886-a75ed05874b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:43.140700 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092abb99-2b63-4a58-8886-a75ed05874b8 admin admin] PATH_INFO: `/v3/users/004b17a911d1414599dec4c0f3ced227` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:43.142433 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092abb99-2b63-4a58-8886-a75ed05874b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=004b17a911d1414599dec4c0f3ced227)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:20:43.145018 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092abb99-2b63-4a58-8886-a75ed05874b8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:20:43.369845 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-092abb99-2b63-4a58-8886-a75ed05874b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '004b17a911d1414599dec4c0f3ced227'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:20:43.408121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-092abb99-2b63-4a58-8886-a75ed05874b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '004b17a911d1414599dec4c0f3ced227'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:20:43.503012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-092abb99-2b63-4a58-8886-a75ed05874b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '004b17a911d1414599dec4c0f3ced227'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:20:43.503975 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-092abb99-2b63-4a58-8886-a75ed05874b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '004b17a911d1414599dec4c0f3ced227'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:20:43.543393 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-092abb99-2b63-4a58-8886-a75ed05874b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '004b17a911d1414599dec4c0f3ced227'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:20:43.588664 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1784/3560] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:20:43 2022] DELETE /identity/v3/users/004b17a911d1414599dec4c0f3ced227 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:20:44.212883 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a4e89-a2ac-4e5b-bcc2-a43bba8bdd13 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:20:44.214514 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-329a4e89-a2ac-4e5b-bcc2-a43bba8bdd13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:20:44.239375 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a4e89-a2ac-4e5b-bcc2-a43bba8bdd13 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:20:44.390364 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3d010-1a4d-47d7-885c-d73e89abfb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:20:44.392268 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3d010-1a4d-47d7-885c-d73e89abfb59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:44.392556 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3d010-1a4d-47d7-885c-d73e89abfb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:44.394362 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3d010-1a4d-47d7-885c-d73e89abfb59 admin admin] PATH_INFO: `/v3/projects/e6cffe1eb35d4bd7b646d590aa056a0c` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:44.395967 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c3d010-1a4d-47d7-885c-d73e89abfb59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6cffe1eb35d4bd7b646d590aa056a0c)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:20:44.401402 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c3d010-1a4d-47d7-885c-d73e89abfb59 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:20:44.654015 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-70c3d010-1a4d-47d7-885c-d73e89abfb59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6cffe1eb35d4bd7b646d590aa056a0c', 'request_id': 'req-70c3d010-1a4d-47d7-885c-d73e89abfb59'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:20:44.659736 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-70c3d010-1a4d-47d7-885c-d73e89abfb59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6cffe1eb35d4bd7b646d590aa056a0c', 'request_id': 'req-70c3d010-1a4d-47d7-885c-d73e89abfb59'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:20:44.688153 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-70c3d010-1a4d-47d7-885c-d73e89abfb59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6cffe1eb35d4bd7b646d590aa056a0c', 'request_id': 'req-70c3d010-1a4d-47d7-885c-d73e89abfb59'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:20:44.722527 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54a734-b1df-4746-852b-a1a050ec6ab0 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:44.723060 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54a734-b1df-4746-852b-a1a050ec6ab0 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:44.723847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54a734-b1df-4746-852b-a1a050ec6ab0 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:44.725581 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1785/3561] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:20:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 21:20:44.732794 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c7851-8323-44ab-aca0-3217bb4f3bf5 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:44.733069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c7851-8323-44ab-aca0-3217bb4f3bf5 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:44.733559 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c7851-8323-44ab-aca0-3217bb4f3bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:44.809458 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-70c3d010-1a4d-47d7-885c-d73e89abfb59 admin admin] The token cache is being invalidate because project e6cffe1eb35d4bd7b646d590aa056a0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:20:44.810806 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-70c3d010-1a4d-47d7-885c-d73e89abfb59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:20:44.812549 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-70c3d010-1a4d-47d7-885c-d73e89abfb59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:20:44.814872 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1777/3562] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:20:44 2022] DELETE /identity/v3/projects/e6cffe1eb35d4bd7b646d590aa056a0c => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:20:44.821858 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf979c-51a8-44ff-83e2-b3c6927e2f38 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:44.822653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf979c-51a8-44ff-83e2-b3c6927e2f38 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:44.823092 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf979c-51a8-44ff-83e2-b3c6927e2f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:44.823684 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-985c7851-8323-44ab-aca0-3217bb4f3bf5 None None] MFA Rules not processed for user `4ad3f89b7037413a83c7905cef263b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:20:44.825452 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-985c7851-8323-44ab-aca0-3217bb4f3bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:20:44.900881 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-bfcf979c-51a8-44ff-83e2-b3c6927e2f38 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:20:44.902901 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-bfcf979c-51a8-44ff-83e2-b3c6927e2f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:20:44.941872 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1786/3563] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:20:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:20:44.978391 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c7851-8323-44ab-aca0-3217bb4f3bf5 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:20:44.980005 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-985c7851-8323-44ab-aca0-3217bb4f3bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:20:44.996243 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c7851-8323-44ab-aca0-3217bb4f3bf5 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:20:45.004840 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a63d3-a3b7-48b9-944b-cbc75297233f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:20:45.005843 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a63d3-a3b7-48b9-944b-cbc75297233f service placement] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:45.006385 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a63d3-a3b7-48b9-944b-cbc75297233f service placement] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:45.006883 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a63d3-a3b7-48b9-944b-cbc75297233f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:45.017642 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a63d3-a3b7-48b9-944b-cbc75297233f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:20:45.024418 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1778/3564] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:20:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:20:45.026906 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b741d-fb4d-4745-864e-691361a889d1 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:45.027215 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b741d-fb4d-4745-864e-691361a889d1 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:45.027572 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b741d-fb4d-4745-864e-691361a889d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:45.028133 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a63d3-a3b7-48b9-944b-cbc75297233f service placement] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:20:45.050810 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1787/3565] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:20:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:20:45.052520 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-fb7b741d-fb4d-4745-864e-691361a889d1 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:20:45.055827 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-fb7b741d-fb4d-4745-864e-691361a889d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:20:45.069837 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1779/3566] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:20:45.074409 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a63d3-a3b7-48b9-944b-cbc75297233f service placement] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:20:45.090957 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a63d3-a3b7-48b9-944b-cbc75297233f service placement] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:20:45.111323 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faedc271-f432-4a23-9ab1-96c0845e4c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:20:45.113003 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faedc271-f432-4a23-9ab1-96c0845e4c33 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:45.113364 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faedc271-f432-4a23-9ab1-96c0845e4c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:45.113708 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faedc271-f432-4a23-9ab1-96c0845e4c33 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:45.117722 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faedc271-f432-4a23-9ab1-96c0845e4c33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:20:45.118186 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faedc271-f432-4a23-9ab1-96c0845e4c33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:20:45.124160 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faedc271-f432-4a23-9ab1-96c0845e4c33 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:20:45.160121 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1788/3567] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:20:45.163563 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b741d-fb4d-4745-864e-691361a889d1 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:20:45.177336 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b741d-fb4d-4745-864e-691361a889d1 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:20:45.194864 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c656ef-97f4-4eb3-a980-329be8ba4457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:20:45.194864 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c656ef-97f4-4eb3-a980-329be8ba4457 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:45.194864 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c656ef-97f4-4eb3-a980-329be8ba4457 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:45.194864 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c656ef-97f4-4eb3-a980-329be8ba4457 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:45.195741 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c656ef-97f4-4eb3-a980-329be8ba4457 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:20:45.195741 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c656ef-97f4-4eb3-a980-329be8ba4457 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:20:45.339565 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1780/3568] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:20:45 2022] POST /identity/v3/projects => generated 379 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:20:45.343442 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faedc271-f432-4a23-9ab1-96c0845e4c33 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:20:45.355780 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faedc271-f432-4a23-9ab1-96c0845e4c33 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:20:45.458320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a992d5-c3b6-4ff0-bb07-a00e8c948735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:20:45.459229 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a992d5-c3b6-4ff0-bb07-a00e8c948735 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:45.460266 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a992d5-c3b6-4ff0-bb07-a00e8c948735 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:45.460659 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a992d5-c3b6-4ff0-bb07-a00e8c948735 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:45.462036 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a992d5-c3b6-4ff0-bb07-a00e8c948735 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:20:45.464341 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a992d5-c3b6-4ff0-bb07-a00e8c948735 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:20:45.597236 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1789/3569] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:20:45 2022] POST /identity/v3/users => generated 290 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:20:45.600991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c656ef-97f4-4eb3-a980-329be8ba4457 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:20:45.612616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c656ef-97f4-4eb3-a980-329be8ba4457 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:20:45.618849 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3dc42-055f-4a3d-b8cf-d69ddd8a4602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:20:45.619888 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3dc42-055f-4a3d-b8cf-d69ddd8a4602 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:45.620385 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3dc42-055f-4a3d-b8cf-d69ddd8a4602 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:45.620865 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3dc42-055f-4a3d-b8cf-d69ddd8a4602 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:45.622136 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3dc42-055f-4a3d-b8cf-d69ddd8a4602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:20:45.624193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3dc42-055f-4a3d-b8cf-d69ddd8a4602 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:20:45.642384 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a992d5-c3b6-4ff0-bb07-a00e8c948735 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:20:45.650513 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1781/3570] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:20:45.656708 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a992d5-c3b6-4ff0-bb07-a00e8c948735 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:20:45.663540 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe0323-8cbc-44ff-9f75-34897dd96691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:20:45.663540 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe0323-8cbc-44ff-9f75-34897dd96691 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:45.663540 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe0323-8cbc-44ff-9f75-34897dd96691 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:45.663540 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe0323-8cbc-44ff-9f75-34897dd96691 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:45.665188 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe0323-8cbc-44ff-9f75-34897dd96691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:20:45.666978 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe0323-8cbc-44ff-9f75-34897dd96691 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:20:45.679386 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1790/3571] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:20:45.684052 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3dc42-055f-4a3d-b8cf-d69ddd8a4602 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:20:45.694599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3dc42-055f-4a3d-b8cf-d69ddd8a4602 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:20:45.700508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ad965-09c3-48bb-8e26-5bc58afbd337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:20:45.701349 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ad965-09c3-48bb-8e26-5bc58afbd337 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:45.701645 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ad965-09c3-48bb-8e26-5bc58afbd337 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:45.701975 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ad965-09c3-48bb-8e26-5bc58afbd337 admin admin] PATH_INFO: `/v3/projects/72deb8cb9e6e401f82ec1a3ff894a1a7/users/f17c7aaa6e5d4aefa1f1f508e2b9b4e9/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:45.720539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ad965-09c3-48bb-8e26-5bc58afbd337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72deb8cb9e6e401f82ec1a3ff894a1a7, user_id=f17c7aaa6e5d4aefa1f1f508e2b9b4e9, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:20:45.723998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ad965-09c3-48bb-8e26-5bc58afbd337 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:20:45.855582 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7e177-3ed3-483f-bf75-505341263291 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:45.856458 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7e177-3ed3-483f-bf75-505341263291 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:45.856927 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7e177-3ed3-483f-bf75-505341263291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:45.861601 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1782/3572] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:20:45 2022] PUT /identity/v3/projects/72deb8cb9e6e401f82ec1a3ff894a1a7/users/f17c7aaa6e5d4aefa1f1f508e2b9b4e9/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:20:45.912725 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-5bf7e177-3ed3-483f-bf75-505341263291 None None] MFA Rules not processed for user `f17c7aaa6e5d4aefa1f1f508e2b9b4e9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:20:45.924025 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5bf7e177-3ed3-483f-bf75-505341263291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:20:46.039544 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1791/3573] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:20:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:20:46.051731 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ad965-09c3-48bb-8e26-5bc58afbd337 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:20:46.055501 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-880ad965-09c3-48bb-8e26-5bc58afbd337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:20:46.155982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ad965-09c3-48bb-8e26-5bc58afbd337 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:20:46.160559 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf012c8-28e7-45a7-8ff3-3de8cd626c76 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e302b1298dd04d6590e3d079f7b13b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:20:46.161239 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf012c8-28e7-45a7-8ff3-3de8cd626c76 service glance] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:46.161508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf012c8-28e7-45a7-8ff3-3de8cd626c76 service glance] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:46.161808 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf012c8-28e7-45a7-8ff3-3de8cd626c76 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:46.186060 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf012c8-28e7-45a7-8ff3-3de8cd626c76 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:20:46.189550 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf012c8-28e7-45a7-8ff3-3de8cd626c76 service glance] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:20:46.212737 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1783/3574] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:20:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:20:46.661802 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618357ee-956a-4807-b01b-04fd69139e93 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:46.661802 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618357ee-956a-4807-b01b-04fd69139e93 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:46.665348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618357ee-956a-4807-b01b-04fd69139e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:46.710363 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-618357ee-956a-4807-b01b-04fd69139e93 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:20:46.712241 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-618357ee-956a-4807-b01b-04fd69139e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:20:46.793464 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1792/3575] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:20:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:20:46.931281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf012c8-28e7-45a7-8ff3-3de8cd626c76 service glance] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:20:46.932828 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2cf012c8-28e7-45a7-8ff3-3de8cd626c76 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:20:47.038558 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf012c8-28e7-45a7-8ff3-3de8cd626c76 service glance] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:20:47.045936 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508102f-34ee-4f29-bf57-d361428be465 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:20:47.046973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508102f-34ee-4f29-bf57-d361428be465 service swift] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:47.047354 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508102f-34ee-4f29-bf57-d361428be465 service swift] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:47.047696 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508102f-34ee-4f29-bf57-d361428be465 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:47.058112 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508102f-34ee-4f29-bf57-d361428be465 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:20:47.060332 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508102f-34ee-4f29-bf57-d361428be465 service swift] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:20:47.072558 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1784/3576] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:20:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:20:47.455728 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cf661-70a8-4fab-9aa4-5f3391d8b56d None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:47.456781 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cf661-70a8-4fab-9aa4-5f3391d8b56d None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:47.457321 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cf661-70a8-4fab-9aa4-5f3391d8b56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:47.525531 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-b01cf661-70a8-4fab-9aa4-5f3391d8b56d None None] MFA Rules not processed for user `2f5eafa970bd4247bdaef1cda747c3fc`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:20:47.527800 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b01cf661-70a8-4fab-9aa4-5f3391d8b56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:20:47.600305 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1793/3577] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:20:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:20:48.881267 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508102f-34ee-4f29-bf57-d361428be465 service swift] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:20:48.885448 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0508102f-34ee-4f29-bf57-d361428be465 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:20:48.993104 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508102f-34ee-4f29-bf57-d361428be465 service swift] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:20:49.000556 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e71b1d-2021-43b9-bc6d-1abb069d72e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:20:49.001488 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e71b1d-2021-43b9-bc6d-1abb069d72e8 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:49.002276 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e71b1d-2021-43b9-bc6d-1abb069d72e8 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:49.003783 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e71b1d-2021-43b9-bc6d-1abb069d72e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:49.008305 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a2e71b1d-2021-43b9-bc6d-1abb069d72e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:20:49.023902 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e71b1d-2021-43b9-bc6d-1abb069d72e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:20:49.026325 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e71b1d-2021-43b9-bc6d-1abb069d72e8 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:20:49.042021 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1785/3578] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:20:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:20:52.773883 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cf661-70a8-4fab-9aa4-5f3391d8b56d None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:20:52.775382 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b01cf661-70a8-4fab-9aa4-5f3391d8b56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:20:52.864132 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cf661-70a8-4fab-9aa4-5f3391d8b56d None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:20:52.868141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b74ad-d981-408e-adec-0e2abb87684d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:20:52.869408 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b74ad-d981-408e-adec-0e2abb87684d service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:52.869894 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b74ad-d981-408e-adec-0e2abb87684d service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:52.870173 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b74ad-d981-408e-adec-0e2abb87684d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:52.872027 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-609b74ad-d981-408e-adec-0e2abb87684d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:20:52.884010 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b74ad-d981-408e-adec-0e2abb87684d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:20:52.885497 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b74ad-d981-408e-adec-0e2abb87684d service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:20:52.897222 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1794/3579] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:20:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:20:56.525446 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5b61d-50ef-4bb3-889a-79a8e84ee0c1 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:56.526369 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5b61d-50ef-4bb3-889a-79a8e84ee0c1 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:56.526369 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5b61d-50ef-4bb3-889a-79a8e84ee0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:56.543998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-a5a5b61d-50ef-4bb3-889a-79a8e84ee0c1 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:20:56.545309 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a5a5b61d-50ef-4bb3-889a-79a8e84ee0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:20:56.556500 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1786/3580] 10.222.0.23 () {58 vars in 967 bytes} [Sat Apr 30 21:20:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:20:56.570432 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b74ad-d981-408e-adec-0e2abb87684d service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:20:56.588426 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b74ad-d981-408e-adec-0e2abb87684d service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:20:56.595521 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0fbfb-a5dc-460a-a5b4-37e1e9e82865 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:20:56.596227 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0fbfb-a5dc-460a-a5b4-37e1e9e82865 service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:56.596511 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0fbfb-a5dc-460a-a5b4-37e1e9e82865 service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:56.596812 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0fbfb-a5dc-460a-a5b4-37e1e9e82865 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:56.606405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0fbfb-a5dc-460a-a5b4-37e1e9e82865 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:20:56.608013 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0fbfb-a5dc-460a-a5b4-37e1e9e82865 service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:20:56.617400 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1795/3581] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:20:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:20:56.991056 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5b61d-50ef-4bb3-889a-79a8e84ee0c1 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:20:57.094143 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5b61d-50ef-4bb3-889a-79a8e84ee0c1 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:20:57.101847 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c0d82f-e1d8-4eb1-87a8-29a81b7b797d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:20:57.103107 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0d82f-e1d8-4eb1-87a8-29a81b7b797d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:57.103386 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0d82f-e1d8-4eb1-87a8-29a81b7b797d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:57.111502 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0d82f-e1d8-4eb1-87a8-29a81b7b797d admin admin] PATH_INFO: `/v3/users/f17c7aaa6e5d4aefa1f1f508e2b9b4e9` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:57.111502 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c0d82f-e1d8-4eb1-87a8-29a81b7b797d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f17c7aaa6e5d4aefa1f1f508e2b9b4e9)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:20:57.111502 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c0d82f-e1d8-4eb1-87a8-29a81b7b797d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:20:57.316972 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c7c0d82f-e1d8-4eb1-87a8-29a81b7b797d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f17c7aaa6e5d4aefa1f1f508e2b9b4e9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:20:57.335855 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c7c0d82f-e1d8-4eb1-87a8-29a81b7b797d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f17c7aaa6e5d4aefa1f1f508e2b9b4e9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:20:57.400270 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c7c0d82f-e1d8-4eb1-87a8-29a81b7b797d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f17c7aaa6e5d4aefa1f1f508e2b9b4e9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:20:57.427042 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c7c0d82f-e1d8-4eb1-87a8-29a81b7b797d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f17c7aaa6e5d4aefa1f1f508e2b9b4e9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:20:57.428420 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c7c0d82f-e1d8-4eb1-87a8-29a81b7b797d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f17c7aaa6e5d4aefa1f1f508e2b9b4e9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:20:57.437005 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1787/3582] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:20:56 2022] DELETE /identity/v3/users/f17c7aaa6e5d4aefa1f1f508e2b9b4e9 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:20:57.441253 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8c7bb-6e3e-4bf0-a4d0-04a9b0fe2fde None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:57.441809 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8c7bb-6e3e-4bf0-a4d0-04a9b0fe2fde None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:57.442312 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8c7bb-6e3e-4bf0-a4d0-04a9b0fe2fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:57.467615 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-5cb8c7bb-6e3e-4bf0-a4d0-04a9b0fe2fde None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:20:57.470589 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5cb8c7bb-6e3e-4bf0-a4d0-04a9b0fe2fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:20:57.517024 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c0d82f-e1d8-4eb1-87a8-29a81b7b797d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:20:57.518618 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c7c0d82f-e1d8-4eb1-87a8-29a81b7b797d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:20:57.585423 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1796/3583] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:20:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:20:57.587250 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8c7bb-6e3e-4bf0-a4d0-04a9b0fe2fde None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:20:57.591756 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5cb8c7bb-6e3e-4bf0-a4d0-04a9b0fe2fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:20:57.613072 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8c7bb-6e3e-4bf0-a4d0-04a9b0fe2fde None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:20:57.619293 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c0d82f-e1d8-4eb1-87a8-29a81b7b797d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:20:57.619868 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ed768-972f-406b-83ae-e85306cd78ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:20:57.621957 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ed768-972f-406b-83ae-e85306cd78ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:57.622593 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ed768-972f-406b-83ae-e85306cd78ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:57.622885 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ed768-972f-406b-83ae-e85306cd78ad admin admin] PATH_INFO: `/v3/users/f3e57c830031491a9d8fd6b3664b4390` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:57.624238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ed768-972f-406b-83ae-e85306cd78ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3e57c830031491a9d8fd6b3664b4390)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:20:57.626575 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f4ddd-c8fb-4d89-98ff-162dc62bfeff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:20:57.627785 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ed768-972f-406b-83ae-e85306cd78ad admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:20:57.628015 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f4ddd-c8fb-4d89-98ff-162dc62bfeff service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:57.628518 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f4ddd-c8fb-4d89-98ff-162dc62bfeff service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:57.628942 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f4ddd-c8fb-4d89-98ff-162dc62bfeff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:57.633159 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a21f4ddd-c8fb-4d89-98ff-162dc62bfeff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:20:57.645861 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f4ddd-c8fb-4d89-98ff-162dc62bfeff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:20:57.648191 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f4ddd-c8fb-4d89-98ff-162dc62bfeff service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:20:57.659277 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1788/3584] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:20:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:20:57.662487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f4ddd-c8fb-4d89-98ff-162dc62bfeff service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:20:57.662487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a21f4ddd-c8fb-4d89-98ff-162dc62bfeff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:20:57.675629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f4ddd-c8fb-4d89-98ff-162dc62bfeff service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:20:57.681797 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f023da-e45a-4163-bd70-befd57f0669c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:20:57.682637 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f023da-e45a-4163-bd70-befd57f0669c service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:57.683090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f023da-e45a-4163-bd70-befd57f0669c service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:57.683514 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f023da-e45a-4163-bd70-befd57f0669c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:57.695631 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f023da-e45a-4163-bd70-befd57f0669c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:20:57.697058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f023da-e45a-4163-bd70-befd57f0669c service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:20:57.706947 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1789/3585] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:20:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:20:57.828822 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-140ed768-972f-406b-83ae-e85306cd78ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3e57c830031491a9d8fd6b3664b4390'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:20:57.849930 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-140ed768-972f-406b-83ae-e85306cd78ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3e57c830031491a9d8fd6b3664b4390'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:20:57.931073 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-140ed768-972f-406b-83ae-e85306cd78ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3e57c830031491a9d8fd6b3664b4390'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:20:57.934636 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-140ed768-972f-406b-83ae-e85306cd78ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3e57c830031491a9d8fd6b3664b4390'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:20:57.939802 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-140ed768-972f-406b-83ae-e85306cd78ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3e57c830031491a9d8fd6b3664b4390'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:20:57.947373 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1797/3586] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:20:57 2022] DELETE /identity/v3/users/f3e57c830031491a9d8fd6b3664b4390 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:20:58.372483 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f023da-e45a-4163-bd70-befd57f0669c service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:20:58.374217 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a7f023da-e45a-4163-bd70-befd57f0669c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:20:58.390592 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f023da-e45a-4163-bd70-befd57f0669c service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:20:58.487194 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec27359-b526-416a-a51e-a385c4fb8ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:20:58.488234 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec27359-b526-416a-a51e-a385c4fb8ddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:58.488619 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec27359-b526-416a-a51e-a385c4fb8ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:58.489003 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec27359-b526-416a-a51e-a385c4fb8ddc admin admin] PATH_INFO: `/v3/projects/72deb8cb9e6e401f82ec1a3ff894a1a7` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:58.490750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec27359-b526-416a-a51e-a385c4fb8ddc admin admin] RBAC: Authorizing `identity:delete_project(project_id=72deb8cb9e6e401f82ec1a3ff894a1a7)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:20:58.493680 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec27359-b526-416a-a51e-a385c4fb8ddc admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:20:58.634776 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-dec27359-b526-416a-a51e-a385c4fb8ddc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72deb8cb9e6e401f82ec1a3ff894a1a7', 'request_id': 'req-dec27359-b526-416a-a51e-a385c4fb8ddc'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:20:58.641045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-dec27359-b526-416a-a51e-a385c4fb8ddc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72deb8cb9e6e401f82ec1a3ff894a1a7', 'request_id': 'req-dec27359-b526-416a-a51e-a385c4fb8ddc'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:20:58.647496 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-dec27359-b526-416a-a51e-a385c4fb8ddc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72deb8cb9e6e401f82ec1a3ff894a1a7', 'request_id': 'req-dec27359-b526-416a-a51e-a385c4fb8ddc'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:20:58.701636 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ed768-972f-406b-83ae-e85306cd78ad admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:20:58.703894 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-140ed768-972f-406b-83ae-e85306cd78ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:20:58.720636 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ed768-972f-406b-83ae-e85306cd78ad admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:20:58.761540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-dec27359-b526-416a-a51e-a385c4fb8ddc admin admin] The token cache is being invalidate because project 72deb8cb9e6e401f82ec1a3ff894a1a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:20:58.763069 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-dec27359-b526-416a-a51e-a385c4fb8ddc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:20:58.763069 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-dec27359-b526-416a-a51e-a385c4fb8ddc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:20:58.769525 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1790/3587] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:20:58 2022] DELETE /identity/v3/projects/72deb8cb9e6e401f82ec1a3ff894a1a7 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:20:58.774964 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f6506-d7b2-4f5d-b8c1-8fb4f9e984b0 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:58.776336 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f6506-d7b2-4f5d-b8c1-8fb4f9e984b0 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:58.776800 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f6506-d7b2-4f5d-b8c1-8fb4f9e984b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:58.817348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-985f6506-d7b2-4f5d-b8c1-8fb4f9e984b0 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:20:58.826969 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-985f6506-d7b2-4f5d-b8c1-8fb4f9e984b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:20:58.879612 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974de407-d908-4916-9052-ecbfd3daf2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:20:58.881002 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974de407-d908-4916-9052-ecbfd3daf2d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:58.881349 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974de407-d908-4916-9052-ecbfd3daf2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:58.881638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974de407-d908-4916-9052-ecbfd3daf2d2 admin admin] PATH_INFO: `/v3/projects/692585b32bd44ddb8ab633a1f1842d5f` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:58.884880 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974de407-d908-4916-9052-ecbfd3daf2d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=692585b32bd44ddb8ab633a1f1842d5f)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:20:58.890111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974de407-d908-4916-9052-ecbfd3daf2d2 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:20:58.944123 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1791/3588] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:20:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:20:58.947378 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa57430-569d-48b3-a210-21bd3d4adc1d None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:58.947889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa57430-569d-48b3-a210-21bd3d4adc1d None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:58.948541 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa57430-569d-48b3-a210-21bd3d4adc1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:58.970846 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-aaa57430-569d-48b3-a210-21bd3d4adc1d None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:20:58.972407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-aaa57430-569d-48b3-a210-21bd3d4adc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:20:58.988236 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1792/3589] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:20:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:20:58.989336 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa57430-569d-48b3-a210-21bd3d4adc1d None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:20:58.998851 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa57430-569d-48b3-a210-21bd3d4adc1d None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:20:59.003944 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384fd346-a72a-4b9c-8444-9c44441b7676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:20:59.004533 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384fd346-a72a-4b9c-8444-9c44441b7676 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:59.004811 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384fd346-a72a-4b9c-8444-9c44441b7676 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:59.005237 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384fd346-a72a-4b9c-8444-9c44441b7676 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:59.006147 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384fd346-a72a-4b9c-8444-9c44441b7676 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:20:59.006594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384fd346-a72a-4b9c-8444-9c44441b7676 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:20:59.008535 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384fd346-a72a-4b9c-8444-9c44441b7676 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:20:59.023948 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1793/3590] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:20:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:20:59.032695 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384fd346-a72a-4b9c-8444-9c44441b7676 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:20:59.050445 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-974de407-d908-4916-9052-ecbfd3daf2d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '692585b32bd44ddb8ab633a1f1842d5f', 'request_id': 'req-974de407-d908-4916-9052-ecbfd3daf2d2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:20:59.055396 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384fd346-a72a-4b9c-8444-9c44441b7676 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:20:59.073990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-974de407-d908-4916-9052-ecbfd3daf2d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '692585b32bd44ddb8ab633a1f1842d5f', 'request_id': 'req-974de407-d908-4916-9052-ecbfd3daf2d2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:20:59.090186 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-974de407-d908-4916-9052-ecbfd3daf2d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '692585b32bd44ddb8ab633a1f1842d5f', 'request_id': 'req-974de407-d908-4916-9052-ecbfd3daf2d2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:20:59.122459 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f665642-a774-4a3d-be74-c03d17210738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:20:59.123492 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f665642-a774-4a3d-be74-c03d17210738 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:59.124050 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f665642-a774-4a3d-be74-c03d17210738 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:59.124541 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f665642-a774-4a3d-be74-c03d17210738 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:59.125404 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f665642-a774-4a3d-be74-c03d17210738 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:20:59.127656 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f665642-a774-4a3d-be74-c03d17210738 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:20:59.178145 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-974de407-d908-4916-9052-ecbfd3daf2d2 admin admin] The token cache is being invalidate because project 692585b32bd44ddb8ab633a1f1842d5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:20:59.178447 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-974de407-d908-4916-9052-ecbfd3daf2d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:20:59.179311 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-974de407-d908-4916-9052-ecbfd3daf2d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:20:59.181237 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1798/3591] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:20:58 2022] DELETE /identity/v3/projects/692585b32bd44ddb8ab633a1f1842d5f => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:20:59.186502 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd503f-0ab5-4b48-b652-b041230b38ac None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:59.186875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd503f-0ab5-4b48-b652-b041230b38ac None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:59.187639 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd503f-0ab5-4b48-b652-b041230b38ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:59.210839 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-92dd503f-0ab5-4b48-b652-b041230b38ac None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:20:59.213263 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-92dd503f-0ab5-4b48-b652-b041230b38ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:20:59.223724 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1799/3592] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:20:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:20:59.231519 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e5747-e552-4a0d-8ade-9887e9f1a585 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:59.231819 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e5747-e552-4a0d-8ade-9887e9f1a585 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:59.232084 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e5747-e552-4a0d-8ade-9887e9f1a585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:59.255581 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-f90e5747-e552-4a0d-8ade-9887e9f1a585 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:20:59.258601 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f90e5747-e552-4a0d-8ade-9887e9f1a585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:20:59.262578 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1794/3593] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:20:59 2022] POST /identity/v3/projects => generated 391 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:20:59.264186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f665642-a774-4a3d-be74-c03d17210738 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:20:59.269835 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3f665642-a774-4a3d-be74-c03d17210738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:20:59.361880 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f665642-a774-4a3d-be74-c03d17210738 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:20:59.362648 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1800/3594] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:20:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:20:59.367527 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e5747-e552-4a0d-8ade-9887e9f1a585 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:20:59.370877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16e2fe-38d8-4d3b-a222-f91d96ab8d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:20:59.371748 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16e2fe-38d8-4d3b-a222-f91d96ab8d5d admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:59.373520 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16e2fe-38d8-4d3b-a222-f91d96ab8d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:59.374014 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16e2fe-38d8-4d3b-a222-f91d96ab8d5d admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:59.375315 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16e2fe-38d8-4d3b-a222-f91d96ab8d5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:20:59.377489 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16e2fe-38d8-4d3b-a222-f91d96ab8d5d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:20:59.379471 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e5747-e552-4a0d-8ade-9887e9f1a585 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:20:59.385611 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2311f-b711-4671-9e82-a44581e7de9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:20:59.386448 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2311f-b711-4671-9e82-a44581e7de9c admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:59.386864 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2311f-b711-4671-9e82-a44581e7de9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:59.387235 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2311f-b711-4671-9e82-a44581e7de9c admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:59.388370 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c2311f-b711-4671-9e82-a44581e7de9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:20:59.388803 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c2311f-b711-4671-9e82-a44581e7de9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:20:59.390808 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c2311f-b711-4671-9e82-a44581e7de9c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:20:59.405994 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1801/3595] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:20:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:20:59.410199 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2311f-b711-4671-9e82-a44581e7de9c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:20:59.420908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2311f-b711-4671-9e82-a44581e7de9c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:20:59.425704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46243267-496d-48b6-a262-6be6dcd8e1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:20:59.426556 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46243267-496d-48b6-a262-6be6dcd8e1cb admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:59.426939 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46243267-496d-48b6-a262-6be6dcd8e1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:59.427883 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46243267-496d-48b6-a262-6be6dcd8e1cb admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:59.431387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46243267-496d-48b6-a262-6be6dcd8e1cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:20:59.431387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46243267-496d-48b6-a262-6be6dcd8e1cb admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:20:59.459490 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1795/3596] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:20:59 2022] POST /identity/v3/users => generated 296 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:20:59.463563 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16e2fe-38d8-4d3b-a222-f91d96ab8d5d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:20:59.473994 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16e2fe-38d8-4d3b-a222-f91d96ab8d5d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:20:59.480643 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be2ea92-c956-4231-b80c-7ef1f5409eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:20:59.481331 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2ea92-c956-4231-b80c-7ef1f5409eaa admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:59.489262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2ea92-c956-4231-b80c-7ef1f5409eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:59.489262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2ea92-c956-4231-b80c-7ef1f5409eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:59.489262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be2ea92-c956-4231-b80c-7ef1f5409eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:20:59.489262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be2ea92-c956-4231-b80c-7ef1f5409eaa admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:20:59.502994 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1796/3597] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:20:59.503933 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be2ea92-c956-4231-b80c-7ef1f5409eaa admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:20:59.526163 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be2ea92-c956-4231-b80c-7ef1f5409eaa admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:20:59.547156 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab2403-453b-4a37-80da-3602cbbce5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:20:59.547613 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab2403-453b-4a37-80da-3602cbbce5a0 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:59.548001 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab2403-453b-4a37-80da-3602cbbce5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:59.548696 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab2403-453b-4a37-80da-3602cbbce5a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:59.549534 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab2403-453b-4a37-80da-3602cbbce5a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:20:59.551636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab2403-453b-4a37-80da-3602cbbce5a0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:20:59.557831 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1802/3598] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:20:59 2022] POST /identity/v3/projects => generated 389 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:20:59.562048 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46243267-496d-48b6-a262-6be6dcd8e1cb admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:20:59.573391 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1797/3599] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:20:59.574814 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab2403-453b-4a37-80da-3602cbbce5a0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:20:59.590224 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab2403-453b-4a37-80da-3602cbbce5a0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:20:59.692045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344813b3-8b74-4f08-9dd3-e5f2503a9308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:20:59.693791 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344813b3-8b74-4f08-9dd3-e5f2503a9308 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:59.694285 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344813b3-8b74-4f08-9dd3-e5f2503a9308 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:59.694773 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344813b3-8b74-4f08-9dd3-e5f2503a9308 admin admin] PATH_INFO: `/v3/projects/defac230e0c54511ace7b7a2652d9a00/users/e9e0ed559f5e4852bbf2379bc5f250ab/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:59.696432 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46243267-496d-48b6-a262-6be6dcd8e1cb admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:20:59.711539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3eed6b-eb35-4017-800f-075ce92a80dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:20:59.712375 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3eed6b-eb35-4017-800f-075ce92a80dd admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:59.712632 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3eed6b-eb35-4017-800f-075ce92a80dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:59.712989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3eed6b-eb35-4017-800f-075ce92a80dd admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:59.713606 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3eed6b-eb35-4017-800f-075ce92a80dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:20:59.715572 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344813b3-8b74-4f08-9dd3-e5f2503a9308 admin admin] RBAC: Authorizing `identity:create_grant(project_id=defac230e0c54511ace7b7a2652d9a00, user_id=e9e0ed559f5e4852bbf2379bc5f250ab, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:20:59.715760 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3eed6b-eb35-4017-800f-075ce92a80dd admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:20:59.719264 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344813b3-8b74-4f08-9dd3-e5f2503a9308 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:20:59.775076 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1798/3600] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:20:59 2022] PUT /identity/v3/projects/defac230e0c54511ace7b7a2652d9a00/users/e9e0ed559f5e4852bbf2379bc5f250ab/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:20:59.790069 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf37efc-de1b-4d29-95eb-f6dedc10cfcf None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:59.790361 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf37efc-de1b-4d29-95eb-f6dedc10cfcf None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:59.790630 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf37efc-de1b-4d29-95eb-f6dedc10cfcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:59.817332 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1803/3601] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:20:59 2022] POST /identity/v3/users => generated 295 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:20:59.818868 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3eed6b-eb35-4017-800f-075ce92a80dd admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:20:59.846663 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-3cf37efc-de1b-4d29-95eb-f6dedc10cfcf None None] MFA Rules not processed for user `e9e0ed559f5e4852bbf2379bc5f250ab`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:20:59.847901 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3cf37efc-de1b-4d29-95eb-f6dedc10cfcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:20:59.853926 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3eed6b-eb35-4017-800f-075ce92a80dd admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:20:59.952650 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1799/3602] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:20:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:20:59.964633 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf37efc-de1b-4d29-95eb-f6dedc10cfcf None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:20:59.965988 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3cf37efc-de1b-4d29-95eb-f6dedc10cfcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:20:59.993534 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e914a348-d62e-4359-a8ae-5021534e8fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:20:59.994352 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914a348-d62e-4359-a8ae-5021534e8fed admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:20:59.994633 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914a348-d62e-4359-a8ae-5021534e8fed admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:20:59.995996 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914a348-d62e-4359-a8ae-5021534e8fed admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:20:59.996247 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e914a348-d62e-4359-a8ae-5021534e8fed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:20:59.999212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e914a348-d62e-4359-a8ae-5021534e8fed admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:00.014042 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1804/3603] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:21:00.018514 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e914a348-d62e-4359-a8ae-5021534e8fed admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:00.031876 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e914a348-d62e-4359-a8ae-5021534e8fed admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:00.039166 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e2543-8429-4003-9696-3a0a5e6cf1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:00.039855 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e2543-8429-4003-9696-3a0a5e6cf1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:00.040140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e2543-8429-4003-9696-3a0a5e6cf1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:00.040414 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e2543-8429-4003-9696-3a0a5e6cf1d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:00.041368 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e2543-8429-4003-9696-3a0a5e6cf1d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:00.042832 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e2543-8429-4003-9696-3a0a5e6cf1d6 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:00.060818 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1805/3604] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:21:00.062255 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e2543-8429-4003-9696-3a0a5e6cf1d6 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:00.077490 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e2543-8429-4003-9696-3a0a5e6cf1d6 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:00.083953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b877c-626c-4aaa-bef3-fc4c7e68f56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:00.084854 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b877c-626c-4aaa-bef3-fc4c7e68f56d admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:00.085729 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b877c-626c-4aaa-bef3-fc4c7e68f56d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:00.086048 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b877c-626c-4aaa-bef3-fc4c7e68f56d admin admin] PATH_INFO: `/v3/projects/afc5d20f2f9f4ecf981cdfe980cfc21d/users/65bedbcb4d094160a9a9fc3b6ba6f603/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:00.113225 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b877c-626c-4aaa-bef3-fc4c7e68f56d admin admin] RBAC: Authorizing `identity:create_grant(project_id=afc5d20f2f9f4ecf981cdfe980cfc21d, user_id=65bedbcb4d094160a9a9fc3b6ba6f603, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:00.113416 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf37efc-de1b-4d29-95eb-f6dedc10cfcf None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:00.116070 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b877c-626c-4aaa-bef3-fc4c7e68f56d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:00.131482 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1822af-df37-4b5a-8833-8bc7157b6f58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:00.132705 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1822af-df37-4b5a-8833-8bc7157b6f58 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:00.132990 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1822af-df37-4b5a-8833-8bc7157b6f58 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:00.133269 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1822af-df37-4b5a-8833-8bc7157b6f58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:00.149670 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1822af-df37-4b5a-8833-8bc7157b6f58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:00.152401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1822af-df37-4b5a-8833-8bc7157b6f58 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:00.177186 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1800/3605] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:20:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:21:00.218443 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1806/3606] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:21:00 2022] PUT /identity/v3/projects/afc5d20f2f9f4ecf981cdfe980cfc21d/users/65bedbcb4d094160a9a9fc3b6ba6f603/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:21:00.223511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0f962-5ad4-48ca-b826-2b51400242ca None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:00.223876 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0f962-5ad4-48ca-b826-2b51400242ca None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:00.224698 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0f962-5ad4-48ca-b826-2b51400242ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:00.261388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-3dd0f962-5ad4-48ca-b826-2b51400242ca None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:21:00.262841 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3dd0f962-5ad4-48ca-b826-2b51400242ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:00.381656 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1801/3607] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:21:00.406692 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b877c-626c-4aaa-bef3-fc4c7e68f56d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:00.414023 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ed9b877c-626c-4aaa-bef3-fc4c7e68f56d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:00.424898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0f962-5ad4-48ca-b826-2b51400242ca None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:00.437559 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0f962-5ad4-48ca-b826-2b51400242ca None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:00.454202 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63135211-8689-4a79-bd25-5087b4c3d46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:00.455215 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63135211-8689-4a79-bd25-5087b4c3d46f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:00.455499 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63135211-8689-4a79-bd25-5087b4c3d46f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:00.457611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63135211-8689-4a79-bd25-5087b4c3d46f admin admin] PATH_INFO: `/v3/users/e9e0ed559f5e4852bbf2379bc5f250ab` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:00.461909 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63135211-8689-4a79-bd25-5087b4c3d46f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9e0ed559f5e4852bbf2379bc5f250ab)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:00.465680 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63135211-8689-4a79-bd25-5087b4c3d46f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:00.518823 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b877c-626c-4aaa-bef3-fc4c7e68f56d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:00.526378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709b0c5-982c-48a6-9ce4-0c8cbd9d001c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:00.527447 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709b0c5-982c-48a6-9ce4-0c8cbd9d001c service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:00.530967 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709b0c5-982c-48a6-9ce4-0c8cbd9d001c service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:00.530967 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709b0c5-982c-48a6-9ce4-0c8cbd9d001c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:00.560094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709b0c5-982c-48a6-9ce4-0c8cbd9d001c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:00.560255 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709b0c5-982c-48a6-9ce4-0c8cbd9d001c service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:00.597151 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1807/3608] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:21:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:21:00.751926 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-63135211-8689-4a79-bd25-5087b4c3d46f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9e0ed559f5e4852bbf2379bc5f250ab'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:00.770765 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-63135211-8689-4a79-bd25-5087b4c3d46f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9e0ed559f5e4852bbf2379bc5f250ab'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:00.851576 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-63135211-8689-4a79-bd25-5087b4c3d46f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9e0ed559f5e4852bbf2379bc5f250ab'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:00.860141 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-63135211-8689-4a79-bd25-5087b4c3d46f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9e0ed559f5e4852bbf2379bc5f250ab'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:00.861335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-63135211-8689-4a79-bd25-5087b4c3d46f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9e0ed559f5e4852bbf2379bc5f250ab'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:00.868817 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1802/3609] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:21:00 2022] DELETE /identity/v3/users/e9e0ed559f5e4852bbf2379bc5f250ab => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:21:00.873319 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae966fe4-1cf0-4e57-8f5d-6778fff0500a None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:00.874165 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae966fe4-1cf0-4e57-8f5d-6778fff0500a None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:00.877327 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae966fe4-1cf0-4e57-8f5d-6778fff0500a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:00.893593 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-ae966fe4-1cf0-4e57-8f5d-6778fff0500a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:21:00.894826 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ae966fe4-1cf0-4e57-8f5d-6778fff0500a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:00.982965 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1808/3610] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:21:01.008404 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63135211-8689-4a79-bd25-5087b4c3d46f admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:01.010172 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-63135211-8689-4a79-bd25-5087b4c3d46f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:01.074963 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63135211-8689-4a79-bd25-5087b4c3d46f admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:01.079945 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b423f-8fd0-4261-bb83-b8a657f8efbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:01.080906 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b423f-8fd0-4261-bb83-b8a657f8efbb service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:01.081389 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b423f-8fd0-4261-bb83-b8a657f8efbb service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:01.081933 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b423f-8fd0-4261-bb83-b8a657f8efbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:01.092416 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b423f-8fd0-4261-bb83-b8a657f8efbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:01.094428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b423f-8fd0-4261-bb83-b8a657f8efbb service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:01.109510 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1803/3611] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:21:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:21:01.915177 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae966fe4-1cf0-4e57-8f5d-6778fff0500a None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:01.917004 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ae966fe4-1cf0-4e57-8f5d-6778fff0500a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:01.948242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae966fe4-1cf0-4e57-8f5d-6778fff0500a None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:01.963813 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56952e14-a251-4ab9-829c-8a21a16d8755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:01.964701 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56952e14-a251-4ab9-829c-8a21a16d8755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:01.964986 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56952e14-a251-4ab9-829c-8a21a16d8755 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:01.966355 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56952e14-a251-4ab9-829c-8a21a16d8755 admin admin] PATH_INFO: `/v3/projects/defac230e0c54511ace7b7a2652d9a00` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:01.966503 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56952e14-a251-4ab9-829c-8a21a16d8755 admin admin] RBAC: Authorizing `identity:delete_project(project_id=defac230e0c54511ace7b7a2652d9a00)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:01.968621 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56952e14-a251-4ab9-829c-8a21a16d8755 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:02.201542 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-56952e14-a251-4ab9-829c-8a21a16d8755 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'defac230e0c54511ace7b7a2652d9a00', 'request_id': 'req-56952e14-a251-4ab9-829c-8a21a16d8755'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:02.217120 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-56952e14-a251-4ab9-829c-8a21a16d8755 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'defac230e0c54511ace7b7a2652d9a00', 'request_id': 'req-56952e14-a251-4ab9-829c-8a21a16d8755'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:02.230803 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-56952e14-a251-4ab9-829c-8a21a16d8755 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'defac230e0c54511ace7b7a2652d9a00', 'request_id': 'req-56952e14-a251-4ab9-829c-8a21a16d8755'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:02.334714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-56952e14-a251-4ab9-829c-8a21a16d8755 admin admin] The token cache is being invalidate because project defac230e0c54511ace7b7a2652d9a00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:21:02.341520 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-56952e14-a251-4ab9-829c-8a21a16d8755 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:02.342565 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-56952e14-a251-4ab9-829c-8a21a16d8755 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:02.345171 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1809/3612] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:21:01 2022] DELETE /identity/v3/projects/defac230e0c54511ace7b7a2652d9a00 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:21:02.351699 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edd2b8-4b7a-4979-a876-56503bcbb8f2 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:02.352271 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edd2b8-4b7a-4979-a876-56503bcbb8f2 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:02.352271 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edd2b8-4b7a-4979-a876-56503bcbb8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:02.399802 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-14edd2b8-4b7a-4979-a876-56503bcbb8f2 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:21:02.401261 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-14edd2b8-4b7a-4979-a876-56503bcbb8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:02.555751 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1804/3613] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:21:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:21:02.572692 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae7a40-ade3-4fe0-aaaf-caa930f7b0bd None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:02.573089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae7a40-ade3-4fe0-aaaf-caa930f7b0bd None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:02.573380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae7a40-ade3-4fe0-aaaf-caa930f7b0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:02.607678 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-0aae7a40-ade3-4fe0-aaaf-caa930f7b0bd None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:21:02.611070 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0aae7a40-ade3-4fe0-aaaf-caa930f7b0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:02.631426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14edd2b8-4b7a-4979-a876-56503bcbb8f2 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:02.636318 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1810/3614] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:21:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:21:02.653630 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14edd2b8-4b7a-4979-a876-56503bcbb8f2 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:02.659585 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e8947-c194-42a0-80c8-c77aa8ed7422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:02.660525 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e8947-c194-42a0-80c8-c77aa8ed7422 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:02.661024 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e8947-c194-42a0-80c8-c77aa8ed7422 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:02.666279 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e8947-c194-42a0-80c8-c77aa8ed7422 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:02.666279 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e8947-c194-42a0-80c8-c77aa8ed7422 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:21:02.666279 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e8947-c194-42a0-80c8-c77aa8ed7422 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:02.666279 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e8947-c194-42a0-80c8-c77aa8ed7422 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:02.685976 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1805/3615] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:21:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:21:02.686715 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae7a40-ade3-4fe0-aaaf-caa930f7b0bd None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:02.703895 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae7a40-ade3-4fe0-aaaf-caa930f7b0bd None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:02.714235 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb63f7-459a-4dd3-98b1-768d11cbffdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:02.714235 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb63f7-459a-4dd3-98b1-768d11cbffdc admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:02.714235 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb63f7-459a-4dd3-98b1-768d11cbffdc admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:02.714235 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb63f7-459a-4dd3-98b1-768d11cbffdc admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:02.714524 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb63f7-459a-4dd3-98b1-768d11cbffdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:02.723115 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb63f7-459a-4dd3-98b1-768d11cbffdc admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:02.826443 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1811/3616] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:21:02 2022] POST /identity/v3/projects => generated 399 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:21:02.832696 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e8947-c194-42a0-80c8-c77aa8ed7422 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:02.845643 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e8947-c194-42a0-80c8-c77aa8ed7422 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:02.941573 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420d0c1-d66e-4b2d-95e5-cd2dfd9bccfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:02.942528 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420d0c1-d66e-4b2d-95e5-cd2dfd9bccfe admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:02.942956 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420d0c1-d66e-4b2d-95e5-cd2dfd9bccfe admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:02.943443 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420d0c1-d66e-4b2d-95e5-cd2dfd9bccfe admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:02.944393 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420d0c1-d66e-4b2d-95e5-cd2dfd9bccfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:02.954520 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420d0c1-d66e-4b2d-95e5-cd2dfd9bccfe admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:03.035029 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb63f7-459a-4dd3-98b1-768d11cbffdc admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:03.037052 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-13eb63f7-459a-4dd3-98b1-768d11cbffdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:03.098566 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1806/3617] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:21:02 2022] POST /identity/v3/users => generated 300 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:21:03.102930 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420d0c1-d66e-4b2d-95e5-cd2dfd9bccfe admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:03.113007 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420d0c1-d66e-4b2d-95e5-cd2dfd9bccfe admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:03.118501 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e12b6-e687-4dd1-924f-8dbea7c391bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:03.119184 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e12b6-e687-4dd1-924f-8dbea7c391bc admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:03.123097 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e12b6-e687-4dd1-924f-8dbea7c391bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:03.123097 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e12b6-e687-4dd1-924f-8dbea7c391bc admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:03.123097 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e12b6-e687-4dd1-924f-8dbea7c391bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:03.123097 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e12b6-e687-4dd1-924f-8dbea7c391bc admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:03.137163 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1807/3618] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:21:03.141654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e12b6-e687-4dd1-924f-8dbea7c391bc admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:03.161183 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e12b6-e687-4dd1-924f-8dbea7c391bc admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:03.167252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68b905-7b58-48fb-ad31-9d62a8a9385f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:03.168470 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68b905-7b58-48fb-ad31-9d62a8a9385f admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:03.169092 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68b905-7b58-48fb-ad31-9d62a8a9385f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:03.169448 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68b905-7b58-48fb-ad31-9d62a8a9385f admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:03.170296 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f68b905-7b58-48fb-ad31-9d62a8a9385f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:03.171989 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f68b905-7b58-48fb-ad31-9d62a8a9385f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:03.176530 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb63f7-459a-4dd3-98b1-768d11cbffdc admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:03.182476 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f8dac-4848-45ff-9dbe-2f0976e568ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:03.183123 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f8dac-4848-45ff-9dbe-2f0976e568ac service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:03.183406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f8dac-4848-45ff-9dbe-2f0976e568ac service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:03.183672 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f8dac-4848-45ff-9dbe-2f0976e568ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:03.184303 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1808/3619] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:21:03.185625 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6c2f8dac-4848-45ff-9dbe-2f0976e568ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:03.188644 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68b905-7b58-48fb-ad31-9d62a8a9385f admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:03.207728 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f8dac-4848-45ff-9dbe-2f0976e568ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:03.209619 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f8dac-4848-45ff-9dbe-2f0976e568ac service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:03.224175 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68b905-7b58-48fb-ad31-9d62a8a9385f admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:03.232020 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1812/3620] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:21:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:21:03.235702 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa76e4c-7313-4d8d-a2de-ca80e1a9afa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:03.236967 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa76e4c-7313-4d8d-a2de-ca80e1a9afa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:03.237395 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa76e4c-7313-4d8d-a2de-ca80e1a9afa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:03.237890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa76e4c-7313-4d8d-a2de-ca80e1a9afa7 admin admin] PATH_INFO: `/v3/projects/ba09e1b6bcaf40dd985dac3f517a6d75/users/747bf703565644ee997986445f2d233c/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:03.262733 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa76e4c-7313-4d8d-a2de-ca80e1a9afa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba09e1b6bcaf40dd985dac3f517a6d75, user_id=747bf703565644ee997986445f2d233c, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:03.268903 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa76e4c-7313-4d8d-a2de-ca80e1a9afa7 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:03.372193 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1809/3621] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:21:03 2022] PUT /identity/v3/projects/ba09e1b6bcaf40dd985dac3f517a6d75/users/747bf703565644ee997986445f2d233c/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:21:03.383231 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193cc20-4b74-4817-acce-b5f963164f05 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:03.384267 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193cc20-4b74-4817-acce-b5f963164f05 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:03.384706 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193cc20-4b74-4817-acce-b5f963164f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:03.430793 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-e193cc20-4b74-4817-acce-b5f963164f05 None None] MFA Rules not processed for user `747bf703565644ee997986445f2d233c`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:21:03.433940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e193cc20-4b74-4817-acce-b5f963164f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:03.541963 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1813/3622] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:21:03 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:21:03.553628 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa76e4c-7313-4d8d-a2de-ca80e1a9afa7 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:03.556599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4aa76e4c-7313-4d8d-a2de-ca80e1a9afa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:03.657345 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa76e4c-7313-4d8d-a2de-ca80e1a9afa7 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:03.664308 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15883b-21ed-40bb-bc97-18fe840a32e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:03.665103 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15883b-21ed-40bb-bc97-18fe840a32e1 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:03.665365 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15883b-21ed-40bb-bc97-18fe840a32e1 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:03.665705 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15883b-21ed-40bb-bc97-18fe840a32e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:03.675975 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c15883b-21ed-40bb-bc97-18fe840a32e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:03.679950 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c15883b-21ed-40bb-bc97-18fe840a32e1 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:03.692999 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1810/3623] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:21:03 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:21:03.734410 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193cc20-4b74-4817-acce-b5f963164f05 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:03.840134 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15883b-21ed-40bb-bc97-18fe840a32e1 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:03.841620 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2c15883b-21ed-40bb-bc97-18fe840a32e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:03.910534 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193cc20-4b74-4817-acce-b5f963164f05 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:03.925390 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78168518-8552-41c6-9ee2-e4c0c8eb7c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:03.928156 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78168518-8552-41c6-9ee2-e4c0c8eb7c92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:03.928729 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78168518-8552-41c6-9ee2-e4c0c8eb7c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:03.929186 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78168518-8552-41c6-9ee2-e4c0c8eb7c92 admin admin] PATH_INFO: `/v3/users/747bf703565644ee997986445f2d233c` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:03.931547 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78168518-8552-41c6-9ee2-e4c0c8eb7c92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=747bf703565644ee997986445f2d233c)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:03.933648 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78168518-8552-41c6-9ee2-e4c0c8eb7c92 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:03.947931 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15883b-21ed-40bb-bc97-18fe840a32e1 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:03.983453 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855c26a-77b1-47a4-ad8d-96d4f9c341e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:03.984498 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855c26a-77b1-47a4-ad8d-96d4f9c341e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:03.985012 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855c26a-77b1-47a4-ad8d-96d4f9c341e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:03.985713 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855c26a-77b1-47a4-ad8d-96d4f9c341e0 admin admin] PATH_INFO: `/v3/users/a75959d37cbf4c9b8482e480a0888246` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:03.995938 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3855c26a-77b1-47a4-ad8d-96d4f9c341e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a75959d37cbf4c9b8482e480a0888246)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:03.998112 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3855c26a-77b1-47a4-ad8d-96d4f9c341e0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:04.226931 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-78168518-8552-41c6-9ee2-e4c0c8eb7c92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '747bf703565644ee997986445f2d233c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:04.254943 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-78168518-8552-41c6-9ee2-e4c0c8eb7c92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '747bf703565644ee997986445f2d233c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:04.324675 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3855c26a-77b1-47a4-ad8d-96d4f9c341e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a75959d37cbf4c9b8482e480a0888246'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:04.346462 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3855c26a-77b1-47a4-ad8d-96d4f9c341e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a75959d37cbf4c9b8482e480a0888246'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:04.377712 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-78168518-8552-41c6-9ee2-e4c0c8eb7c92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '747bf703565644ee997986445f2d233c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:04.378633 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-78168518-8552-41c6-9ee2-e4c0c8eb7c92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '747bf703565644ee997986445f2d233c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:04.387457 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-78168518-8552-41c6-9ee2-e4c0c8eb7c92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '747bf703565644ee997986445f2d233c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:04.398411 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1814/3624] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:21:03 2022] DELETE /identity/v3/users/747bf703565644ee997986445f2d233c => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:21:04.400109 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0bae4b-8a28-4923-838e-49eff9a67edd None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:04.400571 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0bae4b-8a28-4923-838e-49eff9a67edd None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:04.400998 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0bae4b-8a28-4923-838e-49eff9a67edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:04.424833 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-1d0bae4b-8a28-4923-838e-49eff9a67edd None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:21:04.426137 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1d0bae4b-8a28-4923-838e-49eff9a67edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:04.457385 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3855c26a-77b1-47a4-ad8d-96d4f9c341e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a75959d37cbf4c9b8482e480a0888246'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:04.471090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3855c26a-77b1-47a4-ad8d-96d4f9c341e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a75959d37cbf4c9b8482e480a0888246'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:04.472863 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3855c26a-77b1-47a4-ad8d-96d4f9c341e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a75959d37cbf4c9b8482e480a0888246'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:04.485088 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1811/3625] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:21:03 2022] DELETE /identity/v3/users/a75959d37cbf4c9b8482e480a0888246 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:21:04.548460 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1815/3626] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:21:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:21:04.565601 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855c26a-77b1-47a4-ad8d-96d4f9c341e0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:04.568097 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3855c26a-77b1-47a4-ad8d-96d4f9c341e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:04.660689 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855c26a-77b1-47a4-ad8d-96d4f9c341e0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:04.673925 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350a8e1-ffa6-47e2-895d-cf19e31e73b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:04.674904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350a8e1-ffa6-47e2-895d-cf19e31e73b6 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:04.675201 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350a8e1-ffa6-47e2-895d-cf19e31e73b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:04.675489 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350a8e1-ffa6-47e2-895d-cf19e31e73b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:04.800187 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0350a8e1-ffa6-47e2-895d-cf19e31e73b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:04.801597 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0350a8e1-ffa6-47e2-895d-cf19e31e73b6 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:04.832649 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1812/3627] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:21:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:21:05.487263 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0bae4b-8a28-4923-838e-49eff9a67edd None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:05.490560 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1d0bae4b-8a28-4923-838e-49eff9a67edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:05.504797 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0bae4b-8a28-4923-838e-49eff9a67edd None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:05.510716 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf66393-98df-4a40-850d-8c2de692c9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:05.511887 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf66393-98df-4a40-850d-8c2de692c9a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:05.512490 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf66393-98df-4a40-850d-8c2de692c9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:05.512969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf66393-98df-4a40-850d-8c2de692c9a3 admin admin] PATH_INFO: `/v3/projects/6cebc4a4f75349b09fd03f67d0207875` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:05.514414 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf66393-98df-4a40-850d-8c2de692c9a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cebc4a4f75349b09fd03f67d0207875)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:05.516673 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf66393-98df-4a40-850d-8c2de692c9a3 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:05.638496 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-edf66393-98df-4a40-850d-8c2de692c9a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cebc4a4f75349b09fd03f67d0207875', 'request_id': 'req-edf66393-98df-4a40-850d-8c2de692c9a3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:05.647337 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-edf66393-98df-4a40-850d-8c2de692c9a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cebc4a4f75349b09fd03f67d0207875', 'request_id': 'req-edf66393-98df-4a40-850d-8c2de692c9a3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:05.653677 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-edf66393-98df-4a40-850d-8c2de692c9a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cebc4a4f75349b09fd03f67d0207875', 'request_id': 'req-edf66393-98df-4a40-850d-8c2de692c9a3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:05.743545 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-edf66393-98df-4a40-850d-8c2de692c9a3 admin admin] The token cache is being invalidate because project 6cebc4a4f75349b09fd03f67d0207875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:21:05.746090 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-edf66393-98df-4a40-850d-8c2de692c9a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:05.748815 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-edf66393-98df-4a40-850d-8c2de692c9a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:05.761314 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1816/3628] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:21:05 2022] DELETE /identity/v3/projects/6cebc4a4f75349b09fd03f67d0207875 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:21:05.762713 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd7a55-9d50-403f-a94f-cce1de7ca77b None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:05.763185 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd7a55-9d50-403f-a94f-cce1de7ca77b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:05.763310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd7a55-9d50-403f-a94f-cce1de7ca77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:05.795595 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-18bd7a55-9d50-403f-a94f-cce1de7ca77b None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:21:05.800059 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-18bd7a55-9d50-403f-a94f-cce1de7ca77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:05.894796 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1813/3629] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:21:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:21:05.907992 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68d214-f09e-4f10-85d2-521452c6ac5b None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:05.908282 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68d214-f09e-4f10-85d2-521452c6ac5b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:05.908564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68d214-f09e-4f10-85d2-521452c6ac5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:05.936924 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-5c68d214-f09e-4f10-85d2-521452c6ac5b None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:21:05.938654 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5c68d214-f09e-4f10-85d2-521452c6ac5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:05.947070 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1817/3630] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:21:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:21:05.951548 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd7a55-9d50-403f-a94f-cce1de7ca77b None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:05.968767 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd7a55-9d50-403f-a94f-cce1de7ca77b None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:06.008333 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54fe8f-3310-436a-9369-d8fe1915bc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:06.009025 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54fe8f-3310-436a-9369-d8fe1915bc22 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:06.009310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54fe8f-3310-436a-9369-d8fe1915bc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:06.009585 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54fe8f-3310-436a-9369-d8fe1915bc22 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:06.014263 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54fe8f-3310-436a-9369-d8fe1915bc22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:21:06.014263 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54fe8f-3310-436a-9369-d8fe1915bc22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:06.014263 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54fe8f-3310-436a-9369-d8fe1915bc22 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:06.044128 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1814/3631] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:21:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:21:06.045018 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68d214-f09e-4f10-85d2-521452c6ac5b None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:06.061946 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68d214-f09e-4f10-85d2-521452c6ac5b None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:06.082572 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54fe8f-3310-436a-9369-d8fe1915bc22 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:06.084254 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56313b-50fd-49dd-a9c6-d00afe2420c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:06.085809 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56313b-50fd-49dd-a9c6-d00afe2420c2 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:06.086791 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56313b-50fd-49dd-a9c6-d00afe2420c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:06.087227 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56313b-50fd-49dd-a9c6-d00afe2420c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:06.088117 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6b54fe8f-3310-436a-9369-d8fe1915bc22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:06.088246 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56313b-50fd-49dd-a9c6-d00afe2420c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:06.095370 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56313b-50fd-49dd-a9c6-d00afe2420c2 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:06.122150 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54fe8f-3310-436a-9369-d8fe1915bc22 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:06.144052 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817eab99-ca55-40be-b0e8-2b42371c7717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:06.145790 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817eab99-ca55-40be-b0e8-2b42371c7717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:06.146186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817eab99-ca55-40be-b0e8-2b42371c7717 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:06.146699 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817eab99-ca55-40be-b0e8-2b42371c7717 admin admin] PATH_INFO: `/v3/projects/ba09e1b6bcaf40dd985dac3f517a6d75` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:06.149642 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817eab99-ca55-40be-b0e8-2b42371c7717 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba09e1b6bcaf40dd985dac3f517a6d75)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:06.152281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817eab99-ca55-40be-b0e8-2b42371c7717 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:06.234325 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1818/3632] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:21:06 2022] POST /identity/v3/projects => generated 373 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:21:06.238754 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56313b-50fd-49dd-a9c6-d00afe2420c2 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:06.310649 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-817eab99-ca55-40be-b0e8-2b42371c7717 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba09e1b6bcaf40dd985dac3f517a6d75', 'request_id': 'req-817eab99-ca55-40be-b0e8-2b42371c7717'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:06.324909 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-817eab99-ca55-40be-b0e8-2b42371c7717 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba09e1b6bcaf40dd985dac3f517a6d75', 'request_id': 'req-817eab99-ca55-40be-b0e8-2b42371c7717'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:06.341641 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-817eab99-ca55-40be-b0e8-2b42371c7717 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba09e1b6bcaf40dd985dac3f517a6d75', 'request_id': 'req-817eab99-ca55-40be-b0e8-2b42371c7717'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:06.409935 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56313b-50fd-49dd-a9c6-d00afe2420c2 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:06.490995 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-817eab99-ca55-40be-b0e8-2b42371c7717 admin admin] The token cache is being invalidate because project ba09e1b6bcaf40dd985dac3f517a6d75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:21:06.491332 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-817eab99-ca55-40be-b0e8-2b42371c7717 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:06.491963 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-817eab99-ca55-40be-b0e8-2b42371c7717 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:06.496137 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1815/3633] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:21:06 2022] DELETE /identity/v3/projects/ba09e1b6bcaf40dd985dac3f517a6d75 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:21:06.505914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181cd77-0648-4c95-8506-65670ae132ac None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:06.505914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181cd77-0648-4c95-8506-65670ae132ac None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:06.505914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181cd77-0648-4c95-8506-65670ae132ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:06.520581 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3a881-508b-4eb2-b09c-f1b8ffb716e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:06.521341 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3a881-508b-4eb2-b09c-f1b8ffb716e7 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:06.521639 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3a881-508b-4eb2-b09c-f1b8ffb716e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:06.521950 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3a881-508b-4eb2-b09c-f1b8ffb716e7 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:06.523481 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3a881-508b-4eb2-b09c-f1b8ffb716e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:06.525665 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3a881-508b-4eb2-b09c-f1b8ffb716e7 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:06.562303 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-e181cd77-0648-4c95-8506-65670ae132ac None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:21:06.563763 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e181cd77-0648-4c95-8506-65670ae132ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:06.584323 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1816/3634] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:21:06.599993 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2cb14-0bb2-4b49-93e1-416ee7858bd5 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:06.599993 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2cb14-0bb2-4b49-93e1-416ee7858bd5 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:06.600271 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2cb14-0bb2-4b49-93e1-416ee7858bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:06.645516 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1819/3635] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:21:06 2022] POST /identity/v3/users => generated 287 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:21:06.647521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-bfc2cb14-0bb2-4b49-93e1-416ee7858bd5 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:21:06.649949 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3a881-508b-4eb2-b09c-f1b8ffb716e7 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:06.654617 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-67d3a881-508b-4eb2-b09c-f1b8ffb716e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:06.657074 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-bfc2cb14-0bb2-4b49-93e1-416ee7858bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:06.701088 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1817/3636] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:21:06.704929 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3a881-508b-4eb2-b09c-f1b8ffb716e7 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:06.706215 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2cb14-0bb2-4b49-93e1-416ee7858bd5 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:06.717515 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b49fc-d30a-4d5d-9f3f-a7daf40b88f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:06.720017 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b49fc-d30a-4d5d-9f3f-a7daf40b88f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:06.720730 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b49fc-d30a-4d5d-9f3f-a7daf40b88f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:06.721330 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b49fc-d30a-4d5d-9f3f-a7daf40b88f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:06.723380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b49fc-d30a-4d5d-9f3f-a7daf40b88f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:06.725097 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b49fc-d30a-4d5d-9f3f-a7daf40b88f4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:06.733537 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2cb14-0bb2-4b49-93e1-416ee7858bd5 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:06.750437 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c4f20a-fa07-42ef-81d0-1dced9545628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:06.751203 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1820/3637] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:21:06.751598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4f20a-fa07-42ef-81d0-1dced9545628 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:06.752087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4f20a-fa07-42ef-81d0-1dced9545628 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:06.752533 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4f20a-fa07-42ef-81d0-1dced9545628 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:06.753454 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c4f20a-fa07-42ef-81d0-1dced9545628 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:21:06.756986 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b49fc-d30a-4d5d-9f3f-a7daf40b88f4 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:06.760483 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c4f20a-fa07-42ef-81d0-1dced9545628 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:06.767439 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c4f20a-fa07-42ef-81d0-1dced9545628 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:06.773962 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b49fc-d30a-4d5d-9f3f-a7daf40b88f4 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:06.781783 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19faad-92bc-40ce-8112-8db792fc43d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:06.782581 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19faad-92bc-40ce-8112-8db792fc43d0 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:06.782930 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19faad-92bc-40ce-8112-8db792fc43d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:06.783603 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a19faad-92bc-40ce-8112-8db792fc43d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:06.784866 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a19faad-92bc-40ce-8112-8db792fc43d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:06.786622 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a19faad-92bc-40ce-8112-8db792fc43d0 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:06.803240 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1818/3638] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:21:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:21:06.806404 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1821/3639] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:21:06.807356 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19faad-92bc-40ce-8112-8db792fc43d0 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:06.807486 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c4f20a-fa07-42ef-81d0-1dced9545628 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:06.819836 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a19faad-92bc-40ce-8112-8db792fc43d0 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:06.829781 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d2907-1970-432f-8889-6a1427f5bbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:06.830922 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d2907-1970-432f-8889-6a1427f5bbf6 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:06.831203 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d2907-1970-432f-8889-6a1427f5bbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:06.831559 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d2907-1970-432f-8889-6a1427f5bbf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:06.833972 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d2907-1970-432f-8889-6a1427f5bbf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:06.836115 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d2907-1970-432f-8889-6a1427f5bbf6 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:06.839899 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c4f20a-fa07-42ef-81d0-1dced9545628 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:06.850027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d96ff-4b8d-4b37-85ee-8f4bb2222817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:06.855105 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d96ff-4b8d-4b37-85ee-8f4bb2222817 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:06.857084 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d96ff-4b8d-4b37-85ee-8f4bb2222817 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:06.857528 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d96ff-4b8d-4b37-85ee-8f4bb2222817 admin admin] PATH_INFO: `/v3/projects/99a37bca62d74ef594bfc452d211135d/users/b92faac66cd946faaaee4bd6a816451b/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:06.895165 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d96ff-4b8d-4b37-85ee-8f4bb2222817 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99a37bca62d74ef594bfc452d211135d, user_id=b92faac66cd946faaaee4bd6a816451b, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:06.900069 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d96ff-4b8d-4b37-85ee-8f4bb2222817 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:06.951661 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1822/3640] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:21:06 2022] POST /identity/v3/projects => generated 379 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:21:06.955909 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d2907-1970-432f-8889-6a1427f5bbf6 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:06.998056 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1819/3641] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:21:06 2022] PUT /identity/v3/projects/99a37bca62d74ef594bfc452d211135d/users/b92faac66cd946faaaee4bd6a816451b/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:21:07.008343 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85239e4e-83d5-4ba1-96c2-ed87ff273df0 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:07.009032 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85239e4e-83d5-4ba1-96c2-ed87ff273df0 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:07.010367 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85239e4e-83d5-4ba1-96c2-ed87ff273df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:07.088022 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-85239e4e-83d5-4ba1-96c2-ed87ff273df0 None None] MFA Rules not processed for user `b92faac66cd946faaaee4bd6a816451b`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:21:07.089513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-85239e4e-83d5-4ba1-96c2-ed87ff273df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:07.128678 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d2907-1970-432f-8889-6a1427f5bbf6 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:07.247346 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1820/3642] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:21:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:21:07.254742 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39491a6d-90a2-438f-92d2-61a1ffe0bf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:07.256430 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39491a6d-90a2-438f-92d2-61a1ffe0bf49 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:07.261317 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39491a6d-90a2-438f-92d2-61a1ffe0bf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:07.261317 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39491a6d-90a2-438f-92d2-61a1ffe0bf49 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:07.261317 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39491a6d-90a2-438f-92d2-61a1ffe0bf49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:07.261603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85239e4e-83d5-4ba1-96c2-ed87ff273df0 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:07.262689 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-85239e4e-83d5-4ba1-96c2-ed87ff273df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:07.270217 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39491a6d-90a2-438f-92d2-61a1ffe0bf49 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:07.395047 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85239e4e-83d5-4ba1-96c2-ed87ff273df0 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:07.401019 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ddf2b-f7dc-485c-8640-ff0debfede6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:07.401743 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ddf2b-f7dc-485c-8640-ff0debfede6f service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:07.402085 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ddf2b-f7dc-485c-8640-ff0debfede6f service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:07.402459 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ddf2b-f7dc-485c-8640-ff0debfede6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:07.410133 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1823/3643] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:21:06 2022] POST /identity/v3/users => generated 290 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:21:07.411049 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39491a6d-90a2-438f-92d2-61a1ffe0bf49 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:07.411666 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ddf2b-f7dc-485c-8640-ff0debfede6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:07.413976 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ddf2b-f7dc-485c-8640-ff0debfede6f service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:07.423651 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1821/3644] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:21:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:21:07.430676 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39491a6d-90a2-438f-92d2-61a1ffe0bf49 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:07.448521 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403c6f3-7199-4f47-a445-5ce5b50f87c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:07.449202 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403c6f3-7199-4f47-a445-5ce5b50f87c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:07.449651 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403c6f3-7199-4f47-a445-5ce5b50f87c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:07.450527 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403c6f3-7199-4f47-a445-5ce5b50f87c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:07.451539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8403c6f3-7199-4f47-a445-5ce5b50f87c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:07.453875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8403c6f3-7199-4f47-a445-5ce5b50f87c5 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:07.479490 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1824/3645] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:21:07.479756 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ddf2b-f7dc-485c-8640-ff0debfede6f service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:07.524171 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ddf2b-f7dc-485c-8640-ff0debfede6f service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:07.540494 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42059a-bfb1-427d-abfa-c93e85444715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:07.542106 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42059a-bfb1-427d-abfa-c93e85444715 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:07.542400 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42059a-bfb1-427d-abfa-c93e85444715 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:07.542680 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42059a-bfb1-427d-abfa-c93e85444715 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:07.546911 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42059a-bfb1-427d-abfa-c93e85444715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:07.549430 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42059a-bfb1-427d-abfa-c93e85444715 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:07.574045 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1822/3646] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:21:07.578403 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403c6f3-7199-4f47-a445-5ce5b50f87c5 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:07.607448 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403c6f3-7199-4f47-a445-5ce5b50f87c5 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:07.645342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f32642-a8b6-428a-adbe-3baec0a2c052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:07.646375 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f32642-a8b6-428a-adbe-3baec0a2c052 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:07.651089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f32642-a8b6-428a-adbe-3baec0a2c052 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:07.651089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f32642-a8b6-428a-adbe-3baec0a2c052 admin admin] PATH_INFO: `/v3/projects/8b8ae5530f6847478106f78f50e7314d/users/02b78cd5fee5448b9e42dbb212f0de19/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:07.700391 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42059a-bfb1-427d-abfa-c93e85444715 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:07.709098 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f32642-a8b6-428a-adbe-3baec0a2c052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b8ae5530f6847478106f78f50e7314d, user_id=02b78cd5fee5448b9e42dbb212f0de19, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:07.714725 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f32642-a8b6-428a-adbe-3baec0a2c052 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:07.721804 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42059a-bfb1-427d-abfa-c93e85444715 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:07.731805 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec886f-31d9-45de-b683-e9a8a9f42907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:07.733158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec886f-31d9-45de-b683-e9a8a9f42907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:07.733603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec886f-31d9-45de-b683-e9a8a9f42907 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:07.734384 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec886f-31d9-45de-b683-e9a8a9f42907 admin admin] PATH_INFO: `/v3/users/b92faac66cd946faaaee4bd6a816451b` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:07.741876 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ec886f-31d9-45de-b683-e9a8a9f42907 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b92faac66cd946faaaee4bd6a816451b)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:07.741876 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ec886f-31d9-45de-b683-e9a8a9f42907 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:07.806126 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1825/3647] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:21:07 2022] PUT /identity/v3/projects/8b8ae5530f6847478106f78f50e7314d/users/02b78cd5fee5448b9e42dbb212f0de19/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:21:07.807860 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660ac6c-8f29-44de-968e-d8ce2c7badd3 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:07.808399 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660ac6c-8f29-44de-968e-d8ce2c7badd3 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:07.808892 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660ac6c-8f29-44de-968e-d8ce2c7badd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:07.857245 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-0660ac6c-8f29-44de-968e-d8ce2c7badd3 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:21:07.858611 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0660ac6c-8f29-44de-968e-d8ce2c7badd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:07.995630 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1826/3648] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:21:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:21:08.030116 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-55ec886f-31d9-45de-b683-e9a8a9f42907 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b92faac66cd946faaaee4bd6a816451b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:08.030623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660ac6c-8f29-44de-968e-d8ce2c7badd3 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:08.030623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0660ac6c-8f29-44de-968e-d8ce2c7badd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:08.066690 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-55ec886f-31d9-45de-b683-e9a8a9f42907 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b92faac66cd946faaaee4bd6a816451b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:08.159548 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-55ec886f-31d9-45de-b683-e9a8a9f42907 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b92faac66cd946faaaee4bd6a816451b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:08.169601 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-55ec886f-31d9-45de-b683-e9a8a9f42907 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b92faac66cd946faaaee4bd6a816451b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:08.170449 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-55ec886f-31d9-45de-b683-e9a8a9f42907 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b92faac66cd946faaaee4bd6a816451b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:08.182357 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1823/3649] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:21:07 2022] DELETE /identity/v3/users/b92faac66cd946faaaee4bd6a816451b => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:21:08.191780 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd70fc-7557-49ab-9f41-6e394f0c622d None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:08.192073 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd70fc-7557-49ab-9f41-6e394f0c622d None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:08.192356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd70fc-7557-49ab-9f41-6e394f0c622d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:08.192930 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660ac6c-8f29-44de-968e-d8ce2c7badd3 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:08.236434 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-85dd70fc-7557-49ab-9f41-6e394f0c622d None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:21:08.238900 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-85dd70fc-7557-49ab-9f41-6e394f0c622d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:08.322905 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6efa83-28c0-420b-ac2f-13e6b96c9e39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:08.323580 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6efa83-28c0-420b-ac2f-13e6b96c9e39 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:08.323864 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6efa83-28c0-420b-ac2f-13e6b96c9e39 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:08.324158 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6efa83-28c0-420b-ac2f-13e6b96c9e39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:08.331427 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-fd6efa83-28c0-420b-ac2f-13e6b96c9e39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:08.395996 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1824/3650] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:21:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:21:08.407232 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd70fc-7557-49ab-9f41-6e394f0c622d None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:08.410064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-85dd70fc-7557-49ab-9f41-6e394f0c622d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:08.436909 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd70fc-7557-49ab-9f41-6e394f0c622d None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:08.443393 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db6f42-bce5-43cf-943e-cefb4c509d7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:08.444875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db6f42-bce5-43cf-943e-cefb4c509d7f service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:08.445235 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db6f42-bce5-43cf-943e-cefb4c509d7f service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:08.445743 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db6f42-bce5-43cf-943e-cefb4c509d7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:08.458045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6db6f42-bce5-43cf-943e-cefb4c509d7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:08.459665 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6db6f42-bce5-43cf-943e-cefb4c509d7f service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:08.470089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6efa83-28c0-420b-ac2f-13e6b96c9e39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:08.471584 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6efa83-28c0-420b-ac2f-13e6b96c9e39 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:08.476258 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1825/3651] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:21:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:21:08.490134 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1827/3652] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:21:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:21:10.048687 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db6f42-bce5-43cf-943e-cefb4c509d7f service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:10.050278 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f6db6f42-bce5-43cf-943e-cefb4c509d7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:10.073487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db6f42-bce5-43cf-943e-cefb4c509d7f service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:10.090196 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ec888-877e-4cfc-9996-35f464d5e847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:10.091090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ec888-877e-4cfc-9996-35f464d5e847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:10.091374 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ec888-877e-4cfc-9996-35f464d5e847 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:10.092142 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ec888-877e-4cfc-9996-35f464d5e847 admin admin] PATH_INFO: `/v3/projects/99a37bca62d74ef594bfc452d211135d` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:10.094564 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ec888-877e-4cfc-9996-35f464d5e847 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99a37bca62d74ef594bfc452d211135d)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:10.096740 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ec888-877e-4cfc-9996-35f464d5e847 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:10.327799 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8b2ec888-877e-4cfc-9996-35f464d5e847 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99a37bca62d74ef594bfc452d211135d', 'request_id': 'req-8b2ec888-877e-4cfc-9996-35f464d5e847'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:10.337367 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8b2ec888-877e-4cfc-9996-35f464d5e847 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99a37bca62d74ef594bfc452d211135d', 'request_id': 'req-8b2ec888-877e-4cfc-9996-35f464d5e847'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:10.348413 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8b2ec888-877e-4cfc-9996-35f464d5e847 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99a37bca62d74ef594bfc452d211135d', 'request_id': 'req-8b2ec888-877e-4cfc-9996-35f464d5e847'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:10.379029 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa76c67-0bbf-48ca-98e5-773b08147c20 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:10.379587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa76c67-0bbf-48ca-98e5-773b08147c20 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:10.379587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa76c67-0bbf-48ca-98e5-773b08147c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:10.408256 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-4aa76c67-0bbf-48ca-98e5-773b08147c20 None None] MFA Rules not processed for user `65bedbcb4d094160a9a9fc3b6ba6f603`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:21:10.409472 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4aa76c67-0bbf-48ca-98e5-773b08147c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:10.439169 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8b2ec888-877e-4cfc-9996-35f464d5e847 admin admin] The token cache is being invalidate because project 99a37bca62d74ef594bfc452d211135d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:21:10.439957 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8b2ec888-877e-4cfc-9996-35f464d5e847 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:10.440916 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8b2ec888-877e-4cfc-9996-35f464d5e847 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:10.444884 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1826/3653] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:21:10 2022] DELETE /identity/v3/projects/99a37bca62d74ef594bfc452d211135d => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:21:10.452091 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7242b-0fc3-4c54-b904-afad84311b6f None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:10.453021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7242b-0fc3-4c54-b904-afad84311b6f None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:10.453508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7242b-0fc3-4c54-b904-afad84311b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:10.503534 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-e6c7242b-0fc3-4c54-b904-afad84311b6f None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:21:10.504867 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e6c7242b-0fc3-4c54-b904-afad84311b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:10.526610 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1828/3654] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:21:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:21:10.534543 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa76c67-0bbf-48ca-98e5-773b08147c20 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:10.536173 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4aa76c67-0bbf-48ca-98e5-773b08147c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:10.639676 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1827/3655] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:21:10.641191 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e8814-5b45-4c96-9fb4-14c88a478062 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:10.641623 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e8814-5b45-4c96-9fb4-14c88a478062 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:10.641931 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e8814-5b45-4c96-9fb4-14c88a478062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:10.668630 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-8a7e8814-5b45-4c96-9fb4-14c88a478062 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:21:10.670172 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8a7e8814-5b45-4c96-9fb4-14c88a478062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:10.671988 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa76c67-0bbf-48ca-98e5-773b08147c20 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:10.684048 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1828/3656] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:21:10.685197 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e8814-5b45-4c96-9fb4-14c88a478062 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:10.686470 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1df494-e0ce-42ab-a016-1d87c858cbf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:10.687668 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1df494-e0ce-42ab-a016-1d87c858cbf2 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:10.688198 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1df494-e0ce-42ab-a016-1d87c858cbf2 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:10.690558 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1df494-e0ce-42ab-a016-1d87c858cbf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:10.700188 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e8814-5b45-4c96-9fb4-14c88a478062 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:10.705326 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd6d60d-1d4e-4de5-8c3e-488ae864f62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:10.706248 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6d60d-1d4e-4de5-8c3e-488ae864f62d admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:10.706709 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6d60d-1d4e-4de5-8c3e-488ae864f62d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:10.707210 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6d60d-1d4e-4de5-8c3e-488ae864f62d admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:10.708374 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd6d60d-1d4e-4de5-8c3e-488ae864f62d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:21:10.709432 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd6d60d-1d4e-4de5-8c3e-488ae864f62d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:10.711877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd6d60d-1d4e-4de5-8c3e-488ae864f62d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:10.712891 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1df494-e0ce-42ab-a016-1d87c858cbf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:10.714934 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1df494-e0ce-42ab-a016-1d87c858cbf2 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:10.728003 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1829/3657] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:21:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:21:10.729904 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1829/3658] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:21:10 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:21:10.732473 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1df494-e0ce-42ab-a016-1d87c858cbf2 service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:10.749276 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1df494-e0ce-42ab-a016-1d87c858cbf2 service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:10.756304 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415b22d-c138-4d98-983a-5d7c7bc25021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:10.758190 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415b22d-c138-4d98-983a-5d7c7bc25021 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:10.759084 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415b22d-c138-4d98-983a-5d7c7bc25021 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:10.759604 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415b22d-c138-4d98-983a-5d7c7bc25021 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:10.761403 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415b22d-c138-4d98-983a-5d7c7bc25021 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:10.771476 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415b22d-c138-4d98-983a-5d7c7bc25021 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:10.856463 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1830/3659] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:21:10 2022] POST /identity/v3/projects => generated 359 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:21:10.860278 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd6d60d-1d4e-4de5-8c3e-488ae864f62d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:10.888918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd6d60d-1d4e-4de5-8c3e-488ae864f62d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:11.058170 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3d689-7486-454a-bb99-eaa3b54b6ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:11.059001 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3d689-7486-454a-bb99-eaa3b54b6ece admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:11.059458 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3d689-7486-454a-bb99-eaa3b54b6ece admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:11.059990 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3d689-7486-454a-bb99-eaa3b54b6ece admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:11.061076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b3d689-7486-454a-bb99-eaa3b54b6ece admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:11.065212 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b3d689-7486-454a-bb99-eaa3b54b6ece admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:11.168733 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1830/3660] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:21:10 2022] POST /identity/v3/users => generated 280 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:21:11.172900 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415b22d-c138-4d98-983a-5d7c7bc25021 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:11.185809 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415b22d-c138-4d98-983a-5d7c7bc25021 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:11.190689 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87a6af-e5b3-4ab9-99f0-7fa08cde69c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:11.191466 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87a6af-e5b3-4ab9-99f0-7fa08cde69c8 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:11.191821 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87a6af-e5b3-4ab9-99f0-7fa08cde69c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:11.192219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87a6af-e5b3-4ab9-99f0-7fa08cde69c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:11.193015 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e87a6af-e5b3-4ab9-99f0-7fa08cde69c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:11.194826 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e87a6af-e5b3-4ab9-99f0-7fa08cde69c8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:11.208427 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1831/3661] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:21:11.214900 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3d689-7486-454a-bb99-eaa3b54b6ece admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:11.242759 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3d689-7486-454a-bb99-eaa3b54b6ece admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:11.252445 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad007b4-67f5-4ce2-a34d-69e117bb3837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:11.253600 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad007b4-67f5-4ce2-a34d-69e117bb3837 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:11.254537 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad007b4-67f5-4ce2-a34d-69e117bb3837 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:11.255424 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad007b4-67f5-4ce2-a34d-69e117bb3837 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:11.256583 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad007b4-67f5-4ce2-a34d-69e117bb3837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:11.259408 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad007b4-67f5-4ce2-a34d-69e117bb3837 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:11.281862 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1831/3662] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:21:11.282586 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87a6af-e5b3-4ab9-99f0-7fa08cde69c8 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:11.301105 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87a6af-e5b3-4ab9-99f0-7fa08cde69c8 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:11.315428 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38351f-7ffc-4dea-9311-ba76a507ab9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:11.316330 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38351f-7ffc-4dea-9311-ba76a507ab9d admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:11.316612 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38351f-7ffc-4dea-9311-ba76a507ab9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:11.316987 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38351f-7ffc-4dea-9311-ba76a507ab9d admin admin] PATH_INFO: `/v3/projects/c9673e6cef5e44a39d1f3cfdfdda63c5/users/bd649bcca73d45cea6526857c8b5116a/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:11.348058 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38351f-7ffc-4dea-9311-ba76a507ab9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9673e6cef5e44a39d1f3cfdfdda63c5, user_id=bd649bcca73d45cea6526857c8b5116a, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:11.351947 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38351f-7ffc-4dea-9311-ba76a507ab9d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:11.474694 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1832/3663] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:21:11 2022] PUT /identity/v3/projects/c9673e6cef5e44a39d1f3cfdfdda63c5/users/bd649bcca73d45cea6526857c8b5116a/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:21:11.488123 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08fa80-726e-470d-8862-470550d7b52e None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:11.488425 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08fa80-726e-470d-8862-470550d7b52e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:11.488685 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08fa80-726e-470d-8862-470550d7b52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:11.551561 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-8e08fa80-726e-470d-8862-470550d7b52e None None] MFA Rules not processed for user `bd649bcca73d45cea6526857c8b5116a`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:21:11.553104 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8e08fa80-726e-470d-8862-470550d7b52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:11.723337 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1832/3664] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:21:11 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:21:11.863390 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38351f-7ffc-4dea-9311-ba76a507ab9d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:11.866049 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4e38351f-7ffc-4dea-9311-ba76a507ab9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:12.073216 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38351f-7ffc-4dea-9311-ba76a507ab9d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:12.087023 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fcf3cf-fcdc-484e-83c1-b09a095ea02c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:12.087703 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcf3cf-fcdc-484e-83c1-b09a095ea02c service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:12.087988 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcf3cf-fcdc-484e-83c1-b09a095ea02c service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:12.088261 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcf3cf-fcdc-484e-83c1-b09a095ea02c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:12.110757 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fcf3cf-fcdc-484e-83c1-b09a095ea02c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:12.115103 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fcf3cf-fcdc-484e-83c1-b09a095ea02c service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:12.130290 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1833/3665] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:21:11 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:21:12.191406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08fa80-726e-470d-8862-470550d7b52e None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:12.211407 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bda1b-667c-47d6-a4b0-168a3041bbec None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:12.211948 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bda1b-667c-47d6-a4b0-168a3041bbec None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:12.212368 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bda1b-667c-47d6-a4b0-168a3041bbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:12.281732 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-261bda1b-667c-47d6-a4b0-168a3041bbec None None] MFA Rules not processed for user `02b78cd5fee5448b9e42dbb212f0de19`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:21:12.288683 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-261bda1b-667c-47d6-a4b0-168a3041bbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:12.305472 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08fa80-726e-470d-8862-470550d7b52e None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:12.310937 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db510a-28b9-497c-9488-68f24c2a5709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:12.312058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db510a-28b9-497c-9488-68f24c2a5709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:12.312550 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db510a-28b9-497c-9488-68f24c2a5709 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:12.312995 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db510a-28b9-497c-9488-68f24c2a5709 admin admin] PATH_INFO: `/v3/users/bd649bcca73d45cea6526857c8b5116a` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:12.314712 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db510a-28b9-497c-9488-68f24c2a5709 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd649bcca73d45cea6526857c8b5116a)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:12.317016 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db510a-28b9-497c-9488-68f24c2a5709 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:12.483963 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1834/3666] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:21:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:21:12.497068 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261bda1b-667c-47d6-a4b0-168a3041bbec None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:12.513380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261bda1b-667c-47d6-a4b0-168a3041bbec None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:12.529813 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e0264-09ef-4787-acc3-37d27508bcaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:12.530480 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e0264-09ef-4787-acc3-37d27508bcaf service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:12.530769 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e0264-09ef-4787-acc3-37d27508bcaf service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:12.531672 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e0264-09ef-4787-acc3-37d27508bcaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:12.542315 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e0264-09ef-4787-acc3-37d27508bcaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:12.544250 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e0264-09ef-4787-acc3-37d27508bcaf service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:12.571709 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-02db510a-28b9-497c-9488-68f24c2a5709 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd649bcca73d45cea6526857c8b5116a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:12.582462 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1835/3667] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:21:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:21:12.626081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-02db510a-28b9-497c-9488-68f24c2a5709 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd649bcca73d45cea6526857c8b5116a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:12.718579 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-02db510a-28b9-497c-9488-68f24c2a5709 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd649bcca73d45cea6526857c8b5116a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:12.742705 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-02db510a-28b9-497c-9488-68f24c2a5709 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd649bcca73d45cea6526857c8b5116a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:12.744077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-02db510a-28b9-497c-9488-68f24c2a5709 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd649bcca73d45cea6526857c8b5116a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:12.767669 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1833/3668] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:21:12 2022] DELETE /identity/v3/users/bd649bcca73d45cea6526857c8b5116a => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:21:12.769863 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a168a-a769-4292-bf99-457ad8626fed None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:12.770395 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a168a-a769-4292-bf99-457ad8626fed None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:12.770945 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a168a-a769-4292-bf99-457ad8626fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:12.817080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-b47a168a-a769-4292-bf99-457ad8626fed None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:21:12.818515 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b47a168a-a769-4292-bf99-457ad8626fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:12.936878 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1836/3669] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:21:12.968252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db510a-28b9-497c-9488-68f24c2a5709 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:12.970574 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-02db510a-28b9-497c-9488-68f24c2a5709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:13.096886 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db510a-28b9-497c-9488-68f24c2a5709 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:13.108966 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b686db6-4269-4958-bd20-a41846a1e3e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:13.110302 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b686db6-4269-4958-bd20-a41846a1e3e8 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:13.110758 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b686db6-4269-4958-bd20-a41846a1e3e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:13.113704 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b686db6-4269-4958-bd20-a41846a1e3e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:13.125296 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b686db6-4269-4958-bd20-a41846a1e3e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:13.127290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b686db6-4269-4958-bd20-a41846a1e3e8 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:13.168853 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1834/3670] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:21:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:21:13.610155 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a168a-a769-4292-bf99-457ad8626fed None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:13.611724 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b47a168a-a769-4292-bf99-457ad8626fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:13.653545 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a168a-a769-4292-bf99-457ad8626fed None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:13.666517 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8e4a4-29b4-4e83-8104-861e5895f68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:13.667702 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8e4a4-29b4-4e83-8104-861e5895f68b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:13.668132 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8e4a4-29b4-4e83-8104-861e5895f68b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:13.668552 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8e4a4-29b4-4e83-8104-861e5895f68b admin admin] PATH_INFO: `/v3/users/0a426fa7ed504002881521b1e820e359` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:13.670578 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af8e4a4-29b4-4e83-8104-861e5895f68b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a426fa7ed504002881521b1e820e359)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:13.673714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af8e4a4-29b4-4e83-8104-861e5895f68b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:13.903536 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d2501-3ac4-4f4b-a58e-d97d4f922cb5 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:13.908021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d2501-3ac4-4f4b-a58e-d97d4f922cb5 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:13.908021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d2501-3ac4-4f4b-a58e-d97d4f922cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:13.931117 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3af8e4a4-29b4-4e83-8104-861e5895f68b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a426fa7ed504002881521b1e820e359'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:13.938990 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-e39d2501-3ac4-4f4b-a58e-d97d4f922cb5 None None] MFA Rules not processed for user `02b78cd5fee5448b9e42dbb212f0de19`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:21:13.940414 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e39d2501-3ac4-4f4b-a58e-d97d4f922cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:13.974068 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3af8e4a4-29b4-4e83-8104-861e5895f68b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a426fa7ed504002881521b1e820e359'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:14.056406 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1835/3671] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:21:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:21:14.072594 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3af8e4a4-29b4-4e83-8104-861e5895f68b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a426fa7ed504002881521b1e820e359'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:14.072594 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3af8e4a4-29b4-4e83-8104-861e5895f68b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a426fa7ed504002881521b1e820e359'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:14.087787 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3af8e4a4-29b4-4e83-8104-861e5895f68b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a426fa7ed504002881521b1e820e359'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:14.097503 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1837/3672] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:21:13 2022] DELETE /identity/v3/users/0a426fa7ed504002881521b1e820e359 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:21:14.156058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3a737-eb5c-40b0-82b6-13f8ed328b3d None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:14.156381 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3a737-eb5c-40b0-82b6-13f8ed328b3d None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:14.156662 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3a737-eb5c-40b0-82b6-13f8ed328b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:14.200896 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-58d3a737-eb5c-40b0-82b6-13f8ed328b3d None None] MFA Rules not processed for user `2f5eafa970bd4247bdaef1cda747c3fc`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:21:14.204014 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-58d3a737-eb5c-40b0-82b6-13f8ed328b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:14.312171 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1836/3673] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:21:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:21:14.319238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8e4a4-29b4-4e83-8104-861e5895f68b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:14.329067 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3af8e4a4-29b4-4e83-8104-861e5895f68b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:14.424231 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8e4a4-29b4-4e83-8104-861e5895f68b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:14.430943 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dfdc6a-18fc-48cc-9b82-1b3582db4937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:14.432072 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dfdc6a-18fc-48cc-9b82-1b3582db4937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:14.433135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dfdc6a-18fc-48cc-9b82-1b3582db4937 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:14.434111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dfdc6a-18fc-48cc-9b82-1b3582db4937 admin admin] PATH_INFO: `/v3/projects/c9673e6cef5e44a39d1f3cfdfdda63c5` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:14.435361 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dfdc6a-18fc-48cc-9b82-1b3582db4937 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9673e6cef5e44a39d1f3cfdfdda63c5)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:14.437343 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dfdc6a-18fc-48cc-9b82-1b3582db4937 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:14.660343 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d8dfdc6a-18fc-48cc-9b82-1b3582db4937 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9673e6cef5e44a39d1f3cfdfdda63c5', 'request_id': 'req-d8dfdc6a-18fc-48cc-9b82-1b3582db4937'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:14.673966 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d8dfdc6a-18fc-48cc-9b82-1b3582db4937 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9673e6cef5e44a39d1f3cfdfdda63c5', 'request_id': 'req-d8dfdc6a-18fc-48cc-9b82-1b3582db4937'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:14.676703 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3a737-eb5c-40b0-82b6-13f8ed328b3d None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:14.682107 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-58d3a737-eb5c-40b0-82b6-13f8ed328b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:14.701534 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3a737-eb5c-40b0-82b6-13f8ed328b3d None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:14.716225 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d8dfdc6a-18fc-48cc-9b82-1b3582db4937 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9673e6cef5e44a39d1f3cfdfdda63c5', 'request_id': 'req-d8dfdc6a-18fc-48cc-9b82-1b3582db4937'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:14.796223 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d8dfdc6a-18fc-48cc-9b82-1b3582db4937 admin admin] The token cache is being invalidate because project c9673e6cef5e44a39d1f3cfdfdda63c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:21:14.797064 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d8dfdc6a-18fc-48cc-9b82-1b3582db4937 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:14.798526 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d8dfdc6a-18fc-48cc-9b82-1b3582db4937 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:14.800418 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1838/3674] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:21:14 2022] DELETE /identity/v3/projects/c9673e6cef5e44a39d1f3cfdfdda63c5 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:21:14.808092 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f71be-bd86-4e66-8db2-4f2bb9e96d3c None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:14.809419 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f71be-bd86-4e66-8db2-4f2bb9e96d3c None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:14.810481 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322cb55-cb86-4e31-aac0-ba9a31eb8087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:14.812194 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322cb55-cb86-4e31-aac0-ba9a31eb8087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:14.812484 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322cb55-cb86-4e31-aac0-ba9a31eb8087 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:14.812763 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322cb55-cb86-4e31-aac0-ba9a31eb8087 admin admin] PATH_INFO: `/v3/projects/c91284d0547c4c8a9d99f57d0a43f98b` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:14.814811 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322cb55-cb86-4e31-aac0-ba9a31eb8087 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c91284d0547c4c8a9d99f57d0a43f98b)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:14.817034 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f71be-bd86-4e66-8db2-4f2bb9e96d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:14.817750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322cb55-cb86-4e31-aac0-ba9a31eb8087 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:14.854434 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-a64f71be-bd86-4e66-8db2-4f2bb9e96d3c None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:21:14.856384 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a64f71be-bd86-4e66-8db2-4f2bb9e96d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:14.891202 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1839/3675] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:21:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:21:14.892935 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d569e7c-5b0d-48e6-b55a-d9b556c0d040 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:14.893438 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d569e7c-5b0d-48e6-b55a-d9b556c0d040 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:14.893997 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d569e7c-5b0d-48e6-b55a-d9b556c0d040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:14.927835 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-3d569e7c-5b0d-48e6-b55a-d9b556c0d040 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:21:14.930082 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3d569e7c-5b0d-48e6-b55a-d9b556c0d040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:14.944755 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7322cb55-cb86-4e31-aac0-ba9a31eb8087 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c91284d0547c4c8a9d99f57d0a43f98b', 'request_id': 'req-7322cb55-cb86-4e31-aac0-ba9a31eb8087'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:14.967249 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7322cb55-cb86-4e31-aac0-ba9a31eb8087 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c91284d0547c4c8a9d99f57d0a43f98b', 'request_id': 'req-7322cb55-cb86-4e31-aac0-ba9a31eb8087'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:14.983539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7322cb55-cb86-4e31-aac0-ba9a31eb8087 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c91284d0547c4c8a9d99f57d0a43f98b', 'request_id': 'req-7322cb55-cb86-4e31-aac0-ba9a31eb8087'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:15.011698 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1840/3676] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:21:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:21:15.016615 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d569e7c-5b0d-48e6-b55a-d9b556c0d040 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:15.032212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d569e7c-5b0d-48e6-b55a-d9b556c0d040 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:15.040026 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d678567-c77c-4e06-b22e-46d3f50f3ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:15.045875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d678567-c77c-4e06-b22e-46d3f50f3ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:15.045875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d678567-c77c-4e06-b22e-46d3f50f3ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:15.045875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d678567-c77c-4e06-b22e-46d3f50f3ee8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:15.045875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d678567-c77c-4e06-b22e-46d3f50f3ee8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:21:15.045875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d678567-c77c-4e06-b22e-46d3f50f3ee8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:15.045875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d678567-c77c-4e06-b22e-46d3f50f3ee8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:15.066274 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7322cb55-cb86-4e31-aac0-ba9a31eb8087 admin admin] The token cache is being invalidate because project c91284d0547c4c8a9d99f57d0a43f98b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:21:15.067860 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7322cb55-cb86-4e31-aac0-ba9a31eb8087 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:15.069620 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7322cb55-cb86-4e31-aac0-ba9a31eb8087 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:15.072912 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1837/3678] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:21:14 2022] DELETE /identity/v3/projects/c91284d0547c4c8a9d99f57d0a43f98b => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:21:15.073865 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322cb55-cb86-4e31-aac0-ba9a31eb8087 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:15.075347 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7322cb55-cb86-4e31-aac0-ba9a31eb8087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:15.076907 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1841/3678] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:21:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:21:15.080360 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7fa8d-0089-4590-9d76-82404ccb32b5 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:15.081988 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7fa8d-0089-4590-9d76-82404ccb32b5 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:15.082287 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7fa8d-0089-4590-9d76-82404ccb32b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:15.104072 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322cb55-cb86-4e31-aac0-ba9a31eb8087 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:15.119669 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-edf7fa8d-0089-4590-9d76-82404ccb32b5 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:21:15.120152 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13459d08-45c5-4775-baf6-3a80c5e46dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:15.120905 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-edf7fa8d-0089-4590-9d76-82404ccb32b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:15.121037 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13459d08-45c5-4775-baf6-3a80c5e46dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:15.121181 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13459d08-45c5-4775-baf6-3a80c5e46dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:15.121707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13459d08-45c5-4775-baf6-3a80c5e46dd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:15.122578 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13459d08-45c5-4775-baf6-3a80c5e46dd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:15.124864 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13459d08-45c5-4775-baf6-3a80c5e46dd3 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:15.129254 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1842/3679] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:21:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:21:15.137235 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9a8bd-f796-4f66-b6ee-9077798d79a5 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:15.137515 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9a8bd-f796-4f66-b6ee-9077798d79a5 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:15.143519 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9a8bd-f796-4f66-b6ee-9077798d79a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:15.158112 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-4dd9a8bd-f796-4f66-b6ee-9077798d79a5 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:21:15.160019 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4dd9a8bd-f796-4f66-b6ee-9077798d79a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:15.170289 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1843/3680] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:21:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:21:15.175901 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9a8bd-f796-4f66-b6ee-9077798d79a5 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:15.188885 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9a8bd-f796-4f66-b6ee-9077798d79a5 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:15.209932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e58c6-07e4-46c5-a765-ea2d31ecf690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:15.209932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e58c6-07e4-46c5-a765-ea2d31ecf690 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:15.209932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e58c6-07e4-46c5-a765-ea2d31ecf690 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:15.209932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e58c6-07e4-46c5-a765-ea2d31ecf690 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:15.210317 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e58c6-07e4-46c5-a765-ea2d31ecf690 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:21:15.210317 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e58c6-07e4-46c5-a765-ea2d31ecf690 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:15.210317 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e58c6-07e4-46c5-a765-ea2d31ecf690 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:15.223322 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1844/3681] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:21:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:21:15.235194 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e58c6-07e4-46c5-a765-ea2d31ecf690 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:15.238379 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1838/3682] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:21:15 2022] POST /identity/v3/projects => generated 381 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:21:15.248001 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13459d08-45c5-4775-baf6-3a80c5e46dd3 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:15.269916 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e58c6-07e4-46c5-a765-ea2d31ecf690 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:15.372186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13459d08-45c5-4775-baf6-3a80c5e46dd3 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:15.388378 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8eff8-82ef-45dc-89c0-e0b186cbf169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:15.389421 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8eff8-82ef-45dc-89c0-e0b186cbf169 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:15.390091 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8eff8-82ef-45dc-89c0-e0b186cbf169 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:15.390406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8eff8-82ef-45dc-89c0-e0b186cbf169 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:15.391090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8eff8-82ef-45dc-89c0-e0b186cbf169 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:15.394043 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400ee0a-5b9b-4085-8154-1c9bbedb674b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:15.394741 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400ee0a-5b9b-4085-8154-1c9bbedb674b admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:15.396598 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400ee0a-5b9b-4085-8154-1c9bbedb674b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:15.396598 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400ee0a-5b9b-4085-8154-1c9bbedb674b admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:15.396598 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3400ee0a-5b9b-4085-8154-1c9bbedb674b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:15.397591 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8eff8-82ef-45dc-89c0-e0b186cbf169 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:15.398650 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3400ee0a-5b9b-4085-8154-1c9bbedb674b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:15.495298 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1839/3683] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:21:15 2022] POST /identity/v3/users => generated 291 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:21:15.497131 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d4deb-32aa-4494-b9a3-9ff42c1c2e87 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:15.497417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d4deb-32aa-4494-b9a3-9ff42c1c2e87 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:15.497692 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d4deb-32aa-4494-b9a3-9ff42c1c2e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:15.517249 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-f60d4deb-32aa-4494-b9a3-9ff42c1c2e87 None None] MFA Rules not processed for user `65bedbcb4d094160a9a9fc3b6ba6f603`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:21:15.518970 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f60d4deb-32aa-4494-b9a3-9ff42c1c2e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:15.565394 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1845/3684] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:21:15 2022] POST /identity/v3/projects => generated 383 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:21:15.565394 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400ee0a-5b9b-4085-8154-1c9bbedb674b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:15.592462 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1840/3685] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:21:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:21:15.592462 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d4deb-32aa-4494-b9a3-9ff42c1c2e87 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:15.606658 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d4deb-32aa-4494-b9a3-9ff42c1c2e87 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:15.688438 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400ee0a-5b9b-4085-8154-1c9bbedb674b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:15.705531 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196516d-ed69-4dc4-a357-2ef57feb03bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:15.711679 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c56709-8f5a-469c-8f7e-a533bfc17cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:15.712287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196516d-ed69-4dc4-a357-2ef57feb03bd admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:15.712373 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c56709-8f5a-469c-8f7e-a533bfc17cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:15.712446 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196516d-ed69-4dc4-a357-2ef57feb03bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:15.712809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196516d-ed69-4dc4-a357-2ef57feb03bd admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:15.714292 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6196516d-ed69-4dc4-a357-2ef57feb03bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:15.715948 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6196516d-ed69-4dc4-a357-2ef57feb03bd admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:15.720605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c56709-8f5a-469c-8f7e-a533bfc17cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:15.727802 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c56709-8f5a-469c-8f7e-a533bfc17cf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:15.727802 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c56709-8f5a-469c-8f7e-a533bfc17cf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:15.727802 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c56709-8f5a-469c-8f7e-a533bfc17cf7 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:15.771078 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1846/3686] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:21:15.791050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c56709-8f5a-469c-8f7e-a533bfc17cf7 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:15.812708 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c56709-8f5a-469c-8f7e-a533bfc17cf7 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:15.826797 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec96836-ab0b-47ff-8817-c40926e03c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:15.827530 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec96836-ab0b-47ff-8817-c40926e03c7b admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:15.827923 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec96836-ab0b-47ff-8817-c40926e03c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:15.828080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec96836-ab0b-47ff-8817-c40926e03c7b admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:15.828813 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec96836-ab0b-47ff-8817-c40926e03c7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:15.832683 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1841/3687] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:21:15 2022] POST /identity/v3/users => generated 292 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:21:15.833101 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec96836-ab0b-47ff-8817-c40926e03c7b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:15.833803 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196516d-ed69-4dc4-a357-2ef57feb03bd admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:15.857829 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1847/3688] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:21:15.861668 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196516d-ed69-4dc4-a357-2ef57feb03bd admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:15.862351 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec96836-ab0b-47ff-8817-c40926e03c7b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:15.876279 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d2877-cfd8-412d-bd03-f4e8c6a71b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:15.877239 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d2877-cfd8-412d-bd03-f4e8c6a71b4b admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:15.877728 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d2877-cfd8-412d-bd03-f4e8c6a71b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:15.878563 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d2877-cfd8-412d-bd03-f4e8c6a71b4b admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:15.880646 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562d2877-cfd8-412d-bd03-f4e8c6a71b4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:15.883587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec96836-ab0b-47ff-8817-c40926e03c7b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:15.886158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562d2877-cfd8-412d-bd03-f4e8c6a71b4b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:15.893329 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a6e80-308e-4776-83e5-0704ec3586e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:15.894460 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a6e80-308e-4776-83e5-0704ec3586e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:15.895017 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a6e80-308e-4776-83e5-0704ec3586e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:15.895512 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a6e80-308e-4776-83e5-0704ec3586e2 admin admin] PATH_INFO: `/v3/projects/06b329e61e254c7c9c722e9afd8160ea/users/833f17bf2a0a4f89a95214e4e19c153a/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:15.925656 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1842/3689] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:21:15.926649 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d2877-cfd8-412d-bd03-f4e8c6a71b4b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:15.940674 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a6e80-308e-4776-83e5-0704ec3586e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06b329e61e254c7c9c722e9afd8160ea, user_id=833f17bf2a0a4f89a95214e4e19c153a, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:15.946733 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a6e80-308e-4776-83e5-0704ec3586e2 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:15.948871 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d2877-cfd8-412d-bd03-f4e8c6a71b4b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:15.972885 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87392b-3198-47d8-903d-413074070eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:15.975744 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87392b-3198-47d8-903d-413074070eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:15.975744 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87392b-3198-47d8-903d-413074070eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:15.975744 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87392b-3198-47d8-903d-413074070eb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:15.975744 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d87392b-3198-47d8-903d-413074070eb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:15.977272 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d87392b-3198-47d8-903d-413074070eb8 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:16.023940 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1843/3690] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:21:16.028121 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87392b-3198-47d8-903d-413074070eb8 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:16.044282 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1848/3691] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:21:15 2022] PUT /identity/v3/projects/06b329e61e254c7c9c722e9afd8160ea/users/833f17bf2a0a4f89a95214e4e19c153a/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:21:16.045979 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87392b-3198-47d8-903d-413074070eb8 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:16.051789 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd50ff-d9fb-4919-8d79-9ebf151fb28c None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:16.052410 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd50ff-d9fb-4919-8d79-9ebf151fb28c None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:16.052761 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd50ff-d9fb-4919-8d79-9ebf151fb28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:16.098280 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-29fd50ff-d9fb-4919-8d79-9ebf151fb28c None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:21:16.102503 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-29fd50ff-d9fb-4919-8d79-9ebf151fb28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:16.156554 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a253cef-d357-4e8e-abfa-1a4121c3c71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:16.157591 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a253cef-d357-4e8e-abfa-1a4121c3c71e admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:16.158096 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a253cef-d357-4e8e-abfa-1a4121c3c71e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:16.158447 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a253cef-d357-4e8e-abfa-1a4121c3c71e admin admin] PATH_INFO: `/v3/projects/3e12f061321b434e92c0f85031c54ef8/users/a42c6a51b78b408f85cbacb545f06707/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:16.182128 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a253cef-d357-4e8e-abfa-1a4121c3c71e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e12f061321b434e92c0f85031c54ef8, user_id=a42c6a51b78b408f85cbacb545f06707, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:16.187286 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a253cef-d357-4e8e-abfa-1a4121c3c71e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:16.209931 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1849/3692] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:21:16.219606 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd50ff-d9fb-4919-8d79-9ebf151fb28c None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:16.221027 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-29fd50ff-d9fb-4919-8d79-9ebf151fb28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:16.285783 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd50ff-d9fb-4919-8d79-9ebf151fb28c None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:16.294114 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1844/3693] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:21:16 2022] PUT /identity/v3/projects/3e12f061321b434e92c0f85031c54ef8/users/a42c6a51b78b408f85cbacb545f06707/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:21:16.295569 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52912746-7835-42a4-b545-6e5b3368bc8e None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:16.295866 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52912746-7835-42a4-b545-6e5b3368bc8e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:16.296147 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52912746-7835-42a4-b545-6e5b3368bc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:16.324725 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-52912746-7835-42a4-b545-6e5b3368bc8e None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:21:16.326003 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-52912746-7835-42a4-b545-6e5b3368bc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:16.374208 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff65b6-ab01-4124-a097-dc6b39646b3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:16.374873 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff65b6-ab01-4124-a097-dc6b39646b3c service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:16.375564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff65b6-ab01-4124-a097-dc6b39646b3c service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:16.375849 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff65b6-ab01-4124-a097-dc6b39646b3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:16.410461 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1845/3694] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:21:16.438706 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52912746-7835-42a4-b545-6e5b3368bc8e None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:16.451252 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff65b6-ab01-4124-a097-dc6b39646b3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:16.452534 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52912746-7835-42a4-b545-6e5b3368bc8e None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:16.456053 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff65b6-ab01-4124-a097-dc6b39646b3c service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:16.456520 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c08d2a-a7a6-4de1-b158-8dd32a9155c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:16.457259 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c08d2a-a7a6-4de1-b158-8dd32a9155c9 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:16.457592 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c08d2a-a7a6-4de1-b158-8dd32a9155c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:16.457934 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c08d2a-a7a6-4de1-b158-8dd32a9155c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:16.467423 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1850/3695] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:21:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:21:16.477136 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c08d2a-a7a6-4de1-b158-8dd32a9155c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:16.485277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c08d2a-a7a6-4de1-b158-8dd32a9155c9 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:16.502042 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1846/3696] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:21:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:21:18.498188 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed49d7-8b64-4f3c-93a9-e3b08b2fcc9b None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:18.498714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed49d7-8b64-4f3c-93a9-e3b08b2fcc9b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:18.498792 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed49d7-8b64-4f3c-93a9-e3b08b2fcc9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:18.527902 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee89d1-54ce-4e47-a65e-2b571adc0279 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:18.528999 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee89d1-54ce-4e47-a65e-2b571adc0279 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:18.529486 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee89d1-54ce-4e47-a65e-2b571adc0279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:18.542894 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-6bed49d7-8b64-4f3c-93a9-e3b08b2fcc9b None None] MFA Rules not processed for user `833f17bf2a0a4f89a95214e4e19c153a`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:21:18.544285 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6bed49d7-8b64-4f3c-93a9-e3b08b2fcc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:18.570804 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-e8ee89d1-54ce-4e47-a65e-2b571adc0279 None None] MFA Rules not processed for user `a42c6a51b78b408f85cbacb545f06707`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:21:18.572837 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e8ee89d1-54ce-4e47-a65e-2b571adc0279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:18.669597 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1847/3697] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:21:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:21:18.683692 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a811eb-2bc3-4db7-86f2-dc1c133e63fd None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:18.684431 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a811eb-2bc3-4db7-86f2-dc1c133e63fd None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:18.684545 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1851/3698] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:21:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:21:18.685333 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a811eb-2bc3-4db7-86f2-dc1c133e63fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:18.696940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d0b99-f6cf-4878-8e87-e18c83b3354c None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:18.697213 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d0b99-f6cf-4878-8e87-e18c83b3354c None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:18.697432 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d0b99-f6cf-4878-8e87-e18c83b3354c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:18.717896 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-4b7d0b99-f6cf-4878-8e87-e18c83b3354c None None] MFA Rules not processed for user `833f17bf2a0a4f89a95214e4e19c153a`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:21:18.719299 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4b7d0b99-f6cf-4878-8e87-e18c83b3354c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:18.725695 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-50a811eb-2bc3-4db7-86f2-dc1c133e63fd None None] MFA Rules not processed for user `a42c6a51b78b408f85cbacb545f06707`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:21:18.727419 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-50a811eb-2bc3-4db7-86f2-dc1c133e63fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:18.736599 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1848/3699] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:21:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:21:18.738088 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1852/3700] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:21:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:21:18.739195 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a811eb-2bc3-4db7-86f2-dc1c133e63fd None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:18.740443 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-50a811eb-2bc3-4db7-86f2-dc1c133e63fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:18.838186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a811eb-2bc3-4db7-86f2-dc1c133e63fd None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:18.847084 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac198b38-24ea-459f-84ac-43bbc27f478a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:18.848198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac198b38-24ea-459f-84ac-43bbc27f478a service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:18.848198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac198b38-24ea-459f-84ac-43bbc27f478a service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:18.848439 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac198b38-24ea-459f-84ac-43bbc27f478a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:18.862656 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac198b38-24ea-459f-84ac-43bbc27f478a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:18.865026 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac198b38-24ea-459f-84ac-43bbc27f478a service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:18.875640 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1849/3701] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:21:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:21:18.963710 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d0b99-f6cf-4878-8e87-e18c83b3354c None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:18.965202 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4b7d0b99-f6cf-4878-8e87-e18c83b3354c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:18.982176 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d0b99-f6cf-4878-8e87-e18c83b3354c None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:18.991254 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e6e17-0560-4520-824c-f3d8d8f03331 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:18.991924 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e6e17-0560-4520-824c-f3d8d8f03331 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:18.994464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e6e17-0560-4520-824c-f3d8d8f03331 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:18.994785 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e6e17-0560-4520-824c-f3d8d8f03331 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:19.006958 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e6e17-0560-4520-824c-f3d8d8f03331 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:19.008658 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e6e17-0560-4520-824c-f3d8d8f03331 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:19.020147 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1853/3702] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:21:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:21:26.151033 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac198b38-24ea-459f-84ac-43bbc27f478a service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:26.164752 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac198b38-24ea-459f-84ac-43bbc27f478a service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:26.170527 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6676a-a516-47ac-b6bb-f94d320cb532 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:26.171174 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6676a-a516-47ac-b6bb-f94d320cb532 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:26.171458 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6676a-a516-47ac-b6bb-f94d320cb532 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:26.171732 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6676a-a516-47ac-b6bb-f94d320cb532 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:26.173655 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-40a6676a-a516-47ac-b6bb-f94d320cb532 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:26.188520 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a6676a-a516-47ac-b6bb-f94d320cb532 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:26.190181 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a6676a-a516-47ac-b6bb-f94d320cb532 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:26.201348 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1850/3703] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:21:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:21:47.303816 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5c2be-3482-4796-ac63-734e3b80e813 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:47.304367 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5c2be-3482-4796-ac63-734e3b80e813 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:47.304464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5c2be-3482-4796-ac63-734e3b80e813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:47.321969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-37d5c2be-3482-4796-ac63-734e3b80e813 None None] MFA Rules not processed for user `02b78cd5fee5448b9e42dbb212f0de19`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:21:47.323487 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-37d5c2be-3482-4796-ac63-734e3b80e813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:47.376828 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1854/3704] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:21:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:21:49.221853 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6676a-a516-47ac-b6bb-f94d320cb532 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:49.246743 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6676a-a516-47ac-b6bb-f94d320cb532 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:49.250031 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117f3aa-365a-4476-bcfa-896a21ef6855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:49.254700 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117f3aa-365a-4476-bcfa-896a21ef6855 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:49.254976 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117f3aa-365a-4476-bcfa-896a21ef6855 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:49.255260 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117f3aa-365a-4476-bcfa-896a21ef6855 admin admin] PATH_INFO: `/v3/users/833f17bf2a0a4f89a95214e4e19c153a` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:49.256796 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b117f3aa-365a-4476-bcfa-896a21ef6855 admin admin] RBAC: Authorizing `identity:delete_user(user_id=833f17bf2a0a4f89a95214e4e19c153a)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:49.258831 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b117f3aa-365a-4476-bcfa-896a21ef6855 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:49.513960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b117f3aa-365a-4476-bcfa-896a21ef6855 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '833f17bf2a0a4f89a95214e4e19c153a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:49.526128 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b117f3aa-365a-4476-bcfa-896a21ef6855 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '833f17bf2a0a4f89a95214e4e19c153a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:49.615111 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b117f3aa-365a-4476-bcfa-896a21ef6855 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '833f17bf2a0a4f89a95214e4e19c153a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:49.622348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b117f3aa-365a-4476-bcfa-896a21ef6855 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '833f17bf2a0a4f89a95214e4e19c153a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:49.623012 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b117f3aa-365a-4476-bcfa-896a21ef6855 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '833f17bf2a0a4f89a95214e4e19c153a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:49.629023 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1851/3705] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:21:49 2022] DELETE /identity/v3/users/833f17bf2a0a4f89a95214e4e19c153a => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:21:49.937566 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5c2be-3482-4796-ac63-734e3b80e813 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:49.953187 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5c2be-3482-4796-ac63-734e3b80e813 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:50.016851 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d967f4-126e-49c2-a2f6-d62cbed92936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:50.017840 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d967f4-126e-49c2-a2f6-d62cbed92936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:50.018125 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d967f4-126e-49c2-a2f6-d62cbed92936 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:50.018400 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d967f4-126e-49c2-a2f6-d62cbed92936 admin admin] PATH_INFO: `/v3/projects/06b329e61e254c7c9c722e9afd8160ea` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:50.023137 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d967f4-126e-49c2-a2f6-d62cbed92936 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06b329e61e254c7c9c722e9afd8160ea)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:50.025589 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d967f4-126e-49c2-a2f6-d62cbed92936 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:50.164398 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f8d967f4-126e-49c2-a2f6-d62cbed92936 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06b329e61e254c7c9c722e9afd8160ea', 'request_id': 'req-f8d967f4-126e-49c2-a2f6-d62cbed92936'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:50.169739 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f8d967f4-126e-49c2-a2f6-d62cbed92936 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06b329e61e254c7c9c722e9afd8160ea', 'request_id': 'req-f8d967f4-126e-49c2-a2f6-d62cbed92936'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:50.175902 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f8d967f4-126e-49c2-a2f6-d62cbed92936 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06b329e61e254c7c9c722e9afd8160ea', 'request_id': 'req-f8d967f4-126e-49c2-a2f6-d62cbed92936'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:50.287731 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f8d967f4-126e-49c2-a2f6-d62cbed92936 admin admin] The token cache is being invalidate because project 06b329e61e254c7c9c722e9afd8160ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:21:50.288993 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f8d967f4-126e-49c2-a2f6-d62cbed92936 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:50.288993 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f8d967f4-126e-49c2-a2f6-d62cbed92936 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:21:50.291134 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1855/3706] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:21:49 2022] DELETE /identity/v3/projects/06b329e61e254c7c9c722e9afd8160ea => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:21:50.295860 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584e9e0-dd77-4cac-ac4e-364b26007e50 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:50.296390 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584e9e0-dd77-4cac-ac4e-364b26007e50 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:50.296506 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584e9e0-dd77-4cac-ac4e-364b26007e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:50.315205 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-e584e9e0-dd77-4cac-ac4e-364b26007e50 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:21:50.316833 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e584e9e0-dd77-4cac-ac4e-364b26007e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:50.389093 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1852/3707] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:21:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:21:50.397004 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fa38e-8b14-4c40-bccc-12ada8266c2d None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:50.398258 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fa38e-8b14-4c40-bccc-12ada8266c2d None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:50.398258 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fa38e-8b14-4c40-bccc-12ada8266c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:50.416700 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-8c1fa38e-8b14-4c40-bccc-12ada8266c2d None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:21:50.418103 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8c1fa38e-8b14-4c40-bccc-12ada8266c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:50.426645 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1856/3708] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:21:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:21:50.431474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584e9e0-dd77-4cac-ac4e-364b26007e50 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:50.441342 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584e9e0-dd77-4cac-ac4e-364b26007e50 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:50.446804 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2950ef9-d5fb-44d1-879c-bd8228af86e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:50.447463 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2950ef9-d5fb-44d1-879c-bd8228af86e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:50.447751 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2950ef9-d5fb-44d1-879c-bd8228af86e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:50.448030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2950ef9-d5fb-44d1-879c-bd8228af86e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:50.448764 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2950ef9-d5fb-44d1-879c-bd8228af86e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:21:50.449071 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2950ef9-d5fb-44d1-879c-bd8228af86e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:50.450732 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2950ef9-d5fb-44d1-879c-bd8228af86e8 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:50.464403 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1853/3709] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:21:50.469025 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1fa38e-8b14-4c40-bccc-12ada8266c2d None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:50.487344 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1fa38e-8b14-4c40-bccc-12ada8266c2d None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:50.493190 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1658e8f-5de6-493b-b9f1-c34adaca281e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:50.494186 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1658e8f-5de6-493b-b9f1-c34adaca281e admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:50.494566 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1658e8f-5de6-493b-b9f1-c34adaca281e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:50.494916 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1658e8f-5de6-493b-b9f1-c34adaca281e admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:50.495687 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1658e8f-5de6-493b-b9f1-c34adaca281e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:50.498505 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1658e8f-5de6-493b-b9f1-c34adaca281e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:50.590249 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1857/3710] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:21:50 2022] POST /identity/v3/projects => generated 399 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:21:50.594188 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2950ef9-d5fb-44d1-879c-bd8228af86e8 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:50.606096 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2950ef9-d5fb-44d1-879c-bd8228af86e8 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:50.663419 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5691a533-6890-4f56-b52e-2df387bfcf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:50.664097 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691a533-6890-4f56-b52e-2df387bfcf5e admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:50.664383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691a533-6890-4f56-b52e-2df387bfcf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:50.664663 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691a533-6890-4f56-b52e-2df387bfcf5e admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:50.665347 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5691a533-6890-4f56-b52e-2df387bfcf5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:50.667466 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5691a533-6890-4f56-b52e-2df387bfcf5e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:50.796415 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1854/3711] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:21:50 2022] POST /identity/v3/users => generated 300 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:21:50.797985 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1658e8f-5de6-493b-b9f1-c34adaca281e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:50.809374 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1658e8f-5de6-493b-b9f1-c34adaca281e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:50.814273 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b7798-dcbe-4431-ab1e-0ba72c84de7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:50.815013 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b7798-dcbe-4431-ab1e-0ba72c84de7e admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:50.815214 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b7798-dcbe-4431-ab1e-0ba72c84de7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:50.815487 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b7798-dcbe-4431-ab1e-0ba72c84de7e admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:50.816202 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b7798-dcbe-4431-ab1e-0ba72c84de7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:50.817845 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b7798-dcbe-4431-ab1e-0ba72c84de7e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:50.829654 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1858/3712] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:21:50.833823 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5691a533-6890-4f56-b52e-2df387bfcf5e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:50.849177 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5691a533-6890-4f56-b52e-2df387bfcf5e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:50.851058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afecb97-2c3e-454b-8bec-ee266c1c7e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:50.851731 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afecb97-2c3e-454b-8bec-ee266c1c7e6a admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:50.852016 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afecb97-2c3e-454b-8bec-ee266c1c7e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:50.852294 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afecb97-2c3e-454b-8bec-ee266c1c7e6a admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:50.853016 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afecb97-2c3e-454b-8bec-ee266c1c7e6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:50.854880 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afecb97-2c3e-454b-8bec-ee266c1c7e6a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:50.866541 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1855/3713] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:21:50.870829 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b7798-dcbe-4431-ab1e-0ba72c84de7e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:50.880852 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b7798-dcbe-4431-ab1e-0ba72c84de7e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:50.886242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489bcd2-0e39-41fd-b33a-88c61c345568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:50.887125 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489bcd2-0e39-41fd-b33a-88c61c345568 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:50.887402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489bcd2-0e39-41fd-b33a-88c61c345568 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:50.887672 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489bcd2-0e39-41fd-b33a-88c61c345568 admin admin] PATH_INFO: `/v3/projects/5dc17b1f657d4f6caefcd0aae175053d/users/8d214c299b614208912789b9e3d7daae/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:50.902871 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8489bcd2-0e39-41fd-b33a-88c61c345568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dc17b1f657d4f6caefcd0aae175053d, user_id=8d214c299b614208912789b9e3d7daae, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:50.905539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8489bcd2-0e39-41fd-b33a-88c61c345568 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:50.960521 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1859/3714] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:21:50 2022] PUT /identity/v3/projects/5dc17b1f657d4f6caefcd0aae175053d/users/8d214c299b614208912789b9e3d7daae/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:21:50.965579 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c211f-442b-4e79-af99-5eaa0350f69a None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:50.965899 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c211f-442b-4e79-af99-5eaa0350f69a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:50.966184 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c211f-442b-4e79-af99-5eaa0350f69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:50.986458 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-4e3c211f-442b-4e79-af99-5eaa0350f69a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:21:50.988373 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4e3c211f-442b-4e79-af99-5eaa0350f69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:51.060603 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1856/3715] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:21:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:21:51.068317 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489bcd2-0e39-41fd-b33a-88c61c345568 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:51.071289 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8489bcd2-0e39-41fd-b33a-88c61c345568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:51.144925 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489bcd2-0e39-41fd-b33a-88c61c345568 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:51.149915 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017a35d-cc21-4abf-a023-106b0c08a7cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:51.151499 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017a35d-cc21-4abf-a023-106b0c08a7cc service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:51.151499 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017a35d-cc21-4abf-a023-106b0c08a7cc service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:51.151872 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017a35d-cc21-4abf-a023-106b0c08a7cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:51.163459 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3017a35d-cc21-4abf-a023-106b0c08a7cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:51.167136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3017a35d-cc21-4abf-a023-106b0c08a7cc service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:51.176784 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1860/3716] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:21:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:21:52.504853 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fda95-c608-4672-8dcb-7d122a522f6c None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:52.505408 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fda95-c608-4672-8dcb-7d122a522f6c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:52.505503 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fda95-c608-4672-8dcb-7d122a522f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:52.539423 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-d62fda95-c608-4672-8dcb-7d122a522f6c None None] MFA Rules not processed for user `8d214c299b614208912789b9e3d7daae`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:21:52.540855 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d62fda95-c608-4672-8dcb-7d122a522f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:52.621235 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1857/3717] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:21:52 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:21:52.631045 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b26b36-471e-418a-8d6f-445ba6072e72 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:52.631601 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b26b36-471e-418a-8d6f-445ba6072e72 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:52.631887 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b26b36-471e-418a-8d6f-445ba6072e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:52.651162 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-94b26b36-471e-418a-8d6f-445ba6072e72 None None] MFA Rules not processed for user `8d214c299b614208912789b9e3d7daae`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:21:52.652467 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-94b26b36-471e-418a-8d6f-445ba6072e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:52.665839 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1861/3718] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:21:52 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:21:52.672149 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fda95-c608-4672-8dcb-7d122a522f6c None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:52.673509 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d62fda95-c608-4672-8dcb-7d122a522f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:52.758384 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fda95-c608-4672-8dcb-7d122a522f6c None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:52.764417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3d897-997c-4f0a-8808-418c6b930d24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:52.765075 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3d897-997c-4f0a-8808-418c6b930d24 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:52.765359 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3d897-997c-4f0a-8808-418c6b930d24 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:52.765641 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3d897-997c-4f0a-8808-418c6b930d24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:52.774988 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3d897-997c-4f0a-8808-418c6b930d24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:52.776581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3d897-997c-4f0a-8808-418c6b930d24 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:52.786170 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1858/3719] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:21:52 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:21:53.249047 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b26b36-471e-418a-8d6f-445ba6072e72 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:21:53.250557 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-94b26b36-471e-418a-8d6f-445ba6072e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:53.263832 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b26b36-471e-418a-8d6f-445ba6072e72 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:21:53.267036 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0cf3f9-b9fe-4797-8e13-3ee93dc215c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:21:53.267714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cf3f9-b9fe-4797-8e13-3ee93dc215c1 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:21:53.267995 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cf3f9-b9fe-4797-8e13-3ee93dc215c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:21:53.277006 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cf3f9-b9fe-4797-8e13-3ee93dc215c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:21:53.289496 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ef0cf3f9-b9fe-4797-8e13-3ee93dc215c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:21:53.300050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0cf3f9-b9fe-4797-8e13-3ee93dc215c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:21:53.301781 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0cf3f9-b9fe-4797-8e13-3ee93dc215c1 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:21:53.310435 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1862/3720] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:21:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:22:10.841076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0bcf7-c663-46cc-9b90-fc9a9bc855cc None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:10.841875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0bcf7-c663-46cc-9b90-fc9a9bc855cc None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:10.841875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0bcf7-c663-46cc-9b90-fc9a9bc855cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:10.893221 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-3ab0bcf7-c663-46cc-9b90-fc9a9bc855cc None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:22:10.894588 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3ab0bcf7-c663-46cc-9b90-fc9a9bc855cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:10.958707 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1859/3721] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:22:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:22:11.083668 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0cf3f9-b9fe-4797-8e13-3ee93dc215c1 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:11.085387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ef0cf3f9-b9fe-4797-8e13-3ee93dc215c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:11.177704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0cf3f9-b9fe-4797-8e13-3ee93dc215c1 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:11.183784 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362319c6-3f65-4839-a246-48039c823a1a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:11.184560 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362319c6-3f65-4839-a246-48039c823a1a service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:11.184865 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362319c6-3f65-4839-a246-48039c823a1a service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:11.185142 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362319c6-3f65-4839-a246-48039c823a1a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:11.193662 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362319c6-3f65-4839-a246-48039c823a1a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:11.196095 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362319c6-3f65-4839-a246-48039c823a1a service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:11.204155 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1863/3722] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:22:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:22:13.228373 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0bcf7-c663-46cc-9b90-fc9a9bc855cc None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:13.244668 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0bcf7-c663-46cc-9b90-fc9a9bc855cc None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:13.255073 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b484cd-25cb-436a-967c-ca171d77cf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:13.258844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b484cd-25cb-436a-967c-ca171d77cf07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:13.259722 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b484cd-25cb-436a-967c-ca171d77cf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:13.260214 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b484cd-25cb-436a-967c-ca171d77cf07 admin admin] PATH_INFO: `/v3/users/8d214c299b614208912789b9e3d7daae` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:13.263058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b484cd-25cb-436a-967c-ca171d77cf07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d214c299b614208912789b9e3d7daae)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:13.265680 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b484cd-25cb-436a-967c-ca171d77cf07 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:13.547594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b7b484cd-25cb-436a-967c-ca171d77cf07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d214c299b614208912789b9e3d7daae'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:13.575930 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b7b484cd-25cb-436a-967c-ca171d77cf07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d214c299b614208912789b9e3d7daae'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:13.642308 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b7b484cd-25cb-436a-967c-ca171d77cf07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d214c299b614208912789b9e3d7daae'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:13.692390 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b7b484cd-25cb-436a-967c-ca171d77cf07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d214c299b614208912789b9e3d7daae'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:13.700591 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b7b484cd-25cb-436a-967c-ca171d77cf07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d214c299b614208912789b9e3d7daae'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:13.717797 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1860/3723] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:22:13 2022] DELETE /identity/v3/users/8d214c299b614208912789b9e3d7daae => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:14.118666 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362319c6-3f65-4839-a246-48039c823a1a service swift] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:14.140621 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362319c6-3f65-4839-a246-48039c823a1a service swift] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:14.237411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610da55d-f12d-4157-8d6c-de497ecc215b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:14.238575 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610da55d-f12d-4157-8d6c-de497ecc215b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:14.238956 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610da55d-f12d-4157-8d6c-de497ecc215b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:14.242608 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610da55d-f12d-4157-8d6c-de497ecc215b admin admin] PATH_INFO: `/v3/projects/5dc17b1f657d4f6caefcd0aae175053d` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:14.244031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610da55d-f12d-4157-8d6c-de497ecc215b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dc17b1f657d4f6caefcd0aae175053d)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:14.246176 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610da55d-f12d-4157-8d6c-de497ecc215b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:14.411778 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401645c3-9aa5-4889-9196-22fce7dcd382 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:14.419581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401645c3-9aa5-4889-9196-22fce7dcd382 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:14.419581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401645c3-9aa5-4889-9196-22fce7dcd382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:14.421030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-610da55d-f12d-4157-8d6c-de497ecc215b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dc17b1f657d4f6caefcd0aae175053d', 'request_id': 'req-610da55d-f12d-4157-8d6c-de497ecc215b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:14.427690 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-610da55d-f12d-4157-8d6c-de497ecc215b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dc17b1f657d4f6caefcd0aae175053d', 'request_id': 'req-610da55d-f12d-4157-8d6c-de497ecc215b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:14.434244 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-610da55d-f12d-4157-8d6c-de497ecc215b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dc17b1f657d4f6caefcd0aae175053d', 'request_id': 'req-610da55d-f12d-4157-8d6c-de497ecc215b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:14.434878 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-401645c3-9aa5-4889-9196-22fce7dcd382 None None] MFA Rules not processed for user `a42c6a51b78b408f85cbacb545f06707`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:22:14.436426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-401645c3-9aa5-4889-9196-22fce7dcd382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:14.517827 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-610da55d-f12d-4157-8d6c-de497ecc215b admin admin] The token cache is being invalidate because project 5dc17b1f657d4f6caefcd0aae175053d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:22:14.518429 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-610da55d-f12d-4157-8d6c-de497ecc215b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:14.520459 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-610da55d-f12d-4157-8d6c-de497ecc215b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:14.522467 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1864/3724] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:22:14 2022] DELETE /identity/v3/projects/5dc17b1f657d4f6caefcd0aae175053d => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:14.530445 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721114f5-96cb-402a-beeb-07a55b11ed24 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:14.530744 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721114f5-96cb-402a-beeb-07a55b11ed24 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:14.531127 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721114f5-96cb-402a-beeb-07a55b11ed24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:14.536896 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1861/3725] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:22:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:22:14.575919 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-721114f5-96cb-402a-beeb-07a55b11ed24 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:22:14.575919 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-721114f5-96cb-402a-beeb-07a55b11ed24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:14.682809 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1865/3726] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:22:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:22:14.691426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a2a94-7657-4b83-99ea-7a247d319e1f None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:14.691872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a2a94-7657-4b83-99ea-7a247d319e1f None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:14.692305 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a2a94-7657-4b83-99ea-7a247d319e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:14.731641 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-6d3a2a94-7657-4b83-99ea-7a247d319e1f None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:22:14.732961 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6d3a2a94-7657-4b83-99ea-7a247d319e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:14.757818 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1862/3727] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:22:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:22:14.758051 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721114f5-96cb-402a-beeb-07a55b11ed24 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:14.763802 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721114f5-96cb-402a-beeb-07a55b11ed24 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:14.773215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfafe2a-1643-4d32-8d76-eb7b850e2a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:14.773396 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfafe2a-1643-4d32-8d76-eb7b850e2a26 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:14.773670 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfafe2a-1643-4d32-8d76-eb7b850e2a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:14.774081 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfafe2a-1643-4d32-8d76-eb7b850e2a26 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:14.775199 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfafe2a-1643-4d32-8d76-eb7b850e2a26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:22:14.775729 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfafe2a-1643-4d32-8d76-eb7b850e2a26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:14.778782 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfafe2a-1643-4d32-8d76-eb7b850e2a26 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:14.797732 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1866/3728] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:22:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:22:14.802497 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a2a94-7657-4b83-99ea-7a247d319e1f None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:14.814115 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a2a94-7657-4b83-99ea-7a247d319e1f None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:14.819037 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3154d1b-faa2-4039-88a3-b7da2f4c98f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:14.820400 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3154d1b-faa2-4039-88a3-b7da2f4c98f9 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:14.820680 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3154d1b-faa2-4039-88a3-b7da2f4c98f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:14.820953 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3154d1b-faa2-4039-88a3-b7da2f4c98f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:14.821648 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3154d1b-faa2-4039-88a3-b7da2f4c98f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:14.823670 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3154d1b-faa2-4039-88a3-b7da2f4c98f9 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:15.017403 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1863/3729] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:22:14 2022] POST /identity/v3/projects => generated 375 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:22:15.024148 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfafe2a-1643-4d32-8d76-eb7b850e2a26 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:15.036851 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfafe2a-1643-4d32-8d76-eb7b850e2a26 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:15.095369 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b6c4b-c50c-45f7-83bb-bf4f6f7b8f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:15.096061 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b6c4b-c50c-45f7-83bb-bf4f6f7b8f41 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:15.096346 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b6c4b-c50c-45f7-83bb-bf4f6f7b8f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:15.097251 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b6c4b-c50c-45f7-83bb-bf4f6f7b8f41 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:15.098007 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b6c4b-c50c-45f7-83bb-bf4f6f7b8f41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:15.101833 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b6c4b-c50c-45f7-83bb-bf4f6f7b8f41 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:15.177040 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1867/3730] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:22:15 2022] POST /identity/v3/users => generated 288 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:22:15.181995 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3154d1b-faa2-4039-88a3-b7da2f4c98f9 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:15.202658 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3154d1b-faa2-4039-88a3-b7da2f4c98f9 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:15.211287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e26b0-389f-4fa0-b777-c4bc2dc4abeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:15.212086 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e26b0-389f-4fa0-b777-c4bc2dc4abeb admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:15.212418 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e26b0-389f-4fa0-b777-c4bc2dc4abeb admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:15.213412 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e26b0-389f-4fa0-b777-c4bc2dc4abeb admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:15.216752 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e26b0-389f-4fa0-b777-c4bc2dc4abeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:15.220755 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e26b0-389f-4fa0-b777-c4bc2dc4abeb admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:15.233830 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1864/3731] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:22:15.237712 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b6c4b-c50c-45f7-83bb-bf4f6f7b8f41 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:15.249633 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b6c4b-c50c-45f7-83bb-bf4f6f7b8f41 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:15.254620 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a288d9b-5bc4-46e5-b116-a4206aabb1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:15.255413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a288d9b-5bc4-46e5-b116-a4206aabb1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:15.255801 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a288d9b-5bc4-46e5-b116-a4206aabb1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:15.256181 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a288d9b-5bc4-46e5-b116-a4206aabb1f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:15.257164 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a288d9b-5bc4-46e5-b116-a4206aabb1f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:15.260526 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a288d9b-5bc4-46e5-b116-a4206aabb1f6 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:15.275060 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1868/3732] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:22:15.284573 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e26b0-389f-4fa0-b777-c4bc2dc4abeb admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:15.297947 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e26b0-389f-4fa0-b777-c4bc2dc4abeb admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:15.307768 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8bdef2-4ea7-4a5b-b717-b9f368d021fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:15.308664 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bdef2-4ea7-4a5b-b717-b9f368d021fa admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:15.308946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bdef2-4ea7-4a5b-b717-b9f368d021fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:15.309224 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bdef2-4ea7-4a5b-b717-b9f368d021fa admin admin] PATH_INFO: `/v3/projects/def690693f654dc8aff77fa04e78d762/users/e56c6d1395334b3ebe2293ba9d59fe9b/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:15.335630 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8bdef2-4ea7-4a5b-b717-b9f368d021fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=def690693f654dc8aff77fa04e78d762, user_id=e56c6d1395334b3ebe2293ba9d59fe9b, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:15.338764 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8bdef2-4ea7-4a5b-b717-b9f368d021fa admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:15.427013 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1865/3733] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:22:15 2022] PUT /identity/v3/projects/def690693f654dc8aff77fa04e78d762/users/e56c6d1395334b3ebe2293ba9d59fe9b/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:15.430225 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6a9c9-a777-41c7-93fe-36ccc45761a3 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:15.430522 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6a9c9-a777-41c7-93fe-36ccc45761a3 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:15.430810 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6a9c9-a777-41c7-93fe-36ccc45761a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:15.453118 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-b1d6a9c9-a777-41c7-93fe-36ccc45761a3 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:22:15.454405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b1d6a9c9-a777-41c7-93fe-36ccc45761a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:15.610002 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1869/3734] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:22:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:22:15.626341 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8bdef2-4ea7-4a5b-b717-b9f368d021fa admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:15.628566 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2e8bdef2-4ea7-4a5b-b717-b9f368d021fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:15.745871 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8bdef2-4ea7-4a5b-b717-b9f368d021fa admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:15.751046 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8496184-cd23-4025-a9a3-58149023f99c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:15.752425 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8496184-cd23-4025-a9a3-58149023f99c service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:15.752811 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8496184-cd23-4025-a9a3-58149023f99c service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:15.753203 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8496184-cd23-4025-a9a3-58149023f99c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:15.764909 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8496184-cd23-4025-a9a3-58149023f99c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:15.767040 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8496184-cd23-4025-a9a3-58149023f99c service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:15.786146 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1866/3735] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:22:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:22:17.645476 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36a04e-0655-4dc7-a79a-b1678040e9c6 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:17.647059 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36a04e-0655-4dc7-a79a-b1678040e9c6 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:17.647711 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36a04e-0655-4dc7-a79a-b1678040e9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:17.710870 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-2f36a04e-0655-4dc7-a79a-b1678040e9c6 None None] MFA Rules not processed for user `e56c6d1395334b3ebe2293ba9d59fe9b`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:22:17.710870 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2f36a04e-0655-4dc7-a79a-b1678040e9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:17.906334 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1870/3736] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:22:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:22:18.038776 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8496184-cd23-4025-a9a3-58149023f99c service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:18.043372 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a8496184-cd23-4025-a9a3-58149023f99c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:18.163902 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8496184-cd23-4025-a9a3-58149023f99c service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:18.171772 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828d73b-b247-44d4-a382-27fc2b88c41a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:18.172765 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828d73b-b247-44d4-a382-27fc2b88c41a service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:18.183943 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828d73b-b247-44d4-a382-27fc2b88c41a service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:18.184979 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828d73b-b247-44d4-a382-27fc2b88c41a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:18.207813 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828d73b-b247-44d4-a382-27fc2b88c41a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:18.211945 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828d73b-b247-44d4-a382-27fc2b88c41a service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:18.255230 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1867/3737] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:22:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:22:21.071882 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ba112-b320-4e10-b073-a8cae03137b1 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:21.072911 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ba112-b320-4e10-b073-a8cae03137b1 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:21.073380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ba112-b320-4e10-b073-a8cae03137b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:21.094732 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-792ba112-b320-4e10-b073-a8cae03137b1 None None] MFA Rules not processed for user `e56c6d1395334b3ebe2293ba9d59fe9b`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:22:21.104097 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-792ba112-b320-4e10-b073-a8cae03137b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:21.123350 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1871/3738] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:22:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:22:23.243910 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828d73b-b247-44d4-a382-27fc2b88c41a service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:23.246508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a828d73b-b247-44d4-a382-27fc2b88c41a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:23.267065 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828d73b-b247-44d4-a382-27fc2b88c41a service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:23.294212 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d576d78-f378-4787-a732-8872956cde77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:23.298559 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d576d78-f378-4787-a732-8872956cde77 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:23.299058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d576d78-f378-4787-a732-8872956cde77 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:23.299333 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d576d78-f378-4787-a732-8872956cde77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:23.301892 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9d576d78-f378-4787-a732-8872956cde77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:23.380381 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d576d78-f378-4787-a732-8872956cde77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:23.382763 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d576d78-f378-4787-a732-8872956cde77 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:23.393170 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1868/3739] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:22:23 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:22:28.004663 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ba112-b320-4e10-b073-a8cae03137b1 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:28.006229 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-792ba112-b320-4e10-b073-a8cae03137b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:28.032025 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792ba112-b320-4e10-b073-a8cae03137b1 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:28.037304 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b2131-3497-46b5-9a4a-7f25e1154387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:28.038511 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b2131-3497-46b5-9a4a-7f25e1154387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:28.038796 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b2131-3497-46b5-9a4a-7f25e1154387 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:28.039262 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b2131-3497-46b5-9a4a-7f25e1154387 admin admin] PATH_INFO: `/v3/users/02b78cd5fee5448b9e42dbb212f0de19` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:28.040792 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b2131-3497-46b5-9a4a-7f25e1154387 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02b78cd5fee5448b9e42dbb212f0de19)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:28.043126 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b2131-3497-46b5-9a4a-7f25e1154387 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:28.378140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4d8b2131-3497-46b5-9a4a-7f25e1154387 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02b78cd5fee5448b9e42dbb212f0de19'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:28.393657 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4d8b2131-3497-46b5-9a4a-7f25e1154387 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02b78cd5fee5448b9e42dbb212f0de19'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:28.457445 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4d8b2131-3497-46b5-9a4a-7f25e1154387 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02b78cd5fee5448b9e42dbb212f0de19'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:28.458644 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4d8b2131-3497-46b5-9a4a-7f25e1154387 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02b78cd5fee5448b9e42dbb212f0de19'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:28.467728 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4d8b2131-3497-46b5-9a4a-7f25e1154387 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02b78cd5fee5448b9e42dbb212f0de19'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:28.476558 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1872/3740] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:22:28 2022] DELETE /identity/v3/users/02b78cd5fee5448b9e42dbb212f0de19 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:28.812693 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d576d78-f378-4787-a732-8872956cde77 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:28.826984 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d576d78-f378-4787-a732-8872956cde77 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:28.890411 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5618f35b-8772-493d-9f6c-24cb6b73fb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:28.891319 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618f35b-8772-493d-9f6c-24cb6b73fb11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:28.891619 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618f35b-8772-493d-9f6c-24cb6b73fb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:28.891875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618f35b-8772-493d-9f6c-24cb6b73fb11 admin admin] PATH_INFO: `/v3/projects/8b8ae5530f6847478106f78f50e7314d` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:28.893704 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5618f35b-8772-493d-9f6c-24cb6b73fb11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b8ae5530f6847478106f78f50e7314d)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:28.896714 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5618f35b-8772-493d-9f6c-24cb6b73fb11 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:29.039439 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5618f35b-8772-493d-9f6c-24cb6b73fb11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b8ae5530f6847478106f78f50e7314d', 'request_id': 'req-5618f35b-8772-493d-9f6c-24cb6b73fb11'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:29.044899 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5618f35b-8772-493d-9f6c-24cb6b73fb11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b8ae5530f6847478106f78f50e7314d', 'request_id': 'req-5618f35b-8772-493d-9f6c-24cb6b73fb11'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:29.051598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5618f35b-8772-493d-9f6c-24cb6b73fb11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b8ae5530f6847478106f78f50e7314d', 'request_id': 'req-5618f35b-8772-493d-9f6c-24cb6b73fb11'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:29.141659 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5618f35b-8772-493d-9f6c-24cb6b73fb11 admin admin] The token cache is being invalidate because project 8b8ae5530f6847478106f78f50e7314d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:22:29.141981 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5618f35b-8772-493d-9f6c-24cb6b73fb11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:29.142685 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5618f35b-8772-493d-9f6c-24cb6b73fb11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:29.144288 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1869/3741] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:22:28 2022] DELETE /identity/v3/projects/8b8ae5530f6847478106f78f50e7314d => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:29.151333 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ec53b-583d-400d-b8b2-7605732c13d7 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:29.151843 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ec53b-583d-400d-b8b2-7605732c13d7 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:29.151934 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ec53b-583d-400d-b8b2-7605732c13d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:29.170693 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-208ec53b-583d-400d-b8b2-7605732c13d7 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:22:29.171913 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-208ec53b-583d-400d-b8b2-7605732c13d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:29.240018 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1873/3742] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:22:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:22:29.248655 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca2646-a3c7-4591-8253-1b31ee011de3 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:29.249000 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca2646-a3c7-4591-8253-1b31ee011de3 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:29.249280 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca2646-a3c7-4591-8253-1b31ee011de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:29.265729 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb13729-eca9-456a-98f2-e9e539b21d12 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:29.266127 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb13729-eca9-456a-98f2-e9e539b21d12 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:29.266513 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb13729-eca9-456a-98f2-e9e539b21d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:29.280594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-afca2646-a3c7-4591-8253-1b31ee011de3 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:22:29.282529 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-afca2646-a3c7-4591-8253-1b31ee011de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:29.293243 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1870/3743] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:22:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:22:29.297148 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca2646-a3c7-4591-8253-1b31ee011de3 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:29.302216 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-3fb13729-eca9-456a-98f2-e9e539b21d12 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:22:29.303940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3fb13729-eca9-456a-98f2-e9e539b21d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:29.308588 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca2646-a3c7-4591-8253-1b31ee011de3 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:29.313821 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8296c-b04f-4bca-ac66-0a4dd8fbc468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:29.314555 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8296c-b04f-4bca-ac66-0a4dd8fbc468 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:29.316957 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8296c-b04f-4bca-ac66-0a4dd8fbc468 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:29.316957 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8296c-b04f-4bca-ac66-0a4dd8fbc468 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:29.316957 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f8296c-b04f-4bca-ac66-0a4dd8fbc468 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:22:29.316957 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f8296c-b04f-4bca-ac66-0a4dd8fbc468 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:29.318380 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f8296c-b04f-4bca-ac66-0a4dd8fbc468 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:29.331116 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1871/3744] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:22:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:22:29.335086 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8296c-b04f-4bca-ac66-0a4dd8fbc468 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:29.345982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8296c-b04f-4bca-ac66-0a4dd8fbc468 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:29.351739 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d38072-3608-4c29-ba0e-a7a6c2e1717e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:29.352485 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d38072-3608-4c29-ba0e-a7a6c2e1717e admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:29.352838 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d38072-3608-4c29-ba0e-a7a6c2e1717e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:29.353439 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d38072-3608-4c29-ba0e-a7a6c2e1717e admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:29.354096 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d38072-3608-4c29-ba0e-a7a6c2e1717e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:29.356153 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d38072-3608-4c29-ba0e-a7a6c2e1717e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:29.374742 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1874/3745] 10.222.0.23 () {58 vars in 967 bytes} [Sat Apr 30 21:22:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:22:29.388097 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb13729-eca9-456a-98f2-e9e539b21d12 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:29.389314 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3fb13729-eca9-456a-98f2-e9e539b21d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:29.450620 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1872/3746] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:22:29 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:22:29.454557 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d38072-3608-4c29-ba0e-a7a6c2e1717e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:29.467690 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb13729-eca9-456a-98f2-e9e539b21d12 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:29.539982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d38072-3608-4c29-ba0e-a7a6c2e1717e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:29.543288 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2cf10-13fe-4cad-887a-8bef38bd8147 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:29.544065 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2cf10-13fe-4cad-887a-8bef38bd8147 service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:29.544425 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2cf10-13fe-4cad-887a-8bef38bd8147 service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:29.544777 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2cf10-13fe-4cad-887a-8bef38bd8147 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:29.545019 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72bfb94-0d3e-4f7b-95da-7a73de0233f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:29.546037 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bfb94-0d3e-4f7b-95da-7a73de0233f7 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:29.546253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bfb94-0d3e-4f7b-95da-7a73de0233f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:29.546540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bfb94-0d3e-4f7b-95da-7a73de0233f7 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:29.547230 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72bfb94-0d3e-4f7b-95da-7a73de0233f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:29.549214 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72bfb94-0d3e-4f7b-95da-7a73de0233f7 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:29.608249 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f2cf10-13fe-4cad-887a-8bef38bd8147 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:29.609887 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f2cf10-13fe-4cad-887a-8bef38bd8147 service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:29.618733 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1875/3747] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:22:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 30 21:22:29.635616 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1873/3748] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:22:29 2022] POST /identity/v3/users => generated 294 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:22:29.638412 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2cf10-13fe-4cad-887a-8bef38bd8147 service swift] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:29.649145 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2cf10-13fe-4cad-887a-8bef38bd8147 service swift] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:29.653857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a4b48-1df9-4787-8418-9926001fcb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:29.666339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a4b48-1df9-4787-8418-9926001fcb15 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:29.666339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a4b48-1df9-4787-8418-9926001fcb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:29.666339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a4b48-1df9-4787-8418-9926001fcb15 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:29.666339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a4b48-1df9-4787-8418-9926001fcb15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:29.666339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a4b48-1df9-4787-8418-9926001fcb15 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:29.668560 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1876/3749] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:22:29.672566 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72bfb94-0d3e-4f7b-95da-7a73de0233f7 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:29.683597 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72bfb94-0d3e-4f7b-95da-7a73de0233f7 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:29.688396 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc3802-0c5c-4ef3-b88e-95639fd10a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:29.689058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc3802-0c5c-4ef3-b88e-95639fd10a5c admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:29.689363 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc3802-0c5c-4ef3-b88e-95639fd10a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:29.689623 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc3802-0c5c-4ef3-b88e-95639fd10a5c admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:29.690385 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc3802-0c5c-4ef3-b88e-95639fd10a5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:29.691983 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc3802-0c5c-4ef3-b88e-95639fd10a5c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:29.702015 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1874/3750] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:22:29.706121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a4b48-1df9-4787-8418-9926001fcb15 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:29.716351 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a4b48-1df9-4787-8418-9926001fcb15 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:29.721340 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8dc4c4-2d26-436e-8d81-2c1940aed2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:29.722407 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8dc4c4-2d26-436e-8d81-2c1940aed2d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:29.722822 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8dc4c4-2d26-436e-8d81-2c1940aed2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:29.723106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8dc4c4-2d26-436e-8d81-2c1940aed2d2 admin admin] PATH_INFO: `/v3/projects/18c521a1be054741967d000f121446de/users/ebb0bdfe89f646568610312d0c0ef6ce/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:29.739369 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8dc4c4-2d26-436e-8d81-2c1940aed2d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18c521a1be054741967d000f121446de, user_id=ebb0bdfe89f646568610312d0c0ef6ce, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:29.742731 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8dc4c4-2d26-436e-8d81-2c1940aed2d2 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:29.824586 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1877/3751] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:22:29 2022] PUT /identity/v3/projects/18c521a1be054741967d000f121446de/users/ebb0bdfe89f646568610312d0c0ef6ce/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:29.827298 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14f66a-b748-4ed4-b4dd-12391dea6a09 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:29.827708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14f66a-b748-4ed4-b4dd-12391dea6a09 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:29.827983 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14f66a-b748-4ed4-b4dd-12391dea6a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:29.849337 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-6e14f66a-b748-4ed4-b4dd-12391dea6a09 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:22:29.851225 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6e14f66a-b748-4ed4-b4dd-12391dea6a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:29.910029 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1875/3752] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:22:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:22:29.920075 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8dc4c4-2d26-436e-8d81-2c1940aed2d2 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:29.921935 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-df8dc4c4-2d26-436e-8d81-2c1940aed2d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:29.981722 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8dc4c4-2d26-436e-8d81-2c1940aed2d2 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:29.985599 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d7688-2cb4-484c-a0e1-ac9b2f926a83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:29.986310 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d7688-2cb4-484c-a0e1-ac9b2f926a83 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:29.986599 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d7688-2cb4-484c-a0e1-ac9b2f926a83 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:29.986879 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d7688-2cb4-484c-a0e1-ac9b2f926a83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:29.996039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d7688-2cb4-484c-a0e1-ac9b2f926a83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:29.997485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d7688-2cb4-484c-a0e1-ac9b2f926a83 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:30.007229 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1878/3753] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:22:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:22:31.297512 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2c2eb-7074-45ec-9114-6a10c0793242 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:31.298498 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2c2eb-7074-45ec-9114-6a10c0793242 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:31.298924 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2c2eb-7074-45ec-9114-6a10c0793242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:31.332248 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-86d2c2eb-7074-45ec-9114-6a10c0793242 None None] MFA Rules not processed for user `ebb0bdfe89f646568610312d0c0ef6ce`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:22:31.333288 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-86d2c2eb-7074-45ec-9114-6a10c0793242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:31.424069 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1876/3754] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:22:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:22:31.807574 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4fc72c-fd90-4120-8179-ef5606e2f04e None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:31.808102 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4fc72c-fd90-4120-8179-ef5606e2f04e None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:31.808102 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4fc72c-fd90-4120-8179-ef5606e2f04e None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:31.809471 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1879/3755] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:22:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:22:31.815669 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f35dc3-d54a-42c2-b215-6926bf992867 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:31.816046 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f35dc3-d54a-42c2-b215-6926bf992867 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:31.816392 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f35dc3-d54a-42c2-b215-6926bf992867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:31.851833 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-70f35dc3-d54a-42c2-b215-6926bf992867 None None] MFA Rules not processed for user `4ad3f89b7037413a83c7905cef263b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:22:31.853601 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-70f35dc3-d54a-42c2-b215-6926bf992867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:31.941089 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1877/3756] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:22:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:22:31.968215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4fc72c-fd90-4120-8179-ef5606e2f04e None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:31.971747 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1f4fc72c-fd90-4120-8179-ef5606e2f04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:31.988209 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4fc72c-fd90-4120-8179-ef5606e2f04e None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:31.994277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f976bb-4ad9-4919-b3c3-c7a4446fe45f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:31.995477 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f976bb-4ad9-4919-b3c3-c7a4446fe45f service placement] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:31.995835 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f976bb-4ad9-4919-b3c3-c7a4446fe45f service placement] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:31.996179 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f976bb-4ad9-4919-b3c3-c7a4446fe45f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:32.005976 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f976bb-4ad9-4919-b3c3-c7a4446fe45f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:32.008254 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f976bb-4ad9-4919-b3c3-c7a4446fe45f service placement] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:32.021216 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1880/3757] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:22:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:22:32.325420 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f35dc3-d54a-42c2-b215-6926bf992867 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:32.337258 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f35dc3-d54a-42c2-b215-6926bf992867 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:32.350111 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5be86-03f9-4433-8e4e-7bdb0452ac13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:32.351563 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5be86-03f9-4433-8e4e-7bdb0452ac13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:32.351851 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5be86-03f9-4433-8e4e-7bdb0452ac13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:32.352618 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5be86-03f9-4433-8e4e-7bdb0452ac13 admin admin] PATH_INFO: `/v3/users/ebb0bdfe89f646568610312d0c0ef6ce` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:32.354009 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5be86-03f9-4433-8e4e-7bdb0452ac13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebb0bdfe89f646568610312d0c0ef6ce)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:32.357087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5be86-03f9-4433-8e4e-7bdb0452ac13 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:32.610613 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c5a5be86-03f9-4433-8e4e-7bdb0452ac13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebb0bdfe89f646568610312d0c0ef6ce'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:32.621747 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c13a7-ca83-4b3a-967a-83301548f2ab None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:32.622140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c13a7-ca83-4b3a-967a-83301548f2ab None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:32.622727 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c13a7-ca83-4b3a-967a-83301548f2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:32.623401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c5a5be86-03f9-4433-8e4e-7bdb0452ac13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebb0bdfe89f646568610312d0c0ef6ce'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:32.641465 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-707c13a7-ca83-4b3a-967a-83301548f2ab None None] MFA Rules not processed for user `2f5eafa970bd4247bdaef1cda747c3fc`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:22:32.642725 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-707c13a7-ca83-4b3a-967a-83301548f2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:32.666000 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c5a5be86-03f9-4433-8e4e-7bdb0452ac13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebb0bdfe89f646568610312d0c0ef6ce'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:32.673227 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c5a5be86-03f9-4433-8e4e-7bdb0452ac13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebb0bdfe89f646568610312d0c0ef6ce'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:32.673957 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c5a5be86-03f9-4433-8e4e-7bdb0452ac13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebb0bdfe89f646568610312d0c0ef6ce'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:32.681117 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1878/3758] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:22:32 2022] DELETE /identity/v3/users/ebb0bdfe89f646568610312d0c0ef6ce => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:32.698932 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1881/3759] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:22:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:22:33.092675 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5be86-03f9-4433-8e4e-7bdb0452ac13 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:33.094303 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c5a5be86-03f9-4433-8e4e-7bdb0452ac13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:33.162120 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5be86-03f9-4433-8e4e-7bdb0452ac13 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:33.166757 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade983ef-6b42-4039-bcd1-8e5e8ab26aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:33.167630 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade983ef-6b42-4039-bcd1-8e5e8ab26aff admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:33.167909 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade983ef-6b42-4039-bcd1-8e5e8ab26aff admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:33.168181 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade983ef-6b42-4039-bcd1-8e5e8ab26aff admin admin] PATH_INFO: `/v3/projects/18c521a1be054741967d000f121446de` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:33.169416 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade983ef-6b42-4039-bcd1-8e5e8ab26aff admin admin] RBAC: Authorizing `identity:delete_project(project_id=18c521a1be054741967d000f121446de)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:33.171375 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade983ef-6b42-4039-bcd1-8e5e8ab26aff admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:33.319977 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ade983ef-6b42-4039-bcd1-8e5e8ab26aff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18c521a1be054741967d000f121446de', 'request_id': 'req-ade983ef-6b42-4039-bcd1-8e5e8ab26aff'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:33.326777 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ade983ef-6b42-4039-bcd1-8e5e8ab26aff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18c521a1be054741967d000f121446de', 'request_id': 'req-ade983ef-6b42-4039-bcd1-8e5e8ab26aff'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:33.333746 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ade983ef-6b42-4039-bcd1-8e5e8ab26aff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18c521a1be054741967d000f121446de', 'request_id': 'req-ade983ef-6b42-4039-bcd1-8e5e8ab26aff'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:33.409009 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ade983ef-6b42-4039-bcd1-8e5e8ab26aff admin admin] The token cache is being invalidate because project 18c521a1be054741967d000f121446de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:22:33.409203 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ade983ef-6b42-4039-bcd1-8e5e8ab26aff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:33.409871 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ade983ef-6b42-4039-bcd1-8e5e8ab26aff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:33.411434 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1879/3760] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:22:33 2022] DELETE /identity/v3/projects/18c521a1be054741967d000f121446de => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:33.419193 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0f18a-9a09-4cf3-a366-6b8b5069c0b5 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:33.419722 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0f18a-9a09-4cf3-a366-6b8b5069c0b5 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:33.419722 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0f18a-9a09-4cf3-a366-6b8b5069c0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:33.441733 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-12f0f18a-9a09-4cf3-a366-6b8b5069c0b5 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:22:33.450248 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-12f0f18a-9a09-4cf3-a366-6b8b5069c0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:33.521307 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1882/3761] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:22:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:22:33.529348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2e62d-c689-46d5-a2a7-f9c2cd7bc410 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:33.529886 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2e62d-c689-46d5-a2a7-f9c2cd7bc410 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:33.530165 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2e62d-c689-46d5-a2a7-f9c2cd7bc410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:33.554206 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-31b2e62d-c689-46d5-a2a7-f9c2cd7bc410 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:22:33.555347 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-31b2e62d-c689-46d5-a2a7-f9c2cd7bc410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:33.569835 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1880/3762] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:22:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:22:33.571449 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0f18a-9a09-4cf3-a366-6b8b5069c0b5 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:33.582080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0f18a-9a09-4cf3-a366-6b8b5069c0b5 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:33.587387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49361420-7e18-44ab-bbcb-3ecb68a0954b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:33.588331 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49361420-7e18-44ab-bbcb-3ecb68a0954b admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:33.588609 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49361420-7e18-44ab-bbcb-3ecb68a0954b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:33.589043 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49361420-7e18-44ab-bbcb-3ecb68a0954b admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:33.589801 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49361420-7e18-44ab-bbcb-3ecb68a0954b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:22:33.590337 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49361420-7e18-44ab-bbcb-3ecb68a0954b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:33.592508 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49361420-7e18-44ab-bbcb-3ecb68a0954b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:33.605729 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1883/3763] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:22:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:22:33.610684 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2e62d-c689-46d5-a2a7-f9c2cd7bc410 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:33.623406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2e62d-c689-46d5-a2a7-f9c2cd7bc410 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:33.630936 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c89f93-10af-40e9-b42f-c063cf2fea9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:33.632331 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c89f93-10af-40e9-b42f-c063cf2fea9c admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:33.632793 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c89f93-10af-40e9-b42f-c063cf2fea9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:33.633683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c89f93-10af-40e9-b42f-c063cf2fea9c admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:33.634737 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c89f93-10af-40e9-b42f-c063cf2fea9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:33.637357 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c89f93-10af-40e9-b42f-c063cf2fea9c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:33.719373 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1881/3764] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:22:33 2022] POST /identity/v3/projects => generated 369 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:22:33.720277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49361420-7e18-44ab-bbcb-3ecb68a0954b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:33.733449 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49361420-7e18-44ab-bbcb-3ecb68a0954b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:33.807621 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc92e2-1e04-4807-947a-3d86c80a9fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:33.808310 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc92e2-1e04-4807-947a-3d86c80a9fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:33.808625 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc92e2-1e04-4807-947a-3d86c80a9fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:33.808902 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc92e2-1e04-4807-947a-3d86c80a9fe8 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:33.811896 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc92e2-1e04-4807-947a-3d86c80a9fe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:33.811896 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc92e2-1e04-4807-947a-3d86c80a9fe8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:33.913789 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1884/3765] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:22:33 2022] POST /identity/v3/users => generated 285 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:22:33.916941 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c89f93-10af-40e9-b42f-c063cf2fea9c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:33.928620 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c89f93-10af-40e9-b42f-c063cf2fea9c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:33.934823 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa6d66-26e6-421b-8354-b24fc916f43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:33.935599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa6d66-26e6-421b-8354-b24fc916f43e admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:33.935953 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa6d66-26e6-421b-8354-b24fc916f43e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:33.936325 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa6d66-26e6-421b-8354-b24fc916f43e admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:33.937135 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa6d66-26e6-421b-8354-b24fc916f43e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:33.938907 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa6d66-26e6-421b-8354-b24fc916f43e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:33.953277 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1882/3766] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:22:33.955686 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc92e2-1e04-4807-947a-3d86c80a9fe8 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:33.965773 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc92e2-1e04-4807-947a-3d86c80a9fe8 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:33.970814 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8d924-649d-4291-9ea8-c75bd9d6064c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:33.971658 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8d924-649d-4291-9ea8-c75bd9d6064c admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:33.971962 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8d924-649d-4291-9ea8-c75bd9d6064c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:33.972468 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8d924-649d-4291-9ea8-c75bd9d6064c admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:33.973736 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8d924-649d-4291-9ea8-c75bd9d6064c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:33.975046 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8d924-649d-4291-9ea8-c75bd9d6064c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:33.987378 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1885/3767] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:22:33.991537 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa6d66-26e6-421b-8354-b24fc916f43e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:34.005672 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa6d66-26e6-421b-8354-b24fc916f43e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:34.010982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb2c27c-4e67-4f85-b34d-d940e97d2f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:34.012692 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2c27c-4e67-4f85-b34d-d940e97d2f31 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:34.012692 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2c27c-4e67-4f85-b34d-d940e97d2f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:34.012692 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2c27c-4e67-4f85-b34d-d940e97d2f31 admin admin] PATH_INFO: `/v3/projects/ebce3b7cc7a7481688e5dcdfdd1c41af/users/50da71bb739f42d183523eda91aa5562/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:34.029050 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb2c27c-4e67-4f85-b34d-d940e97d2f31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebce3b7cc7a7481688e5dcdfdd1c41af, user_id=50da71bb739f42d183523eda91aa5562, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:34.031746 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb2c27c-4e67-4f85-b34d-d940e97d2f31 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:34.135074 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1883/3768] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:22:33 2022] PUT /identity/v3/projects/ebce3b7cc7a7481688e5dcdfdd1c41af/users/50da71bb739f42d183523eda91aa5562/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:34.145445 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fc9c7-5141-423f-b9fe-f04b40cf994f None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:34.145937 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fc9c7-5141-423f-b9fe-f04b40cf994f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:34.146298 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fc9c7-5141-423f-b9fe-f04b40cf994f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:34.176214 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-605fc9c7-5141-423f-b9fe-f04b40cf994f None None] MFA Rules not processed for user `50da71bb739f42d183523eda91aa5562`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:22:34.177523 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-605fc9c7-5141-423f-b9fe-f04b40cf994f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:34.252035 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1886/3769] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:22:34 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:22:34.257330 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb2c27c-4e67-4f85-b34d-d940e97d2f31 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:34.340726 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb2c27c-4e67-4f85-b34d-d940e97d2f31 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:34.345502 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51574a5a-78c6-43b7-ba6d-89a5400055f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:34.346278 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51574a5a-78c6-43b7-ba6d-89a5400055f7 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:34.346562 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51574a5a-78c6-43b7-ba6d-89a5400055f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:34.346839 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51574a5a-78c6-43b7-ba6d-89a5400055f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:34.347524 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51574a5a-78c6-43b7-ba6d-89a5400055f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:34.349449 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51574a5a-78c6-43b7-ba6d-89a5400055f7 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:34.499792 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1884/3770] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:22:34 2022] POST /identity/v3/projects => generated 367 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:22:34.501414 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605fc9c7-5141-423f-b9fe-f04b40cf994f None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:34.513121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605fc9c7-5141-423f-b9fe-f04b40cf994f None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:34.567931 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc88965-d267-4f1a-b49b-ad53278e32bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:34.568596 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc88965-d267-4f1a-b49b-ad53278e32bf admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:34.569489 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc88965-d267-4f1a-b49b-ad53278e32bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:34.569785 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc88965-d267-4f1a-b49b-ad53278e32bf admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:34.570467 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc88965-d267-4f1a-b49b-ad53278e32bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:34.572466 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc88965-d267-4f1a-b49b-ad53278e32bf admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:34.663480 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1887/3771] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:22:34 2022] POST /identity/v3/users => generated 290 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:22:34.664736 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51574a5a-78c6-43b7-ba6d-89a5400055f7 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:34.674987 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51574a5a-78c6-43b7-ba6d-89a5400055f7 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:34.680741 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf5531-2b8c-47f9-a82d-9d0490f3b971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:34.681413 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf5531-2b8c-47f9-a82d-9d0490f3b971 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:34.681712 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf5531-2b8c-47f9-a82d-9d0490f3b971 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:34.682065 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf5531-2b8c-47f9-a82d-9d0490f3b971 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:34.682790 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf5531-2b8c-47f9-a82d-9d0490f3b971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:34.684392 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf5531-2b8c-47f9-a82d-9d0490f3b971 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:34.696057 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1885/3772] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:22:34.700440 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc88965-d267-4f1a-b49b-ad53278e32bf admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:34.711601 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc88965-d267-4f1a-b49b-ad53278e32bf admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:34.716427 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7267b89-e6ef-45db-816d-140cfec2374f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:34.717364 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7267b89-e6ef-45db-816d-140cfec2374f admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:34.717641 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7267b89-e6ef-45db-816d-140cfec2374f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:34.717964 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7267b89-e6ef-45db-816d-140cfec2374f admin admin] PATH_INFO: `/v3/projects/94ad12bf94b74559943c10d48e500a7f/users/36fc5d7bb3e44728956b56605920a2bd/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:34.734035 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7267b89-e6ef-45db-816d-140cfec2374f admin admin] RBAC: Authorizing `identity:create_grant(project_id=94ad12bf94b74559943c10d48e500a7f, user_id=36fc5d7bb3e44728956b56605920a2bd, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:34.736616 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7267b89-e6ef-45db-816d-140cfec2374f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:34.826590 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1888/3773] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:22:34 2022] PUT /identity/v3/projects/94ad12bf94b74559943c10d48e500a7f/users/36fc5d7bb3e44728956b56605920a2bd/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:34.832297 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf5531-2b8c-47f9-a82d-9d0490f3b971 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:34.843019 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf5531-2b8c-47f9-a82d-9d0490f3b971 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:34.901240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df026d-9da9-4006-960c-e117dcf41922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:34.902049 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df026d-9da9-4006-960c-e117dcf41922 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:34.902338 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df026d-9da9-4006-960c-e117dcf41922 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:34.902618 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df026d-9da9-4006-960c-e117dcf41922 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:34.903376 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df026d-9da9-4006-960c-e117dcf41922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:34.905057 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df026d-9da9-4006-960c-e117dcf41922 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:34.916429 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1886/3774] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:22:34.920423 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7267b89-e6ef-45db-816d-140cfec2374f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:34.932171 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7267b89-e6ef-45db-816d-140cfec2374f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:34.939036 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa66d9-df3d-4eb3-b4fa-f3cd45a14739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:34.940080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa66d9-df3d-4eb3-b4fa-f3cd45a14739 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:34.940440 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa66d9-df3d-4eb3-b4fa-f3cd45a14739 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:34.940783 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa66d9-df3d-4eb3-b4fa-f3cd45a14739 admin admin] PATH_INFO: `/v3/projects/94ad12bf94b74559943c10d48e500a7f/users/36fc5d7bb3e44728956b56605920a2bd/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:34.944166 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa66d9-df3d-4eb3-b4fa-f3cd45a14739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94ad12bf94b74559943c10d48e500a7f, user_id=36fc5d7bb3e44728956b56605920a2bd, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:34.947957 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa66d9-df3d-4eb3-b4fa-f3cd45a14739 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:34.972139 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1889/3775] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:22:34 2022] PUT /identity/v3/projects/94ad12bf94b74559943c10d48e500a7f/users/36fc5d7bb3e44728956b56605920a2bd/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:34.976053 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dd364-44ab-4424-ae9e-b044bca324dc None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:34.976445 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dd364-44ab-4424-ae9e-b044bca324dc None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:34.976822 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dd364-44ab-4424-ae9e-b044bca324dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:35.005947 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-e27dd364-44ab-4424-ae9e-b044bca324dc None None] MFA Rules not processed for user `36fc5d7bb3e44728956b56605920a2bd`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:22:35.007811 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e27dd364-44ab-4424-ae9e-b044bca324dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:35.087252 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1887/3776] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:22:34 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:22:35.091851 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa66d9-df3d-4eb3-b4fa-f3cd45a14739 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:35.102656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa66d9-df3d-4eb3-b4fa-f3cd45a14739 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:35.107531 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7984eb-95cf-4190-9c22-d222c7e56deb tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fc5d7bb3e44728956b56605920a2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94ad12bf94b74559943c10d48e500a7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:35.108207 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7984eb-95cf-4190-9c22-d222c7e56deb tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:35.108488 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7984eb-95cf-4190-9c22-d222c7e56deb tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:35.108762 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7984eb-95cf-4190-9c22-d222c7e56deb tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:35.109940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7984eb-95cf-4190-9c22-d222c7e56deb tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:35.110579 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-eb7984eb-95cf-4190-9c22-d222c7e56deb tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:22:35.110579 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:22:35.110579 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:22:35.111490 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7984eb-95cf-4190-9c22-d222c7e56deb tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:35.199740 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1890/3777] 10.222.0.23 () {60 vars in 1148 bytes} [Sat Apr 30 21:22:35 2022] POST /identity/v3/domains => generated 275 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:22:35.204427 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27dd364-44ab-4424-ae9e-b044bca324dc None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:35.213885 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27dd364-44ab-4424-ae9e-b044bca324dc None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:35.270856 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b20be-acd6-4b9c-842e-8ffeb2708c41 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fc5d7bb3e44728956b56605920a2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94ad12bf94b74559943c10d48e500a7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:35.271955 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b20be-acd6-4b9c-842e-8ffeb2708c41 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:35.272408 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b20be-acd6-4b9c-842e-8ffeb2708c41 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:35.272850 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b20be-acd6-4b9c-842e-8ffeb2708c41 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] PATH_INFO: `/v3/groups` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:35.273701 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248b20be-acd6-4b9c-842e-8ffeb2708c41 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:35.275162 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-248b20be-acd6-4b9c-842e-8ffeb2708c41 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:22:35.275162 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:22:35.275162 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:22:35.276869 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248b20be-acd6-4b9c-842e-8ffeb2708c41 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:35.350310 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1888/3778] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:22:35 2022] POST /identity/v3/groups => generated 280 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:22:35.351416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7984eb-95cf-4190-9c22-d222c7e56deb tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:35.363899 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7984eb-95cf-4190-9c22-d222c7e56deb tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:35.370334 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd452230-6a3d-424e-97b9-6174d6b0a069 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fc5d7bb3e44728956b56605920a2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94ad12bf94b74559943c10d48e500a7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:35.371196 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd452230-6a3d-424e-97b9-6174d6b0a069 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:35.371479 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd452230-6a3d-424e-97b9-6174d6b0a069 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:35.371755 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd452230-6a3d-424e-97b9-6174d6b0a069 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] PATH_INFO: `/v3/groups/5d9ee6cb109a44e9867e51d987b25cd6` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:35.383293 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd452230-6a3d-424e-97b9-6174d6b0a069 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorizing `identity:update_group(group_id=5d9ee6cb109a44e9867e51d987b25cd6)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:35.384387 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-bd452230-6a3d-424e-97b9-6174d6b0a069 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:22:35.384387 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:22:35.384387 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:22:35.385636 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd452230-6a3d-424e-97b9-6174d6b0a069 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:35.483992 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1891/3779] 10.222.0.23 () {60 vars in 1246 bytes} [Sat Apr 30 21:22:35 2022] PATCH /identity/v3/groups/5d9ee6cb109a44e9867e51d987b25cd6 => generated 291 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:22:35.488201 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b20be-acd6-4b9c-842e-8ffeb2708c41 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:35.498788 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b20be-acd6-4b9c-842e-8ffeb2708c41 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:35.504878 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3206dfd-3f36-47de-b11d-6d7b885aa7f9 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fc5d7bb3e44728956b56605920a2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94ad12bf94b74559943c10d48e500a7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:35.505775 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3206dfd-3f36-47de-b11d-6d7b885aa7f9 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:35.506047 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3206dfd-3f36-47de-b11d-6d7b885aa7f9 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:35.506321 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3206dfd-3f36-47de-b11d-6d7b885aa7f9 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] PATH_INFO: `/v3/groups/5d9ee6cb109a44e9867e51d987b25cd6` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:35.512686 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3206dfd-3f36-47de-b11d-6d7b885aa7f9 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorizing `identity:get_group(group_id=5d9ee6cb109a44e9867e51d987b25cd6)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:35.515310 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-c3206dfd-3f36-47de-b11d-6d7b885aa7f9 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:22:35.515310 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:22:35.515310 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:22:35.515310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3206dfd-3f36-47de-b11d-6d7b885aa7f9 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:35.516645 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1889/3780] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:22:35 2022] GET /identity/v3/groups/5d9ee6cb109a44e9867e51d987b25cd6 => generated 291 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:22:35.520847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd452230-6a3d-424e-97b9-6174d6b0a069 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:35.531041 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd452230-6a3d-424e-97b9-6174d6b0a069 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:35.536536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e582d-6577-4166-840f-40aeb5189e9d tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fc5d7bb3e44728956b56605920a2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94ad12bf94b74559943c10d48e500a7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:35.537945 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e582d-6577-4166-840f-40aeb5189e9d tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:35.538230 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e582d-6577-4166-840f-40aeb5189e9d tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:35.538523 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e582d-6577-4166-840f-40aeb5189e9d tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] PATH_INFO: `/v3/groups/5d9ee6cb109a44e9867e51d987b25cd6` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:35.539759 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e582d-6577-4166-840f-40aeb5189e9d tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorizing `identity:update_group(group_id=5d9ee6cb109a44e9867e51d987b25cd6)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:35.541708 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e582d-6577-4166-840f-40aeb5189e9d tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:35.672359 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1892/3781] 10.222.0.23 () {60 vars in 1245 bytes} [Sat Apr 30 21:22:35 2022] PATCH /identity/v3/groups/5d9ee6cb109a44e9867e51d987b25cd6 => generated 307 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:22:35.676986 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3206dfd-3f36-47de-b11d-6d7b885aa7f9 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:35.687668 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3206dfd-3f36-47de-b11d-6d7b885aa7f9 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:35.692763 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8ba94-9a13-482e-9eec-b19bf20ec445 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fc5d7bb3e44728956b56605920a2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94ad12bf94b74559943c10d48e500a7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:35.694146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8ba94-9a13-482e-9eec-b19bf20ec445 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:35.694439 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8ba94-9a13-482e-9eec-b19bf20ec445 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:35.694713 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8ba94-9a13-482e-9eec-b19bf20ec445 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] PATH_INFO: `/v3/groups/5d9ee6cb109a44e9867e51d987b25cd6` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:35.700268 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8ba94-9a13-482e-9eec-b19bf20ec445 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorizing `identity:delete_group(group_id=5d9ee6cb109a44e9867e51d987b25cd6)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:35.704724 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-0be8ba94-9a13-482e-9eec-b19bf20ec445 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:22:35.704724 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:22:35.704724 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:22:35.704724 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8ba94-9a13-482e-9eec-b19bf20ec445 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:35.847930 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1890/3782] 10.222.0.23 () {58 vars in 1226 bytes} [Sat Apr 30 21:22:35 2022] DELETE /identity/v3/groups/5d9ee6cb109a44e9867e51d987b25cd6 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:35.853145 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e582d-6577-4166-840f-40aeb5189e9d tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:35.864560 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e582d-6577-4166-840f-40aeb5189e9d tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:35.943079 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63500ecd-8e3d-4351-937b-e66f6d76e2a9 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fc5d7bb3e44728956b56605920a2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94ad12bf94b74559943c10d48e500a7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:35.945195 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63500ecd-8e3d-4351-937b-e66f6d76e2a9 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:35.945677 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63500ecd-8e3d-4351-937b-e66f6d76e2a9 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:35.946238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63500ecd-8e3d-4351-937b-e66f6d76e2a9 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] PATH_INFO: `/v3/groups` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:35.951507 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63500ecd-8e3d-4351-937b-e66f6d76e2a9 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:35.951507 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-63500ecd-8e3d-4351-937b-e66f6d76e2a9 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:22:35.951507 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:22:35.951507 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:22:35.951507 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63500ecd-8e3d-4351-937b-e66f6d76e2a9 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:36.032039 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1893/3783] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:22:35 2022] POST /identity/v3/groups => generated 327 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:22:36.038183 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8ba94-9a13-482e-9eec-b19bf20ec445 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:36.051148 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8ba94-9a13-482e-9eec-b19bf20ec445 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:36.057423 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f0d6d-bc12-46cd-85ad-7a43e6e24f1c tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fc5d7bb3e44728956b56605920a2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94ad12bf94b74559943c10d48e500a7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:36.060279 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f0d6d-bc12-46cd-85ad-7a43e6e24f1c tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:36.060771 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f0d6d-bc12-46cd-85ad-7a43e6e24f1c tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:36.060963 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f0d6d-bc12-46cd-85ad-7a43e6e24f1c tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:36.062207 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f0d6d-bc12-46cd-85ad-7a43e6e24f1c tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:36.063718 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f0d6d-bc12-46cd-85ad-7a43e6e24f1c tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:36.160802 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1891/3784] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:22:36 2022] POST /identity/v3/users => generated 321 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:22:36.165429 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63500ecd-8e3d-4351-937b-e66f6d76e2a9 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:36.176659 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63500ecd-8e3d-4351-937b-e66f6d76e2a9 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:36.181441 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04411943-c5e2-4def-8ebb-8f3462f4d854 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fc5d7bb3e44728956b56605920a2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94ad12bf94b74559943c10d48e500a7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:36.182391 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04411943-c5e2-4def-8ebb-8f3462f4d854 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:36.182677 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04411943-c5e2-4def-8ebb-8f3462f4d854 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:36.182954 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04411943-c5e2-4def-8ebb-8f3462f4d854 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] PATH_INFO: `/v3/groups/a60d63c028b1423fa9e38ed05fffdfcb/users/7ae2769b3cc540ee95cf3507ecc70162` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:36.203411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04411943-c5e2-4def-8ebb-8f3462f4d854 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=a60d63c028b1423fa9e38ed05fffdfcb, user_id=7ae2769b3cc540ee95cf3507ecc70162)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:36.204732 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-04411943-c5e2-4def-8ebb-8f3462f4d854 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:22:36.204732 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:22:36.204732 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:22:36.205815 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04411943-c5e2-4def-8ebb-8f3462f4d854 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:36.293382 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1894/3785] 10.222.0.23 () {60 vars in 1359 bytes} [Sat Apr 30 21:22:36 2022] PUT /identity/v3/groups/a60d63c028b1423fa9e38ed05fffdfcb/users/7ae2769b3cc540ee95cf3507ecc70162 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:22:36.294791 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f0d6d-bc12-46cd-85ad-7a43e6e24f1c tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:36.306041 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f0d6d-bc12-46cd-85ad-7a43e6e24f1c tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:36.372933 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c31c3-3ca1-485d-b4e8-3a8cd1667da5 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fc5d7bb3e44728956b56605920a2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94ad12bf94b74559943c10d48e500a7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:36.373593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c31c3-3ca1-485d-b4e8-3a8cd1667da5 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:36.373933 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c31c3-3ca1-485d-b4e8-3a8cd1667da5 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:36.374215 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c31c3-3ca1-485d-b4e8-3a8cd1667da5 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:36.374902 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c31c3-3ca1-485d-b4e8-3a8cd1667da5 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:36.376956 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c31c3-3ca1-485d-b4e8-3a8cd1667da5 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:36.525206 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1892/3786] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:22:36 2022] POST /identity/v3/users => generated 321 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:22:36.526480 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04411943-c5e2-4def-8ebb-8f3462f4d854 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:36.538098 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04411943-c5e2-4def-8ebb-8f3462f4d854 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:36.542647 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e0533-511f-448c-904b-17eb07ae8de1 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fc5d7bb3e44728956b56605920a2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94ad12bf94b74559943c10d48e500a7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:36.543537 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e0533-511f-448c-904b-17eb07ae8de1 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:36.543823 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e0533-511f-448c-904b-17eb07ae8de1 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:36.544102 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e0533-511f-448c-904b-17eb07ae8de1 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] PATH_INFO: `/v3/groups/a60d63c028b1423fa9e38ed05fffdfcb/users/670fd7bcf72f4367afaf715c104cd8d3` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:36.559891 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639e0533-511f-448c-904b-17eb07ae8de1 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=a60d63c028b1423fa9e38ed05fffdfcb, user_id=670fd7bcf72f4367afaf715c104cd8d3)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:36.562113 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639e0533-511f-448c-904b-17eb07ae8de1 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:36.655978 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1895/3787] 10.222.0.23 () {60 vars in 1359 bytes} [Sat Apr 30 21:22:36 2022] PUT /identity/v3/groups/a60d63c028b1423fa9e38ed05fffdfcb/users/670fd7bcf72f4367afaf715c104cd8d3 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:36.660362 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c31c3-3ca1-485d-b4e8-3a8cd1667da5 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:36.671448 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c31c3-3ca1-485d-b4e8-3a8cd1667da5 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:36.728750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f0a32-925b-4cac-877c-ba987416143d tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fc5d7bb3e44728956b56605920a2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94ad12bf94b74559943c10d48e500a7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:36.729436 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f0a32-925b-4cac-877c-ba987416143d tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:36.729740 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f0a32-925b-4cac-877c-ba987416143d tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:36.730058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f0a32-925b-4cac-877c-ba987416143d tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:36.730748 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f0a32-925b-4cac-877c-ba987416143d tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:36.732826 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f0a32-925b-4cac-877c-ba987416143d tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:36.807232 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1893/3788] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:22:36 2022] POST /identity/v3/users => generated 323 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:22:36.811495 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e0533-511f-448c-904b-17eb07ae8de1 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:36.821953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e0533-511f-448c-904b-17eb07ae8de1 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:36.826778 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ee3e6-349e-4c30-a099-af0350ca52ef tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fc5d7bb3e44728956b56605920a2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94ad12bf94b74559943c10d48e500a7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:36.827802 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ee3e6-349e-4c30-a099-af0350ca52ef tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:36.828202 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ee3e6-349e-4c30-a099-af0350ca52ef tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:36.828552 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ee3e6-349e-4c30-a099-af0350ca52ef tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] PATH_INFO: `/v3/groups/a60d63c028b1423fa9e38ed05fffdfcb/users/c13ed174bd374fa58213e44d8d7a8b26` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:36.844692 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ee3e6-349e-4c30-a099-af0350ca52ef tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=a60d63c028b1423fa9e38ed05fffdfcb, user_id=c13ed174bd374fa58213e44d8d7a8b26)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:36.846676 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ee3e6-349e-4c30-a099-af0350ca52ef tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:36.923740 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1896/3789] 10.222.0.23 () {60 vars in 1359 bytes} [Sat Apr 30 21:22:36 2022] PUT /identity/v3/groups/a60d63c028b1423fa9e38ed05fffdfcb/users/c13ed174bd374fa58213e44d8d7a8b26 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:36.928635 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f0a32-925b-4cac-877c-ba987416143d tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:36.940122 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f0a32-925b-4cac-877c-ba987416143d tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:37.011312 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1881e-a282-4287-aaf8-20c0134ce69a tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fc5d7bb3e44728956b56605920a2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94ad12bf94b74559943c10d48e500a7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:37.012164 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1881e-a282-4287-aaf8-20c0134ce69a tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:37.012445 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1881e-a282-4287-aaf8-20c0134ce69a tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:37.012719 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1881e-a282-4287-aaf8-20c0134ce69a tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] PATH_INFO: `/v3/groups/a60d63c028b1423fa9e38ed05fffdfcb/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:37.014005 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1881e-a282-4287-aaf8-20c0134ce69a tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=a60d63c028b1423fa9e38ed05fffdfcb)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:37.015203 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-d6b1881e-a282-4287-aaf8-20c0134ce69a tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:22:37.015203 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:22:37.015203 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:22:37.018291 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1881e-a282-4287-aaf8-20c0134ce69a tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:37.035105 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1894/3790] 10.222.0.23 () {58 vars in 1241 bytes} [Sat Apr 30 21:22:36 2022] GET /identity/v3/groups/a60d63c028b1423fa9e38ed05fffdfcb/users => generated 1081 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:22:37.039286 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ee3e6-349e-4c30-a099-af0350ca52ef tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:37.050278 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ee3e6-349e-4c30-a099-af0350ca52ef tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:37.055060 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98498dca-2ce7-458e-8751-db83e2adb6f3 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fc5d7bb3e44728956b56605920a2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94ad12bf94b74559943c10d48e500a7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:37.055949 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98498dca-2ce7-458e-8751-db83e2adb6f3 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:37.056243 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98498dca-2ce7-458e-8751-db83e2adb6f3 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:37.056559 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98498dca-2ce7-458e-8751-db83e2adb6f3 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] PATH_INFO: `/v3/groups/a60d63c028b1423fa9e38ed05fffdfcb/users/7ae2769b3cc540ee95cf3507ecc70162` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:37.064279 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98498dca-2ce7-458e-8751-db83e2adb6f3 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=a60d63c028b1423fa9e38ed05fffdfcb, user_id=7ae2769b3cc540ee95cf3507ecc70162)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:37.064279 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-98498dca-2ce7-458e-8751-db83e2adb6f3 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:22:37.064279 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:22:37.064279 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:22:37.064279 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98498dca-2ce7-458e-8751-db83e2adb6f3 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:37.074305 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1897/3791] 10.222.0.23 () {58 vars in 1341 bytes} [Sat Apr 30 21:22:37 2022] HEAD /identity/v3/groups/a60d63c028b1423fa9e38ed05fffdfcb/users/7ae2769b3cc540ee95cf3507ecc70162 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:37.078351 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1881e-a282-4287-aaf8-20c0134ce69a tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:37.089501 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1881e-a282-4287-aaf8-20c0134ce69a tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:37.094480 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa4f13-a820-49f6-8e16-024089aba2d0 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fc5d7bb3e44728956b56605920a2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94ad12bf94b74559943c10d48e500a7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:37.095368 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa4f13-a820-49f6-8e16-024089aba2d0 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:37.095653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa4f13-a820-49f6-8e16-024089aba2d0 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:37.095934 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa4f13-a820-49f6-8e16-024089aba2d0 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] PATH_INFO: `/v3/groups/a60d63c028b1423fa9e38ed05fffdfcb/users/7ae2769b3cc540ee95cf3507ecc70162` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:37.098062 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aa4f13-a820-49f6-8e16-024089aba2d0 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=a60d63c028b1423fa9e38ed05fffdfcb, user_id=7ae2769b3cc540ee95cf3507ecc70162)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:37.099171 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-96aa4f13-a820-49f6-8e16-024089aba2d0 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:22:37.099171 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:22:37.099171 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:22:37.100418 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aa4f13-a820-49f6-8e16-024089aba2d0 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:37.167944 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-96aa4f13-a820-49f6-8e16-024089aba2d0 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '7ae2769b3cc540ee95cf3507ecc70162'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:37.254172 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1895/3792] 10.222.0.23 () {58 vars in 1343 bytes} [Sat Apr 30 21:22:37 2022] DELETE /identity/v3/groups/a60d63c028b1423fa9e38ed05fffdfcb/users/7ae2769b3cc540ee95cf3507ecc70162 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:37.255721 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98498dca-2ce7-458e-8751-db83e2adb6f3 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:37.269468 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98498dca-2ce7-458e-8751-db83e2adb6f3 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:37.359263 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b66aa-113d-4b10-a070-78d228bfedaa tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fc5d7bb3e44728956b56605920a2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94ad12bf94b74559943c10d48e500a7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:37.360147 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b66aa-113d-4b10-a070-78d228bfedaa tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:37.360483 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b66aa-113d-4b10-a070-78d228bfedaa tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:37.360764 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b66aa-113d-4b10-a070-78d228bfedaa tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] PATH_INFO: `/v3/groups/a60d63c028b1423fa9e38ed05fffdfcb/users/670fd7bcf72f4367afaf715c104cd8d3` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:37.362749 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b66aa-113d-4b10-a070-78d228bfedaa tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=a60d63c028b1423fa9e38ed05fffdfcb, user_id=670fd7bcf72f4367afaf715c104cd8d3)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:37.364881 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b66aa-113d-4b10-a070-78d228bfedaa tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:37.380345 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1898/3793] 10.222.0.23 () {58 vars in 1341 bytes} [Sat Apr 30 21:22:37 2022] HEAD /identity/v3/groups/a60d63c028b1423fa9e38ed05fffdfcb/users/670fd7bcf72f4367afaf715c104cd8d3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:37.384183 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa4f13-a820-49f6-8e16-024089aba2d0 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:37.410247 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa4f13-a820-49f6-8e16-024089aba2d0 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:37.415534 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e14c9-09ed-4715-b242-f27c53d25461 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fc5d7bb3e44728956b56605920a2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94ad12bf94b74559943c10d48e500a7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:37.416429 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e14c9-09ed-4715-b242-f27c53d25461 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:37.416713 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e14c9-09ed-4715-b242-f27c53d25461 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:37.416988 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e14c9-09ed-4715-b242-f27c53d25461 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] PATH_INFO: `/v3/groups/a60d63c028b1423fa9e38ed05fffdfcb/users/670fd7bcf72f4367afaf715c104cd8d3` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:37.418784 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e14c9-09ed-4715-b242-f27c53d25461 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=a60d63c028b1423fa9e38ed05fffdfcb, user_id=670fd7bcf72f4367afaf715c104cd8d3)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:37.420743 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e14c9-09ed-4715-b242-f27c53d25461 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:37.516697 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5c3e14c9-09ed-4715-b242-f27c53d25461 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '670fd7bcf72f4367afaf715c104cd8d3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:37.609543 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1896/3794] 10.222.0.23 () {58 vars in 1343 bytes} [Sat Apr 30 21:22:37 2022] DELETE /identity/v3/groups/a60d63c028b1423fa9e38ed05fffdfcb/users/670fd7bcf72f4367afaf715c104cd8d3 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:37.613733 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b66aa-113d-4b10-a070-78d228bfedaa tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:37.652939 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b66aa-113d-4b10-a070-78d228bfedaa tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:37.729988 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9761b99-3dca-4a84-a6db-ecbe3b43889e tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fc5d7bb3e44728956b56605920a2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94ad12bf94b74559943c10d48e500a7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:37.730893 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9761b99-3dca-4a84-a6db-ecbe3b43889e tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:37.731171 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9761b99-3dca-4a84-a6db-ecbe3b43889e tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:37.731444 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9761b99-3dca-4a84-a6db-ecbe3b43889e tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] PATH_INFO: `/v3/groups/a60d63c028b1423fa9e38ed05fffdfcb/users/c13ed174bd374fa58213e44d8d7a8b26` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:37.733127 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9761b99-3dca-4a84-a6db-ecbe3b43889e tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=a60d63c028b1423fa9e38ed05fffdfcb, user_id=c13ed174bd374fa58213e44d8d7a8b26)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:37.735224 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9761b99-3dca-4a84-a6db-ecbe3b43889e tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:37.748556 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1899/3795] 10.222.0.23 () {58 vars in 1341 bytes} [Sat Apr 30 21:22:37 2022] HEAD /identity/v3/groups/a60d63c028b1423fa9e38ed05fffdfcb/users/c13ed174bd374fa58213e44d8d7a8b26 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:37.752723 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e14c9-09ed-4715-b242-f27c53d25461 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:37.763916 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e14c9-09ed-4715-b242-f27c53d25461 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:37.768999 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7163239-94b2-40fd-89ac-235289169740 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fc5d7bb3e44728956b56605920a2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94ad12bf94b74559943c10d48e500a7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:37.770080 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7163239-94b2-40fd-89ac-235289169740 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:37.770366 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7163239-94b2-40fd-89ac-235289169740 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:37.770641 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7163239-94b2-40fd-89ac-235289169740 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] PATH_INFO: `/v3/groups/a60d63c028b1423fa9e38ed05fffdfcb/users/c13ed174bd374fa58213e44d8d7a8b26` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:37.773005 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7163239-94b2-40fd-89ac-235289169740 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=a60d63c028b1423fa9e38ed05fffdfcb, user_id=c13ed174bd374fa58213e44d8d7a8b26)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:37.775102 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7163239-94b2-40fd-89ac-235289169740 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:37.911106 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d7163239-94b2-40fd-89ac-235289169740 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c13ed174bd374fa58213e44d8d7a8b26'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:37.986530 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1897/3796] 10.222.0.23 () {58 vars in 1343 bytes} [Sat Apr 30 21:22:37 2022] DELETE /identity/v3/groups/a60d63c028b1423fa9e38ed05fffdfcb/users/c13ed174bd374fa58213e44d8d7a8b26 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:37.990669 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9761b99-3dca-4a84-a6db-ecbe3b43889e tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:38.003102 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9761b99-3dca-4a84-a6db-ecbe3b43889e tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:38.065572 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d90f40-8d10-4537-a6e3-e13be3e87c1a tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fc5d7bb3e44728956b56605920a2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94ad12bf94b74559943c10d48e500a7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:38.066909 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d90f40-8d10-4537-a6e3-e13be3e87c1a tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:38.067197 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d90f40-8d10-4537-a6e3-e13be3e87c1a tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:38.067472 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d90f40-8d10-4537-a6e3-e13be3e87c1a tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] PATH_INFO: `/v3/groups/a60d63c028b1423fa9e38ed05fffdfcb/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:38.069280 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d90f40-8d10-4537-a6e3-e13be3e87c1a tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=a60d63c028b1423fa9e38ed05fffdfcb)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:38.070374 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-f2d90f40-8d10-4537-a6e3-e13be3e87c1a tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:22:38.070374 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:22:38.070374 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:22:38.071568 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d90f40-8d10-4537-a6e3-e13be3e87c1a tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:38.089432 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1900/3797] 10.222.0.23 () {58 vars in 1241 bytes} [Sat Apr 30 21:22:37 2022] GET /identity/v3/groups/a60d63c028b1423fa9e38ed05fffdfcb/users => generated 145 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:22:38.093716 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7163239-94b2-40fd-89ac-235289169740 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:38.107596 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7163239-94b2-40fd-89ac-235289169740 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:38.109249 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f26d6b-917c-4b35-a22f-c7daac702666 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fc5d7bb3e44728956b56605920a2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94ad12bf94b74559943c10d48e500a7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:38.110300 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f26d6b-917c-4b35-a22f-c7daac702666 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:38.110643 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f26d6b-917c-4b35-a22f-c7daac702666 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:38.110924 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f26d6b-917c-4b35-a22f-c7daac702666 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] PATH_INFO: `/v3/users/c13ed174bd374fa58213e44d8d7a8b26` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:38.112118 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f26d6b-917c-4b35-a22f-c7daac702666 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c13ed174bd374fa58213e44d8d7a8b26)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:38.114097 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f26d6b-917c-4b35-a22f-c7daac702666 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:38.242791 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e1f26d6b-917c-4b35-a22f-c7daac702666 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c13ed174bd374fa58213e44d8d7a8b26'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:38.255809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e1f26d6b-917c-4b35-a22f-c7daac702666 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c13ed174bd374fa58213e44d8d7a8b26'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:38.317494 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e1f26d6b-917c-4b35-a22f-c7daac702666 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c13ed174bd374fa58213e44d8d7a8b26'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:38.328994 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e1f26d6b-917c-4b35-a22f-c7daac702666 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c13ed174bd374fa58213e44d8d7a8b26'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:38.329798 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e1f26d6b-917c-4b35-a22f-c7daac702666 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c13ed174bd374fa58213e44d8d7a8b26'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:38.336908 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1898/3798] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:22:38 2022] DELETE /identity/v3/users/c13ed174bd374fa58213e44d8d7a8b26 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:38.343243 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d90f40-8d10-4537-a6e3-e13be3e87c1a tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:38.345330 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f2d90f40-8d10-4537-a6e3-e13be3e87c1a tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:38.358371 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d90f40-8d10-4537-a6e3-e13be3e87c1a tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:38.421173 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ffa3c7-2af6-4de1-a03d-72ac002f4f99 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fc5d7bb3e44728956b56605920a2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94ad12bf94b74559943c10d48e500a7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:38.422030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ffa3c7-2af6-4de1-a03d-72ac002f4f99 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:38.422318 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ffa3c7-2af6-4de1-a03d-72ac002f4f99 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:38.422597 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ffa3c7-2af6-4de1-a03d-72ac002f4f99 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] PATH_INFO: `/v3/users/670fd7bcf72f4367afaf715c104cd8d3` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:38.423796 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ffa3c7-2af6-4de1-a03d-72ac002f4f99 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorizing `identity:delete_user(user_id=670fd7bcf72f4367afaf715c104cd8d3)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:38.426174 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ffa3c7-2af6-4de1-a03d-72ac002f4f99 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:38.530749 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-58ffa3c7-2af6-4de1-a03d-72ac002f4f99 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '670fd7bcf72f4367afaf715c104cd8d3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:38.543161 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-58ffa3c7-2af6-4de1-a03d-72ac002f4f99 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '670fd7bcf72f4367afaf715c104cd8d3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:38.597206 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-58ffa3c7-2af6-4de1-a03d-72ac002f4f99 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '670fd7bcf72f4367afaf715c104cd8d3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:38.597940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-58ffa3c7-2af6-4de1-a03d-72ac002f4f99 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '670fd7bcf72f4367afaf715c104cd8d3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:38.607592 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-58ffa3c7-2af6-4de1-a03d-72ac002f4f99 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '670fd7bcf72f4367afaf715c104cd8d3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:38.623901 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1901/3799] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:22:38 2022] DELETE /identity/v3/users/670fd7bcf72f4367afaf715c104cd8d3 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:38.628117 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f26d6b-917c-4b35-a22f-c7daac702666 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:38.642997 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f26d6b-917c-4b35-a22f-c7daac702666 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:38.733122 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40863eb6-ca61-4494-ae2d-17010523c742 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fc5d7bb3e44728956b56605920a2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94ad12bf94b74559943c10d48e500a7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:38.734218 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40863eb6-ca61-4494-ae2d-17010523c742 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:38.734600 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40863eb6-ca61-4494-ae2d-17010523c742 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:38.734971 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40863eb6-ca61-4494-ae2d-17010523c742 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] PATH_INFO: `/v3/users/7ae2769b3cc540ee95cf3507ecc70162` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:38.736285 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40863eb6-ca61-4494-ae2d-17010523c742 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7ae2769b3cc540ee95cf3507ecc70162)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:38.738439 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40863eb6-ca61-4494-ae2d-17010523c742 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:38.878615 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-40863eb6-ca61-4494-ae2d-17010523c742 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ae2769b3cc540ee95cf3507ecc70162'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:38.890472 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-40863eb6-ca61-4494-ae2d-17010523c742 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ae2769b3cc540ee95cf3507ecc70162'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:38.940080 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-40863eb6-ca61-4494-ae2d-17010523c742 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ae2769b3cc540ee95cf3507ecc70162'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:38.948274 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-40863eb6-ca61-4494-ae2d-17010523c742 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ae2769b3cc540ee95cf3507ecc70162'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:38.950042 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-40863eb6-ca61-4494-ae2d-17010523c742 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ae2769b3cc540ee95cf3507ecc70162'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:38.955792 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1899/3800] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:22:38 2022] DELETE /identity/v3/users/7ae2769b3cc540ee95cf3507ecc70162 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:22:38.960550 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ffa3c7-2af6-4de1-a03d-72ac002f4f99 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:38.962208 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-58ffa3c7-2af6-4de1-a03d-72ac002f4f99 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:38.975724 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ffa3c7-2af6-4de1-a03d-72ac002f4f99 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:39.044949 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8e62e-b3b6-4af0-a9f4-123bf5b7d503 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fc5d7bb3e44728956b56605920a2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94ad12bf94b74559943c10d48e500a7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:39.045984 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8e62e-b3b6-4af0-a9f4-123bf5b7d503 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:39.046388 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8e62e-b3b6-4af0-a9f4-123bf5b7d503 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:39.046736 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8e62e-b3b6-4af0-a9f4-123bf5b7d503 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] PATH_INFO: `/v3/groups/a60d63c028b1423fa9e38ed05fffdfcb` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:39.048119 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8e62e-b3b6-4af0-a9f4-123bf5b7d503 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorizing `identity:delete_group(group_id=a60d63c028b1423fa9e38ed05fffdfcb)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:39.049205 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-73b8e62e-b3b6-4af0-a9f4-123bf5b7d503 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:22:39.049205 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:22:39.049205 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:22:39.050780 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8e62e-b3b6-4af0-a9f4-123bf5b7d503 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:39.186611 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1902/3801] 10.222.0.23 () {58 vars in 1226 bytes} [Sat Apr 30 21:22:38 2022] DELETE /identity/v3/groups/a60d63c028b1423fa9e38ed05fffdfcb => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:22:39.191864 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40863eb6-ca61-4494-ae2d-17010523c742 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:39.194194 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-40863eb6-ca61-4494-ae2d-17010523c742 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:39.207005 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40863eb6-ca61-4494-ae2d-17010523c742 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:39.269150 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553065b1-caeb-42ba-9404-c0139fe0366b tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fc5d7bb3e44728956b56605920a2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94ad12bf94b74559943c10d48e500a7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:39.270021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553065b1-caeb-42ba-9404-c0139fe0366b tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:39.270316 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553065b1-caeb-42ba-9404-c0139fe0366b tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:39.270598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553065b1-caeb-42ba-9404-c0139fe0366b tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] PATH_INFO: `/v3/groups` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:39.271326 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553065b1-caeb-42ba-9404-c0139fe0366b tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:39.277969 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553065b1-caeb-42ba-9404-c0139fe0366b tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:39.363242 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1900/3802] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:22:39 2022] POST /identity/v3/groups => generated 325 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:22:39.367915 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8e62e-b3b6-4af0-a9f4-123bf5b7d503 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:39.378458 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8e62e-b3b6-4af0-a9f4-123bf5b7d503 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:39.383453 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd172f93-98ff-4cbb-b426-2ffe2edc920e tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fc5d7bb3e44728956b56605920a2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94ad12bf94b74559943c10d48e500a7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:39.389619 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd172f93-98ff-4cbb-b426-2ffe2edc920e tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:39.389619 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd172f93-98ff-4cbb-b426-2ffe2edc920e tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:39.389619 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd172f93-98ff-4cbb-b426-2ffe2edc920e tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] PATH_INFO: `/v3/groups` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:39.389619 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd172f93-98ff-4cbb-b426-2ffe2edc920e tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:39.389619 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd172f93-98ff-4cbb-b426-2ffe2edc920e tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:39.477690 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1903/3803] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:22:39 2022] POST /identity/v3/groups => generated 325 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:22:39.481813 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553065b1-caeb-42ba-9404-c0139fe0366b tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:39.492320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553065b1-caeb-42ba-9404-c0139fe0366b tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:39.496886 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5f9e4-1124-4bbb-92aa-7c64338546f1 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fc5d7bb3e44728956b56605920a2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94ad12bf94b74559943c10d48e500a7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:39.497534 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5f9e4-1124-4bbb-92aa-7c64338546f1 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:39.497857 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5f9e4-1124-4bbb-92aa-7c64338546f1 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:39.498162 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5f9e4-1124-4bbb-92aa-7c64338546f1 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] PATH_INFO: `/v3/groups` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:39.498840 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5f9e4-1124-4bbb-92aa-7c64338546f1 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:39.500790 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5f9e4-1124-4bbb-92aa-7c64338546f1 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:39.562120 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1901/3804] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:22:39 2022] POST /identity/v3/groups => generated 323 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:22:39.566064 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd172f93-98ff-4cbb-b426-2ffe2edc920e tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:39.576462 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd172f93-98ff-4cbb-b426-2ffe2edc920e tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:39.581502 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c786d-6e39-4a05-956a-54341c30ddea tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fc5d7bb3e44728956b56605920a2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94ad12bf94b74559943c10d48e500a7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:39.582193 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c786d-6e39-4a05-956a-54341c30ddea tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:39.582485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c786d-6e39-4a05-956a-54341c30ddea tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:39.582904 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c786d-6e39-4a05-956a-54341c30ddea tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] PATH_INFO: `/v3/groups` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:39.583611 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c786d-6e39-4a05-956a-54341c30ddea tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:39.585257 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-279c786d-6e39-4a05-956a-54341c30ddea tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:22:39.585257 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:22:39.585257 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:22:39.586436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c786d-6e39-4a05-956a-54341c30ddea tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:39.593181 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1904/3805] 10.222.0.23 () {58 vars in 1124 bytes} [Sat Apr 30 21:22:39 2022] GET /identity/v3/groups => generated 1483 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:22:39.597179 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5f9e4-1124-4bbb-92aa-7c64338546f1 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:39.607896 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5f9e4-1124-4bbb-92aa-7c64338546f1 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:39.612483 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536f3b6-be4e-49a2-900b-d808b63f40b6 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fc5d7bb3e44728956b56605920a2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94ad12bf94b74559943c10d48e500a7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:39.613322 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536f3b6-be4e-49a2-900b-d808b63f40b6 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:39.613607 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536f3b6-be4e-49a2-900b-d808b63f40b6 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:39.617137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536f3b6-be4e-49a2-900b-d808b63f40b6 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] PATH_INFO: `/v3/groups/7e936679466b40458a4c8ecd53c98761` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:39.619469 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a536f3b6-be4e-49a2-900b-d808b63f40b6 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorizing `identity:delete_group(group_id=7e936679466b40458a4c8ecd53c98761)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:39.621360 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a536f3b6-be4e-49a2-900b-d808b63f40b6 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:39.726905 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1902/3806] 10.222.0.23 () {58 vars in 1226 bytes} [Sat Apr 30 21:22:39 2022] DELETE /identity/v3/groups/7e936679466b40458a4c8ecd53c98761 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:39.730968 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c786d-6e39-4a05-956a-54341c30ddea tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:39.741217 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c786d-6e39-4a05-956a-54341c30ddea tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:39.795823 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75826d-7972-4215-a084-6ad8c480848a tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fc5d7bb3e44728956b56605920a2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94ad12bf94b74559943c10d48e500a7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:39.796683 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75826d-7972-4215-a084-6ad8c480848a tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:39.796997 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75826d-7972-4215-a084-6ad8c480848a tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:39.797278 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75826d-7972-4215-a084-6ad8c480848a tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] PATH_INFO: `/v3/groups/fc0e1a2d52e24bd1a03feba2a5f2f6a7` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:39.802549 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a75826d-7972-4215-a084-6ad8c480848a tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorizing `identity:delete_group(group_id=fc0e1a2d52e24bd1a03feba2a5f2f6a7)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:39.804978 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a75826d-7972-4215-a084-6ad8c480848a tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:39.922337 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1905/3807] 10.222.0.23 () {58 vars in 1226 bytes} [Sat Apr 30 21:22:39 2022] DELETE /identity/v3/groups/fc0e1a2d52e24bd1a03feba2a5f2f6a7 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:39.926815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536f3b6-be4e-49a2-900b-d808b63f40b6 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:39.937599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536f3b6-be4e-49a2-900b-d808b63f40b6 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:39.996288 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3655141-0ce0-4706-a1ac-14ad640a0a99 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fc5d7bb3e44728956b56605920a2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94ad12bf94b74559943c10d48e500a7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:39.996511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3655141-0ce0-4706-a1ac-14ad640a0a99 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:39.996843 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3655141-0ce0-4706-a1ac-14ad640a0a99 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:39.997084 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3655141-0ce0-4706-a1ac-14ad640a0a99 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] PATH_INFO: `/v3/groups/ddddd53b9ec54dee9e4c9c7c0baf9966` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:40.002294 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3655141-0ce0-4706-a1ac-14ad640a0a99 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorizing `identity:delete_group(group_id=ddddd53b9ec54dee9e4c9c7c0baf9966)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:40.004362 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3655141-0ce0-4706-a1ac-14ad640a0a99 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:40.121317 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1903/3808] 10.222.0.23 () {58 vars in 1226 bytes} [Sat Apr 30 21:22:39 2022] DELETE /identity/v3/groups/ddddd53b9ec54dee9e4c9c7c0baf9966 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:22:40.126349 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75826d-7972-4215-a084-6ad8c480848a tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:40.137183 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75826d-7972-4215-a084-6ad8c480848a tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:40.191749 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64db29-8ef3-4e68-ad6a-56a51dfcacf0 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fc5d7bb3e44728956b56605920a2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94ad12bf94b74559943c10d48e500a7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:40.192413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64db29-8ef3-4e68-ad6a-56a51dfcacf0 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:40.192703 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64db29-8ef3-4e68-ad6a-56a51dfcacf0 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:40.192985 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64db29-8ef3-4e68-ad6a-56a51dfcacf0 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:40.194251 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64db29-8ef3-4e68-ad6a-56a51dfcacf0 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:40.196129 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64db29-8ef3-4e68-ad6a-56a51dfcacf0 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:40.313032 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1906/3809] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:22:40 2022] POST /identity/v3/users => generated 321 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:22:40.319600 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3655141-0ce0-4706-a1ac-14ad640a0a99 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:40.332635 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3655141-0ce0-4706-a1ac-14ad640a0a99 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:40.337522 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22e689-ac94-4b15-b1a0-89450a376100 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fc5d7bb3e44728956b56605920a2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94ad12bf94b74559943c10d48e500a7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:40.338439 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22e689-ac94-4b15-b1a0-89450a376100 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:40.338957 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22e689-ac94-4b15-b1a0-89450a376100 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:40.339215 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22e689-ac94-4b15-b1a0-89450a376100 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] PATH_INFO: `/v3/groups` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:40.340081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22e689-ac94-4b15-b1a0-89450a376100 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:40.343208 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22e689-ac94-4b15-b1a0-89450a376100 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:40.443044 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1904/3810] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:22:40 2022] POST /identity/v3/groups => generated 326 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:22:40.447824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64db29-8ef3-4e68-ad6a-56a51dfcacf0 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:40.458878 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64db29-8ef3-4e68-ad6a-56a51dfcacf0 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:40.466990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdcec59-edfc-4be1-8577-559cc68d4fe0 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fc5d7bb3e44728956b56605920a2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94ad12bf94b74559943c10d48e500a7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:40.466990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdcec59-edfc-4be1-8577-559cc68d4fe0 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:40.466990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdcec59-edfc-4be1-8577-559cc68d4fe0 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:40.467263 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdcec59-edfc-4be1-8577-559cc68d4fe0 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] PATH_INFO: `/v3/groups/874e9f9025044fb4ba26758595af0679/users/b77d25d9e4fc4379854f8c16d5d63194` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:40.486206 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdcec59-edfc-4be1-8577-559cc68d4fe0 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=874e9f9025044fb4ba26758595af0679, user_id=b77d25d9e4fc4379854f8c16d5d63194)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:40.488532 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdcec59-edfc-4be1-8577-559cc68d4fe0 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:40.593147 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1907/3811] 10.222.0.23 () {60 vars in 1359 bytes} [Sat Apr 30 21:22:40 2022] PUT /identity/v3/groups/874e9f9025044fb4ba26758595af0679/users/b77d25d9e4fc4379854f8c16d5d63194 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:40.598939 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22e689-ac94-4b15-b1a0-89450a376100 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:40.612951 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22e689-ac94-4b15-b1a0-89450a376100 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:40.695722 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae323b-c772-46cc-a9cd-0c652c92b208 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fc5d7bb3e44728956b56605920a2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94ad12bf94b74559943c10d48e500a7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:40.696965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae323b-c772-46cc-a9cd-0c652c92b208 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:40.697248 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae323b-c772-46cc-a9cd-0c652c92b208 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:40.697881 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae323b-c772-46cc-a9cd-0c652c92b208 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] PATH_INFO: `/v3/groups` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:40.698602 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ae323b-c772-46cc-a9cd-0c652c92b208 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:40.700524 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ae323b-c772-46cc-a9cd-0c652c92b208 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:40.831979 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1905/3812] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:22:40 2022] POST /identity/v3/groups => generated 324 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:22:40.835852 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdcec59-edfc-4be1-8577-559cc68d4fe0 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:40.846335 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdcec59-edfc-4be1-8577-559cc68d4fe0 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:40.851448 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ba3cb-0935-4997-8bed-484091b577ea tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fc5d7bb3e44728956b56605920a2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94ad12bf94b74559943c10d48e500a7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:40.852341 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ba3cb-0935-4997-8bed-484091b577ea tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:40.852644 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ba3cb-0935-4997-8bed-484091b577ea tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:40.852899 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ba3cb-0935-4997-8bed-484091b577ea tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] PATH_INFO: `/v3/groups/697ed68d42d143b69f58d3dbbe98480c/users/b77d25d9e4fc4379854f8c16d5d63194` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:40.859567 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ba3cb-0935-4997-8bed-484091b577ea tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=697ed68d42d143b69f58d3dbbe98480c, user_id=b77d25d9e4fc4379854f8c16d5d63194)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:40.861576 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ba3cb-0935-4997-8bed-484091b577ea tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:40.947632 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1908/3813] 10.222.0.23 () {60 vars in 1359 bytes} [Sat Apr 30 21:22:40 2022] PUT /identity/v3/groups/697ed68d42d143b69f58d3dbbe98480c/users/b77d25d9e4fc4379854f8c16d5d63194 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:40.951998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae323b-c772-46cc-a9cd-0c652c92b208 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:40.962345 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae323b-c772-46cc-a9cd-0c652c92b208 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:41.019777 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e6d62-bf05-41e9-b091-f82616f1874b tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fc5d7bb3e44728956b56605920a2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94ad12bf94b74559943c10d48e500a7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:41.020642 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e6d62-bf05-41e9-b091-f82616f1874b tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:41.020925 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e6d62-bf05-41e9-b091-f82616f1874b tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:41.021209 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e6d62-bf05-41e9-b091-f82616f1874b tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] PATH_INFO: `/v3/users/b77d25d9e4fc4379854f8c16d5d63194/groups` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:41.023056 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322e6d62-bf05-41e9-b091-f82616f1874b tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=b77d25d9e4fc4379854f8c16d5d63194)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:41.025160 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322e6d62-bf05-41e9-b091-f82616f1874b tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:41.038638 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1906/3814] 10.222.0.23 () {58 vars in 1241 bytes} [Sat Apr 30 21:22:40 2022] GET /identity/v3/users/b77d25d9e4fc4379854f8c16d5d63194/groups => generated 836 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:22:41.043174 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ba3cb-0935-4997-8bed-484091b577ea tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:41.054543 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ba3cb-0935-4997-8bed-484091b577ea tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:41.059184 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247b858-7b4b-42d4-882a-12c328472426 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fc5d7bb3e44728956b56605920a2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94ad12bf94b74559943c10d48e500a7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:41.060011 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247b858-7b4b-42d4-882a-12c328472426 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:41.060288 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247b858-7b4b-42d4-882a-12c328472426 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:41.060557 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247b858-7b4b-42d4-882a-12c328472426 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] PATH_INFO: `/v3/groups/697ed68d42d143b69f58d3dbbe98480c` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:41.061840 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247b858-7b4b-42d4-882a-12c328472426 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorizing `identity:delete_group(group_id=697ed68d42d143b69f58d3dbbe98480c)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:41.063732 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247b858-7b4b-42d4-882a-12c328472426 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:41.192388 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1909/3815] 10.222.0.23 () {58 vars in 1226 bytes} [Sat Apr 30 21:22:41 2022] DELETE /identity/v3/groups/697ed68d42d143b69f58d3dbbe98480c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:41.197107 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e6d62-bf05-41e9-b091-f82616f1874b tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:41.208757 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e6d62-bf05-41e9-b091-f82616f1874b tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:41.279469 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b96087b-c273-4861-a546-f94c8da852dc tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fc5d7bb3e44728956b56605920a2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94ad12bf94b74559943c10d48e500a7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:41.280733 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96087b-c273-4861-a546-f94c8da852dc tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:41.281461 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96087b-c273-4861-a546-f94c8da852dc tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:41.281811 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96087b-c273-4861-a546-f94c8da852dc tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] PATH_INFO: `/v3/groups/874e9f9025044fb4ba26758595af0679` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:41.283167 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b96087b-c273-4861-a546-f94c8da852dc tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorizing `identity:delete_group(group_id=874e9f9025044fb4ba26758595af0679)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:41.285289 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b96087b-c273-4861-a546-f94c8da852dc tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:41.425116 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1907/3816] 10.222.0.23 () {58 vars in 1226 bytes} [Sat Apr 30 21:22:41 2022] DELETE /identity/v3/groups/874e9f9025044fb4ba26758595af0679 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:41.429777 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247b858-7b4b-42d4-882a-12c328472426 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:41.439858 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247b858-7b4b-42d4-882a-12c328472426 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:41.495589 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b516b32-cb0a-49d2-be88-64c690edff63 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fc5d7bb3e44728956b56605920a2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94ad12bf94b74559943c10d48e500a7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:41.496587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b516b32-cb0a-49d2-be88-64c690edff63 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:41.496925 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b516b32-cb0a-49d2-be88-64c690edff63 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:41.497265 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b516b32-cb0a-49d2-be88-64c690edff63 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] PATH_INFO: `/v3/users/b77d25d9e4fc4379854f8c16d5d63194` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:41.498631 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b516b32-cb0a-49d2-be88-64c690edff63 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b77d25d9e4fc4379854f8c16d5d63194)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:41.500589 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b516b32-cb0a-49d2-be88-64c690edff63 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:41.603222 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3b516b32-cb0a-49d2-be88-64c690edff63 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b77d25d9e4fc4379854f8c16d5d63194'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:41.616169 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3b516b32-cb0a-49d2-be88-64c690edff63 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b77d25d9e4fc4379854f8c16d5d63194'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:41.665862 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3b516b32-cb0a-49d2-be88-64c690edff63 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b77d25d9e4fc4379854f8c16d5d63194'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:41.666736 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3b516b32-cb0a-49d2-be88-64c690edff63 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b77d25d9e4fc4379854f8c16d5d63194'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:41.676109 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49b8ab-7651-49df-9fe2-62eb6d7d2cf0 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:41.676627 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49b8ab-7651-49df-9fe2-62eb6d7d2cf0 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:41.677105 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49b8ab-7651-49df-9fe2-62eb6d7d2cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:41.679643 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3b516b32-cb0a-49d2-be88-64c690edff63 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b77d25d9e4fc4379854f8c16d5d63194'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:41.688342 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1910/3817] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:22:41 2022] DELETE /identity/v3/users/b77d25d9e4fc4379854f8c16d5d63194 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:41.701438 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-8c49b8ab-7651-49df-9fe2-62eb6d7d2cf0 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:22:41.703181 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8c49b8ab-7651-49df-9fe2-62eb6d7d2cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:41.705314 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b516b32-cb0a-49d2-be88-64c690edff63 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:41.707022 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3b516b32-cb0a-49d2-be88-64c690edff63 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:41.764471 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1908/3818] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:22:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:22:41.776308 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b516b32-cb0a-49d2-be88-64c690edff63 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:41.777416 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c49b8ab-7651-49df-9fe2-62eb6d7d2cf0 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:41.779202 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8c49b8ab-7651-49df-9fe2-62eb6d7d2cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:41.782380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0edb3d-9575-4ceb-8c19-33b71ee1f115 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fc5d7bb3e44728956b56605920a2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94ad12bf94b74559943c10d48e500a7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:41.783710 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0edb3d-9575-4ceb-8c19-33b71ee1f115 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:41.783710 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0edb3d-9575-4ceb-8c19-33b71ee1f115 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:41.784017 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0edb3d-9575-4ceb-8c19-33b71ee1f115 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] PATH_INFO: `/v3/domains/35d44c268aa9423b8463dbd0924cbfdd` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:41.791655 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0edb3d-9575-4ceb-8c19-33b71ee1f115 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=35d44c268aa9423b8463dbd0924cbfdd)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:41.792701 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-3e0edb3d-9575-4ceb-8c19-33b71ee1f115 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:22:41.792701 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:22:41.792701 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:22:41.793604 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0edb3d-9575-4ceb-8c19-33b71ee1f115 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:41.822740 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3e0edb3d-9575-4ceb-8c19-33b71ee1f115 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '35d44c268aa9423b8463dbd0924cbfdd'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:41.823851 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3e0edb3d-9575-4ceb-8c19-33b71ee1f115 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '35d44c268aa9423b8463dbd0924cbfdd'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:41.856188 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c49b8ab-7651-49df-9fe2-62eb6d7d2cf0 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:41.923335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57335ed2-2cc8-42ed-812f-e100cef495a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:41.923335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57335ed2-2cc8-42ed-812f-e100cef495a5 service swift] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:41.923335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57335ed2-2cc8-42ed-812f-e100cef495a5 service swift] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:41.923335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57335ed2-2cc8-42ed-812f-e100cef495a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:41.925589 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-57335ed2-2cc8-42ed-812f-e100cef495a5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:41.940339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3e0edb3d-9575-4ceb-8c19-33b71ee1f115 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '35d44c268aa9423b8463dbd0924cbfdd'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:41.941305 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3e0edb3d-9575-4ceb-8c19-33b71ee1f115 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '35d44c268aa9423b8463dbd0924cbfdd'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:41.944098 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1911/3819] 10.222.0.23 () {60 vars in 1248 bytes} [Sat Apr 30 21:22:41 2022] PATCH /identity/v3/domains/35d44c268aa9423b8463dbd0924cbfdd => generated 276 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:22:41.947988 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0edb3d-9575-4ceb-8c19-33b71ee1f115 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:41.949488 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3e0edb3d-9575-4ceb-8c19-33b71ee1f115 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:41.994541 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57335ed2-2cc8-42ed-812f-e100cef495a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:41.996204 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57335ed2-2cc8-42ed-812f-e100cef495a5 service swift] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:42.005125 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1909/3820] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:22:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 30 21:22:42.021135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0edb3d-9575-4ceb-8c19-33b71ee1f115 tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:42.026724 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066877e6-cdcd-4e5b-b93e-9e27a906d75c tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36fc5d7bb3e44728956b56605920a2bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94ad12bf94b74559943c10d48e500a7f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:42.028078 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066877e6-cdcd-4e5b-b93e-9e27a906d75c tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:42.028078 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066877e6-cdcd-4e5b-b93e-9e27a906d75c tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:42.028267 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066877e6-cdcd-4e5b-b93e-9e27a906d75c tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] PATH_INFO: `/v3/domains/35d44c268aa9423b8463dbd0924cbfdd` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:42.040488 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066877e6-cdcd-4e5b-b93e-9e27a906d75c tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=35d44c268aa9423b8463dbd0924cbfdd)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:42.041591 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-066877e6-cdcd-4e5b-b93e-9e27a906d75c tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:22:42.041591 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:22:42.041591 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:22:42.045652 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066877e6-cdcd-4e5b-b93e-9e27a906d75c tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:42.066301 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-066877e6-cdcd-4e5b-b93e-9e27a906d75c tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '35d44c268aa9423b8463dbd0924cbfdd'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:42.071735 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-066877e6-cdcd-4e5b-b93e-9e27a906d75c tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '35d44c268aa9423b8463dbd0924cbfdd'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:42.234117 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-066877e6-cdcd-4e5b-b93e-9e27a906d75c tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35d44c268aa9423b8463dbd0924cbfdd', 'request_id': 'req-066877e6-cdcd-4e5b-b93e-9e27a906d75c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:42.244926 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-066877e6-cdcd-4e5b-b93e-9e27a906d75c tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35d44c268aa9423b8463dbd0924cbfdd', 'request_id': 'req-066877e6-cdcd-4e5b-b93e-9e27a906d75c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:42.255252 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-066877e6-cdcd-4e5b-b93e-9e27a906d75c tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35d44c268aa9423b8463dbd0924cbfdd', 'request_id': 'req-066877e6-cdcd-4e5b-b93e-9e27a906d75c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:42.351907 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-066877e6-cdcd-4e5b-b93e-9e27a906d75c tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] The token cache is being invalidate because project 35d44c268aa9423b8463dbd0924cbfdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:22:42.352326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-066877e6-cdcd-4e5b-b93e-9e27a906d75c tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:42.353213 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-066877e6-cdcd-4e5b-b93e-9e27a906d75c tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:42.382565 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-066877e6-cdcd-4e5b-b93e-9e27a906d75c tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '35d44c268aa9423b8463dbd0924cbfdd', 'request_id': 'req-066877e6-cdcd-4e5b-b93e-9e27a906d75c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:42.385873 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-066877e6-cdcd-4e5b-b93e-9e27a906d75c tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '35d44c268aa9423b8463dbd0924cbfdd', 'request_id': 'req-066877e6-cdcd-4e5b-b93e-9e27a906d75c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:42.389587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-066877e6-cdcd-4e5b-b93e-9e27a906d75c tempest-GroupsV3TestJSON-382215152 tempest-GroupsV3TestJSON-382215152-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '35d44c268aa9423b8463dbd0924cbfdd', 'request_id': 'req-066877e6-cdcd-4e5b-b93e-9e27a906d75c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:42.410033 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1912/3821] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:22:41 2022] DELETE /identity/v3/domains/35d44c268aa9423b8463dbd0924cbfdd => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:42.415176 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57335ed2-2cc8-42ed-812f-e100cef495a5 service swift] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:42.417700 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-57335ed2-2cc8-42ed-812f-e100cef495a5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:42.513677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57335ed2-2cc8-42ed-812f-e100cef495a5 service swift] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:42.593690 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f560c9-28ee-42d7-9df6-beab18ea3ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:42.594956 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f560c9-28ee-42d7-9df6-beab18ea3ef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:42.595455 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f560c9-28ee-42d7-9df6-beab18ea3ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:42.595981 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f560c9-28ee-42d7-9df6-beab18ea3ef7 admin admin] PATH_INFO: `/v3/users/50da71bb739f42d183523eda91aa5562` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:42.597435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f560c9-28ee-42d7-9df6-beab18ea3ef7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50da71bb739f42d183523eda91aa5562)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:42.600494 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f560c9-28ee-42d7-9df6-beab18ea3ef7 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:42.905640 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-25f560c9-28ee-42d7-9df6-beab18ea3ef7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50da71bb739f42d183523eda91aa5562'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:42.919530 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-25f560c9-28ee-42d7-9df6-beab18ea3ef7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50da71bb739f42d183523eda91aa5562'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:42.980224 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-25f560c9-28ee-42d7-9df6-beab18ea3ef7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50da71bb739f42d183523eda91aa5562'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:42.989917 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-25f560c9-28ee-42d7-9df6-beab18ea3ef7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50da71bb739f42d183523eda91aa5562'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:42.991101 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-25f560c9-28ee-42d7-9df6-beab18ea3ef7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50da71bb739f42d183523eda91aa5562'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:43.016374 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1910/3822] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:22:42 2022] DELETE /identity/v3/users/50da71bb739f42d183523eda91aa5562 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:43.021377 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d068d-f230-4f92-80b0-46ae9627ec4e None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:43.023038 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d068d-f230-4f92-80b0-46ae9627ec4e None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:43.023331 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d068d-f230-4f92-80b0-46ae9627ec4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:43.061145 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-a50d068d-f230-4f92-80b0-46ae9627ec4e None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:22:43.062405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a50d068d-f230-4f92-80b0-46ae9627ec4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:43.192404 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1913/3823] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:22:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:22:43.199770 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f560c9-28ee-42d7-9df6-beab18ea3ef7 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:43.205382 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-25f560c9-28ee-42d7-9df6-beab18ea3ef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:43.288936 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f560c9-28ee-42d7-9df6-beab18ea3ef7 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:43.294571 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f46b35-a464-4fa0-9804-25ad22212c0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:43.297350 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f46b35-a464-4fa0-9804-25ad22212c0a service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:43.297350 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f46b35-a464-4fa0-9804-25ad22212c0a service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:43.297350 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f46b35-a464-4fa0-9804-25ad22212c0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:43.311016 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f46b35-a464-4fa0-9804-25ad22212c0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:43.312807 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f46b35-a464-4fa0-9804-25ad22212c0a service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:43.328578 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1911/3824] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:22:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:22:43.878356 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d068d-f230-4f92-80b0-46ae9627ec4e None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:43.880140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a50d068d-f230-4f92-80b0-46ae9627ec4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:43.900234 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d068d-f230-4f92-80b0-46ae9627ec4e None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:43.919575 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a182986-4f49-4ea0-97c1-417599089df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:43.921836 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a182986-4f49-4ea0-97c1-417599089df2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:43.921836 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a182986-4f49-4ea0-97c1-417599089df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:43.921836 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a182986-4f49-4ea0-97c1-417599089df2 admin admin] PATH_INFO: `/v3/projects/ebce3b7cc7a7481688e5dcdfdd1c41af` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:43.922799 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a182986-4f49-4ea0-97c1-417599089df2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebce3b7cc7a7481688e5dcdfdd1c41af)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:43.925015 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a182986-4f49-4ea0-97c1-417599089df2 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:44.057277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1a182986-4f49-4ea0-97c1-417599089df2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebce3b7cc7a7481688e5dcdfdd1c41af', 'request_id': 'req-1a182986-4f49-4ea0-97c1-417599089df2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:44.068377 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1a182986-4f49-4ea0-97c1-417599089df2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebce3b7cc7a7481688e5dcdfdd1c41af', 'request_id': 'req-1a182986-4f49-4ea0-97c1-417599089df2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:44.076461 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1a182986-4f49-4ea0-97c1-417599089df2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebce3b7cc7a7481688e5dcdfdd1c41af', 'request_id': 'req-1a182986-4f49-4ea0-97c1-417599089df2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:44.200618 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1a182986-4f49-4ea0-97c1-417599089df2 admin admin] The token cache is being invalidate because project ebce3b7cc7a7481688e5dcdfdd1c41af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:22:44.201069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1a182986-4f49-4ea0-97c1-417599089df2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:44.203437 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1a182986-4f49-4ea0-97c1-417599089df2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:44.209279 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f46b35-a464-4fa0-9804-25ad22212c0a service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:44.221087 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1914/3825] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:22:43 2022] DELETE /identity/v3/projects/ebce3b7cc7a7481688e5dcdfdd1c41af => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:44.222155 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f46b35-a464-4fa0-9804-25ad22212c0a service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:44.296669 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcadfa58-e35a-4210-8dc1-9ac9b2a4c839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:44.298308 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadfa58-e35a-4210-8dc1-9ac9b2a4c839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:44.298618 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadfa58-e35a-4210-8dc1-9ac9b2a4c839 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:44.299010 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadfa58-e35a-4210-8dc1-9ac9b2a4c839 admin admin] PATH_INFO: `/v3/users/36fc5d7bb3e44728956b56605920a2bd` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:44.300760 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcadfa58-e35a-4210-8dc1-9ac9b2a4c839 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36fc5d7bb3e44728956b56605920a2bd)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:44.304505 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcadfa58-e35a-4210-8dc1-9ac9b2a4c839 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:44.522801 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bcadfa58-e35a-4210-8dc1-9ac9b2a4c839 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36fc5d7bb3e44728956b56605920a2bd'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:44.544641 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bcadfa58-e35a-4210-8dc1-9ac9b2a4c839 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36fc5d7bb3e44728956b56605920a2bd'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:44.626200 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bcadfa58-e35a-4210-8dc1-9ac9b2a4c839 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36fc5d7bb3e44728956b56605920a2bd'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:44.636577 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bcadfa58-e35a-4210-8dc1-9ac9b2a4c839 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36fc5d7bb3e44728956b56605920a2bd'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:44.637596 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bcadfa58-e35a-4210-8dc1-9ac9b2a4c839 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36fc5d7bb3e44728956b56605920a2bd'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:44.655472 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1912/3826] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:22:44 2022] DELETE /identity/v3/users/36fc5d7bb3e44728956b56605920a2bd => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:45.221005 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a182986-4f49-4ea0-97c1-417599089df2 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:45.222577 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1a182986-4f49-4ea0-97c1-417599089df2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:45.237452 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a182986-4f49-4ea0-97c1-417599089df2 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:45.267709 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcadfa58-e35a-4210-8dc1-9ac9b2a4c839 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:45.269702 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-bcadfa58-e35a-4210-8dc1-9ac9b2a4c839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:45.345681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a4355-6158-4fbb-b6b8-fc9faa5355e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:45.346767 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a4355-6158-4fbb-b6b8-fc9faa5355e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:45.347077 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a4355-6158-4fbb-b6b8-fc9faa5355e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:45.347422 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a4355-6158-4fbb-b6b8-fc9faa5355e1 admin admin] PATH_INFO: `/v3/users/e56c6d1395334b3ebe2293ba9d59fe9b` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:45.351067 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093a4355-6158-4fbb-b6b8-fc9faa5355e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e56c6d1395334b3ebe2293ba9d59fe9b)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:45.353589 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093a4355-6158-4fbb-b6b8-fc9faa5355e1 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:45.395380 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcadfa58-e35a-4210-8dc1-9ac9b2a4c839 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:45.402073 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0d233-a758-4482-9a43-9e3c73b65b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:45.403181 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0d233-a758-4482-9a43-9e3c73b65b70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:45.403633 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0d233-a758-4482-9a43-9e3c73b65b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:45.404072 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0d233-a758-4482-9a43-9e3c73b65b70 admin admin] PATH_INFO: `/v3/projects/94ad12bf94b74559943c10d48e500a7f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:45.405461 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab0d233-a758-4482-9a43-9e3c73b65b70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94ad12bf94b74559943c10d48e500a7f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:45.407576 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab0d233-a758-4482-9a43-9e3c73b65b70 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:45.727370 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-fab0d233-a758-4482-9a43-9e3c73b65b70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94ad12bf94b74559943c10d48e500a7f', 'request_id': 'req-fab0d233-a758-4482-9a43-9e3c73b65b70'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:45.733275 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-093a4355-6158-4fbb-b6b8-fc9faa5355e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e56c6d1395334b3ebe2293ba9d59fe9b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:45.733992 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-fab0d233-a758-4482-9a43-9e3c73b65b70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94ad12bf94b74559943c10d48e500a7f', 'request_id': 'req-fab0d233-a758-4482-9a43-9e3c73b65b70'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:45.742119 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-fab0d233-a758-4482-9a43-9e3c73b65b70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94ad12bf94b74559943c10d48e500a7f', 'request_id': 'req-fab0d233-a758-4482-9a43-9e3c73b65b70'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:45.751536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-093a4355-6158-4fbb-b6b8-fc9faa5355e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e56c6d1395334b3ebe2293ba9d59fe9b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:46.070642 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-fab0d233-a758-4482-9a43-9e3c73b65b70 admin admin] The token cache is being invalidate because project 94ad12bf94b74559943c10d48e500a7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:22:46.070936 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-fab0d233-a758-4482-9a43-9e3c73b65b70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:46.071589 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-fab0d233-a758-4482-9a43-9e3c73b65b70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:46.073483 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1913/3827] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:22:45 2022] DELETE /identity/v3/projects/94ad12bf94b74559943c10d48e500a7f => generated 0 bytes in 806 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:46.078365 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242fc78-d2ad-4083-8cae-c43313d5151d None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:46.078852 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242fc78-d2ad-4083-8cae-c43313d5151d None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:46.079278 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242fc78-d2ad-4083-8cae-c43313d5151d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:46.099928 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-6242fc78-d2ad-4083-8cae-c43313d5151d None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:22:46.101418 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6242fc78-d2ad-4083-8cae-c43313d5151d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:46.175419 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-093a4355-6158-4fbb-b6b8-fc9faa5355e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e56c6d1395334b3ebe2293ba9d59fe9b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:46.176232 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-093a4355-6158-4fbb-b6b8-fc9faa5355e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e56c6d1395334b3ebe2293ba9d59fe9b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:46.185013 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1914/3828] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:22:46.186001 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-093a4355-6158-4fbb-b6b8-fc9faa5355e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e56c6d1395334b3ebe2293ba9d59fe9b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:46.192361 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f12a0-f5a6-4a85-8fe3-223514ef1e03 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:46.201347 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f12a0-f5a6-4a85-8fe3-223514ef1e03 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:46.201347 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f12a0-f5a6-4a85-8fe3-223514ef1e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:46.201563 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1915/3829] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:22:45 2022] DELETE /identity/v3/users/e56c6d1395334b3ebe2293ba9d59fe9b => generated 0 bytes in 973 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:46.217211 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-555f12a0-f5a6-4a85-8fe3-223514ef1e03 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:22:46.218741 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-555f12a0-f5a6-4a85-8fe3-223514ef1e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:46.315575 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1915/3830] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:22:46.320960 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a4355-6158-4fbb-b6b8-fc9faa5355e1 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:46.332265 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a4355-6158-4fbb-b6b8-fc9faa5355e1 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:46.337887 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dcc418-85c8-4f3c-883d-d349ad315fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:46.338771 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dcc418-85c8-4f3c-883d-d349ad315fca admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:46.339054 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dcc418-85c8-4f3c-883d-d349ad315fca admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:46.339502 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dcc418-85c8-4f3c-883d-d349ad315fca admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:46.340541 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dcc418-85c8-4f3c-883d-d349ad315fca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:22:46.341013 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dcc418-85c8-4f3c-883d-d349ad315fca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:46.343472 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dcc418-85c8-4f3c-883d-d349ad315fca admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:46.361640 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1916/3831] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:22:46.367991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f12a0-f5a6-4a85-8fe3-223514ef1e03 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:46.385313 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f12a0-f5a6-4a85-8fe3-223514ef1e03 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:46.419272 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071091f-8801-4ed2-944e-a5f2f9b7a324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:46.423327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071091f-8801-4ed2-944e-a5f2f9b7a324 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:46.423327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071091f-8801-4ed2-944e-a5f2f9b7a324 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:46.423327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071091f-8801-4ed2-944e-a5f2f9b7a324 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:46.423327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a071091f-8801-4ed2-944e-a5f2f9b7a324 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:46.423728 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a071091f-8801-4ed2-944e-a5f2f9b7a324 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:46.565133 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dcc418-85c8-4f3c-883d-d349ad315fca admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:46.566998 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-90dcc418-85c8-4f3c-883d-d349ad315fca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:46.567768 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1916/3832] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:22:46 2022] POST /identity/v3/projects => generated 365 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:22:46.573057 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071091f-8801-4ed2-944e-a5f2f9b7a324 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:46.589936 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dcc418-85c8-4f3c-883d-d349ad315fca admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:46.699715 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b60041-54d2-41b2-940b-25421dde673e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:46.700713 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b60041-54d2-41b2-940b-25421dde673e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:46.701172 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b60041-54d2-41b2-940b-25421dde673e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:46.701473 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071091f-8801-4ed2-944e-a5f2f9b7a324 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:46.701827 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b60041-54d2-41b2-940b-25421dde673e admin admin] PATH_INFO: `/v3/projects/def690693f654dc8aff77fa04e78d762` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:46.703216 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b60041-54d2-41b2-940b-25421dde673e admin admin] RBAC: Authorizing `identity:delete_project(project_id=def690693f654dc8aff77fa04e78d762)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:46.706664 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b60041-54d2-41b2-940b-25421dde673e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:46.708131 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0cfcfd-14f2-46c1-a914-91af3ffe88a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:46.709088 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0cfcfd-14f2-46c1-a914-91af3ffe88a7 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:46.709438 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0cfcfd-14f2-46c1-a914-91af3ffe88a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:46.709853 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0cfcfd-14f2-46c1-a914-91af3ffe88a7 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:46.715650 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0cfcfd-14f2-46c1-a914-91af3ffe88a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:46.715650 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0cfcfd-14f2-46c1-a914-91af3ffe88a7 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:46.850348 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1917/3833] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:22:46 2022] POST /identity/v3/users => generated 283 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:22:46.855127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0cfcfd-14f2-46c1-a914-91af3ffe88a7 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:46.866804 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0cfcfd-14f2-46c1-a914-91af3ffe88a7 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:46.874043 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5520013-bf48-44ad-b95e-fd886efc4953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:46.874043 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5520013-bf48-44ad-b95e-fd886efc4953 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:46.874043 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5520013-bf48-44ad-b95e-fd886efc4953 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:46.874043 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5520013-bf48-44ad-b95e-fd886efc4953 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:46.874608 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5520013-bf48-44ad-b95e-fd886efc4953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:46.885513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5520013-bf48-44ad-b95e-fd886efc4953 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:46.903096 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-86b60041-54d2-41b2-940b-25421dde673e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'def690693f654dc8aff77fa04e78d762', 'request_id': 'req-86b60041-54d2-41b2-940b-25421dde673e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:46.907238 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1918/3834] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:22:46.909932 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5520013-bf48-44ad-b95e-fd886efc4953 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:46.920304 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-86b60041-54d2-41b2-940b-25421dde673e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'def690693f654dc8aff77fa04e78d762', 'request_id': 'req-86b60041-54d2-41b2-940b-25421dde673e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:46.925815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5520013-bf48-44ad-b95e-fd886efc4953 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:46.934539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-86b60041-54d2-41b2-940b-25421dde673e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'def690693f654dc8aff77fa04e78d762', 'request_id': 'req-86b60041-54d2-41b2-940b-25421dde673e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:47.000846 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29089d83-c70a-4435-b6d8-0445d6409146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:47.001583 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29089d83-c70a-4435-b6d8-0445d6409146 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:47.002017 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29089d83-c70a-4435-b6d8-0445d6409146 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:47.002359 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29089d83-c70a-4435-b6d8-0445d6409146 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:47.003086 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29089d83-c70a-4435-b6d8-0445d6409146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:47.004865 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29089d83-c70a-4435-b6d8-0445d6409146 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:47.017418 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1919/3835] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:22:47.020728 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29089d83-c70a-4435-b6d8-0445d6409146 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:47.031507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29089d83-c70a-4435-b6d8-0445d6409146 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:47.036527 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cdbb99-af71-4394-87eb-9f3a06045f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:47.038014 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cdbb99-af71-4394-87eb-9f3a06045f6d admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:47.038302 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cdbb99-af71-4394-87eb-9f3a06045f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:47.041181 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cdbb99-af71-4394-87eb-9f3a06045f6d admin admin] PATH_INFO: `/v3/projects/cf5cbf4fea854b93815d80d3af27bdf4/users/2c4dd9684e344d47a7213877aa4427a0/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:47.060507 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-86b60041-54d2-41b2-940b-25421dde673e admin admin] The token cache is being invalidate because project def690693f654dc8aff77fa04e78d762 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:22:47.061269 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-86b60041-54d2-41b2-940b-25421dde673e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:47.061954 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cdbb99-af71-4394-87eb-9f3a06045f6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf5cbf4fea854b93815d80d3af27bdf4, user_id=2c4dd9684e344d47a7213877aa4427a0, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:47.062663 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-86b60041-54d2-41b2-940b-25421dde673e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:47.064452 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1917/3836] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:22:46 2022] DELETE /identity/v3/projects/def690693f654dc8aff77fa04e78d762 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:22:47.068810 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cdbb99-af71-4394-87eb-9f3a06045f6d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:47.070567 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8bc6c-0648-40c4-b694-a027e649fe8b None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:47.070866 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8bc6c-0648-40c4-b694-a027e649fe8b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:47.071152 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8bc6c-0648-40c4-b694-a027e649fe8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:47.093681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-cdc8bc6c-0648-40c4-b694-a027e649fe8b None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:22:47.095035 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-cdc8bc6c-0648-40c4-b694-a027e649fe8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:47.110311 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1918/3837] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:22:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:22:47.114253 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259958f-782d-4d6c-be85-3ce660106855 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:47.114555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259958f-782d-4d6c-be85-3ce660106855 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:47.114839 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259958f-782d-4d6c-be85-3ce660106855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:47.136672 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1920/3838] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:22:47 2022] PUT /identity/v3/projects/cf5cbf4fea854b93815d80d3af27bdf4/users/2c4dd9684e344d47a7213877aa4427a0/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:22:47.142131 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-a259958f-782d-4d6c-be85-3ce660106855 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:22:47.142131 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a259958f-782d-4d6c-be85-3ce660106855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:47.153589 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71849330-b38d-4fdb-8aef-3579424ecb94 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:47.153914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71849330-b38d-4fdb-8aef-3579424ecb94 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:47.154193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71849330-b38d-4fdb-8aef-3579424ecb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:47.187985 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-71849330-b38d-4fdb-8aef-3579424ecb94 None None] MFA Rules not processed for user `2c4dd9684e344d47a7213877aa4427a0`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:22:47.189824 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-71849330-b38d-4fdb-8aef-3579424ecb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:47.236000 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1919/3839] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:22:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:22:47.241352 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a259958f-782d-4d6c-be85-3ce660106855 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:47.257041 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a259958f-782d-4d6c-be85-3ce660106855 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:47.265482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd4a1a-9c41-43ae-bbcf-22373247a977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:47.272009 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd4a1a-9c41-43ae-bbcf-22373247a977 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:47.272009 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd4a1a-9c41-43ae-bbcf-22373247a977 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:47.279228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd4a1a-9c41-43ae-bbcf-22373247a977 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:47.279228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd4a1a-9c41-43ae-bbcf-22373247a977 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:22:47.279228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd4a1a-9c41-43ae-bbcf-22373247a977 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:47.279228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd4a1a-9c41-43ae-bbcf-22373247a977 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:47.284846 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1921/3840] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:22:47 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:22:47.305500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71849330-b38d-4fdb-8aef-3579424ecb94 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:47.310368 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1920/3841] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:22:47.317604 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-71849330-b38d-4fdb-8aef-3579424ecb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:47.319850 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd4a1a-9c41-43ae-bbcf-22373247a977 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:47.340119 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd4a1a-9c41-43ae-bbcf-22373247a977 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:47.347438 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206cd80-9691-4218-9fdc-443ca49faf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:47.348183 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71849330-b38d-4fdb-8aef-3579424ecb94 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:47.348809 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206cd80-9691-4218-9fdc-443ca49faf0c admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:47.349350 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206cd80-9691-4218-9fdc-443ca49faf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:47.349913 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206cd80-9691-4218-9fdc-443ca49faf0c admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:47.350926 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206cd80-9691-4218-9fdc-443ca49faf0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:47.353288 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206cd80-9691-4218-9fdc-443ca49faf0c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:47.359045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a08093-ca78-4c8e-8174-cc01eeae963f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:47.360173 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a08093-ca78-4c8e-8174-cc01eeae963f admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:47.360173 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a08093-ca78-4c8e-8174-cc01eeae963f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:47.360455 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a08093-ca78-4c8e-8174-cc01eeae963f admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:47.363099 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a08093-ca78-4c8e-8174-cc01eeae963f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:47.363099 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a08093-ca78-4c8e-8174-cc01eeae963f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:47.477243 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1921/3842] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:22:47 2022] POST /identity/v3/projects => generated 395 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:22:47.478541 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206cd80-9691-4218-9fdc-443ca49faf0c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:47.510137 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1922/3843] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:22:47 2022] POST /identity/v3/projects => generated 367 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:22:47.515309 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a08093-ca78-4c8e-8174-cc01eeae963f admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:47.619347 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206cd80-9691-4218-9fdc-443ca49faf0c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:47.624321 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0a580-d1a6-4696-8532-a2fcc9465784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:47.625060 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0a580-d1a6-4696-8532-a2fcc9465784 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:47.625609 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0a580-d1a6-4696-8532-a2fcc9465784 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:47.625999 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0a580-d1a6-4696-8532-a2fcc9465784 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:47.627601 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0a580-d1a6-4696-8532-a2fcc9465784 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:47.630297 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0a580-d1a6-4696-8532-a2fcc9465784 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:47.636553 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a08093-ca78-4c8e-8174-cc01eeae963f admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:47.642461 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae534ead-516e-4943-8f16-76b550554bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:47.647272 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae534ead-516e-4943-8f16-76b550554bad admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:47.647272 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae534ead-516e-4943-8f16-76b550554bad admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:47.647272 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae534ead-516e-4943-8f16-76b550554bad admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:47.647272 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae534ead-516e-4943-8f16-76b550554bad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:47.647881 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae534ead-516e-4943-8f16-76b550554bad admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:47.737468 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1922/3844] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:22:47 2022] POST /identity/v3/users => generated 298 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:22:47.741211 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0a580-d1a6-4696-8532-a2fcc9465784 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:47.752997 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0a580-d1a6-4696-8532-a2fcc9465784 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:47.759734 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ef5a7-b7aa-4861-935f-c8bf8aa4e8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:47.763973 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1923/3845] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:22:47 2022] POST /identity/v3/users => generated 290 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:22:47.764419 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ef5a7-b7aa-4861-935f-c8bf8aa4e8ca admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:47.764419 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ef5a7-b7aa-4861-935f-c8bf8aa4e8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:47.764419 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ef5a7-b7aa-4861-935f-c8bf8aa4e8ca admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:47.764419 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ef5a7-b7aa-4861-935f-c8bf8aa4e8ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:47.765663 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ef5a7-b7aa-4861-935f-c8bf8aa4e8ca admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:47.765804 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae534ead-516e-4943-8f16-76b550554bad admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:47.783493 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae534ead-516e-4943-8f16-76b550554bad admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:47.789235 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1923/3846] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:22:47.792773 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ef5a7-b7aa-4861-935f-c8bf8aa4e8ca admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:47.793839 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece3f3c-5306-47c7-9eab-e10bb0016507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:47.794528 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece3f3c-5306-47c7-9eab-e10bb0016507 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:47.795031 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece3f3c-5306-47c7-9eab-e10bb0016507 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:47.795309 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece3f3c-5306-47c7-9eab-e10bb0016507 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:47.796055 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece3f3c-5306-47c7-9eab-e10bb0016507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:47.798582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece3f3c-5306-47c7-9eab-e10bb0016507 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:47.809853 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ef5a7-b7aa-4861-935f-c8bf8aa4e8ca admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:47.813027 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1924/3847] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:22:47.819906 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f2410-b5dd-454e-9d32-caf5e080747b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:47.819906 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f2410-b5dd-454e-9d32-caf5e080747b admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:47.819906 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f2410-b5dd-454e-9d32-caf5e080747b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:47.819906 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f2410-b5dd-454e-9d32-caf5e080747b admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:47.820238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f2410-b5dd-454e-9d32-caf5e080747b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:47.820238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f2410-b5dd-454e-9d32-caf5e080747b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:47.820892 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece3f3c-5306-47c7-9eab-e10bb0016507 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:47.842945 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece3f3c-5306-47c7-9eab-e10bb0016507 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:47.851046 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1924/3848] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:22:47.855591 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f2410-b5dd-454e-9d32-caf5e080747b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:47.876751 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76e013-f847-4e6c-9af6-28b7dd517b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:47.879228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f2410-b5dd-454e-9d32-caf5e080747b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:47.880761 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76e013-f847-4e6c-9af6-28b7dd517b94 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:47.881238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76e013-f847-4e6c-9af6-28b7dd517b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:47.881540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76e013-f847-4e6c-9af6-28b7dd517b94 admin admin] PATH_INFO: `/v3/projects/350378218f3e4f86985047806ea958a6/users/5162bfc9d55d4b45b3c7840fa01a3178/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:47.895580 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77413b34-771a-48ce-b81b-f186e04e7dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:47.897124 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77413b34-771a-48ce-b81b-f186e04e7dee admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:47.897411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77413b34-771a-48ce-b81b-f186e04e7dee admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:47.897701 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77413b34-771a-48ce-b81b-f186e04e7dee admin admin] PATH_INFO: `/v3/projects/03431e5f43c045d78e741327bacf5d1c/users/f230caf9b44f4c11b91e2f9dcb3a3d82/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:47.909700 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e76e013-f847-4e6c-9af6-28b7dd517b94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=350378218f3e4f86985047806ea958a6, user_id=5162bfc9d55d4b45b3c7840fa01a3178, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:47.914308 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e76e013-f847-4e6c-9af6-28b7dd517b94 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:47.933411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77413b34-771a-48ce-b81b-f186e04e7dee admin admin] RBAC: Authorizing `identity:create_grant(project_id=03431e5f43c045d78e741327bacf5d1c, user_id=f230caf9b44f4c11b91e2f9dcb3a3d82, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:47.936174 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77413b34-771a-48ce-b81b-f186e04e7dee admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:47.994299 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1925/3849] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:22:47 2022] PUT /identity/v3/projects/350378218f3e4f86985047806ea958a6/users/5162bfc9d55d4b45b3c7840fa01a3178/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:48.008040 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76e013-f847-4e6c-9af6-28b7dd517b94 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:48.045362 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1925/3850] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:22:47 2022] PUT /identity/v3/projects/03431e5f43c045d78e741327bacf5d1c/users/f230caf9b44f4c11b91e2f9dcb3a3d82/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:22:48.052055 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11420aa-307b-4e3f-a111-e2a327cf70c4 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:48.052055 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11420aa-307b-4e3f-a111-e2a327cf70c4 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:48.052055 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11420aa-307b-4e3f-a111-e2a327cf70c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:48.075728 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-c11420aa-307b-4e3f-a111-e2a327cf70c4 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:22:48.081286 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c11420aa-307b-4e3f-a111-e2a327cf70c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:48.128440 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76e013-f847-4e6c-9af6-28b7dd517b94 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:48.155495 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1926/3851] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:22:48.165207 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11420aa-307b-4e3f-a111-e2a327cf70c4 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:48.167510 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c11420aa-307b-4e3f-a111-e2a327cf70c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:48.214342 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f70010-2cea-41ba-878a-03e2bee1feef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:48.215312 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f70010-2cea-41ba-878a-03e2bee1feef admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:48.215758 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f70010-2cea-41ba-878a-03e2bee1feef admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:48.216209 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f70010-2cea-41ba-878a-03e2bee1feef admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:48.217377 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f70010-2cea-41ba-878a-03e2bee1feef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:48.219313 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f70010-2cea-41ba-878a-03e2bee1feef admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:48.244578 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1926/3852] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:22:48.245468 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11420aa-307b-4e3f-a111-e2a327cf70c4 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:48.248876 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f70010-2cea-41ba-878a-03e2bee1feef admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:48.252011 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da04a3cc-5d57-48a8-ba0d-4b288d6ec041 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:48.253173 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04a3cc-5d57-48a8-ba0d-4b288d6ec041 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:48.253653 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04a3cc-5d57-48a8-ba0d-4b288d6ec041 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:48.254111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04a3cc-5d57-48a8-ba0d-4b288d6ec041 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:48.264417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f70010-2cea-41ba-878a-03e2bee1feef admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:48.266402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da04a3cc-5d57-48a8-ba0d-4b288d6ec041 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:48.268814 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da04a3cc-5d57-48a8-ba0d-4b288d6ec041 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:48.285098 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d077271-8507-47c1-88f6-bf04dd386614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:48.286244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d077271-8507-47c1-88f6-bf04dd386614 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:48.287698 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1927/3853] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:22:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:22:48.287828 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d077271-8507-47c1-88f6-bf04dd386614 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:48.287828 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d077271-8507-47c1-88f6-bf04dd386614 admin admin] PATH_INFO: `/v3/projects/350378218f3e4f86985047806ea958a6/users/5162bfc9d55d4b45b3c7840fa01a3178/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:48.289820 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d077271-8507-47c1-88f6-bf04dd386614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=350378218f3e4f86985047806ea958a6, user_id=5162bfc9d55d4b45b3c7840fa01a3178, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:48.292567 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d077271-8507-47c1-88f6-bf04dd386614 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:48.321481 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1927/3854] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:22:48 2022] PUT /identity/v3/projects/350378218f3e4f86985047806ea958a6/users/5162bfc9d55d4b45b3c7840fa01a3178/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:48.325250 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9095a-8914-4c16-b571-585c7b4a4620 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:48.325250 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9095a-8914-4c16-b571-585c7b4a4620 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:48.327012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9095a-8914-4c16-b571-585c7b4a4620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:48.357539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-1be9095a-8914-4c16-b571-585c7b4a4620 None None] MFA Rules not processed for user `5162bfc9d55d4b45b3c7840fa01a3178`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:22:48.359031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1be9095a-8914-4c16-b571-585c7b4a4620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:48.508375 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1928/3855] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:22:48 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:22:48.513121 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d077271-8507-47c1-88f6-bf04dd386614 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:48.528863 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d077271-8507-47c1-88f6-bf04dd386614 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:48.534652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d76261-4835-4741-84cc-aac5a4199517 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5162bfc9d55d4b45b3c7840fa01a3178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '350378218f3e4f86985047806ea958a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:48.535417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d76261-4835-4741-84cc-aac5a4199517 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:48.535799 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d76261-4835-4741-84cc-aac5a4199517 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:48.536264 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d76261-4835-4741-84cc-aac5a4199517 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] PATH_INFO: `/v3/regions` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:48.537768 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d76261-4835-4741-84cc-aac5a4199517 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:48.539998 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-c4d76261-4835-4741-84cc-aac5a4199517 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:22:48.539998 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:22:48.539998 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:22:48.540960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d76261-4835-4741-84cc-aac5a4199517 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:48.665349 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1928/3856] 10.222.0.23 () {60 vars in 1148 bytes} [Sat Apr 30 21:22:48 2022] POST /identity/v3/regions => generated 223 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:22:48.670425 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9095a-8914-4c16-b571-585c7b4a4620 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:48.688800 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9095a-8914-4c16-b571-585c7b4a4620 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:48.716426 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94bc239-5ebd-4ad7-b2f6-0d5739388804 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5162bfc9d55d4b45b3c7840fa01a3178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '350378218f3e4f86985047806ea958a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:48.717132 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bc239-5ebd-4ad7-b2f6-0d5739388804 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:48.717468 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bc239-5ebd-4ad7-b2f6-0d5739388804 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:48.717779 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bc239-5ebd-4ad7-b2f6-0d5739388804 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] PATH_INFO: `/v3/regions` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:48.721629 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94bc239-5ebd-4ad7-b2f6-0d5739388804 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:48.727392 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-e94bc239-5ebd-4ad7-b2f6-0d5739388804 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:22:48.727392 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:22:48.727392 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:22:48.727392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94bc239-5ebd-4ad7-b2f6-0d5739388804 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:48.802352 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1929/3857] 10.222.0.23 () {60 vars in 1148 bytes} [Sat Apr 30 21:22:48 2022] POST /identity/v3/regions => generated 223 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:22:48.805893 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d76261-4835-4741-84cc-aac5a4199517 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:48.827209 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d76261-4835-4741-84cc-aac5a4199517 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:48.863416 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ddcdb-3fb5-452e-af56-91121cf7c673 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5162bfc9d55d4b45b3c7840fa01a3178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '350378218f3e4f86985047806ea958a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:48.864494 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ddcdb-3fb5-452e-af56-91121cf7c673 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:48.864787 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ddcdb-3fb5-452e-af56-91121cf7c673 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:48.865099 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ddcdb-3fb5-452e-af56-91121cf7c673 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] PATH_INFO: `/v3/regions/4ca22bcf-7bbf-4b90-b748-786fa659e228` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:48.865852 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0ddcdb-3fb5-452e-af56-91121cf7c673 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: Authorizing `identity:create_region(region_id=4ca22bcf-7bbf-4b90-b748-786fa659e228)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:48.867709 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0ddcdb-3fb5-452e-af56-91121cf7c673 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:48.954510 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1929/3858] 10.222.0.23 () {60 vars in 1258 bytes} [Sat Apr 30 21:22:48 2022] PUT /identity/v3/regions/4ca22bcf-7bbf-4b90-b748-786fa659e228 => generated 232 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:22:48.962725 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94bc239-5ebd-4ad7-b2f6-0d5739388804 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:48.974053 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94bc239-5ebd-4ad7-b2f6-0d5739388804 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:48.994753 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ec142-f3fb-48c5-87b4-6b61e939ff1f tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5162bfc9d55d4b45b3c7840fa01a3178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '350378218f3e4f86985047806ea958a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:49.000808 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ec142-f3fb-48c5-87b4-6b61e939ff1f tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:49.007167 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ec142-f3fb-48c5-87b4-6b61e939ff1f tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:49.007167 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ec142-f3fb-48c5-87b4-6b61e939ff1f tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] PATH_INFO: `/v3/regions/4ca22bcf-7bbf-4b90-b748-786fa659e228` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:49.007167 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ec142-f3fb-48c5-87b4-6b61e939ff1f tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: Authorizing `identity:delete_region(region_id=4ca22bcf-7bbf-4b90-b748-786fa659e228)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:49.007167 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-e47ec142-f3fb-48c5-87b4-6b61e939ff1f tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:22:49.007167 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:22:49.007167 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:22:49.007722 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ec142-f3fb-48c5-87b4-6b61e939ff1f tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:49.112604 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1930/3859] 10.222.0.23 () {58 vars in 1241 bytes} [Sat Apr 30 21:22:48 2022] DELETE /identity/v3/regions/4ca22bcf-7bbf-4b90-b748-786fa659e228 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:49.120933 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ddcdb-3fb5-452e-af56-91121cf7c673 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:49.137178 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ddcdb-3fb5-452e-af56-91121cf7c673 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:49.161610 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df50c4-f1bb-4b08-900b-406b748bbd80 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5162bfc9d55d4b45b3c7840fa01a3178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '350378218f3e4f86985047806ea958a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:49.161610 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df50c4-f1bb-4b08-900b-406b748bbd80 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:49.161610 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df50c4-f1bb-4b08-900b-406b748bbd80 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:49.161970 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df50c4-f1bb-4b08-900b-406b748bbd80 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] PATH_INFO: `/v3/regions` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:49.163831 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df50c4-f1bb-4b08-900b-406b748bbd80 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:49.168374 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df50c4-f1bb-4b08-900b-406b748bbd80 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:49.285929 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1930/3860] 10.222.0.23 () {60 vars in 1149 bytes} [Sat Apr 30 21:22:49 2022] POST /identity/v3/regions => generated 254 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:22:49.290550 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ec142-f3fb-48c5-87b4-6b61e939ff1f tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:49.305330 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ec142-f3fb-48c5-87b4-6b61e939ff1f tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:49.333058 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2caba-b996-44e3-a120-02e910c704da tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5162bfc9d55d4b45b3c7840fa01a3178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '350378218f3e4f86985047806ea958a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:49.334471 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2caba-b996-44e3-a120-02e910c704da tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:49.334777 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2caba-b996-44e3-a120-02e910c704da tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:49.335036 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2caba-b996-44e3-a120-02e910c704da tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] PATH_INFO: `/v3/regions/35ec7dfc67dc4a44b1f361cb06819f07` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:49.335758 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2caba-b996-44e3-a120-02e910c704da tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: Authorizing `identity:update_region(region_id=35ec7dfc67dc4a44b1f361cb06819f07)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:49.336769 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-3ed2caba-b996-44e3-a120-02e910c704da tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:22:49.336769 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:22:49.336769 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:22:49.338085 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2caba-b996-44e3-a120-02e910c704da tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:49.444312 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1931/3861] 10.222.0.23 () {60 vars in 1249 bytes} [Sat Apr 30 21:22:49 2022] PATCH /identity/v3/regions/35ec7dfc67dc4a44b1f361cb06819f07 => generated 254 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:22:49.448616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df50c4-f1bb-4b08-900b-406b748bbd80 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:49.461716 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df50c4-f1bb-4b08-900b-406b748bbd80 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:49.486954 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02300b-3e53-4bb4-abbc-dc1b085905c9 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5162bfc9d55d4b45b3c7840fa01a3178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '350378218f3e4f86985047806ea958a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:49.492805 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02300b-3e53-4bb4-abbc-dc1b085905c9 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:49.498277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02300b-3e53-4bb4-abbc-dc1b085905c9 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:49.498277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02300b-3e53-4bb4-abbc-dc1b085905c9 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] PATH_INFO: `/v3/regions/35ec7dfc67dc4a44b1f361cb06819f07` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:49.498277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02300b-3e53-4bb4-abbc-dc1b085905c9 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: Authorizing `identity:get_region(region_id=35ec7dfc67dc4a44b1f361cb06819f07)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:49.498277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02300b-3e53-4bb4-abbc-dc1b085905c9 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:49.507197 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1931/3862] 10.222.0.23 () {58 vars in 1226 bytes} [Sat Apr 30 21:22:49 2022] GET /identity/v3/regions/35ec7dfc67dc4a44b1f361cb06819f07 => generated 254 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:22:49.509053 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2caba-b996-44e3-a120-02e910c704da tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:49.524743 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2caba-b996-44e3-a120-02e910c704da tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:49.543439 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319459d-7f52-461c-b821-77ad6dbd20fb tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5162bfc9d55d4b45b3c7840fa01a3178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '350378218f3e4f86985047806ea958a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:49.544818 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319459d-7f52-461c-b821-77ad6dbd20fb tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:49.545392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319459d-7f52-461c-b821-77ad6dbd20fb tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:49.545588 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319459d-7f52-461c-b821-77ad6dbd20fb tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] PATH_INFO: `/v3/regions/35ec7dfc67dc4a44b1f361cb06819f07` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:49.546238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6319459d-7f52-461c-b821-77ad6dbd20fb tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: Authorizing `identity:delete_region(region_id=35ec7dfc67dc4a44b1f361cb06819f07)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:49.551644 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6319459d-7f52-461c-b821-77ad6dbd20fb tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:50.073504 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1932/3863] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:22:49 2022] DELETE /identity/v3/regions/35ec7dfc67dc4a44b1f361cb06819f07 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:50.077496 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02300b-3e53-4bb4-abbc-dc1b085905c9 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:50.089287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02300b-3e53-4bb4-abbc-dc1b085905c9 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:50.106142 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f0cfb-1454-4120-8636-fad6dd444fbc tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5162bfc9d55d4b45b3c7840fa01a3178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '350378218f3e4f86985047806ea958a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:50.106870 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f0cfb-1454-4120-8636-fad6dd444fbc tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:50.107158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f0cfb-1454-4120-8636-fad6dd444fbc tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:50.107442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f0cfb-1454-4120-8636-fad6dd444fbc tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] PATH_INFO: `/v3/regions` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:50.108118 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f0cfb-1454-4120-8636-fad6dd444fbc tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:50.109288 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f0cfb-1454-4120-8636-fad6dd444fbc tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:50.116325 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1932/3864] 10.222.0.23 () {58 vars in 1127 bytes} [Sat Apr 30 21:22:50 2022] GET /identity/v3/regions => generated 668 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:22:50.120336 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319459d-7f52-461c-b821-77ad6dbd20fb tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:50.137416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319459d-7f52-461c-b821-77ad6dbd20fb tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:50.143037 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5744c0-434e-406f-a367-0c5cd2724685 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5162bfc9d55d4b45b3c7840fa01a3178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '350378218f3e4f86985047806ea958a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:50.143928 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5744c0-434e-406f-a367-0c5cd2724685 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:50.144743 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5744c0-434e-406f-a367-0c5cd2724685 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:50.144743 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5744c0-434e-406f-a367-0c5cd2724685 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] PATH_INFO: `/v3/regions/35ec7dfc67dc4a44b1f361cb06819f07` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:50.145119 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5744c0-434e-406f-a367-0c5cd2724685 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: Authorizing `identity:delete_region(region_id=35ec7dfc67dc4a44b1f361cb06819f07)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:50.146751 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5744c0-434e-406f-a367-0c5cd2724685 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:50.187497 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-ea5744c0-434e-406f-a367-0c5cd2724685 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] Could not find region: 35ec7dfc67dc4a44b1f361cb06819f07.: keystone.exception.RegionNotFound: Could not find region: 35ec7dfc67dc4a44b1f361cb06819f07. Apr 30 21:22:50.187497 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:22:50.187497 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Apr 30 21:22:50.187497 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Apr 30 21:22:50.187497 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Apr 30 21:22:50.187497 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Apr 30 21:22:50.187497 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Apr 30 21:22:50.187497 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Apr 30 21:22:50.187497 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 35ec7dfc67dc4a44b1f361cb06819f07. Apr 30 21:22:50.187497 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:22:50.187497 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 21:22:50.187497 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:22:50.187497 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:22:50.187497 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:22:50.187497 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:22:50.187497 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:22:50.188808 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:22:50.188808 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:22:50.188808 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:22:50.188808 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:22:50.188808 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:22:50.188808 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:22:50.188808 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:22:50.188808 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Apr 30 21:22:50.188808 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Apr 30 21:22:50.188808 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:22:50.188808 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:22:50.188808 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Apr 30 21:22:50.188808 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Apr 30 21:22:50.188808 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 35ec7dfc67dc4a44b1f361cb06819f07. Apr 30 21:22:50.188808 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:22:50.194564 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1933/3865] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:22:50 2022] DELETE /identity/v3/regions/35ec7dfc67dc4a44b1f361cb06819f07 => generated 112 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 30 21:22:50.194931 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f0cfb-1454-4120-8636-fad6dd444fbc tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:50.206007 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f0cfb-1454-4120-8636-fad6dd444fbc tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:50.212294 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51925f2a-112c-4e75-8b1d-acacb6026bd8 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5162bfc9d55d4b45b3c7840fa01a3178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '350378218f3e4f86985047806ea958a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:50.213123 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51925f2a-112c-4e75-8b1d-acacb6026bd8 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:50.213292 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51925f2a-112c-4e75-8b1d-acacb6026bd8 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:50.213743 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51925f2a-112c-4e75-8b1d-acacb6026bd8 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] PATH_INFO: `/v3/regions` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:50.219226 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51925f2a-112c-4e75-8b1d-acacb6026bd8 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:50.219226 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51925f2a-112c-4e75-8b1d-acacb6026bd8 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:50.227655 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1933/3866] 10.222.0.23 () {58 vars in 1127 bytes} [Sat Apr 30 21:22:50 2022] GET /identity/v3/regions => generated 668 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:22:50.228766 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5744c0-434e-406f-a367-0c5cd2724685 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:50.242473 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5744c0-434e-406f-a367-0c5cd2724685 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:50.251980 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8e3f8-9942-4ac5-82c4-ff01c3b6acca tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5162bfc9d55d4b45b3c7840fa01a3178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '350378218f3e4f86985047806ea958a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:50.253471 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8e3f8-9942-4ac5-82c4-ff01c3b6acca tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:50.254047 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8e3f8-9942-4ac5-82c4-ff01c3b6acca tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:50.254426 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a8e3f8-9942-4ac5-82c4-ff01c3b6acca tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] PATH_INFO: `/v3/regions` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:50.255253 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a8e3f8-9942-4ac5-82c4-ff01c3b6acca tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:50.257611 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a8e3f8-9942-4ac5-82c4-ff01c3b6acca tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:50.316012 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb117b-2494-4b91-9097-c36d203cacda None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:50.316303 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb117b-2494-4b91-9097-c36d203cacda None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:50.316582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb117b-2494-4b91-9097-c36d203cacda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:50.345486 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1934/3867] 10.222.0.23 () {60 vars in 1149 bytes} [Sat Apr 30 21:22:50 2022] POST /identity/v3/regions => generated 253 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:22:50.351826 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8e3f8-9942-4ac5-82c4-ff01c3b6acca tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:50.362020 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-d6bb117b-2494-4b91-9097-c36d203cacda None None] MFA Rules not processed for user `f230caf9b44f4c11b91e2f9dcb3a3d82`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:22:50.364375 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d6bb117b-2494-4b91-9097-c36d203cacda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:50.416104 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a8e3f8-9942-4ac5-82c4-ff01c3b6acca tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:50.427277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee82031-193f-4212-8a99-0b47638f84f0 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5162bfc9d55d4b45b3c7840fa01a3178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '350378218f3e4f86985047806ea958a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:50.427604 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee82031-193f-4212-8a99-0b47638f84f0 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:50.427804 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee82031-193f-4212-8a99-0b47638f84f0 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:50.428140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee82031-193f-4212-8a99-0b47638f84f0 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] PATH_INFO: `/v3/regions` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:50.429390 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee82031-193f-4212-8a99-0b47638f84f0 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: Adding query filter params (parent_region_id=6071edfd69664b4bb1431da790421d6c) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:22:50.429765 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee82031-193f-4212-8a99-0b47638f84f0 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:50.433966 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee82031-193f-4212-8a99-0b47638f84f0 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:50.448637 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1935/3868] 10.222.0.23 () {58 vars in 1226 bytes} [Sat Apr 30 21:22:50 2022] GET /identity/v3/regions?parent_region_id=6071edfd69664b4bb1431da790421d6c => generated 399 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:22:50.453040 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee82031-193f-4212-8a99-0b47638f84f0 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:50.467528 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1934/3869] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:22:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:22:50.468099 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee82031-193f-4212-8a99-0b47638f84f0 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:50.472202 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e68bd6-8731-4e75-b68f-5e6bc99c3e5b None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:50.472505 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e68bd6-8731-4e75-b68f-5e6bc99c3e5b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:50.476492 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d4fa4-9415-406d-9fea-f1baa3efdcf9 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5162bfc9d55d4b45b3c7840fa01a3178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '350378218f3e4f86985047806ea958a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:50.476636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e68bd6-8731-4e75-b68f-5e6bc99c3e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:50.476717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d4fa4-9415-406d-9fea-f1baa3efdcf9 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:50.476717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d4fa4-9415-406d-9fea-f1baa3efdcf9 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:50.476717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d4fa4-9415-406d-9fea-f1baa3efdcf9 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] PATH_INFO: `/v3/regions/937584f872054868b2c07f3f207a9453` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:50.476717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d4fa4-9415-406d-9fea-f1baa3efdcf9 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: Authorizing `identity:delete_region(region_id=937584f872054868b2c07f3f207a9453)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:50.477682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d4fa4-9415-406d-9fea-f1baa3efdcf9 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:50.499621 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-42e68bd6-8731-4e75-b68f-5e6bc99c3e5b None None] MFA Rules not processed for user `f230caf9b44f4c11b91e2f9dcb3a3d82`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:22:50.501684 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-42e68bd6-8731-4e75-b68f-5e6bc99c3e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:50.516910 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1935/3870] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:22:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:22:50.525974 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e68bd6-8731-4e75-b68f-5e6bc99c3e5b None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:50.528671 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-42e68bd6-8731-4e75-b68f-5e6bc99c3e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:50.554475 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1936/3871] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:22:50 2022] DELETE /identity/v3/regions/937584f872054868b2c07f3f207a9453 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:50.563014 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d4fa4-9415-406d-9fea-f1baa3efdcf9 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:50.604071 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d4fa4-9415-406d-9fea-f1baa3efdcf9 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:50.610154 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6641f861-377c-4c4f-ba06-4340949792a4 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5162bfc9d55d4b45b3c7840fa01a3178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '350378218f3e4f86985047806ea958a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:50.611231 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641f861-377c-4c4f-ba06-4340949792a4 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:50.611522 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641f861-377c-4c4f-ba06-4340949792a4 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:50.612396 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641f861-377c-4c4f-ba06-4340949792a4 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] PATH_INFO: `/v3/regions/08a4e3d6cb4b4ba2b4e7ab045a804785` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:50.613060 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6641f861-377c-4c4f-ba06-4340949792a4 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: Authorizing `identity:delete_region(region_id=08a4e3d6cb4b4ba2b4e7ab045a804785)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:50.614907 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6641f861-377c-4c4f-ba06-4340949792a4 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:50.661915 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e68bd6-8731-4e75-b68f-5e6bc99c3e5b None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:50.684308 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe18ce-17ec-4022-bb43-3a6fca857657 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:50.685005 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe18ce-17ec-4022-bb43-3a6fca857657 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:50.685292 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe18ce-17ec-4022-bb43-3a6fca857657 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:50.685565 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe18ce-17ec-4022-bb43-3a6fca857657 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:50.701736 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbe18ce-17ec-4022-bb43-3a6fca857657 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:50.701736 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbe18ce-17ec-4022-bb43-3a6fca857657 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:50.732703 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1937/3872] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:22:50 2022] DELETE /identity/v3/regions/08a4e3d6cb4b4ba2b4e7ab045a804785 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:50.738408 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6641f861-377c-4c4f-ba06-4340949792a4 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:50.739103 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1936/3873] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:22:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:22:50.794281 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6641f861-377c-4c4f-ba06-4340949792a4 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:50.811882 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ccbefe-cf13-4b17-b1f8-7ad2e4baac28 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5162bfc9d55d4b45b3c7840fa01a3178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '350378218f3e4f86985047806ea958a6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:50.812884 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccbefe-cf13-4b17-b1f8-7ad2e4baac28 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:50.813383 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccbefe-cf13-4b17-b1f8-7ad2e4baac28 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:50.813786 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccbefe-cf13-4b17-b1f8-7ad2e4baac28 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] PATH_INFO: `/v3/regions/6071edfd69664b4bb1431da790421d6c` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:50.816484 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ccbefe-cf13-4b17-b1f8-7ad2e4baac28 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: Authorizing `identity:delete_region(region_id=6071edfd69664b4bb1431da790421d6c)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:50.818977 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ccbefe-cf13-4b17-b1f8-7ad2e4baac28 tempest-RegionsTestJSON-1118049067 tempest-RegionsTestJSON-1118049067-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:50.919909 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1938/3874] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:22:50 2022] DELETE /identity/v3/regions/6071edfd69664b4bb1431da790421d6c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:50.923316 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe18ce-17ec-4022-bb43-3a6fca857657 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:51.046206 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe18ce-17ec-4022-bb43-3a6fca857657 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:51.072119 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff576d-24f2-4d48-88ac-5970e47da6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:51.073001 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff576d-24f2-4d48-88ac-5970e47da6b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:51.073433 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff576d-24f2-4d48-88ac-5970e47da6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:51.073718 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff576d-24f2-4d48-88ac-5970e47da6b2 admin admin] PATH_INFO: `/v3/users/2c4dd9684e344d47a7213877aa4427a0` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:51.075415 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff576d-24f2-4d48-88ac-5970e47da6b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c4dd9684e344d47a7213877aa4427a0)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:51.077594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff576d-24f2-4d48-88ac-5970e47da6b2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:51.301505 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e4ff576d-24f2-4d48-88ac-5970e47da6b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c4dd9684e344d47a7213877aa4427a0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:51.323520 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e4ff576d-24f2-4d48-88ac-5970e47da6b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c4dd9684e344d47a7213877aa4427a0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:51.397669 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e4ff576d-24f2-4d48-88ac-5970e47da6b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c4dd9684e344d47a7213877aa4427a0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:51.406251 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e4ff576d-24f2-4d48-88ac-5970e47da6b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c4dd9684e344d47a7213877aa4427a0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:51.407331 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e4ff576d-24f2-4d48-88ac-5970e47da6b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c4dd9684e344d47a7213877aa4427a0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:51.416840 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1937/3875] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:22:50 2022] DELETE /identity/v3/users/2c4dd9684e344d47a7213877aa4427a0 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:51.425969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32fbd4-d2e8-4784-9144-a2892360196f None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:51.426689 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32fbd4-d2e8-4784-9144-a2892360196f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:51.427232 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32fbd4-d2e8-4784-9144-a2892360196f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:51.452919 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-3c32fbd4-d2e8-4784-9144-a2892360196f None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:22:51.454256 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3c32fbd4-d2e8-4784-9144-a2892360196f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:51.551910 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1939/3876] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:22:51.562673 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff576d-24f2-4d48-88ac-5970e47da6b2 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:51.564748 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e4ff576d-24f2-4d48-88ac-5970e47da6b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:51.683232 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff576d-24f2-4d48-88ac-5970e47da6b2 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:51.696298 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917cc918-803a-478e-8dd1-0d5b7e6de375 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:51.696298 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cc918-803a-478e-8dd1-0d5b7e6de375 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:51.696888 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cc918-803a-478e-8dd1-0d5b7e6de375 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:51.696888 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cc918-803a-478e-8dd1-0d5b7e6de375 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:51.708885 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917cc918-803a-478e-8dd1-0d5b7e6de375 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:51.711051 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917cc918-803a-478e-8dd1-0d5b7e6de375 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:51.721796 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1938/3877] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:22:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:22:52.347897 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c32fbd4-d2e8-4784-9144-a2892360196f None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:52.352178 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3c32fbd4-d2e8-4784-9144-a2892360196f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:52.375990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c32fbd4-d2e8-4784-9144-a2892360196f None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:52.384074 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2fa5da-1530-4cca-8ec3-c6b502f6b850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:52.384959 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2fa5da-1530-4cca-8ec3-c6b502f6b850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:52.389835 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2fa5da-1530-4cca-8ec3-c6b502f6b850 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:52.392797 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2fa5da-1530-4cca-8ec3-c6b502f6b850 admin admin] PATH_INFO: `/v3/projects/cf5cbf4fea854b93815d80d3af27bdf4` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:52.393797 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2fa5da-1530-4cca-8ec3-c6b502f6b850 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf5cbf4fea854b93815d80d3af27bdf4)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:52.397463 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2fa5da-1530-4cca-8ec3-c6b502f6b850 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:52.562375 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6b2fa5da-1530-4cca-8ec3-c6b502f6b850 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf5cbf4fea854b93815d80d3af27bdf4', 'request_id': 'req-6b2fa5da-1530-4cca-8ec3-c6b502f6b850'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:52.577345 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6b2fa5da-1530-4cca-8ec3-c6b502f6b850 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf5cbf4fea854b93815d80d3af27bdf4', 'request_id': 'req-6b2fa5da-1530-4cca-8ec3-c6b502f6b850'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:52.585875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6b2fa5da-1530-4cca-8ec3-c6b502f6b850 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf5cbf4fea854b93815d80d3af27bdf4', 'request_id': 'req-6b2fa5da-1530-4cca-8ec3-c6b502f6b850'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:52.670625 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6b2fa5da-1530-4cca-8ec3-c6b502f6b850 admin admin] The token cache is being invalidate because project cf5cbf4fea854b93815d80d3af27bdf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:22:52.671316 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6b2fa5da-1530-4cca-8ec3-c6b502f6b850 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:52.672161 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6b2fa5da-1530-4cca-8ec3-c6b502f6b850 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:52.674491 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1940/3878] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:22:52 2022] DELETE /identity/v3/projects/cf5cbf4fea854b93815d80d3af27bdf4 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:52.679254 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917cc918-803a-478e-8dd1-0d5b7e6de375 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:52.692327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917cc918-803a-478e-8dd1-0d5b7e6de375 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:52.800939 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b853c1-1eb7-462a-9c4e-bf73fa13f823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:52.803913 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b853c1-1eb7-462a-9c4e-bf73fa13f823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:52.804441 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b853c1-1eb7-462a-9c4e-bf73fa13f823 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:52.804887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b853c1-1eb7-462a-9c4e-bf73fa13f823 admin admin] PATH_INFO: `/v3/users/5162bfc9d55d4b45b3c7840fa01a3178` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:52.806860 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b853c1-1eb7-462a-9c4e-bf73fa13f823 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5162bfc9d55d4b45b3c7840fa01a3178)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:52.810043 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b853c1-1eb7-462a-9c4e-bf73fa13f823 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:53.028527 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a4b853c1-1eb7-462a-9c4e-bf73fa13f823 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5162bfc9d55d4b45b3c7840fa01a3178'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:53.043635 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a4b853c1-1eb7-462a-9c4e-bf73fa13f823 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5162bfc9d55d4b45b3c7840fa01a3178'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:53.134317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a4b853c1-1eb7-462a-9c4e-bf73fa13f823 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5162bfc9d55d4b45b3c7840fa01a3178'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:53.146241 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a4b853c1-1eb7-462a-9c4e-bf73fa13f823 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5162bfc9d55d4b45b3c7840fa01a3178'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:53.148021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a4b853c1-1eb7-462a-9c4e-bf73fa13f823 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5162bfc9d55d4b45b3c7840fa01a3178'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:53.155342 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1939/3879] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:22:52 2022] DELETE /identity/v3/users/5162bfc9d55d4b45b3c7840fa01a3178 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:53.906102 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2fa5da-1530-4cca-8ec3-c6b502f6b850 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:53.907793 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6b2fa5da-1530-4cca-8ec3-c6b502f6b850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:53.947143 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2fa5da-1530-4cca-8ec3-c6b502f6b850 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:54.033495 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d021f-d0fe-4d81-825d-b111fec74616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:54.034566 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d021f-d0fe-4d81-825d-b111fec74616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:54.034951 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d021f-d0fe-4d81-825d-b111fec74616 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:54.035323 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d021f-d0fe-4d81-825d-b111fec74616 admin admin] PATH_INFO: `/v3/projects/350378218f3e4f86985047806ea958a6` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:54.036701 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d021f-d0fe-4d81-825d-b111fec74616 admin admin] RBAC: Authorizing `identity:delete_project(project_id=350378218f3e4f86985047806ea958a6)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:54.042428 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d021f-d0fe-4d81-825d-b111fec74616 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:54.165875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-362d021f-d0fe-4d81-825d-b111fec74616 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '350378218f3e4f86985047806ea958a6', 'request_id': 'req-362d021f-d0fe-4d81-825d-b111fec74616'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:54.172164 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-362d021f-d0fe-4d81-825d-b111fec74616 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '350378218f3e4f86985047806ea958a6', 'request_id': 'req-362d021f-d0fe-4d81-825d-b111fec74616'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:54.183280 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-362d021f-d0fe-4d81-825d-b111fec74616 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '350378218f3e4f86985047806ea958a6', 'request_id': 'req-362d021f-d0fe-4d81-825d-b111fec74616'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:54.257957 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-362d021f-d0fe-4d81-825d-b111fec74616 admin admin] The token cache is being invalidate because project 350378218f3e4f86985047806ea958a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:22:54.258613 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-362d021f-d0fe-4d81-825d-b111fec74616 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:54.259534 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-362d021f-d0fe-4d81-825d-b111fec74616 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:54.261303 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1941/3880] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:22:53 2022] DELETE /identity/v3/projects/350378218f3e4f86985047806ea958a6 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:54.266505 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df1d92-6d91-4bb6-815b-8570373b88a2 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:54.267521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df1d92-6d91-4bb6-815b-8570373b88a2 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:54.267989 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df1d92-6d91-4bb6-815b-8570373b88a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:54.293448 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-f8df1d92-6d91-4bb6-815b-8570373b88a2 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:22:54.294701 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f8df1d92-6d91-4bb6-815b-8570373b88a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:54.397073 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1940/3881] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:22:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:22:54.404782 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee83ad-8f2c-44af-a4d2-f05c43ca3109 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:54.405061 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee83ad-8f2c-44af-a4d2-f05c43ca3109 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:54.405378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee83ad-8f2c-44af-a4d2-f05c43ca3109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:54.428918 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-5cee83ad-8f2c-44af-a4d2-f05c43ca3109 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:22:54.430258 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5cee83ad-8f2c-44af-a4d2-f05c43ca3109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:54.441828 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1942/3882] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:22:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:22:54.445013 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df1d92-6d91-4bb6-815b-8570373b88a2 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:54.455756 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df1d92-6d91-4bb6-815b-8570373b88a2 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:54.460925 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560be912-ea9b-4607-89f3-91b3c85f3d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:54.461603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560be912-ea9b-4607-89f3-91b3c85f3d98 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:54.462121 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560be912-ea9b-4607-89f3-91b3c85f3d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:54.462406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560be912-ea9b-4607-89f3-91b3c85f3d98 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:54.463169 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560be912-ea9b-4607-89f3-91b3c85f3d98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:22:54.463476 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560be912-ea9b-4607-89f3-91b3c85f3d98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:54.465160 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560be912-ea9b-4607-89f3-91b3c85f3d98 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:54.479778 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1941/3883] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:22:54.485409 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee83ad-8f2c-44af-a4d2-f05c43ca3109 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:54.503195 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee83ad-8f2c-44af-a4d2-f05c43ca3109 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:54.510025 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a946fd7-4dd0-490b-a78f-f4b460501433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:54.526288 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a946fd7-4dd0-490b-a78f-f4b460501433 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:54.526288 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a946fd7-4dd0-490b-a78f-f4b460501433 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:54.526288 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a946fd7-4dd0-490b-a78f-f4b460501433 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:54.526288 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a946fd7-4dd0-490b-a78f-f4b460501433 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:54.526288 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a946fd7-4dd0-490b-a78f-f4b460501433 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:54.691875 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1943/3884] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:22:54 2022] POST /identity/v3/projects => generated 365 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:22:54.695858 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560be912-ea9b-4607-89f3-91b3c85f3d98 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:54.707101 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560be912-ea9b-4607-89f3-91b3c85f3d98 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:54.772541 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbee5b-38ee-4226-9c13-85f5819ece14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:54.773293 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbee5b-38ee-4226-9c13-85f5819ece14 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:54.773676 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbee5b-38ee-4226-9c13-85f5819ece14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:54.779058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbee5b-38ee-4226-9c13-85f5819ece14 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:54.779058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cbee5b-38ee-4226-9c13-85f5819ece14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:54.779058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cbee5b-38ee-4226-9c13-85f5819ece14 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:54.860405 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1942/3885] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:22:54 2022] POST /identity/v3/users => generated 283 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:22:54.864430 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a946fd7-4dd0-490b-a78f-f4b460501433 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:54.877689 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a946fd7-4dd0-490b-a78f-f4b460501433 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:54.883563 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b94d0-5508-497c-9b43-1e65c9ec2593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:54.884262 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b94d0-5508-497c-9b43-1e65c9ec2593 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:54.884555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b94d0-5508-497c-9b43-1e65c9ec2593 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:54.884824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b94d0-5508-497c-9b43-1e65c9ec2593 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:54.885551 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855b94d0-5508-497c-9b43-1e65c9ec2593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:54.887216 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855b94d0-5508-497c-9b43-1e65c9ec2593 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:54.902665 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1944/3886] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:22:54.904269 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbee5b-38ee-4226-9c13-85f5819ece14 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:54.918080 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbee5b-38ee-4226-9c13-85f5819ece14 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:54.923712 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949cb80-b538-42e5-9cae-cf0bcfdc7b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:54.924843 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949cb80-b538-42e5-9cae-cf0bcfdc7b68 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:54.925539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949cb80-b538-42e5-9cae-cf0bcfdc7b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:54.926014 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949cb80-b538-42e5-9cae-cf0bcfdc7b68 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:54.926892 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e949cb80-b538-42e5-9cae-cf0bcfdc7b68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:54.928745 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e949cb80-b538-42e5-9cae-cf0bcfdc7b68 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:54.951891 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1943/3887] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:22:54.955798 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b94d0-5508-497c-9b43-1e65c9ec2593 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:54.968590 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b94d0-5508-497c-9b43-1e65c9ec2593 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:54.976994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22cf55-6567-4e5c-bfb6-e32130f87204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:54.976994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22cf55-6567-4e5c-bfb6-e32130f87204 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:54.976994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22cf55-6567-4e5c-bfb6-e32130f87204 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:54.976994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22cf55-6567-4e5c-bfb6-e32130f87204 admin admin] PATH_INFO: `/v3/projects/95dcf9a748f74f429c0ba59c06b9a11f/users/aeab0894645340edb86e6f6eae501cad/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:54.994393 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22cf55-6567-4e5c-bfb6-e32130f87204 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95dcf9a748f74f429c0ba59c06b9a11f, user_id=aeab0894645340edb86e6f6eae501cad, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:54.997473 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22cf55-6567-4e5c-bfb6-e32130f87204 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:55.112679 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1945/3888] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:22:54 2022] PUT /identity/v3/projects/95dcf9a748f74f429c0ba59c06b9a11f/users/aeab0894645340edb86e6f6eae501cad/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:22:55.123202 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82eca75-fe05-4727-b31c-187079f49470 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:55.123494 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82eca75-fe05-4727-b31c-187079f49470 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:55.123777 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82eca75-fe05-4727-b31c-187079f49470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:55.159869 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-e82eca75-fe05-4727-b31c-187079f49470 None None] MFA Rules not processed for user `aeab0894645340edb86e6f6eae501cad`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:22:55.161615 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e82eca75-fe05-4727-b31c-187079f49470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:55.233422 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1944/3889] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:22:55 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:22:55.237938 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22cf55-6567-4e5c-bfb6-e32130f87204 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:55.312275 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22cf55-6567-4e5c-bfb6-e32130f87204 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:55.320966 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81e8c6-ade2-4c83-9a73-e97eedeef821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:55.321618 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81e8c6-ade2-4c83-9a73-e97eedeef821 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:55.321925 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81e8c6-ade2-4c83-9a73-e97eedeef821 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:55.322207 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81e8c6-ade2-4c83-9a73-e97eedeef821 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:55.322893 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db81e8c6-ade2-4c83-9a73-e97eedeef821 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:55.324821 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db81e8c6-ade2-4c83-9a73-e97eedeef821 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:55.472894 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1946/3890] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:22:55 2022] POST /identity/v3/projects => generated 359 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:22:55.476699 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82eca75-fe05-4727-b31c-187079f49470 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:55.491840 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82eca75-fe05-4727-b31c-187079f49470 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:55.546886 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d1af0-a135-4421-bcf7-67e185151880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:55.548250 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d1af0-a135-4421-bcf7-67e185151880 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:55.548532 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d1af0-a135-4421-bcf7-67e185151880 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:55.548806 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d1af0-a135-4421-bcf7-67e185151880 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:55.549771 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d1af0-a135-4421-bcf7-67e185151880 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:55.551724 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3d1af0-a135-4421-bcf7-67e185151880 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:55.664156 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1945/3891] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:22:55 2022] POST /identity/v3/users => generated 286 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:22:55.666275 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81e8c6-ade2-4c83-9a73-e97eedeef821 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:55.678649 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81e8c6-ade2-4c83-9a73-e97eedeef821 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:55.684271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8511cb-2621-4a2e-bb22-4eefb714f3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:55.684947 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8511cb-2621-4a2e-bb22-4eefb714f3ae admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:55.685230 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8511cb-2621-4a2e-bb22-4eefb714f3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:55.685507 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8511cb-2621-4a2e-bb22-4eefb714f3ae admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:55.686272 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8511cb-2621-4a2e-bb22-4eefb714f3ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:55.688023 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8511cb-2621-4a2e-bb22-4eefb714f3ae admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:55.699018 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1947/3892] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:22:55.703300 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d1af0-a135-4421-bcf7-67e185151880 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:55.715236 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d1af0-a135-4421-bcf7-67e185151880 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:55.720617 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae10ea-3346-4c59-a3ed-e84836ebebef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:55.721618 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae10ea-3346-4c59-a3ed-e84836ebebef admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:55.722170 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae10ea-3346-4c59-a3ed-e84836ebebef admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:55.722524 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae10ea-3346-4c59-a3ed-e84836ebebef admin admin] PATH_INFO: `/v3/projects/474d2e5f1bfd475fa1bbf3ecebe6db98/users/4b5b34df34514a67867954cdb285e325/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:55.739798 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae10ea-3346-4c59-a3ed-e84836ebebef admin admin] RBAC: Authorizing `identity:create_grant(project_id=474d2e5f1bfd475fa1bbf3ecebe6db98, user_id=4b5b34df34514a67867954cdb285e325, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:55.742522 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae10ea-3346-4c59-a3ed-e84836ebebef admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:55.809527 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1946/3893] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:22:55 2022] PUT /identity/v3/projects/474d2e5f1bfd475fa1bbf3ecebe6db98/users/4b5b34df34514a67867954cdb285e325/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:55.814072 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8511cb-2621-4a2e-bb22-4eefb714f3ae admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:55.824878 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8511cb-2621-4a2e-bb22-4eefb714f3ae admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:55.885351 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3216cac-c1f5-4270-82bf-bac8548a498c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:55.886106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3216cac-c1f5-4270-82bf-bac8548a498c admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:55.886404 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3216cac-c1f5-4270-82bf-bac8548a498c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:55.886712 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3216cac-c1f5-4270-82bf-bac8548a498c admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:55.887447 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3216cac-c1f5-4270-82bf-bac8548a498c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:55.889084 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3216cac-c1f5-4270-82bf-bac8548a498c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:55.900262 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1948/3894] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:22:55.904594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae10ea-3346-4c59-a3ed-e84836ebebef admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:55.915968 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae10ea-3346-4c59-a3ed-e84836ebebef admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:55.920827 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf1aa0f-8c96-44ef-b373-cccda9bbb0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:55.921747 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1aa0f-8c96-44ef-b373-cccda9bbb0a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:55.922064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1aa0f-8c96-44ef-b373-cccda9bbb0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:55.922344 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1aa0f-8c96-44ef-b373-cccda9bbb0a3 admin admin] PATH_INFO: `/v3/projects/474d2e5f1bfd475fa1bbf3ecebe6db98/users/4b5b34df34514a67867954cdb285e325/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:55.924356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf1aa0f-8c96-44ef-b373-cccda9bbb0a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=474d2e5f1bfd475fa1bbf3ecebe6db98, user_id=4b5b34df34514a67867954cdb285e325, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:55.927443 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf1aa0f-8c96-44ef-b373-cccda9bbb0a3 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:55.938624 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1947/3895] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:22:55 2022] PUT /identity/v3/projects/474d2e5f1bfd475fa1bbf3ecebe6db98/users/4b5b34df34514a67867954cdb285e325/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:55.951338 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550089ba-222d-4316-8357-e96987a44c1f None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:55.951810 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550089ba-222d-4316-8357-e96987a44c1f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:55.952098 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550089ba-222d-4316-8357-e96987a44c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:55.982360 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-550089ba-222d-4316-8357-e96987a44c1f None None] MFA Rules not processed for user `4b5b34df34514a67867954cdb285e325`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:22:55.983760 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-550089ba-222d-4316-8357-e96987a44c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:56.069627 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1949/3896] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:22:55 2022] POST /identity/v3/auth/tokens => generated 3293 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:22:56.073726 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf1aa0f-8c96-44ef-b373-cccda9bbb0a3 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:56.087217 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf1aa0f-8c96-44ef-b373-cccda9bbb0a3 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:56.092732 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a78af2-1841-4a36-8736-d28a82f4841f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:56.093469 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a78af2-1841-4a36-8736-d28a82f4841f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:56.093864 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a78af2-1841-4a36-8736-d28a82f4841f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:56.094323 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a78af2-1841-4a36-8736-d28a82f4841f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:56.095147 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a78af2-1841-4a36-8736-d28a82f4841f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:56.096238 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-b9a78af2-1841-4a36-8736-d28a82f4841f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:22:56.096238 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:22:56.096238 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:22:56.097227 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a78af2-1841-4a36-8736-d28a82f4841f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:56.204621 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1948/3897] 10.222.0.23 () {60 vars in 1142 bytes} [Sat Apr 30 21:22:56 2022] POST /identity/v3/roles => generated 235 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:22:56.208734 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550089ba-222d-4316-8357-e96987a44c1f None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:56.219074 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550089ba-222d-4316-8357-e96987a44c1f None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:56.224062 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440aa8c-d77a-4ce9-8d6f-aa065c19c134 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:56.225374 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440aa8c-d77a-4ce9-8d6f-aa065c19c134 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:56.225694 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440aa8c-d77a-4ce9-8d6f-aa065c19c134 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:56.226006 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440aa8c-d77a-4ce9-8d6f-aa065c19c134 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:56.226782 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440aa8c-d77a-4ce9-8d6f-aa065c19c134 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:56.227836 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-8440aa8c-d77a-4ce9-8d6f-aa065c19c134 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:22:56.227836 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:22:56.227836 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:22:56.228722 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440aa8c-d77a-4ce9-8d6f-aa065c19c134 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:56.306196 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1950/3898] 10.222.0.23 () {60 vars in 1142 bytes} [Sat Apr 30 21:22:56 2022] POST /identity/v3/roles => generated 235 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:22:56.307741 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a78af2-1841-4a36-8736-d28a82f4841f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:56.320046 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a78af2-1841-4a36-8736-d28a82f4841f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:56.332192 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349a628-6f92-4c8f-b320-a18050d089bb tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:56.332961 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349a628-6f92-4c8f-b320-a18050d089bb tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:56.333306 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349a628-6f92-4c8f-b320-a18050d089bb tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:56.333654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349a628-6f92-4c8f-b320-a18050d089bb tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:56.335355 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349a628-6f92-4c8f-b320-a18050d089bb tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:56.336876 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349a628-6f92-4c8f-b320-a18050d089bb tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:56.445841 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1949/3899] 10.222.0.23 () {60 vars in 1142 bytes} [Sat Apr 30 21:22:56 2022] POST /identity/v3/roles => generated 234 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:22:56.450353 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440aa8c-d77a-4ce9-8d6f-aa065c19c134 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:56.463171 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440aa8c-d77a-4ce9-8d6f-aa065c19c134 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:56.467925 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81983c6d-a78c-47a4-973d-7a665ab38a9a tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:56.468591 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81983c6d-a78c-47a4-973d-7a665ab38a9a tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:56.468875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81983c6d-a78c-47a4-973d-7a665ab38a9a tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:56.469156 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81983c6d-a78c-47a4-973d-7a665ab38a9a tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:56.470390 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81983c6d-a78c-47a4-973d-7a665ab38a9a tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:56.473154 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81983c6d-a78c-47a4-973d-7a665ab38a9a tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:56.527780 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1951/3900] 10.222.0.23 () {60 vars in 1148 bytes} [Sat Apr 30 21:22:56 2022] POST /identity/v3/domains => generated 276 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:22:56.529266 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349a628-6f92-4c8f-b320-a18050d089bb tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:56.539711 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349a628-6f92-4c8f-b320-a18050d089bb tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:56.596248 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09d497-cd31-4628-8f6e-8057c05f08b4 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:56.596924 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09d497-cd31-4628-8f6e-8057c05f08b4 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:56.597210 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09d497-cd31-4628-8f6e-8057c05f08b4 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:56.597492 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09d497-cd31-4628-8f6e-8057c05f08b4 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:56.598234 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c09d497-cd31-4628-8f6e-8057c05f08b4 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:56.600184 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c09d497-cd31-4628-8f6e-8057c05f08b4 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:56.781444 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1950/3901] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:22:56 2022] POST /identity/v3/projects => generated 400 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:22:56.785480 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81983c6d-a78c-47a4-973d-7a665ab38a9a tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:56.801240 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81983c6d-a78c-47a4-973d-7a665ab38a9a tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:56.856555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be8b3a-9a58-4a82-bcf5-7d1d820c5c32 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:56.857239 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be8b3a-9a58-4a82-bcf5-7d1d820c5c32 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:56.857535 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be8b3a-9a58-4a82-bcf5-7d1d820c5c32 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:56.857846 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be8b3a-9a58-4a82-bcf5-7d1d820c5c32 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/groups` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:56.858557 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be8b3a-9a58-4a82-bcf5-7d1d820c5c32 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:56.860505 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be8b3a-9a58-4a82-bcf5-7d1d820c5c32 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:56.949221 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1952/3902] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:22:56 2022] POST /identity/v3/groups => generated 300 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:22:56.950466 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09d497-cd31-4628-8f6e-8057c05f08b4 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:56.960497 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09d497-cd31-4628-8f6e-8057c05f08b4 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:56.965623 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635129b6-49b4-47b9-afa5-dbf392fb7d6c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:56.966319 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635129b6-49b4-47b9-afa5-dbf392fb7d6c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:56.966601 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635129b6-49b4-47b9-afa5-dbf392fb7d6c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:56.966876 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635129b6-49b4-47b9-afa5-dbf392fb7d6c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:56.967782 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635129b6-49b4-47b9-afa5-dbf392fb7d6c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:56.969387 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635129b6-49b4-47b9-afa5-dbf392fb7d6c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:57.020984 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1951/3903] 10.222.0.23 () {60 vars in 1142 bytes} [Sat Apr 30 21:22:56 2022] POST /identity/v3/roles => generated 234 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:22:57.025242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be8b3a-9a58-4a82-bcf5-7d1d820c5c32 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:57.035957 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be8b3a-9a58-4a82-bcf5-7d1d820c5c32 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:57.042131 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f02ac3b-32c3-44c8-ab54-ce36ffe9748a tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:57.042977 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02ac3b-32c3-44c8-ab54-ce36ffe9748a tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:57.043263 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02ac3b-32c3-44c8-ab54-ce36ffe9748a tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:57.044518 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02ac3b-32c3-44c8-ab54-ce36ffe9748a tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:57.044518 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f02ac3b-32c3-44c8-ab54-ce36ffe9748a tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:57.046334 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f02ac3b-32c3-44c8-ab54-ce36ffe9748a tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:57.138492 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1953/3904] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:22:57 2022] POST /identity/v3/users => generated 436 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:22:57.143312 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635129b6-49b4-47b9-afa5-dbf392fb7d6c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:57.153960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635129b6-49b4-47b9-afa5-dbf392fb7d6c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:57.159760 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4def8dd-3086-4776-ba39-ceafc4d3afae tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:57.160438 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4def8dd-3086-4776-ba39-ceafc4d3afae tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:57.160724 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4def8dd-3086-4776-ba39-ceafc4d3afae tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:57.161027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4def8dd-3086-4776-ba39-ceafc4d3afae tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:57.161780 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4def8dd-3086-4776-ba39-ceafc4d3afae tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:57.163514 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-c4def8dd-3086-4776-ba39-ceafc4d3afae tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:22:57.163514 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:22:57.163514 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:22:57.164426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4def8dd-3086-4776-ba39-ceafc4d3afae tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:57.258342 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1952/3905] 10.222.0.23 () {60 vars in 1142 bytes} [Sat Apr 30 21:22:57 2022] POST /identity/v3/roles => generated 269 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:22:57.259561 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f02ac3b-32c3-44c8-ab54-ce36ffe9748a tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:57.273726 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f02ac3b-32c3-44c8-ab54-ce36ffe9748a tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:57.287752 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba476ad1-21c8-4f18-a4f6-53de5d93862e tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:57.288663 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba476ad1-21c8-4f18-a4f6-53de5d93862e tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:57.288951 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba476ad1-21c8-4f18-a4f6-53de5d93862e tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:57.290610 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba476ad1-21c8-4f18-a4f6-53de5d93862e tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/projects/6e5fd78edd3748d188fbac1b0048cf11/users/534c8a3a013541b6bad345521a264b5b/roles/e7f60ab710b04e35bf936a896a70fe74` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:57.306754 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba476ad1-21c8-4f18-a4f6-53de5d93862e tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6e5fd78edd3748d188fbac1b0048cf11, user_id=534c8a3a013541b6bad345521a264b5b, role_id=e7f60ab710b04e35bf936a896a70fe74)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:57.310413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba476ad1-21c8-4f18-a4f6-53de5d93862e tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:57.387121 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1954/3906] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:22:57 2022] PUT /identity/v3/projects/6e5fd78edd3748d188fbac1b0048cf11/users/534c8a3a013541b6bad345521a264b5b/roles/e7f60ab710b04e35bf936a896a70fe74 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:57.391387 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4def8dd-3086-4776-ba39-ceafc4d3afae tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:57.402153 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4def8dd-3086-4776-ba39-ceafc4d3afae tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:57.461320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d3022-7bdd-48ac-af05-ed0e01ed3d24 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:57.462120 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d3022-7bdd-48ac-af05-ed0e01ed3d24 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:57.462404 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d3022-7bdd-48ac-af05-ed0e01ed3d24 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:57.462898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d3022-7bdd-48ac-af05-ed0e01ed3d24 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:57.463560 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6d3022-7bdd-48ac-af05-ed0e01ed3d24 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Adding query filter params (scope.project.id=6e5fd78edd3748d188fbac1b0048cf11, user.id=534c8a3a013541b6bad345521a264b5b) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:22:57.463876 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6d3022-7bdd-48ac-af05-ed0e01ed3d24 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:57.465081 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-8c6d3022-7bdd-48ac-af05-ed0e01ed3d24 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:22:57.465081 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:22:57.465081 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:22:57.466338 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6d3022-7bdd-48ac-af05-ed0e01ed3d24 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:57.514300 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1953/3907] 10.222.0.23 () {58 vars in 1355 bytes} [Sat Apr 30 21:22:57 2022] GET /identity/v3/role_assignments?scope.project.id=6e5fd78edd3748d188fbac1b0048cf11&user.id=534c8a3a013541b6bad345521a264b5b&effective => generated 228 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:22:57.518145 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba476ad1-21c8-4f18-a4f6-53de5d93862e tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:57.529454 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba476ad1-21c8-4f18-a4f6-53de5d93862e tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:57.535094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd3f14-26d7-48c1-aad6-d485924f4cf7 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:57.536884 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd3f14-26d7-48c1-aad6-d485924f4cf7 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:57.536884 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd3f14-26d7-48c1-aad6-d485924f4cf7 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:57.536884 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd3f14-26d7-48c1-aad6-d485924f4cf7 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/projects/6e5fd78edd3748d188fbac1b0048cf11/users/534c8a3a013541b6bad345521a264b5b/roles/e7f60ab710b04e35bf936a896a70fe74` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:57.539878 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd3f14-26d7-48c1-aad6-d485924f4cf7 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=6e5fd78edd3748d188fbac1b0048cf11, user_id=534c8a3a013541b6bad345521a264b5b, role_id=e7f60ab710b04e35bf936a896a70fe74)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:57.540916 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-5bfd3f14-26d7-48c1-aad6-d485924f4cf7 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:22:57.540916 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:22:57.540916 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:22:57.542929 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd3f14-26d7-48c1-aad6-d485924f4cf7 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:57.550363 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5bfd3f14-26d7-48c1-aad6-d485924f4cf7 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invalidating the token cache because role e7f60ab710b04e35bf936a896a70fe74 was removed from user 534c8a3a013541b6bad345521a264b5b on project 6e5fd78edd3748d188fbac1b0048cf11. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:22:57.550656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5bfd3f14-26d7-48c1-aad6-d485924f4cf7 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:57.551363 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5bfd3f14-26d7-48c1-aad6-d485924f4cf7 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:57.659772 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1955/3908] 10.222.0.23 () {58 vars in 1466 bytes} [Sat Apr 30 21:22:57 2022] DELETE /identity/v3/projects/6e5fd78edd3748d188fbac1b0048cf11/users/534c8a3a013541b6bad345521a264b5b/roles/e7f60ab710b04e35bf936a896a70fe74 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:57.664627 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d3022-7bdd-48ac-af05-ed0e01ed3d24 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:57.667825 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8c6d3022-7bdd-48ac-af05-ed0e01ed3d24 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:57.694497 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d3022-7bdd-48ac-af05-ed0e01ed3d24 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:57.739267 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0cfb1-b72f-45be-a55a-bdbeae55e461 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:57.740253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0cfb1-b72f-45be-a55a-bdbeae55e461 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:57.740440 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0cfb1-b72f-45be-a55a-bdbeae55e461 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:57.740697 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0cfb1-b72f-45be-a55a-bdbeae55e461 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles/e7f60ab710b04e35bf936a896a70fe74` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:57.741991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0cfb1-b72f-45be-a55a-bdbeae55e461 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=e7f60ab710b04e35bf936a896a70fe74)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:57.744879 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-f1a0cfb1-b72f-45be-a55a-bdbeae55e461 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:22:57.744879 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:22:57.744879 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:22:57.744879 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0cfb1-b72f-45be-a55a-bdbeae55e461 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:57.860013 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f1a0cfb1-b72f-45be-a55a-bdbeae55e461 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invalidating the token cache because role e7f60ab710b04e35bf936a896a70fe74 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:22:57.860393 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f1a0cfb1-b72f-45be-a55a-bdbeae55e461 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:57.861492 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f1a0cfb1-b72f-45be-a55a-bdbeae55e461 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:57.863586 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1954/3909] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:22:57 2022] DELETE /identity/v3/roles/e7f60ab710b04e35bf936a896a70fe74 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:57.868375 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd3f14-26d7-48c1-aad6-d485924f4cf7 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:57.879362 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd3f14-26d7-48c1-aad6-d485924f4cf7 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:57.941730 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5b7fe-5ed3-491c-a19b-d4d46362ea4b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:57.942739 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5b7fe-5ed3-491c-a19b-d4d46362ea4b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:57.943024 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5b7fe-5ed3-491c-a19b-d4d46362ea4b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:57.943861 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5b7fe-5ed3-491c-a19b-d4d46362ea4b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/projects/6e5fd78edd3748d188fbac1b0048cf11/users/534c8a3a013541b6bad345521a264b5b/roles/c3a0d7adec184c40a8e2c2fb45815470` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:57.946284 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5b7fe-5ed3-491c-a19b-d4d46362ea4b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6e5fd78edd3748d188fbac1b0048cf11, user_id=534c8a3a013541b6bad345521a264b5b, role_id=c3a0d7adec184c40a8e2c2fb45815470)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:57.948991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5b7fe-5ed3-491c-a19b-d4d46362ea4b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:58.020066 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1956/3910] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:22:57 2022] PUT /identity/v3/projects/6e5fd78edd3748d188fbac1b0048cf11/users/534c8a3a013541b6bad345521a264b5b/roles/c3a0d7adec184c40a8e2c2fb45815470 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:58.025182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0cfb1-b72f-45be-a55a-bdbeae55e461 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:58.026793 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f1a0cfb1-b72f-45be-a55a-bdbeae55e461 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:58.041616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0cfb1-b72f-45be-a55a-bdbeae55e461 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:58.103742 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e1572-cff9-4331-a8fa-19c9c2786884 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:58.104697 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e1572-cff9-4331-a8fa-19c9c2786884 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:58.105011 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e1572-cff9-4331-a8fa-19c9c2786884 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:58.105287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e1572-cff9-4331-a8fa-19c9c2786884 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles/c3a0d7adec184c40a8e2c2fb45815470/implies/f0a33113c26b4e14a89f5eb9b6675e9a` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:58.107131 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e1572-cff9-4331-a8fa-19c9c2786884 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c3a0d7adec184c40a8e2c2fb45815470, implied_role_id=f0a33113c26b4e14a89f5eb9b6675e9a)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:58.108161 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-a23e1572-cff9-4331-a8fa-19c9c2786884 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:22:58.108161 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:22:58.108161 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:22:58.112911 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e1572-cff9-4331-a8fa-19c9c2786884 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:58.175764 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1955/3911] 10.222.0.23 () {60 vars in 1362 bytes} [Sat Apr 30 21:22:58 2022] PUT /identity/v3/roles/c3a0d7adec184c40a8e2c2fb45815470/implies/f0a33113c26b4e14a89f5eb9b6675e9a => generated 521 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:22:58.180400 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5b7fe-5ed3-491c-a19b-d4d46362ea4b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:58.191701 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5b7fe-5ed3-491c-a19b-d4d46362ea4b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:58.250235 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26fe162-41f6-4f5c-be0d-e98014ae619e tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:58.251500 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26fe162-41f6-4f5c-be0d-e98014ae619e tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:58.251500 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26fe162-41f6-4f5c-be0d-e98014ae619e tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:58.251855 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26fe162-41f6-4f5c-be0d-e98014ae619e tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:58.252411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26fe162-41f6-4f5c-be0d-e98014ae619e tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Adding query filter params (scope.project.id=6e5fd78edd3748d188fbac1b0048cf11, user.id=534c8a3a013541b6bad345521a264b5b) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:22:58.252723 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26fe162-41f6-4f5c-be0d-e98014ae619e tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:58.254040 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-f26fe162-41f6-4f5c-be0d-e98014ae619e tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:22:58.254040 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:22:58.254040 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:22:58.255192 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26fe162-41f6-4f5c-be0d-e98014ae619e tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:58.317709 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1957/3912] 10.222.0.23 () {58 vars in 1355 bytes} [Sat Apr 30 21:22:58 2022] GET /identity/v3/role_assignments?scope.project.id=6e5fd78edd3748d188fbac1b0048cf11&user.id=534c8a3a013541b6bad345521a264b5b&effective => generated 1061 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:22:58.322565 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e1572-cff9-4331-a8fa-19c9c2786884 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:58.334947 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e1572-cff9-4331-a8fa-19c9c2786884 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:58.340400 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe681262-0500-493b-8e92-facba1de6b9d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:58.343030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe681262-0500-493b-8e92-facba1de6b9d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:58.343030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe681262-0500-493b-8e92-facba1de6b9d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:58.343030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe681262-0500-493b-8e92-facba1de6b9d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles/c3a0d7adec184c40a8e2c2fb45815470/implies/f0a33113c26b4e14a89f5eb9b6675e9a` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:58.344313 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe681262-0500-493b-8e92-facba1de6b9d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c3a0d7adec184c40a8e2c2fb45815470, implied_role_id=f0a33113c26b4e14a89f5eb9b6675e9a)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:58.345450 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-fe681262-0500-493b-8e92-facba1de6b9d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:22:58.345450 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:22:58.345450 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:22:58.346428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe681262-0500-493b-8e92-facba1de6b9d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:58.450263 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1956/3913] 10.222.0.23 () {58 vars in 1346 bytes} [Sat Apr 30 21:22:58 2022] DELETE /identity/v3/roles/c3a0d7adec184c40a8e2c2fb45815470/implies/f0a33113c26b4e14a89f5eb9b6675e9a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:58.454488 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26fe162-41f6-4f5c-be0d-e98014ae619e tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:58.465827 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26fe162-41f6-4f5c-be0d-e98014ae619e tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:58.530504 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205dbb0d-5158-4997-9929-35edeae2947b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:58.531165 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205dbb0d-5158-4997-9929-35edeae2947b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:58.531451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205dbb0d-5158-4997-9929-35edeae2947b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:58.531732 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205dbb0d-5158-4997-9929-35edeae2947b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:58.532618 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205dbb0d-5158-4997-9929-35edeae2947b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Adding query filter params (scope.project.id=6e5fd78edd3748d188fbac1b0048cf11, user.id=534c8a3a013541b6bad345521a264b5b) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:22:58.532927 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205dbb0d-5158-4997-9929-35edeae2947b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:58.534834 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205dbb0d-5158-4997-9929-35edeae2947b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:58.584687 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1958/3914] 10.222.0.23 () {58 vars in 1355 bytes} [Sat Apr 30 21:22:58 2022] GET /identity/v3/role_assignments?scope.project.id=6e5fd78edd3748d188fbac1b0048cf11&user.id=534c8a3a013541b6bad345521a264b5b&effective => generated 577 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:22:58.588713 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe681262-0500-493b-8e92-facba1de6b9d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:58.601177 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe681262-0500-493b-8e92-facba1de6b9d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:58.605720 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa92af6-4436-4446-b88d-1f6905d616b3 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:58.606651 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa92af6-4436-4446-b88d-1f6905d616b3 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:58.606931 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa92af6-4436-4446-b88d-1f6905d616b3 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:58.607201 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa92af6-4436-4446-b88d-1f6905d616b3 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles/c3a0d7adec184c40a8e2c2fb45815470/implies/f0a33113c26b4e14a89f5eb9b6675e9a` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:58.608852 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa92af6-4436-4446-b88d-1f6905d616b3 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c3a0d7adec184c40a8e2c2fb45815470, implied_role_id=f0a33113c26b4e14a89f5eb9b6675e9a)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:58.610468 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa92af6-4436-4446-b88d-1f6905d616b3 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:58.628353 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-6fa92af6-4436-4446-b88d-1f6905d616b3 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] c3a0d7adec184c40a8e2c2fb45815470 does not imply f0a33113c26b4e14a89f5eb9b6675e9a.: keystone.exception.ImpliedRoleNotFound: c3a0d7adec184c40a8e2c2fb45815470 does not imply f0a33113c26b4e14a89f5eb9b6675e9a. Apr 30 21:22:58.628353 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:22:58.628353 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Apr 30 21:22:58.628353 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ref = query.one() Apr 30 21:22:58.628353 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Apr 30 21:22:58.628353 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._iter().one() Apr 30 21:22:58.628353 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1408, in one Apr 30 21:22:58.628353 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._only_one_row( Apr 30 21:22:58.628353 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Apr 30 21:22:58.628353 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exc.NoResultFound( Apr 30 21:22:58.628353 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Apr 30 21:22:58.628353 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:22:58.628353 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 21:22:58.628353 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:22:58.628353 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:22:58.628353 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:22:58.629861 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:22:58.629861 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:22:58.629861 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:22:58.629861 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:22:58.629861 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:22:58.629861 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:22:58.629861 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:22:58.629861 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:22:58.629861 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:22:58.629861 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Apr 30 21:22:58.629861 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Apr 30 21:22:58.629861 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:22:58.629861 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:22:58.629861 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Apr 30 21:22:58.629861 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Apr 30 21:22:58.629861 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Apr 30 21:22:58.631803 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Apr 30 21:22:58.631803 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Apr 30 21:22:58.631803 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Apr 30 21:22:58.631803 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: c3a0d7adec184c40a8e2c2fb45815470 does not imply f0a33113c26b4e14a89f5eb9b6675e9a. Apr 30 21:22:58.631803 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:22:58.631803 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1957/3915] 10.222.0.23 () {58 vars in 1346 bytes} [Sat Apr 30 21:22:58 2022] DELETE /identity/v3/roles/c3a0d7adec184c40a8e2c2fb45815470/implies/f0a33113c26b4e14a89f5eb9b6675e9a => generated 137 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 30 21:22:58.634366 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205dbb0d-5158-4997-9929-35edeae2947b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:58.644677 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205dbb0d-5158-4997-9929-35edeae2947b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:58.650613 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f7a32-c338-41d7-8f4f-d4ac42592e4b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:58.651511 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f7a32-c338-41d7-8f4f-d4ac42592e4b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:58.651797 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f7a32-c338-41d7-8f4f-d4ac42592e4b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:58.652076 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f7a32-c338-41d7-8f4f-d4ac42592e4b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/projects/6e5fd78edd3748d188fbac1b0048cf11/users/534c8a3a013541b6bad345521a264b5b/roles/c3a0d7adec184c40a8e2c2fb45815470` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:58.654381 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f7a32-c338-41d7-8f4f-d4ac42592e4b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=6e5fd78edd3748d188fbac1b0048cf11, user_id=534c8a3a013541b6bad345521a264b5b, role_id=c3a0d7adec184c40a8e2c2fb45815470)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:58.657094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f7a32-c338-41d7-8f4f-d4ac42592e4b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:58.664008 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0f0f7a32-c338-41d7-8f4f-d4ac42592e4b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invalidating the token cache because role c3a0d7adec184c40a8e2c2fb45815470 was removed from user 534c8a3a013541b6bad345521a264b5b on project 6e5fd78edd3748d188fbac1b0048cf11. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:22:58.664413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0f0f7a32-c338-41d7-8f4f-d4ac42592e4b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:58.665161 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0f0f7a32-c338-41d7-8f4f-d4ac42592e4b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:58.751088 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1959/3916] 10.222.0.23 () {58 vars in 1466 bytes} [Sat Apr 30 21:22:58 2022] DELETE /identity/v3/projects/6e5fd78edd3748d188fbac1b0048cf11/users/534c8a3a013541b6bad345521a264b5b/roles/c3a0d7adec184c40a8e2c2fb45815470 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:58.760776 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa92af6-4436-4446-b88d-1f6905d616b3 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:58.763155 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6fa92af6-4436-4446-b88d-1f6905d616b3 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:58.776358 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa92af6-4436-4446-b88d-1f6905d616b3 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:58.839599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ad51f-5aaf-40d0-b53e-110c67b08ac8 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:58.840277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ad51f-5aaf-40d0-b53e-110c67b08ac8 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:58.840631 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ad51f-5aaf-40d0-b53e-110c67b08ac8 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:58.841007 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ad51f-5aaf-40d0-b53e-110c67b08ac8 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:58.842021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ad51f-5aaf-40d0-b53e-110c67b08ac8 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:58.843818 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ad51f-5aaf-40d0-b53e-110c67b08ac8 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:58.935231 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1958/3917] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:22:58 2022] POST /identity/v3/roles => generated 272 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:22:58.939462 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f7a32-c338-41d7-8f4f-d4ac42592e4b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:58.949521 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f7a32-c338-41d7-8f4f-d4ac42592e4b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:58.954100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db96201-b28a-4c53-a1a0-95404a5fdc6d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:58.954814 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db96201-b28a-4c53-a1a0-95404a5fdc6d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:58.955030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db96201-b28a-4c53-a1a0-95404a5fdc6d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:58.955306 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db96201-b28a-4c53-a1a0-95404a5fdc6d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:58.956030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db96201-b28a-4c53-a1a0-95404a5fdc6d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Adding query filter params (domain_id=0f8be929734d4e469e272ad5df22aa33) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:22:58.956334 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db96201-b28a-4c53-a1a0-95404a5fdc6d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:58.957345 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-5db96201-b28a-4c53-a1a0-95404a5fdc6d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:22:58.957345 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:22:58.957345 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:22:58.958254 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db96201-b28a-4c53-a1a0-95404a5fdc6d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:58.966558 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1960/3918] 10.222.0.23 () {58 vars in 1206 bytes} [Sat Apr 30 21:22:58 2022] GET /identity/v3/roles?domain_id=0f8be929734d4e469e272ad5df22aa33 => generated 409 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:22:58.970418 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ad51f-5aaf-40d0-b53e-110c67b08ac8 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:58.981205 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ad51f-5aaf-40d0-b53e-110c67b08ac8 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:58.986395 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bfd77-a920-408a-a9c9-ec83f748d952 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:58.987244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bfd77-a920-408a-a9c9-ec83f748d952 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:58.987630 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bfd77-a920-408a-a9c9-ec83f748d952 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:58.988082 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bfd77-a920-408a-a9c9-ec83f748d952 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles/0f336ef47beb429cbf4060202991b27f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:58.989176 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34bfd77-a920-408a-a9c9-ec83f748d952 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=0f336ef47beb429cbf4060202991b27f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:58.991489 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34bfd77-a920-408a-a9c9-ec83f748d952 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:59.121790 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c34bfd77-a920-408a-a9c9-ec83f748d952 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invalidating the token cache because role 0f336ef47beb429cbf4060202991b27f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:22:59.122095 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c34bfd77-a920-408a-a9c9-ec83f748d952 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:59.122769 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c34bfd77-a920-408a-a9c9-ec83f748d952 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:59.124754 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1959/3919] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:22:58 2022] DELETE /identity/v3/roles/0f336ef47beb429cbf4060202991b27f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:59.128914 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db96201-b28a-4c53-a1a0-95404a5fdc6d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:59.130640 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5db96201-b28a-4c53-a1a0-95404a5fdc6d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:59.143619 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db96201-b28a-4c53-a1a0-95404a5fdc6d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:59.205971 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229438b-9500-4261-a59d-27a42271cc45 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:59.206790 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229438b-9500-4261-a59d-27a42271cc45 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:59.207089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229438b-9500-4261-a59d-27a42271cc45 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:59.207369 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229438b-9500-4261-a59d-27a42271cc45 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:59.208107 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229438b-9500-4261-a59d-27a42271cc45 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Adding query filter params (domain_id=0f8be929734d4e469e272ad5df22aa33) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:22:59.208416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229438b-9500-4261-a59d-27a42271cc45 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:59.210775 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229438b-9500-4261-a59d-27a42271cc45 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:59.216698 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1961/3920] 10.222.0.23 () {58 vars in 1206 bytes} [Sat Apr 30 21:22:59 2022] GET /identity/v3/roles?domain_id=0f8be929734d4e469e272ad5df22aa33 => generated 148 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:22:59.220935 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bfd77-a920-408a-a9c9-ec83f748d952 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:59.231735 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bfd77-a920-408a-a9c9-ec83f748d952 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:59.236596 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d8a8d-9649-4cdb-8139-e578515d36be tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:59.237441 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d8a8d-9649-4cdb-8139-e578515d36be tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:59.237723 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d8a8d-9649-4cdb-8139-e578515d36be tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:59.238031 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d8a8d-9649-4cdb-8139-e578515d36be tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles/0f336ef47beb429cbf4060202991b27f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:59.248923 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d8a8d-9649-4cdb-8139-e578515d36be tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 21:22:59.259069 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-f57d8a8d-9649-4cdb-8139-e578515d36be tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Could not find role: 0f336ef47beb429cbf4060202991b27f.: keystone.exception.RoleNotFound: Could not find role: 0f336ef47beb429cbf4060202991b27f. Apr 30 21:22:59.259069 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:22:59.259069 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:22:59.259069 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:22:59.259069 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:22:59.259069 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:22:59.259069 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:22:59.259069 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:22:59.259069 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:22:59.259069 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:22:59.259069 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:22:59.259069 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:22:59.259069 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Apr 30 21:22:59.259069 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Apr 30 21:22:59.260065 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 21:22:59.260065 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 21:22:59.260065 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 21:22:59.260065 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 21:22:59.260065 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:22:59.260065 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:22:59.260065 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 21:22:59.260065 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 21:22:59.260065 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 21:22:59.260065 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 21:22:59.260065 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 21:22:59.260065 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 21:22:59.260065 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 21:22:59.260065 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 21:22:59.260065 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 21:22:59.260065 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 21:22:59.261204 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 21:22:59.261204 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 21:22:59.261204 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 21:22:59.261204 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 21:22:59.261204 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Apr 30 21:22:59.261204 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Apr 30 21:22:59.261204 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Apr 30 21:22:59.261204 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Apr 30 21:22:59.261204 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Apr 30 21:22:59.261204 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 21:22:59.261204 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 0f336ef47beb429cbf4060202991b27f. Apr 30 21:22:59.261204 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:22:59.261204 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1960/3921] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:22:59 2022] DELETE /identity/v3/roles/0f336ef47beb429cbf4060202991b27f => generated 110 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 30 21:22:59.266226 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229438b-9500-4261-a59d-27a42271cc45 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:59.277934 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229438b-9500-4261-a59d-27a42271cc45 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:59.283057 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b0c2c-4965-40df-abb9-0175ef70f3bb tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:59.283959 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b0c2c-4965-40df-abb9-0175ef70f3bb tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:59.284244 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b0c2c-4965-40df-abb9-0175ef70f3bb tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:59.284527 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b0c2c-4965-40df-abb9-0175ef70f3bb tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/domains/0f8be929734d4e469e272ad5df22aa33/groups/03ec303e7ea8468f91971c914b24922f/roles/fd1d84a4d5cf43d0ad5b9e8105002b72` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:59.293455 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b0c2c-4965-40df-abb9-0175ef70f3bb tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=0f8be929734d4e469e272ad5df22aa33, group_id=03ec303e7ea8468f91971c914b24922f, role_id=fd1d84a4d5cf43d0ad5b9e8105002b72)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:59.372482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b0c2c-4965-40df-abb9-0175ef70f3bb tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:59.449401 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1962/3922] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:22:59 2022] PUT /identity/v3/domains/0f8be929734d4e469e272ad5df22aa33/groups/03ec303e7ea8468f91971c914b24922f/roles/fd1d84a4d5cf43d0ad5b9e8105002b72 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:22:59.453960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d8a8d-9649-4cdb-8139-e578515d36be tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:59.465653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d8a8d-9649-4cdb-8139-e578515d36be tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:59.541077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e7d800-8d43-4d6c-be07-b4039f75fe7a tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:59.541977 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7d800-8d43-4d6c-be07-b4039f75fe7a tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:59.542264 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7d800-8d43-4d6c-be07-b4039f75fe7a tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:59.542545 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7d800-8d43-4d6c-be07-b4039f75fe7a tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/domains/0f8be929734d4e469e272ad5df22aa33/groups/03ec303e7ea8468f91971c914b24922f/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:59.544807 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e7d800-8d43-4d6c-be07-b4039f75fe7a tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=0f8be929734d4e469e272ad5df22aa33, group_id=03ec303e7ea8468f91971c914b24922f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:59.545897 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-90e7d800-8d43-4d6c-be07-b4039f75fe7a tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:22:59.545897 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:22:59.545897 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:22:59.548095 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e7d800-8d43-4d6c-be07-b4039f75fe7a tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:59.579430 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1961/3923] 10.222.0.23 () {58 vars in 1364 bytes} [Sat Apr 30 21:22:59 2022] GET /identity/v3/domains/0f8be929734d4e469e272ad5df22aa33/groups/03ec303e7ea8468f91971c914b24922f/roles => generated 409 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:22:59.579598 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b0c2c-4965-40df-abb9-0175ef70f3bb tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:59.586856 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b0c2c-4965-40df-abb9-0175ef70f3bb tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:59.591789 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf87a64-7698-4438-bb46-cb413fa6ae33 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:59.592788 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf87a64-7698-4438-bb46-cb413fa6ae33 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:59.593141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf87a64-7698-4438-bb46-cb413fa6ae33 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:59.593490 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf87a64-7698-4438-bb46-cb413fa6ae33 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/domains/0f8be929734d4e469e272ad5df22aa33/groups/03ec303e7ea8468f91971c914b24922f/roles/fd1d84a4d5cf43d0ad5b9e8105002b72` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:59.596284 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf87a64-7698-4438-bb46-cb413fa6ae33 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=0f8be929734d4e469e272ad5df22aa33, group_id=03ec303e7ea8468f91971c914b24922f, role_id=fd1d84a4d5cf43d0ad5b9e8105002b72)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:59.597379 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-ebf87a64-7698-4438-bb46-cb413fa6ae33 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:22:59.597379 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:22:59.597379 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:22:59.599504 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf87a64-7698-4438-bb46-cb413fa6ae33 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:59.606369 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1963/3924] 10.222.0.23 () {58 vars in 1464 bytes} [Sat Apr 30 21:22:59 2022] HEAD /identity/v3/domains/0f8be929734d4e469e272ad5df22aa33/groups/03ec303e7ea8468f91971c914b24922f/roles/fd1d84a4d5cf43d0ad5b9e8105002b72 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:59.610938 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e7d800-8d43-4d6c-be07-b4039f75fe7a tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:59.621890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e7d800-8d43-4d6c-be07-b4039f75fe7a tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:59.627179 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd7165-683b-43ec-94db-4af812fbd362 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:59.628200 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd7165-683b-43ec-94db-4af812fbd362 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:59.628492 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd7165-683b-43ec-94db-4af812fbd362 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:59.628963 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd7165-683b-43ec-94db-4af812fbd362 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/domains/0f8be929734d4e469e272ad5df22aa33/groups/03ec303e7ea8468f91971c914b24922f/roles/fd1d84a4d5cf43d0ad5b9e8105002b72` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:59.632277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fd7165-683b-43ec-94db-4af812fbd362 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=0f8be929734d4e469e272ad5df22aa33, group_id=03ec303e7ea8468f91971c914b24922f, role_id=fd1d84a4d5cf43d0ad5b9e8105002b72)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:59.633428 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-c5fd7165-683b-43ec-94db-4af812fbd362 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:22:59.633428 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:22:59.633428 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:22:59.635710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fd7165-683b-43ec-94db-4af812fbd362 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:59.644815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c5fd7165-683b-43ec-94db-4af812fbd362 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invalidating the token cache because role fd1d84a4d5cf43d0ad5b9e8105002b72 was removed from group 03ec303e7ea8468f91971c914b24922f on domain 0f8be929734d4e469e272ad5df22aa33. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:22:59.645273 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c5fd7165-683b-43ec-94db-4af812fbd362 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:59.645942 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c5fd7165-683b-43ec-94db-4af812fbd362 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:22:59.735250 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1962/3925] 10.222.0.23 () {58 vars in 1466 bytes} [Sat Apr 30 21:22:59 2022] DELETE /identity/v3/domains/0f8be929734d4e469e272ad5df22aa33/groups/03ec303e7ea8468f91971c914b24922f/roles/fd1d84a4d5cf43d0ad5b9e8105002b72 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:59.740034 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf87a64-7698-4438-bb46-cb413fa6ae33 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:59.741804 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ebf87a64-7698-4438-bb46-cb413fa6ae33 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:22:59.756672 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf87a64-7698-4438-bb46-cb413fa6ae33 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:22:59.816958 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b455e-d9e8-4642-b9a6-24dbe682014c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:22:59.817857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b455e-d9e8-4642-b9a6-24dbe682014c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:22:59.818141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b455e-d9e8-4642-b9a6-24dbe682014c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:22:59.818984 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b455e-d9e8-4642-b9a6-24dbe682014c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/projects/6e5fd78edd3748d188fbac1b0048cf11/groups/03ec303e7ea8468f91971c914b24922f/roles/fd1d84a4d5cf43d0ad5b9e8105002b72` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:22:59.821167 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b455e-d9e8-4642-b9a6-24dbe682014c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6e5fd78edd3748d188fbac1b0048cf11, group_id=03ec303e7ea8468f91971c914b24922f, role_id=fd1d84a4d5cf43d0ad5b9e8105002b72)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:22:59.823871 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b455e-d9e8-4642-b9a6-24dbe682014c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:22:59.935050 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1964/3926] 10.222.0.23 () {60 vars in 1485 bytes} [Sat Apr 30 21:22:59 2022] PUT /identity/v3/projects/6e5fd78edd3748d188fbac1b0048cf11/groups/03ec303e7ea8468f91971c914b24922f/roles/fd1d84a4d5cf43d0ad5b9e8105002b72 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:22:59.938982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd7165-683b-43ec-94db-4af812fbd362 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:22:59.949410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd7165-683b-43ec-94db-4af812fbd362 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:00.020398 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95d155-ea2e-4c11-bc61-132b75b06744 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:00.021166 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95d155-ea2e-4c11-bc61-132b75b06744 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:00.021608 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95d155-ea2e-4c11-bc61-132b75b06744 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:00.021952 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95d155-ea2e-4c11-bc61-132b75b06744 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/projects/6e5fd78edd3748d188fbac1b0048cf11/groups/03ec303e7ea8468f91971c914b24922f/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:00.023819 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea95d155-ea2e-4c11-bc61-132b75b06744 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:list_grants(project_id=6e5fd78edd3748d188fbac1b0048cf11, group_id=03ec303e7ea8468f91971c914b24922f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:00.026414 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea95d155-ea2e-4c11-bc61-132b75b06744 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:00.046371 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1963/3927] 10.222.0.23 () {58 vars in 1367 bytes} [Sat Apr 30 21:22:59 2022] GET /identity/v3/projects/6e5fd78edd3748d188fbac1b0048cf11/groups/03ec303e7ea8468f91971c914b24922f/roles => generated 410 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:23:00.046481 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b455e-d9e8-4642-b9a6-24dbe682014c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:00.055445 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b455e-d9e8-4642-b9a6-24dbe682014c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:00.060041 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26f1db-b011-4670-90b5-59d615b9c10c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:00.060913 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26f1db-b011-4670-90b5-59d615b9c10c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:00.061196 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26f1db-b011-4670-90b5-59d615b9c10c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:00.061472 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26f1db-b011-4670-90b5-59d615b9c10c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/groups/03ec303e7ea8468f91971c914b24922f/users/534c8a3a013541b6bad345521a264b5b` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:00.063198 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c26f1db-b011-4670-90b5-59d615b9c10c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=03ec303e7ea8468f91971c914b24922f, user_id=534c8a3a013541b6bad345521a264b5b)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:00.065291 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c26f1db-b011-4670-90b5-59d615b9c10c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:00.146312 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1965/3928] 10.222.0.23 () {60 vars in 1359 bytes} [Sat Apr 30 21:23:00 2022] PUT /identity/v3/groups/03ec303e7ea8468f91971c914b24922f/users/534c8a3a013541b6bad345521a264b5b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:23:00.150775 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bbd587-575e-40e9-bfca-b97b40a6f950 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:00.151076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bbd587-575e-40e9-bfca-b97b40a6f950 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:00.151360 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bbd587-575e-40e9-bfca-b97b40a6f950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:00.188488 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-77bbd587-575e-40e9-bfca-b97b40a6f950 None None] MFA Rules not processed for user `534c8a3a013541b6bad345521a264b5b`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:00.189715 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-77bbd587-575e-40e9-bfca-b97b40a6f950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:00.276241 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1964/3929] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:00 2022] POST /identity/v3/auth/tokens => generated 3255 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:23:00.280474 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26f1db-b011-4670-90b5-59d615b9c10c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:00.348871 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26f1db-b011-4670-90b5-59d615b9c10c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:00.354831 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd769c1-25ef-45f3-b2f5-285c835680ed tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:00.355755 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd769c1-25ef-45f3-b2f5-285c835680ed tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:00.356043 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd769c1-25ef-45f3-b2f5-285c835680ed tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:00.356329 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd769c1-25ef-45f3-b2f5-285c835680ed tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/projects/6e5fd78edd3748d188fbac1b0048cf11/groups/03ec303e7ea8468f91971c914b24922f/roles/fd1d84a4d5cf43d0ad5b9e8105002b72` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:00.358663 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd769c1-25ef-45f3-b2f5-285c835680ed tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:check_grant(project_id=6e5fd78edd3748d188fbac1b0048cf11, group_id=03ec303e7ea8468f91971c914b24922f, role_id=fd1d84a4d5cf43d0ad5b9e8105002b72)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:00.362415 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd769c1-25ef-45f3-b2f5-285c835680ed tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:00.374755 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1966/3930] 10.222.0.23 () {58 vars in 1467 bytes} [Sat Apr 30 21:23:00 2022] HEAD /identity/v3/projects/6e5fd78edd3748d188fbac1b0048cf11/groups/03ec303e7ea8468f91971c914b24922f/roles/fd1d84a4d5cf43d0ad5b9e8105002b72 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:00.375765 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bbd587-575e-40e9-bfca-b97b40a6f950 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:00.398217 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bbd587-575e-40e9-bfca-b97b40a6f950 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:00.403215 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6943d45f-614b-4a84-bd3e-01d105884487 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:00.404267 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943d45f-614b-4a84-bd3e-01d105884487 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:00.404556 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943d45f-614b-4a84-bd3e-01d105884487 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:00.404838 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943d45f-614b-4a84-bd3e-01d105884487 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/projects/6e5fd78edd3748d188fbac1b0048cf11/groups/03ec303e7ea8468f91971c914b24922f/roles/fd1d84a4d5cf43d0ad5b9e8105002b72` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:00.408538 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6943d45f-614b-4a84-bd3e-01d105884487 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=6e5fd78edd3748d188fbac1b0048cf11, group_id=03ec303e7ea8468f91971c914b24922f, role_id=fd1d84a4d5cf43d0ad5b9e8105002b72)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:00.415133 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6943d45f-614b-4a84-bd3e-01d105884487 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:00.426303 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6943d45f-614b-4a84-bd3e-01d105884487 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invalidating the token cache because role fd1d84a4d5cf43d0ad5b9e8105002b72 was removed from group 03ec303e7ea8468f91971c914b24922f on project 6e5fd78edd3748d188fbac1b0048cf11. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:23:00.426601 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6943d45f-614b-4a84-bd3e-01d105884487 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:00.427356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6943d45f-614b-4a84-bd3e-01d105884487 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:00.524674 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1965/3931] 10.222.0.23 () {58 vars in 1469 bytes} [Sat Apr 30 21:23:00 2022] DELETE /identity/v3/projects/6e5fd78edd3748d188fbac1b0048cf11/groups/03ec303e7ea8468f91971c914b24922f/roles/fd1d84a4d5cf43d0ad5b9e8105002b72 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:00.529350 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd769c1-25ef-45f3-b2f5-285c835680ed tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:00.531200 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-dbd769c1-25ef-45f3-b2f5-285c835680ed tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:00.553616 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd769c1-25ef-45f3-b2f5-285c835680ed tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:00.648456 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477efa29-c041-442b-bd80-a80009748c97 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:00.649356 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477efa29-c041-442b-bd80-a80009748c97 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:00.649636 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477efa29-c041-442b-bd80-a80009748c97 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:00.649953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477efa29-c041-442b-bd80-a80009748c97 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/groups/03ec303e7ea8468f91971c914b24922f/users/534c8a3a013541b6bad345521a264b5b` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:00.651662 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477efa29-c041-442b-bd80-a80009748c97 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=03ec303e7ea8468f91971c914b24922f, user_id=534c8a3a013541b6bad345521a264b5b)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:00.660557 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-477efa29-c041-442b-bd80-a80009748c97 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:23:00.660557 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:23:00.660557 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:23:00.660557 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477efa29-c041-442b-bd80-a80009748c97 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:00.722927 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-477efa29-c041-442b-bd80-a80009748c97 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '534c8a3a013541b6bad345521a264b5b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:00.811713 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1967/3932] 10.222.0.23 () {58 vars in 1343 bytes} [Sat Apr 30 21:23:00 2022] DELETE /identity/v3/groups/03ec303e7ea8468f91971c914b24922f/users/534c8a3a013541b6bad345521a264b5b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:00.814810 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6943d45f-614b-4a84-bd3e-01d105884487 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:00.825046 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6943d45f-614b-4a84-bd3e-01d105884487 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:00.895090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91ac88b-312d-4cab-9121-fc028aaaa557 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:00.896000 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ac88b-312d-4cab-9121-fc028aaaa557 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:00.896288 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ac88b-312d-4cab-9121-fc028aaaa557 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:00.897173 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ac88b-312d-4cab-9121-fc028aaaa557 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/system/groups/03ec303e7ea8468f91971c914b24922f/roles/fd1d84a4d5cf43d0ad5b9e8105002b72` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:00.898976 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91ac88b-312d-4cab-9121-fc028aaaa557 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=03ec303e7ea8468f91971c914b24922f, role_id=fd1d84a4d5cf43d0ad5b9e8105002b72)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:00.899989 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-a91ac88b-312d-4cab-9121-fc028aaaa557 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:23:00.899989 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:23:00.899989 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:23:00.900881 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91ac88b-312d-4cab-9121-fc028aaaa557 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:00.986015 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1966/3933] 10.222.0.23 () {60 vars in 1380 bytes} [Sat Apr 30 21:23:00 2022] PUT /identity/v3/system/groups/03ec303e7ea8468f91971c914b24922f/roles/fd1d84a4d5cf43d0ad5b9e8105002b72 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:00.990192 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477efa29-c041-442b-bd80-a80009748c97 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:01.000929 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477efa29-c041-442b-bd80-a80009748c97 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:01.006261 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20bfb8-6fae-49c6-8b2f-2fe03eee6cf6 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:01.007599 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20bfb8-6fae-49c6-8b2f-2fe03eee6cf6 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:01.007894 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20bfb8-6fae-49c6-8b2f-2fe03eee6cf6 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:01.008186 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20bfb8-6fae-49c6-8b2f-2fe03eee6cf6 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/system/groups/03ec303e7ea8468f91971c914b24922f/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:01.009445 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20bfb8-6fae-49c6-8b2f-2fe03eee6cf6 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=03ec303e7ea8468f91971c914b24922f)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:01.010511 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-ec20bfb8-6fae-49c6-8b2f-2fe03eee6cf6 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:23:01.010511 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:23:01.010511 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:23:01.011411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20bfb8-6fae-49c6-8b2f-2fe03eee6cf6 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:01.024397 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1968/3934] 10.222.0.23 () {58 vars in 1262 bytes} [Sat Apr 30 21:23:00 2022] GET /identity/v3/system/groups/03ec303e7ea8468f91971c914b24922f/roles => generated 375 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:23:01.028453 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91ac88b-312d-4cab-9121-fc028aaaa557 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:01.039189 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91ac88b-312d-4cab-9121-fc028aaaa557 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:01.043326 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11881d53-2a03-4179-b094-db4d8201e5e5 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:01.044177 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11881d53-2a03-4179-b094-db4d8201e5e5 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:01.044462 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11881d53-2a03-4179-b094-db4d8201e5e5 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:01.044739 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11881d53-2a03-4179-b094-db4d8201e5e5 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/system/groups/03ec303e7ea8468f91971c914b24922f/roles/fd1d84a4d5cf43d0ad5b9e8105002b72` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:01.046536 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11881d53-2a03-4179-b094-db4d8201e5e5 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=03ec303e7ea8468f91971c914b24922f, role_id=fd1d84a4d5cf43d0ad5b9e8105002b72)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:01.047566 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-11881d53-2a03-4179-b094-db4d8201e5e5 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:23:01.047566 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:23:01.047566 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:23:01.048445 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11881d53-2a03-4179-b094-db4d8201e5e5 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:01.059553 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1967/3935] 10.222.0.23 () {58 vars in 1362 bytes} [Sat Apr 30 21:23:01 2022] HEAD /identity/v3/system/groups/03ec303e7ea8468f91971c914b24922f/roles/fd1d84a4d5cf43d0ad5b9e8105002b72 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:01.063658 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20bfb8-6fae-49c6-8b2f-2fe03eee6cf6 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:01.075660 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20bfb8-6fae-49c6-8b2f-2fe03eee6cf6 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:01.080829 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f001d3-71f4-44dc-a5c6-89e37a17a82f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:01.081908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f001d3-71f4-44dc-a5c6-89e37a17a82f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:01.082206 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f001d3-71f4-44dc-a5c6-89e37a17a82f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:01.082517 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f001d3-71f4-44dc-a5c6-89e37a17a82f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/system/groups/03ec303e7ea8468f91971c914b24922f/roles/fd1d84a4d5cf43d0ad5b9e8105002b72` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:01.084974 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f001d3-71f4-44dc-a5c6-89e37a17a82f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=03ec303e7ea8468f91971c914b24922f, role_id=fd1d84a4d5cf43d0ad5b9e8105002b72)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:01.086030 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-27f001d3-71f4-44dc-a5c6-89e37a17a82f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:23:01.086030 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:23:01.086030 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:23:01.087195 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f001d3-71f4-44dc-a5c6-89e37a17a82f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:01.128902 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11881d53-2a03-4179-b094-db4d8201e5e5 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:01.131268 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-11881d53-2a03-4179-b094-db4d8201e5e5 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:01.185824 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1969/3936] 10.222.0.23 () {58 vars in 1364 bytes} [Sat Apr 30 21:23:01 2022] DELETE /identity/v3/system/groups/03ec303e7ea8468f91971c914b24922f/roles/fd1d84a4d5cf43d0ad5b9e8105002b72 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:01.190719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f001d3-71f4-44dc-a5c6-89e37a17a82f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:01.205315 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f001d3-71f4-44dc-a5c6-89e37a17a82f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:01.211010 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11881d53-2a03-4179-b094-db4d8201e5e5 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:01.211571 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a2bd5-cb40-4ac0-a48f-19f95786f592 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:01.212636 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a2bd5-cb40-4ac0-a48f-19f95786f592 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:01.213058 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a2bd5-cb40-4ac0-a48f-19f95786f592 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:01.213348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a2bd5-cb40-4ac0-a48f-19f95786f592 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/domains/0f8be929734d4e469e272ad5df22aa33/users/534c8a3a013541b6bad345521a264b5b/roles/fd1d84a4d5cf43d0ad5b9e8105002b72` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:01.215194 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732b2c6-43d6-4a1f-80b0-beaac0ec7904 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e302b1298dd04d6590e3d079f7b13b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:01.215908 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732b2c6-43d6-4a1f-80b0-beaac0ec7904 service glance] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:01.216262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732b2c6-43d6-4a1f-80b0-beaac0ec7904 service glance] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:01.216385 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a2bd5-cb40-4ac0-a48f-19f95786f592 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=0f8be929734d4e469e272ad5df22aa33, user_id=534c8a3a013541b6bad345521a264b5b, role_id=fd1d84a4d5cf43d0ad5b9e8105002b72)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:01.216660 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732b2c6-43d6-4a1f-80b0-beaac0ec7904 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:01.218960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6732b2c6-43d6-4a1f-80b0-beaac0ec7904 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:01.219857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a2bd5-cb40-4ac0-a48f-19f95786f592 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:01.297726 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732b2c6-43d6-4a1f-80b0-beaac0ec7904 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:01.297726 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732b2c6-43d6-4a1f-80b0-beaac0ec7904 service glance] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:01.317681 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1968/3937] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:23:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:23:01.329326 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1970/3938] 10.222.0.23 () {60 vars in 1479 bytes} [Sat Apr 30 21:23:01 2022] PUT /identity/v3/domains/0f8be929734d4e469e272ad5df22aa33/users/534c8a3a013541b6bad345521a264b5b/roles/fd1d84a4d5cf43d0ad5b9e8105002b72 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:01.340498 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732b2c6-43d6-4a1f-80b0-beaac0ec7904 service glance] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:01.351202 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732b2c6-43d6-4a1f-80b0-beaac0ec7904 service glance] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:01.409338 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01558d1d-6f0b-4ae4-aa19-3ac1132d3043 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:01.410230 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01558d1d-6f0b-4ae4-aa19-3ac1132d3043 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:01.410530 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01558d1d-6f0b-4ae4-aa19-3ac1132d3043 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:01.410788 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01558d1d-6f0b-4ae4-aa19-3ac1132d3043 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/domains/0f8be929734d4e469e272ad5df22aa33/users/534c8a3a013541b6bad345521a264b5b/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:01.412503 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01558d1d-6f0b-4ae4-aa19-3ac1132d3043 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=0f8be929734d4e469e272ad5df22aa33, user_id=534c8a3a013541b6bad345521a264b5b)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:01.415068 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01558d1d-6f0b-4ae4-aa19-3ac1132d3043 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:01.426325 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1969/3939] 10.222.0.23 () {58 vars in 1361 bytes} [Sat Apr 30 21:23:01 2022] GET /identity/v3/domains/0f8be929734d4e469e272ad5df22aa33/users/534c8a3a013541b6bad345521a264b5b/roles => generated 408 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:23:01.430938 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a2bd5-cb40-4ac0-a48f-19f95786f592 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:01.441417 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a2bd5-cb40-4ac0-a48f-19f95786f592 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:01.446595 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca61b0b-ec95-4308-a582-1de199dc115a tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:01.447782 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca61b0b-ec95-4308-a582-1de199dc115a tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:01.447782 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca61b0b-ec95-4308-a582-1de199dc115a tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:01.448009 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca61b0b-ec95-4308-a582-1de199dc115a tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/domains/0f8be929734d4e469e272ad5df22aa33/users/534c8a3a013541b6bad345521a264b5b/roles/fd1d84a4d5cf43d0ad5b9e8105002b72` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:01.450323 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca61b0b-ec95-4308-a582-1de199dc115a tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=0f8be929734d4e469e272ad5df22aa33, user_id=534c8a3a013541b6bad345521a264b5b, role_id=fd1d84a4d5cf43d0ad5b9e8105002b72)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:01.453111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca61b0b-ec95-4308-a582-1de199dc115a tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:01.458990 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1971/3940] 10.222.0.23 () {58 vars in 1461 bytes} [Sat Apr 30 21:23:01 2022] HEAD /identity/v3/domains/0f8be929734d4e469e272ad5df22aa33/users/534c8a3a013541b6bad345521a264b5b/roles/fd1d84a4d5cf43d0ad5b9e8105002b72 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:01.463085 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01558d1d-6f0b-4ae4-aa19-3ac1132d3043 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:01.473284 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01558d1d-6f0b-4ae4-aa19-3ac1132d3043 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:01.478112 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c1f904-413e-4d0a-ba19-a6fdf830baa4 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:01.478998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1f904-413e-4d0a-ba19-a6fdf830baa4 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:01.479279 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1f904-413e-4d0a-ba19-a6fdf830baa4 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:01.479552 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1f904-413e-4d0a-ba19-a6fdf830baa4 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/domains/0f8be929734d4e469e272ad5df22aa33/users/534c8a3a013541b6bad345521a264b5b/roles/fd1d84a4d5cf43d0ad5b9e8105002b72` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:01.481844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c1f904-413e-4d0a-ba19-a6fdf830baa4 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=0f8be929734d4e469e272ad5df22aa33, user_id=534c8a3a013541b6bad345521a264b5b, role_id=fd1d84a4d5cf43d0ad5b9e8105002b72)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:01.484477 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c1f904-413e-4d0a-ba19-a6fdf830baa4 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:01.489639 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-27c1f904-413e-4d0a-ba19-a6fdf830baa4 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invalidating the token cache because role fd1d84a4d5cf43d0ad5b9e8105002b72 was removed from user 534c8a3a013541b6bad345521a264b5b on domain 0f8be929734d4e469e272ad5df22aa33. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:23:01.489965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-27c1f904-413e-4d0a-ba19-a6fdf830baa4 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:01.491158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-27c1f904-413e-4d0a-ba19-a6fdf830baa4 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:01.526797 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca61b0b-ec95-4308-a582-1de199dc115a tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:01.528596 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-eca61b0b-ec95-4308-a582-1de199dc115a tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:01.585416 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1970/3941] 10.222.0.23 () {58 vars in 1463 bytes} [Sat Apr 30 21:23:01 2022] DELETE /identity/v3/domains/0f8be929734d4e469e272ad5df22aa33/users/534c8a3a013541b6bad345521a264b5b/roles/fd1d84a4d5cf43d0ad5b9e8105002b72 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:23:01.586292 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca61b0b-ec95-4308-a582-1de199dc115a tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:01.590322 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c1f904-413e-4d0a-ba19-a6fdf830baa4 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:01.591663 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-27c1f904-413e-4d0a-ba19-a6fdf830baa4 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:01.637351 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519b0f2-0332-4e45-8e59-79313895bacc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:01.638072 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519b0f2-0332-4e45-8e59-79313895bacc service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:01.638351 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519b0f2-0332-4e45-8e59-79313895bacc service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:01.638622 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519b0f2-0332-4e45-8e59-79313895bacc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:01.640479 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5519b0f2-0332-4e45-8e59-79313895bacc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:01.650245 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519b0f2-0332-4e45-8e59-79313895bacc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:01.653083 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519b0f2-0332-4e45-8e59-79313895bacc service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:01.654970 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c1f904-413e-4d0a-ba19-a6fdf830baa4 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:01.660206 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfd60f-88bf-4d39-a7cc-949c138c9b27 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:01.661235 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfd60f-88bf-4d39-a7cc-949c138c9b27 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:01.661521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfd60f-88bf-4d39-a7cc-949c138c9b27 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:01.661819 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfd60f-88bf-4d39-a7cc-949c138c9b27 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/projects/6e5fd78edd3748d188fbac1b0048cf11/users/534c8a3a013541b6bad345521a264b5b/roles/fd1d84a4d5cf43d0ad5b9e8105002b72` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:01.664887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bfd60f-88bf-4d39-a7cc-949c138c9b27 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6e5fd78edd3748d188fbac1b0048cf11, user_id=534c8a3a013541b6bad345521a264b5b, role_id=fd1d84a4d5cf43d0ad5b9e8105002b72)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:01.667596 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bfd60f-88bf-4d39-a7cc-949c138c9b27 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:01.672646 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1972/3942] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:23:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:23:01.745722 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1971/3943] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:23:01 2022] PUT /identity/v3/projects/6e5fd78edd3748d188fbac1b0048cf11/users/534c8a3a013541b6bad345521a264b5b/roles/fd1d84a4d5cf43d0ad5b9e8105002b72 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:23:01.745986 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519b0f2-0332-4e45-8e59-79313895bacc service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:01.758809 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519b0f2-0332-4e45-8e59-79313895bacc service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:01.834914 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d71774-f7e2-44d5-b6e2-6f287aaf7e49 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:01.838021 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d71774-f7e2-44d5-b6e2-6f287aaf7e49 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:01.838021 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d71774-f7e2-44d5-b6e2-6f287aaf7e49 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:01.838021 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d71774-f7e2-44d5-b6e2-6f287aaf7e49 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/projects/6e5fd78edd3748d188fbac1b0048cf11/users/534c8a3a013541b6bad345521a264b5b/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:01.838751 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d71774-f7e2-44d5-b6e2-6f287aaf7e49 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:list_grants(project_id=6e5fd78edd3748d188fbac1b0048cf11, user_id=534c8a3a013541b6bad345521a264b5b)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:01.839800 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-b9d71774-f7e2-44d5-b6e2-6f287aaf7e49 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:23:01.839800 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:23:01.839800 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:23:01.841639 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d71774-f7e2-44d5-b6e2-6f287aaf7e49 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:01.861032 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1973/3944] 10.222.0.23 () {58 vars in 1364 bytes} [Sat Apr 30 21:23:01 2022] GET /identity/v3/projects/6e5fd78edd3748d188fbac1b0048cf11/users/534c8a3a013541b6bad345521a264b5b/roles => generated 409 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:23:01.862486 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfd60f-88bf-4d39-a7cc-949c138c9b27 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:01.882859 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfd60f-88bf-4d39-a7cc-949c138c9b27 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:01.889434 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73b0ee-299b-42f1-a709-a9e71adc0d2f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:01.895538 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73b0ee-299b-42f1-a709-a9e71adc0d2f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:01.895538 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73b0ee-299b-42f1-a709-a9e71adc0d2f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:01.895538 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73b0ee-299b-42f1-a709-a9e71adc0d2f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/projects/6e5fd78edd3748d188fbac1b0048cf11/users/534c8a3a013541b6bad345521a264b5b/roles/fd1d84a4d5cf43d0ad5b9e8105002b72` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:01.895538 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc73b0ee-299b-42f1-a709-a9e71adc0d2f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:check_grant(project_id=6e5fd78edd3748d188fbac1b0048cf11, user_id=534c8a3a013541b6bad345521a264b5b, role_id=fd1d84a4d5cf43d0ad5b9e8105002b72)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:01.897303 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-cc73b0ee-299b-42f1-a709-a9e71adc0d2f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:23:01.897303 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:23:01.897303 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:23:01.901314 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc73b0ee-299b-42f1-a709-a9e71adc0d2f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:01.924770 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1972/3945] 10.222.0.23 () {58 vars in 1464 bytes} [Sat Apr 30 21:23:01 2022] HEAD /identity/v3/projects/6e5fd78edd3748d188fbac1b0048cf11/users/534c8a3a013541b6bad345521a264b5b/roles/fd1d84a4d5cf43d0ad5b9e8105002b72 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:01.929454 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d71774-f7e2-44d5-b6e2-6f287aaf7e49 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:01.940995 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d71774-f7e2-44d5-b6e2-6f287aaf7e49 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:01.948371 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4021f1eb-dfe2-467f-9606-05ba7d6e80d1 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:01.948371 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021f1eb-dfe2-467f-9606-05ba7d6e80d1 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:01.949224 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021f1eb-dfe2-467f-9606-05ba7d6e80d1 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:01.949224 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021f1eb-dfe2-467f-9606-05ba7d6e80d1 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/projects/6e5fd78edd3748d188fbac1b0048cf11/users/534c8a3a013541b6bad345521a264b5b/roles/fd1d84a4d5cf43d0ad5b9e8105002b72` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:01.952047 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4021f1eb-dfe2-467f-9606-05ba7d6e80d1 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=6e5fd78edd3748d188fbac1b0048cf11, user_id=534c8a3a013541b6bad345521a264b5b, role_id=fd1d84a4d5cf43d0ad5b9e8105002b72)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:01.956093 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4021f1eb-dfe2-467f-9606-05ba7d6e80d1 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:01.963276 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4021f1eb-dfe2-467f-9606-05ba7d6e80d1 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invalidating the token cache because role fd1d84a4d5cf43d0ad5b9e8105002b72 was removed from user 534c8a3a013541b6bad345521a264b5b on project 6e5fd78edd3748d188fbac1b0048cf11. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:23:01.963664 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4021f1eb-dfe2-467f-9606-05ba7d6e80d1 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:01.964478 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4021f1eb-dfe2-467f-9606-05ba7d6e80d1 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:02.040695 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1974/3946] 10.222.0.23 () {58 vars in 1466 bytes} [Sat Apr 30 21:23:01 2022] DELETE /identity/v3/projects/6e5fd78edd3748d188fbac1b0048cf11/users/534c8a3a013541b6bad345521a264b5b/roles/fd1d84a4d5cf43d0ad5b9e8105002b72 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:02.041986 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73b0ee-299b-42f1-a709-a9e71adc0d2f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:02.043727 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-cc73b0ee-299b-42f1-a709-a9e71adc0d2f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:02.058774 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73b0ee-299b-42f1-a709-a9e71adc0d2f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:02.116170 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ce7d3-68f8-4c4d-8555-9f74d573cb5b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:02.116949 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ce7d3-68f8-4c4d-8555-9f74d573cb5b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:02.117235 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ce7d3-68f8-4c4d-8555-9f74d573cb5b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:02.117514 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ce7d3-68f8-4c4d-8555-9f74d573cb5b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/system/users/534c8a3a013541b6bad345521a264b5b/roles/fd1d84a4d5cf43d0ad5b9e8105002b72` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:02.119292 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ce7d3-68f8-4c4d-8555-9f74d573cb5b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=534c8a3a013541b6bad345521a264b5b, role_id=fd1d84a4d5cf43d0ad5b9e8105002b72)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:02.120309 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-8e6ce7d3-68f8-4c4d-8555-9f74d573cb5b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:23:02.120309 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:23:02.120309 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:23:02.121193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ce7d3-68f8-4c4d-8555-9f74d573cb5b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:02.203552 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1973/3947] 10.222.0.23 () {60 vars in 1377 bytes} [Sat Apr 30 21:23:02 2022] PUT /identity/v3/system/users/534c8a3a013541b6bad345521a264b5b/roles/fd1d84a4d5cf43d0ad5b9e8105002b72 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:02.207358 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4021f1eb-dfe2-467f-9606-05ba7d6e80d1 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:02.218434 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4021f1eb-dfe2-467f-9606-05ba7d6e80d1 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:02.222959 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5bc6de-8537-4cb6-bc5a-874f513b9eb1 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:02.223782 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5bc6de-8537-4cb6-bc5a-874f513b9eb1 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:02.224210 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5bc6de-8537-4cb6-bc5a-874f513b9eb1 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:02.225100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5bc6de-8537-4cb6-bc5a-874f513b9eb1 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/system/users/534c8a3a013541b6bad345521a264b5b/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:02.226459 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5bc6de-8537-4cb6-bc5a-874f513b9eb1 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=534c8a3a013541b6bad345521a264b5b)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:02.227381 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-ff5bc6de-8537-4cb6-bc5a-874f513b9eb1 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:23:02.227381 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:23:02.227381 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:23:02.228574 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5bc6de-8537-4cb6-bc5a-874f513b9eb1 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:02.241311 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1975/3948] 10.222.0.23 () {58 vars in 1259 bytes} [Sat Apr 30 21:23:02 2022] GET /identity/v3/system/users/534c8a3a013541b6bad345521a264b5b/roles => generated 374 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:23:02.245453 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ce7d3-68f8-4c4d-8555-9f74d573cb5b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:02.255456 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ce7d3-68f8-4c4d-8555-9f74d573cb5b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:02.260115 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46f9ec-e923-436b-8fd9-0c9503024e02 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:02.261024 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46f9ec-e923-436b-8fd9-0c9503024e02 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:02.261315 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46f9ec-e923-436b-8fd9-0c9503024e02 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:02.261592 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46f9ec-e923-436b-8fd9-0c9503024e02 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/system/users/534c8a3a013541b6bad345521a264b5b/roles/fd1d84a4d5cf43d0ad5b9e8105002b72` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:02.263363 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab46f9ec-e923-436b-8fd9-0c9503024e02 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=534c8a3a013541b6bad345521a264b5b, role_id=fd1d84a4d5cf43d0ad5b9e8105002b72)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:02.264380 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-ab46f9ec-e923-436b-8fd9-0c9503024e02 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:23:02.264380 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:23:02.264380 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:23:02.265261 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab46f9ec-e923-436b-8fd9-0c9503024e02 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:02.270528 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1974/3949] 10.222.0.23 () {58 vars in 1359 bytes} [Sat Apr 30 21:23:02 2022] HEAD /identity/v3/system/users/534c8a3a013541b6bad345521a264b5b/roles/fd1d84a4d5cf43d0ad5b9e8105002b72 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:02.275186 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5bc6de-8537-4cb6-bc5a-874f513b9eb1 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:02.285741 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5bc6de-8537-4cb6-bc5a-874f513b9eb1 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:02.293120 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e56f748-aae8-438c-97e2-875738fe6d2c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:02.294093 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56f748-aae8-438c-97e2-875738fe6d2c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:02.295322 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56f748-aae8-438c-97e2-875738fe6d2c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:02.295322 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56f748-aae8-438c-97e2-875738fe6d2c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/system/users/534c8a3a013541b6bad345521a264b5b/roles/fd1d84a4d5cf43d0ad5b9e8105002b72` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:02.296999 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e56f748-aae8-438c-97e2-875738fe6d2c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=534c8a3a013541b6bad345521a264b5b, role_id=fd1d84a4d5cf43d0ad5b9e8105002b72)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:02.298130 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-7e56f748-aae8-438c-97e2-875738fe6d2c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:23:02.298130 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:23:02.298130 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:23:02.298959 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e56f748-aae8-438c-97e2-875738fe6d2c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:02.356902 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1976/3950] 10.222.0.23 () {58 vars in 1361 bytes} [Sat Apr 30 21:23:02 2022] DELETE /identity/v3/system/users/534c8a3a013541b6bad345521a264b5b/roles/fd1d84a4d5cf43d0ad5b9e8105002b72 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:02.361876 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46f9ec-e923-436b-8fd9-0c9503024e02 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:02.373238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46f9ec-e923-436b-8fd9-0c9503024e02 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:02.377737 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25adb9bd-d92f-4ed8-8e44-49701d611254 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:02.378528 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adb9bd-d92f-4ed8-8e44-49701d611254 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:02.379665 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adb9bd-d92f-4ed8-8e44-49701d611254 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:02.379949 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adb9bd-d92f-4ed8-8e44-49701d611254 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:02.381124 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25adb9bd-d92f-4ed8-8e44-49701d611254 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:02.383637 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25adb9bd-d92f-4ed8-8e44-49701d611254 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:02.483058 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1975/3951] 10.222.0.23 () {60 vars in 1142 bytes} [Sat Apr 30 21:23:02 2022] POST /identity/v3/roles => generated 269 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:23:02.487310 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e56f748-aae8-438c-97e2-875738fe6d2c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:02.499156 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e56f748-aae8-438c-97e2-875738fe6d2c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:02.504177 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d53f8d-da25-4da1-8b7f-ee502d84dbb9 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:02.504974 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d53f8d-da25-4da1-8b7f-ee502d84dbb9 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:02.505257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d53f8d-da25-4da1-8b7f-ee502d84dbb9 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:02.505529 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d53f8d-da25-4da1-8b7f-ee502d84dbb9 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:02.506866 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d53f8d-da25-4da1-8b7f-ee502d84dbb9 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:02.507871 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-84d53f8d-da25-4da1-8b7f-ee502d84dbb9 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:23:02.507871 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:23:02.507871 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:23:02.508745 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d53f8d-da25-4da1-8b7f-ee502d84dbb9 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:02.604541 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1977/3952] 10.222.0.23 () {60 vars in 1142 bytes} [Sat Apr 30 21:23:02 2022] POST /identity/v3/roles => generated 270 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:23:02.608608 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25adb9bd-d92f-4ed8-8e44-49701d611254 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:02.620228 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25adb9bd-d92f-4ed8-8e44-49701d611254 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:02.625518 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d53f8d-da25-4da1-8b7f-ee502d84dbb9 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:02.625650 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d139e65-5021-47b4-a8cc-ed2106724c56 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:02.626490 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d139e65-5021-47b4-a8cc-ed2106724c56 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:02.627343 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d139e65-5021-47b4-a8cc-ed2106724c56 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:02.627650 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d139e65-5021-47b4-a8cc-ed2106724c56 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles/721c3922867a49f2acf7bb54e594ef05/implies/c219c65f3c314b9c9b2c980a49be884b` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:02.628451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-84d53f8d-da25-4da1-8b7f-ee502d84dbb9 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:02.629455 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d139e65-5021-47b4-a8cc-ed2106724c56 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=721c3922867a49f2acf7bb54e594ef05, implied_role_id=c219c65f3c314b9c9b2c980a49be884b)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:02.631648 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d139e65-5021-47b4-a8cc-ed2106724c56 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:02.716766 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d53f8d-da25-4da1-8b7f-ee502d84dbb9 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:02.722992 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc0e286-45cc-4996-a627-7549a2e0856a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:02.723983 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0e286-45cc-4996-a627-7549a2e0856a service placement] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:02.724440 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0e286-45cc-4996-a627-7549a2e0856a service placement] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:02.724864 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0e286-45cc-4996-a627-7549a2e0856a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:02.727543 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8cc0e286-45cc-4996-a627-7549a2e0856a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:02.744984 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc0e286-45cc-4996-a627-7549a2e0856a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:02.745150 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1976/3953] 10.222.0.23 () {60 vars in 1362 bytes} [Sat Apr 30 21:23:02 2022] PUT /identity/v3/roles/721c3922867a49f2acf7bb54e594ef05/implies/c219c65f3c314b9c9b2c980a49be884b => generated 530 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:23:02.747563 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc0e286-45cc-4996-a627-7549a2e0856a service placement] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:02.749253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d139e65-5021-47b4-a8cc-ed2106724c56 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:02.761827 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1978/3954] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:23:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:23:02.815126 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d139e65-5021-47b4-a8cc-ed2106724c56 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:02.821553 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925eec2-aca3-46db-a3b8-e18232cafdfd tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:02.822631 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925eec2-aca3-46db-a3b8-e18232cafdfd tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:02.822927 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925eec2-aca3-46db-a3b8-e18232cafdfd tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:02.823207 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925eec2-aca3-46db-a3b8-e18232cafdfd tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:02.824111 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f925eec2-aca3-46db-a3b8-e18232cafdfd tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:02.825143 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-f925eec2-aca3-46db-a3b8-e18232cafdfd tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:23:02.825143 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:23:02.825143 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:23:02.826197 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f925eec2-aca3-46db-a3b8-e18232cafdfd tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:02.911918 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1977/3955] 10.222.0.23 () {60 vars in 1148 bytes} [Sat Apr 30 21:23:02 2022] POST /identity/v3/domains => generated 276 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:23:02.919642 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc0e286-45cc-4996-a627-7549a2e0856a service placement] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:02.935775 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc0e286-45cc-4996-a627-7549a2e0856a service placement] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:03.018468 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050dba76-7c19-494a-aba3-9c8837cc206e tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:03.018468 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050dba76-7c19-494a-aba3-9c8837cc206e tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:03.018468 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050dba76-7c19-494a-aba3-9c8837cc206e tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:03.019787 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050dba76-7c19-494a-aba3-9c8837cc206e tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:03.019787 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050dba76-7c19-494a-aba3-9c8837cc206e tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:03.019787 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050dba76-7c19-494a-aba3-9c8837cc206e tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:03.080800 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1979/3956] 10.222.0.23 () {60 vars in 1142 bytes} [Sat Apr 30 21:23:02 2022] POST /identity/v3/roles => generated 269 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:23:03.086241 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925eec2-aca3-46db-a3b8-e18232cafdfd tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:03.116600 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925eec2-aca3-46db-a3b8-e18232cafdfd tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:03.128196 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9857ec-47dc-473b-b1c1-a663dd8e073f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:03.133017 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9857ec-47dc-473b-b1c1-a663dd8e073f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:03.133017 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9857ec-47dc-473b-b1c1-a663dd8e073f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:03.133017 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9857ec-47dc-473b-b1c1-a663dd8e073f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles/721c3922867a49f2acf7bb54e594ef05/implies/343b8c86f16f459aa41178b4f9cc4d98` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:03.133017 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9857ec-47dc-473b-b1c1-a663dd8e073f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=721c3922867a49f2acf7bb54e594ef05, implied_role_id=343b8c86f16f459aa41178b4f9cc4d98)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:03.134128 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9857ec-47dc-473b-b1c1-a663dd8e073f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:03.197996 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1978/3957] 10.222.0.23 () {60 vars in 1362 bytes} [Sat Apr 30 21:23:03 2022] PUT /identity/v3/roles/721c3922867a49f2acf7bb54e594ef05/implies/343b8c86f16f459aa41178b4f9cc4d98 => generated 529 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:23:03.202374 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050dba76-7c19-494a-aba3-9c8837cc206e tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:03.214985 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050dba76-7c19-494a-aba3-9c8837cc206e tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:03.277193 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216fdc4-bd94-4a9f-9e42-4b0f3fa5ac6f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:03.278373 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216fdc4-bd94-4a9f-9e42-4b0f3fa5ac6f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:03.278907 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216fdc4-bd94-4a9f-9e42-4b0f3fa5ac6f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:03.279287 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216fdc4-bd94-4a9f-9e42-4b0f3fa5ac6f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles/721c3922867a49f2acf7bb54e594ef05/implies/fd1d84a4d5cf43d0ad5b9e8105002b72` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:03.281232 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7216fdc4-bd94-4a9f-9e42-4b0f3fa5ac6f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=721c3922867a49f2acf7bb54e594ef05, implied_role_id=fd1d84a4d5cf43d0ad5b9e8105002b72)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:03.282387 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-7216fdc4-bd94-4a9f-9e42-4b0f3fa5ac6f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:23:03.282387 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:23:03.282387 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:23:03.283386 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7216fdc4-bd94-4a9f-9e42-4b0f3fa5ac6f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:03.392471 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1980/3958] 10.222.0.23 () {60 vars in 1362 bytes} [Sat Apr 30 21:23:03 2022] PUT /identity/v3/roles/721c3922867a49f2acf7bb54e594ef05/implies/fd1d84a4d5cf43d0ad5b9e8105002b72 => generated 524 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:23:03.396884 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9857ec-47dc-473b-b1c1-a663dd8e073f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:03.407145 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9857ec-47dc-473b-b1c1-a663dd8e073f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:03.464779 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb96744-6987-4a02-b01d-9b8bf6d7bb4c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:03.465640 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb96744-6987-4a02-b01d-9b8bf6d7bb4c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:03.465941 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb96744-6987-4a02-b01d-9b8bf6d7bb4c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:03.466219 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb96744-6987-4a02-b01d-9b8bf6d7bb4c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles/fd1d84a4d5cf43d0ad5b9e8105002b72/implies/721c3922867a49f2acf7bb54e594ef05` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:03.467949 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb96744-6987-4a02-b01d-9b8bf6d7bb4c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=fd1d84a4d5cf43d0ad5b9e8105002b72, implied_role_id=721c3922867a49f2acf7bb54e594ef05)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:03.469616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb96744-6987-4a02-b01d-9b8bf6d7bb4c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:03.494813 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-efb96744-6987-4a02-b01d-9b8bf6d7bb4c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] 721c3922867a49f2acf7bb54e594ef05 cannot be an implied roles.: keystone.exception.InvalidImpliedRole: 721c3922867a49f2acf7bb54e594ef05 cannot be an implied roles. Apr 30 21:23:03.494813 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:23:03.494813 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:23:03.494813 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:23:03.494813 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:23:03.494813 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:23:03.494813 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:23:03.494813 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:23:03.494813 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:23:03.494813 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:23:03.494813 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:23:03.494813 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:23:03.494813 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Apr 30 21:23:03.494813 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Apr 30 21:23:03.496000 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:23:03.496000 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:23:03.496000 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Apr 30 21:23:03.496000 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Apr 30 21:23:03.496000 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: 721c3922867a49f2acf7bb54e594ef05 cannot be an implied roles. Apr 30 21:23:03.496000 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:23:03.496408 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1979/3959] 10.222.0.23 () {60 vars in 1362 bytes} [Sat Apr 30 21:23:03 2022] PUT /identity/v3/roles/fd1d84a4d5cf43d0ad5b9e8105002b72/implies/721c3922867a49f2acf7bb54e594ef05 => generated 116 bytes in 100 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Apr 30 21:23:03.500572 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216fdc4-bd94-4a9f-9e42-4b0f3fa5ac6f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:03.510963 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216fdc4-bd94-4a9f-9e42-4b0f3fa5ac6f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:03.516516 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e098ead-3923-46aa-9717-bec4991a9910 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:03.521159 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e098ead-3923-46aa-9717-bec4991a9910 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:03.521159 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e098ead-3923-46aa-9717-bec4991a9910 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:03.521159 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e098ead-3923-46aa-9717-bec4991a9910 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles/721c3922867a49f2acf7bb54e594ef05/implies/fd1d84a4d5cf43d0ad5b9e8105002b72` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:03.521159 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e098ead-3923-46aa-9717-bec4991a9910 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=721c3922867a49f2acf7bb54e594ef05, implied_role_id=fd1d84a4d5cf43d0ad5b9e8105002b72)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:03.521527 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-9e098ead-3923-46aa-9717-bec4991a9910 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:23:03.521527 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:23:03.521527 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:23:03.521749 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e098ead-3923-46aa-9717-bec4991a9910 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:03.592114 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1981/3960] 10.222.0.23 () {58 vars in 1346 bytes} [Sat Apr 30 21:23:03 2022] DELETE /identity/v3/roles/721c3922867a49f2acf7bb54e594ef05/implies/fd1d84a4d5cf43d0ad5b9e8105002b72 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:23:03.596693 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb96744-6987-4a02-b01d-9b8bf6d7bb4c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:03.608453 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb96744-6987-4a02-b01d-9b8bf6d7bb4c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:03.686310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9b1fd-badb-4897-8c43-fff03c706f2f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:03.687473 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9b1fd-badb-4897-8c43-fff03c706f2f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:03.687607 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9b1fd-badb-4897-8c43-fff03c706f2f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:03.687825 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9b1fd-badb-4897-8c43-fff03c706f2f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles/721c3922867a49f2acf7bb54e594ef05/implies/343b8c86f16f459aa41178b4f9cc4d98` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:03.689958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a9b1fd-badb-4897-8c43-fff03c706f2f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=721c3922867a49f2acf7bb54e594ef05, implied_role_id=343b8c86f16f459aa41178b4f9cc4d98)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:03.691612 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a9b1fd-badb-4897-8c43-fff03c706f2f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:03.792091 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1980/3961] 10.222.0.23 () {58 vars in 1346 bytes} [Sat Apr 30 21:23:03 2022] DELETE /identity/v3/roles/721c3922867a49f2acf7bb54e594ef05/implies/343b8c86f16f459aa41178b4f9cc4d98 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:03.796688 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e098ead-3923-46aa-9717-bec4991a9910 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:03.807358 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e098ead-3923-46aa-9717-bec4991a9910 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:03.867560 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c56f6-653d-46fd-8247-c58b02336c05 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:03.868429 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c56f6-653d-46fd-8247-c58b02336c05 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:03.868714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c56f6-653d-46fd-8247-c58b02336c05 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:03.868995 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c56f6-653d-46fd-8247-c58b02336c05 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles/343b8c86f16f459aa41178b4f9cc4d98` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:03.870315 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c56f6-653d-46fd-8247-c58b02336c05 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=343b8c86f16f459aa41178b4f9cc4d98)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:03.871503 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-4e8c56f6-653d-46fd-8247-c58b02336c05 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:23:03.871503 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:23:03.871503 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:23:03.872333 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c56f6-653d-46fd-8247-c58b02336c05 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:03.950953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4e8c56f6-653d-46fd-8247-c58b02336c05 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invalidating the token cache because role 343b8c86f16f459aa41178b4f9cc4d98 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:23:03.951247 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4e8c56f6-653d-46fd-8247-c58b02336c05 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:03.951958 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4e8c56f6-653d-46fd-8247-c58b02336c05 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:03.953876 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1982/3962] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:23:03 2022] DELETE /identity/v3/roles/343b8c86f16f459aa41178b4f9cc4d98 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:03.959669 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9b1fd-badb-4897-8c43-fff03c706f2f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:03.961561 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b0a9b1fd-badb-4897-8c43-fff03c706f2f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:03.975191 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9b1fd-badb-4897-8c43-fff03c706f2f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:04.039275 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493289d-4bcf-4b98-88c1-6c7f7eba0af6 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:04.040172 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493289d-4bcf-4b98-88c1-6c7f7eba0af6 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:04.040457 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493289d-4bcf-4b98-88c1-6c7f7eba0af6 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:04.040752 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493289d-4bcf-4b98-88c1-6c7f7eba0af6 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/domains/f6c69eb9fefb44bb893ec75f5b0fd9bb` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:04.053283 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493289d-4bcf-4b98-88c1-6c7f7eba0af6 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f6c69eb9fefb44bb893ec75f5b0fd9bb)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:04.055482 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-9493289d-4bcf-4b98-88c1-6c7f7eba0af6 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:23:04.055482 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:23:04.055482 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:23:04.056392 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493289d-4bcf-4b98-88c1-6c7f7eba0af6 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:04.079794 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9493289d-4bcf-4b98-88c1-6c7f7eba0af6 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f6c69eb9fefb44bb893ec75f5b0fd9bb'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:04.080693 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9493289d-4bcf-4b98-88c1-6c7f7eba0af6 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f6c69eb9fefb44bb893ec75f5b0fd9bb'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:04.175555 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9493289d-4bcf-4b98-88c1-6c7f7eba0af6 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f6c69eb9fefb44bb893ec75f5b0fd9bb'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:04.176727 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9493289d-4bcf-4b98-88c1-6c7f7eba0af6 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f6c69eb9fefb44bb893ec75f5b0fd9bb'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:04.181286 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1981/3963] 10.222.0.23 () {60 vars in 1248 bytes} [Sat Apr 30 21:23:03 2022] PATCH /identity/v3/domains/f6c69eb9fefb44bb893ec75f5b0fd9bb => generated 277 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:23:04.185039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c56f6-653d-46fd-8247-c58b02336c05 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:04.195337 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c56f6-653d-46fd-8247-c58b02336c05 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:04.254363 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af950ede-8bf0-41ed-bdad-fd441da33c8b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:04.255324 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af950ede-8bf0-41ed-bdad-fd441da33c8b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:04.255732 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af950ede-8bf0-41ed-bdad-fd441da33c8b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:04.256085 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af950ede-8bf0-41ed-bdad-fd441da33c8b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/domains/f6c69eb9fefb44bb893ec75f5b0fd9bb` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:04.267089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af950ede-8bf0-41ed-bdad-fd441da33c8b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f6c69eb9fefb44bb893ec75f5b0fd9bb)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:04.273242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af950ede-8bf0-41ed-bdad-fd441da33c8b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:04.295205 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-af950ede-8bf0-41ed-bdad-fd441da33c8b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f6c69eb9fefb44bb893ec75f5b0fd9bb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:04.298807 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-af950ede-8bf0-41ed-bdad-fd441da33c8b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f6c69eb9fefb44bb893ec75f5b0fd9bb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:04.425699 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-af950ede-8bf0-41ed-bdad-fd441da33c8b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6c69eb9fefb44bb893ec75f5b0fd9bb', 'request_id': 'req-af950ede-8bf0-41ed-bdad-fd441da33c8b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:04.434697 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-af950ede-8bf0-41ed-bdad-fd441da33c8b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6c69eb9fefb44bb893ec75f5b0fd9bb', 'request_id': 'req-af950ede-8bf0-41ed-bdad-fd441da33c8b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:04.444382 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-af950ede-8bf0-41ed-bdad-fd441da33c8b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6c69eb9fefb44bb893ec75f5b0fd9bb', 'request_id': 'req-af950ede-8bf0-41ed-bdad-fd441da33c8b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:04.516656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-af950ede-8bf0-41ed-bdad-fd441da33c8b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] The token cache is being invalidate because project f6c69eb9fefb44bb893ec75f5b0fd9bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:23:04.520464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-af950ede-8bf0-41ed-bdad-fd441da33c8b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:04.520464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-af950ede-8bf0-41ed-bdad-fd441da33c8b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:04.526344 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-af950ede-8bf0-41ed-bdad-fd441da33c8b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f6c69eb9fefb44bb893ec75f5b0fd9bb', 'request_id': 'req-af950ede-8bf0-41ed-bdad-fd441da33c8b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:04.527020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-af950ede-8bf0-41ed-bdad-fd441da33c8b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f6c69eb9fefb44bb893ec75f5b0fd9bb', 'request_id': 'req-af950ede-8bf0-41ed-bdad-fd441da33c8b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:04.527639 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-af950ede-8bf0-41ed-bdad-fd441da33c8b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f6c69eb9fefb44bb893ec75f5b0fd9bb', 'request_id': 'req-af950ede-8bf0-41ed-bdad-fd441da33c8b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:04.537473 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1983/3964] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:23:04 2022] DELETE /identity/v3/domains/f6c69eb9fefb44bb893ec75f5b0fd9bb => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:04.541741 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493289d-4bcf-4b98-88c1-6c7f7eba0af6 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:04.543281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9493289d-4bcf-4b98-88c1-6c7f7eba0af6 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:04.557882 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493289d-4bcf-4b98-88c1-6c7f7eba0af6 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:04.623815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45bc894-6412-4fab-a849-6877a30894da tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:04.624768 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bc894-6412-4fab-a849-6877a30894da tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:04.625054 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bc894-6412-4fab-a849-6877a30894da tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:04.625333 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bc894-6412-4fab-a849-6877a30894da tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles/721c3922867a49f2acf7bb54e594ef05/implies/c219c65f3c314b9c9b2c980a49be884b` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:04.627074 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45bc894-6412-4fab-a849-6877a30894da tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=721c3922867a49f2acf7bb54e594ef05, implied_role_id=c219c65f3c314b9c9b2c980a49be884b)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:04.628686 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45bc894-6412-4fab-a849-6877a30894da tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:04.694883 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1982/3965] 10.222.0.23 () {58 vars in 1346 bytes} [Sat Apr 30 21:23:04 2022] DELETE /identity/v3/roles/721c3922867a49f2acf7bb54e594ef05/implies/c219c65f3c314b9c9b2c980a49be884b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:04.698930 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af950ede-8bf0-41ed-bdad-fd441da33c8b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:04.700337 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-af950ede-8bf0-41ed-bdad-fd441da33c8b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:04.713244 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af950ede-8bf0-41ed-bdad-fd441da33c8b tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:04.766619 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ab1e4-082e-4c83-b75f-ab5272596a31 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:04.767474 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ab1e4-082e-4c83-b75f-ab5272596a31 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:04.767755 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ab1e4-082e-4c83-b75f-ab5272596a31 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:04.768025 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ab1e4-082e-4c83-b75f-ab5272596a31 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles/c219c65f3c314b9c9b2c980a49be884b` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:04.769362 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ab1e4-082e-4c83-b75f-ab5272596a31 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=c219c65f3c314b9c9b2c980a49be884b)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:04.771173 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ab1e4-082e-4c83-b75f-ab5272596a31 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:04.888117 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ab5ab1e4-082e-4c83-b75f-ab5272596a31 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invalidating the token cache because role c219c65f3c314b9c9b2c980a49be884b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:23:04.888424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ab5ab1e4-082e-4c83-b75f-ab5272596a31 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:04.889098 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ab5ab1e4-082e-4c83-b75f-ab5272596a31 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:04.891239 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1984/3966] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:23:04 2022] DELETE /identity/v3/roles/c219c65f3c314b9c9b2c980a49be884b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:04.895267 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45bc894-6412-4fab-a849-6877a30894da tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:04.898300 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b45bc894-6412-4fab-a849-6877a30894da tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:04.913399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45bc894-6412-4fab-a849-6877a30894da tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:04.977029 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a08fb-c4d9-499b-b15d-921aea30f354 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:04.978613 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a08fb-c4d9-499b-b15d-921aea30f354 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:04.978905 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a08fb-c4d9-499b-b15d-921aea30f354 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:04.979192 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a08fb-c4d9-499b-b15d-921aea30f354 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles/721c3922867a49f2acf7bb54e594ef05` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:04.980537 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a08fb-c4d9-499b-b15d-921aea30f354 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=721c3922867a49f2acf7bb54e594ef05)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:04.982199 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a08fb-c4d9-499b-b15d-921aea30f354 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:05.195110 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-761a08fb-c4d9-499b-b15d-921aea30f354 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invalidating the token cache because role 721c3922867a49f2acf7bb54e594ef05 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:23:05.195772 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-761a08fb-c4d9-499b-b15d-921aea30f354 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:05.196132 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-761a08fb-c4d9-499b-b15d-921aea30f354 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:05.198106 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1983/3967] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:23:04 2022] DELETE /identity/v3/roles/721c3922867a49f2acf7bb54e594ef05 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:05.203531 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ab1e4-082e-4c83-b75f-ab5272596a31 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:05.213396 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ab1e4-082e-4c83-b75f-ab5272596a31 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:05.270166 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d7f4e-520e-430e-bc53-558660bd9fba tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:05.271114 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d7f4e-520e-430e-bc53-558660bd9fba tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:05.271405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d7f4e-520e-430e-bc53-558660bd9fba tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:05.271716 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d7f4e-520e-430e-bc53-558660bd9fba tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles/c3a0d7adec184c40a8e2c2fb45815470/implies/f0a33113c26b4e14a89f5eb9b6675e9a` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:05.273504 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d7f4e-520e-430e-bc53-558660bd9fba tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c3a0d7adec184c40a8e2c2fb45815470, implied_role_id=f0a33113c26b4e14a89f5eb9b6675e9a)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:05.275102 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d7f4e-520e-430e-bc53-558660bd9fba tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:05.385989 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1985/3968] 10.222.0.23 () {60 vars in 1362 bytes} [Sat Apr 30 21:23:05 2022] PUT /identity/v3/roles/c3a0d7adec184c40a8e2c2fb45815470/implies/f0a33113c26b4e14a89f5eb9b6675e9a => generated 521 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:23:05.390105 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a08fb-c4d9-499b-b15d-921aea30f354 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:05.391566 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-761a08fb-c4d9-499b-b15d-921aea30f354 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:05.404283 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a08fb-c4d9-499b-b15d-921aea30f354 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:05.487147 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d24fc5-1919-4504-9f8c-ab086bee4ba2 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:05.493872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d24fc5-1919-4504-9f8c-ab086bee4ba2 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:05.493872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d24fc5-1919-4504-9f8c-ab086bee4ba2 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:05.493872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d24fc5-1919-4504-9f8c-ab086bee4ba2 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles/c3a0d7adec184c40a8e2c2fb45815470/implies/f0a33113c26b4e14a89f5eb9b6675e9a` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:05.495697 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d24fc5-1919-4504-9f8c-ab086bee4ba2 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=c3a0d7adec184c40a8e2c2fb45815470, implied_role_id=f0a33113c26b4e14a89f5eb9b6675e9a)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:05.497035 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-78d24fc5-1919-4504-9f8c-ab086bee4ba2 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:23:05.497035 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:23:05.497035 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:23:05.498251 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d24fc5-1919-4504-9f8c-ab086bee4ba2 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:05.499348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d24fc5-1919-4504-9f8c-ab086bee4ba2 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=c3a0d7adec184c40a8e2c2fb45815470, implied_role_id=f0a33113c26b4e14a89f5eb9b6675e9a)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:05.500413 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-78d24fc5-1919-4504-9f8c-ab086bee4ba2 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:23:05.500413 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:23:05.500413 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:23:05.501405 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d24fc5-1919-4504-9f8c-ab086bee4ba2 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:05.507920 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1984/3969] 10.222.0.23 () {58 vars in 1344 bytes} [Sat Apr 30 21:23:05 2022] HEAD /identity/v3/roles/c3a0d7adec184c40a8e2c2fb45815470/implies/f0a33113c26b4e14a89f5eb9b6675e9a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:05.512105 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d7f4e-520e-430e-bc53-558660bd9fba tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:05.526185 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d7f4e-520e-430e-bc53-558660bd9fba tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:05.532989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecdbea2-efd8-4d41-b65a-e049029b750c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:05.534265 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecdbea2-efd8-4d41-b65a-e049029b750c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:05.534513 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecdbea2-efd8-4d41-b65a-e049029b750c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:05.534894 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecdbea2-efd8-4d41-b65a-e049029b750c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles/c3a0d7adec184c40a8e2c2fb45815470/implies/f0a33113c26b4e14a89f5eb9b6675e9a` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:05.537839 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecdbea2-efd8-4d41-b65a-e049029b750c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=c3a0d7adec184c40a8e2c2fb45815470, implied_role_id=f0a33113c26b4e14a89f5eb9b6675e9a)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:05.539143 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-1ecdbea2-efd8-4d41-b65a-e049029b750c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:23:05.539143 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:23:05.539143 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:23:05.540416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecdbea2-efd8-4d41-b65a-e049029b750c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:05.551045 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1986/3970] 10.222.0.23 () {58 vars in 1343 bytes} [Sat Apr 30 21:23:05 2022] GET /identity/v3/roles/c3a0d7adec184c40a8e2c2fb45815470/implies/f0a33113c26b4e14a89f5eb9b6675e9a => generated 521 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:23:05.553309 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d24fc5-1919-4504-9f8c-ab086bee4ba2 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:05.563565 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d24fc5-1919-4504-9f8c-ab086bee4ba2 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:05.568420 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f3ba3-6f4a-4dc7-84b9-4d2008555715 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:05.569334 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f3ba3-6f4a-4dc7-84b9-4d2008555715 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:05.569615 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f3ba3-6f4a-4dc7-84b9-4d2008555715 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:05.569924 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f3ba3-6f4a-4dc7-84b9-4d2008555715 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles/c3a0d7adec184c40a8e2c2fb45815470/implies/f0a33113c26b4e14a89f5eb9b6675e9a` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:05.571708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f3ba3-6f4a-4dc7-84b9-4d2008555715 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c3a0d7adec184c40a8e2c2fb45815470, implied_role_id=f0a33113c26b4e14a89f5eb9b6675e9a)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:05.573301 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f3ba3-6f4a-4dc7-84b9-4d2008555715 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:05.681313 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1985/3971] 10.222.0.23 () {58 vars in 1346 bytes} [Sat Apr 30 21:23:05 2022] DELETE /identity/v3/roles/c3a0d7adec184c40a8e2c2fb45815470/implies/f0a33113c26b4e14a89f5eb9b6675e9a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:05.682474 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecdbea2-efd8-4d41-b65a-e049029b750c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:05.700364 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecdbea2-efd8-4d41-b65a-e049029b750c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:05.807541 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6941fc-d82f-4885-990b-4ef517271ed5 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:05.808296 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6941fc-d82f-4885-990b-4ef517271ed5 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:05.808958 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6941fc-d82f-4885-990b-4ef517271ed5 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:05.808958 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6941fc-d82f-4885-990b-4ef517271ed5 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles/c3a0d7adec184c40a8e2c2fb45815470/implies/f0a33113c26b4e14a89f5eb9b6675e9a` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:05.811610 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6941fc-d82f-4885-990b-4ef517271ed5 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=c3a0d7adec184c40a8e2c2fb45815470, implied_role_id=f0a33113c26b4e14a89f5eb9b6675e9a)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:05.813668 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6941fc-d82f-4885-990b-4ef517271ed5 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:05.830831 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-1b6941fc-d82f-4885-990b-4ef517271ed5 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] c3a0d7adec184c40a8e2c2fb45815470 does not imply f0a33113c26b4e14a89f5eb9b6675e9a.: keystone.exception.ImpliedRoleNotFound: c3a0d7adec184c40a8e2c2fb45815470 does not imply f0a33113c26b4e14a89f5eb9b6675e9a. Apr 30 21:23:05.830831 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:23:05.830831 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Apr 30 21:23:05.830831 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = query.one() Apr 30 21:23:05.830831 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Apr 30 21:23:05.830831 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._iter().one() Apr 30 21:23:05.830831 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1408, in one Apr 30 21:23:05.830831 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._only_one_row( Apr 30 21:23:05.830831 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Apr 30 21:23:05.830831 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exc.NoResultFound( Apr 30 21:23:05.830831 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Apr 30 21:23:05.830831 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:23:05.830831 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 21:23:05.830831 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:23:05.830831 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:23:05.830831 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:23:05.832047 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:23:05.832047 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:23:05.832047 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:23:05.832047 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:23:05.832047 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:23:05.832047 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:23:05.832047 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:23:05.832047 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:23:05.832047 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:23:05.832047 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Apr 30 21:23:05.832047 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Apr 30 21:23:05.832047 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Apr 30 21:23:05.832047 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Apr 30 21:23:05.832047 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Apr 30 21:23:05.832047 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Apr 30 21:23:05.832047 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Apr 30 21:23:05.837383 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Apr 30 21:23:05.837383 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: c3a0d7adec184c40a8e2c2fb45815470 does not imply f0a33113c26b4e14a89f5eb9b6675e9a. Apr 30 21:23:05.837383 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:23:05.837383 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1987/3972] 10.222.0.23 () {58 vars in 1343 bytes} [Sat Apr 30 21:23:05 2022] GET /identity/v3/roles/c3a0d7adec184c40a8e2c2fb45815470/implies/f0a33113c26b4e14a89f5eb9b6675e9a => generated 137 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Apr 30 21:23:05.837816 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f3ba3-6f4a-4dc7-84b9-4d2008555715 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:05.848803 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f3ba3-6f4a-4dc7-84b9-4d2008555715 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:05.861482 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1804d-81aa-4194-bea9-4cd2cf9011ff tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:05.861482 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1804d-81aa-4194-bea9-4cd2cf9011ff tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:05.861482 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1804d-81aa-4194-bea9-4cd2cf9011ff tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:05.861812 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1804d-81aa-4194-bea9-4cd2cf9011ff tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles/c3a0d7adec184c40a8e2c2fb45815470/implies/f0a33113c26b4e14a89f5eb9b6675e9a` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:05.861812 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d1804d-81aa-4194-bea9-4cd2cf9011ff tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c3a0d7adec184c40a8e2c2fb45815470, implied_role_id=f0a33113c26b4e14a89f5eb9b6675e9a)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:05.861812 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d1804d-81aa-4194-bea9-4cd2cf9011ff tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:05.876089 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-03d1804d-81aa-4194-bea9-4cd2cf9011ff tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] c3a0d7adec184c40a8e2c2fb45815470 does not imply f0a33113c26b4e14a89f5eb9b6675e9a.: keystone.exception.ImpliedRoleNotFound: c3a0d7adec184c40a8e2c2fb45815470 does not imply f0a33113c26b4e14a89f5eb9b6675e9a. Apr 30 21:23:05.876089 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:23:05.876089 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Apr 30 21:23:05.876089 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ref = query.one() Apr 30 21:23:05.876089 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Apr 30 21:23:05.876089 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._iter().one() Apr 30 21:23:05.876089 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1408, in one Apr 30 21:23:05.876089 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._only_one_row( Apr 30 21:23:05.876089 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Apr 30 21:23:05.876089 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exc.NoResultFound( Apr 30 21:23:05.876089 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Apr 30 21:23:05.876089 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:23:05.876089 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 21:23:05.876089 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:23:05.876089 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:23:05.876089 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:23:05.877349 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:23:05.877349 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:23:05.877349 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:23:05.877349 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:23:05.877349 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:23:05.877349 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:23:05.877349 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:23:05.877349 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:23:05.877349 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:23:05.877349 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Apr 30 21:23:05.877349 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Apr 30 21:23:05.877349 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:23:05.877349 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:23:05.877349 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Apr 30 21:23:05.877349 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Apr 30 21:23:05.877349 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Apr 30 21:23:05.878755 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Apr 30 21:23:05.878755 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Apr 30 21:23:05.878755 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Apr 30 21:23:05.878755 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: c3a0d7adec184c40a8e2c2fb45815470 does not imply f0a33113c26b4e14a89f5eb9b6675e9a. Apr 30 21:23:05.878755 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:23:05.881821 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1986/3973] 10.222.0.23 () {58 vars in 1346 bytes} [Sat Apr 30 21:23:05 2022] DELETE /identity/v3/roles/c3a0d7adec184c40a8e2c2fb45815470/implies/f0a33113c26b4e14a89f5eb9b6675e9a => generated 137 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Apr 30 21:23:05.883481 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6941fc-d82f-4885-990b-4ef517271ed5 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:05.894331 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6941fc-d82f-4885-990b-4ef517271ed5 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:05.901395 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56e985-d776-4409-98f8-f68f8ae7fcbf tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:05.902023 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56e985-d776-4409-98f8-f68f8ae7fcbf tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:05.902146 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56e985-d776-4409-98f8-f68f8ae7fcbf tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:05.902467 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56e985-d776-4409-98f8-f68f8ae7fcbf tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles/c3a0d7adec184c40a8e2c2fb45815470/implies/f0a33113c26b4e14a89f5eb9b6675e9a` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:05.904264 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56e985-d776-4409-98f8-f68f8ae7fcbf tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c3a0d7adec184c40a8e2c2fb45815470, implied_role_id=f0a33113c26b4e14a89f5eb9b6675e9a)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:05.906055 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56e985-d776-4409-98f8-f68f8ae7fcbf tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:06.018399 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1988/3974] 10.222.0.23 () {60 vars in 1362 bytes} [Sat Apr 30 21:23:05 2022] PUT /identity/v3/roles/c3a0d7adec184c40a8e2c2fb45815470/implies/f0a33113c26b4e14a89f5eb9b6675e9a => generated 521 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:23:06.019599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1804d-81aa-4194-bea9-4cd2cf9011ff tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:06.031379 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1804d-81aa-4194-bea9-4cd2cf9011ff tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:06.130492 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca737781-6f28-4c09-8a97-a5e51890d25d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:06.143652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca737781-6f28-4c09-8a97-a5e51890d25d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:06.143652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca737781-6f28-4c09-8a97-a5e51890d25d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:06.143652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca737781-6f28-4c09-8a97-a5e51890d25d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles/c3a0d7adec184c40a8e2c2fb45815470/implies/8a6f1c75c55045c9a3332350b00ed5e8` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:06.143652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca737781-6f28-4c09-8a97-a5e51890d25d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c3a0d7adec184c40a8e2c2fb45815470, implied_role_id=8a6f1c75c55045c9a3332350b00ed5e8)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:06.144070 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca737781-6f28-4c09-8a97-a5e51890d25d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:06.223588 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1987/3975] 10.222.0.23 () {60 vars in 1362 bytes} [Sat Apr 30 21:23:06 2022] PUT /identity/v3/roles/c3a0d7adec184c40a8e2c2fb45815470/implies/8a6f1c75c55045c9a3332350b00ed5e8 => generated 520 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:23:06.224263 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56e985-d776-4409-98f8-f68f8ae7fcbf tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:06.235768 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56e985-d776-4409-98f8-f68f8ae7fcbf tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:06.317457 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c0e665-3c70-49e2-86d7-3c505a53426c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:06.318882 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0e665-3c70-49e2-86d7-3c505a53426c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:06.319160 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0e665-3c70-49e2-86d7-3c505a53426c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:06.320159 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0e665-3c70-49e2-86d7-3c505a53426c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles/8a6f1c75c55045c9a3332350b00ed5e8/implies/fd1d84a4d5cf43d0ad5b9e8105002b72` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:06.321985 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c0e665-3c70-49e2-86d7-3c505a53426c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=8a6f1c75c55045c9a3332350b00ed5e8, implied_role_id=fd1d84a4d5cf43d0ad5b9e8105002b72)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:06.323683 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c0e665-3c70-49e2-86d7-3c505a53426c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:06.427214 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1989/3976] 10.222.0.23 () {60 vars in 1362 bytes} [Sat Apr 30 21:23:06 2022] PUT /identity/v3/roles/8a6f1c75c55045c9a3332350b00ed5e8/implies/fd1d84a4d5cf43d0ad5b9e8105002b72 => generated 519 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:23:06.437737 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca737781-6f28-4c09-8a97-a5e51890d25d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:06.454391 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca737781-6f28-4c09-8a97-a5e51890d25d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:06.572225 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267471c-bf68-4214-82a8-6bcc64538b49 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:06.573143 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267471c-bf68-4214-82a8-6bcc64538b49 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:06.573904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267471c-bf68-4214-82a8-6bcc64538b49 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:06.574362 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267471c-bf68-4214-82a8-6bcc64538b49 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:06.575157 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267471c-bf68-4214-82a8-6bcc64538b49 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:06.576637 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-4267471c-bf68-4214-82a8-6bcc64538b49 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:23:06.576637 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:23:06.576637 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:23:06.581679 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267471c-bf68-4214-82a8-6bcc64538b49 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:06.608553 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1988/3977] 10.222.0.23 () {58 vars in 1151 bytes} [Sat Apr 30 21:23:06 2022] GET /identity/v3/role_inferences => generated 1605 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:23:06.609577 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c0e665-3c70-49e2-86d7-3c505a53426c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:06.620650 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c0e665-3c70-49e2-86d7-3c505a53426c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:06.625168 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b87b2-26df-4844-903b-9a1d7bd92c65 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:06.626109 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b87b2-26df-4844-903b-9a1d7bd92c65 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:06.626870 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b87b2-26df-4844-903b-9a1d7bd92c65 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:06.626870 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b87b2-26df-4844-903b-9a1d7bd92c65 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles/8a6f1c75c55045c9a3332350b00ed5e8/implies/fd1d84a4d5cf43d0ad5b9e8105002b72` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:06.628696 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b87b2-26df-4844-903b-9a1d7bd92c65 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=8a6f1c75c55045c9a3332350b00ed5e8, implied_role_id=fd1d84a4d5cf43d0ad5b9e8105002b72)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:06.631345 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b87b2-26df-4844-903b-9a1d7bd92c65 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:06.700118 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1990/3978] 10.222.0.23 () {58 vars in 1346 bytes} [Sat Apr 30 21:23:06 2022] DELETE /identity/v3/roles/8a6f1c75c55045c9a3332350b00ed5e8/implies/fd1d84a4d5cf43d0ad5b9e8105002b72 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:23:06.704358 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267471c-bf68-4214-82a8-6bcc64538b49 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:06.716062 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267471c-bf68-4214-82a8-6bcc64538b49 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:06.784610 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d35a3-8d3b-486e-96c2-30f786b0b964 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:06.785859 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d35a3-8d3b-486e-96c2-30f786b0b964 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:06.786355 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d35a3-8d3b-486e-96c2-30f786b0b964 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:06.787454 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d35a3-8d3b-486e-96c2-30f786b0b964 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles/c3a0d7adec184c40a8e2c2fb45815470/implies/8a6f1c75c55045c9a3332350b00ed5e8` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:06.789721 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187d35a3-8d3b-486e-96c2-30f786b0b964 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c3a0d7adec184c40a8e2c2fb45815470, implied_role_id=8a6f1c75c55045c9a3332350b00ed5e8)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:06.792541 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187d35a3-8d3b-486e-96c2-30f786b0b964 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:06.795503 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88bf7d-f3b1-438d-8488-090d82079e2c None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:06.796771 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88bf7d-f3b1-438d-8488-090d82079e2c None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:06.797420 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88bf7d-f3b1-438d-8488-090d82079e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:06.822459 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-4f88bf7d-f3b1-438d-8488-090d82079e2c None None] MFA Rules not processed for user `f230caf9b44f4c11b91e2f9dcb3a3d82`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:06.823776 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4f88bf7d-f3b1-438d-8488-090d82079e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:06.870010 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1989/3979] 10.222.0.23 () {58 vars in 1346 bytes} [Sat Apr 30 21:23:06 2022] DELETE /identity/v3/roles/c3a0d7adec184c40a8e2c2fb45815470/implies/8a6f1c75c55045c9a3332350b00ed5e8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:06.870966 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d35a3-8d3b-486e-96c2-30f786b0b964 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:06.956945 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d35a3-8d3b-486e-96c2-30f786b0b964 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:06.967028 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4171f1-3dfc-4754-80ff-e130ec2a3e05 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:06.969768 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4171f1-3dfc-4754-80ff-e130ec2a3e05 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:06.970986 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4171f1-3dfc-4754-80ff-e130ec2a3e05 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:06.971276 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4171f1-3dfc-4754-80ff-e130ec2a3e05 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles/c3a0d7adec184c40a8e2c2fb45815470/implies/f0a33113c26b4e14a89f5eb9b6675e9a` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:06.971910 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1991/3980] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:23:06.973116 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88bf7d-f3b1-438d-8488-090d82079e2c None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:06.975224 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4f88bf7d-f3b1-438d-8488-090d82079e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:06.976895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4171f1-3dfc-4754-80ff-e130ec2a3e05 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c3a0d7adec184c40a8e2c2fb45815470, implied_role_id=f0a33113c26b4e14a89f5eb9b6675e9a)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:06.980325 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4171f1-3dfc-4754-80ff-e130ec2a3e05 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:07.092308 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88bf7d-f3b1-438d-8488-090d82079e2c None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:07.107433 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1990/3981] 10.222.0.23 () {58 vars in 1346 bytes} [Sat Apr 30 21:23:06 2022] DELETE /identity/v3/roles/c3a0d7adec184c40a8e2c2fb45815470/implies/f0a33113c26b4e14a89f5eb9b6675e9a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:07.112792 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f9983-004a-4c32-83be-4e2e8d597b69 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:07.113429 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f9983-004a-4c32-83be-4e2e8d597b69 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:07.113720 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f9983-004a-4c32-83be-4e2e8d597b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:07.141896 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-377f9983-004a-4c32-83be-4e2e8d597b69 None None] MFA Rules not processed for user `f230caf9b44f4c11b91e2f9dcb3a3d82`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:07.149003 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-377f9983-004a-4c32-83be-4e2e8d597b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:07.206922 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a03c7c-a320-4352-82cf-b311ff1dccee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:07.209014 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a03c7c-a320-4352-82cf-b311ff1dccee service placement] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:07.209399 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a03c7c-a320-4352-82cf-b311ff1dccee service placement] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:07.209691 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a03c7c-a320-4352-82cf-b311ff1dccee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:07.211694 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-06a03c7c-a320-4352-82cf-b311ff1dccee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:07.230464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a03c7c-a320-4352-82cf-b311ff1dccee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:07.232097 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a03c7c-a320-4352-82cf-b311ff1dccee service placement] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:07.247143 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1992/3982] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:23:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:23:07.247994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a03c7c-a320-4352-82cf-b311ff1dccee service placement] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:07.252588 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1991/3983] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:23:07.260760 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a03c7c-a320-4352-82cf-b311ff1dccee service placement] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:07.276078 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7bbf2f-218e-4b33-a4a6-8bf94b51be10 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:07.276452 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7bbf2f-218e-4b33-a4a6-8bf94b51be10 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:07.277027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7bbf2f-218e-4b33-a4a6-8bf94b51be10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:07.303733 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-2c7bbf2f-218e-4b33-a4a6-8bf94b51be10 None None] MFA Rules not processed for user `f230caf9b44f4c11b91e2f9dcb3a3d82`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:07.305103 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2c7bbf2f-218e-4b33-a4a6-8bf94b51be10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:07.315406 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1992/3984] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:23:07.329577 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5591e-877e-4d96-9b6a-0be7e456c776 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:07.330343 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5591e-877e-4d96-9b6a-0be7e456c776 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:07.330569 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5591e-877e-4d96-9b6a-0be7e456c776 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:07.330847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5591e-877e-4d96-9b6a-0be7e456c776 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:07.331657 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a5591e-877e-4d96-9b6a-0be7e456c776 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:07.333271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a5591e-877e-4d96-9b6a-0be7e456c776 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:07.341009 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c39ed-18ac-488a-8f20-a3a4c6a5ffb3 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:07.341350 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c39ed-18ac-488a-8f20-a3a4c6a5ffb3 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:07.342051 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c39ed-18ac-488a-8f20-a3a4c6a5ffb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:07.351149 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1993/3985] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:23:07 2022] GET /identity/v3/roles => generated 2322 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:23:07.352254 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5591e-877e-4d96-9b6a-0be7e456c776 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:07.373902 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5591e-877e-4d96-9b6a-0be7e456c776 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:07.374834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-6a9c39ed-18ac-488a-8f20-a3a4c6a5ffb3 None None] MFA Rules not processed for user `f230caf9b44f4c11b91e2f9dcb3a3d82`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:07.376629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6a9c39ed-18ac-488a-8f20-a3a4c6a5ffb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:07.381142 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb4562-b39d-4549-aa20-c3d936ca0cda tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:07.381879 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb4562-b39d-4549-aa20-c3d936ca0cda tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:07.382316 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb4562-b39d-4549-aa20-c3d936ca0cda tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:07.382771 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb4562-b39d-4549-aa20-c3d936ca0cda tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:07.383579 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb4562-b39d-4549-aa20-c3d936ca0cda tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:07.385234 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb4562-b39d-4549-aa20-c3d936ca0cda tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:07.391109 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1993/3986] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:23:07.428136 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba908d-8215-4f15-988f-bddb2c0daced None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:07.435346 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba908d-8215-4f15-988f-bddb2c0daced None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:07.435346 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba908d-8215-4f15-988f-bddb2c0daced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:07.460804 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-d4ba908d-8215-4f15-988f-bddb2c0daced None None] MFA Rules not processed for user `f230caf9b44f4c11b91e2f9dcb3a3d82`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:07.462301 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d4ba908d-8215-4f15-988f-bddb2c0daced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:07.466527 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1994/3987] 10.222.0.23 () {60 vars in 1142 bytes} [Sat Apr 30 21:23:07 2022] POST /identity/v3/roles => generated 235 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:23:07.467594 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb4562-b39d-4549-aa20-c3d936ca0cda tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:07.496371 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1994/3988] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:23:07.499622 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb4562-b39d-4549-aa20-c3d936ca0cda tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:07.528238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eded05c-6d4e-4848-bdc1-fe44841457ee tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:07.529210 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eded05c-6d4e-4848-bdc1-fe44841457ee tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:07.529500 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eded05c-6d4e-4848-bdc1-fe44841457ee tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:07.529871 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eded05c-6d4e-4848-bdc1-fe44841457ee tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles/969812efc85e442f8fe32cc4552f4156` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:07.533580 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eded05c-6d4e-4848-bdc1-fe44841457ee tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:update_role(role_id=969812efc85e442f8fe32cc4552f4156)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:07.534633 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-3eded05c-6d4e-4848-bdc1-fe44841457ee tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:23:07.534633 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:23:07.534633 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:23:07.535530 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eded05c-6d4e-4848-bdc1-fe44841457ee tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:07.628585 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1995/3989] 10.222.0.23 () {60 vars in 1242 bytes} [Sat Apr 30 21:23:07 2022] PATCH /identity/v3/roles/969812efc85e442f8fe32cc4552f4156 => generated 237 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:23:07.629796 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba908d-8215-4f15-988f-bddb2c0daced None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:07.640625 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba908d-8215-4f15-988f-bddb2c0daced None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:07.645369 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f86236-42ba-4336-aa96-84921e5f3eb8 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:07.646911 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f86236-42ba-4336-aa96-84921e5f3eb8 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:07.647201 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f86236-42ba-4336-aa96-84921e5f3eb8 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:07.647480 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f86236-42ba-4336-aa96-84921e5f3eb8 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles/969812efc85e442f8fe32cc4552f4156` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:07.656426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f86236-42ba-4336-aa96-84921e5f3eb8 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:get_role(role_id=969812efc85e442f8fe32cc4552f4156)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:07.657456 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-92f86236-42ba-4336-aa96-84921e5f3eb8 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:23:07.657456 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:23:07.657456 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:23:07.658464 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f86236-42ba-4336-aa96-84921e5f3eb8 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:07.660857 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1995/3990] 10.222.0.23 () {58 vars in 1220 bytes} [Sat Apr 30 21:23:07 2022] GET /identity/v3/roles/969812efc85e442f8fe32cc4552f4156 => generated 237 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:23:07.664817 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eded05c-6d4e-4848-bdc1-fe44841457ee tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:07.675619 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eded05c-6d4e-4848-bdc1-fe44841457ee tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:07.680946 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27090e-1509-4d44-8130-f348380a2cbc tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:07.682519 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27090e-1509-4d44-8130-f348380a2cbc tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:07.683401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27090e-1509-4d44-8130-f348380a2cbc tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:07.683732 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27090e-1509-4d44-8130-f348380a2cbc tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:07.684464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27090e-1509-4d44-8130-f348380a2cbc tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:07.686898 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27090e-1509-4d44-8130-f348380a2cbc tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:07.700468 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1996/3991] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:23:07 2022] GET /identity/v3/roles => generated 2550 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:23:07.704454 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f86236-42ba-4336-aa96-84921e5f3eb8 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:07.716110 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f86236-42ba-4336-aa96-84921e5f3eb8 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:07.729584 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722cc27-baea-4eb8-9287-bb5de5739ff8 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:07.735811 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722cc27-baea-4eb8-9287-bb5de5739ff8 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:07.736122 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722cc27-baea-4eb8-9287-bb5de5739ff8 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:07.736410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722cc27-baea-4eb8-9287-bb5de5739ff8 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles/969812efc85e442f8fe32cc4552f4156` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:07.738344 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722cc27-baea-4eb8-9287-bb5de5739ff8 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:delete_role(role_id=969812efc85e442f8fe32cc4552f4156)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:07.739446 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-6722cc27-baea-4eb8-9287-bb5de5739ff8 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:23:07.739446 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:23:07.739446 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:23:07.743065 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722cc27-baea-4eb8-9287-bb5de5739ff8 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:07.791198 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303022c4-0e37-45a6-a7f3-ba86479c002c None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:07.791591 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303022c4-0e37-45a6-a7f3-ba86479c002c None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:07.795017 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303022c4-0e37-45a6-a7f3-ba86479c002c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:07.815768 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-303022c4-0e37-45a6-a7f3-ba86479c002c None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:07.817662 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-303022c4-0e37-45a6-a7f3-ba86479c002c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:07.875713 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6722cc27-baea-4eb8-9287-bb5de5739ff8 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invalidating the token cache because role 969812efc85e442f8fe32cc4552f4156 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:23:07.876089 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6722cc27-baea-4eb8-9287-bb5de5739ff8 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:07.878541 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6722cc27-baea-4eb8-9287-bb5de5739ff8 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:07.881656 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1996/3992] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:23:07 2022] DELETE /identity/v3/roles/969812efc85e442f8fe32cc4552f4156 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:07.886551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722cc27-baea-4eb8-9287-bb5de5739ff8 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:07.888852 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6722cc27-baea-4eb8-9287-bb5de5739ff8 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:07.953822 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1997/3993] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:23:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:23:07.968295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303022c4-0e37-45a6-a7f3-ba86479c002c None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:07.970106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-303022c4-0e37-45a6-a7f3-ba86479c002c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:08.021495 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722cc27-baea-4eb8-9287-bb5de5739ff8 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:08.027058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d23c65-5484-46b8-b3c1-8623f21193f4 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:08.028037 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d23c65-5484-46b8-b3c1-8623f21193f4 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:08.028323 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d23c65-5484-46b8-b3c1-8623f21193f4 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:08.028860 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d23c65-5484-46b8-b3c1-8623f21193f4 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles/c3a0d7adec184c40a8e2c2fb45815470/implies/f0a33113c26b4e14a89f5eb9b6675e9a` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:08.030568 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d23c65-5484-46b8-b3c1-8623f21193f4 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c3a0d7adec184c40a8e2c2fb45815470, implied_role_id=f0a33113c26b4e14a89f5eb9b6675e9a)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:08.032222 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d23c65-5484-46b8-b3c1-8623f21193f4 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:08.063617 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303022c4-0e37-45a6-a7f3-ba86479c002c None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:08.130252 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c400077-348a-4ed0-93c7-80594a3c26a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:08.131068 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c400077-348a-4ed0-93c7-80594a3c26a7 service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:08.131361 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c400077-348a-4ed0-93c7-80594a3c26a7 service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:08.131640 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c400077-348a-4ed0-93c7-80594a3c26a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:08.143031 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1997/3994] 10.222.0.23 () {60 vars in 1362 bytes} [Sat Apr 30 21:23:07 2022] PUT /identity/v3/roles/c3a0d7adec184c40a8e2c2fb45815470/implies/f0a33113c26b4e14a89f5eb9b6675e9a => generated 521 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:23:08.148058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d23c65-5484-46b8-b3c1-8623f21193f4 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:08.214985 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c400077-348a-4ed0-93c7-80594a3c26a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:08.218509 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c400077-348a-4ed0-93c7-80594a3c26a7 service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:08.232786 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1998/3995] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:23:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 30 21:23:08.295700 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d23c65-5484-46b8-b3c1-8623f21193f4 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:08.300917 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3e762-6ce4-477e-a8ac-14f6014fea77 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:08.301869 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3e762-6ce4-477e-a8ac-14f6014fea77 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:08.303104 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3e762-6ce4-477e-a8ac-14f6014fea77 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:08.303104 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3e762-6ce4-477e-a8ac-14f6014fea77 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles/c3a0d7adec184c40a8e2c2fb45815470/implies/8a6f1c75c55045c9a3332350b00ed5e8` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:08.305808 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d3e762-6ce4-477e-a8ac-14f6014fea77 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=c3a0d7adec184c40a8e2c2fb45815470, implied_role_id=8a6f1c75c55045c9a3332350b00ed5e8)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:08.306196 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d3e762-6ce4-477e-a8ac-14f6014fea77 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:08.397398 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1998/3996] 10.222.0.23 () {60 vars in 1362 bytes} [Sat Apr 30 21:23:08 2022] PUT /identity/v3/roles/c3a0d7adec184c40a8e2c2fb45815470/implies/8a6f1c75c55045c9a3332350b00ed5e8 => generated 520 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:23:08.402649 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c400077-348a-4ed0-93c7-80594a3c26a7 service swift] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:08.415935 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c400077-348a-4ed0-93c7-80594a3c26a7 service swift] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:08.570673 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80798fe4-c556-4c41-858a-5a3bbeb8e053 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:08.571612 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80798fe4-c556-4c41-858a-5a3bbeb8e053 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:08.571897 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80798fe4-c556-4c41-858a-5a3bbeb8e053 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:08.572218 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80798fe4-c556-4c41-858a-5a3bbeb8e053 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles/8a6f1c75c55045c9a3332350b00ed5e8/implies/fd1d84a4d5cf43d0ad5b9e8105002b72` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:08.576950 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80798fe4-c556-4c41-858a-5a3bbeb8e053 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=8a6f1c75c55045c9a3332350b00ed5e8, implied_role_id=fd1d84a4d5cf43d0ad5b9e8105002b72)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:08.578839 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80798fe4-c556-4c41-858a-5a3bbeb8e053 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:08.680176 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 1999/3997] 10.222.0.23 () {60 vars in 1362 bytes} [Sat Apr 30 21:23:08 2022] PUT /identity/v3/roles/8a6f1c75c55045c9a3332350b00ed5e8/implies/fd1d84a4d5cf43d0ad5b9e8105002b72 => generated 519 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:23:08.682117 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3e762-6ce4-477e-a8ac-14f6014fea77 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:08.692750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3e762-6ce4-477e-a8ac-14f6014fea77 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:08.752644 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11ef2a-9467-41d9-87ac-09a518cea186 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:08.753506 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11ef2a-9467-41d9-87ac-09a518cea186 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:08.753811 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11ef2a-9467-41d9-87ac-09a518cea186 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:08.754093 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11ef2a-9467-41d9-87ac-09a518cea186 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles/8a6f1c75c55045c9a3332350b00ed5e8/implies` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:08.755257 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af11ef2a-9467-41d9-87ac-09a518cea186 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=8a6f1c75c55045c9a3332350b00ed5e8)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:08.756318 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-af11ef2a-9467-41d9-87ac-09a518cea186 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:23:08.756318 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:23:08.756318 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:23:08.757207 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af11ef2a-9467-41d9-87ac-09a518cea186 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:08.764607 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 1999/3998] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Apr 30 21:23:08 2022] GET /identity/v3/roles/8a6f1c75c55045c9a3332350b00ed5e8/implies => generated 488 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:23:08.768708 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80798fe4-c556-4c41-858a-5a3bbeb8e053 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:08.778951 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80798fe4-c556-4c41-858a-5a3bbeb8e053 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:08.783548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ef9dd-b112-4546-8fed-149161115dae tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:08.784392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ef9dd-b112-4546-8fed-149161115dae tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:08.784676 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ef9dd-b112-4546-8fed-149161115dae tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:08.784957 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ef9dd-b112-4546-8fed-149161115dae tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles/c3a0d7adec184c40a8e2c2fb45815470/implies` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:08.786155 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5ef9dd-b112-4546-8fed-149161115dae tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=c3a0d7adec184c40a8e2c2fb45815470)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:08.787712 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-cc5ef9dd-b112-4546-8fed-149161115dae tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:23:08.787712 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:23:08.787712 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:23:08.788724 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5ef9dd-b112-4546-8fed-149161115dae tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:08.797307 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2000/3999] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Apr 30 21:23:08 2022] GET /identity/v3/roles/c3a0d7adec184c40a8e2c2fb45815470/implies => generated 660 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:23:08.801746 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11ef2a-9467-41d9-87ac-09a518cea186 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:08.812280 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11ef2a-9467-41d9-87ac-09a518cea186 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:08.816905 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4833c5c-721f-440d-ac3c-b63b92ddfad4 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:08.817842 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4833c5c-721f-440d-ac3c-b63b92ddfad4 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:08.818125 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4833c5c-721f-440d-ac3c-b63b92ddfad4 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:08.818401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4833c5c-721f-440d-ac3c-b63b92ddfad4 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles/8a6f1c75c55045c9a3332350b00ed5e8/implies/fd1d84a4d5cf43d0ad5b9e8105002b72` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:08.820260 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4833c5c-721f-440d-ac3c-b63b92ddfad4 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=8a6f1c75c55045c9a3332350b00ed5e8, implied_role_id=fd1d84a4d5cf43d0ad5b9e8105002b72)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:08.822013 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4833c5c-721f-440d-ac3c-b63b92ddfad4 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:08.882969 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2000/4000] 10.222.0.23 () {58 vars in 1346 bytes} [Sat Apr 30 21:23:08 2022] DELETE /identity/v3/roles/8a6f1c75c55045c9a3332350b00ed5e8/implies/fd1d84a4d5cf43d0ad5b9e8105002b72 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:08.887200 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ef9dd-b112-4546-8fed-149161115dae tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:08.897964 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ef9dd-b112-4546-8fed-149161115dae tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:08.959896 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ba693-143d-4edb-8467-5d34930523ab tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:08.960952 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ba693-143d-4edb-8467-5d34930523ab tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:08.961308 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ba693-143d-4edb-8467-5d34930523ab tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:08.961661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ba693-143d-4edb-8467-5d34930523ab tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles/c3a0d7adec184c40a8e2c2fb45815470/implies/8a6f1c75c55045c9a3332350b00ed5e8` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:08.963614 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ba693-143d-4edb-8467-5d34930523ab tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c3a0d7adec184c40a8e2c2fb45815470, implied_role_id=8a6f1c75c55045c9a3332350b00ed5e8)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:08.965329 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ba693-143d-4edb-8467-5d34930523ab tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:09.048744 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2001/4001] 10.222.0.23 () {58 vars in 1346 bytes} [Sat Apr 30 21:23:08 2022] DELETE /identity/v3/roles/c3a0d7adec184c40a8e2c2fb45815470/implies/8a6f1c75c55045c9a3332350b00ed5e8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:09.053240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4833c5c-721f-440d-ac3c-b63b92ddfad4 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:09.064982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4833c5c-721f-440d-ac3c-b63b92ddfad4 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:09.129273 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0834d1-3320-4169-b933-2fa24d66fb0a tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:09.130213 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0834d1-3320-4169-b933-2fa24d66fb0a tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:09.130492 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0834d1-3320-4169-b933-2fa24d66fb0a tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:09.130784 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0834d1-3320-4169-b933-2fa24d66fb0a tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles/c3a0d7adec184c40a8e2c2fb45815470/implies/f0a33113c26b4e14a89f5eb9b6675e9a` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:09.132433 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0834d1-3320-4169-b933-2fa24d66fb0a tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=c3a0d7adec184c40a8e2c2fb45815470, implied_role_id=f0a33113c26b4e14a89f5eb9b6675e9a)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:09.134103 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0834d1-3320-4169-b933-2fa24d66fb0a tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:09.191096 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2001/4002] 10.222.0.23 () {58 vars in 1346 bytes} [Sat Apr 30 21:23:09 2022] DELETE /identity/v3/roles/c3a0d7adec184c40a8e2c2fb45815470/implies/f0a33113c26b4e14a89f5eb9b6675e9a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:09.201043 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ba693-143d-4edb-8467-5d34930523ab tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:09.212248 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ba693-143d-4edb-8467-5d34930523ab tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:09.268076 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087d584-d4d8-4f34-9b0a-c7cfc45a47d2 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:09.269038 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087d584-d4d8-4f34-9b0a-c7cfc45a47d2 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:09.269326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087d584-d4d8-4f34-9b0a-c7cfc45a47d2 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:09.269602 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087d584-d4d8-4f34-9b0a-c7cfc45a47d2 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/domains/f6c69eb9fefb44bb893ec75f5b0fd9bb` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:09.279541 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d087d584-d4d8-4f34-9b0a-c7cfc45a47d2 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 21:23:09.293801 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-d087d584-d4d8-4f34-9b0a-c7cfc45a47d2 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Could not find domain: f6c69eb9fefb44bb893ec75f5b0fd9bb.: keystone.exception.DomainNotFound: Could not find domain: f6c69eb9fefb44bb893ec75f5b0fd9bb. Apr 30 21:23:09.293801 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:23:09.293801 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Apr 30 21:23:09.293801 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Apr 30 21:23:09.293801 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 21:23:09.293801 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 21:23:09.293801 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 21:23:09.293801 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 21:23:09.293801 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f6c69eb9fefb44bb893ec75f5b0fd9bb. Apr 30 21:23:09.293801 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:23:09.293801 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 21:23:09.293801 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:23:09.293801 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:23:09.293801 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:23:09.293801 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:23:09.293801 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:23:09.294983 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:23:09.294983 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:23:09.294983 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:23:09.294983 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:23:09.294983 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:23:09.294983 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:23:09.294983 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:23:09.294983 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Apr 30 21:23:09.294983 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Apr 30 21:23:09.294983 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 21:23:09.294983 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 21:23:09.294983 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 21:23:09.294983 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 21:23:09.294983 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:23:09.294983 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:23:09.294983 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 21:23:09.296079 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 21:23:09.296079 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 21:23:09.296079 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 21:23:09.296079 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 21:23:09.296079 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 21:23:09.296079 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 21:23:09.296079 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 21:23:09.296079 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 21:23:09.296079 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 21:23:09.296079 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 21:23:09.296079 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 21:23:09.296079 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 21:23:09.296079 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 21:23:09.296079 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Apr 30 21:23:09.296079 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 21:23:09.296079 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f6c69eb9fefb44bb893ec75f5b0fd9bb. Apr 30 21:23:09.296079 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:23:09.297252 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2002/4003] 10.222.0.23 () {60 vars in 1248 bytes} [Sat Apr 30 21:23:09 2022] PATCH /identity/v3/domains/f6c69eb9fefb44bb893ec75f5b0fd9bb => generated 112 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 30 21:23:09.299355 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0834d1-3320-4169-b933-2fa24d66fb0a tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:09.310005 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0834d1-3320-4169-b933-2fa24d66fb0a tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:09.314644 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea844e-b4f9-477c-9d10-460ea2188c0c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:09.315496 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea844e-b4f9-477c-9d10-460ea2188c0c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:09.315782 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea844e-b4f9-477c-9d10-460ea2188c0c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:09.316069 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea844e-b4f9-477c-9d10-460ea2188c0c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/users/534c8a3a013541b6bad345521a264b5b` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:09.317253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea844e-b4f9-477c-9d10-460ea2188c0c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:delete_user(user_id=534c8a3a013541b6bad345521a264b5b)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:09.319700 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea844e-b4f9-477c-9d10-460ea2188c0c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:09.421042 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-53ea844e-b4f9-477c-9d10-460ea2188c0c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '534c8a3a013541b6bad345521a264b5b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:09.436436 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-53ea844e-b4f9-477c-9d10-460ea2188c0c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '534c8a3a013541b6bad345521a264b5b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:09.499676 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-53ea844e-b4f9-477c-9d10-460ea2188c0c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '534c8a3a013541b6bad345521a264b5b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:09.510229 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-53ea844e-b4f9-477c-9d10-460ea2188c0c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '534c8a3a013541b6bad345521a264b5b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:09.511601 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-53ea844e-b4f9-477c-9d10-460ea2188c0c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '534c8a3a013541b6bad345521a264b5b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:09.527540 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2002/4004] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:23:09 2022] DELETE /identity/v3/users/534c8a3a013541b6bad345521a264b5b => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:09.529251 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087d584-d4d8-4f34-9b0a-c7cfc45a47d2 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:09.531836 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d087d584-d4d8-4f34-9b0a-c7cfc45a47d2 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:09.561015 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087d584-d4d8-4f34-9b0a-c7cfc45a47d2 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:09.675604 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8484c-1142-402f-91e4-84ab59d0b5ba tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:09.676512 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8484c-1142-402f-91e4-84ab59d0b5ba tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:09.676949 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8484c-1142-402f-91e4-84ab59d0b5ba tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:09.678156 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8484c-1142-402f-91e4-84ab59d0b5ba tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles/fd1d84a4d5cf43d0ad5b9e8105002b72` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:09.680163 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8484c-1142-402f-91e4-84ab59d0b5ba tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:delete_role(role_id=fd1d84a4d5cf43d0ad5b9e8105002b72)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:09.681199 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-b2e8484c-1142-402f-91e4-84ab59d0b5ba tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:23:09.681199 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:23:09.681199 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:23:09.683045 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e8484c-1142-402f-91e4-84ab59d0b5ba tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:09.847713 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b2e8484c-1142-402f-91e4-84ab59d0b5ba tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invalidating the token cache because role fd1d84a4d5cf43d0ad5b9e8105002b72 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:23:09.848103 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b2e8484c-1142-402f-91e4-84ab59d0b5ba tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:09.848968 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b2e8484c-1142-402f-91e4-84ab59d0b5ba tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:09.864645 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2003/4005] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:23:09 2022] DELETE /identity/v3/roles/fd1d84a4d5cf43d0ad5b9e8105002b72 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:09.871230 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea844e-b4f9-477c-9d10-460ea2188c0c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:09.883937 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea844e-b4f9-477c-9d10-460ea2188c0c tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:09.954247 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a5119-4904-4e3f-b579-73732bca3b4d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:09.955612 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a5119-4904-4e3f-b579-73732bca3b4d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:09.956177 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a5119-4904-4e3f-b579-73732bca3b4d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:09.956725 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a5119-4904-4e3f-b579-73732bca3b4d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/groups/03ec303e7ea8468f91971c914b24922f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:09.960194 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a5119-4904-4e3f-b579-73732bca3b4d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:delete_group(group_id=03ec303e7ea8468f91971c914b24922f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:09.963942 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a5119-4904-4e3f-b579-73732bca3b4d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:10.101436 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2003/4006] 10.222.0.23 () {58 vars in 1226 bytes} [Sat Apr 30 21:23:09 2022] DELETE /identity/v3/groups/03ec303e7ea8468f91971c914b24922f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:10.110340 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8484c-1142-402f-91e4-84ab59d0b5ba tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:10.110340 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b2e8484c-1142-402f-91e4-84ab59d0b5ba tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:10.123767 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e8484c-1142-402f-91e4-84ab59d0b5ba tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:10.206304 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2205384-ffcd-4439-9a76-1ff0bfd6bfb1 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:10.210114 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2205384-ffcd-4439-9a76-1ff0bfd6bfb1 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:10.210415 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2205384-ffcd-4439-9a76-1ff0bfd6bfb1 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:10.210706 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2205384-ffcd-4439-9a76-1ff0bfd6bfb1 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/projects/6e5fd78edd3748d188fbac1b0048cf11` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:10.212557 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2205384-ffcd-4439-9a76-1ff0bfd6bfb1 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6e5fd78edd3748d188fbac1b0048cf11)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:10.214890 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2205384-ffcd-4439-9a76-1ff0bfd6bfb1 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:10.405380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f2205384-ffcd-4439-9a76-1ff0bfd6bfb1 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e5fd78edd3748d188fbac1b0048cf11', 'request_id': 'req-f2205384-ffcd-4439-9a76-1ff0bfd6bfb1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:10.417550 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f2205384-ffcd-4439-9a76-1ff0bfd6bfb1 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e5fd78edd3748d188fbac1b0048cf11', 'request_id': 'req-f2205384-ffcd-4439-9a76-1ff0bfd6bfb1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:10.425127 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f2205384-ffcd-4439-9a76-1ff0bfd6bfb1 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e5fd78edd3748d188fbac1b0048cf11', 'request_id': 'req-f2205384-ffcd-4439-9a76-1ff0bfd6bfb1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:10.528736 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f2205384-ffcd-4439-9a76-1ff0bfd6bfb1 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] The token cache is being invalidate because project 6e5fd78edd3748d188fbac1b0048cf11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:23:10.529012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f2205384-ffcd-4439-9a76-1ff0bfd6bfb1 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:10.529666 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f2205384-ffcd-4439-9a76-1ff0bfd6bfb1 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:10.531255 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2004/4007] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:23:10 2022] DELETE /identity/v3/projects/6e5fd78edd3748d188fbac1b0048cf11 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:23:10.535372 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a5119-4904-4e3f-b579-73732bca3b4d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:10.539438 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f86a5119-4904-4e3f-b579-73732bca3b4d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:10.554334 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a5119-4904-4e3f-b579-73732bca3b4d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:10.656154 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2106f9-875c-47c7-97e9-a0fdafb8a79f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:10.657162 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2106f9-875c-47c7-97e9-a0fdafb8a79f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:10.657530 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2106f9-875c-47c7-97e9-a0fdafb8a79f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:10.657932 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2106f9-875c-47c7-97e9-a0fdafb8a79f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/domains/0f8be929734d4e469e272ad5df22aa33` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:10.659465 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2106f9-875c-47c7-97e9-a0fdafb8a79f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0f8be929734d4e469e272ad5df22aa33)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:10.661186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2106f9-875c-47c7-97e9-a0fdafb8a79f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:10.706819 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1e2106f9-875c-47c7-97e9-a0fdafb8a79f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0f8be929734d4e469e272ad5df22aa33'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:10.708188 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1e2106f9-875c-47c7-97e9-a0fdafb8a79f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0f8be929734d4e469e272ad5df22aa33'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:10.789332 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1e2106f9-875c-47c7-97e9-a0fdafb8a79f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0f8be929734d4e469e272ad5df22aa33'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:10.789999 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1e2106f9-875c-47c7-97e9-a0fdafb8a79f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0f8be929734d4e469e272ad5df22aa33'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:10.793790 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2004/4008] 10.222.0.23 () {60 vars in 1248 bytes} [Sat Apr 30 21:23:10 2022] PATCH /identity/v3/domains/0f8be929734d4e469e272ad5df22aa33 => generated 277 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:23:10.796850 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2205384-ffcd-4439-9a76-1ff0bfd6bfb1 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:10.809682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2205384-ffcd-4439-9a76-1ff0bfd6bfb1 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:10.929125 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88aa4fe-6405-45f7-a254-0c8cbb4903cf tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:10.929961 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88aa4fe-6405-45f7-a254-0c8cbb4903cf tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:10.930254 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88aa4fe-6405-45f7-a254-0c8cbb4903cf tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:10.930526 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88aa4fe-6405-45f7-a254-0c8cbb4903cf tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/domains/0f8be929734d4e469e272ad5df22aa33` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:10.944255 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88aa4fe-6405-45f7-a254-0c8cbb4903cf tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0f8be929734d4e469e272ad5df22aa33)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:10.945962 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88aa4fe-6405-45f7-a254-0c8cbb4903cf tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:10.971712 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d88aa4fe-6405-45f7-a254-0c8cbb4903cf tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0f8be929734d4e469e272ad5df22aa33'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:10.978991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d88aa4fe-6405-45f7-a254-0c8cbb4903cf tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0f8be929734d4e469e272ad5df22aa33'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:11.129670 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d88aa4fe-6405-45f7-a254-0c8cbb4903cf tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f8be929734d4e469e272ad5df22aa33', 'request_id': 'req-d88aa4fe-6405-45f7-a254-0c8cbb4903cf'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:11.138720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d88aa4fe-6405-45f7-a254-0c8cbb4903cf tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f8be929734d4e469e272ad5df22aa33', 'request_id': 'req-d88aa4fe-6405-45f7-a254-0c8cbb4903cf'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:11.148632 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d88aa4fe-6405-45f7-a254-0c8cbb4903cf tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f8be929734d4e469e272ad5df22aa33', 'request_id': 'req-d88aa4fe-6405-45f7-a254-0c8cbb4903cf'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:11.230801 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d88aa4fe-6405-45f7-a254-0c8cbb4903cf tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] The token cache is being invalidate because project 0f8be929734d4e469e272ad5df22aa33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:23:11.231025 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d88aa4fe-6405-45f7-a254-0c8cbb4903cf tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:11.231636 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d88aa4fe-6405-45f7-a254-0c8cbb4903cf tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:11.239814 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d88aa4fe-6405-45f7-a254-0c8cbb4903cf tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0f8be929734d4e469e272ad5df22aa33', 'request_id': 'req-d88aa4fe-6405-45f7-a254-0c8cbb4903cf'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:11.240600 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d88aa4fe-6405-45f7-a254-0c8cbb4903cf tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0f8be929734d4e469e272ad5df22aa33', 'request_id': 'req-d88aa4fe-6405-45f7-a254-0c8cbb4903cf'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:11.241295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d88aa4fe-6405-45f7-a254-0c8cbb4903cf tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0f8be929734d4e469e272ad5df22aa33', 'request_id': 'req-d88aa4fe-6405-45f7-a254-0c8cbb4903cf'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:11.250534 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2005/4009] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:23:10 2022] DELETE /identity/v3/domains/0f8be929734d4e469e272ad5df22aa33 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:11.254506 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2106f9-875c-47c7-97e9-a0fdafb8a79f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:11.255974 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1e2106f9-875c-47c7-97e9-a0fdafb8a79f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:11.268359 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2106f9-875c-47c7-97e9-a0fdafb8a79f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:11.326500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6241656-287a-4c40-9632-d914ddd5352d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:11.327355 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6241656-287a-4c40-9632-d914ddd5352d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:11.327644 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6241656-287a-4c40-9632-d914ddd5352d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:11.327927 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6241656-287a-4c40-9632-d914ddd5352d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles/8a6f1c75c55045c9a3332350b00ed5e8` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:11.329388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6241656-287a-4c40-9632-d914ddd5352d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:delete_role(role_id=8a6f1c75c55045c9a3332350b00ed5e8)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:11.331041 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6241656-287a-4c40-9632-d914ddd5352d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:11.414208 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b6241656-287a-4c40-9632-d914ddd5352d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invalidating the token cache because role 8a6f1c75c55045c9a3332350b00ed5e8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:23:11.417933 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b6241656-287a-4c40-9632-d914ddd5352d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:11.417933 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b6241656-287a-4c40-9632-d914ddd5352d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:11.417933 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2005/4010] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:23:11 2022] DELETE /identity/v3/roles/8a6f1c75c55045c9a3332350b00ed5e8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:11.420995 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88aa4fe-6405-45f7-a254-0c8cbb4903cf tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:11.422432 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d88aa4fe-6405-45f7-a254-0c8cbb4903cf tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:11.436147 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88aa4fe-6405-45f7-a254-0c8cbb4903cf tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:11.527153 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33151eac-18c9-4565-80b5-1593d9300376 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:11.534519 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33151eac-18c9-4565-80b5-1593d9300376 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:11.534989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33151eac-18c9-4565-80b5-1593d9300376 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:11.535156 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33151eac-18c9-4565-80b5-1593d9300376 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles/f0a33113c26b4e14a89f5eb9b6675e9a` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:11.538723 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33151eac-18c9-4565-80b5-1593d9300376 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f0a33113c26b4e14a89f5eb9b6675e9a)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:11.540655 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33151eac-18c9-4565-80b5-1593d9300376 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:11.672491 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-33151eac-18c9-4565-80b5-1593d9300376 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invalidating the token cache because role f0a33113c26b4e14a89f5eb9b6675e9a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:23:11.673018 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-33151eac-18c9-4565-80b5-1593d9300376 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:11.674753 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-33151eac-18c9-4565-80b5-1593d9300376 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:11.677916 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2006/4011] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:23:11 2022] DELETE /identity/v3/roles/f0a33113c26b4e14a89f5eb9b6675e9a => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:11.681640 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6241656-287a-4c40-9632-d914ddd5352d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:11.684268 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b6241656-287a-4c40-9632-d914ddd5352d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:11.697682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6241656-287a-4c40-9632-d914ddd5352d tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:11.782616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f91d8-7ca0-4f1d-9e54-80f1fb1bd52f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5b34df34514a67867954cdb285e325', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:11.784640 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f91d8-7ca0-4f1d-9e54-80f1fb1bd52f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:11.785212 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f91d8-7ca0-4f1d-9e54-80f1fb1bd52f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:11.785744 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f91d8-7ca0-4f1d-9e54-80f1fb1bd52f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] PATH_INFO: `/v3/roles/c3a0d7adec184c40a8e2c2fb45815470` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:11.788738 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f91d8-7ca0-4f1d-9e54-80f1fb1bd52f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c3a0d7adec184c40a8e2c2fb45815470)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:11.790858 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f91d8-7ca0-4f1d-9e54-80f1fb1bd52f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:11.882239 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d20f91d8-7ca0-4f1d-9e54-80f1fb1bd52f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invalidating the token cache because role c3a0d7adec184c40a8e2c2fb45815470 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:23:11.882531 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d20f91d8-7ca0-4f1d-9e54-80f1fb1bd52f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:11.883196 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d20f91d8-7ca0-4f1d-9e54-80f1fb1bd52f tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:11.888946 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2006/4012] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:23:11 2022] DELETE /identity/v3/roles/c3a0d7adec184c40a8e2c2fb45815470 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:11.889102 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33151eac-18c9-4565-80b5-1593d9300376 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:11.890621 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-33151eac-18c9-4565-80b5-1593d9300376 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:11.978114 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33151eac-18c9-4565-80b5-1593d9300376 tempest-RolesV3TestJSON-438593 tempest-RolesV3TestJSON-438593-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:12.035878 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a398ef0-7d10-46ed-80a7-a214897595bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:12.036725 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a398ef0-7d10-46ed-80a7-a214897595bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:12.037005 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a398ef0-7d10-46ed-80a7-a214897595bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:12.037279 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a398ef0-7d10-46ed-80a7-a214897595bb admin admin] PATH_INFO: `/v3/users/aeab0894645340edb86e6f6eae501cad` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:12.038647 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a398ef0-7d10-46ed-80a7-a214897595bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=aeab0894645340edb86e6f6eae501cad)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:12.040536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a398ef0-7d10-46ed-80a7-a214897595bb admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:12.368094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2a398ef0-7d10-46ed-80a7-a214897595bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aeab0894645340edb86e6f6eae501cad'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:12.383741 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2a398ef0-7d10-46ed-80a7-a214897595bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aeab0894645340edb86e6f6eae501cad'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:12.431140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2a398ef0-7d10-46ed-80a7-a214897595bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aeab0894645340edb86e6f6eae501cad'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:12.432089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2a398ef0-7d10-46ed-80a7-a214897595bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aeab0894645340edb86e6f6eae501cad'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:12.440406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2a398ef0-7d10-46ed-80a7-a214897595bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aeab0894645340edb86e6f6eae501cad'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:12.452869 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2007/4013] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:23:11 2022] DELETE /identity/v3/users/aeab0894645340edb86e6f6eae501cad => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:12.456389 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb297a-5218-4c68-882f-0cdb92ecd389 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:12.456682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb297a-5218-4c68-882f-0cdb92ecd389 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:12.456975 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb297a-5218-4c68-882f-0cdb92ecd389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:12.499887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-a7eb297a-5218-4c68-882f-0cdb92ecd389 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:12.501379 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a7eb297a-5218-4c68-882f-0cdb92ecd389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:12.581890 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2007/4014] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:23:12.592196 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a398ef0-7d10-46ed-80a7-a214897595bb admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:12.593685 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2a398ef0-7d10-46ed-80a7-a214897595bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:12.656804 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a398ef0-7d10-46ed-80a7-a214897595bb admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:12.660983 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19526188-ecdc-4f5c-bd57-1613526a0562 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:12.662463 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19526188-ecdc-4f5c-bd57-1613526a0562 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:12.662848 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19526188-ecdc-4f5c-bd57-1613526a0562 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:12.663191 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19526188-ecdc-4f5c-bd57-1613526a0562 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:12.675980 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19526188-ecdc-4f5c-bd57-1613526a0562 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:12.677503 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19526188-ecdc-4f5c-bd57-1613526a0562 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:12.688717 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2008/4015] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:23:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:23:13.211430 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb297a-5218-4c68-882f-0cdb92ecd389 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:13.213061 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a7eb297a-5218-4c68-882f-0cdb92ecd389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:13.241362 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb297a-5218-4c68-882f-0cdb92ecd389 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:13.246508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adacbfc-5d5f-4ede-8886-89b178cc8086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:13.247355 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adacbfc-5d5f-4ede-8886-89b178cc8086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:13.247637 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adacbfc-5d5f-4ede-8886-89b178cc8086 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:13.259374 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adacbfc-5d5f-4ede-8886-89b178cc8086 admin admin] PATH_INFO: `/v3/projects/95dcf9a748f74f429c0ba59c06b9a11f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:13.259374 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adacbfc-5d5f-4ede-8886-89b178cc8086 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95dcf9a748f74f429c0ba59c06b9a11f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:13.259374 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adacbfc-5d5f-4ede-8886-89b178cc8086 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:13.414639 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4adacbfc-5d5f-4ede-8886-89b178cc8086 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95dcf9a748f74f429c0ba59c06b9a11f', 'request_id': 'req-4adacbfc-5d5f-4ede-8886-89b178cc8086'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:13.420652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4adacbfc-5d5f-4ede-8886-89b178cc8086 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95dcf9a748f74f429c0ba59c06b9a11f', 'request_id': 'req-4adacbfc-5d5f-4ede-8886-89b178cc8086'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:13.427551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4adacbfc-5d5f-4ede-8886-89b178cc8086 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95dcf9a748f74f429c0ba59c06b9a11f', 'request_id': 'req-4adacbfc-5d5f-4ede-8886-89b178cc8086'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:13.483190 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4adacbfc-5d5f-4ede-8886-89b178cc8086 admin admin] The token cache is being invalidate because project 95dcf9a748f74f429c0ba59c06b9a11f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:23:13.483688 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4adacbfc-5d5f-4ede-8886-89b178cc8086 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:13.484372 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4adacbfc-5d5f-4ede-8886-89b178cc8086 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:13.486204 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2008/4016] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:23:13 2022] DELETE /identity/v3/projects/95dcf9a748f74f429c0ba59c06b9a11f => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:23:13.490181 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19526188-ecdc-4f5c-bd57-1613526a0562 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:13.512962 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19526188-ecdc-4f5c-bd57-1613526a0562 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:13.578774 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ec3a7-8fbc-49f9-a905-2ddbcb90854b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:13.582424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ec3a7-8fbc-49f9-a905-2ddbcb90854b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:13.582424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ec3a7-8fbc-49f9-a905-2ddbcb90854b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:13.582424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ec3a7-8fbc-49f9-a905-2ddbcb90854b admin admin] PATH_INFO: `/v3/users/4b5b34df34514a67867954cdb285e325` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:13.582424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9ec3a7-8fbc-49f9-a905-2ddbcb90854b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b5b34df34514a67867954cdb285e325)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:13.584856 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9ec3a7-8fbc-49f9-a905-2ddbcb90854b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:13.622940 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a33e65-2604-4b46-b9f4-a9fb587d5f9a None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:13.623191 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a33e65-2604-4b46-b9f4-a9fb587d5f9a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:13.623496 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a33e65-2604-4b46-b9f4-a9fb587d5f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:13.658649 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-d8a33e65-2604-4b46-b9f4-a9fb587d5f9a None None] MFA Rules not processed for user `a42c6a51b78b408f85cbacb545f06707`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:13.659899 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d8a33e65-2604-4b46-b9f4-a9fb587d5f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:13.768608 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2009/4017] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:23:13.842678 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ef9ec3a7-8fbc-49f9-a905-2ddbcb90854b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b5b34df34514a67867954cdb285e325'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:13.878058 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ef9ec3a7-8fbc-49f9-a905-2ddbcb90854b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b5b34df34514a67867954cdb285e325'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:13.973452 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ef9ec3a7-8fbc-49f9-a905-2ddbcb90854b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b5b34df34514a67867954cdb285e325'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:13.974414 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ef9ec3a7-8fbc-49f9-a905-2ddbcb90854b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b5b34df34514a67867954cdb285e325'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:13.983516 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ef9ec3a7-8fbc-49f9-a905-2ddbcb90854b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b5b34df34514a67867954cdb285e325'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:13.990966 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2009/4018] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:23:13 2022] DELETE /identity/v3/users/4b5b34df34514a67867954cdb285e325 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:23:15.022312 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a33e65-2604-4b46-b9f4-a9fb587d5f9a None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:15.023749 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d8a33e65-2604-4b46-b9f4-a9fb587d5f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:15.059528 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a33e65-2604-4b46-b9f4-a9fb587d5f9a None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:15.168951 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da0955-4321-4761-8fd1-0401c9f98b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:15.169186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da0955-4321-4761-8fd1-0401c9f98b56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:15.169310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da0955-4321-4761-8fd1-0401c9f98b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:15.169744 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da0955-4321-4761-8fd1-0401c9f98b56 admin admin] PATH_INFO: `/v3/projects/474d2e5f1bfd475fa1bbf3ecebe6db98` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:15.170916 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da0955-4321-4761-8fd1-0401c9f98b56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=474d2e5f1bfd475fa1bbf3ecebe6db98)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:15.172861 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da0955-4321-4761-8fd1-0401c9f98b56 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:15.307337 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-44da0955-4321-4761-8fd1-0401c9f98b56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'request_id': 'req-44da0955-4321-4761-8fd1-0401c9f98b56'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:15.316867 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-44da0955-4321-4761-8fd1-0401c9f98b56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'request_id': 'req-44da0955-4321-4761-8fd1-0401c9f98b56'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:15.334027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-44da0955-4321-4761-8fd1-0401c9f98b56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '474d2e5f1bfd475fa1bbf3ecebe6db98', 'request_id': 'req-44da0955-4321-4761-8fd1-0401c9f98b56'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:15.436483 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-44da0955-4321-4761-8fd1-0401c9f98b56 admin admin] The token cache is being invalidate because project 474d2e5f1bfd475fa1bbf3ecebe6db98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:23:15.436786 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-44da0955-4321-4761-8fd1-0401c9f98b56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:15.438351 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-44da0955-4321-4761-8fd1-0401c9f98b56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:15.445480 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2010/4019] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:23:15 2022] DELETE /identity/v3/projects/474d2e5f1bfd475fa1bbf3ecebe6db98 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:23:15.448256 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdf0cf-5873-4c43-a5fb-05d045c593af None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:15.448749 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdf0cf-5873-4c43-a5fb-05d045c593af None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:15.448892 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdf0cf-5873-4c43-a5fb-05d045c593af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:15.478844 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-40fdf0cf-5873-4c43-a5fb-05d045c593af None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:15.480095 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-40fdf0cf-5873-4c43-a5fb-05d045c593af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:15.599870 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2010/4020] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:23:15.606308 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b70544-c040-4e22-a2c9-e0516bb0af95 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:15.606598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b70544-c040-4e22-a2c9-e0516bb0af95 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:15.606881 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b70544-c040-4e22-a2c9-e0516bb0af95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:15.651131 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-56b70544-c040-4e22-a2c9-e0516bb0af95 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:15.652471 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-56b70544-c040-4e22-a2c9-e0516bb0af95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:15.679207 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2011/4021] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:23:15.680458 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fdf0cf-5873-4c43-a5fb-05d045c593af None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:15.694856 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fdf0cf-5873-4c43-a5fb-05d045c593af None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:15.720948 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba939b-169f-4930-a878-9c21b3054d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:15.721887 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba939b-169f-4930-a878-9c21b3054d21 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:15.722218 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba939b-169f-4930-a878-9c21b3054d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:15.722509 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba939b-169f-4930-a878-9c21b3054d21 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:15.723199 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba939b-169f-4930-a878-9c21b3054d21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:23:15.735011 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba939b-169f-4930-a878-9c21b3054d21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:15.735011 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba939b-169f-4930-a878-9c21b3054d21 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:15.758518 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2011/4022] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:23:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:23:15.759984 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b70544-c040-4e22-a2c9-e0516bb0af95 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:15.776025 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b70544-c040-4e22-a2c9-e0516bb0af95 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:15.792296 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20badf5d-50c2-45b0-916c-7e8002adc379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:15.793427 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20badf5d-50c2-45b0-916c-7e8002adc379 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:15.794097 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20badf5d-50c2-45b0-916c-7e8002adc379 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:15.794791 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20badf5d-50c2-45b0-916c-7e8002adc379 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:15.795834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20badf5d-50c2-45b0-916c-7e8002adc379 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:15.797989 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20badf5d-50c2-45b0-916c-7e8002adc379 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:15.933295 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2012/4023] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:23:15 2022] POST /identity/v3/projects => generated 369 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:23:15.937717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba939b-169f-4930-a878-9c21b3054d21 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:15.961050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba939b-169f-4930-a878-9c21b3054d21 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:16.052454 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc4891-848b-46d2-9b94-aba2b81eabf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:16.053225 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc4891-848b-46d2-9b94-aba2b81eabf1 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:16.053589 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc4891-848b-46d2-9b94-aba2b81eabf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:16.054005 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc4891-848b-46d2-9b94-aba2b81eabf1 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:16.054853 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc4891-848b-46d2-9b94-aba2b81eabf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:16.056881 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc4891-848b-46d2-9b94-aba2b81eabf1 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:16.290420 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2012/4024] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:23:15 2022] POST /identity/v3/users => generated 285 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:23:16.294323 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20badf5d-50c2-45b0-916c-7e8002adc379 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:16.310969 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20badf5d-50c2-45b0-916c-7e8002adc379 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:16.315778 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feffd893-ab0e-47df-a3f1-90ee580ed5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:16.316590 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffd893-ab0e-47df-a3f1-90ee580ed5cf admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:16.316952 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffd893-ab0e-47df-a3f1-90ee580ed5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:16.317299 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffd893-ab0e-47df-a3f1-90ee580ed5cf admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:16.318380 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feffd893-ab0e-47df-a3f1-90ee580ed5cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:16.320099 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feffd893-ab0e-47df-a3f1-90ee580ed5cf admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:16.335605 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2013/4025] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:23:16.336964 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc4891-848b-46d2-9b94-aba2b81eabf1 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:16.349565 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc4891-848b-46d2-9b94-aba2b81eabf1 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:16.358278 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54dd119-2cd9-4355-99fc-02dac5015779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:16.358968 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54dd119-2cd9-4355-99fc-02dac5015779 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:16.359257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54dd119-2cd9-4355-99fc-02dac5015779 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:16.359558 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54dd119-2cd9-4355-99fc-02dac5015779 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:16.360272 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54dd119-2cd9-4355-99fc-02dac5015779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:16.363582 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54dd119-2cd9-4355-99fc-02dac5015779 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:16.374103 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2013/4026] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:23:16.378410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feffd893-ab0e-47df-a3f1-90ee580ed5cf admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:16.388916 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feffd893-ab0e-47df-a3f1-90ee580ed5cf admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:16.395414 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e2dc1-d48b-45f2-9ee9-0bfa3d9b477d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:16.402180 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e2dc1-d48b-45f2-9ee9-0bfa3d9b477d admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:16.402180 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e2dc1-d48b-45f2-9ee9-0bfa3d9b477d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:16.402180 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e2dc1-d48b-45f2-9ee9-0bfa3d9b477d admin admin] PATH_INFO: `/v3/projects/2d1dae6fd1a0408b9a6c6f4d103d624b/users/a4597b3afb7740fabed076b6d921e249/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:16.421486 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e2dc1-d48b-45f2-9ee9-0bfa3d9b477d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d1dae6fd1a0408b9a6c6f4d103d624b, user_id=a4597b3afb7740fabed076b6d921e249, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:16.425052 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e2dc1-d48b-45f2-9ee9-0bfa3d9b477d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:16.919750 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2014/4027] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:23:16 2022] PUT /identity/v3/projects/2d1dae6fd1a0408b9a6c6f4d103d624b/users/a4597b3afb7740fabed076b6d921e249/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:16.931726 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66852c7b-9280-4658-9487-5857ccfd1ff5 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:16.932312 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66852c7b-9280-4658-9487-5857ccfd1ff5 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:16.932312 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66852c7b-9280-4658-9487-5857ccfd1ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:16.960475 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-66852c7b-9280-4658-9487-5857ccfd1ff5 None None] MFA Rules not processed for user `a4597b3afb7740fabed076b6d921e249`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:16.974524 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-66852c7b-9280-4658-9487-5857ccfd1ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:17.040917 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2014/4028] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:16 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:23:17.041695 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e2dc1-d48b-45f2-9ee9-0bfa3d9b477d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:17.155560 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e2dc1-d48b-45f2-9ee9-0bfa3d9b477d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:17.181883 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f626a-437e-49ac-9ec2-ddab26bcc898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:17.181883 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f626a-437e-49ac-9ec2-ddab26bcc898 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:17.181883 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f626a-437e-49ac-9ec2-ddab26bcc898 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:17.181883 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f626a-437e-49ac-9ec2-ddab26bcc898 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:17.216041 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723f626a-437e-49ac-9ec2-ddab26bcc898 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:17.216041 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723f626a-437e-49ac-9ec2-ddab26bcc898 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:17.530450 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2015/4029] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:23:17 2022] POST /identity/v3/projects => generated 369 bytes in 489 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:23:17.534481 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66852c7b-9280-4658-9487-5857ccfd1ff5 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:17.545892 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66852c7b-9280-4658-9487-5857ccfd1ff5 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:17.603776 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610d7af-dc2d-4c62-8876-e1882fc2c082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:17.604481 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610d7af-dc2d-4c62-8876-e1882fc2c082 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:17.604764 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610d7af-dc2d-4c62-8876-e1882fc2c082 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:17.605043 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610d7af-dc2d-4c62-8876-e1882fc2c082 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:17.605737 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610d7af-dc2d-4c62-8876-e1882fc2c082 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:17.607716 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610d7af-dc2d-4c62-8876-e1882fc2c082 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:17.740952 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2015/4030] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:23:17 2022] POST /identity/v3/users => generated 291 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:23:17.744919 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f626a-437e-49ac-9ec2-ddab26bcc898 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:17.756571 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f626a-437e-49ac-9ec2-ddab26bcc898 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:17.766297 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abddc1ae-98b6-42e7-a512-c47a6c750089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:17.766297 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abddc1ae-98b6-42e7-a512-c47a6c750089 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:17.766297 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abddc1ae-98b6-42e7-a512-c47a6c750089 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:17.766297 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abddc1ae-98b6-42e7-a512-c47a6c750089 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:17.767414 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abddc1ae-98b6-42e7-a512-c47a6c750089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:17.767414 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abddc1ae-98b6-42e7-a512-c47a6c750089 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:17.782602 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2016/4031] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:23:17.804352 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610d7af-dc2d-4c62-8876-e1882fc2c082 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:17.817729 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610d7af-dc2d-4c62-8876-e1882fc2c082 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:17.834227 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4816d-51b4-42b9-b88a-66b12c1b0c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:17.836073 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4816d-51b4-42b9-b88a-66b12c1b0c93 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:17.836362 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4816d-51b4-42b9-b88a-66b12c1b0c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:17.836645 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4816d-51b4-42b9-b88a-66b12c1b0c93 admin admin] PATH_INFO: `/v3/projects/fe2c164a565b426c95704ca3585696b7/users/8d84b9eca5954e11b8193170b2d4a17a/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:17.870487 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4816d-51b4-42b9-b88a-66b12c1b0c93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe2c164a565b426c95704ca3585696b7, user_id=8d84b9eca5954e11b8193170b2d4a17a, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:17.873541 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4816d-51b4-42b9-b88a-66b12c1b0c93 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:18.039494 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2016/4032] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:23:17 2022] PUT /identity/v3/projects/fe2c164a565b426c95704ca3585696b7/users/8d84b9eca5954e11b8193170b2d4a17a/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:23:18.043566 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abddc1ae-98b6-42e7-a512-c47a6c750089 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:18.058962 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abddc1ae-98b6-42e7-a512-c47a6c750089 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:18.154889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88771f57-bc1a-40dc-adce-9ede5e575e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:18.155946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88771f57-bc1a-40dc-adce-9ede5e575e81 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:18.166541 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88771f57-bc1a-40dc-adce-9ede5e575e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:18.166541 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88771f57-bc1a-40dc-adce-9ede5e575e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:18.166541 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88771f57-bc1a-40dc-adce-9ede5e575e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:18.166541 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88771f57-bc1a-40dc-adce-9ede5e575e81 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:18.173738 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2017/4033] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:23:18 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:23:18.175240 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4816d-51b4-42b9-b88a-66b12c1b0c93 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:18.186707 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4816d-51b4-42b9-b88a-66b12c1b0c93 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:18.191981 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19814c6-528d-4ba8-af5f-e50722e28bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:18.193785 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19814c6-528d-4ba8-af5f-e50722e28bb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:18.194135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19814c6-528d-4ba8-af5f-e50722e28bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:18.194558 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19814c6-528d-4ba8-af5f-e50722e28bb1 admin admin] PATH_INFO: `/v3/projects/fe2c164a565b426c95704ca3585696b7/users/8d84b9eca5954e11b8193170b2d4a17a/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:18.196604 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19814c6-528d-4ba8-af5f-e50722e28bb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe2c164a565b426c95704ca3585696b7, user_id=8d84b9eca5954e11b8193170b2d4a17a, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:18.199480 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19814c6-528d-4ba8-af5f-e50722e28bb1 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:18.218232 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2017/4034] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:23:18 2022] PUT /identity/v3/projects/fe2c164a565b426c95704ca3585696b7/users/8d84b9eca5954e11b8193170b2d4a17a/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:23:18.229739 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0ade3-881f-46c0-9184-ad619abff1e0 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:18.230115 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0ade3-881f-46c0-9184-ad619abff1e0 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:18.230212 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0ade3-881f-46c0-9184-ad619abff1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:18.309830 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-cfe0ade3-881f-46c0-9184-ad619abff1e0 None None] MFA Rules not processed for user `8d84b9eca5954e11b8193170b2d4a17a`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:18.310995 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-cfe0ade3-881f-46c0-9184-ad619abff1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:18.422989 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2018/4035] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:18 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:23:18.428870 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19814c6-528d-4ba8-af5f-e50722e28bb1 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:18.452908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19814c6-528d-4ba8-af5f-e50722e28bb1 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:18.462595 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e685ed74-f5cc-44d4-a09b-32d375403e6a tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d84b9eca5954e11b8193170b2d4a17a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe2c164a565b426c95704ca3585696b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:18.463417 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685ed74-f5cc-44d4-a09b-32d375403e6a tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:18.464223 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685ed74-f5cc-44d4-a09b-32d375403e6a tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:18.464223 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685ed74-f5cc-44d4-a09b-32d375403e6a tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:18.465318 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e685ed74-f5cc-44d4-a09b-32d375403e6a tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:18.467895 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e685ed74-f5cc-44d4-a09b-32d375403e6a tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:18.630475 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2018/4036] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:23:18 2022] POST /identity/v3/projects => generated 359 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:23:18.635148 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0ade3-881f-46c0-9184-ad619abff1e0 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:18.647035 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0ade3-881f-46c0-9184-ad619abff1e0 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:18.706680 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b8fee-dd2e-4e8b-b00c-160180173e72 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d84b9eca5954e11b8193170b2d4a17a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe2c164a565b426c95704ca3585696b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:18.707374 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b8fee-dd2e-4e8b-b00c-160180173e72 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:18.707662 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b8fee-dd2e-4e8b-b00c-160180173e72 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:18.707942 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b8fee-dd2e-4e8b-b00c-160180173e72 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:18.709232 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b8fee-dd2e-4e8b-b00c-160180173e72 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:18.711331 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b8fee-dd2e-4e8b-b00c-160180173e72 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:18.898574 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2019/4037] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:23:18 2022] POST /identity/v3/users => generated 373 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:23:18.902768 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e685ed74-f5cc-44d4-a09b-32d375403e6a tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:18.914506 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e685ed74-f5cc-44d4-a09b-32d375403e6a tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:18.919188 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4966d7-6f3e-44db-9e71-326a30a22a54 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d84b9eca5954e11b8193170b2d4a17a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe2c164a565b426c95704ca3585696b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:18.919867 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4966d7-6f3e-44db-9e71-326a30a22a54 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:18.920154 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4966d7-6f3e-44db-9e71-326a30a22a54 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:18.920439 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4966d7-6f3e-44db-9e71-326a30a22a54 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:18.921244 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4966d7-6f3e-44db-9e71-326a30a22a54 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:23:18.921546 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4966d7-6f3e-44db-9e71-326a30a22a54 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:18.922817 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-da4966d7-6f3e-44db-9e71-326a30a22a54 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:23:18.922817 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:23:18.922817 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:23:18.924227 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4966d7-6f3e-44db-9e71-326a30a22a54 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:18.956785 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2019/4038] 10.222.0.23 () {58 vars in 1156 bytes} [Sat Apr 30 21:23:18 2022] GET /identity/v3/users?domain_id=default => generated 8322 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:23:18.961988 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b8fee-dd2e-4e8b-b00c-160180173e72 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:18.972355 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b8fee-dd2e-4e8b-b00c-160180173e72 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:18.977334 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54bcc9-c8dd-43bf-89b3-2d40f4427e99 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d84b9eca5954e11b8193170b2d4a17a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe2c164a565b426c95704ca3585696b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:18.978247 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54bcc9-c8dd-43bf-89b3-2d40f4427e99 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:18.978536 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54bcc9-c8dd-43bf-89b3-2d40f4427e99 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:18.978812 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54bcc9-c8dd-43bf-89b3-2d40f4427e99 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] PATH_INFO: `/v3/users/a3d6c7a8d669468cbcbdbb5746da5612` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:18.992887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a54bcc9-c8dd-43bf-89b3-2d40f4427e99 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] RBAC: Authorizing `identity:update_user(user_id=a3d6c7a8d669468cbcbdbb5746da5612)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:18.994119 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-9a54bcc9-c8dd-43bf-89b3-2d40f4427e99 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:23:18.994119 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:23:18.994119 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:23:18.995392 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a54bcc9-c8dd-43bf-89b3-2d40f4427e99 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:19.113587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9a54bcc9-c8dd-43bf-89b3-2d40f4427e99 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'a3d6c7a8d669468cbcbdbb5746da5612'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:19.213266 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9a54bcc9-c8dd-43bf-89b3-2d40f4427e99 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] Invalidating the token cache because user a3d6c7a8d669468cbcbdbb5746da5612 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:23:19.213567 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9a54bcc9-c8dd-43bf-89b3-2d40f4427e99 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:19.214333 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9a54bcc9-c8dd-43bf-89b3-2d40f4427e99 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:19.216852 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2020/4039] 10.222.0.23 () {60 vars in 1243 bytes} [Sat Apr 30 21:23:18 2022] PATCH /identity/v3/users/a3d6c7a8d669468cbcbdbb5746da5612 => generated 488 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:23:19.221465 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96abad9-a136-4aca-b160-166ca25b2bde None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:19.227503 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96abad9-a136-4aca-b160-166ca25b2bde None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:19.227503 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96abad9-a136-4aca-b160-166ca25b2bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:19.236542 ncdv-master-1 devstack@keystone.service[91017]: WARNING keystone.auth.plugins.core [None req-b96abad9-a136-4aca-b160-166ca25b2bde None None] User is disabled: a3d6c7a8d669468cbcbdbb5746da5612: AssertionError: User is disabled: a3d6c7a8d669468cbcbdbb5746da5612 Apr 30 21:23:19.248558 ncdv-master-1 devstack@keystone.service[91017]: WARNING keystone.server.flask.application [None req-b96abad9-a136-4aca-b160-166ca25b2bde None None] Authorization failed. The request you have made requires authentication. from 10.222.0.23: keystone.exception.Unauthorized: The request you have made requires authentication. Apr 30 21:23:19.250618 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2020/4040] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:19 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 30 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Apr 30 21:23:19.255469 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54bcc9-c8dd-43bf-89b3-2d40f4427e99 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:19.257435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9a54bcc9-c8dd-43bf-89b3-2d40f4427e99 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:19.271737 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54bcc9-c8dd-43bf-89b3-2d40f4427e99 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:19.277294 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db524f-4d33-456f-8e06-959262b4c437 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d84b9eca5954e11b8193170b2d4a17a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe2c164a565b426c95704ca3585696b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:19.278293 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db524f-4d33-456f-8e06-959262b4c437 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:19.278748 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db524f-4d33-456f-8e06-959262b4c437 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:19.279750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db524f-4d33-456f-8e06-959262b4c437 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] PATH_INFO: `/v3/users/a3d6c7a8d669468cbcbdbb5746da5612` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:19.295232 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28db524f-4d33-456f-8e06-959262b4c437 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a3d6c7a8d669468cbcbdbb5746da5612)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:19.297190 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28db524f-4d33-456f-8e06-959262b4c437 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:19.415409 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-28db524f-4d33-456f-8e06-959262b4c437 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3d6c7a8d669468cbcbdbb5746da5612'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:19.428052 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-28db524f-4d33-456f-8e06-959262b4c437 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3d6c7a8d669468cbcbdbb5746da5612'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:19.517131 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-28db524f-4d33-456f-8e06-959262b4c437 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3d6c7a8d669468cbcbdbb5746da5612'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:19.526979 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-28db524f-4d33-456f-8e06-959262b4c437 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3d6c7a8d669468cbcbdbb5746da5612'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:19.529034 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-28db524f-4d33-456f-8e06-959262b4c437 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3d6c7a8d669468cbcbdbb5746da5612'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:19.534386 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2021/4041] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:23:19 2022] DELETE /identity/v3/users/a3d6c7a8d669468cbcbdbb5746da5612 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:19.539066 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96abad9-a136-4aca-b160-166ca25b2bde None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:19.540987 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b96abad9-a136-4aca-b160-166ca25b2bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:19.614887 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96abad9-a136-4aca-b160-166ca25b2bde None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:19.624092 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4356484-388b-48cd-ba95-f553145d6b96 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d84b9eca5954e11b8193170b2d4a17a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe2c164a565b426c95704ca3585696b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:19.625309 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4356484-388b-48cd-ba95-f553145d6b96 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:19.625591 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4356484-388b-48cd-ba95-f553145d6b96 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:19.625912 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4356484-388b-48cd-ba95-f553145d6b96 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] PATH_INFO: `/v3/projects/fd8760a4fdd8477ea2d17308c2a33563` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:19.627227 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4356484-388b-48cd-ba95-f553145d6b96 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fd8760a4fdd8477ea2d17308c2a33563)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:19.630017 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4356484-388b-48cd-ba95-f553145d6b96 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:19.738650 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c4356484-388b-48cd-ba95-f553145d6b96 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd8760a4fdd8477ea2d17308c2a33563', 'request_id': 'req-c4356484-388b-48cd-ba95-f553145d6b96'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:19.743946 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c4356484-388b-48cd-ba95-f553145d6b96 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd8760a4fdd8477ea2d17308c2a33563', 'request_id': 'req-c4356484-388b-48cd-ba95-f553145d6b96'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:19.751222 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c4356484-388b-48cd-ba95-f553145d6b96 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd8760a4fdd8477ea2d17308c2a33563', 'request_id': 'req-c4356484-388b-48cd-ba95-f553145d6b96'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:19.838949 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c4356484-388b-48cd-ba95-f553145d6b96 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] The token cache is being invalidate because project fd8760a4fdd8477ea2d17308c2a33563 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:23:19.839337 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c4356484-388b-48cd-ba95-f553145d6b96 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:19.840214 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c4356484-388b-48cd-ba95-f553145d6b96 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:19.841880 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2021/4042] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:23:19 2022] DELETE /identity/v3/projects/fd8760a4fdd8477ea2d17308c2a33563 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:19.855977 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db524f-4d33-456f-8e06-959262b4c437 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:19.857319 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db524f-4d33-456f-8e06-959262b4c437 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:19.914698 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b8f0c-1aa9-4726-bdf2-90211d74dec2 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d84b9eca5954e11b8193170b2d4a17a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe2c164a565b426c95704ca3585696b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:19.915376 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b8f0c-1aa9-4726-bdf2-90211d74dec2 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:19.915658 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b8f0c-1aa9-4726-bdf2-90211d74dec2 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:19.915936 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b8f0c-1aa9-4726-bdf2-90211d74dec2 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:19.916641 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455b8f0c-1aa9-4726-bdf2-90211d74dec2 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:19.918605 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455b8f0c-1aa9-4726-bdf2-90211d74dec2 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:19.931875 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-455b8f0c-1aa9-4726-bdf2-90211d74dec2 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] Could not find domain: d993bab4a14842e4b4d49d7a2877c567.: keystone.exception.DomainNotFound: Could not find domain: d993bab4a14842e4b4d49d7a2877c567. Apr 30 21:23:19.931875 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:23:19.931875 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Apr 30 21:23:19.931875 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Apr 30 21:23:19.931875 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 21:23:19.931875 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 21:23:19.931875 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 21:23:19.931875 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 21:23:19.931875 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: d993bab4a14842e4b4d49d7a2877c567. Apr 30 21:23:19.931875 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:23:19.931875 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 21:23:19.931875 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:23:19.931875 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:23:19.931875 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:23:19.931875 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:23:19.931875 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:23:19.937559 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:23:19.937559 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:23:19.937559 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:23:19.937559 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:23:19.937559 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:23:19.937559 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:23:19.937559 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:23:19.937559 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Apr 30 21:23:19.937559 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Apr 30 21:23:19.937559 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:23:19.937559 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:23:19.937559 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 21:23:19.937559 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 21:23:19.937559 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 21:23:19.937559 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 21:23:19.937559 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Apr 30 21:23:19.937559 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Apr 30 21:23:19.938844 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:23:19.938844 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:23:19.938844 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 21:23:19.938844 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 21:23:19.938844 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 21:23:19.938844 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 21:23:19.938844 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 21:23:19.938844 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 21:23:19.938844 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 21:23:19.938844 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 21:23:19.938844 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 21:23:19.938844 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 21:23:19.938844 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 21:23:19.938844 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 21:23:19.938844 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 21:23:19.938844 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 21:23:19.938844 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Apr 30 21:23:19.940044 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 21:23:19.940044 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: d993bab4a14842e4b4d49d7a2877c567. Apr 30 21:23:19.940044 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:23:19.940044 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2022/4043] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:23:19 2022] POST /identity/v3/users => generated 112 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 30 21:23:19.942028 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4356484-388b-48cd-ba95-f553145d6b96 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:19.944555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c4356484-388b-48cd-ba95-f553145d6b96 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:20.013538 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4356484-388b-48cd-ba95-f553145d6b96 tempest-UsersNegativeTest-588759678 tempest-UsersNegativeTest-588759678-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:20.022423 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e26cdd-da14-453e-a6a0-7c0fb0ddfb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:20.023369 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e26cdd-da14-453e-a6a0-7c0fb0ddfb92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:20.025245 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e26cdd-da14-453e-a6a0-7c0fb0ddfb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:20.025245 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e26cdd-da14-453e-a6a0-7c0fb0ddfb92 admin admin] PATH_INFO: `/v3/users/a4597b3afb7740fabed076b6d921e249` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:20.025444 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e26cdd-da14-453e-a6a0-7c0fb0ddfb92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4597b3afb7740fabed076b6d921e249)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:20.027463 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e26cdd-da14-453e-a6a0-7c0fb0ddfb92 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:20.260343 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e1e26cdd-da14-453e-a6a0-7c0fb0ddfb92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4597b3afb7740fabed076b6d921e249'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:20.282842 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e1e26cdd-da14-453e-a6a0-7c0fb0ddfb92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4597b3afb7740fabed076b6d921e249'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:20.362447 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e1e26cdd-da14-453e-a6a0-7c0fb0ddfb92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4597b3afb7740fabed076b6d921e249'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:20.363231 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e1e26cdd-da14-453e-a6a0-7c0fb0ddfb92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4597b3afb7740fabed076b6d921e249'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:20.372833 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e1e26cdd-da14-453e-a6a0-7c0fb0ddfb92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4597b3afb7740fabed076b6d921e249'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:20.386265 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2022/4044] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:23:19 2022] DELETE /identity/v3/users/a4597b3afb7740fabed076b6d921e249 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:20.391171 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cab4eb-aabd-40a7-ad4e-018cea413aff None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:20.391543 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cab4eb-aabd-40a7-ad4e-018cea413aff None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:20.391957 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cab4eb-aabd-40a7-ad4e-018cea413aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:20.416301 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-35cab4eb-aabd-40a7-ad4e-018cea413aff None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:20.417646 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-35cab4eb-aabd-40a7-ad4e-018cea413aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:20.492206 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2023/4045] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:23:20.516166 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e26cdd-da14-453e-a6a0-7c0fb0ddfb92 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:20.517682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e1e26cdd-da14-453e-a6a0-7c0fb0ddfb92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:20.597297 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e26cdd-da14-453e-a6a0-7c0fb0ddfb92 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:20.616243 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a7bc6-a613-4a37-b37f-a6499a518f4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:20.617222 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a7bc6-a613-4a37-b37f-a6499a518f4a service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:20.617568 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a7bc6-a613-4a37-b37f-a6499a518f4a service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:20.618104 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a7bc6-a613-4a37-b37f-a6499a518f4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:20.628592 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a7bc6-a613-4a37-b37f-a6499a518f4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:20.630325 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a7bc6-a613-4a37-b37f-a6499a518f4a service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:20.641296 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2023/4046] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:23:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:23:22.075148 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cab4eb-aabd-40a7-ad4e-018cea413aff None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:22.076947 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-35cab4eb-aabd-40a7-ad4e-018cea413aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:22.092210 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cab4eb-aabd-40a7-ad4e-018cea413aff None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:22.107033 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1b1bce-987f-4f85-90b2-9545e453e337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:22.110179 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b1bce-987f-4f85-90b2-9545e453e337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:22.114365 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b1bce-987f-4f85-90b2-9545e453e337 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:22.114365 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b1bce-987f-4f85-90b2-9545e453e337 admin admin] PATH_INFO: `/v3/projects/2d1dae6fd1a0408b9a6c6f4d103d624b` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:22.116365 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1b1bce-987f-4f85-90b2-9545e453e337 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d1dae6fd1a0408b9a6c6f4d103d624b)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:22.119913 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1b1bce-987f-4f85-90b2-9545e453e337 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:22.254299 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2b1b1bce-987f-4f85-90b2-9545e453e337 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d1dae6fd1a0408b9a6c6f4d103d624b', 'request_id': 'req-2b1b1bce-987f-4f85-90b2-9545e453e337'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:22.272537 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2b1b1bce-987f-4f85-90b2-9545e453e337 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d1dae6fd1a0408b9a6c6f4d103d624b', 'request_id': 'req-2b1b1bce-987f-4f85-90b2-9545e453e337'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:22.282241 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2b1b1bce-987f-4f85-90b2-9545e453e337 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d1dae6fd1a0408b9a6c6f4d103d624b', 'request_id': 'req-2b1b1bce-987f-4f85-90b2-9545e453e337'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:22.332350 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2b1b1bce-987f-4f85-90b2-9545e453e337 admin admin] The token cache is being invalidate because project 2d1dae6fd1a0408b9a6c6f4d103d624b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:23:22.332904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2b1b1bce-987f-4f85-90b2-9545e453e337 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:22.333659 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2b1b1bce-987f-4f85-90b2-9545e453e337 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:22.335481 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2024/4047] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:23:22 2022] DELETE /identity/v3/projects/2d1dae6fd1a0408b9a6c6f4d103d624b => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:22.339716 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a7bc6-a613-4a37-b37f-a6499a518f4a service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:22.349431 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a7bc6-a613-4a37-b37f-a6499a518f4a service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:22.420532 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5367cd-60a5-49f9-9774-fbe781956d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:22.423128 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5367cd-60a5-49f9-9774-fbe781956d5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:22.423418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5367cd-60a5-49f9-9774-fbe781956d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:22.423965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5367cd-60a5-49f9-9774-fbe781956d5d admin admin] PATH_INFO: `/v3/users/8d84b9eca5954e11b8193170b2d4a17a` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:22.425240 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5367cd-60a5-49f9-9774-fbe781956d5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d84b9eca5954e11b8193170b2d4a17a)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:22.427749 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5367cd-60a5-49f9-9774-fbe781956d5d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:22.623539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7d5367cd-60a5-49f9-9774-fbe781956d5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d84b9eca5954e11b8193170b2d4a17a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:22.639977 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7d5367cd-60a5-49f9-9774-fbe781956d5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d84b9eca5954e11b8193170b2d4a17a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:22.768025 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7d5367cd-60a5-49f9-9774-fbe781956d5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d84b9eca5954e11b8193170b2d4a17a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:22.768647 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7d5367cd-60a5-49f9-9774-fbe781956d5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d84b9eca5954e11b8193170b2d4a17a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:22.776924 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7d5367cd-60a5-49f9-9774-fbe781956d5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d84b9eca5954e11b8193170b2d4a17a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:22.783553 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2024/4048] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:23:22 2022] DELETE /identity/v3/users/8d84b9eca5954e11b8193170b2d4a17a => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:23:23.434690 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1b1bce-987f-4f85-90b2-9545e453e337 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:23.436163 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2b1b1bce-987f-4f85-90b2-9545e453e337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:23.449656 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1b1bce-987f-4f85-90b2-9545e453e337 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:23.507435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef127d-41e4-4548-b2f8-8d93fa90b49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:23.508296 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef127d-41e4-4548-b2f8-8d93fa90b49a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:23.508602 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef127d-41e4-4548-b2f8-8d93fa90b49a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:23.509009 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef127d-41e4-4548-b2f8-8d93fa90b49a admin admin] PATH_INFO: `/v3/projects/fe2c164a565b426c95704ca3585696b7` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:23.510791 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef127d-41e4-4548-b2f8-8d93fa90b49a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe2c164a565b426c95704ca3585696b7)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:23.513830 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef127d-41e4-4548-b2f8-8d93fa90b49a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:23.683270 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b6ef127d-41e4-4548-b2f8-8d93fa90b49a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe2c164a565b426c95704ca3585696b7', 'request_id': 'req-b6ef127d-41e4-4548-b2f8-8d93fa90b49a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:23.689744 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b6ef127d-41e4-4548-b2f8-8d93fa90b49a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe2c164a565b426c95704ca3585696b7', 'request_id': 'req-b6ef127d-41e4-4548-b2f8-8d93fa90b49a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:23.699654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b6ef127d-41e4-4548-b2f8-8d93fa90b49a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe2c164a565b426c95704ca3585696b7', 'request_id': 'req-b6ef127d-41e4-4548-b2f8-8d93fa90b49a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:23.761887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b6ef127d-41e4-4548-b2f8-8d93fa90b49a admin admin] The token cache is being invalidate because project fe2c164a565b426c95704ca3585696b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:23:23.762195 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b6ef127d-41e4-4548-b2f8-8d93fa90b49a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:23.762886 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b6ef127d-41e4-4548-b2f8-8d93fa90b49a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:23.764543 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2025/4049] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:23:23 2022] DELETE /identity/v3/projects/fe2c164a565b426c95704ca3585696b7 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:23.769526 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0d1bb-b4f1-4903-a4b4-67deb5b9c405 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:23.770033 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0d1bb-b4f1-4903-a4b4-67deb5b9c405 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:23.770208 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0d1bb-b4f1-4903-a4b4-67deb5b9c405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:23.789874 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-69d0d1bb-b4f1-4903-a4b4-67deb5b9c405 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:23.791175 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-69d0d1bb-b4f1-4903-a4b4-67deb5b9c405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:23.861914 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2025/4050] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:23:23.867295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a6c6a-a6e6-4c27-a9ad-e1b6ee800fb8 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:23.868336 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a6c6a-a6e6-4c27-a9ad-e1b6ee800fb8 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:23.868688 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a6c6a-a6e6-4c27-a9ad-e1b6ee800fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:23.892441 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-b74a6c6a-a6e6-4c27-a9ad-e1b6ee800fb8 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:23.893683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b74a6c6a-a6e6-4c27-a9ad-e1b6ee800fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:23.904406 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2026/4051] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:23:23.909014 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0d1bb-b4f1-4903-a4b4-67deb5b9c405 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:23.920402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0d1bb-b4f1-4903-a4b4-67deb5b9c405 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:23.925386 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb86c42-2a5c-4155-9c60-1563eb6c0e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:23.926120 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb86c42-2a5c-4155-9c60-1563eb6c0e32 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:23.927101 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb86c42-2a5c-4155-9c60-1563eb6c0e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:23.927379 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb86c42-2a5c-4155-9c60-1563eb6c0e32 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:23.928130 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb86c42-2a5c-4155-9c60-1563eb6c0e32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:23:23.929210 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb86c42-2a5c-4155-9c60-1563eb6c0e32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:23.930204 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb86c42-2a5c-4155-9c60-1563eb6c0e32 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:23.941949 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2026/4052] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:23:23.946903 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a6c6a-a6e6-4c27-a9ad-e1b6ee800fb8 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:23.956059 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a6c6a-a6e6-4c27-a9ad-e1b6ee800fb8 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:23.960962 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c31bee-edd4-4429-8706-d24004f3bac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:23.961621 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c31bee-edd4-4429-8706-d24004f3bac9 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:23.961945 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c31bee-edd4-4429-8706-d24004f3bac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:23.962649 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c31bee-edd4-4429-8706-d24004f3bac9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:23.962904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c31bee-edd4-4429-8706-d24004f3bac9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:23.966638 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c31bee-edd4-4429-8706-d24004f3bac9 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:23.976151 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb86c42-2a5c-4155-9c60-1563eb6c0e32 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:23.977997 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-afb86c42-2a5c-4155-9c60-1563eb6c0e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:24.009998 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb86c42-2a5c-4155-9c60-1563eb6c0e32 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:24.019552 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be339d-ef87-43fc-ada9-9029b019891b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:24.020855 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be339d-ef87-43fc-ada9-9029b019891b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:24.021237 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be339d-ef87-43fc-ada9-9029b019891b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:24.022308 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be339d-ef87-43fc-ada9-9029b019891b admin admin] PATH_INFO: `/v3/users/f230caf9b44f4c11b91e2f9dcb3a3d82` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:24.023925 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be339d-ef87-43fc-ada9-9029b019891b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f230caf9b44f4c11b91e2f9dcb3a3d82)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:24.026087 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be339d-ef87-43fc-ada9-9029b019891b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:24.066698 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2027/4053] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:23:23 2022] POST /identity/v3/projects => generated 371 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:23:24.071505 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c31bee-edd4-4429-8706-d24004f3bac9 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:24.132294 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c31bee-edd4-4429-8706-d24004f3bac9 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:24.138579 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c6f8db-f892-4780-97f4-6e7d572348b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:24.139267 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6f8db-f892-4780-97f4-6e7d572348b3 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:24.139558 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6f8db-f892-4780-97f4-6e7d572348b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:24.139836 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6f8db-f892-4780-97f4-6e7d572348b3 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:24.140545 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c6f8db-f892-4780-97f4-6e7d572348b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:24.142735 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c6f8db-f892-4780-97f4-6e7d572348b3 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:24.352352 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2028/4054] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:23:24 2022] POST /identity/v3/users => generated 286 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:23:24.356465 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c6f8db-f892-4780-97f4-6e7d572348b3 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:24.365544 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-46be339d-ef87-43fc-ada9-9029b019891b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f230caf9b44f4c11b91e2f9dcb3a3d82'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:24.369207 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c6f8db-f892-4780-97f4-6e7d572348b3 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:24.373997 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e82b9-718e-41c0-baea-bf41fd4d72e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:24.374715 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e82b9-718e-41c0-baea-bf41fd4d72e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:24.374964 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e82b9-718e-41c0-baea-bf41fd4d72e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:24.375369 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e82b9-718e-41c0-baea-bf41fd4d72e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:24.376109 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e82b9-718e-41c0-baea-bf41fd4d72e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:24.377792 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e82b9-718e-41c0-baea-bf41fd4d72e0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:24.378524 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-46be339d-ef87-43fc-ada9-9029b019891b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f230caf9b44f4c11b91e2f9dcb3a3d82'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:24.387927 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2029/4055] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:23:24.391952 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e82b9-718e-41c0-baea-bf41fd4d72e0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:24.402101 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e82b9-718e-41c0-baea-bf41fd4d72e0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:24.406886 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e618bae-5b10-4f65-80cd-c4357acb835f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:24.407540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e618bae-5b10-4f65-80cd-c4357acb835f admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:24.407820 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e618bae-5b10-4f65-80cd-c4357acb835f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:24.408095 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e618bae-5b10-4f65-80cd-c4357acb835f admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:24.408802 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e618bae-5b10-4f65-80cd-c4357acb835f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:24.410422 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e618bae-5b10-4f65-80cd-c4357acb835f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:24.423457 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2030/4056] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:23:24.428295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e618bae-5b10-4f65-80cd-c4357acb835f admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:24.438579 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e618bae-5b10-4f65-80cd-c4357acb835f admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:24.444144 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf2bd4-981d-4b62-a994-eb6b1d9250ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:24.445000 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf2bd4-981d-4b62-a994-eb6b1d9250ba admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:24.445281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf2bd4-981d-4b62-a994-eb6b1d9250ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:24.451458 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf2bd4-981d-4b62-a994-eb6b1d9250ba admin admin] PATH_INFO: `/v3/projects/907f0ff604644f12aa9f08c620858c51/users/a550314b8e02464a96c05f7628e17410/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:24.459750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf2bd4-981d-4b62-a994-eb6b1d9250ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=907f0ff604644f12aa9f08c620858c51, user_id=a550314b8e02464a96c05f7628e17410, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:24.462704 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf2bd4-981d-4b62-a994-eb6b1d9250ba admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:24.544768 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-46be339d-ef87-43fc-ada9-9029b019891b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f230caf9b44f4c11b91e2f9dcb3a3d82'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:24.545392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-46be339d-ef87-43fc-ada9-9029b019891b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f230caf9b44f4c11b91e2f9dcb3a3d82'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:24.552312 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2031/4057] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:23:24 2022] PUT /identity/v3/projects/907f0ff604644f12aa9f08c620858c51/users/a550314b8e02464a96c05f7628e17410/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:23:24.558888 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-46be339d-ef87-43fc-ada9-9029b019891b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f230caf9b44f4c11b91e2f9dcb3a3d82'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:24.565424 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2027/4058] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:23:23 2022] DELETE /identity/v3/users/f230caf9b44f4c11b91e2f9dcb3a3d82 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:24.633885 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc623aca-3c05-4f9d-97d9-e30a6d8afbe9 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:24.634635 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc623aca-3c05-4f9d-97d9-e30a6d8afbe9 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:24.635186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc623aca-3c05-4f9d-97d9-e30a6d8afbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:24.670054 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-bc623aca-3c05-4f9d-97d9-e30a6d8afbe9 None None] MFA Rules not processed for user `a550314b8e02464a96c05f7628e17410`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:24.671513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-bc623aca-3c05-4f9d-97d9-e30a6d8afbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:24.750621 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2032/4059] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:23:24.755264 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be339d-ef87-43fc-ada9-9029b019891b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:24.767714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be339d-ef87-43fc-ada9-9029b019891b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:24.772451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632d004-df2d-4a1c-aa96-16e9fc8d6409 tempest-IdentityCatalogTest-59771221 tempest-IdentityCatalogTest-59771221-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a550314b8e02464a96c05f7628e17410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '907f0ff604644f12aa9f08c620858c51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:24.773108 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632d004-df2d-4a1c-aa96-16e9fc8d6409 tempest-IdentityCatalogTest-59771221 tempest-IdentityCatalogTest-59771221-project] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:24.773399 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632d004-df2d-4a1c-aa96-16e9fc8d6409 tempest-IdentityCatalogTest-59771221 tempest-IdentityCatalogTest-59771221-project] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:24.773685 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632d004-df2d-4a1c-aa96-16e9fc8d6409 tempest-IdentityCatalogTest-59771221 tempest-IdentityCatalogTest-59771221-project] PATH_INFO: `/v3/auth/catalog` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:24.774373 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c632d004-df2d-4a1c-aa96-16e9fc8d6409 tempest-IdentityCatalogTest-59771221 tempest-IdentityCatalogTest-59771221-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:24.775467 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c632d004-df2d-4a1c-aa96-16e9fc8d6409 tempest-IdentityCatalogTest-59771221 tempest-IdentityCatalogTest-59771221-project] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:24.781308 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2028/4060] 10.222.0.23 () {58 vars in 1142 bytes} [Sat Apr 30 21:23:24 2022] GET /identity/v3/auth/catalog => generated 2648 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:23:24.782198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc623aca-3c05-4f9d-97d9-e30a6d8afbe9 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:24.783635 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-bc623aca-3c05-4f9d-97d9-e30a6d8afbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:24.838708 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632d004-df2d-4a1c-aa96-16e9fc8d6409 tempest-IdentityCatalogTest-59771221 tempest-IdentityCatalogTest-59771221-project] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:24.840462 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c632d004-df2d-4a1c-aa96-16e9fc8d6409 tempest-IdentityCatalogTest-59771221 tempest-IdentityCatalogTest-59771221-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:24.851994 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc623aca-3c05-4f9d-97d9-e30a6d8afbe9 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:24.861494 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632d004-df2d-4a1c-aa96-16e9fc8d6409 tempest-IdentityCatalogTest-59771221 tempest-IdentityCatalogTest-59771221-project] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:24.864440 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e29bcf-bfa9-49b0-ab09-76ae0057043b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:24.865486 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e29bcf-bfa9-49b0-ab09-76ae0057043b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:24.866446 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e29bcf-bfa9-49b0-ab09-76ae0057043b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:24.866577 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e29bcf-bfa9-49b0-ab09-76ae0057043b admin admin] PATH_INFO: `/v3/users/a550314b8e02464a96c05f7628e17410` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:24.868089 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e29bcf-bfa9-49b0-ab09-76ae0057043b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a550314b8e02464a96c05f7628e17410)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:24.870748 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e29bcf-bfa9-49b0-ab09-76ae0057043b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:24.876493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b271305-e097-40fe-9d15-14cae8f7b50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:24.877682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b271305-e097-40fe-9d15-14cae8f7b50f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:24.878158 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b271305-e097-40fe-9d15-14cae8f7b50f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:24.878271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b271305-e097-40fe-9d15-14cae8f7b50f admin admin] PATH_INFO: `/v3/projects/03431e5f43c045d78e741327bacf5d1c` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:24.879558 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b271305-e097-40fe-9d15-14cae8f7b50f admin admin] RBAC: Authorizing `identity:delete_project(project_id=03431e5f43c045d78e741327bacf5d1c)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:24.881593 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b271305-e097-40fe-9d15-14cae8f7b50f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:25.193844 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4b271305-e097-40fe-9d15-14cae8f7b50f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03431e5f43c045d78e741327bacf5d1c', 'request_id': 'req-4b271305-e097-40fe-9d15-14cae8f7b50f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:25.199334 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4b271305-e097-40fe-9d15-14cae8f7b50f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03431e5f43c045d78e741327bacf5d1c', 'request_id': 'req-4b271305-e097-40fe-9d15-14cae8f7b50f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:25.199790 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-22e29bcf-bfa9-49b0-ab09-76ae0057043b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a550314b8e02464a96c05f7628e17410'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:25.209963 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4b271305-e097-40fe-9d15-14cae8f7b50f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03431e5f43c045d78e741327bacf5d1c', 'request_id': 'req-4b271305-e097-40fe-9d15-14cae8f7b50f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:25.212335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-22e29bcf-bfa9-49b0-ab09-76ae0057043b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a550314b8e02464a96c05f7628e17410'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:25.299351 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4b271305-e097-40fe-9d15-14cae8f7b50f admin admin] The token cache is being invalidate because project 03431e5f43c045d78e741327bacf5d1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:23:25.299730 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4b271305-e097-40fe-9d15-14cae8f7b50f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:25.300462 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4b271305-e097-40fe-9d15-14cae8f7b50f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:25.302816 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2029/4061] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:23:24 2022] DELETE /identity/v3/projects/03431e5f43c045d78e741327bacf5d1c => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:23:25.308469 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b40d62-baeb-417b-8481-c52d033fe5f1 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:25.308891 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b40d62-baeb-417b-8481-c52d033fe5f1 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:25.309242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b40d62-baeb-417b-8481-c52d033fe5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:25.327275 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-22b40d62-baeb-417b-8481-c52d033fe5f1 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:25.328461 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-22b40d62-baeb-417b-8481-c52d033fe5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:25.350765 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-22e29bcf-bfa9-49b0-ab09-76ae0057043b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a550314b8e02464a96c05f7628e17410'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:25.358364 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-22e29bcf-bfa9-49b0-ab09-76ae0057043b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a550314b8e02464a96c05f7628e17410'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:25.359413 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-22e29bcf-bfa9-49b0-ab09-76ae0057043b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a550314b8e02464a96c05f7628e17410'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:25.368425 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2033/4062] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:23:24 2022] DELETE /identity/v3/users/a550314b8e02464a96c05f7628e17410 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:23:25.368425 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51acf5b-ce61-4c16-b588-dd13bb7ae0f8 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:25.368425 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51acf5b-ce61-4c16-b588-dd13bb7ae0f8 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:25.368425 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51acf5b-ce61-4c16-b588-dd13bb7ae0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:25.385246 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-d51acf5b-ce61-4c16-b588-dd13bb7ae0f8 None None] MFA Rules not processed for user `2f5eafa970bd4247bdaef1cda747c3fc`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:25.386621 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d51acf5b-ce61-4c16-b588-dd13bb7ae0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:25.401924 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2030/4063] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:23:25.407188 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d0337-248a-48fc-8182-4a076bf6cbd1 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:25.407188 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d0337-248a-48fc-8182-4a076bf6cbd1 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:25.407188 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d0337-248a-48fc-8182-4a076bf6cbd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:25.425107 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-aa4d0337-248a-48fc-8182-4a076bf6cbd1 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:25.426372 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-aa4d0337-248a-48fc-8182-4a076bf6cbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:25.455007 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2034/4064] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:23:25.459414 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dda3a4-87d6-4086-b6c9-4d048e62acd4 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:25.459901 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dda3a4-87d6-4086-b6c9-4d048e62acd4 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:25.460354 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dda3a4-87d6-4086-b6c9-4d048e62acd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:25.485651 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-17dda3a4-87d6-4086-b6c9-4d048e62acd4 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:25.486944 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-17dda3a4-87d6-4086-b6c9-4d048e62acd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:25.512548 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2031/4065] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:23:25.522451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d0337-248a-48fc-8182-4a076bf6cbd1 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:25.531267 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-aa4d0337-248a-48fc-8182-4a076bf6cbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:25.566184 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2035/4066] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:23:25.568140 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dda3a4-87d6-4086-b6c9-4d048e62acd4 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:25.577388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dda3a4-87d6-4086-b6c9-4d048e62acd4 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:25.583427 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e87fc-5475-4721-9be5-a37791750d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:25.589120 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e87fc-5475-4721-9be5-a37791750d09 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:25.589120 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e87fc-5475-4721-9be5-a37791750d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:25.589120 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e87fc-5475-4721-9be5-a37791750d09 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:25.589120 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e87fc-5475-4721-9be5-a37791750d09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:23:25.589120 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e87fc-5475-4721-9be5-a37791750d09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:25.589120 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e87fc-5475-4721-9be5-a37791750d09 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:25.589559 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d0337-248a-48fc-8182-4a076bf6cbd1 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:25.592910 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9fa12-bd1a-482b-a525-441eb0343cbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:25.593556 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9fa12-bd1a-482b-a525-441eb0343cbf service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:25.593867 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9fa12-bd1a-482b-a525-441eb0343cbf service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:25.594142 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9fa12-bd1a-482b-a525-441eb0343cbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:25.600925 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2036/4067] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:23:25.609717 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e87fc-5475-4721-9be5-a37791750d09 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:25.610023 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9fa12-bd1a-482b-a525-441eb0343cbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:25.612098 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9fa12-bd1a-482b-a525-441eb0343cbf service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:25.620828 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e87fc-5475-4721-9be5-a37791750d09 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:25.625921 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac73fee6-17a9-4ddf-8c42-ebef40735390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:25.626572 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2032/4068] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:23:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:23:25.626701 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73fee6-17a9-4ddf-8c42-ebef40735390 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:25.626951 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73fee6-17a9-4ddf-8c42-ebef40735390 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:25.627232 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73fee6-17a9-4ddf-8c42-ebef40735390 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:25.627992 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac73fee6-17a9-4ddf-8c42-ebef40735390 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:25.630632 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac73fee6-17a9-4ddf-8c42-ebef40735390 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:25.713031 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2037/4069] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:23:25 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:23:25.717179 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9fa12-bd1a-482b-a525-441eb0343cbf service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:25.722053 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac73fee6-17a9-4ddf-8c42-ebef40735390 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:25.725071 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ac73fee6-17a9-4ddf-8c42-ebef40735390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:25.727911 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9fa12-bd1a-482b-a525-441eb0343cbf service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:25.782247 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac73fee6-17a9-4ddf-8c42-ebef40735390 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:25.786697 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cce045-eae6-433d-b422-83d34d1c34ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:25.787364 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a0038-1d95-42d5-b44a-5a331654ad33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:25.787856 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cce045-eae6-433d-b422-83d34d1c34ca service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:25.787856 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cce045-eae6-433d-b422-83d34d1c34ca service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:25.788055 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cce045-eae6-433d-b422-83d34d1c34ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:25.788143 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a0038-1d95-42d5-b44a-5a331654ad33 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:25.788331 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a0038-1d95-42d5-b44a-5a331654ad33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:25.788602 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a0038-1d95-42d5-b44a-5a331654ad33 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:25.789293 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a0038-1d95-42d5-b44a-5a331654ad33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:25.790120 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-76cce045-eae6-433d-b422-83d34d1c34ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:25.791268 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a0038-1d95-42d5-b44a-5a331654ad33 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:25.802729 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cce045-eae6-433d-b422-83d34d1c34ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:25.804180 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cce045-eae6-433d-b422-83d34d1c34ca service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:25.812962 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2038/4070] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:23:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:23:25.887096 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2033/4071] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:23:25 2022] POST /identity/v3/users => generated 291 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:23:25.890157 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cce045-eae6-433d-b422-83d34d1c34ca service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:25.909677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cce045-eae6-433d-b422-83d34d1c34ca service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:25.915992 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53babc-455a-4001-a138-a360bc36a7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:25.916910 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53babc-455a-4001-a138-a360bc36a7aa admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:25.917674 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53babc-455a-4001-a138-a360bc36a7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:25.918130 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53babc-455a-4001-a138-a360bc36a7aa admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:25.919245 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb53babc-455a-4001-a138-a360bc36a7aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:25.921458 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb53babc-455a-4001-a138-a360bc36a7aa admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:25.938583 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2039/4072] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:23:25.941451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a0038-1d95-42d5-b44a-5a331654ad33 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:25.955270 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a0038-1d95-42d5-b44a-5a331654ad33 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:25.967163 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad570c-5e11-48d1-95e6-864b7c0397fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:25.967163 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad570c-5e11-48d1-95e6-864b7c0397fe admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:25.967163 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad570c-5e11-48d1-95e6-864b7c0397fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:25.967163 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad570c-5e11-48d1-95e6-864b7c0397fe admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:25.967585 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad570c-5e11-48d1-95e6-864b7c0397fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:25.967585 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad570c-5e11-48d1-95e6-864b7c0397fe admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:25.981391 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2034/4073] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:23:25.988005 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53babc-455a-4001-a138-a360bc36a7aa admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:25.999370 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53babc-455a-4001-a138-a360bc36a7aa admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:26.005106 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05904500-1896-496e-a71f-88e9a73fefa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:26.006065 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05904500-1896-496e-a71f-88e9a73fefa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:26.006355 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05904500-1896-496e-a71f-88e9a73fefa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:26.006631 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05904500-1896-496e-a71f-88e9a73fefa3 admin admin] PATH_INFO: `/v3/projects/8e529167b5244152802e4fb30080be96/users/9a3a68305ff545f4a13f6dd9eb091f7d/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:26.030274 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05904500-1896-496e-a71f-88e9a73fefa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e529167b5244152802e4fb30080be96, user_id=9a3a68305ff545f4a13f6dd9eb091f7d, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:26.033056 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05904500-1896-496e-a71f-88e9a73fefa3 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:26.054056 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad570c-5e11-48d1-95e6-864b7c0397fe admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:26.054056 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-20ad570c-5e11-48d1-95e6-864b7c0397fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:26.069637 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad570c-5e11-48d1-95e6-864b7c0397fe admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:26.075251 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761dfb4-05db-4662-b8b2-58fa3f54dcea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:26.076461 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761dfb4-05db-4662-b8b2-58fa3f54dcea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:26.076720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761dfb4-05db-4662-b8b2-58fa3f54dcea admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:26.077058 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761dfb4-05db-4662-b8b2-58fa3f54dcea admin admin] PATH_INFO: `/v3/projects/907f0ff604644f12aa9f08c620858c51` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:26.078573 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5761dfb4-05db-4662-b8b2-58fa3f54dcea admin admin] RBAC: Authorizing `identity:delete_project(project_id=907f0ff604644f12aa9f08c620858c51)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:26.080530 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5761dfb4-05db-4662-b8b2-58fa3f54dcea admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:26.117525 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2040/4074] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:23:25 2022] PUT /identity/v3/projects/8e529167b5244152802e4fb30080be96/users/9a3a68305ff545f4a13f6dd9eb091f7d/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:26.124327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd19f94-bf13-4d0b-bb08-7f5a49ef6558 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:26.125841 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd19f94-bf13-4d0b-bb08-7f5a49ef6558 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:26.126457 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd19f94-bf13-4d0b-bb08-7f5a49ef6558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:26.149032 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-6cd19f94-bf13-4d0b-bb08-7f5a49ef6558 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:26.150514 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6cd19f94-bf13-4d0b-bb08-7f5a49ef6558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:26.214108 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2041/4075] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:23:26.224443 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd19f94-bf13-4d0b-bb08-7f5a49ef6558 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:26.247516 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5761dfb4-05db-4662-b8b2-58fa3f54dcea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '907f0ff604644f12aa9f08c620858c51', 'request_id': 'req-5761dfb4-05db-4662-b8b2-58fa3f54dcea'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:26.254752 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5761dfb4-05db-4662-b8b2-58fa3f54dcea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '907f0ff604644f12aa9f08c620858c51', 'request_id': 'req-5761dfb4-05db-4662-b8b2-58fa3f54dcea'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:26.262587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5761dfb4-05db-4662-b8b2-58fa3f54dcea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '907f0ff604644f12aa9f08c620858c51', 'request_id': 'req-5761dfb4-05db-4662-b8b2-58fa3f54dcea'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:26.288461 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd19f94-bf13-4d0b-bb08-7f5a49ef6558 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:26.338105 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6cf85e-e643-4258-9ac9-afe3b03f76cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:26.338768 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6cf85e-e643-4258-9ac9-afe3b03f76cf service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:26.339048 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6cf85e-e643-4258-9ac9-afe3b03f76cf service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:26.339348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6cf85e-e643-4258-9ac9-afe3b03f76cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:26.402275 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6cf85e-e643-4258-9ac9-afe3b03f76cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:26.403719 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6cf85e-e643-4258-9ac9-afe3b03f76cf service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:26.414978 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2042/4076] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:23:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:23:26.444231 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5761dfb4-05db-4662-b8b2-58fa3f54dcea admin admin] The token cache is being invalidate because project 907f0ff604644f12aa9f08c620858c51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:23:26.444780 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5761dfb4-05db-4662-b8b2-58fa3f54dcea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:26.445635 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5761dfb4-05db-4662-b8b2-58fa3f54dcea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:26.458453 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2035/4077] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:23:26 2022] DELETE /identity/v3/projects/907f0ff604644f12aa9f08c620858c51 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:23:26.465917 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320277e-32ec-4ecc-8c3a-3f7f8001a57b None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:26.466835 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320277e-32ec-4ecc-8c3a-3f7f8001a57b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:26.467352 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320277e-32ec-4ecc-8c3a-3f7f8001a57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:26.508598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-3320277e-32ec-4ecc-8c3a-3f7f8001a57b None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:26.510450 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3320277e-32ec-4ecc-8c3a-3f7f8001a57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:26.529539 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2043/4078] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:23:26.536613 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2bbf0a-33ff-4c75-8e7a-562b740b3f01 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:26.536963 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2bbf0a-33ff-4c75-8e7a-562b740b3f01 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:26.546460 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2bbf0a-33ff-4c75-8e7a-562b740b3f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:26.588196 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-4b2bbf0a-33ff-4c75-8e7a-562b740b3f01 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:26.589961 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4b2bbf0a-33ff-4c75-8e7a-562b740b3f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:26.607040 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2036/4079] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:23:26.609338 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320277e-32ec-4ecc-8c3a-3f7f8001a57b None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:26.621894 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320277e-32ec-4ecc-8c3a-3f7f8001a57b None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:26.627802 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68828d1-2b44-4c5d-98ae-c6ea5989a56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:26.628661 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68828d1-2b44-4c5d-98ae-c6ea5989a56d admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:26.629099 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68828d1-2b44-4c5d-98ae-c6ea5989a56d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:26.629526 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68828d1-2b44-4c5d-98ae-c6ea5989a56d admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:26.630552 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68828d1-2b44-4c5d-98ae-c6ea5989a56d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:23:26.631009 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68828d1-2b44-4c5d-98ae-c6ea5989a56d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:26.632796 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68828d1-2b44-4c5d-98ae-c6ea5989a56d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:26.658298 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2bbf0a-33ff-4c75-8e7a-562b740b3f01 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:26.669023 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2044/4080] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:23:26.675892 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2bbf0a-33ff-4c75-8e7a-562b740b3f01 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:26.687813 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48dfe3-e8cf-4fd7-a19e-6da9423003d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:26.688676 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48dfe3-e8cf-4fd7-a19e-6da9423003d4 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:26.689159 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48dfe3-e8cf-4fd7-a19e-6da9423003d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:26.689583 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48dfe3-e8cf-4fd7-a19e-6da9423003d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:26.690338 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48dfe3-e8cf-4fd7-a19e-6da9423003d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:26.693044 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48dfe3-e8cf-4fd7-a19e-6da9423003d4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:26.828411 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2037/4081] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:23:26 2022] POST /identity/v3/projects => generated 359 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:23:26.832621 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68828d1-2b44-4c5d-98ae-c6ea5989a56d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:26.843420 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68828d1-2b44-4c5d-98ae-c6ea5989a56d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:26.909719 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef6666-0903-4e94-a2d0-3bf6feff1800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:26.910499 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef6666-0903-4e94-a2d0-3bf6feff1800 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:26.910887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef6666-0903-4e94-a2d0-3bf6feff1800 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:26.911245 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef6666-0903-4e94-a2d0-3bf6feff1800 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:26.912241 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef6666-0903-4e94-a2d0-3bf6feff1800 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:26.914359 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef6666-0903-4e94-a2d0-3bf6feff1800 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:27.052198 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2045/4082] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:23:26 2022] POST /identity/v3/users => generated 280 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:23:27.052419 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48dfe3-e8cf-4fd7-a19e-6da9423003d4 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:27.052419 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48dfe3-e8cf-4fd7-a19e-6da9423003d4 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:27.053179 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f598dd-ed44-4d73-87af-3232e18ef519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:27.055016 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f598dd-ed44-4d73-87af-3232e18ef519 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:27.055309 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f598dd-ed44-4d73-87af-3232e18ef519 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:27.055588 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f598dd-ed44-4d73-87af-3232e18ef519 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:27.056316 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f598dd-ed44-4d73-87af-3232e18ef519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:27.057969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f598dd-ed44-4d73-87af-3232e18ef519 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:27.071799 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2038/4083] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:23:27.076039 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef6666-0903-4e94-a2d0-3bf6feff1800 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:27.086554 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef6666-0903-4e94-a2d0-3bf6feff1800 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:27.091605 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f555fea-2937-4f81-aa4c-8611d2ffd9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:27.092469 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f555fea-2937-4f81-aa4c-8611d2ffd9c2 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:27.092759 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f555fea-2937-4f81-aa4c-8611d2ffd9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:27.093042 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f555fea-2937-4f81-aa4c-8611d2ffd9c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:27.093799 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f555fea-2937-4f81-aa4c-8611d2ffd9c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:27.095440 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f555fea-2937-4f81-aa4c-8611d2ffd9c2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:27.109806 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2046/4084] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:23:27.111531 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f598dd-ed44-4d73-87af-3232e18ef519 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:27.122381 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f598dd-ed44-4d73-87af-3232e18ef519 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:27.126998 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f26eba-15d5-420c-bfc5-f2ff1032782a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:27.127878 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f26eba-15d5-420c-bfc5-f2ff1032782a admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:27.128166 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f26eba-15d5-420c-bfc5-f2ff1032782a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:27.128447 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f26eba-15d5-420c-bfc5-f2ff1032782a admin admin] PATH_INFO: `/v3/projects/a76a79d19647491a81a3529150a616ff/users/55f355cd0b0d4839be162dca2b95d4a5/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:27.144664 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f26eba-15d5-420c-bfc5-f2ff1032782a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a76a79d19647491a81a3529150a616ff, user_id=55f355cd0b0d4839be162dca2b95d4a5, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:27.148030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f26eba-15d5-420c-bfc5-f2ff1032782a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:27.253527 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2039/4085] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:23:27 2022] PUT /identity/v3/projects/a76a79d19647491a81a3529150a616ff/users/55f355cd0b0d4839be162dca2b95d4a5/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:23:27.264467 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00732021-1d37-40db-9fc3-1a63026230da None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:27.264835 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00732021-1d37-40db-9fc3-1a63026230da None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:27.265180 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00732021-1d37-40db-9fc3-1a63026230da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:27.305486 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-00732021-1d37-40db-9fc3-1a63026230da None None] MFA Rules not processed for user `55f355cd0b0d4839be162dca2b95d4a5`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:27.306985 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-00732021-1d37-40db-9fc3-1a63026230da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:27.405493 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2047/4086] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:27 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:23:27.411429 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396e274-cdd6-4c93-988c-6d9817ee6aa8 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:27.411942 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396e274-cdd6-4c93-988c-6d9817ee6aa8 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:27.412169 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396e274-cdd6-4c93-988c-6d9817ee6aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:27.430897 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-6396e274-cdd6-4c93-988c-6d9817ee6aa8 None None] MFA Rules not processed for user `55f355cd0b0d4839be162dca2b95d4a5`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:27.432814 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6396e274-cdd6-4c93-988c-6d9817ee6aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:27.437291 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2040/4087] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:27 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 21:23:27.442970 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3eb69-acfd-4ca5-97a9-1a08f1f90192 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:27.443266 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3eb69-acfd-4ca5-97a9-1a08f1f90192 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:27.443546 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3eb69-acfd-4ca5-97a9-1a08f1f90192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:27.460903 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-2dd3eb69-acfd-4ca5-97a9-1a08f1f90192 None None] MFA Rules not processed for user `55f355cd0b0d4839be162dca2b95d4a5`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:27.462151 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2dd3eb69-acfd-4ca5-97a9-1a08f1f90192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:27.468303 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2048/4088] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:27 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 24 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 21:23:27.470164 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396e274-cdd6-4c93-988c-6d9817ee6aa8 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:27.481792 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396e274-cdd6-4c93-988c-6d9817ee6aa8 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:27.486095 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e17be1-aaf6-4421-ae44-5e39c3c11726 tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f355cd0b0d4839be162dca2b95d4a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76a79d19647491a81a3529150a616ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:27.486736 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e17be1-aaf6-4421-ae44-5e39c3c11726 tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] REQUEST_METHOD: `HEAD` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:27.487020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e17be1-aaf6-4421-ae44-5e39c3c11726 tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:27.487295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e17be1-aaf6-4421-ae44-5e39c3c11726 tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:27.494351 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e17be1-aaf6-4421-ae44-5e39c3c11726 tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] RBAC: Authorizing `identity:check_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:27.496167 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e17be1-aaf6-4421-ae44-5e39c3c11726 tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:27.502787 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2041/4089] 10.222.0.23 () {56 vars in 1263 bytes} [Sat Apr 30 21:23:27 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Apr 30 21:23:27.506999 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3eb69-acfd-4ca5-97a9-1a08f1f90192 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:27.525779 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3eb69-acfd-4ca5-97a9-1a08f1f90192 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:27.529964 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf177a-8ec0-4c70-9faa-edcc8a3b9d65 tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f355cd0b0d4839be162dca2b95d4a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76a79d19647491a81a3529150a616ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:27.530609 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf177a-8ec0-4c70-9faa-edcc8a3b9d65 tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:27.530901 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf177a-8ec0-4c70-9faa-edcc8a3b9d65 tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:27.531180 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf177a-8ec0-4c70-9faa-edcc8a3b9d65 tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:27.538428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf177a-8ec0-4c70-9faa-edcc8a3b9d65 tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:27.540200 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf177a-8ec0-4c70-9faa-edcc8a3b9d65 tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:27.546266 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2049/4090] 10.222.0.23 () {56 vars in 1262 bytes} [Sat Apr 30 21:23:27 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 30 21:23:27.550527 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e17be1-aaf6-4421-ae44-5e39c3c11726 tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:27.560499 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e17be1-aaf6-4421-ae44-5e39c3c11726 tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:27.564754 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e25d9c-ec9a-432f-b90e-25c52df6ef9a tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f355cd0b0d4839be162dca2b95d4a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76a79d19647491a81a3529150a616ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:27.565477 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e25d9c-ec9a-432f-b90e-25c52df6ef9a tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:27.565743 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e25d9c-ec9a-432f-b90e-25c52df6ef9a tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:27.566053 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e25d9c-ec9a-432f-b90e-25c52df6ef9a tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:27.574476 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e25d9c-ec9a-432f-b90e-25c52df6ef9a tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:27.576445 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e25d9c-ec9a-432f-b90e-25c52df6ef9a tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:27.717038 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2042/4091] 10.222.0.23 () {56 vars in 1265 bytes} [Sat Apr 30 21:23:27 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:27.721138 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf177a-8ec0-4c70-9faa-edcc8a3b9d65 tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:27.730885 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf177a-8ec0-4c70-9faa-edcc8a3b9d65 tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:27.735110 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab3e51-ef3c-436d-b591-75ecbddc90aa tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f355cd0b0d4839be162dca2b95d4a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76a79d19647491a81a3529150a616ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:27.735796 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab3e51-ef3c-436d-b591-75ecbddc90aa tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] REQUEST_METHOD: `HEAD` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:27.736096 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab3e51-ef3c-436d-b591-75ecbddc90aa tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:27.736392 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab3e51-ef3c-436d-b591-75ecbddc90aa tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:27.738252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-46ab3e51-ef3c-436d-b591-75ecbddc90aa tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:27.782607 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-46ab3e51-ef3c-436d-b591-75ecbddc90aa tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Apr 30 21:23:27.782607 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:23:27.782607 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:23:27.782607 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:23:27.782607 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:23:27.782607 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:23:27.782607 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:23:27.782607 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:23:27.782607 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:23:27.782607 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:23:27.782607 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:23:27.782607 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:23:27.782607 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Apr 30 21:23:27.782607 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Apr 30 21:23:27.782607 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Apr 30 21:23:27.783842 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Apr 30 21:23:27.783842 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Apr 30 21:23:27.783842 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Apr 30 21:23:27.783842 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:23:27.783842 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:23:27.783842 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Apr 30 21:23:27.783842 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Apr 30 21:23:27.783842 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Apr 30 21:23:27.783842 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self.check_revocation(token) Apr 30 21:23:27.783842 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:23:27.783842 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:23:27.783842 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Apr 30 21:23:27.783842 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Apr 30 21:23:27.783842 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:23:27.783842 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:23:27.783842 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Apr 30 21:23:27.783842 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Apr 30 21:23:27.785284 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:23:27.785284 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:23:27.785284 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Apr 30 21:23:27.785284 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Apr 30 21:23:27.785284 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Apr 30 21:23:27.785284 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:23:27.785284 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2050/4092] 10.222.0.23 () {56 vars in 1263 bytes} [Sat Apr 30 21:23:27 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) Apr 30 21:23:27.790208 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d2e49-b8f5-445e-b328-62aa2610e70c None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:27.790508 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d2e49-b8f5-445e-b328-62aa2610e70c None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:27.790794 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d2e49-b8f5-445e-b328-62aa2610e70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:27.807973 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-976d2e49-b8f5-445e-b328-62aa2610e70c None None] MFA Rules not processed for user `55f355cd0b0d4839be162dca2b95d4a5`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:27.809191 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-976d2e49-b8f5-445e-b328-62aa2610e70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:27.813065 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2043/4093] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:27 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 21:23:27.816371 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab3e51-ef3c-436d-b591-75ecbddc90aa tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:27.825968 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab3e51-ef3c-436d-b591-75ecbddc90aa tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:27.830329 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d7346-717f-48ff-aba7-a2d7d77561cb tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f355cd0b0d4839be162dca2b95d4a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76a79d19647491a81a3529150a616ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:27.830972 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d7346-717f-48ff-aba7-a2d7d77561cb tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:27.831258 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d7346-717f-48ff-aba7-a2d7d77561cb tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:27.831536 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d7346-717f-48ff-aba7-a2d7d77561cb tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:27.838575 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d7346-717f-48ff-aba7-a2d7d77561cb tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:27.840515 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d7346-717f-48ff-aba7-a2d7d77561cb tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:27.852249 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2051/4094] 10.222.0.23 () {56 vars in 1262 bytes} [Sat Apr 30 21:23:27 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 21:23:27.853358 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d2e49-b8f5-445e-b328-62aa2610e70c None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:27.867559 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d2e49-b8f5-445e-b328-62aa2610e70c None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:27.869800 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f80c4-fa18-4321-9c5e-3d02a2ca480b tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f355cd0b0d4839be162dca2b95d4a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76a79d19647491a81a3529150a616ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:27.870650 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f80c4-fa18-4321-9c5e-3d02a2ca480b tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:27.871012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f80c4-fa18-4321-9c5e-3d02a2ca480b tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:27.871381 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f80c4-fa18-4321-9c5e-3d02a2ca480b tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:27.899587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f80c4-fa18-4321-9c5e-3d02a2ca480b tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:27.901205 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f80c4-fa18-4321-9c5e-3d02a2ca480b tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:27.976387 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2044/4095] 10.222.0.23 () {56 vars in 1265 bytes} [Sat Apr 30 21:23:27 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:27.987840 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fa16a-f024-4450-bb5e-089a726020ee None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:27.988419 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fa16a-f024-4450-bb5e-089a726020ee None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:27.989602 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fa16a-f024-4450-bb5e-089a726020ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:27.992672 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f80c4-fa18-4321-9c5e-3d02a2ca480b tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:28.019462 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f80c4-fa18-4321-9c5e-3d02a2ca480b tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:28.024997 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1d8eb-c860-43e0-8fa1-b2ec99835302 tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55f355cd0b0d4839be162dca2b95d4a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a76a79d19647491a81a3529150a616ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:28.025696 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1d8eb-c860-43e0-8fa1-b2ec99835302 tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:28.026013 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1d8eb-c860-43e0-8fa1-b2ec99835302 tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:28.026292 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1d8eb-c860-43e0-8fa1-b2ec99835302 tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:28.028163 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d7e1d8eb-c860-43e0-8fa1-b2ec99835302 tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:28.033453 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-915fa16a-f024-4450-bb5e-089a726020ee None None] MFA Rules not processed for user `9a3a68305ff545f4a13f6dd9eb091f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:28.035014 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-915fa16a-f024-4450-bb5e-089a726020ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:28.041658 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-d7e1d8eb-c860-43e0-8fa1-b2ec99835302 tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Apr 30 21:23:28.041658 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:23:28.041658 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:23:28.041658 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:23:28.041658 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:23:28.041658 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:23:28.041658 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:23:28.041658 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:23:28.041658 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:23:28.041658 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:23:28.041658 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:23:28.041658 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:23:28.041658 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Apr 30 21:23:28.041658 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Apr 30 21:23:28.041658 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Apr 30 21:23:28.047908 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Apr 30 21:23:28.047908 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Apr 30 21:23:28.047908 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Apr 30 21:23:28.047908 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:23:28.047908 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:23:28.047908 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Apr 30 21:23:28.047908 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Apr 30 21:23:28.047908 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Apr 30 21:23:28.047908 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self.check_revocation(token) Apr 30 21:23:28.047908 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:23:28.047908 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:23:28.047908 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Apr 30 21:23:28.047908 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Apr 30 21:23:28.047908 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:23:28.047908 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:23:28.047908 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Apr 30 21:23:28.047908 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Apr 30 21:23:28.049378 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:23:28.049378 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:23:28.049378 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Apr 30 21:23:28.049378 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Apr 30 21:23:28.049378 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Apr 30 21:23:28.049378 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:23:28.049378 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2045/4096] 10.222.0.23 () {56 vars in 1262 bytes} [Sat Apr 30 21:23:27 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 21:23:28.051149 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1d8eb-c860-43e0-8fa1-b2ec99835302 tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:28.117541 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2052/4097] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:23:28.121932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1d8eb-c860-43e0-8fa1-b2ec99835302 tempest-TokensV3Test-733808402 tempest-TokensV3Test-733808402-project] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:28.124192 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca41cb0-e26c-4c38-a316-7ff5ce70761b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:28.125081 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca41cb0-e26c-4c38-a316-7ff5ce70761b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:28.125367 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca41cb0-e26c-4c38-a316-7ff5ce70761b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:28.125692 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca41cb0-e26c-4c38-a316-7ff5ce70761b admin admin] PATH_INFO: `/v3/users/55f355cd0b0d4839be162dca2b95d4a5` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:28.127128 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca41cb0-e26c-4c38-a316-7ff5ce70761b admin admin] RBAC: Authorizing `identity:delete_user(user_id=55f355cd0b0d4839be162dca2b95d4a5)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:28.128439 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d2ec8-47a6-4f1b-96da-dc9f2130d1c8 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:28.128729 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d2ec8-47a6-4f1b-96da-dc9f2130d1c8 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:28.129010 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d2ec8-47a6-4f1b-96da-dc9f2130d1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:28.129112 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca41cb0-e26c-4c38-a316-7ff5ce70761b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:28.148902 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-ab7d2ec8-47a6-4f1b-96da-dc9f2130d1c8 None None] MFA Rules not processed for user `9a3a68305ff545f4a13f6dd9eb091f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:28.150756 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ab7d2ec8-47a6-4f1b-96da-dc9f2130d1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:28.158340 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2053/4098] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:23:28.169525 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d2ec8-47a6-4f1b-96da-dc9f2130d1c8 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:28.171003 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ab7d2ec8-47a6-4f1b-96da-dc9f2130d1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:28.242490 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d2ec8-47a6-4f1b-96da-dc9f2130d1c8 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:28.248072 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490f698-8ef0-4607-8131-72b98ad73a50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:28.248710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490f698-8ef0-4607-8131-72b98ad73a50 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:28.248992 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490f698-8ef0-4607-8131-72b98ad73a50 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:28.249265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490f698-8ef0-4607-8131-72b98ad73a50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:28.258661 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490f698-8ef0-4607-8131-72b98ad73a50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:28.261094 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490f698-8ef0-4607-8131-72b98ad73a50 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:28.273727 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2054/4099] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:23:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:23:28.382039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2ca41cb0-e26c-4c38-a316-7ff5ce70761b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55f355cd0b0d4839be162dca2b95d4a5'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:28.394371 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2ca41cb0-e26c-4c38-a316-7ff5ce70761b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55f355cd0b0d4839be162dca2b95d4a5'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:28.481850 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2ca41cb0-e26c-4c38-a316-7ff5ce70761b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55f355cd0b0d4839be162dca2b95d4a5'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:28.482520 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2ca41cb0-e26c-4c38-a316-7ff5ce70761b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55f355cd0b0d4839be162dca2b95d4a5'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:28.490616 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2ca41cb0-e26c-4c38-a316-7ff5ce70761b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55f355cd0b0d4839be162dca2b95d4a5'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:28.496550 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2046/4100] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:23:28 2022] DELETE /identity/v3/users/55f355cd0b0d4839be162dca2b95d4a5 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:28.501277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43717e39-1bce-4bae-8abb-fee415a6213a None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:28.501826 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43717e39-1bce-4bae-8abb-fee415a6213a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:28.502078 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43717e39-1bce-4bae-8abb-fee415a6213a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:28.520153 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-43717e39-1bce-4bae-8abb-fee415a6213a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:28.521357 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-43717e39-1bce-4bae-8abb-fee415a6213a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:28.582121 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2055/4101] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:23:28.592186 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca41cb0-e26c-4c38-a316-7ff5ce70761b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:28.593627 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2ca41cb0-e26c-4c38-a316-7ff5ce70761b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:28.668658 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b81d38-fcf4-4e94-b46c-6519ae356dd0 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:28.668950 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b81d38-fcf4-4e94-b46c-6519ae356dd0 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:28.669266 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b81d38-fcf4-4e94-b46c-6519ae356dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:28.701172 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-02b81d38-fcf4-4e94-b46c-6519ae356dd0 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:28.703717 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-02b81d38-fcf4-4e94-b46c-6519ae356dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:28.714202 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca41cb0-e26c-4c38-a316-7ff5ce70761b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:28.719757 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790e6e8-5274-43d1-83c9-4d61bd741099 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:28.720708 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790e6e8-5274-43d1-83c9-4d61bd741099 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:28.720996 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790e6e8-5274-43d1-83c9-4d61bd741099 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:28.721278 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790e6e8-5274-43d1-83c9-4d61bd741099 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:28.733003 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a790e6e8-5274-43d1-83c9-4d61bd741099 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:28.734987 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a790e6e8-5274-43d1-83c9-4d61bd741099 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:28.746770 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2047/4102] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:23:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:23:28.810137 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2056/4103] 10.222.0.23 () {58 vars in 967 bytes} [Sat Apr 30 21:23:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:23:28.842364 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790e6e8-5274-43d1-83c9-4d61bd741099 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:28.843918 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a790e6e8-5274-43d1-83c9-4d61bd741099 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:28.946604 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790e6e8-5274-43d1-83c9-4d61bd741099 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:28.953704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8411551-96c7-473d-bf98-2d53906d7d47 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:28.957366 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8411551-96c7-473d-bf98-2d53906d7d47 service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:28.958292 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8411551-96c7-473d-bf98-2d53906d7d47 service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:28.958601 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8411551-96c7-473d-bf98-2d53906d7d47 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:28.968699 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8411551-96c7-473d-bf98-2d53906d7d47 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:28.970439 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8411551-96c7-473d-bf98-2d53906d7d47 service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:28.979385 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2048/4104] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:23:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:23:29.445132 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b81d38-fcf4-4e94-b46c-6519ae356dd0 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:29.446877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-02b81d38-fcf4-4e94-b46c-6519ae356dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:29.477433 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b81d38-fcf4-4e94-b46c-6519ae356dd0 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:29.482765 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185f571-2c53-481c-902d-63084b66e8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:29.483642 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185f571-2c53-481c-902d-63084b66e8b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:29.484213 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185f571-2c53-481c-902d-63084b66e8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:29.484499 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185f571-2c53-481c-902d-63084b66e8b3 admin admin] PATH_INFO: `/v3/projects/a76a79d19647491a81a3529150a616ff` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:29.485788 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d185f571-2c53-481c-902d-63084b66e8b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a76a79d19647491a81a3529150a616ff)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:29.487747 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d185f571-2c53-481c-902d-63084b66e8b3 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:29.608435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d185f571-2c53-481c-902d-63084b66e8b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a76a79d19647491a81a3529150a616ff', 'request_id': 'req-d185f571-2c53-481c-902d-63084b66e8b3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:29.613674 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d185f571-2c53-481c-902d-63084b66e8b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a76a79d19647491a81a3529150a616ff', 'request_id': 'req-d185f571-2c53-481c-902d-63084b66e8b3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:29.620640 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d185f571-2c53-481c-902d-63084b66e8b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a76a79d19647491a81a3529150a616ff', 'request_id': 'req-d185f571-2c53-481c-902d-63084b66e8b3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:29.716010 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d185f571-2c53-481c-902d-63084b66e8b3 admin admin] The token cache is being invalidate because project a76a79d19647491a81a3529150a616ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:23:29.718951 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d185f571-2c53-481c-902d-63084b66e8b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:29.718951 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d185f571-2c53-481c-902d-63084b66e8b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:29.718951 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2057/4105] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:23:29 2022] DELETE /identity/v3/projects/a76a79d19647491a81a3529150a616ff => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:29.724359 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc0117-cc8e-44af-a031-594606c831ca None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:29.724725 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc0117-cc8e-44af-a031-594606c831ca None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:29.725105 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc0117-cc8e-44af-a031-594606c831ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:29.775065 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-8bfc0117-cc8e-44af-a031-594606c831ca None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:29.776539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8bfc0117-cc8e-44af-a031-594606c831ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:29.852152 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2049/4106] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:23:29.861333 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df4468-5c06-4d2a-92a0-79ad80e0cd9d None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:29.861625 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df4468-5c06-4d2a-92a0-79ad80e0cd9d None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:29.861946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df4468-5c06-4d2a-92a0-79ad80e0cd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:29.881698 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-f0df4468-5c06-4d2a-92a0-79ad80e0cd9d None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:29.883186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f0df4468-5c06-4d2a-92a0-79ad80e0cd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:29.896728 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2058/4107] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:23:29.897538 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc0117-cc8e-44af-a031-594606c831ca None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:29.908065 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc0117-cc8e-44af-a031-594606c831ca None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:29.913457 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58500fb8-e2c6-40ef-9d4d-7cd81b786665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:29.916718 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58500fb8-e2c6-40ef-9d4d-7cd81b786665 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:29.916718 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58500fb8-e2c6-40ef-9d4d-7cd81b786665 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:29.916718 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58500fb8-e2c6-40ef-9d4d-7cd81b786665 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:29.916718 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58500fb8-e2c6-40ef-9d4d-7cd81b786665 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:23:29.916718 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58500fb8-e2c6-40ef-9d4d-7cd81b786665 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:29.917309 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58500fb8-e2c6-40ef-9d4d-7cd81b786665 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:29.929980 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2050/4108] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:23:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:23:29.934347 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df4468-5c06-4d2a-92a0-79ad80e0cd9d None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:29.945370 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df4468-5c06-4d2a-92a0-79ad80e0cd9d None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:29.951372 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47224524-d508-463a-9e43-e3f880d1b92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:29.952330 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47224524-d508-463a-9e43-e3f880d1b92f admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:29.952805 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47224524-d508-463a-9e43-e3f880d1b92f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:29.953271 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47224524-d508-463a-9e43-e3f880d1b92f admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:29.954391 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47224524-d508-463a-9e43-e3f880d1b92f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:29.956740 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47224524-d508-463a-9e43-e3f880d1b92f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:30.066844 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2059/4109] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:23:29 2022] POST /identity/v3/projects => generated 375 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:23:30.071322 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58500fb8-e2c6-40ef-9d4d-7cd81b786665 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:30.081414 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58500fb8-e2c6-40ef-9d4d-7cd81b786665 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:30.142416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeab2cc-15ca-457a-96d7-c116d9fd3dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:30.143589 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeab2cc-15ca-457a-96d7-c116d9fd3dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:30.143885 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeab2cc-15ca-457a-96d7-c116d9fd3dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:30.144142 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeab2cc-15ca-457a-96d7-c116d9fd3dc4 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:30.144859 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeab2cc-15ca-457a-96d7-c116d9fd3dc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:30.147381 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeab2cc-15ca-457a-96d7-c116d9fd3dc4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:30.257566 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2051/4110] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:23:30 2022] POST /identity/v3/users => generated 288 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:23:30.258814 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47224524-d508-463a-9e43-e3f880d1b92f admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:30.276335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47224524-d508-463a-9e43-e3f880d1b92f admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:30.281340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f301466-457f-43a1-9512-aa321d9fe82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:30.282112 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f301466-457f-43a1-9512-aa321d9fe82a admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:30.282319 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f301466-457f-43a1-9512-aa321d9fe82a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:30.282596 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f301466-457f-43a1-9512-aa321d9fe82a admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:30.283332 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f301466-457f-43a1-9512-aa321d9fe82a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:30.284984 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f301466-457f-43a1-9512-aa321d9fe82a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:30.295918 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2060/4111] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:23:30.300029 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeab2cc-15ca-457a-96d7-c116d9fd3dc4 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:30.310532 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeab2cc-15ca-457a-96d7-c116d9fd3dc4 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:30.316507 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c9e59-a669-4ef5-b621-f8c5179566ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:30.317711 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c9e59-a669-4ef5-b621-f8c5179566ac admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:30.318027 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c9e59-a669-4ef5-b621-f8c5179566ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:30.318303 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c9e59-a669-4ef5-b621-f8c5179566ac admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:30.319125 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c9e59-a669-4ef5-b621-f8c5179566ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:30.320637 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c9e59-a669-4ef5-b621-f8c5179566ac admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:30.332425 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2052/4112] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:23:30.337210 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f301466-457f-43a1-9512-aa321d9fe82a admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:30.347285 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f301466-457f-43a1-9512-aa321d9fe82a admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:30.352063 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d3a39-6b6f-4d4e-b186-450339cd16b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:30.352936 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d3a39-6b6f-4d4e-b186-450339cd16b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:30.353215 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d3a39-6b6f-4d4e-b186-450339cd16b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:30.353499 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d3a39-6b6f-4d4e-b186-450339cd16b7 admin admin] PATH_INFO: `/v3/projects/f8eb0464e4654fdc85af24d7eaa5660e/users/bb3597f57da7487cb6fc364cb207f98c/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:30.367839 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d3a39-6b6f-4d4e-b186-450339cd16b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8eb0464e4654fdc85af24d7eaa5660e, user_id=bb3597f57da7487cb6fc364cb207f98c, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:30.370551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d3a39-6b6f-4d4e-b186-450339cd16b7 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:30.482180 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2061/4113] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:23:30 2022] PUT /identity/v3/projects/f8eb0464e4654fdc85af24d7eaa5660e/users/bb3597f57da7487cb6fc364cb207f98c/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:30.492619 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21479536-3eb5-4e52-920b-b190e05c85bb None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:30.493026 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21479536-3eb5-4e52-920b-b190e05c85bb None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:30.493284 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21479536-3eb5-4e52-920b-b190e05c85bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:30.522597 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-21479536-3eb5-4e52-920b-b190e05c85bb None None] MFA Rules not processed for user `bb3597f57da7487cb6fc364cb207f98c`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:30.523866 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-21479536-3eb5-4e52-920b-b190e05c85bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:30.589195 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2053/4114] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:23:30.594375 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d3a39-6b6f-4d4e-b186-450339cd16b7 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:30.607643 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d3a39-6b6f-4d4e-b186-450339cd16b7 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:30.615549 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e14e5-505a-4ffa-b562-7049775898c9 tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3597f57da7487cb6fc364cb207f98c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8eb0464e4654fdc85af24d7eaa5660e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:30.617474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e14e5-505a-4ffa-b562-7049775898c9 tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:30.618121 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e14e5-505a-4ffa-b562-7049775898c9 tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:30.618593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e14e5-505a-4ffa-b562-7049775898c9 tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] PATH_INFO: `/v3/users/bb3597f57da7487cb6fc364cb207f98c/password` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:30.769463 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-455e14e5-505a-4ffa-b562-7049775898c9 tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'bb3597f57da7487cb6fc364cb207f98c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:30.963077 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2062/4115] 10.222.0.23 () {60 vars in 1268 bytes} [Sat Apr 30 21:23:30 2022] POST /identity/v3/users/bb3597f57da7487cb6fc364cb207f98c/password => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:23:31.968987 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89da1a-397d-4768-83fd-5bf67d69d889 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:31.969562 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89da1a-397d-4768-83fd-5bf67d69d889 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:31.969562 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89da1a-397d-4768-83fd-5bf67d69d889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:31.987484 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-fa89da1a-397d-4768-83fd-5bf67d69d889 None None] MFA Rules not processed for user `bb3597f57da7487cb6fc364cb207f98c`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:31.988734 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-fa89da1a-397d-4768-83fd-5bf67d69d889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:31.992056 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2054/4116] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:31 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 24 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 21:23:31.996971 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d11b5a-0371-4827-b3f3-7a588449e59f None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:31.997507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d11b5a-0371-4827-b3f3-7a588449e59f None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:31.997507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d11b5a-0371-4827-b3f3-7a588449e59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:32.017536 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-a0d11b5a-0371-4827-b3f3-7a588449e59f None None] MFA Rules not processed for user `bb3597f57da7487cb6fc364cb207f98c`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:32.024179 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a0d11b5a-0371-4827-b3f3-7a588449e59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:32.027024 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2063/4117] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:23:32.031499 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89da1a-397d-4768-83fd-5bf67d69d889 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:32.043585 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89da1a-397d-4768-83fd-5bf67d69d889 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:32.047973 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ad1cf-942c-48a1-b859-5082f84a9dbc tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3597f57da7487cb6fc364cb207f98c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8eb0464e4654fdc85af24d7eaa5660e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:32.049117 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ad1cf-942c-48a1-b859-5082f84a9dbc tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:32.049398 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ad1cf-942c-48a1-b859-5082f84a9dbc tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:32.049669 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ad1cf-942c-48a1-b859-5082f84a9dbc tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] PATH_INFO: `/v3/users/bb3597f57da7487cb6fc364cb207f98c/password` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:32.097517 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-c20ad1cf-942c-48a1-b859-5082f84a9dbc tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Apr 30 21:23:32.097517 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:23:32.097517 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:23:32.097517 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:23:32.097517 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:23:32.097517 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:23:32.097517 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:23:32.097517 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:23:32.097517 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:23:32.097517 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:23:32.097517 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:23:32.097517 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:23:32.097517 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Apr 30 21:23:32.098599 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(*args, **kwargs) Apr 30 21:23:32.098599 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Apr 30 21:23:32.098599 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Apr 30 21:23:32.098599 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:23:32.098599 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:23:32.098599 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 21:23:32.098599 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 21:23:32.098599 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Apr 30 21:23:32.098599 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Apr 30 21:23:32.098599 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Apr 30 21:23:32.098599 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Apr 30 21:23:32.098599 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Apr 30 21:23:32.098599 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Apr 30 21:23:32.098599 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Apr 30 21:23:32.098599 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:23:32.099618 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2055/4118] 10.222.0.23 () {60 vars in 1268 bytes} [Sat Apr 30 21:23:32 2022] POST /identity/v3/users/bb3597f57da7487cb6fc364cb207f98c/password => generated 188 bytes in 68 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Apr 30 21:23:32.103072 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d11b5a-0371-4827-b3f3-7a588449e59f None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:32.111846 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d11b5a-0371-4827-b3f3-7a588449e59f None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:32.116515 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de8418-707f-4d66-8d5d-19942e8dc431 tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3597f57da7487cb6fc364cb207f98c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8eb0464e4654fdc85af24d7eaa5660e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:32.117371 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de8418-707f-4d66-8d5d-19942e8dc431 tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:32.117658 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de8418-707f-4d66-8d5d-19942e8dc431 tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:32.117968 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de8418-707f-4d66-8d5d-19942e8dc431 tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] PATH_INFO: `/v3/users/bb3597f57da7487cb6fc364cb207f98c/password` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:32.163824 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-c8de8418-707f-4d66-8d5d-19942e8dc431 tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Apr 30 21:23:32.163824 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:23:32.163824 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:23:32.163824 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:23:32.163824 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:23:32.163824 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:23:32.163824 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:23:32.163824 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:23:32.163824 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:23:32.163824 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:23:32.163824 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:23:32.163824 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:23:32.163824 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Apr 30 21:23:32.164885 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return f(*args, **kwargs) Apr 30 21:23:32.164885 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Apr 30 21:23:32.164885 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Apr 30 21:23:32.164885 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:23:32.164885 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:23:32.164885 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 21:23:32.164885 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 21:23:32.164885 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Apr 30 21:23:32.164885 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Apr 30 21:23:32.164885 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Apr 30 21:23:32.164885 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Apr 30 21:23:32.164885 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Apr 30 21:23:32.164885 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Apr 30 21:23:32.164885 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Apr 30 21:23:32.164885 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:23:32.166114 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2064/4119] 10.222.0.23 () {60 vars in 1268 bytes} [Sat Apr 30 21:23:32 2022] POST /identity/v3/users/bb3597f57da7487cb6fc364cb207f98c/password => generated 188 bytes in 63 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Apr 30 21:23:32.168640 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ad1cf-942c-48a1-b859-5082f84a9dbc tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:32.179802 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ad1cf-942c-48a1-b859-5082f84a9dbc tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:32.184135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d8bf0-4a76-461e-a796-ee67dc85733b tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3597f57da7487cb6fc364cb207f98c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8eb0464e4654fdc85af24d7eaa5660e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:32.185002 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d8bf0-4a76-461e-a796-ee67dc85733b tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:32.187591 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d8bf0-4a76-461e-a796-ee67dc85733b tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:32.187591 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d8bf0-4a76-461e-a796-ee67dc85733b tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] PATH_INFO: `/v3/users/bb3597f57da7487cb6fc364cb207f98c/password` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:32.321463 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-799d8bf0-4a76-461e-a796-ee67dc85733b tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'bb3597f57da7487cb6fc364cb207f98c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:32.391243 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2056/4120] 10.222.0.23 () {60 vars in 1268 bytes} [Sat Apr 30 21:23:32 2022] POST /identity/v3/users/bb3597f57da7487cb6fc364cb207f98c/password => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:33.397299 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4d9a6-12ef-4934-9100-6cc7ad4de8bb None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:33.397862 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4d9a6-12ef-4934-9100-6cc7ad4de8bb None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:33.398188 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4d9a6-12ef-4934-9100-6cc7ad4de8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:33.415882 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-10c4d9a6-12ef-4934-9100-6cc7ad4de8bb None None] MFA Rules not processed for user `bb3597f57da7487cb6fc364cb207f98c`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:33.417172 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-10c4d9a6-12ef-4934-9100-6cc7ad4de8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:33.420641 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2065/4121] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:33 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 24 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 21:23:33.426157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d7ecf-c2de-4128-9850-8b90dd308d81 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:33.426714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d7ecf-c2de-4128-9850-8b90dd308d81 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:33.426901 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d7ecf-c2de-4128-9850-8b90dd308d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:33.450051 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-ce0d7ecf-c2de-4128-9850-8b90dd308d81 None None] MFA Rules not processed for user `bb3597f57da7487cb6fc364cb207f98c`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:33.452118 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ce0d7ecf-c2de-4128-9850-8b90dd308d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:33.460841 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2057/4122] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:23:33.465234 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c4d9a6-12ef-4934-9100-6cc7ad4de8bb None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:33.476324 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c4d9a6-12ef-4934-9100-6cc7ad4de8bb None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:33.481130 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a998942e-4200-4ec0-bb8c-54a8635e6feb tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3597f57da7487cb6fc364cb207f98c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8eb0464e4654fdc85af24d7eaa5660e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:33.481987 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998942e-4200-4ec0-bb8c-54a8635e6feb tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:33.482259 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998942e-4200-4ec0-bb8c-54a8635e6feb tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:33.482584 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998942e-4200-4ec0-bb8c-54a8635e6feb tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] PATH_INFO: `/v3/users/bb3597f57da7487cb6fc364cb207f98c/password` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:33.577255 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a998942e-4200-4ec0-bb8c-54a8635e6feb tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'bb3597f57da7487cb6fc364cb207f98c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:33.648527 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2066/4123] 10.222.0.23 () {60 vars in 1268 bytes} [Sat Apr 30 21:23:33 2022] POST /identity/v3/users/bb3597f57da7487cb6fc364cb207f98c/password => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:23:34.654169 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc2f24-4fc3-4e56-8d1c-ae1cc68178f2 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:34.654640 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc2f24-4fc3-4e56-8d1c-ae1cc68178f2 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:34.654758 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc2f24-4fc3-4e56-8d1c-ae1cc68178f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:34.672571 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-ccbc2f24-4fc3-4e56-8d1c-ae1cc68178f2 None None] MFA Rules not processed for user `bb3597f57da7487cb6fc364cb207f98c`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:34.674064 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ccbc2f24-4fc3-4e56-8d1c-ae1cc68178f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:34.677716 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2058/4124] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:34 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 25 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 21:23:34.682643 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68dbde-ba6d-4676-a2f5-53a2bf379c7e None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:34.683239 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68dbde-ba6d-4676-a2f5-53a2bf379c7e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:34.683337 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68dbde-ba6d-4676-a2f5-53a2bf379c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:34.701312 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-9a68dbde-ba6d-4676-a2f5-53a2bf379c7e None None] MFA Rules not processed for user `bb3597f57da7487cb6fc364cb207f98c`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:34.702572 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9a68dbde-ba6d-4676-a2f5-53a2bf379c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:34.709501 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2067/4125] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:23:34.713538 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc2f24-4fc3-4e56-8d1c-ae1cc68178f2 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:34.724863 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc2f24-4fc3-4e56-8d1c-ae1cc68178f2 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:34.728811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21edf81e-22f0-498e-bb38-faee26412f00 tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3597f57da7487cb6fc364cb207f98c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8eb0464e4654fdc85af24d7eaa5660e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:34.729648 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21edf81e-22f0-498e-bb38-faee26412f00 tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:34.729964 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21edf81e-22f0-498e-bb38-faee26412f00 tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:34.730237 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21edf81e-22f0-498e-bb38-faee26412f00 tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] PATH_INFO: `/v3/users/bb3597f57da7487cb6fc364cb207f98c/password` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:34.823109 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-21edf81e-22f0-498e-bb38-faee26412f00 tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'bb3597f57da7487cb6fc364cb207f98c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:34.905689 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2059/4126] 10.222.0.23 () {60 vars in 1268 bytes} [Sat Apr 30 21:23:34 2022] POST /identity/v3/users/bb3597f57da7487cb6fc364cb207f98c/password => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:35.911455 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18092c6-b5fa-4483-b4d6-d3de3a5a6856 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:35.911999 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18092c6-b5fa-4483-b4d6-d3de3a5a6856 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:35.911999 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18092c6-b5fa-4483-b4d6-d3de3a5a6856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:35.931515 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-e18092c6-b5fa-4483-b4d6-d3de3a5a6856 None None] MFA Rules not processed for user `bb3597f57da7487cb6fc364cb207f98c`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:35.932790 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e18092c6-b5fa-4483-b4d6-d3de3a5a6856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:35.936057 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2068/4127] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:35 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 21:23:35.940715 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4bee6-33f8-44f3-9255-c3be2b0181e3 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:35.941195 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4bee6-33f8-44f3-9255-c3be2b0181e3 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:35.941309 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4bee6-33f8-44f3-9255-c3be2b0181e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:35.962474 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-6ea4bee6-33f8-44f3-9255-c3be2b0181e3 None None] MFA Rules not processed for user `bb3597f57da7487cb6fc364cb207f98c`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:35.963717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6ea4bee6-33f8-44f3-9255-c3be2b0181e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:35.971044 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2060/4128] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:23:35.975244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18092c6-b5fa-4483-b4d6-d3de3a5a6856 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:35.987179 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18092c6-b5fa-4483-b4d6-d3de3a5a6856 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:35.992098 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ec807-5b61-4c4a-9f98-ca138fb35b95 tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3597f57da7487cb6fc364cb207f98c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8eb0464e4654fdc85af24d7eaa5660e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:35.992969 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ec807-5b61-4c4a-9f98-ca138fb35b95 tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:35.993252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ec807-5b61-4c4a-9f98-ca138fb35b95 tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:35.993774 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ec807-5b61-4c4a-9f98-ca138fb35b95 tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] PATH_INFO: `/v3/users/bb3597f57da7487cb6fc364cb207f98c/password` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:36.143630 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-389ec807-5b61-4c4a-9f98-ca138fb35b95 tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'bb3597f57da7487cb6fc364cb207f98c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:36.289720 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2069/4129] 10.222.0.23 () {60 vars in 1268 bytes} [Sat Apr 30 21:23:35 2022] POST /identity/v3/users/bb3597f57da7487cb6fc364cb207f98c/password => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:37.297503 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ff53c-8a30-411c-9555-e16a5fb01fae None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:37.298147 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ff53c-8a30-411c-9555-e16a5fb01fae None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:37.298147 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ff53c-8a30-411c-9555-e16a5fb01fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:37.317103 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-f89ff53c-8a30-411c-9555-e16a5fb01fae None None] MFA Rules not processed for user `bb3597f57da7487cb6fc364cb207f98c`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:37.318374 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f89ff53c-8a30-411c-9555-e16a5fb01fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:37.322432 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2061/4130] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:37 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 21:23:38.328360 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9810db-a203-4fa2-89e0-28f260c71f46 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:38.328892 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9810db-a203-4fa2-89e0-28f260c71f46 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:38.329004 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9810db-a203-4fa2-89e0-28f260c71f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:38.347335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-5d9810db-a203-4fa2-89e0-28f260c71f46 None None] MFA Rules not processed for user `bb3597f57da7487cb6fc364cb207f98c`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:38.349161 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5d9810db-a203-4fa2-89e0-28f260c71f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:38.356083 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2070/4131] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:23:38.362174 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e094f-6669-4217-afb7-3473f3339e99 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:38.362645 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e094f-6669-4217-afb7-3473f3339e99 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:38.362743 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e094f-6669-4217-afb7-3473f3339e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:38.381042 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-4e2e094f-6669-4217-afb7-3473f3339e99 None None] MFA Rules not processed for user `bb3597f57da7487cb6fc364cb207f98c`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:38.382345 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4e2e094f-6669-4217-afb7-3473f3339e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:38.385428 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2062/4132] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:38 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 24 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 21:23:38.389865 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe6943-b08f-4e5b-b9f8-3d6a60d9a198 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:38.390157 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe6943-b08f-4e5b-b9f8-3d6a60d9a198 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:38.390439 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe6943-b08f-4e5b-b9f8-3d6a60d9a198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:38.587039 ncdv-master-1 devstack@keystone.service[91018]: WARNING keystone.server.flask.application [None req-1dfe6943-b08f-4e5b-b9f8-3d6a60d9a198 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.23: keystone.exception.Unauthorized: The request you have made requires authentication. Apr 30 21:23:38.588653 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2071/4133] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:38 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 200 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Apr 30 21:23:38.595330 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d75a3-89c5-40f5-acad-ad61891cee3f None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:38.595623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d75a3-89c5-40f5-acad-ad61891cee3f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:38.595904 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d75a3-89c5-40f5-acad-ad61891cee3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:38.690335 ncdv-master-1 devstack@keystone.service[91017]: WARNING keystone.server.flask.application [None req-cc6d75a3-89c5-40f5-acad-ad61891cee3f None None] Authorization failed. The request you have made requires authentication. from 10.222.0.23: keystone.exception.Unauthorized: The request you have made requires authentication. Apr 30 21:23:38.691904 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2063/4134] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:38 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 98 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Apr 30 21:23:38.696465 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b22340-70e4-4791-85fa-8b0c840fa36f None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:38.696864 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b22340-70e4-4791-85fa-8b0c840fa36f None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:38.697295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b22340-70e4-4791-85fa-8b0c840fa36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:38.720270 ncdv-master-1 devstack@keystone.service[91018]: WARNING keystone.server.flask.application [None req-e9b22340-70e4-4791-85fa-8b0c840fa36f None None] Authorization failed. The request you have made requires authentication. from 10.222.0.23: keystone.exception.Unauthorized: The request you have made requires authentication. Apr 30 21:23:38.721900 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2072/4135] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:38 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 27 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Apr 30 21:23:39.758330 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d75a3-89c5-40f5-acad-ad61891cee3f None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:39.760211 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-cc6d75a3-89c5-40f5-acad-ad61891cee3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:39.826497 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d75a3-89c5-40f5-acad-ad61891cee3f None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:39.830996 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df4f90-73c6-4c90-9bf4-7e55d48299fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:39.831861 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df4f90-73c6-4c90-9bf4-7e55d48299fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:39.832164 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df4f90-73c6-4c90-9bf4-7e55d48299fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:39.832440 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df4f90-73c6-4c90-9bf4-7e55d48299fa admin admin] PATH_INFO: `/v3/users/a42c6a51b78b408f85cbacb545f06707` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:39.833622 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11df4f90-73c6-4c90-9bf4-7e55d48299fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=a42c6a51b78b408f85cbacb545f06707)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:39.835595 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11df4f90-73c6-4c90-9bf4-7e55d48299fa admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:40.071873 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-11df4f90-73c6-4c90-9bf4-7e55d48299fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a42c6a51b78b408f85cbacb545f06707'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:40.084190 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-11df4f90-73c6-4c90-9bf4-7e55d48299fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a42c6a51b78b408f85cbacb545f06707'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:40.173509 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-11df4f90-73c6-4c90-9bf4-7e55d48299fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a42c6a51b78b408f85cbacb545f06707'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:40.174266 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-11df4f90-73c6-4c90-9bf4-7e55d48299fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a42c6a51b78b408f85cbacb545f06707'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:40.182142 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-11df4f90-73c6-4c90-9bf4-7e55d48299fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a42c6a51b78b408f85cbacb545f06707'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:40.188082 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2064/4136] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:23:39 2022] DELETE /identity/v3/users/a42c6a51b78b408f85cbacb545f06707 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:40.495936 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b22340-70e4-4791-85fa-8b0c840fa36f None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:40.498395 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e9b22340-70e4-4791-85fa-8b0c840fa36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:40.576688 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b22340-70e4-4791-85fa-8b0c840fa36f None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:40.581457 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5fba95-c77f-4a8e-b975-4f3219f26e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:40.582974 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fba95-c77f-4a8e-b975-4f3219f26e09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:40.583253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fba95-c77f-4a8e-b975-4f3219f26e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:40.583525 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fba95-c77f-4a8e-b975-4f3219f26e09 admin admin] PATH_INFO: `/v3/projects/3e12f061321b434e92c0f85031c54ef8` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:40.584757 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5fba95-c77f-4a8e-b975-4f3219f26e09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e12f061321b434e92c0f85031c54ef8)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:40.586714 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5fba95-c77f-4a8e-b975-4f3219f26e09 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:40.717383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ac5fba95-c77f-4a8e-b975-4f3219f26e09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e12f061321b434e92c0f85031c54ef8', 'request_id': 'req-ac5fba95-c77f-4a8e-b975-4f3219f26e09'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:40.726203 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ac5fba95-c77f-4a8e-b975-4f3219f26e09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e12f061321b434e92c0f85031c54ef8', 'request_id': 'req-ac5fba95-c77f-4a8e-b975-4f3219f26e09'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:40.733075 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ac5fba95-c77f-4a8e-b975-4f3219f26e09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e12f061321b434e92c0f85031c54ef8', 'request_id': 'req-ac5fba95-c77f-4a8e-b975-4f3219f26e09'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:40.812674 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ac5fba95-c77f-4a8e-b975-4f3219f26e09 admin admin] The token cache is being invalidate because project 3e12f061321b434e92c0f85031c54ef8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:23:40.813040 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ac5fba95-c77f-4a8e-b975-4f3219f26e09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:40.813828 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ac5fba95-c77f-4a8e-b975-4f3219f26e09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:40.815796 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2073/4137] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:23:40 2022] DELETE /identity/v3/projects/3e12f061321b434e92c0f85031c54ef8 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:40.825694 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a5cd3-acfe-4e6c-aabf-d1157392fca3 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:40.826253 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a5cd3-acfe-4e6c-aabf-d1157392fca3 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:40.826350 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a5cd3-acfe-4e6c-aabf-d1157392fca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:40.852753 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-5b1a5cd3-acfe-4e6c-aabf-d1157392fca3 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:40.853839 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5b1a5cd3-acfe-4e6c-aabf-d1157392fca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:40.931564 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2065/4138] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:23:40.940806 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154289b5-11b4-4189-a560-54391f532e16 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:40.941099 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154289b5-11b4-4189-a560-54391f532e16 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:40.941435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154289b5-11b4-4189-a560-54391f532e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:40.963586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-154289b5-11b4-4189-a560-54391f532e16 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:40.965096 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-154289b5-11b4-4189-a560-54391f532e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:40.973861 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2074/4139] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:23:40.977799 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a5cd3-acfe-4e6c-aabf-d1157392fca3 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:40.988672 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a5cd3-acfe-4e6c-aabf-d1157392fca3 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:40.993318 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc866d6-5228-4168-8996-b1f061a9a5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:40.998073 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc866d6-5228-4168-8996-b1f061a9a5a6 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:40.998460 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc866d6-5228-4168-8996-b1f061a9a5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:40.998895 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc866d6-5228-4168-8996-b1f061a9a5a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:40.999632 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc866d6-5228-4168-8996-b1f061a9a5a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:23:40.999879 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc866d6-5228-4168-8996-b1f061a9a5a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:41.001533 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc866d6-5228-4168-8996-b1f061a9a5a6 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:41.017488 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2066/4140] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:23:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:23:41.018802 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154289b5-11b4-4189-a560-54391f532e16 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:41.028603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154289b5-11b4-4189-a560-54391f532e16 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:41.033819 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19936b5c-13d0-4e53-be89-0502f8f3ff08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:41.034441 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19936b5c-13d0-4e53-be89-0502f8f3ff08 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:41.034717 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19936b5c-13d0-4e53-be89-0502f8f3ff08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:41.041059 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19936b5c-13d0-4e53-be89-0502f8f3ff08 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:41.041059 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19936b5c-13d0-4e53-be89-0502f8f3ff08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:41.041059 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19936b5c-13d0-4e53-be89-0502f8f3ff08 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:41.146735 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2075/4141] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:23:41 2022] POST /identity/v3/projects => generated 365 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:23:41.150298 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc866d6-5228-4168-8996-b1f061a9a5a6 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:41.161402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc866d6-5228-4168-8996-b1f061a9a5a6 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:41.219414 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c1b531-016a-4381-93d0-8790ac0a29ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:41.220093 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1b531-016a-4381-93d0-8790ac0a29ae admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:41.220377 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1b531-016a-4381-93d0-8790ac0a29ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:41.220656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1b531-016a-4381-93d0-8790ac0a29ae admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:41.221343 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c1b531-016a-4381-93d0-8790ac0a29ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:41.223895 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c1b531-016a-4381-93d0-8790ac0a29ae admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:41.404269 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2067/4142] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:23:41 2022] POST /identity/v3/users => generated 283 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:23:41.408378 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19936b5c-13d0-4e53-be89-0502f8f3ff08 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:41.418899 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19936b5c-13d0-4e53-be89-0502f8f3ff08 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:41.423636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8c081-3a5c-4c01-a26d-bb09549fec13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:41.424289 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8c081-3a5c-4c01-a26d-bb09549fec13 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:41.424570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8c081-3a5c-4c01-a26d-bb09549fec13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:41.424843 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8c081-3a5c-4c01-a26d-bb09549fec13 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:41.425560 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde8c081-3a5c-4c01-a26d-bb09549fec13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:41.427194 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde8c081-3a5c-4c01-a26d-bb09549fec13 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:41.437432 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2076/4143] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:23:41.442091 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c1b531-016a-4381-93d0-8790ac0a29ae admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:41.452182 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c1b531-016a-4381-93d0-8790ac0a29ae admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:41.456748 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ef9e0-9ee4-46c2-bb3d-4bf8a2f371f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:41.458059 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ef9e0-9ee4-46c2-bb3d-4bf8a2f371f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:41.458338 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ef9e0-9ee4-46c2-bb3d-4bf8a2f371f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:41.458611 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ef9e0-9ee4-46c2-bb3d-4bf8a2f371f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:41.459330 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ef9e0-9ee4-46c2-bb3d-4bf8a2f371f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:41.460923 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ef9e0-9ee4-46c2-bb3d-4bf8a2f371f8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:41.470776 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2068/4144] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:23:41.475044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8c081-3a5c-4c01-a26d-bb09549fec13 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:41.485014 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8c081-3a5c-4c01-a26d-bb09549fec13 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:41.490441 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb59f7-d053-44a7-a8ee-25ba96ae9efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:41.491340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb59f7-d053-44a7-a8ee-25ba96ae9efc admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:41.491643 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb59f7-d053-44a7-a8ee-25ba96ae9efc admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:41.491916 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb59f7-d053-44a7-a8ee-25ba96ae9efc admin admin] PATH_INFO: `/v3/projects/f310fd5a6bdd4e1ebf08bfbc064975ea/users/f1377a9a42b344329e636b7a471ea89c/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:41.506609 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb59f7-d053-44a7-a8ee-25ba96ae9efc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f310fd5a6bdd4e1ebf08bfbc064975ea, user_id=f1377a9a42b344329e636b7a471ea89c, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:41.509337 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb59f7-d053-44a7-a8ee-25ba96ae9efc admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:41.577828 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2077/4145] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:23:41 2022] PUT /identity/v3/projects/f310fd5a6bdd4e1ebf08bfbc064975ea/users/f1377a9a42b344329e636b7a471ea89c/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:23:41.589701 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3151f-0966-4cae-9685-5a4706796496 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:41.590052 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3151f-0966-4cae-9685-5a4706796496 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:41.590329 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3151f-0966-4cae-9685-5a4706796496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:41.617561 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-d6b3151f-0966-4cae-9685-5a4706796496 None None] MFA Rules not processed for user `f1377a9a42b344329e636b7a471ea89c`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:41.618797 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d6b3151f-0966-4cae-9685-5a4706796496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:41.680979 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2069/4146] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:41 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:23:41.694171 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb59f7-d053-44a7-a8ee-25ba96ae9efc admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:41.695881 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-fffb59f7-d053-44a7-a8ee-25ba96ae9efc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:41.766368 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb59f7-d053-44a7-a8ee-25ba96ae9efc admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:41.772265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b7b38-d65c-4ae1-b0a1-d7cf85f34f4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:41.772907 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b7b38-d65c-4ae1-b0a1-d7cf85f34f4b service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:41.773193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b7b38-d65c-4ae1-b0a1-d7cf85f34f4b service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:41.773471 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b7b38-d65c-4ae1-b0a1-d7cf85f34f4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:41.781258 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b7b38-d65c-4ae1-b0a1-d7cf85f34f4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:41.783951 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b7b38-d65c-4ae1-b0a1-d7cf85f34f4b service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:41.792054 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2078/4147] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:23:41 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:23:41.806437 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8e272-0cfe-44da-8969-7aa3c00e92fc None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:41.806727 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8e272-0cfe-44da-8969-7aa3c00e92fc None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:41.807035 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8e272-0cfe-44da-8969-7aa3c00e92fc None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:41.808411 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2070/4148] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:23:41.812954 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b7b38-d65c-4ae1-b0a1-d7cf85f34f4b service nova] Authenticating service token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 30 21:23:41.824640 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b7b38-d65c-4ae1-b0a1-d7cf85f34f4b service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:41.832565 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b7b38-d65c-4ae1-b0a1-d7cf85f34f4b service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:41.836872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cace68-f572-4574-b0b7-81824d665ace tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1377a9a42b344329e636b7a471ea89c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f310fd5a6bdd4e1ebf08bfbc064975ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:41.837712 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cace68-f572-4574-b0b7-81824d665ace tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:41.838074 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cace68-f572-4574-b0b7-81824d665ace tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:41.838370 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cace68-f572-4574-b0b7-81824d665ace tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] PATH_INFO: `/v3/projects/f310fd5a6bdd4e1ebf08bfbc064975ea` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:41.841365 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cace68-f572-4574-b0b7-81824d665ace tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] RBAC: Authorizing `identity:get_project(project_id=f310fd5a6bdd4e1ebf08bfbc064975ea)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:41.841365 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cace68-f572-4574-b0b7-81824d665ace tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:41.843227 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2079/4149] 10.222.0.23 () {58 vars in 1443 bytes} [Sat Apr 30 21:23:41 2022] GET /identity/v3/projects/f310fd5a6bdd4e1ebf08bfbc064975ea => generated 365 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:23:41.870837 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea884efd-0116-485e-8fcb-27745f2bd4f3 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:41.871338 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea884efd-0116-485e-8fcb-27745f2bd4f3 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:41.871468 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea884efd-0116-485e-8fcb-27745f2bd4f3 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:41.872840 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2071/4150] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:23:41.877858 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cace68-f572-4574-b0b7-81824d665ace tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] Authenticating service token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 30 21:23:41.892392 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cace68-f572-4574-b0b7-81824d665ace tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:41.901794 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cace68-f572-4574-b0b7-81824d665ace tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:41.906443 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145e93f-130a-4a8f-93d4-02cbb876cd0d tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1377a9a42b344329e636b7a471ea89c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f310fd5a6bdd4e1ebf08bfbc064975ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:41.907313 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145e93f-130a-4a8f-93d4-02cbb876cd0d tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:41.907600 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145e93f-130a-4a8f-93d4-02cbb876cd0d tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:41.907879 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145e93f-130a-4a8f-93d4-02cbb876cd0d tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] PATH_INFO: `/v3/projects/f310fd5a6bdd4e1ebf08bfbc064975ea` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:41.909110 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145e93f-130a-4a8f-93d4-02cbb876cd0d tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] RBAC: Authorizing `identity:get_project(project_id=f310fd5a6bdd4e1ebf08bfbc064975ea)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:41.911567 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145e93f-130a-4a8f-93d4-02cbb876cd0d tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:41.916088 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2080/4151] 10.222.0.23 () {58 vars in 1443 bytes} [Sat Apr 30 21:23:41 2022] GET /identity/v3/projects/f310fd5a6bdd4e1ebf08bfbc064975ea => generated 365 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:23:41.955455 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac7a73-b39b-4f7e-86c0-bd9f68e0ae14 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:41.955742 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac7a73-b39b-4f7e-86c0-bd9f68e0ae14 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:41.956024 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac7a73-b39b-4f7e-86c0-bd9f68e0ae14 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:41.958000 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2072/4152] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:23:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:23:41.965385 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145e93f-130a-4a8f-93d4-02cbb876cd0d tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] Authenticating service token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 30 21:23:41.981338 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145e93f-130a-4a8f-93d4-02cbb876cd0d tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:41.990487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145e93f-130a-4a8f-93d4-02cbb876cd0d tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:41.995767 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3134e4f-848c-4702-a11f-444041201c9e tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1377a9a42b344329e636b7a471ea89c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f310fd5a6bdd4e1ebf08bfbc064975ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:41.996688 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3134e4f-848c-4702-a11f-444041201c9e tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:41.996970 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3134e4f-848c-4702-a11f-444041201c9e tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:41.997243 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3134e4f-848c-4702-a11f-444041201c9e tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] PATH_INFO: `/v3/projects/f310fd5a6bdd4e1ebf08bfbc064975ea` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:41.998503 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3134e4f-848c-4702-a11f-444041201c9e tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] RBAC: Authorizing `identity:get_project(project_id=f310fd5a6bdd4e1ebf08bfbc064975ea)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:42.000387 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3134e4f-848c-4702-a11f-444041201c9e tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:42.005987 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2081/4153] 10.222.0.23 () {58 vars in 1443 bytes} [Sat Apr 30 21:23:41 2022] GET /identity/v3/projects/f310fd5a6bdd4e1ebf08bfbc064975ea => generated 365 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:23:42.350533 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f54ed5-625e-46ea-b861-04fcd28b95d9 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:42.350824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f54ed5-625e-46ea-b861-04fcd28b95d9 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:42.351101 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f54ed5-625e-46ea-b861-04fcd28b95d9 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:42.352439 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2073/4154] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:23:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:23:42.357268 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3134e4f-848c-4702-a11f-444041201c9e tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] Authenticating service token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 30 21:23:42.359245 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b3134e4f-848c-4702-a11f-444041201c9e tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:42.376618 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3134e4f-848c-4702-a11f-444041201c9e tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:42.384695 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3134e4f-848c-4702-a11f-444041201c9e tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:42.389049 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12bf644-a20b-44ce-a7e5-ca211cdb5c90 tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1377a9a42b344329e636b7a471ea89c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f310fd5a6bdd4e1ebf08bfbc064975ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:42.389989 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bf644-a20b-44ce-a7e5-ca211cdb5c90 tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:42.390276 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bf644-a20b-44ce-a7e5-ca211cdb5c90 tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:42.390554 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bf644-a20b-44ce-a7e5-ca211cdb5c90 tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] PATH_INFO: `/v3/projects/f310fd5a6bdd4e1ebf08bfbc064975ea` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:42.391799 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12bf644-a20b-44ce-a7e5-ca211cdb5c90 tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] RBAC: Authorizing `identity:get_project(project_id=f310fd5a6bdd4e1ebf08bfbc064975ea)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:42.393579 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12bf644-a20b-44ce-a7e5-ca211cdb5c90 tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:42.395354 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2082/4155] 10.222.0.23 () {58 vars in 1443 bytes} [Sat Apr 30 21:23:42 2022] GET /identity/v3/projects/f310fd5a6bdd4e1ebf08bfbc064975ea => generated 365 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:23:42.433203 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14cc64-4d04-4907-81a9-be4c9c765aeb None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:42.433489 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14cc64-4d04-4907-81a9-be4c9c765aeb None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:42.433784 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14cc64-4d04-4907-81a9-be4c9c765aeb None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:42.435137 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2074/4156] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:23:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:23:42.439848 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12bf644-a20b-44ce-a7e5-ca211cdb5c90 tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] Authenticating service token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 30 21:23:42.453243 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12bf644-a20b-44ce-a7e5-ca211cdb5c90 tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:42.461350 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12bf644-a20b-44ce-a7e5-ca211cdb5c90 tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:42.465385 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99711d01-1e90-4c0c-a24e-9aa0efa7f2ec tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1377a9a42b344329e636b7a471ea89c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f310fd5a6bdd4e1ebf08bfbc064975ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:42.466262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99711d01-1e90-4c0c-a24e-9aa0efa7f2ec tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:42.466544 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99711d01-1e90-4c0c-a24e-9aa0efa7f2ec tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:42.466817 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99711d01-1e90-4c0c-a24e-9aa0efa7f2ec tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] PATH_INFO: `/v3/projects/f310fd5a6bdd4e1ebf08bfbc064975ea` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:42.468015 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99711d01-1e90-4c0c-a24e-9aa0efa7f2ec tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] RBAC: Authorizing `identity:get_project(project_id=f310fd5a6bdd4e1ebf08bfbc064975ea)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:42.470030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99711d01-1e90-4c0c-a24e-9aa0efa7f2ec tempest-QuotasTestJSON-1612110372 tempest-QuotasTestJSON-1612110372-project] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:42.471677 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2083/4157] 10.222.0.23 () {58 vars in 1443 bytes} [Sat Apr 30 21:23:42 2022] GET /identity/v3/projects/f310fd5a6bdd4e1ebf08bfbc064975ea => generated 365 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:23:42.502622 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14cc64-4d04-4907-81a9-be4c9c765aeb None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:42.565001 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14cc64-4d04-4907-81a9-be4c9c765aeb None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:42.569598 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973c084-ff11-4c68-ad92-0bd8d7b8206b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:42.570506 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973c084-ff11-4c68-ad92-0bd8d7b8206b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:42.570817 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973c084-ff11-4c68-ad92-0bd8d7b8206b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:42.571157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973c084-ff11-4c68-ad92-0bd8d7b8206b admin admin] PATH_INFO: `/v3/users/f1377a9a42b344329e636b7a471ea89c` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:42.572311 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a973c084-ff11-4c68-ad92-0bd8d7b8206b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1377a9a42b344329e636b7a471ea89c)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:42.574281 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a973c084-ff11-4c68-ad92-0bd8d7b8206b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:42.804769 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a973c084-ff11-4c68-ad92-0bd8d7b8206b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1377a9a42b344329e636b7a471ea89c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:42.820166 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a973c084-ff11-4c68-ad92-0bd8d7b8206b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1377a9a42b344329e636b7a471ea89c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:42.898769 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a973c084-ff11-4c68-ad92-0bd8d7b8206b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1377a9a42b344329e636b7a471ea89c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:42.899422 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a973c084-ff11-4c68-ad92-0bd8d7b8206b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1377a9a42b344329e636b7a471ea89c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:42.907118 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a973c084-ff11-4c68-ad92-0bd8d7b8206b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1377a9a42b344329e636b7a471ea89c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:42.914163 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2075/4158] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:23:42 2022] DELETE /identity/v3/users/f1377a9a42b344329e636b7a471ea89c => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:42.918724 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f64711-57af-4ee7-9267-614ca8cf0baa None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:42.919113 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f64711-57af-4ee7-9267-614ca8cf0baa None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:42.919292 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f64711-57af-4ee7-9267-614ca8cf0baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:42.938226 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-e6f64711-57af-4ee7-9267-614ca8cf0baa None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:42.939520 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e6f64711-57af-4ee7-9267-614ca8cf0baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:42.999850 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2084/4159] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:23:43.010144 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973c084-ff11-4c68-ad92-0bd8d7b8206b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:43.011522 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a973c084-ff11-4c68-ad92-0bd8d7b8206b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:43.068100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973c084-ff11-4c68-ad92-0bd8d7b8206b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:43.071700 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64498d53-4943-461a-96b2-70c94789755f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:43.072340 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64498d53-4943-461a-96b2-70c94789755f service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:43.072622 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64498d53-4943-461a-96b2-70c94789755f service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:43.072897 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64498d53-4943-461a-96b2-70c94789755f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:43.082453 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64498d53-4943-461a-96b2-70c94789755f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:43.083836 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64498d53-4943-461a-96b2-70c94789755f service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:43.093288 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2076/4160] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:23:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:23:43.520060 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f64711-57af-4ee7-9267-614ca8cf0baa None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:43.521698 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e6f64711-57af-4ee7-9267-614ca8cf0baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:43.542200 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f64711-57af-4ee7-9267-614ca8cf0baa None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:43.543932 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5646a-a79b-4dc6-b7f4-498fc088e6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:43.544901 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5646a-a79b-4dc6-b7f4-498fc088e6f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:43.545282 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5646a-a79b-4dc6-b7f4-498fc088e6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:43.545654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5646a-a79b-4dc6-b7f4-498fc088e6f8 admin admin] PATH_INFO: `/v3/projects/f310fd5a6bdd4e1ebf08bfbc064975ea` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:43.547568 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5646a-a79b-4dc6-b7f4-498fc088e6f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f310fd5a6bdd4e1ebf08bfbc064975ea)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:43.550068 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5646a-a79b-4dc6-b7f4-498fc088e6f8 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:43.687390 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-88e5646a-a79b-4dc6-b7f4-498fc088e6f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f310fd5a6bdd4e1ebf08bfbc064975ea', 'request_id': 'req-88e5646a-a79b-4dc6-b7f4-498fc088e6f8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:43.693224 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-88e5646a-a79b-4dc6-b7f4-498fc088e6f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f310fd5a6bdd4e1ebf08bfbc064975ea', 'request_id': 'req-88e5646a-a79b-4dc6-b7f4-498fc088e6f8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:43.699244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-88e5646a-a79b-4dc6-b7f4-498fc088e6f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f310fd5a6bdd4e1ebf08bfbc064975ea', 'request_id': 'req-88e5646a-a79b-4dc6-b7f4-498fc088e6f8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:43.784105 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-88e5646a-a79b-4dc6-b7f4-498fc088e6f8 admin admin] The token cache is being invalidate because project f310fd5a6bdd4e1ebf08bfbc064975ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:23:43.784395 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-88e5646a-a79b-4dc6-b7f4-498fc088e6f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:43.785391 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-88e5646a-a79b-4dc6-b7f4-498fc088e6f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:43.786873 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2085/4161] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:23:43 2022] DELETE /identity/v3/projects/f310fd5a6bdd4e1ebf08bfbc064975ea => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:43.794085 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a0810-1323-4e17-aed5-8d15b56b66d5 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:43.794582 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a0810-1323-4e17-aed5-8d15b56b66d5 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:43.794691 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a0810-1323-4e17-aed5-8d15b56b66d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:43.813072 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-516a0810-1323-4e17-aed5-8d15b56b66d5 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:43.814467 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-516a0810-1323-4e17-aed5-8d15b56b66d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:43.878518 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2077/4162] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:23:43.887485 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a695332-0bcd-46d9-a983-cad89719d2c5 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:43.887858 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a695332-0bcd-46d9-a983-cad89719d2c5 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:43.888135 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a695332-0bcd-46d9-a983-cad89719d2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:43.906654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-8a695332-0bcd-46d9-a983-cad89719d2c5 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:43.907781 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8a695332-0bcd-46d9-a983-cad89719d2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:43.915740 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2086/4163] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:23:43.920120 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a0810-1323-4e17-aed5-8d15b56b66d5 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:43.930387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a0810-1323-4e17-aed5-8d15b56b66d5 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:43.935037 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b01255-604e-4db9-ab2b-101af01981df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:43.935711 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b01255-604e-4db9-ab2b-101af01981df admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:43.935974 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b01255-604e-4db9-ab2b-101af01981df admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:43.936243 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b01255-604e-4db9-ab2b-101af01981df admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:43.936959 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b01255-604e-4db9-ab2b-101af01981df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:23:43.940327 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b01255-604e-4db9-ab2b-101af01981df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:43.940327 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b01255-604e-4db9-ab2b-101af01981df admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:43.952098 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2078/4164] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:23:43.966498 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a695332-0bcd-46d9-a983-cad89719d2c5 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:43.977551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a695332-0bcd-46d9-a983-cad89719d2c5 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:43.983230 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97927e35-dbd9-4a52-95d7-4d46e00d9534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:43.984111 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97927e35-dbd9-4a52-95d7-4d46e00d9534 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:43.984391 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97927e35-dbd9-4a52-95d7-4d46e00d9534 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:43.984711 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97927e35-dbd9-4a52-95d7-4d46e00d9534 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:43.985518 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97927e35-dbd9-4a52-95d7-4d46e00d9534 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:43.987758 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97927e35-dbd9-4a52-95d7-4d46e00d9534 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:44.101623 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2087/4165] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:23:43 2022] POST /identity/v3/projects => generated 365 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:23:44.117175 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b01255-604e-4db9-ab2b-101af01981df admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:44.127669 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b01255-604e-4db9-ab2b-101af01981df admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:44.198475 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b06f7-d82c-44d6-ad23-f03fe498214b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:44.199294 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b06f7-d82c-44d6-ad23-f03fe498214b admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:44.199621 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b06f7-d82c-44d6-ad23-f03fe498214b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:44.199933 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b06f7-d82c-44d6-ad23-f03fe498214b admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:44.200580 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b06f7-d82c-44d6-ad23-f03fe498214b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:44.202627 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b06f7-d82c-44d6-ad23-f03fe498214b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:44.299745 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2079/4166] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:23:44 2022] POST /identity/v3/users => generated 283 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:23:44.304297 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97927e35-dbd9-4a52-95d7-4d46e00d9534 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:44.314385 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97927e35-dbd9-4a52-95d7-4d46e00d9534 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:44.319526 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feadd799-479c-4671-99d5-262b351583fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:44.320177 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feadd799-479c-4671-99d5-262b351583fd admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:44.320463 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feadd799-479c-4671-99d5-262b351583fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:44.320748 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feadd799-479c-4671-99d5-262b351583fd admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:44.323982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feadd799-479c-4671-99d5-262b351583fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:44.323982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feadd799-479c-4671-99d5-262b351583fd admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:44.333811 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2088/4167] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:23:44.337641 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b06f7-d82c-44d6-ad23-f03fe498214b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:44.348603 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b06f7-d82c-44d6-ad23-f03fe498214b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:44.353214 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7be7f0-d3b1-4193-9e7d-aba73891cdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:44.353901 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7be7f0-d3b1-4193-9e7d-aba73891cdf0 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:44.354182 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7be7f0-d3b1-4193-9e7d-aba73891cdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:44.354456 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7be7f0-d3b1-4193-9e7d-aba73891cdf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:44.355167 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7be7f0-d3b1-4193-9e7d-aba73891cdf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:44.360634 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7be7f0-d3b1-4193-9e7d-aba73891cdf0 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:44.366508 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2080/4168] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:23:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:23:44.370639 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feadd799-479c-4671-99d5-262b351583fd admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:44.380710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feadd799-479c-4671-99d5-262b351583fd admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:44.385251 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa20c876-facd-4aed-9e41-979420d2d92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:44.386207 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20c876-facd-4aed-9e41-979420d2d92e admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:44.386493 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20c876-facd-4aed-9e41-979420d2d92e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:44.386771 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20c876-facd-4aed-9e41-979420d2d92e admin admin] PATH_INFO: `/v3/projects/d60fbfd64cc04f3eb8f2db6746afaf04/users/a44db0249a214dcc9b2985ff18a3a690/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:44.401984 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa20c876-facd-4aed-9e41-979420d2d92e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d60fbfd64cc04f3eb8f2db6746afaf04, user_id=a44db0249a214dcc9b2985ff18a3a690, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:44.404824 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa20c876-facd-4aed-9e41-979420d2d92e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:44.506321 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2089/4169] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:23:44 2022] PUT /identity/v3/projects/d60fbfd64cc04f3eb8f2db6746afaf04/users/a44db0249a214dcc9b2985ff18a3a690/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:23:44.521307 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872a1bd-9518-4c87-9327-1716edc0126d None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:44.521623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872a1bd-9518-4c87-9327-1716edc0126d None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:44.521946 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872a1bd-9518-4c87-9327-1716edc0126d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:44.549112 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-6872a1bd-9518-4c87-9327-1716edc0126d None None] MFA Rules not processed for user `a44db0249a214dcc9b2985ff18a3a690`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:44.550438 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6872a1bd-9518-4c87-9327-1716edc0126d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:44.615423 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2081/4170] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:44 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:23:44.627295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa20c876-facd-4aed-9e41-979420d2d92e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:44.629565 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-fa20c876-facd-4aed-9e41-979420d2d92e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:44.699900 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa20c876-facd-4aed-9e41-979420d2d92e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:44.703664 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91139b-5410-498b-a359-9903608af738 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:44.704299 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91139b-5410-498b-a359-9903608af738 service cinder] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:44.704579 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91139b-5410-498b-a359-9903608af738 service cinder] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:44.704853 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91139b-5410-498b-a359-9903608af738 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:44.713800 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d91139b-5410-498b-a359-9903608af738 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:44.717893 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d91139b-5410-498b-a359-9903608af738 service cinder] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:44.723978 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2090/4171] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:23:44 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:23:48.390874 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872a1bd-9518-4c87-9327-1716edc0126d None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:48.392406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6872a1bd-9518-4c87-9327-1716edc0126d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:48.469204 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872a1bd-9518-4c87-9327-1716edc0126d None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:48.474547 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f12008-7994-4c98-b22a-a9f5e28a2ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:48.475575 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f12008-7994-4c98-b22a-a9f5e28a2ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:48.475860 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f12008-7994-4c98-b22a-a9f5e28a2ace admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:48.476140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f12008-7994-4c98-b22a-a9f5e28a2ace admin admin] PATH_INFO: `/v3/users/9a3a68305ff545f4a13f6dd9eb091f7d` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:48.477337 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f12008-7994-4c98-b22a-a9f5e28a2ace admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a3a68305ff545f4a13f6dd9eb091f7d)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:48.479313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f12008-7994-4c98-b22a-a9f5e28a2ace admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:48.688916 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-19f12008-7994-4c98-b22a-a9f5e28a2ace admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a3a68305ff545f4a13f6dd9eb091f7d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:48.701299 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-19f12008-7994-4c98-b22a-a9f5e28a2ace admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a3a68305ff545f4a13f6dd9eb091f7d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:48.774375 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-19f12008-7994-4c98-b22a-a9f5e28a2ace admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a3a68305ff545f4a13f6dd9eb091f7d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:48.774375 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-19f12008-7994-4c98-b22a-a9f5e28a2ace admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a3a68305ff545f4a13f6dd9eb091f7d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:48.781135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-19f12008-7994-4c98-b22a-a9f5e28a2ace admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a3a68305ff545f4a13f6dd9eb091f7d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:48.787644 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2082/4172] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:23:48 2022] DELETE /identity/v3/users/9a3a68305ff545f4a13f6dd9eb091f7d => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:49.020550 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91139b-5410-498b-a359-9903608af738 service cinder] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:49.033110 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91139b-5410-498b-a359-9903608af738 service cinder] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:49.090964 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920b075-346c-4b6c-a867-bd85088dda4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:49.091815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920b075-346c-4b6c-a867-bd85088dda4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:49.092093 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920b075-346c-4b6c-a867-bd85088dda4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:49.092363 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920b075-346c-4b6c-a867-bd85088dda4a admin admin] PATH_INFO: `/v3/projects/8e529167b5244152802e4fb30080be96` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:49.093549 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b920b075-346c-4b6c-a867-bd85088dda4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e529167b5244152802e4fb30080be96)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:49.095554 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b920b075-346c-4b6c-a867-bd85088dda4a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:49.205850 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b920b075-346c-4b6c-a867-bd85088dda4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e529167b5244152802e4fb30080be96', 'request_id': 'req-b920b075-346c-4b6c-a867-bd85088dda4a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:49.211285 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b920b075-346c-4b6c-a867-bd85088dda4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e529167b5244152802e4fb30080be96', 'request_id': 'req-b920b075-346c-4b6c-a867-bd85088dda4a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:49.217621 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b920b075-346c-4b6c-a867-bd85088dda4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e529167b5244152802e4fb30080be96', 'request_id': 'req-b920b075-346c-4b6c-a867-bd85088dda4a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:49.308580 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b920b075-346c-4b6c-a867-bd85088dda4a admin admin] The token cache is being invalidate because project 8e529167b5244152802e4fb30080be96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:23:49.308894 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b920b075-346c-4b6c-a867-bd85088dda4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:49.309555 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b920b075-346c-4b6c-a867-bd85088dda4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:49.311101 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2091/4173] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:23:49 2022] DELETE /identity/v3/projects/8e529167b5244152802e4fb30080be96 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:49.317068 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f471a8-4088-4402-82a6-e3c6284aac75 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:49.317361 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f471a8-4088-4402-82a6-e3c6284aac75 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:49.317642 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f471a8-4088-4402-82a6-e3c6284aac75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:49.335582 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-d0f471a8-4088-4402-82a6-e3c6284aac75 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:49.336820 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d0f471a8-4088-4402-82a6-e3c6284aac75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:49.398803 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2083/4174] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:23:49.406462 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9e96f-b56c-41c8-ad5a-7bd1ab732912 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:49.411015 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9e96f-b56c-41c8-ad5a-7bd1ab732912 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:49.411015 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9e96f-b56c-41c8-ad5a-7bd1ab732912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:49.425178 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-16d9e96f-b56c-41c8-ad5a-7bd1ab732912 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:49.426919 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-16d9e96f-b56c-41c8-ad5a-7bd1ab732912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:49.435049 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2092/4175] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:23:49.439090 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f471a8-4088-4402-82a6-e3c6284aac75 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:49.449257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f471a8-4088-4402-82a6-e3c6284aac75 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:49.453914 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcccfe4-13e0-4e9d-a6d3-b139e0b53d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:49.454565 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcccfe4-13e0-4e9d-a6d3-b139e0b53d0b admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:49.454848 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcccfe4-13e0-4e9d-a6d3-b139e0b53d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:49.455128 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcccfe4-13e0-4e9d-a6d3-b139e0b53d0b admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:49.455906 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcccfe4-13e0-4e9d-a6d3-b139e0b53d0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:23:49.456162 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcccfe4-13e0-4e9d-a6d3-b139e0b53d0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:49.457819 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcccfe4-13e0-4e9d-a6d3-b139e0b53d0b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:49.469210 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2084/4176] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:23:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:23:49.473446 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9e96f-b56c-41c8-ad5a-7bd1ab732912 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:49.482536 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9e96f-b56c-41c8-ad5a-7bd1ab732912 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:49.487137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632db7b-1c89-4687-9058-cf428d22d5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:49.487775 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632db7b-1c89-4687-9058-cf428d22d5d5 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:49.488560 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632db7b-1c89-4687-9058-cf428d22d5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:49.488831 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632db7b-1c89-4687-9058-cf428d22d5d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:49.489503 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e632db7b-1c89-4687-9058-cf428d22d5d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:49.491434 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e632db7b-1c89-4687-9058-cf428d22d5d5 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:49.569113 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2093/4177] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:23:49 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:23:49.573233 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcccfe4-13e0-4e9d-a6d3-b139e0b53d0b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:49.583559 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcccfe4-13e0-4e9d-a6d3-b139e0b53d0b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:49.639136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98327708-e6a5-44b3-8293-df44378868fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:49.639900 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98327708-e6a5-44b3-8293-df44378868fd admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:49.640194 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98327708-e6a5-44b3-8293-df44378868fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:49.640478 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98327708-e6a5-44b3-8293-df44378868fd admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:49.641168 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98327708-e6a5-44b3-8293-df44378868fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:49.643270 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98327708-e6a5-44b3-8293-df44378868fd admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:49.736629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a098b52-16e9-4e12-9e55-96904c9cc169 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:49.736851 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a098b52-16e9-4e12-9e55-96904c9cc169 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:49.737130 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a098b52-16e9-4e12-9e55-96904c9cc169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:49.749523 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2085/4178] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:23:49 2022] POST /identity/v3/users => generated 287 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:23:49.753528 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98327708-e6a5-44b3-8293-df44378868fd admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:49.763788 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98327708-e6a5-44b3-8293-df44378868fd admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:49.770008 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546dc41-f032-40f9-8787-b5c380829b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:49.770758 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546dc41-f032-40f9-8787-b5c380829b66 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:49.771068 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546dc41-f032-40f9-8787-b5c380829b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:49.771348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546dc41-f032-40f9-8787-b5c380829b66 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:49.772068 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e546dc41-f032-40f9-8787-b5c380829b66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:49.773783 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e546dc41-f032-40f9-8787-b5c380829b66 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:49.784402 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2086/4179] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:23:49.788349 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546dc41-f032-40f9-8787-b5c380829b66 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:49.797673 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546dc41-f032-40f9-8787-b5c380829b66 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:49.802837 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c7b9c-db0b-40df-8039-9fe64d754d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:49.803471 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c7b9c-db0b-40df-8039-9fe64d754d3b admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:49.803750 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c7b9c-db0b-40df-8039-9fe64d754d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:49.804025 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c7b9c-db0b-40df-8039-9fe64d754d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:49.804714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c7b9c-db0b-40df-8039-9fe64d754d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:49.806419 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c7b9c-db0b-40df-8039-9fe64d754d3b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:49.815986 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2087/4180] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:23:49.820366 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c7b9c-db0b-40df-8039-9fe64d754d3b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:49.829606 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c7b9c-db0b-40df-8039-9fe64d754d3b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:49.835132 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09dc20-a0bc-4997-a7bf-272162887a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:49.835958 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09dc20-a0bc-4997-a7bf-272162887a87 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:49.836237 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09dc20-a0bc-4997-a7bf-272162887a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:49.836509 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09dc20-a0bc-4997-a7bf-272162887a87 admin admin] PATH_INFO: `/v3/projects/bfe1b39ed5644c20ac54608a6f25e0bf/users/f2be8a8f7a034cddb01078690b5bd364/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:49.853966 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d09dc20-a0bc-4997-a7bf-272162887a87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfe1b39ed5644c20ac54608a6f25e0bf, user_id=f2be8a8f7a034cddb01078690b5bd364, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:49.854365 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-4a098b52-16e9-4e12-9e55-96904c9cc169 None None] MFA Rules not processed for user `bb3597f57da7487cb6fc364cb207f98c`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:49.855562 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4a098b52-16e9-4e12-9e55-96904c9cc169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:49.856734 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d09dc20-a0bc-4997-a7bf-272162887a87 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:49.858894 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2094/4181] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:49 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 21:23:49.863918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a098b52-16e9-4e12-9e55-96904c9cc169 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:49.865173 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4a098b52-16e9-4e12-9e55-96904c9cc169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:49.927579 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a098b52-16e9-4e12-9e55-96904c9cc169 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:49.931681 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee39c2-9165-4889-b422-2009c49cbbd0 tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3597f57da7487cb6fc364cb207f98c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8eb0464e4654fdc85af24d7eaa5660e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:49.932528 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee39c2-9165-4889-b422-2009c49cbbd0 tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:49.932839 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee39c2-9165-4889-b422-2009c49cbbd0 tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:49.933090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee39c2-9165-4889-b422-2009c49cbbd0 tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] PATH_INFO: `/v3/users/bb3597f57da7487cb6fc364cb207f98c/password` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:49.955724 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2088/4182] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:23:49 2022] PUT /identity/v3/projects/bfe1b39ed5644c20ac54608a6f25e0bf/users/f2be8a8f7a034cddb01078690b5bd364/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:23:49.960593 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef6de3-c277-4ae0-a42e-f68c06491740 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:49.960907 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef6de3-c277-4ae0-a42e-f68c06491740 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:49.961153 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef6de3-c277-4ae0-a42e-f68c06491740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:49.981423 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-5fef6de3-c277-4ae0-a42e-f68c06491740 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:49.982657 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5fef6de3-c277-4ae0-a42e-f68c06491740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:50.036187 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0aee39c2-9165-4889-b422-2009c49cbbd0 tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'bb3597f57da7487cb6fc364cb207f98c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:50.045021 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2089/4183] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:23:50.055646 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef6de3-c277-4ae0-a42e-f68c06491740 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:50.057091 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5fef6de3-c277-4ae0-a42e-f68c06491740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:50.114238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef6de3-c277-4ae0-a42e-f68c06491740 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:50.117882 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a75689-a20c-4009-9951-1916f7e7d577 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:50.118523 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a75689-a20c-4009-9951-1916f7e7d577 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:50.118806 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a75689-a20c-4009-9951-1916f7e7d577 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:50.119084 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a75689-a20c-4009-9951-1916f7e7d577 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:50.128296 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a75689-a20c-4009-9951-1916f7e7d577 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:50.129747 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a75689-a20c-4009-9951-1916f7e7d577 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:50.132991 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2095/4184] 10.222.0.23 () {60 vars in 1268 bytes} [Sat Apr 30 21:23:49 2022] POST /identity/v3/users/bb3597f57da7487cb6fc364cb207f98c/password => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:23:50.139731 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2090/4185] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:23:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:23:51.138533 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd194a-c0f1-4ee6-abbe-06d448856bfa None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:51.139044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd194a-c0f1-4ee6-abbe-06d448856bfa None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:51.139044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd194a-c0f1-4ee6-abbe-06d448856bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:51.155989 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-76cd194a-c0f1-4ee6-abbe-06d448856bfa None None] MFA Rules not processed for user `bb3597f57da7487cb6fc364cb207f98c`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:51.157171 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-76cd194a-c0f1-4ee6-abbe-06d448856bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:51.160919 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2096/4186] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:51 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 23 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 21:23:51.165364 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfdb72-fb99-4c83-97a0-e03ce4aa2a19 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:51.165857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfdb72-fb99-4c83-97a0-e03ce4aa2a19 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:51.165971 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfdb72-fb99-4c83-97a0-e03ce4aa2a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:51.242544 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-09bfdb72-fb99-4c83-97a0-e03ce4aa2a19 None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Apr 30 21:23:51.242544 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:23:51.242544 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:23:51.242544 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:23:51.242544 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:23:51.242544 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:23:51.242544 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:23:51.242544 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:23:51.242544 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:23:51.242544 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:23:51.242544 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:23:51.242544 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:23:51.242544 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Apr 30 21:23:51.242544 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(*args, **kwargs) Apr 30 21:23:51.242544 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Apr 30 21:23:51.242544 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Apr 30 21:23:51.243929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Apr 30 21:23:51.243929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Apr 30 21:23:51.243929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Apr 30 21:23:51.243929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Apr 30 21:23:51.243929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Apr 30 21:23:51.243929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Apr 30 21:23:51.243929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Apr 30 21:23:51.243929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Apr 30 21:23:51.243929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:23:51.243929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:23:51.243929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Apr 30 21:23:51.243929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Apr 30 21:23:51.243929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Apr 30 21:23:51.243929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self.check_revocation(token) Apr 30 21:23:51.243929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:23:51.243929 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:23:51.245038 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Apr 30 21:23:51.245038 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Apr 30 21:23:51.245038 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:23:51.245038 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:23:51.245038 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Apr 30 21:23:51.245038 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Apr 30 21:23:51.245038 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:23:51.245038 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:23:51.245038 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Apr 30 21:23:51.245038 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Apr 30 21:23:51.245038 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Apr 30 21:23:51.245038 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:23:51.245038 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2091/4187] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:51 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 21:23:51.248341 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390e925-c2d0-40f1-833e-6e95c4206982 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:51.248637 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390e925-c2d0-40f1-833e-6e95c4206982 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:51.248948 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390e925-c2d0-40f1-833e-6e95c4206982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:51.417250 ncdv-master-1 devstack@keystone.service[91018]: WARNING keystone.server.flask.application [None req-b390e925-c2d0-40f1-833e-6e95c4206982 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.23: keystone.exception.Unauthorized: The request you have made requires authentication. Apr 30 21:23:51.417480 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6203078-8348-4562-9246-6e2867145ba8 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:51.417653 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6203078-8348-4562-9246-6e2867145ba8 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:51.418243 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6203078-8348-4562-9246-6e2867145ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:51.419423 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2097/4188] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:51 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 172 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Apr 30 21:23:51.424028 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433244ae-13bb-4ff0-acb1-6e9d89e1d129 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:51.424494 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433244ae-13bb-4ff0-acb1-6e9d89e1d129 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:51.435583 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433244ae-13bb-4ff0-acb1-6e9d89e1d129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:51.454512 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-d6203078-8348-4562-9246-6e2867145ba8 None None] MFA Rules not processed for user `f2be8a8f7a034cddb01078690b5bd364`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:51.457509 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d6203078-8348-4562-9246-6e2867145ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:51.524665 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2092/4189] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:23:51.535099 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130eb56-f7c5-4ab4-b796-12777b30f764 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:51.535388 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130eb56-f7c5-4ab4-b796-12777b30f764 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:51.535684 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130eb56-f7c5-4ab4-b796-12777b30f764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:51.554655 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-b130eb56-f7c5-4ab4-b796-12777b30f764 None None] MFA Rules not processed for user `f2be8a8f7a034cddb01078690b5bd364`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:51.555868 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b130eb56-f7c5-4ab4-b796-12777b30f764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:51.563532 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2093/4190] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:23:51.575593 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130eb56-f7c5-4ab4-b796-12777b30f764 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:51.576954 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b130eb56-f7c5-4ab4-b796-12777b30f764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:51.579524 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-433244ae-13bb-4ff0-acb1-6e9d89e1d129 None None] MFA Rules not processed for user `bb3597f57da7487cb6fc364cb207f98c`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:51.581785 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-433244ae-13bb-4ff0-acb1-6e9d89e1d129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:51.588098 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2098/4191] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:23:51.592608 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433244ae-13bb-4ff0-acb1-6e9d89e1d129 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:51.601235 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433244ae-13bb-4ff0-acb1-6e9d89e1d129 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:51.605402 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46e909-0095-43c3-b31d-74905eca0f51 tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3597f57da7487cb6fc364cb207f98c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8eb0464e4654fdc85af24d7eaa5660e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:51.606300 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46e909-0095-43c3-b31d-74905eca0f51 tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:51.606585 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46e909-0095-43c3-b31d-74905eca0f51 tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:51.606862 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46e909-0095-43c3-b31d-74905eca0f51 tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] PATH_INFO: `/v3/users/bb3597f57da7487cb6fc364cb207f98c/password` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:51.653327 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130eb56-f7c5-4ab4-b796-12777b30f764 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:51.659084 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c288cc17-cfa9-4501-8c99-722b1b6e6fe3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:51.661100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288cc17-cfa9-4501-8c99-722b1b6e6fe3 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:51.661100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288cc17-cfa9-4501-8c99-722b1b6e6fe3 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:51.661100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288cc17-cfa9-4501-8c99-722b1b6e6fe3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:51.668949 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c288cc17-cfa9-4501-8c99-722b1b6e6fe3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:51.670711 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c288cc17-cfa9-4501-8c99-722b1b6e6fe3 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:51.679646 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2094/4192] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:23:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:23:51.738443 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bf46e909-0095-43c3-b31d-74905eca0f51 tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'bb3597f57da7487cb6fc364cb207f98c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:51.876359 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2099/4193] 10.222.0.23 () {60 vars in 1268 bytes} [Sat Apr 30 21:23:51 2022] POST /identity/v3/users/bb3597f57da7487cb6fc364cb207f98c/password => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:23:52.882003 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e74133-7212-45f8-9279-38302cba8f96 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:52.882510 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e74133-7212-45f8-9279-38302cba8f96 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:52.882629 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e74133-7212-45f8-9279-38302cba8f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:52.900247 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-88e74133-7212-45f8-9279-38302cba8f96 None None] MFA Rules not processed for user `bb3597f57da7487cb6fc364cb207f98c`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:52.902015 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-88e74133-7212-45f8-9279-38302cba8f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:52.904552 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2095/4194] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:52 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 24 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 21:23:52.909066 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670184c-7399-45ab-8252-12a6b1596531 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:52.909545 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670184c-7399-45ab-8252-12a6b1596531 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:52.909651 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670184c-7399-45ab-8252-12a6b1596531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:52.928747 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-f670184c-7399-45ab-8252-12a6b1596531 None None] MFA Rules not processed for user `bb3597f57da7487cb6fc364cb207f98c`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:52.930131 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f670184c-7399-45ab-8252-12a6b1596531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:52.938439 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2100/4195] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:23:52.942755 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e74133-7212-45f8-9279-38302cba8f96 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:52.953493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e74133-7212-45f8-9279-38302cba8f96 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:52.958565 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03856f51-d66f-4c74-8e64-67b1b1560f26 tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3597f57da7487cb6fc364cb207f98c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8eb0464e4654fdc85af24d7eaa5660e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:52.959591 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03856f51-d66f-4c74-8e64-67b1b1560f26 tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:52.959843 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03856f51-d66f-4c74-8e64-67b1b1560f26 tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:52.960130 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03856f51-d66f-4c74-8e64-67b1b1560f26 tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] PATH_INFO: `/v3/users/bb3597f57da7487cb6fc364cb207f98c/password` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:53.080110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-03856f51-d66f-4c74-8e64-67b1b1560f26 tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'bb3597f57da7487cb6fc364cb207f98c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:53.167708 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2096/4196] 10.222.0.23 () {60 vars in 1268 bytes} [Sat Apr 30 21:23:52 2022] POST /identity/v3/users/bb3597f57da7487cb6fc364cb207f98c/password => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:54.174683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f3f75-40f4-4a21-8cec-0249b14eda14 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:54.176134 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f3f75-40f4-4a21-8cec-0249b14eda14 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:54.176652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f3f75-40f4-4a21-8cec-0249b14eda14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:54.196052 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-062f3f75-40f4-4a21-8cec-0249b14eda14 None None] MFA Rules not processed for user `bb3597f57da7487cb6fc364cb207f98c`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:54.197822 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-062f3f75-40f4-4a21-8cec-0249b14eda14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:54.202112 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2101/4197] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:54 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 21:23:54.207202 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2d261-2585-420a-8b48-54a1cdd611df None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:54.208028 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2d261-2585-420a-8b48-54a1cdd611df None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:54.208463 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2d261-2585-420a-8b48-54a1cdd611df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:54.229310 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-3aa2d261-2585-420a-8b48-54a1cdd611df None None] MFA Rules not processed for user `bb3597f57da7487cb6fc364cb207f98c`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:54.230914 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3aa2d261-2585-420a-8b48-54a1cdd611df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:54.247148 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f3f75-40f4-4a21-8cec-0249b14eda14 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:54.251561 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2097/4198] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:23:54.259344 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f3f75-40f4-4a21-8cec-0249b14eda14 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:54.267770 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138dd019-db7c-41b0-824b-22daacca14aa tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3597f57da7487cb6fc364cb207f98c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8eb0464e4654fdc85af24d7eaa5660e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:54.279013 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138dd019-db7c-41b0-824b-22daacca14aa tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:54.279741 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138dd019-db7c-41b0-824b-22daacca14aa tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:54.280039 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138dd019-db7c-41b0-824b-22daacca14aa tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] PATH_INFO: `/v3/users/bb3597f57da7487cb6fc364cb207f98c/password` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:54.399996 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-138dd019-db7c-41b0-824b-22daacca14aa tempest-IdentityV3UsersTest-1214767325 tempest-IdentityV3UsersTest-1214767325-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'bb3597f57da7487cb6fc364cb207f98c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:54.458603 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2102/4199] 10.222.0.23 () {60 vars in 1268 bytes} [Sat Apr 30 21:23:54 2022] POST /identity/v3/users/bb3597f57da7487cb6fc364cb207f98c/password => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:55.464257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f6335-0fb6-4197-831e-7eab00fc0e46 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:55.465840 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f6335-0fb6-4197-831e-7eab00fc0e46 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:55.465840 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f6335-0fb6-4197-831e-7eab00fc0e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:55.483030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-1c5f6335-0fb6-4197-831e-7eab00fc0e46 None None] MFA Rules not processed for user `bb3597f57da7487cb6fc364cb207f98c`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:55.483834 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1c5f6335-0fb6-4197-831e-7eab00fc0e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:55.486960 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2098/4200] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:55 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 24 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 21:23:56.492978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf4b09-b15b-4d0f-a5fa-b6fde46d81c3 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:56.494346 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf4b09-b15b-4d0f-a5fa-b6fde46d81c3 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:56.494786 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf4b09-b15b-4d0f-a5fa-b6fde46d81c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:56.514952 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-c2bf4b09-b15b-4d0f-a5fa-b6fde46d81c3 None None] MFA Rules not processed for user `bb3597f57da7487cb6fc364cb207f98c`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:56.516171 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c2bf4b09-b15b-4d0f-a5fa-b6fde46d81c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:56.525009 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2103/4201] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:23:56.531020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f6335-0fb6-4197-831e-7eab00fc0e46 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:56.536135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1c5f6335-0fb6-4197-831e-7eab00fc0e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:56.552561 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f6335-0fb6-4197-831e-7eab00fc0e46 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:56.557215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d8ab28-c7a3-43fa-9756-cdff30261336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:56.558120 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8ab28-c7a3-43fa-9756-cdff30261336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:56.558397 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8ab28-c7a3-43fa-9756-cdff30261336 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:56.558667 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8ab28-c7a3-43fa-9756-cdff30261336 admin admin] PATH_INFO: `/v3/users/bb3597f57da7487cb6fc364cb207f98c` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:56.559952 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d8ab28-c7a3-43fa-9756-cdff30261336 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb3597f57da7487cb6fc364cb207f98c)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:56.562276 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d8ab28-c7a3-43fa-9756-cdff30261336 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:56.810077 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-03d8ab28-c7a3-43fa-9756-cdff30261336 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb3597f57da7487cb6fc364cb207f98c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:56.823663 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-03d8ab28-c7a3-43fa-9756-cdff30261336 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb3597f57da7487cb6fc364cb207f98c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:56.897982 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-03d8ab28-c7a3-43fa-9756-cdff30261336 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb3597f57da7487cb6fc364cb207f98c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:56.901319 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-03d8ab28-c7a3-43fa-9756-cdff30261336 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb3597f57da7487cb6fc364cb207f98c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:56.907027 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-03d8ab28-c7a3-43fa-9756-cdff30261336 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb3597f57da7487cb6fc364cb207f98c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:56.913838 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2099/4202] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:23:56 2022] DELETE /identity/v3/users/bb3597f57da7487cb6fc364cb207f98c => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:56.918238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78800868-cee7-4d9a-8243-dcc21f00273b None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:56.918587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78800868-cee7-4d9a-8243-dcc21f00273b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:56.918928 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78800868-cee7-4d9a-8243-dcc21f00273b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:56.939769 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-78800868-cee7-4d9a-8243-dcc21f00273b None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:56.942288 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-78800868-cee7-4d9a-8243-dcc21f00273b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:57.011318 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2104/4203] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:23:57.038858 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d8ab28-c7a3-43fa-9756-cdff30261336 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:57.040373 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-03d8ab28-c7a3-43fa-9756-cdff30261336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:57.101365 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d8ab28-c7a3-43fa-9756-cdff30261336 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:57.105200 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23207ca-71aa-4624-992e-1fb81e087cbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:57.105891 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23207ca-71aa-4624-992e-1fb81e087cbd service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:57.106178 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23207ca-71aa-4624-992e-1fb81e087cbd service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:57.106456 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23207ca-71aa-4624-992e-1fb81e087cbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:57.116475 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23207ca-71aa-4624-992e-1fb81e087cbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:57.118136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23207ca-71aa-4624-992e-1fb81e087cbd service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:57.129321 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2100/4204] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:23:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:23:57.133786 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78800868-cee7-4d9a-8243-dcc21f00273b None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:57.144990 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-78800868-cee7-4d9a-8243-dcc21f00273b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:57.154607 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78800868-cee7-4d9a-8243-dcc21f00273b None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:57.161174 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fff714-5c72-4b47-8456-182dde6422e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:57.162167 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fff714-5c72-4b47-8456-182dde6422e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:57.163020 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fff714-5c72-4b47-8456-182dde6422e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:57.163538 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fff714-5c72-4b47-8456-182dde6422e0 admin admin] PATH_INFO: `/v3/users/2f5eafa970bd4247bdaef1cda747c3fc` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:57.165197 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fff714-5c72-4b47-8456-182dde6422e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f5eafa970bd4247bdaef1cda747c3fc)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:57.167336 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fff714-5c72-4b47-8456-182dde6422e0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:57.343743 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-52fff714-5c72-4b47-8456-182dde6422e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f5eafa970bd4247bdaef1cda747c3fc'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:57.356808 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-52fff714-5c72-4b47-8456-182dde6422e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f5eafa970bd4247bdaef1cda747c3fc'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:57.424808 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-52fff714-5c72-4b47-8456-182dde6422e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f5eafa970bd4247bdaef1cda747c3fc'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:57.432595 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-52fff714-5c72-4b47-8456-182dde6422e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f5eafa970bd4247bdaef1cda747c3fc'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:57.437730 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-52fff714-5c72-4b47-8456-182dde6422e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f5eafa970bd4247bdaef1cda747c3fc'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:57.439476 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2105/4205] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:23:57 2022] DELETE /identity/v3/users/2f5eafa970bd4247bdaef1cda747c3fc => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:57.608662 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23207ca-71aa-4624-992e-1fb81e087cbd service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:57.610148 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a23207ca-71aa-4624-992e-1fb81e087cbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:57.623457 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23207ca-71aa-4624-992e-1fb81e087cbd service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:57.681359 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e7821-99c0-4a1f-bfed-5c9afa582bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:57.682017 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e7821-99c0-4a1f-bfed-5c9afa582bc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:57.682304 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e7821-99c0-4a1f-bfed-5c9afa582bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:57.682580 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e7821-99c0-4a1f-bfed-5c9afa582bc6 admin admin] PATH_INFO: `/v3/projects/f8eb0464e4654fdc85af24d7eaa5660e` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:57.683859 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e7821-99c0-4a1f-bfed-5c9afa582bc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8eb0464e4654fdc85af24d7eaa5660e)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:57.685745 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e7821-99c0-4a1f-bfed-5c9afa582bc6 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:57.688850 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fff714-5c72-4b47-8456-182dde6422e0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:57.691380 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-52fff714-5c72-4b47-8456-182dde6422e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:57.708829 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fff714-5c72-4b47-8456-182dde6422e0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:57.718720 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6cb9e-2fbf-4fbc-9a43-cf9b67a62d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:57.719787 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6cb9e-2fbf-4fbc-9a43-cf9b67a62d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:57.720112 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6cb9e-2fbf-4fbc-9a43-cf9b67a62d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:57.720431 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6cb9e-2fbf-4fbc-9a43-cf9b67a62d15 admin admin] PATH_INFO: `/v3/projects/713c8f2f4e2141f18904b10656eaf37f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:57.721682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d6cb9e-2fbf-4fbc-9a43-cf9b67a62d15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=713c8f2f4e2141f18904b10656eaf37f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:57.724451 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d6cb9e-2fbf-4fbc-9a43-cf9b67a62d15 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:57.805483 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-885e7821-99c0-4a1f-bfed-5c9afa582bc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8eb0464e4654fdc85af24d7eaa5660e', 'request_id': 'req-885e7821-99c0-4a1f-bfed-5c9afa582bc6'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:57.810769 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-885e7821-99c0-4a1f-bfed-5c9afa582bc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8eb0464e4654fdc85af24d7eaa5660e', 'request_id': 'req-885e7821-99c0-4a1f-bfed-5c9afa582bc6'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:57.817156 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-885e7821-99c0-4a1f-bfed-5c9afa582bc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8eb0464e4654fdc85af24d7eaa5660e', 'request_id': 'req-885e7821-99c0-4a1f-bfed-5c9afa582bc6'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:57.852453 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-10d6cb9e-2fbf-4fbc-9a43-cf9b67a62d15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '713c8f2f4e2141f18904b10656eaf37f', 'request_id': 'req-10d6cb9e-2fbf-4fbc-9a43-cf9b67a62d15'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:57.857886 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-10d6cb9e-2fbf-4fbc-9a43-cf9b67a62d15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '713c8f2f4e2141f18904b10656eaf37f', 'request_id': 'req-10d6cb9e-2fbf-4fbc-9a43-cf9b67a62d15'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:57.864184 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-10d6cb9e-2fbf-4fbc-9a43-cf9b67a62d15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '713c8f2f4e2141f18904b10656eaf37f', 'request_id': 'req-10d6cb9e-2fbf-4fbc-9a43-cf9b67a62d15'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:57.892120 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-885e7821-99c0-4a1f-bfed-5c9afa582bc6 admin admin] The token cache is being invalidate because project f8eb0464e4654fdc85af24d7eaa5660e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:23:57.895890 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-885e7821-99c0-4a1f-bfed-5c9afa582bc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:57.895890 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-885e7821-99c0-4a1f-bfed-5c9afa582bc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:57.895890 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2101/4206] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:23:57 2022] DELETE /identity/v3/projects/f8eb0464e4654fdc85af24d7eaa5660e => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:57.901102 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa93d5-6e83-4f82-b261-75046dd5d407 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:57.901396 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa93d5-6e83-4f82-b261-75046dd5d407 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:57.901680 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa93d5-6e83-4f82-b261-75046dd5d407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:57.920086 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-fffa93d5-6e83-4f82-b261-75046dd5d407 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:57.921353 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-fffa93d5-6e83-4f82-b261-75046dd5d407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:57.961302 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-10d6cb9e-2fbf-4fbc-9a43-cf9b67a62d15 admin admin] The token cache is being invalidate because project 713c8f2f4e2141f18904b10656eaf37f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:23:57.961591 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-10d6cb9e-2fbf-4fbc-9a43-cf9b67a62d15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:57.962505 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-10d6cb9e-2fbf-4fbc-9a43-cf9b67a62d15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:23:57.964110 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2106/4207] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:23:57 2022] DELETE /identity/v3/projects/713c8f2f4e2141f18904b10656eaf37f => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:23:57.969147 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a2440-8337-4f33-9830-9f879bac9876 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:57.969437 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a2440-8337-4f33-9830-9f879bac9876 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:57.969715 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a2440-8337-4f33-9830-9f879bac9876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:57.981447 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2102/4208] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:23:57.988152 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-4c6a2440-8337-4f33-9830-9f879bac9876 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:57.989359 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4c6a2440-8337-4f33-9830-9f879bac9876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:57.992218 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f29fc-21c1-4bac-9f57-d5763e521969 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:57.992507 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f29fc-21c1-4bac-9f57-d5763e521969 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:57.992781 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f29fc-21c1-4bac-9f57-d5763e521969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:57.997440 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2107/4209] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:23:58.010035 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c449904-eec5-4fd1-8385-c14c7e8854b5 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:58.010318 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c449904-eec5-4fd1-8385-c14c7e8854b5 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:58.010593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c449904-eec5-4fd1-8385-c14c7e8854b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:58.012766 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-845f29fc-21c1-4bac-9f57-d5763e521969 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:58.014026 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-845f29fc-21c1-4bac-9f57-d5763e521969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:58.023553 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2103/4210] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:23:58.027893 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f29fc-21c1-4bac-9f57-d5763e521969 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:58.028974 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-0c449904-eec5-4fd1-8385-c14c7e8854b5 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:58.030182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0c449904-eec5-4fd1-8385-c14c7e8854b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:58.036902 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f29fc-21c1-4bac-9f57-d5763e521969 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:58.038088 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2108/4211] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:23:58.041646 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16258766-9626-47b1-b349-5d1617fcd657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:58.042320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16258766-9626-47b1-b349-5d1617fcd657 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:58.042601 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16258766-9626-47b1-b349-5d1617fcd657 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:58.042916 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16258766-9626-47b1-b349-5d1617fcd657 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:58.043628 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16258766-9626-47b1-b349-5d1617fcd657 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:23:58.043930 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16258766-9626-47b1-b349-5d1617fcd657 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:58.045320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c449904-eec5-4fd1-8385-c14c7e8854b5 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:58.045683 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16258766-9626-47b1-b349-5d1617fcd657 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:58.054862 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c449904-eec5-4fd1-8385-c14c7e8854b5 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:58.059115 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2104/4212] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:23:58.064047 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44abf144-3662-4918-94a8-f15e82eb3889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:58.064047 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44abf144-3662-4918-94a8-f15e82eb3889 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:58.064047 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44abf144-3662-4918-94a8-f15e82eb3889 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:58.064047 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44abf144-3662-4918-94a8-f15e82eb3889 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:58.064487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44abf144-3662-4918-94a8-f15e82eb3889 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:23:58.064487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44abf144-3662-4918-94a8-f15e82eb3889 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:58.064487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44abf144-3662-4918-94a8-f15e82eb3889 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:58.067635 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16258766-9626-47b1-b349-5d1617fcd657 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:58.079358 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2109/4213] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:23:58.079511 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16258766-9626-47b1-b349-5d1617fcd657 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:58.080648 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44abf144-3662-4918-94a8-f15e82eb3889 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:58.087019 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f24802-64c1-49cc-a92f-6ec11a2a8dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:58.087019 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f24802-64c1-49cc-a92f-6ec11a2a8dd8 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:58.087019 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f24802-64c1-49cc-a92f-6ec11a2a8dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:58.087019 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f24802-64c1-49cc-a92f-6ec11a2a8dd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:58.087445 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f24802-64c1-49cc-a92f-6ec11a2a8dd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:58.087546 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f24802-64c1-49cc-a92f-6ec11a2a8dd8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:58.091506 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44abf144-3662-4918-94a8-f15e82eb3889 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:58.096127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a7b20d-0e9f-4ace-8427-3b694b9ec455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:58.096801 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7b20d-0e9f-4ace-8427-3b694b9ec455 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:58.097288 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7b20d-0e9f-4ace-8427-3b694b9ec455 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:58.097394 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7b20d-0e9f-4ace-8427-3b694b9ec455 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:58.098139 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a7b20d-0e9f-4ace-8427-3b694b9ec455 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:58.100066 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a7b20d-0e9f-4ace-8427-3b694b9ec455 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:58.140057 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2105/4214] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:23:58 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:23:58.144924 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f24802-64c1-49cc-a92f-6ec11a2a8dd8 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:58.185709 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2110/4215] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:23:58 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:23:58.189715 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a7b20d-0e9f-4ace-8427-3b694b9ec455 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:58.205728 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f24802-64c1-49cc-a92f-6ec11a2a8dd8 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:58.259512 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a7b20d-0e9f-4ace-8427-3b694b9ec455 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:58.264561 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c5127-8674-4f7a-b402-866710dd3241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:58.265406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c5127-8674-4f7a-b402-866710dd3241 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:58.265692 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c5127-8674-4f7a-b402-866710dd3241 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:58.265929 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f9bcb-aa78-4888-a246-2bd6813ebf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:58.266061 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c5127-8674-4f7a-b402-866710dd3241 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:58.266495 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f9bcb-aa78-4888-a246-2bd6813ebf6a admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:58.266732 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c5127-8674-4f7a-b402-866710dd3241 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:58.266851 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f9bcb-aa78-4888-a246-2bd6813ebf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:58.267044 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f9bcb-aa78-4888-a246-2bd6813ebf6a admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:58.267721 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f9bcb-aa78-4888-a246-2bd6813ebf6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:58.268687 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c5127-8674-4f7a-b402-866710dd3241 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:58.269679 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f9bcb-aa78-4888-a246-2bd6813ebf6a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:58.344466 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2106/4216] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:23:58 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:23:58.349323 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f9bcb-aa78-4888-a246-2bd6813ebf6a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:58.356130 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2111/4217] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:23:58 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:23:58.360146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c5127-8674-4f7a-b402-866710dd3241 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:58.360595 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f9bcb-aa78-4888-a246-2bd6813ebf6a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:58.365550 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908b261-830b-4e73-89bd-0480b3902057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:58.366911 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908b261-830b-4e73-89bd-0480b3902057 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:58.367601 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908b261-830b-4e73-89bd-0480b3902057 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:58.367601 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908b261-830b-4e73-89bd-0480b3902057 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:58.368489 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d908b261-830b-4e73-89bd-0480b3902057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:58.370683 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d908b261-830b-4e73-89bd-0480b3902057 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:58.371386 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c5127-8674-4f7a-b402-866710dd3241 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:58.376297 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1eff1-5ce9-42bc-b545-cfd32dd89b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:58.376966 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1eff1-5ce9-42bc-b545-cfd32dd89b78 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:58.377250 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1eff1-5ce9-42bc-b545-cfd32dd89b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:58.377524 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1eff1-5ce9-42bc-b545-cfd32dd89b78 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:58.378277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1eff1-5ce9-42bc-b545-cfd32dd89b78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:58.380627 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1eff1-5ce9-42bc-b545-cfd32dd89b78 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:58.382192 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2107/4218] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:23:58.386269 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908b261-830b-4e73-89bd-0480b3902057 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:58.396397 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908b261-830b-4e73-89bd-0480b3902057 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:58.401442 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0297c7c-4a25-4bdb-8168-58224d1a9263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:58.404890 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0297c7c-4a25-4bdb-8168-58224d1a9263 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:58.405031 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2112/4219] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:23:58.405140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0297c7c-4a25-4bdb-8168-58224d1a9263 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:58.405140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0297c7c-4a25-4bdb-8168-58224d1a9263 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:58.405140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0297c7c-4a25-4bdb-8168-58224d1a9263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:58.405419 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0297c7c-4a25-4bdb-8168-58224d1a9263 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:58.406156 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1eff1-5ce9-42bc-b545-cfd32dd89b78 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:58.419627 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2108/4220] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:23:58.419789 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1eff1-5ce9-42bc-b545-cfd32dd89b78 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:58.420678 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0297c7c-4a25-4bdb-8168-58224d1a9263 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:58.421445 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72e1fd-502f-49e8-a68b-c95dd6837c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:58.422146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72e1fd-502f-49e8-a68b-c95dd6837c85 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:58.422425 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72e1fd-502f-49e8-a68b-c95dd6837c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:58.422957 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72e1fd-502f-49e8-a68b-c95dd6837c85 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:58.423681 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72e1fd-502f-49e8-a68b-c95dd6837c85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:58.425313 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72e1fd-502f-49e8-a68b-c95dd6837c85 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:58.430637 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0297c7c-4a25-4bdb-8168-58224d1a9263 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:58.435265 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c82726-4f15-48f6-861f-88a45cbb22af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:58.435785 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2113/4221] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:23:58.454776 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c82726-4f15-48f6-861f-88a45cbb22af admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:58.454776 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c82726-4f15-48f6-861f-88a45cbb22af admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:58.454776 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c82726-4f15-48f6-861f-88a45cbb22af admin admin] PATH_INFO: `/v3/projects/6abbe77263be4f0e96c3b778f1653976/users/d50992314a584bae8cbff6dfc9d29b1e/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:58.454776 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c82726-4f15-48f6-861f-88a45cbb22af admin admin] RBAC: Authorizing `identity:create_grant(project_id=6abbe77263be4f0e96c3b778f1653976, user_id=d50992314a584bae8cbff6dfc9d29b1e, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:58.454776 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c82726-4f15-48f6-861f-88a45cbb22af admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:58.458362 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72e1fd-502f-49e8-a68b-c95dd6837c85 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:58.467962 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72e1fd-502f-49e8-a68b-c95dd6837c85 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:58.473309 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92aa396-21ea-40e5-9931-02ba98f3d7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:58.474166 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92aa396-21ea-40e5-9931-02ba98f3d7eb admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:58.474466 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92aa396-21ea-40e5-9931-02ba98f3d7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:58.474720 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92aa396-21ea-40e5-9931-02ba98f3d7eb admin admin] PATH_INFO: `/v3/projects/3364787934af4f59b17a58b380fe95da/users/20b4082fa07249e2b6dfb9b4506ab398/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:58.489016 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92aa396-21ea-40e5-9931-02ba98f3d7eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3364787934af4f59b17a58b380fe95da, user_id=20b4082fa07249e2b6dfb9b4506ab398, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:58.491684 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92aa396-21ea-40e5-9931-02ba98f3d7eb admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:58.578671 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2109/4222] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:23:58 2022] PUT /identity/v3/projects/6abbe77263be4f0e96c3b778f1653976/users/d50992314a584bae8cbff6dfc9d29b1e/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:58.591135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359e2e7-4658-41cd-9096-f1290696f73c None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:58.591494 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359e2e7-4658-41cd-9096-f1290696f73c None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:58.591773 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359e2e7-4658-41cd-9096-f1290696f73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:58.613058 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2114/4223] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:23:58 2022] PUT /identity/v3/projects/3364787934af4f59b17a58b380fe95da/users/20b4082fa07249e2b6dfb9b4506ab398/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:23:58.618570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a7af2-c560-48f3-bb6d-dabd62fab124 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:58.618867 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a7af2-c560-48f3-bb6d-dabd62fab124 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:58.619152 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a7af2-c560-48f3-bb6d-dabd62fab124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:58.628003 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-1359e2e7-4658-41cd-9096-f1290696f73c None None] MFA Rules not processed for user `d50992314a584bae8cbff6dfc9d29b1e`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:58.629209 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1359e2e7-4658-41cd-9096-f1290696f73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:58.635819 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-897a7af2-c560-48f3-bb6d-dabd62fab124 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:58.637675 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-897a7af2-c560-48f3-bb6d-dabd62fab124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:58.696472 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2110/4224] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:23:58.700875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359e2e7-4658-41cd-9096-f1290696f73c None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:58.704191 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2115/4225] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:23:58.712626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359e2e7-4658-41cd-9096-f1290696f73c None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:58.714872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a7af2-c560-48f3-bb6d-dabd62fab124 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:58.721925 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-897a7af2-c560-48f3-bb6d-dabd62fab124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:58.722106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a87dee7-9ce0-462c-ae63-72c5ee648610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:58.722106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87dee7-9ce0-462c-ae63-72c5ee648610 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:58.722106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87dee7-9ce0-462c-ae63-72c5ee648610 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:58.722106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87dee7-9ce0-462c-ae63-72c5ee648610 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:58.722607 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a87dee7-9ce0-462c-ae63-72c5ee648610 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:58.722607 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a87dee7-9ce0-462c-ae63-72c5ee648610 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:58.778730 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a7af2-c560-48f3-bb6d-dabd62fab124 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:58.782632 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2bac0-37be-4ec7-9ca0-96f12eb98744 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:58.783277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2bac0-37be-4ec7-9ca0-96f12eb98744 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:58.783557 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2bac0-37be-4ec7-9ca0-96f12eb98744 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:58.783917 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2bac0-37be-4ec7-9ca0-96f12eb98744 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:58.793899 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c2bac0-37be-4ec7-9ca0-96f12eb98744 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:58.795394 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c2bac0-37be-4ec7-9ca0-96f12eb98744 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:58.800655 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2111/4226] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:23:58 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:23:58.801611 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a87dee7-9ce0-462c-ae63-72c5ee648610 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:58.806624 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2116/4227] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:23:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:23:58.865291 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a87dee7-9ce0-462c-ae63-72c5ee648610 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:58.870141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dcadb3-921c-493d-a4bf-f672d70c1a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:58.870809 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcadb3-921c-493d-a4bf-f672d70c1a29 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:58.871175 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcadb3-921c-493d-a4bf-f672d70c1a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:58.871479 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcadb3-921c-493d-a4bf-f672d70c1a29 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:58.872157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dcadb3-921c-493d-a4bf-f672d70c1a29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:58.874333 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dcadb3-921c-493d-a4bf-f672d70c1a29 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:59.024708 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2112/4228] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:23:58 2022] POST /identity/v3/users => generated 292 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:23:59.028633 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2bac0-37be-4ec7-9ca0-96f12eb98744 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:59.038227 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2bac0-37be-4ec7-9ca0-96f12eb98744 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:59.042721 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a36aac-88ec-44c7-a928-7b6bebbdfbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:59.043373 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a36aac-88ec-44c7-a928-7b6bebbdfbe9 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:59.043657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a36aac-88ec-44c7-a928-7b6bebbdfbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:59.043933 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a36aac-88ec-44c7-a928-7b6bebbdfbe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:59.044656 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a36aac-88ec-44c7-a928-7b6bebbdfbe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:59.046331 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a36aac-88ec-44c7-a928-7b6bebbdfbe9 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:59.057201 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2117/4229] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:23:59.061252 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dcadb3-921c-493d-a4bf-f672d70c1a29 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:59.072095 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dcadb3-921c-493d-a4bf-f672d70c1a29 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:59.076879 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a167df-d2f7-4e53-86d4-1bb4e4575a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:59.077633 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a167df-d2f7-4e53-86d4-1bb4e4575a2f admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:59.077961 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a167df-d2f7-4e53-86d4-1bb4e4575a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:59.078235 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a167df-d2f7-4e53-86d4-1bb4e4575a2f admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:59.078953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a167df-d2f7-4e53-86d4-1bb4e4575a2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:59.080645 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a167df-d2f7-4e53-86d4-1bb4e4575a2f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:59.090879 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2113/4230] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:23:59.094935 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a36aac-88ec-44c7-a928-7b6bebbdfbe9 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:59.105633 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a36aac-88ec-44c7-a928-7b6bebbdfbe9 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:59.110861 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4c2e6-c4b2-4a4f-ad99-3fc1492b34fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:59.111818 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4c2e6-c4b2-4a4f-ad99-3fc1492b34fa admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:59.113643 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4c2e6-c4b2-4a4f-ad99-3fc1492b34fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:59.113643 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4c2e6-c4b2-4a4f-ad99-3fc1492b34fa admin admin] PATH_INFO: `/v3/projects/9492bde9ae1b46bb86c47027e9bdcc9d/users/526e4f63ee9946d2a7ed9bb862e33a57/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:59.129977 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af4c2e6-c4b2-4a4f-ad99-3fc1492b34fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=9492bde9ae1b46bb86c47027e9bdcc9d, user_id=526e4f63ee9946d2a7ed9bb862e33a57, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:59.132737 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af4c2e6-c4b2-4a4f-ad99-3fc1492b34fa admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:59.224700 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2118/4231] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:23:59 2022] PUT /identity/v3/projects/9492bde9ae1b46bb86c47027e9bdcc9d/users/526e4f63ee9946d2a7ed9bb862e33a57/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:23:59.234730 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6715ba-22d3-461b-90f1-4a137e82d61f None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:59.235017 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6715ba-22d3-461b-90f1-4a137e82d61f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:59.235297 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6715ba-22d3-461b-90f1-4a137e82d61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:59.264498 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-dd6715ba-22d3-461b-90f1-4a137e82d61f None None] MFA Rules not processed for user `526e4f63ee9946d2a7ed9bb862e33a57`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:23:59.265726 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-dd6715ba-22d3-461b-90f1-4a137e82d61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:59.336610 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2114/4232] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:23:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:23:59.349772 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4c2e6-c4b2-4a4f-ad99-3fc1492b34fa admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:59.351559 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1af4c2e6-c4b2-4a4f-ad99-3fc1492b34fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:23:59.428149 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4c2e6-c4b2-4a4f-ad99-3fc1492b34fa admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:59.432056 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb908f-9e20-4b8e-8234-c1aaf248c2be service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e302b1298dd04d6590e3d079f7b13b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:59.432701 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb908f-9e20-4b8e-8234-c1aaf248c2be service glance] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:59.432982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb908f-9e20-4b8e-8234-c1aaf248c2be service glance] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:59.433254 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb908f-9e20-4b8e-8234-c1aaf248c2be service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:59.489992 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb908f-9e20-4b8e-8234-c1aaf248c2be service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:59.491546 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb908f-9e20-4b8e-8234-c1aaf248c2be service glance] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:59.501643 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2119/4233] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:23:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:23:59.777899 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6715ba-22d3-461b-90f1-4a137e82d61f None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:23:59.789124 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6715ba-22d3-461b-90f1-4a137e82d61f None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:23:59.793877 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd65ac-31b6-410e-a879-39c9fd7a08b7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e302b1298dd04d6590e3d079f7b13b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:23:59.795053 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd65ac-31b6-410e-a879-39c9fd7a08b7 service glance] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:23:59.795341 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd65ac-31b6-410e-a879-39c9fd7a08b7 service glance] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:23:59.795624 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd65ac-31b6-410e-a879-39c9fd7a08b7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:23:59.804677 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd65ac-31b6-410e-a879-39c9fd7a08b7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:23:59.806225 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd65ac-31b6-410e-a879-39c9fd7a08b7 service glance] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:23:59.815543 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2115/4234] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:23:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:24:00.609798 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb908f-9e20-4b8e-8234-c1aaf248c2be service glance] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:00.691724 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb908f-9e20-4b8e-8234-c1aaf248c2be service glance] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:00.697541 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269012c1-59e6-43a0-b8fe-b06b2a3de368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:00.699630 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269012c1-59e6-43a0-b8fe-b06b2a3de368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:00.699988 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269012c1-59e6-43a0-b8fe-b06b2a3de368 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:00.700340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269012c1-59e6-43a0-b8fe-b06b2a3de368 admin admin] PATH_INFO: `/v3/users/d50992314a584bae8cbff6dfc9d29b1e` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:00.702774 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269012c1-59e6-43a0-b8fe-b06b2a3de368 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d50992314a584bae8cbff6dfc9d29b1e)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:00.705889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269012c1-59e6-43a0-b8fe-b06b2a3de368 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:00.923689 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-269012c1-59e6-43a0-b8fe-b06b2a3de368 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd50992314a584bae8cbff6dfc9d29b1e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:00.947472 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-269012c1-59e6-43a0-b8fe-b06b2a3de368 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd50992314a584bae8cbff6dfc9d29b1e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:01.025024 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-269012c1-59e6-43a0-b8fe-b06b2a3de368 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd50992314a584bae8cbff6dfc9d29b1e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:01.033114 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-269012c1-59e6-43a0-b8fe-b06b2a3de368 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd50992314a584bae8cbff6dfc9d29b1e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:01.035733 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-269012c1-59e6-43a0-b8fe-b06b2a3de368 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd50992314a584bae8cbff6dfc9d29b1e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:01.042609 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2120/4235] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:24:00 2022] DELETE /identity/v3/users/d50992314a584bae8cbff6dfc9d29b1e => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:01.047425 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d2645-7da7-4ba5-89e0-f995934b47c5 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:01.048170 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d2645-7da7-4ba5-89e0-f995934b47c5 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:01.048466 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d2645-7da7-4ba5-89e0-f995934b47c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:01.071570 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-058d2645-7da7-4ba5-89e0-f995934b47c5 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:01.072835 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-058d2645-7da7-4ba5-89e0-f995934b47c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:01.154391 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2116/4236] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:24:01.164700 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269012c1-59e6-43a0-b8fe-b06b2a3de368 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:01.167068 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-269012c1-59e6-43a0-b8fe-b06b2a3de368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:01.254346 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269012c1-59e6-43a0-b8fe-b06b2a3de368 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:01.258107 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398fd270-024a-452f-a1ed-78882dd7100f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:01.258754 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fd270-024a-452f-a1ed-78882dd7100f service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:01.259186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fd270-024a-452f-a1ed-78882dd7100f service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:01.259460 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fd270-024a-452f-a1ed-78882dd7100f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:01.270055 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398fd270-024a-452f-a1ed-78882dd7100f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:01.271534 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398fd270-024a-452f-a1ed-78882dd7100f service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:01.290316 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2121/4237] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:24:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:24:01.784225 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d2645-7da7-4ba5-89e0-f995934b47c5 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:01.786209 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-058d2645-7da7-4ba5-89e0-f995934b47c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:01.801039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d2645-7da7-4ba5-89e0-f995934b47c5 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:01.812498 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef905a-fb93-46e4-adf2-123b5f4250bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:01.814308 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef905a-fb93-46e4-adf2-123b5f4250bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:01.814813 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef905a-fb93-46e4-adf2-123b5f4250bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:01.815286 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef905a-fb93-46e4-adf2-123b5f4250bf admin admin] PATH_INFO: `/v3/projects/6abbe77263be4f0e96c3b778f1653976` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:01.818607 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef905a-fb93-46e4-adf2-123b5f4250bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6abbe77263be4f0e96c3b778f1653976)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:01.820806 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ef905a-fb93-46e4-adf2-123b5f4250bf admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:01.965166 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e1ef905a-fb93-46e4-adf2-123b5f4250bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6abbe77263be4f0e96c3b778f1653976', 'request_id': 'req-e1ef905a-fb93-46e4-adf2-123b5f4250bf'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:01.984080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e1ef905a-fb93-46e4-adf2-123b5f4250bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6abbe77263be4f0e96c3b778f1653976', 'request_id': 'req-e1ef905a-fb93-46e4-adf2-123b5f4250bf'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:01.984903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e1ef905a-fb93-46e4-adf2-123b5f4250bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6abbe77263be4f0e96c3b778f1653976', 'request_id': 'req-e1ef905a-fb93-46e4-adf2-123b5f4250bf'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:02.059424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e1ef905a-fb93-46e4-adf2-123b5f4250bf admin admin] The token cache is being invalidate because project 6abbe77263be4f0e96c3b778f1653976 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:24:02.060072 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e1ef905a-fb93-46e4-adf2-123b5f4250bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:02.060907 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e1ef905a-fb93-46e4-adf2-123b5f4250bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:02.064376 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2117/4238] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:24:01 2022] DELETE /identity/v3/projects/6abbe77263be4f0e96c3b778f1653976 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:02.069511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398fd270-024a-452f-a1ed-78882dd7100f service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:02.080493 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398fd270-024a-452f-a1ed-78882dd7100f service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:02.151793 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655aa23-d32f-478e-a46c-5a1975dca0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:02.152966 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655aa23-d32f-478e-a46c-5a1975dca0bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:02.153251 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655aa23-d32f-478e-a46c-5a1975dca0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:02.153526 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655aa23-d32f-478e-a46c-5a1975dca0bb admin admin] PATH_INFO: `/v3/users/526e4f63ee9946d2a7ed9bb862e33a57` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:02.155067 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655aa23-d32f-478e-a46c-5a1975dca0bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=526e4f63ee9946d2a7ed9bb862e33a57)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:02.157060 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655aa23-d32f-478e-a46c-5a1975dca0bb admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:02.414774 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e655aa23-d32f-478e-a46c-5a1975dca0bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '526e4f63ee9946d2a7ed9bb862e33a57'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:02.433461 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e655aa23-d32f-478e-a46c-5a1975dca0bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '526e4f63ee9946d2a7ed9bb862e33a57'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:02.506213 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e655aa23-d32f-478e-a46c-5a1975dca0bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '526e4f63ee9946d2a7ed9bb862e33a57'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:02.524353 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e655aa23-d32f-478e-a46c-5a1975dca0bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '526e4f63ee9946d2a7ed9bb862e33a57'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:02.526379 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e655aa23-d32f-478e-a46c-5a1975dca0bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '526e4f63ee9946d2a7ed9bb862e33a57'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:02.533327 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2122/4239] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:24:02 2022] DELETE /identity/v3/users/526e4f63ee9946d2a7ed9bb862e33a57 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:03.060800 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef905a-fb93-46e4-adf2-123b5f4250bf admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:03.064354 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e1ef905a-fb93-46e4-adf2-123b5f4250bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:03.091457 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef905a-fb93-46e4-adf2-123b5f4250bf admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:03.188503 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e20e90-e587-42b1-ac52-b116752de039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:03.189832 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e20e90-e587-42b1-ac52-b116752de039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:03.190361 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e20e90-e587-42b1-ac52-b116752de039 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:03.190765 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e20e90-e587-42b1-ac52-b116752de039 admin admin] PATH_INFO: `/v3/projects/9492bde9ae1b46bb86c47027e9bdcc9d` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:03.192181 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e20e90-e587-42b1-ac52-b116752de039 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9492bde9ae1b46bb86c47027e9bdcc9d)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:03.195062 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e20e90-e587-42b1-ac52-b116752de039 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:03.366687 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-17e20e90-e587-42b1-ac52-b116752de039 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9492bde9ae1b46bb86c47027e9bdcc9d', 'request_id': 'req-17e20e90-e587-42b1-ac52-b116752de039'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:03.372766 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-17e20e90-e587-42b1-ac52-b116752de039 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9492bde9ae1b46bb86c47027e9bdcc9d', 'request_id': 'req-17e20e90-e587-42b1-ac52-b116752de039'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:03.381067 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-17e20e90-e587-42b1-ac52-b116752de039 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9492bde9ae1b46bb86c47027e9bdcc9d', 'request_id': 'req-17e20e90-e587-42b1-ac52-b116752de039'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:03.498668 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-17e20e90-e587-42b1-ac52-b116752de039 admin admin] The token cache is being invalidate because project 9492bde9ae1b46bb86c47027e9bdcc9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:24:03.498964 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-17e20e90-e587-42b1-ac52-b116752de039 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:03.499831 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-17e20e90-e587-42b1-ac52-b116752de039 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:03.501883 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2118/4240] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:24:03 2022] DELETE /identity/v3/projects/9492bde9ae1b46bb86c47027e9bdcc9d => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:03.508376 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa85e9-7285-4019-aadf-69cf6e9c32f6 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:03.508866 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa85e9-7285-4019-aadf-69cf6e9c32f6 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:03.508866 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa85e9-7285-4019-aadf-69cf6e9c32f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:03.532169 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-20fa85e9-7285-4019-aadf-69cf6e9c32f6 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:03.533387 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-20fa85e9-7285-4019-aadf-69cf6e9c32f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:03.600782 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2123/4241] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:24:03.610500 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fcfd6d-1392-499b-8dee-039aa7084364 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:03.613214 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fcfd6d-1392-499b-8dee-039aa7084364 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:03.613214 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fcfd6d-1392-499b-8dee-039aa7084364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:03.632737 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-90fcfd6d-1392-499b-8dee-039aa7084364 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:03.634075 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-90fcfd6d-1392-499b-8dee-039aa7084364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:03.642350 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2119/4242] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:24:03.647932 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa85e9-7285-4019-aadf-69cf6e9c32f6 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:03.663910 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa85e9-7285-4019-aadf-69cf6e9c32f6 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:03.671479 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb038d-8fbd-45e3-b88f-3b6c31c9ad18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:03.673288 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb038d-8fbd-45e3-b88f-3b6c31c9ad18 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:03.680476 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb038d-8fbd-45e3-b88f-3b6c31c9ad18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:03.680476 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb038d-8fbd-45e3-b88f-3b6c31c9ad18 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:03.680476 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb038d-8fbd-45e3-b88f-3b6c31c9ad18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:24:03.680476 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb038d-8fbd-45e3-b88f-3b6c31c9ad18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:03.680476 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb038d-8fbd-45e3-b88f-3b6c31c9ad18 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:03.709122 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2124/4243] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:24:03.709391 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fcfd6d-1392-499b-8dee-039aa7084364 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:03.721213 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fcfd6d-1392-499b-8dee-039aa7084364 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:03.727005 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef0908-509d-4f17-ab69-dafdb92ec566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:03.727864 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef0908-509d-4f17-ab69-dafdb92ec566 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:03.728519 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef0908-509d-4f17-ab69-dafdb92ec566 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:03.728519 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef0908-509d-4f17-ab69-dafdb92ec566 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:03.729112 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef0908-509d-4f17-ab69-dafdb92ec566 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:03.731117 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef0908-509d-4f17-ab69-dafdb92ec566 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:03.847605 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2120/4244] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:24:03 2022] POST /identity/v3/projects => generated 359 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:24:03.850100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb038d-8fbd-45e3-b88f-3b6c31c9ad18 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:03.860085 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb038d-8fbd-45e3-b88f-3b6c31c9ad18 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:03.917117 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd502598-60ef-46be-8b0a-3d89cb78fa73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:03.917814 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd502598-60ef-46be-8b0a-3d89cb78fa73 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:03.918103 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd502598-60ef-46be-8b0a-3d89cb78fa73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:03.918431 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd502598-60ef-46be-8b0a-3d89cb78fa73 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:03.919164 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd502598-60ef-46be-8b0a-3d89cb78fa73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:03.921145 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd502598-60ef-46be-8b0a-3d89cb78fa73 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:04.002407 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2125/4245] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:24:03 2022] POST /identity/v3/users => generated 280 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:24:04.006970 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef0908-509d-4f17-ab69-dafdb92ec566 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:04.020109 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef0908-509d-4f17-ab69-dafdb92ec566 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:04.025744 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481df17-bc52-4d37-98ee-aa5d3a167710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:04.026710 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481df17-bc52-4d37-98ee-aa5d3a167710 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:04.026999 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481df17-bc52-4d37-98ee-aa5d3a167710 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:04.033385 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481df17-bc52-4d37-98ee-aa5d3a167710 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:04.033385 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5481df17-bc52-4d37-98ee-aa5d3a167710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:04.033385 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5481df17-bc52-4d37-98ee-aa5d3a167710 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:04.054953 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd502598-60ef-46be-8b0a-3d89cb78fa73 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:04.056040 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2121/4246] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:24:04.067887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd502598-60ef-46be-8b0a-3d89cb78fa73 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:04.075905 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8da276-c7d1-4fd1-b6dc-8258200e56d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:04.076834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8da276-c7d1-4fd1-b6dc-8258200e56d6 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:04.077117 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8da276-c7d1-4fd1-b6dc-8258200e56d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:04.085622 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8da276-c7d1-4fd1-b6dc-8258200e56d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:04.085622 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8da276-c7d1-4fd1-b6dc-8258200e56d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:04.085622 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8da276-c7d1-4fd1-b6dc-8258200e56d6 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:04.099866 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2126/4247] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:24:04.104408 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481df17-bc52-4d37-98ee-aa5d3a167710 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:04.115406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481df17-bc52-4d37-98ee-aa5d3a167710 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:04.122843 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6fd285-e041-472d-b704-7d8ddce57378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:04.123985 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6fd285-e041-472d-b704-7d8ddce57378 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:04.124445 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6fd285-e041-472d-b704-7d8ddce57378 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:04.124871 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6fd285-e041-472d-b704-7d8ddce57378 admin admin] PATH_INFO: `/v3/projects/4aee757b0df54992a28116e355fdc91e/users/189735dba7ae42348413216cc2bdb871/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:04.146022 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6fd285-e041-472d-b704-7d8ddce57378 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aee757b0df54992a28116e355fdc91e, user_id=189735dba7ae42348413216cc2bdb871, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:04.149237 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6fd285-e041-472d-b704-7d8ddce57378 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:04.243192 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2122/4248] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:24:04 2022] PUT /identity/v3/projects/4aee757b0df54992a28116e355fdc91e/users/189735dba7ae42348413216cc2bdb871/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:04.256588 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cddac9-a5b8-4989-8cfa-106dc0ede19d None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:04.257237 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cddac9-a5b8-4989-8cfa-106dc0ede19d None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:04.257658 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cddac9-a5b8-4989-8cfa-106dc0ede19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:04.303294 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-a7cddac9-a5b8-4989-8cfa-106dc0ede19d None None] MFA Rules not processed for user `189735dba7ae42348413216cc2bdb871`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:04.305253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a7cddac9-a5b8-4989-8cfa-106dc0ede19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:04.392347 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2127/4249] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:04 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:24:04.405911 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6fd285-e041-472d-b704-7d8ddce57378 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:04.485745 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6fd285-e041-472d-b704-7d8ddce57378 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:04.496135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee4df2-a2a2-49c5-aca7-6cda1a7a514d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:04.497093 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee4df2-a2a2-49c5-aca7-6cda1a7a514d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:04.497382 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee4df2-a2a2-49c5-aca7-6cda1a7a514d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:04.497658 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee4df2-a2a2-49c5-aca7-6cda1a7a514d admin admin] PATH_INFO: `/v3/users/189735dba7ae42348413216cc2bdb871` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:04.499197 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee4df2-a2a2-49c5-aca7-6cda1a7a514d admin admin] RBAC: Authorizing `identity:delete_user(user_id=189735dba7ae42348413216cc2bdb871)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:04.501280 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee4df2-a2a2-49c5-aca7-6cda1a7a514d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:04.685449 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8bee4df2-a2a2-49c5-aca7-6cda1a7a514d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '189735dba7ae42348413216cc2bdb871'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:04.708428 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8bee4df2-a2a2-49c5-aca7-6cda1a7a514d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '189735dba7ae42348413216cc2bdb871'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:04.766328 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8bee4df2-a2a2-49c5-aca7-6cda1a7a514d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '189735dba7ae42348413216cc2bdb871'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:04.767201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8bee4df2-a2a2-49c5-aca7-6cda1a7a514d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '189735dba7ae42348413216cc2bdb871'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:04.774841 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8bee4df2-a2a2-49c5-aca7-6cda1a7a514d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '189735dba7ae42348413216cc2bdb871'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:04.781035 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2123/4250] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:24:04 2022] DELETE /identity/v3/users/189735dba7ae42348413216cc2bdb871 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:04.785978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739f12b-f6c8-4f6b-bc10-ee568ad8c380 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:04.786796 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739f12b-f6c8-4f6b-bc10-ee568ad8c380 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:04.787317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739f12b-f6c8-4f6b-bc10-ee568ad8c380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:04.807711 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-3739f12b-f6c8-4f6b-bc10-ee568ad8c380 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:04.809058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3739f12b-f6c8-4f6b-bc10-ee568ad8c380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:04.884808 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2128/4251] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:24:04.900441 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee4df2-a2a2-49c5-aca7-6cda1a7a514d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:04.902707 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8bee4df2-a2a2-49c5-aca7-6cda1a7a514d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:05.023133 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee4df2-a2a2-49c5-aca7-6cda1a7a514d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:05.028052 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d2bc2-5e0c-456c-8bd4-2161565ced49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:05.028980 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d2bc2-5e0c-456c-8bd4-2161565ced49 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:05.029518 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d2bc2-5e0c-456c-8bd4-2161565ced49 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:05.029991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d2bc2-5e0c-456c-8bd4-2161565ced49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:05.042653 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d2bc2-5e0c-456c-8bd4-2161565ced49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:05.044111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d2bc2-5e0c-456c-8bd4-2161565ced49 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:05.056600 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2124/4252] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:24:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:24:05.203402 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7e8df-7e86-406e-a8e0-cde31719e3c7 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:05.203899 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7e8df-7e86-406e-a8e0-cde31719e3c7 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:05.204374 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7e8df-7e86-406e-a8e0-cde31719e3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:05.248708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-85a7e8df-7e86-406e-a8e0-cde31719e3c7 None None] MFA Rules not processed for user `20b4082fa07249e2b6dfb9b4506ab398`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:05.248708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-85a7e8df-7e86-406e-a8e0-cde31719e3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:05.383751 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2129/4253] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:24:05.398515 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d2bc2-5e0c-456c-8bd4-2161565ced49 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:05.400112 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d62d2bc2-5e0c-456c-8bd4-2161565ced49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:05.570613 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d2bc2-5e0c-456c-8bd4-2161565ced49 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:05.580142 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa1ccc-b200-41e9-86bd-d2e74149035b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:05.581521 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa1ccc-b200-41e9-86bd-d2e74149035b service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:05.582086 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa1ccc-b200-41e9-86bd-d2e74149035b service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:05.582590 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa1ccc-b200-41e9-86bd-d2e74149035b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:05.591549 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa1ccc-b200-41e9-86bd-d2e74149035b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:05.594325 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa1ccc-b200-41e9-86bd-d2e74149035b service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:05.613972 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2125/4254] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:24:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:24:05.709600 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7e8df-7e86-406e-a8e0-cde31719e3c7 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:05.709600 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-85a7e8df-7e86-406e-a8e0-cde31719e3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:05.731315 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7e8df-7e86-406e-a8e0-cde31719e3c7 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:05.743760 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf50cc4-8b4f-4555-a4d2-e6743f81f3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:05.746383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf50cc4-8b4f-4555-a4d2-e6743f81f3d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:05.746383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf50cc4-8b4f-4555-a4d2-e6743f81f3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:05.746383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf50cc4-8b4f-4555-a4d2-e6743f81f3d3 admin admin] PATH_INFO: `/v3/projects/4aee757b0df54992a28116e355fdc91e` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:05.749963 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf50cc4-8b4f-4555-a4d2-e6743f81f3d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aee757b0df54992a28116e355fdc91e)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:05.754165 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf50cc4-8b4f-4555-a4d2-e6743f81f3d3 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:05.995165 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-daf50cc4-8b4f-4555-a4d2-e6743f81f3d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aee757b0df54992a28116e355fdc91e', 'request_id': 'req-daf50cc4-8b4f-4555-a4d2-e6743f81f3d3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:06.023944 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-daf50cc4-8b4f-4555-a4d2-e6743f81f3d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aee757b0df54992a28116e355fdc91e', 'request_id': 'req-daf50cc4-8b4f-4555-a4d2-e6743f81f3d3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:06.036785 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-daf50cc4-8b4f-4555-a4d2-e6743f81f3d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aee757b0df54992a28116e355fdc91e', 'request_id': 'req-daf50cc4-8b4f-4555-a4d2-e6743f81f3d3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:06.183990 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-daf50cc4-8b4f-4555-a4d2-e6743f81f3d3 admin admin] The token cache is being invalidate because project 4aee757b0df54992a28116e355fdc91e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:24:06.184291 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-daf50cc4-8b4f-4555-a4d2-e6743f81f3d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:06.185179 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-daf50cc4-8b4f-4555-a4d2-e6743f81f3d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:06.189720 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2130/4255] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:24:05 2022] DELETE /identity/v3/projects/4aee757b0df54992a28116e355fdc91e => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:06.195660 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b218148-e1de-4d17-8b67-6a72530621f4 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:06.196032 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b218148-e1de-4d17-8b67-6a72530621f4 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:06.196389 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b218148-e1de-4d17-8b67-6a72530621f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:06.217596 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-1b218148-e1de-4d17-8b67-6a72530621f4 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:06.219021 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1b218148-e1de-4d17-8b67-6a72530621f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:06.395792 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2126/4256] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:24:06.403898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0315c9-4429-43d5-b638-7f703b714e80 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:06.404187 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0315c9-4429-43d5-b638-7f703b714e80 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:06.404474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0315c9-4429-43d5-b638-7f703b714e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:06.449808 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-0c0315c9-4429-43d5-b638-7f703b714e80 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:06.452410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0c0315c9-4429-43d5-b638-7f703b714e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:06.476798 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b218148-e1de-4d17-8b67-6a72530621f4 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:06.477334 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2131/4257] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:24:06.491768 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b218148-e1de-4d17-8b67-6a72530621f4 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:06.501337 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e188c-5446-47c8-bac8-3b51802c2ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:06.502134 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e188c-5446-47c8-bac8-3b51802c2ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:06.502421 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e188c-5446-47c8-bac8-3b51802c2ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:06.505924 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e188c-5446-47c8-bac8-3b51802c2ce2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:06.505924 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e188c-5446-47c8-bac8-3b51802c2ce2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:24:06.505924 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e188c-5446-47c8-bac8-3b51802c2ce2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:06.506201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e188c-5446-47c8-bac8-3b51802c2ce2 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:06.524299 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2127/4258] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:24:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:24:06.525658 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0315c9-4429-43d5-b638-7f703b714e80 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:06.535357 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0315c9-4429-43d5-b638-7f703b714e80 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:06.540654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999f079-9fd9-4aab-9d57-f94ab09638d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:06.541236 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999f079-9fd9-4aab-9d57-f94ab09638d0 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:06.541526 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999f079-9fd9-4aab-9d57-f94ab09638d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:06.541864 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999f079-9fd9-4aab-9d57-f94ab09638d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:06.542564 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b999f079-9fd9-4aab-9d57-f94ab09638d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:06.544535 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b999f079-9fd9-4aab-9d57-f94ab09638d0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:06.637823 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2132/4259] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:24:06 2022] POST /identity/v3/projects => generated 409 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:24:06.642299 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e188c-5446-47c8-bac8-3b51802c2ce2 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:06.654633 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e188c-5446-47c8-bac8-3b51802c2ce2 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:06.751496 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecccfd1f-c40c-474d-bb84-7d7f235fd9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:06.752549 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccfd1f-c40c-474d-bb84-7d7f235fd9a2 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:06.753363 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccfd1f-c40c-474d-bb84-7d7f235fd9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:06.753821 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccfd1f-c40c-474d-bb84-7d7f235fd9a2 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:06.754812 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecccfd1f-c40c-474d-bb84-7d7f235fd9a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:06.756864 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecccfd1f-c40c-474d-bb84-7d7f235fd9a2 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:06.875782 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2128/4260] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:24:06 2022] POST /identity/v3/users => generated 305 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:24:06.880484 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999f079-9fd9-4aab-9d57-f94ab09638d0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:06.904842 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999f079-9fd9-4aab-9d57-f94ab09638d0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:06.920372 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fd9c3-4898-4d0a-a0df-11eb879fa90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:06.921158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fd9c3-4898-4d0a-a0df-11eb879fa90b admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:06.921522 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fd9c3-4898-4d0a-a0df-11eb879fa90b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:06.921913 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fd9c3-4898-4d0a-a0df-11eb879fa90b admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:06.922988 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044fd9c3-4898-4d0a-a0df-11eb879fa90b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:06.925292 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044fd9c3-4898-4d0a-a0df-11eb879fa90b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:06.951651 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2133/4261] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:24:06.960642 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecccfd1f-c40c-474d-bb84-7d7f235fd9a2 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:06.976722 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecccfd1f-c40c-474d-bb84-7d7f235fd9a2 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:06.981838 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c12bd83-14bc-4a60-be72-df71a77de857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:06.982564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12bd83-14bc-4a60-be72-df71a77de857 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:06.982852 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12bd83-14bc-4a60-be72-df71a77de857 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:06.983137 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12bd83-14bc-4a60-be72-df71a77de857 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:06.983868 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c12bd83-14bc-4a60-be72-df71a77de857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:06.985501 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c12bd83-14bc-4a60-be72-df71a77de857 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:06.997179 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2129/4262] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:24:07.001328 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fd9c3-4898-4d0a-a0df-11eb879fa90b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:07.012708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fd9c3-4898-4d0a-a0df-11eb879fa90b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:07.017909 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8efe419-96da-400b-adcd-113ffe6207b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:07.019058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efe419-96da-400b-adcd-113ffe6207b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:07.019385 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efe419-96da-400b-adcd-113ffe6207b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:07.019670 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efe419-96da-400b-adcd-113ffe6207b1 admin admin] PATH_INFO: `/v3/projects/e6ff343ae4574701bd6f36e4b2fe7b0e/users/30bc1799eedd4cdcaf0cf4465f019550/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:07.040671 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8efe419-96da-400b-adcd-113ffe6207b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6ff343ae4574701bd6f36e4b2fe7b0e, user_id=30bc1799eedd4cdcaf0cf4465f019550, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:07.045195 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8efe419-96da-400b-adcd-113ffe6207b1 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:07.138825 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2134/4263] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:24:07 2022] PUT /identity/v3/projects/e6ff343ae4574701bd6f36e4b2fe7b0e/users/30bc1799eedd4cdcaf0cf4465f019550/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:07.151374 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79216943-47a2-4500-9786-1b2a37d15e92 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:07.152014 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79216943-47a2-4500-9786-1b2a37d15e92 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:07.159993 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79216943-47a2-4500-9786-1b2a37d15e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:07.183580 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-79216943-47a2-4500-9786-1b2a37d15e92 None None] MFA Rules not processed for user `30bc1799eedd4cdcaf0cf4465f019550`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:07.188210 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-79216943-47a2-4500-9786-1b2a37d15e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:07.260341 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2130/4264] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:07 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:24:07.264792 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8efe419-96da-400b-adcd-113ffe6207b1 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:07.333193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8efe419-96da-400b-adcd-113ffe6207b1 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:07.340143 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587be89-5fb5-4219-959a-1a5d6cba9099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:07.342667 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587be89-5fb5-4219-959a-1a5d6cba9099 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:07.342667 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587be89-5fb5-4219-959a-1a5d6cba9099 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:07.342667 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587be89-5fb5-4219-959a-1a5d6cba9099 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:07.343093 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a587be89-5fb5-4219-959a-1a5d6cba9099 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:07.345876 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a587be89-5fb5-4219-959a-1a5d6cba9099 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:07.470464 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2135/4265] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:24:07 2022] POST /identity/v3/projects => generated 411 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:24:07.471500 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79216943-47a2-4500-9786-1b2a37d15e92 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:07.488842 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79216943-47a2-4500-9786-1b2a37d15e92 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:07.553024 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3449c19-eaab-4c8a-a475-eccda9fcea1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:07.553703 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3449c19-eaab-4c8a-a475-eccda9fcea1a admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:07.554043 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3449c19-eaab-4c8a-a475-eccda9fcea1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:07.554320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3449c19-eaab-4c8a-a475-eccda9fcea1a admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:07.555099 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3449c19-eaab-4c8a-a475-eccda9fcea1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:07.560539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3449c19-eaab-4c8a-a475-eccda9fcea1a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:07.659375 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2131/4266] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:24:07 2022] POST /identity/v3/users => generated 312 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:24:07.662263 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587be89-5fb5-4219-959a-1a5d6cba9099 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:07.677864 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587be89-5fb5-4219-959a-1a5d6cba9099 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:07.692388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a38dc-39d8-4bba-89e3-0647b75afbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:07.693332 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a38dc-39d8-4bba-89e3-0647b75afbb5 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:07.693820 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a38dc-39d8-4bba-89e3-0647b75afbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:07.694295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a38dc-39d8-4bba-89e3-0647b75afbb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:07.695178 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a38dc-39d8-4bba-89e3-0647b75afbb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:07.697679 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a38dc-39d8-4bba-89e3-0647b75afbb5 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:07.718494 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2136/4267] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:24:07.720071 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3449c19-eaab-4c8a-a475-eccda9fcea1a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:07.730231 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3449c19-eaab-4c8a-a475-eccda9fcea1a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:07.736992 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a85e24-2917-455a-af65-ecf41bde026a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:07.738562 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a85e24-2917-455a-af65-ecf41bde026a admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:07.738838 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a85e24-2917-455a-af65-ecf41bde026a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:07.739141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a85e24-2917-455a-af65-ecf41bde026a admin admin] PATH_INFO: `/v3/projects/5c72666ff1ef4a8c866242ac61c49446/users/ebaa30e91cf5472b835ff66154da4ab0/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:07.757077 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a85e24-2917-455a-af65-ecf41bde026a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c72666ff1ef4a8c866242ac61c49446, user_id=ebaa30e91cf5472b835ff66154da4ab0, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:07.760298 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a85e24-2917-455a-af65-ecf41bde026a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:07.843142 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2132/4268] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:24:07 2022] PUT /identity/v3/projects/5c72666ff1ef4a8c866242ac61c49446/users/ebaa30e91cf5472b835ff66154da4ab0/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:07.847382 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a38dc-39d8-4bba-89e3-0647b75afbb5 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:07.860593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a38dc-39d8-4bba-89e3-0647b75afbb5 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:07.942328 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06207641-a9d7-4979-9656-45ac923c6777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:07.943252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06207641-a9d7-4979-9656-45ac923c6777 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:07.943574 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06207641-a9d7-4979-9656-45ac923c6777 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:07.943922 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06207641-a9d7-4979-9656-45ac923c6777 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:07.944963 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06207641-a9d7-4979-9656-45ac923c6777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:07.950437 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06207641-a9d7-4979-9656-45ac923c6777 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:07.966046 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2137/4269] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:24:07.970025 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a85e24-2917-455a-af65-ecf41bde026a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:07.983226 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a85e24-2917-455a-af65-ecf41bde026a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:07.990018 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8cbffd-1a90-4cc7-b60f-8ee6178f5e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:07.991573 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cbffd-1a90-4cc7-b60f-8ee6178f5e3d admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:08.000070 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cbffd-1a90-4cc7-b60f-8ee6178f5e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:08.000070 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cbffd-1a90-4cc7-b60f-8ee6178f5e3d admin admin] PATH_INFO: `/v3/projects/5c72666ff1ef4a8c866242ac61c49446/users/ebaa30e91cf5472b835ff66154da4ab0/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:08.000070 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8cbffd-1a90-4cc7-b60f-8ee6178f5e3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c72666ff1ef4a8c866242ac61c49446, user_id=ebaa30e91cf5472b835ff66154da4ab0, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:08.000070 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8cbffd-1a90-4cc7-b60f-8ee6178f5e3d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:08.010526 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2133/4270] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:24:07 2022] PUT /identity/v3/projects/5c72666ff1ef4a8c866242ac61c49446/users/ebaa30e91cf5472b835ff66154da4ab0/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:08.021994 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7ed6d-b11c-4261-bfa5-3827f0bd572f None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:08.023557 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7ed6d-b11c-4261-bfa5-3827f0bd572f None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:08.023870 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7ed6d-b11c-4261-bfa5-3827f0bd572f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:08.054039 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-33a7ed6d-b11c-4261-bfa5-3827f0bd572f None None] MFA Rules not processed for user `ebaa30e91cf5472b835ff66154da4ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:08.055378 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-33a7ed6d-b11c-4261-bfa5-3827f0bd572f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:08.175468 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2138/4271] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:08 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:24:08.183746 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8cbffd-1a90-4cc7-b60f-8ee6178f5e3d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:08.185986 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4f8cbffd-1a90-4cc7-b60f-8ee6178f5e3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:08.256121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8cbffd-1a90-4cc7-b60f-8ee6178f5e3d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:08.260974 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cf26e-d9e4-4066-a6d6-c553fcf122f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:08.261848 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cf26e-d9e4-4066-a6d6-c553fcf122f5 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:08.262334 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cf26e-d9e4-4066-a6d6-c553fcf122f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:08.262615 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cf26e-d9e4-4066-a6d6-c553fcf122f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:08.284611 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4cf26e-d9e4-4066-a6d6-c553fcf122f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:08.290102 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a7ed6d-b11c-4261-bfa5-3827f0bd572f None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:08.290236 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4cf26e-d9e4-4066-a6d6-c553fcf122f5 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:08.290340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-33a7ed6d-b11c-4261-bfa5-3827f0bd572f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:08.304505 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2134/4272] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:24:08 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:24:08.448020 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a7ed6d-b11c-4261-bfa5-3827f0bd572f None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:08.466216 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d396b-f2c6-48ee-9d72-2206dce51aa5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:08.467217 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d396b-f2c6-48ee-9d72-2206dce51aa5 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:08.467507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d396b-f2c6-48ee-9d72-2206dce51aa5 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:08.468205 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d396b-f2c6-48ee-9d72-2206dce51aa5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:08.471221 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-680d396b-f2c6-48ee-9d72-2206dce51aa5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:08.582205 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d396b-f2c6-48ee-9d72-2206dce51aa5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:08.584080 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d396b-f2c6-48ee-9d72-2206dce51aa5 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:08.606959 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2139/4273] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:24:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:24:10.307936 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5876344-c2ef-453a-9952-7bfa79a8a33f None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:10.308419 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5876344-c2ef-453a-9952-7bfa79a8a33f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:10.308604 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5876344-c2ef-453a-9952-7bfa79a8a33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:10.330346 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-c5876344-c2ef-453a-9952-7bfa79a8a33f None None] MFA Rules not processed for user `20b4082fa07249e2b6dfb9b4506ab398`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:10.332777 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c5876344-c2ef-453a-9952-7bfa79a8a33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:10.418827 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2135/4274] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:24:12.794024 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d396b-f2c6-48ee-9d72-2206dce51aa5 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:12.859239 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d396b-f2c6-48ee-9d72-2206dce51aa5 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:12.866430 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b04af8-3460-40c2-8176-65b2884415cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:12.867372 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b04af8-3460-40c2-8176-65b2884415cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:12.867886 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b04af8-3460-40c2-8176-65b2884415cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:12.868006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b04af8-3460-40c2-8176-65b2884415cf admin admin] PATH_INFO: `/v3/users/30bc1799eedd4cdcaf0cf4465f019550` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:12.869131 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b04af8-3460-40c2-8176-65b2884415cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=30bc1799eedd4cdcaf0cf4465f019550)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:12.871190 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b04af8-3460-40c2-8176-65b2884415cf admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:13.154555 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d9b04af8-3460-40c2-8176-65b2884415cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30bc1799eedd4cdcaf0cf4465f019550'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:13.166971 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d9b04af8-3460-40c2-8176-65b2884415cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30bc1799eedd4cdcaf0cf4465f019550'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:13.296855 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d9b04af8-3460-40c2-8176-65b2884415cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30bc1799eedd4cdcaf0cf4465f019550'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:13.312248 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d9b04af8-3460-40c2-8176-65b2884415cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30bc1799eedd4cdcaf0cf4465f019550'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:13.313739 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d9b04af8-3460-40c2-8176-65b2884415cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30bc1799eedd4cdcaf0cf4465f019550'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:13.326776 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2140/4275] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:24:12 2022] DELETE /identity/v3/users/30bc1799eedd4cdcaf0cf4465f019550 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:13.330637 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed460285-2e43-44c0-ad0b-d97e8df4f1bb None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:13.331736 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed460285-2e43-44c0-ad0b-d97e8df4f1bb None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:13.331736 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed460285-2e43-44c0-ad0b-d97e8df4f1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:13.357793 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-ed460285-2e43-44c0-ad0b-d97e8df4f1bb None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:13.359090 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ed460285-2e43-44c0-ad0b-d97e8df4f1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:13.512571 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2136/4276] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:24:13.555202 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b04af8-3460-40c2-8176-65b2884415cf admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:13.556776 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d9b04af8-3460-40c2-8176-65b2884415cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:13.760101 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b04af8-3460-40c2-8176-65b2884415cf admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:13.763965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36fede-5300-4750-801d-be219505b280 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:13.764861 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36fede-5300-4750-801d-be219505b280 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:13.765330 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36fede-5300-4750-801d-be219505b280 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:13.765612 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36fede-5300-4750-801d-be219505b280 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:13.787694 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36fede-5300-4750-801d-be219505b280 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:13.791469 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36fede-5300-4750-801d-be219505b280 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:13.807443 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2141/4277] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:24:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:24:14.379522 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed460285-2e43-44c0-ad0b-d97e8df4f1bb None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:14.381928 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ed460285-2e43-44c0-ad0b-d97e8df4f1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:14.401093 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed460285-2e43-44c0-ad0b-d97e8df4f1bb None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:14.423404 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e534b-183c-43c8-8c07-addf6dbf5d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:14.424350 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e534b-183c-43c8-8c07-addf6dbf5d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:14.425219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e534b-183c-43c8-8c07-addf6dbf5d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:14.425494 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e534b-183c-43c8-8c07-addf6dbf5d29 admin admin] PATH_INFO: `/v3/users/f2be8a8f7a034cddb01078690b5bd364` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:14.428551 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e534b-183c-43c8-8c07-addf6dbf5d29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2be8a8f7a034cddb01078690b5bd364)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:14.430645 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e534b-183c-43c8-8c07-addf6dbf5d29 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:14.744210 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36fede-5300-4750-801d-be219505b280 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:14.745878 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-cc36fede-5300-4750-801d-be219505b280 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:14.768936 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36fede-5300-4750-801d-be219505b280 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:14.771702 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d89e534b-183c-43c8-8c07-addf6dbf5d29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2be8a8f7a034cddb01078690b5bd364'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:14.779149 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb96cae-430b-4af0-b808-3ae23b21f884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:14.780492 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb96cae-430b-4af0-b808-3ae23b21f884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:14.780971 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb96cae-430b-4af0-b808-3ae23b21f884 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:14.781439 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb96cae-430b-4af0-b808-3ae23b21f884 admin admin] PATH_INFO: `/v3/projects/e6ff343ae4574701bd6f36e4b2fe7b0e` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:14.787347 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb96cae-430b-4af0-b808-3ae23b21f884 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6ff343ae4574701bd6f36e4b2fe7b0e)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:14.789653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb96cae-430b-4af0-b808-3ae23b21f884 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:14.810207 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d89e534b-183c-43c8-8c07-addf6dbf5d29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2be8a8f7a034cddb01078690b5bd364'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:14.908050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d89e534b-183c-43c8-8c07-addf6dbf5d29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2be8a8f7a034cddb01078690b5bd364'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:14.908624 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d89e534b-183c-43c8-8c07-addf6dbf5d29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2be8a8f7a034cddb01078690b5bd364'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:14.920404 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d89e534b-183c-43c8-8c07-addf6dbf5d29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2be8a8f7a034cddb01078690b5bd364'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:14.938114 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2137/4278] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:24:14 2022] DELETE /identity/v3/users/f2be8a8f7a034cddb01078690b5bd364 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:14.961358 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1bb96cae-430b-4af0-b808-3ae23b21f884 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6ff343ae4574701bd6f36e4b2fe7b0e', 'request_id': 'req-1bb96cae-430b-4af0-b808-3ae23b21f884'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:14.978261 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1bb96cae-430b-4af0-b808-3ae23b21f884 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6ff343ae4574701bd6f36e4b2fe7b0e', 'request_id': 'req-1bb96cae-430b-4af0-b808-3ae23b21f884'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:15.003465 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1bb96cae-430b-4af0-b808-3ae23b21f884 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6ff343ae4574701bd6f36e4b2fe7b0e', 'request_id': 'req-1bb96cae-430b-4af0-b808-3ae23b21f884'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:15.161601 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1bb96cae-430b-4af0-b808-3ae23b21f884 admin admin] The token cache is being invalidate because project e6ff343ae4574701bd6f36e4b2fe7b0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:24:15.161841 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1bb96cae-430b-4af0-b808-3ae23b21f884 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:15.162908 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1bb96cae-430b-4af0-b808-3ae23b21f884 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:15.165259 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2142/4279] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:24:14 2022] DELETE /identity/v3/projects/e6ff343ae4574701bd6f36e4b2fe7b0e => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:15.169531 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e534b-183c-43c8-8c07-addf6dbf5d29 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:15.173320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d89e534b-183c-43c8-8c07-addf6dbf5d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:15.289590 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e534b-183c-43c8-8c07-addf6dbf5d29 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:15.295370 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f8f95-28c3-4a30-8f05-8819252a361b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:15.296463 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f8f95-28c3-4a30-8f05-8819252a361b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:15.296844 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f8f95-28c3-4a30-8f05-8819252a361b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:15.297473 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f8f95-28c3-4a30-8f05-8819252a361b admin admin] PATH_INFO: `/v3/users/ebaa30e91cf5472b835ff66154da4ab0` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:15.298841 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f8f95-28c3-4a30-8f05-8819252a361b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebaa30e91cf5472b835ff66154da4ab0)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:15.302837 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f8f95-28c3-4a30-8f05-8819252a361b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:15.416286 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb96cae-430b-4af0-b808-3ae23b21f884 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:15.417163 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1bb96cae-430b-4af0-b808-3ae23b21f884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:15.520550 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb96cae-430b-4af0-b808-3ae23b21f884 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:15.525660 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9404fce-ebcf-4548-b143-04bfea24f537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:15.530348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9404fce-ebcf-4548-b143-04bfea24f537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:15.530348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9404fce-ebcf-4548-b143-04bfea24f537 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:15.530348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9404fce-ebcf-4548-b143-04bfea24f537 admin admin] PATH_INFO: `/v3/projects/bfe1b39ed5644c20ac54608a6f25e0bf` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:15.530348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9404fce-ebcf-4548-b143-04bfea24f537 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfe1b39ed5644c20ac54608a6f25e0bf)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:15.530348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9404fce-ebcf-4548-b143-04bfea24f537 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:15.564751 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e09f8f95-28c3-4a30-8f05-8819252a361b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebaa30e91cf5472b835ff66154da4ab0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:15.577080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e09f8f95-28c3-4a30-8f05-8819252a361b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebaa30e91cf5472b835ff66154da4ab0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:15.678057 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e09f8f95-28c3-4a30-8f05-8819252a361b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebaa30e91cf5472b835ff66154da4ab0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:15.678057 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e09f8f95-28c3-4a30-8f05-8819252a361b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebaa30e91cf5472b835ff66154da4ab0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:15.682976 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c9404fce-ebcf-4548-b143-04bfea24f537 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfe1b39ed5644c20ac54608a6f25e0bf', 'request_id': 'req-c9404fce-ebcf-4548-b143-04bfea24f537'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:15.689146 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e09f8f95-28c3-4a30-8f05-8819252a361b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebaa30e91cf5472b835ff66154da4ab0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:15.689519 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c9404fce-ebcf-4548-b143-04bfea24f537 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfe1b39ed5644c20ac54608a6f25e0bf', 'request_id': 'req-c9404fce-ebcf-4548-b143-04bfea24f537'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:15.697161 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c9404fce-ebcf-4548-b143-04bfea24f537 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfe1b39ed5644c20ac54608a6f25e0bf', 'request_id': 'req-c9404fce-ebcf-4548-b143-04bfea24f537'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:15.701251 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2138/4280] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:24:15 2022] DELETE /identity/v3/users/ebaa30e91cf5472b835ff66154da4ab0 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:15.830342 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c9404fce-ebcf-4548-b143-04bfea24f537 admin admin] The token cache is being invalidate because project bfe1b39ed5644c20ac54608a6f25e0bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:24:15.831245 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c9404fce-ebcf-4548-b143-04bfea24f537 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:15.832154 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c9404fce-ebcf-4548-b143-04bfea24f537 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:15.837201 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2143/4281] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:24:15 2022] DELETE /identity/v3/projects/bfe1b39ed5644c20ac54608a6f25e0bf => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:15.839077 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd6cba-8d21-4b7a-b358-884b79a42cf7 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:15.839603 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd6cba-8d21-4b7a-b358-884b79a42cf7 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:15.840118 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd6cba-8d21-4b7a-b358-884b79a42cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:15.860983 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-98fd6cba-8d21-4b7a-b358-884b79a42cf7 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:15.863438 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-98fd6cba-8d21-4b7a-b358-884b79a42cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:15.931102 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2139/4282] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:24:15.939038 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f519d4-1fc0-44b8-9bbe-ee411e0f6129 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:15.939625 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f519d4-1fc0-44b8-9bbe-ee411e0f6129 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:15.939954 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f519d4-1fc0-44b8-9bbe-ee411e0f6129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:15.958341 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd6cba-8d21-4b7a-b358-884b79a42cf7 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:15.960117 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-98fd6cba-8d21-4b7a-b358-884b79a42cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:15.975481 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-19f519d4-1fc0-44b8-9bbe-ee411e0f6129 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:15.977842 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd6cba-8d21-4b7a-b358-884b79a42cf7 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:15.978095 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-19f519d4-1fc0-44b8-9bbe-ee411e0f6129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:15.985427 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe53fd7-9d04-41fd-a0e4-0bee88c9941c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:15.986683 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe53fd7-9d04-41fd-a0e4-0bee88c9941c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:15.987357 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe53fd7-9d04-41fd-a0e4-0bee88c9941c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:15.987888 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe53fd7-9d04-41fd-a0e4-0bee88c9941c admin admin] PATH_INFO: `/v3/projects/5c72666ff1ef4a8c866242ac61c49446` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:15.989910 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe53fd7-9d04-41fd-a0e4-0bee88c9941c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c72666ff1ef4a8c866242ac61c49446)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:15.992576 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe53fd7-9d04-41fd-a0e4-0bee88c9941c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:15.995240 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2144/4283] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:24:15.999294 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f519d4-1fc0-44b8-9bbe-ee411e0f6129 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:16.009314 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f519d4-1fc0-44b8-9bbe-ee411e0f6129 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:16.014478 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692038cc-f289-40cd-ad9f-02ac9dae8088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:16.015468 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692038cc-f289-40cd-ad9f-02ac9dae8088 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:16.015960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692038cc-f289-40cd-ad9f-02ac9dae8088 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:16.016442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692038cc-f289-40cd-ad9f-02ac9dae8088 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:16.017381 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692038cc-f289-40cd-ad9f-02ac9dae8088 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:24:16.017962 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692038cc-f289-40cd-ad9f-02ac9dae8088 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:16.020435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692038cc-f289-40cd-ad9f-02ac9dae8088 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:16.036689 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2145/4284] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:24:16.041402 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692038cc-f289-40cd-ad9f-02ac9dae8088 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:16.052302 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692038cc-f289-40cd-ad9f-02ac9dae8088 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:16.057945 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040427c-e682-45fb-b6ef-0580316e8664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:16.058683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040427c-e682-45fb-b6ef-0580316e8664 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:16.059145 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040427c-e682-45fb-b6ef-0580316e8664 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:16.060129 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040427c-e682-45fb-b6ef-0580316e8664 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:16.060341 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3040427c-e682-45fb-b6ef-0580316e8664 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:16.062438 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3040427c-e682-45fb-b6ef-0580316e8664 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:16.180857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4fe53fd7-9d04-41fd-a0e4-0bee88c9941c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c72666ff1ef4a8c866242ac61c49446', 'request_id': 'req-4fe53fd7-9d04-41fd-a0e4-0bee88c9941c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:16.187047 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4fe53fd7-9d04-41fd-a0e4-0bee88c9941c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c72666ff1ef4a8c866242ac61c49446', 'request_id': 'req-4fe53fd7-9d04-41fd-a0e4-0bee88c9941c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:16.194047 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4fe53fd7-9d04-41fd-a0e4-0bee88c9941c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c72666ff1ef4a8c866242ac61c49446', 'request_id': 'req-4fe53fd7-9d04-41fd-a0e4-0bee88c9941c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:16.208120 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2146/4285] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:24:16 2022] POST /identity/v3/projects => generated 359 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:24:16.209943 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040427c-e682-45fb-b6ef-0580316e8664 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:16.298133 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040427c-e682-45fb-b6ef-0580316e8664 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:16.303523 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897554f-2969-4868-bd2c-7397a9142120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:16.307244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897554f-2969-4868-bd2c-7397a9142120 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:16.307244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897554f-2969-4868-bd2c-7397a9142120 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:16.307244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897554f-2969-4868-bd2c-7397a9142120 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:16.307244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897554f-2969-4868-bd2c-7397a9142120 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:16.307774 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897554f-2969-4868-bd2c-7397a9142120 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:16.356740 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4fe53fd7-9d04-41fd-a0e4-0bee88c9941c admin admin] The token cache is being invalidate because project 5c72666ff1ef4a8c866242ac61c49446 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:24:16.357222 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4fe53fd7-9d04-41fd-a0e4-0bee88c9941c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:16.358197 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4fe53fd7-9d04-41fd-a0e4-0bee88c9941c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:16.363952 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2140/4286] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:24:15 2022] DELETE /identity/v3/projects/5c72666ff1ef4a8c866242ac61c49446 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:24:16.366187 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24eae42-2e03-4aa5-b081-a50b9a45e28d None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:16.366476 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24eae42-2e03-4aa5-b081-a50b9a45e28d None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:16.366759 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24eae42-2e03-4aa5-b081-a50b9a45e28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:16.398419 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-a24eae42-2e03-4aa5-b081-a50b9a45e28d None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:16.400020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a24eae42-2e03-4aa5-b081-a50b9a45e28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:16.420683 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2141/4287] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:24:16.423370 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047a704-d438-404a-bbcc-bf47e983ee65 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:16.430912 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047a704-d438-404a-bbcc-bf47e983ee65 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:16.430912 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047a704-d438-404a-bbcc-bf47e983ee65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:16.449347 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-a047a704-d438-404a-bbcc-bf47e983ee65 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:16.450821 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a047a704-d438-404a-bbcc-bf47e983ee65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:16.455456 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2147/4288] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:24:16 2022] POST /identity/v3/users => generated 280 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:24:16.459911 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897554f-2969-4868-bd2c-7397a9142120 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:16.461718 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6897554f-2969-4868-bd2c-7397a9142120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:16.464425 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2142/4289] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:24:16.468661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a047a704-d438-404a-bbcc-bf47e983ee65 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:16.478207 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897554f-2969-4868-bd2c-7397a9142120 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:16.480509 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a047a704-d438-404a-bbcc-bf47e983ee65 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:16.487576 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11125eed-49fb-4bde-b941-032f98387a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:16.488598 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11125eed-49fb-4bde-b941-032f98387a08 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:16.488888 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11125eed-49fb-4bde-b941-032f98387a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:16.489263 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11125eed-49fb-4bde-b941-032f98387a08 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:16.490194 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11125eed-49fb-4bde-b941-032f98387a08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:24:16.491482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11125eed-49fb-4bde-b941-032f98387a08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:16.493324 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11125eed-49fb-4bde-b941-032f98387a08 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:16.495269 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441033e-a5be-4657-8cfd-293ca444b668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:16.496785 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441033e-a5be-4657-8cfd-293ca444b668 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:16.497241 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441033e-a5be-4657-8cfd-293ca444b668 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:16.497702 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441033e-a5be-4657-8cfd-293ca444b668 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:16.499117 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441033e-a5be-4657-8cfd-293ca444b668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:16.502100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441033e-a5be-4657-8cfd-293ca444b668 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:16.509059 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2143/4290] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:24:16.513273 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11125eed-49fb-4bde-b941-032f98387a08 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:16.519228 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2148/4291] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:24:16.526709 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441033e-a5be-4657-8cfd-293ca444b668 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:16.530239 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11125eed-49fb-4bde-b941-032f98387a08 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:16.536070 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c5ef0-dcfb-4d78-81bd-da3cb8114f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:16.536070 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c5ef0-dcfb-4d78-81bd-da3cb8114f7f admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:16.536353 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c5ef0-dcfb-4d78-81bd-da3cb8114f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:16.540870 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441033e-a5be-4657-8cfd-293ca444b668 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:16.541239 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c5ef0-dcfb-4d78-81bd-da3cb8114f7f admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:16.542038 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c5ef0-dcfb-4d78-81bd-da3cb8114f7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:16.544023 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c5ef0-dcfb-4d78-81bd-da3cb8114f7f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:16.552012 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192542d-a485-4b4d-aa74-471dd8f696aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:16.552704 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192542d-a485-4b4d-aa74-471dd8f696aa admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:16.552994 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192542d-a485-4b4d-aa74-471dd8f696aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:16.554066 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192542d-a485-4b4d-aa74-471dd8f696aa admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:16.555069 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c192542d-a485-4b4d-aa74-471dd8f696aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:16.557702 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c192542d-a485-4b4d-aa74-471dd8f696aa admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:16.573558 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2149/4292] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:24:16.575482 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192542d-a485-4b4d-aa74-471dd8f696aa admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:16.590442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192542d-a485-4b4d-aa74-471dd8f696aa admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:16.598274 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9438a-d869-4f33-a8d2-b0bcb3e0f8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:16.599975 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9438a-d869-4f33-a8d2-b0bcb3e0f8ee admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:16.602771 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9438a-d869-4f33-a8d2-b0bcb3e0f8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:16.603457 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9438a-d869-4f33-a8d2-b0bcb3e0f8ee admin admin] PATH_INFO: `/v3/projects/4e70d13eec914f99bb25c21a3ee00cb9/users/339b025eec344377ba46ce48f556f09e/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:16.633093 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9438a-d869-4f33-a8d2-b0bcb3e0f8ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e70d13eec914f99bb25c21a3ee00cb9, user_id=339b025eec344377ba46ce48f556f09e, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:16.636020 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9438a-d869-4f33-a8d2-b0bcb3e0f8ee admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:16.704825 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2144/4293] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:24:16 2022] POST /identity/v3/projects => generated 355 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:24:16.706917 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c5ef0-dcfb-4d78-81bd-da3cb8114f7f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:16.808370 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c5ef0-dcfb-4d78-81bd-da3cb8114f7f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:16.810186 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2150/4294] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:24:16 2022] PUT /identity/v3/projects/4e70d13eec914f99bb25c21a3ee00cb9/users/339b025eec344377ba46ce48f556f09e/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:24:16.872819 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6f242-9db0-4c7a-a222-ff3f948741ea None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:16.873454 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6f242-9db0-4c7a-a222-ff3f948741ea None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:16.873933 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6f242-9db0-4c7a-a222-ff3f948741ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:16.904538 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-a8f6f242-9db0-4c7a-a222-ff3f948741ea None None] MFA Rules not processed for user `339b025eec344377ba46ce48f556f09e`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:16.906356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a8f6f242-9db0-4c7a-a222-ff3f948741ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:16.927919 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf6b32-be4a-42e2-9578-ab5dbae28ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:16.929642 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf6b32-be4a-42e2-9578-ab5dbae28ffe admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:16.930251 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf6b32-be4a-42e2-9578-ab5dbae28ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:16.930818 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf6b32-be4a-42e2-9578-ab5dbae28ffe admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:16.934264 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf6b32-be4a-42e2-9578-ab5dbae28ffe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:16.934264 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf6b32-be4a-42e2-9578-ab5dbae28ffe admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:17.005729 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2151/4295] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:16 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:24:17.041674 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6f242-9db0-4c7a-a222-ff3f948741ea None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:17.042424 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2145/4296] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:24:16 2022] POST /identity/v3/users => generated 278 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:24:17.043492 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf6b32-be4a-42e2-9578-ab5dbae28ffe admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:17.054271 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6f242-9db0-4c7a-a222-ff3f948741ea None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:17.059892 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe58307-9962-47b5-ac24-f66d368887da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:17.060555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf6b32-be4a-42e2-9578-ab5dbae28ffe admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:17.060764 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe58307-9962-47b5-ac24-f66d368887da admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:17.061384 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe58307-9962-47b5-ac24-f66d368887da admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:17.061956 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe58307-9962-47b5-ac24-f66d368887da admin admin] PATH_INFO: `/v3/users/339b025eec344377ba46ce48f556f09e` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:17.063356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe58307-9962-47b5-ac24-f66d368887da admin admin] RBAC: Authorizing `identity:delete_user(user_id=339b025eec344377ba46ce48f556f09e)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:17.066076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe58307-9962-47b5-ac24-f66d368887da admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:17.066826 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdebe0-c025-4cda-b983-bd241befc7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:17.067495 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdebe0-c025-4cda-b983-bd241befc7c9 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:17.067774 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdebe0-c025-4cda-b983-bd241befc7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:17.068047 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdebe0-c025-4cda-b983-bd241befc7c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:17.068764 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbdebe0-c025-4cda-b983-bd241befc7c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:17.070392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbdebe0-c025-4cda-b983-bd241befc7c9 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:17.081262 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2146/4297] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:24:17.085803 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdebe0-c025-4cda-b983-bd241befc7c9 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:17.097205 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdebe0-c025-4cda-b983-bd241befc7c9 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:17.104515 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56e7f1-1d7f-49f0-a0e1-4e4ad2a0d75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:17.105239 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56e7f1-1d7f-49f0-a0e1-4e4ad2a0d75d admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:17.105529 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56e7f1-1d7f-49f0-a0e1-4e4ad2a0d75d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:17.105832 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56e7f1-1d7f-49f0-a0e1-4e4ad2a0d75d admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:17.106603 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc56e7f1-1d7f-49f0-a0e1-4e4ad2a0d75d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:17.108362 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc56e7f1-1d7f-49f0-a0e1-4e4ad2a0d75d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:17.120732 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2147/4298] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:24:17.126817 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56e7f1-1d7f-49f0-a0e1-4e4ad2a0d75d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:17.140930 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56e7f1-1d7f-49f0-a0e1-4e4ad2a0d75d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:17.148215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a5844-22fc-44f3-a3ec-602b001e5ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:17.149861 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a5844-22fc-44f3-a3ec-602b001e5ffd admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:17.152477 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a5844-22fc-44f3-a3ec-602b001e5ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:17.152477 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a5844-22fc-44f3-a3ec-602b001e5ffd admin admin] PATH_INFO: `/v3/projects/c09c25b4b6c9472f9e18fb79a6903339/users/dce7690094f842cabe3dd92d5e78970e/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:17.175712 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a5844-22fc-44f3-a3ec-602b001e5ffd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c09c25b4b6c9472f9e18fb79a6903339, user_id=dce7690094f842cabe3dd92d5e78970e, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:17.179127 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a5844-22fc-44f3-a3ec-602b001e5ffd admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:17.334356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-abe58307-9962-47b5-ac24-f66d368887da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '339b025eec344377ba46ce48f556f09e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:17.348044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-abe58307-9962-47b5-ac24-f66d368887da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '339b025eec344377ba46ce48f556f09e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:17.375119 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2148/4299] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:24:17 2022] PUT /identity/v3/projects/c09c25b4b6c9472f9e18fb79a6903339/users/dce7690094f842cabe3dd92d5e78970e/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:24:17.386337 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fef89-fb4c-4380-ba98-17a8d030c21b None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:17.386835 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fef89-fb4c-4380-ba98-17a8d030c21b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:17.387301 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fef89-fb4c-4380-ba98-17a8d030c21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:17.415233 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-e66fef89-fb4c-4380-ba98-17a8d030c21b None None] MFA Rules not processed for user `dce7690094f842cabe3dd92d5e78970e`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:17.416817 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e66fef89-fb4c-4380-ba98-17a8d030c21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:17.417872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-abe58307-9962-47b5-ac24-f66d368887da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '339b025eec344377ba46ce48f556f09e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:17.426830 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-abe58307-9962-47b5-ac24-f66d368887da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '339b025eec344377ba46ce48f556f09e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:17.427706 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-abe58307-9962-47b5-ac24-f66d368887da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '339b025eec344377ba46ce48f556f09e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:17.435013 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2152/4300] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:24:17 2022] DELETE /identity/v3/users/339b025eec344377ba46ce48f556f09e => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:24:17.439981 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf93cd-3395-4b0d-9fdd-46748a8b9874 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:17.440343 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf93cd-3395-4b0d-9fdd-46748a8b9874 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:17.440695 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf93cd-3395-4b0d-9fdd-46748a8b9874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:17.463737 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-ebaf93cd-3395-4b0d-9fdd-46748a8b9874 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:17.465078 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ebaf93cd-3395-4b0d-9fdd-46748a8b9874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:17.496627 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2149/4301] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:17 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:24:17.502118 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fef89-fb4c-4380-ba98-17a8d030c21b None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:17.503543 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e66fef89-fb4c-4380-ba98-17a8d030c21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:17.532258 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2153/4302] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:24:17.543845 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf93cd-3395-4b0d-9fdd-46748a8b9874 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:17.545423 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ebaf93cd-3395-4b0d-9fdd-46748a8b9874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:17.578510 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fef89-fb4c-4380-ba98-17a8d030c21b None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:17.584302 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4ce7b-42f9-4cdc-8e6f-567c6b82ea5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:17.585103 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4ce7b-42f9-4cdc-8e6f-567c6b82ea5e admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:17.585427 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4ce7b-42f9-4cdc-8e6f-567c6b82ea5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:17.585700 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4ce7b-42f9-4cdc-8e6f-567c6b82ea5e admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:17.586451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4ce7b-42f9-4cdc-8e6f-567c6b82ea5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:17.590664 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4ce7b-42f9-4cdc-8e6f-567c6b82ea5e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:17.610333 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf93cd-3395-4b0d-9fdd-46748a8b9874 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:17.614342 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df2642-3da6-454c-a215-b95b328bf7ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:17.615077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df2642-3da6-454c-a215-b95b328bf7ee service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:17.616152 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df2642-3da6-454c-a215-b95b328bf7ee service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:17.616152 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df2642-3da6-454c-a215-b95b328bf7ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:17.625804 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df2642-3da6-454c-a215-b95b328bf7ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:17.627406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df2642-3da6-454c-a215-b95b328bf7ee service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:17.638018 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2154/4303] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:24:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:24:17.686918 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2150/4304] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:24:17 2022] POST /identity/v3/projects => generated 355 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:24:17.687779 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df2642-3da6-454c-a215-b95b328bf7ee service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:17.700010 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df2642-3da6-454c-a215-b95b328bf7ee service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:17.764244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e51ca-98a0-4ba6-a25a-93bd4500832c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:17.764927 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e51ca-98a0-4ba6-a25a-93bd4500832c admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:17.765216 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e51ca-98a0-4ba6-a25a-93bd4500832c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:17.765498 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e51ca-98a0-4ba6-a25a-93bd4500832c admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:17.768990 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e51ca-98a0-4ba6-a25a-93bd4500832c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:17.768990 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e51ca-98a0-4ba6-a25a-93bd4500832c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:17.857717 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2155/4305] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:24:17 2022] POST /identity/v3/users => generated 284 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:24:17.860678 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4ce7b-42f9-4cdc-8e6f-567c6b82ea5e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:17.882494 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e51ca-98a0-4ba6-a25a-93bd4500832c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:17.885332 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9c5e51ca-98a0-4ba6-a25a-93bd4500832c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:17.888857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4ce7b-42f9-4cdc-8e6f-567c6b82ea5e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:17.913679 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113dfa6-c20e-46e1-ba89-a4852ff6c66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:17.914917 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113dfa6-c20e-46e1-ba89-a4852ff6c66d admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:17.915211 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113dfa6-c20e-46e1-ba89-a4852ff6c66d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:17.915492 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113dfa6-c20e-46e1-ba89-a4852ff6c66d admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:17.916362 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8113dfa6-c20e-46e1-ba89-a4852ff6c66d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:17.918022 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8113dfa6-c20e-46e1-ba89-a4852ff6c66d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:17.937680 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2151/4306] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:24:17.941966 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113dfa6-c20e-46e1-ba89-a4852ff6c66d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:17.963519 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113dfa6-c20e-46e1-ba89-a4852ff6c66d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:17.966764 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59045759-fff3-40d9-8def-5f1828589c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:17.970410 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59045759-fff3-40d9-8def-5f1828589c62 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:17.970664 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59045759-fff3-40d9-8def-5f1828589c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:17.970945 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59045759-fff3-40d9-8def-5f1828589c62 admin admin] PATH_INFO: `/v3/projects/3b107ae4a988422a892ab90f1d2b505a/users/d87968af35034e82bd628caaa9549042/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:17.973017 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e51ca-98a0-4ba6-a25a-93bd4500832c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:17.976918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f5cce-5db0-4d6b-be7c-ad36dcbe6282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:17.977596 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f5cce-5db0-4d6b-be7c-ad36dcbe6282 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:17.977985 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f5cce-5db0-4d6b-be7c-ad36dcbe6282 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:17.978268 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f5cce-5db0-4d6b-be7c-ad36dcbe6282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:17.980139 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d56f5cce-5db0-4d6b-be7c-ad36dcbe6282 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:17.990376 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59045759-fff3-40d9-8def-5f1828589c62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b107ae4a988422a892ab90f1d2b505a, user_id=d87968af35034e82bd628caaa9549042, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:17.994033 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56f5cce-5db0-4d6b-be7c-ad36dcbe6282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:17.994672 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59045759-fff3-40d9-8def-5f1828589c62 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:17.996207 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56f5cce-5db0-4d6b-be7c-ad36dcbe6282 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:18.007757 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2156/4307] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:24:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:24:18.152866 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2152/4308] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:24:17 2022] PUT /identity/v3/projects/3b107ae4a988422a892ab90f1d2b505a/users/d87968af35034e82bd628caaa9549042/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:24:18.159180 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f5cce-5db0-4d6b-be7c-ad36dcbe6282 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:18.183833 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f5cce-5db0-4d6b-be7c-ad36dcbe6282 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:18.294676 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800453c-614b-4605-95b3-437a53df5958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:18.295629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800453c-614b-4605-95b3-437a53df5958 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:18.296101 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800453c-614b-4605-95b3-437a53df5958 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:18.296557 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800453c-614b-4605-95b3-437a53df5958 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:18.297697 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800453c-614b-4605-95b3-437a53df5958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:18.300066 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800453c-614b-4605-95b3-437a53df5958 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:18.312056 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2157/4309] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:24:18.318875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59045759-fff3-40d9-8def-5f1828589c62 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:18.326024 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800453c-614b-4605-95b3-437a53df5958 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:18.331364 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59045759-fff3-40d9-8def-5f1828589c62 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:18.333891 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1800453c-614b-4605-95b3-437a53df5958 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:18.341929 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5322d1b-86dd-4b78-8717-1940980bf6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:18.347493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5322d1b-86dd-4b78-8717-1940980bf6a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:18.347493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5322d1b-86dd-4b78-8717-1940980bf6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:18.347493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5322d1b-86dd-4b78-8717-1940980bf6a5 admin admin] PATH_INFO: `/v3/projects/3b107ae4a988422a892ab90f1d2b505a/users/d87968af35034e82bd628caaa9549042/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:18.350875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5322d1b-86dd-4b78-8717-1940980bf6a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b107ae4a988422a892ab90f1d2b505a, user_id=d87968af35034e82bd628caaa9549042, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:18.353570 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5322d1b-86dd-4b78-8717-1940980bf6a5 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:18.360324 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800453c-614b-4605-95b3-437a53df5958 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:18.371133 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7395d7-4903-4695-a17b-7adcc2eee66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:18.372004 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7395d7-4903-4695-a17b-7adcc2eee66a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:18.372281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7395d7-4903-4695-a17b-7adcc2eee66a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:18.373390 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7395d7-4903-4695-a17b-7adcc2eee66a admin admin] PATH_INFO: `/v3/projects/4e70d13eec914f99bb25c21a3ee00cb9` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:18.377433 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7395d7-4903-4695-a17b-7adcc2eee66a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e70d13eec914f99bb25c21a3ee00cb9)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:18.379906 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7395d7-4903-4695-a17b-7adcc2eee66a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:18.385811 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2153/4310] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:24:18 2022] PUT /identity/v3/projects/3b107ae4a988422a892ab90f1d2b505a/users/d87968af35034e82bd628caaa9549042/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:18.392013 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c9ed9-1c56-472b-ac9c-ea3cb0677045 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:18.392307 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c9ed9-1c56-472b-ac9c-ea3cb0677045 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:18.392587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c9ed9-1c56-472b-ac9c-ea3cb0677045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:18.447111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-767c9ed9-1c56-472b-ac9c-ea3cb0677045 None None] MFA Rules not processed for user `d87968af35034e82bd628caaa9549042`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:18.451094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-767c9ed9-1c56-472b-ac9c-ea3cb0677045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:18.583246 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2154/4311] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:18 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:24:18.594278 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c9ed9-1c56-472b-ac9c-ea3cb0677045 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:18.610543 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0c7395d7-4903-4695-a17b-7adcc2eee66a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e70d13eec914f99bb25c21a3ee00cb9', 'request_id': 'req-0c7395d7-4903-4695-a17b-7adcc2eee66a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:18.619997 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c9ed9-1c56-472b-ac9c-ea3cb0677045 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:18.625537 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0c7395d7-4903-4695-a17b-7adcc2eee66a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e70d13eec914f99bb25c21a3ee00cb9', 'request_id': 'req-0c7395d7-4903-4695-a17b-7adcc2eee66a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:18.640552 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0c7395d7-4903-4695-a17b-7adcc2eee66a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e70d13eec914f99bb25c21a3ee00cb9', 'request_id': 'req-0c7395d7-4903-4695-a17b-7adcc2eee66a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:18.720712 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6156f5f-4735-4200-915d-896ec0d3d5a3 tempest-QuotasTest-986755975 tempest-QuotasTest-986755975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd87968af35034e82bd628caaa9549042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b107ae4a988422a892ab90f1d2b505a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:18.724977 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6156f5f-4735-4200-915d-896ec0d3d5a3 tempest-QuotasTest-986755975 tempest-QuotasTest-986755975-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:18.724977 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6156f5f-4735-4200-915d-896ec0d3d5a3 tempest-QuotasTest-986755975 tempest-QuotasTest-986755975-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:18.724977 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6156f5f-4735-4200-915d-896ec0d3d5a3 tempest-QuotasTest-986755975 tempest-QuotasTest-986755975-project-admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:18.724977 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6156f5f-4735-4200-915d-896ec0d3d5a3 tempest-QuotasTest-986755975 tempest-QuotasTest-986755975-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:24:18.724977 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6156f5f-4735-4200-915d-896ec0d3d5a3 tempest-QuotasTest-986755975 tempest-QuotasTest-986755975-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:18.726452 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6156f5f-4735-4200-915d-896ec0d3d5a3 tempest-QuotasTest-986755975 tempest-QuotasTest-986755975-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:18.748776 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0c7395d7-4903-4695-a17b-7adcc2eee66a admin admin] The token cache is being invalidate because project 4e70d13eec914f99bb25c21a3ee00cb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:24:18.749103 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0c7395d7-4903-4695-a17b-7adcc2eee66a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:18.753025 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0c7395d7-4903-4695-a17b-7adcc2eee66a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:18.754425 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2158/4312] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:24:18 2022] DELETE /identity/v3/projects/4e70d13eec914f99bb25c21a3ee00cb9 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:18.757824 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2155/4313] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:24:18.759370 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75cdd0-1438-4b48-a9aa-30f1c8942489 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:18.759664 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75cdd0-1438-4b48-a9aa-30f1c8942489 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:18.759942 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75cdd0-1438-4b48-a9aa-30f1c8942489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:18.762462 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6156f5f-4735-4200-915d-896ec0d3d5a3 tempest-QuotasTest-986755975 tempest-QuotasTest-986755975-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:18.764352 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e6156f5f-4735-4200-915d-896ec0d3d5a3 tempest-QuotasTest-986755975 tempest-QuotasTest-986755975-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:18.781034 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6156f5f-4735-4200-915d-896ec0d3d5a3 tempest-QuotasTest-986755975 tempest-QuotasTest-986755975-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:18.786718 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-4d75cdd0-1438-4b48-a9aa-30f1c8942489 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:18.788127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4d75cdd0-1438-4b48-a9aa-30f1c8942489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:18.810934 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014195c-128e-42e7-a162-c4fb971e3b9a tempest-QuotasTest-986755975 tempest-QuotasTest-986755975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd87968af35034e82bd628caaa9549042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b107ae4a988422a892ab90f1d2b505a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:18.811308 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014195c-128e-42e7-a162-c4fb971e3b9a tempest-QuotasTest-986755975 tempest-QuotasTest-986755975-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:18.818535 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014195c-128e-42e7-a162-c4fb971e3b9a tempest-QuotasTest-986755975 tempest-QuotasTest-986755975-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:18.818535 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014195c-128e-42e7-a162-c4fb971e3b9a tempest-QuotasTest-986755975 tempest-QuotasTest-986755975-project-admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:18.818535 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014195c-128e-42e7-a162-c4fb971e3b9a tempest-QuotasTest-986755975 tempest-QuotasTest-986755975-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:18.818535 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014195c-128e-42e7-a162-c4fb971e3b9a tempest-QuotasTest-986755975 tempest-QuotasTest-986755975-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:18.867837 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2159/4314] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:24:18.876712 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1043e6c-a28d-4f85-9489-165fd00a9f9c None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:18.877796 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1043e6c-a28d-4f85-9489-165fd00a9f9c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:18.878387 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1043e6c-a28d-4f85-9489-165fd00a9f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:18.922507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-c1043e6c-a28d-4f85-9489-165fd00a9f9c None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:18.922507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c1043e6c-a28d-4f85-9489-165fd00a9f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:18.923397 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2160/4315] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:24:18.928746 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1043e6c-a28d-4f85-9489-165fd00a9f9c None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:18.941456 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1043e6c-a28d-4f85-9489-165fd00a9f9c None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:18.946762 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d184d-1ac4-4e13-a594-c2f5b9f580a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:18.947834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d184d-1ac4-4e13-a594-c2f5b9f580a8 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:18.948280 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d184d-1ac4-4e13-a594-c2f5b9f580a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:18.948750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d184d-1ac4-4e13-a594-c2f5b9f580a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:18.949625 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d184d-1ac4-4e13-a594-c2f5b9f580a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:24:18.950235 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d184d-1ac4-4e13-a594-c2f5b9f580a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:18.951908 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d184d-1ac4-4e13-a594-c2f5b9f580a8 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:18.972979 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2161/4316] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:24:18.979073 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2156/4317] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:24:18 2022] POST /identity/v3/projects => generated 350 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:24:18.983440 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d184d-1ac4-4e13-a594-c2f5b9f580a8 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:18.983637 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014195c-128e-42e7-a162-c4fb971e3b9a tempest-QuotasTest-986755975 tempest-QuotasTest-986755975-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:18.994945 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d184d-1ac4-4e13-a594-c2f5b9f580a8 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:19.063783 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd0bef-abba-43d9-be49-af9087dbeb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:19.064893 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd0bef-abba-43d9-be49-af9087dbeb38 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:19.065190 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd0bef-abba-43d9-be49-af9087dbeb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:19.065804 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd0bef-abba-43d9-be49-af9087dbeb38 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:19.066525 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccd0bef-abba-43d9-be49-af9087dbeb38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:19.066888 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014195c-128e-42e7-a162-c4fb971e3b9a tempest-QuotasTest-986755975 tempest-QuotasTest-986755975-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:19.068807 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccd0bef-abba-43d9-be49-af9087dbeb38 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:19.073031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1e465-b9ca-4291-8406-62962e0b62a6 tempest-QuotasTest-986755975 tempest-QuotasTest-986755975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd87968af35034e82bd628caaa9549042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b107ae4a988422a892ab90f1d2b505a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:19.099698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1e465-b9ca-4291-8406-62962e0b62a6 tempest-QuotasTest-986755975 tempest-QuotasTest-986755975-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:19.099698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1e465-b9ca-4291-8406-62962e0b62a6 tempest-QuotasTest-986755975 tempest-QuotasTest-986755975-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:19.099698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1e465-b9ca-4291-8406-62962e0b62a6 tempest-QuotasTest-986755975 tempest-QuotasTest-986755975-project-admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:19.099698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa1e465-b9ca-4291-8406-62962e0b62a6 tempest-QuotasTest-986755975 tempest-QuotasTest-986755975-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:24:19.099698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa1e465-b9ca-4291-8406-62962e0b62a6 tempest-QuotasTest-986755975 tempest-QuotasTest-986755975-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:19.101569 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa1e465-b9ca-4291-8406-62962e0b62a6 tempest-QuotasTest-986755975 tempest-QuotasTest-986755975-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:19.101569 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2157/4318] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:24:19.102831 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1e465-b9ca-4291-8406-62962e0b62a6 tempest-QuotasTest-986755975 tempest-QuotasTest-986755975-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:19.104856 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8aa1e465-b9ca-4291-8406-62962e0b62a6 tempest-QuotasTest-986755975 tempest-QuotasTest-986755975-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:19.185162 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1e465-b9ca-4291-8406-62962e0b62a6 tempest-QuotasTest-986755975 tempest-QuotasTest-986755975-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:19.191599 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e935d-ea63-45cd-ba98-675ca993da5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:19.192551 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e935d-ea63-45cd-ba98-675ca993da5b service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:19.193136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e935d-ea63-45cd-ba98-675ca993da5b service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:19.193595 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e935d-ea63-45cd-ba98-675ca993da5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:19.204315 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e935d-ea63-45cd-ba98-675ca993da5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:19.206151 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e935d-ea63-45cd-ba98-675ca993da5b service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:19.217095 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2158/4319] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:24:19 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:24:19.391002 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2162/4320] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:24:18 2022] POST /identity/v3/projects => generated 383 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:24:19.395360 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e935d-ea63-45cd-ba98-675ca993da5b service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:19.406551 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e935d-ea63-45cd-ba98-675ca993da5b service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:19.480291 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8756b-7768-446c-a3bf-9cc6cbacaa85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:19.481293 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8756b-7768-446c-a3bf-9cc6cbacaa85 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:19.481582 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8756b-7768-446c-a3bf-9cc6cbacaa85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:19.481896 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8756b-7768-446c-a3bf-9cc6cbacaa85 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:19.482716 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc8756b-7768-446c-a3bf-9cc6cbacaa85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:19.484822 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc8756b-7768-446c-a3bf-9cc6cbacaa85 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:19.619593 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2159/4321] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:24:19 2022] POST /identity/v3/users => generated 292 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:24:19.620886 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd0bef-abba-43d9-be49-af9087dbeb38 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:19.632725 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd0bef-abba-43d9-be49-af9087dbeb38 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:19.641120 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de41ff-b7aa-43a4-af81-7711c8b1a67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:19.642156 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de41ff-b7aa-43a4-af81-7711c8b1a67a admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:19.642660 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de41ff-b7aa-43a4-af81-7711c8b1a67a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:19.643993 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de41ff-b7aa-43a4-af81-7711c8b1a67a admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:19.645063 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de41ff-b7aa-43a4-af81-7711c8b1a67a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:19.647609 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de41ff-b7aa-43a4-af81-7711c8b1a67a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:19.660630 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2163/4322] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:24:19.664948 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8756b-7768-446c-a3bf-9cc6cbacaa85 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:19.677303 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8756b-7768-446c-a3bf-9cc6cbacaa85 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:19.682378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4002b-373d-4c41-b647-66daecff3db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:19.683057 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4002b-373d-4c41-b647-66daecff3db1 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:19.683342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4002b-373d-4c41-b647-66daecff3db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:19.683616 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4002b-373d-4c41-b647-66daecff3db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:19.684340 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e4002b-373d-4c41-b647-66daecff3db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:19.686138 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e4002b-373d-4c41-b647-66daecff3db1 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:19.698579 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2160/4323] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:24:19.702998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de41ff-b7aa-43a4-af81-7711c8b1a67a admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:19.724072 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de41ff-b7aa-43a4-af81-7711c8b1a67a admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:19.734794 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcfdcc4-41cd-420d-8ef3-8bc5b10cb733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:19.735894 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcfdcc4-41cd-420d-8ef3-8bc5b10cb733 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:19.736251 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcfdcc4-41cd-420d-8ef3-8bc5b10cb733 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:19.737645 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcfdcc4-41cd-420d-8ef3-8bc5b10cb733 admin admin] PATH_INFO: `/v3/projects/54ceedad6e134d94ac8758f8385a47e0/users/9cc9b55d852942538c3ad8f317dcd73e/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:19.760590 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcfdcc4-41cd-420d-8ef3-8bc5b10cb733 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54ceedad6e134d94ac8758f8385a47e0, user_id=9cc9b55d852942538c3ad8f317dcd73e, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:19.763522 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcfdcc4-41cd-420d-8ef3-8bc5b10cb733 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:19.777392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4002b-373d-4c41-b647-66daecff3db1 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:19.848093 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4002b-373d-4c41-b647-66daecff3db1 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:19.857366 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2164/4324] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:24:19 2022] PUT /identity/v3/projects/54ceedad6e134d94ac8758f8385a47e0/users/9cc9b55d852942538c3ad8f317dcd73e/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:19.859665 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e80256-da4e-40b9-ae12-2b9c475e19f7 tempest-QuotasTest-986755975 tempest-QuotasTest-986755975-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd87968af35034e82bd628caaa9549042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b107ae4a988422a892ab90f1d2b505a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:19.863176 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e80256-da4e-40b9-ae12-2b9c475e19f7 tempest-QuotasTest-986755975 tempest-QuotasTest-986755975-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:19.863176 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e80256-da4e-40b9-ae12-2b9c475e19f7 tempest-QuotasTest-986755975 tempest-QuotasTest-986755975-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:19.863176 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e80256-da4e-40b9-ae12-2b9c475e19f7 tempest-QuotasTest-986755975 tempest-QuotasTest-986755975-project-admin] PATH_INFO: `/v3/projects/7964f3c150924165ac1f06988e67314e` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:19.863176 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e80256-da4e-40b9-ae12-2b9c475e19f7 tempest-QuotasTest-986755975 tempest-QuotasTest-986755975-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7964f3c150924165ac1f06988e67314e)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:19.864475 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e80256-da4e-40b9-ae12-2b9c475e19f7 tempest-QuotasTest-986755975 tempest-QuotasTest-986755975-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:19.867473 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24033c-cb20-454e-9f2f-a06d2babc3db None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:19.868010 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24033c-cb20-454e-9f2f-a06d2babc3db None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:19.868455 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24033c-cb20-454e-9f2f-a06d2babc3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:19.907848 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-0d24033c-cb20-454e-9f2f-a06d2babc3db None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:19.913199 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0d24033c-cb20-454e-9f2f-a06d2babc3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:19.999741 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e5e80256-da4e-40b9-ae12-2b9c475e19f7 tempest-QuotasTest-986755975 tempest-QuotasTest-986755975-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7964f3c150924165ac1f06988e67314e', 'request_id': 'req-e5e80256-da4e-40b9-ae12-2b9c475e19f7'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:20.024105 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e5e80256-da4e-40b9-ae12-2b9c475e19f7 tempest-QuotasTest-986755975 tempest-QuotasTest-986755975-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7964f3c150924165ac1f06988e67314e', 'request_id': 'req-e5e80256-da4e-40b9-ae12-2b9c475e19f7'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:20.031311 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e5e80256-da4e-40b9-ae12-2b9c475e19f7 tempest-QuotasTest-986755975 tempest-QuotasTest-986755975-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7964f3c150924165ac1f06988e67314e', 'request_id': 'req-e5e80256-da4e-40b9-ae12-2b9c475e19f7'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:20.044183 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2165/4325] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:24:20.059900 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24033c-cb20-454e-9f2f-a06d2babc3db None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:20.061476 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0d24033c-cb20-454e-9f2f-a06d2babc3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:20.109797 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e5e80256-da4e-40b9-ae12-2b9c475e19f7 tempest-QuotasTest-986755975 tempest-QuotasTest-986755975-project-admin] The token cache is being invalidate because project 7964f3c150924165ac1f06988e67314e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:24:20.110102 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e5e80256-da4e-40b9-ae12-2b9c475e19f7 tempest-QuotasTest-986755975 tempest-QuotasTest-986755975-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:20.110935 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e5e80256-da4e-40b9-ae12-2b9c475e19f7 tempest-QuotasTest-986755975 tempest-QuotasTest-986755975-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:20.113466 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2161/4326] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:24:19 2022] DELETE /identity/v3/projects/7964f3c150924165ac1f06988e67314e => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:20.127885 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24033c-cb20-454e-9f2f-a06d2babc3db None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:20.197193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf0452-0c2f-4f83-aa72-7b6f908aaae1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:20.198344 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf0452-0c2f-4f83-aa72-7b6f908aaae1 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:20.198806 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf0452-0c2f-4f83-aa72-7b6f908aaae1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:20.199240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf0452-0c2f-4f83-aa72-7b6f908aaae1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:20.201335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e9cf0452-0c2f-4f83-aa72-7b6f908aaae1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:20.254382 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e80256-da4e-40b9-ae12-2b9c475e19f7 tempest-QuotasTest-986755975 tempest-QuotasTest-986755975-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:20.256007 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e5e80256-da4e-40b9-ae12-2b9c475e19f7 tempest-QuotasTest-986755975 tempest-QuotasTest-986755975-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:20.302593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf0452-0c2f-4f83-aa72-7b6f908aaae1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:20.304091 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf0452-0c2f-4f83-aa72-7b6f908aaae1 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:20.328825 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2166/4327] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:24:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:24:20.353467 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e80256-da4e-40b9-ae12-2b9c475e19f7 tempest-QuotasTest-986755975 tempest-QuotasTest-986755975-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:20.358148 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855bdf1-e21b-4548-804f-b5aa8b3029c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:20.359047 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855bdf1-e21b-4548-804f-b5aa8b3029c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:20.359763 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855bdf1-e21b-4548-804f-b5aa8b3029c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:20.360008 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855bdf1-e21b-4548-804f-b5aa8b3029c5 admin admin] PATH_INFO: `/v3/users/dce7690094f842cabe3dd92d5e78970e` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:20.361221 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1855bdf1-e21b-4548-804f-b5aa8b3029c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dce7690094f842cabe3dd92d5e78970e)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:20.363910 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1855bdf1-e21b-4548-804f-b5aa8b3029c5 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:20.630552 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1855bdf1-e21b-4548-804f-b5aa8b3029c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dce7690094f842cabe3dd92d5e78970e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:20.654730 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1855bdf1-e21b-4548-804f-b5aa8b3029c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dce7690094f842cabe3dd92d5e78970e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:20.740719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1855bdf1-e21b-4548-804f-b5aa8b3029c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dce7690094f842cabe3dd92d5e78970e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:20.741424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1855bdf1-e21b-4548-804f-b5aa8b3029c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dce7690094f842cabe3dd92d5e78970e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:20.752444 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1855bdf1-e21b-4548-804f-b5aa8b3029c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dce7690094f842cabe3dd92d5e78970e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:20.765896 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2162/4328] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:24:20 2022] DELETE /identity/v3/users/dce7690094f842cabe3dd92d5e78970e => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:20.767637 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95490089-aa15-4b31-a2f5-5f2a13157f7d None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:20.768504 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95490089-aa15-4b31-a2f5-5f2a13157f7d None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:20.768789 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95490089-aa15-4b31-a2f5-5f2a13157f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:20.799593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-95490089-aa15-4b31-a2f5-5f2a13157f7d None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:20.802370 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-95490089-aa15-4b31-a2f5-5f2a13157f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:20.887061 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2167/4329] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:24:20.898718 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855bdf1-e21b-4548-804f-b5aa8b3029c5 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:20.908738 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1855bdf1-e21b-4548-804f-b5aa8b3029c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:21.015714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855bdf1-e21b-4548-804f-b5aa8b3029c5 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:21.019660 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb225a5-f7ee-426e-bf42-21561818f5fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:21.020381 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb225a5-f7ee-426e-bf42-21561818f5fe service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:21.020757 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb225a5-f7ee-426e-bf42-21561818f5fe service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:21.021104 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb225a5-f7ee-426e-bf42-21561818f5fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:21.030805 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb225a5-f7ee-426e-bf42-21561818f5fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:21.032290 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb225a5-f7ee-426e-bf42-21561818f5fe service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:21.045638 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2163/4330] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:24:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:24:21.781094 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95490089-aa15-4b31-a2f5-5f2a13157f7d None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:21.782786 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-95490089-aa15-4b31-a2f5-5f2a13157f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:21.796033 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95490089-aa15-4b31-a2f5-5f2a13157f7d None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:21.804595 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf41fe-42bb-4d7c-9be5-43b5cefd4b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:21.805611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf41fe-42bb-4d7c-9be5-43b5cefd4b2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:21.806261 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf41fe-42bb-4d7c-9be5-43b5cefd4b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:21.806896 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf41fe-42bb-4d7c-9be5-43b5cefd4b2d admin admin] PATH_INFO: `/v3/projects/c09c25b4b6c9472f9e18fb79a6903339` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:21.808845 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf41fe-42bb-4d7c-9be5-43b5cefd4b2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c09c25b4b6c9472f9e18fb79a6903339)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:21.811085 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf41fe-42bb-4d7c-9be5-43b5cefd4b2d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:21.940987 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-decf41fe-42bb-4d7c-9be5-43b5cefd4b2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c09c25b4b6c9472f9e18fb79a6903339', 'request_id': 'req-decf41fe-42bb-4d7c-9be5-43b5cefd4b2d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:21.948962 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-decf41fe-42bb-4d7c-9be5-43b5cefd4b2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c09c25b4b6c9472f9e18fb79a6903339', 'request_id': 'req-decf41fe-42bb-4d7c-9be5-43b5cefd4b2d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:21.958107 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-decf41fe-42bb-4d7c-9be5-43b5cefd4b2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c09c25b4b6c9472f9e18fb79a6903339', 'request_id': 'req-decf41fe-42bb-4d7c-9be5-43b5cefd4b2d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:22.142500 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb225a5-f7ee-426e-bf42-21561818f5fe service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:22.144499 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5eb225a5-f7ee-426e-bf42-21561818f5fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:22.162737 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb225a5-f7ee-426e-bf42-21561818f5fe service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:22.166448 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-decf41fe-42bb-4d7c-9be5-43b5cefd4b2d admin admin] The token cache is being invalidate because project c09c25b4b6c9472f9e18fb79a6903339 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:24:22.166746 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-decf41fe-42bb-4d7c-9be5-43b5cefd4b2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:22.167708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-decf41fe-42bb-4d7c-9be5-43b5cefd4b2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:22.169356 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2168/4331] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:24:21 2022] DELETE /identity/v3/projects/c09c25b4b6c9472f9e18fb79a6903339 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:22.175924 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b79ea-ff64-4a8f-8c2b-d3ab10b10876 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:22.176488 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b79ea-ff64-4a8f-8c2b-d3ab10b10876 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:22.176777 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b79ea-ff64-4a8f-8c2b-d3ab10b10876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:22.198694 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-f52b79ea-ff64-4a8f-8c2b-d3ab10b10876 None None] MFA Rules not processed for user `65bedbcb4d094160a9a9fc3b6ba6f603`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:22.199922 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f52b79ea-ff64-4a8f-8c2b-d3ab10b10876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:22.261331 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03461658-4085-43e5-93f4-6f776eea0076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:22.262417 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03461658-4085-43e5-93f4-6f776eea0076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:22.263054 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03461658-4085-43e5-93f4-6f776eea0076 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:22.263546 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03461658-4085-43e5-93f4-6f776eea0076 admin admin] PATH_INFO: `/v3/users/a44db0249a214dcc9b2985ff18a3a690` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:22.265460 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03461658-4085-43e5-93f4-6f776eea0076 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a44db0249a214dcc9b2985ff18a3a690)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:22.271393 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03461658-4085-43e5-93f4-6f776eea0076 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:22.329731 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2169/4332] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:24:22.330910 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b79ea-ff64-4a8f-8c2b-d3ab10b10876 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:22.332291 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f52b79ea-ff64-4a8f-8c2b-d3ab10b10876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:22.363844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b79ea-ff64-4a8f-8c2b-d3ab10b10876 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:22.375716 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31021614-4f03-4c7b-846b-44ffbeda19d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:22.378011 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31021614-4f03-4c7b-846b-44ffbeda19d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:22.378406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31021614-4f03-4c7b-846b-44ffbeda19d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:22.379958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31021614-4f03-4c7b-846b-44ffbeda19d0 admin admin] PATH_INFO: `/v3/users/d87968af35034e82bd628caaa9549042` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:22.381866 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31021614-4f03-4c7b-846b-44ffbeda19d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d87968af35034e82bd628caaa9549042)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:22.390366 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31021614-4f03-4c7b-846b-44ffbeda19d0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:22.531656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-03461658-4085-43e5-93f4-6f776eea0076 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a44db0249a214dcc9b2985ff18a3a690'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:22.546360 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-03461658-4085-43e5-93f4-6f776eea0076 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a44db0249a214dcc9b2985ff18a3a690'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:22.607400 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-03461658-4085-43e5-93f4-6f776eea0076 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a44db0249a214dcc9b2985ff18a3a690'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:22.608884 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-03461658-4085-43e5-93f4-6f776eea0076 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a44db0249a214dcc9b2985ff18a3a690'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:22.619128 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-03461658-4085-43e5-93f4-6f776eea0076 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a44db0249a214dcc9b2985ff18a3a690'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:22.628983 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2164/4333] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:24:22 2022] DELETE /identity/v3/users/a44db0249a214dcc9b2985ff18a3a690 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:24:22.630524 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe22ab-2b7d-4d22-98af-bc05e942d1f9 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:22.630942 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe22ab-2b7d-4d22-98af-bc05e942d1f9 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:22.631348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe22ab-2b7d-4d22-98af-bc05e942d1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:22.654040 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-aebe22ab-2b7d-4d22-98af-bc05e942d1f9 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:22.656049 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-aebe22ab-2b7d-4d22-98af-bc05e942d1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:22.678152 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-31021614-4f03-4c7b-846b-44ffbeda19d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd87968af35034e82bd628caaa9549042'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:22.716492 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-31021614-4f03-4c7b-846b-44ffbeda19d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd87968af35034e82bd628caaa9549042'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:22.731811 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2165/4334] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:24:22.755351 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe22ab-2b7d-4d22-98af-bc05e942d1f9 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:22.757279 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-aebe22ab-2b7d-4d22-98af-bc05e942d1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:22.826406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-31021614-4f03-4c7b-846b-44ffbeda19d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd87968af35034e82bd628caaa9549042'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:22.839599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-31021614-4f03-4c7b-846b-44ffbeda19d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd87968af35034e82bd628caaa9549042'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:22.842399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-31021614-4f03-4c7b-846b-44ffbeda19d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd87968af35034e82bd628caaa9549042'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:22.845839 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe22ab-2b7d-4d22-98af-bc05e942d1f9 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:22.851309 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a259e82-37cb-4c18-8636-919ec5997209 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:22.852134 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a259e82-37cb-4c18-8636-919ec5997209 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:22.852525 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a259e82-37cb-4c18-8636-919ec5997209 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:22.852904 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a259e82-37cb-4c18-8636-919ec5997209 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:22.855127 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1a259e82-37cb-4c18-8636-919ec5997209 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:22.863269 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2170/4335] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:24:22 2022] DELETE /identity/v3/users/d87968af35034e82bd628caaa9549042 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:22.870387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a259e82-37cb-4c18-8636-919ec5997209 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:22.873468 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a259e82-37cb-4c18-8636-919ec5997209 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:22.891716 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2166/4336] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:24:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:24:23.831441 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31021614-4f03-4c7b-846b-44ffbeda19d0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:23.833132 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-31021614-4f03-4c7b-846b-44ffbeda19d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:23.895858 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a259e82-37cb-4c18-8636-919ec5997209 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:23.898056 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1a259e82-37cb-4c18-8636-919ec5997209 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:23.918969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a259e82-37cb-4c18-8636-919ec5997209 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:24.080215 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31021614-4f03-4c7b-846b-44ffbeda19d0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:24.095664 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632c3a8-9ee8-4bef-bf34-ad6aaf9be48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:24.097501 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632c3a8-9ee8-4bef-bf34-ad6aaf9be48e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:24.097998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632c3a8-9ee8-4bef-bf34-ad6aaf9be48e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:24.098449 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632c3a8-9ee8-4bef-bf34-ad6aaf9be48e admin admin] PATH_INFO: `/v3/users/5df6ea2992c04a97af023bfb428ac44e` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:24.102175 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c632c3a8-9ee8-4bef-bf34-ad6aaf9be48e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5df6ea2992c04a97af023bfb428ac44e)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:24.106453 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c632c3a8-9ee8-4bef-bf34-ad6aaf9be48e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:24.127550 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f52581-caca-4cb6-b5e0-900765c9b902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:24.129086 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f52581-caca-4cb6-b5e0-900765c9b902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:24.132433 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f52581-caca-4cb6-b5e0-900765c9b902 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:24.132433 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f52581-caca-4cb6-b5e0-900765c9b902 admin admin] PATH_INFO: `/v3/projects/d60fbfd64cc04f3eb8f2db6746afaf04` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:24.132433 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f52581-caca-4cb6-b5e0-900765c9b902 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d60fbfd64cc04f3eb8f2db6746afaf04)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:24.137244 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f52581-caca-4cb6-b5e0-900765c9b902 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:24.400979 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c632c3a8-9ee8-4bef-bf34-ad6aaf9be48e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5df6ea2992c04a97af023bfb428ac44e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:24.403979 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-78f52581-caca-4cb6-b5e0-900765c9b902 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd60fbfd64cc04f3eb8f2db6746afaf04', 'request_id': 'req-78f52581-caca-4cb6-b5e0-900765c9b902'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:24.411421 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-78f52581-caca-4cb6-b5e0-900765c9b902 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd60fbfd64cc04f3eb8f2db6746afaf04', 'request_id': 'req-78f52581-caca-4cb6-b5e0-900765c9b902'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:24.417482 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c632c3a8-9ee8-4bef-bf34-ad6aaf9be48e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5df6ea2992c04a97af023bfb428ac44e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:24.418118 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-78f52581-caca-4cb6-b5e0-900765c9b902 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd60fbfd64cc04f3eb8f2db6746afaf04', 'request_id': 'req-78f52581-caca-4cb6-b5e0-900765c9b902'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:24.493085 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c632c3a8-9ee8-4bef-bf34-ad6aaf9be48e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5df6ea2992c04a97af023bfb428ac44e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:24.500763 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c632c3a8-9ee8-4bef-bf34-ad6aaf9be48e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5df6ea2992c04a97af023bfb428ac44e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:24.501539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c632c3a8-9ee8-4bef-bf34-ad6aaf9be48e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5df6ea2992c04a97af023bfb428ac44e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:24.508462 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2171/4337] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:24:23 2022] DELETE /identity/v3/users/5df6ea2992c04a97af023bfb428ac44e => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:24.509287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632c3a8-9ee8-4bef-bf34-ad6aaf9be48e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:24.510827 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c632c3a8-9ee8-4bef-bf34-ad6aaf9be48e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:24.558647 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-78f52581-caca-4cb6-b5e0-900765c9b902 admin admin] The token cache is being invalidate because project d60fbfd64cc04f3eb8f2db6746afaf04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:24:24.560217 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-78f52581-caca-4cb6-b5e0-900765c9b902 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:24.562254 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-78f52581-caca-4cb6-b5e0-900765c9b902 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:24.564109 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2167/4338] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:24:23 2022] DELETE /identity/v3/projects/d60fbfd64cc04f3eb8f2db6746afaf04 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:24:24.569461 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6a177-4475-49b1-998e-ec29f030af88 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:24.570070 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6a177-4475-49b1-998e-ec29f030af88 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:24.570187 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6a177-4475-49b1-998e-ec29f030af88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:24.584568 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632c3a8-9ee8-4bef-bf34-ad6aaf9be48e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:24.591356 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-c5e6a177-4475-49b1-998e-ec29f030af88 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:24.592013 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3604f-122e-4bbe-a669-275d32faf969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:24.592576 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c5e6a177-4475-49b1-998e-ec29f030af88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:24.593186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3604f-122e-4bbe-a669-275d32faf969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:24.593322 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3604f-122e-4bbe-a669-275d32faf969 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:24.593946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3604f-122e-4bbe-a669-275d32faf969 admin admin] PATH_INFO: `/v3/projects/3b107ae4a988422a892ab90f1d2b505a` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:24.595642 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3604f-122e-4bbe-a669-275d32faf969 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b107ae4a988422a892ab90f1d2b505a)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:24.599401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3604f-122e-4bbe-a669-275d32faf969 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:24.602078 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2168/4339] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:24:24.611140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31b2fb-1baa-43c4-838f-4b75537b3659 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:24.612309 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31b2fb-1baa-43c4-838f-4b75537b3659 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:24.612590 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31b2fb-1baa-43c4-838f-4b75537b3659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:24.636941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-2a31b2fb-1baa-43c4-838f-4b75537b3659 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:24.638207 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2a31b2fb-1baa-43c4-838f-4b75537b3659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:24.646820 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2169/4340] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:24:24.651097 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a31b2fb-1baa-43c4-838f-4b75537b3659 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:24.660633 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a31b2fb-1baa-43c4-838f-4b75537b3659 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:24.665556 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b086ef-bfb5-4ca4-8082-df9e98964401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:24.668295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b086ef-bfb5-4ca4-8082-df9e98964401 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:24.668295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b086ef-bfb5-4ca4-8082-df9e98964401 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:24.668295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b086ef-bfb5-4ca4-8082-df9e98964401 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:24.668295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b086ef-bfb5-4ca4-8082-df9e98964401 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:24:24.668295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b086ef-bfb5-4ca4-8082-df9e98964401 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:24.669480 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b086ef-bfb5-4ca4-8082-df9e98964401 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:24.683449 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2170/4341] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:24:24.687928 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b086ef-bfb5-4ca4-8082-df9e98964401 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:24.706193 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b086ef-bfb5-4ca4-8082-df9e98964401 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:24.713941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2335f8-bb26-42f3-9edf-7f930cf96b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:24.715400 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2335f8-bb26-42f3-9edf-7f930cf96b34 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:24.715848 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2335f8-bb26-42f3-9edf-7f930cf96b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:24.716332 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2335f8-bb26-42f3-9edf-7f930cf96b34 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:24.717179 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2335f8-bb26-42f3-9edf-7f930cf96b34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:24.719862 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2335f8-bb26-42f3-9edf-7f930cf96b34 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:24.781392 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-46f3604f-122e-4bbe-a669-275d32faf969 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b107ae4a988422a892ab90f1d2b505a', 'request_id': 'req-46f3604f-122e-4bbe-a669-275d32faf969'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:24.795684 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-46f3604f-122e-4bbe-a669-275d32faf969 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b107ae4a988422a892ab90f1d2b505a', 'request_id': 'req-46f3604f-122e-4bbe-a669-275d32faf969'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:24.820990 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-46f3604f-122e-4bbe-a669-275d32faf969 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b107ae4a988422a892ab90f1d2b505a', 'request_id': 'req-46f3604f-122e-4bbe-a669-275d32faf969'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:24.848367 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2171/4342] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:24:24 2022] POST /identity/v3/projects => generated 373 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:24:24.853463 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2335f8-bb26-42f3-9edf-7f930cf96b34 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:24.923077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-46f3604f-122e-4bbe-a669-275d32faf969 admin admin] The token cache is being invalidate because project 3b107ae4a988422a892ab90f1d2b505a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:24:24.923657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-46f3604f-122e-4bbe-a669-275d32faf969 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:24.924919 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-46f3604f-122e-4bbe-a669-275d32faf969 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:24.926857 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2172/4343] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:24:24 2022] DELETE /identity/v3/projects/3b107ae4a988422a892ab90f1d2b505a => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:24.933466 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de1c5c-ea0f-4d50-b70a-20c3ae2d0e49 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:24.933782 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de1c5c-ea0f-4d50-b70a-20c3ae2d0e49 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:24.934237 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de1c5c-ea0f-4d50-b70a-20c3ae2d0e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:24.944778 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2335f8-bb26-42f3-9edf-7f930cf96b34 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:24.964509 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-17de1c5c-ea0f-4d50-b70a-20c3ae2d0e49 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:24.966199 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59311ff0-1768-47db-934c-a29d448f209a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:24.966374 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-17de1c5c-ea0f-4d50-b70a-20c3ae2d0e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:24.966892 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59311ff0-1768-47db-934c-a29d448f209a admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:24.967174 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59311ff0-1768-47db-934c-a29d448f209a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:24.967446 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59311ff0-1768-47db-934c-a29d448f209a admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:24.968139 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59311ff0-1768-47db-934c-a29d448f209a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:24.976464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59311ff0-1768-47db-934c-a29d448f209a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:24.978707 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2173/4344] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:24:24.979683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de1c5c-ea0f-4d50-b70a-20c3ae2d0e49 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:24.981425 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-17de1c5c-ea0f-4d50-b70a-20c3ae2d0e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:24.996237 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de1c5c-ea0f-4d50-b70a-20c3ae2d0e49 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:25.006082 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8b14b-3e71-4dd9-a04c-0770a5f7a1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:25.006082 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8b14b-3e71-4dd9-a04c-0770a5f7a1e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:25.006609 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8b14b-3e71-4dd9-a04c-0770a5f7a1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:25.007043 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8b14b-3e71-4dd9-a04c-0770a5f7a1e7 admin admin] PATH_INFO: `/v3/projects/b9c121a94ec3445baa05dcaa3dc22af2` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:25.008455 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc8b14b-3e71-4dd9-a04c-0770a5f7a1e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9c121a94ec3445baa05dcaa3dc22af2)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:25.010656 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc8b14b-3e71-4dd9-a04c-0770a5f7a1e7 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:25.165065 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2172/4345] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:24:24 2022] POST /identity/v3/users => generated 287 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:24:25.166914 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e05f95-e20a-4b0d-8cf0-515d2c3def32 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:25.167396 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e05f95-e20a-4b0d-8cf0-515d2c3def32 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:25.167684 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e05f95-e20a-4b0d-8cf0-515d2c3def32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:25.183264 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-efc8b14b-3e71-4dd9-a04c-0770a5f7a1e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9c121a94ec3445baa05dcaa3dc22af2', 'request_id': 'req-efc8b14b-3e71-4dd9-a04c-0770a5f7a1e7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:25.192772 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-efc8b14b-3e71-4dd9-a04c-0770a5f7a1e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9c121a94ec3445baa05dcaa3dc22af2', 'request_id': 'req-efc8b14b-3e71-4dd9-a04c-0770a5f7a1e7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:25.206163 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-efc8b14b-3e71-4dd9-a04c-0770a5f7a1e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9c121a94ec3445baa05dcaa3dc22af2', 'request_id': 'req-efc8b14b-3e71-4dd9-a04c-0770a5f7a1e7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:25.215961 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-c6e05f95-e20a-4b0d-8cf0-515d2c3def32 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:25.215961 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c6e05f95-e20a-4b0d-8cf0-515d2c3def32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:25.307240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-efc8b14b-3e71-4dd9-a04c-0770a5f7a1e7 admin admin] The token cache is being invalidate because project b9c121a94ec3445baa05dcaa3dc22af2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:24:25.307240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-efc8b14b-3e71-4dd9-a04c-0770a5f7a1e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:25.307240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-efc8b14b-3e71-4dd9-a04c-0770a5f7a1e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:25.308550 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2174/4346] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:24:24 2022] DELETE /identity/v3/projects/b9c121a94ec3445baa05dcaa3dc22af2 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:25.309573 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8b14b-3e71-4dd9-a04c-0770a5f7a1e7 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:25.312815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-efc8b14b-3e71-4dd9-a04c-0770a5f7a1e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:25.371893 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2173/4347] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:24:25.372236 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1cad4-69f3-4d33-a2a4-6e31666c2936 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:25.372835 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1cad4-69f3-4d33-a2a4-6e31666c2936 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:25.373124 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1cad4-69f3-4d33-a2a4-6e31666c2936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:25.416509 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-73b1cad4-69f3-4d33-a2a4-6e31666c2936 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:25.420346 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-73b1cad4-69f3-4d33-a2a4-6e31666c2936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:25.440967 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2174/4348] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:24:25.446874 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1cad4-69f3-4d33-a2a4-6e31666c2936 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:25.461353 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8b14b-3e71-4dd9-a04c-0770a5f7a1e7 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:25.465858 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1cad4-69f3-4d33-a2a4-6e31666c2936 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:25.474287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03fb42b-f0a2-424e-972b-fad9fd53cc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:25.474287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fb42b-f0a2-424e-972b-fad9fd53cc0e admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:25.474287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fb42b-f0a2-424e-972b-fad9fd53cc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:25.474287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fb42b-f0a2-424e-972b-fad9fd53cc0e admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:25.475045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03fb42b-f0a2-424e-972b-fad9fd53cc0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:25.476673 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03fb42b-f0a2-424e-972b-fad9fd53cc0e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:25.480942 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262febdc-8957-48aa-8fd0-c12f1486e361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:25.481618 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262febdc-8957-48aa-8fd0-c12f1486e361 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:25.482010 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262febdc-8957-48aa-8fd0-c12f1486e361 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:25.482259 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262febdc-8957-48aa-8fd0-c12f1486e361 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:25.482991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262febdc-8957-48aa-8fd0-c12f1486e361 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:24:25.483295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262febdc-8957-48aa-8fd0-c12f1486e361 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:25.491440 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262febdc-8957-48aa-8fd0-c12f1486e361 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:25.506389 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2175/4349] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:24:25.508003 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd363a-1caa-40cf-b0e5-a2940f2548bb None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:25.508305 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd363a-1caa-40cf-b0e5-a2940f2548bb None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:25.508588 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd363a-1caa-40cf-b0e5-a2940f2548bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:25.530084 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2175/4350] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:24:25.531992 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262febdc-8957-48aa-8fd0-c12f1486e361 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:25.557160 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262febdc-8957-48aa-8fd0-c12f1486e361 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:25.564173 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-45bd363a-1caa-40cf-b0e5-a2940f2548bb None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:25.565601 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-45bd363a-1caa-40cf-b0e5-a2940f2548bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:25.568562 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ed9a5-e84a-4f1d-86af-b5a4dc9fb264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:25.569249 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ed9a5-e84a-4f1d-86af-b5a4dc9fb264 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:25.569788 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ed9a5-e84a-4f1d-86af-b5a4dc9fb264 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:25.570102 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ed9a5-e84a-4f1d-86af-b5a4dc9fb264 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:25.571039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ed9a5-e84a-4f1d-86af-b5a4dc9fb264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:25.572679 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ed9a5-e84a-4f1d-86af-b5a4dc9fb264 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:25.591575 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2176/4351] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:24:25.592495 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd363a-1caa-40cf-b0e5-a2940f2548bb None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:25.625801 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2176/4352] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:24:25.625801 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ed9a5-e84a-4f1d-86af-b5a4dc9fb264 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:25.636087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd363a-1caa-40cf-b0e5-a2940f2548bb None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:25.646182 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ed9a5-e84a-4f1d-86af-b5a4dc9fb264 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:25.648581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ae15b-6819-40b7-b814-b78c6b6e1d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:25.649310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ae15b-6819-40b7-b814-b78c6b6e1d64 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:25.649712 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ae15b-6819-40b7-b814-b78c6b6e1d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:25.649978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ae15b-6819-40b7-b814-b78c6b6e1d64 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:25.652614 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1ae15b-6819-40b7-b814-b78c6b6e1d64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:25.654027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1ae15b-6819-40b7-b814-b78c6b6e1d64 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:25.675088 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b2cbe6-a62f-4331-a240-7cf89c3d654f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:25.675772 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2cbe6-a62f-4331-a240-7cf89c3d654f admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:25.676054 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2cbe6-a62f-4331-a240-7cf89c3d654f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:25.676333 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2cbe6-a62f-4331-a240-7cf89c3d654f admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:25.677682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b2cbe6-a62f-4331-a240-7cf89c3d654f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:24:25.678028 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b2cbe6-a62f-4331-a240-7cf89c3d654f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:25.686495 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b2cbe6-a62f-4331-a240-7cf89c3d654f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:25.711751 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2177/4353] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:24:25.712689 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b2cbe6-a62f-4331-a240-7cf89c3d654f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:25.732324 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b2cbe6-a62f-4331-a240-7cf89c3d654f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:25.741683 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850d4db-3b8f-495e-a738-053813a5fc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:25.743014 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850d4db-3b8f-495e-a738-053813a5fc84 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:25.743563 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850d4db-3b8f-495e-a738-053813a5fc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:25.744180 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850d4db-3b8f-495e-a738-053813a5fc84 admin admin] PATH_INFO: `/v3/projects/f2d5e4e93c5147dcae69e62ca9b45922/users/c0f66fef313d4f9abe4bbe2d8ab7f52f/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:25.766940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1850d4db-3b8f-495e-a738-053813a5fc84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2d5e4e93c5147dcae69e62ca9b45922, user_id=c0f66fef313d4f9abe4bbe2d8ab7f52f, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:25.770082 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1850d4db-3b8f-495e-a738-053813a5fc84 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:25.852860 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2177/4354] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:24:25 2022] POST /identity/v3/projects => generated 377 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:24:25.854208 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ae15b-6819-40b7-b814-b78c6b6e1d64 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:25.868770 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2178/4355] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:24:25 2022] PUT /identity/v3/projects/f2d5e4e93c5147dcae69e62ca9b45922/users/c0f66fef313d4f9abe4bbe2d8ab7f52f/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:25.885217 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850d4db-3b8f-495e-a738-053813a5fc84 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:25.939072 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ae15b-6819-40b7-b814-b78c6b6e1d64 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:25.993489 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850d4db-3b8f-495e-a738-053813a5fc84 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:26.000000 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7643d-6282-4b8b-a6aa-ffe9990439b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:26.001251 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7643d-6282-4b8b-a6aa-ffe9990439b1 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:26.001691 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7643d-6282-4b8b-a6aa-ffe9990439b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:26.002381 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7643d-6282-4b8b-a6aa-ffe9990439b1 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:26.003770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7643d-6282-4b8b-a6aa-ffe9990439b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:26.006106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7643d-6282-4b8b-a6aa-ffe9990439b1 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:26.055364 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550d89b-2525-46b2-b13b-ae4b1680e1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:26.056925 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550d89b-2525-46b2-b13b-ae4b1680e1d0 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:26.057239 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550d89b-2525-46b2-b13b-ae4b1680e1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:26.057708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550d89b-2525-46b2-b13b-ae4b1680e1d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:26.060260 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550d89b-2525-46b2-b13b-ae4b1680e1d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:26.062736 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550d89b-2525-46b2-b13b-ae4b1680e1d0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:26.126448 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2179/4356] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:24:25 2022] POST /identity/v3/users => generated 289 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:24:26.126448 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156c161-46e1-4589-b9ec-76fd9375eeee None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:26.126448 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156c161-46e1-4589-b9ec-76fd9375eeee None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:26.126822 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156c161-46e1-4589-b9ec-76fd9375eeee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:26.168356 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-e156c161-46e1-4589-b9ec-76fd9375eeee None None] MFA Rules not processed for user `c0f66fef313d4f9abe4bbe2d8ab7f52f`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:26.172550 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e156c161-46e1-4589-b9ec-76fd9375eeee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:26.187922 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2178/4357] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:24:25 2022] POST /identity/v3/projects => generated 389 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:24:26.191167 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550d89b-2525-46b2-b13b-ae4b1680e1d0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:26.303391 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550d89b-2525-46b2-b13b-ae4b1680e1d0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:26.310602 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885b2cc-18d7-4afc-bb6b-d7b908cfc255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:26.312199 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885b2cc-18d7-4afc-bb6b-d7b908cfc255 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:26.312762 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885b2cc-18d7-4afc-bb6b-d7b908cfc255 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:26.315875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885b2cc-18d7-4afc-bb6b-d7b908cfc255 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:26.315875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885b2cc-18d7-4afc-bb6b-d7b908cfc255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:26.316725 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885b2cc-18d7-4afc-bb6b-d7b908cfc255 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:26.328875 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2180/4358] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:24:26.329732 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156c161-46e1-4589-b9ec-76fd9375eeee None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:26.334520 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2179/4359] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:24:26.338630 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885b2cc-18d7-4afc-bb6b-d7b908cfc255 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:26.348246 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885b2cc-18d7-4afc-bb6b-d7b908cfc255 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:26.350144 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156c161-46e1-4589-b9ec-76fd9375eeee None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:26.353999 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be35b64-5426-4979-ae97-26700b9f8cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:26.354758 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be35b64-5426-4979-ae97-26700b9f8cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:26.355106 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be35b64-5426-4979-ae97-26700b9f8cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:26.355452 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be35b64-5426-4979-ae97-26700b9f8cb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:26.356249 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be35b64-5426-4979-ae97-26700b9f8cb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:26.357002 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf595047-0127-4606-8ee9-e8e413ab09c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:26.357886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf595047-0127-4606-8ee9-e8e413ab09c3 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:26.358348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf595047-0127-4606-8ee9-e8e413ab09c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:26.358485 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be35b64-5426-4979-ae97-26700b9f8cb0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:26.359624 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf595047-0127-4606-8ee9-e8e413ab09c3 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:26.360348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf595047-0127-4606-8ee9-e8e413ab09c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:26.362995 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf595047-0127-4606-8ee9-e8e413ab09c3 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:26.374013 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2180/4360] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:24:26.376400 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be35b64-5426-4979-ae97-26700b9f8cb0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:26.378371 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7be35b64-5426-4979-ae97-26700b9f8cb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:26.459350 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2181/4361] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:24:26 2022] POST /identity/v3/users => generated 295 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:24:26.461167 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf595047-0127-4606-8ee9-e8e413ab09c3 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:26.488095 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be35b64-5426-4979-ae97-26700b9f8cb0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:26.489848 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf595047-0127-4606-8ee9-e8e413ab09c3 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:26.498359 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba3fb9-a9cf-4007-b02f-e83c67186885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:26.501436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba3fb9-a9cf-4007-b02f-e83c67186885 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:26.503426 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba3fb9-a9cf-4007-b02f-e83c67186885 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:26.503426 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba3fb9-a9cf-4007-b02f-e83c67186885 admin admin] PATH_INFO: `/v3/projects/3e465ba33b284ffda335af1a600cbccc/users/8d6fb7be8b7f42a9b1e01340f3c9d772/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:26.517167 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b7fcbd-464a-43a9-837e-59e0998ea889 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:26.518419 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7fcbd-464a-43a9-837e-59e0998ea889 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:26.518710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7fcbd-464a-43a9-837e-59e0998ea889 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:26.520385 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7fcbd-464a-43a9-837e-59e0998ea889 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:26.541623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba3fb9-a9cf-4007-b02f-e83c67186885 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e465ba33b284ffda335af1a600cbccc, user_id=8d6fb7be8b7f42a9b1e01340f3c9d772, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:26.545002 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba3fb9-a9cf-4007-b02f-e83c67186885 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:26.630337 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2182/4362] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:24:26 2022] PUT /identity/v3/projects/3e465ba33b284ffda335af1a600cbccc/users/8d6fb7be8b7f42a9b1e01340f3c9d772/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:26.631342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba3fb9-a9cf-4007-b02f-e83c67186885 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:26.639655 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b7fcbd-464a-43a9-837e-59e0998ea889 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:26.643879 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b7fcbd-464a-43a9-837e-59e0998ea889 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:26.660004 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2181/4363] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:24:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:24:26.673546 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d519ed-3605-430a-a441-738fc8d2f503 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:26.673546 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d519ed-3605-430a-a441-738fc8d2f503 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:26.673546 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d519ed-3605-430a-a441-738fc8d2f503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:26.728207 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-13d519ed-3605-430a-a441-738fc8d2f503 None None] MFA Rules not processed for user `8d6fb7be8b7f42a9b1e01340f3c9d772`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:26.729526 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-13d519ed-3605-430a-a441-738fc8d2f503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:26.766569 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba3fb9-a9cf-4007-b02f-e83c67186885 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:26.788840 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a907d-8bee-4b6b-9298-3b85b1742bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:26.789702 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a907d-8bee-4b6b-9298-3b85b1742bba admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:26.790200 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a907d-8bee-4b6b-9298-3b85b1742bba admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:26.790585 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a907d-8bee-4b6b-9298-3b85b1742bba admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:26.791571 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a907d-8bee-4b6b-9298-3b85b1742bba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:26.795961 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a907d-8bee-4b6b-9298-3b85b1742bba admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:26.817554 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2183/4364] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:24:26.824235 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a907d-8bee-4b6b-9298-3b85b1742bba admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:26.851680 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a907d-8bee-4b6b-9298-3b85b1742bba admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:26.858155 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ab9b6-ac61-4d14-a4a7-74aefc4e255e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:26.859057 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ab9b6-ac61-4d14-a4a7-74aefc4e255e admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:26.859338 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ab9b6-ac61-4d14-a4a7-74aefc4e255e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:26.859610 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ab9b6-ac61-4d14-a4a7-74aefc4e255e admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:26.860344 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ab9b6-ac61-4d14-a4a7-74aefc4e255e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:26.864824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ab9b6-ac61-4d14-a4a7-74aefc4e255e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:26.882266 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2184/4365] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:24:26.883617 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ab9b6-ac61-4d14-a4a7-74aefc4e255e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:26.900578 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ab9b6-ac61-4d14-a4a7-74aefc4e255e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:26.907202 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8799a-28a1-4eeb-b5d8-a23c76c678c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:26.908112 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8799a-28a1-4eeb-b5d8-a23c76c678c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:26.908396 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8799a-28a1-4eeb-b5d8-a23c76c678c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:26.908670 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8799a-28a1-4eeb-b5d8-a23c76c678c9 admin admin] PATH_INFO: `/v3/projects/dd851d0a5daa4d03977b37c9b6904b6c/users/17921dea12554204984a990f94a9b354/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:26.912891 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2182/4366] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:24:26.918051 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d519ed-3605-430a-a441-738fc8d2f503 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:26.933445 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d519ed-3605-430a-a441-738fc8d2f503 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:26.938878 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa07de-7aba-4b73-b182-a3972b7bdbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:26.940133 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa07de-7aba-4b73-b182-a3972b7bdbde admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:26.940708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa07de-7aba-4b73-b182-a3972b7bdbde admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:26.940708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa07de-7aba-4b73-b182-a3972b7bdbde admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:26.941373 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa07de-7aba-4b73-b182-a3972b7bdbde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:26.941616 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8799a-28a1-4eeb-b5d8-a23c76c678c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd851d0a5daa4d03977b37c9b6904b6c, user_id=17921dea12554204984a990f94a9b354, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:26.944183 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa07de-7aba-4b73-b182-a3972b7bdbde admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:26.951536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8799a-28a1-4eeb-b5d8-a23c76c678c9 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:27.099115 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2185/4367] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:24:26 2022] PUT /identity/v3/projects/dd851d0a5daa4d03977b37c9b6904b6c/users/17921dea12554204984a990f94a9b354/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:27.106985 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2183/4368] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:24:26 2022] POST /identity/v3/projects => generated 375 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:24:27.108011 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa07de-7aba-4b73-b182-a3972b7bdbde admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:27.116512 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc6013-f3a5-45c5-bbf8-ee52acd6a7bf None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:27.117265 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc6013-f3a5-45c5-bbf8-ee52acd6a7bf None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:27.118052 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc6013-f3a5-45c5-bbf8-ee52acd6a7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:27.182248 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-8cbc6013-f3a5-45c5-bbf8-ee52acd6a7bf None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:27.183653 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8cbc6013-f3a5-45c5-bbf8-ee52acd6a7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:27.276655 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa07de-7aba-4b73-b182-a3972b7bdbde admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:27.291469 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe46be3-4ce8-433c-a197-8994a75247ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:27.292361 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe46be3-4ce8-433c-a197-8994a75247ea admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:27.292815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe46be3-4ce8-433c-a197-8994a75247ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:27.293178 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe46be3-4ce8-433c-a197-8994a75247ea admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:27.293999 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe46be3-4ce8-433c-a197-8994a75247ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:27.296043 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe46be3-4ce8-433c-a197-8994a75247ea admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:27.304055 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2186/4369] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:24:27.321519 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc6013-f3a5-45c5-bbf8-ee52acd6a7bf None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:27.324564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8cbc6013-f3a5-45c5-bbf8-ee52acd6a7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:27.418652 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2184/4370] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:24:27 2022] POST /identity/v3/users => generated 294 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:24:27.423202 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe46be3-4ce8-433c-a197-8994a75247ea admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:27.443896 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe46be3-4ce8-433c-a197-8994a75247ea admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:27.446700 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f15ccb-c938-43dd-92b0-42a18a978f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:27.447392 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f15ccb-c938-43dd-92b0-42a18a978f72 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:27.447673 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f15ccb-c938-43dd-92b0-42a18a978f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:27.447949 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f15ccb-c938-43dd-92b0-42a18a978f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:27.448818 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f15ccb-c938-43dd-92b0-42a18a978f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:27.451451 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f15ccb-c938-43dd-92b0-42a18a978f72 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:27.472519 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc6013-f3a5-45c5-bbf8-ee52acd6a7bf None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:27.479550 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2185/4371] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:24:27.479550 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f15ccb-c938-43dd-92b0-42a18a978f72 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:27.482606 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769338ed-68df-48f8-8f8b-d1246e4e41e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:27.483281 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769338ed-68df-48f8-8f8b-d1246e4e41e5 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:27.483560 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769338ed-68df-48f8-8f8b-d1246e4e41e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:27.484107 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769338ed-68df-48f8-8f8b-d1246e4e41e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:27.508052 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769338ed-68df-48f8-8f8b-d1246e4e41e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:27.510064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f15ccb-c938-43dd-92b0-42a18a978f72 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:27.510737 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769338ed-68df-48f8-8f8b-d1246e4e41e5 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:27.526661 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2187/4372] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:24:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:24:27.526871 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ac7af-fa52-4b3a-b6d1-49f1ef6a3895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:27.529685 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769338ed-68df-48f8-8f8b-d1246e4e41e5 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:27.529848 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ac7af-fa52-4b3a-b6d1-49f1ef6a3895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:27.529848 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ac7af-fa52-4b3a-b6d1-49f1ef6a3895 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:27.529848 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ac7af-fa52-4b3a-b6d1-49f1ef6a3895 admin admin] PATH_INFO: `/v3/users/c0f66fef313d4f9abe4bbe2d8ab7f52f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:27.529848 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ac7af-fa52-4b3a-b6d1-49f1ef6a3895 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0f66fef313d4f9abe4bbe2d8ab7f52f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:27.531512 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ac7af-fa52-4b3a-b6d1-49f1ef6a3895 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:27.541903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769338ed-68df-48f8-8f8b-d1246e4e41e5 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:27.555045 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515e438-c048-4c72-a9d9-576dd4f55a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:27.556291 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515e438-c048-4c72-a9d9-576dd4f55a2f admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:27.556797 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515e438-c048-4c72-a9d9-576dd4f55a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:27.557366 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515e438-c048-4c72-a9d9-576dd4f55a2f admin admin] PATH_INFO: `/v3/projects/3c79746fa72c4192b5984cecda6e91a2/users/078d3385bc6a4418970db78273f2db57/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:27.580313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515e438-c048-4c72-a9d9-576dd4f55a2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c79746fa72c4192b5984cecda6e91a2, user_id=078d3385bc6a4418970db78273f2db57, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:27.583489 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a515e438-c048-4c72-a9d9-576dd4f55a2f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:27.710482 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2188/4373] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:24:27 2022] PUT /identity/v3/projects/3c79746fa72c4192b5984cecda6e91a2/users/078d3385bc6a4418970db78273f2db57/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:27.715000 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515e438-c048-4c72-a9d9-576dd4f55a2f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:27.794479 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-760ac7af-fa52-4b3a-b6d1-49f1ef6a3895 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0f66fef313d4f9abe4bbe2d8ab7f52f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:27.834742 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-760ac7af-fa52-4b3a-b6d1-49f1ef6a3895 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0f66fef313d4f9abe4bbe2d8ab7f52f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:27.846218 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515e438-c048-4c72-a9d9-576dd4f55a2f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:27.852703 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeac445-096f-4c1c-93a8-7f715f6a6f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:27.853504 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeac445-096f-4c1c-93a8-7f715f6a6f78 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:27.853878 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeac445-096f-4c1c-93a8-7f715f6a6f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:27.854593 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeac445-096f-4c1c-93a8-7f715f6a6f78 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:27.855406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeac445-096f-4c1c-93a8-7f715f6a6f78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:27.866381 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeac445-096f-4c1c-93a8-7f715f6a6f78 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:27.887589 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2189/4374] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:24:27.891359 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeac445-096f-4c1c-93a8-7f715f6a6f78 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:27.915928 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-760ac7af-fa52-4b3a-b6d1-49f1ef6a3895 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0f66fef313d4f9abe4bbe2d8ab7f52f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:27.930403 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeac445-096f-4c1c-93a8-7f715f6a6f78 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:27.933200 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-760ac7af-fa52-4b3a-b6d1-49f1ef6a3895 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0f66fef313d4f9abe4bbe2d8ab7f52f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:27.934822 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-760ac7af-fa52-4b3a-b6d1-49f1ef6a3895 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0f66fef313d4f9abe4bbe2d8ab7f52f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:27.954147 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a127257-7159-43e6-b755-e9dfeb543c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:27.955096 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a127257-7159-43e6-b755-e9dfeb543c22 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:27.955371 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a127257-7159-43e6-b755-e9dfeb543c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:27.955668 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a127257-7159-43e6-b755-e9dfeb543c22 admin admin] PATH_INFO: `/v3/projects/3c79746fa72c4192b5984cecda6e91a2/users/078d3385bc6a4418970db78273f2db57/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:27.956206 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2186/4375] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:24:27 2022] DELETE /identity/v3/users/c0f66fef313d4f9abe4bbe2d8ab7f52f => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:27.958290 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a127257-7159-43e6-b755-e9dfeb543c22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c79746fa72c4192b5984cecda6e91a2, user_id=078d3385bc6a4418970db78273f2db57, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:27.961404 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a127257-7159-43e6-b755-e9dfeb543c22 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:27.961880 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb73404-a1a7-44b5-a285-9535695b98aa None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:27.963718 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb73404-a1a7-44b5-a285-9535695b98aa None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:27.964016 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb73404-a1a7-44b5-a285-9535695b98aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:27.988061 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-deb73404-a1a7-44b5-a285-9535695b98aa None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:27.989603 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2190/4376] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:24:27 2022] PUT /identity/v3/projects/3c79746fa72c4192b5984cecda6e91a2/users/078d3385bc6a4418970db78273f2db57/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:27.990182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-deb73404-a1a7-44b5-a285-9535695b98aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:27.991244 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d996c65-83c7-4f21-823c-eb2f1fde9e68 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:27.991544 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d996c65-83c7-4f21-823c-eb2f1fde9e68 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:27.991827 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d996c65-83c7-4f21-823c-eb2f1fde9e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:28.029093 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-4d996c65-83c7-4f21-823c-eb2f1fde9e68 None None] MFA Rules not processed for user `078d3385bc6a4418970db78273f2db57`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:28.030422 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4d996c65-83c7-4f21-823c-eb2f1fde9e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:28.111913 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2187/4377] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:24:28.130563 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2191/4378] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:27 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:24:28.176106 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb73404-a1a7-44b5-a285-9535695b98aa None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:28.177344 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d996c65-83c7-4f21-823c-eb2f1fde9e68 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:28.179632 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-deb73404-a1a7-44b5-a285-9535695b98aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:28.182341 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4d996c65-83c7-4f21-823c-eb2f1fde9e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:28.342040 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb73404-a1a7-44b5-a285-9535695b98aa None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:28.354829 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678dbcdb-a424-4a7d-be16-3d931237986f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:28.355921 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678dbcdb-a424-4a7d-be16-3d931237986f service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:28.356637 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678dbcdb-a424-4a7d-be16-3d931237986f service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:28.357019 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678dbcdb-a424-4a7d-be16-3d931237986f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:28.357304 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d996c65-83c7-4f21-823c-eb2f1fde9e68 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:28.373039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5d98c-d64f-4496-af5e-ad19b75a4a63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:28.375785 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5d98c-d64f-4496-af5e-ad19b75a4a63 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:28.375785 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5d98c-d64f-4496-af5e-ad19b75a4a63 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:28.375785 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5d98c-d64f-4496-af5e-ad19b75a4a63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:28.381861 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678dbcdb-a424-4a7d-be16-3d931237986f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:28.383764 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678dbcdb-a424-4a7d-be16-3d931237986f service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:28.399058 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d5d98c-d64f-4496-af5e-ad19b75a4a63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:28.400845 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d5d98c-d64f-4496-af5e-ad19b75a4a63 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:28.402640 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2188/4379] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:24:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:24:28.414928 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2192/4380] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:24:28 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:24:29.450537 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678dbcdb-a424-4a7d-be16-3d931237986f service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:29.452130 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-678dbcdb-a424-4a7d-be16-3d931237986f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:29.480154 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678dbcdb-a424-4a7d-be16-3d931237986f service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:29.508291 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66531b89-a187-470c-a7bb-c3e60379b7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:29.510699 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66531b89-a187-470c-a7bb-c3e60379b7b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:29.512521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66531b89-a187-470c-a7bb-c3e60379b7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:29.512818 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66531b89-a187-470c-a7bb-c3e60379b7b8 admin admin] PATH_INFO: `/v3/projects/f2d5e4e93c5147dcae69e62ca9b45922` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:29.514880 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66531b89-a187-470c-a7bb-c3e60379b7b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2d5e4e93c5147dcae69e62ca9b45922)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:29.516822 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66531b89-a187-470c-a7bb-c3e60379b7b8 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:29.694459 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-66531b89-a187-470c-a7bb-c3e60379b7b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2d5e4e93c5147dcae69e62ca9b45922', 'request_id': 'req-66531b89-a187-470c-a7bb-c3e60379b7b8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:29.709063 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-66531b89-a187-470c-a7bb-c3e60379b7b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2d5e4e93c5147dcae69e62ca9b45922', 'request_id': 'req-66531b89-a187-470c-a7bb-c3e60379b7b8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:29.712154 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-66531b89-a187-470c-a7bb-c3e60379b7b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2d5e4e93c5147dcae69e62ca9b45922', 'request_id': 'req-66531b89-a187-470c-a7bb-c3e60379b7b8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:29.823220 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-66531b89-a187-470c-a7bb-c3e60379b7b8 admin admin] The token cache is being invalidate because project f2d5e4e93c5147dcae69e62ca9b45922 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:24:29.823912 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-66531b89-a187-470c-a7bb-c3e60379b7b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:29.832567 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-66531b89-a187-470c-a7bb-c3e60379b7b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:29.834303 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2189/4381] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:24:29 2022] DELETE /identity/v3/projects/f2d5e4e93c5147dcae69e62ca9b45922 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:29.841309 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0ff02-d058-4050-acd9-eb06bf473c33 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:29.841831 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0ff02-d058-4050-acd9-eb06bf473c33 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:29.842026 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0ff02-d058-4050-acd9-eb06bf473c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:29.880576 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-57f0ff02-d058-4050-acd9-eb06bf473c33 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:29.882568 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-57f0ff02-d058-4050-acd9-eb06bf473c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:29.981795 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2193/4382] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:24:29.987088 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3dd75-0b99-4a91-ba2e-18272bea0ed1 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:29.987641 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3dd75-0b99-4a91-ba2e-18272bea0ed1 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:29.988105 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3dd75-0b99-4a91-ba2e-18272bea0ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:30.034091 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-59b3dd75-0b99-4a91-ba2e-18272bea0ed1 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:30.035351 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-59b3dd75-0b99-4a91-ba2e-18272bea0ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:30.054609 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2190/4383] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:24:30.060238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0ff02-d058-4050-acd9-eb06bf473c33 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:30.077393 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0ff02-d058-4050-acd9-eb06bf473c33 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:30.102872 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a3ac5-7850-4cb4-87ae-8f34e3d31299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:30.103491 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a3ac5-7850-4cb4-87ae-8f34e3d31299 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:30.103775 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a3ac5-7850-4cb4-87ae-8f34e3d31299 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:30.104053 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a3ac5-7850-4cb4-87ae-8f34e3d31299 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:30.104791 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a3ac5-7850-4cb4-87ae-8f34e3d31299 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:24:30.105098 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a3ac5-7850-4cb4-87ae-8f34e3d31299 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:30.109619 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a3ac5-7850-4cb4-87ae-8f34e3d31299 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:30.143782 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2194/4384] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:24:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:24:30.143971 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3dd75-0b99-4a91-ba2e-18272bea0ed1 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:30.160960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3dd75-0b99-4a91-ba2e-18272bea0ed1 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:30.174822 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b399f6e-5c35-4d8b-8235-baae4cec642b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:30.175571 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b399f6e-5c35-4d8b-8235-baae4cec642b admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:30.180046 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b399f6e-5c35-4d8b-8235-baae4cec642b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:30.180392 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b399f6e-5c35-4d8b-8235-baae4cec642b admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:30.181153 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b399f6e-5c35-4d8b-8235-baae4cec642b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:30.183386 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b399f6e-5c35-4d8b-8235-baae4cec642b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:30.327214 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2191/4385] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:24:30 2022] POST /identity/v3/projects => generated 391 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:24:30.331148 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a3ac5-7850-4cb4-87ae-8f34e3d31299 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:30.343426 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a3ac5-7850-4cb4-87ae-8f34e3d31299 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:30.439824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc06e79-4b7e-4bea-ba96-75814d65b94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:30.440784 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc06e79-4b7e-4bea-ba96-75814d65b94c admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:30.441135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc06e79-4b7e-4bea-ba96-75814d65b94c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:30.444155 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc06e79-4b7e-4bea-ba96-75814d65b94c admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:30.444155 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc06e79-4b7e-4bea-ba96-75814d65b94c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:30.445002 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc06e79-4b7e-4bea-ba96-75814d65b94c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:30.557048 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2195/4386] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:24:30 2022] POST /identity/v3/users => generated 296 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:24:30.561015 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b399f6e-5c35-4d8b-8235-baae4cec642b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:30.584436 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b399f6e-5c35-4d8b-8235-baae4cec642b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:30.592558 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6498b1c-5b25-4011-80b4-f1e1894a239c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:30.593556 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6498b1c-5b25-4011-80b4-f1e1894a239c admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:30.594157 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6498b1c-5b25-4011-80b4-f1e1894a239c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:30.594661 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6498b1c-5b25-4011-80b4-f1e1894a239c admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:30.600015 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6498b1c-5b25-4011-80b4-f1e1894a239c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:30.603033 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6498b1c-5b25-4011-80b4-f1e1894a239c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:30.633015 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2192/4387] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:24:30.636763 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc06e79-4b7e-4bea-ba96-75814d65b94c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:30.659375 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc06e79-4b7e-4bea-ba96-75814d65b94c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:30.664861 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b7bc7-93c8-4dd0-9726-c21d2abc35c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:30.666894 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b7bc7-93c8-4dd0-9726-c21d2abc35c8 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:30.667295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b7bc7-93c8-4dd0-9726-c21d2abc35c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:30.668185 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b7bc7-93c8-4dd0-9726-c21d2abc35c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:30.669674 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b7bc7-93c8-4dd0-9726-c21d2abc35c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:30.674481 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b7bc7-93c8-4dd0-9726-c21d2abc35c8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:30.689686 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2196/4388] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:24:30.693477 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6498b1c-5b25-4011-80b4-f1e1894a239c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:30.705113 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6498b1c-5b25-4011-80b4-f1e1894a239c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:30.722287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795bc9b4-f9a5-46e5-9735-c5c5d851c56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:30.722287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bc9b4-f9a5-46e5-9735-c5c5d851c56a admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:30.722287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bc9b4-f9a5-46e5-9735-c5c5d851c56a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:30.722287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bc9b4-f9a5-46e5-9735-c5c5d851c56a admin admin] PATH_INFO: `/v3/projects/e297ade488854410bf06fe5437e3ae64/users/d9d8ddde3fa947fc835cfac09b56cdbf/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:30.729563 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54c2b3-0b43-4be1-9db2-56836f4c143a None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:30.729965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54c2b3-0b43-4be1-9db2-56836f4c143a None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:30.730345 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54c2b3-0b43-4be1-9db2-56836f4c143a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:30.759778 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795bc9b4-f9a5-46e5-9735-c5c5d851c56a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e297ade488854410bf06fe5437e3ae64, user_id=d9d8ddde3fa947fc835cfac09b56cdbf, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:30.763979 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795bc9b4-f9a5-46e5-9735-c5c5d851c56a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:30.771340 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-8c54c2b3-0b43-4be1-9db2-56836f4c143a None None] MFA Rules not processed for user `9cc9b55d852942538c3ad8f317dcd73e`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:30.772992 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8c54c2b3-0b43-4be1-9db2-56836f4c143a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:30.875531 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2197/4389] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:24:30.888840 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54c2b3-0b43-4be1-9db2-56836f4c143a None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:30.890746 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2193/4390] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:24:30 2022] PUT /identity/v3/projects/e297ade488854410bf06fe5437e3ae64/users/d9d8ddde3fa947fc835cfac09b56cdbf/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:30.896530 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8c54c2b3-0b43-4be1-9db2-56836f4c143a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:30.907141 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efacbd05-8114-4221-b4d9-d0c08ddd8d9f None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:30.907447 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efacbd05-8114-4221-b4d9-d0c08ddd8d9f None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:30.907704 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efacbd05-8114-4221-b4d9-d0c08ddd8d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:30.972285 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-efacbd05-8114-4221-b4d9-d0c08ddd8d9f None None] MFA Rules not processed for user `d9d8ddde3fa947fc835cfac09b56cdbf`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:30.974258 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-efacbd05-8114-4221-b4d9-d0c08ddd8d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:31.000608 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54c2b3-0b43-4be1-9db2-56836f4c143a None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:31.080865 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a29e398-fd45-41ca-bf9b-0b69e27c0f81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:31.082086 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29e398-fd45-41ca-bf9b-0b69e27c0f81 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:31.082377 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29e398-fd45-41ca-bf9b-0b69e27c0f81 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:31.082652 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29e398-fd45-41ca-bf9b-0b69e27c0f81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:31.092784 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2194/4391] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:24:31.097387 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89174662-5c0c-432d-b7be-47ee584d8eb8 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:31.099083 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89174662-5c0c-432d-b7be-47ee584d8eb8 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:31.101119 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89174662-5c0c-432d-b7be-47ee584d8eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:31.149914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-89174662-5c0c-432d-b7be-47ee584d8eb8 None None] MFA Rules not processed for user `17921dea12554204984a990f94a9b354`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:31.151571 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-89174662-5c0c-432d-b7be-47ee584d8eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:31.161434 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a29e398-fd45-41ca-bf9b-0b69e27c0f81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:31.163129 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a29e398-fd45-41ca-bf9b-0b69e27c0f81 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:31.186212 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2198/4392] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:24:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:24:31.187198 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a29e398-fd45-41ca-bf9b-0b69e27c0f81 service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:31.290402 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2195/4393] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:24:31.302844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49899614-8649-4cf2-a473-a73662cfde62 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:31.302844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49899614-8649-4cf2-a473-a73662cfde62 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:31.302844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49899614-8649-4cf2-a473-a73662cfde62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:31.366417 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a29e398-fd45-41ca-bf9b-0b69e27c0f81 service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:31.366996 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-49899614-8649-4cf2-a473-a73662cfde62 None None] MFA Rules not processed for user `17921dea12554204984a990f94a9b354`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:31.368745 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-49899614-8649-4cf2-a473-a73662cfde62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:31.381938 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e09d5-78cd-4739-bdca-357530eda19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:31.387414 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e09d5-78cd-4739-bdca-357530eda19f admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:31.387414 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e09d5-78cd-4739-bdca-357530eda19f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:31.387414 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e09d5-78cd-4739-bdca-357530eda19f admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:31.387414 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e09d5-78cd-4739-bdca-357530eda19f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:31.389589 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2196/4394] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:24:31.392105 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e09d5-78cd-4739-bdca-357530eda19f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:31.501414 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2199/4395] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:24:31 2022] POST /identity/v3/projects => generated 391 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:24:31.503268 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49899614-8649-4cf2-a473-a73662cfde62 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:31.517886 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49899614-8649-4cf2-a473-a73662cfde62 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:31.628009 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583c09d-bee0-41ae-9552-1597d77eea5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:31.628705 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583c09d-bee0-41ae-9552-1597d77eea5e admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:31.629106 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583c09d-bee0-41ae-9552-1597d77eea5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:31.629990 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583c09d-bee0-41ae-9552-1597d77eea5e admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:31.630791 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583c09d-bee0-41ae-9552-1597d77eea5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:31.634188 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583c09d-bee0-41ae-9552-1597d77eea5e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:31.698702 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e09d5-78cd-4739-bdca-357530eda19f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:31.740583 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2197/4396] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:24:31 2022] POST /identity/v3/users => generated 302 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:24:31.744069 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583c09d-bee0-41ae-9552-1597d77eea5e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:31.767264 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583c09d-bee0-41ae-9552-1597d77eea5e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:31.785448 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93fbe7-9c17-43d8-94b8-e0d060f0baed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:31.788432 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93fbe7-9c17-43d8-94b8-e0d060f0baed admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:31.788432 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93fbe7-9c17-43d8-94b8-e0d060f0baed admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:31.788432 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93fbe7-9c17-43d8-94b8-e0d060f0baed admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:31.789151 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc93fbe7-9c17-43d8-94b8-e0d060f0baed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:31.790543 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc93fbe7-9c17-43d8-94b8-e0d060f0baed admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:31.818459 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2198/4397] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:24:31.822336 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93fbe7-9c17-43d8-94b8-e0d060f0baed admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:31.840117 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93fbe7-9c17-43d8-94b8-e0d060f0baed admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:31.850824 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f644be-d6d5-4800-8f6e-a3fb12daad67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:31.851736 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f644be-d6d5-4800-8f6e-a3fb12daad67 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:31.852020 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f644be-d6d5-4800-8f6e-a3fb12daad67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:31.852303 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f644be-d6d5-4800-8f6e-a3fb12daad67 admin admin] PATH_INFO: `/v3/projects/bd060bbbc24843798ba4e710a5a76391/users/ded545ca58e442c9906a6d025a844b2e/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:31.883195 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e09d5-78cd-4739-bdca-357530eda19f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:31.891103 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f644be-d6d5-4800-8f6e-a3fb12daad67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd060bbbc24843798ba4e710a5a76391, user_id=ded545ca58e442c9906a6d025a844b2e, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:31.896724 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f644be-d6d5-4800-8f6e-a3fb12daad67 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:31.899637 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4df384-dcbd-4a64-ba23-0b5b00205859 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:31.900529 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4df384-dcbd-4a64-ba23-0b5b00205859 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:31.900890 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4df384-dcbd-4a64-ba23-0b5b00205859 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:31.901247 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4df384-dcbd-4a64-ba23-0b5b00205859 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:31.978585 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4df384-dcbd-4a64-ba23-0b5b00205859 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:31.982307 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4df384-dcbd-4a64-ba23-0b5b00205859 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:32.009713 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2200/4398] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:24:31 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:24:32.020034 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2199/4399] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:24:31 2022] PUT /identity/v3/projects/bd060bbbc24843798ba4e710a5a76391/users/ded545ca58e442c9906a6d025a844b2e/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:24:32.024147 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4df384-dcbd-4a64-ba23-0b5b00205859 service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:32.047347 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4df384-dcbd-4a64-ba23-0b5b00205859 service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:32.184912 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae08b9b-b0ff-4f2e-ae53-027bc0fe3749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:32.185976 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae08b9b-b0ff-4f2e-ae53-027bc0fe3749 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:32.186499 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae08b9b-b0ff-4f2e-ae53-027bc0fe3749 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:32.186990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae08b9b-b0ff-4f2e-ae53-027bc0fe3749 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:32.188004 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae08b9b-b0ff-4f2e-ae53-027bc0fe3749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:32.190947 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae08b9b-b0ff-4f2e-ae53-027bc0fe3749 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:32.215431 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2201/4400] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:24:32.223792 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f644be-d6d5-4800-8f6e-a3fb12daad67 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:32.240706 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f644be-d6d5-4800-8f6e-a3fb12daad67 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:32.256192 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4686a-b8ce-4087-b843-967bfa9f046b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:32.287383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4686a-b8ce-4087-b843-967bfa9f046b admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:32.287383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4686a-b8ce-4087-b843-967bfa9f046b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:32.287383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4686a-b8ce-4087-b843-967bfa9f046b admin admin] PATH_INFO: `/v3/projects/bd060bbbc24843798ba4e710a5a76391/users/ded545ca58e442c9906a6d025a844b2e/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:32.287383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4686a-b8ce-4087-b843-967bfa9f046b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd060bbbc24843798ba4e710a5a76391, user_id=ded545ca58e442c9906a6d025a844b2e, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:32.287383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4686a-b8ce-4087-b843-967bfa9f046b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:32.302055 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48268a14-d4c6-48de-a3a8-2c8c3c6a1a25 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:32.302218 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2200/4401] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:24:32 2022] PUT /identity/v3/projects/bd060bbbc24843798ba4e710a5a76391/users/ded545ca58e442c9906a6d025a844b2e/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:32.305692 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48268a14-d4c6-48de-a3a8-2c8c3c6a1a25 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:32.305692 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48268a14-d4c6-48de-a3a8-2c8c3c6a1a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:32.349337 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-48268a14-d4c6-48de-a3a8-2c8c3c6a1a25 None None] MFA Rules not processed for user `ded545ca58e442c9906a6d025a844b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:32.352095 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-48268a14-d4c6-48de-a3a8-2c8c3c6a1a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:32.461084 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2202/4402] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:32 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:24:32.463226 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4686a-b8ce-4087-b843-967bfa9f046b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:32.488849 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4686a-b8ce-4087-b843-967bfa9f046b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:32.496469 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c958942-85a7-41de-8860-74861c774a8f tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:32.498331 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c958942-85a7-41de-8860-74861c774a8f tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:32.498331 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c958942-85a7-41de-8860-74861c774a8f tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:32.498617 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c958942-85a7-41de-8860-74861c774a8f tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:32.499493 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c958942-85a7-41de-8860-74861c774a8f tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:32.502798 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c958942-85a7-41de-8860-74861c774a8f tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:32.666830 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2201/4403] 10.222.0.23 () {60 vars in 1148 bytes} [Sat Apr 30 21:24:32 2022] POST /identity/v3/domains => generated 276 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:24:32.671623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48268a14-d4c6-48de-a3a8-2c8c3c6a1a25 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:32.681875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48268a14-d4c6-48de-a3a8-2c8c3c6a1a25 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:32.764395 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67b3dc-82ac-481c-9dbf-3cd5a270b6e0 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:32.764395 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67b3dc-82ac-481c-9dbf-3cd5a270b6e0 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:32.764395 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67b3dc-82ac-481c-9dbf-3cd5a270b6e0 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:32.764712 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67b3dc-82ac-481c-9dbf-3cd5a270b6e0 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/f8070622799b4e29aaba54dcb1ede26f/config` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:32.764712 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f67b3dc-82ac-481c-9dbf-3cd5a270b6e0 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=f8070622799b4e29aaba54dcb1ede26f)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:32.765618 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-7f67b3dc-82ac-481c-9dbf-3cd5a270b6e0 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:24:32.765618 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:24:32.765618 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:24:32.766757 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f67b3dc-82ac-481c-9dbf-3cd5a270b6e0 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:32.902737 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2203/4404] 10.222.0.23 () {60 vars in 1268 bytes} [Sat Apr 30 21:24:32 2022] PUT /identity/v3/domains/f8070622799b4e29aaba54dcb1ede26f/config => generated 138 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:24:32.906188 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c958942-85a7-41de-8860-74861c774a8f tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:32.935065 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c958942-85a7-41de-8860-74861c774a8f tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:32.940787 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b1d21-0b90-4ba2-af34-84263d3bcaf9 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:32.943030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b1d21-0b90-4ba2-af34-84263d3bcaf9 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:32.943538 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b1d21-0b90-4ba2-af34-84263d3bcaf9 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:32.944026 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b1d21-0b90-4ba2-af34-84263d3bcaf9 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/f8070622799b4e29aaba54dcb1ede26f/config/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:32.945793 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b1d21-0b90-4ba2-af34-84263d3bcaf9 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=f8070622799b4e29aaba54dcb1ede26f, group=identity)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:32.948832 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-e73b1d21-0b90-4ba2-af34-84263d3bcaf9 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:24:32.948832 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:24:32.948832 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:24:32.951085 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b1d21-0b90-4ba2-af34-84263d3bcaf9 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:32.967682 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2202/4405] 10.222.0.23 () {58 vars in 1274 bytes} [Sat Apr 30 21:24:32 2022] GET /identity/v3/domains/f8070622799b4e29aaba54dcb1ede26f/config/identity => generated 45 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:24:32.968171 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67b3dc-82ac-481c-9dbf-3cd5a270b6e0 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:32.988479 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67b3dc-82ac-481c-9dbf-3cd5a270b6e0 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:33.014553 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8a843-c9af-4f28-a2b1-3aad496a2487 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:33.015455 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8a843-c9af-4f28-a2b1-3aad496a2487 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:33.015741 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8a843-c9af-4f28-a2b1-3aad496a2487 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:33.016029 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8a843-c9af-4f28-a2b1-3aad496a2487 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/f8070622799b4e29aaba54dcb1ede26f/config/identity/driver` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:33.022750 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b8a843-c9af-4f28-a2b1-3aad496a2487 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=f8070622799b4e29aaba54dcb1ede26f, group=identity, option=driver)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:33.023888 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-e0b8a843-c9af-4f28-a2b1-3aad496a2487 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:24:33.023888 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:24:33.023888 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:24:33.024703 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b8a843-c9af-4f28-a2b1-3aad496a2487 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:33.043596 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2204/4406] 10.222.0.23 () {58 vars in 1295 bytes} [Sat Apr 30 21:24:32 2022] GET /identity/v3/domains/f8070622799b4e29aaba54dcb1ede26f/config/identity/driver => generated 31 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:24:33.045083 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b1d21-0b90-4ba2-af34-84263d3bcaf9 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:33.067006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b1d21-0b90-4ba2-af34-84263d3bcaf9 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:33.071032 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754e501-a8ce-4e82-b4f3-332225bb4c40 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:33.072048 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754e501-a8ce-4e82-b4f3-332225bb4c40 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:33.072401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754e501-a8ce-4e82-b4f3-332225bb4c40 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:33.072756 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754e501-a8ce-4e82-b4f3-332225bb4c40 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/f8070622799b4e29aaba54dcb1ede26f/config/ldap` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:33.074308 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7754e501-a8ce-4e82-b4f3-332225bb4c40 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=f8070622799b4e29aaba54dcb1ede26f, group=ldap)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:33.076608 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7754e501-a8ce-4e82-b4f3-332225bb4c40 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:33.083004 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2203/4407] 10.222.0.23 () {58 vars in 1262 bytes} [Sat Apr 30 21:24:33 2022] GET /identity/v3/domains/f8070622799b4e29aaba54dcb1ede26f/config/ldap => generated 106 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:24:33.087541 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8a843-c9af-4f28-a2b1-3aad496a2487 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:33.101766 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8a843-c9af-4f28-a2b1-3aad496a2487 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:33.117626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82924d36-89ab-424b-a13c-388e00e9325c tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:33.117626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82924d36-89ab-424b-a13c-388e00e9325c tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:33.117626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82924d36-89ab-424b-a13c-388e00e9325c tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:33.118053 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82924d36-89ab-424b-a13c-388e00e9325c tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/f8070622799b4e29aaba54dcb1ede26f/config/ldap/url` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:33.118712 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82924d36-89ab-424b-a13c-388e00e9325c tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=f8070622799b4e29aaba54dcb1ede26f, group=ldap, option=url)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:33.120547 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82924d36-89ab-424b-a13c-388e00e9325c tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:33.137902 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2205/4408] 10.222.0.23 () {58 vars in 1274 bytes} [Sat Apr 30 21:24:33 2022] GET /identity/v3/domains/f8070622799b4e29aaba54dcb1ede26f/config/ldap/url => generated 46 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:24:33.140247 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754e501-a8ce-4e82-b4f3-332225bb4c40 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:33.155567 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754e501-a8ce-4e82-b4f3-332225bb4c40 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:33.162689 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f86e59-90f0-4110-aa61-d2d09b5b5051 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:33.165372 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f86e59-90f0-4110-aa61-d2d09b5b5051 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:33.165941 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f86e59-90f0-4110-aa61-d2d09b5b5051 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:33.166507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f86e59-90f0-4110-aa61-d2d09b5b5051 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/f8070622799b4e29aaba54dcb1ede26f/config/ldap/user_tree_dn` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:33.168165 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f86e59-90f0-4110-aa61-d2d09b5b5051 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=f8070622799b4e29aaba54dcb1ede26f, group=ldap, option=user_tree_dn)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:33.170126 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f86e59-90f0-4110-aa61-d2d09b5b5051 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:33.178320 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2204/4409] 10.222.0.23 () {58 vars in 1301 bytes} [Sat Apr 30 21:24:33 2022] GET /identity/v3/domains/f8070622799b4e29aaba54dcb1ede26f/config/ldap/user_tree_dn => generated 63 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:24:33.182490 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82924d36-89ab-424b-a13c-388e00e9325c tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:33.197700 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82924d36-89ab-424b-a13c-388e00e9325c tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:33.204671 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0dbbd2-ae9f-4298-8a6a-2576c46a4866 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:33.205682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0dbbd2-ae9f-4298-8a6a-2576c46a4866 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:33.209500 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0dbbd2-ae9f-4298-8a6a-2576c46a4866 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:33.209500 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0dbbd2-ae9f-4298-8a6a-2576c46a4866 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/f8070622799b4e29aaba54dcb1ede26f/config` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:33.209500 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0dbbd2-ae9f-4298-8a6a-2576c46a4866 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=f8070622799b4e29aaba54dcb1ede26f)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:33.209500 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-9a0dbbd2-ae9f-4298-8a6a-2576c46a4866 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:24:33.209500 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:24:33.209500 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:24:33.210150 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0dbbd2-ae9f-4298-8a6a-2576c46a4866 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:33.304226 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2206/4410] 10.222.0.23 () {58 vars in 1250 bytes} [Sat Apr 30 21:24:33 2022] DELETE /identity/v3/domains/f8070622799b4e29aaba54dcb1ede26f/config => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:33.309486 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f86e59-90f0-4110-aa61-d2d09b5b5051 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:33.322504 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f86e59-90f0-4110-aa61-d2d09b5b5051 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:33.334307 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb55924-60c7-41e6-80b4-6f775582faca tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:33.335275 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb55924-60c7-41e6-80b4-6f775582faca tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:33.335667 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb55924-60c7-41e6-80b4-6f775582faca tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:33.336047 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb55924-60c7-41e6-80b4-6f775582faca tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/f8070622799b4e29aaba54dcb1ede26f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:33.337889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb55924-60c7-41e6-80b4-6f775582faca tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f8070622799b4e29aaba54dcb1ede26f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:33.339621 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb55924-60c7-41e6-80b4-6f775582faca tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:33.404735 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-feb55924-60c7-41e6-80b4-6f775582faca tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f8070622799b4e29aaba54dcb1ede26f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:33.407262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-feb55924-60c7-41e6-80b4-6f775582faca tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f8070622799b4e29aaba54dcb1ede26f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:33.545045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-feb55924-60c7-41e6-80b4-6f775582faca tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f8070622799b4e29aaba54dcb1ede26f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:33.546490 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-feb55924-60c7-41e6-80b4-6f775582faca tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f8070622799b4e29aaba54dcb1ede26f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:33.556975 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2205/4411] 10.222.0.23 () {60 vars in 1248 bytes} [Sat Apr 30 21:24:33 2022] PATCH /identity/v3/domains/f8070622799b4e29aaba54dcb1ede26f => generated 277 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:24:33.561317 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0dbbd2-ae9f-4298-8a6a-2576c46a4866 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:33.564136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-9a0dbbd2-ae9f-4298-8a6a-2576c46a4866 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:33.586855 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0dbbd2-ae9f-4298-8a6a-2576c46a4866 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:33.670227 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580672f0-e582-4267-bdd0-a6caf94c3110 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:33.671381 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580672f0-e582-4267-bdd0-a6caf94c3110 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:33.672267 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580672f0-e582-4267-bdd0-a6caf94c3110 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:33.672739 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580672f0-e582-4267-bdd0-a6caf94c3110 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/f8070622799b4e29aaba54dcb1ede26f` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:33.690769 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580672f0-e582-4267-bdd0-a6caf94c3110 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f8070622799b4e29aaba54dcb1ede26f)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:33.693187 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580672f0-e582-4267-bdd0-a6caf94c3110 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:33.728580 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-580672f0-e582-4267-bdd0-a6caf94c3110 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f8070622799b4e29aaba54dcb1ede26f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:33.740580 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-580672f0-e582-4267-bdd0-a6caf94c3110 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f8070622799b4e29aaba54dcb1ede26f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:33.942173 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-580672f0-e582-4267-bdd0-a6caf94c3110 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8070622799b4e29aaba54dcb1ede26f', 'request_id': 'req-580672f0-e582-4267-bdd0-a6caf94c3110'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:33.963530 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-580672f0-e582-4267-bdd0-a6caf94c3110 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8070622799b4e29aaba54dcb1ede26f', 'request_id': 'req-580672f0-e582-4267-bdd0-a6caf94c3110'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:33.973897 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-580672f0-e582-4267-bdd0-a6caf94c3110 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8070622799b4e29aaba54dcb1ede26f', 'request_id': 'req-580672f0-e582-4267-bdd0-a6caf94c3110'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:34.082111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-580672f0-e582-4267-bdd0-a6caf94c3110 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] The token cache is being invalidate because project f8070622799b4e29aaba54dcb1ede26f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:24:34.082670 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-580672f0-e582-4267-bdd0-a6caf94c3110 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:34.085270 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-580672f0-e582-4267-bdd0-a6caf94c3110 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:34.134333 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-580672f0-e582-4267-bdd0-a6caf94c3110 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f8070622799b4e29aaba54dcb1ede26f', 'request_id': 'req-580672f0-e582-4267-bdd0-a6caf94c3110'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:34.134333 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-580672f0-e582-4267-bdd0-a6caf94c3110 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f8070622799b4e29aaba54dcb1ede26f', 'request_id': 'req-580672f0-e582-4267-bdd0-a6caf94c3110'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:34.134333 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-580672f0-e582-4267-bdd0-a6caf94c3110 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f8070622799b4e29aaba54dcb1ede26f', 'request_id': 'req-580672f0-e582-4267-bdd0-a6caf94c3110'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:34.164369 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb55924-60c7-41e6-80b4-6f775582faca tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:34.165086 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2207/4412] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:24:33 2022] DELETE /identity/v3/domains/f8070622799b4e29aaba54dcb1ede26f => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:34.195507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb55924-60c7-41e6-80b4-6f775582faca tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:34.338607 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78723dd1-111b-4143-8dd4-7aaed179770d tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:34.340654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78723dd1-111b-4143-8dd4-7aaed179770d tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:34.344207 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78723dd1-111b-4143-8dd4-7aaed179770d tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:34.344637 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78723dd1-111b-4143-8dd4-7aaed179770d tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:34.347508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78723dd1-111b-4143-8dd4-7aaed179770d tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:34.350912 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78723dd1-111b-4143-8dd4-7aaed179770d tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:34.474484 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2206/4413] 10.222.0.23 () {60 vars in 1148 bytes} [Sat Apr 30 21:24:34 2022] POST /identity/v3/domains => generated 276 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:24:34.478152 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580672f0-e582-4267-bdd0-a6caf94c3110 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:34.480162 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-580672f0-e582-4267-bdd0-a6caf94c3110 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:34.504524 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580672f0-e582-4267-bdd0-a6caf94c3110 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:34.592489 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac61893-d2fd-4184-8515-300baf917547 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:34.593348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac61893-d2fd-4184-8515-300baf917547 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:34.593640 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac61893-d2fd-4184-8515-300baf917547 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:34.593990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac61893-d2fd-4184-8515-300baf917547 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/e8e25c483f14465d8c73e79f73563c72/config` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:34.594939 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac61893-d2fd-4184-8515-300baf917547 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=e8e25c483f14465d8c73e79f73563c72)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:34.599278 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac61893-d2fd-4184-8515-300baf917547 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:34.712020 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2208/4414] 10.222.0.23 () {60 vars in 1268 bytes} [Sat Apr 30 21:24:34 2022] PUT /identity/v3/domains/e8e25c483f14465d8c73e79f73563c72/config => generated 138 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:24:34.713906 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78723dd1-111b-4143-8dd4-7aaed179770d tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:34.732427 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78723dd1-111b-4143-8dd4-7aaed179770d tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:34.740029 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81b606-028a-465f-a63c-c02231cd1ad0 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:34.741411 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81b606-028a-465f-a63c-c02231cd1ad0 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:34.742359 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81b606-028a-465f-a63c-c02231cd1ad0 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:34.742863 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81b606-028a-465f-a63c-c02231cd1ad0 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/e8e25c483f14465d8c73e79f73563c72/config` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:34.745175 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d81b606-028a-465f-a63c-c02231cd1ad0 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=e8e25c483f14465d8c73e79f73563c72)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:34.748031 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-0d81b606-028a-465f-a63c-c02231cd1ad0 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:24:34.748031 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:24:34.748031 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:24:34.749500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d81b606-028a-465f-a63c-c02231cd1ad0 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:34.893278 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2207/4415] 10.222.0.23 () {60 vars in 1270 bytes} [Sat Apr 30 21:24:34 2022] PATCH /identity/v3/domains/e8e25c483f14465d8c73e79f73563c72/config => generated 141 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:24:34.897065 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac61893-d2fd-4184-8515-300baf917547 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:34.918633 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac61893-d2fd-4184-8515-300baf917547 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:34.925418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5912f0c-3da5-4c24-b925-945d7918a5dd tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:34.926326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5912f0c-3da5-4c24-b925-945d7918a5dd tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:34.926616 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5912f0c-3da5-4c24-b925-945d7918a5dd tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:34.926931 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5912f0c-3da5-4c24-b925-945d7918a5dd tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/e8e25c483f14465d8c73e79f73563c72/config` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:34.928254 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5912f0c-3da5-4c24-b925-945d7918a5dd tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=e8e25c483f14465d8c73e79f73563c72)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:34.930125 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5912f0c-3da5-4c24-b925-945d7918a5dd tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:34.938986 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2209/4416] 10.222.0.23 () {58 vars in 1247 bytes} [Sat Apr 30 21:24:34 2022] GET /identity/v3/domains/e8e25c483f14465d8c73e79f73563c72/config => generated 141 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:24:34.941006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81b606-028a-465f-a63c-c02231cd1ad0 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:34.954257 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81b606-028a-465f-a63c-c02231cd1ad0 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:34.962053 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ddd134-a3c4-4fa1-b60c-d72dd70419c0 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:34.963217 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddd134-a3c4-4fa1-b60c-d72dd70419c0 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:34.963660 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddd134-a3c4-4fa1-b60c-d72dd70419c0 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:34.964126 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddd134-a3c4-4fa1-b60c-d72dd70419c0 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/e8e25c483f14465d8c73e79f73563c72/config` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:34.965133 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ddd134-a3c4-4fa1-b60c-d72dd70419c0 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=e8e25c483f14465d8c73e79f73563c72)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:34.966400 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-55ddd134-a3c4-4fa1-b60c-d72dd70419c0 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:24:34.966400 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:24:34.966400 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:24:34.967631 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ddd134-a3c4-4fa1-b60c-d72dd70419c0 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:35.077183 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2208/4417] 10.222.0.23 () {58 vars in 1250 bytes} [Sat Apr 30 21:24:34 2022] DELETE /identity/v3/domains/e8e25c483f14465d8c73e79f73563c72/config => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:35.082284 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5912f0c-3da5-4c24-b925-945d7918a5dd tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:35.094024 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5912f0c-3da5-4c24-b925-945d7918a5dd tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:35.102872 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3252d-a23b-419e-a3ca-2bfbb3372b48 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:35.104531 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3252d-a23b-419e-a3ca-2bfbb3372b48 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:35.104894 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3252d-a23b-419e-a3ca-2bfbb3372b48 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:35.105749 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3252d-a23b-419e-a3ca-2bfbb3372b48 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/e8e25c483f14465d8c73e79f73563c72/config` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:35.106823 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b3252d-a23b-419e-a3ca-2bfbb3372b48 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=e8e25c483f14465d8c73e79f73563c72)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:35.109312 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b3252d-a23b-419e-a3ca-2bfbb3372b48 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:35.128258 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-68b3252d-a23b-419e-a3ca-2bfbb3372b48 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Could not find any options in domain configuration for domain e8e25c483f14465d8c73e79f73563c72.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain e8e25c483f14465d8c73e79f73563c72. Apr 30 21:24:35.128258 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:24:35.128258 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:24:35.128258 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:24:35.128258 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:24:35.128258 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:24:35.128258 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:24:35.128258 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:24:35.128258 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:24:35.128258 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:24:35.128258 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:24:35.128258 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:24:35.128258 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Apr 30 21:24:35.129340 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Apr 30 21:24:35.129340 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Apr 30 21:24:35.129340 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Apr 30 21:24:35.129340 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:24:35.129340 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:24:35.129340 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Apr 30 21:24:35.129340 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Apr 30 21:24:35.129340 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain e8e25c483f14465d8c73e79f73563c72. Apr 30 21:24:35.129340 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:24:35.135859 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2210/4418] 10.222.0.23 () {58 vars in 1247 bytes} [Sat Apr 30 21:24:35 2022] GET /identity/v3/domains/e8e25c483f14465d8c73e79f73563c72/config => generated 151 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 30 21:24:35.136830 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ddd134-a3c4-4fa1-b60c-d72dd70419c0 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:35.150467 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ddd134-a3c4-4fa1-b60c-d72dd70419c0 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:35.160882 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59befce0-4fac-474f-8d71-7daa6f10288b tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:35.161899 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59befce0-4fac-474f-8d71-7daa6f10288b tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:35.162307 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59befce0-4fac-474f-8d71-7daa6f10288b tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:35.163025 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59befce0-4fac-474f-8d71-7daa6f10288b tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/e8e25c483f14465d8c73e79f73563c72/config` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:35.166238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59befce0-4fac-474f-8d71-7daa6f10288b tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=e8e25c483f14465d8c73e79f73563c72)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:35.168860 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59befce0-4fac-474f-8d71-7daa6f10288b tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:35.177007 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2209/4419] 10.222.0.23 () {58 vars in 1250 bytes} [Sat Apr 30 21:24:35 2022] DELETE /identity/v3/domains/e8e25c483f14465d8c73e79f73563c72/config => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:35.181200 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3252d-a23b-419e-a3ca-2bfbb3372b48 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:35.196700 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3252d-a23b-419e-a3ca-2bfbb3372b48 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:35.204136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197035a-ba47-4369-957a-1081112473fd tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:35.206005 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197035a-ba47-4369-957a-1081112473fd tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:35.206481 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197035a-ba47-4369-957a-1081112473fd tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:35.206955 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197035a-ba47-4369-957a-1081112473fd tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/e8e25c483f14465d8c73e79f73563c72` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:35.209323 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2197035a-ba47-4369-957a-1081112473fd tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e8e25c483f14465d8c73e79f73563c72)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:35.211266 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2197035a-ba47-4369-957a-1081112473fd tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:35.259729 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2197035a-ba47-4369-957a-1081112473fd tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e8e25c483f14465d8c73e79f73563c72'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:35.266192 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2197035a-ba47-4369-957a-1081112473fd tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e8e25c483f14465d8c73e79f73563c72'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:35.390530 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2197035a-ba47-4369-957a-1081112473fd tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e8e25c483f14465d8c73e79f73563c72'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:35.391569 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2197035a-ba47-4369-957a-1081112473fd tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e8e25c483f14465d8c73e79f73563c72'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:35.404624 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2211/4420] 10.222.0.23 () {60 vars in 1248 bytes} [Sat Apr 30 21:24:35 2022] PATCH /identity/v3/domains/e8e25c483f14465d8c73e79f73563c72 => generated 277 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:24:35.408490 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59befce0-4fac-474f-8d71-7daa6f10288b tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:35.410498 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-59befce0-4fac-474f-8d71-7daa6f10288b tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:35.426420 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59befce0-4fac-474f-8d71-7daa6f10288b tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:35.506953 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3131d-f978-415c-aaf3-827cf31ade4a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:35.507403 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3131d-f978-415c-aaf3-827cf31ade4a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:35.507768 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3131d-f978-415c-aaf3-827cf31ade4a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:35.508125 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3131d-f978-415c-aaf3-827cf31ade4a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/e8e25c483f14465d8c73e79f73563c72` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:35.523590 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3131d-f978-415c-aaf3-827cf31ade4a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e8e25c483f14465d8c73e79f73563c72)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:35.525560 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-36c3131d-f978-415c-aaf3-827cf31ade4a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:24:35.525560 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:24:35.525560 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:24:35.530703 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3131d-f978-415c-aaf3-827cf31ade4a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:35.541385 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4d34f-d579-48e7-a7a1-d7819a4db930 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:35.541789 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4d34f-d579-48e7-a7a1-d7819a4db930 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:35.542186 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4d34f-d579-48e7-a7a1-d7819a4db930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:35.570027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-36c3131d-f978-415c-aaf3-827cf31ade4a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e8e25c483f14465d8c73e79f73563c72'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:35.571235 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-5de4d34f-d579-48e7-a7a1-d7819a4db930 None None] MFA Rules not processed for user `9cc9b55d852942538c3ad8f317dcd73e`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:35.572470 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5de4d34f-d579-48e7-a7a1-d7819a4db930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:35.576496 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-36c3131d-f978-415c-aaf3-827cf31ade4a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e8e25c483f14465d8c73e79f73563c72'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:35.651607 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2212/4421] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:24:35.772424 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-36c3131d-f978-415c-aaf3-827cf31ade4a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8e25c483f14465d8c73e79f73563c72', 'request_id': 'req-36c3131d-f978-415c-aaf3-827cf31ade4a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:35.779920 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-36c3131d-f978-415c-aaf3-827cf31ade4a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8e25c483f14465d8c73e79f73563c72', 'request_id': 'req-36c3131d-f978-415c-aaf3-827cf31ade4a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:35.789276 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-36c3131d-f978-415c-aaf3-827cf31ade4a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8e25c483f14465d8c73e79f73563c72', 'request_id': 'req-36c3131d-f978-415c-aaf3-827cf31ade4a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:35.887485 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-36c3131d-f978-415c-aaf3-827cf31ade4a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] The token cache is being invalidate because project e8e25c483f14465d8c73e79f73563c72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:24:35.887810 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-36c3131d-f978-415c-aaf3-827cf31ade4a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:35.888714 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-36c3131d-f978-415c-aaf3-827cf31ade4a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:35.906587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-36c3131d-f978-415c-aaf3-827cf31ade4a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e8e25c483f14465d8c73e79f73563c72', 'request_id': 'req-36c3131d-f978-415c-aaf3-827cf31ade4a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:35.907549 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-36c3131d-f978-415c-aaf3-827cf31ade4a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e8e25c483f14465d8c73e79f73563c72', 'request_id': 'req-36c3131d-f978-415c-aaf3-827cf31ade4a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:35.915874 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-36c3131d-f978-415c-aaf3-827cf31ade4a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e8e25c483f14465d8c73e79f73563c72', 'request_id': 'req-36c3131d-f978-415c-aaf3-827cf31ade4a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:35.929477 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2210/4422] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:24:35 2022] DELETE /identity/v3/domains/e8e25c483f14465d8c73e79f73563c72 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:35.935027 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4d34f-d579-48e7-a7a1-d7819a4db930 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:35.952961 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4d34f-d579-48e7-a7a1-d7819a4db930 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:36.025206 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3503d5-dece-4ebe-8181-8836f6284e8d tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:36.026343 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3503d5-dece-4ebe-8181-8836f6284e8d tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:36.026847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3503d5-dece-4ebe-8181-8836f6284e8d tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:36.027134 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3503d5-dece-4ebe-8181-8836f6284e8d tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:36.028073 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3503d5-dece-4ebe-8181-8836f6284e8d tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:36.033521 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3503d5-dece-4ebe-8181-8836f6284e8d tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:36.143745 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2213/4423] 10.222.0.23 () {60 vars in 1148 bytes} [Sat Apr 30 21:24:35 2022] POST /identity/v3/domains => generated 277 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:24:36.145670 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3131d-f978-415c-aaf3-827cf31ade4a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:36.148275 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-36c3131d-f978-415c-aaf3-827cf31ade4a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:36.167707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3131d-f978-415c-aaf3-827cf31ade4a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:36.239326 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da9b0d-80d9-4126-bc59-fbb8e798e5e6 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:36.240186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da9b0d-80d9-4126-bc59-fbb8e798e5e6 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:36.240527 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da9b0d-80d9-4126-bc59-fbb8e798e5e6 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:36.240816 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da9b0d-80d9-4126-bc59-fbb8e798e5e6 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/82a53ecdab4a4d98a46cf7903c13d772/config` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:36.241571 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98da9b0d-80d9-4126-bc59-fbb8e798e5e6 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=82a53ecdab4a4d98a46cf7903c13d772)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:36.242640 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-98da9b0d-80d9-4126-bc59-fbb8e798e5e6 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:24:36.242640 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:24:36.242640 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:24:36.243533 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98da9b0d-80d9-4126-bc59-fbb8e798e5e6 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:36.371016 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2211/4424] 10.222.0.23 () {60 vars in 1268 bytes} [Sat Apr 30 21:24:36 2022] PUT /identity/v3/domains/82a53ecdab4a4d98a46cf7903c13d772/config => generated 138 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:24:36.375484 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3503d5-dece-4ebe-8181-8836f6284e8d tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:36.387272 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3503d5-dece-4ebe-8181-8836f6284e8d tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:36.393050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb64dc3-9ee2-43cd-82e0-5864c2658e14 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:36.393532 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb64dc3-9ee2-43cd-82e0-5864c2658e14 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:36.393861 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb64dc3-9ee2-43cd-82e0-5864c2658e14 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:36.394142 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb64dc3-9ee2-43cd-82e0-5864c2658e14 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/82a53ecdab4a4d98a46cf7903c13d772/config/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:36.395155 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb64dc3-9ee2-43cd-82e0-5864c2658e14 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=82a53ecdab4a4d98a46cf7903c13d772, group=identity)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:36.396195 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-7eb64dc3-9ee2-43cd-82e0-5864c2658e14 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:24:36.396195 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:24:36.396195 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:24:36.397236 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb64dc3-9ee2-43cd-82e0-5864c2658e14 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:36.528484 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2214/4425] 10.222.0.23 () {60 vars in 1296 bytes} [Sat Apr 30 21:24:36 2022] PATCH /identity/v3/domains/82a53ecdab4a4d98a46cf7903c13d772/config/identity => generated 177 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:24:36.529702 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da9b0d-80d9-4126-bc59-fbb8e798e5e6 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:36.541592 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da9b0d-80d9-4126-bc59-fbb8e798e5e6 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:36.546919 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a11fcb-0a55-464d-87dd-2457bc1860d0 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:36.550351 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a11fcb-0a55-464d-87dd-2457bc1860d0 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:36.550351 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a11fcb-0a55-464d-87dd-2457bc1860d0 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:36.550351 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a11fcb-0a55-464d-87dd-2457bc1860d0 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/82a53ecdab4a4d98a46cf7903c13d772/config/identity/driver` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:36.550351 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a11fcb-0a55-464d-87dd-2457bc1860d0 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=82a53ecdab4a4d98a46cf7903c13d772, group=identity, option=driver)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:36.550856 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a11fcb-0a55-464d-87dd-2457bc1860d0 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:36.651668 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2212/4426] 10.222.0.23 () {60 vars in 1317 bytes} [Sat Apr 30 21:24:36 2022] PATCH /identity/v3/domains/82a53ecdab4a4d98a46cf7903c13d772/config/identity/driver => generated 175 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:24:36.655591 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb64dc3-9ee2-43cd-82e0-5864c2658e14 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:36.667325 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb64dc3-9ee2-43cd-82e0-5864c2658e14 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:36.674773 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa97f86-664f-4a46-a826-104839523099 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:36.675676 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa97f86-664f-4a46-a826-104839523099 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:36.675963 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa97f86-664f-4a46-a826-104839523099 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:36.676244 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa97f86-664f-4a46-a826-104839523099 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/82a53ecdab4a4d98a46cf7903c13d772/config/identity/driver` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:36.676990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa97f86-664f-4a46-a826-104839523099 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=82a53ecdab4a4d98a46cf7903c13d772, group=identity, option=driver)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:36.679257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa97f86-664f-4a46-a826-104839523099 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:36.830700 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2215/4427] 10.222.0.23 () {58 vars in 1298 bytes} [Sat Apr 30 21:24:36 2022] DELETE /identity/v3/domains/82a53ecdab4a4d98a46cf7903c13d772/config/identity/driver => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:36.835047 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a11fcb-0a55-464d-87dd-2457bc1860d0 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:36.845242 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a11fcb-0a55-464d-87dd-2457bc1860d0 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:36.850530 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6570290-00a4-4896-9ccc-1f27de2119db tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:36.856535 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6570290-00a4-4896-9ccc-1f27de2119db tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:36.856535 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6570290-00a4-4896-9ccc-1f27de2119db tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:36.856535 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6570290-00a4-4896-9ccc-1f27de2119db tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/82a53ecdab4a4d98a46cf7903c13d772/config/identity/driver` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:36.856535 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6570290-00a4-4896-9ccc-1f27de2119db tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=82a53ecdab4a4d98a46cf7903c13d772, group=identity, option=driver)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:36.857063 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6570290-00a4-4896-9ccc-1f27de2119db tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:36.869794 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-d6570290-00a4-4896-9ccc-1f27de2119db tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Could not find option driver in group identity in domain configuration for domain 82a53ecdab4a4d98a46cf7903c13d772.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 82a53ecdab4a4d98a46cf7903c13d772. Apr 30 21:24:36.869794 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:24:36.869794 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:24:36.869794 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:24:36.869794 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:24:36.869794 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:24:36.869794 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:24:36.869794 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:24:36.869794 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:24:36.869794 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:24:36.869794 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:24:36.869794 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:24:36.869794 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Apr 30 21:24:36.870758 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Apr 30 21:24:36.870758 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Apr 30 21:24:36.870758 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Apr 30 21:24:36.870758 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:24:36.870758 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:24:36.870758 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Apr 30 21:24:36.870758 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Apr 30 21:24:36.870758 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 82a53ecdab4a4d98a46cf7903c13d772. Apr 30 21:24:36.870758 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:24:36.871310 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2213/4428] 10.222.0.23 () {58 vars in 1295 bytes} [Sat Apr 30 21:24:36 2022] GET /identity/v3/domains/82a53ecdab4a4d98a46cf7903c13d772/config/identity/driver => generated 171 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 30 21:24:36.875847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa97f86-664f-4a46-a826-104839523099 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:36.890664 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa97f86-664f-4a46-a826-104839523099 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:36.896996 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cacb83-58ce-4bb6-aa4a-b8b26cc623d4 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:36.898102 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cacb83-58ce-4bb6-aa4a-b8b26cc623d4 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:36.898545 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cacb83-58ce-4bb6-aa4a-b8b26cc623d4 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:36.899006 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cacb83-58ce-4bb6-aa4a-b8b26cc623d4 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/82a53ecdab4a4d98a46cf7903c13d772/config/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:36.899824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cacb83-58ce-4bb6-aa4a-b8b26cc623d4 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=82a53ecdab4a4d98a46cf7903c13d772, group=identity)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:36.901598 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cacb83-58ce-4bb6-aa4a-b8b26cc623d4 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:36.967226 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2216/4429] 10.222.0.23 () {58 vars in 1277 bytes} [Sat Apr 30 21:24:36 2022] DELETE /identity/v3/domains/82a53ecdab4a4d98a46cf7903c13d772/config/identity => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:36.972297 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6570290-00a4-4896-9ccc-1f27de2119db tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:36.983761 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6570290-00a4-4896-9ccc-1f27de2119db tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:36.990087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42430a92-3f24-4ae3-ac50-5f2774352195 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:36.990985 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42430a92-3f24-4ae3-ac50-5f2774352195 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:36.991270 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42430a92-3f24-4ae3-ac50-5f2774352195 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:36.991563 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42430a92-3f24-4ae3-ac50-5f2774352195 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/82a53ecdab4a4d98a46cf7903c13d772/config/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:36.992874 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42430a92-3f24-4ae3-ac50-5f2774352195 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=82a53ecdab4a4d98a46cf7903c13d772, group=identity)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:36.995475 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42430a92-3f24-4ae3-ac50-5f2774352195 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:37.010956 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-42430a92-3f24-4ae3-ac50-5f2774352195 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Could not find group identity in domain configuration for domain 82a53ecdab4a4d98a46cf7903c13d772.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 82a53ecdab4a4d98a46cf7903c13d772. Apr 30 21:24:37.010956 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:24:37.010956 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:24:37.010956 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:24:37.010956 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:24:37.010956 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:24:37.010956 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:24:37.010956 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:24:37.010956 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:24:37.010956 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:24:37.010956 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:24:37.010956 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:24:37.010956 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Apr 30 21:24:37.011916 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Apr 30 21:24:37.011916 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Apr 30 21:24:37.011916 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Apr 30 21:24:37.011916 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:24:37.011916 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:24:37.011916 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Apr 30 21:24:37.011916 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Apr 30 21:24:37.011916 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 82a53ecdab4a4d98a46cf7903c13d772. Apr 30 21:24:37.011916 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:24:37.018793 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cacb83-58ce-4bb6-aa4a-b8b26cc623d4 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:37.019247 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2214/4430] 10.222.0.23 () {58 vars in 1274 bytes} [Sat Apr 30 21:24:36 2022] GET /identity/v3/domains/82a53ecdab4a4d98a46cf7903c13d772/config/identity => generated 154 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 30 21:24:37.029418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cacb83-58ce-4bb6-aa4a-b8b26cc623d4 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:37.035407 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af169e1d-8541-446f-9e24-84ca91447611 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:37.036425 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af169e1d-8541-446f-9e24-84ca91447611 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:37.036862 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af169e1d-8541-446f-9e24-84ca91447611 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:37.037286 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af169e1d-8541-446f-9e24-84ca91447611 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/82a53ecdab4a4d98a46cf7903c13d772/config` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:37.038209 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af169e1d-8541-446f-9e24-84ca91447611 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=82a53ecdab4a4d98a46cf7903c13d772)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:37.040283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af169e1d-8541-446f-9e24-84ca91447611 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:37.115489 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2217/4431] 10.222.0.23 () {58 vars in 1250 bytes} [Sat Apr 30 21:24:37 2022] DELETE /identity/v3/domains/82a53ecdab4a4d98a46cf7903c13d772/config => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:37.121174 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42430a92-3f24-4ae3-ac50-5f2774352195 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:37.136549 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42430a92-3f24-4ae3-ac50-5f2774352195 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:37.142632 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801f63b-2519-4b5e-b13c-39c611592e3f tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:37.143636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801f63b-2519-4b5e-b13c-39c611592e3f tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:37.143945 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801f63b-2519-4b5e-b13c-39c611592e3f tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:37.144331 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801f63b-2519-4b5e-b13c-39c611592e3f tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/82a53ecdab4a4d98a46cf7903c13d772` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:37.146049 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8801f63b-2519-4b5e-b13c-39c611592e3f tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=82a53ecdab4a4d98a46cf7903c13d772)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:37.148444 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8801f63b-2519-4b5e-b13c-39c611592e3f tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:37.169750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8801f63b-2519-4b5e-b13c-39c611592e3f tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '82a53ecdab4a4d98a46cf7903c13d772'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:37.170883 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8801f63b-2519-4b5e-b13c-39c611592e3f tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '82a53ecdab4a4d98a46cf7903c13d772'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:37.359917 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8801f63b-2519-4b5e-b13c-39c611592e3f tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '82a53ecdab4a4d98a46cf7903c13d772'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:37.360843 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8801f63b-2519-4b5e-b13c-39c611592e3f tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '82a53ecdab4a4d98a46cf7903c13d772'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:37.365184 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2215/4432] 10.222.0.23 () {60 vars in 1248 bytes} [Sat Apr 30 21:24:37 2022] PATCH /identity/v3/domains/82a53ecdab4a4d98a46cf7903c13d772 => generated 278 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:24:37.370401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af169e1d-8541-446f-9e24-84ca91447611 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:37.372261 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-af169e1d-8541-446f-9e24-84ca91447611 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:37.400580 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af169e1d-8541-446f-9e24-84ca91447611 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:37.515771 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3c933-3f63-4e41-9cf9-1d64064c7b90 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:37.516811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3c933-3f63-4e41-9cf9-1d64064c7b90 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:37.518010 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3c933-3f63-4e41-9cf9-1d64064c7b90 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:37.518248 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3c933-3f63-4e41-9cf9-1d64064c7b90 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/82a53ecdab4a4d98a46cf7903c13d772` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:37.550098 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3c933-3f63-4e41-9cf9-1d64064c7b90 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=82a53ecdab4a4d98a46cf7903c13d772)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:37.551776 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3c933-3f63-4e41-9cf9-1d64064c7b90 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:37.588313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2cd3c933-3f63-4e41-9cf9-1d64064c7b90 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '82a53ecdab4a4d98a46cf7903c13d772'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:37.593697 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2cd3c933-3f63-4e41-9cf9-1d64064c7b90 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '82a53ecdab4a4d98a46cf7903c13d772'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:37.737024 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2cd3c933-3f63-4e41-9cf9-1d64064c7b90 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82a53ecdab4a4d98a46cf7903c13d772', 'request_id': 'req-2cd3c933-3f63-4e41-9cf9-1d64064c7b90'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:37.743311 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2cd3c933-3f63-4e41-9cf9-1d64064c7b90 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82a53ecdab4a4d98a46cf7903c13d772', 'request_id': 'req-2cd3c933-3f63-4e41-9cf9-1d64064c7b90'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:37.750949 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2cd3c933-3f63-4e41-9cf9-1d64064c7b90 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82a53ecdab4a4d98a46cf7903c13d772', 'request_id': 'req-2cd3c933-3f63-4e41-9cf9-1d64064c7b90'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:37.852107 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2cd3c933-3f63-4e41-9cf9-1d64064c7b90 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] The token cache is being invalidate because project 82a53ecdab4a4d98a46cf7903c13d772 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:24:37.852905 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2cd3c933-3f63-4e41-9cf9-1d64064c7b90 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:37.853729 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2cd3c933-3f63-4e41-9cf9-1d64064c7b90 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:37.862107 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2cd3c933-3f63-4e41-9cf9-1d64064c7b90 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '82a53ecdab4a4d98a46cf7903c13d772', 'request_id': 'req-2cd3c933-3f63-4e41-9cf9-1d64064c7b90'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:37.862847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2cd3c933-3f63-4e41-9cf9-1d64064c7b90 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '82a53ecdab4a4d98a46cf7903c13d772', 'request_id': 'req-2cd3c933-3f63-4e41-9cf9-1d64064c7b90'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:37.863546 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2cd3c933-3f63-4e41-9cf9-1d64064c7b90 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '82a53ecdab4a4d98a46cf7903c13d772', 'request_id': 'req-2cd3c933-3f63-4e41-9cf9-1d64064c7b90'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:37.874048 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2218/4433] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:24:37 2022] DELETE /identity/v3/domains/82a53ecdab4a4d98a46cf7903c13d772 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:37.877445 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801f63b-2519-4b5e-b13c-39c611592e3f tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:37.887521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801f63b-2519-4b5e-b13c-39c611592e3f tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:37.992972 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33930017-8f79-4279-a67a-b81fffaf5644 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:37.993993 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33930017-8f79-4279-a67a-b81fffaf5644 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:37.994519 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33930017-8f79-4279-a67a-b81fffaf5644 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:37.995023 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33930017-8f79-4279-a67a-b81fffaf5644 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:37.995871 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33930017-8f79-4279-a67a-b81fffaf5644 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:37.997216 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-33930017-8f79-4279-a67a-b81fffaf5644 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:24:37.997216 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:24:37.997216 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:24:37.998736 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33930017-8f79-4279-a67a-b81fffaf5644 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:38.006512 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2216/4434] 10.222.0.23 () {58 vars in 1172 bytes} [Sat Apr 30 21:24:37 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:24:38.009537 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3c933-3f63-4e41-9cf9-1d64064c7b90 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:38.011418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2cd3c933-3f63-4e41-9cf9-1d64064c7b90 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:38.024910 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3c933-3f63-4e41-9cf9-1d64064c7b90 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:38.031099 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff24054-ae2c-46c6-beb8-1e6241a0dc1c tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:38.031986 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff24054-ae2c-46c6-beb8-1e6241a0dc1c tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:38.032326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff24054-ae2c-46c6-beb8-1e6241a0dc1c tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:38.032692 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff24054-ae2c-46c6-beb8-1e6241a0dc1c tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:38.034003 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff24054-ae2c-46c6-beb8-1e6241a0dc1c tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:38.035099 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-8ff24054-ae2c-46c6-beb8-1e6241a0dc1c tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:24:38.035099 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:24:38.035099 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:24:38.036196 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff24054-ae2c-46c6-beb8-1e6241a0dc1c tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:38.037698 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2219/4435] 10.222.0.23 () {58 vars in 1199 bytes} [Sat Apr 30 21:24:38 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Apr 30 21:24:38.041616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33930017-8f79-4279-a67a-b81fffaf5644 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:38.052379 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33930017-8f79-4279-a67a-b81fffaf5644 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:38.059538 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31a257-ace4-4554-a350-627ec576cf3f tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:38.060571 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31a257-ace4-4554-a350-627ec576cf3f tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:38.061343 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31a257-ace4-4554-a350-627ec576cf3f tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:38.061936 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31a257-ace4-4554-a350-627ec576cf3f tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:38.062841 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa31a257-ace4-4554-a350-627ec576cf3f tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:38.065157 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa31a257-ace4-4554-a350-627ec576cf3f tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:38.069487 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2217/4436] 10.222.0.23 () {58 vars in 1220 bytes} [Sat Apr 30 21:24:38 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:24:38.070753 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff24054-ae2c-46c6-beb8-1e6241a0dc1c tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:38.082748 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff24054-ae2c-46c6-beb8-1e6241a0dc1c tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:38.087979 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0503fa7-4b52-4a8a-8637-b7b4c6c8d433 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:38.088995 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0503fa7-4b52-4a8a-8637-b7b4c6c8d433 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:38.089459 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0503fa7-4b52-4a8a-8637-b7b4c6c8d433 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:38.089941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0503fa7-4b52-4a8a-8637-b7b4c6c8d433 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:38.090776 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0503fa7-4b52-4a8a-8637-b7b4c6c8d433 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:38.094706 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0503fa7-4b52-4a8a-8637-b7b4c6c8d433 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:38.097443 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2220/4437] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:24:38 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:24:38.101180 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31a257-ace4-4554-a350-627ec576cf3f tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:38.110325 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31a257-ace4-4554-a350-627ec576cf3f tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:38.117014 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f4e68-99bb-4334-9f8f-d3cbb0d805a4 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:38.118014 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f4e68-99bb-4334-9f8f-d3cbb0d805a4 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:38.118425 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f4e68-99bb-4334-9f8f-d3cbb0d805a4 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:38.118887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f4e68-99bb-4334-9f8f-d3cbb0d805a4 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:38.120042 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f4e68-99bb-4334-9f8f-d3cbb0d805a4 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:38.122098 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f4e68-99bb-4334-9f8f-d3cbb0d805a4 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:38.123773 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2218/4438] 10.222.0.23 () {58 vars in 1187 bytes} [Sat Apr 30 21:24:38 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:24:38.128031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0503fa7-4b52-4a8a-8637-b7b4c6c8d433 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:38.139341 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0503fa7-4b52-4a8a-8637-b7b4c6c8d433 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:38.149928 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bfeb06-82c1-4b0b-994d-713d1bbe7f13 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:38.150810 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfeb06-82c1-4b0b-994d-713d1bbe7f13 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:38.151486 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfeb06-82c1-4b0b-994d-713d1bbe7f13 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:38.151486 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfeb06-82c1-4b0b-994d-713d1bbe7f13 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:38.152196 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bfeb06-82c1-4b0b-994d-713d1bbe7f13 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:38.154240 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bfeb06-82c1-4b0b-994d-713d1bbe7f13 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:38.158420 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2221/4439] 10.222.0.23 () {58 vars in 1199 bytes} [Sat Apr 30 21:24:38 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:24:38.160610 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f4e68-99bb-4334-9f8f-d3cbb0d805a4 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:38.170696 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f4e68-99bb-4334-9f8f-d3cbb0d805a4 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:38.176682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c861576-4863-42ee-a5d0-f7b1122bad83 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:38.182988 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c861576-4863-42ee-a5d0-f7b1122bad83 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:38.183808 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c861576-4863-42ee-a5d0-f7b1122bad83 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:38.183808 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c861576-4863-42ee-a5d0-f7b1122bad83 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:38.184514 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c861576-4863-42ee-a5d0-f7b1122bad83 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:38.186494 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c861576-4863-42ee-a5d0-f7b1122bad83 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:38.191840 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2219/4440] 10.222.0.23 () {58 vars in 1202 bytes} [Sat Apr 30 21:24:38 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:24:38.193040 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bfeb06-82c1-4b0b-994d-713d1bbe7f13 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:38.206171 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bfeb06-82c1-4b0b-994d-713d1bbe7f13 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:38.212057 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c575e7-945f-4ac8-abd3-457fb3812237 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:38.212923 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c575e7-945f-4ac8-abd3-457fb3812237 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:38.213278 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c575e7-945f-4ac8-abd3-457fb3812237 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:38.213656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c575e7-945f-4ac8-abd3-457fb3812237 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:38.214437 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c575e7-945f-4ac8-abd3-457fb3812237 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:38.216116 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c575e7-945f-4ac8-abd3-457fb3812237 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:38.217487 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2222/4441] 10.222.0.23 () {58 vars in 1208 bytes} [Sat Apr 30 21:24:38 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:24:38.222827 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c861576-4863-42ee-a5d0-f7b1122bad83 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:38.233920 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c861576-4863-42ee-a5d0-f7b1122bad83 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:38.242916 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697197ba-ef2b-4a40-b3e9-5bbc3b4b5ee1 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:38.244210 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697197ba-ef2b-4a40-b3e9-5bbc3b4b5ee1 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:38.246437 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697197ba-ef2b-4a40-b3e9-5bbc3b4b5ee1 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:38.246835 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697197ba-ef2b-4a40-b3e9-5bbc3b4b5ee1 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:38.249518 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697197ba-ef2b-4a40-b3e9-5bbc3b4b5ee1 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:38.254400 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697197ba-ef2b-4a40-b3e9-5bbc3b4b5ee1 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:38.256109 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2220/4442] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:24:38 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:24:38.259793 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c575e7-945f-4ac8-abd3-457fb3812237 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:38.272901 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c575e7-945f-4ac8-abd3-457fb3812237 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:38.289019 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4fe6c2-5b64-492e-aa98-641fa7c0f127 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:38.289846 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fe6c2-5b64-492e-aa98-641fa7c0f127 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:38.290142 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fe6c2-5b64-492e-aa98-641fa7c0f127 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:38.290401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fe6c2-5b64-492e-aa98-641fa7c0f127 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:38.291224 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4fe6c2-5b64-492e-aa98-641fa7c0f127 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:38.292988 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4fe6c2-5b64-492e-aa98-641fa7c0f127 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:38.297843 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2223/4443] 10.222.0.23 () {58 vars in 1217 bytes} [Sat Apr 30 21:24:38 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:24:38.299535 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697197ba-ef2b-4a40-b3e9-5bbc3b4b5ee1 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:38.310694 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697197ba-ef2b-4a40-b3e9-5bbc3b4b5ee1 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:38.317907 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ecc1a6-e879-465e-b419-33546b702b11 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:38.317907 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecc1a6-e879-465e-b419-33546b702b11 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:38.317907 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecc1a6-e879-465e-b419-33546b702b11 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:38.318223 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecc1a6-e879-465e-b419-33546b702b11 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:38.318330 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ecc1a6-e879-465e-b419-33546b702b11 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:38.320173 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ecc1a6-e879-465e-b419-33546b702b11 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:38.321546 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2221/4444] 10.222.0.23 () {58 vars in 1247 bytes} [Sat Apr 30 21:24:38 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Apr 30 21:24:38.325503 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4fe6c2-5b64-492e-aa98-641fa7c0f127 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:38.336462 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4fe6c2-5b64-492e-aa98-641fa7c0f127 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:38.342597 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceddde6-0d97-4b69-bb96-7b97e2f9c51a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:38.343611 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceddde6-0d97-4b69-bb96-7b97e2f9c51a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:38.343899 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceddde6-0d97-4b69-bb96-7b97e2f9c51a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:38.344176 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceddde6-0d97-4b69-bb96-7b97e2f9c51a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:38.345004 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceddde6-0d97-4b69-bb96-7b97e2f9c51a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:38.347275 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceddde6-0d97-4b69-bb96-7b97e2f9c51a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:38.349155 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2224/4445] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:24:38 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Apr 30 21:24:38.353242 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ecc1a6-e879-465e-b419-33546b702b11 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:38.365034 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ecc1a6-e879-465e-b419-33546b702b11 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:38.370577 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e7455-da21-4653-a7cf-34e2c5170fc4 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:38.371682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e7455-da21-4653-a7cf-34e2c5170fc4 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:38.372213 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e7455-da21-4653-a7cf-34e2c5170fc4 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:38.372682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e7455-da21-4653-a7cf-34e2c5170fc4 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:38.373668 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248e7455-da21-4653-a7cf-34e2c5170fc4 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:38.375591 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248e7455-da21-4653-a7cf-34e2c5170fc4 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:38.378527 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2222/4446] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:24:38 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:24:38.382466 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceddde6-0d97-4b69-bb96-7b97e2f9c51a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:38.403437 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceddde6-0d97-4b69-bb96-7b97e2f9c51a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:38.427600 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9842b9-fc7a-427d-ace3-611a46352ffc tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:38.428411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9842b9-fc7a-427d-ace3-611a46352ffc tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:38.428696 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9842b9-fc7a-427d-ace3-611a46352ffc tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:38.428974 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9842b9-fc7a-427d-ace3-611a46352ffc tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:38.429664 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9842b9-fc7a-427d-ace3-611a46352ffc tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:38.431412 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9842b9-fc7a-427d-ace3-611a46352ffc tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:38.432665 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2225/4447] 10.222.0.23 () {58 vars in 1226 bytes} [Sat Apr 30 21:24:38 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:24:38.436783 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e7455-da21-4653-a7cf-34e2c5170fc4 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:38.450330 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e7455-da21-4653-a7cf-34e2c5170fc4 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:38.460665 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec8297-b1e6-4b53-950e-119df15ced07 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:38.462314 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec8297-b1e6-4b53-950e-119df15ced07 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:38.463535 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec8297-b1e6-4b53-950e-119df15ced07 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:38.464909 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec8297-b1e6-4b53-950e-119df15ced07 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:38.466476 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ec8297-b1e6-4b53-950e-119df15ced07 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:38.468480 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ec8297-b1e6-4b53-950e-119df15ced07 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:38.473067 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2223/4448] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:24:38 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Apr 30 21:24:38.474211 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9842b9-fc7a-427d-ace3-611a46352ffc tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:38.484230 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9842b9-fc7a-427d-ace3-611a46352ffc tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:38.489375 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07deaa32-f53f-48d5-85b3-38bda4ed54bc tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:38.490197 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07deaa32-f53f-48d5-85b3-38bda4ed54bc tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:38.490482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07deaa32-f53f-48d5-85b3-38bda4ed54bc tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:38.490766 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07deaa32-f53f-48d5-85b3-38bda4ed54bc tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:38.491421 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07deaa32-f53f-48d5-85b3-38bda4ed54bc tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:38.493042 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07deaa32-f53f-48d5-85b3-38bda4ed54bc tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:38.494334 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2226/4449] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:24:38 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:24:38.498777 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec8297-b1e6-4b53-950e-119df15ced07 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:38.510871 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec8297-b1e6-4b53-950e-119df15ced07 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:38.516361 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdab12a-7cb1-4cb1-9add-beec01c70553 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:38.517460 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdab12a-7cb1-4cb1-9add-beec01c70553 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:38.524653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdab12a-7cb1-4cb1-9add-beec01c70553 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:38.524653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdab12a-7cb1-4cb1-9add-beec01c70553 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:38.524653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdab12a-7cb1-4cb1-9add-beec01c70553 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:38.524653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdab12a-7cb1-4cb1-9add-beec01c70553 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:38.524653 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2224/4450] 10.222.0.23 () {58 vars in 1241 bytes} [Sat Apr 30 21:24:38 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Apr 30 21:24:38.526159 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07deaa32-f53f-48d5-85b3-38bda4ed54bc tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:38.538442 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07deaa32-f53f-48d5-85b3-38bda4ed54bc tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:38.547720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d348ab61-bf5a-46b4-890f-488eb32c43bb tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:38.549224 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348ab61-bf5a-46b4-890f-488eb32c43bb tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:38.549611 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348ab61-bf5a-46b4-890f-488eb32c43bb tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:38.550026 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348ab61-bf5a-46b4-890f-488eb32c43bb tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:38.550860 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d348ab61-bf5a-46b4-890f-488eb32c43bb tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:38.552708 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d348ab61-bf5a-46b4-890f-488eb32c43bb tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:38.556221 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2227/4451] 10.222.0.23 () {58 vars in 1247 bytes} [Sat Apr 30 21:24:38 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:24:38.558758 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdab12a-7cb1-4cb1-9add-beec01c70553 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:38.572106 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdab12a-7cb1-4cb1-9add-beec01c70553 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:38.578139 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abadd339-f89f-472a-bda7-2b98318a5f0c tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:38.579262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abadd339-f89f-472a-bda7-2b98318a5f0c tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:38.580383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abadd339-f89f-472a-bda7-2b98318a5f0c tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:38.580774 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abadd339-f89f-472a-bda7-2b98318a5f0c tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:38.581571 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abadd339-f89f-472a-bda7-2b98318a5f0c tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:38.583379 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abadd339-f89f-472a-bda7-2b98318a5f0c tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:38.585149 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2225/4452] 10.222.0.23 () {58 vars in 1247 bytes} [Sat Apr 30 21:24:38 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:24:38.589591 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d348ab61-bf5a-46b4-890f-488eb32c43bb tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:38.606164 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d348ab61-bf5a-46b4-890f-488eb32c43bb tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:38.613115 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b389c-60b9-4e53-988d-3e82589db5ee tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:38.614355 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b389c-60b9-4e53-988d-3e82589db5ee tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:38.614883 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b389c-60b9-4e53-988d-3e82589db5ee tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:38.615413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b389c-60b9-4e53-988d-3e82589db5ee tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:38.616291 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b389c-60b9-4e53-988d-3e82589db5ee tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:38.618342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b389c-60b9-4e53-988d-3e82589db5ee tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:38.620204 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2228/4453] 10.222.0.23 () {58 vars in 1268 bytes} [Sat Apr 30 21:24:38 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:24:38.626599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abadd339-f89f-472a-bda7-2b98318a5f0c tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:38.640912 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abadd339-f89f-472a-bda7-2b98318a5f0c tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:38.647268 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3daa10a-6ac5-4d78-9d07-aebdf481d4c0 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:38.648349 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3daa10a-6ac5-4d78-9d07-aebdf481d4c0 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:38.648834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3daa10a-6ac5-4d78-9d07-aebdf481d4c0 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:38.649475 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3daa10a-6ac5-4d78-9d07-aebdf481d4c0 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:38.650400 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3daa10a-6ac5-4d78-9d07-aebdf481d4c0 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:38.652221 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3daa10a-6ac5-4d78-9d07-aebdf481d4c0 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:38.653955 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2226/4454] 10.222.0.23 () {58 vars in 1247 bytes} [Sat Apr 30 21:24:38 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:24:38.658810 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b389c-60b9-4e53-988d-3e82589db5ee tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:38.674199 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b389c-60b9-4e53-988d-3e82589db5ee tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:38.681929 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6c8d5-af93-4b8e-bc8a-18ba55434b08 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:38.682960 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6c8d5-af93-4b8e-bc8a-18ba55434b08 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:38.683346 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6c8d5-af93-4b8e-bc8a-18ba55434b08 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:38.683727 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6c8d5-af93-4b8e-bc8a-18ba55434b08 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:38.685200 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6c8d5-af93-4b8e-bc8a-18ba55434b08 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:38.687673 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6c8d5-af93-4b8e-bc8a-18ba55434b08 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:38.691538 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2229/4455] 10.222.0.23 () {58 vars in 1256 bytes} [Sat Apr 30 21:24:38 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:24:38.695957 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3daa10a-6ac5-4d78-9d07-aebdf481d4c0 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:38.707824 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3daa10a-6ac5-4d78-9d07-aebdf481d4c0 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:38.712815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f732a6-bd0d-4a5a-8ffb-d2f3b1d49e08 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:38.713617 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f732a6-bd0d-4a5a-8ffb-d2f3b1d49e08 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:38.713934 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f732a6-bd0d-4a5a-8ffb-d2f3b1d49e08 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:38.714210 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f732a6-bd0d-4a5a-8ffb-d2f3b1d49e08 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:38.715162 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f732a6-bd0d-4a5a-8ffb-d2f3b1d49e08 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:38.716470 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f732a6-bd0d-4a5a-8ffb-d2f3b1d49e08 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:38.721821 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2227/4456] 10.222.0.23 () {58 vars in 1247 bytes} [Sat Apr 30 21:24:38 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:24:38.723518 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6c8d5-af93-4b8e-bc8a-18ba55434b08 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:38.737896 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6c8d5-af93-4b8e-bc8a-18ba55434b08 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:38.752487 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7b9fc-92d4-44f5-be5c-bd3de57e70c1 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:38.752487 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7b9fc-92d4-44f5-be5c-bd3de57e70c1 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:38.752928 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7b9fc-92d4-44f5-be5c-bd3de57e70c1 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:38.753146 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7b9fc-92d4-44f5-be5c-bd3de57e70c1 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:38.753923 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7b9fc-92d4-44f5-be5c-bd3de57e70c1 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:38.755684 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7b9fc-92d4-44f5-be5c-bd3de57e70c1 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:38.760013 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2230/4457] 10.222.0.23 () {58 vars in 1241 bytes} [Sat Apr 30 21:24:38 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:24:38.762434 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f732a6-bd0d-4a5a-8ffb-d2f3b1d49e08 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:38.775462 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f732a6-bd0d-4a5a-8ffb-d2f3b1d49e08 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:38.781998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc1f901-7a8a-46d6-be0a-3f5c0d74720b tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:38.783632 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1f901-7a8a-46d6-be0a-3f5c0d74720b tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:38.785366 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1f901-7a8a-46d6-be0a-3f5c0d74720b tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:38.785366 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1f901-7a8a-46d6-be0a-3f5c0d74720b tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:38.785366 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc1f901-7a8a-46d6-be0a-3f5c0d74720b tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:38.787321 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc1f901-7a8a-46d6-be0a-3f5c0d74720b tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:38.789806 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2228/4458] 10.222.0.23 () {58 vars in 1250 bytes} [Sat Apr 30 21:24:38 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:24:38.792953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7b9fc-92d4-44f5-be5c-bd3de57e70c1 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:38.807847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7b9fc-92d4-44f5-be5c-bd3de57e70c1 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:38.813506 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e4ca1-6436-491c-86cf-4045cfff1e66 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:38.814978 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e4ca1-6436-491c-86cf-4045cfff1e66 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:38.815336 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e4ca1-6436-491c-86cf-4045cfff1e66 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:38.815544 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e4ca1-6436-491c-86cf-4045cfff1e66 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:38.816255 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e4ca1-6436-491c-86cf-4045cfff1e66 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:38.818916 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e4ca1-6436-491c-86cf-4045cfff1e66 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:38.824157 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2231/4459] 10.222.0.23 () {58 vars in 1253 bytes} [Sat Apr 30 21:24:38 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:24:38.825053 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc1f901-7a8a-46d6-be0a-3f5c0d74720b tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:38.836163 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc1f901-7a8a-46d6-be0a-3f5c0d74720b tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:38.841500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf42b8c-33ea-49bb-8570-825b3166967a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:38.842462 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf42b8c-33ea-49bb-8570-825b3166967a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:38.842813 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf42b8c-33ea-49bb-8570-825b3166967a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:38.843713 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf42b8c-33ea-49bb-8570-825b3166967a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:38.844381 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf42b8c-33ea-49bb-8570-825b3166967a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:38.846768 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf42b8c-33ea-49bb-8570-825b3166967a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:38.847962 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2229/4460] 10.222.0.23 () {58 vars in 1289 bytes} [Sat Apr 30 21:24:38 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Apr 30 21:24:38.853124 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e4ca1-6436-491c-86cf-4045cfff1e66 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:38.865330 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e4ca1-6436-491c-86cf-4045cfff1e66 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:38.870759 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e55fa9-2bd2-46dc-8ffe-b8706f2296d5 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:38.877051 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e55fa9-2bd2-46dc-8ffe-b8706f2296d5 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:38.877051 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e55fa9-2bd2-46dc-8ffe-b8706f2296d5 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:38.877051 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e55fa9-2bd2-46dc-8ffe-b8706f2296d5 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:38.877051 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e55fa9-2bd2-46dc-8ffe-b8706f2296d5 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:38.877424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e55fa9-2bd2-46dc-8ffe-b8706f2296d5 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:38.877424 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2232/4461] 10.222.0.23 () {58 vars in 1256 bytes} [Sat Apr 30 21:24:38 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:24:38.879983 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf42b8c-33ea-49bb-8570-825b3166967a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:38.891016 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf42b8c-33ea-49bb-8570-825b3166967a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:38.895929 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d590e-2671-4efa-a6e0-a4de4973fb8b tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:38.896753 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d590e-2671-4efa-a6e0-a4de4973fb8b tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:38.897040 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d590e-2671-4efa-a6e0-a4de4973fb8b tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:38.897300 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d590e-2671-4efa-a6e0-a4de4973fb8b tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:38.898035 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d590e-2671-4efa-a6e0-a4de4973fb8b tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:38.899684 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d590e-2671-4efa-a6e0-a4de4973fb8b tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:38.901817 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2230/4462] 10.222.0.23 () {58 vars in 1265 bytes} [Sat Apr 30 21:24:38 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:24:38.912053 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e55fa9-2bd2-46dc-8ffe-b8706f2296d5 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:38.931623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e55fa9-2bd2-46dc-8ffe-b8706f2296d5 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:38.938485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3127f1-8c46-4cd4-af6c-514ec83b814e tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:38.939368 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3127f1-8c46-4cd4-af6c-514ec83b814e tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:38.941796 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3127f1-8c46-4cd4-af6c-514ec83b814e tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:38.942152 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3127f1-8c46-4cd4-af6c-514ec83b814e tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:38.943565 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3127f1-8c46-4cd4-af6c-514ec83b814e tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:38.945298 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3127f1-8c46-4cd4-af6c-514ec83b814e tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:38.946832 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2233/4463] 10.222.0.23 () {58 vars in 1307 bytes} [Sat Apr 30 21:24:38 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:24:38.952146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d590e-2671-4efa-a6e0-a4de4973fb8b tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:38.979579 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d590e-2671-4efa-a6e0-a4de4973fb8b tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:38.992112 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4363a3f-7e51-47fd-8402-ef3554211a67 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:38.992112 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4363a3f-7e51-47fd-8402-ef3554211a67 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:38.992112 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4363a3f-7e51-47fd-8402-ef3554211a67 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:38.992546 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4363a3f-7e51-47fd-8402-ef3554211a67 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:38.992939 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4363a3f-7e51-47fd-8402-ef3554211a67 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:38.995198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4363a3f-7e51-47fd-8402-ef3554211a67 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:38.996674 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2231/4464] 10.222.0.23 () {58 vars in 1289 bytes} [Sat Apr 30 21:24:38 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:24:39.000788 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3127f1-8c46-4cd4-af6c-514ec83b814e tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:39.012905 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3127f1-8c46-4cd4-af6c-514ec83b814e tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:39.019437 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae467b1a-4130-4463-ae45-df062c342c93 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:39.020637 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae467b1a-4130-4463-ae45-df062c342c93 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:39.021164 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae467b1a-4130-4463-ae45-df062c342c93 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:39.022024 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae467b1a-4130-4463-ae45-df062c342c93 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:39.022962 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae467b1a-4130-4463-ae45-df062c342c93 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:39.025143 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae467b1a-4130-4463-ae45-df062c342c93 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:39.026799 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2234/4465] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:24:38 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Apr 30 21:24:39.031074 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4363a3f-7e51-47fd-8402-ef3554211a67 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:39.042385 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4363a3f-7e51-47fd-8402-ef3554211a67 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:39.049035 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d08627-fd84-4eb8-9b87-9481bce48115 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:39.050639 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d08627-fd84-4eb8-9b87-9481bce48115 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:39.050932 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d08627-fd84-4eb8-9b87-9481bce48115 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:39.051211 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d08627-fd84-4eb8-9b87-9481bce48115 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:39.051876 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d08627-fd84-4eb8-9b87-9481bce48115 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:39.053707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d08627-fd84-4eb8-9b87-9481bce48115 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:39.055161 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2232/4466] 10.222.0.23 () {58 vars in 1226 bytes} [Sat Apr 30 21:24:39 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:24:39.059373 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae467b1a-4130-4463-ae45-df062c342c93 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:39.071346 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae467b1a-4130-4463-ae45-df062c342c93 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:39.077222 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc048d1-cb61-4993-b89a-98833699e35a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:39.078254 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc048d1-cb61-4993-b89a-98833699e35a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:39.079125 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc048d1-cb61-4993-b89a-98833699e35a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:39.080045 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc048d1-cb61-4993-b89a-98833699e35a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:39.080837 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc048d1-cb61-4993-b89a-98833699e35a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:39.082775 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc048d1-cb61-4993-b89a-98833699e35a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:39.084236 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2235/4467] 10.222.0.23 () {58 vars in 1241 bytes} [Sat Apr 30 21:24:39 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:24:39.088409 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d08627-fd84-4eb8-9b87-9481bce48115 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:39.102458 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d08627-fd84-4eb8-9b87-9481bce48115 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:39.109882 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76faa1f-c1ff-44f4-bc07-1fc9dd655fe6 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:39.111667 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76faa1f-c1ff-44f4-bc07-1fc9dd655fe6 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:39.112189 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76faa1f-c1ff-44f4-bc07-1fc9dd655fe6 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:39.112660 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76faa1f-c1ff-44f4-bc07-1fc9dd655fe6 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:39.113836 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76faa1f-c1ff-44f4-bc07-1fc9dd655fe6 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:39.115895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76faa1f-c1ff-44f4-bc07-1fc9dd655fe6 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:39.118164 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2233/4468] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Apr 30 21:24:39 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:24:39.122536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc048d1-cb61-4993-b89a-98833699e35a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:39.135747 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc048d1-cb61-4993-b89a-98833699e35a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:39.141304 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2c72f-9446-4f61-95ba-17d6eded99c4 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:39.144707 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2c72f-9446-4f61-95ba-17d6eded99c4 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:39.144707 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2c72f-9446-4f61-95ba-17d6eded99c4 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:39.144707 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2c72f-9446-4f61-95ba-17d6eded99c4 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:39.144707 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c2c72f-9446-4f61-95ba-17d6eded99c4 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:39.146187 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c2c72f-9446-4f61-95ba-17d6eded99c4 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:39.147509 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2236/4469] 10.222.0.23 () {58 vars in 1250 bytes} [Sat Apr 30 21:24:39 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Apr 30 21:24:39.151476 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76faa1f-c1ff-44f4-bc07-1fc9dd655fe6 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:39.161777 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76faa1f-c1ff-44f4-bc07-1fc9dd655fe6 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:39.167878 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7ba25-a460-4aa4-a8fa-aee13622d4fd tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:39.168069 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7ba25-a460-4aa4-a8fa-aee13622d4fd tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:39.168382 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7ba25-a460-4aa4-a8fa-aee13622d4fd tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:39.168642 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7ba25-a460-4aa4-a8fa-aee13622d4fd tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:39.169381 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f7ba25-a460-4aa4-a8fa-aee13622d4fd tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:39.171185 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f7ba25-a460-4aa4-a8fa-aee13622d4fd tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:39.175834 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2234/4470] 10.222.0.23 () {58 vars in 1253 bytes} [Sat Apr 30 21:24:39 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Apr 30 21:24:39.178939 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2c72f-9446-4f61-95ba-17d6eded99c4 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:39.191561 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2c72f-9446-4f61-95ba-17d6eded99c4 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:39.200430 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c30af-d6a9-449d-8862-8218a79560c3 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:39.201494 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c30af-d6a9-449d-8862-8218a79560c3 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:39.201885 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c30af-d6a9-449d-8862-8218a79560c3 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:39.202430 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72c30af-d6a9-449d-8862-8218a79560c3 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:39.203206 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72c30af-d6a9-449d-8862-8218a79560c3 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:39.205240 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72c30af-d6a9-449d-8862-8218a79560c3 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:39.207605 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2237/4471] 10.222.0.23 () {58 vars in 1256 bytes} [Sat Apr 30 21:24:39 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:24:39.211101 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7ba25-a460-4aa4-a8fa-aee13622d4fd tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:39.224165 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7ba25-a460-4aa4-a8fa-aee13622d4fd tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:39.259340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a0287a-7d78-46c7-84dd-f79e8e3d9517 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:39.260395 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0287a-7d78-46c7-84dd-f79e8e3d9517 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:39.260783 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0287a-7d78-46c7-84dd-f79e8e3d9517 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:39.261282 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0287a-7d78-46c7-84dd-f79e8e3d9517 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:39.262083 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a0287a-7d78-46c7-84dd-f79e8e3d9517 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:39.263901 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a0287a-7d78-46c7-84dd-f79e8e3d9517 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:39.265161 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2235/4472] 10.222.0.23 () {58 vars in 1250 bytes} [Sat Apr 30 21:24:39 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:24:39.269480 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c30af-d6a9-449d-8862-8218a79560c3 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:39.281652 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72c30af-d6a9-449d-8862-8218a79560c3 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:39.289657 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813bbc9-9675-432b-b80e-8b339723b05e tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:39.299226 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813bbc9-9675-432b-b80e-8b339723b05e tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:39.299226 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813bbc9-9675-432b-b80e-8b339723b05e tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:39.299226 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813bbc9-9675-432b-b80e-8b339723b05e tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:39.299226 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813bbc9-9675-432b-b80e-8b339723b05e tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:39.299583 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813bbc9-9675-432b-b80e-8b339723b05e tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:39.299583 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2238/4473] 10.222.0.23 () {58 vars in 1256 bytes} [Sat Apr 30 21:24:39 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Apr 30 21:24:39.302511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a0287a-7d78-46c7-84dd-f79e8e3d9517 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:39.314676 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a0287a-7d78-46c7-84dd-f79e8e3d9517 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:39.323152 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb93b4-bf05-4096-b732-8229ec2fdd20 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:39.324164 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb93b4-bf05-4096-b732-8229ec2fdd20 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:39.324787 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb93b4-bf05-4096-b732-8229ec2fdd20 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:39.325309 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb93b4-bf05-4096-b732-8229ec2fdd20 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:39.326256 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb93b4-bf05-4096-b732-8229ec2fdd20 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:39.328331 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb93b4-bf05-4096-b732-8229ec2fdd20 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:39.333669 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2236/4474] 10.222.0.23 () {58 vars in 1292 bytes} [Sat Apr 30 21:24:39 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:24:39.335000 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813bbc9-9675-432b-b80e-8b339723b05e tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:39.347264 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813bbc9-9675-432b-b80e-8b339723b05e tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:39.363094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f521c-9afe-4fcc-a663-a9323ca0992c tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:39.364517 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f521c-9afe-4fcc-a663-a9323ca0992c tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:39.364720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f521c-9afe-4fcc-a663-a9323ca0992c tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:39.365023 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f521c-9afe-4fcc-a663-a9323ca0992c tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:39.365681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f521c-9afe-4fcc-a663-a9323ca0992c tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:39.367451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f521c-9afe-4fcc-a663-a9323ca0992c tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:39.369056 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2239/4475] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:24:39 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:24:39.378419 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb93b4-bf05-4096-b732-8229ec2fdd20 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:39.390706 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb93b4-bf05-4096-b732-8229ec2fdd20 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:39.397032 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b5e21-905b-475a-a0f3-7e8960511281 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:39.398155 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b5e21-905b-475a-a0f3-7e8960511281 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:39.398458 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b5e21-905b-475a-a0f3-7e8960511281 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:39.402316 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b5e21-905b-475a-a0f3-7e8960511281 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:39.402316 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b5e21-905b-475a-a0f3-7e8960511281 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:39.402629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92b5e21-905b-475a-a0f3-7e8960511281 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:39.407402 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2237/4476] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:24:39 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:24:39.409149 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f521c-9afe-4fcc-a663-a9323ca0992c tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:39.425055 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f521c-9afe-4fcc-a663-a9323ca0992c tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:39.431433 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5caee00-5dc3-4144-8983-00f3ed5f809a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:39.432807 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5caee00-5dc3-4144-8983-00f3ed5f809a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:39.433479 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5caee00-5dc3-4144-8983-00f3ed5f809a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:39.434033 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5caee00-5dc3-4144-8983-00f3ed5f809a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:39.434800 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5caee00-5dc3-4144-8983-00f3ed5f809a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:39.439947 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5caee00-5dc3-4144-8983-00f3ed5f809a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:39.441388 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2240/4477] 10.222.0.23 () {58 vars in 1211 bytes} [Sat Apr 30 21:24:39 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:24:39.446574 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b5e21-905b-475a-a0f3-7e8960511281 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:39.462525 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92b5e21-905b-475a-a0f3-7e8960511281 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:39.469070 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c2451-b785-44bc-94b4-c321f2be8066 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:39.470782 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c2451-b785-44bc-94b4-c321f2be8066 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:39.471231 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c2451-b785-44bc-94b4-c321f2be8066 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:39.471667 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c2451-b785-44bc-94b4-c321f2be8066 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:39.472689 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c2451-b785-44bc-94b4-c321f2be8066 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:39.474579 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c2451-b785-44bc-94b4-c321f2be8066 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:39.480523 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2238/4478] 10.222.0.23 () {58 vars in 1226 bytes} [Sat Apr 30 21:24:39 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:24:39.480876 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5caee00-5dc3-4144-8983-00f3ed5f809a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:39.491254 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5caee00-5dc3-4144-8983-00f3ed5f809a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:39.497064 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20b4ca-29c9-4b5c-8c3f-0dd54488f832 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:39.497925 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20b4ca-29c9-4b5c-8c3f-0dd54488f832 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:39.498313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20b4ca-29c9-4b5c-8c3f-0dd54488f832 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:39.498704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20b4ca-29c9-4b5c-8c3f-0dd54488f832 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:39.499454 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a20b4ca-29c9-4b5c-8c3f-0dd54488f832 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:39.501277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a20b4ca-29c9-4b5c-8c3f-0dd54488f832 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:39.503145 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2241/4479] 10.222.0.23 () {58 vars in 1214 bytes} [Sat Apr 30 21:24:39 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:24:39.515824 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c2451-b785-44bc-94b4-c321f2be8066 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:39.531259 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c2451-b785-44bc-94b4-c321f2be8066 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:39.539133 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81028474-8072-420d-b185-8b1a9299ece2 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:39.539925 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81028474-8072-420d-b185-8b1a9299ece2 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:39.540209 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81028474-8072-420d-b185-8b1a9299ece2 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:39.540487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81028474-8072-420d-b185-8b1a9299ece2 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:39.541169 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81028474-8072-420d-b185-8b1a9299ece2 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:39.543092 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81028474-8072-420d-b185-8b1a9299ece2 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:39.544258 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2239/4480] 10.222.0.23 () {58 vars in 1217 bytes} [Sat Apr 30 21:24:39 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:24:39.549020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20b4ca-29c9-4b5c-8c3f-0dd54488f832 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:39.564808 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20b4ca-29c9-4b5c-8c3f-0dd54488f832 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:39.570552 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906f5c2-7cae-45ea-bd4a-d93e22c48e61 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:39.571381 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906f5c2-7cae-45ea-bd4a-d93e22c48e61 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:39.571667 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906f5c2-7cae-45ea-bd4a-d93e22c48e61 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:39.571994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906f5c2-7cae-45ea-bd4a-d93e22c48e61 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:39.572837 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2906f5c2-7cae-45ea-bd4a-d93e22c48e61 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:39.575071 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2906f5c2-7cae-45ea-bd4a-d93e22c48e61 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:39.576961 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2242/4481] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:24:39 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:24:39.581342 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81028474-8072-420d-b185-8b1a9299ece2 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:39.593613 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81028474-8072-420d-b185-8b1a9299ece2 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:39.600149 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158fbb9b-71da-4f3b-997e-8aa14ae40707 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:39.600964 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fbb9b-71da-4f3b-997e-8aa14ae40707 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:39.601249 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fbb9b-71da-4f3b-997e-8aa14ae40707 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:39.601530 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fbb9b-71da-4f3b-997e-8aa14ae40707 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:39.602253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158fbb9b-71da-4f3b-997e-8aa14ae40707 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:39.603973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158fbb9b-71da-4f3b-997e-8aa14ae40707 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:39.608224 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2240/4482] 10.222.0.23 () {58 vars in 1238 bytes} [Sat Apr 30 21:24:39 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Apr 30 21:24:39.609548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906f5c2-7cae-45ea-bd4a-d93e22c48e61 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:39.622148 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906f5c2-7cae-45ea-bd4a-d93e22c48e61 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:39.629382 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32030d44-9697-4282-a5ce-d23d8ec0da30 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:39.630361 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32030d44-9697-4282-a5ce-d23d8ec0da30 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:39.630656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32030d44-9697-4282-a5ce-d23d8ec0da30 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:39.630938 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32030d44-9697-4282-a5ce-d23d8ec0da30 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:39.631603 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32030d44-9697-4282-a5ce-d23d8ec0da30 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:39.633296 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32030d44-9697-4282-a5ce-d23d8ec0da30 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:39.634899 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2243/4483] 10.222.0.23 () {58 vars in 1259 bytes} [Sat Apr 30 21:24:39 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:24:39.639334 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158fbb9b-71da-4f3b-997e-8aa14ae40707 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:39.652398 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158fbb9b-71da-4f3b-997e-8aa14ae40707 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:39.657995 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c17bdd-0b96-4cce-91af-18e5e7c7d2ae tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:39.658962 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c17bdd-0b96-4cce-91af-18e5e7c7d2ae tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:39.659353 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c17bdd-0b96-4cce-91af-18e5e7c7d2ae tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:39.659725 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c17bdd-0b96-4cce-91af-18e5e7c7d2ae tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:39.660462 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c17bdd-0b96-4cce-91af-18e5e7c7d2ae tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:39.662182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c17bdd-0b96-4cce-91af-18e5e7c7d2ae tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:39.663318 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2241/4484] 10.222.0.23 () {58 vars in 1262 bytes} [Sat Apr 30 21:24:39 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:24:39.667700 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32030d44-9697-4282-a5ce-d23d8ec0da30 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:39.679578 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32030d44-9697-4282-a5ce-d23d8ec0da30 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:39.684714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fdf827-f3ee-4ba0-92a9-c9c6a1ff3325 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:39.685495 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdf827-f3ee-4ba0-92a9-c9c6a1ff3325 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:39.685807 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdf827-f3ee-4ba0-92a9-c9c6a1ff3325 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:39.686090 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fdf827-f3ee-4ba0-92a9-c9c6a1ff3325 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:39.686736 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fdf827-f3ee-4ba0-92a9-c9c6a1ff3325 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:39.688374 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fdf827-f3ee-4ba0-92a9-c9c6a1ff3325 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:39.690222 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2244/4485] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:24:39 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:24:39.695340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c17bdd-0b96-4cce-91af-18e5e7c7d2ae tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:39.710848 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c17bdd-0b96-4cce-91af-18e5e7c7d2ae tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:39.715127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c72845-2f90-4900-9e7c-51551cf72058 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:39.716015 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c72845-2f90-4900-9e7c-51551cf72058 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:39.716307 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c72845-2f90-4900-9e7c-51551cf72058 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:39.716588 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c72845-2f90-4900-9e7c-51551cf72058 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:39.717270 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c72845-2f90-4900-9e7c-51551cf72058 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:39.718949 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c72845-2f90-4900-9e7c-51551cf72058 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:39.720482 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2242/4486] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:24:39 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:24:39.724753 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fdf827-f3ee-4ba0-92a9-c9c6a1ff3325 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:39.758591 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fdf827-f3ee-4ba0-92a9-c9c6a1ff3325 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:39.774739 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5ae4b-dfc1-440b-840a-1c706c3b257a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:39.775890 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5ae4b-dfc1-440b-840a-1c706c3b257a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:39.776340 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5ae4b-dfc1-440b-840a-1c706c3b257a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:39.776791 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5ae4b-dfc1-440b-840a-1c706c3b257a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:39.778692 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d5ae4b-dfc1-440b-840a-1c706c3b257a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:39.781195 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d5ae4b-dfc1-440b-840a-1c706c3b257a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:39.783302 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2245/4487] 10.222.0.23 () {58 vars in 1277 bytes} [Sat Apr 30 21:24:39 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:24:39.791048 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c72845-2f90-4900-9e7c-51551cf72058 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:39.803601 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c72845-2f90-4900-9e7c-51551cf72058 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:39.808902 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7eecd-8c4c-44dd-83ee-2fedd70c6136 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:39.809806 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7eecd-8c4c-44dd-83ee-2fedd70c6136 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:39.810101 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7eecd-8c4c-44dd-83ee-2fedd70c6136 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:39.810381 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7eecd-8c4c-44dd-83ee-2fedd70c6136 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/82a53ecdab4a4d98a46cf7903c13d772` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:39.823486 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d7eecd-8c4c-44dd-83ee-2fedd70c6136 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 21:24:39.833926 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-90d7eecd-8c4c-44dd-83ee-2fedd70c6136 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Could not find domain: 82a53ecdab4a4d98a46cf7903c13d772.: keystone.exception.DomainNotFound: Could not find domain: 82a53ecdab4a4d98a46cf7903c13d772. Apr 30 21:24:39.833926 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:24:39.833926 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Apr 30 21:24:39.833926 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Apr 30 21:24:39.833926 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 21:24:39.833926 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 21:24:39.833926 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 21:24:39.833926 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 21:24:39.833926 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 82a53ecdab4a4d98a46cf7903c13d772. Apr 30 21:24:39.833926 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:24:39.833926 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 21:24:39.833926 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:24:39.833926 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:24:39.833926 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:24:39.833926 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:24:39.835004 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:24:39.835004 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:24:39.835004 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:24:39.835004 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:24:39.835004 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:24:39.835004 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:24:39.835004 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:24:39.835004 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:24:39.835004 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Apr 30 21:24:39.835004 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Apr 30 21:24:39.835004 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 21:24:39.835004 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 21:24:39.835004 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 21:24:39.835004 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 21:24:39.835004 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:24:39.835004 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:24:39.835941 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 21:24:39.835941 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 21:24:39.835941 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 21:24:39.835941 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 21:24:39.835941 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 21:24:39.835941 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 21:24:39.835941 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 21:24:39.835941 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 21:24:39.835941 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 21:24:39.835941 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 21:24:39.835941 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 21:24:39.835941 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 21:24:39.835941 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 21:24:39.835941 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 21:24:39.835941 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Apr 30 21:24:39.835941 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 21:24:39.835941 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 82a53ecdab4a4d98a46cf7903c13d772. Apr 30 21:24:39.842830 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:24:39.842830 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2243/4488] 10.222.0.23 () {60 vars in 1248 bytes} [Sat Apr 30 21:24:39 2022] PATCH /identity/v3/domains/82a53ecdab4a4d98a46cf7903c13d772 => generated 112 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 30 21:24:39.843015 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5ae4b-dfc1-440b-840a-1c706c3b257a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:39.850832 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5ae4b-dfc1-440b-840a-1c706c3b257a tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:39.855700 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54406f-af70-4f26-ada4-bef78f4dafa6 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:39.856541 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54406f-af70-4f26-ada4-bef78f4dafa6 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:39.856828 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54406f-af70-4f26-ada4-bef78f4dafa6 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:39.857109 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54406f-af70-4f26-ada4-bef78f4dafa6 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/e8e25c483f14465d8c73e79f73563c72` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:39.867030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e54406f-af70-4f26-ada4-bef78f4dafa6 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 21:24:39.876953 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-8e54406f-af70-4f26-ada4-bef78f4dafa6 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Could not find domain: e8e25c483f14465d8c73e79f73563c72.: keystone.exception.DomainNotFound: Could not find domain: e8e25c483f14465d8c73e79f73563c72. Apr 30 21:24:39.876953 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:24:39.876953 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Apr 30 21:24:39.876953 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Apr 30 21:24:39.876953 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 21:24:39.876953 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 21:24:39.876953 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 21:24:39.876953 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 21:24:39.876953 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: e8e25c483f14465d8c73e79f73563c72. Apr 30 21:24:39.876953 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:24:39.876953 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 21:24:39.876953 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:24:39.876953 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:24:39.876953 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:24:39.876953 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:24:39.878237 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:24:39.878237 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:24:39.878237 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:24:39.878237 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:24:39.878237 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:24:39.878237 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:24:39.878237 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:24:39.878237 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:24:39.878237 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Apr 30 21:24:39.878237 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Apr 30 21:24:39.878237 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 21:24:39.878237 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 21:24:39.878237 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 21:24:39.878237 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 21:24:39.878237 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:24:39.878237 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:24:39.879369 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 21:24:39.879369 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 21:24:39.879369 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 21:24:39.879369 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 21:24:39.879369 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 21:24:39.879369 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 21:24:39.879369 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 21:24:39.879369 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 21:24:39.879369 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 21:24:39.879369 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 21:24:39.879369 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 21:24:39.879369 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 21:24:39.879369 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 21:24:39.879369 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 21:24:39.879369 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Apr 30 21:24:39.879369 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 21:24:39.879369 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: e8e25c483f14465d8c73e79f73563c72. Apr 30 21:24:39.880779 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:24:39.880779 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2246/4489] 10.222.0.23 () {60 vars in 1248 bytes} [Sat Apr 30 21:24:39 2022] PATCH /identity/v3/domains/e8e25c483f14465d8c73e79f73563c72 => generated 112 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 30 21:24:39.882642 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7eecd-8c4c-44dd-83ee-2fedd70c6136 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:39.892905 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7eecd-8c4c-44dd-83ee-2fedd70c6136 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:39.897672 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61982f7e-66c6-4db5-9a2c-a15227838991 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ded545ca58e442c9906a6d025a844b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd060bbbc24843798ba4e710a5a76391', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:39.898609 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61982f7e-66c6-4db5-9a2c-a15227838991 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:39.898898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61982f7e-66c6-4db5-9a2c-a15227838991 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:39.899243 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61982f7e-66c6-4db5-9a2c-a15227838991 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] PATH_INFO: `/v3/domains/f8070622799b4e29aaba54dcb1ede26f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:39.907127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61982f7e-66c6-4db5-9a2c-a15227838991 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 21:24:39.919056 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-61982f7e-66c6-4db5-9a2c-a15227838991 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Could not find domain: f8070622799b4e29aaba54dcb1ede26f.: keystone.exception.DomainNotFound: Could not find domain: f8070622799b4e29aaba54dcb1ede26f. Apr 30 21:24:39.919056 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:24:39.919056 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Apr 30 21:24:39.919056 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Apr 30 21:24:39.919056 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 21:24:39.919056 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 21:24:39.919056 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 21:24:39.919056 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 21:24:39.919056 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f8070622799b4e29aaba54dcb1ede26f. Apr 30 21:24:39.919056 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:24:39.919056 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 21:24:39.919056 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:24:39.919056 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:24:39.919056 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:24:39.919056 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:24:39.920061 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:24:39.920061 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:24:39.920061 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:24:39.920061 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:24:39.920061 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:24:39.920061 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:24:39.920061 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:24:39.920061 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:24:39.920061 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Apr 30 21:24:39.920061 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Apr 30 21:24:39.920061 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 21:24:39.920061 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 21:24:39.920061 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 21:24:39.920061 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 21:24:39.920061 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:24:39.920061 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:24:39.921186 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 21:24:39.921186 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 21:24:39.921186 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 21:24:39.921186 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 21:24:39.921186 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 21:24:39.921186 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 21:24:39.921186 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 21:24:39.921186 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 21:24:39.921186 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 21:24:39.921186 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 21:24:39.921186 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 21:24:39.921186 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 21:24:39.921186 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 21:24:39.921186 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 21:24:39.921186 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Apr 30 21:24:39.921186 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 21:24:39.921186 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f8070622799b4e29aaba54dcb1ede26f. Apr 30 21:24:39.925076 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:24:39.925076 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2244/4490] 10.222.0.23 () {60 vars in 1248 bytes} [Sat Apr 30 21:24:39 2022] PATCH /identity/v3/domains/f8070622799b4e29aaba54dcb1ede26f => generated 112 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Apr 30 21:24:39.926582 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54406f-af70-4f26-ada4-bef78f4dafa6 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:39.928486 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8e54406f-af70-4f26-ada4-bef78f4dafa6 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:40.006928 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54406f-af70-4f26-ada4-bef78f4dafa6 tempest-DomainConfigurationTestJSON-1285973461 tempest-DomainConfigurationTestJSON-1285973461-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:40.017661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e840624-827d-4c06-a45d-8141e113050c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:40.018995 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e840624-827d-4c06-a45d-8141e113050c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:40.019530 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e840624-827d-4c06-a45d-8141e113050c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:40.020012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e840624-827d-4c06-a45d-8141e113050c admin admin] PATH_INFO: `/v3/users/d9d8ddde3fa947fc835cfac09b56cdbf` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:40.021595 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e840624-827d-4c06-a45d-8141e113050c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9d8ddde3fa947fc835cfac09b56cdbf)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:40.023982 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e840624-827d-4c06-a45d-8141e113050c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:40.295977 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2e840624-827d-4c06-a45d-8141e113050c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9d8ddde3fa947fc835cfac09b56cdbf'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:40.310088 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2e840624-827d-4c06-a45d-8141e113050c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9d8ddde3fa947fc835cfac09b56cdbf'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:40.468650 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2e840624-827d-4c06-a45d-8141e113050c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9d8ddde3fa947fc835cfac09b56cdbf'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:40.469905 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2e840624-827d-4c06-a45d-8141e113050c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9d8ddde3fa947fc835cfac09b56cdbf'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:40.478650 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2e840624-827d-4c06-a45d-8141e113050c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9d8ddde3fa947fc835cfac09b56cdbf'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:40.484972 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2247/4491] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:24:39 2022] DELETE /identity/v3/users/d9d8ddde3fa947fc835cfac09b56cdbf => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:40.489792 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d1599-2100-416e-8f63-c807e35eea20 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:40.501189 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d1599-2100-416e-8f63-c807e35eea20 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:40.501189 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d1599-2100-416e-8f63-c807e35eea20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:40.537588 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-315d1599-2100-416e-8f63-c807e35eea20 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:40.540705 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-315d1599-2100-416e-8f63-c807e35eea20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:40.640731 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2245/4492] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:24:40.732612 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e840624-827d-4c06-a45d-8141e113050c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:40.734354 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2e840624-827d-4c06-a45d-8141e113050c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:40.863076 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e840624-827d-4c06-a45d-8141e113050c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:40.867133 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f41a46-6a4f-487d-9ef6-467ca9e04b2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:40.867803 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f41a46-6a4f-487d-9ef6-467ca9e04b2f service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:40.868086 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f41a46-6a4f-487d-9ef6-467ca9e04b2f service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:40.868357 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f41a46-6a4f-487d-9ef6-467ca9e04b2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:40.887711 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f41a46-6a4f-487d-9ef6-467ca9e04b2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:40.889329 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f41a46-6a4f-487d-9ef6-467ca9e04b2f service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:40.913963 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2248/4493] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:24:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:24:41.832955 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879a386-7685-4ba7-87f3-d4f1fb9c0706 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:41.833439 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879a386-7685-4ba7-87f3-d4f1fb9c0706 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:41.833526 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879a386-7685-4ba7-87f3-d4f1fb9c0706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:41.854593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-5879a386-7685-4ba7-87f3-d4f1fb9c0706 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:41.855840 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5879a386-7685-4ba7-87f3-d4f1fb9c0706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:41.908647 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f41a46-6a4f-487d-9ef6-467ca9e04b2f service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:41.911527 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-10f41a46-6a4f-487d-9ef6-467ca9e04b2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:41.937950 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2246/4494] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:24:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:24:42.047950 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f41a46-6a4f-487d-9ef6-467ca9e04b2f service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:42.054654 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed4b22-992c-42b1-92de-a0004257b01f tempest-RoutersIpV6AdminTest-591566857 tempest-RoutersIpV6AdminTest-591566857-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '078d3385bc6a4418970db78273f2db57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c79746fa72c4192b5984cecda6e91a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:42.056938 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed4b22-992c-42b1-92de-a0004257b01f tempest-RoutersIpV6AdminTest-591566857 tempest-RoutersIpV6AdminTest-591566857-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:42.056938 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed4b22-992c-42b1-92de-a0004257b01f tempest-RoutersIpV6AdminTest-591566857 tempest-RoutersIpV6AdminTest-591566857-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:42.058148 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed4b22-992c-42b1-92de-a0004257b01f tempest-RoutersIpV6AdminTest-591566857 tempest-RoutersIpV6AdminTest-591566857-project-admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:42.059219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed4b22-992c-42b1-92de-a0004257b01f tempest-RoutersIpV6AdminTest-591566857 tempest-RoutersIpV6AdminTest-591566857-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:24:42.059767 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed4b22-992c-42b1-92de-a0004257b01f tempest-RoutersIpV6AdminTest-591566857 tempest-RoutersIpV6AdminTest-591566857-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:42.061728 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed4b22-992c-42b1-92de-a0004257b01f tempest-RoutersIpV6AdminTest-591566857 tempest-RoutersIpV6AdminTest-591566857-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:42.092264 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2249/4495] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:24:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:24:42.098135 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879a386-7685-4ba7-87f3-d4f1fb9c0706 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:42.124053 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879a386-7685-4ba7-87f3-d4f1fb9c0706 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:42.138531 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed4b22-992c-42b1-92de-a0004257b01f tempest-RoutersIpV6AdminTest-591566857 tempest-RoutersIpV6AdminTest-591566857-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:42.140451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-faed4b22-992c-42b1-92de-a0004257b01f tempest-RoutersIpV6AdminTest-591566857 tempest-RoutersIpV6AdminTest-591566857-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:42.143634 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e27ed7-3029-4aab-87d4-afcc8cb0b014 tempest-RoutersIpV6AdminTest-591566857 tempest-RoutersIpV6AdminTest-591566857-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '078d3385bc6a4418970db78273f2db57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c79746fa72c4192b5984cecda6e91a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:42.144529 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e27ed7-3029-4aab-87d4-afcc8cb0b014 tempest-RoutersIpV6AdminTest-591566857 tempest-RoutersIpV6AdminTest-591566857-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:42.144979 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e27ed7-3029-4aab-87d4-afcc8cb0b014 tempest-RoutersIpV6AdminTest-591566857 tempest-RoutersIpV6AdminTest-591566857-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:42.145464 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e27ed7-3029-4aab-87d4-afcc8cb0b014 tempest-RoutersIpV6AdminTest-591566857 tempest-RoutersIpV6AdminTest-591566857-project-admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:42.146349 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e27ed7-3029-4aab-87d4-afcc8cb0b014 tempest-RoutersIpV6AdminTest-591566857 tempest-RoutersIpV6AdminTest-591566857-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:42.148458 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e27ed7-3029-4aab-87d4-afcc8cb0b014 tempest-RoutersIpV6AdminTest-591566857 tempest-RoutersIpV6AdminTest-591566857-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:42.293791 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed4b22-992c-42b1-92de-a0004257b01f tempest-RoutersIpV6AdminTest-591566857 tempest-RoutersIpV6AdminTest-591566857-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:42.300117 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec89219-f4ba-405c-84cf-4d44982b874e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:42.301152 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec89219-f4ba-405c-84cf-4d44982b874e service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:42.301583 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec89219-f4ba-405c-84cf-4d44982b874e service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:42.301972 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec89219-f4ba-405c-84cf-4d44982b874e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:42.311533 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec89219-f4ba-405c-84cf-4d44982b874e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:42.320746 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec89219-f4ba-405c-84cf-4d44982b874e service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:42.324504 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2250/4496] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:24:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 30 21:24:42.335908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec89219-f4ba-405c-84cf-4d44982b874e service swift] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:42.341028 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-aec89219-f4ba-405c-84cf-4d44982b874e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:42.370309 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec89219-f4ba-405c-84cf-4d44982b874e service swift] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:42.379324 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3b456-84ab-49f4-840a-50ab780f3106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:42.380169 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3b456-84ab-49f4-840a-50ab780f3106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:42.380449 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3b456-84ab-49f4-840a-50ab780f3106 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:42.380725 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3b456-84ab-49f4-840a-50ab780f3106 admin admin] PATH_INFO: `/v3/projects/e297ade488854410bf06fe5437e3ae64` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:42.384612 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3b456-84ab-49f4-840a-50ab780f3106 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e297ade488854410bf06fe5437e3ae64)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:42.384612 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3b456-84ab-49f4-840a-50ab780f3106 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:42.385227 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2247/4497] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:24:42 2022] POST /identity/v3/projects => generated 348 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:24:42.386783 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e27ed7-3029-4aab-87d4-afcc8cb0b014 tempest-RoutersIpV6AdminTest-591566857 tempest-RoutersIpV6AdminTest-591566857-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:42.500037 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e27ed7-3029-4aab-87d4-afcc8cb0b014 tempest-RoutersIpV6AdminTest-591566857 tempest-RoutersIpV6AdminTest-591566857-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:42.505608 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271bd01-da45-4af1-ab43-0ca241f86c9b tempest-RoutersIpV6AdminTest-591566857 tempest-RoutersIpV6AdminTest-591566857-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '078d3385bc6a4418970db78273f2db57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c79746fa72c4192b5984cecda6e91a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:42.506583 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271bd01-da45-4af1-ab43-0ca241f86c9b tempest-RoutersIpV6AdminTest-591566857 tempest-RoutersIpV6AdminTest-591566857-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:42.507025 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271bd01-da45-4af1-ab43-0ca241f86c9b tempest-RoutersIpV6AdminTest-591566857 tempest-RoutersIpV6AdminTest-591566857-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:42.507440 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271bd01-da45-4af1-ab43-0ca241f86c9b tempest-RoutersIpV6AdminTest-591566857 tempest-RoutersIpV6AdminTest-591566857-project-admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:42.508373 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271bd01-da45-4af1-ab43-0ca241f86c9b tempest-RoutersIpV6AdminTest-591566857 tempest-RoutersIpV6AdminTest-591566857-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:24:42.508858 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271bd01-da45-4af1-ab43-0ca241f86c9b tempest-RoutersIpV6AdminTest-591566857 tempest-RoutersIpV6AdminTest-591566857-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:42.510738 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271bd01-da45-4af1-ab43-0ca241f86c9b tempest-RoutersIpV6AdminTest-591566857 tempest-RoutersIpV6AdminTest-591566857-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:42.538130 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2248/4498] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:24:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:24:42.578219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8ae3b456-84ab-49f4-840a-50ab780f3106 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e297ade488854410bf06fe5437e3ae64', 'request_id': 'req-8ae3b456-84ab-49f4-840a-50ab780f3106'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:42.585477 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8ae3b456-84ab-49f4-840a-50ab780f3106 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e297ade488854410bf06fe5437e3ae64', 'request_id': 'req-8ae3b456-84ab-49f4-840a-50ab780f3106'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:42.593039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8ae3b456-84ab-49f4-840a-50ab780f3106 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e297ade488854410bf06fe5437e3ae64', 'request_id': 'req-8ae3b456-84ab-49f4-840a-50ab780f3106'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:42.691322 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8ae3b456-84ab-49f4-840a-50ab780f3106 admin admin] The token cache is being invalidate because project e297ade488854410bf06fe5437e3ae64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:24:42.693377 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8ae3b456-84ab-49f4-840a-50ab780f3106 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:42.693904 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8ae3b456-84ab-49f4-840a-50ab780f3106 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:42.701958 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2251/4499] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:24:42 2022] DELETE /identity/v3/projects/e297ade488854410bf06fe5437e3ae64 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:24:42.706576 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271bd01-da45-4af1-ab43-0ca241f86c9b tempest-RoutersIpV6AdminTest-591566857 tempest-RoutersIpV6AdminTest-591566857-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:42.708376 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e271bd01-da45-4af1-ab43-0ca241f86c9b tempest-RoutersIpV6AdminTest-591566857 tempest-RoutersIpV6AdminTest-591566857-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:42.855560 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271bd01-da45-4af1-ab43-0ca241f86c9b tempest-RoutersIpV6AdminTest-591566857 tempest-RoutersIpV6AdminTest-591566857-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:42.965722 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e388802-4514-4b44-aae0-196cab4473f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:42.966988 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e388802-4514-4b44-aae0-196cab4473f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:42.967547 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e388802-4514-4b44-aae0-196cab4473f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:42.968101 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e388802-4514-4b44-aae0-196cab4473f2 admin admin] PATH_INFO: `/v3/users/ded545ca58e442c9906a6d025a844b2e` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:42.969708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e388802-4514-4b44-aae0-196cab4473f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ded545ca58e442c9906a6d025a844b2e)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:42.972502 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e388802-4514-4b44-aae0-196cab4473f2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:43.237678 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7e388802-4514-4b44-aae0-196cab4473f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ded545ca58e442c9906a6d025a844b2e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:43.252609 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7e388802-4514-4b44-aae0-196cab4473f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ded545ca58e442c9906a6d025a844b2e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:43.326247 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7e388802-4514-4b44-aae0-196cab4473f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ded545ca58e442c9906a6d025a844b2e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:43.346407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7e388802-4514-4b44-aae0-196cab4473f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ded545ca58e442c9906a6d025a844b2e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:43.347273 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7e388802-4514-4b44-aae0-196cab4473f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ded545ca58e442c9906a6d025a844b2e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:43.366182 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2249/4500] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:24:42 2022] DELETE /identity/v3/users/ded545ca58e442c9906a6d025a844b2e => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:43.958751 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3b456-84ab-49f4-840a-50ab780f3106 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:43.960251 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8ae3b456-84ab-49f4-840a-50ab780f3106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:44.076589 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3b456-84ab-49f4-840a-50ab780f3106 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:44.186610 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e388802-4514-4b44-aae0-196cab4473f2 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:44.188636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7e388802-4514-4b44-aae0-196cab4473f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:44.215910 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a19011-5e6e-47d1-a4ee-d3d71ffa9e9b tempest-RoutersIpV6AdminTest-591566857 tempest-RoutersIpV6AdminTest-591566857-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '078d3385bc6a4418970db78273f2db57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c79746fa72c4192b5984cecda6e91a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:44.229702 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a19011-5e6e-47d1-a4ee-d3d71ffa9e9b tempest-RoutersIpV6AdminTest-591566857 tempest-RoutersIpV6AdminTest-591566857-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:44.230100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a19011-5e6e-47d1-a4ee-d3d71ffa9e9b tempest-RoutersIpV6AdminTest-591566857 tempest-RoutersIpV6AdminTest-591566857-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:44.230385 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a19011-5e6e-47d1-a4ee-d3d71ffa9e9b tempest-RoutersIpV6AdminTest-591566857 tempest-RoutersIpV6AdminTest-591566857-project-admin] PATH_INFO: `/v3/projects/26e31b6d76d64358ac445881c33c50f4` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:44.234538 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a19011-5e6e-47d1-a4ee-d3d71ffa9e9b tempest-RoutersIpV6AdminTest-591566857 tempest-RoutersIpV6AdminTest-591566857-project-admin] RBAC: Authorizing `identity:delete_project(project_id=26e31b6d76d64358ac445881c33c50f4)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:44.239748 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a19011-5e6e-47d1-a4ee-d3d71ffa9e9b tempest-RoutersIpV6AdminTest-591566857 tempest-RoutersIpV6AdminTest-591566857-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:44.366029 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e388802-4514-4b44-aae0-196cab4473f2 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:44.375528 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d946782-8a19-457c-88e0-d843ac762b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:44.376449 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d946782-8a19-457c-88e0-d843ac762b55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:44.376736 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d946782-8a19-457c-88e0-d843ac762b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:44.377007 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d946782-8a19-457c-88e0-d843ac762b55 admin admin] PATH_INFO: `/v3/projects/bd060bbbc24843798ba4e710a5a76391` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:44.381698 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d946782-8a19-457c-88e0-d843ac762b55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd060bbbc24843798ba4e710a5a76391)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:44.385393 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d946782-8a19-457c-88e0-d843ac762b55 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:44.416791 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c4a19011-5e6e-47d1-a4ee-d3d71ffa9e9b tempest-RoutersIpV6AdminTest-591566857 tempest-RoutersIpV6AdminTest-591566857-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26e31b6d76d64358ac445881c33c50f4', 'request_id': 'req-c4a19011-5e6e-47d1-a4ee-d3d71ffa9e9b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:44.442553 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c4a19011-5e6e-47d1-a4ee-d3d71ffa9e9b tempest-RoutersIpV6AdminTest-591566857 tempest-RoutersIpV6AdminTest-591566857-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26e31b6d76d64358ac445881c33c50f4', 'request_id': 'req-c4a19011-5e6e-47d1-a4ee-d3d71ffa9e9b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:44.459275 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c4a19011-5e6e-47d1-a4ee-d3d71ffa9e9b tempest-RoutersIpV6AdminTest-591566857 tempest-RoutersIpV6AdminTest-591566857-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26e31b6d76d64358ac445881c33c50f4', 'request_id': 'req-c4a19011-5e6e-47d1-a4ee-d3d71ffa9e9b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:44.513379 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4d946782-8a19-457c-88e0-d843ac762b55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd060bbbc24843798ba4e710a5a76391', 'request_id': 'req-4d946782-8a19-457c-88e0-d843ac762b55'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:44.519998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4d946782-8a19-457c-88e0-d843ac762b55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd060bbbc24843798ba4e710a5a76391', 'request_id': 'req-4d946782-8a19-457c-88e0-d843ac762b55'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:44.526789 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4d946782-8a19-457c-88e0-d843ac762b55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd060bbbc24843798ba4e710a5a76391', 'request_id': 'req-4d946782-8a19-457c-88e0-d843ac762b55'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:44.581156 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c4a19011-5e6e-47d1-a4ee-d3d71ffa9e9b tempest-RoutersIpV6AdminTest-591566857 tempest-RoutersIpV6AdminTest-591566857-project-admin] The token cache is being invalidate because project 26e31b6d76d64358ac445881c33c50f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:24:44.581594 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c4a19011-5e6e-47d1-a4ee-d3d71ffa9e9b tempest-RoutersIpV6AdminTest-591566857 tempest-RoutersIpV6AdminTest-591566857-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:44.582410 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c4a19011-5e6e-47d1-a4ee-d3d71ffa9e9b tempest-RoutersIpV6AdminTest-591566857 tempest-RoutersIpV6AdminTest-591566857-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:44.584357 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2252/4501] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:24:43 2022] DELETE /identity/v3/projects/26e31b6d76d64358ac445881c33c50f4 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:44.600416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a19011-5e6e-47d1-a4ee-d3d71ffa9e9b tempest-RoutersIpV6AdminTest-591566857 tempest-RoutersIpV6AdminTest-591566857-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:44.606634 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c4a19011-5e6e-47d1-a4ee-d3d71ffa9e9b tempest-RoutersIpV6AdminTest-591566857 tempest-RoutersIpV6AdminTest-591566857-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:44.624937 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4d946782-8a19-457c-88e0-d843ac762b55 admin admin] The token cache is being invalidate because project bd060bbbc24843798ba4e710a5a76391 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:24:44.625529 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4d946782-8a19-457c-88e0-d843ac762b55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:44.627089 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4d946782-8a19-457c-88e0-d843ac762b55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:44.630732 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2250/4502] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:24:44 2022] DELETE /identity/v3/projects/bd060bbbc24843798ba4e710a5a76391 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:44.636082 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7512e67-5c4e-4d32-9732-3f9cd9aae5f5 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:44.636586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7512e67-5c4e-4d32-9732-3f9cd9aae5f5 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:44.637025 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7512e67-5c4e-4d32-9732-3f9cd9aae5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:44.714728 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-c7512e67-5c4e-4d32-9732-3f9cd9aae5f5 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:44.717826 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c7512e67-5c4e-4d32-9732-3f9cd9aae5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:44.760387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a19011-5e6e-47d1-a4ee-d3d71ffa9e9b tempest-RoutersIpV6AdminTest-591566857 tempest-RoutersIpV6AdminTest-591566857-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:44.825079 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2251/4503] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:24:44.904513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1af30-750e-4bc2-ac1c-1ddc3ce99524 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:44.904908 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1af30-750e-4bc2-ac1c-1ddc3ce99524 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:44.905367 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1af30-750e-4bc2-ac1c-1ddc3ce99524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:44.955163 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-41b1af30-750e-4bc2-ac1c-1ddc3ce99524 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:44.957948 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-41b1af30-750e-4bc2-ac1c-1ddc3ce99524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:44.968083 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be22e8-4e07-4e36-aa8f-9280258e5fd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:44.968766 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be22e8-4e07-4e36-aa8f-9280258e5fd3 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:44.969787 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be22e8-4e07-4e36-aa8f-9280258e5fd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:44.970603 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be22e8-4e07-4e36-aa8f-9280258e5fd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:44.980545 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-45be22e8-4e07-4e36-aa8f-9280258e5fd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:44.981338 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2252/4504] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:24:44.982666 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1af30-750e-4bc2-ac1c-1ddc3ce99524 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:45.003708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1af30-750e-4bc2-ac1c-1ddc3ce99524 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:45.013263 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11ab30-2e09-4391-a3e3-627969bdac89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:45.014311 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11ab30-2e09-4391-a3e3-627969bdac89 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:45.014841 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11ab30-2e09-4391-a3e3-627969bdac89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:45.015274 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11ab30-2e09-4391-a3e3-627969bdac89 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:45.016332 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e11ab30-2e09-4391-a3e3-627969bdac89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:24:45.017531 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e11ab30-2e09-4391-a3e3-627969bdac89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:45.026522 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e11ab30-2e09-4391-a3e3-627969bdac89 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:45.049546 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2253/4505] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:24:45.050791 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11ab30-2e09-4391-a3e3-627969bdac89 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:45.073407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11ab30-2e09-4391-a3e3-627969bdac89 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:45.088298 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5030c5-0857-4fc2-8330-9136561c2ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:45.089246 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5030c5-0857-4fc2-8330-9136561c2ec5 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:45.089685 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5030c5-0857-4fc2-8330-9136561c2ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:45.090527 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5030c5-0857-4fc2-8330-9136561c2ec5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:45.091435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5030c5-0857-4fc2-8330-9136561c2ec5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:45.093517 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5030c5-0857-4fc2-8330-9136561c2ec5 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:45.225229 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be22e8-4e07-4e36-aa8f-9280258e5fd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:45.225229 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be22e8-4e07-4e36-aa8f-9280258e5fd3 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:45.225229 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2253/4506] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:24:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 609 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:24:45.329434 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2254/4507] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:24:45 2022] POST /identity/v3/projects => generated 367 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:24:45.333782 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be22e8-4e07-4e36-aa8f-9280258e5fd3 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:45.353172 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be22e8-4e07-4e36-aa8f-9280258e5fd3 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:45.431177 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce571ac-b44e-4840-859c-1bca8e16cbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:45.431911 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce571ac-b44e-4840-859c-1bca8e16cbbd admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:45.432197 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce571ac-b44e-4840-859c-1bca8e16cbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:45.432479 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce571ac-b44e-4840-859c-1bca8e16cbbd admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:45.433177 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce571ac-b44e-4840-859c-1bca8e16cbbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:45.435509 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce571ac-b44e-4840-859c-1bca8e16cbbd admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:45.614163 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2254/4508] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:24:45 2022] POST /identity/v3/users => generated 284 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:24:45.618491 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5030c5-0857-4fc2-8330-9136561c2ec5 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:45.644589 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5030c5-0857-4fc2-8330-9136561c2ec5 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:45.655313 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277edee8-64a4-479e-b6e4-8fc99ee736a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:45.656793 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277edee8-64a4-479e-b6e4-8fc99ee736a9 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:45.657278 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277edee8-64a4-479e-b6e4-8fc99ee736a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:45.657775 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277edee8-64a4-479e-b6e4-8fc99ee736a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:45.658824 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277edee8-64a4-479e-b6e4-8fc99ee736a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:45.661203 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277edee8-64a4-479e-b6e4-8fc99ee736a9 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:45.698447 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2255/4509] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:24:45.702236 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce571ac-b44e-4840-859c-1bca8e16cbbd admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:45.717562 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce571ac-b44e-4840-859c-1bca8e16cbbd admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:45.724425 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2cf2b-e655-43ed-8b30-26cbc696e3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:45.726468 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2cf2b-e655-43ed-8b30-26cbc696e3e6 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:45.726966 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2cf2b-e655-43ed-8b30-26cbc696e3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:45.727411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2cf2b-e655-43ed-8b30-26cbc696e3e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:45.728453 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2cf2b-e655-43ed-8b30-26cbc696e3e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:45.730327 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2cf2b-e655-43ed-8b30-26cbc696e3e6 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:45.748883 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2255/4510] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:24:45.753958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277edee8-64a4-479e-b6e4-8fc99ee736a9 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:45.788178 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277edee8-64a4-479e-b6e4-8fc99ee736a9 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:45.801374 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6d155-960b-4a26-8217-ec528804ebaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:45.802604 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6d155-960b-4a26-8217-ec528804ebaa admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:45.803073 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6d155-960b-4a26-8217-ec528804ebaa admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:45.803630 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6d155-960b-4a26-8217-ec528804ebaa admin admin] PATH_INFO: `/v3/projects/1ebb65b7eb0b4816a9d5b5aa9a17c5d2/users/a55ff4f76d724999ad96416dbf1c15c3/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:45.832323 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d6d155-960b-4a26-8217-ec528804ebaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ebb65b7eb0b4816a9d5b5aa9a17c5d2, user_id=a55ff4f76d724999ad96416dbf1c15c3, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:45.839422 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d6d155-960b-4a26-8217-ec528804ebaa admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:45.948146 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2256/4511] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:24:45 2022] PUT /identity/v3/projects/1ebb65b7eb0b4816a9d5b5aa9a17c5d2/users/a55ff4f76d724999ad96416dbf1c15c3/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:24:45.959081 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f4e2c-1fac-449b-9061-649c78598623 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:45.959389 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f4e2c-1fac-449b-9061-649c78598623 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:45.960034 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f4e2c-1fac-449b-9061-649c78598623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:46.030060 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-1d9f4e2c-1fac-449b-9061-649c78598623 None None] MFA Rules not processed for user `a55ff4f76d724999ad96416dbf1c15c3`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:46.032021 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1d9f4e2c-1fac-449b-9061-649c78598623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:46.193469 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2256/4512] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:45 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:24:46.197624 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6d155-960b-4a26-8217-ec528804ebaa admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:46.311232 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6d155-960b-4a26-8217-ec528804ebaa admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:46.327275 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ae5c2-106e-478f-b1ad-e32591ce9717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:46.328241 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ae5c2-106e-478f-b1ad-e32591ce9717 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:46.328241 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ae5c2-106e-478f-b1ad-e32591ce9717 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:46.328475 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ae5c2-106e-478f-b1ad-e32591ce9717 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:46.329376 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0ae5c2-106e-478f-b1ad-e32591ce9717 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:46.331341 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0ae5c2-106e-478f-b1ad-e32591ce9717 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:46.454218 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2257/4513] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:24:46 2022] POST /identity/v3/projects => generated 367 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:24:46.467253 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f4e2c-1fac-449b-9061-649c78598623 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:46.477013 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f4e2c-1fac-449b-9061-649c78598623 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:46.551808 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49a2bb-8613-451d-96a8-e6950789e9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:46.552558 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49a2bb-8613-451d-96a8-e6950789e9c6 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:46.552848 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49a2bb-8613-451d-96a8-e6950789e9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:46.553135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49a2bb-8613-451d-96a8-e6950789e9c6 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:46.553866 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49a2bb-8613-451d-96a8-e6950789e9c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:46.555832 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49a2bb-8613-451d-96a8-e6950789e9c6 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:46.720808 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2257/4514] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:24:46 2022] POST /identity/v3/users => generated 290 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:24:46.724615 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ae5c2-106e-478f-b1ad-e32591ce9717 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:46.737500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ae5c2-106e-478f-b1ad-e32591ce9717 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:46.745513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40119e9-d49b-45ac-b45c-0c56125832f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:46.746498 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40119e9-d49b-45ac-b45c-0c56125832f3 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:46.746857 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40119e9-d49b-45ac-b45c-0c56125832f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:46.747251 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40119e9-d49b-45ac-b45c-0c56125832f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:46.748055 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40119e9-d49b-45ac-b45c-0c56125832f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:46.755080 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40119e9-d49b-45ac-b45c-0c56125832f3 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:46.767252 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2258/4515] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:24:46.771369 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49a2bb-8613-451d-96a8-e6950789e9c6 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:46.782958 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49a2bb-8613-451d-96a8-e6950789e9c6 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:46.788233 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285de65-6e95-442d-a82e-4c5e533c8566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:46.789212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285de65-6e95-442d-a82e-4c5e533c8566 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:46.789565 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285de65-6e95-442d-a82e-4c5e533c8566 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:46.789953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285de65-6e95-442d-a82e-4c5e533c8566 admin admin] PATH_INFO: `/v3/projects/6cf07b051a82409e98eb5ce1a1b3ff71/users/e0e1dd233deb4f47a4a1c40f4468617c/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:46.813065 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6285de65-6e95-442d-a82e-4c5e533c8566 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cf07b051a82409e98eb5ce1a1b3ff71, user_id=e0e1dd233deb4f47a4a1c40f4468617c, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:46.816320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6285de65-6e95-442d-a82e-4c5e533c8566 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:46.895020 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2258/4516] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:24:46 2022] PUT /identity/v3/projects/6cf07b051a82409e98eb5ce1a1b3ff71/users/e0e1dd233deb4f47a4a1c40f4468617c/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:46.899218 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40119e9-d49b-45ac-b45c-0c56125832f3 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:46.917580 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40119e9-d49b-45ac-b45c-0c56125832f3 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:47.000037 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7eb146-1eba-49a1-a168-9f16a0337556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:47.001959 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7eb146-1eba-49a1-a168-9f16a0337556 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:47.002261 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7eb146-1eba-49a1-a168-9f16a0337556 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:47.002530 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7eb146-1eba-49a1-a168-9f16a0337556 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:47.003418 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7eb146-1eba-49a1-a168-9f16a0337556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:47.006155 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7eb146-1eba-49a1-a168-9f16a0337556 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:47.029638 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2259/4517] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:24:47.035518 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285de65-6e95-442d-a82e-4c5e533c8566 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:47.050768 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285de65-6e95-442d-a82e-4c5e533c8566 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:47.072502 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4eaffa-019a-440e-a451-4fd7c1df1d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:47.075874 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4eaffa-019a-440e-a451-4fd7c1df1d26 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:47.075874 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4eaffa-019a-440e-a451-4fd7c1df1d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:47.075874 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4eaffa-019a-440e-a451-4fd7c1df1d26 admin admin] PATH_INFO: `/v3/projects/6cf07b051a82409e98eb5ce1a1b3ff71/users/e0e1dd233deb4f47a4a1c40f4468617c/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:47.086212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4eaffa-019a-440e-a451-4fd7c1df1d26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cf07b051a82409e98eb5ce1a1b3ff71, user_id=e0e1dd233deb4f47a4a1c40f4468617c, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:47.093177 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4eaffa-019a-440e-a451-4fd7c1df1d26 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:47.130455 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2259/4518] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:24:47 2022] PUT /identity/v3/projects/6cf07b051a82409e98eb5ce1a1b3ff71/users/e0e1dd233deb4f47a4a1c40f4468617c/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:24:47.149849 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019759c-750f-4839-a1f7-4832e632dbbc None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:47.149849 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019759c-750f-4839-a1f7-4832e632dbbc None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:47.149849 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019759c-750f-4839-a1f7-4832e632dbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:47.198421 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-5019759c-750f-4839-a1f7-4832e632dbbc None None] MFA Rules not processed for user `e0e1dd233deb4f47a4a1c40f4468617c`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:47.200036 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5019759c-750f-4839-a1f7-4832e632dbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:47.338243 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2260/4519] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:47 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:24:47.343884 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4eaffa-019a-440e-a451-4fd7c1df1d26 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:47.356329 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4eaffa-019a-440e-a451-4fd7c1df1d26 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:47.361440 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c05aee-fbec-416d-8ed4-32b27bccd032 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:47.362148 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c05aee-fbec-416d-8ed4-32b27bccd032 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:47.362433 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c05aee-fbec-416d-8ed4-32b27bccd032 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:47.362704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c05aee-fbec-416d-8ed4-32b27bccd032 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:47.363391 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c05aee-fbec-416d-8ed4-32b27bccd032 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:47.365392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c05aee-fbec-416d-8ed4-32b27bccd032 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:47.644826 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2260/4520] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:24:47 2022] POST /identity/v3/projects => generated 359 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:24:47.646099 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019759c-750f-4839-a1f7-4832e632dbbc None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:47.659570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019759c-750f-4839-a1f7-4832e632dbbc None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:47.736851 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186323b-50a3-4d45-8656-260d346ab241 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:47.737750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186323b-50a3-4d45-8656-260d346ab241 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:47.738140 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186323b-50a3-4d45-8656-260d346ab241 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:47.738427 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186323b-50a3-4d45-8656-260d346ab241 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:47.739495 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186323b-50a3-4d45-8656-260d346ab241 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:47.741559 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186323b-50a3-4d45-8656-260d346ab241 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:47.825859 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2261/4521] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:24:47 2022] POST /identity/v3/users => generated 407 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:24:47.831257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c05aee-fbec-416d-8ed4-32b27bccd032 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:47.854020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c05aee-fbec-416d-8ed4-32b27bccd032 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:47.862220 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d3090-bf74-43f9-85e4-2c4e2e36f0a3 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:47.863973 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d3090-bf74-43f9-85e4-2c4e2e36f0a3 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:47.864458 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d3090-bf74-43f9-85e4-2c4e2e36f0a3 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:47.864908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d3090-bf74-43f9-85e4-2c4e2e36f0a3 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/users/18aa48d08f0049d795af3ed03bd6692b` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:47.884376 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d3090-bf74-43f9-85e4-2c4e2e36f0a3 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:get_user(user_id=18aa48d08f0049d795af3ed03bd6692b)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:47.891011 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d3090-bf74-43f9-85e4-2c4e2e36f0a3 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:47.894147 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2261/4522] 10.222.0.23 () {58 vars in 1220 bytes} [Sat Apr 30 21:24:47 2022] GET /identity/v3/users/18aa48d08f0049d795af3ed03bd6692b => generated 407 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:24:47.897929 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186323b-50a3-4d45-8656-260d346ab241 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:47.916295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186323b-50a3-4d45-8656-260d346ab241 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:47.921797 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b1055-9180-4399-8755-91d93ceb23d6 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:47.922706 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b1055-9180-4399-8755-91d93ceb23d6 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:47.923597 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b1055-9180-4399-8755-91d93ceb23d6 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:47.923939 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b1055-9180-4399-8755-91d93ceb23d6 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/users/18aa48d08f0049d795af3ed03bd6692b` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:47.926905 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0b1055-9180-4399-8755-91d93ceb23d6 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:delete_user(user_id=18aa48d08f0049d795af3ed03bd6692b)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:47.929097 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0b1055-9180-4399-8755-91d93ceb23d6 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:48.118309 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0a0b1055-9180-4399-8755-91d93ceb23d6 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18aa48d08f0049d795af3ed03bd6692b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:48.136590 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0a0b1055-9180-4399-8755-91d93ceb23d6 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18aa48d08f0049d795af3ed03bd6692b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:48.228942 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0a0b1055-9180-4399-8755-91d93ceb23d6 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18aa48d08f0049d795af3ed03bd6692b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:48.239731 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0a0b1055-9180-4399-8755-91d93ceb23d6 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18aa48d08f0049d795af3ed03bd6692b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:48.241115 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0a0b1055-9180-4399-8755-91d93ceb23d6 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18aa48d08f0049d795af3ed03bd6692b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:48.251639 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2262/4523] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:24:47 2022] DELETE /identity/v3/users/18aa48d08f0049d795af3ed03bd6692b => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:24:48.253140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d3090-bf74-43f9-85e4-2c4e2e36f0a3 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:48.255980 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5e0d3090-bf74-43f9-85e4-2c4e2e36f0a3 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:48.278750 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d3090-bf74-43f9-85e4-2c4e2e36f0a3 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:48.363142 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7d94d-14ba-4a7a-aa38-4201ddfb9020 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:48.364127 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7d94d-14ba-4a7a-aa38-4201ddfb9020 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:48.364475 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7d94d-14ba-4a7a-aa38-4201ddfb9020 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:48.364824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7d94d-14ba-4a7a-aa38-4201ddfb9020 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/projects/f3c36a3114674b37aa47d8941e87a2a3` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:48.366070 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a7d94d-14ba-4a7a-aa38-4201ddfb9020 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f3c36a3114674b37aa47d8941e87a2a3)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:48.368072 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a7d94d-14ba-4a7a-aa38-4201ddfb9020 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:48.543762 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-27a7d94d-14ba-4a7a-aa38-4201ddfb9020 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3c36a3114674b37aa47d8941e87a2a3', 'request_id': 'req-27a7d94d-14ba-4a7a-aa38-4201ddfb9020'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:48.553576 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-27a7d94d-14ba-4a7a-aa38-4201ddfb9020 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3c36a3114674b37aa47d8941e87a2a3', 'request_id': 'req-27a7d94d-14ba-4a7a-aa38-4201ddfb9020'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:48.565637 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-27a7d94d-14ba-4a7a-aa38-4201ddfb9020 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3c36a3114674b37aa47d8941e87a2a3', 'request_id': 'req-27a7d94d-14ba-4a7a-aa38-4201ddfb9020'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:48.689792 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-27a7d94d-14ba-4a7a-aa38-4201ddfb9020 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] The token cache is being invalidate because project f3c36a3114674b37aa47d8941e87a2a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:24:48.689792 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-27a7d94d-14ba-4a7a-aa38-4201ddfb9020 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:48.697062 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-27a7d94d-14ba-4a7a-aa38-4201ddfb9020 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:48.705610 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2262/4524] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:24:48 2022] DELETE /identity/v3/projects/f3c36a3114674b37aa47d8941e87a2a3 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:48.707090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b1055-9180-4399-8755-91d93ceb23d6 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:48.725414 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b1055-9180-4399-8755-91d93ceb23d6 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:48.833537 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c92934-3010-446e-96d9-b59dbb8fd028 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:48.834265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c92934-3010-446e-96d9-b59dbb8fd028 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:48.834555 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c92934-3010-446e-96d9-b59dbb8fd028 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:48.834838 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c92934-3010-446e-96d9-b59dbb8fd028 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:48.835557 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c92934-3010-446e-96d9-b59dbb8fd028 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:48.837315 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c92934-3010-446e-96d9-b59dbb8fd028 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:48.956378 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2263/4525] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:24:48 2022] POST /identity/v3/projects => generated 347 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:24:48.961581 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7d94d-14ba-4a7a-aa38-4201ddfb9020 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:48.963079 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-27a7d94d-14ba-4a7a-aa38-4201ddfb9020 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:48.986707 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7d94d-14ba-4a7a-aa38-4201ddfb9020 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:49.164778 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f15139-90f5-4667-b8ba-b2e8f07a6b85 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:49.165783 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f15139-90f5-4667-b8ba-b2e8f07a6b85 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:49.166506 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f15139-90f5-4667-b8ba-b2e8f07a6b85 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:49.166506 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f15139-90f5-4667-b8ba-b2e8f07a6b85 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:49.167886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f15139-90f5-4667-b8ba-b2e8f07a6b85 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:24:49.168404 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f15139-90f5-4667-b8ba-b2e8f07a6b85 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:49.170491 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f15139-90f5-4667-b8ba-b2e8f07a6b85 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:49.193850 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2263/4526] 10.222.0.23 () {58 vars in 1159 bytes} [Sat Apr 30 21:24:48 2022] GET /identity/v3/projects?is_domain=True => generated 1019 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:24:49.198015 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c92934-3010-446e-96d9-b59dbb8fd028 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:49.212873 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c92934-3010-446e-96d9-b59dbb8fd028 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:49.227693 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841b846-df65-4c54-8ec6-ff82238da5e3 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:49.228755 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841b846-df65-4c54-8ec6-ff82238da5e3 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:49.229200 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841b846-df65-4c54-8ec6-ff82238da5e3 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:49.229633 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841b846-df65-4c54-8ec6-ff82238da5e3 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:49.230540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841b846-df65-4c54-8ec6-ff82238da5e3 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:49.232567 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841b846-df65-4c54-8ec6-ff82238da5e3 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:49.261235 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2264/4527] 10.222.0.23 () {58 vars in 1127 bytes} [Sat Apr 30 21:24:49 2022] GET /identity/v3/domains => generated 828 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:24:49.265290 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f15139-90f5-4667-b8ba-b2e8f07a6b85 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:49.280881 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f15139-90f5-4667-b8ba-b2e8f07a6b85 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:49.297035 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a070192-b162-4561-9be7-d6d119bec5c2 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:49.298746 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a070192-b162-4561-9be7-d6d119bec5c2 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:49.299105 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a070192-b162-4561-9be7-d6d119bec5c2 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:49.299456 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a070192-b162-4561-9be7-d6d119bec5c2 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/projects/f66d02e781304c45a4f6ca52d5dd5d09` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:49.301819 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a070192-b162-4561-9be7-d6d119bec5c2 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:update_project(project_id=f66d02e781304c45a4f6ca52d5dd5d09)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:49.302953 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-6a070192-b162-4561-9be7-d6d119bec5c2 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:24:49.302953 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:24:49.302953 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:24:49.305615 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a070192-b162-4561-9be7-d6d119bec5c2 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:49.326779 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6a070192-b162-4561-9be7-d6d119bec5c2 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f66d02e781304c45a4f6ca52d5dd5d09'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:49.327539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6a070192-b162-4561-9be7-d6d119bec5c2 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f66d02e781304c45a4f6ca52d5dd5d09'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:49.461257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6a070192-b162-4561-9be7-d6d119bec5c2 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f66d02e781304c45a4f6ca52d5dd5d09'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:49.464629 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6a070192-b162-4561-9be7-d6d119bec5c2 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f66d02e781304c45a4f6ca52d5dd5d09'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:49.467639 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2264/4528] 10.222.0.23 () {60 vars in 1251 bytes} [Sat Apr 30 21:24:49 2022] PATCH /identity/v3/projects/f66d02e781304c45a4f6ca52d5dd5d09 => generated 361 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:24:49.471757 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841b846-df65-4c54-8ec6-ff82238da5e3 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:49.473739 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5841b846-df65-4c54-8ec6-ff82238da5e3 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:49.501924 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841b846-df65-4c54-8ec6-ff82238da5e3 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:49.594617 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef7e35-fb3f-4b7d-8df4-ddf485426431 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:49.596173 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef7e35-fb3f-4b7d-8df4-ddf485426431 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:49.596463 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef7e35-fb3f-4b7d-8df4-ddf485426431 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:49.596743 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef7e35-fb3f-4b7d-8df4-ddf485426431 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/projects/f66d02e781304c45a4f6ca52d5dd5d09` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:49.611615 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef7e35-fb3f-4b7d-8df4-ddf485426431 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f66d02e781304c45a4f6ca52d5dd5d09)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:49.615837 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef7e35-fb3f-4b7d-8df4-ddf485426431 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:49.672711 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-10ef7e35-fb3f-4b7d-8df4-ddf485426431 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f66d02e781304c45a4f6ca52d5dd5d09'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:49.677572 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-10ef7e35-fb3f-4b7d-8df4-ddf485426431 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f66d02e781304c45a4f6ca52d5dd5d09'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:49.868973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-10ef7e35-fb3f-4b7d-8df4-ddf485426431 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f66d02e781304c45a4f6ca52d5dd5d09', 'request_id': 'req-10ef7e35-fb3f-4b7d-8df4-ddf485426431'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:49.879729 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-10ef7e35-fb3f-4b7d-8df4-ddf485426431 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f66d02e781304c45a4f6ca52d5dd5d09', 'request_id': 'req-10ef7e35-fb3f-4b7d-8df4-ddf485426431'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:49.900253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-10ef7e35-fb3f-4b7d-8df4-ddf485426431 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f66d02e781304c45a4f6ca52d5dd5d09', 'request_id': 'req-10ef7e35-fb3f-4b7d-8df4-ddf485426431'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:50.142179 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-10ef7e35-fb3f-4b7d-8df4-ddf485426431 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] The token cache is being invalidate because project f66d02e781304c45a4f6ca52d5dd5d09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:24:50.142562 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-10ef7e35-fb3f-4b7d-8df4-ddf485426431 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:50.146866 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-10ef7e35-fb3f-4b7d-8df4-ddf485426431 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:50.158566 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-10ef7e35-fb3f-4b7d-8df4-ddf485426431 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f66d02e781304c45a4f6ca52d5dd5d09', 'request_id': 'req-10ef7e35-fb3f-4b7d-8df4-ddf485426431'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:50.159873 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-10ef7e35-fb3f-4b7d-8df4-ddf485426431 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f66d02e781304c45a4f6ca52d5dd5d09', 'request_id': 'req-10ef7e35-fb3f-4b7d-8df4-ddf485426431'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:50.160656 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-10ef7e35-fb3f-4b7d-8df4-ddf485426431 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f66d02e781304c45a4f6ca52d5dd5d09', 'request_id': 'req-10ef7e35-fb3f-4b7d-8df4-ddf485426431'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:50.173055 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2265/4529] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:24:49 2022] DELETE /identity/v3/projects/f66d02e781304c45a4f6ca52d5dd5d09 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:50.178403 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a070192-b162-4561-9be7-d6d119bec5c2 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:50.191259 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a070192-b162-4561-9be7-d6d119bec5c2 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:50.292973 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a1cd1-217b-4a06-a010-ce73261a4138 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:50.294287 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a1cd1-217b-4a06-a010-ce73261a4138 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:50.294757 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a1cd1-217b-4a06-a010-ce73261a4138 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:50.295053 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a1cd1-217b-4a06-a010-ce73261a4138 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:50.296629 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a1cd1-217b-4a06-a010-ce73261a4138 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:50.299054 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a1cd1-217b-4a06-a010-ce73261a4138 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:50.436980 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2265/4530] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:24:50 2022] POST /identity/v3/projects => generated 360 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:24:50.442099 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef7e35-fb3f-4b7d-8df4-ddf485426431 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:50.442099 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-10ef7e35-fb3f-4b7d-8df4-ddf485426431 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:50.463496 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef7e35-fb3f-4b7d-8df4-ddf485426431 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:50.548521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10de83a-1f01-4e06-bba2-1fa522faf1d8 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:50.555263 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10de83a-1f01-4e06-bba2-1fa522faf1d8 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:50.556046 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10de83a-1f01-4e06-bba2-1fa522faf1d8 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:50.556502 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10de83a-1f01-4e06-bba2-1fa522faf1d8 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/projects/56b6813193ba4048b8888a943333c55f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:50.558356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10de83a-1f01-4e06-bba2-1fa522faf1d8 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:get_project(project_id=56b6813193ba4048b8888a943333c55f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:50.561659 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10de83a-1f01-4e06-bba2-1fa522faf1d8 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:50.562869 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2266/4531] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:24:50 2022] GET /identity/v3/projects/56b6813193ba4048b8888a943333c55f => generated 360 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:24:50.569966 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a1cd1-217b-4a06-a010-ce73261a4138 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:50.585204 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a1cd1-217b-4a06-a010-ce73261a4138 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:50.590065 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad9368-58f3-48ed-ae1a-6e7da49b9674 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:50.590974 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad9368-58f3-48ed-ae1a-6e7da49b9674 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:50.591312 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad9368-58f3-48ed-ae1a-6e7da49b9674 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:50.591591 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad9368-58f3-48ed-ae1a-6e7da49b9674 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/projects/56b6813193ba4048b8888a943333c55f` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:50.593092 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad9368-58f3-48ed-ae1a-6e7da49b9674 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:delete_project(project_id=56b6813193ba4048b8888a943333c55f)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:50.597524 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad9368-58f3-48ed-ae1a-6e7da49b9674 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:50.763622 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-74ad9368-58f3-48ed-ae1a-6e7da49b9674 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56b6813193ba4048b8888a943333c55f', 'request_id': 'req-74ad9368-58f3-48ed-ae1a-6e7da49b9674'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:50.779772 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-74ad9368-58f3-48ed-ae1a-6e7da49b9674 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56b6813193ba4048b8888a943333c55f', 'request_id': 'req-74ad9368-58f3-48ed-ae1a-6e7da49b9674'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:50.794790 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-74ad9368-58f3-48ed-ae1a-6e7da49b9674 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56b6813193ba4048b8888a943333c55f', 'request_id': 'req-74ad9368-58f3-48ed-ae1a-6e7da49b9674'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:50.904416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-74ad9368-58f3-48ed-ae1a-6e7da49b9674 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] The token cache is being invalidate because project 56b6813193ba4048b8888a943333c55f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:24:50.904416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-74ad9368-58f3-48ed-ae1a-6e7da49b9674 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:50.907181 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-74ad9368-58f3-48ed-ae1a-6e7da49b9674 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:50.916651 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10de83a-1f01-4e06-bba2-1fa522faf1d8 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:50.917222 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2266/4532] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:24:50 2022] DELETE /identity/v3/projects/56b6813193ba4048b8888a943333c55f => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:50.918837 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c10de83a-1f01-4e06-bba2-1fa522faf1d8 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:50.937498 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10de83a-1f01-4e06-bba2-1fa522faf1d8 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:51.016203 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7d6f5-830f-4cc5-9fb2-835163508129 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:51.017583 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7d6f5-830f-4cc5-9fb2-835163508129 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:51.018289 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7d6f5-830f-4cc5-9fb2-835163508129 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:51.018887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7d6f5-830f-4cc5-9fb2-835163508129 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:51.019523 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7d6f5-830f-4cc5-9fb2-835163508129 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:51.022850 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7d6f5-830f-4cc5-9fb2-835163508129 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:51.144339 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2267/4533] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:24:50 2022] POST /identity/v3/projects => generated 361 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:24:51.148352 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad9368-58f3-48ed-ae1a-6e7da49b9674 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:51.166518 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad9368-58f3-48ed-ae1a-6e7da49b9674 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:51.329808 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc73e4-34be-4456-a7bf-2ca21b8de75a tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:51.330539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc73e4-34be-4456-a7bf-2ca21b8de75a tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:51.330652 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc73e4-34be-4456-a7bf-2ca21b8de75a tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:51.331156 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc73e4-34be-4456-a7bf-2ca21b8de75a tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/projects/80cbd95020a54ce08d695aeb7fb61f76` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:51.332503 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc73e4-34be-4456-a7bf-2ca21b8de75a tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:get_project(project_id=80cbd95020a54ce08d695aeb7fb61f76)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:51.338884 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc73e4-34be-4456-a7bf-2ca21b8de75a tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:51.349545 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2267/4534] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:24:51 2022] GET /identity/v3/projects/80cbd95020a54ce08d695aeb7fb61f76 => generated 361 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:24:51.354897 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7d6f5-830f-4cc5-9fb2-835163508129 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:51.363189 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7d6f5-830f-4cc5-9fb2-835163508129 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:51.368455 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d020b15-cc55-4c85-b9dd-0a262e773d49 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:51.369686 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d020b15-cc55-4c85-b9dd-0a262e773d49 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:51.370169 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d020b15-cc55-4c85-b9dd-0a262e773d49 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:51.370560 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d020b15-cc55-4c85-b9dd-0a262e773d49 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/projects/80cbd95020a54ce08d695aeb7fb61f76` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:51.372179 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d020b15-cc55-4c85-b9dd-0a262e773d49 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:delete_project(project_id=80cbd95020a54ce08d695aeb7fb61f76)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:51.374650 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d020b15-cc55-4c85-b9dd-0a262e773d49 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:51.783205 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8d020b15-cc55-4c85-b9dd-0a262e773d49 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80cbd95020a54ce08d695aeb7fb61f76', 'request_id': 'req-8d020b15-cc55-4c85-b9dd-0a262e773d49'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:51.788516 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8d020b15-cc55-4c85-b9dd-0a262e773d49 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80cbd95020a54ce08d695aeb7fb61f76', 'request_id': 'req-8d020b15-cc55-4c85-b9dd-0a262e773d49'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:51.795926 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8d020b15-cc55-4c85-b9dd-0a262e773d49 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80cbd95020a54ce08d695aeb7fb61f76', 'request_id': 'req-8d020b15-cc55-4c85-b9dd-0a262e773d49'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:51.928161 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8d020b15-cc55-4c85-b9dd-0a262e773d49 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] The token cache is being invalidate because project 80cbd95020a54ce08d695aeb7fb61f76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:24:51.929744 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8d020b15-cc55-4c85-b9dd-0a262e773d49 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:51.930772 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8d020b15-cc55-4c85-b9dd-0a262e773d49 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:51.934132 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2268/4535] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:24:51 2022] DELETE /identity/v3/projects/80cbd95020a54ce08d695aeb7fb61f76 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:51.939635 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc73e4-34be-4456-a7bf-2ca21b8de75a tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:51.943471 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a9dc73e4-34be-4456-a7bf-2ca21b8de75a tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:51.976342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc73e4-34be-4456-a7bf-2ca21b8de75a tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:52.075375 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f9879-4322-4d56-8f23-f852aa02c92c tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:52.075978 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f9879-4322-4d56-8f23-f852aa02c92c tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:52.076287 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f9879-4322-4d56-8f23-f852aa02c92c tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:52.076548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f9879-4322-4d56-8f23-f852aa02c92c tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:52.077252 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f9879-4322-4d56-8f23-f852aa02c92c tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:52.080058 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f9879-4322-4d56-8f23-f852aa02c92c tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:52.198650 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2268/4536] 10.222.0.23 () {60 vars in 1151 bytes} [Sat Apr 30 21:24:51 2022] POST /identity/v3/projects => generated 348 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:24:52.202365 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d020b15-cc55-4c85-b9dd-0a262e773d49 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:52.214368 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d020b15-cc55-4c85-b9dd-0a262e773d49 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:52.305005 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be48fd-3f17-479a-a7be-c7f820e26686 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:52.305992 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be48fd-3f17-479a-a7be-c7f820e26686 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:52.306290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be48fd-3f17-479a-a7be-c7f820e26686 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:52.306552 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be48fd-3f17-479a-a7be-c7f820e26686 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/projects/ba6878d4c36e47288d0c6868759fdc10` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:52.307741 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be48fd-3f17-479a-a7be-c7f820e26686 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:get_project(project_id=ba6878d4c36e47288d0c6868759fdc10)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:52.310182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be48fd-3f17-479a-a7be-c7f820e26686 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:52.312721 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2269/4537] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:24:52 2022] GET /identity/v3/projects/ba6878d4c36e47288d0c6868759fdc10 => generated 348 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:24:52.317940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f9879-4322-4d56-8f23-f852aa02c92c tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:52.333704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f9879-4322-4d56-8f23-f852aa02c92c tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:52.347282 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e18146-cd3a-40ab-84f3-e820bcb2103e tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:52.348355 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e18146-cd3a-40ab-84f3-e820bcb2103e tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:52.348652 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e18146-cd3a-40ab-84f3-e820bcb2103e tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:52.348958 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e18146-cd3a-40ab-84f3-e820bcb2103e tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/projects/ba6878d4c36e47288d0c6868759fdc10` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:52.353780 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e18146-cd3a-40ab-84f3-e820bcb2103e tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ba6878d4c36e47288d0c6868759fdc10)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:52.355931 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e18146-cd3a-40ab-84f3-e820bcb2103e tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:52.589625 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f9e18146-cd3a-40ab-84f3-e820bcb2103e tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba6878d4c36e47288d0c6868759fdc10', 'request_id': 'req-f9e18146-cd3a-40ab-84f3-e820bcb2103e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:52.599953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f9e18146-cd3a-40ab-84f3-e820bcb2103e tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba6878d4c36e47288d0c6868759fdc10', 'request_id': 'req-f9e18146-cd3a-40ab-84f3-e820bcb2103e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:52.609236 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f9e18146-cd3a-40ab-84f3-e820bcb2103e tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba6878d4c36e47288d0c6868759fdc10', 'request_id': 'req-f9e18146-cd3a-40ab-84f3-e820bcb2103e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:52.703254 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f9e18146-cd3a-40ab-84f3-e820bcb2103e tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] The token cache is being invalidate because project ba6878d4c36e47288d0c6868759fdc10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:24:52.703606 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f9e18146-cd3a-40ab-84f3-e820bcb2103e tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:52.706972 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f9e18146-cd3a-40ab-84f3-e820bcb2103e tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:52.709507 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2269/4538] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:24:52 2022] DELETE /identity/v3/projects/ba6878d4c36e47288d0c6868759fdc10 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:52.713597 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be48fd-3f17-479a-a7be-c7f820e26686 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:52.715977 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-10be48fd-3f17-479a-a7be-c7f820e26686 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:52.737580 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be48fd-3f17-479a-a7be-c7f820e26686 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:52.820616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07672b9-9ffd-4508-9689-e6e39c4db5c5 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:52.821311 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07672b9-9ffd-4508-9689-e6e39c4db5c5 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:52.821781 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07672b9-9ffd-4508-9689-e6e39c4db5c5 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:52.822086 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07672b9-9ffd-4508-9689-e6e39c4db5c5 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:52.822896 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07672b9-9ffd-4508-9689-e6e39c4db5c5 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:52.824745 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07672b9-9ffd-4508-9689-e6e39c4db5c5 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:52.967568 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2270/4539] 10.222.0.23 () {60 vars in 1148 bytes} [Sat Apr 30 21:24:52 2022] POST /identity/v3/domains => generated 277 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:24:52.972077 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e18146-cd3a-40ab-84f3-e820bcb2103e tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:52.997714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e18146-cd3a-40ab-84f3-e820bcb2103e tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:53.089179 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7c956-a9e0-4b33-a411-ae8253afb61a tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:53.089893 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7c956-a9e0-4b33-a411-ae8253afb61a tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:53.090183 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7c956-a9e0-4b33-a411-ae8253afb61a tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:53.090459 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7c956-a9e0-4b33-a411-ae8253afb61a tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:53.091160 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7c956-a9e0-4b33-a411-ae8253afb61a tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:53.093643 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7c956-a9e0-4b33-a411-ae8253afb61a tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:53.259431 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2270/4540] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:24:52 2022] POST /identity/v3/projects => generated 405 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:24:53.259943 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07672b9-9ffd-4508-9689-e6e39c4db5c5 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:53.275331 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07672b9-9ffd-4508-9689-e6e39c4db5c5 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:53.375814 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242dc95c-6d6d-4751-8048-d4375b924867 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:53.376578 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242dc95c-6d6d-4751-8048-d4375b924867 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:53.376870 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242dc95c-6d6d-4751-8048-d4375b924867 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:53.377152 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242dc95c-6d6d-4751-8048-d4375b924867 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/projects/5e76d0f1733b4a11afd757badf8257d1` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:53.379203 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242dc95c-6d6d-4751-8048-d4375b924867 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:get_project(project_id=5e76d0f1733b4a11afd757badf8257d1)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:53.381860 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242dc95c-6d6d-4751-8048-d4375b924867 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:53.384836 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2271/4541] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:24:53 2022] GET /identity/v3/projects/5e76d0f1733b4a11afd757badf8257d1 => generated 405 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:24:53.389193 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7c956-a9e0-4b33-a411-ae8253afb61a tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:53.403915 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7c956-a9e0-4b33-a411-ae8253afb61a tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:53.410639 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a0185-8542-4c6a-a8c4-32b1ef06b33c tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:53.412319 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a0185-8542-4c6a-a8c4-32b1ef06b33c tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:53.412319 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a0185-8542-4c6a-a8c4-32b1ef06b33c tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:53.412319 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a0185-8542-4c6a-a8c4-32b1ef06b33c tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/projects/5e76d0f1733b4a11afd757badf8257d1` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:53.414486 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06a0185-8542-4c6a-a8c4-32b1ef06b33c tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5e76d0f1733b4a11afd757badf8257d1)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:53.418756 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06a0185-8542-4c6a-a8c4-32b1ef06b33c tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:53.546852 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d06a0185-8542-4c6a-a8c4-32b1ef06b33c tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e76d0f1733b4a11afd757badf8257d1', 'request_id': 'req-d06a0185-8542-4c6a-a8c4-32b1ef06b33c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:53.555543 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d06a0185-8542-4c6a-a8c4-32b1ef06b33c tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e76d0f1733b4a11afd757badf8257d1', 'request_id': 'req-d06a0185-8542-4c6a-a8c4-32b1ef06b33c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:53.564292 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d06a0185-8542-4c6a-a8c4-32b1ef06b33c tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e76d0f1733b4a11afd757badf8257d1', 'request_id': 'req-d06a0185-8542-4c6a-a8c4-32b1ef06b33c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:53.628807 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d06a0185-8542-4c6a-a8c4-32b1ef06b33c tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] The token cache is being invalidate because project 5e76d0f1733b4a11afd757badf8257d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:24:53.629136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d06a0185-8542-4c6a-a8c4-32b1ef06b33c tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:53.633403 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d06a0185-8542-4c6a-a8c4-32b1ef06b33c tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:53.641242 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2271/4542] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:24:53 2022] DELETE /identity/v3/projects/5e76d0f1733b4a11afd757badf8257d1 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:53.642428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242dc95c-6d6d-4751-8048-d4375b924867 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:53.644230 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-242dc95c-6d6d-4751-8048-d4375b924867 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:53.665045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242dc95c-6d6d-4751-8048-d4375b924867 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:53.810594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc413ec6-43f1-4bc6-83ac-343ad7094f35 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:53.813105 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc413ec6-43f1-4bc6-83ac-343ad7094f35 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:53.813105 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc413ec6-43f1-4bc6-83ac-343ad7094f35 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:53.813105 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc413ec6-43f1-4bc6-83ac-343ad7094f35 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/domains/da69b0fe97a54e92bd9eee597334706b` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:53.814714 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc413ec6-43f1-4bc6-83ac-343ad7094f35 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=da69b0fe97a54e92bd9eee597334706b)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:53.816532 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc413ec6-43f1-4bc6-83ac-343ad7094f35 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:53.866803 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bc413ec6-43f1-4bc6-83ac-343ad7094f35 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'da69b0fe97a54e92bd9eee597334706b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:53.867929 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bc413ec6-43f1-4bc6-83ac-343ad7094f35 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'da69b0fe97a54e92bd9eee597334706b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:54.023304 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bc413ec6-43f1-4bc6-83ac-343ad7094f35 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'da69b0fe97a54e92bd9eee597334706b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:54.023304 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bc413ec6-43f1-4bc6-83ac-343ad7094f35 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'da69b0fe97a54e92bd9eee597334706b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:54.031576 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2272/4543] 10.222.0.23 () {60 vars in 1248 bytes} [Sat Apr 30 21:24:53 2022] PATCH /identity/v3/domains/da69b0fe97a54e92bd9eee597334706b => generated 278 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:24:54.032881 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a0185-8542-4c6a-a8c4-32b1ef06b33c tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:54.047490 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a0185-8542-4c6a-a8c4-32b1ef06b33c tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:54.188798 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d3ffe-abc5-4b68-a3d6-c77ebe89a0bf tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:54.197320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d3ffe-abc5-4b68-a3d6-c77ebe89a0bf tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:54.197541 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d3ffe-abc5-4b68-a3d6-c77ebe89a0bf tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:54.197863 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d3ffe-abc5-4b68-a3d6-c77ebe89a0bf tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/domains/da69b0fe97a54e92bd9eee597334706b` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:54.219228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d3ffe-abc5-4b68-a3d6-c77ebe89a0bf tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=da69b0fe97a54e92bd9eee597334706b)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:54.222779 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d3ffe-abc5-4b68-a3d6-c77ebe89a0bf tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:54.258502 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-683d3ffe-abc5-4b68-a3d6-c77ebe89a0bf tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'da69b0fe97a54e92bd9eee597334706b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:54.265954 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-683d3ffe-abc5-4b68-a3d6-c77ebe89a0bf tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'da69b0fe97a54e92bd9eee597334706b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:54.409567 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-683d3ffe-abc5-4b68-a3d6-c77ebe89a0bf tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da69b0fe97a54e92bd9eee597334706b', 'request_id': 'req-683d3ffe-abc5-4b68-a3d6-c77ebe89a0bf'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:54.417410 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-683d3ffe-abc5-4b68-a3d6-c77ebe89a0bf tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da69b0fe97a54e92bd9eee597334706b', 'request_id': 'req-683d3ffe-abc5-4b68-a3d6-c77ebe89a0bf'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:54.427161 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-683d3ffe-abc5-4b68-a3d6-c77ebe89a0bf tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da69b0fe97a54e92bd9eee597334706b', 'request_id': 'req-683d3ffe-abc5-4b68-a3d6-c77ebe89a0bf'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:54.548275 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-683d3ffe-abc5-4b68-a3d6-c77ebe89a0bf tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] The token cache is being invalidate because project da69b0fe97a54e92bd9eee597334706b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:24:54.548781 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-683d3ffe-abc5-4b68-a3d6-c77ebe89a0bf tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:54.549691 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-683d3ffe-abc5-4b68-a3d6-c77ebe89a0bf tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:54.567275 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-683d3ffe-abc5-4b68-a3d6-c77ebe89a0bf tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'da69b0fe97a54e92bd9eee597334706b', 'request_id': 'req-683d3ffe-abc5-4b68-a3d6-c77ebe89a0bf'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:54.570585 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-683d3ffe-abc5-4b68-a3d6-c77ebe89a0bf tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'da69b0fe97a54e92bd9eee597334706b', 'request_id': 'req-683d3ffe-abc5-4b68-a3d6-c77ebe89a0bf'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:54.571483 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-683d3ffe-abc5-4b68-a3d6-c77ebe89a0bf tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'da69b0fe97a54e92bd9eee597334706b', 'request_id': 'req-683d3ffe-abc5-4b68-a3d6-c77ebe89a0bf'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:54.596533 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2272/4544] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:24:54 2022] DELETE /identity/v3/domains/da69b0fe97a54e92bd9eee597334706b => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:54.604269 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc413ec6-43f1-4bc6-83ac-343ad7094f35 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:54.605857 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-bc413ec6-43f1-4bc6-83ac-343ad7094f35 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:54.628452 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc413ec6-43f1-4bc6-83ac-343ad7094f35 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:54.788376 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c9217-2a17-4a40-a0c1-3b993f5d6ec5 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:54.789091 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c9217-2a17-4a40-a0c1-3b993f5d6ec5 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:54.789381 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c9217-2a17-4a40-a0c1-3b993f5d6ec5 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:54.789664 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c9217-2a17-4a40-a0c1-3b993f5d6ec5 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:54.791842 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268c9217-2a17-4a40-a0c1-3b993f5d6ec5 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:54.795307 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268c9217-2a17-4a40-a0c1-3b993f5d6ec5 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:54.883746 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2273/4545] 10.222.0.23 () {60 vars in 1148 bytes} [Sat Apr 30 21:24:54 2022] POST /identity/v3/domains => generated 277 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:24:54.893339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d3ffe-abc5-4b68-a3d6-c77ebe89a0bf tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:54.895359 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-683d3ffe-abc5-4b68-a3d6-c77ebe89a0bf tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:54.920167 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d3ffe-abc5-4b68-a3d6-c77ebe89a0bf tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:55.119504 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26878d67-5421-4eee-9c22-73c7ea0c2364 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:55.120368 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26878d67-5421-4eee-9c22-73c7ea0c2364 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:55.120667 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26878d67-5421-4eee-9c22-73c7ea0c2364 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:55.120952 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26878d67-5421-4eee-9c22-73c7ea0c2364 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:55.121665 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26878d67-5421-4eee-9c22-73c7ea0c2364 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:55.129636 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26878d67-5421-4eee-9c22-73c7ea0c2364 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:55.269687 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2273/4546] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:24:54 2022] POST /identity/v3/projects => generated 407 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:24:55.274710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c9217-2a17-4a40-a0c1-3b993f5d6ec5 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:55.289542 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c9217-2a17-4a40-a0c1-3b993f5d6ec5 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:55.372879 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487df182-3b1a-4ca8-800a-2357a014cf7f tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:55.374145 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487df182-3b1a-4ca8-800a-2357a014cf7f tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:55.375073 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487df182-3b1a-4ca8-800a-2357a014cf7f tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:55.375358 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487df182-3b1a-4ca8-800a-2357a014cf7f tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:55.376106 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487df182-3b1a-4ca8-800a-2357a014cf7f tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:55.378545 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487df182-3b1a-4ca8-800a-2357a014cf7f tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:55.507892 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2274/4547] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:24:55 2022] POST /identity/v3/projects => generated 404 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:24:55.511664 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26878d67-5421-4eee-9c22-73c7ea0c2364 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:55.549256 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26878d67-5421-4eee-9c22-73c7ea0c2364 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:55.735496 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487df182-3b1a-4ca8-800a-2357a014cf7f tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:55.737956 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-487df182-3b1a-4ca8-800a-2357a014cf7f tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:55.803018 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e238e6d-39ca-4a85-8982-ed44b2ac2627 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:55.803940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e238e6d-39ca-4a85-8982-ed44b2ac2627 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:55.804235 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e238e6d-39ca-4a85-8982-ed44b2ac2627 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:55.804517 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e238e6d-39ca-4a85-8982-ed44b2ac2627 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/projects/d636bb6a562146539924f960bb1360b7` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:55.814705 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e238e6d-39ca-4a85-8982-ed44b2ac2627 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d636bb6a562146539924f960bb1360b7)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:55.816690 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e238e6d-39ca-4a85-8982-ed44b2ac2627 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:55.889926 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487df182-3b1a-4ca8-800a-2357a014cf7f tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:55.905861 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3ee1c-8552-4e8e-af8b-326c6cdd5c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:55.907728 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3ee1c-8552-4e8e-af8b-326c6cdd5c12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:55.911185 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3ee1c-8552-4e8e-af8b-326c6cdd5c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:55.911185 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3ee1c-8552-4e8e-af8b-326c6cdd5c12 admin admin] PATH_INFO: `/v3/users/17921dea12554204984a990f94a9b354` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:55.911185 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c3ee1c-8552-4e8e-af8b-326c6cdd5c12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17921dea12554204984a990f94a9b354)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:55.916385 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c3ee1c-8552-4e8e-af8b-326c6cdd5c12 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:56.020289 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7e238e6d-39ca-4a85-8982-ed44b2ac2627 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd636bb6a562146539924f960bb1360b7', 'request_id': 'req-7e238e6d-39ca-4a85-8982-ed44b2ac2627'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:56.033007 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7e238e6d-39ca-4a85-8982-ed44b2ac2627 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd636bb6a562146539924f960bb1360b7', 'request_id': 'req-7e238e6d-39ca-4a85-8982-ed44b2ac2627'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:56.054179 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7e238e6d-39ca-4a85-8982-ed44b2ac2627 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd636bb6a562146539924f960bb1360b7', 'request_id': 'req-7e238e6d-39ca-4a85-8982-ed44b2ac2627'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:56.412635 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7e238e6d-39ca-4a85-8982-ed44b2ac2627 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] The token cache is being invalidate because project d636bb6a562146539924f960bb1360b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:24:56.413230 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7e238e6d-39ca-4a85-8982-ed44b2ac2627 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:56.414320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7e238e6d-39ca-4a85-8982-ed44b2ac2627 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:56.417425 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2274/4548] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:24:55 2022] DELETE /identity/v3/projects/d636bb6a562146539924f960bb1360b7 => generated 0 bytes in 906 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:56.421929 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e238e6d-39ca-4a85-8982-ed44b2ac2627 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:56.429997 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7e238e6d-39ca-4a85-8982-ed44b2ac2627 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:56.512219 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f3c3ee1c-8552-4e8e-af8b-326c6cdd5c12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17921dea12554204984a990f94a9b354'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:56.547015 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f3c3ee1c-8552-4e8e-af8b-326c6cdd5c12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17921dea12554204984a990f94a9b354'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:56.621117 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e238e6d-39ca-4a85-8982-ed44b2ac2627 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:56.634382 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f3c3ee1c-8552-4e8e-af8b-326c6cdd5c12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17921dea12554204984a990f94a9b354'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:56.634878 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf87b7-9028-4134-8857-4f093c11fd45 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:56.636003 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf87b7-9028-4134-8857-4f093c11fd45 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:56.636473 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf87b7-9028-4134-8857-4f093c11fd45 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:56.636936 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf87b7-9028-4134-8857-4f093c11fd45 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/projects/dd4b0c4861674a78a8c6f7a9e66c7b0f` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:56.638392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf87b7-9028-4134-8857-4f093c11fd45 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dd4b0c4861674a78a8c6f7a9e66c7b0f)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:56.640515 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf87b7-9028-4134-8857-4f093c11fd45 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:56.647255 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f3c3ee1c-8552-4e8e-af8b-326c6cdd5c12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17921dea12554204984a990f94a9b354'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:56.648189 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f3c3ee1c-8552-4e8e-af8b-326c6cdd5c12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17921dea12554204984a990f94a9b354'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:56.677852 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2275/4549] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:24:55 2022] DELETE /identity/v3/users/17921dea12554204984a990f94a9b354 => generated 0 bytes in 941 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:24:56.809257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c2bf87b7-9028-4134-8857-4f093c11fd45 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd4b0c4861674a78a8c6f7a9e66c7b0f', 'request_id': 'req-c2bf87b7-9028-4134-8857-4f093c11fd45'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:56.826053 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c2bf87b7-9028-4134-8857-4f093c11fd45 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd4b0c4861674a78a8c6f7a9e66c7b0f', 'request_id': 'req-c2bf87b7-9028-4134-8857-4f093c11fd45'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:56.842678 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c2bf87b7-9028-4134-8857-4f093c11fd45 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd4b0c4861674a78a8c6f7a9e66c7b0f', 'request_id': 'req-c2bf87b7-9028-4134-8857-4f093c11fd45'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:56.960188 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c2bf87b7-9028-4134-8857-4f093c11fd45 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] The token cache is being invalidate because project dd4b0c4861674a78a8c6f7a9e66c7b0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:24:56.960767 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c2bf87b7-9028-4134-8857-4f093c11fd45 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:56.963048 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c2bf87b7-9028-4134-8857-4f093c11fd45 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:56.965464 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2275/4550] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:24:56 2022] DELETE /identity/v3/projects/dd4b0c4861674a78a8c6f7a9e66c7b0f => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:56.969675 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3ee1c-8552-4e8e-af8b-326c6cdd5c12 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:56.971426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f3c3ee1c-8552-4e8e-af8b-326c6cdd5c12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:57.079486 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf87b7-9028-4134-8857-4f093c11fd45 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:57.079486 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c2bf87b7-9028-4134-8857-4f093c11fd45 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:57.199124 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3ee1c-8552-4e8e-af8b-326c6cdd5c12 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:57.234823 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf87b7-9028-4134-8857-4f093c11fd45 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:57.239860 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6bc08-8cac-464f-aa6a-0c881e0329eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:57.240703 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6bc08-8cac-464f-aa6a-0c881e0329eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:57.240991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6bc08-8cac-464f-aa6a-0c881e0329eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:57.241273 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6bc08-8cac-464f-aa6a-0c881e0329eb admin admin] PATH_INFO: `/v3/projects/dd851d0a5daa4d03977b37c9b6904b6c` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:57.242702 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e6bc08-8cac-464f-aa6a-0c881e0329eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd851d0a5daa4d03977b37c9b6904b6c)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:57.244743 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e6bc08-8cac-464f-aa6a-0c881e0329eb admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:57.319968 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dffdc1b-8296-469a-bf69-8e0f4b297134 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:57.320856 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffdc1b-8296-469a-bf69-8e0f4b297134 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:57.321144 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffdc1b-8296-469a-bf69-8e0f4b297134 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:57.321430 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffdc1b-8296-469a-bf69-8e0f4b297134 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/domains/79057cd07dd04752868cfaf2bc623705` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:57.323159 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dffdc1b-8296-469a-bf69-8e0f4b297134 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=79057cd07dd04752868cfaf2bc623705)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:57.324969 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dffdc1b-8296-469a-bf69-8e0f4b297134 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:57.354749 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7dffdc1b-8296-469a-bf69-8e0f4b297134 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '79057cd07dd04752868cfaf2bc623705'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:57.356119 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7dffdc1b-8296-469a-bf69-8e0f4b297134 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '79057cd07dd04752868cfaf2bc623705'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:57.408461 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f6e6bc08-8cac-464f-aa6a-0c881e0329eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd851d0a5daa4d03977b37c9b6904b6c', 'request_id': 'req-f6e6bc08-8cac-464f-aa6a-0c881e0329eb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:57.421903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f6e6bc08-8cac-464f-aa6a-0c881e0329eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd851d0a5daa4d03977b37c9b6904b6c', 'request_id': 'req-f6e6bc08-8cac-464f-aa6a-0c881e0329eb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:57.446346 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f6e6bc08-8cac-464f-aa6a-0c881e0329eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd851d0a5daa4d03977b37c9b6904b6c', 'request_id': 'req-f6e6bc08-8cac-464f-aa6a-0c881e0329eb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:57.494277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7dffdc1b-8296-469a-bf69-8e0f4b297134 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '79057cd07dd04752868cfaf2bc623705'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:57.495200 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7dffdc1b-8296-469a-bf69-8e0f4b297134 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '79057cd07dd04752868cfaf2bc623705'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:57.502538 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2276/4551] 10.222.0.23 () {60 vars in 1248 bytes} [Sat Apr 30 21:24:56 2022] PATCH /identity/v3/domains/79057cd07dd04752868cfaf2bc623705 => generated 278 bytes in 533 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:24:57.503524 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dffdc1b-8296-469a-bf69-8e0f4b297134 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:57.505417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7dffdc1b-8296-469a-bf69-8e0f4b297134 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:57.535313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f6e6bc08-8cac-464f-aa6a-0c881e0329eb admin admin] The token cache is being invalidate because project dd851d0a5daa4d03977b37c9b6904b6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:24:57.535871 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f6e6bc08-8cac-464f-aa6a-0c881e0329eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:57.537116 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f6e6bc08-8cac-464f-aa6a-0c881e0329eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:57.540543 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2276/4552] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:24:57 2022] DELETE /identity/v3/projects/dd851d0a5daa4d03977b37c9b6904b6c => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:57.545465 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a36b36-a15a-420f-b8b2-b50e6ce823d3 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:57.546281 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a36b36-a15a-420f-b8b2-b50e6ce823d3 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:57.547442 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a36b36-a15a-420f-b8b2-b50e6ce823d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:57.579487 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-17a36b36-a15a-420f-b8b2-b50e6ce823d3 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:57.582637 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-17a36b36-a15a-420f-b8b2-b50e6ce823d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:57.641602 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dffdc1b-8296-469a-bf69-8e0f4b297134 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:57.702905 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2277/4553] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:24:57.711252 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062f349-da84-4e22-b0a6-27292611081e None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:57.711967 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062f349-da84-4e22-b0a6-27292611081e None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:57.712239 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062f349-da84-4e22-b0a6-27292611081e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:57.714142 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d320b-6523-4384-adcf-8c8b0df75ac2 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:57.715371 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d320b-6523-4384-adcf-8c8b0df75ac2 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:57.715731 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d320b-6523-4384-adcf-8c8b0df75ac2 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:57.716356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d320b-6523-4384-adcf-8c8b0df75ac2 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/domains/79057cd07dd04752868cfaf2bc623705` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:57.732104 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-8062f349-da84-4e22-b0a6-27292611081e None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:57.734034 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8062f349-da84-4e22-b0a6-27292611081e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:57.737642 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d320b-6523-4384-adcf-8c8b0df75ac2 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=79057cd07dd04752868cfaf2bc623705)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:57.740186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d320b-6523-4384-adcf-8c8b0df75ac2 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:57.751357 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2278/4554] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:24:57.753309 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062f349-da84-4e22-b0a6-27292611081e None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:57.765359 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062f349-da84-4e22-b0a6-27292611081e None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:57.772295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f276e7c-bdd9-4d9c-b726-54ac5885e96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:57.772977 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f276e7c-bdd9-4d9c-b726-54ac5885e96a admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:57.773325 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f276e7c-bdd9-4d9c-b726-54ac5885e96a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:57.773614 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f276e7c-bdd9-4d9c-b726-54ac5885e96a admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:57.774592 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f276e7c-bdd9-4d9c-b726-54ac5885e96a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:24:57.774890 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f276e7c-bdd9-4d9c-b726-54ac5885e96a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:57.777686 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f276e7c-bdd9-4d9c-b726-54ac5885e96a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:57.781940 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-965d320b-6523-4384-adcf-8c8b0df75ac2 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '79057cd07dd04752868cfaf2bc623705'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:57.783723 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-965d320b-6523-4384-adcf-8c8b0df75ac2 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '79057cd07dd04752868cfaf2bc623705'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:57.812081 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2279/4555] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:24:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:24:57.813678 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f276e7c-bdd9-4d9c-b726-54ac5885e96a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:57.832338 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f276e7c-bdd9-4d9c-b726-54ac5885e96a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:57.838046 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd33fce-c917-40c5-addb-0409a25ba0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:57.838719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd33fce-c917-40c5-addb-0409a25ba0e4 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:57.839005 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd33fce-c917-40c5-addb-0409a25ba0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:57.839557 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd33fce-c917-40c5-addb-0409a25ba0e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:57.840299 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd33fce-c917-40c5-addb-0409a25ba0e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:57.842351 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd33fce-c917-40c5-addb-0409a25ba0e4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:57.917153 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-965d320b-6523-4384-adcf-8c8b0df75ac2 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79057cd07dd04752868cfaf2bc623705', 'request_id': 'req-965d320b-6523-4384-adcf-8c8b0df75ac2'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:57.925878 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-965d320b-6523-4384-adcf-8c8b0df75ac2 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79057cd07dd04752868cfaf2bc623705', 'request_id': 'req-965d320b-6523-4384-adcf-8c8b0df75ac2'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:57.932898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-965d320b-6523-4384-adcf-8c8b0df75ac2 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79057cd07dd04752868cfaf2bc623705', 'request_id': 'req-965d320b-6523-4384-adcf-8c8b0df75ac2'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:57.952473 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2280/4556] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:24:57 2022] POST /identity/v3/projects => generated 387 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:24:57.957171 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd33fce-c917-40c5-addb-0409a25ba0e4 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:58.013335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-965d320b-6523-4384-adcf-8c8b0df75ac2 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] The token cache is being invalidate because project 79057cd07dd04752868cfaf2bc623705 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:24:58.014030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-965d320b-6523-4384-adcf-8c8b0df75ac2 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:58.015355 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-965d320b-6523-4384-adcf-8c8b0df75ac2 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:58.038090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-965d320b-6523-4384-adcf-8c8b0df75ac2 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '79057cd07dd04752868cfaf2bc623705', 'request_id': 'req-965d320b-6523-4384-adcf-8c8b0df75ac2'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:58.040645 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-965d320b-6523-4384-adcf-8c8b0df75ac2 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '79057cd07dd04752868cfaf2bc623705', 'request_id': 'req-965d320b-6523-4384-adcf-8c8b0df75ac2'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:58.044726 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-965d320b-6523-4384-adcf-8c8b0df75ac2 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '79057cd07dd04752868cfaf2bc623705', 'request_id': 'req-965d320b-6523-4384-adcf-8c8b0df75ac2'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:58.081188 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2277/4557] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:24:57 2022] DELETE /identity/v3/domains/79057cd07dd04752868cfaf2bc623705 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:58.082794 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d320b-6523-4384-adcf-8c8b0df75ac2 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:58.086282 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-965d320b-6523-4384-adcf-8c8b0df75ac2 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:58.153299 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd33fce-c917-40c5-addb-0409a25ba0e4 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:58.163991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb20d62-1c76-4a99-a161-5be6afb91cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:58.165802 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb20d62-1c76-4a99-a161-5be6afb91cc9 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:58.166647 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb20d62-1c76-4a99-a161-5be6afb91cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:58.167151 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb20d62-1c76-4a99-a161-5be6afb91cc9 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:58.174795 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb20d62-1c76-4a99-a161-5be6afb91cc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:58.179613 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb20d62-1c76-4a99-a161-5be6afb91cc9 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:58.223658 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d320b-6523-4384-adcf-8c8b0df75ac2 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:58.295068 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59be822-c35b-447b-8474-c874239337ce tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:58.295856 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59be822-c35b-447b-8474-c874239337ce tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:58.296446 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59be822-c35b-447b-8474-c874239337ce tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:58.296790 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59be822-c35b-447b-8474-c874239337ce tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:58.299041 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59be822-c35b-447b-8474-c874239337ce tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:58.301042 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59be822-c35b-447b-8474-c874239337ce tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:58.307524 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2281/4558] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:24:57 2022] POST /identity/v3/users => generated 294 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:24:58.308388 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb20d62-1c76-4a99-a161-5be6afb91cc9 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:58.315342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-edb20d62-1c76-4a99-a161-5be6afb91cc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:58.332470 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb20d62-1c76-4a99-a161-5be6afb91cc9 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:58.338532 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560d0dc-ca28-41a6-8931-7483a0cb55e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:58.339587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560d0dc-ca28-41a6-8931-7483a0cb55e9 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:58.340043 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560d0dc-ca28-41a6-8931-7483a0cb55e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:58.340587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560d0dc-ca28-41a6-8931-7483a0cb55e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:58.341718 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560d0dc-ca28-41a6-8931-7483a0cb55e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:58.343690 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560d0dc-ca28-41a6-8931-7483a0cb55e9 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:58.356236 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2282/4559] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:24:58.360947 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560d0dc-ca28-41a6-8931-7483a0cb55e9 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:58.371016 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560d0dc-ca28-41a6-8931-7483a0cb55e9 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:58.376311 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525397c-e0d2-4937-8874-baed1a76038f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:58.377041 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525397c-e0d2-4937-8874-baed1a76038f admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:58.377325 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525397c-e0d2-4937-8874-baed1a76038f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:58.377603 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525397c-e0d2-4937-8874-baed1a76038f admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:58.378417 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0525397c-e0d2-4937-8874-baed1a76038f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:58.380198 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0525397c-e0d2-4937-8874-baed1a76038f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:58.391550 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2283/4560] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:24:58.395595 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525397c-e0d2-4937-8874-baed1a76038f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:58.405197 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525397c-e0d2-4937-8874-baed1a76038f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:58.410498 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03118885-2a15-403d-b339-0ec5a7cbab90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:58.414918 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03118885-2a15-403d-b339-0ec5a7cbab90 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:58.414918 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03118885-2a15-403d-b339-0ec5a7cbab90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:58.414918 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03118885-2a15-403d-b339-0ec5a7cbab90 admin admin] PATH_INFO: `/v3/projects/1236f389e69047b8add7cbc7cefe8f24/users/a466ad74049c4383af4a5f43f7023728/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:58.420200 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2278/4561] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:24:58 2022] POST /identity/v3/projects => generated 376 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:24:58.421915 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59be822-c35b-447b-8474-c874239337ce tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:58.430125 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03118885-2a15-403d-b339-0ec5a7cbab90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1236f389e69047b8add7cbc7cefe8f24, user_id=a466ad74049c4383af4a5f43f7023728, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:58.432839 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03118885-2a15-403d-b339-0ec5a7cbab90 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:58.491493 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59be822-c35b-447b-8474-c874239337ce tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:58.496024 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39e42f-a929-41d2-a6bf-00e35d2617d0 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:58.497073 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39e42f-a929-41d2-a6bf-00e35d2617d0 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:58.497520 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39e42f-a929-41d2-a6bf-00e35d2617d0 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:58.497992 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39e42f-a929-41d2-a6bf-00e35d2617d0 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/projects/034080ef10704b5a9d7199fef853b7ee` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:58.499418 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe39e42f-a929-41d2-a6bf-00e35d2617d0 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:get_project(project_id=034080ef10704b5a9d7199fef853b7ee)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:58.502561 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe39e42f-a929-41d2-a6bf-00e35d2617d0 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:58.504639 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2279/4562] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:24:58 2022] GET /identity/v3/projects/034080ef10704b5a9d7199fef853b7ee => generated 376 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:24:58.508486 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39e42f-a929-41d2-a6bf-00e35d2617d0 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:58.520085 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39e42f-a929-41d2-a6bf-00e35d2617d0 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:58.526108 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79078a1e-c65c-40d1-894a-10173107f0b8 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:58.527077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79078a1e-c65c-40d1-894a-10173107f0b8 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:58.527523 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79078a1e-c65c-40d1-894a-10173107f0b8 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:58.528112 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79078a1e-c65c-40d1-894a-10173107f0b8 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:58.529021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79078a1e-c65c-40d1-894a-10173107f0b8 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:58.530481 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-79078a1e-c65c-40d1-894a-10173107f0b8 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:24:58.530481 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:24:58.530481 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:24:58.535013 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79078a1e-c65c-40d1-894a-10173107f0b8 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:58.538677 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2284/4563] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:24:58 2022] PUT /identity/v3/projects/1236f389e69047b8add7cbc7cefe8f24/users/a466ad74049c4383af4a5f43f7023728/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:24:58.544482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82359a83-6f63-4863-84c5-74c8ca18b592 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:58.545106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82359a83-6f63-4863-84c5-74c8ca18b592 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:58.545397 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82359a83-6f63-4863-84c5-74c8ca18b592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:58.567304 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2280/4564] 10.222.0.23 () {58 vars in 1130 bytes} [Sat Apr 30 21:24:58 2022] GET /identity/v3/projects => generated 7329 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:24:58.567814 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-82359a83-6f63-4863-84c5-74c8ca18b592 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:24:58.569134 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-82359a83-6f63-4863-84c5-74c8ca18b592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:58.571897 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79078a1e-c65c-40d1-894a-10173107f0b8 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:58.583261 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79078a1e-c65c-40d1-894a-10173107f0b8 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:58.646111 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2285/4565] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:24:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:24:58.650353 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3cbef-ea6a-45fe-927f-091c62d57f1d tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:58.651310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3cbef-ea6a-45fe-927f-091c62d57f1d tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:58.651310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3cbef-ea6a-45fe-927f-091c62d57f1d tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:58.651603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3cbef-ea6a-45fe-927f-091c62d57f1d tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/projects/034080ef10704b5a9d7199fef853b7ee` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:58.653024 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d3cbef-ea6a-45fe-927f-091c62d57f1d tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:delete_project(project_id=034080ef10704b5a9d7199fef853b7ee)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:58.655006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d3cbef-ea6a-45fe-927f-091c62d57f1d tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:58.669414 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82359a83-6f63-4863-84c5-74c8ca18b592 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:58.671704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-82359a83-6f63-4863-84c5-74c8ca18b592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:58.764667 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82359a83-6f63-4863-84c5-74c8ca18b592 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:58.770365 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe489d-d9a2-4ac5-b821-07f384e99603 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:58.771065 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe489d-d9a2-4ac5-b821-07f384e99603 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:58.771305 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe489d-d9a2-4ac5-b821-07f384e99603 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:58.771586 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe489d-d9a2-4ac5-b821-07f384e99603 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:58.789047 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe489d-d9a2-4ac5-b821-07f384e99603 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:58.790603 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe489d-d9a2-4ac5-b821-07f384e99603 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:58.801654 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2286/4566] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:24:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:24:58.803895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d6d3cbef-ea6a-45fe-927f-091c62d57f1d tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '034080ef10704b5a9d7199fef853b7ee', 'request_id': 'req-d6d3cbef-ea6a-45fe-927f-091c62d57f1d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:58.809940 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d6d3cbef-ea6a-45fe-927f-091c62d57f1d tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '034080ef10704b5a9d7199fef853b7ee', 'request_id': 'req-d6d3cbef-ea6a-45fe-927f-091c62d57f1d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:58.816725 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d6d3cbef-ea6a-45fe-927f-091c62d57f1d tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '034080ef10704b5a9d7199fef853b7ee', 'request_id': 'req-d6d3cbef-ea6a-45fe-927f-091c62d57f1d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:58.892603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d6d3cbef-ea6a-45fe-927f-091c62d57f1d tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] The token cache is being invalidate because project 034080ef10704b5a9d7199fef853b7ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:24:58.892893 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d6d3cbef-ea6a-45fe-927f-091c62d57f1d tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:58.894049 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d6d3cbef-ea6a-45fe-927f-091c62d57f1d tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:58.897014 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2281/4567] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:24:58 2022] DELETE /identity/v3/projects/034080ef10704b5a9d7199fef853b7ee => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:58.901868 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe489d-d9a2-4ac5-b821-07f384e99603 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:58.918834 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe489d-d9a2-4ac5-b821-07f384e99603 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:59.032844 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c33661-5ee7-4d0c-9741-43b1ba564ceb tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:59.033523 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c33661-5ee7-4d0c-9741-43b1ba564ceb tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:59.034022 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c33661-5ee7-4d0c-9741-43b1ba564ceb tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:59.034303 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c33661-5ee7-4d0c-9741-43b1ba564ceb tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:59.034999 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c33661-5ee7-4d0c-9741-43b1ba564ceb tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:59.036939 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c33661-5ee7-4d0c-9741-43b1ba564ceb tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:59.169535 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2287/4568] 10.222.0.23 () {60 vars in 1151 bytes} [Sat Apr 30 21:24:58 2022] POST /identity/v3/projects => generated 347 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:24:59.174854 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3cbef-ea6a-45fe-927f-091c62d57f1d tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:59.177581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d6d3cbef-ea6a-45fe-927f-091c62d57f1d tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:59.194174 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3cbef-ea6a-45fe-927f-091c62d57f1d tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:59.299530 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e8259b-4972-4c62-b214-b2b0f3b0e49e tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:59.300456 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8259b-4972-4c62-b214-b2b0f3b0e49e tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:59.300894 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8259b-4972-4c62-b214-b2b0f3b0e49e tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:59.301179 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8259b-4972-4c62-b214-b2b0f3b0e49e tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/projects/821d5c48a6754e51b2d57b6e27ec5a6d` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:59.302491 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e8259b-4972-4c62-b214-b2b0f3b0e49e tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:update_project(project_id=821d5c48a6754e51b2d57b6e27ec5a6d)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:59.303838 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-47e8259b-4972-4c62-b214-b2b0f3b0e49e tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:24:59.303838 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:24:59.303838 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:24:59.305068 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e8259b-4972-4c62-b214-b2b0f3b0e49e tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:59.449573 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2282/4569] 10.222.0.23 () {60 vars in 1251 bytes} [Sat Apr 30 21:24:59 2022] PATCH /identity/v3/projects/821d5c48a6754e51b2d57b6e27ec5a6d => generated 360 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:24:59.451103 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c33661-5ee7-4d0c-9741-43b1ba564ceb tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:59.464839 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c33661-5ee7-4d0c-9741-43b1ba564ceb tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:59.474078 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3a653-fefd-4483-89e8-ec8338adedc6 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:59.474957 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3a653-fefd-4483-89e8-ec8338adedc6 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:59.475245 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3a653-fefd-4483-89e8-ec8338adedc6 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:59.475664 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3a653-fefd-4483-89e8-ec8338adedc6 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/projects/821d5c48a6754e51b2d57b6e27ec5a6d` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:59.491663 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e3a653-fefd-4483-89e8-ec8338adedc6 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:get_project(project_id=821d5c48a6754e51b2d57b6e27ec5a6d)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:59.495594 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e3a653-fefd-4483-89e8-ec8338adedc6 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:59.499547 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2288/4570] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:24:59 2022] GET /identity/v3/projects/821d5c48a6754e51b2d57b6e27ec5a6d => generated 347 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:24:59.501154 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e8259b-4972-4c62-b214-b2b0f3b0e49e tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:59.518788 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e8259b-4972-4c62-b214-b2b0f3b0e49e tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:59.531583 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc7303-9d09-4c07-b731-f855832f60f5 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:59.532603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc7303-9d09-4c07-b731-f855832f60f5 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:59.532791 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc7303-9d09-4c07-b731-f855832f60f5 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:59.533065 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc7303-9d09-4c07-b731-f855832f60f5 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/projects/821d5c48a6754e51b2d57b6e27ec5a6d` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:59.538780 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc7303-9d09-4c07-b731-f855832f60f5 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:delete_project(project_id=821d5c48a6754e51b2d57b6e27ec5a6d)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:59.540807 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc7303-9d09-4c07-b731-f855832f60f5 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:59.687121 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f8dc7303-9d09-4c07-b731-f855832f60f5 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '821d5c48a6754e51b2d57b6e27ec5a6d', 'request_id': 'req-f8dc7303-9d09-4c07-b731-f855832f60f5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:59.698538 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f8dc7303-9d09-4c07-b731-f855832f60f5 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '821d5c48a6754e51b2d57b6e27ec5a6d', 'request_id': 'req-f8dc7303-9d09-4c07-b731-f855832f60f5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:59.702188 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f8dc7303-9d09-4c07-b731-f855832f60f5 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '821d5c48a6754e51b2d57b6e27ec5a6d', 'request_id': 'req-f8dc7303-9d09-4c07-b731-f855832f60f5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:59.772887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f8dc7303-9d09-4c07-b731-f855832f60f5 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] The token cache is being invalidate because project 821d5c48a6754e51b2d57b6e27ec5a6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:24:59.772887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f8dc7303-9d09-4c07-b731-f855832f60f5 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:59.773155 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f8dc7303-9d09-4c07-b731-f855832f60f5 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:24:59.775659 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2283/4571] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:24:59 2022] DELETE /identity/v3/projects/821d5c48a6754e51b2d57b6e27ec5a6d => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:24:59.780428 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3a653-fefd-4483-89e8-ec8338adedc6 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:59.783050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-53e3a653-fefd-4483-89e8-ec8338adedc6 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:24:59.799630 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3a653-fefd-4483-89e8-ec8338adedc6 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:24:59.874248 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd422dbd-e4b1-4364-98d1-593a57b57bc1 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:24:59.875056 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd422dbd-e4b1-4364-98d1-593a57b57bc1 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:24:59.876081 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd422dbd-e4b1-4364-98d1-593a57b57bc1 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:24:59.876375 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd422dbd-e4b1-4364-98d1-593a57b57bc1 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:24:59.877078 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd422dbd-e4b1-4364-98d1-593a57b57bc1 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:24:59.879240 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd422dbd-e4b1-4364-98d1-593a57b57bc1 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:24:59.981431 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2289/4572] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:24:59 2022] POST /identity/v3/projects => generated 360 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:24:59.983755 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc7303-9d09-4c07-b731-f855832f60f5 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:24:59.995288 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc7303-9d09-4c07-b731-f855832f60f5 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:00.062687 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f26fbbe-c7e6-45e1-a1d5-ed5353b3985f tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:00.064093 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26fbbe-c7e6-45e1-a1d5-ed5353b3985f tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:00.064380 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26fbbe-c7e6-45e1-a1d5-ed5353b3985f tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:00.064657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26fbbe-c7e6-45e1-a1d5-ed5353b3985f tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/projects/47eb22927a6e4e619220bad248c2b7d0` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:00.065983 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f26fbbe-c7e6-45e1-a1d5-ed5353b3985f tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:update_project(project_id=47eb22927a6e4e619220bad248c2b7d0)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:00.068092 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f26fbbe-c7e6-45e1-a1d5-ed5353b3985f tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:00.217022 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2284/4573] 10.222.0.23 () {60 vars in 1251 bytes} [Sat Apr 30 21:24:59 2022] PATCH /identity/v3/projects/47eb22927a6e4e619220bad248c2b7d0 => generated 372 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:25:00.221748 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd422dbd-e4b1-4364-98d1-593a57b57bc1 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:00.238506 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd422dbd-e4b1-4364-98d1-593a57b57bc1 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:00.246277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29943271-8990-4671-9329-c6b855abd89e tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:00.247477 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29943271-8990-4671-9329-c6b855abd89e tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:00.247863 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29943271-8990-4671-9329-c6b855abd89e tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:00.248261 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29943271-8990-4671-9329-c6b855abd89e tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/projects/47eb22927a6e4e619220bad248c2b7d0` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:00.283501 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f46a74-dd95-4706-a462-73e4c220674e None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:00.286356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f46a74-dd95-4706-a462-73e4c220674e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:00.286465 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f46a74-dd95-4706-a462-73e4c220674e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:00.303962 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29943271-8990-4671-9329-c6b855abd89e tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:get_project(project_id=47eb22927a6e4e619220bad248c2b7d0)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:00.310644 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29943271-8990-4671-9329-c6b855abd89e tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:00.315878 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2290/4574] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:25:00 2022] GET /identity/v3/projects/47eb22927a6e4e619220bad248c2b7d0 => generated 359 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:25:00.317497 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29943271-8990-4671-9329-c6b855abd89e tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:00.333452 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29943271-8990-4671-9329-c6b855abd89e tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:00.342881 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-85f46a74-dd95-4706-a462-73e4c220674e None None] MFA Rules not processed for user `a466ad74049c4383af4a5f43f7023728`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:00.345132 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-85f46a74-dd95-4706-a462-73e4c220674e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:00.348709 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d00e3-7b56-48ce-8473-a09ab8a86292 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:00.349653 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d00e3-7b56-48ce-8473-a09ab8a86292 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:00.349984 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d00e3-7b56-48ce-8473-a09ab8a86292 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:00.350269 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d00e3-7b56-48ce-8473-a09ab8a86292 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/projects/47eb22927a6e4e619220bad248c2b7d0` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:00.351920 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d00e3-7b56-48ce-8473-a09ab8a86292 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:delete_project(project_id=47eb22927a6e4e619220bad248c2b7d0)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:00.356334 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d00e3-7b56-48ce-8473-a09ab8a86292 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:00.457237 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2285/4575] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:25:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:25:00.466691 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0f1e2-eba8-4f28-b03a-accff8430f19 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:00.466979 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0f1e2-eba8-4f28-b03a-accff8430f19 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:00.467263 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0f1e2-eba8-4f28-b03a-accff8430f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:00.469912 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-780d00e3-7b56-48ce-8473-a09ab8a86292 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47eb22927a6e4e619220bad248c2b7d0', 'request_id': 'req-780d00e3-7b56-48ce-8473-a09ab8a86292'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:00.477270 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-780d00e3-7b56-48ce-8473-a09ab8a86292 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47eb22927a6e4e619220bad248c2b7d0', 'request_id': 'req-780d00e3-7b56-48ce-8473-a09ab8a86292'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:00.484420 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-780d00e3-7b56-48ce-8473-a09ab8a86292 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47eb22927a6e4e619220bad248c2b7d0', 'request_id': 'req-780d00e3-7b56-48ce-8473-a09ab8a86292'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:00.499941 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-53f0f1e2-eba8-4f28-b03a-accff8430f19 None None] MFA Rules not processed for user `a466ad74049c4383af4a5f43f7023728`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:00.502416 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-53f0f1e2-eba8-4f28-b03a-accff8430f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:00.564447 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2286/4576] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:25:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:25:00.567312 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-780d00e3-7b56-48ce-8473-a09ab8a86292 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] The token cache is being invalidate because project 47eb22927a6e4e619220bad248c2b7d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:25:00.567647 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-780d00e3-7b56-48ce-8473-a09ab8a86292 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:00.568662 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-780d00e3-7b56-48ce-8473-a09ab8a86292 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:00.574487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3cbb4-9ae0-45c4-8345-3f870fa9ad47 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:00.574697 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2291/4577] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:25:00 2022] DELETE /identity/v3/projects/47eb22927a6e4e619220bad248c2b7d0 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:00.574978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3cbb4-9ae0-45c4-8345-3f870fa9ad47 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:00.575368 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3cbb4-9ae0-45c4-8345-3f870fa9ad47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:00.575488 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d00e3-7b56-48ce-8473-a09ab8a86292 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:00.577380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-780d00e3-7b56-48ce-8473-a09ab8a86292 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:00.599493 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-9ec3cbb4-9ae0-45c4-8345-3f870fa9ad47 None None] MFA Rules not processed for user `a466ad74049c4383af4a5f43f7023728`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:00.603162 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9ec3cbb4-9ae0-45c4-8345-3f870fa9ad47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:00.608389 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2287/4578] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:25:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:25:00.620537 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3cbb4-9ae0-45c4-8345-3f870fa9ad47 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:00.624150 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9ec3cbb4-9ae0-45c4-8345-3f870fa9ad47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:00.668967 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d00e3-7b56-48ce-8473-a09ab8a86292 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:00.681662 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c64d1e-f1a0-4d89-a54f-cd9bf3db8c99 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:00.694169 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c64d1e-f1a0-4d89-a54f-cd9bf3db8c99 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:00.694169 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c64d1e-f1a0-4d89-a54f-cd9bf3db8c99 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:00.694169 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c64d1e-f1a0-4d89-a54f-cd9bf3db8c99 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:00.694909 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c64d1e-f1a0-4d89-a54f-cd9bf3db8c99 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:00.698733 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c64d1e-f1a0-4d89-a54f-cd9bf3db8c99 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:00.757281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3cbb4-9ae0-45c4-8345-3f870fa9ad47 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:00.763098 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d50ab-5128-4d6f-8e9e-cf68a7fa8949 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:00.763743 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d50ab-5128-4d6f-8e9e-cf68a7fa8949 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:00.764060 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d50ab-5128-4d6f-8e9e-cf68a7fa8949 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:00.764296 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d50ab-5128-4d6f-8e9e-cf68a7fa8949 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:00.766677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-df9d50ab-5128-4d6f-8e9e-cf68a7fa8949 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:00.777343 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d50ab-5128-4d6f-8e9e-cf68a7fa8949 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:00.778973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d50ab-5128-4d6f-8e9e-cf68a7fa8949 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:00.789015 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2288/4579] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:25:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:25:00.838764 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2292/4580] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:25:00 2022] POST /identity/v3/projects => generated 354 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:25:00.843828 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d50ab-5128-4d6f-8e9e-cf68a7fa8949 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:00.857372 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d50ab-5128-4d6f-8e9e-cf68a7fa8949 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:00.940356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66117756-586a-45fb-9b2a-7917970ece57 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:00.941589 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66117756-586a-45fb-9b2a-7917970ece57 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:00.942133 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66117756-586a-45fb-9b2a-7917970ece57 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:00.942754 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66117756-586a-45fb-9b2a-7917970ece57 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/projects/7a691219ccb349daa4bfafdc704f8c8c` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:00.944269 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66117756-586a-45fb-9b2a-7917970ece57 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:update_project(project_id=7a691219ccb349daa4bfafdc704f8c8c)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:00.946912 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66117756-586a-45fb-9b2a-7917970ece57 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:01.087131 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2289/4581] 10.222.0.23 () {60 vars in 1251 bytes} [Sat Apr 30 21:25:00 2022] PATCH /identity/v3/projects/7a691219ccb349daa4bfafdc704f8c8c => generated 368 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:25:01.091487 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c64d1e-f1a0-4d89-a54f-cd9bf3db8c99 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:01.103093 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c64d1e-f1a0-4d89-a54f-cd9bf3db8c99 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:01.107841 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac219ef-f4df-4c23-8b2c-fa8bdf1d84ed tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:01.108733 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac219ef-f4df-4c23-8b2c-fa8bdf1d84ed tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:01.109040 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac219ef-f4df-4c23-8b2c-fa8bdf1d84ed tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:01.109316 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac219ef-f4df-4c23-8b2c-fa8bdf1d84ed tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/projects/7a691219ccb349daa4bfafdc704f8c8c` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:01.122001 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac219ef-f4df-4c23-8b2c-fa8bdf1d84ed tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:get_project(project_id=7a691219ccb349daa4bfafdc704f8c8c)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:01.124371 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac219ef-f4df-4c23-8b2c-fa8bdf1d84ed tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:01.126811 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2293/4582] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:25:01 2022] GET /identity/v3/projects/7a691219ccb349daa4bfafdc704f8c8c => generated 355 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:25:01.130907 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66117756-586a-45fb-9b2a-7917970ece57 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:01.141134 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66117756-586a-45fb-9b2a-7917970ece57 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:01.146616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb7e20-6b8b-4739-8412-afe0fad9d349 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:01.147500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb7e20-6b8b-4739-8412-afe0fad9d349 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:01.147769 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb7e20-6b8b-4739-8412-afe0fad9d349 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:01.148048 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb7e20-6b8b-4739-8412-afe0fad9d349 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/projects/7a691219ccb349daa4bfafdc704f8c8c` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:01.149265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb7e20-6b8b-4739-8412-afe0fad9d349 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7a691219ccb349daa4bfafdc704f8c8c)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:01.151295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb7e20-6b8b-4739-8412-afe0fad9d349 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:01.317294 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-60fb7e20-6b8b-4739-8412-afe0fad9d349 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a691219ccb349daa4bfafdc704f8c8c', 'request_id': 'req-60fb7e20-6b8b-4739-8412-afe0fad9d349'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:01.331168 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-60fb7e20-6b8b-4739-8412-afe0fad9d349 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a691219ccb349daa4bfafdc704f8c8c', 'request_id': 'req-60fb7e20-6b8b-4739-8412-afe0fad9d349'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:01.339464 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-60fb7e20-6b8b-4739-8412-afe0fad9d349 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a691219ccb349daa4bfafdc704f8c8c', 'request_id': 'req-60fb7e20-6b8b-4739-8412-afe0fad9d349'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:01.463972 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-60fb7e20-6b8b-4739-8412-afe0fad9d349 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] The token cache is being invalidate because project 7a691219ccb349daa4bfafdc704f8c8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:25:01.464594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-60fb7e20-6b8b-4739-8412-afe0fad9d349 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:01.466589 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-60fb7e20-6b8b-4739-8412-afe0fad9d349 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:01.470264 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2290/4583] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:25:01 2022] DELETE /identity/v3/projects/7a691219ccb349daa4bfafdc704f8c8c => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:01.474942 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac219ef-f4df-4c23-8b2c-fa8bdf1d84ed tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:01.477114 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3ac219ef-f4df-4c23-8b2c-fa8bdf1d84ed tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:01.499466 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac219ef-f4df-4c23-8b2c-fa8bdf1d84ed tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:01.575344 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ea67a-8882-4cda-8c87-3d597b21f910 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:01.576391 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ea67a-8882-4cda-8c87-3d597b21f910 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:01.576759 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ea67a-8882-4cda-8c87-3d597b21f910 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:01.577115 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ea67a-8882-4cda-8c87-3d597b21f910 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/domains/79057cd07dd04752868cfaf2bc623705` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:01.587819 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ea67a-8882-4cda-8c87-3d597b21f910 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 21:25:01.603768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-a34ea67a-8882-4cda-8c87-3d597b21f910 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Could not find domain: 79057cd07dd04752868cfaf2bc623705.: keystone.exception.DomainNotFound: Could not find domain: 79057cd07dd04752868cfaf2bc623705. Apr 30 21:25:01.603768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:25:01.603768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Apr 30 21:25:01.603768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Apr 30 21:25:01.603768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 21:25:01.603768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 21:25:01.603768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 21:25:01.603768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 21:25:01.603768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 79057cd07dd04752868cfaf2bc623705. Apr 30 21:25:01.603768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:25:01.603768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 21:25:01.603768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:25:01.603768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:25:01.603768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:25:01.603768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:25:01.603768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:25:01.605179 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:25:01.605179 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:25:01.605179 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:25:01.605179 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:25:01.605179 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:25:01.605179 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:25:01.605179 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:25:01.605179 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Apr 30 21:25:01.605179 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Apr 30 21:25:01.605179 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 21:25:01.605179 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 21:25:01.605179 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 21:25:01.605179 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 21:25:01.605179 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:25:01.605179 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:25:01.605179 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 21:25:01.606508 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 21:25:01.606508 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 21:25:01.606508 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 21:25:01.606508 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 21:25:01.606508 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 21:25:01.606508 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 21:25:01.606508 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 21:25:01.606508 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 21:25:01.606508 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 21:25:01.606508 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 21:25:01.606508 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 21:25:01.606508 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 21:25:01.606508 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 21:25:01.606508 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Apr 30 21:25:01.606508 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 21:25:01.606508 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 79057cd07dd04752868cfaf2bc623705. Apr 30 21:25:01.606508 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:25:01.607889 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2294/4584] 10.222.0.23 () {60 vars in 1248 bytes} [Sat Apr 30 21:25:01 2022] PATCH /identity/v3/domains/79057cd07dd04752868cfaf2bc623705 => generated 112 bytes in 133 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 30 21:25:01.612089 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb7e20-6b8b-4739-8412-afe0fad9d349 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:01.624782 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb7e20-6b8b-4739-8412-afe0fad9d349 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:01.637728 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b88f96-b864-4add-98f0-1bc7a4b747c0 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0e1dd233deb4f47a4a1c40f4468617c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf07b051a82409e98eb5ce1a1b3ff71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:01.640210 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b88f96-b864-4add-98f0-1bc7a4b747c0 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:01.640515 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b88f96-b864-4add-98f0-1bc7a4b747c0 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:01.642596 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b88f96-b864-4add-98f0-1bc7a4b747c0 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] PATH_INFO: `/v3/domains/da69b0fe97a54e92bd9eee597334706b` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:01.658582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b88f96-b864-4add-98f0-1bc7a4b747c0 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 21:25:01.672886 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-a1b88f96-b864-4add-98f0-1bc7a4b747c0 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Could not find domain: da69b0fe97a54e92bd9eee597334706b.: keystone.exception.DomainNotFound: Could not find domain: da69b0fe97a54e92bd9eee597334706b. Apr 30 21:25:01.672886 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:25:01.672886 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Apr 30 21:25:01.672886 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Apr 30 21:25:01.672886 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 21:25:01.672886 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 21:25:01.672886 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 21:25:01.672886 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 21:25:01.672886 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: da69b0fe97a54e92bd9eee597334706b. Apr 30 21:25:01.672886 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:25:01.672886 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 21:25:01.672886 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:25:01.672886 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:25:01.672886 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:25:01.672886 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:25:01.672886 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:25:01.679846 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:25:01.679846 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:25:01.679846 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:25:01.679846 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:25:01.679846 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:25:01.679846 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:25:01.679846 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:25:01.679846 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Apr 30 21:25:01.679846 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Apr 30 21:25:01.679846 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 21:25:01.679846 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 21:25:01.679846 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 21:25:01.679846 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 21:25:01.679846 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:25:01.679846 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:25:01.679846 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 21:25:01.680874 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 21:25:01.680874 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 21:25:01.680874 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 21:25:01.680874 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 21:25:01.680874 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 21:25:01.680874 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 21:25:01.680874 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 21:25:01.680874 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 21:25:01.680874 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 21:25:01.680874 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 21:25:01.680874 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 21:25:01.680874 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 21:25:01.680874 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 21:25:01.680874 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Apr 30 21:25:01.680874 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 21:25:01.680874 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: da69b0fe97a54e92bd9eee597334706b. Apr 30 21:25:01.680874 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:25:01.682601 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2291/4585] 10.222.0.23 () {60 vars in 1248 bytes} [Sat Apr 30 21:25:01 2022] PATCH /identity/v3/domains/da69b0fe97a54e92bd9eee597334706b => generated 112 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 30 21:25:01.682700 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ea67a-8882-4cda-8c87-3d597b21f910 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:01.683318 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a34ea67a-8882-4cda-8c87-3d597b21f910 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:01.792808 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ea67a-8882-4cda-8c87-3d597b21f910 tempest-ProjectsTestJSON-667352399 tempest-ProjectsTestJSON-667352399-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:01.808980 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c5f1c-97f3-4a59-bcbf-a6d3d69b9b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:01.808980 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c5f1c-97f3-4a59-bcbf-a6d3d69b9b26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:01.808980 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c5f1c-97f3-4a59-bcbf-a6d3d69b9b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:01.808980 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c5f1c-97f3-4a59-bcbf-a6d3d69b9b26 admin admin] PATH_INFO: `/v3/users/a55ff4f76d724999ad96416dbf1c15c3` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:01.809312 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3c5f1c-97f3-4a59-bcbf-a6d3d69b9b26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a55ff4f76d724999ad96416dbf1c15c3)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:01.809312 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3c5f1c-97f3-4a59-bcbf-a6d3d69b9b26 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:01.811803 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647088ef-7e01-40cc-86e0-86c1ee0167dc None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:01.814322 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647088ef-7e01-40cc-86e0-86c1ee0167dc None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:01.814853 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647088ef-7e01-40cc-86e0-86c1ee0167dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:01.845719 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-647088ef-7e01-40cc-86e0-86c1ee0167dc None None] MFA Rules not processed for user `a466ad74049c4383af4a5f43f7023728`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:01.847366 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-647088ef-7e01-40cc-86e0-86c1ee0167dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:01.938455 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2292/4586] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:25:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:25:02.060559 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8a3c5f1c-97f3-4a59-bcbf-a6d3d69b9b26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a55ff4f76d724999ad96416dbf1c15c3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:02.076556 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8a3c5f1c-97f3-4a59-bcbf-a6d3d69b9b26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a55ff4f76d724999ad96416dbf1c15c3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:02.186899 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8a3c5f1c-97f3-4a59-bcbf-a6d3d69b9b26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a55ff4f76d724999ad96416dbf1c15c3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:02.187627 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8a3c5f1c-97f3-4a59-bcbf-a6d3d69b9b26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a55ff4f76d724999ad96416dbf1c15c3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:02.197020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8a3c5f1c-97f3-4a59-bcbf-a6d3d69b9b26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a55ff4f76d724999ad96416dbf1c15c3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:02.206325 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2295/4587] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:25:01 2022] DELETE /identity/v3/users/a55ff4f76d724999ad96416dbf1c15c3 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:25:02.214178 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728bedf-261a-4b31-b42c-36b189b575bd None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:02.214472 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728bedf-261a-4b31-b42c-36b189b575bd None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:02.214755 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728bedf-261a-4b31-b42c-36b189b575bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:02.233544 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-d728bedf-261a-4b31-b42c-36b189b575bd None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:02.234914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d728bedf-261a-4b31-b42c-36b189b575bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:02.360577 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2293/4588] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:25:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:25:02.392572 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c5f1c-97f3-4a59-bcbf-a6d3d69b9b26 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:02.394161 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8a3c5f1c-97f3-4a59-bcbf-a6d3d69b9b26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:02.504528 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c5f1c-97f3-4a59-bcbf-a6d3d69b9b26 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:02.517692 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1db992-6760-4619-a6f4-bbbf353b5f43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:02.518411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1db992-6760-4619-a6f4-bbbf353b5f43 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:02.519128 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1db992-6760-4619-a6f4-bbbf353b5f43 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:02.519128 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1db992-6760-4619-a6f4-bbbf353b5f43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:02.542583 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1db992-6760-4619-a6f4-bbbf353b5f43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:02.544053 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1db992-6760-4619-a6f4-bbbf353b5f43 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:02.584446 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2296/4589] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:25:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:25:03.157303 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05646e00-d2dd-4857-b29d-f170312af95b None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:03.157859 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05646e00-d2dd-4857-b29d-f170312af95b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:03.158636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05646e00-d2dd-4857-b29d-f170312af95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:03.185058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-05646e00-d2dd-4857-b29d-f170312af95b None None] MFA Rules not processed for user `a466ad74049c4383af4a5f43f7023728`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:03.187160 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-05646e00-d2dd-4857-b29d-f170312af95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:03.325550 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2294/4590] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:25:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:25:04.228922 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1db992-6760-4619-a6f4-bbbf353b5f43 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:04.231288 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3e1db992-6760-4619-a6f4-bbbf353b5f43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:04.250229 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1db992-6760-4619-a6f4-bbbf353b5f43 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:04.258391 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa7b85-8b53-4ba0-8c9f-85579e0e3c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:04.259624 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa7b85-8b53-4ba0-8c9f-85579e0e3c8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:04.260121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa7b85-8b53-4ba0-8c9f-85579e0e3c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:04.260607 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa7b85-8b53-4ba0-8c9f-85579e0e3c8f admin admin] PATH_INFO: `/v3/projects/1ebb65b7eb0b4816a9d5b5aa9a17c5d2` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:04.264508 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaa7b85-8b53-4ba0-8c9f-85579e0e3c8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ebb65b7eb0b4816a9d5b5aa9a17c5d2)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:04.269550 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaa7b85-8b53-4ba0-8c9f-85579e0e3c8f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:04.435397 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-bbaa7b85-8b53-4ba0-8c9f-85579e0e3c8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ebb65b7eb0b4816a9d5b5aa9a17c5d2', 'request_id': 'req-bbaa7b85-8b53-4ba0-8c9f-85579e0e3c8f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:04.444812 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-bbaa7b85-8b53-4ba0-8c9f-85579e0e3c8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ebb65b7eb0b4816a9d5b5aa9a17c5d2', 'request_id': 'req-bbaa7b85-8b53-4ba0-8c9f-85579e0e3c8f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:04.452035 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-bbaa7b85-8b53-4ba0-8c9f-85579e0e3c8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ebb65b7eb0b4816a9d5b5aa9a17c5d2', 'request_id': 'req-bbaa7b85-8b53-4ba0-8c9f-85579e0e3c8f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:04.555692 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-bbaa7b85-8b53-4ba0-8c9f-85579e0e3c8f admin admin] The token cache is being invalidate because project 1ebb65b7eb0b4816a9d5b5aa9a17c5d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:25:04.556156 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-bbaa7b85-8b53-4ba0-8c9f-85579e0e3c8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:04.557093 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-bbaa7b85-8b53-4ba0-8c9f-85579e0e3c8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:04.558967 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2297/4591] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:25:04 2022] DELETE /identity/v3/projects/1ebb65b7eb0b4816a9d5b5aa9a17c5d2 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:04.563152 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05646e00-d2dd-4857-b29d-f170312af95b None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:04.576642 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05646e00-d2dd-4857-b29d-f170312af95b None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:04.648749 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a7b8f-7e8e-4fae-b9fb-0b4d48b9976c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:04.651843 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a7b8f-7e8e-4fae-b9fb-0b4d48b9976c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:04.653272 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a7b8f-7e8e-4fae-b9fb-0b4d48b9976c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:04.653272 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a7b8f-7e8e-4fae-b9fb-0b4d48b9976c admin admin] PATH_INFO: `/v3/users/e0e1dd233deb4f47a4a1c40f4468617c` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:04.654019 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a7b8f-7e8e-4fae-b9fb-0b4d48b9976c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0e1dd233deb4f47a4a1c40f4468617c)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:04.658840 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a7b8f-7e8e-4fae-b9fb-0b4d48b9976c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:04.971476 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-715a7b8f-7e8e-4fae-b9fb-0b4d48b9976c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0e1dd233deb4f47a4a1c40f4468617c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:04.989197 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-715a7b8f-7e8e-4fae-b9fb-0b4d48b9976c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0e1dd233deb4f47a4a1c40f4468617c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:05.165309 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-715a7b8f-7e8e-4fae-b9fb-0b4d48b9976c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0e1dd233deb4f47a4a1c40f4468617c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:05.176253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-715a7b8f-7e8e-4fae-b9fb-0b4d48b9976c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0e1dd233deb4f47a4a1c40f4468617c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:05.176253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-715a7b8f-7e8e-4fae-b9fb-0b4d48b9976c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0e1dd233deb4f47a4a1c40f4468617c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:05.196373 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2295/4592] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:25:04 2022] DELETE /identity/v3/users/e0e1dd233deb4f47a4a1c40f4468617c => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:05.399665 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5aad3f-d63a-4c68-b257-7b9880123fa9 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:05.399665 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5aad3f-d63a-4c68-b257-7b9880123fa9 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:05.399665 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5aad3f-d63a-4c68-b257-7b9880123fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:05.429289 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-8a5aad3f-d63a-4c68-b257-7b9880123fa9 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:05.430751 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8a5aad3f-d63a-4c68-b257-7b9880123fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:05.530229 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2298/4593] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:25:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:25:05.556658 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a7b8f-7e8e-4fae-b9fb-0b4d48b9976c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:05.562894 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-715a7b8f-7e8e-4fae-b9fb-0b4d48b9976c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:05.707461 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a7b8f-7e8e-4fae-b9fb-0b4d48b9976c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:05.714142 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e7d76-71e8-46b8-8b65-08f1a3b9b497 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:05.715159 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e7d76-71e8-46b8-8b65-08f1a3b9b497 service swift] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:05.715698 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e7d76-71e8-46b8-8b65-08f1a3b9b497 service swift] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:05.716191 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e7d76-71e8-46b8-8b65-08f1a3b9b497 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:05.731574 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e7d76-71e8-46b8-8b65-08f1a3b9b497 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:05.733641 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e7d76-71e8-46b8-8b65-08f1a3b9b497 service swift] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:05.744139 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2296/4594] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:25:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:25:05.967374 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5aad3f-d63a-4c68-b257-7b9880123fa9 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:05.968875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8a5aad3f-d63a-4c68-b257-7b9880123fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:06.195326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5aad3f-d63a-4c68-b257-7b9880123fa9 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:06.206387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7b64ee-38b7-4320-838b-8810cfd86b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:06.207702 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b64ee-38b7-4320-838b-8810cfd86b18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:06.208204 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b64ee-38b7-4320-838b-8810cfd86b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:06.208721 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b64ee-38b7-4320-838b-8810cfd86b18 admin admin] PATH_INFO: `/v3/projects/6cf07b051a82409e98eb5ce1a1b3ff71` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:06.210405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7b64ee-38b7-4320-838b-8810cfd86b18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cf07b051a82409e98eb5ce1a1b3ff71)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:06.213468 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7b64ee-38b7-4320-838b-8810cfd86b18 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:06.370633 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2f7b64ee-38b7-4320-838b-8810cfd86b18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cf07b051a82409e98eb5ce1a1b3ff71', 'request_id': 'req-2f7b64ee-38b7-4320-838b-8810cfd86b18'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:06.400467 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2f7b64ee-38b7-4320-838b-8810cfd86b18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cf07b051a82409e98eb5ce1a1b3ff71', 'request_id': 'req-2f7b64ee-38b7-4320-838b-8810cfd86b18'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:06.418688 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2f7b64ee-38b7-4320-838b-8810cfd86b18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cf07b051a82409e98eb5ce1a1b3ff71', 'request_id': 'req-2f7b64ee-38b7-4320-838b-8810cfd86b18'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:06.510775 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2f7b64ee-38b7-4320-838b-8810cfd86b18 admin admin] The token cache is being invalidate because project 6cf07b051a82409e98eb5ce1a1b3ff71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:25:06.511172 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2f7b64ee-38b7-4320-838b-8810cfd86b18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:06.511778 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2f7b64ee-38b7-4320-838b-8810cfd86b18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:06.517694 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2299/4595] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:25:05 2022] DELETE /identity/v3/projects/6cf07b051a82409e98eb5ce1a1b3ff71 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:06.519484 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e975c6-3975-4585-a149-1221691fa1c1 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:06.519772 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e975c6-3975-4585-a149-1221691fa1c1 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:06.520050 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e975c6-3975-4585-a149-1221691fa1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:06.563701 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-78e975c6-3975-4585-a149-1221691fa1c1 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:06.564951 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-78e975c6-3975-4585-a149-1221691fa1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:06.699812 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2297/4596] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:25:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:25:06.709238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59249475-1178-4063-8cb2-87ad132f8123 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:06.710361 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59249475-1178-4063-8cb2-87ad132f8123 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:06.710888 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59249475-1178-4063-8cb2-87ad132f8123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:06.746302 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-59249475-1178-4063-8cb2-87ad132f8123 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:06.748946 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-59249475-1178-4063-8cb2-87ad132f8123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:06.765240 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2300/4597] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:25:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:25:06.769944 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e975c6-3975-4585-a149-1221691fa1c1 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:06.782766 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e975c6-3975-4585-a149-1221691fa1c1 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:06.798885 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd60ab4-71c6-4b6c-8a4c-81744d931387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:06.799650 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd60ab4-71c6-4b6c-8a4c-81744d931387 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:06.800160 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd60ab4-71c6-4b6c-8a4c-81744d931387 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:06.800631 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd60ab4-71c6-4b6c-8a4c-81744d931387 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:06.801578 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd60ab4-71c6-4b6c-8a4c-81744d931387 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:25:06.802156 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd60ab4-71c6-4b6c-8a4c-81744d931387 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:06.803953 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd60ab4-71c6-4b6c-8a4c-81744d931387 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:06.839137 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2298/4598] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:25:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:25:06.843271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59249475-1178-4063-8cb2-87ad132f8123 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:06.859003 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59249475-1178-4063-8cb2-87ad132f8123 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:06.871208 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c12a71-06d8-4c89-8d33-32051a99a58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:06.872124 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c12a71-06d8-4c89-8d33-32051a99a58e admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:06.872569 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c12a71-06d8-4c89-8d33-32051a99a58e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:06.873006 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c12a71-06d8-4c89-8d33-32051a99a58e admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:06.873970 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c12a71-06d8-4c89-8d33-32051a99a58e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:06.879208 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c12a71-06d8-4c89-8d33-32051a99a58e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:06.982293 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2301/4599] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:25:06 2022] POST /identity/v3/projects => generated 369 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:25:06.986779 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd60ab4-71c6-4b6c-8a4c-81744d931387 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:07.000836 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd60ab4-71c6-4b6c-8a4c-81744d931387 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:07.133513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c44fb-c832-43ef-ae6f-9c884ff69b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:07.134307 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c44fb-c832-43ef-ae6f-9c884ff69b99 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:07.134586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c44fb-c832-43ef-ae6f-9c884ff69b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:07.134866 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c44fb-c832-43ef-ae6f-9c884ff69b99 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:07.135563 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c44fb-c832-43ef-ae6f-9c884ff69b99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:07.137528 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c44fb-c832-43ef-ae6f-9c884ff69b99 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:07.260325 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2299/4600] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:25:06 2022] POST /identity/v3/users => generated 285 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:25:07.264681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c12a71-06d8-4c89-8d33-32051a99a58e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:07.289530 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c12a71-06d8-4c89-8d33-32051a99a58e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:07.311123 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8962a74-758f-40b7-8dbc-8b7e08979b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:07.313804 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8962a74-758f-40b7-8dbc-8b7e08979b33 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:07.316244 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8962a74-758f-40b7-8dbc-8b7e08979b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:07.316556 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8962a74-758f-40b7-8dbc-8b7e08979b33 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:07.317324 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8962a74-758f-40b7-8dbc-8b7e08979b33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:07.320286 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8962a74-758f-40b7-8dbc-8b7e08979b33 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:07.337659 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2302/4601] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:25:07.341001 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c44fb-c832-43ef-ae6f-9c884ff69b99 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:07.355544 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c44fb-c832-43ef-ae6f-9c884ff69b99 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:07.363207 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02953f4-3bde-407d-b5f3-de0fbb7357a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:07.363949 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02953f4-3bde-407d-b5f3-de0fbb7357a7 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:07.364283 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02953f4-3bde-407d-b5f3-de0fbb7357a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:07.364562 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02953f4-3bde-407d-b5f3-de0fbb7357a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:07.365871 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02953f4-3bde-407d-b5f3-de0fbb7357a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:07.367294 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02953f4-3bde-407d-b5f3-de0fbb7357a7 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:07.382427 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2300/4602] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:25:07.386466 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8962a74-758f-40b7-8dbc-8b7e08979b33 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:07.398481 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8962a74-758f-40b7-8dbc-8b7e08979b33 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:07.406385 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a5597-3e06-4783-948a-9398b5bf11a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:07.408964 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a5597-3e06-4783-948a-9398b5bf11a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:07.409638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a5597-3e06-4783-948a-9398b5bf11a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:07.410365 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a5597-3e06-4783-948a-9398b5bf11a4 admin admin] PATH_INFO: `/v3/projects/3cad2b0005a94547b636dd28b8aa28b8/users/3afcffd61ba940fb9fb621627718af80/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:07.435346 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a5597-3e06-4783-948a-9398b5bf11a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cad2b0005a94547b636dd28b8aa28b8, user_id=3afcffd61ba940fb9fb621627718af80, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:07.439389 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a5597-3e06-4783-948a-9398b5bf11a4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:07.528662 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2303/4603] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:25:07 2022] PUT /identity/v3/projects/3cad2b0005a94547b636dd28b8aa28b8/users/3afcffd61ba940fb9fb621627718af80/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:07.542419 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7134f-b6ea-4f63-a777-b001cceb9fb6 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:07.544348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7134f-b6ea-4f63-a777-b001cceb9fb6 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:07.544778 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7134f-b6ea-4f63-a777-b001cceb9fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:07.618136 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-6ce7134f-b6ea-4f63-a777-b001cceb9fb6 None None] MFA Rules not processed for user `3afcffd61ba940fb9fb621627718af80`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:07.620710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6ce7134f-b6ea-4f63-a777-b001cceb9fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:07.744794 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2301/4604] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:25:07 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:25:07.750341 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a5597-3e06-4783-948a-9398b5bf11a4 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:07.908631 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a5597-3e06-4783-948a-9398b5bf11a4 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:07.926076 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4866713-5738-4648-abb2-b4a82519c19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:07.927129 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4866713-5738-4648-abb2-b4a82519c19f admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:07.927129 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4866713-5738-4648-abb2-b4a82519c19f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:07.929788 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4866713-5738-4648-abb2-b4a82519c19f admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:07.929788 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4866713-5738-4648-abb2-b4a82519c19f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:07.930006 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4866713-5738-4648-abb2-b4a82519c19f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:08.056403 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2304/4605] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:25:07 2022] POST /identity/v3/projects => generated 367 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:25:08.060392 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7134f-b6ea-4f63-a777-b001cceb9fb6 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:08.073577 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7134f-b6ea-4f63-a777-b001cceb9fb6 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:08.205154 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eee301-0a7d-4d0b-a393-9c1ab3427c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:08.205510 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eee301-0a7d-4d0b-a393-9c1ab3427c32 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:08.205888 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eee301-0a7d-4d0b-a393-9c1ab3427c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:08.208436 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eee301-0a7d-4d0b-a393-9c1ab3427c32 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:08.214262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eee301-0a7d-4d0b-a393-9c1ab3427c32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:08.221476 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eee301-0a7d-4d0b-a393-9c1ab3427c32 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:08.365907 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2302/4606] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:25:08 2022] POST /identity/v3/users => generated 290 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:25:08.369137 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4866713-5738-4648-abb2-b4a82519c19f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:08.386856 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4866713-5738-4648-abb2-b4a82519c19f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:08.401260 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f40a0d-91ae-4349-98d9-820f4d0ca50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:08.404815 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f40a0d-91ae-4349-98d9-820f4d0ca50d admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:08.405928 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f40a0d-91ae-4349-98d9-820f4d0ca50d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:08.407269 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f40a0d-91ae-4349-98d9-820f4d0ca50d admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:08.409446 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f40a0d-91ae-4349-98d9-820f4d0ca50d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:08.412711 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f40a0d-91ae-4349-98d9-820f4d0ca50d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:08.442841 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2305/4607] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:25:08.447187 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eee301-0a7d-4d0b-a393-9c1ab3427c32 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:08.471410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eee301-0a7d-4d0b-a393-9c1ab3427c32 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:08.490629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e31545-2c3a-4423-b1bd-8073df01a243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:08.491536 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e31545-2c3a-4423-b1bd-8073df01a243 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:08.491826 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e31545-2c3a-4423-b1bd-8073df01a243 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:08.492090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e31545-2c3a-4423-b1bd-8073df01a243 admin admin] PATH_INFO: `/v3/projects/b5dd2979fda24d10869f17577060cc81/users/28f3c44c884c4bc683b67c12cfbd69dc/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:08.522708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e31545-2c3a-4423-b1bd-8073df01a243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5dd2979fda24d10869f17577060cc81, user_id=28f3c44c884c4bc683b67c12cfbd69dc, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:08.525735 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e31545-2c3a-4423-b1bd-8073df01a243 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:08.600471 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2303/4608] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:25:08 2022] PUT /identity/v3/projects/b5dd2979fda24d10869f17577060cc81/users/28f3c44c884c4bc683b67c12cfbd69dc/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:08.606893 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f40a0d-91ae-4349-98d9-820f4d0ca50d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:08.628127 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f40a0d-91ae-4349-98d9-820f4d0ca50d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:08.730321 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43752736-1073-4c51-9f30-8a0184a439b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:08.730321 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43752736-1073-4c51-9f30-8a0184a439b7 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:08.730321 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43752736-1073-4c51-9f30-8a0184a439b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:08.730321 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43752736-1073-4c51-9f30-8a0184a439b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:08.738593 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43752736-1073-4c51-9f30-8a0184a439b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:08.742493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43752736-1073-4c51-9f30-8a0184a439b7 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:08.774860 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2306/4609] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:25:08.775234 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e31545-2c3a-4423-b1bd-8073df01a243 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:08.808643 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e31545-2c3a-4423-b1bd-8073df01a243 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:08.844278 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20d96b-ca74-4f59-a6e2-e4ff5d011376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:08.846335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20d96b-ca74-4f59-a6e2-e4ff5d011376 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:08.856230 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20d96b-ca74-4f59-a6e2-e4ff5d011376 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:08.856904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20d96b-ca74-4f59-a6e2-e4ff5d011376 admin admin] PATH_INFO: `/v3/projects/b5dd2979fda24d10869f17577060cc81/users/28f3c44c884c4bc683b67c12cfbd69dc/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:08.862530 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c20d96b-ca74-4f59-a6e2-e4ff5d011376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5dd2979fda24d10869f17577060cc81, user_id=28f3c44c884c4bc683b67c12cfbd69dc, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:08.866998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c20d96b-ca74-4f59-a6e2-e4ff5d011376 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:08.883448 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2304/4610] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:25:08 2022] PUT /identity/v3/projects/b5dd2979fda24d10869f17577060cc81/users/28f3c44c884c4bc683b67c12cfbd69dc/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:25:08.895258 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d1f74-a572-4e86-b9eb-c0f25be3b510 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:08.895519 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d1f74-a572-4e86-b9eb-c0f25be3b510 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:08.895801 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d1f74-a572-4e86-b9eb-c0f25be3b510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:08.963836 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-2b9d1f74-a572-4e86-b9eb-c0f25be3b510 None None] MFA Rules not processed for user `28f3c44c884c4bc683b67c12cfbd69dc`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:08.967235 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2b9d1f74-a572-4e86-b9eb-c0f25be3b510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:08.981614 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20d96b-ca74-4f59-a6e2-e4ff5d011376 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:08.983598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3c20d96b-ca74-4f59-a6e2-e4ff5d011376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:09.154421 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2307/4611] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:25:08 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:25:09.158132 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d1f74-a572-4e86-b9eb-c0f25be3b510 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:09.178729 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d1f74-a572-4e86-b9eb-c0f25be3b510 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:09.195119 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20d96b-ca74-4f59-a6e2-e4ff5d011376 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:09.196182 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c993a-53fd-417b-b8d8-a925cd1bd44b tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f3c44c884c4bc683b67c12cfbd69dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5dd2979fda24d10869f17577060cc81', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:09.196983 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c993a-53fd-417b-b8d8-a925cd1bd44b tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:09.198059 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c993a-53fd-417b-b8d8-a925cd1bd44b tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:09.198733 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c993a-53fd-417b-b8d8-a925cd1bd44b tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] PATH_INFO: `/v3/services` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:09.200820 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c993a-53fd-417b-b8d8-a925cd1bd44b tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:09.204115 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-012c993a-53fd-417b-b8d8-a925cd1bd44b tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:25:09.204115 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:25:09.204115 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:25:09.206136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c993a-53fd-417b-b8d8-a925cd1bd44b tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:09.210996 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e2358-837c-41a6-a00f-4738ddd0f081 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:09.212425 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e2358-837c-41a6-a00f-4738ddd0f081 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:09.213166 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e2358-837c-41a6-a00f-4738ddd0f081 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:09.214585 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e2358-837c-41a6-a00f-4738ddd0f081 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:09.217585 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-678e2358-837c-41a6-a00f-4738ddd0f081 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:09.303642 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2308/4612] 10.222.0.23 () {60 vars in 1151 bytes} [Sat Apr 30 21:25:09 2022] POST /identity/v3/services => generated 240 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:25:09.309159 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c993a-53fd-417b-b8d8-a925cd1bd44b tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:09.367995 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c993a-53fd-417b-b8d8-a925cd1bd44b tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:09.389500 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9725e-c4bf-4723-9521-475d4947468c tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f3c44c884c4bc683b67c12cfbd69dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5dd2979fda24d10869f17577060cc81', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:09.391714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9725e-c4bf-4723-9521-475d4947468c tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:09.392230 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9725e-c4bf-4723-9521-475d4947468c tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:09.396490 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9725e-c4bf-4723-9521-475d4947468c tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] PATH_INFO: `/v3/services/6756e4946ec3437aa8b12fb01b71c601` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:09.397575 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9725e-c4bf-4723-9521-475d4947468c tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: Authorizing `identity:delete_service(service_id=6756e4946ec3437aa8b12fb01b71c601)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:09.399047 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-5db9725e-c4bf-4723-9521-475d4947468c tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:25:09.399047 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:25:09.399047 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:25:09.400700 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9725e-c4bf-4723-9521-475d4947468c tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:09.425062 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e2358-837c-41a6-a00f-4738ddd0f081 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:09.426865 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e2358-837c-41a6-a00f-4738ddd0f081 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:09.463141 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2305/4613] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:25:08 2022] GET /identity/v3/auth/tokens => generated 3389 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:25:09.547904 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2309/4614] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:25:09 2022] DELETE /identity/v3/services/6756e4946ec3437aa8b12fb01b71c601 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:09.553124 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e2358-837c-41a6-a00f-4738ddd0f081 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:09.591986 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e2358-837c-41a6-a00f-4738ddd0f081 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:09.625120 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717050b-332b-4e26-aa69-2ca863970c4e tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f3c44c884c4bc683b67c12cfbd69dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5dd2979fda24d10869f17577060cc81', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:09.626427 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717050b-332b-4e26-aa69-2ca863970c4e tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:09.627100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717050b-332b-4e26-aa69-2ca863970c4e tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:09.627588 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717050b-332b-4e26-aa69-2ca863970c4e tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:09.628773 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2717050b-332b-4e26-aa69-2ca863970c4e tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:09.630091 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-2717050b-332b-4e26-aa69-2ca863970c4e tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:25:09.630091 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:25:09.630091 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:25:09.631734 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2717050b-332b-4e26-aa69-2ca863970c4e tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:09.736414 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2306/4615] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:25:09 2022] POST /identity/v3/services => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:25:09.740574 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9725e-c4bf-4723-9521-475d4947468c tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:09.754100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9725e-c4bf-4723-9521-475d4947468c tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:09.773953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377984aa-9984-4b05-96b6-dbb73b0e5c17 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f3c44c884c4bc683b67c12cfbd69dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5dd2979fda24d10869f17577060cc81', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:09.774880 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377984aa-9984-4b05-96b6-dbb73b0e5c17 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:09.775172 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377984aa-9984-4b05-96b6-dbb73b0e5c17 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:09.775455 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377984aa-9984-4b05-96b6-dbb73b0e5c17 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] PATH_INFO: `/v3/services/12c1c3950c2c46e18f2dc3794396f438` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:09.776212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377984aa-9984-4b05-96b6-dbb73b0e5c17 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: Authorizing `identity:update_service(service_id=12c1c3950c2c46e18f2dc3794396f438)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:09.777258 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-377984aa-9984-4b05-96b6-dbb73b0e5c17 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:25:09.777258 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:25:09.777258 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:25:09.778203 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377984aa-9984-4b05-96b6-dbb73b0e5c17 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:09.872029 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2310/4616] 10.222.0.23 () {60 vars in 1251 bytes} [Sat Apr 30 21:25:09 2022] PATCH /identity/v3/services/12c1c3950c2c46e18f2dc3794396f438 => generated 283 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:25:09.873727 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717050b-332b-4e26-aa69-2ca863970c4e tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:09.888408 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717050b-332b-4e26-aa69-2ca863970c4e tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:09.907811 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b15db-25b2-4567-9b69-5f266d8928df tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f3c44c884c4bc683b67c12cfbd69dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5dd2979fda24d10869f17577060cc81', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:09.909320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b15db-25b2-4567-9b69-5f266d8928df tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:09.910012 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b15db-25b2-4567-9b69-5f266d8928df tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:09.910474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b15db-25b2-4567-9b69-5f266d8928df tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] PATH_INFO: `/v3/services/12c1c3950c2c46e18f2dc3794396f438` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:09.911325 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492b15db-25b2-4567-9b69-5f266d8928df tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: Authorizing `identity:get_service(service_id=12c1c3950c2c46e18f2dc3794396f438)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:09.912537 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-492b15db-25b2-4567-9b69-5f266d8928df tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:25:09.912537 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:25:09.912537 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:25:09.914007 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492b15db-25b2-4567-9b69-5f266d8928df tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:09.927034 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377984aa-9984-4b05-96b6-dbb73b0e5c17 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:09.934739 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2307/4617] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:25:09 2022] GET /identity/v3/services/12c1c3950c2c46e18f2dc3794396f438 => generated 283 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:25:09.940319 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377984aa-9984-4b05-96b6-dbb73b0e5c17 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:09.946011 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce15e41-f68c-4c82-a69c-350292040620 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f3c44c884c4bc683b67c12cfbd69dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5dd2979fda24d10869f17577060cc81', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:09.947460 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce15e41-f68c-4c82-a69c-350292040620 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:09.947998 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce15e41-f68c-4c82-a69c-350292040620 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:09.948720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce15e41-f68c-4c82-a69c-350292040620 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] PATH_INFO: `/v3/services/12c1c3950c2c46e18f2dc3794396f438` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:09.949739 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce15e41-f68c-4c82-a69c-350292040620 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: Authorizing `identity:delete_service(service_id=12c1c3950c2c46e18f2dc3794396f438)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:09.951643 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce15e41-f68c-4c82-a69c-350292040620 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:10.060426 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2311/4618] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:25:09 2022] DELETE /identity/v3/services/12c1c3950c2c46e18f2dc3794396f438 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:10.061357 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b15db-25b2-4567-9b69-5f266d8928df tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:10.078691 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b15db-25b2-4567-9b69-5f266d8928df tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:10.111430 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a956b93-d02f-4e25-98dd-12841677ee1c tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f3c44c884c4bc683b67c12cfbd69dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5dd2979fda24d10869f17577060cc81', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:10.112454 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a956b93-d02f-4e25-98dd-12841677ee1c tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:10.112941 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a956b93-d02f-4e25-98dd-12841677ee1c tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:10.113321 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a956b93-d02f-4e25-98dd-12841677ee1c tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] PATH_INFO: `/v3/services/12c1c3950c2c46e18f2dc3794396f438` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:10.114228 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a956b93-d02f-4e25-98dd-12841677ee1c tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: Authorizing `identity:get_service(service_id=12c1c3950c2c46e18f2dc3794396f438)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:10.122042 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a956b93-d02f-4e25-98dd-12841677ee1c tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:10.152831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-3a956b93-d02f-4e25-98dd-12841677ee1c tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] Could not find service: 12c1c3950c2c46e18f2dc3794396f438.: keystone.exception.ServiceNotFound: Could not find service: 12c1c3950c2c46e18f2dc3794396f438. Apr 30 21:25:10.152831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:25:10.152831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Apr 30 21:25:10.152831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Apr 30 21:25:10.152831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Apr 30 21:25:10.152831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Apr 30 21:25:10.152831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Apr 30 21:25:10.152831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 21:25:10.152831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 12c1c3950c2c46e18f2dc3794396f438. Apr 30 21:25:10.152831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:25:10.152831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 21:25:10.152831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:25:10.152831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:25:10.152831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:25:10.152831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:25:10.152831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:25:10.159715 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:25:10.159715 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:25:10.159715 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:25:10.159715 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:25:10.159715 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:25:10.159715 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:25:10.159715 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:25:10.159715 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Apr 30 21:25:10.159715 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_service(service_id) Apr 30 21:25:10.159715 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Apr 30 21:25:10.159715 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Apr 30 21:25:10.159715 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:25:10.159715 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:25:10.159715 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 21:25:10.159715 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 21:25:10.159715 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 21:25:10.160911 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 21:25:10.160911 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 21:25:10.160911 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 21:25:10.160911 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 21:25:10.160911 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 21:25:10.160911 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 21:25:10.160911 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 21:25:10.160911 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 21:25:10.160911 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 21:25:10.160911 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 21:25:10.160911 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 21:25:10.160911 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Apr 30 21:25:10.160911 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Apr 30 21:25:10.160911 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 12c1c3950c2c46e18f2dc3794396f438. Apr 30 21:25:10.160911 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:25:10.160911 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2308/4619] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:25:10 2022] GET /identity/v3/services/12c1c3950c2c46e18f2dc3794396f438 => generated 113 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 30 21:25:10.162713 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce15e41-f68c-4c82-a69c-350292040620 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:10.177524 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce15e41-f68c-4c82-a69c-350292040620 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:10.182522 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc7106a-d87d-4a42-b15a-c52d5c8fd6b2 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f3c44c884c4bc683b67c12cfbd69dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5dd2979fda24d10869f17577060cc81', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:10.183463 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7106a-d87d-4a42-b15a-c52d5c8fd6b2 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:10.184371 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7106a-d87d-4a42-b15a-c52d5c8fd6b2 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:10.184679 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7106a-d87d-4a42-b15a-c52d5c8fd6b2 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] PATH_INFO: `/v3/services` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:10.185424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc7106a-d87d-4a42-b15a-c52d5c8fd6b2 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:10.187132 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc7106a-d87d-4a42-b15a-c52d5c8fd6b2 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:10.283891 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2312/4620] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:25:10 2022] POST /identity/v3/services => generated 273 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:25:10.285156 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a956b93-d02f-4e25-98dd-12841677ee1c tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:10.296202 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a956b93-d02f-4e25-98dd-12841677ee1c tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:10.342734 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8e47c-346b-4adb-a78e-7263425d3317 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f3c44c884c4bc683b67c12cfbd69dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5dd2979fda24d10869f17577060cc81', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:10.342969 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8e47c-346b-4adb-a78e-7263425d3317 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:10.343231 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8e47c-346b-4adb-a78e-7263425d3317 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:10.343507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8e47c-346b-4adb-a78e-7263425d3317 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:10.344254 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8e47c-346b-4adb-a78e-7263425d3317 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:10.346285 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8e47c-346b-4adb-a78e-7263425d3317 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:10.421394 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2309/4621] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:25:10 2022] POST /identity/v3/services => generated 274 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:25:10.423296 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc7106a-d87d-4a42-b15a-c52d5c8fd6b2 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:10.439812 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc7106a-d87d-4a42-b15a-c52d5c8fd6b2 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:10.473647 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044af1f-07a9-4fa8-a99c-a56509e43d25 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f3c44c884c4bc683b67c12cfbd69dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5dd2979fda24d10869f17577060cc81', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:10.475323 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044af1f-07a9-4fa8-a99c-a56509e43d25 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:10.475832 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044af1f-07a9-4fa8-a99c-a56509e43d25 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:10.476396 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044af1f-07a9-4fa8-a99c-a56509e43d25 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] PATH_INFO: `/v3/services` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:10.477229 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044af1f-07a9-4fa8-a99c-a56509e43d25 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:10.481927 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044af1f-07a9-4fa8-a99c-a56509e43d25 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:10.546621 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2313/4622] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:25:10 2022] POST /identity/v3/services => generated 275 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:25:10.550979 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8e47c-346b-4adb-a78e-7263425d3317 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:10.571634 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8e47c-346b-4adb-a78e-7263425d3317 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:10.631844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750144b-22ea-42a9-ae7b-433080d61d4a tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f3c44c884c4bc683b67c12cfbd69dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5dd2979fda24d10869f17577060cc81', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:10.632547 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750144b-22ea-42a9-ae7b-433080d61d4a tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:10.632838 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750144b-22ea-42a9-ae7b-433080d61d4a tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:10.633120 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750144b-22ea-42a9-ae7b-433080d61d4a tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:10.633917 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750144b-22ea-42a9-ae7b-433080d61d4a tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:10.634967 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-0750144b-22ea-42a9-ae7b-433080d61d4a tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:25:10.634967 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:25:10.634967 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:25:10.635870 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750144b-22ea-42a9-ae7b-433080d61d4a tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:10.678541 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2310/4623] 10.222.0.23 () {58 vars in 1130 bytes} [Sat Apr 30 21:25:10 2022] GET /identity/v3/services => generated 2977 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:25:10.682860 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044af1f-07a9-4fa8-a99c-a56509e43d25 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:10.717589 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044af1f-07a9-4fa8-a99c-a56509e43d25 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:10.737783 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6a1b0-9a89-43d3-b9a4-88e1de85e5a4 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f3c44c884c4bc683b67c12cfbd69dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5dd2979fda24d10869f17577060cc81', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:10.738761 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6a1b0-9a89-43d3-b9a4-88e1de85e5a4 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:10.739242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6a1b0-9a89-43d3-b9a4-88e1de85e5a4 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:10.739671 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6a1b0-9a89-43d3-b9a4-88e1de85e5a4 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] PATH_INFO: `/v3/services` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:10.740562 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec6a1b0-9a89-43d3-b9a4-88e1de85e5a4 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-111349027) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:25:10.741058 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec6a1b0-9a89-43d3-b9a4-88e1de85e5a4 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:10.749653 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-7ec6a1b0-9a89-43d3-b9a4-88e1de85e5a4 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:25:10.749653 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:25:10.749653 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:25:10.750625 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec6a1b0-9a89-43d3-b9a4-88e1de85e5a4 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:10.767549 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2314/4624] 10.222.0.23 () {58 vars in 1219 bytes} [Sat Apr 30 21:25:10 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-111349027 => generated 415 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:25:10.769000 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750144b-22ea-42a9-ae7b-433080d61d4a tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:10.789374 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750144b-22ea-42a9-ae7b-433080d61d4a tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:10.806654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f88435-f292-44af-a36f-ec29e4714997 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f3c44c884c4bc683b67c12cfbd69dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5dd2979fda24d10869f17577060cc81', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:10.807535 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f88435-f292-44af-a36f-ec29e4714997 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:10.808167 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f88435-f292-44af-a36f-ec29e4714997 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:10.809046 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f88435-f292-44af-a36f-ec29e4714997 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:10.810186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f88435-f292-44af-a36f-ec29e4714997 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-2070448778) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:25:10.810918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f88435-f292-44af-a36f-ec29e4714997 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:10.812842 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f88435-f292-44af-a36f-ec29e4714997 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:10.823375 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2311/4625] 10.222.0.23 () {58 vars in 1221 bytes} [Sat Apr 30 21:25:10 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-2070448778 => generated 417 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:25:10.827217 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6a1b0-9a89-43d3-b9a4-88e1de85e5a4 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:10.842511 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6a1b0-9a89-43d3-b9a4-88e1de85e5a4 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:10.864540 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ebf94-89e1-41f6-9790-77b1774db5eb tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f3c44c884c4bc683b67c12cfbd69dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5dd2979fda24d10869f17577060cc81', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:10.868449 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ebf94-89e1-41f6-9790-77b1774db5eb tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:10.868775 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ebf94-89e1-41f6-9790-77b1774db5eb tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:10.869068 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ebf94-89e1-41f6-9790-77b1774db5eb tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] PATH_INFO: `/v3/services` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:10.869839 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ebf94-89e1-41f6-9790-77b1774db5eb tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1820729499) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:25:10.870175 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ebf94-89e1-41f6-9790-77b1774db5eb tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:10.871815 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ebf94-89e1-41f6-9790-77b1774db5eb tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:10.893408 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2315/4626] 10.222.0.23 () {58 vars in 1221 bytes} [Sat Apr 30 21:25:10 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1820729499 => generated 418 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:25:10.895751 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f88435-f292-44af-a36f-ec29e4714997 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:10.908671 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f88435-f292-44af-a36f-ec29e4714997 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:10.923840 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b20d60-5651-44d5-8140-e49856ba354a tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f3c44c884c4bc683b67c12cfbd69dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5dd2979fda24d10869f17577060cc81', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:10.925592 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b20d60-5651-44d5-8140-e49856ba354a tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:10.926145 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b20d60-5651-44d5-8140-e49856ba354a tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:10.926833 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b20d60-5651-44d5-8140-e49856ba354a tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] PATH_INFO: `/v3/services/64248af1598247d1a3320cee414bbb51` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:10.927657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b20d60-5651-44d5-8140-e49856ba354a tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: Authorizing `identity:delete_service(service_id=64248af1598247d1a3320cee414bbb51)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:10.929242 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-42b20d60-5651-44d5-8140-e49856ba354a tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:25:10.929242 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:25:10.929242 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:25:10.932300 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b20d60-5651-44d5-8140-e49856ba354a tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:11.183547 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2312/4627] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:25:10 2022] DELETE /identity/v3/services/64248af1598247d1a3320cee414bbb51 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:11.185793 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ebf94-89e1-41f6-9790-77b1774db5eb tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:11.199217 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ebf94-89e1-41f6-9790-77b1774db5eb tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:11.248443 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12dd515-93eb-4023-9d86-f5cf70dfb8f1 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f3c44c884c4bc683b67c12cfbd69dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5dd2979fda24d10869f17577060cc81', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:11.249656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12dd515-93eb-4023-9d86-f5cf70dfb8f1 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:11.253957 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12dd515-93eb-4023-9d86-f5cf70dfb8f1 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:11.253957 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12dd515-93eb-4023-9d86-f5cf70dfb8f1 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] PATH_INFO: `/v3/services/a2eb294e45dc4d5088fb45ca1a826c58` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:11.253957 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12dd515-93eb-4023-9d86-f5cf70dfb8f1 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: Authorizing `identity:delete_service(service_id=a2eb294e45dc4d5088fb45ca1a826c58)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:11.253957 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12dd515-93eb-4023-9d86-f5cf70dfb8f1 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:11.412870 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2316/4628] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:25:11 2022] DELETE /identity/v3/services/a2eb294e45dc4d5088fb45ca1a826c58 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:11.419726 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b20d60-5651-44d5-8140-e49856ba354a tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:11.433277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b20d60-5651-44d5-8140-e49856ba354a tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:11.501223 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7732494-b628-4649-9e1f-57437c8384d0 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28f3c44c884c4bc683b67c12cfbd69dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5dd2979fda24d10869f17577060cc81', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:11.501223 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7732494-b628-4649-9e1f-57437c8384d0 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:11.501223 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7732494-b628-4649-9e1f-57437c8384d0 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:11.501544 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7732494-b628-4649-9e1f-57437c8384d0 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] PATH_INFO: `/v3/services/4b9823f6afa34ae7b0f3e1c384a09d11` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:11.501544 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7732494-b628-4649-9e1f-57437c8384d0 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: Authorizing `identity:delete_service(service_id=4b9823f6afa34ae7b0f3e1c384a09d11)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:11.501544 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7732494-b628-4649-9e1f-57437c8384d0 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:11.873413 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2313/4629] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:25:11 2022] DELETE /identity/v3/services/4b9823f6afa34ae7b0f3e1c384a09d11 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:11.878342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12dd515-93eb-4023-9d86-f5cf70dfb8f1 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:11.982937 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12dd515-93eb-4023-9d86-f5cf70dfb8f1 tempest-ServicesTestJSON-209066521 tempest-ServicesTestJSON-209066521-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:12.001211 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8010f-642d-42d2-9d45-05bc2e3e1c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:12.002730 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8010f-642d-42d2-9d45-05bc2e3e1c76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:12.003213 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8010f-642d-42d2-9d45-05bc2e3e1c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:12.003654 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8010f-642d-42d2-9d45-05bc2e3e1c76 admin admin] PATH_INFO: `/v3/users/3afcffd61ba940fb9fb621627718af80` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:12.005704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8010f-642d-42d2-9d45-05bc2e3e1c76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3afcffd61ba940fb9fb621627718af80)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:12.008301 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8010f-642d-42d2-9d45-05bc2e3e1c76 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:12.247792 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-45a8010f-642d-42d2-9d45-05bc2e3e1c76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3afcffd61ba940fb9fb621627718af80'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:12.266160 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-45a8010f-642d-42d2-9d45-05bc2e3e1c76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3afcffd61ba940fb9fb621627718af80'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:12.411177 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-45a8010f-642d-42d2-9d45-05bc2e3e1c76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3afcffd61ba940fb9fb621627718af80'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:12.411820 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-45a8010f-642d-42d2-9d45-05bc2e3e1c76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3afcffd61ba940fb9fb621627718af80'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:12.422112 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-45a8010f-642d-42d2-9d45-05bc2e3e1c76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3afcffd61ba940fb9fb621627718af80'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:12.437965 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2317/4630] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:25:11 2022] DELETE /identity/v3/users/3afcffd61ba940fb9fb621627718af80 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:12.449007 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf294c3-5a6b-434e-8519-6edce514db6f None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:12.449520 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf294c3-5a6b-434e-8519-6edce514db6f None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:12.449881 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf294c3-5a6b-434e-8519-6edce514db6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:12.484441 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-8cf294c3-5a6b-434e-8519-6edce514db6f None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:12.490076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8cf294c3-5a6b-434e-8519-6edce514db6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:12.645541 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2314/4631] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:25:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:25:12.673039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8010f-642d-42d2-9d45-05bc2e3e1c76 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:12.683536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-45a8010f-642d-42d2-9d45-05bc2e3e1c76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:12.801811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8010f-642d-42d2-9d45-05bc2e3e1c76 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:12.805782 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0d4cc-c709-4210-b54f-fab3bde83913 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:12.806462 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0d4cc-c709-4210-b54f-fab3bde83913 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:12.807655 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0d4cc-c709-4210-b54f-fab3bde83913 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:12.807946 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0d4cc-c709-4210-b54f-fab3bde83913 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:12.821572 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0d4cc-c709-4210-b54f-fab3bde83913 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:12.823514 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0d4cc-c709-4210-b54f-fab3bde83913 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:12.840204 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2318/4632] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:25:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:25:13.622823 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf294c3-5a6b-434e-8519-6edce514db6f None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:13.624432 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8cf294c3-5a6b-434e-8519-6edce514db6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:13.652294 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf294c3-5a6b-434e-8519-6edce514db6f None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:13.672345 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4b9d0-0f35-4639-8fd9-eaa7e4b1a6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:13.673200 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4b9d0-0f35-4639-8fd9-eaa7e4b1a6fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:13.673486 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4b9d0-0f35-4639-8fd9-eaa7e4b1a6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:13.673783 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4b9d0-0f35-4639-8fd9-eaa7e4b1a6fc admin admin] PATH_INFO: `/v3/projects/3cad2b0005a94547b636dd28b8aa28b8` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:13.678620 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab4b9d0-0f35-4639-8fd9-eaa7e4b1a6fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cad2b0005a94547b636dd28b8aa28b8)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:13.680584 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab4b9d0-0f35-4639-8fd9-eaa7e4b1a6fc admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:13.807993 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3ab4b9d0-0f35-4639-8fd9-eaa7e4b1a6fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cad2b0005a94547b636dd28b8aa28b8', 'request_id': 'req-3ab4b9d0-0f35-4639-8fd9-eaa7e4b1a6fc'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:13.815572 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3ab4b9d0-0f35-4639-8fd9-eaa7e4b1a6fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cad2b0005a94547b636dd28b8aa28b8', 'request_id': 'req-3ab4b9d0-0f35-4639-8fd9-eaa7e4b1a6fc'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:13.829326 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3ab4b9d0-0f35-4639-8fd9-eaa7e4b1a6fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cad2b0005a94547b636dd28b8aa28b8', 'request_id': 'req-3ab4b9d0-0f35-4639-8fd9-eaa7e4b1a6fc'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:13.927328 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3ab4b9d0-0f35-4639-8fd9-eaa7e4b1a6fc admin admin] The token cache is being invalidate because project 3cad2b0005a94547b636dd28b8aa28b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:25:13.928049 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3ab4b9d0-0f35-4639-8fd9-eaa7e4b1a6fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:13.928977 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3ab4b9d0-0f35-4639-8fd9-eaa7e4b1a6fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:13.936450 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2315/4633] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:25:13 2022] DELETE /identity/v3/projects/3cad2b0005a94547b636dd28b8aa28b8 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:13.937214 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0d4cc-c709-4210-b54f-fab3bde83913 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:13.956610 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0d4cc-c709-4210-b54f-fab3bde83913 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:14.111745 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ae5d3-9b85-4395-9106-4249c0dab4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:14.113380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ae5d3-9b85-4395-9106-4249c0dab4ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:14.113669 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ae5d3-9b85-4395-9106-4249c0dab4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:14.114488 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ae5d3-9b85-4395-9106-4249c0dab4ae admin admin] PATH_INFO: `/v3/users/28f3c44c884c4bc683b67c12cfbd69dc` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:14.116253 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ae5d3-9b85-4395-9106-4249c0dab4ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=28f3c44c884c4bc683b67c12cfbd69dc)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:14.119521 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ae5d3-9b85-4395-9106-4249c0dab4ae admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:14.336513 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5a7ae5d3-9b85-4395-9106-4249c0dab4ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28f3c44c884c4bc683b67c12cfbd69dc'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:14.363534 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5a7ae5d3-9b85-4395-9106-4249c0dab4ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28f3c44c884c4bc683b67c12cfbd69dc'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:14.482765 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5a7ae5d3-9b85-4395-9106-4249c0dab4ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28f3c44c884c4bc683b67c12cfbd69dc'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:14.483811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5a7ae5d3-9b85-4395-9106-4249c0dab4ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28f3c44c884c4bc683b67c12cfbd69dc'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:14.492182 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5a7ae5d3-9b85-4395-9106-4249c0dab4ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28f3c44c884c4bc683b67c12cfbd69dc'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:14.498491 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2319/4634] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:25:13 2022] DELETE /identity/v3/users/28f3c44c884c4bc683b67c12cfbd69dc => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:15.147571 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4b9d0-0f35-4639-8fd9-eaa7e4b1a6fc admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:15.149389 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3ab4b9d0-0f35-4639-8fd9-eaa7e4b1a6fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:15.198874 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4b9d0-0f35-4639-8fd9-eaa7e4b1a6fc admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:15.360508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056373f-b48f-4f30-9572-224488bbc7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:15.361429 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056373f-b48f-4f30-9572-224488bbc7ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:15.364027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056373f-b48f-4f30-9572-224488bbc7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:15.364332 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056373f-b48f-4f30-9572-224488bbc7ed admin admin] PATH_INFO: `/v3/projects/b5dd2979fda24d10869f17577060cc81` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:15.370085 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4056373f-b48f-4f30-9572-224488bbc7ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5dd2979fda24d10869f17577060cc81)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:15.374348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4056373f-b48f-4f30-9572-224488bbc7ed admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:15.558500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4056373f-b48f-4f30-9572-224488bbc7ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5dd2979fda24d10869f17577060cc81', 'request_id': 'req-4056373f-b48f-4f30-9572-224488bbc7ed'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:15.579555 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4056373f-b48f-4f30-9572-224488bbc7ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5dd2979fda24d10869f17577060cc81', 'request_id': 'req-4056373f-b48f-4f30-9572-224488bbc7ed'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:15.598238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4056373f-b48f-4f30-9572-224488bbc7ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5dd2979fda24d10869f17577060cc81', 'request_id': 'req-4056373f-b48f-4f30-9572-224488bbc7ed'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:15.695872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4056373f-b48f-4f30-9572-224488bbc7ed admin admin] The token cache is being invalidate because project b5dd2979fda24d10869f17577060cc81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:25:15.695872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4056373f-b48f-4f30-9572-224488bbc7ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:15.696761 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4056373f-b48f-4f30-9572-224488bbc7ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:15.716732 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2316/4635] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:25:15 2022] DELETE /identity/v3/projects/b5dd2979fda24d10869f17577060cc81 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:15.719795 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5c603-d252-44dc-89af-a9ff4a86f950 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:15.720937 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5c603-d252-44dc-89af-a9ff4a86f950 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:15.721507 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5c603-d252-44dc-89af-a9ff4a86f950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:15.790793 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-f9c5c603-d252-44dc-89af-a9ff4a86f950 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:15.790793 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f9c5c603-d252-44dc-89af-a9ff4a86f950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:15.968304 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2320/4636] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:25:15.982130 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cc54b-42ea-4813-a1c5-f4606e88f866 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:15.982453 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cc54b-42ea-4813-a1c5-f4606e88f866 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:15.982712 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cc54b-42ea-4813-a1c5-f4606e88f866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:16.005631 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-c36cc54b-42ea-4813-a1c5-f4606e88f866 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:16.007125 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c36cc54b-42ea-4813-a1c5-f4606e88f866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:16.043217 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2317/4637] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:25:16.043337 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5c603-d252-44dc-89af-a9ff4a86f950 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:16.050451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5c603-d252-44dc-89af-a9ff4a86f950 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:16.055455 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660429ae-c132-4b10-b6ce-bbec16f96bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:16.056143 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660429ae-c132-4b10-b6ce-bbec16f96bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:16.056426 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660429ae-c132-4b10-b6ce-bbec16f96bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:16.056728 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660429ae-c132-4b10-b6ce-bbec16f96bd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:16.057508 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660429ae-c132-4b10-b6ce-bbec16f96bd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:25:16.057863 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660429ae-c132-4b10-b6ce-bbec16f96bd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:16.059507 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660429ae-c132-4b10-b6ce-bbec16f96bd3 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:16.071779 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2321/4638] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:25:16.076260 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36cc54b-42ea-4813-a1c5-f4606e88f866 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:16.086642 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36cc54b-42ea-4813-a1c5-f4606e88f866 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:16.091528 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02adacc7-37b7-44f7-8347-133cc22aff52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:16.092183 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adacc7-37b7-44f7-8347-133cc22aff52 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:16.092467 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adacc7-37b7-44f7-8347-133cc22aff52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:16.092744 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adacc7-37b7-44f7-8347-133cc22aff52 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:16.093445 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02adacc7-37b7-44f7-8347-133cc22aff52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:16.096077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02adacc7-37b7-44f7-8347-133cc22aff52 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:16.650608 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2318/4639] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:25:16 2022] POST /identity/v3/projects => generated 369 bytes in 575 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:25:16.655033 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660429ae-c132-4b10-b6ce-bbec16f96bd3 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:16.671334 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660429ae-c132-4b10-b6ce-bbec16f96bd3 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:16.773427 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad1b3a-c005-4356-bd79-3b64c1f5a46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:16.774870 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad1b3a-c005-4356-bd79-3b64c1f5a46d admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:16.775257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad1b3a-c005-4356-bd79-3b64c1f5a46d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:16.775642 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad1b3a-c005-4356-bd79-3b64c1f5a46d admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:16.777029 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad1b3a-c005-4356-bd79-3b64c1f5a46d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:16.779606 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad1b3a-c005-4356-bd79-3b64c1f5a46d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:16.879093 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2322/4640] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:25:16 2022] POST /identity/v3/users => generated 285 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:25:16.880632 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02adacc7-37b7-44f7-8347-133cc22aff52 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:16.895824 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02adacc7-37b7-44f7-8347-133cc22aff52 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:16.904185 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60dae18-ff5e-446f-9bbe-596724987886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:16.905806 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60dae18-ff5e-446f-9bbe-596724987886 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:16.906656 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60dae18-ff5e-446f-9bbe-596724987886 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:16.906978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60dae18-ff5e-446f-9bbe-596724987886 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:16.907722 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60dae18-ff5e-446f-9bbe-596724987886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:16.909382 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60dae18-ff5e-446f-9bbe-596724987886 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:16.929083 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2319/4641] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:25:16.931438 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad1b3a-c005-4356-bd79-3b64c1f5a46d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:16.944230 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad1b3a-c005-4356-bd79-3b64c1f5a46d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:16.969851 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2790e0-dce1-4b92-9faf-a5f7d15ab91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:16.973605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2790e0-dce1-4b92-9faf-a5f7d15ab91e admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:16.973605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2790e0-dce1-4b92-9faf-a5f7d15ab91e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:16.973605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2790e0-dce1-4b92-9faf-a5f7d15ab91e admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:16.973605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2790e0-dce1-4b92-9faf-a5f7d15ab91e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:16.980907 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2790e0-dce1-4b92-9faf-a5f7d15ab91e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:17.009345 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2323/4642] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:25:17.013153 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60dae18-ff5e-446f-9bbe-596724987886 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:17.030854 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60dae18-ff5e-446f-9bbe-596724987886 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:17.040864 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd42034-b27a-43ca-a77e-846ae75a8a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:17.044461 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd42034-b27a-43ca-a77e-846ae75a8a84 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:17.044461 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd42034-b27a-43ca-a77e-846ae75a8a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:17.044461 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd42034-b27a-43ca-a77e-846ae75a8a84 admin admin] PATH_INFO: `/v3/projects/5e72a582148047e6a80e5b080c5f5900/users/e4ecd18d05c64e8b91119b5933c61fd1/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:17.084231 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd42034-b27a-43ca-a77e-846ae75a8a84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e72a582148047e6a80e5b080c5f5900, user_id=e4ecd18d05c64e8b91119b5933c61fd1, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:17.089555 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd42034-b27a-43ca-a77e-846ae75a8a84 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:17.183675 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2320/4643] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:25:17 2022] PUT /identity/v3/projects/5e72a582148047e6a80e5b080c5f5900/users/e4ecd18d05c64e8b91119b5933c61fd1/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:17.194159 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614be0b-0cd2-44bc-82af-6b8d17cfba6a None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:17.194596 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614be0b-0cd2-44bc-82af-6b8d17cfba6a None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:17.195002 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614be0b-0cd2-44bc-82af-6b8d17cfba6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:17.249129 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-e614be0b-0cd2-44bc-82af-6b8d17cfba6a None None] MFA Rules not processed for user `e4ecd18d05c64e8b91119b5933c61fd1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:17.251222 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e614be0b-0cd2-44bc-82af-6b8d17cfba6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:17.359802 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2324/4644] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:25:17 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:25:17.366721 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd42034-b27a-43ca-a77e-846ae75a8a84 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:17.489637 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd42034-b27a-43ca-a77e-846ae75a8a84 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:17.503026 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52778655-c8f8-4d1e-9bee-bcfd7c94c18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:17.503716 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52778655-c8f8-4d1e-9bee-bcfd7c94c18b admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:17.504000 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52778655-c8f8-4d1e-9bee-bcfd7c94c18b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:17.504277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52778655-c8f8-4d1e-9bee-bcfd7c94c18b admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:17.504975 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52778655-c8f8-4d1e-9bee-bcfd7c94c18b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:17.511006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52778655-c8f8-4d1e-9bee-bcfd7c94c18b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:17.634911 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2321/4645] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:25:17 2022] POST /identity/v3/projects => generated 367 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:25:17.635453 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614be0b-0cd2-44bc-82af-6b8d17cfba6a None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:17.655721 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614be0b-0cd2-44bc-82af-6b8d17cfba6a None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:17.767111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb4e7d-6cd2-4ad9-ad72-ec9b169e27f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:17.767111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb4e7d-6cd2-4ad9-ad72-ec9b169e27f7 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:17.767111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb4e7d-6cd2-4ad9-ad72-ec9b169e27f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:17.767111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb4e7d-6cd2-4ad9-ad72-ec9b169e27f7 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:17.767645 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb4e7d-6cd2-4ad9-ad72-ec9b169e27f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:17.769732 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb4e7d-6cd2-4ad9-ad72-ec9b169e27f7 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:17.874327 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2325/4646] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:25:17 2022] POST /identity/v3/users => generated 290 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:25:17.879071 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52778655-c8f8-4d1e-9bee-bcfd7c94c18b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:17.900937 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52778655-c8f8-4d1e-9bee-bcfd7c94c18b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:17.906814 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee0aee-4fc1-4a35-b9c5-5aa98a3d6827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:17.907775 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee0aee-4fc1-4a35-b9c5-5aa98a3d6827 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:17.908272 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee0aee-4fc1-4a35-b9c5-5aa98a3d6827 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:17.908750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee0aee-4fc1-4a35-b9c5-5aa98a3d6827 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:17.909870 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee0aee-4fc1-4a35-b9c5-5aa98a3d6827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:17.911785 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee0aee-4fc1-4a35-b9c5-5aa98a3d6827 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:17.928747 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2322/4647] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:25:17.930441 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb4e7d-6cd2-4ad9-ad72-ec9b169e27f7 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:17.943001 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb4e7d-6cd2-4ad9-ad72-ec9b169e27f7 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:17.951105 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2d468-5525-498f-9a5a-44d72b60f972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:17.952880 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2d468-5525-498f-9a5a-44d72b60f972 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:17.952880 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2d468-5525-498f-9a5a-44d72b60f972 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:17.952880 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2d468-5525-498f-9a5a-44d72b60f972 admin admin] PATH_INFO: `/v3/projects/e927641110f547ef8a40e4babfac56c9/users/df9bfebdf8544b329f058d3a83580557/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:17.975215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b2d468-5525-498f-9a5a-44d72b60f972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e927641110f547ef8a40e4babfac56c9, user_id=df9bfebdf8544b329f058d3a83580557, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:17.978110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b2d468-5525-498f-9a5a-44d72b60f972 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:18.089038 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2326/4648] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:25:17 2022] PUT /identity/v3/projects/e927641110f547ef8a40e4babfac56c9/users/df9bfebdf8544b329f058d3a83580557/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:18.093160 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee0aee-4fc1-4a35-b9c5-5aa98a3d6827 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:18.117558 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee0aee-4fc1-4a35-b9c5-5aa98a3d6827 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:18.207096 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff910366-a3ab-4c32-884c-2a1b833693ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:18.208213 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff910366-a3ab-4c32-884c-2a1b833693ad admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:18.208688 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff910366-a3ab-4c32-884c-2a1b833693ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:18.209911 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff910366-a3ab-4c32-884c-2a1b833693ad admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:18.210841 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff910366-a3ab-4c32-884c-2a1b833693ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:18.214591 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff910366-a3ab-4c32-884c-2a1b833693ad admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:18.227010 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2323/4649] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:25:18.231298 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2d468-5525-498f-9a5a-44d72b60f972 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:18.248840 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2d468-5525-498f-9a5a-44d72b60f972 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:18.259334 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83358ae3-393e-4db7-9f2d-b7ffb3be5b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:18.260250 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83358ae3-393e-4db7-9f2d-b7ffb3be5b9e admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:18.260572 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83358ae3-393e-4db7-9f2d-b7ffb3be5b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:18.260916 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83358ae3-393e-4db7-9f2d-b7ffb3be5b9e admin admin] PATH_INFO: `/v3/projects/e927641110f547ef8a40e4babfac56c9/users/df9bfebdf8544b329f058d3a83580557/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:18.270049 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83358ae3-393e-4db7-9f2d-b7ffb3be5b9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e927641110f547ef8a40e4babfac56c9, user_id=df9bfebdf8544b329f058d3a83580557, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:18.274239 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83358ae3-393e-4db7-9f2d-b7ffb3be5b9e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:18.292561 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2327/4650] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:25:18 2022] PUT /identity/v3/projects/e927641110f547ef8a40e4babfac56c9/users/df9bfebdf8544b329f058d3a83580557/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:18.305388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7a3a2-3813-4fd2-91d7-bce59d6e9dec None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:18.306159 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7a3a2-3813-4fd2-91d7-bce59d6e9dec None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:18.306522 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7a3a2-3813-4fd2-91d7-bce59d6e9dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:18.341418 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-99c7a3a2-3813-4fd2-91d7-bce59d6e9dec None None] MFA Rules not processed for user `df9bfebdf8544b329f058d3a83580557`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:18.342772 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-99c7a3a2-3813-4fd2-91d7-bce59d6e9dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:18.447046 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2324/4651] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:25:18 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:25:18.451413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83358ae3-393e-4db7-9f2d-b7ffb3be5b9e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:18.528852 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83358ae3-393e-4db7-9f2d-b7ffb3be5b9e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:18.543499 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d3df93-6748-4487-a3f4-d47119739742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:18.545098 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3df93-6748-4487-a3f4-d47119739742 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:18.549422 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3df93-6748-4487-a3f4-d47119739742 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:18.549717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3df93-6748-4487-a3f4-d47119739742 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:18.550472 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d3df93-6748-4487-a3f4-d47119739742 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:18.552604 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d3df93-6748-4487-a3f4-d47119739742 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:18.665884 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2328/4652] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:25:18 2022] POST /identity/v3/projects => generated 369 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:25:18.670158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7a3a2-3813-4fd2-91d7-bce59d6e9dec None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:18.684710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7a3a2-3813-4fd2-91d7-bce59d6e9dec None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:18.804150 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa0070-c4a1-44a8-b4d3-33933cbf674b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:18.804868 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa0070-c4a1-44a8-b4d3-33933cbf674b admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:18.805156 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa0070-c4a1-44a8-b4d3-33933cbf674b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:18.805437 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aa0070-c4a1-44a8-b4d3-33933cbf674b admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:18.806203 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa0070-c4a1-44a8-b4d3-33933cbf674b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:18.808658 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aa0070-c4a1-44a8-b4d3-33933cbf674b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:18.986878 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2325/4653] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:25:18 2022] POST /identity/v3/users => generated 285 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:25:18.989412 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d3df93-6748-4487-a3f4-d47119739742 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:19.032818 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d3df93-6748-4487-a3f4-d47119739742 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:19.037240 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6f841-2e34-40c3-a4e4-d1e3cb2c6c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:19.038075 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6f841-2e34-40c3-a4e4-d1e3cb2c6c7b admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:19.038435 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6f841-2e34-40c3-a4e4-d1e3cb2c6c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:19.038785 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6f841-2e34-40c3-a4e4-d1e3cb2c6c7b admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:19.039767 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6f841-2e34-40c3-a4e4-d1e3cb2c6c7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:19.041544 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6f841-2e34-40c3-a4e4-d1e3cb2c6c7b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:19.057522 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2329/4654] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:25:19.063758 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa0070-c4a1-44a8-b4d3-33933cbf674b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:19.070521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aa0070-c4a1-44a8-b4d3-33933cbf674b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:19.076007 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f8481-07db-4883-929f-fdc2eff91607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:19.077228 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f8481-07db-4883-929f-fdc2eff91607 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:19.078431 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f8481-07db-4883-929f-fdc2eff91607 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:19.078890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f8481-07db-4883-929f-fdc2eff91607 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:19.079885 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f8481-07db-4883-929f-fdc2eff91607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:19.082541 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f8481-07db-4883-929f-fdc2eff91607 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:19.101748 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2326/4655] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:25:19.105072 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6f841-2e34-40c3-a4e4-d1e3cb2c6c7b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:19.135268 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6f841-2e34-40c3-a4e4-d1e3cb2c6c7b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:19.142088 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4775634-d88b-403b-a6c6-2f68eb1dc370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:19.143288 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4775634-d88b-403b-a6c6-2f68eb1dc370 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:19.143873 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4775634-d88b-403b-a6c6-2f68eb1dc370 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:19.144325 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4775634-d88b-403b-a6c6-2f68eb1dc370 admin admin] PATH_INFO: `/v3/projects/8c8a2f821cea47f9b918fbc11d9b71ea/users/f455064f5088443a89e77a376b0a10ef/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:19.165153 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4775634-d88b-403b-a6c6-2f68eb1dc370 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c8a2f821cea47f9b918fbc11d9b71ea, user_id=f455064f5088443a89e77a376b0a10ef, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:19.168802 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4775634-d88b-403b-a6c6-2f68eb1dc370 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:19.247544 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2330/4656] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:25:19 2022] PUT /identity/v3/projects/8c8a2f821cea47f9b918fbc11d9b71ea/users/f455064f5088443a89e77a376b0a10ef/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:19.259076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f13e4-609b-44cc-ba4f-d2687084253f None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:19.259579 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f13e4-609b-44cc-ba4f-d2687084253f None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:19.260030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f13e4-609b-44cc-ba4f-d2687084253f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:19.307890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-9d3f13e4-609b-44cc-ba4f-d2687084253f None None] MFA Rules not processed for user `f455064f5088443a89e77a376b0a10ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:19.310244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9d3f13e4-609b-44cc-ba4f-d2687084253f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:19.449177 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2327/4657] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:25:19 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:25:19.453106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4775634-d88b-403b-a6c6-2f68eb1dc370 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:19.585818 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4775634-d88b-403b-a6c6-2f68eb1dc370 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:19.592466 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f71e6-fffe-4abe-94af-3fd3b9ec451f tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:19.594124 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f71e6-fffe-4abe-94af-3fd3b9ec451f tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:19.594987 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f71e6-fffe-4abe-94af-3fd3b9ec451f tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:19.595919 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f71e6-fffe-4abe-94af-3fd3b9ec451f tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:19.597792 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f71e6-fffe-4abe-94af-3fd3b9ec451f tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:19.600869 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f71e6-fffe-4abe-94af-3fd3b9ec451f tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:19.698951 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2331/4658] 10.222.0.23 () {60 vars in 1148 bytes} [Sat Apr 30 21:25:19 2022] POST /identity/v3/domains => generated 275 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:25:19.704339 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f13e4-609b-44cc-ba4f-d2687084253f None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:19.719235 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f13e4-609b-44cc-ba4f-d2687084253f None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:19.867670 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f55b8-2dc3-434d-afed-02d1fdbfc56c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:19.870470 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f55b8-2dc3-434d-afed-02d1fdbfc56c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:19.878435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f55b8-2dc3-434d-afed-02d1fdbfc56c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:19.878435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f55b8-2dc3-434d-afed-02d1fdbfc56c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:19.879793 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f55b8-2dc3-434d-afed-02d1fdbfc56c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:19.881796 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f55b8-2dc3-434d-afed-02d1fdbfc56c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:19.967253 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2328/4659] 10.222.0.23 () {60 vars in 1142 bytes} [Sat Apr 30 21:25:19 2022] POST /identity/v3/roles => generated 240 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:25:19.971711 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f71e6-fffe-4abe-94af-3fd3b9ec451f tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:19.998016 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f71e6-fffe-4abe-94af-3fd3b9ec451f tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:20.020685 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af297a78-c9bf-4d24-9126-bf20dccd6143 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:20.021615 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af297a78-c9bf-4d24-9126-bf20dccd6143 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:20.021953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af297a78-c9bf-4d24-9126-bf20dccd6143 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:20.022232 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af297a78-c9bf-4d24-9126-bf20dccd6143 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/domains/97e7ad4e5bac430a95c6bcd5275f31c3/users/f455064f5088443a89e77a376b0a10ef/roles/6711a3978dbd4b158577e8db4f392819` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:20.054741 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af297a78-c9bf-4d24-9126-bf20dccd6143 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=97e7ad4e5bac430a95c6bcd5275f31c3, user_id=f455064f5088443a89e77a376b0a10ef, role_id=6711a3978dbd4b158577e8db4f392819)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:20.057567 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af297a78-c9bf-4d24-9126-bf20dccd6143 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:20.165694 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2332/4660] 10.222.0.23 () {60 vars in 1479 bytes} [Sat Apr 30 21:25:19 2022] PUT /identity/v3/domains/97e7ad4e5bac430a95c6bcd5275f31c3/users/f455064f5088443a89e77a376b0a10ef/roles/6711a3978dbd4b158577e8db4f392819 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:20.166747 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f55b8-2dc3-434d-afed-02d1fdbfc56c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:20.184902 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f55b8-2dc3-434d-afed-02d1fdbfc56c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:20.277001 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc985c18-a2b3-4ff6-a31f-05ca4e59b005 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:20.278330 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc985c18-a2b3-4ff6-a31f-05ca4e59b005 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:20.278912 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc985c18-a2b3-4ff6-a31f-05ca4e59b005 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:20.280145 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc985c18-a2b3-4ff6-a31f-05ca4e59b005 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:20.282681 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc985c18-a2b3-4ff6-a31f-05ca4e59b005 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:20.284889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc985c18-a2b3-4ff6-a31f-05ca4e59b005 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:20.375851 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2329/4661] 10.222.0.23 () {60 vars in 1148 bytes} [Sat Apr 30 21:25:20 2022] POST /identity/v3/domains => generated 276 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:25:20.379302 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af297a78-c9bf-4d24-9126-bf20dccd6143 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:20.395846 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af297a78-c9bf-4d24-9126-bf20dccd6143 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:20.490586 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95dde59-6f16-4a8e-ae3b-4a418d1edfbd tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:20.491401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95dde59-6f16-4a8e-ae3b-4a418d1edfbd tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:20.491695 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95dde59-6f16-4a8e-ae3b-4a418d1edfbd tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:20.491972 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95dde59-6f16-4a8e-ae3b-4a418d1edfbd tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:20.492832 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95dde59-6f16-4a8e-ae3b-4a418d1edfbd tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:20.494780 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95dde59-6f16-4a8e-ae3b-4a418d1edfbd tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:20.599834 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2333/4662] 10.222.0.23 () {60 vars in 1142 bytes} [Sat Apr 30 21:25:20 2022] POST /identity/v3/roles => generated 240 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:25:20.604027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc985c18-a2b3-4ff6-a31f-05ca4e59b005 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:20.617155 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc985c18-a2b3-4ff6-a31f-05ca4e59b005 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:20.628651 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a1c9c7-f624-4509-a6c1-9f94e4fa2e98 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:20.629474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1c9c7-f624-4509-a6c1-9f94e4fa2e98 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:20.629896 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1c9c7-f624-4509-a6c1-9f94e4fa2e98 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:20.630276 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1c9c7-f624-4509-a6c1-9f94e4fa2e98 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/groups` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:20.632924 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a1c9c7-f624-4509-a6c1-9f94e4fa2e98 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:20.648281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a1c9c7-f624-4509-a6c1-9f94e4fa2e98 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:20.737768 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2330/4663] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:25:20 2022] POST /identity/v3/groups => generated 325 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:25:20.742181 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95dde59-6f16-4a8e-ae3b-4a418d1edfbd tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:20.757583 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95dde59-6f16-4a8e-ae3b-4a418d1edfbd tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:20.773068 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a18217-8d1a-4cf2-8f5c-34855227c238 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:20.774201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a18217-8d1a-4cf2-8f5c-34855227c238 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:20.774861 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a18217-8d1a-4cf2-8f5c-34855227c238 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:20.774861 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a18217-8d1a-4cf2-8f5c-34855227c238 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/groups/e7cb20bc0bc1470ea3debec5950bd941/users/f455064f5088443a89e77a376b0a10ef` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:20.786147 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a18217-8d1a-4cf2-8f5c-34855227c238 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=e7cb20bc0bc1470ea3debec5950bd941, user_id=f455064f5088443a89e77a376b0a10ef)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:20.790083 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a18217-8d1a-4cf2-8f5c-34855227c238 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:21.067146 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2334/4664] 10.222.0.23 () {60 vars in 1359 bytes} [Sat Apr 30 21:25:20 2022] PUT /identity/v3/groups/e7cb20bc0bc1470ea3debec5950bd941/users/f455064f5088443a89e77a376b0a10ef => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:21.071776 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a1c9c7-f624-4509-a6c1-9f94e4fa2e98 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:21.085625 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a1c9c7-f624-4509-a6c1-9f94e4fa2e98 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:21.155636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ceec30-5a26-4d0d-8b50-961c56fcf360 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:21.157034 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ceec30-5a26-4d0d-8b50-961c56fcf360 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:21.157322 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ceec30-5a26-4d0d-8b50-961c56fcf360 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:21.157603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ceec30-5a26-4d0d-8b50-961c56fcf360 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/domains/f11e3021a3654e7882c1fde6c2090241/groups/e7cb20bc0bc1470ea3debec5950bd941/roles/c98e8eb646134fc5a7f87402544c507f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:21.159874 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ceec30-5a26-4d0d-8b50-961c56fcf360 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=f11e3021a3654e7882c1fde6c2090241, group_id=e7cb20bc0bc1470ea3debec5950bd941, role_id=c98e8eb646134fc5a7f87402544c507f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:21.162652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ceec30-5a26-4d0d-8b50-961c56fcf360 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:21.333554 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2331/4665] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:25:21 2022] PUT /identity/v3/domains/f11e3021a3654e7882c1fde6c2090241/groups/e7cb20bc0bc1470ea3debec5950bd941/roles/c98e8eb646134fc5a7f87402544c507f => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:25:21.337088 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a18217-8d1a-4cf2-8f5c-34855227c238 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:21.364068 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a18217-8d1a-4cf2-8f5c-34855227c238 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:21.493546 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1134a38-39ce-4e3d-98de-21f78a70752c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:21.495243 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1134a38-39ce-4e3d-98de-21f78a70752c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:21.496018 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1134a38-39ce-4e3d-98de-21f78a70752c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:21.496504 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1134a38-39ce-4e3d-98de-21f78a70752c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:21.497862 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1134a38-39ce-4e3d-98de-21f78a70752c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:21.501233 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1134a38-39ce-4e3d-98de-21f78a70752c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:21.600994 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2335/4666] 10.222.0.23 () {60 vars in 1148 bytes} [Sat Apr 30 21:25:21 2022] POST /identity/v3/domains => generated 276 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:25:21.604618 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ceec30-5a26-4d0d-8b50-961c56fcf360 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:21.631034 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ceec30-5a26-4d0d-8b50-961c56fcf360 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:21.706768 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ebcb3-b0ea-49e8-be04-a170122b3cc3 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:21.707572 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ebcb3-b0ea-49e8-be04-a170122b3cc3 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:21.707863 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ebcb3-b0ea-49e8-be04-a170122b3cc3 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:21.708361 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ebcb3-b0ea-49e8-be04-a170122b3cc3 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:21.708895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ebcb3-b0ea-49e8-be04-a170122b3cc3 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:21.710657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ebcb3-b0ea-49e8-be04-a170122b3cc3 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:21.828142 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1134a38-39ce-4e3d-98de-21f78a70752c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:21.830561 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2332/4667] 10.222.0.23 () {60 vars in 1142 bytes} [Sat Apr 30 21:25:21 2022] POST /identity/v3/roles => generated 240 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:25:21.839827 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1134a38-39ce-4e3d-98de-21f78a70752c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:21.845824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48a47b-109b-4228-9041-817eb2c72f3c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:21.849120 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48a47b-109b-4228-9041-817eb2c72f3c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:21.849120 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48a47b-109b-4228-9041-817eb2c72f3c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:21.849120 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48a47b-109b-4228-9041-817eb2c72f3c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/domains/0630f4c4e41f4d1489bcba93968557c7/users/f455064f5088443a89e77a376b0a10ef/roles/5e0658b6e1ac4e6c84faa4d7884b235f` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:21.861584 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a48a47b-109b-4228-9041-817eb2c72f3c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=0630f4c4e41f4d1489bcba93968557c7, user_id=f455064f5088443a89e77a376b0a10ef, role_id=5e0658b6e1ac4e6c84faa4d7884b235f)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:21.864678 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a48a47b-109b-4228-9041-817eb2c72f3c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:21.927162 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ebcb3-b0ea-49e8-be04-a170122b3cc3 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:21.928918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c02ebcb3-b0ea-49e8-be04-a170122b3cc3 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:21.957391 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2336/4668] 10.222.0.23 () {60 vars in 1479 bytes} [Sat Apr 30 21:25:21 2022] PUT /identity/v3/domains/0630f4c4e41f4d1489bcba93968557c7/users/f455064f5088443a89e77a376b0a10ef/roles/5e0658b6e1ac4e6c84faa4d7884b235f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:25:21.962532 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48a47b-109b-4228-9041-817eb2c72f3c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:22.038525 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ebcb3-b0ea-49e8-be04-a170122b3cc3 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:22.071861 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48a47b-109b-4228-9041-817eb2c72f3c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:22.081161 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548037c-bcce-4b70-a6c0-2b5981295df0 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:22.082280 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548037c-bcce-4b70-a6c0-2b5981295df0 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:22.082799 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548037c-bcce-4b70-a6c0-2b5981295df0 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:22.083088 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548037c-bcce-4b70-a6c0-2b5981295df0 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:22.083851 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548037c-bcce-4b70-a6c0-2b5981295df0 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:22.085552 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548037c-bcce-4b70-a6c0-2b5981295df0 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:22.097053 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73924ff7-179d-42da-8592-e67663332dd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:22.097712 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73924ff7-179d-42da-8592-e67663332dd9 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:22.098043 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73924ff7-179d-42da-8592-e67663332dd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:22.098321 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73924ff7-179d-42da-8592-e67663332dd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:22.109877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-73924ff7-179d-42da-8592-e67663332dd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:22.173526 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73924ff7-179d-42da-8592-e67663332dd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:22.175094 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73924ff7-179d-42da-8592-e67663332dd9 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:22.195656 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2333/4669] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:25:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:25:22.298328 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2337/4670] 10.222.0.23 () {60 vars in 1148 bytes} [Sat Apr 30 21:25:21 2022] POST /identity/v3/domains => generated 276 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:25:22.302391 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73924ff7-179d-42da-8592-e67663332dd9 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:22.315550 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73924ff7-179d-42da-8592-e67663332dd9 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:22.382715 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fcdad1-311d-4f9b-9779-e8759ac5f7c0 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:22.383371 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fcdad1-311d-4f9b-9779-e8759ac5f7c0 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:22.383664 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fcdad1-311d-4f9b-9779-e8759ac5f7c0 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:22.384010 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fcdad1-311d-4f9b-9779-e8759ac5f7c0 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:22.384896 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fcdad1-311d-4f9b-9779-e8759ac5f7c0 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:22.386716 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fcdad1-311d-4f9b-9779-e8759ac5f7c0 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:22.488647 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2334/4671] 10.222.0.23 () {60 vars in 1142 bytes} [Sat Apr 30 21:25:22 2022] POST /identity/v3/roles => generated 240 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:25:22.492943 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548037c-bcce-4b70-a6c0-2b5981295df0 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:22.512972 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548037c-bcce-4b70-a6c0-2b5981295df0 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:22.522596 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e556d6-240f-4c2d-bf4f-6b6505f2bccd tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:22.522904 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e556d6-240f-4c2d-bf4f-6b6505f2bccd tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:22.523198 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e556d6-240f-4c2d-bf4f-6b6505f2bccd tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:22.523518 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e556d6-240f-4c2d-bf4f-6b6505f2bccd tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/groups` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:22.524223 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e556d6-240f-4c2d-bf4f-6b6505f2bccd tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:22.526207 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e556d6-240f-4c2d-bf4f-6b6505f2bccd tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:22.625277 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2338/4672] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:25:22 2022] POST /identity/v3/groups => generated 326 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:25:22.629558 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fcdad1-311d-4f9b-9779-e8759ac5f7c0 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:22.642338 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fcdad1-311d-4f9b-9779-e8759ac5f7c0 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:22.657415 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce692e0-37e0-44e8-a9b4-2dcc347f5826 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:22.658565 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce692e0-37e0-44e8-a9b4-2dcc347f5826 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:22.658914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce692e0-37e0-44e8-a9b4-2dcc347f5826 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:22.659254 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce692e0-37e0-44e8-a9b4-2dcc347f5826 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/groups/ff84de8e322c44d4a49cf172267ff5fc/users/f455064f5088443a89e77a376b0a10ef` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:22.666016 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce692e0-37e0-44e8-a9b4-2dcc347f5826 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=ff84de8e322c44d4a49cf172267ff5fc, user_id=f455064f5088443a89e77a376b0a10ef)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:22.667364 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-2ce692e0-37e0-44e8-a9b4-2dcc347f5826 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:25:22.667364 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:25:22.667364 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:25:22.668979 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce692e0-37e0-44e8-a9b4-2dcc347f5826 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:22.764903 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2335/4673] 10.222.0.23 () {60 vars in 1359 bytes} [Sat Apr 30 21:25:22 2022] PUT /identity/v3/groups/ff84de8e322c44d4a49cf172267ff5fc/users/f455064f5088443a89e77a376b0a10ef => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:22.769553 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e556d6-240f-4c2d-bf4f-6b6505f2bccd tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:22.779500 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e556d6-240f-4c2d-bf4f-6b6505f2bccd tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:22.835875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c14441-57ae-4a1a-bc40-d0328fd5ab4c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:22.836790 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c14441-57ae-4a1a-bc40-d0328fd5ab4c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:22.837080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c14441-57ae-4a1a-bc40-d0328fd5ab4c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:22.837362 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c14441-57ae-4a1a-bc40-d0328fd5ab4c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/domains/74ca773197e24e7184d802e06a0c931e/groups/ff84de8e322c44d4a49cf172267ff5fc/roles/5a41a850e81d415bb8370333ff3d0c70` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:22.839695 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c14441-57ae-4a1a-bc40-d0328fd5ab4c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=74ca773197e24e7184d802e06a0c931e, group_id=ff84de8e322c44d4a49cf172267ff5fc, role_id=5a41a850e81d415bb8370333ff3d0c70)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:22.848322 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c14441-57ae-4a1a-bc40-d0328fd5ab4c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:22.929849 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2339/4674] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:25:22 2022] PUT /identity/v3/domains/74ca773197e24e7184d802e06a0c931e/groups/ff84de8e322c44d4a49cf172267ff5fc/roles/5a41a850e81d415bb8370333ff3d0c70 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:22.933975 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce692e0-37e0-44e8-a9b4-2dcc347f5826 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:23.032733 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce692e0-37e0-44e8-a9b4-2dcc347f5826 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:23.115153 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c660f36-024d-461a-bb32-b15b5b7a16d1 tempest-TokensV3TestJSON-1300537546 tempest-TokensV3TestJSON-1300537546-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f455064f5088443a89e77a376b0a10ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8c8a2f821cea47f9b918fbc11d9b71ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:23.115844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c660f36-024d-461a-bb32-b15b5b7a16d1 tempest-TokensV3TestJSON-1300537546 tempest-TokensV3TestJSON-1300537546-project] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:23.116141 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c660f36-024d-461a-bb32-b15b5b7a16d1 tempest-TokensV3TestJSON-1300537546 tempest-TokensV3TestJSON-1300537546-project] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:23.116422 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c660f36-024d-461a-bb32-b15b5b7a16d1 tempest-TokensV3TestJSON-1300537546 tempest-TokensV3TestJSON-1300537546-project] PATH_INFO: `/v3/auth/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:23.117061 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c660f36-024d-461a-bb32-b15b5b7a16d1 tempest-TokensV3TestJSON-1300537546 tempest-TokensV3TestJSON-1300537546-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:23.118203 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c660f36-024d-461a-bb32-b15b5b7a16d1 tempest-TokensV3TestJSON-1300537546 tempest-TokensV3TestJSON-1300537546-project] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:23.198692 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2336/4675] 10.222.0.23 () {58 vars in 1142 bytes} [Sat Apr 30 21:25:22 2022] GET /identity/v3/auth/domains => generated 1171 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:25:23.199955 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c14441-57ae-4a1a-bc40-d0328fd5ab4c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:23.266253 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c14441-57ae-4a1a-bc40-d0328fd5ab4c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:23.272606 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10c05d6-39d0-4cce-9eaa-dca6ea5ba7a9 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:23.273955 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c05d6-39d0-4cce-9eaa-dca6ea5ba7a9 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:23.274435 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c05d6-39d0-4cce-9eaa-dca6ea5ba7a9 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:23.274877 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10c05d6-39d0-4cce-9eaa-dca6ea5ba7a9 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/domains/74ca773197e24e7184d802e06a0c931e/groups/ff84de8e322c44d4a49cf172267ff5fc/roles/5a41a850e81d415bb8370333ff3d0c70` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:23.278363 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10c05d6-39d0-4cce-9eaa-dca6ea5ba7a9 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=74ca773197e24e7184d802e06a0c931e, group_id=ff84de8e322c44d4a49cf172267ff5fc, role_id=5a41a850e81d415bb8370333ff3d0c70)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:23.282030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10c05d6-39d0-4cce-9eaa-dca6ea5ba7a9 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:23.288185 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c10c05d6-39d0-4cce-9eaa-dca6ea5ba7a9 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invalidating the token cache because role 5a41a850e81d415bb8370333ff3d0c70 was removed from group ff84de8e322c44d4a49cf172267ff5fc on domain 74ca773197e24e7184d802e06a0c931e. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:25:23.288603 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c10c05d6-39d0-4cce-9eaa-dca6ea5ba7a9 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:23.289339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c10c05d6-39d0-4cce-9eaa-dca6ea5ba7a9 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:23.348903 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2340/4676] 10.222.0.23 () {58 vars in 1466 bytes} [Sat Apr 30 21:25:23 2022] DELETE /identity/v3/domains/74ca773197e24e7184d802e06a0c931e/groups/ff84de8e322c44d4a49cf172267ff5fc/roles/5a41a850e81d415bb8370333ff3d0c70 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:23.353338 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c660f36-024d-461a-bb32-b15b5b7a16d1 tempest-TokensV3TestJSON-1300537546 tempest-TokensV3TestJSON-1300537546-project] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:23.355110 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7c660f36-024d-461a-bb32-b15b5b7a16d1 tempest-TokensV3TestJSON-1300537546 tempest-TokensV3TestJSON-1300537546-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:23.370361 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c660f36-024d-461a-bb32-b15b5b7a16d1 tempest-TokensV3TestJSON-1300537546 tempest-TokensV3TestJSON-1300537546-project] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:23.430677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae37b292-e6f6-45f2-9365-a790a6305db0 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:23.432471 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37b292-e6f6-45f2-9365-a790a6305db0 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:23.432922 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37b292-e6f6-45f2-9365-a790a6305db0 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:23.433403 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37b292-e6f6-45f2-9365-a790a6305db0 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/groups/ff84de8e322c44d4a49cf172267ff5fc/users/f455064f5088443a89e77a376b0a10ef` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:23.435519 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae37b292-e6f6-45f2-9365-a790a6305db0 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=ff84de8e322c44d4a49cf172267ff5fc, user_id=f455064f5088443a89e77a376b0a10ef)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:23.438141 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae37b292-e6f6-45f2-9365-a790a6305db0 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:23.559137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ae37b292-e6f6-45f2-9365-a790a6305db0 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'f455064f5088443a89e77a376b0a10ef'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:23.664646 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2337/4677] 10.222.0.23 () {58 vars in 1343 bytes} [Sat Apr 30 21:25:23 2022] DELETE /identity/v3/groups/ff84de8e322c44d4a49cf172267ff5fc/users/f455064f5088443a89e77a376b0a10ef => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:23.668821 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10c05d6-39d0-4cce-9eaa-dca6ea5ba7a9 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:23.680127 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10c05d6-39d0-4cce-9eaa-dca6ea5ba7a9 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:23.758855 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c737c1b-ea17-485e-98d5-d4802b802c40 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:23.762827 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c737c1b-ea17-485e-98d5-d4802b802c40 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:23.762827 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c737c1b-ea17-485e-98d5-d4802b802c40 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:23.762827 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c737c1b-ea17-485e-98d5-d4802b802c40 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/groups/ff84de8e322c44d4a49cf172267ff5fc` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:23.762827 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c737c1b-ea17-485e-98d5-d4802b802c40 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:delete_group(group_id=ff84de8e322c44d4a49cf172267ff5fc)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:23.765569 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c737c1b-ea17-485e-98d5-d4802b802c40 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:23.896459 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2341/4678] 10.222.0.23 () {58 vars in 1226 bytes} [Sat Apr 30 21:25:23 2022] DELETE /identity/v3/groups/ff84de8e322c44d4a49cf172267ff5fc => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:23.900849 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae37b292-e6f6-45f2-9365-a790a6305db0 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:23.911777 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae37b292-e6f6-45f2-9365-a790a6305db0 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:24.000494 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74727948-bdbf-4a4e-a4c9-6f780262c152 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:24.001484 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74727948-bdbf-4a4e-a4c9-6f780262c152 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:24.003420 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74727948-bdbf-4a4e-a4c9-6f780262c152 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:24.003420 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74727948-bdbf-4a4e-a4c9-6f780262c152 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/roles/5a41a850e81d415bb8370333ff3d0c70` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:24.004422 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74727948-bdbf-4a4e-a4c9-6f780262c152 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5a41a850e81d415bb8370333ff3d0c70)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:24.006062 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74727948-bdbf-4a4e-a4c9-6f780262c152 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:24.136146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-74727948-bdbf-4a4e-a4c9-6f780262c152 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invalidating the token cache because role 5a41a850e81d415bb8370333ff3d0c70 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:25:24.136382 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-74727948-bdbf-4a4e-a4c9-6f780262c152 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:24.137008 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-74727948-bdbf-4a4e-a4c9-6f780262c152 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:24.139488 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2338/4679] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:25:23 2022] DELETE /identity/v3/roles/5a41a850e81d415bb8370333ff3d0c70 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:24.144219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c737c1b-ea17-485e-98d5-d4802b802c40 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:24.148908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1c737c1b-ea17-485e-98d5-d4802b802c40 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:24.162011 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c737c1b-ea17-485e-98d5-d4802b802c40 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:24.235525 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cbcf6f-e13a-4e1e-a57a-39d2682fe3de tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:24.236739 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbcf6f-e13a-4e1e-a57a-39d2682fe3de tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:24.237299 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbcf6f-e13a-4e1e-a57a-39d2682fe3de tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:24.237747 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbcf6f-e13a-4e1e-a57a-39d2682fe3de tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/domains/74ca773197e24e7184d802e06a0c931e` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:24.239312 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cbcf6f-e13a-4e1e-a57a-39d2682fe3de tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=74ca773197e24e7184d802e06a0c931e)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:24.241065 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cbcf6f-e13a-4e1e-a57a-39d2682fe3de tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:24.287429 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-24cbcf6f-e13a-4e1e-a57a-39d2682fe3de tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '74ca773197e24e7184d802e06a0c931e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:24.288568 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-24cbcf6f-e13a-4e1e-a57a-39d2682fe3de tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '74ca773197e24e7184d802e06a0c931e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:24.406125 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-24cbcf6f-e13a-4e1e-a57a-39d2682fe3de tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '74ca773197e24e7184d802e06a0c931e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:24.406827 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-24cbcf6f-e13a-4e1e-a57a-39d2682fe3de tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '74ca773197e24e7184d802e06a0c931e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:24.412841 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2342/4680] 10.222.0.23 () {60 vars in 1248 bytes} [Sat Apr 30 21:25:24 2022] PATCH /identity/v3/domains/74ca773197e24e7184d802e06a0c931e => generated 277 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:25:24.414084 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74727948-bdbf-4a4e-a4c9-6f780262c152 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:24.426405 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74727948-bdbf-4a4e-a4c9-6f780262c152 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:24.514158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc398b29-466b-4ab3-957f-93b098a8e273 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:24.515731 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc398b29-466b-4ab3-957f-93b098a8e273 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:24.516023 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc398b29-466b-4ab3-957f-93b098a8e273 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:24.516307 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc398b29-466b-4ab3-957f-93b098a8e273 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/domains/74ca773197e24e7184d802e06a0c931e` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:24.537928 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc398b29-466b-4ab3-957f-93b098a8e273 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=74ca773197e24e7184d802e06a0c931e)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:24.540438 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc398b29-466b-4ab3-957f-93b098a8e273 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:24.567327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-dc398b29-466b-4ab3-957f-93b098a8e273 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '74ca773197e24e7184d802e06a0c931e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:24.570729 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-dc398b29-466b-4ab3-957f-93b098a8e273 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '74ca773197e24e7184d802e06a0c931e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:24.713279 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-dc398b29-466b-4ab3-957f-93b098a8e273 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74ca773197e24e7184d802e06a0c931e', 'request_id': 'req-dc398b29-466b-4ab3-957f-93b098a8e273'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:24.720722 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-dc398b29-466b-4ab3-957f-93b098a8e273 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74ca773197e24e7184d802e06a0c931e', 'request_id': 'req-dc398b29-466b-4ab3-957f-93b098a8e273'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:24.727758 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-dc398b29-466b-4ab3-957f-93b098a8e273 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74ca773197e24e7184d802e06a0c931e', 'request_id': 'req-dc398b29-466b-4ab3-957f-93b098a8e273'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:24.806694 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-dc398b29-466b-4ab3-957f-93b098a8e273 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] The token cache is being invalidate because project 74ca773197e24e7184d802e06a0c931e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:25:24.809289 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-dc398b29-466b-4ab3-957f-93b098a8e273 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:24.809289 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-dc398b29-466b-4ab3-957f-93b098a8e273 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:24.816754 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-dc398b29-466b-4ab3-957f-93b098a8e273 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '74ca773197e24e7184d802e06a0c931e', 'request_id': 'req-dc398b29-466b-4ab3-957f-93b098a8e273'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:24.817463 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-dc398b29-466b-4ab3-957f-93b098a8e273 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '74ca773197e24e7184d802e06a0c931e', 'request_id': 'req-dc398b29-466b-4ab3-957f-93b098a8e273'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:24.818131 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-dc398b29-466b-4ab3-957f-93b098a8e273 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '74ca773197e24e7184d802e06a0c931e', 'request_id': 'req-dc398b29-466b-4ab3-957f-93b098a8e273'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:24.829790 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2339/4681] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:25:24 2022] DELETE /identity/v3/domains/74ca773197e24e7184d802e06a0c931e => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:25:24.832021 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cbcf6f-e13a-4e1e-a57a-39d2682fe3de tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:24.833490 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-24cbcf6f-e13a-4e1e-a57a-39d2682fe3de tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:24.849278 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cbcf6f-e13a-4e1e-a57a-39d2682fe3de tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:24.924610 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87733b-9766-41ee-8ad8-27a19b4a39b0 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:24.925550 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87733b-9766-41ee-8ad8-27a19b4a39b0 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:24.925864 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87733b-9766-41ee-8ad8-27a19b4a39b0 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:24.926148 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87733b-9766-41ee-8ad8-27a19b4a39b0 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/domains/0630f4c4e41f4d1489bcba93968557c7/users/f455064f5088443a89e77a376b0a10ef/roles/5e0658b6e1ac4e6c84faa4d7884b235f` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:24.929641 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87733b-9766-41ee-8ad8-27a19b4a39b0 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=0630f4c4e41f4d1489bcba93968557c7, user_id=f455064f5088443a89e77a376b0a10ef, role_id=5e0658b6e1ac4e6c84faa4d7884b235f)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:24.933042 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87733b-9766-41ee-8ad8-27a19b4a39b0 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:24.940570 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2a87733b-9766-41ee-8ad8-27a19b4a39b0 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invalidating the token cache because role 5e0658b6e1ac4e6c84faa4d7884b235f was removed from user f455064f5088443a89e77a376b0a10ef on domain 0630f4c4e41f4d1489bcba93968557c7. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:25:24.940873 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2a87733b-9766-41ee-8ad8-27a19b4a39b0 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:24.941928 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2a87733b-9766-41ee-8ad8-27a19b4a39b0 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:25.051545 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2343/4682] 10.222.0.23 () {58 vars in 1463 bytes} [Sat Apr 30 21:25:24 2022] DELETE /identity/v3/domains/0630f4c4e41f4d1489bcba93968557c7/users/f455064f5088443a89e77a376b0a10ef/roles/5e0658b6e1ac4e6c84faa4d7884b235f => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:25.055621 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc398b29-466b-4ab3-957f-93b098a8e273 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:25.057110 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-dc398b29-466b-4ab3-957f-93b098a8e273 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:25.069529 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc398b29-466b-4ab3-957f-93b098a8e273 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:25.131047 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f2926-2eec-4e8d-a070-f77db0bd8058 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:25.131904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f2926-2eec-4e8d-a070-f77db0bd8058 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:25.132193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f2926-2eec-4e8d-a070-f77db0bd8058 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:25.132474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f2926-2eec-4e8d-a070-f77db0bd8058 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/roles/5e0658b6e1ac4e6c84faa4d7884b235f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:25.133994 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f2926-2eec-4e8d-a070-f77db0bd8058 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5e0658b6e1ac4e6c84faa4d7884b235f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:25.135616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f2926-2eec-4e8d-a070-f77db0bd8058 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:25.236652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e02f2926-2eec-4e8d-a070-f77db0bd8058 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invalidating the token cache because role 5e0658b6e1ac4e6c84faa4d7884b235f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:25:25.236987 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e02f2926-2eec-4e8d-a070-f77db0bd8058 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:25.237972 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e02f2926-2eec-4e8d-a070-f77db0bd8058 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:25.240477 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2340/4683] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:25:25 2022] DELETE /identity/v3/roles/5e0658b6e1ac4e6c84faa4d7884b235f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:25.244794 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87733b-9766-41ee-8ad8-27a19b4a39b0 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:25.246910 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2a87733b-9766-41ee-8ad8-27a19b4a39b0 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:25.262661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87733b-9766-41ee-8ad8-27a19b4a39b0 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:25.342456 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586555d-bdf0-4945-8c89-3745f08a8eb4 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:25.344668 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586555d-bdf0-4945-8c89-3745f08a8eb4 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:25.345158 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586555d-bdf0-4945-8c89-3745f08a8eb4 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:25.345587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586555d-bdf0-4945-8c89-3745f08a8eb4 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/domains/0630f4c4e41f4d1489bcba93968557c7` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:25.347309 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8586555d-bdf0-4945-8c89-3745f08a8eb4 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0630f4c4e41f4d1489bcba93968557c7)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:25.349150 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8586555d-bdf0-4945-8c89-3745f08a8eb4 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:25.374014 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8586555d-bdf0-4945-8c89-3745f08a8eb4 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0630f4c4e41f4d1489bcba93968557c7'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:25.381344 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8586555d-bdf0-4945-8c89-3745f08a8eb4 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0630f4c4e41f4d1489bcba93968557c7'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:25.450463 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8586555d-bdf0-4945-8c89-3745f08a8eb4 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0630f4c4e41f4d1489bcba93968557c7'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:25.451566 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8586555d-bdf0-4945-8c89-3745f08a8eb4 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0630f4c4e41f4d1489bcba93968557c7'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:25.454210 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2344/4684] 10.222.0.23 () {60 vars in 1248 bytes} [Sat Apr 30 21:25:25 2022] PATCH /identity/v3/domains/0630f4c4e41f4d1489bcba93968557c7 => generated 277 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:25:25.458617 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f2926-2eec-4e8d-a070-f77db0bd8058 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:25.460099 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e02f2926-2eec-4e8d-a070-f77db0bd8058 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:25.474848 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f2926-2eec-4e8d-a070-f77db0bd8058 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:25.541712 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d86fca3-b4a8-48d1-ae79-602ab7c92f72 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:25.542621 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86fca3-b4a8-48d1-ae79-602ab7c92f72 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:25.542886 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86fca3-b4a8-48d1-ae79-602ab7c92f72 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:25.543168 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86fca3-b4a8-48d1-ae79-602ab7c92f72 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/domains/0630f4c4e41f4d1489bcba93968557c7` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:25.561398 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d86fca3-b4a8-48d1-ae79-602ab7c92f72 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0630f4c4e41f4d1489bcba93968557c7)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:25.563716 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d86fca3-b4a8-48d1-ae79-602ab7c92f72 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:25.590622 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1d86fca3-b4a8-48d1-ae79-602ab7c92f72 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0630f4c4e41f4d1489bcba93968557c7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:25.595926 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1d86fca3-b4a8-48d1-ae79-602ab7c92f72 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0630f4c4e41f4d1489bcba93968557c7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:25.697059 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1d86fca3-b4a8-48d1-ae79-602ab7c92f72 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0630f4c4e41f4d1489bcba93968557c7', 'request_id': 'req-1d86fca3-b4a8-48d1-ae79-602ab7c92f72'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:25.703480 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1d86fca3-b4a8-48d1-ae79-602ab7c92f72 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0630f4c4e41f4d1489bcba93968557c7', 'request_id': 'req-1d86fca3-b4a8-48d1-ae79-602ab7c92f72'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:25.722453 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1d86fca3-b4a8-48d1-ae79-602ab7c92f72 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0630f4c4e41f4d1489bcba93968557c7', 'request_id': 'req-1d86fca3-b4a8-48d1-ae79-602ab7c92f72'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:25.871993 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1d86fca3-b4a8-48d1-ae79-602ab7c92f72 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] The token cache is being invalidate because project 0630f4c4e41f4d1489bcba93968557c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:25:25.872375 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1d86fca3-b4a8-48d1-ae79-602ab7c92f72 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:25.873043 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1d86fca3-b4a8-48d1-ae79-602ab7c92f72 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:25.881186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1d86fca3-b4a8-48d1-ae79-602ab7c92f72 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0630f4c4e41f4d1489bcba93968557c7', 'request_id': 'req-1d86fca3-b4a8-48d1-ae79-602ab7c92f72'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:25.881859 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1d86fca3-b4a8-48d1-ae79-602ab7c92f72 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0630f4c4e41f4d1489bcba93968557c7', 'request_id': 'req-1d86fca3-b4a8-48d1-ae79-602ab7c92f72'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:25.882551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1d86fca3-b4a8-48d1-ae79-602ab7c92f72 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0630f4c4e41f4d1489bcba93968557c7', 'request_id': 'req-1d86fca3-b4a8-48d1-ae79-602ab7c92f72'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:25.891349 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2341/4685] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:25:25 2022] DELETE /identity/v3/domains/0630f4c4e41f4d1489bcba93968557c7 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:25.895747 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586555d-bdf0-4945-8c89-3745f08a8eb4 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:25.897345 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8586555d-bdf0-4945-8c89-3745f08a8eb4 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:25.911460 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586555d-bdf0-4945-8c89-3745f08a8eb4 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:25.970046 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bdc35a-7676-421c-bbd6-6173bd6aafd5 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:25.971304 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bdc35a-7676-421c-bbd6-6173bd6aafd5 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:25.971661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bdc35a-7676-421c-bbd6-6173bd6aafd5 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:25.972008 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bdc35a-7676-421c-bbd6-6173bd6aafd5 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/domains/f11e3021a3654e7882c1fde6c2090241/groups/e7cb20bc0bc1470ea3debec5950bd941/roles/c98e8eb646134fc5a7f87402544c507f` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:25.974360 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bdc35a-7676-421c-bbd6-6173bd6aafd5 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=f11e3021a3654e7882c1fde6c2090241, group_id=e7cb20bc0bc1470ea3debec5950bd941, role_id=c98e8eb646134fc5a7f87402544c507f)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:25.977011 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bdc35a-7676-421c-bbd6-6173bd6aafd5 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:25.982529 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f0bdc35a-7676-421c-bbd6-6173bd6aafd5 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invalidating the token cache because role c98e8eb646134fc5a7f87402544c507f was removed from group e7cb20bc0bc1470ea3debec5950bd941 on domain f11e3021a3654e7882c1fde6c2090241. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:25:25.984012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f0bdc35a-7676-421c-bbd6-6173bd6aafd5 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:25.984012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f0bdc35a-7676-421c-bbd6-6173bd6aafd5 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:26.063229 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2345/4686] 10.222.0.23 () {58 vars in 1466 bytes} [Sat Apr 30 21:25:25 2022] DELETE /identity/v3/domains/f11e3021a3654e7882c1fde6c2090241/groups/e7cb20bc0bc1470ea3debec5950bd941/roles/c98e8eb646134fc5a7f87402544c507f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:26.064574 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d86fca3-b4a8-48d1-ae79-602ab7c92f72 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:26.066158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1d86fca3-b4a8-48d1-ae79-602ab7c92f72 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:26.081750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d86fca3-b4a8-48d1-ae79-602ab7c92f72 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:26.154948 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45838b0d-13ed-4a60-8234-8056185338ce tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:26.155136 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45838b0d-13ed-4a60-8234-8056185338ce tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:26.155419 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45838b0d-13ed-4a60-8234-8056185338ce tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:26.155757 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45838b0d-13ed-4a60-8234-8056185338ce tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/groups/e7cb20bc0bc1470ea3debec5950bd941/users/f455064f5088443a89e77a376b0a10ef` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:26.157859 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45838b0d-13ed-4a60-8234-8056185338ce tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=e7cb20bc0bc1470ea3debec5950bd941, user_id=f455064f5088443a89e77a376b0a10ef)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:26.159884 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45838b0d-13ed-4a60-8234-8056185338ce tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:26.235409 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-45838b0d-13ed-4a60-8234-8056185338ce tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'f455064f5088443a89e77a376b0a10ef'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:26.328224 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2342/4687] 10.222.0.23 () {58 vars in 1343 bytes} [Sat Apr 30 21:25:26 2022] DELETE /identity/v3/groups/e7cb20bc0bc1470ea3debec5950bd941/users/f455064f5088443a89e77a376b0a10ef => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:26.332420 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bdc35a-7676-421c-bbd6-6173bd6aafd5 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:26.334567 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f0bdc35a-7676-421c-bbd6-6173bd6aafd5 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:26.350810 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bdc35a-7676-421c-bbd6-6173bd6aafd5 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:26.424744 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f0af9-0ff1-4402-8ecf-638e73e54270 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:26.426149 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f0af9-0ff1-4402-8ecf-638e73e54270 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:26.426679 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f0af9-0ff1-4402-8ecf-638e73e54270 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:26.427189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f0af9-0ff1-4402-8ecf-638e73e54270 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/groups/e7cb20bc0bc1470ea3debec5950bd941` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:26.428650 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f0af9-0ff1-4402-8ecf-638e73e54270 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:delete_group(group_id=e7cb20bc0bc1470ea3debec5950bd941)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:26.430991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f0af9-0ff1-4402-8ecf-638e73e54270 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:26.547740 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2346/4688] 10.222.0.23 () {58 vars in 1226 bytes} [Sat Apr 30 21:25:26 2022] DELETE /identity/v3/groups/e7cb20bc0bc1470ea3debec5950bd941 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:26.552838 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45838b0d-13ed-4a60-8234-8056185338ce tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:26.563789 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45838b0d-13ed-4a60-8234-8056185338ce tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:26.634403 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e46dbb-c226-4ee6-ac05-3868c0cb10ec tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:26.635477 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e46dbb-c226-4ee6-ac05-3868c0cb10ec tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:26.636167 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e46dbb-c226-4ee6-ac05-3868c0cb10ec tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:26.636167 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e46dbb-c226-4ee6-ac05-3868c0cb10ec tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/roles/c98e8eb646134fc5a7f87402544c507f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:26.637588 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e46dbb-c226-4ee6-ac05-3868c0cb10ec tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c98e8eb646134fc5a7f87402544c507f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:26.639379 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e46dbb-c226-4ee6-ac05-3868c0cb10ec tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:26.753264 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-54e46dbb-c226-4ee6-ac05-3868c0cb10ec tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invalidating the token cache because role c98e8eb646134fc5a7f87402544c507f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:25:26.753654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-54e46dbb-c226-4ee6-ac05-3868c0cb10ec tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:26.754523 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-54e46dbb-c226-4ee6-ac05-3868c0cb10ec tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:26.756458 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2343/4689] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:25:26 2022] DELETE /identity/v3/roles/c98e8eb646134fc5a7f87402544c507f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:26.760720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f0af9-0ff1-4402-8ecf-638e73e54270 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:26.762604 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-133f0af9-0ff1-4402-8ecf-638e73e54270 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:26.777461 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f0af9-0ff1-4402-8ecf-638e73e54270 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:26.844099 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a6b79-e86b-483a-acb4-edccc88b123e tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:26.845693 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a6b79-e86b-483a-acb4-edccc88b123e tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:26.846200 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a6b79-e86b-483a-acb4-edccc88b123e tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:26.846829 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a6b79-e86b-483a-acb4-edccc88b123e tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/domains/f11e3021a3654e7882c1fde6c2090241` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:26.849203 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a6b79-e86b-483a-acb4-edccc88b123e tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f11e3021a3654e7882c1fde6c2090241)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:26.851871 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a6b79-e86b-483a-acb4-edccc88b123e tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:26.879294 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ac5a6b79-e86b-483a-acb4-edccc88b123e tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f11e3021a3654e7882c1fde6c2090241'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:26.880045 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ac5a6b79-e86b-483a-acb4-edccc88b123e tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f11e3021a3654e7882c1fde6c2090241'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:27.004649 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ac5a6b79-e86b-483a-acb4-edccc88b123e tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f11e3021a3654e7882c1fde6c2090241'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:27.005324 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ac5a6b79-e86b-483a-acb4-edccc88b123e tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f11e3021a3654e7882c1fde6c2090241'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:27.007854 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2347/4690] 10.222.0.23 () {60 vars in 1248 bytes} [Sat Apr 30 21:25:26 2022] PATCH /identity/v3/domains/f11e3021a3654e7882c1fde6c2090241 => generated 277 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:25:27.011934 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e46dbb-c226-4ee6-ac05-3868c0cb10ec tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:27.023342 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e46dbb-c226-4ee6-ac05-3868c0cb10ec tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:27.079752 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514314c-c964-40da-9574-0607086f62c5 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:27.080702 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514314c-c964-40da-9574-0607086f62c5 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:27.081063 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514314c-c964-40da-9574-0607086f62c5 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:27.081407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514314c-c964-40da-9574-0607086f62c5 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/domains/f11e3021a3654e7882c1fde6c2090241` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:27.092924 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6514314c-c964-40da-9574-0607086f62c5 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f11e3021a3654e7882c1fde6c2090241)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:27.095844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6514314c-c964-40da-9574-0607086f62c5 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:27.119171 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6514314c-c964-40da-9574-0607086f62c5 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f11e3021a3654e7882c1fde6c2090241'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:27.122892 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6514314c-c964-40da-9574-0607086f62c5 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f11e3021a3654e7882c1fde6c2090241'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:27.234836 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6514314c-c964-40da-9574-0607086f62c5 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f11e3021a3654e7882c1fde6c2090241', 'request_id': 'req-6514314c-c964-40da-9574-0607086f62c5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:27.241278 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6514314c-c964-40da-9574-0607086f62c5 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f11e3021a3654e7882c1fde6c2090241', 'request_id': 'req-6514314c-c964-40da-9574-0607086f62c5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:27.249183 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6514314c-c964-40da-9574-0607086f62c5 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f11e3021a3654e7882c1fde6c2090241', 'request_id': 'req-6514314c-c964-40da-9574-0607086f62c5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:27.320413 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6514314c-c964-40da-9574-0607086f62c5 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] The token cache is being invalidate because project f11e3021a3654e7882c1fde6c2090241 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:25:27.320771 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6514314c-c964-40da-9574-0607086f62c5 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:27.321524 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6514314c-c964-40da-9574-0607086f62c5 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:27.330098 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6514314c-c964-40da-9574-0607086f62c5 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f11e3021a3654e7882c1fde6c2090241', 'request_id': 'req-6514314c-c964-40da-9574-0607086f62c5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:27.330787 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6514314c-c964-40da-9574-0607086f62c5 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f11e3021a3654e7882c1fde6c2090241', 'request_id': 'req-6514314c-c964-40da-9574-0607086f62c5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:27.331424 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6514314c-c964-40da-9574-0607086f62c5 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f11e3021a3654e7882c1fde6c2090241', 'request_id': 'req-6514314c-c964-40da-9574-0607086f62c5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:27.341311 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2344/4691] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:25:27 2022] DELETE /identity/v3/domains/f11e3021a3654e7882c1fde6c2090241 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:27.346550 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a6b79-e86b-483a-acb4-edccc88b123e tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:27.348424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ac5a6b79-e86b-483a-acb4-edccc88b123e tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:27.362864 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a6b79-e86b-483a-acb4-edccc88b123e tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:27.433171 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855fa8e1-4891-4f04-9af0-22131b1f960e tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:27.434536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855fa8e1-4891-4f04-9af0-22131b1f960e tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:27.435005 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855fa8e1-4891-4f04-9af0-22131b1f960e tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:27.435448 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855fa8e1-4891-4f04-9af0-22131b1f960e tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/domains/97e7ad4e5bac430a95c6bcd5275f31c3/users/f455064f5088443a89e77a376b0a10ef/roles/6711a3978dbd4b158577e8db4f392819` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:27.438471 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855fa8e1-4891-4f04-9af0-22131b1f960e tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=97e7ad4e5bac430a95c6bcd5275f31c3, user_id=f455064f5088443a89e77a376b0a10ef, role_id=6711a3978dbd4b158577e8db4f392819)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:27.441491 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855fa8e1-4891-4f04-9af0-22131b1f960e tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:27.447268 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-855fa8e1-4891-4f04-9af0-22131b1f960e tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invalidating the token cache because role 6711a3978dbd4b158577e8db4f392819 was removed from user f455064f5088443a89e77a376b0a10ef on domain 97e7ad4e5bac430a95c6bcd5275f31c3. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:25:27.447564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-855fa8e1-4891-4f04-9af0-22131b1f960e tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:27.448230 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-855fa8e1-4891-4f04-9af0-22131b1f960e tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:27.548955 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2348/4692] 10.222.0.23 () {58 vars in 1463 bytes} [Sat Apr 30 21:25:27 2022] DELETE /identity/v3/domains/97e7ad4e5bac430a95c6bcd5275f31c3/users/f455064f5088443a89e77a376b0a10ef/roles/6711a3978dbd4b158577e8db4f392819 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:27.553160 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514314c-c964-40da-9574-0607086f62c5 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:27.554600 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6514314c-c964-40da-9574-0607086f62c5 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:27.567616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514314c-c964-40da-9574-0607086f62c5 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:27.622536 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7700d5-a37a-4a37-90ba-887b23feab72 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:27.623322 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7700d5-a37a-4a37-90ba-887b23feab72 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:27.623610 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7700d5-a37a-4a37-90ba-887b23feab72 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:27.623891 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7700d5-a37a-4a37-90ba-887b23feab72 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/roles/6711a3978dbd4b158577e8db4f392819` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:27.625366 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7700d5-a37a-4a37-90ba-887b23feab72 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6711a3978dbd4b158577e8db4f392819)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:27.627044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7700d5-a37a-4a37-90ba-887b23feab72 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:27.707856 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cd7700d5-a37a-4a37-90ba-887b23feab72 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invalidating the token cache because role 6711a3978dbd4b158577e8db4f392819 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:25:27.708175 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cd7700d5-a37a-4a37-90ba-887b23feab72 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:27.708805 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cd7700d5-a37a-4a37-90ba-887b23feab72 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:27.710708 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2345/4693] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:25:27 2022] DELETE /identity/v3/roles/6711a3978dbd4b158577e8db4f392819 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:27.714871 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855fa8e1-4891-4f04-9af0-22131b1f960e tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:27.716299 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-855fa8e1-4891-4f04-9af0-22131b1f960e tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:27.729617 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855fa8e1-4891-4f04-9af0-22131b1f960e tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:27.794245 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10981ff8-cf0c-4773-b82d-150c07e120aa tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:27.795118 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10981ff8-cf0c-4773-b82d-150c07e120aa tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:27.795668 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10981ff8-cf0c-4773-b82d-150c07e120aa tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:27.795945 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10981ff8-cf0c-4773-b82d-150c07e120aa tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/domains/97e7ad4e5bac430a95c6bcd5275f31c3` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:27.797373 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10981ff8-cf0c-4773-b82d-150c07e120aa tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=97e7ad4e5bac430a95c6bcd5275f31c3)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:27.799218 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10981ff8-cf0c-4773-b82d-150c07e120aa tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:27.824336 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-10981ff8-cf0c-4773-b82d-150c07e120aa tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '97e7ad4e5bac430a95c6bcd5275f31c3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:27.825113 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-10981ff8-cf0c-4773-b82d-150c07e120aa tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '97e7ad4e5bac430a95c6bcd5275f31c3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:27.941584 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-10981ff8-cf0c-4773-b82d-150c07e120aa tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '97e7ad4e5bac430a95c6bcd5275f31c3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:27.942403 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-10981ff8-cf0c-4773-b82d-150c07e120aa tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '97e7ad4e5bac430a95c6bcd5275f31c3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:27.945153 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2349/4694] 10.222.0.23 () {60 vars in 1248 bytes} [Sat Apr 30 21:25:27 2022] PATCH /identity/v3/domains/97e7ad4e5bac430a95c6bcd5275f31c3 => generated 276 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:25:27.949300 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7700d5-a37a-4a37-90ba-887b23feab72 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:27.950811 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-cd7700d5-a37a-4a37-90ba-887b23feab72 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:27.964523 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7700d5-a37a-4a37-90ba-887b23feab72 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:28.031353 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78d930-b666-494d-a502-d5c70a1e8b2d tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:28.032424 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78d930-b666-494d-a502-d5c70a1e8b2d tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:28.033459 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78d930-b666-494d-a502-d5c70a1e8b2d tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:28.033830 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78d930-b666-494d-a502-d5c70a1e8b2d tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/domains/97e7ad4e5bac430a95c6bcd5275f31c3` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:28.048559 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78d930-b666-494d-a502-d5c70a1e8b2d tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=97e7ad4e5bac430a95c6bcd5275f31c3)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:28.050320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78d930-b666-494d-a502-d5c70a1e8b2d tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:28.074165 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ff78d930-b666-494d-a502-d5c70a1e8b2d tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '97e7ad4e5bac430a95c6bcd5275f31c3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:28.078564 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ff78d930-b666-494d-a502-d5c70a1e8b2d tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '97e7ad4e5bac430a95c6bcd5275f31c3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:28.176170 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ff78d930-b666-494d-a502-d5c70a1e8b2d tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97e7ad4e5bac430a95c6bcd5275f31c3', 'request_id': 'req-ff78d930-b666-494d-a502-d5c70a1e8b2d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:28.181278 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ff78d930-b666-494d-a502-d5c70a1e8b2d tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97e7ad4e5bac430a95c6bcd5275f31c3', 'request_id': 'req-ff78d930-b666-494d-a502-d5c70a1e8b2d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:28.188139 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ff78d930-b666-494d-a502-d5c70a1e8b2d tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97e7ad4e5bac430a95c6bcd5275f31c3', 'request_id': 'req-ff78d930-b666-494d-a502-d5c70a1e8b2d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:28.277308 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ff78d930-b666-494d-a502-d5c70a1e8b2d tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] The token cache is being invalidate because project 97e7ad4e5bac430a95c6bcd5275f31c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:25:28.277610 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ff78d930-b666-494d-a502-d5c70a1e8b2d tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:28.278295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ff78d930-b666-494d-a502-d5c70a1e8b2d tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:28.285891 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ff78d930-b666-494d-a502-d5c70a1e8b2d tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '97e7ad4e5bac430a95c6bcd5275f31c3', 'request_id': 'req-ff78d930-b666-494d-a502-d5c70a1e8b2d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:28.286569 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ff78d930-b666-494d-a502-d5c70a1e8b2d tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '97e7ad4e5bac430a95c6bcd5275f31c3', 'request_id': 'req-ff78d930-b666-494d-a502-d5c70a1e8b2d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:28.287315 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ff78d930-b666-494d-a502-d5c70a1e8b2d tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '97e7ad4e5bac430a95c6bcd5275f31c3', 'request_id': 'req-ff78d930-b666-494d-a502-d5c70a1e8b2d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:28.296886 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2346/4695] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:25:27 2022] DELETE /identity/v3/domains/97e7ad4e5bac430a95c6bcd5275f31c3 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:25:28.303325 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10981ff8-cf0c-4773-b82d-150c07e120aa tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:28.304865 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-10981ff8-cf0c-4773-b82d-150c07e120aa tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:28.318489 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10981ff8-cf0c-4773-b82d-150c07e120aa tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:28.373876 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1eeb32-e700-463f-9873-871113df4ea7 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:28.374649 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1eeb32-e700-463f-9873-871113df4ea7 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:28.374929 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1eeb32-e700-463f-9873-871113df4ea7 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:28.375211 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1eeb32-e700-463f-9873-871113df4ea7 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:28.375937 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1eeb32-e700-463f-9873-871113df4ea7 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:28.377546 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1eeb32-e700-463f-9873-871113df4ea7 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:28.387641 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2350/4696] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:25:28.391681 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78d930-b666-494d-a502-d5c70a1e8b2d tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:28.393283 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ff78d930-b666-494d-a502-d5c70a1e8b2d tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:28.406963 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78d930-b666-494d-a502-d5c70a1e8b2d tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:28.411626 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7499533-c1f0-4c5a-9a4c-55401cf8d75a tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:28.412506 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7499533-c1f0-4c5a-9a4c-55401cf8d75a tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:28.412793 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7499533-c1f0-4c5a-9a4c-55401cf8d75a tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:28.413070 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7499533-c1f0-4c5a-9a4c-55401cf8d75a tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/projects/5e72a582148047e6a80e5b080c5f5900/users/df9bfebdf8544b329f058d3a83580557/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:28.415716 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7499533-c1f0-4c5a-9a4c-55401cf8d75a tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:create_grant(project_id=5e72a582148047e6a80e5b080c5f5900, user_id=df9bfebdf8544b329f058d3a83580557, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:28.418973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7499533-c1f0-4c5a-9a4c-55401cf8d75a tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:28.496366 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2347/4697] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:25:28 2022] PUT /identity/v3/projects/5e72a582148047e6a80e5b080c5f5900/users/df9bfebdf8544b329f058d3a83580557/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:28.501596 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1eeb32-e700-463f-9873-871113df4ea7 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:28.512311 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1eeb32-e700-463f-9873-871113df4ea7 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:28.573666 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4adbc-8b32-467f-b051-f9a4b3f87154 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:28.574342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4adbc-8b32-467f-b051-f9a4b3f87154 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:28.574983 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4adbc-8b32-467f-b051-f9a4b3f87154 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:28.575205 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4adbc-8b32-467f-b051-f9a4b3f87154 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:28.575844 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4adbc-8b32-467f-b051-f9a4b3f87154 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:28.576926 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4adbc-8b32-467f-b051-f9a4b3f87154 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:28.630501 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2351/4698] 10.222.0.23 () {58 vars in 1145 bytes} [Sat Apr 30 21:25:28 2022] GET /identity/v3/auth/projects => generated 826 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:25:28.641454 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7499533-c1f0-4c5a-9a4c-55401cf8d75a tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:28.652411 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7499533-c1f0-4c5a-9a4c-55401cf8d75a tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:28.657611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278604e4-feaf-4554-b908-85a9b1980db3 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:28.658524 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278604e4-feaf-4554-b908-85a9b1980db3 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:28.658808 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278604e4-feaf-4554-b908-85a9b1980db3 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:28.659084 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278604e4-feaf-4554-b908-85a9b1980db3 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/projects/5e72a582148047e6a80e5b080c5f5900/users/df9bfebdf8544b329f058d3a83580557/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:28.661047 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278604e4-feaf-4554-b908-85a9b1980db3 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=5e72a582148047e6a80e5b080c5f5900, user_id=df9bfebdf8544b329f058d3a83580557, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:28.663693 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278604e4-feaf-4554-b908-85a9b1980db3 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:28.669174 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-278604e4-feaf-4554-b908-85a9b1980db3 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invalidating the token cache because role 30112eb1f3e047398c3c82fb40b72e62 was removed from user df9bfebdf8544b329f058d3a83580557 on project 5e72a582148047e6a80e5b080c5f5900. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:25:28.672814 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-278604e4-feaf-4554-b908-85a9b1980db3 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:28.672814 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-278604e4-feaf-4554-b908-85a9b1980db3 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:28.742383 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2348/4699] 10.222.0.23 () {58 vars in 1466 bytes} [Sat Apr 30 21:25:28 2022] DELETE /identity/v3/projects/5e72a582148047e6a80e5b080c5f5900/users/df9bfebdf8544b329f058d3a83580557/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:28.747909 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4adbc-8b32-467f-b051-f9a4b3f87154 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:28.749702 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ffd4adbc-8b32-467f-b051-f9a4b3f87154 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:28.763829 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4adbc-8b32-467f-b051-f9a4b3f87154 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:28.827290 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7969d956-fad2-4cd1-a79d-bcbc39f902e2 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:28.831698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969d956-fad2-4cd1-a79d-bcbc39f902e2 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:28.831698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969d956-fad2-4cd1-a79d-bcbc39f902e2 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:28.831698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969d956-fad2-4cd1-a79d-bcbc39f902e2 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:28.831698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7969d956-fad2-4cd1-a79d-bcbc39f902e2 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:28.831698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7969d956-fad2-4cd1-a79d-bcbc39f902e2 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:28.929077 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2352/4700] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:25:28 2022] POST /identity/v3/users => generated 323 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:25:28.930332 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278604e4-feaf-4554-b908-85a9b1980db3 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:28.940828 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278604e4-feaf-4554-b908-85a9b1980db3 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:28.947251 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae5300-d3f4-42b6-9a93-5143998e8678 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:28.947251 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae5300-d3f4-42b6-9a93-5143998e8678 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:28.947251 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae5300-d3f4-42b6-9a93-5143998e8678 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:28.947535 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae5300-d3f4-42b6-9a93-5143998e8678 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:28.947615 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edae5300-d3f4-42b6-9a93-5143998e8678 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:28.956765 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edae5300-d3f4-42b6-9a93-5143998e8678 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:29.030364 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7969d956-fad2-4cd1-a79d-bcbc39f902e2 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:29.032905 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7969d956-fad2-4cd1-a79d-bcbc39f902e2 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:29.034228 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2349/4701] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:25:28 2022] POST /identity/v3/projects => generated 364 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:25:29.038404 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae5300-d3f4-42b6-9a93-5143998e8678 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:29.167790 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7969d956-fad2-4cd1-a79d-bcbc39f902e2 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:29.186551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae5300-d3f4-42b6-9a93-5143998e8678 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:29.200619 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff854e33-38a3-48ca-910e-3a3890eebe7a tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:29.201458 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff854e33-38a3-48ca-910e-3a3890eebe7a tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:29.201746 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff854e33-38a3-48ca-910e-3a3890eebe7a tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:29.202054 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff854e33-38a3-48ca-910e-3a3890eebe7a tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:29.204882 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff854e33-38a3-48ca-910e-3a3890eebe7a tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:29.206622 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff854e33-38a3-48ca-910e-3a3890eebe7a tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:29.255635 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e8b085-2945-4de1-a19a-f4608ee61a90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:29.257799 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8b085-2945-4de1-a19a-f4608ee61a90 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:29.260678 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8b085-2945-4de1-a19a-f4608ee61a90 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:29.260977 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8b085-2945-4de1-a19a-f4608ee61a90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:29.263554 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-82e8b085-2945-4de1-a19a-f4608ee61a90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:29.356354 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e8b085-2945-4de1-a19a-f4608ee61a90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:29.358676 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e8b085-2945-4de1-a19a-f4608ee61a90 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:29.362325 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2350/4702] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:25:29 2022] POST /identity/v3/projects => generated 363 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:25:29.366414 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff854e33-38a3-48ca-910e-3a3890eebe7a tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:29.386938 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2353/4703] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:25:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:25:29.407074 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ec95e-47ab-439f-ad77-39c11d4a39d2 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:29.407367 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ec95e-47ab-439f-ad77-39c11d4a39d2 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:29.407643 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ec95e-47ab-439f-ad77-39c11d4a39d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:29.437609 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-617ec95e-47ab-439f-ad77-39c11d4a39d2 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:29.440031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-617ec95e-47ab-439f-ad77-39c11d4a39d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:29.456861 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff854e33-38a3-48ca-910e-3a3890eebe7a tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:29.462823 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690b0bf-fb40-4a98-ad8b-89d1d822e049 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:29.463580 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690b0bf-fb40-4a98-ad8b-89d1d822e049 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:29.463931 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690b0bf-fb40-4a98-ad8b-89d1d822e049 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:29.464302 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690b0bf-fb40-4a98-ad8b-89d1d822e049 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:29.465111 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5690b0bf-fb40-4a98-ad8b-89d1d822e049 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:29.466928 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5690b0bf-fb40-4a98-ad8b-89d1d822e049 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:29.541667 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2354/4704] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:25:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:25:29.572081 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ec95e-47ab-439f-ad77-39c11d4a39d2 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:29.573882 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-617ec95e-47ab-439f-ad77-39c11d4a39d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:29.577943 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2351/4705] 10.222.0.23 () {60 vars in 1142 bytes} [Sat Apr 30 21:25:29 2022] POST /identity/v3/roles => generated 239 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:25:29.578866 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690b0bf-fb40-4a98-ad8b-89d1d822e049 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:29.597192 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690b0bf-fb40-4a98-ad8b-89d1d822e049 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:29.611385 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39691986-b546-4c3d-a58a-9df217e0226a tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:29.612402 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39691986-b546-4c3d-a58a-9df217e0226a tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:29.613236 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39691986-b546-4c3d-a58a-9df217e0226a tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:29.613602 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39691986-b546-4c3d-a58a-9df217e0226a tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/projects/e767cdf877c94a3096b9f32dbe73b9e4/users/b91f71d1af9048908b4144b8adad4902/roles/2323953fe48249d0ab0797d481f67207` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:29.650403 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39691986-b546-4c3d-a58a-9df217e0226a tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e767cdf877c94a3096b9f32dbe73b9e4, user_id=b91f71d1af9048908b4144b8adad4902, role_id=2323953fe48249d0ab0797d481f67207)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:29.655073 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39691986-b546-4c3d-a58a-9df217e0226a tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:29.680122 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ec95e-47ab-439f-ad77-39c11d4a39d2 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:29.686189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69d711-84a5-4255-b6ef-f78af6e8e9ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:29.686973 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69d711-84a5-4255-b6ef-f78af6e8e9ef service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:29.687365 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69d711-84a5-4255-b6ef-f78af6e8e9ef service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:29.687777 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69d711-84a5-4255-b6ef-f78af6e8e9ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:29.700713 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb69d711-84a5-4255-b6ef-f78af6e8e9ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:29.702805 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb69d711-84a5-4255-b6ef-f78af6e8e9ef service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:29.724601 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2355/4706] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:25:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 30 21:25:29.754138 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2352/4707] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:25:29 2022] PUT /identity/v3/projects/e767cdf877c94a3096b9f32dbe73b9e4/users/b91f71d1af9048908b4144b8adad4902/roles/2323953fe48249d0ab0797d481f67207 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:29.759231 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69d711-84a5-4255-b6ef-f78af6e8e9ef service swift] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:29.778200 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69d711-84a5-4255-b6ef-f78af6e8e9ef service swift] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:29.847525 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bcf4f5-4942-489d-8429-4a2db860e566 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:29.848425 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcf4f5-4942-489d-8429-4a2db860e566 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:29.848863 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcf4f5-4942-489d-8429-4a2db860e566 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:29.849075 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcf4f5-4942-489d-8429-4a2db860e566 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/projects/545a11e7e5534ecf816844c74e4d4fc7/users/b91f71d1af9048908b4144b8adad4902/roles/2323953fe48249d0ab0797d481f67207` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:29.857163 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bcf4f5-4942-489d-8429-4a2db860e566 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:create_grant(project_id=545a11e7e5534ecf816844c74e4d4fc7, user_id=b91f71d1af9048908b4144b8adad4902, role_id=2323953fe48249d0ab0797d481f67207)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:29.859977 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bcf4f5-4942-489d-8429-4a2db860e566 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:29.919197 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2356/4708] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:25:29 2022] PUT /identity/v3/projects/545a11e7e5534ecf816844c74e4d4fc7/users/b91f71d1af9048908b4144b8adad4902/roles/2323953fe48249d0ab0797d481f67207 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:25:29.923938 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7baf4-6783-4aa7-8c3a-9bb11f50fe40 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:29.924451 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7baf4-6783-4aa7-8c3a-9bb11f50fe40 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:29.925054 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7baf4-6783-4aa7-8c3a-9bb11f50fe40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:29.957606 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-4dd7baf4-6783-4aa7-8c3a-9bb11f50fe40 None None] MFA Rules not processed for user `b91f71d1af9048908b4144b8adad4902`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:29.959004 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4dd7baf4-6783-4aa7-8c3a-9bb11f50fe40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:29.965114 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2353/4709] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:25:29 2022] POST /identity/v3/auth/tokens => generated 335 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 30 21:25:29.967053 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a24f602-2d05-4a0f-99dc-08d2a17c10b8 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:29.967391 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a24f602-2d05-4a0f-99dc-08d2a17c10b8 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:29.976453 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a24f602-2d05-4a0f-99dc-08d2a17c10b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:29.980094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-6a24f602-2d05-4a0f-99dc-08d2a17c10b8 None None] MFA Rules not processed for user `b91f71d1af9048908b4144b8adad4902`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:29.981468 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6a24f602-2d05-4a0f-99dc-08d2a17c10b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:30.085111 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2357/4710] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:25:29 2022] POST /identity/v3/auth/tokens => generated 3215 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 406 bytes (2 switches on core 0) Apr 30 21:25:30.089319 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd7baf4-6783-4aa7-8c3a-9bb11f50fe40 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:30.183501 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd7baf4-6783-4aa7-8c3a-9bb11f50fe40 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:30.188787 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fe370-cd8e-4a2e-8387-b62603fa332f tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:30.189452 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fe370-cd8e-4a2e-8387-b62603fa332f tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:30.189795 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fe370-cd8e-4a2e-8387-b62603fa332f tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:30.190086 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fe370-cd8e-4a2e-8387-b62603fa332f tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:30.210631 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10fe370-cd8e-4a2e-8387-b62603fa332f tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:30.210631 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10fe370-cd8e-4a2e-8387-b62603fa332f tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:30.285930 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2354/4711] 10.222.0.23 () {56 vars in 1307 bytes} [Sat Apr 30 21:25:30 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:30.287633 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100f444-c85b-4e96-b911-a83cb5e5063c None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:30.287928 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100f444-c85b-4e96-b911-a83cb5e5063c None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:30.288208 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100f444-c85b-4e96-b911-a83cb5e5063c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:30.308139 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-c100f444-c85b-4e96-b911-a83cb5e5063c None None] MFA Rules not processed for user `b91f71d1af9048908b4144b8adad4902`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:30.309406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c100f444-c85b-4e96-b911-a83cb5e5063c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:30.405031 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2358/4712] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:25:30 2022] POST /identity/v3/auth/tokens => generated 3215 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 406 bytes (2 switches on core 0) Apr 30 21:25:30.405695 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fe370-cd8e-4a2e-8387-b62603fa332f tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:30.420786 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fe370-cd8e-4a2e-8387-b62603fa332f tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:30.438491 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c42520-046a-43b9-99a7-9d69ebe37b7a tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:30.438491 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c42520-046a-43b9-99a7-9d69ebe37b7a tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:30.438491 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c42520-046a-43b9-99a7-9d69ebe37b7a tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:30.438972 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c42520-046a-43b9-99a7-9d69ebe37b7a tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/roles/2323953fe48249d0ab0797d481f67207` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:30.441061 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c42520-046a-43b9-99a7-9d69ebe37b7a tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2323953fe48249d0ab0797d481f67207)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:30.448643 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c42520-046a-43b9-99a7-9d69ebe37b7a tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:30.672611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a6c42520-046a-43b9-99a7-9d69ebe37b7a tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invalidating the token cache because role 2323953fe48249d0ab0797d481f67207 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:25:30.674179 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a6c42520-046a-43b9-99a7-9d69ebe37b7a tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:30.679970 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a6c42520-046a-43b9-99a7-9d69ebe37b7a tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:30.679970 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2355/4713] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:25:30 2022] DELETE /identity/v3/roles/2323953fe48249d0ab0797d481f67207 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:30.684099 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100f444-c85b-4e96-b911-a83cb5e5063c None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:30.700709 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100f444-c85b-4e96-b911-a83cb5e5063c None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:30.808407 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae07ef-2b5c-4b54-b665-ce51c4c0d698 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:30.809416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae07ef-2b5c-4b54-b665-ce51c4c0d698 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:30.809934 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae07ef-2b5c-4b54-b665-ce51c4c0d698 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:30.811134 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae07ef-2b5c-4b54-b665-ce51c4c0d698 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/projects/545a11e7e5534ecf816844c74e4d4fc7` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:30.812683 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae07ef-2b5c-4b54-b665-ce51c4c0d698 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:delete_project(project_id=545a11e7e5534ecf816844c74e4d4fc7)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:30.826739 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae07ef-2b5c-4b54-b665-ce51c4c0d698 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:30.925687 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c42520-046a-43b9-99a7-9d69ebe37b7a tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:30.931621 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a6c42520-046a-43b9-99a7-9d69ebe37b7a tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:30.965438 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-79ae07ef-2b5c-4b54-b665-ce51c4c0d698 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '545a11e7e5534ecf816844c74e4d4fc7', 'request_id': 'req-79ae07ef-2b5c-4b54-b665-ce51c4c0d698'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:30.971489 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-79ae07ef-2b5c-4b54-b665-ce51c4c0d698 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '545a11e7e5534ecf816844c74e4d4fc7', 'request_id': 'req-79ae07ef-2b5c-4b54-b665-ce51c4c0d698'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:30.978529 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-79ae07ef-2b5c-4b54-b665-ce51c4c0d698 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '545a11e7e5534ecf816844c74e4d4fc7', 'request_id': 'req-79ae07ef-2b5c-4b54-b665-ce51c4c0d698'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:31.055252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c42520-046a-43b9-99a7-9d69ebe37b7a tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:31.086283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-79ae07ef-2b5c-4b54-b665-ce51c4c0d698 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] The token cache is being invalidate because project 545a11e7e5534ecf816844c74e4d4fc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:25:31.086878 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-79ae07ef-2b5c-4b54-b665-ce51c4c0d698 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:31.088194 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-79ae07ef-2b5c-4b54-b665-ce51c4c0d698 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:31.090621 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2359/4714] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:25:30 2022] DELETE /identity/v3/projects/545a11e7e5534ecf816844c74e4d4fc7 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:31.094655 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae07ef-2b5c-4b54-b665-ce51c4c0d698 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:31.098074 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-79ae07ef-2b5c-4b54-b665-ce51c4c0d698 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:31.147958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e427af-2ca4-45ac-a190-066b1b8cf96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:31.148764 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e427af-2ca4-45ac-a190-066b1b8cf96c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:31.149052 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e427af-2ca4-45ac-a190-066b1b8cf96c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:31.149513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e427af-2ca4-45ac-a190-066b1b8cf96c admin admin] PATH_INFO: `/v3/users/8d6fb7be8b7f42a9b1e01340f3c9d772` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:31.151168 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e427af-2ca4-45ac-a190-066b1b8cf96c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d6fb7be8b7f42a9b1e01340f3c9d772)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:31.154674 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e427af-2ca4-45ac-a190-066b1b8cf96c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:31.267886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae07ef-2b5c-4b54-b665-ce51c4c0d698 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:31.272165 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cef5ca-fed7-4d86-b713-084563f32f6b tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:31.273649 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cef5ca-fed7-4d86-b713-084563f32f6b tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:31.273649 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cef5ca-fed7-4d86-b713-084563f32f6b tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:31.273913 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cef5ca-fed7-4d86-b713-084563f32f6b tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/projects/545a11e7e5534ecf816844c74e4d4fc7` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:31.289275 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cef5ca-fed7-4d86-b713-084563f32f6b tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:delete_project(project_id=545a11e7e5534ecf816844c74e4d4fc7)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:31.291506 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cef5ca-fed7-4d86-b713-084563f32f6b tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:31.314206 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-e9cef5ca-fed7-4d86-b713-084563f32f6b tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Could not find project: 545a11e7e5534ecf816844c74e4d4fc7.: keystone.exception.ProjectNotFound: Could not find project: 545a11e7e5534ecf816844c74e4d4fc7. Apr 30 21:25:31.314206 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:25:31.314206 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:25:31.314206 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:25:31.314206 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:25:31.314206 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:25:31.314206 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:25:31.314206 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:25:31.314206 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:25:31.314206 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:25:31.314206 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:25:31.314206 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:25:31.314206 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Apr 30 21:25:31.314206 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Apr 30 21:25:31.315503 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:25:31.315503 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:25:31.315503 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Apr 30 21:25:31.315503 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Apr 30 21:25:31.315503 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 21:25:31.315503 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 21:25:31.315503 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 21:25:31.315503 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 21:25:31.315503 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 545a11e7e5534ecf816844c74e4d4fc7. Apr 30 21:25:31.315503 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:25:31.321987 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2360/4715] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:25:31 2022] DELETE /identity/v3/projects/545a11e7e5534ecf816844c74e4d4fc7 => generated 113 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Apr 30 21:25:31.323135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cef5ca-fed7-4d86-b713-084563f32f6b tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:31.339514 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cef5ca-fed7-4d86-b713-084563f32f6b tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:31.346811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2b1be-6600-45c6-873d-6e407a590628 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:31.348443 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2b1be-6600-45c6-873d-6e407a590628 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:31.348853 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2b1be-6600-45c6-873d-6e407a590628 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:31.349189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2b1be-6600-45c6-873d-6e407a590628 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/projects/e767cdf877c94a3096b9f32dbe73b9e4` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:31.350798 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c2b1be-6600-45c6-873d-6e407a590628 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e767cdf877c94a3096b9f32dbe73b9e4)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:31.353094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c2b1be-6600-45c6-873d-6e407a590628 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:31.397800 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-85e427af-2ca4-45ac-a190-066b1b8cf96c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d6fb7be8b7f42a9b1e01340f3c9d772'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:31.416903 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-85e427af-2ca4-45ac-a190-066b1b8cf96c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d6fb7be8b7f42a9b1e01340f3c9d772'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:31.494344 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-85e427af-2ca4-45ac-a190-066b1b8cf96c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d6fb7be8b7f42a9b1e01340f3c9d772'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:31.504707 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-34c2b1be-6600-45c6-873d-6e407a590628 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e767cdf877c94a3096b9f32dbe73b9e4', 'request_id': 'req-34c2b1be-6600-45c6-873d-6e407a590628'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:31.506389 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-85e427af-2ca4-45ac-a190-066b1b8cf96c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d6fb7be8b7f42a9b1e01340f3c9d772'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:31.508915 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-85e427af-2ca4-45ac-a190-066b1b8cf96c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d6fb7be8b7f42a9b1e01340f3c9d772'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:31.512594 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-34c2b1be-6600-45c6-873d-6e407a590628 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e767cdf877c94a3096b9f32dbe73b9e4', 'request_id': 'req-34c2b1be-6600-45c6-873d-6e407a590628'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:31.520801 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2356/4716] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:25:30 2022] DELETE /identity/v3/users/8d6fb7be8b7f42a9b1e01340f3c9d772 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:31.522398 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0e0ee-37b0-4318-be7b-8194a8a9a4c4 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:31.522688 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0e0ee-37b0-4318-be7b-8194a8a9a4c4 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:31.523028 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0e0ee-37b0-4318-be7b-8194a8a9a4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:31.523532 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-34c2b1be-6600-45c6-873d-6e407a590628 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e767cdf877c94a3096b9f32dbe73b9e4', 'request_id': 'req-34c2b1be-6600-45c6-873d-6e407a590628'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:31.550826 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-76a0e0ee-37b0-4318-be7b-8194a8a9a4c4 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:31.552739 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-76a0e0ee-37b0-4318-be7b-8194a8a9a4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:31.604574 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-34c2b1be-6600-45c6-873d-6e407a590628 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] The token cache is being invalidate because project e767cdf877c94a3096b9f32dbe73b9e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:25:31.604874 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-34c2b1be-6600-45c6-873d-6e407a590628 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:31.605608 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-34c2b1be-6600-45c6-873d-6e407a590628 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:31.607368 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2361/4717] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:25:31 2022] DELETE /identity/v3/projects/e767cdf877c94a3096b9f32dbe73b9e4 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:31.624566 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2b1be-6600-45c6-873d-6e407a590628 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:31.627801 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-34c2b1be-6600-45c6-873d-6e407a590628 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:31.628595 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2357/4718] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:25:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:25:31.642607 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a0e0ee-37b0-4318-be7b-8194a8a9a4c4 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:31.644413 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-76a0e0ee-37b0-4318-be7b-8194a8a9a4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:31.711545 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a0e0ee-37b0-4318-be7b-8194a8a9a4c4 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:31.716167 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b45dff-d9dc-421f-9398-d1f6a566c4a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:31.720244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b45dff-d9dc-421f-9398-d1f6a566c4a3 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:31.720244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b45dff-d9dc-421f-9398-d1f6a566c4a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:31.720244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b45dff-d9dc-421f-9398-d1f6a566c4a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:31.735274 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b45dff-d9dc-421f-9398-d1f6a566c4a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:31.736744 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b45dff-d9dc-421f-9398-d1f6a566c4a3 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:31.739402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2b1be-6600-45c6-873d-6e407a590628 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:31.748807 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2358/4719] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:25:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:25:31.830653 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93932ff8-052e-44bf-b9f1-e0f3ce19889c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:31.831597 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93932ff8-052e-44bf-b9f1-e0f3ce19889c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:31.832260 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93932ff8-052e-44bf-b9f1-e0f3ce19889c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:31.832379 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93932ff8-052e-44bf-b9f1-e0f3ce19889c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/users/b91f71d1af9048908b4144b8adad4902` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:31.833665 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93932ff8-052e-44bf-b9f1-e0f3ce19889c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b91f71d1af9048908b4144b8adad4902)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:31.838079 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93932ff8-052e-44bf-b9f1-e0f3ce19889c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:32.026282 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-93932ff8-052e-44bf-b9f1-e0f3ce19889c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b91f71d1af9048908b4144b8adad4902'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:32.056494 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-93932ff8-052e-44bf-b9f1-e0f3ce19889c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b91f71d1af9048908b4144b8adad4902'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:32.207507 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-93932ff8-052e-44bf-b9f1-e0f3ce19889c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b91f71d1af9048908b4144b8adad4902'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:32.210231 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-93932ff8-052e-44bf-b9f1-e0f3ce19889c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b91f71d1af9048908b4144b8adad4902'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:32.220320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-93932ff8-052e-44bf-b9f1-e0f3ce19889c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b91f71d1af9048908b4144b8adad4902'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:32.235076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b45dff-d9dc-421f-9398-d1f6a566c4a3 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:32.236709 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2362/4720] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:25:31 2022] DELETE /identity/v3/users/b91f71d1af9048908b4144b8adad4902 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:32.248522 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b45dff-d9dc-421f-9398-d1f6a566c4a3 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:32.306106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93932ff8-052e-44bf-b9f1-e0f3ce19889c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:32.307649 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-93932ff8-052e-44bf-b9f1-e0f3ce19889c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:32.349805 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62278c27-4842-4a32-b4bc-52913a906bcc tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:32.360624 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62278c27-4842-4a32-b4bc-52913a906bcc tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:32.360904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62278c27-4842-4a32-b4bc-52913a906bcc tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:32.361081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62278c27-4842-4a32-b4bc-52913a906bcc tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/domains/74ca773197e24e7184d802e06a0c931e` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:32.384366 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62278c27-4842-4a32-b4bc-52913a906bcc tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 21:25:32.396508 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-62278c27-4842-4a32-b4bc-52913a906bcc tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Could not find domain: 74ca773197e24e7184d802e06a0c931e.: keystone.exception.DomainNotFound: Could not find domain: 74ca773197e24e7184d802e06a0c931e. Apr 30 21:25:32.396508 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:25:32.396508 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Apr 30 21:25:32.396508 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Apr 30 21:25:32.396508 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 21:25:32.396508 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 21:25:32.396508 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 21:25:32.396508 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 21:25:32.396508 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 74ca773197e24e7184d802e06a0c931e. Apr 30 21:25:32.396508 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:25:32.396508 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 21:25:32.396508 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:25:32.396508 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:25:32.396508 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:25:32.396508 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:25:32.396508 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:25:32.399236 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:25:32.399236 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:25:32.399236 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:25:32.399236 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:25:32.399236 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:25:32.399236 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:25:32.399236 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:25:32.399236 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Apr 30 21:25:32.399236 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Apr 30 21:25:32.399236 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 21:25:32.399236 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 21:25:32.399236 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 21:25:32.399236 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 21:25:32.399236 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:25:32.399236 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:25:32.399236 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 21:25:32.400442 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 21:25:32.400442 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 21:25:32.400442 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 21:25:32.400442 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 21:25:32.400442 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 21:25:32.400442 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 21:25:32.400442 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 21:25:32.400442 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 21:25:32.400442 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 21:25:32.400442 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 21:25:32.400442 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 21:25:32.400442 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 21:25:32.400442 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 21:25:32.400442 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Apr 30 21:25:32.400442 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 21:25:32.400442 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 74ca773197e24e7184d802e06a0c931e. Apr 30 21:25:32.400442 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:25:32.401871 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2359/4721] 10.222.0.23 () {60 vars in 1248 bytes} [Sat Apr 30 21:25:32 2022] PATCH /identity/v3/domains/74ca773197e24e7184d802e06a0c931e => generated 112 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 30 21:25:32.402246 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62278c27-4842-4a32-b4bc-52913a906bcc tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:32.404285 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-62278c27-4842-4a32-b4bc-52913a906bcc tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:32.430107 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62278c27-4842-4a32-b4bc-52913a906bcc tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:32.432793 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93932ff8-052e-44bf-b9f1-e0f3ce19889c tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:32.436867 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44308970-e48d-4264-bcc9-e8f111e484a3 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:32.438460 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44308970-e48d-4264-bcc9-e8f111e484a3 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:32.441065 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44308970-e48d-4264-bcc9-e8f111e484a3 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:32.441711 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d7072-3ea4-46a6-bf49-e817cd8141d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:32.441937 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44308970-e48d-4264-bcc9-e8f111e484a3 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/domains/0630f4c4e41f4d1489bcba93968557c7` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:32.442092 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d7072-3ea4-46a6-bf49-e817cd8141d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:32.442092 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d7072-3ea4-46a6-bf49-e817cd8141d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:32.442092 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d7072-3ea4-46a6-bf49-e817cd8141d6 admin admin] PATH_INFO: `/v3/projects/3e465ba33b284ffda335af1a600cbccc` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:32.442092 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d7072-3ea4-46a6-bf49-e817cd8141d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e465ba33b284ffda335af1a600cbccc)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:32.444705 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d7072-3ea4-46a6-bf49-e817cd8141d6 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:32.451443 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44308970-e48d-4264-bcc9-e8f111e484a3 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 21:25:32.469424 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-44308970-e48d-4264-bcc9-e8f111e484a3 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Could not find domain: 0630f4c4e41f4d1489bcba93968557c7.: keystone.exception.DomainNotFound: Could not find domain: 0630f4c4e41f4d1489bcba93968557c7. Apr 30 21:25:32.469424 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:25:32.469424 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Apr 30 21:25:32.469424 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Apr 30 21:25:32.469424 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 21:25:32.469424 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 21:25:32.469424 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 21:25:32.469424 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 21:25:32.469424 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 0630f4c4e41f4d1489bcba93968557c7. Apr 30 21:25:32.469424 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:25:32.469424 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 21:25:32.469424 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:25:32.469424 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:25:32.469424 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:25:32.469424 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:25:32.469424 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:25:32.470787 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:25:32.470787 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:25:32.470787 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:25:32.470787 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:25:32.470787 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:25:32.470787 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:25:32.470787 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:25:32.470787 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Apr 30 21:25:32.470787 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Apr 30 21:25:32.470787 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 21:25:32.470787 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 21:25:32.470787 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 21:25:32.470787 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 21:25:32.470787 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:25:32.470787 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:25:32.470787 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 21:25:32.471841 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 21:25:32.471841 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 21:25:32.471841 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 21:25:32.471841 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 21:25:32.471841 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 21:25:32.471841 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 21:25:32.471841 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 21:25:32.471841 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 21:25:32.471841 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 21:25:32.471841 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 21:25:32.471841 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 21:25:32.471841 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 21:25:32.471841 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 21:25:32.471841 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Apr 30 21:25:32.471841 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 21:25:32.471841 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 0630f4c4e41f4d1489bcba93968557c7. Apr 30 21:25:32.471841 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:25:32.472895 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2360/4722] 10.222.0.23 () {60 vars in 1248 bytes} [Sat Apr 30 21:25:32 2022] PATCH /identity/v3/domains/0630f4c4e41f4d1489bcba93968557c7 => generated 112 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 30 21:25:32.477168 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44308970-e48d-4264-bcc9-e8f111e484a3 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:32.489304 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44308970-e48d-4264-bcc9-e8f111e484a3 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:32.495196 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19eb9e-75ad-4ef8-aaa1-64ef0dbebc97 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:32.496069 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19eb9e-75ad-4ef8-aaa1-64ef0dbebc97 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:32.496358 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19eb9e-75ad-4ef8-aaa1-64ef0dbebc97 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:32.496639 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19eb9e-75ad-4ef8-aaa1-64ef0dbebc97 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/domains/f11e3021a3654e7882c1fde6c2090241` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:32.505272 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea19eb9e-75ad-4ef8-aaa1-64ef0dbebc97 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 21:25:32.515892 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-ea19eb9e-75ad-4ef8-aaa1-64ef0dbebc97 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Could not find domain: f11e3021a3654e7882c1fde6c2090241.: keystone.exception.DomainNotFound: Could not find domain: f11e3021a3654e7882c1fde6c2090241. Apr 30 21:25:32.515892 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:25:32.515892 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Apr 30 21:25:32.515892 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Apr 30 21:25:32.515892 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 21:25:32.515892 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 21:25:32.515892 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 21:25:32.515892 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 21:25:32.515892 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f11e3021a3654e7882c1fde6c2090241. Apr 30 21:25:32.515892 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:25:32.515892 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 21:25:32.515892 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:25:32.515892 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:25:32.515892 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:25:32.515892 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:25:32.515892 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:25:32.517451 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:25:32.517451 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:25:32.517451 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:25:32.517451 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:25:32.517451 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:25:32.517451 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:25:32.517451 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:25:32.517451 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Apr 30 21:25:32.517451 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Apr 30 21:25:32.517451 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 21:25:32.517451 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 21:25:32.517451 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 21:25:32.517451 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 21:25:32.517451 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:25:32.517451 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:25:32.517451 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 21:25:32.518679 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 21:25:32.518679 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 21:25:32.518679 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 21:25:32.518679 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 21:25:32.518679 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 21:25:32.518679 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 21:25:32.518679 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 21:25:32.518679 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 21:25:32.518679 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 21:25:32.518679 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 21:25:32.518679 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 21:25:32.518679 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 21:25:32.518679 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 21:25:32.518679 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Apr 30 21:25:32.518679 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 21:25:32.518679 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f11e3021a3654e7882c1fde6c2090241. Apr 30 21:25:32.518679 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:25:32.522353 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2361/4723] 10.222.0.23 () {60 vars in 1248 bytes} [Sat Apr 30 21:25:32 2022] PATCH /identity/v3/domains/f11e3021a3654e7882c1fde6c2090241 => generated 112 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 30 21:25:32.523267 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19eb9e-75ad-4ef8-aaa1-64ef0dbebc97 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:32.538414 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19eb9e-75ad-4ef8-aaa1-64ef0dbebc97 tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:32.561342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7c4d7072-3ea4-46a6-bf49-e817cd8141d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e465ba33b284ffda335af1a600cbccc', 'request_id': 'req-7c4d7072-3ea4-46a6-bf49-e817cd8141d6'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:32.576144 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7c4d7072-3ea4-46a6-bf49-e817cd8141d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e465ba33b284ffda335af1a600cbccc', 'request_id': 'req-7c4d7072-3ea4-46a6-bf49-e817cd8141d6'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:32.637018 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7c4d7072-3ea4-46a6-bf49-e817cd8141d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e465ba33b284ffda335af1a600cbccc', 'request_id': 'req-7c4d7072-3ea4-46a6-bf49-e817cd8141d6'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:32.650825 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f872906-03d1-4442-a886-0d865dbedfff tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df9bfebdf8544b329f058d3a83580557', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e927641110f547ef8a40e4babfac56c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:32.732296 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f872906-03d1-4442-a886-0d865dbedfff tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:32.732296 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f872906-03d1-4442-a886-0d865dbedfff tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:32.732296 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f872906-03d1-4442-a886-0d865dbedfff tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] PATH_INFO: `/v3/domains/97e7ad4e5bac430a95c6bcd5275f31c3` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:32.732296 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f872906-03d1-4442-a886-0d865dbedfff tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 21:25:32.732296 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-7f872906-03d1-4442-a886-0d865dbedfff tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Could not find domain: 97e7ad4e5bac430a95c6bcd5275f31c3.: keystone.exception.DomainNotFound: Could not find domain: 97e7ad4e5bac430a95c6bcd5275f31c3. Apr 30 21:25:32.733500 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:25:32.733500 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Apr 30 21:25:32.733500 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Apr 30 21:25:32.733500 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 21:25:32.733500 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 21:25:32.733500 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 21:25:32.733500 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 21:25:32.733500 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 97e7ad4e5bac430a95c6bcd5275f31c3. Apr 30 21:25:32.733500 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:25:32.733500 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 21:25:32.733500 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:25:32.733500 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:25:32.733500 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:25:32.733500 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:25:32.733500 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:25:32.733500 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:25:32.733500 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:25:32.733500 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:25:32.735013 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:25:32.735013 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:25:32.735013 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:25:32.735013 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:25:32.735013 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Apr 30 21:25:32.735013 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Apr 30 21:25:32.735013 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 21:25:32.735013 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 21:25:32.735013 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 21:25:32.735013 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 21:25:32.735013 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:25:32.735013 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:25:32.735013 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 21:25:32.735013 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 21:25:32.735013 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 21:25:32.735013 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 21:25:32.736174 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 21:25:32.736174 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 21:25:32.736174 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 21:25:32.736174 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 21:25:32.736174 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 21:25:32.736174 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 21:25:32.736174 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 21:25:32.736174 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 21:25:32.736174 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 21:25:32.736174 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 21:25:32.736174 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Apr 30 21:25:32.736174 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 21:25:32.736174 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 97e7ad4e5bac430a95c6bcd5275f31c3. Apr 30 21:25:32.736174 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:25:32.736174 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2362/4724] 10.222.0.23 () {60 vars in 1248 bytes} [Sat Apr 30 21:25:32 2022] PATCH /identity/v3/domains/97e7ad4e5bac430a95c6bcd5275f31c3 => generated 112 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 30 21:25:32.737140 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f872906-03d1-4442-a886-0d865dbedfff tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:32.737140 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7f872906-03d1-4442-a886-0d865dbedfff tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:32.804826 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f872906-03d1-4442-a886-0d865dbedfff tempest-TokensV3TestJSON-790769332 tempest-TokensV3TestJSON-790769332-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:32.811024 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b340498-4589-45fb-a23a-03f8ef9a1380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:32.812179 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b340498-4589-45fb-a23a-03f8ef9a1380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:32.813143 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b340498-4589-45fb-a23a-03f8ef9a1380 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:32.813515 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b340498-4589-45fb-a23a-03f8ef9a1380 admin admin] PATH_INFO: `/v3/users/e4ecd18d05c64e8b91119b5933c61fd1` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:32.815278 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b340498-4589-45fb-a23a-03f8ef9a1380 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4ecd18d05c64e8b91119b5933c61fd1)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:32.817547 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b340498-4589-45fb-a23a-03f8ef9a1380 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:33.051188 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7c4d7072-3ea4-46a6-bf49-e817cd8141d6 admin admin] The token cache is being invalidate because project 3e465ba33b284ffda335af1a600cbccc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:25:33.051801 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7c4d7072-3ea4-46a6-bf49-e817cd8141d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:33.052613 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7c4d7072-3ea4-46a6-bf49-e817cd8141d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:33.054564 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2363/4725] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:25:32 2022] DELETE /identity/v3/projects/3e465ba33b284ffda335af1a600cbccc => generated 0 bytes in 749 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:33.058360 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d7072-3ea4-46a6-bf49-e817cd8141d6 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:33.060592 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7c4d7072-3ea4-46a6-bf49-e817cd8141d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:33.075361 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d7072-3ea4-46a6-bf49-e817cd8141d6 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:33.086439 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984663c9-6be9-44f5-ac2a-cf74d83d4ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:33.087589 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984663c9-6be9-44f5-ac2a-cf74d83d4ee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:33.087878 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984663c9-6be9-44f5-ac2a-cf74d83d4ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:33.088150 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984663c9-6be9-44f5-ac2a-cf74d83d4ee6 admin admin] PATH_INFO: `/v3/users/078d3385bc6a4418970db78273f2db57` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:33.089564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984663c9-6be9-44f5-ac2a-cf74d83d4ee6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=078d3385bc6a4418970db78273f2db57)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:33.091582 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984663c9-6be9-44f5-ac2a-cf74d83d4ee6 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:33.183562 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8b340498-4589-45fb-a23a-03f8ef9a1380 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4ecd18d05c64e8b91119b5933c61fd1'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:33.202736 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8b340498-4589-45fb-a23a-03f8ef9a1380 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4ecd18d05c64e8b91119b5933c61fd1'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:33.296882 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8b340498-4589-45fb-a23a-03f8ef9a1380 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4ecd18d05c64e8b91119b5933c61fd1'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:33.305711 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8b340498-4589-45fb-a23a-03f8ef9a1380 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4ecd18d05c64e8b91119b5933c61fd1'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:33.306360 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8b340498-4589-45fb-a23a-03f8ef9a1380 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4ecd18d05c64e8b91119b5933c61fd1'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:33.310520 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-984663c9-6be9-44f5-ac2a-cf74d83d4ee6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '078d3385bc6a4418970db78273f2db57'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:33.313608 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2363/4726] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:25:32 2022] DELETE /identity/v3/users/e4ecd18d05c64e8b91119b5933c61fd1 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:33.317927 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540ae66-1fd6-411f-9e35-71926ad8dd25 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:33.318218 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540ae66-1fd6-411f-9e35-71926ad8dd25 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:33.318735 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540ae66-1fd6-411f-9e35-71926ad8dd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:33.327606 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-984663c9-6be9-44f5-ac2a-cf74d83d4ee6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '078d3385bc6a4418970db78273f2db57'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:33.338654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-a540ae66-1fd6-411f-9e35-71926ad8dd25 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:33.340022 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a540ae66-1fd6-411f-9e35-71926ad8dd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:33.393314 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-984663c9-6be9-44f5-ac2a-cf74d83d4ee6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '078d3385bc6a4418970db78273f2db57'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:33.394110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-984663c9-6be9-44f5-ac2a-cf74d83d4ee6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '078d3385bc6a4418970db78273f2db57'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:33.404990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-984663c9-6be9-44f5-ac2a-cf74d83d4ee6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '078d3385bc6a4418970db78273f2db57'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:33.450203 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2364/4727] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:25:33 2022] DELETE /identity/v3/users/078d3385bc6a4418970db78273f2db57 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:25:33.473546 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2364/4728] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:25:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:25:33.491015 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984663c9-6be9-44f5-ac2a-cf74d83d4ee6 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:33.492701 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-984663c9-6be9-44f5-ac2a-cf74d83d4ee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:33.559257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984663c9-6be9-44f5-ac2a-cf74d83d4ee6 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:33.567141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e678a-8490-44bb-83c0-3086b947cc2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:33.568029 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e678a-8490-44bb-83c0-3086b947cc2c service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:33.568514 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e678a-8490-44bb-83c0-3086b947cc2c service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:33.568932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e678a-8490-44bb-83c0-3086b947cc2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:33.645130 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2e678a-8490-44bb-83c0-3086b947cc2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:33.645130 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2e678a-8490-44bb-83c0-3086b947cc2c service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:33.656843 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2365/4729] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:25:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:25:33.848707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540ae66-1fd6-411f-9e35-71926ad8dd25 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:33.850201 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a540ae66-1fd6-411f-9e35-71926ad8dd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:33.873147 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540ae66-1fd6-411f-9e35-71926ad8dd25 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:33.887444 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1546cb8-d6eb-4603-b951-bd417f9787cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:33.889562 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1546cb8-d6eb-4603-b951-bd417f9787cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:33.889562 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1546cb8-d6eb-4603-b951-bd417f9787cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:33.889562 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1546cb8-d6eb-4603-b951-bd417f9787cf admin admin] PATH_INFO: `/v3/projects/3c79746fa72c4192b5984cecda6e91a2` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:33.893066 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1546cb8-d6eb-4603-b951-bd417f9787cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c79746fa72c4192b5984cecda6e91a2)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:33.895398 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1546cb8-d6eb-4603-b951-bd417f9787cf admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:34.025786 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b1546cb8-d6eb-4603-b951-bd417f9787cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c79746fa72c4192b5984cecda6e91a2', 'request_id': 'req-b1546cb8-d6eb-4603-b951-bd417f9787cf'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:34.032472 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b1546cb8-d6eb-4603-b951-bd417f9787cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c79746fa72c4192b5984cecda6e91a2', 'request_id': 'req-b1546cb8-d6eb-4603-b951-bd417f9787cf'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:34.039638 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b1546cb8-d6eb-4603-b951-bd417f9787cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c79746fa72c4192b5984cecda6e91a2', 'request_id': 'req-b1546cb8-d6eb-4603-b951-bd417f9787cf'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:34.103511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b1546cb8-d6eb-4603-b951-bd417f9787cf admin admin] The token cache is being invalidate because project 3c79746fa72c4192b5984cecda6e91a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:25:34.104222 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b1546cb8-d6eb-4603-b951-bd417f9787cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:34.106093 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b1546cb8-d6eb-4603-b951-bd417f9787cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:34.108561 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2365/4730] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:25:33 2022] DELETE /identity/v3/projects/3c79746fa72c4192b5984cecda6e91a2 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:34.114510 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe956db-f917-4da5-8e3f-fc355440d8f3 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:34.115188 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe956db-f917-4da5-8e3f-fc355440d8f3 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:34.115609 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe956db-f917-4da5-8e3f-fc355440d8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:34.137142 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-9fe956db-f917-4da5-8e3f-fc355440d8f3 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:34.138588 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-9fe956db-f917-4da5-8e3f-fc355440d8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:34.229921 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1546cb8-d6eb-4603-b951-bd417f9787cf admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:34.229921 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b1546cb8-d6eb-4603-b951-bd417f9787cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:34.256848 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2366/4731] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:25:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:25:34.271990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73763bd-1c7e-497a-8486-760145b74d6b None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:34.272379 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73763bd-1c7e-497a-8486-760145b74d6b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:34.272772 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73763bd-1c7e-497a-8486-760145b74d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:34.302865 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-e73763bd-1c7e-497a-8486-760145b74d6b None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:34.304087 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e73763bd-1c7e-497a-8486-760145b74d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:34.319886 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2367/4732] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:25:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:25:34.320832 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73763bd-1c7e-497a-8486-760145b74d6b None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:34.331617 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73763bd-1c7e-497a-8486-760145b74d6b None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:34.338867 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ddad1-0c4d-4d0a-a5e5-bface9ba00f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:34.339548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ddad1-0c4d-4d0a-a5e5-bface9ba00f2 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:34.339993 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ddad1-0c4d-4d0a-a5e5-bface9ba00f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:34.340278 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ddad1-0c4d-4d0a-a5e5-bface9ba00f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:34.341009 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1ddad1-0c4d-4d0a-a5e5-bface9ba00f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:25:34.341323 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1ddad1-0c4d-4d0a-a5e5-bface9ba00f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:34.344979 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1ddad1-0c4d-4d0a-a5e5-bface9ba00f2 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:34.352667 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1546cb8-d6eb-4603-b951-bd417f9787cf admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:34.361814 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d81175-36f2-497e-8d4a-fba213199312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:34.362637 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d81175-36f2-497e-8d4a-fba213199312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:34.362978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d81175-36f2-497e-8d4a-fba213199312 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:34.363961 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d81175-36f2-497e-8d4a-fba213199312 admin admin] PATH_INFO: `/v3/projects/5e72a582148047e6a80e5b080c5f5900` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:34.364092 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2368/4733] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:25:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:25:34.365289 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ddad1-0c4d-4d0a-a5e5-bface9ba00f2 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:34.367177 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d81175-36f2-497e-8d4a-fba213199312 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e72a582148047e6a80e5b080c5f5900)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:34.369206 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d81175-36f2-497e-8d4a-fba213199312 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:34.378520 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ddad1-0c4d-4d0a-a5e5-bface9ba00f2 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:34.384549 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35375cd8-df17-4a7b-b697-1f0b5645fc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:34.385511 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35375cd8-df17-4a7b-b697-1f0b5645fc48 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:34.385984 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35375cd8-df17-4a7b-b697-1f0b5645fc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:34.386364 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35375cd8-df17-4a7b-b697-1f0b5645fc48 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:34.387168 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35375cd8-df17-4a7b-b697-1f0b5645fc48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:34.389385 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35375cd8-df17-4a7b-b697-1f0b5645fc48 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:34.508251 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2369/4734] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:25:34 2022] POST /identity/v3/projects => generated 387 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:25:34.518874 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35375cd8-df17-4a7b-b697-1f0b5645fc48 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:34.563891 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f3d81175-36f2-497e-8d4a-fba213199312 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e72a582148047e6a80e5b080c5f5900', 'request_id': 'req-f3d81175-36f2-497e-8d4a-fba213199312'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:34.579376 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f3d81175-36f2-497e-8d4a-fba213199312 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e72a582148047e6a80e5b080c5f5900', 'request_id': 'req-f3d81175-36f2-497e-8d4a-fba213199312'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:34.593194 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f3d81175-36f2-497e-8d4a-fba213199312 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e72a582148047e6a80e5b080c5f5900', 'request_id': 'req-f3d81175-36f2-497e-8d4a-fba213199312'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:34.605748 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35375cd8-df17-4a7b-b697-1f0b5645fc48 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:34.697941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594f0b0-7c67-4139-bc2b-537f5b9e1605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:34.699213 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594f0b0-7c67-4139-bc2b-537f5b9e1605 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:34.699501 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594f0b0-7c67-4139-bc2b-537f5b9e1605 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:34.699932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594f0b0-7c67-4139-bc2b-537f5b9e1605 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:34.706539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6594f0b0-7c67-4139-bc2b-537f5b9e1605 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:34.709344 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6594f0b0-7c67-4139-bc2b-537f5b9e1605 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:34.709915 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f3d81175-36f2-497e-8d4a-fba213199312 admin admin] The token cache is being invalidate because project 5e72a582148047e6a80e5b080c5f5900 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:25:34.710308 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f3d81175-36f2-497e-8d4a-fba213199312 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:34.711413 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f3d81175-36f2-497e-8d4a-fba213199312 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:34.717655 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2366/4735] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:25:34 2022] DELETE /identity/v3/projects/5e72a582148047e6a80e5b080c5f5900 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:34.719642 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d81175-36f2-497e-8d4a-fba213199312 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:34.721125 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f3d81175-36f2-497e-8d4a-fba213199312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:34.744378 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d81175-36f2-497e-8d4a-fba213199312 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:34.750601 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50cafa1-57c3-45de-8170-3c7d92883f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:34.751714 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50cafa1-57c3-45de-8170-3c7d92883f8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:34.752143 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50cafa1-57c3-45de-8170-3c7d92883f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:34.752517 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50cafa1-57c3-45de-8170-3c7d92883f8a admin admin] PATH_INFO: `/v3/users/df9bfebdf8544b329f058d3a83580557` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:34.753977 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50cafa1-57c3-45de-8170-3c7d92883f8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=df9bfebdf8544b329f058d3a83580557)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:34.756213 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50cafa1-57c3-45de-8170-3c7d92883f8a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:34.816926 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2370/4736] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:25:34 2022] POST /identity/v3/users => generated 294 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:25:34.817993 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594f0b0-7c67-4139-bc2b-537f5b9e1605 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:34.823057 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6594f0b0-7c67-4139-bc2b-537f5b9e1605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:34.837612 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594f0b0-7c67-4139-bc2b-537f5b9e1605 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:34.845986 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e54b28-31ff-4e77-a79c-22081b54ba09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:34.847089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e54b28-31ff-4e77-a79c-22081b54ba09 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:34.847480 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e54b28-31ff-4e77-a79c-22081b54ba09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:34.847861 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e54b28-31ff-4e77-a79c-22081b54ba09 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:34.848717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e54b28-31ff-4e77-a79c-22081b54ba09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:34.850718 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e54b28-31ff-4e77-a79c-22081b54ba09 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:34.879881 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2371/4737] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:25:34.884510 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e54b28-31ff-4e77-a79c-22081b54ba09 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:34.899764 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e54b28-31ff-4e77-a79c-22081b54ba09 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:34.910049 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9c530-b510-4743-86a3-6061cf73b7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:34.911024 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9c530-b510-4743-86a3-6061cf73b7be admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:34.911687 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9c530-b510-4743-86a3-6061cf73b7be admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:34.912292 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9c530-b510-4743-86a3-6061cf73b7be admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:34.914153 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e9c530-b510-4743-86a3-6061cf73b7be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:34.916569 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e9c530-b510-4743-86a3-6061cf73b7be admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:34.937081 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2372/4738] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:25:34.942991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9c530-b510-4743-86a3-6061cf73b7be admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:34.958937 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9c530-b510-4743-86a3-6061cf73b7be admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:34.965114 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410932e-d169-4646-b84a-75e7c2cb47d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:34.968242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410932e-d169-4646-b84a-75e7c2cb47d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:34.968242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410932e-d169-4646-b84a-75e7c2cb47d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:34.968242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410932e-d169-4646-b84a-75e7c2cb47d5 admin admin] PATH_INFO: `/v3/projects/70aa0bca867f4251ab203d9a3d4833d5/users/6b662d1b70434685b47ad22caf23ee25/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:35.003818 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e50cafa1-57c3-45de-8170-3c7d92883f8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df9bfebdf8544b329f058d3a83580557'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:35.017612 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d410932e-d169-4646-b84a-75e7c2cb47d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70aa0bca867f4251ab203d9a3d4833d5, user_id=6b662d1b70434685b47ad22caf23ee25, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:35.020888 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e50cafa1-57c3-45de-8170-3c7d92883f8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df9bfebdf8544b329f058d3a83580557'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:35.021071 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d410932e-d169-4646-b84a-75e7c2cb47d5 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:35.079626 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e50cafa1-57c3-45de-8170-3c7d92883f8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df9bfebdf8544b329f058d3a83580557'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:35.089059 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e50cafa1-57c3-45de-8170-3c7d92883f8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df9bfebdf8544b329f058d3a83580557'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:35.092188 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e50cafa1-57c3-45de-8170-3c7d92883f8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df9bfebdf8544b329f058d3a83580557'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:35.095955 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2373/4739] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:25:34 2022] PUT /identity/v3/projects/70aa0bca867f4251ab203d9a3d4833d5/users/6b662d1b70434685b47ad22caf23ee25/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:35.106692 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715f575-8474-482b-af7f-75719b2b30ea None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:35.107352 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715f575-8474-482b-af7f-75719b2b30ea None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:35.107554 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2367/4740] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:25:34 2022] DELETE /identity/v3/users/df9bfebdf8544b329f058d3a83580557 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:35.111880 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715f575-8474-482b-af7f-75719b2b30ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:35.150755 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-b715f575-8474-482b-af7f-75719b2b30ea None None] MFA Rules not processed for user `6b662d1b70434685b47ad22caf23ee25`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:35.152158 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b715f575-8474-482b-af7f-75719b2b30ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:35.232944 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2374/4741] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:25:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:25:35.244776 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50cafa1-57c3-45de-8170-3c7d92883f8a admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:35.246260 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e50cafa1-57c3-45de-8170-3c7d92883f8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:35.326887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50cafa1-57c3-45de-8170-3c7d92883f8a admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:35.332043 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb893e7-4c5f-41a9-a331-24b612c69e82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:35.332918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb893e7-4c5f-41a9-a331-24b612c69e82 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:35.333375 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb893e7-4c5f-41a9-a331-24b612c69e82 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:35.333931 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb893e7-4c5f-41a9-a331-24b612c69e82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:35.345278 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb893e7-4c5f-41a9-a331-24b612c69e82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:35.347042 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb893e7-4c5f-41a9-a331-24b612c69e82 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:35.358172 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2368/4742] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:25:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:25:35.419067 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715f575-8474-482b-af7f-75719b2b30ea None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:35.421364 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b715f575-8474-482b-af7f-75719b2b30ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:35.541157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715f575-8474-482b-af7f-75719b2b30ea None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:35.548904 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c9313-1ee3-4b72-9912-a08e8210f7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:35.552396 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c9313-1ee3-4b72-9912-a08e8210f7cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:35.552882 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c9313-1ee3-4b72-9912-a08e8210f7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:35.553172 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c9313-1ee3-4b72-9912-a08e8210f7cf admin admin] PATH_INFO: `/v3/users/6b662d1b70434685b47ad22caf23ee25` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:35.554720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c9313-1ee3-4b72-9912-a08e8210f7cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b662d1b70434685b47ad22caf23ee25)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:35.557105 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c9313-1ee3-4b72-9912-a08e8210f7cf admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:35.715654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb893e7-4c5f-41a9-a331-24b612c69e82 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:35.716415 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-adb893e7-4c5f-41a9-a331-24b612c69e82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:35.763742 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb893e7-4c5f-41a9-a331-24b612c69e82 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:35.781931 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28549f-593f-44e8-928d-b28e42f16b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:35.783110 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28549f-593f-44e8-928d-b28e42f16b7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:35.783474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28549f-593f-44e8-928d-b28e42f16b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:35.783829 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28549f-593f-44e8-928d-b28e42f16b7e admin admin] PATH_INFO: `/v3/projects/e927641110f547ef8a40e4babfac56c9` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:35.786070 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28549f-593f-44e8-928d-b28e42f16b7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e927641110f547ef8a40e4babfac56c9)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:35.788271 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28549f-593f-44e8-928d-b28e42f16b7e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:35.848495 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ba1c9313-1ee3-4b72-9912-a08e8210f7cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b662d1b70434685b47ad22caf23ee25'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:35.887965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ba1c9313-1ee3-4b72-9912-a08e8210f7cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b662d1b70434685b47ad22caf23ee25'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:35.987792 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ba28549f-593f-44e8-928d-b28e42f16b7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e927641110f547ef8a40e4babfac56c9', 'request_id': 'req-ba28549f-593f-44e8-928d-b28e42f16b7e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:35.995765 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ba28549f-593f-44e8-928d-b28e42f16b7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e927641110f547ef8a40e4babfac56c9', 'request_id': 'req-ba28549f-593f-44e8-928d-b28e42f16b7e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:36.005510 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ba1c9313-1ee3-4b72-9912-a08e8210f7cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b662d1b70434685b47ad22caf23ee25'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:36.007342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ba1c9313-1ee3-4b72-9912-a08e8210f7cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b662d1b70434685b47ad22caf23ee25'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:36.018197 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ba1c9313-1ee3-4b72-9912-a08e8210f7cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b662d1b70434685b47ad22caf23ee25'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:36.030605 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ba28549f-593f-44e8-928d-b28e42f16b7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e927641110f547ef8a40e4babfac56c9', 'request_id': 'req-ba28549f-593f-44e8-928d-b28e42f16b7e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:36.041870 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2375/4743] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:25:35 2022] DELETE /identity/v3/users/6b662d1b70434685b47ad22caf23ee25 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:36.047012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b28e0-907c-4f02-a1bb-f3376ad12332 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:36.047541 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b28e0-907c-4f02-a1bb-f3376ad12332 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:36.048020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b28e0-907c-4f02-a1bb-f3376ad12332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:36.076669 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-183b28e0-907c-4f02-a1bb-f3376ad12332 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:36.079093 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-183b28e0-907c-4f02-a1bb-f3376ad12332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:36.155127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ba28549f-593f-44e8-928d-b28e42f16b7e admin admin] The token cache is being invalidate because project e927641110f547ef8a40e4babfac56c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:25:36.155715 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ba28549f-593f-44e8-928d-b28e42f16b7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:36.156714 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ba28549f-593f-44e8-928d-b28e42f16b7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:36.158861 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2369/4744] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:25:35 2022] DELETE /identity/v3/projects/e927641110f547ef8a40e4babfac56c9 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:36.162466 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28549f-593f-44e8-928d-b28e42f16b7e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:36.164499 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ba28549f-593f-44e8-928d-b28e42f16b7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:36.212372 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2376/4745] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:25:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:25:36.223313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b28e0-907c-4f02-a1bb-f3376ad12332 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:36.225043 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-183b28e0-907c-4f02-a1bb-f3376ad12332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:36.256310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28549f-593f-44e8-928d-b28e42f16b7e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:36.261489 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2346d2-eb12-4bee-b6cd-79a4b0b03407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:36.262620 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2346d2-eb12-4bee-b6cd-79a4b0b03407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:36.263082 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2346d2-eb12-4bee-b6cd-79a4b0b03407 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:36.263508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2346d2-eb12-4bee-b6cd-79a4b0b03407 admin admin] PATH_INFO: `/v3/users/f455064f5088443a89e77a376b0a10ef` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:36.265095 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2346d2-eb12-4bee-b6cd-79a4b0b03407 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f455064f5088443a89e77a376b0a10ef)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:36.267301 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2346d2-eb12-4bee-b6cd-79a4b0b03407 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:36.367105 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b28e0-907c-4f02-a1bb-f3376ad12332 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:36.372377 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4f50f-a89b-48ce-8eb3-89c994fc64c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:36.373158 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4f50f-a89b-48ce-8eb3-89c994fc64c6 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:36.373518 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4f50f-a89b-48ce-8eb3-89c994fc64c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:36.373922 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4f50f-a89b-48ce-8eb3-89c994fc64c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:36.385501 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def4f50f-a89b-48ce-8eb3-89c994fc64c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:36.387158 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def4f50f-a89b-48ce-8eb3-89c994fc64c6 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:36.404608 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2377/4746] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:25:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:25:36.573780 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0b2346d2-eb12-4bee-b6cd-79a4b0b03407 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f455064f5088443a89e77a376b0a10ef'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:36.603742 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0b2346d2-eb12-4bee-b6cd-79a4b0b03407 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f455064f5088443a89e77a376b0a10ef'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:36.724726 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0b2346d2-eb12-4bee-b6cd-79a4b0b03407 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f455064f5088443a89e77a376b0a10ef'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:36.742051 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0b2346d2-eb12-4bee-b6cd-79a4b0b03407 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f455064f5088443a89e77a376b0a10ef'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:36.743215 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0b2346d2-eb12-4bee-b6cd-79a4b0b03407 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f455064f5088443a89e77a376b0a10ef'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:36.754271 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2370/4747] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:25:36 2022] DELETE /identity/v3/users/f455064f5088443a89e77a376b0a10ef => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:37.125326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4f50f-a89b-48ce-8eb3-89c994fc64c6 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:37.127426 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-def4f50f-a89b-48ce-8eb3-89c994fc64c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:37.154016 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4f50f-a89b-48ce-8eb3-89c994fc64c6 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:37.277345 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d1280-68a3-42d4-ac11-a0d171848452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:37.278631 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d1280-68a3-42d4-ac11-a0d171848452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:37.279079 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d1280-68a3-42d4-ac11-a0d171848452 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:37.279731 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d1280-68a3-42d4-ac11-a0d171848452 admin admin] PATH_INFO: `/v3/projects/70aa0bca867f4251ab203d9a3d4833d5` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:37.281881 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d1280-68a3-42d4-ac11-a0d171848452 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70aa0bca867f4251ab203d9a3d4833d5)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:37.286970 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d1280-68a3-42d4-ac11-a0d171848452 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:37.446298 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8a4d1280-68a3-42d4-ac11-a0d171848452 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70aa0bca867f4251ab203d9a3d4833d5', 'request_id': 'req-8a4d1280-68a3-42d4-ac11-a0d171848452'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:37.454539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8a4d1280-68a3-42d4-ac11-a0d171848452 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70aa0bca867f4251ab203d9a3d4833d5', 'request_id': 'req-8a4d1280-68a3-42d4-ac11-a0d171848452'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:37.483954 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8a4d1280-68a3-42d4-ac11-a0d171848452 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70aa0bca867f4251ab203d9a3d4833d5', 'request_id': 'req-8a4d1280-68a3-42d4-ac11-a0d171848452'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:37.598020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8a4d1280-68a3-42d4-ac11-a0d171848452 admin admin] The token cache is being invalidate because project 70aa0bca867f4251ab203d9a3d4833d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:25:37.598020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8a4d1280-68a3-42d4-ac11-a0d171848452 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:37.598020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8a4d1280-68a3-42d4-ac11-a0d171848452 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:37.598020 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2378/4748] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:25:37 2022] DELETE /identity/v3/projects/70aa0bca867f4251ab203d9a3d4833d5 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:37.603187 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108e3be-4e5a-46ac-82c7-ceae87deec3b None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:37.603819 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108e3be-4e5a-46ac-82c7-ceae87deec3b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:37.603930 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108e3be-4e5a-46ac-82c7-ceae87deec3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:37.627357 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-c108e3be-4e5a-46ac-82c7-ceae87deec3b None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:37.628784 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c108e3be-4e5a-46ac-82c7-ceae87deec3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:37.733807 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2371/4749] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:25:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:25:37.737877 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a48fe7-edc6-4e00-83b6-17b06d7feda9 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:37.738368 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a48fe7-edc6-4e00-83b6-17b06d7feda9 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:37.738672 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a48fe7-edc6-4e00-83b6-17b06d7feda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:37.763068 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-b5a48fe7-edc6-4e00-83b6-17b06d7feda9 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:37.764632 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b5a48fe7-edc6-4e00-83b6-17b06d7feda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:37.785854 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2379/4750] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:25:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:25:37.806991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108e3be-4e5a-46ac-82c7-ceae87deec3b None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:37.816908 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108e3be-4e5a-46ac-82c7-ceae87deec3b None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:37.821699 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62f530-47dc-4764-8712-2a7430b00311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:37.822390 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62f530-47dc-4764-8712-2a7430b00311 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:37.822693 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62f530-47dc-4764-8712-2a7430b00311 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:37.822971 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62f530-47dc-4764-8712-2a7430b00311 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:37.823713 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a62f530-47dc-4764-8712-2a7430b00311 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:25:37.824013 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a62f530-47dc-4764-8712-2a7430b00311 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:37.825610 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a62f530-47dc-4764-8712-2a7430b00311 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:37.838518 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2372/4751] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:25:37.844155 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a48fe7-edc6-4e00-83b6-17b06d7feda9 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:37.866121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a48fe7-edc6-4e00-83b6-17b06d7feda9 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:37.866121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b130e-91fc-4a63-a75d-25a5309b557f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:37.866121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b130e-91fc-4a63-a75d-25a5309b557f admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:37.866121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b130e-91fc-4a63-a75d-25a5309b557f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:37.866765 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b130e-91fc-4a63-a75d-25a5309b557f admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:37.866765 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b130e-91fc-4a63-a75d-25a5309b557f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:37.867489 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b130e-91fc-4a63-a75d-25a5309b557f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:38.041132 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62f530-47dc-4764-8712-2a7430b00311 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:38.043419 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9a62f530-47dc-4764-8712-2a7430b00311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:38.055862 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2380/4752] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:25:37 2022] POST /identity/v3/projects => generated 387 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:25:38.062034 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b130e-91fc-4a63-a75d-25a5309b557f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:38.068264 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62f530-47dc-4764-8712-2a7430b00311 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:38.134972 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481c237-de48-4095-bafe-176bbef86b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:38.135861 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481c237-de48-4095-bafe-176bbef86b1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:38.136165 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481c237-de48-4095-bafe-176bbef86b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:38.136887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481c237-de48-4095-bafe-176bbef86b1b admin admin] PATH_INFO: `/v3/projects/8c8a2f821cea47f9b918fbc11d9b71ea` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:38.137837 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d481c237-de48-4095-bafe-176bbef86b1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c8a2f821cea47f9b918fbc11d9b71ea)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:38.139772 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d481c237-de48-4095-bafe-176bbef86b1b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:38.152392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b130e-91fc-4a63-a75d-25a5309b557f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:38.161607 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136fc2b-f28f-42ba-9afe-b8899fbfd699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:38.162369 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136fc2b-f28f-42ba-9afe-b8899fbfd699 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:38.162623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136fc2b-f28f-42ba-9afe-b8899fbfd699 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:38.163032 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136fc2b-f28f-42ba-9afe-b8899fbfd699 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:38.163733 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8136fc2b-f28f-42ba-9afe-b8899fbfd699 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:38.165813 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8136fc2b-f28f-42ba-9afe-b8899fbfd699 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:38.243911 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d481c237-de48-4095-bafe-176bbef86b1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c8a2f821cea47f9b918fbc11d9b71ea', 'request_id': 'req-d481c237-de48-4095-bafe-176bbef86b1b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:38.253063 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d481c237-de48-4095-bafe-176bbef86b1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c8a2f821cea47f9b918fbc11d9b71ea', 'request_id': 'req-d481c237-de48-4095-bafe-176bbef86b1b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:38.260231 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2381/4753] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:25:38 2022] POST /identity/v3/users => generated 294 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:25:38.264485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e66a92-e130-455b-9e79-ecf62e1cc00e None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:38.264777 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e66a92-e130-455b-9e79-ecf62e1cc00e None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:38.265054 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e66a92-e130-455b-9e79-ecf62e1cc00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:38.265209 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d481c237-de48-4095-bafe-176bbef86b1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c8a2f821cea47f9b918fbc11d9b71ea', 'request_id': 'req-d481c237-de48-4095-bafe-176bbef86b1b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:38.299873 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-b9e66a92-e130-455b-9e79-ecf62e1cc00e None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:38.301392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b9e66a92-e130-455b-9e79-ecf62e1cc00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:38.360096 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d481c237-de48-4095-bafe-176bbef86b1b admin admin] The token cache is being invalidate because project 8c8a2f821cea47f9b918fbc11d9b71ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:25:38.360417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d481c237-de48-4095-bafe-176bbef86b1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:38.361286 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d481c237-de48-4095-bafe-176bbef86b1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:38.365992 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2373/4754] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:25:38 2022] DELETE /identity/v3/projects/8c8a2f821cea47f9b918fbc11d9b71ea => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:25:38.365992 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481c237-de48-4095-bafe-176bbef86b1b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:38.367715 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d481c237-de48-4095-bafe-176bbef86b1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:38.397173 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2382/4755] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:25:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:25:38.399162 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9414f-8378-4c61-9ba9-0d827d235163 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:38.399648 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9414f-8378-4c61-9ba9-0d827d235163 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:38.400084 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9414f-8378-4c61-9ba9-0d827d235163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:38.424093 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-13f9414f-8378-4c61-9ba9-0d827d235163 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:38.425336 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-13f9414f-8378-4c61-9ba9-0d827d235163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:38.466964 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481c237-de48-4095-bafe-176bbef86b1b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:38.475715 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6622231-af30-4d66-a84a-88a3dedabd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:38.476484 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6622231-af30-4d66-a84a-88a3dedabd6d admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:38.476842 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6622231-af30-4d66-a84a-88a3dedabd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:38.477308 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6622231-af30-4d66-a84a-88a3dedabd6d admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:38.483227 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6622231-af30-4d66-a84a-88a3dedabd6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:38.486336 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6622231-af30-4d66-a84a-88a3dedabd6d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:38.501069 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2374/4756] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:25:38.502408 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6622231-af30-4d66-a84a-88a3dedabd6d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:38.505618 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e6622231-af30-4d66-a84a-88a3dedabd6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:38.533466 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2383/4757] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:25:38.534860 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9414f-8378-4c61-9ba9-0d827d235163 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:38.556721 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9414f-8378-4c61-9ba9-0d827d235163 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:38.570348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a8ecb-45ea-45b3-9a4f-2f62ce9ce8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:38.574416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a8ecb-45ea-45b3-9a4f-2f62ce9ce8d8 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:38.574416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a8ecb-45ea-45b3-9a4f-2f62ce9ce8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:38.574416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a8ecb-45ea-45b3-9a4f-2f62ce9ce8d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:38.574416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0a8ecb-45ea-45b3-9a4f-2f62ce9ce8d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:38.577149 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0a8ecb-45ea-45b3-9a4f-2f62ce9ce8d8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:38.620020 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6622231-af30-4d66-a84a-88a3dedabd6d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:38.648698 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2384/4758] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:25:38.648698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bdb2f7-0118-41c5-b6d1-3ba481103443 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:38.648698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bdb2f7-0118-41c5-b6d1-3ba481103443 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:38.648698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bdb2f7-0118-41c5-b6d1-3ba481103443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:38.649158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06af605-f3c2-488b-a66e-1fdfc0f6cad3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:38.649158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06af605-f3c2-488b-a66e-1fdfc0f6cad3 service swift] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:38.649158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06af605-f3c2-488b-a66e-1fdfc0f6cad3 service swift] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:38.649158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06af605-f3c2-488b-a66e-1fdfc0f6cad3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:38.655085 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06af605-f3c2-488b-a66e-1fdfc0f6cad3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:38.656843 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06af605-f3c2-488b-a66e-1fdfc0f6cad3 service swift] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:38.660664 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-50bdb2f7-0118-41c5-b6d1-3ba481103443 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:38.662424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-50bdb2f7-0118-41c5-b6d1-3ba481103443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:38.671479 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2385/4759] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:25:38.673001 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bdb2f7-0118-41c5-b6d1-3ba481103443 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:38.677794 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2375/4760] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:25:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:25:38.678707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06af605-f3c2-488b-a66e-1fdfc0f6cad3 service swift] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:38.688988 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bdb2f7-0118-41c5-b6d1-3ba481103443 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:38.700548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f638c13-0148-4c29-9b7c-b596757a71fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:38.702159 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f638c13-0148-4c29-9b7c-b596757a71fd admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:38.702626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f638c13-0148-4c29-9b7c-b596757a71fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:38.703111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f638c13-0148-4c29-9b7c-b596757a71fd admin admin] PATH_INFO: `/v3/projects/239aa4ccbcc9478d9c7cb464f30f65f5/users/1db6288172594ff2a635b92deb90c7ae/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:38.710579 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06af605-f3c2-488b-a66e-1fdfc0f6cad3 service swift] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:38.721067 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ddfcb-d730-48f9-8272-f5206c79ba1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:38.721779 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ddfcb-d730-48f9-8272-f5206c79ba1b admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:38.722066 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ddfcb-d730-48f9-8272-f5206c79ba1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:38.723095 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ddfcb-d730-48f9-8272-f5206c79ba1b admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:38.723095 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ddfcb-d730-48f9-8272-f5206c79ba1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:25:38.723408 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ddfcb-d730-48f9-8272-f5206c79ba1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:38.723849 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f638c13-0148-4c29-9b7c-b596757a71fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=239aa4ccbcc9478d9c7cb464f30f65f5, user_id=1db6288172594ff2a635b92deb90c7ae, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:38.725351 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ddfcb-d730-48f9-8272-f5206c79ba1b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:38.728654 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f638c13-0148-4c29-9b7c-b596757a71fd admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:38.738202 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2376/4761] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:25:38.742562 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ddfcb-d730-48f9-8272-f5206c79ba1b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:38.755577 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ddfcb-d730-48f9-8272-f5206c79ba1b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:38.772796 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1236515e-f69d-4325-8788-1be4cd58f120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:38.774677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236515e-f69d-4325-8788-1be4cd58f120 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:38.774677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236515e-f69d-4325-8788-1be4cd58f120 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:38.774677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236515e-f69d-4325-8788-1be4cd58f120 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:38.774954 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1236515e-f69d-4325-8788-1be4cd58f120 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:38.778437 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1236515e-f69d-4325-8788-1be4cd58f120 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:38.844977 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2386/4762] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:25:38 2022] PUT /identity/v3/projects/239aa4ccbcc9478d9c7cb464f30f65f5/users/1db6288172594ff2a635b92deb90c7ae/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:38.856425 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b286f4-3d12-4e0c-8ccc-ef6b9c46056b None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:38.856712 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b286f4-3d12-4e0c-8ccc-ef6b9c46056b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:38.856994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b286f4-3d12-4e0c-8ccc-ef6b9c46056b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:38.907073 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-b9b286f4-3d12-4e0c-8ccc-ef6b9c46056b None None] MFA Rules not processed for user `1db6288172594ff2a635b92deb90c7ae`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:38.908672 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b9b286f4-3d12-4e0c-8ccc-ef6b9c46056b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:38.935952 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2377/4763] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:25:38 2022] POST /identity/v3/projects => generated 381 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:25:38.940587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1236515e-f69d-4325-8788-1be4cd58f120 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:39.075566 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2387/4764] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:25:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:25:39.081330 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b286f4-3d12-4e0c-8ccc-ef6b9c46056b None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:39.082965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b9b286f4-3d12-4e0c-8ccc-ef6b9c46056b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:39.142301 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1236515e-f69d-4325-8788-1be4cd58f120 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:39.159247 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12471db-e036-48ab-b1a1-c85ba859ff88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:39.160101 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12471db-e036-48ab-b1a1-c85ba859ff88 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:39.160385 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12471db-e036-48ab-b1a1-c85ba859ff88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:39.160659 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12471db-e036-48ab-b1a1-c85ba859ff88 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:39.163239 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12471db-e036-48ab-b1a1-c85ba859ff88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:39.163872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12471db-e036-48ab-b1a1-c85ba859ff88 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:39.228225 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b286f4-3d12-4e0c-8ccc-ef6b9c46056b None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:39.320784 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2378/4765] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:25:38 2022] POST /identity/v3/users => generated 291 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:25:39.325267 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12471db-e036-48ab-b1a1-c85ba859ff88 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:39.352963 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58512d10-a119-4656-8bc4-b513c120920f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:39.354148 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58512d10-a119-4656-8bc4-b513c120920f service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:39.361817 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58512d10-a119-4656-8bc4-b513c120920f service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:39.361817 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58512d10-a119-4656-8bc4-b513c120920f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:39.364398 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12471db-e036-48ab-b1a1-c85ba859ff88 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:39.381156 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795ad95-8bcc-4228-98da-6ecaa288ae46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:39.388721 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795ad95-8bcc-4228-98da-6ecaa288ae46 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:39.394879 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795ad95-8bcc-4228-98da-6ecaa288ae46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:39.398674 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795ad95-8bcc-4228-98da-6ecaa288ae46 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:39.398674 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795ad95-8bcc-4228-98da-6ecaa288ae46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:39.398674 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795ad95-8bcc-4228-98da-6ecaa288ae46 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:39.432370 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2379/4766] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:25:39.446392 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795ad95-8bcc-4228-98da-6ecaa288ae46 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:39.454649 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58512d10-a119-4656-8bc4-b513c120920f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:39.465099 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58512d10-a119-4656-8bc4-b513c120920f service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:39.481227 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795ad95-8bcc-4228-98da-6ecaa288ae46 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:39.481834 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2388/4767] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:25:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:25:39.493639 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c39112-665f-4a62-8a4a-3a5555469dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:39.500121 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c39112-665f-4a62-8a4a-3a5555469dbf admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:39.500427 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c39112-665f-4a62-8a4a-3a5555469dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:39.500716 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c39112-665f-4a62-8a4a-3a5555469dbf admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:39.501506 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c39112-665f-4a62-8a4a-3a5555469dbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:39.505939 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c39112-665f-4a62-8a4a-3a5555469dbf admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:39.535691 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2380/4768] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:25:39.537263 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58512d10-a119-4656-8bc4-b513c120920f service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:39.550442 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58512d10-a119-4656-8bc4-b513c120920f service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:39.556470 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb431e0-34c9-420e-93ce-4c5ad5be5ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:39.557631 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb431e0-34c9-420e-93ce-4c5ad5be5ce9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:39.558162 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb431e0-34c9-420e-93ce-4c5ad5be5ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:39.558670 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb431e0-34c9-420e-93ce-4c5ad5be5ce9 admin admin] PATH_INFO: `/v3/projects/94aa84ddeec0413db1187e6881082e3c/users/bb6303ae6ec0410e869e65bd830512b8/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:39.591493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb431e0-34c9-420e-93ce-4c5ad5be5ce9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94aa84ddeec0413db1187e6881082e3c, user_id=bb6303ae6ec0410e869e65bd830512b8, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:39.594483 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb431e0-34c9-420e-93ce-4c5ad5be5ce9 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:39.697923 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2389/4769] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:25:39 2022] PUT /identity/v3/projects/94aa84ddeec0413db1187e6881082e3c/users/bb6303ae6ec0410e869e65bd830512b8/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:39.704900 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f35ac4-6f7e-484b-981e-6bd0f610ff31 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:39.705607 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f35ac4-6f7e-484b-981e-6bd0f610ff31 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:39.705607 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f35ac4-6f7e-484b-981e-6bd0f610ff31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:39.777588 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-70f35ac4-6f7e-484b-981e-6bd0f610ff31 None None] MFA Rules not processed for user `bb6303ae6ec0410e869e65bd830512b8`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:39.780189 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-70f35ac4-6f7e-484b-981e-6bd0f610ff31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:39.973746 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb431e0-34c9-420e-93ce-4c5ad5be5ce9 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:39.975336 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2381/4770] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:25:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:25:40.168091 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb431e0-34c9-420e-93ce-4c5ad5be5ce9 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:40.186819 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743edfb0-7b0d-4052-b3a5-d04226d0a153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:40.188381 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743edfb0-7b0d-4052-b3a5-d04226d0a153 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:40.191983 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743edfb0-7b0d-4052-b3a5-d04226d0a153 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:40.199423 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743edfb0-7b0d-4052-b3a5-d04226d0a153 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:40.199423 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743edfb0-7b0d-4052-b3a5-d04226d0a153 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:40.199423 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743edfb0-7b0d-4052-b3a5-d04226d0a153 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:40.324779 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f35ac4-6f7e-484b-981e-6bd0f610ff31 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:40.338595 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2390/4771] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:25:39 2022] POST /identity/v3/projects => generated 381 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:25:40.344047 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f35ac4-6f7e-484b-981e-6bd0f610ff31 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:40.474565 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264953dd-b346-4a5d-bc03-02609f75c2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:40.475522 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264953dd-b346-4a5d-bc03-02609f75c2f2 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:40.476158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264953dd-b346-4a5d-bc03-02609f75c2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:40.477219 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264953dd-b346-4a5d-bc03-02609f75c2f2 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:40.478271 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264953dd-b346-4a5d-bc03-02609f75c2f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:40.484915 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264953dd-b346-4a5d-bc03-02609f75c2f2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:40.612178 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2382/4772] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:25:40 2022] POST /identity/v3/users => generated 291 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:25:40.626061 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743edfb0-7b0d-4052-b3a5-d04226d0a153 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:40.723776 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743edfb0-7b0d-4052-b3a5-d04226d0a153 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:40.756183 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2956a-eaee-4a9e-86c8-9e0aa53abb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:40.759869 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2956a-eaee-4a9e-86c8-9e0aa53abb9a admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:40.761745 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2956a-eaee-4a9e-86c8-9e0aa53abb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:40.765005 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2956a-eaee-4a9e-86c8-9e0aa53abb9a admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:40.765005 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2956a-eaee-4a9e-86c8-9e0aa53abb9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:40.765005 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2956a-eaee-4a9e-86c8-9e0aa53abb9a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:40.860873 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2391/4773] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:25:40.893988 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264953dd-b346-4a5d-bc03-02609f75c2f2 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:40.910900 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264953dd-b346-4a5d-bc03-02609f75c2f2 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:40.930123 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eddcf3e-170e-4c56-b0d4-5e187017a365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:40.930822 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eddcf3e-170e-4c56-b0d4-5e187017a365 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:40.931396 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eddcf3e-170e-4c56-b0d4-5e187017a365 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:40.931396 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eddcf3e-170e-4c56-b0d4-5e187017a365 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:40.932097 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eddcf3e-170e-4c56-b0d4-5e187017a365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:40.935768 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eddcf3e-170e-4c56-b0d4-5e187017a365 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:40.965590 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2383/4774] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:25:40.966868 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2956a-eaee-4a9e-86c8-9e0aa53abb9a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:40.982033 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2956a-eaee-4a9e-86c8-9e0aa53abb9a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:41.004123 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b0a4f2-4264-49eb-beeb-e956a7380445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:41.006210 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0a4f2-4264-49eb-beeb-e956a7380445 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:41.006210 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0a4f2-4264-49eb-beeb-e956a7380445 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:41.006210 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0a4f2-4264-49eb-beeb-e956a7380445 admin admin] PATH_INFO: `/v3/projects/b56362be1259483799592da6bae0dcb4/users/263157056fae43ce98e5165dd2562f37/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:41.042464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b0a4f2-4264-49eb-beeb-e956a7380445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b56362be1259483799592da6bae0dcb4, user_id=263157056fae43ce98e5165dd2562f37, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:41.048245 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b0a4f2-4264-49eb-beeb-e956a7380445 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:41.201917 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2392/4775] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:25:40 2022] PUT /identity/v3/projects/b56362be1259483799592da6bae0dcb4/users/263157056fae43ce98e5165dd2562f37/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:25:41.207732 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083443d6-5404-48c8-8c02-b9f102ddbe69 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:41.212431 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083443d6-5404-48c8-8c02-b9f102ddbe69 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:41.212431 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083443d6-5404-48c8-8c02-b9f102ddbe69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:41.286459 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-083443d6-5404-48c8-8c02-b9f102ddbe69 None None] MFA Rules not processed for user `263157056fae43ce98e5165dd2562f37`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:41.287587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-083443d6-5404-48c8-8c02-b9f102ddbe69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:41.505451 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2384/4776] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:25:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:25:41.506705 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b0a4f2-4264-49eb-beeb-e956a7380445 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:41.646749 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b0a4f2-4264-49eb-beeb-e956a7380445 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:41.657642 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642b901-fd35-42e8-a926-92c181f1aee9 tempest-IdentityV3ProjectsTest-1631926286 tempest-IdentityV3ProjectsTest-1631926286-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb6303ae6ec0410e869e65bd830512b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94aa84ddeec0413db1187e6881082e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:41.658713 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642b901-fd35-42e8-a926-92c181f1aee9 tempest-IdentityV3ProjectsTest-1631926286 tempest-IdentityV3ProjectsTest-1631926286-project] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:41.659221 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642b901-fd35-42e8-a926-92c181f1aee9 tempest-IdentityV3ProjectsTest-1631926286 tempest-IdentityV3ProjectsTest-1631926286-project] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:41.659604 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642b901-fd35-42e8-a926-92c181f1aee9 tempest-IdentityV3ProjectsTest-1631926286 tempest-IdentityV3ProjectsTest-1631926286-project] PATH_INFO: `/v3/users/bb6303ae6ec0410e869e65bd830512b8/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:41.668761 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8642b901-fd35-42e8-a926-92c181f1aee9 tempest-IdentityV3ProjectsTest-1631926286 tempest-IdentityV3ProjectsTest-1631926286-project] RBAC: Authorizing `identity:list_user_projects(user_id=bb6303ae6ec0410e869e65bd830512b8)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:41.677933 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8642b901-fd35-42e8-a926-92c181f1aee9 tempest-IdentityV3ProjectsTest-1631926286 tempest-IdentityV3ProjectsTest-1631926286-project] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:41.851206 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2393/4777] 10.222.0.23 () {58 vars in 1247 bytes} [Sat Apr 30 21:25:41 2022] GET /identity/v3/users/bb6303ae6ec0410e869e65bd830512b8/projects => generated 517 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:25:41.854202 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09090614-f5c2-440f-a848-90d044ffa89c None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:41.854690 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09090614-f5c2-440f-a848-90d044ffa89c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:41.855180 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09090614-f5c2-440f-a848-90d044ffa89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:41.923635 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-09090614-f5c2-440f-a848-90d044ffa89c None None] MFA Rules not processed for user `bb6303ae6ec0410e869e65bd830512b8`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:41.925787 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-09090614-f5c2-440f-a848-90d044ffa89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:41.946672 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2385/4778] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:25:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:25:41.951656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26229f-0188-416e-9d45-faed213e5b92 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:41.952128 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26229f-0188-416e-9d45-faed213e5b92 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:41.952644 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26229f-0188-416e-9d45-faed213e5b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:41.989128 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-0f26229f-0188-416e-9d45-faed213e5b92 None None] MFA Rules not processed for user `bb6303ae6ec0410e869e65bd830512b8`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:41.990758 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0f26229f-0188-416e-9d45-faed213e5b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:42.102587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.models.token_model [None req-0f26229f-0188-416e-9d45-faed213e5b92 None None] User bb6303ae6ec0410e869e65bd830512b8 has no access to project b56362be1259483799592da6bae0dcb4 {{(pid=91017) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Apr 30 21:25:42.107265 ncdv-master-1 devstack@keystone.service[91017]: WARNING keystone.server.flask.application [None req-0f26229f-0188-416e-9d45-faed213e5b92 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.23: keystone.exception.Unauthorized: The request you have made requires authentication. Apr 30 21:25:42.108799 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2394/4779] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:25:41 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 159 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Apr 30 21:25:42.116263 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09090614-f5c2-440f-a848-90d044ffa89c None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:42.270974 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09090614-f5c2-440f-a848-90d044ffa89c None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:42.288812 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d617e99-2c01-4054-8b78-5f22f951df3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:42.289988 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d617e99-2c01-4054-8b78-5f22f951df3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:42.290369 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d617e99-2c01-4054-8b78-5f22f951df3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:42.290744 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d617e99-2c01-4054-8b78-5f22f951df3a admin admin] PATH_INFO: `/v3/users/bb6303ae6ec0410e869e65bd830512b8` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:42.295757 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d617e99-2c01-4054-8b78-5f22f951df3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb6303ae6ec0410e869e65bd830512b8)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:42.307001 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d617e99-2c01-4054-8b78-5f22f951df3a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:42.606914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5d617e99-2c01-4054-8b78-5f22f951df3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb6303ae6ec0410e869e65bd830512b8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:42.653517 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5d617e99-2c01-4054-8b78-5f22f951df3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb6303ae6ec0410e869e65bd830512b8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:42.759770 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5d617e99-2c01-4054-8b78-5f22f951df3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb6303ae6ec0410e869e65bd830512b8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:42.772603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5d617e99-2c01-4054-8b78-5f22f951df3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb6303ae6ec0410e869e65bd830512b8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:42.774756 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5d617e99-2c01-4054-8b78-5f22f951df3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb6303ae6ec0410e869e65bd830512b8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:42.806468 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2386/4780] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:25:42 2022] DELETE /identity/v3/users/bb6303ae6ec0410e869e65bd830512b8 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:42.806669 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5d0b1-801a-414c-b086-be53fdf1cebb None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:42.806669 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5d0b1-801a-414c-b086-be53fdf1cebb None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:42.806669 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5d0b1-801a-414c-b086-be53fdf1cebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:42.859555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-fdc5d0b1-801a-414c-b086-be53fdf1cebb None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:42.861201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-fdc5d0b1-801a-414c-b086-be53fdf1cebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:43.019303 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2395/4781] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:25:43.053069 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d617e99-2c01-4054-8b78-5f22f951df3a admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:43.054584 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5d617e99-2c01-4054-8b78-5f22f951df3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:43.249529 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d617e99-2c01-4054-8b78-5f22f951df3a admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:43.257496 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb704bd8-b619-43fe-ad5e-31ee8ae7651e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:43.258321 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb704bd8-b619-43fe-ad5e-31ee8ae7651e service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:43.260155 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb704bd8-b619-43fe-ad5e-31ee8ae7651e service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:43.260559 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb704bd8-b619-43fe-ad5e-31ee8ae7651e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:43.276503 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb704bd8-b619-43fe-ad5e-31ee8ae7651e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:43.278365 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb704bd8-b619-43fe-ad5e-31ee8ae7651e service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:43.297518 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2387/4782] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:25:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:25:44.275618 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5d0b1-801a-414c-b086-be53fdf1cebb None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:44.277799 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-fdc5d0b1-801a-414c-b086-be53fdf1cebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:44.314291 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5d0b1-801a-414c-b086-be53fdf1cebb None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:44.329186 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9e7d4-9713-471e-a74a-76ea58f02653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:44.330770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9e7d4-9713-471e-a74a-76ea58f02653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:44.336096 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9e7d4-9713-471e-a74a-76ea58f02653 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:44.336096 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9e7d4-9713-471e-a74a-76ea58f02653 admin admin] PATH_INFO: `/v3/projects/94aa84ddeec0413db1187e6881082e3c` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:44.336096 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9e7d4-9713-471e-a74a-76ea58f02653 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94aa84ddeec0413db1187e6881082e3c)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:44.339567 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9e7d4-9713-471e-a74a-76ea58f02653 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:44.561596 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-91d9e7d4-9713-471e-a74a-76ea58f02653 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94aa84ddeec0413db1187e6881082e3c', 'request_id': 'req-91d9e7d4-9713-471e-a74a-76ea58f02653'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:44.589427 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-91d9e7d4-9713-471e-a74a-76ea58f02653 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94aa84ddeec0413db1187e6881082e3c', 'request_id': 'req-91d9e7d4-9713-471e-a74a-76ea58f02653'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:44.608048 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-91d9e7d4-9713-471e-a74a-76ea58f02653 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94aa84ddeec0413db1187e6881082e3c', 'request_id': 'req-91d9e7d4-9713-471e-a74a-76ea58f02653'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:44.742663 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-91d9e7d4-9713-471e-a74a-76ea58f02653 admin admin] The token cache is being invalidate because project 94aa84ddeec0413db1187e6881082e3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:25:44.743348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-91d9e7d4-9713-471e-a74a-76ea58f02653 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:44.744281 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-91d9e7d4-9713-471e-a74a-76ea58f02653 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:44.762734 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2396/4783] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:25:44 2022] DELETE /identity/v3/projects/94aa84ddeec0413db1187e6881082e3c => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:44.766825 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb704bd8-b619-43fe-ad5e-31ee8ae7651e service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:44.776790 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb704bd8-b619-43fe-ad5e-31ee8ae7651e service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:44.928799 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91310336-cbc6-4799-8d20-a6dc5874d561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:44.929994 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91310336-cbc6-4799-8d20-a6dc5874d561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:44.930452 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91310336-cbc6-4799-8d20-a6dc5874d561 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:44.930913 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91310336-cbc6-4799-8d20-a6dc5874d561 admin admin] PATH_INFO: `/v3/users/263157056fae43ce98e5165dd2562f37` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:44.933690 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91310336-cbc6-4799-8d20-a6dc5874d561 admin admin] RBAC: Authorizing `identity:delete_user(user_id=263157056fae43ce98e5165dd2562f37)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:44.939994 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91310336-cbc6-4799-8d20-a6dc5874d561 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:45.197993 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-91310336-cbc6-4799-8d20-a6dc5874d561 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '263157056fae43ce98e5165dd2562f37'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:45.254569 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-91310336-cbc6-4799-8d20-a6dc5874d561 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '263157056fae43ce98e5165dd2562f37'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:45.383032 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-91310336-cbc6-4799-8d20-a6dc5874d561 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '263157056fae43ce98e5165dd2562f37'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:45.397399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-91310336-cbc6-4799-8d20-a6dc5874d561 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '263157056fae43ce98e5165dd2562f37'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:45.398794 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-91310336-cbc6-4799-8d20-a6dc5874d561 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '263157056fae43ce98e5165dd2562f37'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:45.418305 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2388/4784] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:25:44 2022] DELETE /identity/v3/users/263157056fae43ce98e5165dd2562f37 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:46.703748 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9e7d4-9713-471e-a74a-76ea58f02653 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:46.707391 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-91d9e7d4-9713-471e-a74a-76ea58f02653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:46.729519 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9e7d4-9713-471e-a74a-76ea58f02653 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:46.754796 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7573fe4-b596-4585-8966-a30bdbfabac1 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:46.755705 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7573fe4-b596-4585-8966-a30bdbfabac1 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:46.756003 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7573fe4-b596-4585-8966-a30bdbfabac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:46.831598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-b7573fe4-b596-4585-8966-a30bdbfabac1 None None] MFA Rules not processed for user `9cc9b55d852942538c3ad8f317dcd73e`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:46.839699 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b7573fe4-b596-4585-8966-a30bdbfabac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:46.869149 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b588a17c-692c-4f73-ab31-1b36d8358299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:46.871039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588a17c-692c-4f73-ab31-1b36d8358299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:46.876274 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588a17c-692c-4f73-ab31-1b36d8358299 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:46.876562 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588a17c-692c-4f73-ab31-1b36d8358299 admin admin] PATH_INFO: `/v3/projects/b56362be1259483799592da6bae0dcb4` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:46.895779 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b588a17c-692c-4f73-ab31-1b36d8358299 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b56362be1259483799592da6bae0dcb4)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:46.908613 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b588a17c-692c-4f73-ab31-1b36d8358299 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:47.027706 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2389/4785] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:25:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:25:47.113615 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b588a17c-692c-4f73-ab31-1b36d8358299 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b56362be1259483799592da6bae0dcb4', 'request_id': 'req-b588a17c-692c-4f73-ab31-1b36d8358299'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:47.126295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b588a17c-692c-4f73-ab31-1b36d8358299 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b56362be1259483799592da6bae0dcb4', 'request_id': 'req-b588a17c-692c-4f73-ab31-1b36d8358299'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:47.137210 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b588a17c-692c-4f73-ab31-1b36d8358299 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b56362be1259483799592da6bae0dcb4', 'request_id': 'req-b588a17c-692c-4f73-ab31-1b36d8358299'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:47.251404 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b588a17c-692c-4f73-ab31-1b36d8358299 admin admin] The token cache is being invalidate because project b56362be1259483799592da6bae0dcb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:25:47.252025 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b588a17c-692c-4f73-ab31-1b36d8358299 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:47.253085 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b588a17c-692c-4f73-ab31-1b36d8358299 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:47.255121 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2397/4786] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:25:46 2022] DELETE /identity/v3/projects/b56362be1259483799592da6bae0dcb4 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:47.261827 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602753cc-bd51-413b-b0ff-00886b7be5a4 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:47.262941 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602753cc-bd51-413b-b0ff-00886b7be5a4 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:47.264469 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602753cc-bd51-413b-b0ff-00886b7be5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:47.310477 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-602753cc-bd51-413b-b0ff-00886b7be5a4 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:47.312504 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-602753cc-bd51-413b-b0ff-00886b7be5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:47.398335 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69eee1-ed8f-4230-bde2-046552500ba9 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:47.400192 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69eee1-ed8f-4230-bde2-046552500ba9 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:47.400709 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69eee1-ed8f-4230-bde2-046552500ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:47.444979 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-5f69eee1-ed8f-4230-bde2-046552500ba9 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:47.446512 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5f69eee1-ed8f-4230-bde2-046552500ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:47.480856 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2390/4787] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:25:47.492229 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba88d18-71e0-4368-b2ae-deb5c48dee2e None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:47.492229 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba88d18-71e0-4368-b2ae-deb5c48dee2e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:47.492229 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba88d18-71e0-4368-b2ae-deb5c48dee2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:47.532895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-cba88d18-71e0-4368-b2ae-deb5c48dee2e None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:47.534348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-cba88d18-71e0-4368-b2ae-deb5c48dee2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:47.550682 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2398/4788] 10.222.0.23 () {58 vars in 967 bytes} [Sat Apr 30 21:25:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:25:47.561248 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2391/4789] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:25:47.566837 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69eee1-ed8f-4230-bde2-046552500ba9 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:47.585958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba88d18-71e0-4368-b2ae-deb5c48dee2e None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:47.586835 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f69eee1-ed8f-4230-bde2-046552500ba9 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:47.587570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-cba88d18-71e0-4368-b2ae-deb5c48dee2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:47.597245 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a69a9d-a22c-4a49-94c1-1922dcc73bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:47.598002 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a69a9d-a22c-4a49-94c1-1922dcc73bdb admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:47.598360 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a69a9d-a22c-4a49-94c1-1922dcc73bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:47.598869 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a69a9d-a22c-4a49-94c1-1922dcc73bdb admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:47.599697 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a69a9d-a22c-4a49-94c1-1922dcc73bdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:25:47.600076 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a69a9d-a22c-4a49-94c1-1922dcc73bdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:47.602058 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a69a9d-a22c-4a49-94c1-1922dcc73bdb admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:47.627103 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2399/4790] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:25:47.631262 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a69a9d-a22c-4a49-94c1-1922dcc73bdb admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:47.650036 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a69a9d-a22c-4a49-94c1-1922dcc73bdb admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:47.665146 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb52f87-52f1-479e-a311-61c791e2acb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:47.666167 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb52f87-52f1-479e-a311-61c791e2acb4 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:47.666564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb52f87-52f1-479e-a311-61c791e2acb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:47.666944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb52f87-52f1-479e-a311-61c791e2acb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:47.667750 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb52f87-52f1-479e-a311-61c791e2acb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:47.671780 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb52f87-52f1-479e-a311-61c791e2acb4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:47.716588 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba88d18-71e0-4368-b2ae-deb5c48dee2e None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:47.723011 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c9263a-7184-4eab-a448-9283feaed37e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:47.723683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9263a-7184-4eab-a448-9283feaed37e service swift] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:47.723965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9263a-7184-4eab-a448-9283feaed37e service swift] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:47.724241 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9263a-7184-4eab-a448-9283feaed37e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:47.735173 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c9263a-7184-4eab-a448-9283feaed37e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:47.737258 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c9263a-7184-4eab-a448-9283feaed37e service swift] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:47.752482 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2392/4791] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:25:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 30 21:25:47.761191 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2400/4792] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:25:47 2022] POST /identity/v3/projects => generated 387 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:25:47.768223 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c9263a-7184-4eab-a448-9283feaed37e service swift] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:47.789629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c9263a-7184-4eab-a448-9283feaed37e service swift] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:47.898354 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc0511-efb6-4ca3-a00d-d66623b4a4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:47.899312 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc0511-efb6-4ca3-a00d-d66623b4a4a4 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:47.899679 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc0511-efb6-4ca3-a00d-d66623b4a4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:47.900075 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc0511-efb6-4ca3-a00d-d66623b4a4a4 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:47.900843 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc0511-efb6-4ca3-a00d-d66623b4a4a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:47.902880 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc0511-efb6-4ca3-a00d-d66623b4a4a4 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:48.011849 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2393/4793] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:25:47 2022] POST /identity/v3/users => generated 300 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:25:48.016612 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb52f87-52f1-479e-a311-61c791e2acb4 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:48.036282 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb52f87-52f1-479e-a311-61c791e2acb4 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:48.049429 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705261af-476d-4556-bae6-9a094f516635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:48.051696 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705261af-476d-4556-bae6-9a094f516635 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:48.052262 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705261af-476d-4556-bae6-9a094f516635 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:48.052763 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705261af-476d-4556-bae6-9a094f516635 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:48.053741 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705261af-476d-4556-bae6-9a094f516635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:48.064482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705261af-476d-4556-bae6-9a094f516635 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:48.084445 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2401/4794] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:25:48.085174 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc0511-efb6-4ca3-a00d-d66623b4a4a4 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:48.100418 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc0511-efb6-4ca3-a00d-d66623b4a4a4 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:48.105871 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e09f2-3c49-45d9-9c82-fb90e9f286fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:48.106748 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e09f2-3c49-45d9-9c82-fb90e9f286fe admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:48.107040 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e09f2-3c49-45d9-9c82-fb90e9f286fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:48.107326 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e09f2-3c49-45d9-9c82-fb90e9f286fe admin admin] PATH_INFO: `/v3/projects/932f682f33ce4292bd1d8f0dcc140812/users/1a04ad6273e743ebb27b033a645e04b9/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:48.126860 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880e09f2-3c49-45d9-9c82-fb90e9f286fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=932f682f33ce4292bd1d8f0dcc140812, user_id=1a04ad6273e743ebb27b033a645e04b9, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:48.143061 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880e09f2-3c49-45d9-9c82-fb90e9f286fe admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:48.246201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705261af-476d-4556-bae6-9a094f516635 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:48.254087 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2394/4795] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:25:48 2022] PUT /identity/v3/projects/932f682f33ce4292bd1d8f0dcc140812/users/1a04ad6273e743ebb27b033a645e04b9/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:48.262574 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705261af-476d-4556-bae6-9a094f516635 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:48.373484 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec6586-ec2d-414c-a034-5a4bb41fb1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:48.376219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec6586-ec2d-414c-a034-5a4bb41fb1c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:48.377569 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec6586-ec2d-414c-a034-5a4bb41fb1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:48.377569 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec6586-ec2d-414c-a034-5a4bb41fb1c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:48.379493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec6586-ec2d-414c-a034-5a4bb41fb1c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:48.386079 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec6586-ec2d-414c-a034-5a4bb41fb1c5 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:48.406616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e09f2-3c49-45d9-9c82-fb90e9f286fe admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:48.412759 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2402/4796] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:25:48.420442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e09f2-3c49-45d9-9c82-fb90e9f286fe admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:48.437485 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd7091-236b-4959-ab7f-f89bfca8414d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:48.443594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd7091-236b-4959-ab7f-f89bfca8414d admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:48.443594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd7091-236b-4959-ab7f-f89bfca8414d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:48.444103 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd7091-236b-4959-ab7f-f89bfca8414d admin admin] PATH_INFO: `/v3/projects/932f682f33ce4292bd1d8f0dcc140812/users/1a04ad6273e743ebb27b033a645e04b9/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:48.446845 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd7091-236b-4959-ab7f-f89bfca8414d admin admin] RBAC: Authorizing `identity:create_grant(project_id=932f682f33ce4292bd1d8f0dcc140812, user_id=1a04ad6273e743ebb27b033a645e04b9, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:48.462652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd7091-236b-4959-ab7f-f89bfca8414d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:48.478901 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2395/4797] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:25:48 2022] PUT /identity/v3/projects/932f682f33ce4292bd1d8f0dcc140812/users/1a04ad6273e743ebb27b033a645e04b9/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:48.491572 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79663e-ea96-43e3-981e-4f93b102f849 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:48.492258 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79663e-ea96-43e3-981e-4f93b102f849 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:48.492694 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79663e-ea96-43e3-981e-4f93b102f849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:48.543000 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-ee79663e-ea96-43e3-981e-4f93b102f849 None None] MFA Rules not processed for user `1a04ad6273e743ebb27b033a645e04b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:48.544441 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ee79663e-ea96-43e3-981e-4f93b102f849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:48.651254 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd7091-236b-4959-ab7f-f89bfca8414d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:48.654427 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2403/4798] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:25:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:25:48.789351 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd7091-236b-4959-ab7f-f89bfca8414d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:48.801321 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61f26d-7774-4ffa-adb7-557801c541ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:48.802890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61f26d-7774-4ffa-adb7-557801c541ba admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:48.803230 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61f26d-7774-4ffa-adb7-557801c541ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:48.803683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61f26d-7774-4ffa-adb7-557801c541ba admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:48.804556 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f61f26d-7774-4ffa-adb7-557801c541ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:48.806895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f61f26d-7774-4ffa-adb7-557801c541ba admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:48.892167 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2396/4799] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:25:48 2022] POST /identity/v3/projects => generated 387 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:25:48.900541 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79663e-ea96-43e3-981e-4f93b102f849 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:48.922121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79663e-ea96-43e3-981e-4f93b102f849 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:49.030374 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcce3d6-152e-4042-8415-0717a089270f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:49.030620 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcce3d6-152e-4042-8415-0717a089270f admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:49.030866 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcce3d6-152e-4042-8415-0717a089270f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:49.031118 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcce3d6-152e-4042-8415-0717a089270f admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:49.031769 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcce3d6-152e-4042-8415-0717a089270f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:49.035210 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcce3d6-152e-4042-8415-0717a089270f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:49.150395 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2404/4800] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:25:48 2022] POST /identity/v3/users => generated 294 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:25:49.151225 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61f26d-7774-4ffa-adb7-557801c541ba admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:49.163902 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61f26d-7774-4ffa-adb7-557801c541ba admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:49.172496 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2bcbc2-8df0-49da-af7b-29ba8e7c8c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:49.173193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2bcbc2-8df0-49da-af7b-29ba8e7c8c78 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:49.173499 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2bcbc2-8df0-49da-af7b-29ba8e7c8c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:49.173875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2bcbc2-8df0-49da-af7b-29ba8e7c8c78 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:49.174697 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2bcbc2-8df0-49da-af7b-29ba8e7c8c78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:49.176557 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2bcbc2-8df0-49da-af7b-29ba8e7c8c78 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:49.198254 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2397/4801] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:25:49.200193 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcce3d6-152e-4042-8415-0717a089270f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:49.215005 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcce3d6-152e-4042-8415-0717a089270f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:49.221142 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb10eb-d3c4-4a37-8c6b-a028508824f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:49.221869 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb10eb-d3c4-4a37-8c6b-a028508824f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:49.228179 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb10eb-d3c4-4a37-8c6b-a028508824f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:49.228179 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb10eb-d3c4-4a37-8c6b-a028508824f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:49.228179 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb10eb-d3c4-4a37-8c6b-a028508824f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:49.228179 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb10eb-d3c4-4a37-8c6b-a028508824f8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:49.240703 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2405/4802] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:25:49.242155 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2bcbc2-8df0-49da-af7b-29ba8e7c8c78 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:49.258227 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2bcbc2-8df0-49da-af7b-29ba8e7c8c78 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:49.265383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05683be-5fae-4345-831d-712d807e11a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:49.266385 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05683be-5fae-4345-831d-712d807e11a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:49.266671 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05683be-5fae-4345-831d-712d807e11a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:49.266964 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05683be-5fae-4345-831d-712d807e11a6 admin admin] PATH_INFO: `/v3/projects/da76701f84a84461b052d50b307a323c/users/4ba10798906a4672993b244945722ad5/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:49.325395 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05683be-5fae-4345-831d-712d807e11a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da76701f84a84461b052d50b307a323c, user_id=4ba10798906a4672993b244945722ad5, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:49.330435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05683be-5fae-4345-831d-712d807e11a6 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:49.415706 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2398/4803] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:25:49 2022] PUT /identity/v3/projects/da76701f84a84461b052d50b307a323c/users/4ba10798906a4672993b244945722ad5/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:49.426433 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb2896-f1b6-4f75-80d5-1c979902a89e None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:49.426733 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb2896-f1b6-4f75-80d5-1c979902a89e None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:49.427025 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb2896-f1b6-4f75-80d5-1c979902a89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:49.461581 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-86cb2896-f1b6-4f75-80d5-1c979902a89e None None] MFA Rules not processed for user `4ba10798906a4672993b244945722ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:49.463270 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-86cb2896-f1b6-4f75-80d5-1c979902a89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:49.689160 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2406/4804] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:25:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:25:49.702942 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05683be-5fae-4345-831d-712d807e11a6 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:49.705654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c05683be-5fae-4345-831d-712d807e11a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:49.790086 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05683be-5fae-4345-831d-712d807e11a6 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:49.796921 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e51ce-45d1-4ecc-8cfb-bbe710dfd574 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e302b1298dd04d6590e3d079f7b13b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:49.797713 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e51ce-45d1-4ecc-8cfb-bbe710dfd574 service glance] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:49.798140 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e51ce-45d1-4ecc-8cfb-bbe710dfd574 service glance] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:49.799942 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e51ce-45d1-4ecc-8cfb-bbe710dfd574 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:49.875794 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e51ce-45d1-4ecc-8cfb-bbe710dfd574 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:49.877299 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e51ce-45d1-4ecc-8cfb-bbe710dfd574 service glance] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:49.887743 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2399/4805] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:25:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:25:49.943595 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f311b09-69c6-488a-8ea7-18fb4e1f886a None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:49.944086 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f311b09-69c6-488a-8ea7-18fb4e1f886a None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:49.944206 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f311b09-69c6-488a-8ea7-18fb4e1f886a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:49.962798 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-3f311b09-69c6-488a-8ea7-18fb4e1f886a None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:49.964673 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3f311b09-69c6-488a-8ea7-18fb4e1f886a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:50.023238 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2407/4806] 10.222.0.23 () {58 vars in 967 bytes} [Sat Apr 30 21:25:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:25:50.041681 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e51ce-45d1-4ecc-8cfb-bbe710dfd574 service glance] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:50.118148 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e51ce-45d1-4ecc-8cfb-bbe710dfd574 service glance] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:50.124319 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94066fdc-f20d-49aa-b4e9-7ca29186e399 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:50.124784 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94066fdc-f20d-49aa-b4e9-7ca29186e399 service swift] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:50.125073 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94066fdc-f20d-49aa-b4e9-7ca29186e399 service swift] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:50.125533 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94066fdc-f20d-49aa-b4e9-7ca29186e399 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:50.136377 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94066fdc-f20d-49aa-b4e9-7ca29186e399 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:50.138022 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94066fdc-f20d-49aa-b4e9-7ca29186e399 service swift] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:50.146770 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2400/4807] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:25:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:25:50.517283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f311b09-69c6-488a-8ea7-18fb4e1f886a None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:50.519759 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3f311b09-69c6-488a-8ea7-18fb4e1f886a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:50.687897 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f311b09-69c6-488a-8ea7-18fb4e1f886a None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:50.696067 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7a11b-8a79-462d-b7e4-c98264bc74c7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:50.696806 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7a11b-8a79-462d-b7e4-c98264bc74c7 service placement] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:50.697090 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7a11b-8a79-462d-b7e4-c98264bc74c7 service placement] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:50.697420 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7a11b-8a79-462d-b7e4-c98264bc74c7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:50.707058 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6ca7a11b-8a79-462d-b7e4-c98264bc74c7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:50.729281 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7a11b-8a79-462d-b7e4-c98264bc74c7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:50.734123 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca7a11b-8a79-462d-b7e4-c98264bc74c7 service placement] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:50.798605 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2408/4808] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:25:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:25:51.939527 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0cea26-d0db-4fb4-a007-7a0b0ba99d3d None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:51.940044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0cea26-d0db-4fb4-a007-7a0b0ba99d3d None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:51.940130 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0cea26-d0db-4fb4-a007-7a0b0ba99d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:51.997374 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-ac0cea26-d0db-4fb4-a007-7a0b0ba99d3d None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:51.998677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ac0cea26-d0db-4fb4-a007-7a0b0ba99d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:52.015179 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2401/4809] 10.222.0.23 () {58 vars in 967 bytes} [Sat Apr 30 21:25:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:25:52.025403 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7a11b-8a79-462d-b7e4-c98264bc74c7 service placement] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:52.048387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7a11b-8a79-462d-b7e4-c98264bc74c7 service placement] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:52.060679 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30556577-7465-473f-af6b-c1b6c1c6c3e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:52.061466 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30556577-7465-473f-af6b-c1b6c1c6c3e3 service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:52.061785 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30556577-7465-473f-af6b-c1b6c1c6c3e3 service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:52.062071 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30556577-7465-473f-af6b-c1b6c1c6c3e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:52.073898 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30556577-7465-473f-af6b-c1b6c1c6c3e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:52.075722 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30556577-7465-473f-af6b-c1b6c1c6c3e3 service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:52.086543 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2409/4810] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:25:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:25:54.306928 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0cea26-d0db-4fb4-a007-7a0b0ba99d3d None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:54.308523 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ac0cea26-d0db-4fb4-a007-7a0b0ba99d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:54.410206 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0cea26-d0db-4fb4-a007-7a0b0ba99d3d None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:54.414785 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283d39c-aa20-4cf6-ae10-4e5945b39b86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:54.415890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283d39c-aa20-4cf6-ae10-4e5945b39b86 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:54.416373 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283d39c-aa20-4cf6-ae10-4e5945b39b86 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:54.416878 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283d39c-aa20-4cf6-ae10-4e5945b39b86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:54.418973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0283d39c-aa20-4cf6-ae10-4e5945b39b86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:54.431534 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0283d39c-aa20-4cf6-ae10-4e5945b39b86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:54.433716 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0283d39c-aa20-4cf6-ae10-4e5945b39b86 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:54.443332 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2402/4811] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:25:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:25:54.492731 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30556577-7465-473f-af6b-c1b6c1c6c3e3 service swift] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:54.583786 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30556577-7465-473f-af6b-c1b6c1c6c3e3 service swift] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:54.589883 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf357fe-4723-4885-a2f3-f8b444624327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:54.591171 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf357fe-4723-4885-a2f3-f8b444624327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:54.591719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf357fe-4723-4885-a2f3-f8b444624327 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:54.592298 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf357fe-4723-4885-a2f3-f8b444624327 admin admin] PATH_INFO: `/v3/users/1a04ad6273e743ebb27b033a645e04b9` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:54.595603 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf357fe-4723-4885-a2f3-f8b444624327 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a04ad6273e743ebb27b033a645e04b9)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:54.598863 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf357fe-4723-4885-a2f3-f8b444624327 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:54.836709 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7bf357fe-4723-4885-a2f3-f8b444624327 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a04ad6273e743ebb27b033a645e04b9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:54.850809 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7bf357fe-4723-4885-a2f3-f8b444624327 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a04ad6273e743ebb27b033a645e04b9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:54.947470 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7bf357fe-4723-4885-a2f3-f8b444624327 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a04ad6273e743ebb27b033a645e04b9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:54.948506 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7bf357fe-4723-4885-a2f3-f8b444624327 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a04ad6273e743ebb27b033a645e04b9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:54.960065 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7bf357fe-4723-4885-a2f3-f8b444624327 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a04ad6273e743ebb27b033a645e04b9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:54.980769 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2410/4812] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:25:54 2022] DELETE /identity/v3/users/1a04ad6273e743ebb27b033a645e04b9 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:54.982263 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d7e09-94a7-4893-a497-9abdf7dd1e60 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:54.982834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d7e09-94a7-4893-a497-9abdf7dd1e60 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:54.983977 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d7e09-94a7-4893-a497-9abdf7dd1e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:55.022155 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-dd5d7e09-94a7-4893-a497-9abdf7dd1e60 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:55.028167 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-dd5d7e09-94a7-4893-a497-9abdf7dd1e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:55.180194 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2403/4813] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:25:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:25:55.222773 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf357fe-4723-4885-a2f3-f8b444624327 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:55.224480 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7bf357fe-4723-4885-a2f3-f8b444624327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:55.310739 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf357fe-4723-4885-a2f3-f8b444624327 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:55.315341 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0860a-faf9-4c20-a82d-ac354e6e38b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:55.316015 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0860a-faf9-4c20-a82d-ac354e6e38b5 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:55.316359 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0860a-faf9-4c20-a82d-ac354e6e38b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:55.317188 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0860a-faf9-4c20-a82d-ac354e6e38b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:55.331797 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b0860a-faf9-4c20-a82d-ac354e6e38b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:55.333294 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b0860a-faf9-4c20-a82d-ac354e6e38b5 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:55.346720 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2411/4814] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:25:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:25:56.684057 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d7e09-94a7-4893-a497-9abdf7dd1e60 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:56.685717 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-dd5d7e09-94a7-4893-a497-9abdf7dd1e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:56.697576 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d7e09-94a7-4893-a497-9abdf7dd1e60 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:56.703484 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa7a83a-ace3-409a-9294-4a618aa13f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:56.704432 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7a83a-ace3-409a-9294-4a618aa13f9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:56.704786 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7a83a-ace3-409a-9294-4a618aa13f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:56.705134 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7a83a-ace3-409a-9294-4a618aa13f9d admin admin] PATH_INFO: `/v3/projects/932f682f33ce4292bd1d8f0dcc140812` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:56.706688 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa7a83a-ace3-409a-9294-4a618aa13f9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=932f682f33ce4292bd1d8f0dcc140812)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:56.708712 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa7a83a-ace3-409a-9294-4a618aa13f9d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:56.828584 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-efa7a83a-ace3-409a-9294-4a618aa13f9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '932f682f33ce4292bd1d8f0dcc140812', 'request_id': 'req-efa7a83a-ace3-409a-9294-4a618aa13f9d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:56.846858 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-efa7a83a-ace3-409a-9294-4a618aa13f9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '932f682f33ce4292bd1d8f0dcc140812', 'request_id': 'req-efa7a83a-ace3-409a-9294-4a618aa13f9d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:56.860260 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-efa7a83a-ace3-409a-9294-4a618aa13f9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '932f682f33ce4292bd1d8f0dcc140812', 'request_id': 'req-efa7a83a-ace3-409a-9294-4a618aa13f9d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:56.958244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-efa7a83a-ace3-409a-9294-4a618aa13f9d admin admin] The token cache is being invalidate because project 932f682f33ce4292bd1d8f0dcc140812 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:25:56.960616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-efa7a83a-ace3-409a-9294-4a618aa13f9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:56.965255 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-efa7a83a-ace3-409a-9294-4a618aa13f9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:56.971490 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2404/4815] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:25:56 2022] DELETE /identity/v3/projects/932f682f33ce4292bd1d8f0dcc140812 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:56.972413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0860a-faf9-4c20-a82d-ac354e6e38b5 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:56.987349 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0860a-faf9-4c20-a82d-ac354e6e38b5 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:57.070293 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b9401-567d-472a-839f-8d2bec25961e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:57.072178 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b9401-567d-472a-839f-8d2bec25961e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:57.072719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b9401-567d-472a-839f-8d2bec25961e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:57.073153 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b9401-567d-472a-839f-8d2bec25961e admin admin] PATH_INFO: `/v3/users/4ba10798906a4672993b244945722ad5` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:57.075387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b9401-567d-472a-839f-8d2bec25961e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ba10798906a4672993b244945722ad5)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:57.084505 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b9401-567d-472a-839f-8d2bec25961e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:57.271811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e01b9401-567d-472a-839f-8d2bec25961e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ba10798906a4672993b244945722ad5'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:57.290065 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e01b9401-567d-472a-839f-8d2bec25961e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ba10798906a4672993b244945722ad5'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:57.379727 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e01b9401-567d-472a-839f-8d2bec25961e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ba10798906a4672993b244945722ad5'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:57.380365 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e01b9401-567d-472a-839f-8d2bec25961e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ba10798906a4672993b244945722ad5'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:57.391353 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e01b9401-567d-472a-839f-8d2bec25961e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ba10798906a4672993b244945722ad5'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:57.399266 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2412/4816] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:25:56 2022] DELETE /identity/v3/users/4ba10798906a4672993b244945722ad5 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:25:57.714343 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa7a83a-ace3-409a-9294-4a618aa13f9d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:57.716148 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-efa7a83a-ace3-409a-9294-4a618aa13f9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:57.806511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa7a83a-ace3-409a-9294-4a618aa13f9d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:57.892555 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96cad72-bc85-4e21-bb4f-ce69575fd78d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:57.893490 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cad72-bc85-4e21-bb4f-ce69575fd78d service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:57.893992 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cad72-bc85-4e21-bb4f-ce69575fd78d service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:57.896617 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cad72-bc85-4e21-bb4f-ce69575fd78d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:57.896617 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f96cad72-bc85-4e21-bb4f-ce69575fd78d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:57.935373 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96cad72-bc85-4e21-bb4f-ce69575fd78d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:57.938383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96cad72-bc85-4e21-bb4f-ce69575fd78d service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:57.950179 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2405/4817] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:25:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:25:58.313961 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b9401-567d-472a-839f-8d2bec25961e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:58.315509 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e01b9401-567d-472a-839f-8d2bec25961e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:58.424186 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b9401-567d-472a-839f-8d2bec25961e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:58.428862 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e9ea0-c779-49b7-bd39-a4e2e40f134e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:58.429820 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e9ea0-c779-49b7-bd39-a4e2e40f134e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:58.430106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e9ea0-c779-49b7-bd39-a4e2e40f134e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:58.430384 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e9ea0-c779-49b7-bd39-a4e2e40f134e admin admin] PATH_INFO: `/v3/projects/da76701f84a84461b052d50b307a323c` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:58.431609 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e9ea0-c779-49b7-bd39-a4e2e40f134e admin admin] RBAC: Authorizing `identity:delete_project(project_id=da76701f84a84461b052d50b307a323c)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:58.433561 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e9ea0-c779-49b7-bd39-a4e2e40f134e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:58.574372 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-019e9ea0-c779-49b7-bd39-a4e2e40f134e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da76701f84a84461b052d50b307a323c', 'request_id': 'req-019e9ea0-c779-49b7-bd39-a4e2e40f134e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:58.581362 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-019e9ea0-c779-49b7-bd39-a4e2e40f134e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da76701f84a84461b052d50b307a323c', 'request_id': 'req-019e9ea0-c779-49b7-bd39-a4e2e40f134e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:58.587967 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-019e9ea0-c779-49b7-bd39-a4e2e40f134e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da76701f84a84461b052d50b307a323c', 'request_id': 'req-019e9ea0-c779-49b7-bd39-a4e2e40f134e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:58.655629 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-019e9ea0-c779-49b7-bd39-a4e2e40f134e admin admin] The token cache is being invalidate because project da76701f84a84461b052d50b307a323c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:25:58.656079 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-019e9ea0-c779-49b7-bd39-a4e2e40f134e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:58.656722 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-019e9ea0-c779-49b7-bd39-a4e2e40f134e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:25:58.658345 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2413/4818] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:25:58 2022] DELETE /identity/v3/projects/da76701f84a84461b052d50b307a323c => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:25:58.663535 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66e316-7703-4876-ae79-360ed42cac39 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:58.663832 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66e316-7703-4876-ae79-360ed42cac39 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:58.664113 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66e316-7703-4876-ae79-360ed42cac39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:58.686446 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-6d66e316-7703-4876-ae79-360ed42cac39 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:58.687770 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6d66e316-7703-4876-ae79-360ed42cac39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:58.806487 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2406/4819] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:25:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:25:58.815971 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b30a1-b96e-4e96-8b26-70dd5ffe0231 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:58.816368 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b30a1-b96e-4e96-8b26-70dd5ffe0231 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:58.816761 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b30a1-b96e-4e96-8b26-70dd5ffe0231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:58.841702 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-8a8b30a1-b96e-4e96-8b26-70dd5ffe0231 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:58.844017 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8a8b30a1-b96e-4e96-8b26-70dd5ffe0231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:58.858600 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66e316-7703-4876-ae79-360ed42cac39 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:58.862546 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2414/4820] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:25:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:25:58.868948 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66e316-7703-4876-ae79-360ed42cac39 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:58.874818 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381144a2-89d5-4940-ab7e-4445a5ed59f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:58.875763 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381144a2-89d5-4940-ab7e-4445a5ed59f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:58.876271 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381144a2-89d5-4940-ab7e-4445a5ed59f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:58.876733 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381144a2-89d5-4940-ab7e-4445a5ed59f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:58.878150 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381144a2-89d5-4940-ab7e-4445a5ed59f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:25:58.878657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381144a2-89d5-4940-ab7e-4445a5ed59f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:58.881091 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381144a2-89d5-4940-ab7e-4445a5ed59f4 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:58.896332 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2407/4821] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:25:58.899339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b30a1-b96e-4e96-8b26-70dd5ffe0231 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:58.910432 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b30a1-b96e-4e96-8b26-70dd5ffe0231 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:58.916529 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613d27b-99ea-4640-9764-b5bb74f671b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:58.917200 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613d27b-99ea-4640-9764-b5bb74f671b9 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:58.917479 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613d27b-99ea-4640-9764-b5bb74f671b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:58.917770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613d27b-99ea-4640-9764-b5bb74f671b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:58.918501 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9613d27b-99ea-4640-9764-b5bb74f671b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:58.921430 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9613d27b-99ea-4640-9764-b5bb74f671b9 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:59.038634 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2415/4822] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:25:58 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:25:59.041654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381144a2-89d5-4940-ab7e-4445a5ed59f4 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:59.054256 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381144a2-89d5-4940-ab7e-4445a5ed59f4 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:59.132847 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cd196-f7b1-4a69-8982-85e2d68c5c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:59.133838 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cd196-f7b1-4a69-8982-85e2d68c5c48 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:59.134359 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cd196-f7b1-4a69-8982-85e2d68c5c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:59.134850 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cd196-f7b1-4a69-8982-85e2d68c5c48 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:59.135810 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7cd196-f7b1-4a69-8982-85e2d68c5c48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:59.137780 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7cd196-f7b1-4a69-8982-85e2d68c5c48 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:59.259324 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2408/4823] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:25:59 2022] POST /identity/v3/users => generated 287 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:25:59.265965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613d27b-99ea-4640-9764-b5bb74f671b9 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:59.297609 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613d27b-99ea-4640-9764-b5bb74f671b9 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:59.316129 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc74ec1-1248-4eab-a363-354242c1c7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:59.317717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc74ec1-1248-4eab-a363-354242c1c7df admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:59.318307 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc74ec1-1248-4eab-a363-354242c1c7df admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:59.318827 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc74ec1-1248-4eab-a363-354242c1c7df admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:59.319770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc74ec1-1248-4eab-a363-354242c1c7df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:59.321597 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc74ec1-1248-4eab-a363-354242c1c7df admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:59.334727 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2416/4824] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:25:59.339270 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cd196-f7b1-4a69-8982-85e2d68c5c48 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:59.353120 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cd196-f7b1-4a69-8982-85e2d68c5c48 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:59.359841 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca9b11-251a-4229-b0f2-8d0a8f40e841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:59.360646 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca9b11-251a-4229-b0f2-8d0a8f40e841 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:59.361066 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca9b11-251a-4229-b0f2-8d0a8f40e841 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:59.361441 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca9b11-251a-4229-b0f2-8d0a8f40e841 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:59.362322 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca9b11-251a-4229-b0f2-8d0a8f40e841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:59.364236 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca9b11-251a-4229-b0f2-8d0a8f40e841 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:59.378259 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2409/4825] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:25:59.382659 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc74ec1-1248-4eab-a363-354242c1c7df admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:59.394259 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc74ec1-1248-4eab-a363-354242c1c7df admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:59.400600 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d7072-6bcc-4364-ad91-966ec95b903c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:59.402693 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d7072-6bcc-4364-ad91-966ec95b903c admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:59.403080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d7072-6bcc-4364-ad91-966ec95b903c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:59.403370 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d7072-6bcc-4364-ad91-966ec95b903c admin admin] PATH_INFO: `/v3/projects/b02829cc77f44f679f9d9c47476222f8/users/2190ffb5267249ae8af8a2271d87f14c/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:59.437728 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d7072-6bcc-4364-ad91-966ec95b903c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b02829cc77f44f679f9d9c47476222f8, user_id=2190ffb5267249ae8af8a2271d87f14c, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:59.440481 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d7072-6bcc-4364-ad91-966ec95b903c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:59.549647 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2417/4826] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:25:59 2022] PUT /identity/v3/projects/b02829cc77f44f679f9d9c47476222f8/users/2190ffb5267249ae8af8a2271d87f14c/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:25:59.560809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f226e0-c4e1-4cdd-b1b0-698ca0c136f8 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:59.561098 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f226e0-c4e1-4cdd-b1b0-698ca0c136f8 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:59.563253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f226e0-c4e1-4cdd-b1b0-698ca0c136f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:59.623878 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-c3f226e0-c4e1-4cdd-b1b0-698ca0c136f8 None None] MFA Rules not processed for user `2190ffb5267249ae8af8a2271d87f14c`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:25:59.626092 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c3f226e0-c4e1-4cdd-b1b0-698ca0c136f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:59.715952 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2410/4827] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:25:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:25:59.728537 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d7072-6bcc-4364-ad91-966ec95b903c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:25:59.730951 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-190d7072-6bcc-4364-ad91-966ec95b903c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:25:59.803972 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d7072-6bcc-4364-ad91-966ec95b903c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:25:59.807896 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aabf542-2d81-4452-a638-4e7b1f8a7258 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e302b1298dd04d6590e3d079f7b13b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:25:59.808681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabf542-2d81-4452-a638-4e7b1f8a7258 service glance] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:25:59.808976 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabf542-2d81-4452-a638-4e7b1f8a7258 service glance] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:25:59.809255 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabf542-2d81-4452-a638-4e7b1f8a7258 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:25:59.820636 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aabf542-2d81-4452-a638-4e7b1f8a7258 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:25:59.825200 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aabf542-2d81-4452-a638-4e7b1f8a7258 service glance] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:25:59.837075 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2418/4828] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:25:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:26:01.375092 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f226e0-c4e1-4cdd-b1b0-698ca0c136f8 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:01.462789 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aabf542-2d81-4452-a638-4e7b1f8a7258 service glance] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:01.464244 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8aabf542-2d81-4452-a638-4e7b1f8a7258 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:01.475500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f226e0-c4e1-4cdd-b1b0-698ca0c136f8 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:01.483090 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aabf542-2d81-4452-a638-4e7b1f8a7258 service glance] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:01.492499 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a8a91-e5a0-439d-933d-93c2864ee583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:01.493380 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a8a91-e5a0-439d-933d-93c2864ee583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:01.493380 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a8a91-e5a0-439d-933d-93c2864ee583 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:01.493796 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a8a91-e5a0-439d-933d-93c2864ee583 admin admin] PATH_INFO: `/v3/users/2190ffb5267249ae8af8a2271d87f14c` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:01.495363 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a8a91-e5a0-439d-933d-93c2864ee583 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2190ffb5267249ae8af8a2271d87f14c)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:01.495597 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a40786-3d9b-412b-8848-308bca530a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:01.496754 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a40786-3d9b-412b-8848-308bca530a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:01.497274 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a40786-3d9b-412b-8848-308bca530a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:01.497822 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a40786-3d9b-412b-8848-308bca530a38 admin admin] PATH_INFO: `/v3/users/1db6288172594ff2a635b92deb90c7ae` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:01.498078 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a8a91-e5a0-439d-933d-93c2864ee583 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:01.501435 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a40786-3d9b-412b-8848-308bca530a38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1db6288172594ff2a635b92deb90c7ae)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:01.504058 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a40786-3d9b-412b-8848-308bca530a38 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:01.745129 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-060a8a91-e5a0-439d-933d-93c2864ee583 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2190ffb5267249ae8af8a2271d87f14c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:01.756415 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b6a40786-3d9b-412b-8848-308bca530a38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1db6288172594ff2a635b92deb90c7ae'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:01.763443 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-060a8a91-e5a0-439d-933d-93c2864ee583 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2190ffb5267249ae8af8a2271d87f14c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:01.776939 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b6a40786-3d9b-412b-8848-308bca530a38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1db6288172594ff2a635b92deb90c7ae'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:01.839870 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-060a8a91-e5a0-439d-933d-93c2864ee583 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2190ffb5267249ae8af8a2271d87f14c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:01.849339 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-060a8a91-e5a0-439d-933d-93c2864ee583 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2190ffb5267249ae8af8a2271d87f14c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:01.850454 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-060a8a91-e5a0-439d-933d-93c2864ee583 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2190ffb5267249ae8af8a2271d87f14c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:01.858830 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2411/4829] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:26:01 2022] DELETE /identity/v3/users/2190ffb5267249ae8af8a2271d87f14c => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:26:01.863855 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0c2d8-d1d9-4422-8b64-e039b982db8e None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:01.864221 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0c2d8-d1d9-4422-8b64-e039b982db8e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:01.864504 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0c2d8-d1d9-4422-8b64-e039b982db8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:01.885518 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-bae0c2d8-d1d9-4422-8b64-e039b982db8e None None] MFA Rules not processed for user `20b4082fa07249e2b6dfb9b4506ab398`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:26:01.886779 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-bae0c2d8-d1d9-4422-8b64-e039b982db8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:01.919656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b6a40786-3d9b-412b-8848-308bca530a38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1db6288172594ff2a635b92deb90c7ae'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:01.920671 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b6a40786-3d9b-412b-8848-308bca530a38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1db6288172594ff2a635b92deb90c7ae'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:01.931064 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b6a40786-3d9b-412b-8848-308bca530a38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1db6288172594ff2a635b92deb90c7ae'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:01.956841 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2419/4830] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:26:01 2022] DELETE /identity/v3/users/1db6288172594ff2a635b92deb90c7ae => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:26:01.956841 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63e265-d4e1-4d67-a7a5-97a2f19359be None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:01.956841 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63e265-d4e1-4d67-a7a5-97a2f19359be None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:01.956841 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63e265-d4e1-4d67-a7a5-97a2f19359be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:01.972567 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2412/4831] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:26:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:26:01.974370 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e0356-8e6c-4cae-b07e-a3d975a72357 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:01.974913 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e0356-8e6c-4cae-b07e-a3d975a72357 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:01.975209 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e0356-8e6c-4cae-b07e-a3d975a72357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:01.999481 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-ca2e0356-8e6c-4cae-b07e-a3d975a72357 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:26:02.004528 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-2e63e265-d4e1-4d67-a7a5-97a2f19359be None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:26:02.004671 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ca2e0356-8e6c-4cae-b07e-a3d975a72357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:02.004775 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2e63e265-d4e1-4d67-a7a5-97a2f19359be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:02.106781 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2413/4832] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:26:02.117011 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e0356-8e6c-4cae-b07e-a3d975a72357 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:02.119895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ca2e0356-8e6c-4cae-b07e-a3d975a72357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:02.126305 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2420/4833] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:26:02.136511 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63e265-d4e1-4d67-a7a5-97a2f19359be None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:02.138120 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2e63e265-d4e1-4d67-a7a5-97a2f19359be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:02.221581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e0356-8e6c-4cae-b07e-a3d975a72357 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:02.232381 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887fac6-545e-437e-8377-dfbdd72c53b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:02.234384 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63e265-d4e1-4d67-a7a5-97a2f19359be None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:02.235807 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887fac6-545e-437e-8377-dfbdd72c53b9 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:02.236254 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887fac6-545e-437e-8377-dfbdd72c53b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:02.236732 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887fac6-545e-437e-8377-dfbdd72c53b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:02.237905 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9489b6-e08a-4bc5-a13a-511bf2028009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:02.238561 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9489b6-e08a-4bc5-a13a-511bf2028009 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:02.238845 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9489b6-e08a-4bc5-a13a-511bf2028009 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:02.239121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9489b6-e08a-4bc5-a13a-511bf2028009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:02.250846 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9489b6-e08a-4bc5-a13a-511bf2028009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:02.251370 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8887fac6-545e-437e-8377-dfbdd72c53b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:02.252531 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9489b6-e08a-4bc5-a13a-511bf2028009 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:02.253464 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8887fac6-545e-437e-8377-dfbdd72c53b9 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:02.273877 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2414/4834] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:26:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:26:02.274879 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2421/4835] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:26:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:26:02.821699 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887fac6-545e-437e-8377-dfbdd72c53b9 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:02.823837 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8887fac6-545e-437e-8377-dfbdd72c53b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:02.837905 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887fac6-545e-437e-8377-dfbdd72c53b9 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:02.843194 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac279b7e-f1a5-48e4-8322-ef412369a98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:02.845160 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac279b7e-f1a5-48e4-8322-ef412369a98c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:02.845628 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac279b7e-f1a5-48e4-8322-ef412369a98c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:02.846093 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac279b7e-f1a5-48e4-8322-ef412369a98c admin admin] PATH_INFO: `/v3/projects/239aa4ccbcc9478d9c7cb464f30f65f5` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:02.847569 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac279b7e-f1a5-48e4-8322-ef412369a98c admin admin] RBAC: Authorizing `identity:delete_project(project_id=239aa4ccbcc9478d9c7cb464f30f65f5)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:02.849687 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac279b7e-f1a5-48e4-8322-ef412369a98c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:02.989654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ac279b7e-f1a5-48e4-8322-ef412369a98c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '239aa4ccbcc9478d9c7cb464f30f65f5', 'request_id': 'req-ac279b7e-f1a5-48e4-8322-ef412369a98c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:03.003036 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ac279b7e-f1a5-48e4-8322-ef412369a98c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '239aa4ccbcc9478d9c7cb464f30f65f5', 'request_id': 'req-ac279b7e-f1a5-48e4-8322-ef412369a98c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:03.015121 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ac279b7e-f1a5-48e4-8322-ef412369a98c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '239aa4ccbcc9478d9c7cb464f30f65f5', 'request_id': 'req-ac279b7e-f1a5-48e4-8322-ef412369a98c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:03.188089 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ac279b7e-f1a5-48e4-8322-ef412369a98c admin admin] The token cache is being invalidate because project 239aa4ccbcc9478d9c7cb464f30f65f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:26:03.188683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ac279b7e-f1a5-48e4-8322-ef412369a98c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:03.190123 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ac279b7e-f1a5-48e4-8322-ef412369a98c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:03.194389 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2415/4836] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:26:02 2022] DELETE /identity/v3/projects/239aa4ccbcc9478d9c7cb464f30f65f5 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:26:03.199187 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94b99c-a697-4416-8417-41d7e44542cf None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:03.199709 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94b99c-a697-4416-8417-41d7e44542cf None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:03.199709 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94b99c-a697-4416-8417-41d7e44542cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:03.274387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-bb94b99c-a697-4416-8417-41d7e44542cf None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:26:03.275887 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-bb94b99c-a697-4416-8417-41d7e44542cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:03.421133 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2422/4837] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:26:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:26:03.428724 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9b435-abcc-49da-8c90-58509aec319b None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:03.444682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9b435-abcc-49da-8c90-58509aec319b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:03.445258 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9b435-abcc-49da-8c90-58509aec319b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:03.483383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-1ec9b435-abcc-49da-8c90-58509aec319b None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:26:03.483383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1ec9b435-abcc-49da-8c90-58509aec319b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:03.498016 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2416/4838] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:26:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:26:03.499332 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94b99c-a697-4416-8417-41d7e44542cf None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:03.513313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94b99c-a697-4416-8417-41d7e44542cf None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:03.524594 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c17fd9-3b22-44ba-a079-0c5a7ff88762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:03.525550 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c17fd9-3b22-44ba-a079-0c5a7ff88762 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:03.525863 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c17fd9-3b22-44ba-a079-0c5a7ff88762 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:03.526148 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c17fd9-3b22-44ba-a079-0c5a7ff88762 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:03.526879 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c17fd9-3b22-44ba-a079-0c5a7ff88762 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:26:03.527185 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c17fd9-3b22-44ba-a079-0c5a7ff88762 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:03.528804 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c17fd9-3b22-44ba-a079-0c5a7ff88762 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:03.554962 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2423/4839] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:26:03.556682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec9b435-abcc-49da-8c90-58509aec319b None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:03.569965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec9b435-abcc-49da-8c90-58509aec319b None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:03.578130 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8a4eb-f6b9-4fba-bef4-5d506ff61920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:03.579185 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8a4eb-f6b9-4fba-bef4-5d506ff61920 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:03.579803 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8a4eb-f6b9-4fba-bef4-5d506ff61920 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:03.580857 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8a4eb-f6b9-4fba-bef4-5d506ff61920 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:03.582520 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e8a4eb-f6b9-4fba-bef4-5d506ff61920 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:03.585131 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e8a4eb-f6b9-4fba-bef4-5d506ff61920 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:03.740497 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c17fd9-3b22-44ba-a079-0c5a7ff88762 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:03.749416 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2417/4840] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:26:03 2022] POST /identity/v3/projects => generated 379 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:26:03.754819 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c17fd9-3b22-44ba-a079-0c5a7ff88762 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:03.824273 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8a4eb-f6b9-4fba-bef4-5d506ff61920 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:03.827601 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-43e8a4eb-f6b9-4fba-bef4-5d506ff61920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:03.883233 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b294d62-dc75-447f-ac3d-997fc7ee1021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:03.884162 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b294d62-dc75-447f-ac3d-997fc7ee1021 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:03.884433 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b294d62-dc75-447f-ac3d-997fc7ee1021 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:03.884805 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b294d62-dc75-447f-ac3d-997fc7ee1021 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:03.885616 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b294d62-dc75-447f-ac3d-997fc7ee1021 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:03.891320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b294d62-dc75-447f-ac3d-997fc7ee1021 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:03.975325 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8a4eb-f6b9-4fba-bef4-5d506ff61920 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:03.992280 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2424/4841] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:26:03 2022] POST /identity/v3/users => generated 290 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:26:03.993604 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b294d62-dc75-447f-ac3d-997fc7ee1021 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:03.998436 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e8f82-ca0e-487d-8331-4708cf7f3d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:04.001581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e8f82-ca0e-487d-8331-4708cf7f3d41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:04.004014 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e8f82-ca0e-487d-8331-4708cf7f3d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:04.004925 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e8f82-ca0e-487d-8331-4708cf7f3d41 admin admin] PATH_INFO: `/v3/projects/b02829cc77f44f679f9d9c47476222f8` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:04.007326 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917e8f82-ca0e-487d-8331-4708cf7f3d41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b02829cc77f44f679f9d9c47476222f8)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:04.012348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917e8f82-ca0e-487d-8331-4708cf7f3d41 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:04.040085 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b294d62-dc75-447f-ac3d-997fc7ee1021 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:04.057505 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d138a83d-5c5b-4def-bb72-39b388dbbc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:04.058269 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138a83d-5c5b-4def-bb72-39b388dbbc6a admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:04.058773 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138a83d-5c5b-4def-bb72-39b388dbbc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:04.059268 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138a83d-5c5b-4def-bb72-39b388dbbc6a admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:04.060802 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d138a83d-5c5b-4def-bb72-39b388dbbc6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:04.063247 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d138a83d-5c5b-4def-bb72-39b388dbbc6a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:04.084620 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2425/4842] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:26:04.084620 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d138a83d-5c5b-4def-bb72-39b388dbbc6a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:04.090405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d138a83d-5c5b-4def-bb72-39b388dbbc6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:04.191444 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-917e8f82-ca0e-487d-8331-4708cf7f3d41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b02829cc77f44f679f9d9c47476222f8', 'request_id': 'req-917e8f82-ca0e-487d-8331-4708cf7f3d41'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:04.204687 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-917e8f82-ca0e-487d-8331-4708cf7f3d41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b02829cc77f44f679f9d9c47476222f8', 'request_id': 'req-917e8f82-ca0e-487d-8331-4708cf7f3d41'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:04.219763 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-917e8f82-ca0e-487d-8331-4708cf7f3d41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b02829cc77f44f679f9d9c47476222f8', 'request_id': 'req-917e8f82-ca0e-487d-8331-4708cf7f3d41'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:04.264461 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d138a83d-5c5b-4def-bb72-39b388dbbc6a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:04.326262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-917e8f82-ca0e-487d-8331-4708cf7f3d41 admin admin] The token cache is being invalidate because project b02829cc77f44f679f9d9c47476222f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:26:04.326613 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-917e8f82-ca0e-487d-8331-4708cf7f3d41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:04.327288 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-917e8f82-ca0e-487d-8331-4708cf7f3d41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:04.333082 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2418/4843] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:26:03 2022] DELETE /identity/v3/projects/b02829cc77f44f679f9d9c47476222f8 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:26:04.333082 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e8f82-ca0e-487d-8331-4708cf7f3d41 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:04.333530 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-917e8f82-ca0e-487d-8331-4708cf7f3d41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:04.381884 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338bfad-1f5c-483c-b97e-c8eaf2b40d84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:04.382711 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338bfad-1f5c-483c-b97e-c8eaf2b40d84 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:04.383111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338bfad-1f5c-483c-b97e-c8eaf2b40d84 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:04.383737 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338bfad-1f5c-483c-b97e-c8eaf2b40d84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:04.386013 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5338bfad-1f5c-483c-b97e-c8eaf2b40d84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:04.420402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338bfad-1f5c-483c-b97e-c8eaf2b40d84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:04.422894 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338bfad-1f5c-483c-b97e-c8eaf2b40d84 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:04.448610 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2426/4844] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:26:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:26:04.452255 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0948f6d-ced0-45b6-81a8-a3b8d66adab2 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:04.452554 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0948f6d-ced0-45b6-81a8-a3b8d66adab2 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:04.455257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0948f6d-ced0-45b6-81a8-a3b8d66adab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:04.463416 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e8f82-ca0e-487d-8331-4708cf7f3d41 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:04.469744 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920e206-a621-4cf7-8d12-893123f54165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:04.471469 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920e206-a621-4cf7-8d12-893123f54165 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:04.471774 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920e206-a621-4cf7-8d12-893123f54165 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:04.472063 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920e206-a621-4cf7-8d12-893123f54165 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:04.473136 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b920e206-a621-4cf7-8d12-893123f54165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:04.475946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b920e206-a621-4cf7-8d12-893123f54165 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:04.494734 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2419/4845] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:26:04.498321 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-b0948f6d-ced0-45b6-81a8-a3b8d66adab2 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:26:04.500277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b0948f6d-ced0-45b6-81a8-a3b8d66adab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:04.500699 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920e206-a621-4cf7-8d12-893123f54165 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:04.512828 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2427/4846] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:26:04.515081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920e206-a621-4cf7-8d12-893123f54165 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:04.525613 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4c50c-9d0d-4e32-9946-90a6f58372f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:04.528120 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5160fb-b6a8-4500-8f2c-a831f64351d3 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:04.528422 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5160fb-b6a8-4500-8f2c-a831f64351d3 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:04.528710 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5160fb-b6a8-4500-8f2c-a831f64351d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:04.529126 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4c50c-9d0d-4e32-9946-90a6f58372f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:04.529556 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4c50c-9d0d-4e32-9946-90a6f58372f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:04.530726 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4c50c-9d0d-4e32-9946-90a6f58372f5 admin admin] PATH_INFO: `/v3/projects/df29de6983a1403588550faf0e6b2bd8/users/e06225276b764805a8a56f143d920f5f/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:04.554938 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4c50c-9d0d-4e32-9946-90a6f58372f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df29de6983a1403588550faf0e6b2bd8, user_id=e06225276b764805a8a56f143d920f5f, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:04.558609 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4c50c-9d0d-4e32-9946-90a6f58372f5 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:04.565415 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-fe5160fb-b6a8-4500-8f2c-a831f64351d3 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:26:04.566780 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-fe5160fb-b6a8-4500-8f2c-a831f64351d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:04.575013 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2428/4847] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:26:04.579463 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5160fb-b6a8-4500-8f2c-a831f64351d3 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:04.589043 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5160fb-b6a8-4500-8f2c-a831f64351d3 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:04.595326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d72e47-5734-493c-87ae-e3aad6c399e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:04.609696 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d72e47-5734-493c-87ae-e3aad6c399e7 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:04.610091 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d72e47-5734-493c-87ae-e3aad6c399e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:04.610452 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d72e47-5734-493c-87ae-e3aad6c399e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:04.611230 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d72e47-5734-493c-87ae-e3aad6c399e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:26:04.611549 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d72e47-5734-493c-87ae-e3aad6c399e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:04.618726 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d72e47-5734-493c-87ae-e3aad6c399e7 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:04.654115 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2420/4848] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:26:04 2022] PUT /identity/v3/projects/df29de6983a1403588550faf0e6b2bd8/users/e06225276b764805a8a56f143d920f5f/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:26:04.657181 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1f868-fd15-4012-9ba8-5d207b1cbc7c None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:04.657475 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1f868-fd15-4012-9ba8-5d207b1cbc7c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:04.657784 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1f868-fd15-4012-9ba8-5d207b1cbc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:04.662215 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2429/4849] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:26:04.667099 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d72e47-5734-493c-87ae-e3aad6c399e7 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:04.688643 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d72e47-5734-493c-87ae-e3aad6c399e7 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:04.724371 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-bcf1f868-fd15-4012-9ba8-5d207b1cbc7c None None] MFA Rules not processed for user `e06225276b764805a8a56f143d920f5f`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:26:04.726391 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-bcf1f868-fd15-4012-9ba8-5d207b1cbc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:04.814963 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659466fa-6930-49be-b4d8-df3781e3cd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:04.815653 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659466fa-6930-49be-b4d8-df3781e3cd39 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:04.815934 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659466fa-6930-49be-b4d8-df3781e3cd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:04.816213 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659466fa-6930-49be-b4d8-df3781e3cd39 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:04.816911 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659466fa-6930-49be-b4d8-df3781e3cd39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:04.819591 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659466fa-6930-49be-b4d8-df3781e3cd39 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:04.847882 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2421/4850] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:26:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:26:04.858352 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf1f868-fd15-4012-9ba8-5d207b1cbc7c None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:04.859761 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-bcf1f868-fd15-4012-9ba8-5d207b1cbc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:04.920562 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf1f868-fd15-4012-9ba8-5d207b1cbc7c None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:04.924198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560af37-a0a4-4996-aaad-dd8dc257cea3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:04.924891 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560af37-a0a4-4996-aaad-dd8dc257cea3 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:04.925179 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560af37-a0a4-4996-aaad-dd8dc257cea3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:04.925455 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560af37-a0a4-4996-aaad-dd8dc257cea3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:04.933736 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6560af37-a0a4-4996-aaad-dd8dc257cea3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:04.935217 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6560af37-a0a4-4996-aaad-dd8dc257cea3 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:04.944722 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2422/4851] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:26:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:26:05.008245 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2430/4852] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:26:04 2022] POST /identity/v3/projects => generated 391 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:26:05.012590 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560af37-a0a4-4996-aaad-dd8dc257cea3 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:05.025638 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560af37-a0a4-4996-aaad-dd8dc257cea3 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:05.090276 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1519e-8807-4f50-9f9a-189ab1d60a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:05.090953 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1519e-8807-4f50-9f9a-189ab1d60a21 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:05.091233 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1519e-8807-4f50-9f9a-189ab1d60a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:05.091504 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1519e-8807-4f50-9f9a-189ab1d60a21 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:05.092446 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb1519e-8807-4f50-9f9a-189ab1d60a21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:05.094754 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb1519e-8807-4f50-9f9a-189ab1d60a21 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:05.208793 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2423/4853] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:26:05 2022] POST /identity/v3/users => generated 296 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:26:05.213533 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659466fa-6930-49be-b4d8-df3781e3cd39 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:05.234453 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659466fa-6930-49be-b4d8-df3781e3cd39 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:05.241300 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd41d6-4554-4ca9-9b58-ed8323f4e95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:05.243295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd41d6-4554-4ca9-9b58-ed8323f4e95e admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:05.243793 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd41d6-4554-4ca9-9b58-ed8323f4e95e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:05.244266 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd41d6-4554-4ca9-9b58-ed8323f4e95e admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:05.246105 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd41d6-4554-4ca9-9b58-ed8323f4e95e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:05.248281 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd41d6-4554-4ca9-9b58-ed8323f4e95e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:05.269657 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2431/4854] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:26:05.274078 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1519e-8807-4f50-9f9a-189ab1d60a21 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:05.295991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1519e-8807-4f50-9f9a-189ab1d60a21 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:05.303533 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b4465-e4b0-42f0-a014-cb9631cc2e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:05.304286 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b4465-e4b0-42f0-a014-cb9631cc2e25 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:05.304579 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b4465-e4b0-42f0-a014-cb9631cc2e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:05.304860 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b4465-e4b0-42f0-a014-cb9631cc2e25 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:05.307056 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b4465-e4b0-42f0-a014-cb9631cc2e25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:05.312398 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b4465-e4b0-42f0-a014-cb9631cc2e25 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:05.332460 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2424/4855] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:26:05.333953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd41d6-4554-4ca9-9b58-ed8323f4e95e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:05.346972 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd41d6-4554-4ca9-9b58-ed8323f4e95e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:05.354081 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5fe9e1-2348-4d0f-9815-6d623af9a25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:05.354987 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fe9e1-2348-4d0f-9815-6d623af9a25c admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:05.355278 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fe9e1-2348-4d0f-9815-6d623af9a25c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:05.355557 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fe9e1-2348-4d0f-9815-6d623af9a25c admin admin] PATH_INFO: `/v3/projects/733603fc72e94d888b7bfbbfd909856b/users/4ef301ea5e9b4d7ab998ecf1651aae13/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:05.376047 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5fe9e1-2348-4d0f-9815-6d623af9a25c admin admin] RBAC: Authorizing `identity:create_grant(project_id=733603fc72e94d888b7bfbbfd909856b, user_id=4ef301ea5e9b4d7ab998ecf1651aae13, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:05.379081 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5fe9e1-2348-4d0f-9815-6d623af9a25c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:05.468847 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7f3fa-7975-468f-bfb6-d3ce9968152f None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:05.469205 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7f3fa-7975-468f-bfb6-d3ce9968152f None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:05.469547 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7f3fa-7975-468f-bfb6-d3ce9968152f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:05.470981 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2432/4856] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:26:05 2022] PUT /identity/v3/projects/733603fc72e94d888b7bfbbfd909856b/users/4ef301ea5e9b4d7ab998ecf1651aae13/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:26:05.500482 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-cfa7f3fa-7975-468f-bfb6-d3ce9968152f None None] MFA Rules not processed for user `4ef301ea5e9b4d7ab998ecf1651aae13`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:26:05.501615 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-cfa7f3fa-7975-468f-bfb6-d3ce9968152f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:05.626489 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2425/4857] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:26:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:26:05.630853 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5fe9e1-2348-4d0f-9815-6d623af9a25c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:05.808934 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5fe9e1-2348-4d0f-9815-6d623af9a25c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:05.822852 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9610d-b349-43d4-878b-13816fd63206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:05.823702 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9610d-b349-43d4-878b-13816fd63206 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:05.824094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9610d-b349-43d4-878b-13816fd63206 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:05.824371 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9610d-b349-43d4-878b-13816fd63206 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:05.825070 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b9610d-b349-43d4-878b-13816fd63206 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:05.833825 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b9610d-b349-43d4-878b-13816fd63206 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:06.012821 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2433/4858] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:26:05 2022] POST /identity/v3/projects => generated 391 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:26:06.017633 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7f3fa-7975-468f-bfb6-d3ce9968152f None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:06.030447 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7f3fa-7975-468f-bfb6-d3ce9968152f None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:06.153040 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012b6da-0efa-40ec-9368-a4d9a0424b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:06.154128 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012b6da-0efa-40ec-9368-a4d9a0424b94 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:06.155171 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012b6da-0efa-40ec-9368-a4d9a0424b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:06.155771 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012b6da-0efa-40ec-9368-a4d9a0424b94 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:06.156691 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1012b6da-0efa-40ec-9368-a4d9a0424b94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:06.159356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1012b6da-0efa-40ec-9368-a4d9a0424b94 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:06.309902 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2426/4859] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:26:06 2022] POST /identity/v3/users => generated 302 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:26:06.310296 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9610d-b349-43d4-878b-13816fd63206 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:06.342170 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9610d-b349-43d4-878b-13816fd63206 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:06.403243 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149c326-7c4a-4350-8238-a8e1c7f24486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:06.403811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149c326-7c4a-4350-8238-a8e1c7f24486 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:06.404109 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149c326-7c4a-4350-8238-a8e1c7f24486 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:06.404606 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149c326-7c4a-4350-8238-a8e1c7f24486 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:06.424422 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149c326-7c4a-4350-8238-a8e1c7f24486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:06.451642 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149c326-7c4a-4350-8238-a8e1c7f24486 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:06.525747 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012b6da-0efa-40ec-9368-a4d9a0424b94 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:06.534096 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2434/4860] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:26:06.548679 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012b6da-0efa-40ec-9368-a4d9a0424b94 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:06.566811 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a5ad0-747c-4b4e-9f2a-45b08c436e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:06.569121 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a5ad0-747c-4b4e-9f2a-45b08c436e05 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:06.570334 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a5ad0-747c-4b4e-9f2a-45b08c436e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:06.570805 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a5ad0-747c-4b4e-9f2a-45b08c436e05 admin admin] PATH_INFO: `/v3/projects/b83c5e356eb84186924ccb0d76d0dcb8/users/4ef412e138b74f2392c273fc29fb4655/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:06.624688 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a5ad0-747c-4b4e-9f2a-45b08c436e05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b83c5e356eb84186924ccb0d76d0dcb8, user_id=4ef412e138b74f2392c273fc29fb4655, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:06.638169 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a5ad0-747c-4b4e-9f2a-45b08c436e05 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:06.743997 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2427/4861] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:26:06 2022] PUT /identity/v3/projects/b83c5e356eb84186924ccb0d76d0dcb8/users/4ef412e138b74f2392c273fc29fb4655/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:26:06.745621 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149c326-7c4a-4350-8238-a8e1c7f24486 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:06.761903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149c326-7c4a-4350-8238-a8e1c7f24486 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:06.835673 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e8f5b-9a6c-43d6-9ddf-eb30efa2963a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:06.836328 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e8f5b-9a6c-43d6-9ddf-eb30efa2963a admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:06.836722 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e8f5b-9a6c-43d6-9ddf-eb30efa2963a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:06.837018 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e8f5b-9a6c-43d6-9ddf-eb30efa2963a admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:06.837829 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e8f5b-9a6c-43d6-9ddf-eb30efa2963a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:06.840197 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e8f5b-9a6c-43d6-9ddf-eb30efa2963a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:06.857802 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2435/4862] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:26:06.860501 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a5ad0-747c-4b4e-9f2a-45b08c436e05 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:06.917571 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a5ad0-747c-4b4e-9f2a-45b08c436e05 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:06.933488 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f2aa5-d5f9-43b6-a9dc-9abf29672ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:06.935048 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f2aa5-d5f9-43b6-a9dc-9abf29672ec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:06.935495 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f2aa5-d5f9-43b6-a9dc-9abf29672ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:06.936015 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f2aa5-d5f9-43b6-a9dc-9abf29672ec8 admin admin] PATH_INFO: `/v3/projects/b83c5e356eb84186924ccb0d76d0dcb8/users/4ef412e138b74f2392c273fc29fb4655/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:06.958143 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f2aa5-d5f9-43b6-a9dc-9abf29672ec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b83c5e356eb84186924ccb0d76d0dcb8, user_id=4ef412e138b74f2392c273fc29fb4655, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:06.971826 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f2aa5-d5f9-43b6-a9dc-9abf29672ec8 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:07.003896 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2428/4863] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:26:06 2022] PUT /identity/v3/projects/b83c5e356eb84186924ccb0d76d0dcb8/users/4ef412e138b74f2392c273fc29fb4655/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:26:07.015686 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9dc6d4-a29b-4b22-91ce-fbda6187298c None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:07.016210 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9dc6d4-a29b-4b22-91ce-fbda6187298c None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:07.016699 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9dc6d4-a29b-4b22-91ce-fbda6187298c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:07.088953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-8d9dc6d4-a29b-4b22-91ce-fbda6187298c None None] MFA Rules not processed for user `4ef412e138b74f2392c273fc29fb4655`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:26:07.091362 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8d9dc6d4-a29b-4b22-91ce-fbda6187298c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:07.310555 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2436/4864] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:26:07 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:26:07.403297 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f2aa5-d5f9-43b6-a9dc-9abf29672ec8 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:07.409143 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-776f2aa5-d5f9-43b6-a9dc-9abf29672ec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:07.580437 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f2aa5-d5f9-43b6-a9dc-9abf29672ec8 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:07.588274 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971836b-6d13-4ca7-a0be-1d1cead9c8d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:07.588889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971836b-6d13-4ca7-a0be-1d1cead9c8d8 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:07.589182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971836b-6d13-4ca7-a0be-1d1cead9c8d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:07.589462 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971836b-6d13-4ca7-a0be-1d1cead9c8d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:07.722971 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971836b-6d13-4ca7-a0be-1d1cead9c8d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:07.732049 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971836b-6d13-4ca7-a0be-1d1cead9c8d8 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:07.746715 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2429/4865] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:26:07 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:26:09.216939 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9dc6d4-a29b-4b22-91ce-fbda6187298c None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:09.232277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9dc6d4-a29b-4b22-91ce-fbda6187298c None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:09.242807 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb87f9-5b06-417b-8c8a-f68dffe913e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:09.243886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb87f9-5b06-417b-8c8a-f68dffe913e4 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:09.244386 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb87f9-5b06-417b-8c8a-f68dffe913e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:09.244871 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb87f9-5b06-417b-8c8a-f68dffe913e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:09.247727 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e4eb87f9-5b06-417b-8c8a-f68dffe913e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:09.385044 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb87f9-5b06-417b-8c8a-f68dffe913e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:09.387885 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb87f9-5b06-417b-8c8a-f68dffe913e4 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:09.407135 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2437/4866] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:26:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:26:09.851652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971836b-6d13-4ca7-a0be-1d1cead9c8d8 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:09.854061 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7971836b-6d13-4ca7-a0be-1d1cead9c8d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:09.891326 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971836b-6d13-4ca7-a0be-1d1cead9c8d8 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:09.906239 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e316e-6481-419f-a8f8-57ebca20c286 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:09.907082 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e316e-6481-419f-a8f8-57ebca20c286 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:09.907504 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e316e-6481-419f-a8f8-57ebca20c286 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:09.907892 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e316e-6481-419f-a8f8-57ebca20c286 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:09.909933 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a57e316e-6481-419f-a8f8-57ebca20c286 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:09.938905 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e316e-6481-419f-a8f8-57ebca20c286 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:09.942509 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e316e-6481-419f-a8f8-57ebca20c286 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:09.971331 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2430/4867] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:26:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:26:11.673313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb87f9-5b06-417b-8c8a-f68dffe913e4 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:11.675482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e4eb87f9-5b06-417b-8c8a-f68dffe913e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:11.697614 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb87f9-5b06-417b-8c8a-f68dffe913e4 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:11.706187 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24117672-fa13-4fd9-9cdc-64ec37203da0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:11.707275 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24117672-fa13-4fd9-9cdc-64ec37203da0 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:11.708406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24117672-fa13-4fd9-9cdc-64ec37203da0 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:11.708913 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24117672-fa13-4fd9-9cdc-64ec37203da0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:11.713035 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-24117672-fa13-4fd9-9cdc-64ec37203da0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:11.828970 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24117672-fa13-4fd9-9cdc-64ec37203da0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:11.832152 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24117672-fa13-4fd9-9cdc-64ec37203da0 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:11.917667 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2438/4868] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:26:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:26:16.072544 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e316e-6481-419f-a8f8-57ebca20c286 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:16.098396 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e316e-6481-419f-a8f8-57ebca20c286 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:16.112155 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27643a68-8e5c-4446-899a-d3854db641c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:16.113041 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27643a68-8e5c-4446-899a-d3854db641c7 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:16.113489 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27643a68-8e5c-4446-899a-d3854db641c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:16.113959 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27643a68-8e5c-4446-899a-d3854db641c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:16.147890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27643a68-8e5c-4446-899a-d3854db641c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:16.149383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27643a68-8e5c-4446-899a-d3854db641c7 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:16.198634 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2431/4869] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:26:16 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:26:22.481709 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ca207-c8f0-4315-8871-add369faed33 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:22.482254 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ca207-c8f0-4315-8871-add369faed33 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:22.482364 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ca207-c8f0-4315-8871-add369faed33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:22.512939 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-3d0ca207-c8f0-4315-8871-add369faed33 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:26:22.514796 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3d0ca207-c8f0-4315-8871-add369faed33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:22.647993 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2439/4870] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:26:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:26:22.661525 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27643a68-8e5c-4446-899a-d3854db641c7 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:22.665570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-27643a68-8e5c-4446-899a-d3854db641c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:22.858082 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27643a68-8e5c-4446-899a-d3854db641c7 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:22.866824 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c041eea8-beb0-4d9e-ace3-f51cf773abbe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:22.873460 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041eea8-beb0-4d9e-ace3-f51cf773abbe service swift] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:22.873460 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041eea8-beb0-4d9e-ace3-f51cf773abbe service swift] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:22.873460 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041eea8-beb0-4d9e-ace3-f51cf773abbe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:22.882199 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c041eea8-beb0-4d9e-ace3-f51cf773abbe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:22.884875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c041eea8-beb0-4d9e-ace3-f51cf773abbe service swift] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:22.896782 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2432/4871] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:26:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:26:23.998135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ca207-c8f0-4315-8871-add369faed33 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:24.254164 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ca207-c8f0-4315-8871-add369faed33 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:24.271351 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a6a4c-5eb3-40c4-9e0e-a6304999ba00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:24.272599 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a6a4c-5eb3-40c4-9e0e-a6304999ba00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:24.273137 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a6a4c-5eb3-40c4-9e0e-a6304999ba00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:24.273598 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a6a4c-5eb3-40c4-9e0e-a6304999ba00 admin admin] PATH_INFO: `/v3/users/4ef301ea5e9b4d7ab998ecf1651aae13` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:24.275758 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a6a4c-5eb3-40c4-9e0e-a6304999ba00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ef301ea5e9b4d7ab998ecf1651aae13)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:24.277790 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a6a4c-5eb3-40c4-9e0e-a6304999ba00 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:24.720046 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1a9a6a4c-5eb3-40c4-9e0e-a6304999ba00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ef301ea5e9b4d7ab998ecf1651aae13'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:24.734557 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1a9a6a4c-5eb3-40c4-9e0e-a6304999ba00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ef301ea5e9b4d7ab998ecf1651aae13'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:24.815849 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1a9a6a4c-5eb3-40c4-9e0e-a6304999ba00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ef301ea5e9b4d7ab998ecf1651aae13'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:24.819058 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1a9a6a4c-5eb3-40c4-9e0e-a6304999ba00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ef301ea5e9b4d7ab998ecf1651aae13'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:24.843220 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1a9a6a4c-5eb3-40c4-9e0e-a6304999ba00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ef301ea5e9b4d7ab998ecf1651aae13'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:24.870834 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2440/4872] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:26:23 2022] DELETE /identity/v3/users/4ef301ea5e9b4d7ab998ecf1651aae13 => generated 0 bytes in 875 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:26:24.875352 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e299724-30d6-42d1-93ca-780eb831376d None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:24.876193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e299724-30d6-42d1-93ca-780eb831376d None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:24.876667 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e299724-30d6-42d1-93ca-780eb831376d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:24.910803 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-9e299724-30d6-42d1-93ca-780eb831376d None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:26:24.912116 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9e299724-30d6-42d1-93ca-780eb831376d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:25.090138 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2433/4873] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:26:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:26:25.102234 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a6a4c-5eb3-40c4-9e0e-a6304999ba00 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:25.104499 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1a9a6a4c-5eb3-40c4-9e0e-a6304999ba00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:25.197907 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a6a4c-5eb3-40c4-9e0e-a6304999ba00 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:25.202101 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7e9e9-4530-4757-88ca-03b985b93b11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:25.203238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7e9e9-4530-4757-88ca-03b985b93b11 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:25.203827 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7e9e9-4530-4757-88ca-03b985b93b11 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:25.204269 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7e9e9-4530-4757-88ca-03b985b93b11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:25.230504 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f7e9e9-4530-4757-88ca-03b985b93b11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:25.234222 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f7e9e9-4530-4757-88ca-03b985b93b11 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:25.260726 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2441/4874] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:26:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:26:25.882555 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e299724-30d6-42d1-93ca-780eb831376d None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:25.884023 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9e299724-30d6-42d1-93ca-780eb831376d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:25.905620 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e299724-30d6-42d1-93ca-780eb831376d None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:25.933937 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a34979-8477-4a1c-a5cf-200943ff142a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:25.935889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a34979-8477-4a1c-a5cf-200943ff142a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:25.938151 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a34979-8477-4a1c-a5cf-200943ff142a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:25.942610 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a34979-8477-4a1c-a5cf-200943ff142a admin admin] PATH_INFO: `/v3/projects/733603fc72e94d888b7bfbbfd909856b` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:25.948237 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a34979-8477-4a1c-a5cf-200943ff142a admin admin] RBAC: Authorizing `identity:delete_project(project_id=733603fc72e94d888b7bfbbfd909856b)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:25.955111 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a34979-8477-4a1c-a5cf-200943ff142a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:26.193361 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-66a34979-8477-4a1c-a5cf-200943ff142a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '733603fc72e94d888b7bfbbfd909856b', 'request_id': 'req-66a34979-8477-4a1c-a5cf-200943ff142a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:26.204561 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-66a34979-8477-4a1c-a5cf-200943ff142a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '733603fc72e94d888b7bfbbfd909856b', 'request_id': 'req-66a34979-8477-4a1c-a5cf-200943ff142a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:26.213132 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-66a34979-8477-4a1c-a5cf-200943ff142a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '733603fc72e94d888b7bfbbfd909856b', 'request_id': 'req-66a34979-8477-4a1c-a5cf-200943ff142a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:26.338196 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-66a34979-8477-4a1c-a5cf-200943ff142a admin admin] The token cache is being invalidate because project 733603fc72e94d888b7bfbbfd909856b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:26:26.342208 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-66a34979-8477-4a1c-a5cf-200943ff142a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:26.344162 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-66a34979-8477-4a1c-a5cf-200943ff142a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:26.347873 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2434/4875] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:26:25 2022] DELETE /identity/v3/projects/733603fc72e94d888b7bfbbfd909856b => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:26:26.352283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7e9e9-4530-4757-88ca-03b985b93b11 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:26.367145 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7e9e9-4530-4757-88ca-03b985b93b11 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:26.495888 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519a6a9-b8f6-4136-85d4-eb59ad6455b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:26.497206 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519a6a9-b8f6-4136-85d4-eb59ad6455b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:26.497790 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519a6a9-b8f6-4136-85d4-eb59ad6455b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:26.498542 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519a6a9-b8f6-4136-85d4-eb59ad6455b2 admin admin] PATH_INFO: `/v3/users/4ef412e138b74f2392c273fc29fb4655` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:26.501152 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e519a6a9-b8f6-4136-85d4-eb59ad6455b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ef412e138b74f2392c273fc29fb4655)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:26.507867 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e519a6a9-b8f6-4136-85d4-eb59ad6455b2 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:26.749801 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e519a6a9-b8f6-4136-85d4-eb59ad6455b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ef412e138b74f2392c273fc29fb4655'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:26.789831 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e519a6a9-b8f6-4136-85d4-eb59ad6455b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ef412e138b74f2392c273fc29fb4655'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:26.857678 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e519a6a9-b8f6-4136-85d4-eb59ad6455b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ef412e138b74f2392c273fc29fb4655'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:26.857678 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e519a6a9-b8f6-4136-85d4-eb59ad6455b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ef412e138b74f2392c273fc29fb4655'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:26.863287 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e519a6a9-b8f6-4136-85d4-eb59ad6455b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ef412e138b74f2392c273fc29fb4655'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:26.870211 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2442/4876] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:26:26 2022] DELETE /identity/v3/users/4ef412e138b74f2392c273fc29fb4655 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:26:27.784673 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a34979-8477-4a1c-a5cf-200943ff142a admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:27.786541 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-66a34979-8477-4a1c-a5cf-200943ff142a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:27.819973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a34979-8477-4a1c-a5cf-200943ff142a admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:28.002594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6226e3ed-510f-45e8-8c39-e4b9267ae923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:28.004146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226e3ed-510f-45e8-8c39-e4b9267ae923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:28.004660 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226e3ed-510f-45e8-8c39-e4b9267ae923 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:28.005364 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226e3ed-510f-45e8-8c39-e4b9267ae923 admin admin] PATH_INFO: `/v3/projects/b83c5e356eb84186924ccb0d76d0dcb8` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:28.007613 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6226e3ed-510f-45e8-8c39-e4b9267ae923 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b83c5e356eb84186924ccb0d76d0dcb8)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:28.011559 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6226e3ed-510f-45e8-8c39-e4b9267ae923 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:28.205505 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6226e3ed-510f-45e8-8c39-e4b9267ae923 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b83c5e356eb84186924ccb0d76d0dcb8', 'request_id': 'req-6226e3ed-510f-45e8-8c39-e4b9267ae923'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:28.222273 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6226e3ed-510f-45e8-8c39-e4b9267ae923 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b83c5e356eb84186924ccb0d76d0dcb8', 'request_id': 'req-6226e3ed-510f-45e8-8c39-e4b9267ae923'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:28.240360 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6226e3ed-510f-45e8-8c39-e4b9267ae923 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b83c5e356eb84186924ccb0d76d0dcb8', 'request_id': 'req-6226e3ed-510f-45e8-8c39-e4b9267ae923'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:28.308688 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6226e3ed-510f-45e8-8c39-e4b9267ae923 admin admin] The token cache is being invalidate because project b83c5e356eb84186924ccb0d76d0dcb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:26:28.308961 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6226e3ed-510f-45e8-8c39-e4b9267ae923 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:28.310745 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6226e3ed-510f-45e8-8c39-e4b9267ae923 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:28.314887 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2435/4877] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:26:27 2022] DELETE /identity/v3/projects/b83c5e356eb84186924ccb0d76d0dcb8 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:26:28.320749 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bf673-a11c-40f5-beed-53bd67e4b695 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:28.330073 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bf673-a11c-40f5-beed-53bd67e4b695 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:28.330073 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bf673-a11c-40f5-beed-53bd67e4b695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:28.358658 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-4a3bf673-a11c-40f5-beed-53bd67e4b695 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:26:28.361033 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4a3bf673-a11c-40f5-beed-53bd67e4b695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:28.474129 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2443/4878] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:26:28.482556 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe93ae5-bf01-4b0d-a0e3-9589ea1099a8 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:28.487481 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe93ae5-bf01-4b0d-a0e3-9589ea1099a8 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:28.487481 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe93ae5-bf01-4b0d-a0e3-9589ea1099a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:28.509166 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-dbe93ae5-bf01-4b0d-a0e3-9589ea1099a8 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:26:28.510646 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-dbe93ae5-bf01-4b0d-a0e3-9589ea1099a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:28.529748 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2436/4879] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:26:28.530525 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3bf673-a11c-40f5-beed-53bd67e4b695 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:28.545471 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3bf673-a11c-40f5-beed-53bd67e4b695 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:28.554753 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bdc68f-1357-4906-9f88-22d558711e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:28.555890 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdc68f-1357-4906-9f88-22d558711e3a admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:28.556334 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdc68f-1357-4906-9f88-22d558711e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:28.556797 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdc68f-1357-4906-9f88-22d558711e3a admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:28.558395 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bdc68f-1357-4906-9f88-22d558711e3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:26:28.559059 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bdc68f-1357-4906-9f88-22d558711e3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:28.561444 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bdc68f-1357-4906-9f88-22d558711e3a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:28.587901 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe93ae5-bf01-4b0d-a0e3-9589ea1099a8 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:28.598094 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2444/4880] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:26:28.602971 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe93ae5-bf01-4b0d-a0e3-9589ea1099a8 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:28.611222 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebc3a4-6e44-4a58-813a-a2cc953204d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:28.612177 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebc3a4-6e44-4a58-813a-a2cc953204d7 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:28.613016 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebc3a4-6e44-4a58-813a-a2cc953204d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:28.613016 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebc3a4-6e44-4a58-813a-a2cc953204d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:28.613823 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ebc3a4-6e44-4a58-813a-a2cc953204d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:28.617363 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ebc3a4-6e44-4a58-813a-a2cc953204d7 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:28.687026 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bdc68f-1357-4906-9f88-22d558711e3a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:28.690299 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-03bdc68f-1357-4906-9f88-22d558711e3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:28.714942 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bdc68f-1357-4906-9f88-22d558711e3a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:28.724911 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026d119-4162-4e0b-9de2-284e507548a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:28.727001 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026d119-4162-4e0b-9de2-284e507548a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:28.727784 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026d119-4162-4e0b-9de2-284e507548a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:28.728617 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026d119-4162-4e0b-9de2-284e507548a8 admin admin] PATH_INFO: `/v3/users/a466ad74049c4383af4a5f43f7023728` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:28.730972 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3026d119-4162-4e0b-9de2-284e507548a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a466ad74049c4383af4a5f43f7023728)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:28.735205 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3026d119-4162-4e0b-9de2-284e507548a8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:28.775980 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2437/4881] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:26:28 2022] POST /identity/v3/projects => generated 389 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:26:28.781889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebc3a4-6e44-4a58-813a-a2cc953204d7 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:28.883722 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebc3a4-6e44-4a58-813a-a2cc953204d7 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:28.888979 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7e86b-1c2f-4efc-a6d1-4d245bd9e7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:28.889976 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7e86b-1c2f-4efc-a6d1-4d245bd9e7c5 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:28.890486 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7e86b-1c2f-4efc-a6d1-4d245bd9e7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:28.890629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7e86b-1c2f-4efc-a6d1-4d245bd9e7c5 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:28.891338 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c7e86b-1c2f-4efc-a6d1-4d245bd9e7c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:28.893458 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c7e86b-1c2f-4efc-a6d1-4d245bd9e7c5 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:28.923248 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3026d119-4162-4e0b-9de2-284e507548a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a466ad74049c4383af4a5f43f7023728'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:28.947650 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3026d119-4162-4e0b-9de2-284e507548a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a466ad74049c4383af4a5f43f7023728'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:28.995375 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2438/4882] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:26:28 2022] POST /identity/v3/users => generated 295 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:26:28.996442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7e86b-1c2f-4efc-a6d1-4d245bd9e7c5 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:29.013364 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7e86b-1c2f-4efc-a6d1-4d245bd9e7c5 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:29.021171 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ddbf63-bf6d-462f-a170-d39bcce13a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:29.026303 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddbf63-bf6d-462f-a170-d39bcce13a35 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:29.026303 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddbf63-bf6d-462f-a170-d39bcce13a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:29.026303 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddbf63-bf6d-462f-a170-d39bcce13a35 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:29.026303 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ddbf63-bf6d-462f-a170-d39bcce13a35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:29.026303 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ddbf63-bf6d-462f-a170-d39bcce13a35 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:29.037678 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2439/4883] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:26:29.042288 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ddbf63-bf6d-462f-a170-d39bcce13a35 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:29.050268 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3026d119-4162-4e0b-9de2-284e507548a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a466ad74049c4383af4a5f43f7023728'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:29.051055 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3026d119-4162-4e0b-9de2-284e507548a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a466ad74049c4383af4a5f43f7023728'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:29.065253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ddbf63-bf6d-462f-a170-d39bcce13a35 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:29.068746 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3026d119-4162-4e0b-9de2-284e507548a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a466ad74049c4383af4a5f43f7023728'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:29.072432 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34521b2d-9a96-4ac2-a5fc-01da75d3dc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:29.073507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34521b2d-9a96-4ac2-a5fc-01da75d3dc4a admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:29.073908 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34521b2d-9a96-4ac2-a5fc-01da75d3dc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:29.074255 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34521b2d-9a96-4ac2-a5fc-01da75d3dc4a admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:29.076556 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34521b2d-9a96-4ac2-a5fc-01da75d3dc4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:29.079765 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34521b2d-9a96-4ac2-a5fc-01da75d3dc4a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:29.082782 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2445/4884] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:26:28 2022] DELETE /identity/v3/users/a466ad74049c4383af4a5f43f7023728 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:26:29.126716 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2440/4885] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:26:29.128422 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026d119-4162-4e0b-9de2-284e507548a8 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:29.130261 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3026d119-4162-4e0b-9de2-284e507548a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:29.316703 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026d119-4162-4e0b-9de2-284e507548a8 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:29.334520 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae82e1e-a100-4e92-8898-919cd18d2b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:29.335452 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae82e1e-a100-4e92-8898-919cd18d2b32 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:29.335740 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae82e1e-a100-4e92-8898-919cd18d2b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:29.336017 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae82e1e-a100-4e92-8898-919cd18d2b32 admin admin] PATH_INFO: `/v3/projects/0ff84f661fc74cdb8031d8e2ff51e220/users/5482b248f58744a99762f2dd1d48baf3/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:29.382408 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae82e1e-a100-4e92-8898-919cd18d2b32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ff84f661fc74cdb8031d8e2ff51e220, user_id=5482b248f58744a99762f2dd1d48baf3, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:29.386950 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae82e1e-a100-4e92-8898-919cd18d2b32 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:29.501369 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2446/4886] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:26:29 2022] PUT /identity/v3/projects/0ff84f661fc74cdb8031d8e2ff51e220/users/5482b248f58744a99762f2dd1d48baf3/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:26:29.521139 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001e50b-4b3b-4a07-b65b-943fa1ff9583 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:29.521372 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001e50b-4b3b-4a07-b65b-943fa1ff9583 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:29.522300 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001e50b-4b3b-4a07-b65b-943fa1ff9583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:29.547722 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae82e1e-a100-4e92-8898-919cd18d2b32 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:29.555331 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1ae82e1e-a100-4e92-8898-919cd18d2b32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:29.623910 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-e001e50b-4b3b-4a07-b65b-943fa1ff9583 None None] MFA Rules not processed for user `5482b248f58744a99762f2dd1d48baf3`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:26:29.625365 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e001e50b-4b3b-4a07-b65b-943fa1ff9583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:29.709920 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae82e1e-a100-4e92-8898-919cd18d2b32 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:29.715378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be712b9-90ba-4462-afa6-57727fddc938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:29.717062 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be712b9-90ba-4462-afa6-57727fddc938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:29.717510 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be712b9-90ba-4462-afa6-57727fddc938 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:29.718042 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be712b9-90ba-4462-afa6-57727fddc938 admin admin] PATH_INFO: `/v3/projects/1236f389e69047b8add7cbc7cefe8f24` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:29.719441 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be712b9-90ba-4462-afa6-57727fddc938 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1236f389e69047b8add7cbc7cefe8f24)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:29.721927 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be712b9-90ba-4462-afa6-57727fddc938 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:29.764787 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2441/4887] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:26:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:26:29.770906 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001e50b-4b3b-4a07-b65b-943fa1ff9583 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:29.792648 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001e50b-4b3b-4a07-b65b-943fa1ff9583 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:29.801479 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2958e-02d1-4419-b9e7-723dc33fd54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:29.802674 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2958e-02d1-4419-b9e7-723dc33fd54d admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:29.803028 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2958e-02d1-4419-b9e7-723dc33fd54d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:29.803532 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2958e-02d1-4419-b9e7-723dc33fd54d admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:29.804552 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2958e-02d1-4419-b9e7-723dc33fd54d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:29.808075 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2958e-02d1-4419-b9e7-723dc33fd54d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:29.914041 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2442/4888] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:26:29 2022] POST /identity/v3/projects => generated 393 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:26:29.914901 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8be712b9-90ba-4462-afa6-57727fddc938 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1236f389e69047b8add7cbc7cefe8f24', 'request_id': 'req-8be712b9-90ba-4462-afa6-57727fddc938'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:29.918298 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2958e-02d1-4419-b9e7-723dc33fd54d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:29.923651 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8be712b9-90ba-4462-afa6-57727fddc938 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1236f389e69047b8add7cbc7cefe8f24', 'request_id': 'req-8be712b9-90ba-4462-afa6-57727fddc938'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:29.936008 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8be712b9-90ba-4462-afa6-57727fddc938 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1236f389e69047b8add7cbc7cefe8f24', 'request_id': 'req-8be712b9-90ba-4462-afa6-57727fddc938'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:30.077129 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2958e-02d1-4419-b9e7-723dc33fd54d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:30.087464 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d1fae2-d156-4a82-9b9e-b9553fbac413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:30.088278 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1fae2-d156-4a82-9b9e-b9553fbac413 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:30.088565 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1fae2-d156-4a82-9b9e-b9553fbac413 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:30.088847 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1fae2-d156-4a82-9b9e-b9553fbac413 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:30.089555 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d1fae2-d156-4a82-9b9e-b9553fbac413 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:30.100366 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d1fae2-d156-4a82-9b9e-b9553fbac413 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:30.167641 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8be712b9-90ba-4462-afa6-57727fddc938 admin admin] The token cache is being invalidate because project 1236f389e69047b8add7cbc7cefe8f24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:26:30.167935 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8be712b9-90ba-4462-afa6-57727fddc938 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:30.170706 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8be712b9-90ba-4462-afa6-57727fddc938 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:30.172492 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2447/4889] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:26:29 2022] DELETE /identity/v3/projects/1236f389e69047b8add7cbc7cefe8f24 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:26:30.177705 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8f886-1937-4f89-a25c-83228d6aca00 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:30.197738 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8f886-1937-4f89-a25c-83228d6aca00 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:30.197738 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8f886-1937-4f89-a25c-83228d6aca00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:30.204614 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-faa8f886-1937-4f89-a25c-83228d6aca00 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:26:30.206119 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-faa8f886-1937-4f89-a25c-83228d6aca00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:30.226879 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2448/4890] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:26:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:26:30.228952 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154945be-1957-4eab-8f1a-1a5dcc5f736a None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:30.229413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154945be-1957-4eab-8f1a-1a5dcc5f736a None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:30.229945 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154945be-1957-4eab-8f1a-1a5dcc5f736a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:30.263034 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-154945be-1957-4eab-8f1a-1a5dcc5f736a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:26:30.265982 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-154945be-1957-4eab-8f1a-1a5dcc5f736a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:30.277809 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2449/4891] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:26:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:26:30.283474 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154945be-1957-4eab-8f1a-1a5dcc5f736a None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:30.306692 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154945be-1957-4eab-8f1a-1a5dcc5f736a None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:30.314172 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a537936-8220-4eff-b875-bfb8e1cf11a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:30.314989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a537936-8220-4eff-b875-bfb8e1cf11a6 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:30.315403 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a537936-8220-4eff-b875-bfb8e1cf11a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:30.315785 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a537936-8220-4eff-b875-bfb8e1cf11a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:30.316992 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a537936-8220-4eff-b875-bfb8e1cf11a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:26:30.317555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a537936-8220-4eff-b875-bfb8e1cf11a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:30.319606 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a537936-8220-4eff-b875-bfb8e1cf11a6 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:30.338476 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2450/4892] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:26:30.342729 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a537936-8220-4eff-b875-bfb8e1cf11a6 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:30.374757 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a537936-8220-4eff-b875-bfb8e1cf11a6 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:30.379581 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5facf67-b3dc-490a-85c3-26ae49438ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:30.380363 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5facf67-b3dc-490a-85c3-26ae49438ea5 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:30.380650 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5facf67-b3dc-490a-85c3-26ae49438ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:30.380926 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5facf67-b3dc-490a-85c3-26ae49438ea5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:30.383780 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5facf67-b3dc-490a-85c3-26ae49438ea5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:30.385802 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5facf67-b3dc-490a-85c3-26ae49438ea5 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:30.563993 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2443/4893] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:26:29 2022] POST /identity/v3/users => generated 303 bytes in 643 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:26:30.565542 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d1fae2-d156-4a82-9b9e-b9553fbac413 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:30.569430 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-18d1fae2-d156-4a82-9b9e-b9553fbac413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:30.589240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d1fae2-d156-4a82-9b9e-b9553fbac413 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:30.597072 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157e010-ebf7-4f9d-8a01-0c122fadc89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:30.597899 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157e010-ebf7-4f9d-8a01-0c122fadc89d admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:30.598251 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157e010-ebf7-4f9d-8a01-0c122fadc89d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:30.598705 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157e010-ebf7-4f9d-8a01-0c122fadc89d admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:30.599802 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8157e010-ebf7-4f9d-8a01-0c122fadc89d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:30.601182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8157e010-ebf7-4f9d-8a01-0c122fadc89d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:30.625814 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2444/4894] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:26:30.632102 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2451/4895] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:26:30 2022] POST /identity/v3/projects => generated 397 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:26:30.633538 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5facf67-b3dc-490a-85c3-26ae49438ea5 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:30.637461 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157e010-ebf7-4f9d-8a01-0c122fadc89d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:30.688178 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157e010-ebf7-4f9d-8a01-0c122fadc89d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:30.767129 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5facf67-b3dc-490a-85c3-26ae49438ea5 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:30.774123 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df172b2f-7f3c-499e-b0a3-377fc08d3588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:30.775491 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df172b2f-7f3c-499e-b0a3-377fc08d3588 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:30.775491 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df172b2f-7f3c-499e-b0a3-377fc08d3588 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:30.775950 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df172b2f-7f3c-499e-b0a3-377fc08d3588 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:30.780774 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df172b2f-7f3c-499e-b0a3-377fc08d3588 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:30.795181 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df172b2f-7f3c-499e-b0a3-377fc08d3588 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:30.836796 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8586b9-4e88-4c75-a369-0e602d41dd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:30.838008 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8586b9-4e88-4c75-a369-0e602d41dd56 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:30.838590 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8586b9-4e88-4c75-a369-0e602d41dd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:30.839189 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8586b9-4e88-4c75-a369-0e602d41dd56 admin admin] PATH_INFO: `/v3/projects/d31fa382065d4ab984847ff2942c7ca0/users/5f811c8834d849168849e7394cb14852/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:30.863636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8586b9-4e88-4c75-a369-0e602d41dd56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d31fa382065d4ab984847ff2942c7ca0, user_id=5f811c8834d849168849e7394cb14852, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:30.867399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8586b9-4e88-4c75-a369-0e602d41dd56 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:31.107941 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2452/4896] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:26:30 2022] POST /identity/v3/users => generated 299 bytes in 472 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:26:31.109464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df172b2f-7f3c-499e-b0a3-377fc08d3588 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:31.120063 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df172b2f-7f3c-499e-b0a3-377fc08d3588 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:31.120381 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2445/4897] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:26:30 2022] PUT /identity/v3/projects/d31fa382065d4ab984847ff2942c7ca0/users/5f811c8834d849168849e7394cb14852/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:26:31.125275 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8586b9-4e88-4c75-a369-0e602d41dd56 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:31.208907 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8586b9-4e88-4c75-a369-0e602d41dd56 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:31.217407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ceca3-5c92-4ba9-a724-6f1688bfc3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:31.218252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ceca3-5c92-4ba9-a724-6f1688bfc3e3 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:31.218825 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ceca3-5c92-4ba9-a724-6f1688bfc3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:31.219210 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ceca3-5c92-4ba9-a724-6f1688bfc3e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:31.220189 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ceca3-5c92-4ba9-a724-6f1688bfc3e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:31.222107 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ceca3-5c92-4ba9-a724-6f1688bfc3e3 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:31.238437 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2446/4898] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:26:31.239416 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ceca3-5c92-4ba9-a724-6f1688bfc3e3 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:31.252677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ceca3-5c92-4ba9-a724-6f1688bfc3e3 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:31.258111 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7e395-f0bb-4714-9c99-be7f4232dac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:31.259351 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7e395-f0bb-4714-9c99-be7f4232dac6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:31.259741 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7e395-f0bb-4714-9c99-be7f4232dac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:31.260651 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7e395-f0bb-4714-9c99-be7f4232dac6 admin admin] PATH_INFO: `/v3/projects/d31fa382065d4ab984847ff2942c7ca0/users/5f811c8834d849168849e7394cb14852/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:31.262863 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b7e395-f0bb-4714-9c99-be7f4232dac6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d31fa382065d4ab984847ff2942c7ca0, user_id=5f811c8834d849168849e7394cb14852, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:31.266510 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b7e395-f0bb-4714-9c99-be7f4232dac6 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:31.291816 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2447/4899] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:26:31 2022] PUT /identity/v3/projects/d31fa382065d4ab984847ff2942c7ca0/users/5f811c8834d849168849e7394cb14852/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:26:31.294729 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f33c16-ff95-4ba8-91fb-c896d86f86f8 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:31.295840 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ea5f4-3e56-47bf-89e3-56248ef5f350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:31.295974 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f33c16-ff95-4ba8-91fb-c896d86f86f8 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:31.295974 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f33c16-ff95-4ba8-91fb-c896d86f86f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:31.296904 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ea5f4-3e56-47bf-89e3-56248ef5f350 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:31.297365 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ea5f4-3e56-47bf-89e3-56248ef5f350 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:31.297880 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ea5f4-3e56-47bf-89e3-56248ef5f350 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:31.299039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ea5f4-3e56-47bf-89e3-56248ef5f350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:31.303646 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ea5f4-3e56-47bf-89e3-56248ef5f350 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:31.329028 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2453/4900] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:26:31.332765 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-21f33c16-ff95-4ba8-91fb-c896d86f86f8 None None] MFA Rules not processed for user `5f811c8834d849168849e7394cb14852`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:26:31.334525 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-21f33c16-ff95-4ba8-91fb-c896d86f86f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:31.340435 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ea5f4-3e56-47bf-89e3-56248ef5f350 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:31.357799 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ea5f4-3e56-47bf-89e3-56248ef5f350 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:31.425736 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2448/4901] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:26:31 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:26:31.447228 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f33c16-ff95-4ba8-91fb-c896d86f86f8 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:31.449002 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-21f33c16-ff95-4ba8-91fb-c896d86f86f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:31.472899 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2316a0-ff7f-4709-999a-2b444de0cb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:31.473597 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2316a0-ff7f-4709-999a-2b444de0cb98 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:31.473969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2316a0-ff7f-4709-999a-2b444de0cb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:31.474395 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2316a0-ff7f-4709-999a-2b444de0cb98 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:31.476031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2316a0-ff7f-4709-999a-2b444de0cb98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:31.482147 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2316a0-ff7f-4709-999a-2b444de0cb98 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:31.500190 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2454/4902] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:26:31.504412 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2316a0-ff7f-4709-999a-2b444de0cb98 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:31.516162 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2316a0-ff7f-4709-999a-2b444de0cb98 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:31.523153 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f33c16-ff95-4ba8-91fb-c896d86f86f8 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:31.524550 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d523b-89e9-4365-98ba-5f323aa674b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:31.525170 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d523b-89e9-4365-98ba-5f323aa674b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:31.525745 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d523b-89e9-4365-98ba-5f323aa674b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:31.526166 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d523b-89e9-4365-98ba-5f323aa674b4 admin admin] PATH_INFO: `/v3/projects/730b9a65aee24d6182ddd0f3be637473/users/0ca3355d0bd24c23876d7edf4f05a92d/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:31.527286 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d77db7-97f0-47ed-b682-dc457cf670b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:31.527976 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d77db7-97f0-47ed-b682-dc457cf670b5 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:31.528261 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d77db7-97f0-47ed-b682-dc457cf670b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:31.528557 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d77db7-97f0-47ed-b682-dc457cf670b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:31.541492 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d77db7-97f0-47ed-b682-dc457cf670b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:31.543807 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d77db7-97f0-47ed-b682-dc457cf670b5 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:31.560226 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2449/4903] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:26:31 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:26:31.560452 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d523b-89e9-4365-98ba-5f323aa674b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=730b9a65aee24d6182ddd0f3be637473, user_id=0ca3355d0bd24c23876d7edf4f05a92d, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:31.563723 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d523b-89e9-4365-98ba-5f323aa674b4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:31.691533 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1a380-7109-467d-8aea-f905b06196e4 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:31.695787 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2455/4904] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:26:31 2022] PUT /identity/v3/projects/730b9a65aee24d6182ddd0f3be637473/users/0ca3355d0bd24c23876d7edf4f05a92d/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:26:31.695981 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1a380-7109-467d-8aea-f905b06196e4 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:31.695981 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1a380-7109-467d-8aea-f905b06196e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:31.746563 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-94d1a380-7109-467d-8aea-f905b06196e4 None None] MFA Rules not processed for user `0ca3355d0bd24c23876d7edf4f05a92d`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:26:31.749474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-94d1a380-7109-467d-8aea-f905b06196e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:31.850059 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2450/4905] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:26:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:26:31.862910 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e3ddde-3cd6-4093-b94c-77da259d27bf None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:31.863290 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e3ddde-3cd6-4093-b94c-77da259d27bf None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:31.863591 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e3ddde-3cd6-4093-b94c-77da259d27bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:31.886751 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-d0e3ddde-3cd6-4093-b94c-77da259d27bf None None] MFA Rules not processed for user `0ca3355d0bd24c23876d7edf4f05a92d`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:26:31.888866 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d0e3ddde-3cd6-4093-b94c-77da259d27bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:31.898903 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2456/4906] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:26:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:26:31.912909 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1a380-7109-467d-8aea-f905b06196e4 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:31.914929 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-94d1a380-7109-467d-8aea-f905b06196e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:32.015511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1a380-7109-467d-8aea-f905b06196e4 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:32.022138 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc363c-d04d-4bb7-ae69-9d973e5caf92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:32.023084 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc363c-d04d-4bb7-ae69-9d973e5caf92 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:32.023561 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc363c-d04d-4bb7-ae69-9d973e5caf92 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:32.024005 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc363c-d04d-4bb7-ae69-9d973e5caf92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:32.046767 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc363c-d04d-4bb7-ae69-9d973e5caf92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:32.050687 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc363c-d04d-4bb7-ae69-9d973e5caf92 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:32.080053 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2451/4907] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:26:31 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:26:32.095506 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32b898-b568-43f5-bc9b-35bcd624b437 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:32.096071 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32b898-b568-43f5-bc9b-35bcd624b437 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:32.096429 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb32b898-b568-43f5-bc9b-35bcd624b437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:32.131555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-bb32b898-b568-43f5-bc9b-35bcd624b437 None None] MFA Rules not processed for user `0ca3355d0bd24c23876d7edf4f05a92d`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:26:32.132498 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-bb32b898-b568-43f5-bc9b-35bcd624b437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:32.152814 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2457/4908] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:26:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:26:32.189372 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c032073-0278-4df1-9bdd-cd90224f2762 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:32.190633 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c032073-0278-4df1-9bdd-cd90224f2762 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:32.191151 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c032073-0278-4df1-9bdd-cd90224f2762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:32.236577 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-9c032073-0278-4df1-9bdd-cd90224f2762 None None] MFA Rules not processed for user `0ca3355d0bd24c23876d7edf4f05a92d`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:26:32.239829 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9c032073-0278-4df1-9bdd-cd90224f2762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:32.261222 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2452/4909] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:26:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:26:33.187101 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff8858-2e47-4aca-aaf7-a823d6ae2d0d None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:33.189539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff8858-2e47-4aca-aaf7-a823d6ae2d0d None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:33.189539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff8858-2e47-4aca-aaf7-a823d6ae2d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:33.216533 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-faff8858-2e47-4aca-aaf7-a823d6ae2d0d None None] MFA Rules not processed for user `0ca3355d0bd24c23876d7edf4f05a92d`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:26:33.229493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-faff8858-2e47-4aca-aaf7-a823d6ae2d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:33.230610 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2458/4910] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:26:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:26:33.270853 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8d16e-eb3d-4ed8-a232-76c9d8bcaafd None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:33.271409 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8d16e-eb3d-4ed8-a232-76c9d8bcaafd None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:33.271409 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8d16e-eb3d-4ed8-a232-76c9d8bcaafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:33.312740 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-57b8d16e-eb3d-4ed8-a232-76c9d8bcaafd None None] MFA Rules not processed for user `0ca3355d0bd24c23876d7edf4f05a92d`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:26:33.314157 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-57b8d16e-eb3d-4ed8-a232-76c9d8bcaafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:33.322636 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2453/4911] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:26:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:26:33.343278 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff8858-2e47-4aca-aaf7-a823d6ae2d0d None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:33.459850 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff8858-2e47-4aca-aaf7-a823d6ae2d0d None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:33.466262 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23216073-1ffb-42df-a836-6333ad1fd802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:33.472411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23216073-1ffb-42df-a836-6333ad1fd802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:33.472411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23216073-1ffb-42df-a836-6333ad1fd802 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:33.472411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23216073-1ffb-42df-a836-6333ad1fd802 admin admin] PATH_INFO: `/v3/users/0ca3355d0bd24c23876d7edf4f05a92d` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:33.472411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23216073-1ffb-42df-a836-6333ad1fd802 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ca3355d0bd24c23876d7edf4f05a92d)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:33.472411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23216073-1ffb-42df-a836-6333ad1fd802 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:33.719546 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-23216073-1ffb-42df-a836-6333ad1fd802 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ca3355d0bd24c23876d7edf4f05a92d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:33.731456 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-23216073-1ffb-42df-a836-6333ad1fd802 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ca3355d0bd24c23876d7edf4f05a92d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:33.796702 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-23216073-1ffb-42df-a836-6333ad1fd802 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ca3355d0bd24c23876d7edf4f05a92d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:33.797721 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-23216073-1ffb-42df-a836-6333ad1fd802 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ca3355d0bd24c23876d7edf4f05a92d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:33.806228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-23216073-1ffb-42df-a836-6333ad1fd802 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ca3355d0bd24c23876d7edf4f05a92d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:33.813038 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2459/4912] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:26:33 2022] DELETE /identity/v3/users/0ca3355d0bd24c23876d7edf4f05a92d => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:26:33.817585 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df480c-708a-437e-b405-45fac4cb1afb None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:33.818364 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df480c-708a-437e-b405-45fac4cb1afb None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:33.818651 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df480c-708a-437e-b405-45fac4cb1afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:33.837052 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-87df480c-708a-437e-b405-45fac4cb1afb None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:26:33.838370 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-87df480c-708a-437e-b405-45fac4cb1afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:33.914946 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2454/4913] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:26:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:26:33.925476 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23216073-1ffb-42df-a836-6333ad1fd802 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:33.927039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-23216073-1ffb-42df-a836-6333ad1fd802 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:33.990278 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23216073-1ffb-42df-a836-6333ad1fd802 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:33.993919 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3fd357-4b50-4d97-a705-cce4f6b8fdd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:33.994577 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3fd357-4b50-4d97-a705-cce4f6b8fdd1 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:33.994864 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3fd357-4b50-4d97-a705-cce4f6b8fdd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:33.995140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3fd357-4b50-4d97-a705-cce4f6b8fdd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:34.005626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3fd357-4b50-4d97-a705-cce4f6b8fdd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:34.007132 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3fd357-4b50-4d97-a705-cce4f6b8fdd1 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:34.018316 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2460/4914] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:26:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:26:34.782227 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df480c-708a-437e-b405-45fac4cb1afb None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:34.783947 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-87df480c-708a-437e-b405-45fac4cb1afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:34.797319 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df480c-708a-437e-b405-45fac4cb1afb None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:34.802198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a072ba-5d44-4e65-b448-e1560a7de119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:34.804266 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a072ba-5d44-4e65-b448-e1560a7de119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:34.804266 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a072ba-5d44-4e65-b448-e1560a7de119 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:34.804266 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a072ba-5d44-4e65-b448-e1560a7de119 admin admin] PATH_INFO: `/v3/projects/730b9a65aee24d6182ddd0f3be637473` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:34.805332 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a072ba-5d44-4e65-b448-e1560a7de119 admin admin] RBAC: Authorizing `identity:delete_project(project_id=730b9a65aee24d6182ddd0f3be637473)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:34.807310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a072ba-5d44-4e65-b448-e1560a7de119 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:34.910757 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-71a072ba-5d44-4e65-b448-e1560a7de119 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '730b9a65aee24d6182ddd0f3be637473', 'request_id': 'req-71a072ba-5d44-4e65-b448-e1560a7de119'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:34.916000 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-71a072ba-5d44-4e65-b448-e1560a7de119 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '730b9a65aee24d6182ddd0f3be637473', 'request_id': 'req-71a072ba-5d44-4e65-b448-e1560a7de119'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:34.922907 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-71a072ba-5d44-4e65-b448-e1560a7de119 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '730b9a65aee24d6182ddd0f3be637473', 'request_id': 'req-71a072ba-5d44-4e65-b448-e1560a7de119'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:35.014942 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-71a072ba-5d44-4e65-b448-e1560a7de119 admin admin] The token cache is being invalidate because project 730b9a65aee24d6182ddd0f3be637473 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:26:35.019740 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-71a072ba-5d44-4e65-b448-e1560a7de119 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:35.019740 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-71a072ba-5d44-4e65-b448-e1560a7de119 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:35.019740 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2455/4915] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:26:34 2022] DELETE /identity/v3/projects/730b9a65aee24d6182ddd0f3be637473 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:26:35.022458 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaea239-ac44-4398-a907-307974607eb8 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:35.023007 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaea239-ac44-4398-a907-307974607eb8 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:35.023007 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaea239-ac44-4398-a907-307974607eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:35.041131 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-caaea239-ac44-4398-a907-307974607eb8 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:26:35.048547 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-caaea239-ac44-4398-a907-307974607eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:35.102074 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2461/4916] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:26:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:26:35.110382 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef0fc8-dfc4-4154-917c-d577811f65c6 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:35.110676 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef0fc8-dfc4-4154-917c-d577811f65c6 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:35.110961 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef0fc8-dfc4-4154-917c-d577811f65c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:35.132741 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-91ef0fc8-dfc4-4154-917c-d577811f65c6 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:26:35.134166 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-91ef0fc8-dfc4-4154-917c-d577811f65c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:35.144586 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2456/4917] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:26:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:26:35.149107 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaea239-ac44-4398-a907-307974607eb8 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:35.162264 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaea239-ac44-4398-a907-307974607eb8 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:35.170087 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbafe88-73cc-424e-858f-262f13e64be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:35.171287 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbafe88-73cc-424e-858f-262f13e64be0 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:35.171733 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbafe88-73cc-424e-858f-262f13e64be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:35.172201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbafe88-73cc-424e-858f-262f13e64be0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:35.173084 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbafe88-73cc-424e-858f-262f13e64be0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:26:35.173572 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbafe88-73cc-424e-858f-262f13e64be0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:35.175454 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbafe88-73cc-424e-858f-262f13e64be0 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:35.191300 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2462/4918] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:26:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:26:35.195577 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef0fc8-dfc4-4154-917c-d577811f65c6 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:35.205109 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef0fc8-dfc4-4154-917c-d577811f65c6 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:35.210104 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0422872-2fd0-49d3-9f3d-643df6eec51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:35.211012 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0422872-2fd0-49d3-9f3d-643df6eec51c admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:35.211295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0422872-2fd0-49d3-9f3d-643df6eec51c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:35.211568 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0422872-2fd0-49d3-9f3d-643df6eec51c admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:35.212410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0422872-2fd0-49d3-9f3d-643df6eec51c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:35.214399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0422872-2fd0-49d3-9f3d-643df6eec51c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:35.338518 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2457/4919] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:26:35 2022] POST /identity/v3/projects => generated 395 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:26:35.343398 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbafe88-73cc-424e-858f-262f13e64be0 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:35.354709 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbafe88-73cc-424e-858f-262f13e64be0 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:35.456474 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ea6e3-6e73-4e19-8d65-73de400b2faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:35.457271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ea6e3-6e73-4e19-8d65-73de400b2faa admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:35.457627 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ea6e3-6e73-4e19-8d65-73de400b2faa admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:35.458064 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ea6e3-6e73-4e19-8d65-73de400b2faa admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:35.458761 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6ea6e3-6e73-4e19-8d65-73de400b2faa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:35.460774 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6ea6e3-6e73-4e19-8d65-73de400b2faa admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:35.552687 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2463/4920] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:26:35 2022] POST /identity/v3/users => generated 298 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:26:35.557066 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0422872-2fd0-49d3-9f3d-643df6eec51c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:35.569393 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0422872-2fd0-49d3-9f3d-643df6eec51c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:35.574884 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b78095-1135-45be-9948-f3616ef80f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:35.575440 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b78095-1135-45be-9948-f3616ef80f3b admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:35.575716 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b78095-1135-45be-9948-f3616ef80f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:35.575990 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b78095-1135-45be-9948-f3616ef80f3b admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:35.576742 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b78095-1135-45be-9948-f3616ef80f3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:35.578391 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b78095-1135-45be-9948-f3616ef80f3b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:35.591058 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2458/4921] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:26:35.594979 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ea6e3-6e73-4e19-8d65-73de400b2faa admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:35.605121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ea6e3-6e73-4e19-8d65-73de400b2faa admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:35.610989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f8b9d-86f8-4ca3-8e57-55e1bbff3ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:35.611934 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f8b9d-86f8-4ca3-8e57-55e1bbff3ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:35.612430 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f8b9d-86f8-4ca3-8e57-55e1bbff3ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:35.612894 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f8b9d-86f8-4ca3-8e57-55e1bbff3ad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:35.614684 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f8b9d-86f8-4ca3-8e57-55e1bbff3ad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:35.616512 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f8b9d-86f8-4ca3-8e57-55e1bbff3ad6 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:35.632241 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2464/4922] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:26:35.633037 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b78095-1135-45be-9948-f3616ef80f3b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:35.648926 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b78095-1135-45be-9948-f3616ef80f3b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:35.650830 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f8b9d-86f8-4ca3-8e57-55e1bbff3ad6 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:35.654472 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ee6f0-fa78-4557-9d21-cfde53ad49a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:35.655432 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ee6f0-fa78-4557-9d21-cfde53ad49a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:35.655719 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ee6f0-fa78-4557-9d21-cfde53ad49a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:35.656004 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ee6f0-fa78-4557-9d21-cfde53ad49a8 admin admin] PATH_INFO: `/v3/projects/acd535df3826485d8472597a6258a56c/users/582d05a237ba4a1a95ba93474fd4a978/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:35.658849 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-878f8b9d-86f8-4ca3-8e57-55e1bbff3ad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:35.677017 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f8b9d-86f8-4ca3-8e57-55e1bbff3ad6 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:35.682041 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28ee6f0-fa78-4557-9d21-cfde53ad49a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acd535df3826485d8472597a6258a56c, user_id=582d05a237ba4a1a95ba93474fd4a978, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:35.683444 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933e439-259c-4435-9af1-e199b1891a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:35.684894 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933e439-259c-4435-9af1-e199b1891a82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:35.685258 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933e439-259c-4435-9af1-e199b1891a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:35.685734 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933e439-259c-4435-9af1-e199b1891a82 admin admin] PATH_INFO: `/v3/users/5482b248f58744a99762f2dd1d48baf3` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:35.687190 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d933e439-259c-4435-9af1-e199b1891a82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5482b248f58744a99762f2dd1d48baf3)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:35.689006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28ee6f0-fa78-4557-9d21-cfde53ad49a8 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:35.689249 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d933e439-259c-4435-9af1-e199b1891a82 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:35.836922 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2459/4923] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:26:35 2022] PUT /identity/v3/projects/acd535df3826485d8472597a6258a56c/users/582d05a237ba4a1a95ba93474fd4a978/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:26:35.841424 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149f174-8f70-4bae-a0e7-9848bb500507 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:35.842155 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149f174-8f70-4bae-a0e7-9848bb500507 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:35.842614 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149f174-8f70-4bae-a0e7-9848bb500507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:35.860042 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-c149f174-8f70-4bae-a0e7-9848bb500507 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:26:35.861445 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c149f174-8f70-4bae-a0e7-9848bb500507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:35.925242 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2460/4924] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:26:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:26:35.940318 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149f174-8f70-4bae-a0e7-9848bb500507 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:35.941802 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c149f174-8f70-4bae-a0e7-9848bb500507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:35.988577 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d933e439-259c-4435-9af1-e199b1891a82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5482b248f58744a99762f2dd1d48baf3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:36.001809 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d933e439-259c-4435-9af1-e199b1891a82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5482b248f58744a99762f2dd1d48baf3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:36.002644 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149f174-8f70-4bae-a0e7-9848bb500507 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:36.006733 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5929d05-b3e1-4de6-b144-1592908ec62e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:36.007508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5929d05-b3e1-4de6-b144-1592908ec62e service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:36.007901 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5929d05-b3e1-4de6-b144-1592908ec62e service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:36.008315 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5929d05-b3e1-4de6-b144-1592908ec62e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:36.023558 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5929d05-b3e1-4de6-b144-1592908ec62e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:36.025571 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5929d05-b3e1-4de6-b144-1592908ec62e service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:36.037329 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2461/4925] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:26:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:26:36.180267 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d933e439-259c-4435-9af1-e199b1891a82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5482b248f58744a99762f2dd1d48baf3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:36.180901 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d933e439-259c-4435-9af1-e199b1891a82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5482b248f58744a99762f2dd1d48baf3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:36.188782 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d933e439-259c-4435-9af1-e199b1891a82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5482b248f58744a99762f2dd1d48baf3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:36.195274 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2465/4926] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:26:35 2022] DELETE /identity/v3/users/5482b248f58744a99762f2dd1d48baf3 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:26:36.200673 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027904e-b1ee-42ee-ab0c-1389f7b699c3 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:36.200970 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027904e-b1ee-42ee-ab0c-1389f7b699c3 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:36.201255 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027904e-b1ee-42ee-ab0c-1389f7b699c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:36.220411 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-3027904e-b1ee-42ee-ab0c-1389f7b699c3 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:26:36.221724 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3027904e-b1ee-42ee-ab0c-1389f7b699c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:36.297780 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2462/4927] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:26:36.314493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933e439-259c-4435-9af1-e199b1891a82 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:36.317817 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d933e439-259c-4435-9af1-e199b1891a82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:36.380136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933e439-259c-4435-9af1-e199b1891a82 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:36.383807 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa627ec-0cb3-4b97-90ec-cb92ec92cd9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:36.384467 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa627ec-0cb3-4b97-90ec-cb92ec92cd9f service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:36.384782 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa627ec-0cb3-4b97-90ec-cb92ec92cd9f service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:36.385055 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa627ec-0cb3-4b97-90ec-cb92ec92cd9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:36.398975 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa627ec-0cb3-4b97-90ec-cb92ec92cd9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:36.400527 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa627ec-0cb3-4b97-90ec-cb92ec92cd9f service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:36.411225 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2466/4928] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:26:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:26:36.863298 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027904e-b1ee-42ee-ab0c-1389f7b699c3 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:36.865825 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3027904e-b1ee-42ee-ab0c-1389f7b699c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:36.893075 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027904e-b1ee-42ee-ab0c-1389f7b699c3 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:36.898816 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f35d60-a3df-4961-ab6d-830ba474c7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:36.899849 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f35d60-a3df-4961-ab6d-830ba474c7d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:36.900196 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f35d60-a3df-4961-ab6d-830ba474c7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:36.900538 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f35d60-a3df-4961-ab6d-830ba474c7d0 admin admin] PATH_INFO: `/v3/projects/0ff84f661fc74cdb8031d8e2ff51e220` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:36.902401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f35d60-a3df-4961-ab6d-830ba474c7d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ff84f661fc74cdb8031d8e2ff51e220)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:36.906236 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f35d60-a3df-4961-ab6d-830ba474c7d0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:37.056031 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a9f35d60-a3df-4961-ab6d-830ba474c7d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ff84f661fc74cdb8031d8e2ff51e220', 'request_id': 'req-a9f35d60-a3df-4961-ab6d-830ba474c7d0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:37.063863 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a9f35d60-a3df-4961-ab6d-830ba474c7d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ff84f661fc74cdb8031d8e2ff51e220', 'request_id': 'req-a9f35d60-a3df-4961-ab6d-830ba474c7d0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:37.075146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a9f35d60-a3df-4961-ab6d-830ba474c7d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ff84f661fc74cdb8031d8e2ff51e220', 'request_id': 'req-a9f35d60-a3df-4961-ab6d-830ba474c7d0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:37.160860 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a9f35d60-a3df-4961-ab6d-830ba474c7d0 admin admin] The token cache is being invalidate because project 0ff84f661fc74cdb8031d8e2ff51e220 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:26:37.161515 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a9f35d60-a3df-4961-ab6d-830ba474c7d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:37.168734 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a9f35d60-a3df-4961-ab6d-830ba474c7d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:37.170846 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2463/4929] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:26:36 2022] DELETE /identity/v3/projects/0ff84f661fc74cdb8031d8e2ff51e220 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:26:37.174727 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa627ec-0cb3-4b97-90ec-cb92ec92cd9f service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:37.186482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa627ec-0cb3-4b97-90ec-cb92ec92cd9f service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:37.290798 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9249d2-79ed-4ed2-ac05-c0d8986934cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:37.292026 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9249d2-79ed-4ed2-ac05-c0d8986934cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:37.292882 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9249d2-79ed-4ed2-ac05-c0d8986934cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:37.293636 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9249d2-79ed-4ed2-ac05-c0d8986934cc admin admin] PATH_INFO: `/v3/users/5f811c8834d849168849e7394cb14852` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:37.296440 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9249d2-79ed-4ed2-ac05-c0d8986934cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f811c8834d849168849e7394cb14852)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:37.299745 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9249d2-79ed-4ed2-ac05-c0d8986934cc admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:37.486021 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6e9249d2-79ed-4ed2-ac05-c0d8986934cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f811c8834d849168849e7394cb14852'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:37.498348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6e9249d2-79ed-4ed2-ac05-c0d8986934cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f811c8834d849168849e7394cb14852'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:37.596101 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6e9249d2-79ed-4ed2-ac05-c0d8986934cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f811c8834d849168849e7394cb14852'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:37.596686 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6e9249d2-79ed-4ed2-ac05-c0d8986934cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f811c8834d849168849e7394cb14852'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:37.604076 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6e9249d2-79ed-4ed2-ac05-c0d8986934cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f811c8834d849168849e7394cb14852'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:37.610548 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2467/4930] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:26:37 2022] DELETE /identity/v3/users/5f811c8834d849168849e7394cb14852 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:26:37.907991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f35d60-a3df-4961-ab6d-830ba474c7d0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:37.910566 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a9f35d60-a3df-4961-ab6d-830ba474c7d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:37.943081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f35d60-a3df-4961-ab6d-830ba474c7d0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:38.011345 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96733378-d053-4b69-b3fc-7d8f4609bd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:38.013047 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96733378-d053-4b69-b3fc-7d8f4609bd55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:38.014034 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96733378-d053-4b69-b3fc-7d8f4609bd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:38.014686 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96733378-d053-4b69-b3fc-7d8f4609bd55 admin admin] PATH_INFO: `/v3/projects/d31fa382065d4ab984847ff2942c7ca0` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:38.017306 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96733378-d053-4b69-b3fc-7d8f4609bd55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d31fa382065d4ab984847ff2942c7ca0)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:38.025648 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96733378-d053-4b69-b3fc-7d8f4609bd55 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:38.165951 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-96733378-d053-4b69-b3fc-7d8f4609bd55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd31fa382065d4ab984847ff2942c7ca0', 'request_id': 'req-96733378-d053-4b69-b3fc-7d8f4609bd55'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:38.176044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-96733378-d053-4b69-b3fc-7d8f4609bd55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd31fa382065d4ab984847ff2942c7ca0', 'request_id': 'req-96733378-d053-4b69-b3fc-7d8f4609bd55'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:38.187327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-96733378-d053-4b69-b3fc-7d8f4609bd55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd31fa382065d4ab984847ff2942c7ca0', 'request_id': 'req-96733378-d053-4b69-b3fc-7d8f4609bd55'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:38.277639 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-96733378-d053-4b69-b3fc-7d8f4609bd55 admin admin] The token cache is being invalidate because project d31fa382065d4ab984847ff2942c7ca0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:26:38.279147 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-96733378-d053-4b69-b3fc-7d8f4609bd55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:38.281121 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-96733378-d053-4b69-b3fc-7d8f4609bd55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:38.285813 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2464/4931] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:26:37 2022] DELETE /identity/v3/projects/d31fa382065d4ab984847ff2942c7ca0 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:26:38.288035 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e34915-5579-4b4c-91e8-d3254751ba1c None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:38.288487 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e34915-5579-4b4c-91e8-d3254751ba1c None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:38.288863 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e34915-5579-4b4c-91e8-d3254751ba1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:38.311481 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-30e34915-5579-4b4c-91e8-d3254751ba1c None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:26:38.313639 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-30e34915-5579-4b4c-91e8-d3254751ba1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:38.389972 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2468/4932] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:26:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:26:38.391439 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9910fd-77cb-4b01-9051-24a49e7065eb None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:38.391847 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9910fd-77cb-4b01-9051-24a49e7065eb None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:38.392259 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9910fd-77cb-4b01-9051-24a49e7065eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:38.423566 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-0d9910fd-77cb-4b01-9051-24a49e7065eb None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:26:38.424932 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0d9910fd-77cb-4b01-9051-24a49e7065eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:38.433986 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2465/4933] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:26:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:26:38.438236 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e34915-5579-4b4c-91e8-d3254751ba1c None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:38.453146 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e34915-5579-4b4c-91e8-d3254751ba1c None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:38.459328 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa034666-d2f7-4091-ad46-f9163d93bf98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:38.460450 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa034666-d2f7-4091-ad46-f9163d93bf98 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:38.460591 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa034666-d2f7-4091-ad46-f9163d93bf98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:38.461107 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa034666-d2f7-4091-ad46-f9163d93bf98 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:38.462016 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa034666-d2f7-4091-ad46-f9163d93bf98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:26:38.462617 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa034666-d2f7-4091-ad46-f9163d93bf98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:38.470079 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa034666-d2f7-4091-ad46-f9163d93bf98 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:38.512374 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2469/4934] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:26:38.517074 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9910fd-77cb-4b01-9051-24a49e7065eb None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:38.526551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9910fd-77cb-4b01-9051-24a49e7065eb None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:38.533626 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e853f-8bd6-4fb6-bc40-aa89deaa01ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:38.533626 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e853f-8bd6-4fb6-bc40-aa89deaa01ce admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:38.533626 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e853f-8bd6-4fb6-bc40-aa89deaa01ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:38.533989 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e853f-8bd6-4fb6-bc40-aa89deaa01ce admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:38.534597 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e853f-8bd6-4fb6-bc40-aa89deaa01ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:38.536519 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e853f-8bd6-4fb6-bc40-aa89deaa01ce admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:38.681873 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2466/4935] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:26:38 2022] POST /identity/v3/projects => generated 365 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:26:38.683903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa034666-d2f7-4091-ad46-f9163d93bf98 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:38.696749 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa034666-d2f7-4091-ad46-f9163d93bf98 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:38.761054 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99936a74-aca0-42bd-bf77-467cf40a60e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:38.761867 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99936a74-aca0-42bd-bf77-467cf40a60e7 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:38.762167 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99936a74-aca0-42bd-bf77-467cf40a60e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:38.762446 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99936a74-aca0-42bd-bf77-467cf40a60e7 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:38.763674 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99936a74-aca0-42bd-bf77-467cf40a60e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:38.765678 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99936a74-aca0-42bd-bf77-467cf40a60e7 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:38.871000 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2470/4936] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:26:38 2022] POST /identity/v3/users => generated 283 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:26:38.875665 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e853f-8bd6-4fb6-bc40-aa89deaa01ce admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:38.886431 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e853f-8bd6-4fb6-bc40-aa89deaa01ce admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:38.891680 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806754c-be41-4df9-84b1-205e38e0f937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:38.892341 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806754c-be41-4df9-84b1-205e38e0f937 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:38.892626 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806754c-be41-4df9-84b1-205e38e0f937 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:38.892929 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806754c-be41-4df9-84b1-205e38e0f937 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:38.893646 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806754c-be41-4df9-84b1-205e38e0f937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:38.895310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806754c-be41-4df9-84b1-205e38e0f937 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:38.906058 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2467/4937] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:26:38.912611 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99936a74-aca0-42bd-bf77-467cf40a60e7 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:38.924342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99936a74-aca0-42bd-bf77-467cf40a60e7 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:38.929612 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce75798-d4fd-4ecf-9333-134488dee304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:38.930535 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce75798-d4fd-4ecf-9333-134488dee304 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:38.930819 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce75798-d4fd-4ecf-9333-134488dee304 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:38.931097 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce75798-d4fd-4ecf-9333-134488dee304 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:38.931815 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce75798-d4fd-4ecf-9333-134488dee304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:38.936990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce75798-d4fd-4ecf-9333-134488dee304 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:38.947456 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2471/4938] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:26:38.948775 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806754c-be41-4df9-84b1-205e38e0f937 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:38.959514 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806754c-be41-4df9-84b1-205e38e0f937 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:38.964342 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975b77c-3941-45a1-bdc5-34ac0caac8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:38.965217 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975b77c-3941-45a1-bdc5-34ac0caac8fb admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:38.965692 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975b77c-3941-45a1-bdc5-34ac0caac8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:38.965894 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975b77c-3941-45a1-bdc5-34ac0caac8fb admin admin] PATH_INFO: `/v3/projects/d5acec4ac23a4bc3b5ebe5b504ccb591/users/5080b593bede4939bdf15f9a470365da/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:38.980545 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8975b77c-3941-45a1-bdc5-34ac0caac8fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5acec4ac23a4bc3b5ebe5b504ccb591, user_id=5080b593bede4939bdf15f9a470365da, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:38.983393 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8975b77c-3941-45a1-bdc5-34ac0caac8fb admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:39.049722 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2468/4939] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:26:38 2022] PUT /identity/v3/projects/d5acec4ac23a4bc3b5ebe5b504ccb591/users/5080b593bede4939bdf15f9a470365da/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:26:39.061143 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3763f0c-5a4a-4190-8040-e52895f86e6c None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:39.061435 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3763f0c-5a4a-4190-8040-e52895f86e6c None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:39.061717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3763f0c-5a4a-4190-8040-e52895f86e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:39.089943 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-a3763f0c-5a4a-4190-8040-e52895f86e6c None None] MFA Rules not processed for user `5080b593bede4939bdf15f9a470365da`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:26:39.091723 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a3763f0c-5a4a-4190-8040-e52895f86e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:39.156647 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2472/4940] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:26:39 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:26:39.167309 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975b77c-3941-45a1-bdc5-34ac0caac8fb admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:39.175516 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8975b77c-3941-45a1-bdc5-34ac0caac8fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:39.234486 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975b77c-3941-45a1-bdc5-34ac0caac8fb admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:39.238479 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc030b-afe9-411d-95b8-57a07ea01de0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:39.239207 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc030b-afe9-411d-95b8-57a07ea01de0 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:39.239682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc030b-afe9-411d-95b8-57a07ea01de0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:39.240026 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc030b-afe9-411d-95b8-57a07ea01de0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:39.250878 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc030b-afe9-411d-95b8-57a07ea01de0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:39.252934 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc030b-afe9-411d-95b8-57a07ea01de0 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:39.274256 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2469/4941] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:26:39 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:26:40.969859 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476d430-5021-4959-9aa0-d11d750bb745 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:40.970361 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476d430-5021-4959-9aa0-d11d750bb745 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:40.970660 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476d430-5021-4959-9aa0-d11d750bb745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:40.990181 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-b476d430-5021-4959-9aa0-d11d750bb745 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:26:40.991546 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b476d430-5021-4959-9aa0-d11d750bb745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:41.062648 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2473/4942] 10.222.0.23 () {58 vars in 967 bytes} [Sat Apr 30 21:26:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:26:41.085835 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc030b-afe9-411d-95b8-57a07ea01de0 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:41.085835 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7dcc030b-afe9-411d-95b8-57a07ea01de0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:41.180191 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc030b-afe9-411d-95b8-57a07ea01de0 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:41.188664 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a026ba-76a3-48bf-881b-8ff1022ba861 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:41.189393 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a026ba-76a3-48bf-881b-8ff1022ba861 service swift] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:41.189808 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a026ba-76a3-48bf-881b-8ff1022ba861 service swift] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:41.190470 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a026ba-76a3-48bf-881b-8ff1022ba861 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:41.210207 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a026ba-76a3-48bf-881b-8ff1022ba861 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:41.213198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a026ba-76a3-48bf-881b-8ff1022ba861 service swift] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:41.230047 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2470/4943] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:26:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:26:45.742255 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97120cc8-0bc0-4f79-9d67-01cc46112991 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:45.743664 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97120cc8-0bc0-4f79-9d67-01cc46112991 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:45.744119 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97120cc8-0bc0-4f79-9d67-01cc46112991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:45.780308 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-97120cc8-0bc0-4f79-9d67-01cc46112991 None None] MFA Rules not processed for user `582d05a237ba4a1a95ba93474fd4a978`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:26:45.781587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-97120cc8-0bc0-4f79-9d67-01cc46112991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:45.893015 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2474/4944] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:26:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:26:45.905623 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15ec03-f586-4dff-80b6-1d2dc2570688 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:45.919144 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15ec03-f586-4dff-80b6-1d2dc2570688 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:45.919144 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15ec03-f586-4dff-80b6-1d2dc2570688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:45.932790 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-cd15ec03-f586-4dff-80b6-1d2dc2570688 None None] MFA Rules not processed for user `582d05a237ba4a1a95ba93474fd4a978`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:26:45.934889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-cd15ec03-f586-4dff-80b6-1d2dc2570688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:45.944491 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2471/4945] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:26:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:26:45.955557 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97120cc8-0bc0-4f79-9d67-01cc46112991 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:45.957816 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-97120cc8-0bc0-4f79-9d67-01cc46112991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:46.133137 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97120cc8-0bc0-4f79-9d67-01cc46112991 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:46.141829 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225bf478-6a8e-48c1-a9a6-8d5918dd6078 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:46.143384 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bf478-6a8e-48c1-a9a6-8d5918dd6078 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:46.143679 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bf478-6a8e-48c1-a9a6-8d5918dd6078 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:46.143978 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bf478-6a8e-48c1-a9a6-8d5918dd6078 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:46.153987 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225bf478-6a8e-48c1-a9a6-8d5918dd6078 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:46.155692 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225bf478-6a8e-48c1-a9a6-8d5918dd6078 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:46.172781 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2475/4946] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:26:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:26:50.998549 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15ec03-f586-4dff-80b6-1d2dc2570688 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:51.000586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-cd15ec03-f586-4dff-80b6-1d2dc2570688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:51.127804 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15ec03-f586-4dff-80b6-1d2dc2570688 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:51.134841 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5ed65-cb94-4ca5-90dc-5a8cbbb62aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:51.136219 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5ed65-cb94-4ca5-90dc-5a8cbbb62aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:51.138068 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5ed65-cb94-4ca5-90dc-5a8cbbb62aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:51.138562 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5ed65-cb94-4ca5-90dc-5a8cbbb62aa9 admin admin] PATH_INFO: `/v3/users/e06225276b764805a8a56f143d920f5f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:51.141413 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc5ed65-cb94-4ca5-90dc-5a8cbbb62aa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e06225276b764805a8a56f143d920f5f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:51.143558 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc5ed65-cb94-4ca5-90dc-5a8cbbb62aa9 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:51.503518 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-acc5ed65-cb94-4ca5-90dc-5a8cbbb62aa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e06225276b764805a8a56f143d920f5f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:51.547223 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-acc5ed65-cb94-4ca5-90dc-5a8cbbb62aa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e06225276b764805a8a56f143d920f5f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:51.655094 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-acc5ed65-cb94-4ca5-90dc-5a8cbbb62aa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e06225276b764805a8a56f143d920f5f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:51.672968 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-acc5ed65-cb94-4ca5-90dc-5a8cbbb62aa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e06225276b764805a8a56f143d920f5f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:51.672968 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-acc5ed65-cb94-4ca5-90dc-5a8cbbb62aa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e06225276b764805a8a56f143d920f5f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:51.677081 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2472/4947] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:26:50 2022] DELETE /identity/v3/users/e06225276b764805a8a56f143d920f5f => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:26:51.682777 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae4cb2-47a5-4453-aeaf-16fa0bd72394 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:51.683361 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae4cb2-47a5-4453-aeaf-16fa0bd72394 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:51.683498 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae4cb2-47a5-4453-aeaf-16fa0bd72394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:51.708145 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-8eae4cb2-47a5-4453-aeaf-16fa0bd72394 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:26:51.709798 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8eae4cb2-47a5-4453-aeaf-16fa0bd72394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:51.899126 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2476/4948] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:26:51.925172 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5ed65-cb94-4ca5-90dc-5a8cbbb62aa9 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:51.927346 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-acc5ed65-cb94-4ca5-90dc-5a8cbbb62aa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:52.040968 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5ed65-cb94-4ca5-90dc-5a8cbbb62aa9 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:52.045844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd303dfc-3b6f-4b1a-8d41-50608b1440b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:52.047681 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd303dfc-3b6f-4b1a-8d41-50608b1440b1 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:52.049014 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd303dfc-3b6f-4b1a-8d41-50608b1440b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:52.049474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd303dfc-3b6f-4b1a-8d41-50608b1440b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:52.064703 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd303dfc-3b6f-4b1a-8d41-50608b1440b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:52.066603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd303dfc-3b6f-4b1a-8d41-50608b1440b1 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:52.085874 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2473/4949] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:26:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:26:52.849669 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae4cb2-47a5-4453-aeaf-16fa0bd72394 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:52.851193 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8eae4cb2-47a5-4453-aeaf-16fa0bd72394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:52.863838 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eae4cb2-47a5-4453-aeaf-16fa0bd72394 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:52.869847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e20dfa-2157-4ae9-9c69-7875c35a6552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:52.871151 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e20dfa-2157-4ae9-9c69-7875c35a6552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:52.872388 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e20dfa-2157-4ae9-9c69-7875c35a6552 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:52.872734 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e20dfa-2157-4ae9-9c69-7875c35a6552 admin admin] PATH_INFO: `/v3/projects/df29de6983a1403588550faf0e6b2bd8` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:52.874567 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e20dfa-2157-4ae9-9c69-7875c35a6552 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df29de6983a1403588550faf0e6b2bd8)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:52.877075 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e20dfa-2157-4ae9-9c69-7875c35a6552 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:53.053071 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-07e20dfa-2157-4ae9-9c69-7875c35a6552 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df29de6983a1403588550faf0e6b2bd8', 'request_id': 'req-07e20dfa-2157-4ae9-9c69-7875c35a6552'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:53.065240 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-07e20dfa-2157-4ae9-9c69-7875c35a6552 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df29de6983a1403588550faf0e6b2bd8', 'request_id': 'req-07e20dfa-2157-4ae9-9c69-7875c35a6552'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:53.088383 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-07e20dfa-2157-4ae9-9c69-7875c35a6552 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df29de6983a1403588550faf0e6b2bd8', 'request_id': 'req-07e20dfa-2157-4ae9-9c69-7875c35a6552'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:53.198878 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-07e20dfa-2157-4ae9-9c69-7875c35a6552 admin admin] The token cache is being invalidate because project df29de6983a1403588550faf0e6b2bd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:26:53.199468 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-07e20dfa-2157-4ae9-9c69-7875c35a6552 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:53.200386 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-07e20dfa-2157-4ae9-9c69-7875c35a6552 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:26:53.206287 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2477/4950] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:26:52 2022] DELETE /identity/v3/projects/df29de6983a1403588550faf0e6b2bd8 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:26:53.211673 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694db771-4be9-467d-aa0d-b6a409c72f5a None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:53.212206 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694db771-4be9-467d-aa0d-b6a409c72f5a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:53.213045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694db771-4be9-467d-aa0d-b6a409c72f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:53.258428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-694db771-4be9-467d-aa0d-b6a409c72f5a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:26:53.259891 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-694db771-4be9-467d-aa0d-b6a409c72f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:53.360264 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2474/4951] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:26:53.367874 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1e1d6-896b-4184-9a1f-5ced6b18f006 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:53.367874 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1e1d6-896b-4184-9a1f-5ced6b18f006 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:53.368144 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1e1d6-896b-4184-9a1f-5ced6b18f006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:53.400266 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-ebb1e1d6-896b-4184-9a1f-5ced6b18f006 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:26:53.401517 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ebb1e1d6-896b-4184-9a1f-5ced6b18f006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:53.413715 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2478/4952] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:26:53.420023 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694db771-4be9-467d-aa0d-b6a409c72f5a None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:53.431220 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694db771-4be9-467d-aa0d-b6a409c72f5a None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:53.438187 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb34b53-1d6b-4415-9418-862d51c11426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:53.439234 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb34b53-1d6b-4415-9418-862d51c11426 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:53.439732 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb34b53-1d6b-4415-9418-862d51c11426 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:53.440385 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb34b53-1d6b-4415-9418-862d51c11426 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:53.441330 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb34b53-1d6b-4415-9418-862d51c11426 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:26:53.441918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb34b53-1d6b-4415-9418-862d51c11426 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:53.443930 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb34b53-1d6b-4415-9418-862d51c11426 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:53.461732 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2475/4953] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:26:53.465632 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1e1d6-896b-4184-9a1f-5ced6b18f006 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:53.476023 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1e1d6-896b-4184-9a1f-5ced6b18f006 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:53.481968 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b34cc-150b-4a97-93fc-f26916d91658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:53.482647 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b34cc-150b-4a97-93fc-f26916d91658 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:53.482934 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b34cc-150b-4a97-93fc-f26916d91658 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:53.483212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b34cc-150b-4a97-93fc-f26916d91658 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:53.483931 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b34cc-150b-4a97-93fc-f26916d91658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:53.486208 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b34cc-150b-4a97-93fc-f26916d91658 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:53.617304 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2479/4954] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:26:53 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:26:53.644029 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb34b53-1d6b-4415-9418-862d51c11426 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:53.662632 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb34b53-1d6b-4415-9418-862d51c11426 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:53.788650 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab3489-f71e-4f26-b844-06d3e7fd5d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:53.789656 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab3489-f71e-4f26-b844-06d3e7fd5d22 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:53.790117 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab3489-f71e-4f26-b844-06d3e7fd5d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:53.790490 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab3489-f71e-4f26-b844-06d3e7fd5d22 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:53.791462 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab3489-f71e-4f26-b844-06d3e7fd5d22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:53.794418 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab3489-f71e-4f26-b844-06d3e7fd5d22 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:53.902944 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2476/4955] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:26:53 2022] POST /identity/v3/users => generated 293 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:26:53.906866 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b34cc-150b-4a97-93fc-f26916d91658 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:53.920124 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b34cc-150b-4a97-93fc-f26916d91658 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:53.932249 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe98333-33b8-4e72-8422-b35adf9b0286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:53.944405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe98333-33b8-4e72-8422-b35adf9b0286 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:53.944405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe98333-33b8-4e72-8422-b35adf9b0286 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:53.944405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe98333-33b8-4e72-8422-b35adf9b0286 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:53.944405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe98333-33b8-4e72-8422-b35adf9b0286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:53.944405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe98333-33b8-4e72-8422-b35adf9b0286 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:53.965621 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2480/4956] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:26:53.965847 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab3489-f71e-4f26-b844-06d3e7fd5d22 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:53.993731 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab3489-f71e-4f26-b844-06d3e7fd5d22 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:54.012159 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc8366f-ef65-412a-a4e3-95d97c2123e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:54.016695 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8366f-ef65-412a-a4e3-95d97c2123e9 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:54.016695 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8366f-ef65-412a-a4e3-95d97c2123e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:54.016695 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8366f-ef65-412a-a4e3-95d97c2123e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:54.016695 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc8366f-ef65-412a-a4e3-95d97c2123e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:54.018959 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc8366f-ef65-412a-a4e3-95d97c2123e9 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:54.062773 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe98333-33b8-4e72-8422-b35adf9b0286 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:54.062931 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2477/4957] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:26:54.073061 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe98333-33b8-4e72-8422-b35adf9b0286 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:54.078475 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f7e43-c64e-42a3-b143-0ac9ae688fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:54.079366 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f7e43-c64e-42a3-b143-0ac9ae688fc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:54.081192 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f7e43-c64e-42a3-b143-0ac9ae688fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:54.081490 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f7e43-c64e-42a3-b143-0ac9ae688fc1 admin admin] PATH_INFO: `/v3/projects/a84d931c66144ea2bc463d97c643a2ab/users/de3d734a6173484ebf1e0a3e3867023a/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:54.106277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f7e43-c64e-42a3-b143-0ac9ae688fc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a84d931c66144ea2bc463d97c643a2ab, user_id=de3d734a6173484ebf1e0a3e3867023a, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:54.109923 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f7e43-c64e-42a3-b143-0ac9ae688fc1 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:54.221346 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2481/4958] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:26:54 2022] PUT /identity/v3/projects/a84d931c66144ea2bc463d97c643a2ab/users/de3d734a6173484ebf1e0a3e3867023a/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:26:54.232944 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f88796-8965-4c73-be3f-8056b3dace67 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:54.232944 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f88796-8965-4c73-be3f-8056b3dace67 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:54.233528 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f88796-8965-4c73-be3f-8056b3dace67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:54.266228 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-70f88796-8965-4c73-be3f-8056b3dace67 None None] MFA Rules not processed for user `de3d734a6173484ebf1e0a3e3867023a`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:26:54.267513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-70f88796-8965-4c73-be3f-8056b3dace67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:54.402169 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2478/4959] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:26:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:26:54.412975 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f7e43-c64e-42a3-b143-0ac9ae688fc1 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:26:54.414903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e73f7e43-c64e-42a3-b143-0ac9ae688fc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:54.523548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f7e43-c64e-42a3-b143-0ac9ae688fc1 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:26:54.534497 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32401e-e9cb-4693-9fd4-782ef16ab9bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:26:54.535785 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32401e-e9cb-4693-9fd4-782ef16ab9bd service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:54.536092 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32401e-e9cb-4693-9fd4-782ef16ab9bd service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:54.536725 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32401e-e9cb-4693-9fd4-782ef16ab9bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:54.555001 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32401e-e9cb-4693-9fd4-782ef16ab9bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:26:54.557945 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32401e-e9cb-4693-9fd4-782ef16ab9bd service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:26:54.576320 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2482/4960] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:26:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:26:54.635749 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8280e-a99f-4edf-a6bc-4fe0c1a37e9c None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:26:54.636219 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8280e-a99f-4edf-a6bc-4fe0c1a37e9c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:26:54.636685 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8280e-a99f-4edf-a6bc-4fe0c1a37e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:26:54.672251 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-cfe8280e-a99f-4edf-a6bc-4fe0c1a37e9c None None] MFA Rules not processed for user `20b4082fa07249e2b6dfb9b4506ab398`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:26:54.673500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-cfe8280e-a99f-4edf-a6bc-4fe0c1a37e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:26:54.756836 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2479/4961] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:26:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:27:01.332636 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32401e-e9cb-4693-9fd4-782ef16ab9bd service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:01.335289 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-9a32401e-e9cb-4693-9fd4-782ef16ab9bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:01.352412 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32401e-e9cb-4693-9fd4-782ef16ab9bd service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:01.362694 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e8c6d3-3c41-4fb3-8b97-23e4b3bfe37c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:01.362694 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8c6d3-3c41-4fb3-8b97-23e4b3bfe37c service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:01.362694 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8c6d3-3c41-4fb3-8b97-23e4b3bfe37c service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:01.362694 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8c6d3-3c41-4fb3-8b97-23e4b3bfe37c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:01.363153 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-60e8c6d3-3c41-4fb3-8b97-23e4b3bfe37c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:01.448450 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e8c6d3-3c41-4fb3-8b97-23e4b3bfe37c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:01.450083 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e8c6d3-3c41-4fb3-8b97-23e4b3bfe37c service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:01.463235 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2483/4962] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:27:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:27:10.235789 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec6350-633c-4b10-a2fc-06fd58dcba64 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:10.249368 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec6350-633c-4b10-a2fc-06fd58dcba64 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:10.249368 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec6350-633c-4b10-a2fc-06fd58dcba64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:10.263723 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-d2ec6350-633c-4b10-a2fc-06fd58dcba64 None None] MFA Rules not processed for user `9cc9b55d852942538c3ad8f317dcd73e`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:27:10.284516 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d2ec6350-633c-4b10-a2fc-06fd58dcba64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:10.354337 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2480/4963] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:27:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:27:10.773666 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e8c6d3-3c41-4fb3-8b97-23e4b3bfe37c service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:10.783852 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e8c6d3-3c41-4fb3-8b97-23e4b3bfe37c service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:10.788965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc5eeb-f8f0-486b-908d-6764d909a2e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:10.789848 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc5eeb-f8f0-486b-908d-6764d909a2e4 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:10.790461 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc5eeb-f8f0-486b-908d-6764d909a2e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:10.790866 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc5eeb-f8f0-486b-908d-6764d909a2e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:10.793121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b1bc5eeb-f8f0-486b-908d-6764d909a2e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:10.811646 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc5eeb-f8f0-486b-908d-6764d909a2e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:10.814010 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc5eeb-f8f0-486b-908d-6764d909a2e4 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:10.836614 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2484/4964] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:27:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:27:13.343071 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec6350-633c-4b10-a2fc-06fd58dcba64 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:13.356250 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec6350-633c-4b10-a2fc-06fd58dcba64 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:13.374266 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a4c3a-497b-440d-be9c-62bb7c6b5ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:13.375837 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a4c3a-497b-440d-be9c-62bb7c6b5ae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:13.376701 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a4c3a-497b-440d-be9c-62bb7c6b5ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:13.377043 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a4c3a-497b-440d-be9c-62bb7c6b5ae5 admin admin] PATH_INFO: `/v3/users/de3d734a6173484ebf1e0a3e3867023a` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:13.378432 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a4c3a-497b-440d-be9c-62bb7c6b5ae5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de3d734a6173484ebf1e0a3e3867023a)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:13.380935 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a4c3a-497b-440d-be9c-62bb7c6b5ae5 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:13.624661 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-537a4c3a-497b-440d-be9c-62bb7c6b5ae5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de3d734a6173484ebf1e0a3e3867023a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:13.640661 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-537a4c3a-497b-440d-be9c-62bb7c6b5ae5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de3d734a6173484ebf1e0a3e3867023a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:13.728360 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-537a4c3a-497b-440d-be9c-62bb7c6b5ae5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de3d734a6173484ebf1e0a3e3867023a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:13.736455 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-537a4c3a-497b-440d-be9c-62bb7c6b5ae5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de3d734a6173484ebf1e0a3e3867023a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:13.744776 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-537a4c3a-497b-440d-be9c-62bb7c6b5ae5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de3d734a6173484ebf1e0a3e3867023a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:13.744776 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2481/4965] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:27:13 2022] DELETE /identity/v3/users/de3d734a6173484ebf1e0a3e3867023a => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:27:13.748054 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014459e-c07d-444c-b52c-fab1e1a9a19f None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:13.748540 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014459e-c07d-444c-b52c-fab1e1a9a19f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:13.749182 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014459e-c07d-444c-b52c-fab1e1a9a19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:13.770854 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-2014459e-c07d-444c-b52c-fab1e1a9a19f None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:27:13.779412 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2014459e-c07d-444c-b52c-fab1e1a9a19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:13.862857 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2485/4966] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:27:13.872572 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a4c3a-497b-440d-be9c-62bb7c6b5ae5 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:13.874065 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-537a4c3a-497b-440d-be9c-62bb7c6b5ae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:13.960820 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a4c3a-497b-440d-be9c-62bb7c6b5ae5 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:13.966457 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca78876-eb84-412e-8bd5-e77625ea3476 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:13.967685 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca78876-eb84-412e-8bd5-e77625ea3476 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:13.968810 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca78876-eb84-412e-8bd5-e77625ea3476 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:13.969199 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca78876-eb84-412e-8bd5-e77625ea3476 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:13.982123 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca78876-eb84-412e-8bd5-e77625ea3476 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:13.984483 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca78876-eb84-412e-8bd5-e77625ea3476 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:14.015986 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2482/4967] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:27:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:27:14.559984 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014459e-c07d-444c-b52c-fab1e1a9a19f None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:14.561621 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2014459e-c07d-444c-b52c-fab1e1a9a19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:14.576930 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014459e-c07d-444c-b52c-fab1e1a9a19f None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:14.585164 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d7125-6a20-42d7-b97a-23829b1a0391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:14.586333 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d7125-6a20-42d7-b97a-23829b1a0391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:14.588045 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d7125-6a20-42d7-b97a-23829b1a0391 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:14.588045 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d7125-6a20-42d7-b97a-23829b1a0391 admin admin] PATH_INFO: `/v3/projects/a84d931c66144ea2bc463d97c643a2ab` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:14.601306 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d7125-6a20-42d7-b97a-23829b1a0391 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a84d931c66144ea2bc463d97c643a2ab)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:14.606983 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d7125-6a20-42d7-b97a-23829b1a0391 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:14.759767 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8c1d7125-6a20-42d7-b97a-23829b1a0391 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a84d931c66144ea2bc463d97c643a2ab', 'request_id': 'req-8c1d7125-6a20-42d7-b97a-23829b1a0391'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:14.768123 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8c1d7125-6a20-42d7-b97a-23829b1a0391 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a84d931c66144ea2bc463d97c643a2ab', 'request_id': 'req-8c1d7125-6a20-42d7-b97a-23829b1a0391'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:14.774845 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8c1d7125-6a20-42d7-b97a-23829b1a0391 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a84d931c66144ea2bc463d97c643a2ab', 'request_id': 'req-8c1d7125-6a20-42d7-b97a-23829b1a0391'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:14.842824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8c1d7125-6a20-42d7-b97a-23829b1a0391 admin admin] The token cache is being invalidate because project a84d931c66144ea2bc463d97c643a2ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:27:14.843436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8c1d7125-6a20-42d7-b97a-23829b1a0391 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:14.844691 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8c1d7125-6a20-42d7-b97a-23829b1a0391 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:14.846840 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2486/4968] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:27:14 2022] DELETE /identity/v3/projects/a84d931c66144ea2bc463d97c643a2ab => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:27:14.851825 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae6791-6192-4f76-b17a-3b08850d1e87 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:14.852359 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae6791-6192-4f76-b17a-3b08850d1e87 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:14.852698 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae6791-6192-4f76-b17a-3b08850d1e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:14.874410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-74ae6791-6192-4f76-b17a-3b08850d1e87 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:27:14.876160 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-74ae6791-6192-4f76-b17a-3b08850d1e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:14.979193 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2483/4969] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:27:14.981669 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8e61b-bb12-4d33-93db-8dd6d8f73a4d None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:14.982656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8e61b-bb12-4d33-93db-8dd6d8f73a4d None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:14.982656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8e61b-bb12-4d33-93db-8dd6d8f73a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:15.014067 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-80d8e61b-bb12-4d33-93db-8dd6d8f73a4d None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:27:15.015621 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-80d8e61b-bb12-4d33-93db-8dd6d8f73a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:15.031865 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2487/4970] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:27:15.038177 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae6791-6192-4f76-b17a-3b08850d1e87 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:15.053626 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae6791-6192-4f76-b17a-3b08850d1e87 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:15.063939 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b8afe-a9f0-4635-8415-0b3ea002b754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:15.064617 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b8afe-a9f0-4635-8415-0b3ea002b754 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:15.064898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b8afe-a9f0-4635-8415-0b3ea002b754 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:15.065174 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b8afe-a9f0-4635-8415-0b3ea002b754 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:15.065975 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b8afe-a9f0-4635-8415-0b3ea002b754 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:27:15.066335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b8afe-a9f0-4635-8415-0b3ea002b754 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:15.068003 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b8afe-a9f0-4635-8415-0b3ea002b754 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:15.081004 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2484/4971] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:27:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:27:15.085630 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d8e61b-bb12-4d33-93db-8dd6d8f73a4d None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:15.096070 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d8e61b-bb12-4d33-93db-8dd6d8f73a4d None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:15.102841 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fbd23e-8ba4-41c4-8ca9-fb090e8a7b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:15.103913 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fbd23e-8ba4-41c4-8ca9-fb090e8a7b7a admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:15.104379 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fbd23e-8ba4-41c4-8ca9-fb090e8a7b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:15.105368 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fbd23e-8ba4-41c4-8ca9-fb090e8a7b7a admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:15.106419 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fbd23e-8ba4-41c4-8ca9-fb090e8a7b7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:15.108533 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fbd23e-8ba4-41c4-8ca9-fb090e8a7b7a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:15.254883 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2488/4972] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:27:15 2022] POST /identity/v3/projects => generated 359 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:27:15.259875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b8afe-a9f0-4635-8415-0b3ea002b754 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:15.272310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b8afe-a9f0-4635-8415-0b3ea002b754 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:15.338925 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce45ea-a9e7-4ba6-81c5-a41a78397090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:15.339623 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce45ea-a9e7-4ba6-81c5-a41a78397090 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:15.339932 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce45ea-a9e7-4ba6-81c5-a41a78397090 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:15.340215 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce45ea-a9e7-4ba6-81c5-a41a78397090 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:15.340932 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce45ea-a9e7-4ba6-81c5-a41a78397090 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:15.342935 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce45ea-a9e7-4ba6-81c5-a41a78397090 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:15.450758 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2485/4973] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:27:15 2022] POST /identity/v3/users => generated 280 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:27:15.454840 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fbd23e-8ba4-41c4-8ca9-fb090e8a7b7a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:15.468264 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fbd23e-8ba4-41c4-8ca9-fb090e8a7b7a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:15.478212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c360f704-1e3d-4b9e-87fc-d7c17ea4f9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:15.480630 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360f704-1e3d-4b9e-87fc-d7c17ea4f9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:15.481142 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360f704-1e3d-4b9e-87fc-d7c17ea4f9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:15.481814 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360f704-1e3d-4b9e-87fc-d7c17ea4f9e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:15.483034 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c360f704-1e3d-4b9e-87fc-d7c17ea4f9e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:15.485675 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c360f704-1e3d-4b9e-87fc-d7c17ea4f9e7 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:15.503500 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2489/4974] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:27:15.506779 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce45ea-a9e7-4ba6-81c5-a41a78397090 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:15.522058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce45ea-a9e7-4ba6-81c5-a41a78397090 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:15.548383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16967e-4718-495a-bb31-3f2f7ff68619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:15.549085 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16967e-4718-495a-bb31-3f2f7ff68619 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:15.549369 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16967e-4718-495a-bb31-3f2f7ff68619 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:15.550030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16967e-4718-495a-bb31-3f2f7ff68619 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:15.555386 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be16967e-4718-495a-bb31-3f2f7ff68619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:15.557224 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be16967e-4718-495a-bb31-3f2f7ff68619 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:15.579476 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2486/4975] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:27:15.585574 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c360f704-1e3d-4b9e-87fc-d7c17ea4f9e7 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:15.600563 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c360f704-1e3d-4b9e-87fc-d7c17ea4f9e7 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:15.606931 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7d100-0fb0-40e3-ace6-036dc1fd295b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:15.607899 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7d100-0fb0-40e3-ace6-036dc1fd295b admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:15.608184 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7d100-0fb0-40e3-ace6-036dc1fd295b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:15.608460 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7d100-0fb0-40e3-ace6-036dc1fd295b admin admin] PATH_INFO: `/v3/projects/0879dc9c3c7c49e190acf76407cdf550/users/dc6f721b855244068f5eceeb7b5a4bb9/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:15.643711 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7d100-0fb0-40e3-ace6-036dc1fd295b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0879dc9c3c7c49e190acf76407cdf550, user_id=dc6f721b855244068f5eceeb7b5a4bb9, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:15.646546 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7d100-0fb0-40e3-ace6-036dc1fd295b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:15.759718 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2490/4976] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:27:15 2022] PUT /identity/v3/projects/0879dc9c3c7c49e190acf76407cdf550/users/dc6f721b855244068f5eceeb7b5a4bb9/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:27:15.781704 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882757b-b13a-414d-b384-c5dc92a42399 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:15.782794 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882757b-b13a-414d-b384-c5dc92a42399 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:15.783077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882757b-b13a-414d-b384-c5dc92a42399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:15.803542 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7d100-0fb0-40e3-ace6-036dc1fd295b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:15.805915 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-94b7d100-0fb0-40e3-ace6-036dc1fd295b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:15.819581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-3882757b-b13a-414d-b384-c5dc92a42399 None None] MFA Rules not processed for user `dc6f721b855244068f5eceeb7b5a4bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:27:15.828127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3882757b-b13a-414d-b384-c5dc92a42399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:15.956932 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2487/4977] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:27:15 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:27:15.968559 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7d100-0fb0-40e3-ace6-036dc1fd295b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:15.975397 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24dfd96-8967-4249-b814-dc1cd3b0c485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:15.977864 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24dfd96-8967-4249-b814-dc1cd3b0c485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:15.978588 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882757b-b13a-414d-b384-c5dc92a42399 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:15.978729 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24dfd96-8967-4249-b814-dc1cd3b0c485 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:15.979364 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24dfd96-8967-4249-b814-dc1cd3b0c485 admin admin] PATH_INFO: `/v3/users/f0c43fdc22254d7f9c5999e044c4f844` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:15.981521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3882757b-b13a-414d-b384-c5dc92a42399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:16.026321 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24dfd96-8967-4249-b814-dc1cd3b0c485 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0c43fdc22254d7f9c5999e044c4f844)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:16.029224 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24dfd96-8967-4249-b814-dc1cd3b0c485 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:16.092185 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882757b-b13a-414d-b384-c5dc92a42399 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:16.096743 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c547df5-85a4-4ed4-bf8d-5f78aa973f41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:16.097624 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c547df5-85a4-4ed4-bf8d-5f78aa973f41 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:16.098115 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c547df5-85a4-4ed4-bf8d-5f78aa973f41 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:16.098579 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c547df5-85a4-4ed4-bf8d-5f78aa973f41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:16.110310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c547df5-85a4-4ed4-bf8d-5f78aa973f41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:16.112186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c547df5-85a4-4ed4-bf8d-5f78aa973f41 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:16.124995 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2488/4978] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:27:15 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:27:16.414073 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b24dfd96-8967-4249-b814-dc1cd3b0c485 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0c43fdc22254d7f9c5999e044c4f844'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:16.435063 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b24dfd96-8967-4249-b814-dc1cd3b0c485 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0c43fdc22254d7f9c5999e044c4f844'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:16.565968 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b24dfd96-8967-4249-b814-dc1cd3b0c485 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0c43fdc22254d7f9c5999e044c4f844'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:16.566736 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b24dfd96-8967-4249-b814-dc1cd3b0c485 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0c43fdc22254d7f9c5999e044c4f844'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:16.578615 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b24dfd96-8967-4249-b814-dc1cd3b0c485 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0c43fdc22254d7f9c5999e044c4f844'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:16.591695 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2491/4979] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:27:15 2022] DELETE /identity/v3/users/f0c43fdc22254d7f9c5999e044c4f844 => generated 0 bytes in 785 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:27:17.644120 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c547df5-85a4-4ed4-bf8d-5f78aa973f41 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:17.661939 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c547df5-85a4-4ed4-bf8d-5f78aa973f41 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:17.770431 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475ff3e-332a-45d0-b4db-bd06d8b2d676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:17.771868 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475ff3e-332a-45d0-b4db-bd06d8b2d676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:17.772358 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475ff3e-332a-45d0-b4db-bd06d8b2d676 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:17.772800 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475ff3e-332a-45d0-b4db-bd06d8b2d676 admin admin] PATH_INFO: `/v3/projects/b57cf4c7f250443a8afd9460085f6951` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:17.788961 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3475ff3e-332a-45d0-b4db-bd06d8b2d676 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b57cf4c7f250443a8afd9460085f6951)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:17.791440 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3475ff3e-332a-45d0-b4db-bd06d8b2d676 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:17.939320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3475ff3e-332a-45d0-b4db-bd06d8b2d676 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b57cf4c7f250443a8afd9460085f6951', 'request_id': 'req-3475ff3e-332a-45d0-b4db-bd06d8b2d676'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:17.961446 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3475ff3e-332a-45d0-b4db-bd06d8b2d676 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b57cf4c7f250443a8afd9460085f6951', 'request_id': 'req-3475ff3e-332a-45d0-b4db-bd06d8b2d676'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:17.978743 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3475ff3e-332a-45d0-b4db-bd06d8b2d676 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b57cf4c7f250443a8afd9460085f6951', 'request_id': 'req-3475ff3e-332a-45d0-b4db-bd06d8b2d676'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:18.123064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3475ff3e-332a-45d0-b4db-bd06d8b2d676 admin admin] The token cache is being invalidate because project b57cf4c7f250443a8afd9460085f6951 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:27:18.123741 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3475ff3e-332a-45d0-b4db-bd06d8b2d676 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:18.124899 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3475ff3e-332a-45d0-b4db-bd06d8b2d676 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:18.135709 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2489/4980] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:27:17 2022] DELETE /identity/v3/projects/b57cf4c7f250443a8afd9460085f6951 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:27:18.140190 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24dfd96-8967-4249-b814-dc1cd3b0c485 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:18.143478 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b24dfd96-8967-4249-b814-dc1cd3b0c485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:18.170876 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24dfd96-8967-4249-b814-dc1cd3b0c485 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:18.254918 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c3adaa-5259-4478-8381-2273b78f26d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:18.255961 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3adaa-5259-4478-8381-2273b78f26d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:18.256480 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3adaa-5259-4478-8381-2273b78f26d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:18.256971 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c3adaa-5259-4478-8381-2273b78f26d8 admin admin] PATH_INFO: `/v3/users/a64f9942c2914a5c9cc12dbe617ee325` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:18.275314 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c3adaa-5259-4478-8381-2273b78f26d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a64f9942c2914a5c9cc12dbe617ee325)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:18.277899 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c3adaa-5259-4478-8381-2273b78f26d8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:18.648607 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a4c3adaa-5259-4478-8381-2273b78f26d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a64f9942c2914a5c9cc12dbe617ee325'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:18.667496 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a4c3adaa-5259-4478-8381-2273b78f26d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a64f9942c2914a5c9cc12dbe617ee325'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:18.779790 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a4c3adaa-5259-4478-8381-2273b78f26d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a64f9942c2914a5c9cc12dbe617ee325'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:18.780426 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a4c3adaa-5259-4478-8381-2273b78f26d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a64f9942c2914a5c9cc12dbe617ee325'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:18.789349 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a4c3adaa-5259-4478-8381-2273b78f26d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a64f9942c2914a5c9cc12dbe617ee325'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:18.826790 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2492/4981] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:27:18 2022] DELETE /identity/v3/users/a64f9942c2914a5c9cc12dbe617ee325 => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:27:19.879722 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475ff3e-332a-45d0-b4db-bd06d8b2d676 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:19.881211 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3475ff3e-332a-45d0-b4db-bd06d8b2d676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:19.896101 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475ff3e-332a-45d0-b4db-bd06d8b2d676 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:19.979396 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e71bc1-5fb0-4fee-a0d1-4972ec7c8271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:19.980772 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e71bc1-5fb0-4fee-a0d1-4972ec7c8271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:19.981297 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e71bc1-5fb0-4fee-a0d1-4972ec7c8271 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:19.981838 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e71bc1-5fb0-4fee-a0d1-4972ec7c8271 admin admin] PATH_INFO: `/v3/projects/25711370e9804af8b0f59257b0c23162` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:19.999325 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e71bc1-5fb0-4fee-a0d1-4972ec7c8271 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25711370e9804af8b0f59257b0c23162)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:19.999325 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e71bc1-5fb0-4fee-a0d1-4972ec7c8271 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:20.164406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-08e71bc1-5fb0-4fee-a0d1-4972ec7c8271 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25711370e9804af8b0f59257b0c23162', 'request_id': 'req-08e71bc1-5fb0-4fee-a0d1-4972ec7c8271'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:20.175550 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-08e71bc1-5fb0-4fee-a0d1-4972ec7c8271 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25711370e9804af8b0f59257b0c23162', 'request_id': 'req-08e71bc1-5fb0-4fee-a0d1-4972ec7c8271'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:20.195796 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-08e71bc1-5fb0-4fee-a0d1-4972ec7c8271 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25711370e9804af8b0f59257b0c23162', 'request_id': 'req-08e71bc1-5fb0-4fee-a0d1-4972ec7c8271'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:20.295160 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-08e71bc1-5fb0-4fee-a0d1-4972ec7c8271 admin admin] The token cache is being invalidate because project 25711370e9804af8b0f59257b0c23162 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:27:20.295543 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-08e71bc1-5fb0-4fee-a0d1-4972ec7c8271 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:20.296205 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-08e71bc1-5fb0-4fee-a0d1-4972ec7c8271 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:20.298076 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2490/4982] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:27:19 2022] DELETE /identity/v3/projects/25711370e9804af8b0f59257b0c23162 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:27:20.307182 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93824f4-407b-4aaa-9d96-f63b9bfce455 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:20.308410 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93824f4-407b-4aaa-9d96-f63b9bfce455 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:20.308916 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93824f4-407b-4aaa-9d96-f63b9bfce455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:20.350522 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-f93824f4-407b-4aaa-9d96-f63b9bfce455 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:27:20.351858 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f93824f4-407b-4aaa-9d96-f63b9bfce455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:20.476806 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2493/4983] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:27:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:27:20.485813 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2b0a2-5b12-4cc6-854b-fdb9f9f8336c None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:20.486112 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2b0a2-5b12-4cc6-854b-fdb9f9f8336c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:20.486398 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2b0a2-5b12-4cc6-854b-fdb9f9f8336c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:20.506825 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-f4d2b0a2-5b12-4cc6-854b-fdb9f9f8336c None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:27:20.508084 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f4d2b0a2-5b12-4cc6-854b-fdb9f9f8336c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:20.544077 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2491/4984] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:27:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:27:20.549286 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93824f4-407b-4aaa-9d96-f63b9bfce455 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:20.562351 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93824f4-407b-4aaa-9d96-f63b9bfce455 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:20.567859 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba9eee-1e13-404f-a5d5-a0ce2d81af6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:20.568544 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba9eee-1e13-404f-a5d5-a0ce2d81af6c admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:20.568830 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba9eee-1e13-404f-a5d5-a0ce2d81af6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:20.569201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba9eee-1e13-404f-a5d5-a0ce2d81af6c admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:20.578120 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba9eee-1e13-404f-a5d5-a0ce2d81af6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:27:20.578120 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba9eee-1e13-404f-a5d5-a0ce2d81af6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:20.578120 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba9eee-1e13-404f-a5d5-a0ce2d81af6c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:20.589804 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2494/4985] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:27:20.594141 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2b0a2-5b12-4cc6-854b-fdb9f9f8336c None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:20.605221 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2b0a2-5b12-4cc6-854b-fdb9f9f8336c None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:20.619222 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70101c6-b348-4f7c-8f5f-f5d0306f784c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:20.620825 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70101c6-b348-4f7c-8f5f-f5d0306f784c admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:20.621276 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70101c6-b348-4f7c-8f5f-f5d0306f784c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:20.621786 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70101c6-b348-4f7c-8f5f-f5d0306f784c admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:20.622742 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70101c6-b348-4f7c-8f5f-f5d0306f784c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:20.624965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70101c6-b348-4f7c-8f5f-f5d0306f784c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:20.773526 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2492/4986] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:27:20 2022] POST /identity/v3/projects => generated 391 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:27:20.786495 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba9eee-1e13-404f-a5d5-a0ce2d81af6c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:20.802568 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba9eee-1e13-404f-a5d5-a0ce2d81af6c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:20.970548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f73d83-7ed0-472d-a9d5-e02539a7e39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:20.971302 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f73d83-7ed0-472d-a9d5-e02539a7e39c admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:20.971589 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f73d83-7ed0-472d-a9d5-e02539a7e39c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:20.971863 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f73d83-7ed0-472d-a9d5-e02539a7e39c admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:20.973495 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f73d83-7ed0-472d-a9d5-e02539a7e39c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:20.979124 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f73d83-7ed0-472d-a9d5-e02539a7e39c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:21.091485 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2495/4987] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:27:20 2022] POST /identity/v3/users => generated 296 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:27:21.095670 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70101c6-b348-4f7c-8f5f-f5d0306f784c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:21.111426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70101c6-b348-4f7c-8f5f-f5d0306f784c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:21.118389 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661a36f-f757-409c-a5c1-d3dd6d90beb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:21.119099 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661a36f-f757-409c-a5c1-d3dd6d90beb8 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:21.120149 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661a36f-f757-409c-a5c1-d3dd6d90beb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:21.120612 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661a36f-f757-409c-a5c1-d3dd6d90beb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:21.125657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8661a36f-f757-409c-a5c1-d3dd6d90beb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:21.129290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8661a36f-f757-409c-a5c1-d3dd6d90beb8 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:21.142538 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2493/4988] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:27:21.149272 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f73d83-7ed0-472d-a9d5-e02539a7e39c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:21.172418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f73d83-7ed0-472d-a9d5-e02539a7e39c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:21.179691 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a3639-7035-4aec-891a-665805044e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:21.180387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a3639-7035-4aec-891a-665805044e72 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:21.180925 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a3639-7035-4aec-891a-665805044e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:21.181209 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a3639-7035-4aec-891a-665805044e72 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:21.182115 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a3639-7035-4aec-891a-665805044e72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:21.183872 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a3639-7035-4aec-891a-665805044e72 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:21.201739 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2496/4989] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:27:21.205081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661a36f-f757-409c-a5c1-d3dd6d90beb8 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:21.233027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661a36f-f757-409c-a5c1-d3dd6d90beb8 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:21.245131 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4fd532-668b-4030-a434-9b6563d931df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:21.246821 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4fd532-668b-4030-a434-9b6563d931df admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:21.247104 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4fd532-668b-4030-a434-9b6563d931df admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:21.247593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4fd532-668b-4030-a434-9b6563d931df admin admin] PATH_INFO: `/v3/projects/8bbf68d01a624b91b6751596b4a0a480/users/463a0fb1322c4927abb500bfbd05f95f/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:21.270953 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4fd532-668b-4030-a434-9b6563d931df admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bbf68d01a624b91b6751596b4a0a480, user_id=463a0fb1322c4927abb500bfbd05f95f, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:21.275084 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4fd532-668b-4030-a434-9b6563d931df admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:21.429981 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2494/4990] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:27:21 2022] PUT /identity/v3/projects/8bbf68d01a624b91b6751596b4a0a480/users/463a0fb1322c4927abb500bfbd05f95f/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:27:21.436991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86bd4b-85e1-4c5f-99ba-9e372b475cc6 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:21.437490 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86bd4b-85e1-4c5f-99ba-9e372b475cc6 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:21.437705 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86bd4b-85e1-4c5f-99ba-9e372b475cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:21.497570 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-db86bd4b-85e1-4c5f-99ba-9e372b475cc6 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:27:21.502515 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-db86bd4b-85e1-4c5f-99ba-9e372b475cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:21.643336 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2497/4991] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:27:21.755292 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4fd532-668b-4030-a434-9b6563d931df admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:21.757805 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2b4fd532-668b-4030-a434-9b6563d931df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:21.888181 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4fd532-668b-4030-a434-9b6563d931df admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:21.905038 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b3549d-b7ba-4487-9e18-e9c6e63d0718 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:21.905768 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3549d-b7ba-4487-9e18-e9c6e63d0718 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:21.906165 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3549d-b7ba-4487-9e18-e9c6e63d0718 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:21.906544 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3549d-b7ba-4487-9e18-e9c6e63d0718 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:21.928511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b3549d-b7ba-4487-9e18-e9c6e63d0718 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:21.930168 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b3549d-b7ba-4487-9e18-e9c6e63d0718 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:21.943711 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2495/4992] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:27:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:27:23.790431 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1694e2e-5b7a-4ee9-bcab-9a8e1ca3a5b9 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:23.791484 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1694e2e-5b7a-4ee9-bcab-9a8e1ca3a5b9 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:23.792847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1694e2e-5b7a-4ee9-bcab-9a8e1ca3a5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:23.830183 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-b1694e2e-5b7a-4ee9-bcab-9a8e1ca3a5b9 None None] MFA Rules not processed for user `463a0fb1322c4927abb500bfbd05f95f`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:27:23.831675 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b1694e2e-5b7a-4ee9-bcab-9a8e1ca3a5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:23.918267 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2498/4993] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:27:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:27:23.928707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a3f85-8537-40a9-8a5e-86267d73763b None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:23.929317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a3f85-8537-40a9-8a5e-86267d73763b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:23.929317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a3f85-8537-40a9-8a5e-86267d73763b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:23.955453 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-026a3f85-8537-40a9-8a5e-86267d73763b None None] MFA Rules not processed for user `463a0fb1322c4927abb500bfbd05f95f`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:27:23.957889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-026a3f85-8537-40a9-8a5e-86267d73763b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:23.967061 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2496/4994] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:27:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:27:24.191983 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1694e2e-5b7a-4ee9-bcab-9a8e1ca3a5b9 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:24.193750 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b1694e2e-5b7a-4ee9-bcab-9a8e1ca3a5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:24.315413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1694e2e-5b7a-4ee9-bcab-9a8e1ca3a5b9 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:24.322097 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d6d29-4e12-4278-8902-8cbfaa67a847 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:24.323760 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d6d29-4e12-4278-8902-8cbfaa67a847 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:24.324245 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d6d29-4e12-4278-8902-8cbfaa67a847 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:24.324728 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d6d29-4e12-4278-8902-8cbfaa67a847 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:24.334329 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d6d29-4e12-4278-8902-8cbfaa67a847 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:24.336388 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d6d29-4e12-4278-8902-8cbfaa67a847 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:24.348704 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2499/4995] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:27:24 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:27:30.488833 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a3f85-8537-40a9-8a5e-86267d73763b None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:30.497613 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-026a3f85-8537-40a9-8a5e-86267d73763b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:30.524507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a3f85-8537-40a9-8a5e-86267d73763b None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:30.533739 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1848a3-14ed-4900-8a61-44f1286f4055 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:30.534579 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1848a3-14ed-4900-8a61-44f1286f4055 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:30.535099 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1848a3-14ed-4900-8a61-44f1286f4055 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:30.535374 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1848a3-14ed-4900-8a61-44f1286f4055 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:30.537314 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9c1848a3-14ed-4900-8a61-44f1286f4055 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:30.554861 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1848a3-14ed-4900-8a61-44f1286f4055 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:30.556729 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1848a3-14ed-4900-8a61-44f1286f4055 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:30.574018 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2497/4996] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:27:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:27:37.627026 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d6d29-4e12-4278-8902-8cbfaa67a847 service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:37.628528 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-497d6d29-4e12-4278-8902-8cbfaa67a847 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:37.659909 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d6d29-4e12-4278-8902-8cbfaa67a847 service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:37.664887 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e29e7-e43f-458d-b214-0a35398b5c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:37.665800 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e29e7-e43f-458d-b214-0a35398b5c26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:37.666863 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e29e7-e43f-458d-b214-0a35398b5c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:37.667340 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e29e7-e43f-458d-b214-0a35398b5c26 admin admin] PATH_INFO: `/v3/users/dc6f721b855244068f5eceeb7b5a4bb9` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:37.669286 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e29e7-e43f-458d-b214-0a35398b5c26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc6f721b855244068f5eceeb7b5a4bb9)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:37.671274 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e29e7-e43f-458d-b214-0a35398b5c26 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:37.838779 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-162e29e7-e43f-458d-b214-0a35398b5c26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc6f721b855244068f5eceeb7b5a4bb9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:37.851697 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-162e29e7-e43f-458d-b214-0a35398b5c26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc6f721b855244068f5eceeb7b5a4bb9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:37.928533 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-162e29e7-e43f-458d-b214-0a35398b5c26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc6f721b855244068f5eceeb7b5a4bb9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:37.929161 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-162e29e7-e43f-458d-b214-0a35398b5c26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc6f721b855244068f5eceeb7b5a4bb9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:37.946486 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-162e29e7-e43f-458d-b214-0a35398b5c26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc6f721b855244068f5eceeb7b5a4bb9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:37.953632 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2500/4997] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:27:37 2022] DELETE /identity/v3/users/dc6f721b855244068f5eceeb7b5a4bb9 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:27:37.958001 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a3c63-bb61-4d50-81a8-bfdb3329dac2 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:37.958989 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a3c63-bb61-4d50-81a8-bfdb3329dac2 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:37.961240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a3c63-bb61-4d50-81a8-bfdb3329dac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:37.983234 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-d57a3c63-bb61-4d50-81a8-bfdb3329dac2 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:27:37.984891 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d57a3c63-bb61-4d50-81a8-bfdb3329dac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:38.052048 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2498/4998] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:27:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:27:38.062091 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e29e7-e43f-458d-b214-0a35398b5c26 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:38.063613 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-162e29e7-e43f-458d-b214-0a35398b5c26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:38.129201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e29e7-e43f-458d-b214-0a35398b5c26 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:38.132765 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e08d24-e6fa-4f2e-8261-698f38a0f16d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:38.133688 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e08d24-e6fa-4f2e-8261-698f38a0f16d service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:38.134171 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e08d24-e6fa-4f2e-8261-698f38a0f16d service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:38.134771 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e08d24-e6fa-4f2e-8261-698f38a0f16d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:38.148210 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e08d24-e6fa-4f2e-8261-698f38a0f16d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:38.151091 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e08d24-e6fa-4f2e-8261-698f38a0f16d service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:38.163385 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2501/4999] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:27:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:27:38.706164 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a3c63-bb61-4d50-81a8-bfdb3329dac2 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:38.708076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d57a3c63-bb61-4d50-81a8-bfdb3329dac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:38.725259 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a3c63-bb61-4d50-81a8-bfdb3329dac2 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:38.731486 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ae915-be75-4344-b65b-4dc0c28e204d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:38.732920 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ae915-be75-4344-b65b-4dc0c28e204d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:38.733538 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ae915-be75-4344-b65b-4dc0c28e204d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:38.734095 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ae915-be75-4344-b65b-4dc0c28e204d admin admin] PATH_INFO: `/v3/projects/0879dc9c3c7c49e190acf76407cdf550` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:38.736016 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ae915-be75-4344-b65b-4dc0c28e204d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0879dc9c3c7c49e190acf76407cdf550)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:38.738600 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ae915-be75-4344-b65b-4dc0c28e204d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:38.895009 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-836ae915-be75-4344-b65b-4dc0c28e204d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0879dc9c3c7c49e190acf76407cdf550', 'request_id': 'req-836ae915-be75-4344-b65b-4dc0c28e204d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:38.903507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-836ae915-be75-4344-b65b-4dc0c28e204d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0879dc9c3c7c49e190acf76407cdf550', 'request_id': 'req-836ae915-be75-4344-b65b-4dc0c28e204d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:38.914551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-836ae915-be75-4344-b65b-4dc0c28e204d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0879dc9c3c7c49e190acf76407cdf550', 'request_id': 'req-836ae915-be75-4344-b65b-4dc0c28e204d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:38.996455 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-836ae915-be75-4344-b65b-4dc0c28e204d admin admin] The token cache is being invalidate because project 0879dc9c3c7c49e190acf76407cdf550 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:27:38.997143 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-836ae915-be75-4344-b65b-4dc0c28e204d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:38.997380 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-836ae915-be75-4344-b65b-4dc0c28e204d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:38.998957 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2499/5000] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:27:38 2022] DELETE /identity/v3/projects/0879dc9c3c7c49e190acf76407cdf550 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:27:39.004159 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c95c08-1052-465e-b1bc-34601a006150 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:39.004661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c95c08-1052-465e-b1bc-34601a006150 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:39.004777 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c95c08-1052-465e-b1bc-34601a006150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:39.023604 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-78c95c08-1052-465e-b1bc-34601a006150 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:27:39.025092 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-78c95c08-1052-465e-b1bc-34601a006150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:39.107366 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2502/5001] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:27:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:27:39.115576 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83510d2-80d3-4ce2-a9c0-0cc40f0d0e15 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:39.116145 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83510d2-80d3-4ce2-a9c0-0cc40f0d0e15 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:39.116427 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83510d2-80d3-4ce2-a9c0-0cc40f0d0e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:39.135001 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-e83510d2-80d3-4ce2-a9c0-0cc40f0d0e15 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:27:39.136484 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e83510d2-80d3-4ce2-a9c0-0cc40f0d0e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:39.149903 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2500/5002] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:27:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:27:39.151489 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c95c08-1052-465e-b1bc-34601a006150 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:39.163161 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c95c08-1052-465e-b1bc-34601a006150 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:39.171762 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87fe992-240c-4a8f-9c65-66112d8ddbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:39.172773 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87fe992-240c-4a8f-9c65-66112d8ddbf6 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:39.173407 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87fe992-240c-4a8f-9c65-66112d8ddbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:39.173682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87fe992-240c-4a8f-9c65-66112d8ddbf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:39.174497 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87fe992-240c-4a8f-9c65-66112d8ddbf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:27:39.174803 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87fe992-240c-4a8f-9c65-66112d8ddbf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:39.176443 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87fe992-240c-4a8f-9c65-66112d8ddbf6 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:39.191962 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2503/5003] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:27:39.200061 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83510d2-80d3-4ce2-a9c0-0cc40f0d0e15 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:39.212436 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83510d2-80d3-4ce2-a9c0-0cc40f0d0e15 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:39.220711 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324fbac-22fa-4985-b9cc-a1223bf3b475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:39.227848 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324fbac-22fa-4985-b9cc-a1223bf3b475 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:39.227848 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324fbac-22fa-4985-b9cc-a1223bf3b475 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:39.227848 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324fbac-22fa-4985-b9cc-a1223bf3b475 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:39.227848 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e324fbac-22fa-4985-b9cc-a1223bf3b475 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:39.227848 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e324fbac-22fa-4985-b9cc-a1223bf3b475 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:39.357801 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2501/5004] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:27:39 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:27:39.361928 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87fe992-240c-4a8f-9c65-66112d8ddbf6 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:39.373084 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87fe992-240c-4a8f-9c65-66112d8ddbf6 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:39.466004 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b72f3-57be-4358-b25d-132b939fa74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:39.472721 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b72f3-57be-4358-b25d-132b939fa74d admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:39.473016 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b72f3-57be-4358-b25d-132b939fa74d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:39.473288 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b72f3-57be-4358-b25d-132b939fa74d admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:39.474448 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b72f3-57be-4358-b25d-132b939fa74d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:39.477214 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b72f3-57be-4358-b25d-132b939fa74d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:39.585167 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2504/5005] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:27:39 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:27:39.586351 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324fbac-22fa-4985-b9cc-a1223bf3b475 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:39.616106 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324fbac-22fa-4985-b9cc-a1223bf3b475 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:39.622395 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45da12-4631-40d4-adb6-7bd98fd08131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:39.623362 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45da12-4631-40d4-adb6-7bd98fd08131 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:39.623829 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45da12-4631-40d4-adb6-7bd98fd08131 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:39.624351 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45da12-4631-40d4-adb6-7bd98fd08131 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:39.625275 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45da12-4631-40d4-adb6-7bd98fd08131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:39.627190 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45da12-4631-40d4-adb6-7bd98fd08131 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:39.641013 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2502/5006] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:27:39.644913 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b72f3-57be-4358-b25d-132b939fa74d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:39.656958 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b72f3-57be-4358-b25d-132b939fa74d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:39.664213 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a002c775-530c-4068-ac43-5632cadaa5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:39.665152 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002c775-530c-4068-ac43-5632cadaa5a0 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:39.665520 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002c775-530c-4068-ac43-5632cadaa5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:39.666823 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002c775-530c-4068-ac43-5632cadaa5a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:39.673086 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a002c775-530c-4068-ac43-5632cadaa5a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:39.673086 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a002c775-530c-4068-ac43-5632cadaa5a0 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:39.687031 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2505/5007] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:27:39.688338 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45da12-4631-40d4-adb6-7bd98fd08131 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:39.701117 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45da12-4631-40d4-adb6-7bd98fd08131 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:39.706043 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019402e-47ab-454f-bd5e-d95013f66fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:39.706875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019402e-47ab-454f-bd5e-d95013f66fba admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:39.707159 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019402e-47ab-454f-bd5e-d95013f66fba admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:39.707436 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019402e-47ab-454f-bd5e-d95013f66fba admin admin] PATH_INFO: `/v3/projects/f583d2a1c8984eeea95f5191ab7b2c0b/users/59a3b8667dfe48ee80d0d0574f084843/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:39.722858 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6019402e-47ab-454f-bd5e-d95013f66fba admin admin] RBAC: Authorizing `identity:create_grant(project_id=f583d2a1c8984eeea95f5191ab7b2c0b, user_id=59a3b8667dfe48ee80d0d0574f084843, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:39.725729 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6019402e-47ab-454f-bd5e-d95013f66fba admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:39.897847 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2503/5008] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:27:39 2022] PUT /identity/v3/projects/f583d2a1c8984eeea95f5191ab7b2c0b/users/59a3b8667dfe48ee80d0d0574f084843/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:27:39.912045 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcb02b-7ca8-4f82-8926-cb6e8187731a None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:39.912401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcb02b-7ca8-4f82-8926-cb6e8187731a None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:39.912833 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcb02b-7ca8-4f82-8926-cb6e8187731a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:39.953011 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-46fcb02b-7ca8-4f82-8926-cb6e8187731a None None] MFA Rules not processed for user `59a3b8667dfe48ee80d0d0574f084843`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:27:39.954564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-46fcb02b-7ca8-4f82-8926-cb6e8187731a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:40.046443 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2506/5009] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:27:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:27:40.050875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019402e-47ab-454f-bd5e-d95013f66fba admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:40.143125 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019402e-47ab-454f-bd5e-d95013f66fba admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:40.151129 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dab29e-5785-44f8-9c5e-790c324f2189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:40.152076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dab29e-5785-44f8-9c5e-790c324f2189 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:40.152536 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dab29e-5785-44f8-9c5e-790c324f2189 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:40.152813 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dab29e-5785-44f8-9c5e-790c324f2189 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:40.153635 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dab29e-5785-44f8-9c5e-790c324f2189 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:40.155925 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dab29e-5785-44f8-9c5e-790c324f2189 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:40.272775 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2504/5010] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:27:40 2022] POST /identity/v3/projects => generated 383 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:27:40.277353 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fcb02b-7ca8-4f82-8926-cb6e8187731a None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:40.288497 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fcb02b-7ca8-4f82-8926-cb6e8187731a None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:40.345787 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f68e9-0d45-4b9b-83f3-9c3b132a9356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:40.348387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f68e9-0d45-4b9b-83f3-9c3b132a9356 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:40.348387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f68e9-0d45-4b9b-83f3-9c3b132a9356 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:40.348387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f68e9-0d45-4b9b-83f3-9c3b132a9356 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:40.348387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f68e9-0d45-4b9b-83f3-9c3b132a9356 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:40.349534 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f68e9-0d45-4b9b-83f3-9c3b132a9356 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:40.444021 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2507/5011] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:27:40 2022] POST /identity/v3/users => generated 298 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:27:40.449081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dab29e-5785-44f8-9c5e-790c324f2189 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:40.463592 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dab29e-5785-44f8-9c5e-790c324f2189 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:40.469854 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e27db6-c911-4a74-8876-154a08e8e611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:40.470605 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e27db6-c911-4a74-8876-154a08e8e611 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:40.471018 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e27db6-c911-4a74-8876-154a08e8e611 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:40.471302 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e27db6-c911-4a74-8876-154a08e8e611 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:40.472135 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e27db6-c911-4a74-8876-154a08e8e611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:40.473870 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e27db6-c911-4a74-8876-154a08e8e611 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:40.489804 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2505/5012] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:27:40.493199 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f68e9-0d45-4b9b-83f3-9c3b132a9356 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:40.508477 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f68e9-0d45-4b9b-83f3-9c3b132a9356 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:40.514067 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016ccaf-e58c-4692-acf5-9694ea794f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:40.514981 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016ccaf-e58c-4692-acf5-9694ea794f4d admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:40.515263 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016ccaf-e58c-4692-acf5-9694ea794f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:40.515542 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016ccaf-e58c-4692-acf5-9694ea794f4d admin admin] PATH_INFO: `/v3/projects/7f4d34b45cb44fc38efa2e91120a3f82/users/76fa80dd9337468582432a1c28659e6c/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:40.532930 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016ccaf-e58c-4692-acf5-9694ea794f4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f4d34b45cb44fc38efa2e91120a3f82, user_id=76fa80dd9337468582432a1c28659e6c, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:40.535940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016ccaf-e58c-4692-acf5-9694ea794f4d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:40.652047 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2508/5013] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:27:40 2022] PUT /identity/v3/projects/7f4d34b45cb44fc38efa2e91120a3f82/users/76fa80dd9337468582432a1c28659e6c/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:27:40.656048 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e27db6-c911-4a74-8876-154a08e8e611 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:40.667359 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e27db6-c911-4a74-8876-154a08e8e611 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:40.723962 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e32d7-dcfe-4ab5-9264-a838a05bf891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:40.724578 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e32d7-dcfe-4ab5-9264-a838a05bf891 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:40.724865 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e32d7-dcfe-4ab5-9264-a838a05bf891 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:40.725138 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e32d7-dcfe-4ab5-9264-a838a05bf891 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:40.725882 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278e32d7-dcfe-4ab5-9264-a838a05bf891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:40.727479 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278e32d7-dcfe-4ab5-9264-a838a05bf891 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:40.738935 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2506/5014] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:27:40.743190 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016ccaf-e58c-4692-acf5-9694ea794f4d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:40.754754 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016ccaf-e58c-4692-acf5-9694ea794f4d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:40.759665 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56ef89-18ec-41d2-a6cd-4f4ea3997ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:40.760557 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56ef89-18ec-41d2-a6cd-4f4ea3997ebe admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:40.760845 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56ef89-18ec-41d2-a6cd-4f4ea3997ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:40.761122 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56ef89-18ec-41d2-a6cd-4f4ea3997ebe admin admin] PATH_INFO: `/v3/projects/7f4d34b45cb44fc38efa2e91120a3f82/users/76fa80dd9337468582432a1c28659e6c/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:40.763259 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c56ef89-18ec-41d2-a6cd-4f4ea3997ebe admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f4d34b45cb44fc38efa2e91120a3f82, user_id=76fa80dd9337468582432a1c28659e6c, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:40.765936 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c56ef89-18ec-41d2-a6cd-4f4ea3997ebe admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:40.776745 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2509/5015] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:27:40 2022] PUT /identity/v3/projects/7f4d34b45cb44fc38efa2e91120a3f82/users/76fa80dd9337468582432a1c28659e6c/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:27:40.787770 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd50052-a056-448a-9017-541ee0dd2706 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:40.788065 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd50052-a056-448a-9017-541ee0dd2706 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:40.788349 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd50052-a056-448a-9017-541ee0dd2706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:40.843810 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-7fd50052-a056-448a-9017-541ee0dd2706 None None] MFA Rules not processed for user `76fa80dd9337468582432a1c28659e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:27:40.846225 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7fd50052-a056-448a-9017-541ee0dd2706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:40.997367 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2507/5016] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:27:40 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:27:41.010143 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56ef89-18ec-41d2-a6cd-4f4ea3997ebe admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:41.012087 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1c56ef89-18ec-41d2-a6cd-4f4ea3997ebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:41.133679 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56ef89-18ec-41d2-a6cd-4f4ea3997ebe admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:41.138972 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19fc299-4286-4974-850e-131fc64dd6a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:41.139696 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19fc299-4286-4974-850e-131fc64dd6a9 service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:41.139935 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19fc299-4286-4974-850e-131fc64dd6a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:41.140217 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19fc299-4286-4974-850e-131fc64dd6a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:41.151443 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19fc299-4286-4974-850e-131fc64dd6a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:41.154415 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19fc299-4286-4974-850e-131fc64dd6a9 service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:41.171018 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2510/5017] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:27:41 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:27:41.461570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd50052-a056-448a-9017-541ee0dd2706 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:41.554623 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd50052-a056-448a-9017-541ee0dd2706 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:41.570811 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b32f19-90ac-441a-bd71-1b00e0215ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:41.573677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b32f19-90ac-441a-bd71-1b00e0215ec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:41.574191 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b32f19-90ac-441a-bd71-1b00e0215ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:41.574647 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b32f19-90ac-441a-bd71-1b00e0215ec7 admin admin] PATH_INFO: `/v3/users/59a3b8667dfe48ee80d0d0574f084843` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:41.578958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b32f19-90ac-441a-bd71-1b00e0215ec7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59a3b8667dfe48ee80d0d0574f084843)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:41.581278 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b32f19-90ac-441a-bd71-1b00e0215ec7 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:41.923253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-04b32f19-90ac-441a-bd71-1b00e0215ec7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59a3b8667dfe48ee80d0d0574f084843'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:41.945458 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-04b32f19-90ac-441a-bd71-1b00e0215ec7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59a3b8667dfe48ee80d0d0574f084843'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:42.067417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-04b32f19-90ac-441a-bd71-1b00e0215ec7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59a3b8667dfe48ee80d0d0574f084843'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:42.078376 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-04b32f19-90ac-441a-bd71-1b00e0215ec7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59a3b8667dfe48ee80d0d0574f084843'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:42.079303 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-04b32f19-90ac-441a-bd71-1b00e0215ec7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59a3b8667dfe48ee80d0d0574f084843'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:42.095453 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2508/5018] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:27:41 2022] DELETE /identity/v3/users/59a3b8667dfe48ee80d0d0574f084843 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:27:42.097284 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a0052-f74a-432f-8477-166e499af64d None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:42.097666 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a0052-f74a-432f-8477-166e499af64d None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:42.098037 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a0052-f74a-432f-8477-166e499af64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:42.125568 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-7c4a0052-f74a-432f-8477-166e499af64d None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:27:42.132875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7c4a0052-f74a-432f-8477-166e499af64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:42.212254 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2511/5019] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:27:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:27:42.224315 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b32f19-90ac-441a-bd71-1b00e0215ec7 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:42.228414 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-04b32f19-90ac-441a-bd71-1b00e0215ec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:42.347423 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b32f19-90ac-441a-bd71-1b00e0215ec7 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:42.351257 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb83b4b-ab2d-490f-ac93-228a455c284d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:42.352154 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb83b4b-ab2d-490f-ac93-228a455c284d service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:42.352339 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb83b4b-ab2d-490f-ac93-228a455c284d service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:42.352710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb83b4b-ab2d-490f-ac93-228a455c284d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:42.364549 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb83b4b-ab2d-490f-ac93-228a455c284d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:42.366408 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb83b4b-ab2d-490f-ac93-228a455c284d service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:42.377670 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2509/5020] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:27:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:27:43.026753 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a0052-f74a-432f-8477-166e499af64d None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:43.028264 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7c4a0052-f74a-432f-8477-166e499af64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:43.048800 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a0052-f74a-432f-8477-166e499af64d None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:43.054695 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eba915-032a-41c3-9bcb-867548fa3dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:43.057029 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eba915-032a-41c3-9bcb-867548fa3dde admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:43.057174 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eba915-032a-41c3-9bcb-867548fa3dde admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:43.057536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eba915-032a-41c3-9bcb-867548fa3dde admin admin] PATH_INFO: `/v3/projects/f583d2a1c8984eeea95f5191ab7b2c0b` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:43.058912 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eba915-032a-41c3-9bcb-867548fa3dde admin admin] RBAC: Authorizing `identity:delete_project(project_id=f583d2a1c8984eeea95f5191ab7b2c0b)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:43.061187 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eba915-032a-41c3-9bcb-867548fa3dde admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:43.233451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-98eba915-032a-41c3-9bcb-867548fa3dde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f583d2a1c8984eeea95f5191ab7b2c0b', 'request_id': 'req-98eba915-032a-41c3-9bcb-867548fa3dde'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:43.240156 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-98eba915-032a-41c3-9bcb-867548fa3dde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f583d2a1c8984eeea95f5191ab7b2c0b', 'request_id': 'req-98eba915-032a-41c3-9bcb-867548fa3dde'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:43.247699 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-98eba915-032a-41c3-9bcb-867548fa3dde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f583d2a1c8984eeea95f5191ab7b2c0b', 'request_id': 'req-98eba915-032a-41c3-9bcb-867548fa3dde'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:43.377511 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-98eba915-032a-41c3-9bcb-867548fa3dde admin admin] The token cache is being invalidate because project f583d2a1c8984eeea95f5191ab7b2c0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:27:43.378509 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-98eba915-032a-41c3-9bcb-867548fa3dde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:43.379313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-98eba915-032a-41c3-9bcb-867548fa3dde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:43.380899 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2512/5021] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:27:43 2022] DELETE /identity/v3/projects/f583d2a1c8984eeea95f5191ab7b2c0b => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:27:43.386076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb83b4b-ab2d-490f-ac93-228a455c284d service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:43.402163 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb83b4b-ab2d-490f-ac93-228a455c284d service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:43.477462 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1acca-4b5e-4b06-b4e4-96df284c90fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:43.479339 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1acca-4b5e-4b06-b4e4-96df284c90fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:43.479619 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1acca-4b5e-4b06-b4e4-96df284c90fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:43.480081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1acca-4b5e-4b06-b4e4-96df284c90fa admin admin] PATH_INFO: `/v3/users/76fa80dd9337468582432a1c28659e6c` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:43.481498 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1acca-4b5e-4b06-b4e4-96df284c90fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=76fa80dd9337468582432a1c28659e6c)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:43.483644 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1acca-4b5e-4b06-b4e4-96df284c90fa admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:43.756050 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-61d1acca-4b5e-4b06-b4e4-96df284c90fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76fa80dd9337468582432a1c28659e6c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:43.785605 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-61d1acca-4b5e-4b06-b4e4-96df284c90fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76fa80dd9337468582432a1c28659e6c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:43.884632 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-61d1acca-4b5e-4b06-b4e4-96df284c90fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76fa80dd9337468582432a1c28659e6c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:43.893529 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-61d1acca-4b5e-4b06-b4e4-96df284c90fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76fa80dd9337468582432a1c28659e6c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:43.895050 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-61d1acca-4b5e-4b06-b4e4-96df284c90fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76fa80dd9337468582432a1c28659e6c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:43.906316 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2510/5022] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:27:43 2022] DELETE /identity/v3/users/76fa80dd9337468582432a1c28659e6c => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:27:45.160277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eba915-032a-41c3-9bcb-867548fa3dde admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:45.161924 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-98eba915-032a-41c3-9bcb-867548fa3dde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:45.181955 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eba915-032a-41c3-9bcb-867548fa3dde admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:45.256694 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172f655-f868-4bf9-b560-9656fa302db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:45.257707 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172f655-f868-4bf9-b560-9656fa302db7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:45.258199 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172f655-f868-4bf9-b560-9656fa302db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:45.258670 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172f655-f868-4bf9-b560-9656fa302db7 admin admin] PATH_INFO: `/v3/projects/7f4d34b45cb44fc38efa2e91120a3f82` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:45.260435 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c172f655-f868-4bf9-b560-9656fa302db7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f4d34b45cb44fc38efa2e91120a3f82)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:45.262476 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c172f655-f868-4bf9-b560-9656fa302db7 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:45.536866 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c172f655-f868-4bf9-b560-9656fa302db7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f4d34b45cb44fc38efa2e91120a3f82', 'request_id': 'req-c172f655-f868-4bf9-b560-9656fa302db7'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:45.550195 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c172f655-f868-4bf9-b560-9656fa302db7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f4d34b45cb44fc38efa2e91120a3f82', 'request_id': 'req-c172f655-f868-4bf9-b560-9656fa302db7'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:45.561405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c172f655-f868-4bf9-b560-9656fa302db7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f4d34b45cb44fc38efa2e91120a3f82', 'request_id': 'req-c172f655-f868-4bf9-b560-9656fa302db7'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:45.659364 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c172f655-f868-4bf9-b560-9656fa302db7 admin admin] The token cache is being invalidate because project 7f4d34b45cb44fc38efa2e91120a3f82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:27:45.659654 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c172f655-f868-4bf9-b560-9656fa302db7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:45.660337 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c172f655-f868-4bf9-b560-9656fa302db7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:45.661928 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2513/5023] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:27:45 2022] DELETE /identity/v3/projects/7f4d34b45cb44fc38efa2e91120a3f82 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:27:45.667687 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49712d59-d481-409c-9749-626faefa2e84 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:45.668138 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49712d59-d481-409c-9749-626faefa2e84 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:45.668311 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49712d59-d481-409c-9749-626faefa2e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:45.686922 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-49712d59-d481-409c-9749-626faefa2e84 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:27:45.688024 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-49712d59-d481-409c-9749-626faefa2e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:45.760076 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2511/5024] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:27:45.769015 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a5e6d-2657-41a5-a9a7-e42309351912 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:45.769314 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a5e6d-2657-41a5-a9a7-e42309351912 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:45.769593 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a5e6d-2657-41a5-a9a7-e42309351912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:45.792374 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-8c3a5e6d-2657-41a5-a9a7-e42309351912 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:27:45.793740 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8c3a5e6d-2657-41a5-a9a7-e42309351912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:45.803070 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2514/5025] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:27:45.809857 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49712d59-d481-409c-9749-626faefa2e84 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:45.819242 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49712d59-d481-409c-9749-626faefa2e84 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:45.838046 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8db931-45dd-4dc5-9f2d-166c7b7c5e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:45.839304 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8db931-45dd-4dc5-9f2d-166c7b7c5e42 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:45.839882 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8db931-45dd-4dc5-9f2d-166c7b7c5e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:45.840373 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8db931-45dd-4dc5-9f2d-166c7b7c5e42 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:45.841330 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8db931-45dd-4dc5-9f2d-166c7b7c5e42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:27:45.841926 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8db931-45dd-4dc5-9f2d-166c7b7c5e42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:45.844114 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8db931-45dd-4dc5-9f2d-166c7b7c5e42 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:45.858594 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2512/5026] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:27:45.867735 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a5e6d-2657-41a5-a9a7-e42309351912 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:45.886516 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a5e6d-2657-41a5-a9a7-e42309351912 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:45.903140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b42bcf-9ea9-4616-b26e-3af33d8d575d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:45.904754 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b42bcf-9ea9-4616-b26e-3af33d8d575d admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:45.905108 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b42bcf-9ea9-4616-b26e-3af33d8d575d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:45.905543 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b42bcf-9ea9-4616-b26e-3af33d8d575d admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:45.906889 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b42bcf-9ea9-4616-b26e-3af33d8d575d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:45.909446 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b42bcf-9ea9-4616-b26e-3af33d8d575d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:46.014115 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2515/5027] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:27:45 2022] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:27:46.018607 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8db931-45dd-4dc5-9f2d-166c7b7c5e42 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:46.031789 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8db931-45dd-4dc5-9f2d-166c7b7c5e42 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:46.124296 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43163f89-e762-407c-9e44-8c37186686d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:46.125741 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43163f89-e762-407c-9e44-8c37186686d1 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:46.126240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43163f89-e762-407c-9e44-8c37186686d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:46.126524 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43163f89-e762-407c-9e44-8c37186686d1 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:46.127439 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43163f89-e762-407c-9e44-8c37186686d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:46.129727 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43163f89-e762-407c-9e44-8c37186686d1 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:46.271653 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2513/5028] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:27:46 2022] POST /identity/v3/users => generated 287 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:27:46.273537 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b42bcf-9ea9-4616-b26e-3af33d8d575d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:46.294199 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b42bcf-9ea9-4616-b26e-3af33d8d575d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:46.306059 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bde7cf-1f68-46a7-8c44-16ee3d132c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:46.307810 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bde7cf-1f68-46a7-8c44-16ee3d132c55 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:46.308324 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bde7cf-1f68-46a7-8c44-16ee3d132c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:46.309090 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bde7cf-1f68-46a7-8c44-16ee3d132c55 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:46.310370 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bde7cf-1f68-46a7-8c44-16ee3d132c55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:46.313311 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bde7cf-1f68-46a7-8c44-16ee3d132c55 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:46.335656 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2516/5029] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:27:46.340072 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43163f89-e762-407c-9e44-8c37186686d1 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:46.369696 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43163f89-e762-407c-9e44-8c37186686d1 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:46.376768 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b00627-d8aa-4d0f-9742-88c41757504e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:46.378124 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b00627-d8aa-4d0f-9742-88c41757504e admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:46.378773 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b00627-d8aa-4d0f-9742-88c41757504e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:46.379405 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b00627-d8aa-4d0f-9742-88c41757504e admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:46.380259 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b00627-d8aa-4d0f-9742-88c41757504e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:46.382443 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b00627-d8aa-4d0f-9742-88c41757504e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:46.412837 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2514/5030] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:27:46.417066 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bde7cf-1f68-46a7-8c44-16ee3d132c55 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:46.438554 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bde7cf-1f68-46a7-8c44-16ee3d132c55 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:46.469158 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebf385-ed58-40f5-8db1-0e0116183aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:46.470088 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebf385-ed58-40f5-8db1-0e0116183aca admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:46.470951 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebf385-ed58-40f5-8db1-0e0116183aca admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:46.471239 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebf385-ed58-40f5-8db1-0e0116183aca admin admin] PATH_INFO: `/v3/projects/426405d77bbc4e24adcbe789ba3f42f2/users/3383f0c2b1874b15b38dea61e4b8e498/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:46.526881 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ebf385-ed58-40f5-8db1-0e0116183aca admin admin] RBAC: Authorizing `identity:create_grant(project_id=426405d77bbc4e24adcbe789ba3f42f2, user_id=3383f0c2b1874b15b38dea61e4b8e498, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:46.529555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ebf385-ed58-40f5-8db1-0e0116183aca admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:46.709003 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2517/5031] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:27:46 2022] PUT /identity/v3/projects/426405d77bbc4e24adcbe789ba3f42f2/users/3383f0c2b1874b15b38dea61e4b8e498/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:27:46.710787 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72aa017-fd7e-4e5c-a14d-3d4316116377 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:46.711293 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72aa017-fd7e-4e5c-a14d-3d4316116377 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:46.711417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72aa017-fd7e-4e5c-a14d-3d4316116377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:46.732027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-c72aa017-fd7e-4e5c-a14d-3d4316116377 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:27:46.733637 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c72aa017-fd7e-4e5c-a14d-3d4316116377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:46.811163 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2515/5032] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:27:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:27:46.822484 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebf385-ed58-40f5-8db1-0e0116183aca admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:46.824167 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-21ebf385-ed58-40f5-8db1-0e0116183aca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:46.921148 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebf385-ed58-40f5-8db1-0e0116183aca admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:46.939786 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a165a65-86d6-472d-9f1b-0159cbc13b10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:46.940512 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a165a65-86d6-472d-9f1b-0159cbc13b10 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:46.940801 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a165a65-86d6-472d-9f1b-0159cbc13b10 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:46.941082 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a165a65-86d6-472d-9f1b-0159cbc13b10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:46.965017 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a165a65-86d6-472d-9f1b-0159cbc13b10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:46.966446 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a165a65-86d6-472d-9f1b-0159cbc13b10 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:46.998463 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2518/5033] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:27:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:27:47.931997 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72aa017-fd7e-4e5c-a14d-3d4316116377 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:47.935729 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c72aa017-fd7e-4e5c-a14d-3d4316116377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:47.955497 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72aa017-fd7e-4e5c-a14d-3d4316116377 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:47.959683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238da0a9-4433-477f-8717-86e630da7145 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:47.960610 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238da0a9-4433-477f-8717-86e630da7145 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:47.960995 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238da0a9-4433-477f-8717-86e630da7145 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:47.961375 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238da0a9-4433-477f-8717-86e630da7145 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:47.963609 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-238da0a9-4433-477f-8717-86e630da7145 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:47.980304 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238da0a9-4433-477f-8717-86e630da7145 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:47.981993 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238da0a9-4433-477f-8717-86e630da7145 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:48.007659 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2516/5034] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:27:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:27:48.863601 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb48e69-9934-4cfd-b581-41897150e5dd None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:48.864131 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb48e69-9934-4cfd-b581-41897150e5dd None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:48.864228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb48e69-9934-4cfd-b581-41897150e5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:48.898736 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-cdb48e69-9934-4cfd-b581-41897150e5dd None None] MFA Rules not processed for user `3383f0c2b1874b15b38dea61e4b8e498`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:27:48.900869 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-cdb48e69-9934-4cfd-b581-41897150e5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:48.990017 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2519/5035] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:27:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:27:48.995654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238da0a9-4433-477f-8717-86e630da7145 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:49.008395 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238da0a9-4433-477f-8717-86e630da7145 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:49.024331 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd39473-7aea-4b61-b7f5-32efadde8ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:49.025227 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd39473-7aea-4b61-b7f5-32efadde8ab2 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:49.026584 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd39473-7aea-4b61-b7f5-32efadde8ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:49.028049 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd39473-7aea-4b61-b7f5-32efadde8ab2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:49.030826 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd39473-7aea-4b61-b7f5-32efadde8ab2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:49.032944 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd39473-7aea-4b61-b7f5-32efadde8ab2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:49.239094 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2517/5036] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:27:48 2022] POST /identity/v3/projects => generated 373 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:27:49.240338 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb48e69-9934-4cfd-b581-41897150e5dd None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:49.257118 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb48e69-9934-4cfd-b581-41897150e5dd None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:49.381038 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb872bf-162e-46b5-b9ec-7e4f82724671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:49.382052 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb872bf-162e-46b5-b9ec-7e4f82724671 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:49.382501 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb872bf-162e-46b5-b9ec-7e4f82724671 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:49.386374 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb872bf-162e-46b5-b9ec-7e4f82724671 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:49.388116 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb872bf-162e-46b5-b9ec-7e4f82724671 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:49.393414 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb872bf-162e-46b5-b9ec-7e4f82724671 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:49.529062 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd39473-7aea-4b61-b7f5-32efadde8ab2 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:49.530323 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2520/5037] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:27:49 2022] POST /identity/v3/users => generated 293 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:27:49.555734 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd39473-7aea-4b61-b7f5-32efadde8ab2 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:49.565706 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1dc74-2dc4-43c4-9c9b-484735f4dea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:49.566658 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1dc74-2dc4-43c4-9c9b-484735f4dea1 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:49.567163 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1dc74-2dc4-43c4-9c9b-484735f4dea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:49.567551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1dc74-2dc4-43c4-9c9b-484735f4dea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:49.568517 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1dc74-2dc4-43c4-9c9b-484735f4dea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:49.572914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1dc74-2dc4-43c4-9c9b-484735f4dea1 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:49.590192 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2518/5038] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:27:49.597063 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb872bf-162e-46b5-b9ec-7e4f82724671 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:49.622753 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb872bf-162e-46b5-b9ec-7e4f82724671 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:49.631337 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2cf8f-f923-4641-8ac5-a82d414ba036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:49.632379 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2cf8f-f923-4641-8ac5-a82d414ba036 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:49.632757 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2cf8f-f923-4641-8ac5-a82d414ba036 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:49.633130 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2cf8f-f923-4641-8ac5-a82d414ba036 admin admin] PATH_INFO: `/v3/projects/ad82cac5a67f4c21aba328027a9ed73f/users/665730cc6b9a4b0aa98b0cf6f36246ba/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:49.658348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2cf8f-f923-4641-8ac5-a82d414ba036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad82cac5a67f4c21aba328027a9ed73f, user_id=665730cc6b9a4b0aa98b0cf6f36246ba, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:49.661320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2cf8f-f923-4641-8ac5-a82d414ba036 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:49.746010 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2521/5039] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:27:49 2022] PUT /identity/v3/projects/ad82cac5a67f4c21aba328027a9ed73f/users/665730cc6b9a4b0aa98b0cf6f36246ba/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:27:49.751155 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1dc74-2dc4-43c4-9c9b-484735f4dea1 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:49.769579 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1dc74-2dc4-43c4-9c9b-484735f4dea1 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:49.867549 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c95cf5-074e-49c8-8af4-509ccb96ad51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:49.868238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c95cf5-074e-49c8-8af4-509ccb96ad51 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:49.868523 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c95cf5-074e-49c8-8af4-509ccb96ad51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:49.869376 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c95cf5-074e-49c8-8af4-509ccb96ad51 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:49.870451 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c95cf5-074e-49c8-8af4-509ccb96ad51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:49.872065 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c95cf5-074e-49c8-8af4-509ccb96ad51 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:49.888005 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2519/5040] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:27:49.888530 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2cf8f-f923-4641-8ac5-a82d414ba036 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:49.902024 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2cf8f-f923-4641-8ac5-a82d414ba036 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:49.908577 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b890565-f35b-4e6c-950c-a89028e31e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:49.909688 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b890565-f35b-4e6c-950c-a89028e31e42 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:49.910238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b890565-f35b-4e6c-950c-a89028e31e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:49.911487 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b890565-f35b-4e6c-950c-a89028e31e42 admin admin] PATH_INFO: `/v3/projects/ad82cac5a67f4c21aba328027a9ed73f/users/665730cc6b9a4b0aa98b0cf6f36246ba/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:49.914033 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b890565-f35b-4e6c-950c-a89028e31e42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad82cac5a67f4c21aba328027a9ed73f, user_id=665730cc6b9a4b0aa98b0cf6f36246ba, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:49.917801 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b890565-f35b-4e6c-950c-a89028e31e42 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:49.928522 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2522/5041] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:27:49 2022] PUT /identity/v3/projects/ad82cac5a67f4c21aba328027a9ed73f/users/665730cc6b9a4b0aa98b0cf6f36246ba/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:27:51.562996 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcaa6f-0eda-4662-8554-f03336ab1ebc None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:51.563818 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcaa6f-0eda-4662-8554-f03336ab1ebc None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:51.564107 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcaa6f-0eda-4662-8554-f03336ab1ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:51.602984 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-0cbcaa6f-0eda-4662-8554-f03336ab1ebc None None] MFA Rules not processed for user `665730cc6b9a4b0aa98b0cf6f36246ba`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:27:51.607014 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0cbcaa6f-0eda-4662-8554-f03336ab1ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:51.690954 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2520/5042] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:27:51 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:27:51.702244 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe4ae1-f916-4d9f-bbb5-524ae0fa101e None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:51.702767 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe4ae1-f916-4d9f-bbb5-524ae0fa101e None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:51.702767 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe4ae1-f916-4d9f-bbb5-524ae0fa101e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:51.727551 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-78fe4ae1-f916-4d9f-bbb5-524ae0fa101e None None] MFA Rules not processed for user `3383f0c2b1874b15b38dea61e4b8e498`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:27:51.729722 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-78fe4ae1-f916-4d9f-bbb5-524ae0fa101e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:51.800258 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2523/5043] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:27:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:27:52.852140 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbcaa6f-0eda-4662-8554-f03336ab1ebc None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:52.853978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0cbcaa6f-0eda-4662-8554-f03336ab1ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:52.955418 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbcaa6f-0eda-4662-8554-f03336ab1ebc None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:52.962509 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef63f6-57b4-464d-af96-318702419e9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:52.963513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef63f6-57b4-464d-af96-318702419e9e service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:52.964035 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef63f6-57b4-464d-af96-318702419e9e service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:52.964682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef63f6-57b4-464d-af96-318702419e9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:52.975118 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef63f6-57b4-464d-af96-318702419e9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:52.980235 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef63f6-57b4-464d-af96-318702419e9e service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:52.997777 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2521/5044] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:27:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:27:57.782620 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe4ae1-f916-4d9f-bbb5-524ae0fa101e None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:57.784615 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-78fe4ae1-f916-4d9f-bbb5-524ae0fa101e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:57.867825 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe4ae1-f916-4d9f-bbb5-524ae0fa101e None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:57.874705 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e7e5f-d6cc-40ef-8e3e-e6622bef58df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:57.875720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e7e5f-d6cc-40ef-8e3e-e6622bef58df admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:57.875984 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e7e5f-d6cc-40ef-8e3e-e6622bef58df admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:57.876260 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e7e5f-d6cc-40ef-8e3e-e6622bef58df admin admin] PATH_INFO: `/v3/users/65bedbcb4d094160a9a9fc3b6ba6f603` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:57.877468 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e7e5f-d6cc-40ef-8e3e-e6622bef58df admin admin] RBAC: Authorizing `identity:delete_user(user_id=65bedbcb4d094160a9a9fc3b6ba6f603)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:57.879489 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e7e5f-d6cc-40ef-8e3e-e6622bef58df admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:58.073452 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b48e7e5f-d6cc-40ef-8e3e-e6622bef58df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65bedbcb4d094160a9a9fc3b6ba6f603'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:58.086012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b48e7e5f-d6cc-40ef-8e3e-e6622bef58df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65bedbcb4d094160a9a9fc3b6ba6f603'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:58.205390 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b48e7e5f-d6cc-40ef-8e3e-e6622bef58df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65bedbcb4d094160a9a9fc3b6ba6f603'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:58.208628 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b48e7e5f-d6cc-40ef-8e3e-e6622bef58df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65bedbcb4d094160a9a9fc3b6ba6f603'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:58.217723 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b48e7e5f-d6cc-40ef-8e3e-e6622bef58df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65bedbcb4d094160a9a9fc3b6ba6f603'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:58.225030 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2524/5045] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:27:57 2022] DELETE /identity/v3/users/65bedbcb4d094160a9a9fc3b6ba6f603 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:27:58.636487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef63f6-57b4-464d-af96-318702419e9e service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:58.648176 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef63f6-57b4-464d-af96-318702419e9e service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:58.723949 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a420a-8905-4e82-8c47-c8e9ec025d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:58.724895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a420a-8905-4e82-8c47-c8e9ec025d63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:58.725176 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a420a-8905-4e82-8c47-c8e9ec025d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:58.725641 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a420a-8905-4e82-8c47-c8e9ec025d63 admin admin] PATH_INFO: `/v3/projects/afc5d20f2f9f4ecf981cdfe980cfc21d` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:58.727508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a420a-8905-4e82-8c47-c8e9ec025d63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afc5d20f2f9f4ecf981cdfe980cfc21d)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:58.730441 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a420a-8905-4e82-8c47-c8e9ec025d63 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:58.888354 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ac6a420a-8905-4e82-8c47-c8e9ec025d63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'request_id': 'req-ac6a420a-8905-4e82-8c47-c8e9ec025d63'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:58.897119 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ac6a420a-8905-4e82-8c47-c8e9ec025d63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'request_id': 'req-ac6a420a-8905-4e82-8c47-c8e9ec025d63'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:58.908736 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ac6a420a-8905-4e82-8c47-c8e9ec025d63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afc5d20f2f9f4ecf981cdfe980cfc21d', 'request_id': 'req-ac6a420a-8905-4e82-8c47-c8e9ec025d63'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:59.073989 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ac6a420a-8905-4e82-8c47-c8e9ec025d63 admin admin] The token cache is being invalidate because project afc5d20f2f9f4ecf981cdfe980cfc21d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:27:59.074334 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ac6a420a-8905-4e82-8c47-c8e9ec025d63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:59.075669 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ac6a420a-8905-4e82-8c47-c8e9ec025d63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:27:59.077806 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2522/5046] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:27:58 2022] DELETE /identity/v3/projects/afc5d20f2f9f4ecf981cdfe980cfc21d => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:27:59.082792 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391a33e-a944-45fa-b7be-6cc54c00b6cb None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:59.086559 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391a33e-a944-45fa-b7be-6cc54c00b6cb None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:59.087686 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391a33e-a944-45fa-b7be-6cc54c00b6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:59.118554 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-8391a33e-a944-45fa-b7be-6cc54c00b6cb None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:27:59.120316 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8391a33e-a944-45fa-b7be-6cc54c00b6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:59.209023 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2525/5047] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:27:59.220314 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7d569-0747-4814-ad34-591e606abbbd None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:59.220314 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7d569-0747-4814-ad34-591e606abbbd None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:59.220314 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7d569-0747-4814-ad34-591e606abbbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:59.241095 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-f8f7d569-0747-4814-ad34-591e606abbbd None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:27:59.244063 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f8f7d569-0747-4814-ad34-591e606abbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:27:59.265612 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2523/5048] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:27:59.270157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391a33e-a944-45fa-b7be-6cc54c00b6cb None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:59.286076 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391a33e-a944-45fa-b7be-6cc54c00b6cb None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:59.302393 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99a207-07c1-4d90-a08b-630f8814ad87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:59.525453 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99a207-07c1-4d90-a08b-630f8814ad87 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:59.525453 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99a207-07c1-4d90-a08b-630f8814ad87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:59.525453 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99a207-07c1-4d90-a08b-630f8814ad87 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:59.525453 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd99a207-07c1-4d90-a08b-630f8814ad87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:27:59.525453 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd99a207-07c1-4d90-a08b-630f8814ad87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:59.525453 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd99a207-07c1-4d90-a08b-630f8814ad87 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:59.527796 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2526/5049] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:27:59.528635 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7d569-0747-4814-ad34-591e606abbbd None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:59.528635 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7d569-0747-4814-ad34-591e606abbbd None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:59.528635 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70899252-76c3-4256-b3a2-3c25bbccb00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:59.528635 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70899252-76c3-4256-b3a2-3c25bbccb00a admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:59.529127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70899252-76c3-4256-b3a2-3c25bbccb00a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:59.529127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70899252-76c3-4256-b3a2-3c25bbccb00a admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:59.529127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70899252-76c3-4256-b3a2-3c25bbccb00a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:59.529127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70899252-76c3-4256-b3a2-3c25bbccb00a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:59.612240 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2524/5050] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:27:59 2022] POST /identity/v3/projects => generated 371 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:27:59.616840 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99a207-07c1-4d90-a08b-630f8814ad87 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:59.628792 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99a207-07c1-4d90-a08b-630f8814ad87 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:59.736435 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a0300-0b08-455b-aa2d-f8b911ac1e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:59.737391 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a0300-0b08-455b-aa2d-f8b911ac1e9e admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:59.737663 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a0300-0b08-455b-aa2d-f8b911ac1e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:59.738256 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a0300-0b08-455b-aa2d-f8b911ac1e9e admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:59.739072 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a0300-0b08-455b-aa2d-f8b911ac1e9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:59.744385 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a0300-0b08-455b-aa2d-f8b911ac1e9e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:59.853687 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2527/5051] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:27:59 2022] POST /identity/v3/users => generated 286 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:27:59.858418 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70899252-76c3-4256-b3a2-3c25bbccb00a admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:59.885206 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70899252-76c3-4256-b3a2-3c25bbccb00a admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:59.907790 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21272ffc-c70e-4b71-9fe8-2b43223b4d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:59.908491 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21272ffc-c70e-4b71-9fe8-2b43223b4d98 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:59.908836 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21272ffc-c70e-4b71-9fe8-2b43223b4d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:59.909110 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21272ffc-c70e-4b71-9fe8-2b43223b4d98 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:59.911589 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21272ffc-c70e-4b71-9fe8-2b43223b4d98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:59.914780 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21272ffc-c70e-4b71-9fe8-2b43223b4d98 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:59.936983 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2525/5052] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:27:59.937590 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a0300-0b08-455b-aa2d-f8b911ac1e9e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:59.948744 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a0300-0b08-455b-aa2d-f8b911ac1e9e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:27:59.954073 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda453b-5e5b-4c9c-a5a6-e97f65be9b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:27:59.954927 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda453b-5e5b-4c9c-a5a6-e97f65be9b10 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:27:59.955509 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda453b-5e5b-4c9c-a5a6-e97f65be9b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:27:59.955886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda453b-5e5b-4c9c-a5a6-e97f65be9b10 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:27:59.956734 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdda453b-5e5b-4c9c-a5a6-e97f65be9b10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:27:59.959923 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdda453b-5e5b-4c9c-a5a6-e97f65be9b10 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:27:59.974787 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2528/5053] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:27:59.980699 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21272ffc-c70e-4b71-9fe8-2b43223b4d98 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:27:59.997491 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21272ffc-c70e-4b71-9fe8-2b43223b4d98 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:00.005971 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa450c8a-37df-4ed2-bc62-67dedb478d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:00.007339 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa450c8a-37df-4ed2-bc62-67dedb478d0e admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:00.007792 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa450c8a-37df-4ed2-bc62-67dedb478d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:00.008237 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa450c8a-37df-4ed2-bc62-67dedb478d0e admin admin] PATH_INFO: `/v3/projects/cf406de8e3de44c1ad8c376bd32503ac/users/a5e7a9057ca044b780a30da3333aecbf/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:00.049469 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa450c8a-37df-4ed2-bc62-67dedb478d0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf406de8e3de44c1ad8c376bd32503ac, user_id=a5e7a9057ca044b780a30da3333aecbf, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:00.052141 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa450c8a-37df-4ed2-bc62-67dedb478d0e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:00.152197 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2526/5054] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:27:59 2022] PUT /identity/v3/projects/cf406de8e3de44c1ad8c376bd32503ac/users/a5e7a9057ca044b780a30da3333aecbf/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:28:00.173736 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74918e-c2d8-40ed-8c1e-d7e7dcf420d5 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:00.174683 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74918e-c2d8-40ed-8c1e-d7e7dcf420d5 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:00.175679 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74918e-c2d8-40ed-8c1e-d7e7dcf420d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:00.222547 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-db74918e-c2d8-40ed-8c1e-d7e7dcf420d5 None None] MFA Rules not processed for user `a5e7a9057ca044b780a30da3333aecbf`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:00.224816 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-db74918e-c2d8-40ed-8c1e-d7e7dcf420d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:00.396156 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2529/5055] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:28:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:28:00.413988 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa450c8a-37df-4ed2-bc62-67dedb478d0e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:00.416599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-fa450c8a-37df-4ed2-bc62-67dedb478d0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:00.599181 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa450c8a-37df-4ed2-bc62-67dedb478d0e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:00.607547 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28127db5-d627-4b63-9cd9-4841ac097168 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:00.608726 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28127db5-d627-4b63-9cd9-4841ac097168 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:00.609810 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28127db5-d627-4b63-9cd9-4841ac097168 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:00.610451 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28127db5-d627-4b63-9cd9-4841ac097168 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:00.622423 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28127db5-d627-4b63-9cd9-4841ac097168 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:00.624246 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28127db5-d627-4b63-9cd9-4841ac097168 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:00.635505 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2527/5056] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:28:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:28:08.927756 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74918e-c2d8-40ed-8c1e-d7e7dcf420d5 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:08.934368 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-db74918e-c2d8-40ed-8c1e-d7e7dcf420d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:09.034858 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74918e-c2d8-40ed-8c1e-d7e7dcf420d5 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:09.042080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec0932-509f-4d1d-8592-26752d0ef971 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:09.045202 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec0932-509f-4d1d-8592-26752d0ef971 service placement] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:09.045646 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec0932-509f-4d1d-8592-26752d0ef971 service placement] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:09.046069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec0932-509f-4d1d-8592-26752d0ef971 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:09.047990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4cec0932-509f-4d1d-8592-26752d0ef971 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:09.066163 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cec0932-509f-4d1d-8592-26752d0ef971 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:09.068420 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cec0932-509f-4d1d-8592-26752d0ef971 service placement] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:09.095098 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2530/5057] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:28:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:28:10.995745 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28127db5-d627-4b63-9cd9-4841ac097168 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:10.997324 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-28127db5-d627-4b63-9cd9-4841ac097168 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:11.019547 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28127db5-d627-4b63-9cd9-4841ac097168 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:11.027547 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593174ef-3d3f-4705-ac56-409b2b2f9732 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:11.028286 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593174ef-3d3f-4705-ac56-409b2b2f9732 service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:11.028758 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593174ef-3d3f-4705-ac56-409b2b2f9732 service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:11.029034 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593174ef-3d3f-4705-ac56-409b2b2f9732 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:11.031375 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-593174ef-3d3f-4705-ac56-409b2b2f9732 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:11.046213 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593174ef-3d3f-4705-ac56-409b2b2f9732 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:11.048466 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593174ef-3d3f-4705-ac56-409b2b2f9732 service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:11.060373 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2528/5058] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:28:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:28:13.940656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec0932-509f-4d1d-8592-26752d0ef971 service placement] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:14.138179 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec0932-509f-4d1d-8592-26752d0ef971 service placement] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:14.154128 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc590a2-1876-416d-86c3-8db02ced2ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:14.156439 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc590a2-1876-416d-86c3-8db02ced2ada admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:14.156733 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc590a2-1876-416d-86c3-8db02ced2ada admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:14.157016 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc590a2-1876-416d-86c3-8db02ced2ada admin admin] PATH_INFO: `/v3/users/a5e7a9057ca044b780a30da3333aecbf` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:14.163192 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc590a2-1876-416d-86c3-8db02ced2ada admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5e7a9057ca044b780a30da3333aecbf)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:14.166340 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc590a2-1876-416d-86c3-8db02ced2ada admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:14.480909 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1bc590a2-1876-416d-86c3-8db02ced2ada admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5e7a9057ca044b780a30da3333aecbf'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:14.496311 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1bc590a2-1876-416d-86c3-8db02ced2ada admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5e7a9057ca044b780a30da3333aecbf'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:14.575540 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1bc590a2-1876-416d-86c3-8db02ced2ada admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5e7a9057ca044b780a30da3333aecbf'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:14.580667 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1bc590a2-1876-416d-86c3-8db02ced2ada admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5e7a9057ca044b780a30da3333aecbf'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:14.592176 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1bc590a2-1876-416d-86c3-8db02ced2ada admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5e7a9057ca044b780a30da3333aecbf'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:14.608121 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2531/5059] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:28:13 2022] DELETE /identity/v3/users/a5e7a9057ca044b780a30da3333aecbf => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:28:14.612853 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba642f65-d85b-49a3-8215-b7e77e9ac826 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:14.613838 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba642f65-d85b-49a3-8215-b7e77e9ac826 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:14.614359 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba642f65-d85b-49a3-8215-b7e77e9ac826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:14.637453 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-ba642f65-d85b-49a3-8215-b7e77e9ac826 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:14.639267 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ba642f65-d85b-49a3-8215-b7e77e9ac826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:14.788908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc590a2-1876-416d-86c3-8db02ced2ada admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:14.794916 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1bc590a2-1876-416d-86c3-8db02ced2ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:14.988876 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc590a2-1876-416d-86c3-8db02ced2ada admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:15.003582 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94959b3a-6e7c-4804-8704-173a9aaf58ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:15.004496 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94959b3a-6e7c-4804-8704-173a9aaf58ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:15.004781 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94959b3a-6e7c-4804-8704-173a9aaf58ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:15.005059 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94959b3a-6e7c-4804-8704-173a9aaf58ed admin admin] PATH_INFO: `/v3/users/463a0fb1322c4927abb500bfbd05f95f` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:15.006636 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94959b3a-6e7c-4804-8704-173a9aaf58ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=463a0fb1322c4927abb500bfbd05f95f)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:15.012893 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94959b3a-6e7c-4804-8704-173a9aaf58ed admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:15.098211 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2529/5060] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 486 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:28:15.107945 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba642f65-d85b-49a3-8215-b7e77e9ac826 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:15.109631 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ba642f65-d85b-49a3-8215-b7e77e9ac826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:15.214450 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba642f65-d85b-49a3-8215-b7e77e9ac826 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:15.219430 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e563172-6c7f-465f-8f92-9a7995f2920d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:15.220080 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e563172-6c7f-465f-8f92-9a7995f2920d service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:15.220362 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e563172-6c7f-465f-8f92-9a7995f2920d service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:15.220641 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e563172-6c7f-465f-8f92-9a7995f2920d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:15.233679 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e563172-6c7f-465f-8f92-9a7995f2920d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:15.240651 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e563172-6c7f-465f-8f92-9a7995f2920d service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:15.250908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-94959b3a-6e7c-4804-8704-173a9aaf58ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '463a0fb1322c4927abb500bfbd05f95f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:15.278605 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2530/5061] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:28:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:28:15.291913 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-94959b3a-6e7c-4804-8704-173a9aaf58ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '463a0fb1322c4927abb500bfbd05f95f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:15.447688 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-94959b3a-6e7c-4804-8704-173a9aaf58ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '463a0fb1322c4927abb500bfbd05f95f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:15.450772 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-94959b3a-6e7c-4804-8704-173a9aaf58ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '463a0fb1322c4927abb500bfbd05f95f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:15.458263 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-94959b3a-6e7c-4804-8704-173a9aaf58ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '463a0fb1322c4927abb500bfbd05f95f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:15.478892 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2532/5062] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:28:14 2022] DELETE /identity/v3/users/463a0fb1322c4927abb500bfbd05f95f => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:28:16.035653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e563172-6c7f-465f-8f92-9a7995f2920d service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:16.048961 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e563172-6c7f-465f-8f92-9a7995f2920d service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:16.175808 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b40a3-438a-46ee-9fc6-b21aa1334473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:16.177881 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b40a3-438a-46ee-9fc6-b21aa1334473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:16.178442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b40a3-438a-46ee-9fc6-b21aa1334473 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:16.178950 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b40a3-438a-46ee-9fc6-b21aa1334473 admin admin] PATH_INFO: `/v3/projects/8bbf68d01a624b91b6751596b4a0a480` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:16.181809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b40a3-438a-46ee-9fc6-b21aa1334473 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bbf68d01a624b91b6751596b4a0a480)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:16.185340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b40a3-438a-46ee-9fc6-b21aa1334473 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:16.345238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94959b3a-6e7c-4804-8704-173a9aaf58ed admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:16.347311 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-94959b3a-6e7c-4804-8704-173a9aaf58ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:16.371804 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94959b3a-6e7c-4804-8704-173a9aaf58ed admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:16.385892 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4991be-30d6-45f7-bd9a-d88acba97842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:16.388822 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4991be-30d6-45f7-bd9a-d88acba97842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:16.389638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4991be-30d6-45f7-bd9a-d88acba97842 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:16.391204 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4991be-30d6-45f7-bd9a-d88acba97842 admin admin] PATH_INFO: `/v3/projects/cf406de8e3de44c1ad8c376bd32503ac` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:16.394364 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4991be-30d6-45f7-bd9a-d88acba97842 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf406de8e3de44c1ad8c376bd32503ac)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:16.407448 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4991be-30d6-45f7-bd9a-d88acba97842 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:16.410179 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0b3b40a3-438a-46ee-9fc6-b21aa1334473 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bbf68d01a624b91b6751596b4a0a480', 'request_id': 'req-0b3b40a3-438a-46ee-9fc6-b21aa1334473'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:16.433905 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0b3b40a3-438a-46ee-9fc6-b21aa1334473 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bbf68d01a624b91b6751596b4a0a480', 'request_id': 'req-0b3b40a3-438a-46ee-9fc6-b21aa1334473'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:16.452515 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0b3b40a3-438a-46ee-9fc6-b21aa1334473 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bbf68d01a624b91b6751596b4a0a480', 'request_id': 'req-0b3b40a3-438a-46ee-9fc6-b21aa1334473'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:16.544177 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0b3b40a3-438a-46ee-9fc6-b21aa1334473 admin admin] The token cache is being invalidate because project 8bbf68d01a624b91b6751596b4a0a480 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:28:16.544529 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0b3b40a3-438a-46ee-9fc6-b21aa1334473 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:16.546032 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0b3b40a3-438a-46ee-9fc6-b21aa1334473 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:16.548169 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2531/5063] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:28:16 2022] DELETE /identity/v3/projects/8bbf68d01a624b91b6751596b4a0a480 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:28:16.553206 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e922b-d923-4a55-807d-2aa6484781f3 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:16.553565 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e922b-d923-4a55-807d-2aa6484781f3 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:16.553798 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e922b-d923-4a55-807d-2aa6484781f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:16.604244 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ea4991be-30d6-45f7-bd9a-d88acba97842 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf406de8e3de44c1ad8c376bd32503ac', 'request_id': 'req-ea4991be-30d6-45f7-bd9a-d88acba97842'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:16.605225 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-fc4e922b-d923-4a55-807d-2aa6484781f3 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:16.628517 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-fc4e922b-d923-4a55-807d-2aa6484781f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:16.628706 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ea4991be-30d6-45f7-bd9a-d88acba97842 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf406de8e3de44c1ad8c376bd32503ac', 'request_id': 'req-ea4991be-30d6-45f7-bd9a-d88acba97842'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:16.632867 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ea4991be-30d6-45f7-bd9a-d88acba97842 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf406de8e3de44c1ad8c376bd32503ac', 'request_id': 'req-ea4991be-30d6-45f7-bd9a-d88acba97842'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:16.716500 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ea4991be-30d6-45f7-bd9a-d88acba97842 admin admin] The token cache is being invalidate because project cf406de8e3de44c1ad8c376bd32503ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:28:16.717417 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ea4991be-30d6-45f7-bd9a-d88acba97842 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:16.718589 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ea4991be-30d6-45f7-bd9a-d88acba97842 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:16.722719 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2533/5064] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:28:16 2022] DELETE /identity/v3/projects/cf406de8e3de44c1ad8c376bd32503ac => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:28:16.724020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4991be-30d6-45f7-bd9a-d88acba97842 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:16.727098 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ea4991be-30d6-45f7-bd9a-d88acba97842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:16.762415 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2532/5065] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:28:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:28:16.764027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667c29f-903e-45d1-b838-ed22657e031a None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:16.764474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667c29f-903e-45d1-b838-ed22657e031a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:16.764929 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667c29f-903e-45d1-b838-ed22657e031a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:16.801562 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-8667c29f-903e-45d1-b838-ed22657e031a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:16.802842 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8667c29f-903e-45d1-b838-ed22657e031a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:16.823613 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2533/5066] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:28:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:28:16.825140 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4c297-4233-48f2-90ae-4d3e7c8d679c None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:16.828203 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4c297-4233-48f2-90ae-4d3e7c8d679c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:16.828684 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4c297-4233-48f2-90ae-4d3e7c8d679c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:16.879707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-bdc4c297-4233-48f2-90ae-4d3e7c8d679c None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:16.880964 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-bdc4c297-4233-48f2-90ae-4d3e7c8d679c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:16.912654 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2534/5067] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:28:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:28:16.916194 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf282b7-5585-4bf4-bfd2-6af59f18fca4 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:16.922813 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf282b7-5585-4bf4-bfd2-6af59f18fca4 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:16.922813 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf282b7-5585-4bf4-bfd2-6af59f18fca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:16.950252 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4991be-30d6-45f7-bd9a-d88acba97842 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:16.954762 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc21a0b-b0e2-4dc4-aa20-582724dead21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:16.955805 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc21a0b-b0e2-4dc4-aa20-582724dead21 service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:16.956312 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc21a0b-b0e2-4dc4-aa20-582724dead21 service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:16.956897 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc21a0b-b0e2-4dc4-aa20-582724dead21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:16.959154 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8dc21a0b-b0e2-4dc4-aa20-582724dead21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:16.959511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-fdf282b7-5585-4bf4-bfd2-6af59f18fca4 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:16.966377 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-fdf282b7-5585-4bf4-bfd2-6af59f18fca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:16.988672 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2535/5068] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:28:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:28:16.991511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf282b7-5585-4bf4-bfd2-6af59f18fca4 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:17.020195 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf282b7-5585-4bf4-bfd2-6af59f18fca4 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:17.029599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce4d20-212c-4df6-a5d4-7108dc3e3624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:17.030582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce4d20-212c-4df6-a5d4-7108dc3e3624 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:17.031815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce4d20-212c-4df6-a5d4-7108dc3e3624 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:17.033364 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce4d20-212c-4df6-a5d4-7108dc3e3624 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:17.034370 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce4d20-212c-4df6-a5d4-7108dc3e3624 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:28:17.035899 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce4d20-212c-4df6-a5d4-7108dc3e3624 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:17.038202 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce4d20-212c-4df6-a5d4-7108dc3e3624 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:17.075192 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2536/5069] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:28:17.078061 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce4d20-212c-4df6-a5d4-7108dc3e3624 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:17.107668 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce4d20-212c-4df6-a5d4-7108dc3e3624 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:17.127415 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d7c20-25c2-478a-9a79-d47e8e6b8159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:17.130070 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d7c20-25c2-478a-9a79-d47e8e6b8159 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:17.130370 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d7c20-25c2-478a-9a79-d47e8e6b8159 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:17.131248 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d7c20-25c2-478a-9a79-d47e8e6b8159 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:17.137638 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d7c20-25c2-478a-9a79-d47e8e6b8159 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:28:17.138354 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d7c20-25c2-478a-9a79-d47e8e6b8159 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:17.140231 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d7c20-25c2-478a-9a79-d47e8e6b8159 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:17.143086 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc21a0b-b0e2-4dc4-aa20-582724dead21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:17.148019 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc21a0b-b0e2-4dc4-aa20-582724dead21 service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:17.211626 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2534/5070] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:28:16 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:28:17.212520 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc21a0b-b0e2-4dc4-aa20-582724dead21 service cinder] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:17.214712 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2537/5071] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:28:17.219264 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d7c20-25c2-478a-9a79-d47e8e6b8159 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:17.241035 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc21a0b-b0e2-4dc4-aa20-582724dead21 service cinder] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:17.257486 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36616e-9b43-4a47-9478-6c45798566a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:17.258932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36616e-9b43-4a47-9478-6c45798566a0 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:17.259289 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36616e-9b43-4a47-9478-6c45798566a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:17.259635 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36616e-9b43-4a47-9478-6c45798566a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:17.261072 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36616e-9b43-4a47-9478-6c45798566a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:17.263355 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d7c20-25c2-478a-9a79-d47e8e6b8159 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:17.274637 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36616e-9b43-4a47-9478-6c45798566a0 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:17.283509 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93f03e-15f0-4db9-824a-9dc4a39ca19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:17.285407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93f03e-15f0-4db9-824a-9dc4a39ca19c admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:17.285407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93f03e-15f0-4db9-824a-9dc4a39ca19c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:17.285407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93f03e-15f0-4db9-824a-9dc4a39ca19c admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:17.285817 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d93f03e-15f0-4db9-824a-9dc4a39ca19c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:17.295363 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d93f03e-15f0-4db9-824a-9dc4a39ca19c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:17.449418 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2538/5072] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:28:17 2022] POST /identity/v3/projects => generated 375 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:28:17.453748 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93f03e-15f0-4db9-824a-9dc4a39ca19c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:17.466420 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2535/5073] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:28:17 2022] POST /identity/v3/projects => generated 377 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:28:17.472578 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36616e-9b43-4a47-9478-6c45798566a0 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:17.616064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93f03e-15f0-4db9-824a-9dc4a39ca19c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:17.715274 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36616e-9b43-4a47-9478-6c45798566a0 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:17.740206 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850ab73-321e-463f-8583-adcaea232e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:17.741441 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850ab73-321e-463f-8583-adcaea232e1d admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:17.742011 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850ab73-321e-463f-8583-adcaea232e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:17.743082 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850ab73-321e-463f-8583-adcaea232e1d admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:17.743911 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3850ab73-321e-463f-8583-adcaea232e1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:17.750168 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3850ab73-321e-463f-8583-adcaea232e1d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:17.786972 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab238c5-1356-4aeb-95fc-f603e36e0986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:17.787942 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab238c5-1356-4aeb-95fc-f603e36e0986 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:17.788284 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab238c5-1356-4aeb-95fc-f603e36e0986 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:17.788567 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab238c5-1356-4aeb-95fc-f603e36e0986 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:17.789303 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab238c5-1356-4aeb-95fc-f603e36e0986 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:17.807922 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab238c5-1356-4aeb-95fc-f603e36e0986 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:17.862284 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2536/5074] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:28:17 2022] POST /identity/v3/users => generated 289 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:28:17.863233 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850ab73-321e-463f-8583-adcaea232e1d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:17.875255 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850ab73-321e-463f-8583-adcaea232e1d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:17.889637 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9faa6f-cd9b-4104-924a-2f89f6d07745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:17.891254 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9faa6f-cd9b-4104-924a-2f89f6d07745 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:17.891782 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9faa6f-cd9b-4104-924a-2f89f6d07745 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:17.892275 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9faa6f-cd9b-4104-924a-2f89f6d07745 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:17.893252 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9faa6f-cd9b-4104-924a-2f89f6d07745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:17.895200 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9faa6f-cd9b-4104-924a-2f89f6d07745 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:17.911323 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2537/5075] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:28:17.917201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9faa6f-cd9b-4104-924a-2f89f6d07745 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:17.931232 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9faa6f-cd9b-4104-924a-2f89f6d07745 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:17.936575 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795355a-1cef-461d-8fd8-e12bf392386e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:17.937373 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795355a-1cef-461d-8fd8-e12bf392386e admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:17.937802 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795355a-1cef-461d-8fd8-e12bf392386e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:17.938198 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795355a-1cef-461d-8fd8-e12bf392386e admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:17.939038 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795355a-1cef-461d-8fd8-e12bf392386e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:17.940774 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795355a-1cef-461d-8fd8-e12bf392386e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:17.962774 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2539/5076] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:28:17 2022] POST /identity/v3/users => generated 288 bytes in 509 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:28:17.967996 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab238c5-1356-4aeb-95fc-f603e36e0986 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:17.974394 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2538/5077] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:28:17.976720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795355a-1cef-461d-8fd8-e12bf392386e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:17.994596 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab238c5-1356-4aeb-95fc-f603e36e0986 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:18.007846 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27cc36-c53f-4bdf-b6aa-bd092e9531ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:18.008750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27cc36-c53f-4bdf-b6aa-bd092e9531ba admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:18.009134 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27cc36-c53f-4bdf-b6aa-bd092e9531ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:18.009504 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27cc36-c53f-4bdf-b6aa-bd092e9531ba admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:18.010399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c27cc36-c53f-4bdf-b6aa-bd092e9531ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:18.014012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795355a-1cef-461d-8fd8-e12bf392386e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:18.014155 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c27cc36-c53f-4bdf-b6aa-bd092e9531ba admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:18.026546 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf0e72-8bb4-40c0-b831-ceaa29b173a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:18.027460 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf0e72-8bb4-40c0-b831-ceaa29b173a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:18.027746 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf0e72-8bb4-40c0-b831-ceaa29b173a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:18.028131 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf0e72-8bb4-40c0-b831-ceaa29b173a3 admin admin] PATH_INFO: `/v3/projects/a036fe856ad94ef98ff000ee43a9b599/users/1649221dd0a749b0ac9762baa57815fd/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:18.049168 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2540/5078] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:28:18.050580 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27cc36-c53f-4bdf-b6aa-bd092e9531ba admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:18.069074 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf0e72-8bb4-40c0-b831-ceaa29b173a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a036fe856ad94ef98ff000ee43a9b599, user_id=1649221dd0a749b0ac9762baa57815fd, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:18.069074 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf0e72-8bb4-40c0-b831-ceaa29b173a3 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:18.078268 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27cc36-c53f-4bdf-b6aa-bd092e9531ba admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:18.108993 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a2289-4740-4ace-9676-6a6f87cb3027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:18.110003 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a2289-4740-4ace-9676-6a6f87cb3027 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:18.110395 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a2289-4740-4ace-9676-6a6f87cb3027 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:18.118006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a2289-4740-4ace-9676-6a6f87cb3027 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:18.118006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a2289-4740-4ace-9676-6a6f87cb3027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:18.118006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a2289-4740-4ace-9676-6a6f87cb3027 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:18.156673 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2541/5079] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:28:18.161215 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a2289-4740-4ace-9676-6a6f87cb3027 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:18.184167 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a2289-4740-4ace-9676-6a6f87cb3027 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:18.205318 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00666cd9-018b-4686-94fb-72d51d5cc55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:18.206258 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00666cd9-018b-4686-94fb-72d51d5cc55a admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:18.206535 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00666cd9-018b-4686-94fb-72d51d5cc55a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:18.206809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00666cd9-018b-4686-94fb-72d51d5cc55a admin admin] PATH_INFO: `/v3/projects/7e972e71b7fb42a89db19c9ef072c8a4/users/b6658f2c261a4303a218318a916fd4ab/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:18.211943 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2539/5080] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:28:17 2022] PUT /identity/v3/projects/a036fe856ad94ef98ff000ee43a9b599/users/1649221dd0a749b0ac9762baa57815fd/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:28:18.213700 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918ffb4-3cf5-40f9-b724-8b14ecfb8c90 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:18.214124 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918ffb4-3cf5-40f9-b724-8b14ecfb8c90 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:18.214542 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918ffb4-3cf5-40f9-b724-8b14ecfb8c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:18.237727 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-b918ffb4-3cf5-40f9-b724-8b14ecfb8c90 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:18.251545 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b918ffb4-3cf5-40f9-b724-8b14ecfb8c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:18.253738 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00666cd9-018b-4686-94fb-72d51d5cc55a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e972e71b7fb42a89db19c9ef072c8a4, user_id=b6658f2c261a4303a218318a916fd4ab, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:18.257094 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00666cd9-018b-4686-94fb-72d51d5cc55a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:18.395576 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2542/5081] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:28:18 2022] PUT /identity/v3/projects/7e972e71b7fb42a89db19c9ef072c8a4/users/b6658f2c261a4303a218318a916fd4ab/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:28:18.491834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb46dc-de28-4293-a89f-8e4e817524b5 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:18.493126 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb46dc-de28-4293-a89f-8e4e817524b5 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:18.493617 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb46dc-de28-4293-a89f-8e4e817524b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:18.507776 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2540/5082] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:28:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:28:18.518312 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918ffb4-3cf5-40f9-b724-8b14ecfb8c90 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:18.519773 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b918ffb4-3cf5-40f9-b724-8b14ecfb8c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:18.562947 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-f2eb46dc-de28-4293-a89f-8e4e817524b5 None None] MFA Rules not processed for user `b6658f2c261a4303a218318a916fd4ab`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:18.564250 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f2eb46dc-de28-4293-a89f-8e4e817524b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:18.667158 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918ffb4-3cf5-40f9-b724-8b14ecfb8c90 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:18.696255 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2543/5083] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:28:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:28:18.702293 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb46dc-de28-4293-a89f-8e4e817524b5 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:18.783220 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb0567-04f0-47bd-ab80-b2ef06a4b46f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:18.784231 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb0567-04f0-47bd-ab80-b2ef06a4b46f service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:18.784719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb0567-04f0-47bd-ab80-b2ef06a4b46f service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:18.785212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb0567-04f0-47bd-ab80-b2ef06a4b46f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:18.896160 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb46dc-de28-4293-a89f-8e4e817524b5 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:18.909860 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb947a40-210c-4e99-809f-53fe9ca30995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:18.910699 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb947a40-210c-4e99-809f-53fe9ca30995 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:18.911111 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb947a40-210c-4e99-809f-53fe9ca30995 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:18.912046 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb947a40-210c-4e99-809f-53fe9ca30995 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:18.912854 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb947a40-210c-4e99-809f-53fe9ca30995 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:18.917261 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb947a40-210c-4e99-809f-53fe9ca30995 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:18.953190 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb0567-04f0-47bd-ab80-b2ef06a4b46f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:18.959892 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb0567-04f0-47bd-ab80-b2ef06a4b46f service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:18.966888 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2541/5084] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:28:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:28:19.044259 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2544/5085] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:28:18 2022] POST /identity/v3/projects => generated 375 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:28:19.048099 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb0567-04f0-47bd-ab80-b2ef06a4b46f service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:19.058987 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb0567-04f0-47bd-ab80-b2ef06a4b46f service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:19.138011 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212cb74-9bd4-4a22-bd59-565a5a69bfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:19.139396 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212cb74-9bd4-4a22-bd59-565a5a69bfda admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:19.139396 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212cb74-9bd4-4a22-bd59-565a5a69bfda admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:19.139719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212cb74-9bd4-4a22-bd59-565a5a69bfda admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:19.140969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b212cb74-9bd4-4a22-bd59-565a5a69bfda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:19.142956 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b212cb74-9bd4-4a22-bd59-565a5a69bfda admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:19.308583 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2542/5086] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:28:19 2022] POST /identity/v3/users => generated 294 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:28:19.310195 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb947a40-210c-4e99-809f-53fe9ca30995 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:19.320963 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb947a40-210c-4e99-809f-53fe9ca30995 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:19.325644 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64109fb8-1735-4643-89db-67acffef260e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:19.329566 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64109fb8-1735-4643-89db-67acffef260e admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:19.329566 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64109fb8-1735-4643-89db-67acffef260e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:19.329566 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64109fb8-1735-4643-89db-67acffef260e admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:19.329566 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64109fb8-1735-4643-89db-67acffef260e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:19.329566 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64109fb8-1735-4643-89db-67acffef260e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:19.341176 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2545/5087] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:28:19.345402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212cb74-9bd4-4a22-bd59-565a5a69bfda admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:19.356382 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212cb74-9bd4-4a22-bd59-565a5a69bfda admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:19.361829 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01215499-ab2b-4bb4-80e8-771d91601117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:19.362815 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01215499-ab2b-4bb4-80e8-771d91601117 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:19.363173 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01215499-ab2b-4bb4-80e8-771d91601117 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:19.363515 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01215499-ab2b-4bb4-80e8-771d91601117 admin admin] PATH_INFO: `/v3/projects/6bd63f5f58d244b3a99abe25cc4aaf88/users/cadfe5f429294a7984dc6e1c726d14f0/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:19.383583 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01215499-ab2b-4bb4-80e8-771d91601117 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bd63f5f58d244b3a99abe25cc4aaf88, user_id=cadfe5f429294a7984dc6e1c726d14f0, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:19.386495 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01215499-ab2b-4bb4-80e8-771d91601117 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:19.505572 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2543/5088] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:28:19 2022] PUT /identity/v3/projects/6bd63f5f58d244b3a99abe25cc4aaf88/users/cadfe5f429294a7984dc6e1c726d14f0/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:28:19.510342 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64109fb8-1735-4643-89db-67acffef260e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:19.529114 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64109fb8-1735-4643-89db-67acffef260e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:19.618369 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23c2ca-54a2-4e80-9b64-f030f7a3a794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:19.619456 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23c2ca-54a2-4e80-9b64-f030f7a3a794 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:19.619945 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23c2ca-54a2-4e80-9b64-f030f7a3a794 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:19.620380 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23c2ca-54a2-4e80-9b64-f030f7a3a794 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:19.621130 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb23c2ca-54a2-4e80-9b64-f030f7a3a794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:19.622898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb23c2ca-54a2-4e80-9b64-f030f7a3a794 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:19.636536 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2546/5089] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:28:19.641393 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01215499-ab2b-4bb4-80e8-771d91601117 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:19.667910 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01215499-ab2b-4bb4-80e8-771d91601117 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:19.674905 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae71c35-6671-4bee-866b-16d0f15e3828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:19.676145 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae71c35-6671-4bee-866b-16d0f15e3828 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:19.677056 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae71c35-6671-4bee-866b-16d0f15e3828 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:19.677694 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae71c35-6671-4bee-866b-16d0f15e3828 admin admin] PATH_INFO: `/v3/projects/6bd63f5f58d244b3a99abe25cc4aaf88/users/cadfe5f429294a7984dc6e1c726d14f0/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:19.681528 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae71c35-6671-4bee-866b-16d0f15e3828 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bd63f5f58d244b3a99abe25cc4aaf88, user_id=cadfe5f429294a7984dc6e1c726d14f0, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:19.685185 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae71c35-6671-4bee-866b-16d0f15e3828 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:19.713674 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2544/5090] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:28:19 2022] PUT /identity/v3/projects/6bd63f5f58d244b3a99abe25cc4aaf88/users/cadfe5f429294a7984dc6e1c726d14f0/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:28:19.715906 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25dcc9-697a-4d4f-8df1-97264b48a541 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:19.716207 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25dcc9-697a-4d4f-8df1-97264b48a541 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:19.716494 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25dcc9-697a-4d4f-8df1-97264b48a541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:19.752502 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-8c25dcc9-697a-4d4f-8df1-97264b48a541 None None] MFA Rules not processed for user `cadfe5f429294a7984dc6e1c726d14f0`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:19.754010 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8c25dcc9-697a-4d4f-8df1-97264b48a541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:19.871358 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2547/5091] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:28:19 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:28:19.876204 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae71c35-6671-4bee-866b-16d0f15e3828 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:19.901119 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae71c35-6671-4bee-866b-16d0f15e3828 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:19.906476 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f7f62-e679-4f34-a53f-d8712881624e tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cadfe5f429294a7984dc6e1c726d14f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bd63f5f58d244b3a99abe25cc4aaf88', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:19.907665 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f7f62-e679-4f34-a53f-d8712881624e tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:19.908189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f7f62-e679-4f34-a53f-d8712881624e tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:19.908491 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f7f62-e679-4f34-a53f-d8712881624e tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:19.909300 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f7f62-e679-4f34-a53f-d8712881624e tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:19.910391 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-0c1f7f62-e679-4f34-a53f-d8712881624e tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:28:19.910391 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:28:19.910391 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:28:19.911568 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f7f62-e679-4f34-a53f-d8712881624e tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:19.984834 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2545/5092] 10.222.0.23 () {60 vars in 1184 bytes} [Sat Apr 30 21:28:19 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:28:19.988902 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c25dcc9-697a-4d4f-8df1-97264b48a541 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:19.998675 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c25dcc9-697a-4d4f-8df1-97264b48a541 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:20.004241 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f6e51-85d6-4d95-a962-d27857ce85d6 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cadfe5f429294a7984dc6e1c726d14f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bd63f5f58d244b3a99abe25cc4aaf88', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:20.005197 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f6e51-85d6-4d95-a962-d27857ce85d6 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:20.005538 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f6e51-85d6-4d95-a962-d27857ce85d6 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:20.005911 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f6e51-85d6-4d95-a962-d27857ce85d6 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/df9798f35f3544a0a1a8a344af656d12` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:20.006673 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f6e51-85d6-4d95-a962-d27857ce85d6 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=df9798f35f3544a0a1a8a344af656d12)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:20.007771 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-269f6e51-85d6-4d95-a962-d27857ce85d6 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:28:20.007771 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:28:20.007771 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:28:20.009589 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f6e51-85d6-4d95-a962-d27857ce85d6 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:20.022024 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2548/5093] 10.222.0.23 () {58 vars in 1262 bytes} [Sat Apr 30 21:28:19 2022] GET /identity/v3/OS-OAUTH1/consumers/df9798f35f3544a0a1a8a344af656d12 => generated 220 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:28:20.029467 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f7f62-e679-4f34-a53f-d8712881624e tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:20.048984 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f7f62-e679-4f34-a53f-d8712881624e tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:20.057659 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f6e51-85d6-4d95-a962-d27857ce85d6 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:20.059689 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-269f6e51-85d6-4d95-a962-d27857ce85d6 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:20.060926 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dba5f8-62d4-4618-97fb-f236d02e2794 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cadfe5f429294a7984dc6e1c726d14f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bd63f5f58d244b3a99abe25cc4aaf88', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:20.062818 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dba5f8-62d4-4618-97fb-f236d02e2794 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:20.063526 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dba5f8-62d4-4618-97fb-f236d02e2794 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:20.063977 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dba5f8-62d4-4618-97fb-f236d02e2794 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/df9798f35f3544a0a1a8a344af656d12` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:20.064829 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dba5f8-62d4-4618-97fb-f236d02e2794 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=df9798f35f3544a0a1a8a344af656d12)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:20.066753 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-44dba5f8-62d4-4618-97fb-f236d02e2794 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:28:20.066753 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:28:20.066753 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:28:20.068200 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dba5f8-62d4-4618-97fb-f236d02e2794 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:20.068661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-44dba5f8-62d4-4618-97fb-f236d02e2794 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Invalidating token cache because consumer df9798f35f3544a0a1a8a344af656d12 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:28:20.069295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-44dba5f8-62d4-4618-97fb-f236d02e2794 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:20.073426 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-44dba5f8-62d4-4618-97fb-f236d02e2794 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:20.157659 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f6e51-85d6-4d95-a962-d27857ce85d6 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:20.163197 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb59945-ef08-45f2-adcc-d941b15a2491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:20.165511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb59945-ef08-45f2-adcc-d941b15a2491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:20.165511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb59945-ef08-45f2-adcc-d941b15a2491 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:20.165694 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb59945-ef08-45f2-adcc-d941b15a2491 admin admin] PATH_INFO: `/v3/users/582d05a237ba4a1a95ba93474fd4a978` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:20.167007 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb59945-ef08-45f2-adcc-d941b15a2491 admin admin] RBAC: Authorizing `identity:delete_user(user_id=582d05a237ba4a1a95ba93474fd4a978)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:20.168854 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb59945-ef08-45f2-adcc-d941b15a2491 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:20.232526 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-44dba5f8-62d4-4618-97fb-f236d02e2794 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'df9798f35f3544a0a1a8a344af656d12', 'request_id': 'req-44dba5f8-62d4-4618-97fb-f236d02e2794'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:20.389740 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2546/5094] 10.222.0.23 () {58 vars in 1265 bytes} [Sat Apr 30 21:28:20 2022] DELETE /identity/v3/OS-OAUTH1/consumers/df9798f35f3544a0a1a8a344af656d12 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:28:20.391188 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dba5f8-62d4-4618-97fb-f236d02e2794 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:20.392889 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-44dba5f8-62d4-4618-97fb-f236d02e2794 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:20.409135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dba5f8-62d4-4618-97fb-f236d02e2794 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:20.416202 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eed0af-af66-4056-93b6-d8fd9bbca7a6 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cadfe5f429294a7984dc6e1c726d14f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bd63f5f58d244b3a99abe25cc4aaf88', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:20.416998 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eed0af-af66-4056-93b6-d8fd9bbca7a6 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:20.417387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eed0af-af66-4056-93b6-d8fd9bbca7a6 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:20.419873 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eed0af-af66-4056-93b6-d8fd9bbca7a6 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:20.421089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eed0af-af66-4056-93b6-d8fd9bbca7a6 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:20.423229 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eed0af-af66-4056-93b6-d8fd9bbca7a6 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:20.447539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6eb59945-ef08-45f2-adcc-d941b15a2491 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '582d05a237ba4a1a95ba93474fd4a978'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:20.462592 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6eb59945-ef08-45f2-adcc-d941b15a2491 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '582d05a237ba4a1a95ba93474fd4a978'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:20.529126 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2547/5095] 10.222.0.23 () {60 vars in 1184 bytes} [Sat Apr 30 21:28:20 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:28:20.530589 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eed0af-af66-4056-93b6-d8fd9bbca7a6 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:20.541700 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eed0af-af66-4056-93b6-d8fd9bbca7a6 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:20.547171 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766839a-94f7-4177-8e2c-3291fb9ac8a9 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cadfe5f429294a7984dc6e1c726d14f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bd63f5f58d244b3a99abe25cc4aaf88', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:20.553600 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766839a-94f7-4177-8e2c-3291fb9ac8a9 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:20.560688 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766839a-94f7-4177-8e2c-3291fb9ac8a9 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:20.560688 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766839a-94f7-4177-8e2c-3291fb9ac8a9 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/0c619ee0681949148b873651b8b433f4` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:20.560688 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5766839a-94f7-4177-8e2c-3291fb9ac8a9 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=0c619ee0681949148b873651b8b433f4)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:20.560688 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-5766839a-94f7-4177-8e2c-3291fb9ac8a9 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:28:20.560688 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:28:20.560688 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:28:20.561262 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5766839a-94f7-4177-8e2c-3291fb9ac8a9 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:20.565982 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2548/5096] 10.222.0.23 () {58 vars in 1262 bytes} [Sat Apr 30 21:28:20 2022] GET /identity/v3/OS-OAUTH1/consumers/0c619ee0681949148b873651b8b433f4 => generated 220 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:28:20.566524 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6eb59945-ef08-45f2-adcc-d941b15a2491 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '582d05a237ba4a1a95ba93474fd4a978'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:20.569969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766839a-94f7-4177-8e2c-3291fb9ac8a9 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:20.583324 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6eb59945-ef08-45f2-adcc-d941b15a2491 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '582d05a237ba4a1a95ba93474fd4a978'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:20.587095 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6eb59945-ef08-45f2-adcc-d941b15a2491 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '582d05a237ba4a1a95ba93474fd4a978'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:20.587370 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766839a-94f7-4177-8e2c-3291fb9ac8a9 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:20.594274 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2549/5097] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:28:20 2022] DELETE /identity/v3/users/582d05a237ba4a1a95ba93474fd4a978 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:28:20.679405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eec526-c122-40ec-93df-bf21259598f9 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cadfe5f429294a7984dc6e1c726d14f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bd63f5f58d244b3a99abe25cc4aaf88', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:20.681617 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eec526-c122-40ec-93df-bf21259598f9 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:20.682001 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eec526-c122-40ec-93df-bf21259598f9 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:20.682539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eec526-c122-40ec-93df-bf21259598f9 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/0c619ee0681949148b873651b8b433f4` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:20.683395 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eec526-c122-40ec-93df-bf21259598f9 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=0c619ee0681949148b873651b8b433f4)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:20.685543 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eec526-c122-40ec-93df-bf21259598f9 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:20.686320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-98eec526-c122-40ec-93df-bf21259598f9 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Invalidating token cache because consumer 0c619ee0681949148b873651b8b433f4 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:28:20.686861 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-98eec526-c122-40ec-93df-bf21259598f9 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:20.687832 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-98eec526-c122-40ec-93df-bf21259598f9 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:20.803913 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-98eec526-c122-40ec-93df-bf21259598f9 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '0c619ee0681949148b873651b8b433f4', 'request_id': 'req-98eec526-c122-40ec-93df-bf21259598f9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:20.955452 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2549/5098] 10.222.0.23 () {58 vars in 1265 bytes} [Sat Apr 30 21:28:20 2022] DELETE /identity/v3/OS-OAUTH1/consumers/0c619ee0681949148b873651b8b433f4 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:28:20.959899 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb59945-ef08-45f2-adcc-d941b15a2491 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:20.961362 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6eb59945-ef08-45f2-adcc-d941b15a2491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:20.975481 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb59945-ef08-45f2-adcc-d941b15a2491 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:20.983728 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe834269-4e14-4053-b12f-29c6121a7aab tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cadfe5f429294a7984dc6e1c726d14f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bd63f5f58d244b3a99abe25cc4aaf88', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:20.984544 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe834269-4e14-4053-b12f-29c6121a7aab tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:20.984859 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe834269-4e14-4053-b12f-29c6121a7aab tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:20.985140 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe834269-4e14-4053-b12f-29c6121a7aab tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/0c619ee0681949148b873651b8b433f4` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:20.985840 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe834269-4e14-4053-b12f-29c6121a7aab tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=0c619ee0681949148b873651b8b433f4)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:20.987583 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe834269-4e14-4053-b12f-29c6121a7aab tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:21.002971 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eec526-c122-40ec-93df-bf21259598f9 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:21.005445 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-98eec526-c122-40ec-93df-bf21259598f9 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:21.035361 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-fe834269-4e14-4053-b12f-29c6121a7aab tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Apr 30 21:28:21.035361 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:28:21.035361 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:28:21.035361 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:28:21.035361 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:28:21.035361 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:28:21.035361 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:28:21.035361 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:28:21.035361 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:28:21.035361 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:28:21.035361 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:28:21.035361 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:28:21.035361 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Apr 30 21:28:21.035361 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Apr 30 21:28:21.035361 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Apr 30 21:28:21.036726 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Apr 30 21:28:21.036726 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Apr 30 21:28:21.036726 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Apr 30 21:28:21.036726 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Apr 30 21:28:21.036726 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Apr 30 21:28:21.036726 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Apr 30 21:28:21.036726 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Apr 30 21:28:21.036726 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Apr 30 21:28:21.036726 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:28:21.046545 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2550/5099] 10.222.0.23 () {58 vars in 1262 bytes} [Sat Apr 30 21:28:20 2022] GET /identity/v3/OS-OAUTH1/consumers/0c619ee0681949148b873651b8b433f4 => generated 74 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 21:28:21.048743 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe834269-4e14-4053-b12f-29c6121a7aab tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:21.052077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-fe834269-4e14-4053-b12f-29c6121a7aab tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:21.078896 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe834269-4e14-4053-b12f-29c6121a7aab tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:21.084090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfcddd-9120-489b-8566-1579616e44eb tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cadfe5f429294a7984dc6e1c726d14f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bd63f5f58d244b3a99abe25cc4aaf88', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:21.084918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfcddd-9120-489b-8566-1579616e44eb tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:21.085244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfcddd-9120-489b-8566-1579616e44eb tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:21.085476 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfcddd-9120-489b-8566-1579616e44eb tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/0c619ee0681949148b873651b8b433f4` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:21.087068 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfcddd-9120-489b-8566-1579616e44eb tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=0c619ee0681949148b873651b8b433f4)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:21.089234 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-9ecfcddd-9120-489b-8566-1579616e44eb tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:28:21.089234 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:28:21.089234 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:28:21.090236 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfcddd-9120-489b-8566-1579616e44eb tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:21.090507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9ecfcddd-9120-489b-8566-1579616e44eb tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Invalidating token cache because consumer 0c619ee0681949148b873651b8b433f4 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:28:21.090784 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9ecfcddd-9120-489b-8566-1579616e44eb tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:21.091671 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9ecfcddd-9120-489b-8566-1579616e44eb tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:21.094069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eec526-c122-40ec-93df-bf21259598f9 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:21.099814 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824cc40-d9cb-4000-90a8-dbe025bc1436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:21.106042 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824cc40-d9cb-4000-90a8-dbe025bc1436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:21.106042 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824cc40-d9cb-4000-90a8-dbe025bc1436 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:21.106042 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824cc40-d9cb-4000-90a8-dbe025bc1436 admin admin] PATH_INFO: `/v3/projects/acd535df3826485d8472597a6258a56c` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:21.106824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824cc40-d9cb-4000-90a8-dbe025bc1436 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acd535df3826485d8472597a6258a56c)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:21.109362 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824cc40-d9cb-4000-90a8-dbe025bc1436 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:21.140628 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-9ecfcddd-9120-489b-8566-1579616e44eb tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Apr 30 21:28:21.140628 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:28:21.140628 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:28:21.140628 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:28:21.140628 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:28:21.140628 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:28:21.140628 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:28:21.140628 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:28:21.140628 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:28:21.140628 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:28:21.140628 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:28:21.140628 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:28:21.140628 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Apr 30 21:28:21.140628 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Apr 30 21:28:21.140628 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:28:21.141959 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:28:21.141959 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Apr 30 21:28:21.141959 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Apr 30 21:28:21.141959 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Apr 30 21:28:21.141959 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Apr 30 21:28:21.141959 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Apr 30 21:28:21.141959 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Apr 30 21:28:21.141959 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Apr 30 21:28:21.141959 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Apr 30 21:28:21.141959 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Apr 30 21:28:21.141959 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:28:21.147297 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2551/5100] 10.222.0.23 () {58 vars in 1265 bytes} [Sat Apr 30 21:28:21 2022] DELETE /identity/v3/OS-OAUTH1/consumers/0c619ee0681949148b873651b8b433f4 => generated 74 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 21:28:21.148028 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfcddd-9120-489b-8566-1579616e44eb tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:21.150038 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9ecfcddd-9120-489b-8566-1579616e44eb tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:21.163436 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfcddd-9120-489b-8566-1579616e44eb tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:21.169120 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d77e3-8da8-4223-812f-8646c9c32ec2 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cadfe5f429294a7984dc6e1c726d14f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bd63f5f58d244b3a99abe25cc4aaf88', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:21.169783 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d77e3-8da8-4223-812f-8646c9c32ec2 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:21.170071 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d77e3-8da8-4223-812f-8646c9c32ec2 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:21.170452 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d77e3-8da8-4223-812f-8646c9c32ec2 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:21.171257 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d77e3-8da8-4223-812f-8646c9c32ec2 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:21.172277 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-7b8d77e3-8da8-4223-812f-8646c9c32ec2 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:28:21.172277 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:28:21.172277 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:28:21.173158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d77e3-8da8-4223-812f-8646c9c32ec2 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:21.259854 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d824cc40-d9cb-4000-90a8-dbe025bc1436 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acd535df3826485d8472597a6258a56c', 'request_id': 'req-d824cc40-d9cb-4000-90a8-dbe025bc1436'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:21.265455 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d824cc40-d9cb-4000-90a8-dbe025bc1436 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acd535df3826485d8472597a6258a56c', 'request_id': 'req-d824cc40-d9cb-4000-90a8-dbe025bc1436'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:21.272225 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d824cc40-d9cb-4000-90a8-dbe025bc1436 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acd535df3826485d8472597a6258a56c', 'request_id': 'req-d824cc40-d9cb-4000-90a8-dbe025bc1436'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:21.316813 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2552/5101] 10.222.0.23 () {60 vars in 1184 bytes} [Sat Apr 30 21:28:21 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:28:21.321396 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d77e3-8da8-4223-812f-8646c9c32ec2 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:21.332501 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d77e3-8da8-4223-812f-8646c9c32ec2 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:21.391837 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c00327-4fc0-4165-800e-c50ad2884028 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cadfe5f429294a7984dc6e1c726d14f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bd63f5f58d244b3a99abe25cc4aaf88', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:21.392496 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c00327-4fc0-4165-800e-c50ad2884028 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:21.392783 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c00327-4fc0-4165-800e-c50ad2884028 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:21.393067 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c00327-4fc0-4165-800e-c50ad2884028 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:21.393828 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c00327-4fc0-4165-800e-c50ad2884028 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:21.395574 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c00327-4fc0-4165-800e-c50ad2884028 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:21.443959 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d824cc40-d9cb-4000-90a8-dbe025bc1436 admin admin] The token cache is being invalidate because project acd535df3826485d8472597a6258a56c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:28:21.444321 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d824cc40-d9cb-4000-90a8-dbe025bc1436 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:21.444934 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d824cc40-d9cb-4000-90a8-dbe025bc1436 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:21.447369 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2550/5102] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:28:21 2022] DELETE /identity/v3/projects/acd535df3826485d8472597a6258a56c => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:28:21.451905 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b29f7-2e59-469f-ac7a-3e7c49f745ef None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:21.452382 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b29f7-2e59-469f-ac7a-3e7c49f745ef None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:21.452668 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b29f7-2e59-469f-ac7a-3e7c49f745ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:21.471812 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-cf4b29f7-2e59-469f-ac7a-3e7c49f745ef None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:21.473283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-cf4b29f7-2e59-469f-ac7a-3e7c49f745ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:21.551902 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2553/5103] 10.222.0.23 () {60 vars in 1184 bytes} [Sat Apr 30 21:28:21 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:28:21.554302 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c00327-4fc0-4165-800e-c50ad2884028 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:21.557083 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-88c00327-4fc0-4165-800e-c50ad2884028 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:21.563019 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2551/5104] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:28:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:28:21.571243 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b9a6b-629f-4d7c-adad-34715b5ba651 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:21.575247 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c00327-4fc0-4165-800e-c50ad2884028 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:21.575428 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b9a6b-629f-4d7c-adad-34715b5ba651 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:21.575428 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b9a6b-629f-4d7c-adad-34715b5ba651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:21.579771 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76c0625-fcf9-4b72-bbf9-940a1641b6b7 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cadfe5f429294a7984dc6e1c726d14f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bd63f5f58d244b3a99abe25cc4aaf88', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:21.580548 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c0625-fcf9-4b72-bbf9-940a1641b6b7 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:21.580916 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c0625-fcf9-4b72-bbf9-940a1641b6b7 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:21.581274 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c0625-fcf9-4b72-bbf9-940a1641b6b7 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:21.582659 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76c0625-fcf9-4b72-bbf9-940a1641b6b7 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:21.583882 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-e76c0625-fcf9-4b72-bbf9-940a1641b6b7 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:28:21.583882 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:28:21.583882 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:28:21.585210 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76c0625-fcf9-4b72-bbf9-940a1641b6b7 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:21.595047 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2554/5105] 10.222.0.23 () {58 vars in 1163 bytes} [Sat Apr 30 21:28:21 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 537 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:28:21.602907 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76c0625-fcf9-4b72-bbf9-940a1641b6b7 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:21.612844 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-101b9a6b-629f-4d7c-adad-34715b5ba651 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:21.614118 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-101b9a6b-629f-4d7c-adad-34715b5ba651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:21.617672 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76c0625-fcf9-4b72-bbf9-940a1641b6b7 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:21.624602 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336f383-6a94-4cfb-a172-699536a49a56 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cadfe5f429294a7984dc6e1c726d14f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bd63f5f58d244b3a99abe25cc4aaf88', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:21.627465 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2552/5106] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:28:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:28:21.627697 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336f383-6a94-4cfb-a172-699536a49a56 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:21.627697 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336f383-6a94-4cfb-a172-699536a49a56 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:21.627697 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336f383-6a94-4cfb-a172-699536a49a56 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/036259e73bbf423a9cfdb00ac48d8693` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:21.627697 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4336f383-6a94-4cfb-a172-699536a49a56 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=036259e73bbf423a9cfdb00ac48d8693)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:21.629123 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b9a6b-629f-4d7c-adad-34715b5ba651 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:21.629870 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4336f383-6a94-4cfb-a172-699536a49a56 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:21.630496 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4336f383-6a94-4cfb-a172-699536a49a56 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Invalidating token cache because consumer 036259e73bbf423a9cfdb00ac48d8693 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:28:21.631007 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4336f383-6a94-4cfb-a172-699536a49a56 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:21.632596 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4336f383-6a94-4cfb-a172-699536a49a56 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:21.640305 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b9a6b-629f-4d7c-adad-34715b5ba651 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:21.646305 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ccf56-83af-48d1-a5d6-2cbad506449e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:21.649847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ccf56-83af-48d1-a5d6-2cbad506449e admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:21.649847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ccf56-83af-48d1-a5d6-2cbad506449e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:21.649847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ccf56-83af-48d1-a5d6-2cbad506449e admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:21.649847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ccf56-83af-48d1-a5d6-2cbad506449e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:28:21.649847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ccf56-83af-48d1-a5d6-2cbad506449e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:21.651048 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ccf56-83af-48d1-a5d6-2cbad506449e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:21.666540 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2553/5107] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:28:21.670903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ccf56-83af-48d1-a5d6-2cbad506449e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:21.672857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-562ccf56-83af-48d1-a5d6-2cbad506449e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:21.689170 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ccf56-83af-48d1-a5d6-2cbad506449e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:21.695097 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b9c32-1f5e-401b-8e8c-511ef58caa56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:21.696519 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b9c32-1f5e-401b-8e8c-511ef58caa56 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:21.696801 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b9c32-1f5e-401b-8e8c-511ef58caa56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:21.697253 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b9c32-1f5e-401b-8e8c-511ef58caa56 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:21.697744 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4336f383-6a94-4cfb-a172-699536a49a56 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '036259e73bbf423a9cfdb00ac48d8693', 'request_id': 'req-4336f383-6a94-4cfb-a172-699536a49a56'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:21.698151 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b9c32-1f5e-401b-8e8c-511ef58caa56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:21.703046 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b9c32-1f5e-401b-8e8c-511ef58caa56 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:21.810647 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2554/5108] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:28:21 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:28:21.811842 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07210a61-13de-48a4-a6c0-44daee42373a None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:21.811842 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07210a61-13de-48a4-a6c0-44daee42373a None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:21.812117 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07210a61-13de-48a4-a6c0-44daee42373a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:21.832375 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2555/5109] 10.222.0.23 () {58 vars in 1265 bytes} [Sat Apr 30 21:28:21 2022] DELETE /identity/v3/OS-OAUTH1/consumers/036259e73bbf423a9cfdb00ac48d8693 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:28:21.833641 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336f383-6a94-4cfb-a172-699536a49a56 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:21.848760 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-07210a61-13de-48a4-a6c0-44daee42373a None None] MFA Rules not processed for user `1649221dd0a749b0ac9762baa57815fd`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:21.850019 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-07210a61-13de-48a4-a6c0-44daee42373a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:21.853855 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336f383-6a94-4cfb-a172-699536a49a56 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:21.948453 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440fb5c8-fada-4267-8484-fa3dcede5225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:21.949273 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fb5c8-fada-4267-8484-fa3dcede5225 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:21.949614 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fb5c8-fada-4267-8484-fa3dcede5225 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:21.949932 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fb5c8-fada-4267-8484-fa3dcede5225 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:21.950687 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440fb5c8-fada-4267-8484-fa3dcede5225 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:21.953355 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440fb5c8-fada-4267-8484-fa3dcede5225 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:21.968913 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2555/5110] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:28:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:28:21.974205 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07210a61-13de-48a4-a6c0-44daee42373a None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:21.974205 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-07210a61-13de-48a4-a6c0-44daee42373a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:22.059635 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2556/5111] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:28:21 2022] POST /identity/v3/users => generated 287 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:28:22.059635 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd59b29-ff9d-4839-a368-6dc244a4d0ca None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:22.059635 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd59b29-ff9d-4839-a368-6dc244a4d0ca None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:22.059635 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd59b29-ff9d-4839-a368-6dc244a4d0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:22.072500 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07210a61-13de-48a4-a6c0-44daee42373a None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:22.085723 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8378cbc-d34d-4237-b060-69750ae94646 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cadfe5f429294a7984dc6e1c726d14f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bd63f5f58d244b3a99abe25cc4aaf88', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:22.087383 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8378cbc-d34d-4237-b060-69750ae94646 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:22.088308 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8378cbc-d34d-4237-b060-69750ae94646 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:22.088308 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8378cbc-d34d-4237-b060-69750ae94646 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/e83b6cbc4acc4d48874885cd07854a19` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:22.088625 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8378cbc-d34d-4237-b060-69750ae94646 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=e83b6cbc4acc4d48874885cd07854a19)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:22.090300 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8378cbc-d34d-4237-b060-69750ae94646 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:22.090576 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a8378cbc-d34d-4237-b060-69750ae94646 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Invalidating token cache because consumer e83b6cbc4acc4d48874885cd07854a19 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:28:22.091590 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a8378cbc-d34d-4237-b060-69750ae94646 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:22.094822 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a8378cbc-d34d-4237-b060-69750ae94646 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:22.096601 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-9fd59b29-ff9d-4839-a368-6dc244a4d0ca None None] MFA Rules not processed for user `1649221dd0a749b0ac9762baa57815fd`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:22.099226 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9fd59b29-ff9d-4839-a368-6dc244a4d0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:22.119602 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2557/5112] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:28:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:28:22.120165 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd59b29-ff9d-4839-a368-6dc244a4d0ca None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:22.121562 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9fd59b29-ff9d-4839-a368-6dc244a4d0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:22.138404 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd59b29-ff9d-4839-a368-6dc244a4d0ca None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:22.143782 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33142e4-e8e5-4ef1-ba04-a2e198ca5f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:22.146334 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33142e4-e8e5-4ef1-ba04-a2e198ca5f51 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:22.146334 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33142e4-e8e5-4ef1-ba04-a2e198ca5f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:22.146334 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33142e4-e8e5-4ef1-ba04-a2e198ca5f51 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:22.146334 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33142e4-e8e5-4ef1-ba04-a2e198ca5f51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:22.147429 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33142e4-e8e5-4ef1-ba04-a2e198ca5f51 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:22.158959 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2558/5113] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:28:22.160012 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33142e4-e8e5-4ef1-ba04-a2e198ca5f51 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:22.161793 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c33142e4-e8e5-4ef1-ba04-a2e198ca5f51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:22.243419 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a8378cbc-d34d-4237-b060-69750ae94646 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'e83b6cbc4acc4d48874885cd07854a19', 'request_id': 'req-a8378cbc-d34d-4237-b060-69750ae94646'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:22.270100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33142e4-e8e5-4ef1-ba04-a2e198ca5f51 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:22.281536 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d79b82-00a3-456c-b82c-4c4125b76cd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:22.282135 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d79b82-00a3-456c-b82c-4c4125b76cd8 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:22.282484 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d79b82-00a3-456c-b82c-4c4125b76cd8 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:22.289581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d79b82-00a3-456c-b82c-4c4125b76cd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:22.289581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c0d79b82-00a3-456c-b82c-4c4125b76cd8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:22.300422 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d79b82-00a3-456c-b82c-4c4125b76cd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:22.305173 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d79b82-00a3-456c-b82c-4c4125b76cd8 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:22.316387 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2559/5114] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:28:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:28:22.318034 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d79b82-00a3-456c-b82c-4c4125b76cd8 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:22.332664 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d79b82-00a3-456c-b82c-4c4125b76cd8 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:22.340044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadbb23f-b2fd-48e1-8e80-7e62f3249641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:22.341109 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadbb23f-b2fd-48e1-8e80-7e62f3249641 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:22.341751 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadbb23f-b2fd-48e1-8e80-7e62f3249641 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:22.342218 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadbb23f-b2fd-48e1-8e80-7e62f3249641 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:22.343214 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadbb23f-b2fd-48e1-8e80-7e62f3249641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:22.345435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadbb23f-b2fd-48e1-8e80-7e62f3249641 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:22.362194 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2560/5115] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:28:22.363091 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadbb23f-b2fd-48e1-8e80-7e62f3249641 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:22.373684 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2556/5116] 10.222.0.23 () {58 vars in 1265 bytes} [Sat Apr 30 21:28:21 2022] DELETE /identity/v3/OS-OAUTH1/consumers/e83b6cbc4acc4d48874885cd07854a19 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:28:22.374691 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8378cbc-d34d-4237-b060-69750ae94646 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:22.386714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a8378cbc-d34d-4237-b060-69750ae94646 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:22.387757 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadbb23f-b2fd-48e1-8e80-7e62f3249641 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:22.406055 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22a4ad-32e2-4fa3-862c-0fb4ffd2096f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:22.410928 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22a4ad-32e2-4fa3-862c-0fb4ffd2096f admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:22.410928 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22a4ad-32e2-4fa3-862c-0fb4ffd2096f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:22.411900 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8378cbc-d34d-4237-b060-69750ae94646 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:22.412010 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22a4ad-32e2-4fa3-862c-0fb4ffd2096f admin admin] PATH_INFO: `/v3/projects/cdf6569dac6e40749091f906a707d7a1/users/9b5bf2d0e148477a9a233d03bd8989dc/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:22.417458 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae356fca-fa44-4202-b748-f4cc5c4f70a4 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cadfe5f429294a7984dc6e1c726d14f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bd63f5f58d244b3a99abe25cc4aaf88', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:22.418510 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae356fca-fa44-4202-b748-f4cc5c4f70a4 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:22.418806 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae356fca-fa44-4202-b748-f4cc5c4f70a4 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:22.419091 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae356fca-fa44-4202-b748-f4cc5c4f70a4 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:22.419958 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae356fca-fa44-4202-b748-f4cc5c4f70a4 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:22.422706 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae356fca-fa44-4202-b748-f4cc5c4f70a4 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:22.440418 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a22a4ad-32e2-4fa3-862c-0fb4ffd2096f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdf6569dac6e40749091f906a707d7a1, user_id=9b5bf2d0e148477a9a233d03bd8989dc, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:22.443501 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a22a4ad-32e2-4fa3-862c-0fb4ffd2096f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:22.558050 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2557/5117] 10.222.0.23 () {60 vars in 1184 bytes} [Sat Apr 30 21:28:22 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:28:22.558910 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae356fca-fa44-4202-b748-f4cc5c4f70a4 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:22.561852 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2561/5118] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:28:22 2022] PUT /identity/v3/projects/cdf6569dac6e40749091f906a707d7a1/users/9b5bf2d0e148477a9a233d03bd8989dc/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:28:22.574241 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b1940-02bd-46cc-8bd7-c760c64516d4 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:22.576087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b1940-02bd-46cc-8bd7-c760c64516d4 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:22.576087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b1940-02bd-46cc-8bd7-c760c64516d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:22.576340 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae356fca-fa44-4202-b748-f4cc5c4f70a4 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:22.607671 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-680b1940-02bd-46cc-8bd7-c760c64516d4 None None] MFA Rules not processed for user `9b5bf2d0e148477a9a233d03bd8989dc`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:22.608968 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-680b1940-02bd-46cc-8bd7-c760c64516d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:22.691780 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0b5bd-a605-4148-893e-9be57d61a581 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cadfe5f429294a7984dc6e1c726d14f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bd63f5f58d244b3a99abe25cc4aaf88', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:22.693694 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0b5bd-a605-4148-893e-9be57d61a581 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:22.694234 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0b5bd-a605-4148-893e-9be57d61a581 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:22.694921 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0b5bd-a605-4148-893e-9be57d61a581 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/a9e4409ebaed41e4bfc2a05570852eee` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:22.696496 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db0b5bd-a605-4148-893e-9be57d61a581 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=a9e4409ebaed41e4bfc2a05570852eee)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:22.698031 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-0db0b5bd-a605-4148-893e-9be57d61a581 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:28:22.698031 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:28:22.698031 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:28:22.700808 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db0b5bd-a605-4148-893e-9be57d61a581 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:22.759295 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2562/5119] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:28:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:28:22.829381 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58630853-a7f7-47ce-ad2e-8246f8a3aa7f None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:22.829898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58630853-a7f7-47ce-ad2e-8246f8a3aa7f None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:22.830184 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58630853-a7f7-47ce-ad2e-8246f8a3aa7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:22.834017 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2558/5120] 10.222.0.23 () {60 vars in 1284 bytes} [Sat Apr 30 21:28:22 2022] PATCH /identity/v3/OS-OAUTH1/consumers/a9e4409ebaed41e4bfc2a05570852eee => generated 221 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:28:22.840530 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0b5bd-a605-4148-893e-9be57d61a581 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:22.850724 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-58630853-a7f7-47ce-ad2e-8246f8a3aa7f None None] MFA Rules not processed for user `9b5bf2d0e148477a9a233d03bd8989dc`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:22.852542 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-58630853-a7f7-47ce-ad2e-8246f8a3aa7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:22.865059 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2563/5121] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:28:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:28:22.870882 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0b5bd-a605-4148-893e-9be57d61a581 tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:22.876194 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf523e-0ca9-4f26-8f4e-69f9256955eb tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cadfe5f429294a7984dc6e1c726d14f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bd63f5f58d244b3a99abe25cc4aaf88', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:22.877383 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf523e-0ca9-4f26-8f4e-69f9256955eb tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:22.877889 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf523e-0ca9-4f26-8f4e-69f9256955eb tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:22.878501 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf523e-0ca9-4f26-8f4e-69f9256955eb tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/a9e4409ebaed41e4bfc2a05570852eee` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:22.879533 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf523e-0ca9-4f26-8f4e-69f9256955eb tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=a9e4409ebaed41e4bfc2a05570852eee)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:22.881382 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf523e-0ca9-4f26-8f4e-69f9256955eb tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:22.893419 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2559/5122] 10.222.0.23 () {58 vars in 1262 bytes} [Sat Apr 30 21:28:22 2022] GET /identity/v3/OS-OAUTH1/consumers/a9e4409ebaed41e4bfc2a05570852eee => generated 221 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:28:22.906335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58630853-a7f7-47ce-ad2e-8246f8a3aa7f None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:22.933564 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58630853-a7f7-47ce-ad2e-8246f8a3aa7f None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:22.939967 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea55afa-f452-47b9-9864-b1ab05c5032c tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cadfe5f429294a7984dc6e1c726d14f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6bd63f5f58d244b3a99abe25cc4aaf88', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:22.941669 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea55afa-f452-47b9-9864-b1ab05c5032c tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:22.942131 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea55afa-f452-47b9-9864-b1ab05c5032c tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:22.943682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea55afa-f452-47b9-9864-b1ab05c5032c tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/a9e4409ebaed41e4bfc2a05570852eee` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:22.944561 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea55afa-f452-47b9-9864-b1ab05c5032c tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=a9e4409ebaed41e4bfc2a05570852eee)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:22.947927 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea55afa-f452-47b9-9864-b1ab05c5032c tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:22.951540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8ea55afa-f452-47b9-9864-b1ab05c5032c tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Invalidating token cache because consumer a9e4409ebaed41e4bfc2a05570852eee has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:28:22.951540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8ea55afa-f452-47b9-9864-b1ab05c5032c tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:22.951540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8ea55afa-f452-47b9-9864-b1ab05c5032c tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:23.027514 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf523e-0ca9-4f26-8f4e-69f9256955eb tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:23.029547 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-34bf523e-0ca9-4f26-8f4e-69f9256955eb tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:23.046008 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8ea55afa-f452-47b9-9864-b1ab05c5032c tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'a9e4409ebaed41e4bfc2a05570852eee', 'request_id': 'req-8ea55afa-f452-47b9-9864-b1ab05c5032c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:23.128379 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf523e-0ca9-4f26-8f4e-69f9256955eb tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:23.137677 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68723a-e199-4bc4-8b5b-069acf9d2967 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:23.138502 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68723a-e199-4bc4-8b5b-069acf9d2967 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:23.138847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68723a-e199-4bc4-8b5b-069acf9d2967 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:23.140556 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68723a-e199-4bc4-8b5b-069acf9d2967 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:23.143411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3e68723a-e199-4bc4-8b5b-069acf9d2967 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:23.148066 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2564/5123] 10.222.0.23 () {58 vars in 1265 bytes} [Sat Apr 30 21:28:22 2022] DELETE /identity/v3/OS-OAUTH1/consumers/a9e4409ebaed41e4bfc2a05570852eee => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:28:23.149578 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea55afa-f452-47b9-9864-b1ab05c5032c tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:23.159269 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8ea55afa-f452-47b9-9864-b1ab05c5032c tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:23.162851 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e68723a-e199-4bc4-8b5b-069acf9d2967 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:23.166951 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e68723a-e199-4bc4-8b5b-069acf9d2967 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:23.198328 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2560/5124] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:28:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:28:23.252924 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea55afa-f452-47b9-9864-b1ab05c5032c tempest-OAUTHConsumersV3Test-454771447 tempest-OAUTHConsumersV3Test-454771447-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:23.258737 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe33660-eabc-4a89-a578-11883c04489e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:23.259939 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe33660-eabc-4a89-a578-11883c04489e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:23.260403 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe33660-eabc-4a89-a578-11883c04489e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:23.260747 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe33660-eabc-4a89-a578-11883c04489e admin admin] PATH_INFO: `/v3/users/b6658f2c261a4303a218318a916fd4ab` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:23.262067 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe33660-eabc-4a89-a578-11883c04489e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6658f2c261a4303a218318a916fd4ab)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:23.264735 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe33660-eabc-4a89-a578-11883c04489e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:23.567403 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-fbe33660-eabc-4a89-a578-11883c04489e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6658f2c261a4303a218318a916fd4ab'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:23.612931 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-fbe33660-eabc-4a89-a578-11883c04489e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6658f2c261a4303a218318a916fd4ab'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:23.775027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-fbe33660-eabc-4a89-a578-11883c04489e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6658f2c261a4303a218318a916fd4ab'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:23.779601 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-fbe33660-eabc-4a89-a578-11883c04489e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6658f2c261a4303a218318a916fd4ab'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:23.781473 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-fbe33660-eabc-4a89-a578-11883c04489e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6658f2c261a4303a218318a916fd4ab'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:23.801814 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2565/5125] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:28:23 2022] DELETE /identity/v3/users/b6658f2c261a4303a218318a916fd4ab => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:28:23.805140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63cd34-2749-453a-b700-09493f118c58 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:23.805972 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63cd34-2749-453a-b700-09493f118c58 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:23.806449 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63cd34-2749-453a-b700-09493f118c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:23.838990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-ec63cd34-2749-453a-b700-09493f118c58 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:23.842609 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ec63cd34-2749-453a-b700-09493f118c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:23.954470 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2561/5126] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:28:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:28:23.968343 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe33660-eabc-4a89-a578-11883c04489e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:23.973500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-fbe33660-eabc-4a89-a578-11883c04489e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:24.109208 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe33660-eabc-4a89-a578-11883c04489e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:24.113404 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c87960-4706-468f-b7ab-1aba212eb430 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:24.114957 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c87960-4706-468f-b7ab-1aba212eb430 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:24.115250 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c87960-4706-468f-b7ab-1aba212eb430 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:24.115528 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c87960-4706-468f-b7ab-1aba212eb430 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:24.128458 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c87960-4706-468f-b7ab-1aba212eb430 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:24.130121 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c87960-4706-468f-b7ab-1aba212eb430 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:24.143598 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2566/5127] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:28:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:28:25.050496 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63cd34-2749-453a-b700-09493f118c58 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:25.052174 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ec63cd34-2749-453a-b700-09493f118c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:25.076451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63cd34-2749-453a-b700-09493f118c58 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:25.092165 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9c3ba-6a5f-429f-aef6-78c094911b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:25.093180 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9c3ba-6a5f-429f-aef6-78c094911b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:25.093472 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9c3ba-6a5f-429f-aef6-78c094911b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:25.094565 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9c3ba-6a5f-429f-aef6-78c094911b49 admin admin] PATH_INFO: `/v3/projects/7e972e71b7fb42a89db19c9ef072c8a4` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:25.096677 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a9c3ba-6a5f-429f-aef6-78c094911b49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e972e71b7fb42a89db19c9ef072c8a4)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:25.102625 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a9c3ba-6a5f-429f-aef6-78c094911b49 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:25.288764 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f1a9c3ba-6a5f-429f-aef6-78c094911b49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e972e71b7fb42a89db19c9ef072c8a4', 'request_id': 'req-f1a9c3ba-6a5f-429f-aef6-78c094911b49'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:25.294889 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f1a9c3ba-6a5f-429f-aef6-78c094911b49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e972e71b7fb42a89db19c9ef072c8a4', 'request_id': 'req-f1a9c3ba-6a5f-429f-aef6-78c094911b49'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:25.302151 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f1a9c3ba-6a5f-429f-aef6-78c094911b49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e972e71b7fb42a89db19c9ef072c8a4', 'request_id': 'req-f1a9c3ba-6a5f-429f-aef6-78c094911b49'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:25.382165 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f1a9c3ba-6a5f-429f-aef6-78c094911b49 admin admin] The token cache is being invalidate because project 7e972e71b7fb42a89db19c9ef072c8a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:28:25.382165 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f1a9c3ba-6a5f-429f-aef6-78c094911b49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:25.383850 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f1a9c3ba-6a5f-429f-aef6-78c094911b49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:25.387501 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2562/5128] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:28:25 2022] DELETE /identity/v3/projects/7e972e71b7fb42a89db19c9ef072c8a4 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:28:25.391873 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c87960-4706-468f-b7ab-1aba212eb430 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:25.410550 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c87960-4706-468f-b7ab-1aba212eb430 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:25.548742 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc6ea1-a9f1-4f53-bd62-c110dbf3459f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:25.549612 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc6ea1-a9f1-4f53-bd62-c110dbf3459f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:25.550044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc6ea1-a9f1-4f53-bd62-c110dbf3459f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:25.550507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc6ea1-a9f1-4f53-bd62-c110dbf3459f admin admin] PATH_INFO: `/v3/users/cadfe5f429294a7984dc6e1c726d14f0` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:25.554060 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc6ea1-a9f1-4f53-bd62-c110dbf3459f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cadfe5f429294a7984dc6e1c726d14f0)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:25.556201 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc6ea1-a9f1-4f53-bd62-c110dbf3459f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:25.854047 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b9bc6ea1-a9f1-4f53-bd62-c110dbf3459f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cadfe5f429294a7984dc6e1c726d14f0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:25.866426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b9bc6ea1-a9f1-4f53-bd62-c110dbf3459f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cadfe5f429294a7984dc6e1c726d14f0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:25.991643 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b9bc6ea1-a9f1-4f53-bd62-c110dbf3459f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cadfe5f429294a7984dc6e1c726d14f0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:26.000806 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b9bc6ea1-a9f1-4f53-bd62-c110dbf3459f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cadfe5f429294a7984dc6e1c726d14f0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:26.001955 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b9bc6ea1-a9f1-4f53-bd62-c110dbf3459f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cadfe5f429294a7984dc6e1c726d14f0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:26.011056 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2567/5129] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:28:25 2022] DELETE /identity/v3/users/cadfe5f429294a7984dc6e1c726d14f0 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:28:26.766999 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9c3ba-6a5f-429f-aef6-78c094911b49 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:26.771313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f1a9c3ba-6a5f-429f-aef6-78c094911b49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:26.829490 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9c3ba-6a5f-429f-aef6-78c094911b49 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:26.955529 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9e177-af6a-4d1b-ac10-f90434c049da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:26.957093 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9e177-af6a-4d1b-ac10-f90434c049da admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:26.957381 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9e177-af6a-4d1b-ac10-f90434c049da admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:26.957671 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9e177-af6a-4d1b-ac10-f90434c049da admin admin] PATH_INFO: `/v3/projects/6bd63f5f58d244b3a99abe25cc4aaf88` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:26.959938 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c9e177-af6a-4d1b-ac10-f90434c049da admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bd63f5f58d244b3a99abe25cc4aaf88)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:26.962947 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c9e177-af6a-4d1b-ac10-f90434c049da admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:27.113662 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-91c9e177-af6a-4d1b-ac10-f90434c049da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bd63f5f58d244b3a99abe25cc4aaf88', 'request_id': 'req-91c9e177-af6a-4d1b-ac10-f90434c049da'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:27.142855 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-91c9e177-af6a-4d1b-ac10-f90434c049da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bd63f5f58d244b3a99abe25cc4aaf88', 'request_id': 'req-91c9e177-af6a-4d1b-ac10-f90434c049da'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:27.156077 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-91c9e177-af6a-4d1b-ac10-f90434c049da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bd63f5f58d244b3a99abe25cc4aaf88', 'request_id': 'req-91c9e177-af6a-4d1b-ac10-f90434c049da'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:27.298243 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-91c9e177-af6a-4d1b-ac10-f90434c049da admin admin] The token cache is being invalidate because project 6bd63f5f58d244b3a99abe25cc4aaf88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:28:27.298810 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-91c9e177-af6a-4d1b-ac10-f90434c049da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:27.299805 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-91c9e177-af6a-4d1b-ac10-f90434c049da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:27.303462 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2563/5130] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:28:26 2022] DELETE /identity/v3/projects/6bd63f5f58d244b3a99abe25cc4aaf88 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:28:27.308049 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95e1bc-7ef3-4c1f-a4c6-9d2d5646fa3e None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:27.313127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95e1bc-7ef3-4c1f-a4c6-9d2d5646fa3e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:27.313618 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95e1bc-7ef3-4c1f-a4c6-9d2d5646fa3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:27.345902 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-1f95e1bc-7ef3-4c1f-a4c6-9d2d5646fa3e None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:27.347167 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1f95e1bc-7ef3-4c1f-a4c6-9d2d5646fa3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:27.425909 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2568/5131] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:28:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:28:27.433229 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d0d50-c60d-47b0-94f6-2ce489f27297 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:27.433810 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d0d50-c60d-47b0-94f6-2ce489f27297 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:27.434741 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d0d50-c60d-47b0-94f6-2ce489f27297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:27.457038 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-268d0d50-c60d-47b0-94f6-2ce489f27297 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:27.458772 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-268d0d50-c60d-47b0-94f6-2ce489f27297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:27.473529 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2564/5132] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:28:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:28:27.479124 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f95e1bc-7ef3-4c1f-a4c6-9d2d5646fa3e None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:27.491978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f95e1bc-7ef3-4c1f-a4c6-9d2d5646fa3e None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:27.505006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef0bc0-b06e-45c2-a336-feddcb653532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:27.505861 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef0bc0-b06e-45c2-a336-feddcb653532 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:27.506252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef0bc0-b06e-45c2-a336-feddcb653532 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:27.506631 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef0bc0-b06e-45c2-a336-feddcb653532 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:27.507509 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef0bc0-b06e-45c2-a336-feddcb653532 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:28:27.508895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef0bc0-b06e-45c2-a336-feddcb653532 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:27.510683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef0bc0-b06e-45c2-a336-feddcb653532 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:27.530735 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2569/5133] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:28:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:28:27.536992 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d0d50-c60d-47b0-94f6-2ce489f27297 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:27.548942 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d0d50-c60d-47b0-94f6-2ce489f27297 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:27.554927 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189dd794-e0bd-4427-94aa-cd02d980f7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:27.555792 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189dd794-e0bd-4427-94aa-cd02d980f7dd admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:27.556235 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189dd794-e0bd-4427-94aa-cd02d980f7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:27.556666 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189dd794-e0bd-4427-94aa-cd02d980f7dd admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:27.557930 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189dd794-e0bd-4427-94aa-cd02d980f7dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:27.563057 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189dd794-e0bd-4427-94aa-cd02d980f7dd admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:27.675967 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2565/5134] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:28:27 2022] POST /identity/v3/projects => generated 365 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:28:27.679988 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef0bc0-b06e-45c2-a336-feddcb653532 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:27.716271 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef0bc0-b06e-45c2-a336-feddcb653532 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:27.831419 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655724b2-f3a5-4003-8fa4-9bf0c0f69bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:27.832105 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655724b2-f3a5-4003-8fa4-9bf0c0f69bbf admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:27.832387 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655724b2-f3a5-4003-8fa4-9bf0c0f69bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:27.832664 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655724b2-f3a5-4003-8fa4-9bf0c0f69bbf admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:27.833357 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655724b2-f3a5-4003-8fa4-9bf0c0f69bbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:27.836679 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655724b2-f3a5-4003-8fa4-9bf0c0f69bbf admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:27.981201 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2570/5135] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:28:27 2022] POST /identity/v3/users => generated 283 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:28:27.985148 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189dd794-e0bd-4427-94aa-cd02d980f7dd admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:27.998500 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189dd794-e0bd-4427-94aa-cd02d980f7dd admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:28.004081 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a443c-193c-4b23-a69e-f5e469ccc984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:28.004811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a443c-193c-4b23-a69e-f5e469ccc984 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:28.005095 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a443c-193c-4b23-a69e-f5e469ccc984 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:28.005422 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a443c-193c-4b23-a69e-f5e469ccc984 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:28.006191 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a443c-193c-4b23-a69e-f5e469ccc984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:28.008607 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a443c-193c-4b23-a69e-f5e469ccc984 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:28.020106 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2566/5136] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:28:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:28:28.024709 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655724b2-f3a5-4003-8fa4-9bf0c0f69bbf admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:28.036496 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655724b2-f3a5-4003-8fa4-9bf0c0f69bbf admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:28.048250 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa8e16-4993-484f-ac1c-78027a11993b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:28.049165 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa8e16-4993-484f-ac1c-78027a11993b admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:28.049520 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa8e16-4993-484f-ac1c-78027a11993b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:28.049920 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa8e16-4993-484f-ac1c-78027a11993b admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:28.050771 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aa8e16-4993-484f-ac1c-78027a11993b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:28.052414 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aa8e16-4993-484f-ac1c-78027a11993b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:28.064456 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2571/5137] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:28:28.068548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a443c-193c-4b23-a69e-f5e469ccc984 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:28.079273 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a443c-193c-4b23-a69e-f5e469ccc984 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:28.083988 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0908f401-035c-4e5b-a8da-1513583c1197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:28.084868 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908f401-035c-4e5b-a8da-1513583c1197 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:28.085152 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908f401-035c-4e5b-a8da-1513583c1197 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:28.085447 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908f401-035c-4e5b-a8da-1513583c1197 admin admin] PATH_INFO: `/v3/projects/ded425da5c6541d18ad54b75b7110ab8/users/254c69ad30234015b342c4f02023f6ea/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:28.113845 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0908f401-035c-4e5b-a8da-1513583c1197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ded425da5c6541d18ad54b75b7110ab8, user_id=254c69ad30234015b342c4f02023f6ea, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:28.119316 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0908f401-035c-4e5b-a8da-1513583c1197 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:28.219273 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2567/5138] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:28:28 2022] PUT /identity/v3/projects/ded425da5c6541d18ad54b75b7110ab8/users/254c69ad30234015b342c4f02023f6ea/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:28:28.231804 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed8b4b-42be-4b47-8d0c-fafb0ad71e61 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:28.232223 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed8b4b-42be-4b47-8d0c-fafb0ad71e61 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:28.232614 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed8b4b-42be-4b47-8d0c-fafb0ad71e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:28.263674 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-dbed8b4b-42be-4b47-8d0c-fafb0ad71e61 None None] MFA Rules not processed for user `254c69ad30234015b342c4f02023f6ea`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:28.265005 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-dbed8b4b-42be-4b47-8d0c-fafb0ad71e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:28.334843 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2572/5139] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:28:28 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:28:28.339923 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0908f401-035c-4e5b-a8da-1513583c1197 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:28.444366 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0908f401-035c-4e5b-a8da-1513583c1197 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:28.451326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cccd6-869b-43f7-9512-dc68c313e8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:28.452297 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cccd6-869b-43f7-9512-dc68c313e8ae admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:28.452586 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cccd6-869b-43f7-9512-dc68c313e8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:28.452866 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cccd6-869b-43f7-9512-dc68c313e8ae admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:28.453605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57cccd6-869b-43f7-9512-dc68c313e8ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:28.455823 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57cccd6-869b-43f7-9512-dc68c313e8ae admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:28.561559 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2568/5140] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:28:28 2022] POST /identity/v3/projects => generated 369 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:28:28.562556 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed8b4b-42be-4b47-8d0c-fafb0ad71e61 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:28.587001 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed8b4b-42be-4b47-8d0c-fafb0ad71e61 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:28.702711 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e0c265-cbd9-495d-a4c3-e05c1a8ac3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:28.703424 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e0c265-cbd9-495d-a4c3-e05c1a8ac3ba admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:28.703711 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e0c265-cbd9-495d-a4c3-e05c1a8ac3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:28.703990 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e0c265-cbd9-495d-a4c3-e05c1a8ac3ba admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:28.704689 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e0c265-cbd9-495d-a4c3-e05c1a8ac3ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:28.706924 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e0c265-cbd9-495d-a4c3-e05c1a8ac3ba admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:28.767780 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2573/5141] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:28:28 2022] POST /identity/v3/users => generated 291 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:28:28.772048 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cccd6-869b-43f7-9512-dc68c313e8ae admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:28.783821 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cccd6-869b-43f7-9512-dc68c313e8ae admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:28.792749 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ba39a-16b8-48a7-911a-cb38c36c72f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:28.795489 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ba39a-16b8-48a7-911a-cb38c36c72f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:28.795790 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ba39a-16b8-48a7-911a-cb38c36c72f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:28.796068 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ba39a-16b8-48a7-911a-cb38c36c72f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:28.796917 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ba39a-16b8-48a7-911a-cb38c36c72f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:28.798608 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ba39a-16b8-48a7-911a-cb38c36c72f4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:28.811900 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2569/5142] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:28:28.817340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e0c265-cbd9-495d-a4c3-e05c1a8ac3ba admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:28.845452 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e0c265-cbd9-495d-a4c3-e05c1a8ac3ba admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:28.852097 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc760902-44ce-4231-9b74-922656537b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:28.854503 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc760902-44ce-4231-9b74-922656537b88 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:28.854842 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc760902-44ce-4231-9b74-922656537b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:28.856321 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc760902-44ce-4231-9b74-922656537b88 admin admin] PATH_INFO: `/v3/projects/3a567e8f7d8b46f58cab1989cb1312eb/users/4feefbe5478e4ff799363a5b0059fbfd/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:28.891532 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc760902-44ce-4231-9b74-922656537b88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a567e8f7d8b46f58cab1989cb1312eb, user_id=4feefbe5478e4ff799363a5b0059fbfd, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:28.908357 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc760902-44ce-4231-9b74-922656537b88 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:29.026757 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2574/5143] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:28:28 2022] PUT /identity/v3/projects/3a567e8f7d8b46f58cab1989cb1312eb/users/4feefbe5478e4ff799363a5b0059fbfd/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:28:29.033847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ba39a-16b8-48a7-911a-cb38c36c72f4 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:29.058797 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ba39a-16b8-48a7-911a-cb38c36c72f4 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:29.167761 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498c92a-09be-40b9-a152-35ea2403ca95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:29.168544 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498c92a-09be-40b9-a152-35ea2403ca95 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:29.168907 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498c92a-09be-40b9-a152-35ea2403ca95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:29.169566 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498c92a-09be-40b9-a152-35ea2403ca95 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:29.170412 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8498c92a-09be-40b9-a152-35ea2403ca95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:29.172801 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8498c92a-09be-40b9-a152-35ea2403ca95 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:29.185028 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2570/5144] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:28:29.189024 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc760902-44ce-4231-9b74-922656537b88 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:29.210068 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc760902-44ce-4231-9b74-922656537b88 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:29.220720 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92375a-9126-4755-a67e-c068e5cde939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:29.222211 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92375a-9126-4755-a67e-c068e5cde939 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:29.223867 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92375a-9126-4755-a67e-c068e5cde939 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:29.224430 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92375a-9126-4755-a67e-c068e5cde939 admin admin] PATH_INFO: `/v3/projects/3a567e8f7d8b46f58cab1989cb1312eb/users/4feefbe5478e4ff799363a5b0059fbfd/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:29.229678 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f92375a-9126-4755-a67e-c068e5cde939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a567e8f7d8b46f58cab1989cb1312eb, user_id=4feefbe5478e4ff799363a5b0059fbfd, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:29.236916 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f92375a-9126-4755-a67e-c068e5cde939 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:29.283096 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54303c56-644a-4001-be74-f6ec965083e9 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:29.283658 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54303c56-644a-4001-be74-f6ec965083e9 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:29.284197 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54303c56-644a-4001-be74-f6ec965083e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:29.284409 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2575/5145] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:28:29 2022] PUT /identity/v3/projects/3a567e8f7d8b46f58cab1989cb1312eb/users/4feefbe5478e4ff799363a5b0059fbfd/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:28:29.322990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-54303c56-644a-4001-be74-f6ec965083e9 None None] MFA Rules not processed for user `4feefbe5478e4ff799363a5b0059fbfd`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:29.326536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-54303c56-644a-4001-be74-f6ec965083e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:29.438416 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2571/5146] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:28:29 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:28:29.440064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92375a-9126-4755-a67e-c068e5cde939 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:29.454871 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92375a-9126-4755-a67e-c068e5cde939 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:29.461876 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be720a57-8668-4e12-b7f9-cbba91f13646 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feefbe5478e4ff799363a5b0059fbfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a567e8f7d8b46f58cab1989cb1312eb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:29.462868 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be720a57-8668-4e12-b7f9-cbba91f13646 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:29.463366 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be720a57-8668-4e12-b7f9-cbba91f13646 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:29.464001 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be720a57-8668-4e12-b7f9-cbba91f13646 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] PATH_INFO: `/v3/policies` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:29.465906 ncdv-master-1 devstack@keystone.service[91018]: WARNING oslo_log.versionutils [None req-be720a57-8668-4e12-b7f9-cbba91f13646 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Apr 30 21:28:29.475562 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be720a57-8668-4e12-b7f9-cbba91f13646 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:29.475562 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-be720a57-8668-4e12-b7f9-cbba91f13646 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:28:29.475562 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:28:29.475562 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:28:29.475562 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be720a57-8668-4e12-b7f9-cbba91f13646 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:29.605253 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2576/5147] 10.222.0.23 () {60 vars in 1151 bytes} [Sat Apr 30 21:28:29 2022] POST /identity/v3/policies => generated 230 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:28:29.609508 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54303c56-644a-4001-be74-f6ec965083e9 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:29.621908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54303c56-644a-4001-be74-f6ec965083e9 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:29.628513 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc38006-770a-4c98-95e7-b006a218a7f5 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feefbe5478e4ff799363a5b0059fbfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a567e8f7d8b46f58cab1989cb1312eb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:29.629403 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc38006-770a-4c98-95e7-b006a218a7f5 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:29.629749 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc38006-770a-4c98-95e7-b006a218a7f5 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:29.630169 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc38006-770a-4c98-95e7-b006a218a7f5 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] PATH_INFO: `/v3/policies/647e39c783b74d77b738606db5213319` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:29.631401 ncdv-master-1 devstack@keystone.service[91017]: WARNING oslo_log.versionutils [None req-dbc38006-770a-4c98-95e7-b006a218a7f5 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Apr 30 21:28:29.632143 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc38006-770a-4c98-95e7-b006a218a7f5 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=647e39c783b74d77b738606db5213319)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:29.633991 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-dbc38006-770a-4c98-95e7-b006a218a7f5 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:28:29.633991 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:28:29.633991 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:28:29.635866 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc38006-770a-4c98-95e7-b006a218a7f5 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:29.803591 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2572/5148] 10.222.0.23 () {60 vars in 1251 bytes} [Sat Apr 30 21:28:29 2022] PATCH /identity/v3/policies/647e39c783b74d77b738606db5213319 => generated 236 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:28:29.808409 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be720a57-8668-4e12-b7f9-cbba91f13646 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:29.818888 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be720a57-8668-4e12-b7f9-cbba91f13646 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:29.825681 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa173bc6-b4a8-411a-bc01-d959ede4b492 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feefbe5478e4ff799363a5b0059fbfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a567e8f7d8b46f58cab1989cb1312eb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:29.826682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa173bc6-b4a8-411a-bc01-d959ede4b492 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:29.827043 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa173bc6-b4a8-411a-bc01-d959ede4b492 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:29.827726 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa173bc6-b4a8-411a-bc01-d959ede4b492 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] PATH_INFO: `/v3/policies/647e39c783b74d77b738606db5213319` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:29.828311 ncdv-master-1 devstack@keystone.service[91018]: WARNING oslo_log.versionutils [None req-fa173bc6-b4a8-411a-bc01-d959ede4b492 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Apr 30 21:28:29.829014 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa173bc6-b4a8-411a-bc01-d959ede4b492 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=647e39c783b74d77b738606db5213319)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:29.830375 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-fa173bc6-b4a8-411a-bc01-d959ede4b492 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:28:29.830375 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:28:29.830375 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:28:29.831450 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa173bc6-b4a8-411a-bc01-d959ede4b492 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:29.846904 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2577/5149] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:28:29 2022] GET /identity/v3/policies/647e39c783b74d77b738606db5213319 => generated 236 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:28:29.851081 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc38006-770a-4c98-95e7-b006a218a7f5 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:29.863173 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc38006-770a-4c98-95e7-b006a218a7f5 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:29.869270 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9c763-a37b-4170-bb38-be075c39bbac tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feefbe5478e4ff799363a5b0059fbfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a567e8f7d8b46f58cab1989cb1312eb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:29.870173 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9c763-a37b-4170-bb38-be075c39bbac tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:29.870459 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9c763-a37b-4170-bb38-be075c39bbac tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:29.870735 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9c763-a37b-4170-bb38-be075c39bbac tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] PATH_INFO: `/v3/policies/647e39c783b74d77b738606db5213319` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:29.871515 ncdv-master-1 devstack@keystone.service[91017]: WARNING oslo_log.versionutils [None req-4bf9c763-a37b-4170-bb38-be075c39bbac tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Apr 30 21:28:29.872273 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf9c763-a37b-4170-bb38-be075c39bbac tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=647e39c783b74d77b738606db5213319)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:29.873557 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-4bf9c763-a37b-4170-bb38-be075c39bbac tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:28:29.873557 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:28:29.873557 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:28:29.874476 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf9c763-a37b-4170-bb38-be075c39bbac tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:29.985254 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2573/5150] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:28:29 2022] DELETE /identity/v3/policies/647e39c783b74d77b738606db5213319 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:28:29.991039 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa173bc6-b4a8-411a-bc01-d959ede4b492 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:30.013615 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa173bc6-b4a8-411a-bc01-d959ede4b492 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:30.033719 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50cba5-e928-436a-a6e0-ecfda2378565 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feefbe5478e4ff799363a5b0059fbfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a567e8f7d8b46f58cab1989cb1312eb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:30.036143 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50cba5-e928-436a-a6e0-ecfda2378565 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:30.048343 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50cba5-e928-436a-a6e0-ecfda2378565 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:30.048343 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50cba5-e928-436a-a6e0-ecfda2378565 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] PATH_INFO: `/v3/policies` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:30.048343 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50cba5-e928-436a-a6e0-ecfda2378565 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:30.048343 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50cba5-e928-436a-a6e0-ecfda2378565 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:30.176990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9c763-a37b-4170-bb38-be075c39bbac tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:30.178779 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2578/5151] 10.222.0.23 () {60 vars in 1151 bytes} [Sat Apr 30 21:28:29 2022] POST /identity/v3/policies => generated 229 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:28:30.197956 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9c763-a37b-4170-bb38-be075c39bbac tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:30.202979 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077ef7e-2f65-48a4-8b7f-748fcee993a3 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feefbe5478e4ff799363a5b0059fbfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a567e8f7d8b46f58cab1989cb1312eb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:30.204034 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077ef7e-2f65-48a4-8b7f-748fcee993a3 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:30.204541 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077ef7e-2f65-48a4-8b7f-748fcee993a3 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:30.205032 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077ef7e-2f65-48a4-8b7f-748fcee993a3 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] PATH_INFO: `/v3/policies` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:30.206192 ncdv-master-1 devstack@keystone.service[91017]: WARNING oslo_log.versionutils [None req-3077ef7e-2f65-48a4-8b7f-748fcee993a3 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Apr 30 21:28:30.206936 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3077ef7e-2f65-48a4-8b7f-748fcee993a3 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:30.208385 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-3077ef7e-2f65-48a4-8b7f-748fcee993a3 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:28:30.208385 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:28:30.208385 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:28:30.209674 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3077ef7e-2f65-48a4-8b7f-748fcee993a3 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:30.299048 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2574/5152] 10.222.0.23 () {60 vars in 1151 bytes} [Sat Apr 30 21:28:30 2022] POST /identity/v3/policies => generated 228 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:28:30.311281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50cba5-e928-436a-a6e0-ecfda2378565 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:30.327907 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50cba5-e928-436a-a6e0-ecfda2378565 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:30.342537 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f405a74b-45b5-49a5-85a1-fad3f1b70b7e tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feefbe5478e4ff799363a5b0059fbfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a567e8f7d8b46f58cab1989cb1312eb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:30.343221 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405a74b-45b5-49a5-85a1-fad3f1b70b7e tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:30.343509 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405a74b-45b5-49a5-85a1-fad3f1b70b7e tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:30.345863 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405a74b-45b5-49a5-85a1-fad3f1b70b7e tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] PATH_INFO: `/v3/policies` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:30.349199 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f405a74b-45b5-49a5-85a1-fad3f1b70b7e tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:30.352003 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f405a74b-45b5-49a5-85a1-fad3f1b70b7e tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:30.457200 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2579/5153] 10.222.0.23 () {60 vars in 1151 bytes} [Sat Apr 30 21:28:30 2022] POST /identity/v3/policies => generated 229 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:28:30.458821 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077ef7e-2f65-48a4-8b7f-748fcee993a3 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:30.502994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077ef7e-2f65-48a4-8b7f-748fcee993a3 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:30.515744 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684cdc64-a697-4d51-be33-f6a84927e1f5 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feefbe5478e4ff799363a5b0059fbfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a567e8f7d8b46f58cab1989cb1312eb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:30.518479 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684cdc64-a697-4d51-be33-f6a84927e1f5 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:30.519593 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684cdc64-a697-4d51-be33-f6a84927e1f5 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:30.520135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684cdc64-a697-4d51-be33-f6a84927e1f5 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] PATH_INFO: `/v3/policies` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:30.521160 ncdv-master-1 devstack@keystone.service[91017]: WARNING oslo_log.versionutils [None req-684cdc64-a697-4d51-be33-f6a84927e1f5 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Apr 30 21:28:30.522262 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684cdc64-a697-4d51-be33-f6a84927e1f5 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:30.524624 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-684cdc64-a697-4d51-be33-f6a84927e1f5 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:28:30.524624 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:28:30.524624 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:28:30.526471 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684cdc64-a697-4d51-be33-f6a84927e1f5 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:30.542557 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2575/5154] 10.222.0.23 () {58 vars in 1130 bytes} [Sat Apr 30 21:28:30 2022] GET /identity/v3/policies => generated 762 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:28:30.543499 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f405a74b-45b5-49a5-85a1-fad3f1b70b7e tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:30.555273 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f405a74b-45b5-49a5-85a1-fad3f1b70b7e tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:30.561583 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf076a87-b4a8-493b-a20d-e0a629541131 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feefbe5478e4ff799363a5b0059fbfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a567e8f7d8b46f58cab1989cb1312eb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:30.562722 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf076a87-b4a8-493b-a20d-e0a629541131 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:30.563171 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf076a87-b4a8-493b-a20d-e0a629541131 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:30.563618 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf076a87-b4a8-493b-a20d-e0a629541131 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] PATH_INFO: `/v3/policies/c85aac0c5e1c4f5ea32a4a89f29e94ad` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:30.564406 ncdv-master-1 devstack@keystone.service[91018]: WARNING oslo_log.versionutils [None req-bf076a87-b4a8-493b-a20d-e0a629541131 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Apr 30 21:28:30.565031 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf076a87-b4a8-493b-a20d-e0a629541131 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=c85aac0c5e1c4f5ea32a4a89f29e94ad)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:30.566641 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-bf076a87-b4a8-493b-a20d-e0a629541131 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:28:30.566641 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:28:30.566641 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:28:30.567883 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf076a87-b4a8-493b-a20d-e0a629541131 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:30.665567 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684cdc64-a697-4d51-be33-f6a84927e1f5 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:30.666740 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2580/5155] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:28:30 2022] DELETE /identity/v3/policies/c85aac0c5e1c4f5ea32a4a89f29e94ad => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:28:30.681663 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684cdc64-a697-4d51-be33-f6a84927e1f5 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:30.689671 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4451d9d-d382-46da-b6c9-2dab5e72e1bb tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feefbe5478e4ff799363a5b0059fbfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a567e8f7d8b46f58cab1989cb1312eb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:30.692707 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4451d9d-d382-46da-b6c9-2dab5e72e1bb tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:30.693526 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4451d9d-d382-46da-b6c9-2dab5e72e1bb tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:30.693917 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4451d9d-d382-46da-b6c9-2dab5e72e1bb tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] PATH_INFO: `/v3/policies/e6bdfb8e2d6b4a34a8ef1c4ef6078565` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:30.700520 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4451d9d-d382-46da-b6c9-2dab5e72e1bb tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=e6bdfb8e2d6b4a34a8ef1c4ef6078565)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:30.703482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4451d9d-d382-46da-b6c9-2dab5e72e1bb tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:30.806474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf076a87-b4a8-493b-a20d-e0a629541131 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:30.807602 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2576/5156] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:28:30 2022] DELETE /identity/v3/policies/e6bdfb8e2d6b4a34a8ef1c4ef6078565 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:28:30.821202 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf076a87-b4a8-493b-a20d-e0a629541131 tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:30.834129 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ff4d6-e485-41d7-bbdc-6983c8e0127e tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4feefbe5478e4ff799363a5b0059fbfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a567e8f7d8b46f58cab1989cb1312eb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:30.835972 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ff4d6-e485-41d7-bbdc-6983c8e0127e tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:30.836431 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ff4d6-e485-41d7-bbdc-6983c8e0127e tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:30.837166 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ff4d6-e485-41d7-bbdc-6983c8e0127e tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] PATH_INFO: `/v3/policies/708587e4652146c1a49045eed252f91f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:30.842204 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ff4d6-e485-41d7-bbdc-6983c8e0127e tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=708587e4652146c1a49045eed252f91f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:30.845329 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ff4d6-e485-41d7-bbdc-6983c8e0127e tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:30.957867 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2581/5157] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:28:30 2022] DELETE /identity/v3/policies/708587e4652146c1a49045eed252f91f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:28:30.962693 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4451d9d-d382-46da-b6c9-2dab5e72e1bb tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:31.029956 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4451d9d-d382-46da-b6c9-2dab5e72e1bb tempest-PoliciesTestJSON-1379268542 tempest-PoliciesTestJSON-1379268542-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:31.034564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643afb9-0989-4b6a-8ac9-e81c306fc309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:31.035401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643afb9-0989-4b6a-8ac9-e81c306fc309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:31.040439 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643afb9-0989-4b6a-8ac9-e81c306fc309 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:31.040439 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643afb9-0989-4b6a-8ac9-e81c306fc309 admin admin] PATH_INFO: `/v3/users/254c69ad30234015b342c4f02023f6ea` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:31.042470 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5643afb9-0989-4b6a-8ac9-e81c306fc309 admin admin] RBAC: Authorizing `identity:delete_user(user_id=254c69ad30234015b342c4f02023f6ea)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:31.043185 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5643afb9-0989-4b6a-8ac9-e81c306fc309 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:31.292776 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5643afb9-0989-4b6a-8ac9-e81c306fc309 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '254c69ad30234015b342c4f02023f6ea'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:31.308666 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5643afb9-0989-4b6a-8ac9-e81c306fc309 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '254c69ad30234015b342c4f02023f6ea'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:31.509271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5643afb9-0989-4b6a-8ac9-e81c306fc309 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '254c69ad30234015b342c4f02023f6ea'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:31.509271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5643afb9-0989-4b6a-8ac9-e81c306fc309 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '254c69ad30234015b342c4f02023f6ea'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:31.516314 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5643afb9-0989-4b6a-8ac9-e81c306fc309 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '254c69ad30234015b342c4f02023f6ea'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:31.530351 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2577/5158] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:28:30 2022] DELETE /identity/v3/users/254c69ad30234015b342c4f02023f6ea => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:28:31.536011 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b7959-3f77-4169-b0c5-ce1a01ef4a79 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:31.536011 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b7959-3f77-4169-b0c5-ce1a01ef4a79 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:31.536816 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b7959-3f77-4169-b0c5-ce1a01ef4a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:31.560389 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-308b7959-3f77-4169-b0c5-ce1a01ef4a79 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:31.562338 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-308b7959-3f77-4169-b0c5-ce1a01ef4a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:31.632093 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2582/5159] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:28:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:28:31.648873 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f209859-17e4-49d5-9aa0-5f887a30fed7 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:31.649417 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f209859-17e4-49d5-9aa0-5f887a30fed7 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:31.649896 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f209859-17e4-49d5-9aa0-5f887a30fed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:31.673504 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b7959-3f77-4169-b0c5-ce1a01ef4a79 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:31.675348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-308b7959-3f77-4169-b0c5-ce1a01ef4a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:31.685243 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-7f209859-17e4-49d5-9aa0-5f887a30fed7 None None] MFA Rules not processed for user `9cc9b55d852942538c3ad8f317dcd73e`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:31.686823 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7f209859-17e4-49d5-9aa0-5f887a30fed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:31.750052 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b7959-3f77-4169-b0c5-ce1a01ef4a79 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:31.756148 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a220f3-3b0f-4a4a-8b70-980836fe22e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:31.758104 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a220f3-3b0f-4a4a-8b70-980836fe22e9 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:31.758652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a220f3-3b0f-4a4a-8b70-980836fe22e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:31.759093 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a220f3-3b0f-4a4a-8b70-980836fe22e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:31.768440 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2578/5160] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:28:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:28:31.770995 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a220f3-3b0f-4a4a-8b70-980836fe22e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:31.773663 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a220f3-3b0f-4a4a-8b70-980836fe22e9 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:31.795357 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2583/5161] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:28:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:28:33.730587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f209859-17e4-49d5-9aa0-5f887a30fed7 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:33.746766 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f209859-17e4-49d5-9aa0-5f887a30fed7 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:33.756419 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901bb32b-81f6-42be-b298-c1f2195cfe0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:33.757209 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bb32b-81f6-42be-b298-c1f2195cfe0a service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:33.760208 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bb32b-81f6-42be-b298-c1f2195cfe0a service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:33.760516 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901bb32b-81f6-42be-b298-c1f2195cfe0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:33.763769 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-901bb32b-81f6-42be-b298-c1f2195cfe0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:33.788123 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901bb32b-81f6-42be-b298-c1f2195cfe0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:33.793376 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901bb32b-81f6-42be-b298-c1f2195cfe0a service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:33.811246 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2579/5162] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:28:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:28:33.815318 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a220f3-3b0f-4a4a-8b70-980836fe22e9 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:33.816884 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a2a220f3-3b0f-4a4a-8b70-980836fe22e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:33.842861 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a220f3-3b0f-4a4a-8b70-980836fe22e9 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:33.853295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7620c-44fe-4b8c-83c4-eeafee0d60e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:33.854506 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7620c-44fe-4b8c-83c4-eeafee0d60e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:33.855094 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7620c-44fe-4b8c-83c4-eeafee0d60e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:33.856362 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee7620c-44fe-4b8c-83c4-eeafee0d60e3 admin admin] PATH_INFO: `/v3/projects/ded425da5c6541d18ad54b75b7110ab8` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:33.858530 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee7620c-44fe-4b8c-83c4-eeafee0d60e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ded425da5c6541d18ad54b75b7110ab8)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:33.863698 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee7620c-44fe-4b8c-83c4-eeafee0d60e3 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:34.116017 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8ee7620c-44fe-4b8c-83c4-eeafee0d60e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ded425da5c6541d18ad54b75b7110ab8', 'request_id': 'req-8ee7620c-44fe-4b8c-83c4-eeafee0d60e3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:34.128296 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8ee7620c-44fe-4b8c-83c4-eeafee0d60e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ded425da5c6541d18ad54b75b7110ab8', 'request_id': 'req-8ee7620c-44fe-4b8c-83c4-eeafee0d60e3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:34.140211 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8ee7620c-44fe-4b8c-83c4-eeafee0d60e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ded425da5c6541d18ad54b75b7110ab8', 'request_id': 'req-8ee7620c-44fe-4b8c-83c4-eeafee0d60e3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:34.285662 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8ee7620c-44fe-4b8c-83c4-eeafee0d60e3 admin admin] The token cache is being invalidate because project ded425da5c6541d18ad54b75b7110ab8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:28:34.286427 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8ee7620c-44fe-4b8c-83c4-eeafee0d60e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:34.289301 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8ee7620c-44fe-4b8c-83c4-eeafee0d60e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:34.298549 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2584/5163] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:28:33 2022] DELETE /identity/v3/projects/ded425da5c6541d18ad54b75b7110ab8 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:28:34.299339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901bb32b-81f6-42be-b298-c1f2195cfe0a service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:34.326106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901bb32b-81f6-42be-b298-c1f2195cfe0a service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:34.407838 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61056907-06f0-4769-82f6-68a47d8dd99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:34.409348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61056907-06f0-4769-82f6-68a47d8dd99d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:34.409640 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61056907-06f0-4769-82f6-68a47d8dd99d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:34.410003 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61056907-06f0-4769-82f6-68a47d8dd99d admin admin] PATH_INFO: `/v3/users/4feefbe5478e4ff799363a5b0059fbfd` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:34.419922 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61056907-06f0-4769-82f6-68a47d8dd99d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4feefbe5478e4ff799363a5b0059fbfd)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:34.422217 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61056907-06f0-4769-82f6-68a47d8dd99d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:34.709586 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-61056907-06f0-4769-82f6-68a47d8dd99d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4feefbe5478e4ff799363a5b0059fbfd'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:34.733688 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-61056907-06f0-4769-82f6-68a47d8dd99d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4feefbe5478e4ff799363a5b0059fbfd'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:34.813775 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-61056907-06f0-4769-82f6-68a47d8dd99d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4feefbe5478e4ff799363a5b0059fbfd'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:34.814813 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-61056907-06f0-4769-82f6-68a47d8dd99d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4feefbe5478e4ff799363a5b0059fbfd'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:34.827281 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-61056907-06f0-4769-82f6-68a47d8dd99d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4feefbe5478e4ff799363a5b0059fbfd'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:34.842984 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2580/5164] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:28:34 2022] DELETE /identity/v3/users/4feefbe5478e4ff799363a5b0059fbfd => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:28:36.431046 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7620c-44fe-4b8c-83c4-eeafee0d60e3 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:36.432665 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8ee7620c-44fe-4b8c-83c4-eeafee0d60e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:36.454215 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee7620c-44fe-4b8c-83c4-eeafee0d60e3 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:36.625205 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb57a83-f372-42be-ab0a-910a8ccc3cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:36.626122 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb57a83-f372-42be-ab0a-910a8ccc3cb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:36.626608 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb57a83-f372-42be-ab0a-910a8ccc3cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:36.627058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb57a83-f372-42be-ab0a-910a8ccc3cb6 admin admin] PATH_INFO: `/v3/projects/3a567e8f7d8b46f58cab1989cb1312eb` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:36.633139 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb57a83-f372-42be-ab0a-910a8ccc3cb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a567e8f7d8b46f58cab1989cb1312eb)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:36.636714 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb57a83-f372-42be-ab0a-910a8ccc3cb6 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:36.797896 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2cb57a83-f372-42be-ab0a-910a8ccc3cb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a567e8f7d8b46f58cab1989cb1312eb', 'request_id': 'req-2cb57a83-f372-42be-ab0a-910a8ccc3cb6'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:36.811715 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2cb57a83-f372-42be-ab0a-910a8ccc3cb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a567e8f7d8b46f58cab1989cb1312eb', 'request_id': 'req-2cb57a83-f372-42be-ab0a-910a8ccc3cb6'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:36.826354 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2cb57a83-f372-42be-ab0a-910a8ccc3cb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a567e8f7d8b46f58cab1989cb1312eb', 'request_id': 'req-2cb57a83-f372-42be-ab0a-910a8ccc3cb6'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:36.928232 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2cb57a83-f372-42be-ab0a-910a8ccc3cb6 admin admin] The token cache is being invalidate because project 3a567e8f7d8b46f58cab1989cb1312eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:28:36.929798 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2cb57a83-f372-42be-ab0a-910a8ccc3cb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:36.929983 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2cb57a83-f372-42be-ab0a-910a8ccc3cb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:36.932427 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2585/5165] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:28:36 2022] DELETE /identity/v3/projects/3a567e8f7d8b46f58cab1989cb1312eb => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:28:36.940508 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db7e97-e172-4a3b-8d27-be911833d175 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:36.941106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db7e97-e172-4a3b-8d27-be911833d175 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:36.941106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db7e97-e172-4a3b-8d27-be911833d175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:36.992806 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-96db7e97-e172-4a3b-8d27-be911833d175 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:36.996454 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-96db7e97-e172-4a3b-8d27-be911833d175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:37.086920 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2581/5166] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:28:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:28:37.094918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2dec31-1930-4219-afc4-89fd75d4bf57 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:37.095580 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2dec31-1930-4219-afc4-89fd75d4bf57 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:37.095983 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2dec31-1930-4219-afc4-89fd75d4bf57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:37.122503 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-9c2dec31-1930-4219-afc4-89fd75d4bf57 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:37.124157 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9c2dec31-1930-4219-afc4-89fd75d4bf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:37.139486 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2586/5167] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:28:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:28:37.145187 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db7e97-e172-4a3b-8d27-be911833d175 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:37.160546 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db7e97-e172-4a3b-8d27-be911833d175 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:37.177083 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d2b2b-1230-4d23-a897-dca6a98a5765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:37.178157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d2b2b-1230-4d23-a897-dca6a98a5765 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:37.178621 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d2b2b-1230-4d23-a897-dca6a98a5765 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:37.180146 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d2b2b-1230-4d23-a897-dca6a98a5765 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:37.180898 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3d2b2b-1230-4d23-a897-dca6a98a5765 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:28:37.181197 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3d2b2b-1230-4d23-a897-dca6a98a5765 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:37.182932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3d2b2b-1230-4d23-a897-dca6a98a5765 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:37.203335 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2582/5168] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:28:37.207129 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2dec31-1930-4219-afc4-89fd75d4bf57 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:37.219403 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2dec31-1930-4219-afc4-89fd75d4bf57 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:37.226696 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f227a06-6e20-455b-a16a-4010784ee8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:37.227390 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f227a06-6e20-455b-a16a-4010784ee8da admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:37.227677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f227a06-6e20-455b-a16a-4010784ee8da admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:37.227954 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f227a06-6e20-455b-a16a-4010784ee8da admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:37.228704 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f227a06-6e20-455b-a16a-4010784ee8da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:37.230985 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f227a06-6e20-455b-a16a-4010784ee8da admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:37.359537 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2587/5169] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:28:37 2022] POST /identity/v3/projects => generated 371 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:28:37.364147 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d2b2b-1230-4d23-a897-dca6a98a5765 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:37.377277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d2b2b-1230-4d23-a897-dca6a98a5765 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:37.505389 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de304578-a38c-418b-baf8-289713a8280d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:37.506112 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de304578-a38c-418b-baf8-289713a8280d admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:37.506605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de304578-a38c-418b-baf8-289713a8280d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:37.507788 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de304578-a38c-418b-baf8-289713a8280d admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:37.508515 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de304578-a38c-418b-baf8-289713a8280d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:37.510504 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de304578-a38c-418b-baf8-289713a8280d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:37.608323 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2583/5170] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:28:37 2022] POST /identity/v3/users => generated 286 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:28:37.613876 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f227a06-6e20-455b-a16a-4010784ee8da admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:37.626464 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f227a06-6e20-455b-a16a-4010784ee8da admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:37.633795 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c279c76-9f89-47e2-a2b8-cee0aefadd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:37.636521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c279c76-9f89-47e2-a2b8-cee0aefadd61 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:37.636521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c279c76-9f89-47e2-a2b8-cee0aefadd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:37.636521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c279c76-9f89-47e2-a2b8-cee0aefadd61 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:37.636521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c279c76-9f89-47e2-a2b8-cee0aefadd61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:37.638126 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c279c76-9f89-47e2-a2b8-cee0aefadd61 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:37.650043 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2588/5171] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:28:37.654059 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de304578-a38c-418b-baf8-289713a8280d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:37.673068 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de304578-a38c-418b-baf8-289713a8280d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:37.679926 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84c7aa-2373-4fa4-a975-bc25e7e93fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:37.680904 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84c7aa-2373-4fa4-a975-bc25e7e93fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:37.681193 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84c7aa-2373-4fa4-a975-bc25e7e93fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:37.681464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84c7aa-2373-4fa4-a975-bc25e7e93fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:37.682704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe84c7aa-2373-4fa4-a975-bc25e7e93fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:37.684414 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe84c7aa-2373-4fa4-a975-bc25e7e93fc3 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:37.695763 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2584/5172] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:28:37.700119 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c279c76-9f89-47e2-a2b8-cee0aefadd61 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:37.712782 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c279c76-9f89-47e2-a2b8-cee0aefadd61 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:37.717677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b22ab9-e06a-4dc7-af5a-52c3fbd2c995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:37.718774 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b22ab9-e06a-4dc7-af5a-52c3fbd2c995 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:37.719065 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b22ab9-e06a-4dc7-af5a-52c3fbd2c995 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:37.719346 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b22ab9-e06a-4dc7-af5a-52c3fbd2c995 admin admin] PATH_INFO: `/v3/projects/61e815599b8b4d529941388a94c3ae64/users/159c07d7fdfd40b892edf9d912d0175a/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:37.735194 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b22ab9-e06a-4dc7-af5a-52c3fbd2c995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61e815599b8b4d529941388a94c3ae64, user_id=159c07d7fdfd40b892edf9d912d0175a, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:37.737877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b22ab9-e06a-4dc7-af5a-52c3fbd2c995 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:37.840198 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2589/5173] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:28:37 2022] PUT /identity/v3/projects/61e815599b8b4d529941388a94c3ae64/users/159c07d7fdfd40b892edf9d912d0175a/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:28:37.852034 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54936230-f1fa-49e2-ae21-c1732e77a6ad None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:37.852657 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54936230-f1fa-49e2-ae21-c1732e77a6ad None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:37.853010 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54936230-f1fa-49e2-ae21-c1732e77a6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:37.925383 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-54936230-f1fa-49e2-ae21-c1732e77a6ad None None] MFA Rules not processed for user `159c07d7fdfd40b892edf9d912d0175a`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:37.935170 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-54936230-f1fa-49e2-ae21-c1732e77a6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:38.032699 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2585/5174] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:28:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:28:38.051284 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b22ab9-e06a-4dc7-af5a-52c3fbd2c995 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:38.053193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-62b22ab9-e06a-4dc7-af5a-52c3fbd2c995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:38.152746 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b22ab9-e06a-4dc7-af5a-52c3fbd2c995 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:38.157934 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25757133-1b88-4164-8278-4a5044ed15ea service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e302b1298dd04d6590e3d079f7b13b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:38.158598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25757133-1b88-4164-8278-4a5044ed15ea service glance] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:38.158884 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25757133-1b88-4164-8278-4a5044ed15ea service glance] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:38.159189 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25757133-1b88-4164-8278-4a5044ed15ea service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:38.174552 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25757133-1b88-4164-8278-4a5044ed15ea service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:38.176442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25757133-1b88-4164-8278-4a5044ed15ea service glance] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:38.217654 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2590/5175] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:28:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:28:38.758762 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fafceb-8ad3-4298-b4c7-c308cbce9f34 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:38.763280 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fafceb-8ad3-4298-b4c7-c308cbce9f34 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:38.763280 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fafceb-8ad3-4298-b4c7-c308cbce9f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:38.784074 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-a7fafceb-8ad3-4298-b4c7-c308cbce9f34 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:38.786233 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a7fafceb-8ad3-4298-b4c7-c308cbce9f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:38.851791 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2586/5176] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:28:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:28:39.027909 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25757133-1b88-4164-8278-4a5044ed15ea service glance] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:39.029930 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-25757133-1b88-4164-8278-4a5044ed15ea service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:39.122075 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25757133-1b88-4164-8278-4a5044ed15ea service glance] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:39.127480 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b7d99-1478-486d-97fa-4331183cb78f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:39.128159 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b7d99-1478-486d-97fa-4331183cb78f service swift] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:39.128441 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b7d99-1478-486d-97fa-4331183cb78f service swift] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:39.128718 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b7d99-1478-486d-97fa-4331183cb78f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:39.142562 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b7d99-1478-486d-97fa-4331183cb78f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:39.142562 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b7d99-1478-486d-97fa-4331183cb78f service swift] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:39.155438 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2591/5177] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:28:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:28:40.047215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da6e80-77eb-4c2d-99cf-7937a1493b74 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:40.047653 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da6e80-77eb-4c2d-99cf-7937a1493b74 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:40.047898 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da6e80-77eb-4c2d-99cf-7937a1493b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:40.068997 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-23da6e80-77eb-4c2d-99cf-7937a1493b74 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:40.070912 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-23da6e80-77eb-4c2d-99cf-7937a1493b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:40.086513 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2587/5178] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:28:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:28:40.099708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b7d99-1478-486d-97fa-4331183cb78f service swift] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:40.116812 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b7d99-1478-486d-97fa-4331183cb78f service swift] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:40.138324 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36398895-226f-4d71-b89d-82e83f09eded service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:40.139010 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36398895-226f-4d71-b89d-82e83f09eded service swift] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:40.139288 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36398895-226f-4d71-b89d-82e83f09eded service swift] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:40.139568 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36398895-226f-4d71-b89d-82e83f09eded service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:40.152774 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36398895-226f-4d71-b89d-82e83f09eded service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:40.152774 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36398895-226f-4d71-b89d-82e83f09eded service swift] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:40.166963 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2592/5179] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:28:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:28:40.654594 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da6e80-77eb-4c2d-99cf-7937a1493b74 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:40.656252 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-23da6e80-77eb-4c2d-99cf-7937a1493b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:40.738453 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da6e80-77eb-4c2d-99cf-7937a1493b74 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:40.745507 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b89e7-c266-4a07-b2d8-709ccdc23e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:40.748756 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b89e7-c266-4a07-b2d8-709ccdc23e99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:40.749373 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b89e7-c266-4a07-b2d8-709ccdc23e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:40.750645 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b89e7-c266-4a07-b2d8-709ccdc23e99 admin admin] PATH_INFO: `/v3/users/5080b593bede4939bdf15f9a470365da` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:40.752742 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b89e7-c266-4a07-b2d8-709ccdc23e99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5080b593bede4939bdf15f9a470365da)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:40.757208 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b89e7-c266-4a07-b2d8-709ccdc23e99 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:41.053038 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-265b89e7-c266-4a07-b2d8-709ccdc23e99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5080b593bede4939bdf15f9a470365da'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:41.069298 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-265b89e7-c266-4a07-b2d8-709ccdc23e99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5080b593bede4939bdf15f9a470365da'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:41.166717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-265b89e7-c266-4a07-b2d8-709ccdc23e99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5080b593bede4939bdf15f9a470365da'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:41.167818 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-265b89e7-c266-4a07-b2d8-709ccdc23e99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5080b593bede4939bdf15f9a470365da'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:41.178405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-265b89e7-c266-4a07-b2d8-709ccdc23e99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5080b593bede4939bdf15f9a470365da'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:41.203949 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2588/5180] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:28:40 2022] DELETE /identity/v3/users/5080b593bede4939bdf15f9a470365da => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:28:41.207697 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a2d97-1d80-4d46-916b-16f725543ebc None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:41.208649 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a2d97-1d80-4d46-916b-16f725543ebc None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:41.209426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a2d97-1d80-4d46-916b-16f725543ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:41.226820 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f08fb-9771-48ab-b8ad-aef919d1ce8a None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:41.227112 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f08fb-9771-48ab-b8ad-aef919d1ce8a None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:41.227831 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f08fb-9771-48ab-b8ad-aef919d1ce8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:41.245823 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-518a2d97-1d80-4d46-916b-16f725543ebc None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:41.247381 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-518a2d97-1d80-4d46-916b-16f725543ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:41.264036 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-461f08fb-9771-48ab-b8ad-aef919d1ce8a None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:41.266256 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-461f08fb-9771-48ab-b8ad-aef919d1ce8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:41.356765 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2589/5181] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:28:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:28:41.358191 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2593/5182] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:28:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:28:41.369570 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f08fb-9771-48ab-b8ad-aef919d1ce8a None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:41.371282 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-461f08fb-9771-48ab-b8ad-aef919d1ce8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:41.372763 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a2d97-1d80-4d46-916b-16f725543ebc None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:41.375470 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-518a2d97-1d80-4d46-916b-16f725543ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:41.460859 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f08fb-9771-48ab-b8ad-aef919d1ce8a None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:41.468462 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1393d-6521-4e96-b4be-f74e7dcd83c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:41.469929 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1393d-6521-4e96-b4be-f74e7dcd83c7 service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:41.470739 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1393d-6521-4e96-b4be-f74e7dcd83c7 service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:41.471260 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1393d-6521-4e96-b4be-f74e7dcd83c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:41.488833 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c1393d-6521-4e96-b4be-f74e7dcd83c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:41.490267 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a2d97-1d80-4d46-916b-16f725543ebc None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:41.493337 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c1393d-6521-4e96-b4be-f74e7dcd83c7 service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:41.502205 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbfd7a4-cdb9-44e7-b72c-e1fb14f3bb72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:41.505778 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbfd7a4-cdb9-44e7-b72c-e1fb14f3bb72 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:41.508198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbfd7a4-cdb9-44e7-b72c-e1fb14f3bb72 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:41.508198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbfd7a4-cdb9-44e7-b72c-e1fb14f3bb72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:41.514098 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2590/5183] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:28:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:28:41.532568 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbfd7a4-cdb9-44e7-b72c-e1fb14f3bb72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:41.537076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbfd7a4-cdb9-44e7-b72c-e1fb14f3bb72 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:41.558063 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2594/5184] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:28:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:28:41.912891 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1393d-6521-4e96-b4be-f74e7dcd83c7 service swift] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:41.915462 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-23c1393d-6521-4e96-b4be-f74e7dcd83c7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:41.946232 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1393d-6521-4e96-b4be-f74e7dcd83c7 service swift] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:41.966631 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeddd21c-e433-4ec3-a164-4ac745896f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:41.971471 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeddd21c-e433-4ec3-a164-4ac745896f33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:41.971812 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeddd21c-e433-4ec3-a164-4ac745896f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:41.991350 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeddd21c-e433-4ec3-a164-4ac745896f33 admin admin] PATH_INFO: `/v3/projects/d5acec4ac23a4bc3b5ebe5b504ccb591` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:41.997682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeddd21c-e433-4ec3-a164-4ac745896f33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5acec4ac23a4bc3b5ebe5b504ccb591)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:42.002551 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeddd21c-e433-4ec3-a164-4ac745896f33 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:42.246522 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-eeddd21c-e433-4ec3-a164-4ac745896f33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5acec4ac23a4bc3b5ebe5b504ccb591', 'request_id': 'req-eeddd21c-e433-4ec3-a164-4ac745896f33'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:42.255963 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-eeddd21c-e433-4ec3-a164-4ac745896f33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5acec4ac23a4bc3b5ebe5b504ccb591', 'request_id': 'req-eeddd21c-e433-4ec3-a164-4ac745896f33'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:42.265691 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-eeddd21c-e433-4ec3-a164-4ac745896f33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5acec4ac23a4bc3b5ebe5b504ccb591', 'request_id': 'req-eeddd21c-e433-4ec3-a164-4ac745896f33'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:42.377571 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-eeddd21c-e433-4ec3-a164-4ac745896f33 admin admin] The token cache is being invalidate because project d5acec4ac23a4bc3b5ebe5b504ccb591 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:28:42.378789 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-eeddd21c-e433-4ec3-a164-4ac745896f33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:42.379639 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-eeddd21c-e433-4ec3-a164-4ac745896f33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:42.381737 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2591/5185] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:28:41 2022] DELETE /identity/v3/projects/d5acec4ac23a4bc3b5ebe5b504ccb591 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:28:42.386552 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180f3d4-1feb-474b-b588-2f10f6186cc8 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:42.387382 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180f3d4-1feb-474b-b588-2f10f6186cc8 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:42.387819 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180f3d4-1feb-474b-b588-2f10f6186cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:42.413802 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-d180f3d4-1feb-474b-b588-2f10f6186cc8 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:42.415577 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d180f3d4-1feb-474b-b588-2f10f6186cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:42.594716 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2595/5186] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:28:42.603497 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc024053-6dc7-4b63-9af4-c930dc522aaa None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:42.603936 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc024053-6dc7-4b63-9af4-c930dc522aaa None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:42.604063 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc024053-6dc7-4b63-9af4-c930dc522aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:42.635459 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-bc024053-6dc7-4b63-9af4-c930dc522aaa None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:42.636849 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-bc024053-6dc7-4b63-9af4-c930dc522aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:42.690077 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2592/5187] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:28:42.692287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180f3d4-1feb-474b-b588-2f10f6186cc8 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:42.706648 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e0c1e-57a4-48d5-bb6c-baccd4b6b9f9 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:42.706648 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e0c1e-57a4-48d5-bb6c-baccd4b6b9f9 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:42.706648 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e0c1e-57a4-48d5-bb6c-baccd4b6b9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:42.707406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180f3d4-1feb-474b-b588-2f10f6186cc8 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:42.727175 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ee8b4-3e45-4ab2-832a-5c8fa05a685d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:42.729046 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ee8b4-3e45-4ab2-832a-5c8fa05a685d admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:42.729897 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ee8b4-3e45-4ab2-832a-5c8fa05a685d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:42.730190 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ee8b4-3e45-4ab2-832a-5c8fa05a685d admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:42.735292 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ee8b4-3e45-4ab2-832a-5c8fa05a685d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:28:42.735663 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ee8b4-3e45-4ab2-832a-5c8fa05a685d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:42.744962 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ee8b4-3e45-4ab2-832a-5c8fa05a685d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:42.747385 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-a58e0c1e-57a4-48d5-bb6c-baccd4b6b9f9 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:42.749602 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a58e0c1e-57a4-48d5-bb6c-baccd4b6b9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:42.782448 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2596/5188] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:28:42.793043 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ee8b4-3e45-4ab2-832a-5c8fa05a685d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:42.807632 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ee8b4-3e45-4ab2-832a-5c8fa05a685d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:42.821674 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb6964-1a08-40a1-afd5-4d894c469133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:42.822846 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb6964-1a08-40a1-afd5-4d894c469133 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:42.823350 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb6964-1a08-40a1-afd5-4d894c469133 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:42.824375 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb6964-1a08-40a1-afd5-4d894c469133 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:42.825310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb6964-1a08-40a1-afd5-4d894c469133 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:42.827498 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb6964-1a08-40a1-afd5-4d894c469133 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:42.878326 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2593/5189] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:28:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:28:42.904674 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e0c1e-57a4-48d5-bb6c-baccd4b6b9f9 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:42.906527 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a58e0c1e-57a4-48d5-bb6c-baccd4b6b9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:42.942901 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2597/5190] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:28:42 2022] POST /identity/v3/projects => generated 365 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:28:42.948077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb6964-1a08-40a1-afd5-4d894c469133 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:43.038230 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e0c1e-57a4-48d5-bb6c-baccd4b6b9f9 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:43.117864 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a127295b-9e15-4600-8260-540f1534bd17 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:43.118538 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127295b-9e15-4600-8260-540f1534bd17 service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:43.118825 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127295b-9e15-4600-8260-540f1534bd17 service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:43.119100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127295b-9e15-4600-8260-540f1534bd17 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:43.200110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a127295b-9e15-4600-8260-540f1534bd17 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:43.201938 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a127295b-9e15-4600-8260-540f1534bd17 service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:43.209797 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb6964-1a08-40a1-afd5-4d894c469133 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:43.212596 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2594/5191] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:28:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:28:43.234551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c181833-f786-405a-ac77-d5a252e56d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:43.238532 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c181833-f786-405a-ac77-d5a252e56d57 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:43.239567 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c181833-f786-405a-ac77-d5a252e56d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:43.243148 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c181833-f786-405a-ac77-d5a252e56d57 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:43.243897 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c181833-f786-405a-ac77-d5a252e56d57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:43.245924 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c181833-f786-405a-ac77-d5a252e56d57 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:43.382870 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2598/5192] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:28:42 2022] POST /identity/v3/users => generated 283 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:28:43.386920 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a127295b-9e15-4600-8260-540f1534bd17 service swift] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:43.415061 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a127295b-9e15-4600-8260-540f1534bd17 service swift] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:43.427004 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a485985-3278-430e-85a2-834aa8524481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:43.430460 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a485985-3278-430e-85a2-834aa8524481 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:43.437962 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a485985-3278-430e-85a2-834aa8524481 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:43.437962 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a485985-3278-430e-85a2-834aa8524481 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:43.437962 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a485985-3278-430e-85a2-834aa8524481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:43.437962 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a485985-3278-430e-85a2-834aa8524481 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:43.445133 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2595/5193] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:28:43.449520 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c181833-f786-405a-ac77-d5a252e56d57 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:43.462690 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c181833-f786-405a-ac77-d5a252e56d57 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:43.468051 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832dbb5f-4c55-411a-ad83-e5b1a5ca46ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:43.468777 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832dbb5f-4c55-411a-ad83-e5b1a5ca46ac admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:43.469073 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832dbb5f-4c55-411a-ad83-e5b1a5ca46ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:43.469349 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832dbb5f-4c55-411a-ad83-e5b1a5ca46ac admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:43.470126 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832dbb5f-4c55-411a-ad83-e5b1a5ca46ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:43.471802 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832dbb5f-4c55-411a-ad83-e5b1a5ca46ac admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:43.485478 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2599/5194] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:28:43.489671 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a485985-3278-430e-85a2-834aa8524481 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:43.502083 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a485985-3278-430e-85a2-834aa8524481 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:43.507423 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1311270-c9c5-4175-802c-6df2b6e1695d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:43.508546 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1311270-c9c5-4175-802c-6df2b6e1695d admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:43.509043 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1311270-c9c5-4175-802c-6df2b6e1695d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:43.509521 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1311270-c9c5-4175-802c-6df2b6e1695d admin admin] PATH_INFO: `/v3/projects/b44c5988d8ff49798ce2723a03e8df52/users/7da39ddee5ee4dee87e6b2e68b1711b6/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:43.539697 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1311270-c9c5-4175-802c-6df2b6e1695d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b44c5988d8ff49798ce2723a03e8df52, user_id=7da39ddee5ee4dee87e6b2e68b1711b6, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:43.542363 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1311270-c9c5-4175-802c-6df2b6e1695d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:43.661676 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2596/5195] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:28:43 2022] PUT /identity/v3/projects/b44c5988d8ff49798ce2723a03e8df52/users/7da39ddee5ee4dee87e6b2e68b1711b6/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:28:43.673668 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3892c-f603-4f20-b381-ac256d4d766e None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:43.674386 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3892c-f603-4f20-b381-ac256d4d766e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:43.675278 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3892c-f603-4f20-b381-ac256d4d766e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:43.707158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-0aa3892c-f603-4f20-b381-ac256d4d766e None None] MFA Rules not processed for user `7da39ddee5ee4dee87e6b2e68b1711b6`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:43.707158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0aa3892c-f603-4f20-b381-ac256d4d766e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:43.785884 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2600/5196] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:28:43 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:28:43.789884 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1311270-c9c5-4175-802c-6df2b6e1695d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:43.868819 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1311270-c9c5-4175-802c-6df2b6e1695d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:43.873539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a803bf-c3ec-4655-91ed-3a19e26038dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:43.874241 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a803bf-c3ec-4655-91ed-3a19e26038dd admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:43.874525 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a803bf-c3ec-4655-91ed-3a19e26038dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:43.874801 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a803bf-c3ec-4655-91ed-3a19e26038dd admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:43.875494 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a803bf-c3ec-4655-91ed-3a19e26038dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:43.877409 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a803bf-c3ec-4655-91ed-3a19e26038dd admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:43.968641 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2597/5197] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:28:43 2022] POST /identity/v3/projects => generated 365 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:28:43.972647 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3892c-f603-4f20-b381-ac256d4d766e None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:43.983808 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3892c-f603-4f20-b381-ac256d4d766e None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:44.041139 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd3b05b-9e5e-421f-b10a-6e6488d3f255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:44.041651 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3b05b-9e5e-421f-b10a-6e6488d3f255 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:44.041960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3b05b-9e5e-421f-b10a-6e6488d3f255 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:44.042234 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3b05b-9e5e-421f-b10a-6e6488d3f255 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:44.042919 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd3b05b-9e5e-421f-b10a-6e6488d3f255 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:44.044831 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd3b05b-9e5e-421f-b10a-6e6488d3f255 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:44.094751 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3756c30-2dc2-4880-90a3-d43a2c339a2b None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:44.095046 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3756c30-2dc2-4880-90a3-d43a2c339a2b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:44.099252 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3756c30-2dc2-4880-90a3-d43a2c339a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:44.113348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-b3756c30-2dc2-4880-90a3-d43a2c339a2b None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:44.114697 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b3756c30-2dc2-4880-90a3-d43a2c339a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:44.175016 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2601/5198] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:28:43 2022] POST /identity/v3/users => generated 289 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:28:44.179386 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd3b05b-9e5e-421f-b10a-6e6488d3f255 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:44.196839 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2598/5199] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:28:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:28:44.203546 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3756c30-2dc2-4880-90a3-d43a2c339a2b None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:44.205545 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd3b05b-9e5e-421f-b10a-6e6488d3f255 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:44.216747 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997926e5-36fc-4b0b-8532-5cb74c58db90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:44.217725 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997926e5-36fc-4b0b-8532-5cb74c58db90 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:44.218275 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997926e5-36fc-4b0b-8532-5cb74c58db90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:44.219962 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997926e5-36fc-4b0b-8532-5cb74c58db90 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:44.220698 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997926e5-36fc-4b0b-8532-5cb74c58db90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:44.223934 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997926e5-36fc-4b0b-8532-5cb74c58db90 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:44.238047 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2602/5200] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:28:44.242419 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997926e5-36fc-4b0b-8532-5cb74c58db90 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:44.256762 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997926e5-36fc-4b0b-8532-5cb74c58db90 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:44.265769 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d56c4-20f6-458b-9cf8-5f2aad712705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:44.267495 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d56c4-20f6-458b-9cf8-5f2aad712705 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:44.268288 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d56c4-20f6-458b-9cf8-5f2aad712705 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:44.268877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d56c4-20f6-458b-9cf8-5f2aad712705 admin admin] PATH_INFO: `/v3/projects/9cf1cf31241743d4b4bb8ec4379e3f29/users/3053335e34af4ae9bddfd8fdc91cd78f/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:44.294358 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d56c4-20f6-458b-9cf8-5f2aad712705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cf1cf31241743d4b4bb8ec4379e3f29, user_id=3053335e34af4ae9bddfd8fdc91cd78f, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:44.296640 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d56c4-20f6-458b-9cf8-5f2aad712705 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:44.318088 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3756c30-2dc2-4880-90a3-d43a2c339a2b None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:44.324903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c926f2e-5b0b-489f-b054-4ce1c15480ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:44.324903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c926f2e-5b0b-489f-b054-4ce1c15480ae service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:44.325277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c926f2e-5b0b-489f-b054-4ce1c15480ae service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:44.325521 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c926f2e-5b0b-489f-b054-4ce1c15480ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:44.335737 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c926f2e-5b0b-489f-b054-4ce1c15480ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:44.337606 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c926f2e-5b0b-489f-b054-4ce1c15480ae service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:44.348273 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2599/5201] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:28:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:28:44.411388 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2603/5202] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:28:44 2022] PUT /identity/v3/projects/9cf1cf31241743d4b4bb8ec4379e3f29/users/3053335e34af4ae9bddfd8fdc91cd78f/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:28:44.414329 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c926f2e-5b0b-489f-b054-4ce1c15480ae service swift] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:44.435415 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c926f2e-5b0b-489f-b054-4ce1c15480ae service swift] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:44.539802 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e3e6f-1226-491d-b8a8-dc63a7e2563b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:44.540687 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e3e6f-1226-491d-b8a8-dc63a7e2563b admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:44.540857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e3e6f-1226-491d-b8a8-dc63a7e2563b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:44.541056 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e3e6f-1226-491d-b8a8-dc63a7e2563b admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:44.542341 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e3e6f-1226-491d-b8a8-dc63a7e2563b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:44.544043 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e3e6f-1226-491d-b8a8-dc63a7e2563b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:44.558926 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2600/5203] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:28:44.566723 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d56c4-20f6-458b-9cf8-5f2aad712705 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:44.580014 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d56c4-20f6-458b-9cf8-5f2aad712705 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:44.585489 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915a807-943e-4865-bfa3-8d85d24fe1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:44.586579 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915a807-943e-4865-bfa3-8d85d24fe1e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:44.587190 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915a807-943e-4865-bfa3-8d85d24fe1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:44.588777 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915a807-943e-4865-bfa3-8d85d24fe1e2 admin admin] PATH_INFO: `/v3/projects/9cf1cf31241743d4b4bb8ec4379e3f29/users/3053335e34af4ae9bddfd8fdc91cd78f/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:44.592302 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7915a807-943e-4865-bfa3-8d85d24fe1e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cf1cf31241743d4b4bb8ec4379e3f29, user_id=3053335e34af4ae9bddfd8fdc91cd78f, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:44.595479 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7915a807-943e-4865-bfa3-8d85d24fe1e2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:44.608792 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2604/5204] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:28:44 2022] PUT /identity/v3/projects/9cf1cf31241743d4b4bb8ec4379e3f29/users/3053335e34af4ae9bddfd8fdc91cd78f/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:28:44.621892 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0d53c-3f8b-4578-ba9e-e95c90602d54 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:44.621892 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0d53c-3f8b-4578-ba9e-e95c90602d54 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:44.621892 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0d53c-3f8b-4578-ba9e-e95c90602d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:44.661646 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-afc0d53c-3f8b-4578-ba9e-e95c90602d54 None None] MFA Rules not processed for user `3053335e34af4ae9bddfd8fdc91cd78f`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:44.663498 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-afc0d53c-3f8b-4578-ba9e-e95c90602d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:44.827884 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2601/5205] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:28:44 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:28:44.835579 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915a807-943e-4865-bfa3-8d85d24fe1e2 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:44.837358 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7915a807-943e-4865-bfa3-8d85d24fe1e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:44.978701 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915a807-943e-4865-bfa3-8d85d24fe1e2 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:44.982831 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46935ac-5aed-40b2-83e1-150d33587d12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:44.983666 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46935ac-5aed-40b2-83e1-150d33587d12 service cinder] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:44.984153 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46935ac-5aed-40b2-83e1-150d33587d12 service cinder] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:44.984544 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46935ac-5aed-40b2-83e1-150d33587d12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:44.997672 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46935ac-5aed-40b2-83e1-150d33587d12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:44.999664 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46935ac-5aed-40b2-83e1-150d33587d12 service cinder] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:45.016571 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2605/5206] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:28:44 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:28:45.317556 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786eb5e6-40da-4e0a-81ea-01edc376627f None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:45.320218 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786eb5e6-40da-4e0a-81ea-01edc376627f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:45.320540 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786eb5e6-40da-4e0a-81ea-01edc376627f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:45.354786 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-786eb5e6-40da-4e0a-81ea-01edc376627f None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:45.356704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-786eb5e6-40da-4e0a-81ea-01edc376627f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:45.451701 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2602/5207] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:28:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:28:45.463595 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46935ac-5aed-40b2-83e1-150d33587d12 service cinder] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:45.544447 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46935ac-5aed-40b2-83e1-150d33587d12 service cinder] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:45.550078 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0838cb-9f05-4c69-9981-412e12878c19 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:45.550740 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0838cb-9f05-4c69-9981-412e12878c19 service swift] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:45.551010 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0838cb-9f05-4c69-9981-412e12878c19 service swift] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:45.551287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0838cb-9f05-4c69-9981-412e12878c19 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:45.559791 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0838cb-9f05-4c69-9981-412e12878c19 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:45.563683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0838cb-9f05-4c69-9981-412e12878c19 service swift] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:45.569494 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2606/5208] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:28:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:28:46.334099 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786eb5e6-40da-4e0a-81ea-01edc376627f None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:46.486482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786eb5e6-40da-4e0a-81ea-01edc376627f None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:46.492404 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e762c3-3e82-4002-b18d-b097b2841774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:46.498486 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e762c3-3e82-4002-b18d-b097b2841774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:46.498871 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e762c3-3e82-4002-b18d-b097b2841774 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:46.499230 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e762c3-3e82-4002-b18d-b097b2841774 admin admin] PATH_INFO: `/v3/users/7da39ddee5ee4dee87e6b2e68b1711b6` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:46.501090 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e762c3-3e82-4002-b18d-b097b2841774 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7da39ddee5ee4dee87e6b2e68b1711b6)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:46.504333 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e762c3-3e82-4002-b18d-b097b2841774 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:46.762253 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a9e762c3-3e82-4002-b18d-b097b2841774 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7da39ddee5ee4dee87e6b2e68b1711b6'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:46.780534 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a9e762c3-3e82-4002-b18d-b097b2841774 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7da39ddee5ee4dee87e6b2e68b1711b6'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:46.867548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a9e762c3-3e82-4002-b18d-b097b2841774 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7da39ddee5ee4dee87e6b2e68b1711b6'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:46.869105 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a9e762c3-3e82-4002-b18d-b097b2841774 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7da39ddee5ee4dee87e6b2e68b1711b6'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:46.889683 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a9e762c3-3e82-4002-b18d-b097b2841774 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7da39ddee5ee4dee87e6b2e68b1711b6'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:46.898382 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2603/5209] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:28:46 2022] DELETE /identity/v3/users/7da39ddee5ee4dee87e6b2e68b1711b6 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:28:46.902843 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab239e0f-b8d0-492e-961e-efa0cba5c8e9 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:46.903352 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab239e0f-b8d0-492e-961e-efa0cba5c8e9 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:46.903450 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab239e0f-b8d0-492e-961e-efa0cba5c8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:46.918030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab2224-ae3d-46cc-969e-ed24e77da3d0 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:46.918527 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab2224-ae3d-46cc-969e-ed24e77da3d0 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:46.918812 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab2224-ae3d-46cc-969e-ed24e77da3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:46.922409 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-ab239e0f-b8d0-492e-961e-efa0cba5c8e9 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:46.923645 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ab239e0f-b8d0-492e-961e-efa0cba5c8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:46.939252 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-30ab2224-ae3d-46cc-969e-ed24e77da3d0 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:46.940751 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-30ab2224-ae3d-46cc-969e-ed24e77da3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:46.992576 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2607/5210] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:28:47.001960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab239e0f-b8d0-492e-961e-efa0cba5c8e9 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:47.008208 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2604/5211] 10.222.0.23 () {58 vars in 967 bytes} [Sat Apr 30 21:28:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:28:47.009044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ab239e0f-b8d0-492e-961e-efa0cba5c8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:47.017963 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab2224-ae3d-46cc-969e-ed24e77da3d0 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:47.019521 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-30ab2224-ae3d-46cc-969e-ed24e77da3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:47.063474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab239e0f-b8d0-492e-961e-efa0cba5c8e9 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:47.067249 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c71f5f-06ec-4e2d-a643-14570705476a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:47.067875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c71f5f-06ec-4e2d-a643-14570705476a service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:47.068156 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c71f5f-06ec-4e2d-a643-14570705476a service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:47.068463 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c71f5f-06ec-4e2d-a643-14570705476a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:47.078586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c71f5f-06ec-4e2d-a643-14570705476a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:47.080226 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c71f5f-06ec-4e2d-a643-14570705476a service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:47.092163 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2608/5212] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:28:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:28:47.094190 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab2224-ae3d-46cc-969e-ed24e77da3d0 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:47.100406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b736209-f483-400a-b8b2-6fff394737d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:47.101139 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b736209-f483-400a-b8b2-6fff394737d4 service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:47.101662 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b736209-f483-400a-b8b2-6fff394737d4 service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:47.102152 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b736209-f483-400a-b8b2-6fff394737d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:47.114867 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b736209-f483-400a-b8b2-6fff394737d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:47.117215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b736209-f483-400a-b8b2-6fff394737d4 service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:47.126181 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2605/5213] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:28:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 30 21:28:47.570988 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c71f5f-06ec-4e2d-a643-14570705476a service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:47.572392 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a8c71f5f-06ec-4e2d-a643-14570705476a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:47.586086 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c71f5f-06ec-4e2d-a643-14570705476a service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:47.595930 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ca0a1-96e7-49e2-b6ad-ceb8ed3ae11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:47.597784 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ca0a1-96e7-49e2-b6ad-ceb8ed3ae11d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:47.598281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ca0a1-96e7-49e2-b6ad-ceb8ed3ae11d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:47.598737 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ca0a1-96e7-49e2-b6ad-ceb8ed3ae11d admin admin] PATH_INFO: `/v3/projects/b44c5988d8ff49798ce2723a03e8df52` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:47.601005 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ca0a1-96e7-49e2-b6ad-ceb8ed3ae11d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b44c5988d8ff49798ce2723a03e8df52)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:47.603739 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ca0a1-96e7-49e2-b6ad-ceb8ed3ae11d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:47.653663 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608d48e-cfbd-41d2-ac1c-0e39b9c3d876 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:47.653663 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608d48e-cfbd-41d2-ac1c-0e39b9c3d876 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:47.653663 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608d48e-cfbd-41d2-ac1c-0e39b9c3d876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:47.684543 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-c608d48e-cfbd-41d2-ac1c-0e39b9c3d876 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:47.685798 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c608d48e-cfbd-41d2-ac1c-0e39b9c3d876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:47.693063 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2606/5214] 10.222.0.23 () {58 vars in 967 bytes} [Sat Apr 30 21:28:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:28:47.707243 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c608d48e-cfbd-41d2-ac1c-0e39b9c3d876 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:47.718061 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-969ca0a1-96e7-49e2-b6ad-ceb8ed3ae11d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b44c5988d8ff49798ce2723a03e8df52', 'request_id': 'req-969ca0a1-96e7-49e2-b6ad-ceb8ed3ae11d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:47.722630 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c608d48e-cfbd-41d2-ac1c-0e39b9c3d876 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:47.724789 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-969ca0a1-96e7-49e2-b6ad-ceb8ed3ae11d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b44c5988d8ff49798ce2723a03e8df52', 'request_id': 'req-969ca0a1-96e7-49e2-b6ad-ceb8ed3ae11d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:47.731633 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-969ca0a1-96e7-49e2-b6ad-ceb8ed3ae11d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b44c5988d8ff49798ce2723a03e8df52', 'request_id': 'req-969ca0a1-96e7-49e2-b6ad-ceb8ed3ae11d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:47.804150 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8048fd93-cd04-4186-ac16-df07b4101751 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:47.804733 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048fd93-cd04-4186-ac16-df07b4101751 service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:47.805016 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048fd93-cd04-4186-ac16-df07b4101751 service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:47.805327 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8048fd93-cd04-4186-ac16-df07b4101751 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:47.825113 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-969ca0a1-96e7-49e2-b6ad-ceb8ed3ae11d admin admin] The token cache is being invalidate because project b44c5988d8ff49798ce2723a03e8df52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:28:47.825788 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-969ca0a1-96e7-49e2-b6ad-ceb8ed3ae11d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:47.827143 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-969ca0a1-96e7-49e2-b6ad-ceb8ed3ae11d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:47.829610 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2609/5215] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:28:47 2022] DELETE /identity/v3/projects/b44c5988d8ff49798ce2723a03e8df52 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:28:47.835463 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ca0a1-96e7-49e2-b6ad-ceb8ed3ae11d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:47.837176 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-969ca0a1-96e7-49e2-b6ad-ceb8ed3ae11d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:47.873708 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8048fd93-cd04-4186-ac16-df07b4101751 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:47.875566 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8048fd93-cd04-4186-ac16-df07b4101751 service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:47.885505 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2607/5216] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:28:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:28:47.910612 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ca0a1-96e7-49e2-b6ad-ceb8ed3ae11d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:47.917328 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d56938f-c9ea-461e-943e-84a4ac03ef77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:47.918867 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56938f-c9ea-461e-943e-84a4ac03ef77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:47.919105 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56938f-c9ea-461e-943e-84a4ac03ef77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:47.919388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56938f-c9ea-461e-943e-84a4ac03ef77 admin admin] PATH_INFO: `/v3/users/3053335e34af4ae9bddfd8fdc91cd78f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:47.920940 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d56938f-c9ea-461e-943e-84a4ac03ef77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3053335e34af4ae9bddfd8fdc91cd78f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:47.923434 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d56938f-c9ea-461e-943e-84a4ac03ef77 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:48.228011 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5d56938f-c9ea-461e-943e-84a4ac03ef77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3053335e34af4ae9bddfd8fdc91cd78f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:48.240792 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5d56938f-c9ea-461e-943e-84a4ac03ef77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3053335e34af4ae9bddfd8fdc91cd78f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:48.312521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5d56938f-c9ea-461e-943e-84a4ac03ef77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3053335e34af4ae9bddfd8fdc91cd78f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:48.323698 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5d56938f-c9ea-461e-943e-84a4ac03ef77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3053335e34af4ae9bddfd8fdc91cd78f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:48.324668 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5d56938f-c9ea-461e-943e-84a4ac03ef77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3053335e34af4ae9bddfd8fdc91cd78f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:48.341408 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2610/5217] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:28:47 2022] DELETE /identity/v3/users/3053335e34af4ae9bddfd8fdc91cd78f => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:28:48.391712 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ab7d1-26ef-4a11-9b2d-d4348da74bd8 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:48.394692 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ab7d1-26ef-4a11-9b2d-d4348da74bd8 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:48.394692 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ab7d1-26ef-4a11-9b2d-d4348da74bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:48.413536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-7b2ab7d1-26ef-4a11-9b2d-d4348da74bd8 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:48.415578 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7b2ab7d1-26ef-4a11-9b2d-d4348da74bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:48.537347 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2608/5218] 10.222.0.23 () {58 vars in 967 bytes} [Sat Apr 30 21:28:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:28:48.551247 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d56938f-c9ea-461e-943e-84a4ac03ef77 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:48.552674 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5d56938f-c9ea-461e-943e-84a4ac03ef77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:48.636387 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d56938f-c9ea-461e-943e-84a4ac03ef77 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:48.641993 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e526c3-c726-4570-8282-a8a13ecde9fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:48.642853 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e526c3-c726-4570-8282-a8a13ecde9fa service swift] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:48.643339 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e526c3-c726-4570-8282-a8a13ecde9fa service swift] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:48.643645 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e526c3-c726-4570-8282-a8a13ecde9fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:48.653004 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e526c3-c726-4570-8282-a8a13ecde9fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:48.654710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e526c3-c726-4570-8282-a8a13ecde9fa service swift] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:48.666700 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2611/5219] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:28:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:28:49.041246 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ab7d1-26ef-4a11-9b2d-d4348da74bd8 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:49.042738 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7b2ab7d1-26ef-4a11-9b2d-d4348da74bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:49.112489 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ab7d1-26ef-4a11-9b2d-d4348da74bd8 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:49.117728 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51bc112-0bdc-4bce-8d0b-6b252a2734cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:49.118496 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bc112-0bdc-4bce-8d0b-6b252a2734cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:49.118777 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bc112-0bdc-4bce-8d0b-6b252a2734cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:49.119054 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bc112-0bdc-4bce-8d0b-6b252a2734cf admin admin] PATH_INFO: `/v3/projects/9cf1cf31241743d4b4bb8ec4379e3f29` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:49.120289 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51bc112-0bdc-4bce-8d0b-6b252a2734cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cf1cf31241743d4b4bb8ec4379e3f29)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:49.122189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51bc112-0bdc-4bce-8d0b-6b252a2734cf admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:49.222322 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bca70a-37bc-439c-8e1a-151c7d1dd0d1 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:49.222805 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bca70a-37bc-439c-8e1a-151c7d1dd0d1 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:49.222907 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bca70a-37bc-439c-8e1a-151c7d1dd0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:49.240345 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-61bca70a-37bc-439c-8e1a-151c7d1dd0d1 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:49.248707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-61bca70a-37bc-439c-8e1a-151c7d1dd0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:49.249488 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2612/5220] 10.222.0.23 () {58 vars in 967 bytes} [Sat Apr 30 21:28:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:28:49.262885 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bca70a-37bc-439c-8e1a-151c7d1dd0d1 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:49.281956 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bca70a-37bc-439c-8e1a-151c7d1dd0d1 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:49.299181 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b51bc112-0bdc-4bce-8d0b-6b252a2734cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cf1cf31241743d4b4bb8ec4379e3f29', 'request_id': 'req-b51bc112-0bdc-4bce-8d0b-6b252a2734cf'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:49.309414 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b51bc112-0bdc-4bce-8d0b-6b252a2734cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cf1cf31241743d4b4bb8ec4379e3f29', 'request_id': 'req-b51bc112-0bdc-4bce-8d0b-6b252a2734cf'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:49.316731 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b51bc112-0bdc-4bce-8d0b-6b252a2734cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cf1cf31241743d4b4bb8ec4379e3f29', 'request_id': 'req-b51bc112-0bdc-4bce-8d0b-6b252a2734cf'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:49.354420 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617f972-ebcb-4f8d-b21a-4dc27c16e1f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:49.355082 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617f972-ebcb-4f8d-b21a-4dc27c16e1f1 service swift] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:49.355370 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617f972-ebcb-4f8d-b21a-4dc27c16e1f1 service swift] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:49.355648 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617f972-ebcb-4f8d-b21a-4dc27c16e1f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:49.418960 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b51bc112-0bdc-4bce-8d0b-6b252a2734cf admin admin] The token cache is being invalidate because project 9cf1cf31241743d4b4bb8ec4379e3f29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:28:49.419305 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b51bc112-0bdc-4bce-8d0b-6b252a2734cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:49.419880 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b51bc112-0bdc-4bce-8d0b-6b252a2734cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:49.424902 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2609/5221] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:28:49 2022] DELETE /identity/v3/projects/9cf1cf31241743d4b4bb8ec4379e3f29 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:28:49.426646 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a229b-8a92-4683-904a-b6c024a814d5 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:49.427143 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617f972-ebcb-4f8d-b21a-4dc27c16e1f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:49.427315 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a229b-8a92-4683-904a-b6c024a814d5 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:49.427619 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a229b-8a92-4683-904a-b6c024a814d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:49.429301 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617f972-ebcb-4f8d-b21a-4dc27c16e1f1 service swift] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:49.445406 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2613/5222] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:28:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 30 21:28:49.455755 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-434a229b-8a92-4683-904a-b6c024a814d5 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:49.457175 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-434a229b-8a92-4683-904a-b6c024a814d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:49.544953 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2610/5223] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:28:49.545410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974cb9b-38f4-40d6-aa45-549e56cd8c56 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:49.545410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974cb9b-38f4-40d6-aa45-549e56cd8c56 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:49.545696 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974cb9b-38f4-40d6-aa45-549e56cd8c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:49.569920 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-0974cb9b-38f4-40d6-aa45-549e56cd8c56 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:49.571534 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0974cb9b-38f4-40d6-aa45-549e56cd8c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:49.604515 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2614/5224] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:28:49.611957 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a229b-8a92-4683-904a-b6c024a814d5 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:49.632951 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a229b-8a92-4683-904a-b6c024a814d5 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:49.639168 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97973fc7-23c8-4b59-8774-ad888afc79eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:49.639857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97973fc7-23c8-4b59-8774-ad888afc79eb admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:49.640146 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97973fc7-23c8-4b59-8774-ad888afc79eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:49.640812 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97973fc7-23c8-4b59-8774-ad888afc79eb admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:49.642603 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97973fc7-23c8-4b59-8774-ad888afc79eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:28:49.642938 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97973fc7-23c8-4b59-8774-ad888afc79eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:49.645082 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97973fc7-23c8-4b59-8774-ad888afc79eb admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:49.682061 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2611/5225] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:28:49.686513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974cb9b-38f4-40d6-aa45-549e56cd8c56 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:49.699319 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974cb9b-38f4-40d6-aa45-549e56cd8c56 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:49.704669 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525e27b-a777-462b-ba54-ef95fee84818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:49.706665 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525e27b-a777-462b-ba54-ef95fee84818 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:49.707051 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525e27b-a777-462b-ba54-ef95fee84818 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:49.707396 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525e27b-a777-462b-ba54-ef95fee84818 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:49.708174 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e525e27b-a777-462b-ba54-ef95fee84818 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:49.710858 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e525e27b-a777-462b-ba54-ef95fee84818 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:49.831920 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2615/5226] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:28:49 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:28:49.836517 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97973fc7-23c8-4b59-8774-ad888afc79eb admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:49.853641 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97973fc7-23c8-4b59-8774-ad888afc79eb admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:49.913620 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c3f82-2c88-44d1-88a1-0db751d0c7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:49.914600 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c3f82-2c88-44d1-88a1-0db751d0c7ac admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:49.914886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c3f82-2c88-44d1-88a1-0db751d0c7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:49.915163 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c3f82-2c88-44d1-88a1-0db751d0c7ac admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:49.915848 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c3f82-2c88-44d1-88a1-0db751d0c7ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:49.917848 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c3f82-2c88-44d1-88a1-0db751d0c7ac admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:50.090533 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f364cf-8b2e-4db6-857a-37db91c348a1 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:50.090821 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f364cf-8b2e-4db6-857a-37db91c348a1 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:50.091102 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f364cf-8b2e-4db6-857a-37db91c348a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:50.104866 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2612/5227] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:28:49 2022] POST /identity/v3/users => generated 293 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:28:50.109464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c3f82-2c88-44d1-88a1-0db751d0c7ac admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:50.124491 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-d6f364cf-8b2e-4db6-857a-37db91c348a1 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:50.125303 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c3f82-2c88-44d1-88a1-0db751d0c7ac admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:50.132163 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d6f364cf-8b2e-4db6-857a-37db91c348a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:50.132320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb7a91-127d-4dcf-849c-b01378bc09b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:50.132320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb7a91-127d-4dcf-849c-b01378bc09b9 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:50.132320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb7a91-127d-4dcf-849c-b01378bc09b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:50.132320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb7a91-127d-4dcf-849c-b01378bc09b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:50.132960 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb7a91-127d-4dcf-849c-b01378bc09b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:50.134703 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb7a91-127d-4dcf-849c-b01378bc09b9 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:50.145424 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2613/5228] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:28:50.149547 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb7a91-127d-4dcf-849c-b01378bc09b9 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:50.164681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb7a91-127d-4dcf-849c-b01378bc09b9 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:50.170791 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9039c404-1f68-411e-bad0-f17be3b73192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:50.175528 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039c404-1f68-411e-bad0-f17be3b73192 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:50.175528 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039c404-1f68-411e-bad0-f17be3b73192 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:50.175528 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039c404-1f68-411e-bad0-f17be3b73192 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:50.175528 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9039c404-1f68-411e-bad0-f17be3b73192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:50.175528 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9039c404-1f68-411e-bad0-f17be3b73192 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:50.189044 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2614/5229] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:28:50.198738 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9039c404-1f68-411e-bad0-f17be3b73192 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:50.211370 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9039c404-1f68-411e-bad0-f17be3b73192 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:50.212550 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2616/5230] 10.222.0.23 () {58 vars in 967 bytes} [Sat Apr 30 21:28:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:28:50.218045 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23d9b1-2ff3-44bc-83f5-4bad3c544cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:50.219061 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23d9b1-2ff3-44bc-83f5-4bad3c544cf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:50.219436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23d9b1-2ff3-44bc-83f5-4bad3c544cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:50.219779 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23d9b1-2ff3-44bc-83f5-4bad3c544cf6 admin admin] PATH_INFO: `/v3/projects/8db42a5e42884bc687a546cb4904ef5d/users/e6c81689d8214c0f85463ad23fbb592f/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:50.221548 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f364cf-8b2e-4db6-857a-37db91c348a1 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:50.223805 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d6f364cf-8b2e-4db6-857a-37db91c348a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:50.247289 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23d9b1-2ff3-44bc-83f5-4bad3c544cf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8db42a5e42884bc687a546cb4904ef5d, user_id=e6c81689d8214c0f85463ad23fbb592f, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:50.249819 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23d9b1-2ff3-44bc-83f5-4bad3c544cf6 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:50.337117 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f364cf-8b2e-4db6-857a-37db91c348a1 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:50.355583 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66401bd5-62a5-4f55-b392-3e120e65fdb1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:50.356235 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66401bd5-62a5-4f55-b392-3e120e65fdb1 service swift] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:50.358314 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66401bd5-62a5-4f55-b392-3e120e65fdb1 service swift] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:50.358314 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66401bd5-62a5-4f55-b392-3e120e65fdb1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:50.365695 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66401bd5-62a5-4f55-b392-3e120e65fdb1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:50.367389 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66401bd5-62a5-4f55-b392-3e120e65fdb1 service swift] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:50.376672 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2617/5231] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:28:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 30 21:28:50.404344 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9670859-5010-4c4d-9923-a49e2346810a None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:50.404344 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9670859-5010-4c4d-9923-a49e2346810a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:50.404344 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9670859-5010-4c4d-9923-a49e2346810a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:50.432755 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2615/5232] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:28:50 2022] PUT /identity/v3/projects/8db42a5e42884bc687a546cb4904ef5d/users/e6c81689d8214c0f85463ad23fbb592f/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:28:50.435633 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-d9670859-5010-4c4d-9923-a49e2346810a None None] MFA Rules not processed for user `1649221dd0a749b0ac9762baa57815fd`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:50.437273 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d9670859-5010-4c4d-9923-a49e2346810a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:50.543790 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9b684-c277-49ce-97a0-d0f2fadc4a20 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:50.558001 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9b684-c277-49ce-97a0-d0f2fadc4a20 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:50.558001 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9b684-c277-49ce-97a0-d0f2fadc4a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:50.558324 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2618/5233] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:28:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:28:50.603553 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-bfc9b684-c277-49ce-97a0-d0f2fadc4a20 None None] MFA Rules not processed for user `e6c81689d8214c0f85463ad23fbb592f`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:50.608916 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-bfc9b684-c277-49ce-97a0-d0f2fadc4a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:50.744800 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9670859-5010-4c4d-9923-a49e2346810a None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:50.746175 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2616/5234] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:28:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:28:50.869370 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9670859-5010-4c4d-9923-a49e2346810a None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:50.874671 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26baa8ba-5ce2-4044-a385-6d773a2d2429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:50.877837 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26baa8ba-5ce2-4044-a385-6d773a2d2429 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:50.877837 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26baa8ba-5ce2-4044-a385-6d773a2d2429 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:50.877837 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26baa8ba-5ce2-4044-a385-6d773a2d2429 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:50.877837 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26baa8ba-5ce2-4044-a385-6d773a2d2429 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:50.879614 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26baa8ba-5ce2-4044-a385-6d773a2d2429 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:50.909588 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2456d8-877e-4eeb-89a0-a2340b6694c8 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:50.912100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2456d8-877e-4eeb-89a0-a2340b6694c8 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:50.912100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2456d8-877e-4eeb-89a0-a2340b6694c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:50.931604 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-ff2456d8-877e-4eeb-89a0-a2340b6694c8 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:50.933238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ff2456d8-877e-4eeb-89a0-a2340b6694c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:50.989256 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2619/5235] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:28:50 2022] POST /identity/v3/projects => generated 387 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:28:50.994812 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26baa8ba-5ce2-4044-a385-6d773a2d2429 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:51.072498 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26baa8ba-5ce2-4044-a385-6d773a2d2429 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:51.075452 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2617/5236] 10.222.0.23 () {58 vars in 967 bytes} [Sat Apr 30 21:28:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:28:51.079385 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a94512-fa61-43a3-b1a3-c37952f94d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:51.080320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a94512-fa61-43a3-b1a3-c37952f94d4f admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:51.080954 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a94512-fa61-43a3-b1a3-c37952f94d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:51.081453 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a94512-fa61-43a3-b1a3-c37952f94d4f admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:51.082483 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a94512-fa61-43a3-b1a3-c37952f94d4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:51.085251 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a94512-fa61-43a3-b1a3-c37952f94d4f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:51.111884 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2456d8-877e-4eeb-89a0-a2340b6694c8 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:51.189874 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2620/5237] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:28:50 2022] POST /identity/v3/users => generated 294 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:28:51.192732 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a94512-fa61-43a3-b1a3-c37952f94d4f admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:51.216622 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a94512-fa61-43a3-b1a3-c37952f94d4f admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:51.229738 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44ecc2-af68-4c0a-aa4e-bcff8c9835cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:51.231140 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44ecc2-af68-4c0a-aa4e-bcff8c9835cc admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:51.233731 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44ecc2-af68-4c0a-aa4e-bcff8c9835cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:51.234313 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44ecc2-af68-4c0a-aa4e-bcff8c9835cc admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:51.235320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44ecc2-af68-4c0a-aa4e-bcff8c9835cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:51.242271 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44ecc2-af68-4c0a-aa4e-bcff8c9835cc admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:51.243301 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2456d8-877e-4eeb-89a0-a2340b6694c8 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:51.269228 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2621/5238] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:28:51.272120 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44ecc2-af68-4c0a-aa4e-bcff8c9835cc admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:51.295764 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44ecc2-af68-4c0a-aa4e-bcff8c9835cc admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:51.308002 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01edc9b-5020-4fa7-abbf-48f76346df54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:51.311624 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01edc9b-5020-4fa7-abbf-48f76346df54 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:51.312428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01edc9b-5020-4fa7-abbf-48f76346df54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:51.314442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01edc9b-5020-4fa7-abbf-48f76346df54 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:51.315782 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01edc9b-5020-4fa7-abbf-48f76346df54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:51.321168 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01edc9b-5020-4fa7-abbf-48f76346df54 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:51.374914 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2622/5239] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:28:51.376202 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01edc9b-5020-4fa7-abbf-48f76346df54 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:51.415502 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01edc9b-5020-4fa7-abbf-48f76346df54 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:51.427773 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb03f0-0052-4c72-8bd6-99207417f707 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:51.435283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb03f0-0052-4c72-8bd6-99207417f707 service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:51.435283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb03f0-0052-4c72-8bd6-99207417f707 service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:51.435283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb03f0-0052-4c72-8bd6-99207417f707 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:51.438627 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385bef9b-7cce-4fec-bb1b-fc650461ac7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:51.442134 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bef9b-7cce-4fec-bb1b-fc650461ac7f admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:51.442656 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bef9b-7cce-4fec-bb1b-fc650461ac7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:51.444855 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bef9b-7cce-4fec-bb1b-fc650461ac7f admin admin] PATH_INFO: `/v3/projects/32326a8ded8845399676cda34c002831/users/8672bf74eacc4b4990241ef6882596d8/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:51.488877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385bef9b-7cce-4fec-bb1b-fc650461ac7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=32326a8ded8845399676cda34c002831, user_id=8672bf74eacc4b4990241ef6882596d8, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:51.496568 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385bef9b-7cce-4fec-bb1b-fc650461ac7f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:51.561716 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fb03f0-0052-4c72-8bd6-99207417f707 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:51.563609 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fb03f0-0052-4c72-8bd6-99207417f707 service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:51.577397 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2618/5240] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:28:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:28:51.590185 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2623/5241] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:28:51 2022] PUT /identity/v3/projects/32326a8ded8845399676cda34c002831/users/8672bf74eacc4b4990241ef6882596d8/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:28:51.609662 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336caf6-f668-4952-9d88-f97321e9e8df None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:51.611326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336caf6-f668-4952-9d88-f97321e9e8df None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:51.611628 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336caf6-f668-4952-9d88-f97321e9e8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:51.648023 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-2336caf6-f668-4952-9d88-f97321e9e8df None None] MFA Rules not processed for user `8672bf74eacc4b4990241ef6882596d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:51.649917 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2336caf6-f668-4952-9d88-f97321e9e8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:51.747271 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385bef9b-7cce-4fec-bb1b-fc650461ac7f admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:51.753870 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2619/5242] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:28:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:28:51.820173 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385bef9b-7cce-4fec-bb1b-fc650461ac7f admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:51.825018 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a11d9-8398-4714-a740-3d7c6904bcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:51.825676 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a11d9-8398-4714-a740-3d7c6904bcbc admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:51.826027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a11d9-8398-4714-a740-3d7c6904bcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:51.826321 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a11d9-8398-4714-a740-3d7c6904bcbc admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:51.827033 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a11d9-8398-4714-a740-3d7c6904bcbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:51.828969 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a11d9-8398-4714-a740-3d7c6904bcbc admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:51.952754 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2624/5243] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:28:51 2022] POST /identity/v3/projects => generated 387 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:28:51.956475 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336caf6-f668-4952-9d88-f97321e9e8df None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:51.974561 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336caf6-f668-4952-9d88-f97321e9e8df None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:52.077510 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf472b0-93a6-4c57-8bd2-96192f7c9c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:52.078320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf472b0-93a6-4c57-8bd2-96192f7c9c37 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:52.078793 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf472b0-93a6-4c57-8bd2-96192f7c9c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:52.079219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf472b0-93a6-4c57-8bd2-96192f7c9c37 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:52.080205 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf472b0-93a6-4c57-8bd2-96192f7c9c37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:52.082727 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf472b0-93a6-4c57-8bd2-96192f7c9c37 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:52.126824 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a11d9-8398-4714-a740-3d7c6904bcbc admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:52.129223 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2d1a11d9-8398-4714-a740-3d7c6904bcbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:52.170145 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a11d9-8398-4714-a740-3d7c6904bcbc admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:52.186862 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986b831-2949-4ca5-a275-9ece321f78dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:52.187765 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986b831-2949-4ca5-a275-9ece321f78dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:52.188048 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986b831-2949-4ca5-a275-9ece321f78dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:52.188317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986b831-2949-4ca5-a275-9ece321f78dd admin admin] PATH_INFO: `/v3/users/159c07d7fdfd40b892edf9d912d0175a` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:52.192223 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2620/5244] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:28:51 2022] POST /identity/v3/users => generated 300 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:28:52.193636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2986b831-2949-4ca5-a275-9ece321f78dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=159c07d7fdfd40b892edf9d912d0175a)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:52.193636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2986b831-2949-4ca5-a275-9ece321f78dd admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:52.194567 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf472b0-93a6-4c57-8bd2-96192f7c9c37 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:52.220534 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf472b0-93a6-4c57-8bd2-96192f7c9c37 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:52.237365 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6165ace-c562-4a2d-94e9-fae39aac961c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:52.238444 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6165ace-c562-4a2d-94e9-fae39aac961c admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:52.238737 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6165ace-c562-4a2d-94e9-fae39aac961c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:52.239094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6165ace-c562-4a2d-94e9-fae39aac961c admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:52.239863 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6165ace-c562-4a2d-94e9-fae39aac961c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:52.241583 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6165ace-c562-4a2d-94e9-fae39aac961c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:52.268047 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2621/5245] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:28:52.274923 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6165ace-c562-4a2d-94e9-fae39aac961c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:52.303958 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6165ace-c562-4a2d-94e9-fae39aac961c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:52.314757 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4dcbed-118a-434f-9f12-ccfb8d5b4a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:52.314757 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4dcbed-118a-434f-9f12-ccfb8d5b4a51 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:52.314757 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4dcbed-118a-434f-9f12-ccfb8d5b4a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:52.314757 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4dcbed-118a-434f-9f12-ccfb8d5b4a51 admin admin] PATH_INFO: `/v3/projects/ac69cc13661a4713bcd4b96684c461b3/users/7a3a063a8fab4af39aed293fef49d42b/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:52.348603 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4dcbed-118a-434f-9f12-ccfb8d5b4a51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac69cc13661a4713bcd4b96684c461b3, user_id=7a3a063a8fab4af39aed293fef49d42b, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:52.354678 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4dcbed-118a-434f-9f12-ccfb8d5b4a51 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:52.427807 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2986b831-2949-4ca5-a275-9ece321f78dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '159c07d7fdfd40b892edf9d912d0175a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:52.442289 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2986b831-2949-4ca5-a275-9ece321f78dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '159c07d7fdfd40b892edf9d912d0175a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:52.477210 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2622/5246] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:28:52 2022] PUT /identity/v3/projects/ac69cc13661a4713bcd4b96684c461b3/users/7a3a063a8fab4af39aed293fef49d42b/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:28:52.481638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4dcbed-118a-434f-9f12-ccfb8d5b4a51 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:52.503014 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2986b831-2949-4ca5-a275-9ece321f78dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '159c07d7fdfd40b892edf9d912d0175a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:52.520648 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2986b831-2949-4ca5-a275-9ece321f78dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '159c07d7fdfd40b892edf9d912d0175a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:52.524238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2986b831-2949-4ca5-a275-9ece321f78dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '159c07d7fdfd40b892edf9d912d0175a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:52.532510 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2625/5247] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:28:52 2022] DELETE /identity/v3/users/159c07d7fdfd40b892edf9d912d0175a => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:28:52.536730 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284ee58-3c41-4e37-91c6-fbf8eb98e644 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:52.537363 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284ee58-3c41-4e37-91c6-fbf8eb98e644 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:52.538511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b284ee58-3c41-4e37-91c6-fbf8eb98e644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:52.582431 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-b284ee58-3c41-4e37-91c6-fbf8eb98e644 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:52.583548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4dcbed-118a-434f-9f12-ccfb8d5b4a51 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:52.587914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b284ee58-3c41-4e37-91c6-fbf8eb98e644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:52.680383 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504c8340-013b-4394-8a5a-3ba8c184de4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:52.681601 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c8340-013b-4394-8a5a-3ba8c184de4b admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:52.681936 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c8340-013b-4394-8a5a-3ba8c184de4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:52.682216 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c8340-013b-4394-8a5a-3ba8c184de4b admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:52.683925 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504c8340-013b-4394-8a5a-3ba8c184de4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:52.687165 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504c8340-013b-4394-8a5a-3ba8c184de4b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:52.700430 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2626/5248] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:28:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:28:52.706276 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2623/5249] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:28:52.707490 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284ee58-3c41-4e37-91c6-fbf8eb98e644 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:52.712852 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b284ee58-3c41-4e37-91c6-fbf8eb98e644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:52.713039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504c8340-013b-4394-8a5a-3ba8c184de4b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:52.718447 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-504c8340-013b-4394-8a5a-3ba8c184de4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:52.728483 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b284ee58-3c41-4e37-91c6-fbf8eb98e644 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:52.735578 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2f618-ee06-4520-b9bf-d15fcab92d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:52.736707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2f618-ee06-4520-b9bf-d15fcab92d8b admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:52.737442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2f618-ee06-4520-b9bf-d15fcab92d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:52.737913 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2f618-ee06-4520-b9bf-d15fcab92d8b admin admin] PATH_INFO: `/v3/projects/ac69cc13661a4713bcd4b96684c461b3/users/7a3a063a8fab4af39aed293fef49d42b/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:52.740397 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2f618-ee06-4520-b9bf-d15fcab92d8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac69cc13661a4713bcd4b96684c461b3, user_id=7a3a063a8fab4af39aed293fef49d42b, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:52.743778 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2f618-ee06-4520-b9bf-d15fcab92d8b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:52.768731 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2627/5250] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:28:52 2022] PUT /identity/v3/projects/ac69cc13661a4713bcd4b96684c461b3/users/7a3a063a8fab4af39aed293fef49d42b/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:28:52.770807 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2993b6-02fd-4c26-9625-24d337918b26 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:52.771245 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2993b6-02fd-4c26-9625-24d337918b26 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:52.771540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2993b6-02fd-4c26-9625-24d337918b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:52.797663 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504c8340-013b-4394-8a5a-3ba8c184de4b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:52.812151 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-6f2993b6-02fd-4c26-9625-24d337918b26 None None] MFA Rules not processed for user `7a3a063a8fab4af39aed293fef49d42b`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:52.813514 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6f2993b6-02fd-4c26-9625-24d337918b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:52.879793 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57cd6cc-7b29-412c-8896-17351c8063c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:52.880750 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57cd6cc-7b29-412c-8896-17351c8063c5 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:52.881034 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57cd6cc-7b29-412c-8896-17351c8063c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:52.881978 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57cd6cc-7b29-412c-8896-17351c8063c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:52.919290 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2628/5251] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:28:52 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:28:52.919408 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8fb77-8fcb-41f5-bffd-0f08051a0d9b None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:52.919832 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8fb77-8fcb-41f5-bffd-0f08051a0d9b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:52.920340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8fb77-8fcb-41f5-bffd-0f08051a0d9b None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:52.921985 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2629/5252] 10.222.0.23 () {54 vars in 963 bytes} [Sat Apr 30 21:28:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 30 21:28:52.930562 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86911b-4255-4fe8-9964-0fc921d201ed None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:52.930956 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86911b-4255-4fe8-9964-0fc921d201ed None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:52.931413 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86911b-4255-4fe8-9964-0fc921d201ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:52.973991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57cd6cc-7b29-412c-8896-17351c8063c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:52.977017 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57cd6cc-7b29-412c-8896-17351c8063c5 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:52.987899 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-2d86911b-4255-4fe8-9964-0fc921d201ed None None] MFA Rules not processed for user `f3dc7765f32c4b00a7e41f2754b9595b`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:52.987899 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2d86911b-4255-4fe8-9964-0fc921d201ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:52.993064 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2624/5253] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:28:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:28:53.057352 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2630/5254] 10.222.0.23 () {58 vars in 1060 bytes} [Sat Apr 30 21:28:52 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:28:53.087474 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57cd6cc-7b29-412c-8896-17351c8063c5 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:53.109323 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57cd6cc-7b29-412c-8896-17351c8063c5 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:53.114641 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bde33c-6a8d-400f-8f64-c85e2f02b006 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:53.115049 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bde33c-6a8d-400f-8f64-c85e2f02b006 service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:53.116331 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bde33c-6a8d-400f-8f64-c85e2f02b006 service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:53.116331 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bde33c-6a8d-400f-8f64-c85e2f02b006 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:53.142228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bde33c-6a8d-400f-8f64-c85e2f02b006 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:53.144284 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bde33c-6a8d-400f-8f64-c85e2f02b006 service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:53.157355 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2625/5255] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:28:53 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:28:53.612055 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86911b-4255-4fe8-9964-0fc921d201ed None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:53.612055 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2d86911b-4255-4fe8-9964-0fc921d201ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:53.625311 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86911b-4255-4fe8-9964-0fc921d201ed None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:53.633280 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2a4265-13d4-4840-85ab-9cb427cedf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:53.634993 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a4265-13d4-4840-85ab-9cb427cedf69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:53.635637 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a4265-13d4-4840-85ab-9cb427cedf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:53.636958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a4265-13d4-4840-85ab-9cb427cedf69 admin admin] PATH_INFO: `/v3/projects/61e815599b8b4d529941388a94c3ae64` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:53.638864 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2a4265-13d4-4840-85ab-9cb427cedf69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61e815599b8b4d529941388a94c3ae64)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:53.641893 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2a4265-13d4-4840-85ab-9cb427cedf69 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:53.792444 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9d2a4265-13d4-4840-85ab-9cb427cedf69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61e815599b8b4d529941388a94c3ae64', 'request_id': 'req-9d2a4265-13d4-4840-85ab-9cb427cedf69'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:53.798339 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9d2a4265-13d4-4840-85ab-9cb427cedf69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61e815599b8b4d529941388a94c3ae64', 'request_id': 'req-9d2a4265-13d4-4840-85ab-9cb427cedf69'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:53.805797 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9d2a4265-13d4-4840-85ab-9cb427cedf69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61e815599b8b4d529941388a94c3ae64', 'request_id': 'req-9d2a4265-13d4-4840-85ab-9cb427cedf69'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:53.963952 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9d2a4265-13d4-4840-85ab-9cb427cedf69 admin admin] The token cache is being invalidate because project 61e815599b8b4d529941388a94c3ae64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:28:53.964185 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9d2a4265-13d4-4840-85ab-9cb427cedf69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:53.964893 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9d2a4265-13d4-4840-85ab-9cb427cedf69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:28:53.966812 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2631/5256] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:28:53 2022] DELETE /identity/v3/projects/61e815599b8b4d529941388a94c3ae64 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:28:53.971768 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e22432-20b4-4303-8b54-f270f5430504 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:53.972295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e22432-20b4-4303-8b54-f270f5430504 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:53.972393 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e22432-20b4-4303-8b54-f270f5430504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:53.991773 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-c3e22432-20b4-4303-8b54-f270f5430504 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:53.993060 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c3e22432-20b4-4303-8b54-f270f5430504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:54.090137 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2626/5257] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:28:54.098058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d67704-ea51-46d9-ad13-f5c67aa441dc None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:54.098359 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d67704-ea51-46d9-ad13-f5c67aa441dc None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:54.104435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d67704-ea51-46d9-ad13-f5c67aa441dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:54.120575 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-47d67704-ea51-46d9-ad13-f5c67aa441dc None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:54.121922 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-47d67704-ea51-46d9-ad13-f5c67aa441dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:54.130183 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2632/5258] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:28:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:28:54.135236 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e22432-20b4-4303-8b54-f270f5430504 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:54.145165 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e22432-20b4-4303-8b54-f270f5430504 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:54.149923 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184f45e-93bb-4ae5-841f-67efca7d3428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:54.150655 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184f45e-93bb-4ae5-841f-67efca7d3428 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:54.150938 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184f45e-93bb-4ae5-841f-67efca7d3428 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:54.151211 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184f45e-93bb-4ae5-841f-67efca7d3428 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:54.151941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184f45e-93bb-4ae5-841f-67efca7d3428 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:28:54.152242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184f45e-93bb-4ae5-841f-67efca7d3428 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:54.153937 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184f45e-93bb-4ae5-841f-67efca7d3428 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:54.166597 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2627/5259] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:28:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:28:54.171382 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d67704-ea51-46d9-ad13-f5c67aa441dc None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:54.185105 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d67704-ea51-46d9-ad13-f5c67aa441dc None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:54.191076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daccda2-d2fa-4af0-8e5e-7bc24bb4b4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:54.191739 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daccda2-d2fa-4af0-8e5e-7bc24bb4b4f1 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:54.192019 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daccda2-d2fa-4af0-8e5e-7bc24bb4b4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:54.192295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daccda2-d2fa-4af0-8e5e-7bc24bb4b4f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:54.192984 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daccda2-d2fa-4af0-8e5e-7bc24bb4b4f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:54.194959 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daccda2-d2fa-4af0-8e5e-7bc24bb4b4f1 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:54.331690 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2633/5260] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:28:54 2022] POST /identity/v3/projects => generated 369 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:28:54.332828 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184f45e-93bb-4ae5-841f-67efca7d3428 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:54.343417 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184f45e-93bb-4ae5-841f-67efca7d3428 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:54.427480 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6be02-bcc4-48a9-b253-53b6c93d154e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:54.428593 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6be02-bcc4-48a9-b253-53b6c93d154e admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:54.428874 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6be02-bcc4-48a9-b253-53b6c93d154e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:54.429181 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6be02-bcc4-48a9-b253-53b6c93d154e admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:54.429992 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb6be02-bcc4-48a9-b253-53b6c93d154e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:54.432008 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb6be02-bcc4-48a9-b253-53b6c93d154e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:54.523593 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2628/5261] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:28:54 2022] POST /identity/v3/users => generated 285 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:28:54.527475 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daccda2-d2fa-4af0-8e5e-7bc24bb4b4f1 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:54.542149 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daccda2-d2fa-4af0-8e5e-7bc24bb4b4f1 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:54.546914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b226c1-6740-4299-bab4-f8619d7a0c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:54.547584 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b226c1-6740-4299-bab4-f8619d7a0c1b admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:54.547866 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b226c1-6740-4299-bab4-f8619d7a0c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:54.548143 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b226c1-6740-4299-bab4-f8619d7a0c1b admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:54.548869 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b226c1-6740-4299-bab4-f8619d7a0c1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:54.550660 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b226c1-6740-4299-bab4-f8619d7a0c1b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:54.565896 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2634/5262] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:28:54.567124 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6be02-bcc4-48a9-b253-53b6c93d154e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:54.590610 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6be02-bcc4-48a9-b253-53b6c93d154e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:54.600005 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d8cd5-be45-4a5f-9bde-c5482151abac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:54.600816 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d8cd5-be45-4a5f-9bde-c5482151abac admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:54.601107 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d8cd5-be45-4a5f-9bde-c5482151abac admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:54.601387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d8cd5-be45-4a5f-9bde-c5482151abac admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:54.602557 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d8cd5-be45-4a5f-9bde-c5482151abac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:54.606162 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d8cd5-be45-4a5f-9bde-c5482151abac admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:54.618703 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2629/5263] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:28:54 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:28:54.624755 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b226c1-6740-4299-bab4-f8619d7a0c1b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:54.638354 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b226c1-6740-4299-bab4-f8619d7a0c1b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:54.644104 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfcf609-5ad1-4820-8cfa-17e14491e060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:54.645483 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfcf609-5ad1-4820-8cfa-17e14491e060 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:54.646059 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfcf609-5ad1-4820-8cfa-17e14491e060 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:54.646643 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfcf609-5ad1-4820-8cfa-17e14491e060 admin admin] PATH_INFO: `/v3/projects/db0dad82f50a41dfae7411e116ff698c/users/79065c47f37c4baeaaeed0e3d665166c/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:54.675457 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfcf609-5ad1-4820-8cfa-17e14491e060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db0dad82f50a41dfae7411e116ff698c, user_id=79065c47f37c4baeaaeed0e3d665166c, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:54.679493 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfcf609-5ad1-4820-8cfa-17e14491e060 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:54.767564 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2635/5264] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:28:54 2022] PUT /identity/v3/projects/db0dad82f50a41dfae7411e116ff698c/users/79065c47f37c4baeaaeed0e3d665166c/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:28:54.779360 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2da02-2cb1-4222-8346-3434535e6e98 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:54.779716 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2da02-2cb1-4222-8346-3434535e6e98 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:54.784267 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2da02-2cb1-4222-8346-3434535e6e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:54.863204 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-07e2da02-2cb1-4222-8346-3434535e6e98 None None] MFA Rules not processed for user `79065c47f37c4baeaaeed0e3d665166c`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:54.866413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-07e2da02-2cb1-4222-8346-3434535e6e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:54.890873 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfcf609-5ad1-4820-8cfa-17e14491e060 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:54.902877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ddfcf609-5ad1-4820-8cfa-17e14491e060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:54.980978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfcf609-5ad1-4820-8cfa-17e14491e060 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:54.985063 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2630/5265] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:28:54 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:28:54.986518 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2da02-2cb1-4222-8346-3434535e6e98 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:54.988277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216e1bf-1fc8-4f9e-808c-728deb199826 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:54.989162 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216e1bf-1fc8-4f9e-808c-728deb199826 service cinder] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:54.989523 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216e1bf-1fc8-4f9e-808c-728deb199826 service cinder] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:54.989899 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216e1bf-1fc8-4f9e-808c-728deb199826 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:54.992018 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5216e1bf-1fc8-4f9e-808c-728deb199826 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:55.091261 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2da02-2cb1-4222-8346-3434535e6e98 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:55.095019 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216e1bf-1fc8-4f9e-808c-728deb199826 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:55.097336 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216e1bf-1fc8-4f9e-808c-728deb199826 service cinder] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:55.102004 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a628e7-1822-4d93-804e-41edc2c4d64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:55.103939 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a628e7-1822-4d93-804e-41edc2c4d64b admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:55.104500 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a628e7-1822-4d93-804e-41edc2c4d64b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:55.106413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a628e7-1822-4d93-804e-41edc2c4d64b admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:55.107152 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a628e7-1822-4d93-804e-41edc2c4d64b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:55.109979 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a628e7-1822-4d93-804e-41edc2c4d64b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:55.112199 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2636/5266] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:28:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:28:55.267783 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2631/5267] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:28:54 2022] POST /identity/v3/projects => generated 369 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:28:55.270995 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216e1bf-1fc8-4f9e-808c-728deb199826 service cinder] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:55.288064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216e1bf-1fc8-4f9e-808c-728deb199826 service cinder] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:55.376402 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220d731-deb9-4a74-993b-520a5d96ba86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:55.377125 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220d731-deb9-4a74-993b-520a5d96ba86 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:55.377410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220d731-deb9-4a74-993b-520a5d96ba86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:55.377680 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220d731-deb9-4a74-993b-520a5d96ba86 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:55.378423 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b220d731-deb9-4a74-993b-520a5d96ba86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:55.380478 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b220d731-deb9-4a74-993b-520a5d96ba86 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:55.479302 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2637/5268] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:28:55 2022] POST /identity/v3/users => generated 285 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:28:55.483382 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a628e7-1822-4d93-804e-41edc2c4d64b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:55.495329 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a628e7-1822-4d93-804e-41edc2c4d64b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:55.501191 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c247118-fa6d-4235-b429-ec211c34fe1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:55.502395 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c247118-fa6d-4235-b429-ec211c34fe1d admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:55.502913 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c247118-fa6d-4235-b429-ec211c34fe1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:55.503389 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c247118-fa6d-4235-b429-ec211c34fe1d admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:55.504619 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c247118-fa6d-4235-b429-ec211c34fe1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:55.507512 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c247118-fa6d-4235-b429-ec211c34fe1d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:55.522275 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2632/5269] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:28:55.526541 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220d731-deb9-4a74-993b-520a5d96ba86 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:55.539053 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220d731-deb9-4a74-993b-520a5d96ba86 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:55.547000 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19b7d7-45c6-4b1d-8070-339ad782ef0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:55.547979 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19b7d7-45c6-4b1d-8070-339ad782ef0c admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:55.548461 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19b7d7-45c6-4b1d-8070-339ad782ef0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:55.548969 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19b7d7-45c6-4b1d-8070-339ad782ef0c admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:55.550027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19b7d7-45c6-4b1d-8070-339ad782ef0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:55.552717 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19b7d7-45c6-4b1d-8070-339ad782ef0c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:55.575859 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2638/5270] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:28:55.576037 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c247118-fa6d-4235-b429-ec211c34fe1d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:55.589029 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c247118-fa6d-4235-b429-ec211c34fe1d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:55.594772 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4020bc66-a123-46c5-b72b-2d356f9746e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:55.595950 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020bc66-a123-46c5-b72b-2d356f9746e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:55.596243 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020bc66-a123-46c5-b72b-2d356f9746e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:55.596527 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020bc66-a123-46c5-b72b-2d356f9746e8 admin admin] PATH_INFO: `/v3/projects/ea5b19419ab04a83b7611184a239b4ab/users/cedbd9ab6e4b4c66b8e2aba24fa71714/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:55.616293 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4020bc66-a123-46c5-b72b-2d356f9746e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea5b19419ab04a83b7611184a239b4ab, user_id=cedbd9ab6e4b4c66b8e2aba24fa71714, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:55.620317 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4020bc66-a123-46c5-b72b-2d356f9746e8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:55.734246 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e76aa-ff5d-40a4-ac92-945311ce4baa None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:55.734727 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e76aa-ff5d-40a4-ac92-945311ce4baa None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:55.734856 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e76aa-ff5d-40a4-ac92-945311ce4baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:55.736855 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2633/5271] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:28:55 2022] PUT /identity/v3/projects/ea5b19419ab04a83b7611184a239b4ab/users/cedbd9ab6e4b4c66b8e2aba24fa71714/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:28:55.802936 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-839e76aa-ff5d-40a4-ac92-945311ce4baa None None] MFA Rules not processed for user `cedbd9ab6e4b4c66b8e2aba24fa71714`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:28:55.805440 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-839e76aa-ff5d-40a4-ac92-945311ce4baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:55.922642 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2639/5272] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:28:55 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:28:55.934220 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4020bc66-a123-46c5-b72b-2d356f9746e8 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:55.936387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4020bc66-a123-46c5-b72b-2d356f9746e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:28:56.063317 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4020bc66-a123-46c5-b72b-2d356f9746e8 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:56.072955 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518e41c-5c1b-4f93-88de-0247992af8b5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e302b1298dd04d6590e3d079f7b13b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:56.073726 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518e41c-5c1b-4f93-88de-0247992af8b5 service glance] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:56.074066 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518e41c-5c1b-4f93-88de-0247992af8b5 service glance] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:56.074348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518e41c-5c1b-4f93-88de-0247992af8b5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:56.163038 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5518e41c-5c1b-4f93-88de-0247992af8b5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:56.164800 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5518e41c-5c1b-4f93-88de-0247992af8b5 service glance] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:56.187417 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2634/5273] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:28:55 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:28:56.579137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e76aa-ff5d-40a4-ac92-945311ce4baa None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:56.593663 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e76aa-ff5d-40a4-ac92-945311ce4baa None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:56.598536 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e8014-7c33-490a-9177-f47988e8d88e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e302b1298dd04d6590e3d079f7b13b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:56.599426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e8014-7c33-490a-9177-f47988e8d88e service glance] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:56.599921 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e8014-7c33-490a-9177-f47988e8d88e service glance] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:56.600361 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e8014-7c33-490a-9177-f47988e8d88e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:56.610691 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e8014-7c33-490a-9177-f47988e8d88e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:56.612437 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e8014-7c33-490a-9177-f47988e8d88e service glance] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:28:56.624261 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2640/5274] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:28:56 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:28:59.776951 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518e41c-5c1b-4f93-88de-0247992af8b5 service glance] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:28:59.839057 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518e41c-5c1b-4f93-88de-0247992af8b5 service glance] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:28:59.843563 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25fef9-8e7f-4e79-b8a3-ededf3eb43a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:28:59.844427 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25fef9-8e7f-4e79-b8a3-ededf3eb43a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:28:59.844712 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25fef9-8e7f-4e79-b8a3-ededf3eb43a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:28:59.844990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25fef9-8e7f-4e79-b8a3-ededf3eb43a3 admin admin] PATH_INFO: `/v3/users/79065c47f37c4baeaaeed0e3d665166c` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:28:59.846187 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25fef9-8e7f-4e79-b8a3-ededf3eb43a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79065c47f37c4baeaaeed0e3d665166c)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:28:59.848129 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25fef9-8e7f-4e79-b8a3-ededf3eb43a3 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:00.059132 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5b25fef9-8e7f-4e79-b8a3-ededf3eb43a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79065c47f37c4baeaaeed0e3d665166c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:00.070731 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5b25fef9-8e7f-4e79-b8a3-ededf3eb43a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79065c47f37c4baeaaeed0e3d665166c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:00.134688 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5b25fef9-8e7f-4e79-b8a3-ededf3eb43a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79065c47f37c4baeaaeed0e3d665166c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:00.135312 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5b25fef9-8e7f-4e79-b8a3-ededf3eb43a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79065c47f37c4baeaaeed0e3d665166c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:00.143757 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5b25fef9-8e7f-4e79-b8a3-ededf3eb43a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79065c47f37c4baeaaeed0e3d665166c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:00.150465 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2635/5275] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:28:59 2022] DELETE /identity/v3/users/79065c47f37c4baeaaeed0e3d665166c => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:29:00.155023 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed0ba9-772a-43a4-8e34-a71b6e8c252f None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:00.155491 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed0ba9-772a-43a4-8e34-a71b6e8c252f None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:00.155628 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bed0ba9-772a-43a4-8e34-a71b6e8c252f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:00.174160 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-4bed0ba9-772a-43a4-8e34-a71b6e8c252f None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:00.175362 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4bed0ba9-772a-43a4-8e34-a71b6e8c252f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:00.235031 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2641/5276] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:29:00.244539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25fef9-8e7f-4e79-b8a3-ededf3eb43a3 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:00.246029 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5b25fef9-8e7f-4e79-b8a3-ededf3eb43a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:00.307312 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25fef9-8e7f-4e79-b8a3-ededf3eb43a3 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:00.311046 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc601ee2-084a-4f2c-b5af-2f2f00e3ed97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:00.311631 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc601ee2-084a-4f2c-b5af-2f2f00e3ed97 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:00.311916 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc601ee2-084a-4f2c-b5af-2f2f00e3ed97 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:00.312195 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc601ee2-084a-4f2c-b5af-2f2f00e3ed97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:00.321206 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc601ee2-084a-4f2c-b5af-2f2f00e3ed97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:00.322782 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc601ee2-084a-4f2c-b5af-2f2f00e3ed97 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:00.332666 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2636/5277] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:29:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:29:00.743489 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bed0ba9-772a-43a4-8e34-a71b6e8c252f None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:00.744966 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4bed0ba9-772a-43a4-8e34-a71b6e8c252f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:00.769053 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bed0ba9-772a-43a4-8e34-a71b6e8c252f None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:00.774910 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c644f-3f3d-4134-b3fb-586e7b310a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:00.775793 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c644f-3f3d-4134-b3fb-586e7b310a7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:00.776071 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c644f-3f3d-4134-b3fb-586e7b310a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:00.776344 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c644f-3f3d-4134-b3fb-586e7b310a7e admin admin] PATH_INFO: `/v3/projects/db0dad82f50a41dfae7411e116ff698c` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:00.777584 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c644f-3f3d-4134-b3fb-586e7b310a7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=db0dad82f50a41dfae7411e116ff698c)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:00.779704 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c644f-3f3d-4134-b3fb-586e7b310a7e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:00.883518 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-765c644f-3f3d-4134-b3fb-586e7b310a7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db0dad82f50a41dfae7411e116ff698c', 'request_id': 'req-765c644f-3f3d-4134-b3fb-586e7b310a7e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:00.888746 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-765c644f-3f3d-4134-b3fb-586e7b310a7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db0dad82f50a41dfae7411e116ff698c', 'request_id': 'req-765c644f-3f3d-4134-b3fb-586e7b310a7e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:00.894931 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-765c644f-3f3d-4134-b3fb-586e7b310a7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db0dad82f50a41dfae7411e116ff698c', 'request_id': 'req-765c644f-3f3d-4134-b3fb-586e7b310a7e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:00.993057 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-765c644f-3f3d-4134-b3fb-586e7b310a7e admin admin] The token cache is being invalidate because project db0dad82f50a41dfae7411e116ff698c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:29:00.993341 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-765c644f-3f3d-4134-b3fb-586e7b310a7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:00.994165 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-765c644f-3f3d-4134-b3fb-586e7b310a7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:00.995833 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2642/5278] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:29:00 2022] DELETE /identity/v3/projects/db0dad82f50a41dfae7411e116ff698c => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:29:00.999763 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc601ee2-084a-4f2c-b5af-2f2f00e3ed97 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:01.009721 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc601ee2-084a-4f2c-b5af-2f2f00e3ed97 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:01.070659 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368617e-1753-4e07-9baa-40b25bad45c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:01.071551 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368617e-1753-4e07-9baa-40b25bad45c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:01.071911 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368617e-1753-4e07-9baa-40b25bad45c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:01.072103 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368617e-1753-4e07-9baa-40b25bad45c8 admin admin] PATH_INFO: `/v3/users/cedbd9ab6e4b4c66b8e2aba24fa71714` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:01.074136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4368617e-1753-4e07-9baa-40b25bad45c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cedbd9ab6e4b4c66b8e2aba24fa71714)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:01.077618 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4368617e-1753-4e07-9baa-40b25bad45c8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:01.319260 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4368617e-1753-4e07-9baa-40b25bad45c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cedbd9ab6e4b4c66b8e2aba24fa71714'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:01.330588 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4368617e-1753-4e07-9baa-40b25bad45c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cedbd9ab6e4b4c66b8e2aba24fa71714'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:01.471801 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4368617e-1753-4e07-9baa-40b25bad45c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cedbd9ab6e4b4c66b8e2aba24fa71714'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:01.472364 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4368617e-1753-4e07-9baa-40b25bad45c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cedbd9ab6e4b4c66b8e2aba24fa71714'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:01.481460 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4368617e-1753-4e07-9baa-40b25bad45c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cedbd9ab6e4b4c66b8e2aba24fa71714'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:01.487339 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2637/5279] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:29:00 2022] DELETE /identity/v3/users/cedbd9ab6e4b4c66b8e2aba24fa71714 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:29:01.921612 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c644f-3f3d-4134-b3fb-586e7b310a7e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:01.923286 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-765c644f-3f3d-4134-b3fb-586e7b310a7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:01.937003 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c644f-3f3d-4134-b3fb-586e7b310a7e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:02.000024 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583fa301-0a05-4985-951c-c2d4e3697911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:02.000815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583fa301-0a05-4985-951c-c2d4e3697911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:02.001102 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583fa301-0a05-4985-951c-c2d4e3697911 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:02.001465 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583fa301-0a05-4985-951c-c2d4e3697911 admin admin] PATH_INFO: `/v3/projects/ea5b19419ab04a83b7611184a239b4ab` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:02.002745 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583fa301-0a05-4985-951c-c2d4e3697911 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea5b19419ab04a83b7611184a239b4ab)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:02.004661 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583fa301-0a05-4985-951c-c2d4e3697911 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:02.143079 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-583fa301-0a05-4985-951c-c2d4e3697911 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea5b19419ab04a83b7611184a239b4ab', 'request_id': 'req-583fa301-0a05-4985-951c-c2d4e3697911'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:02.149123 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-583fa301-0a05-4985-951c-c2d4e3697911 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea5b19419ab04a83b7611184a239b4ab', 'request_id': 'req-583fa301-0a05-4985-951c-c2d4e3697911'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:02.155564 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-583fa301-0a05-4985-951c-c2d4e3697911 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea5b19419ab04a83b7611184a239b4ab', 'request_id': 'req-583fa301-0a05-4985-951c-c2d4e3697911'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:02.232859 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-583fa301-0a05-4985-951c-c2d4e3697911 admin admin] The token cache is being invalidate because project ea5b19419ab04a83b7611184a239b4ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:29:02.233258 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-583fa301-0a05-4985-951c-c2d4e3697911 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:02.234000 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-583fa301-0a05-4985-951c-c2d4e3697911 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:02.235833 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2643/5280] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:29:01 2022] DELETE /identity/v3/projects/ea5b19419ab04a83b7611184a239b4ab => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:29:02.243579 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ef501-121f-422a-ad6d-a18dfcafb208 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:02.243579 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ef501-121f-422a-ad6d-a18dfcafb208 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:02.244031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ef501-121f-422a-ad6d-a18dfcafb208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:02.264165 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-0a2ef501-121f-422a-ad6d-a18dfcafb208 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:02.265363 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0a2ef501-121f-422a-ad6d-a18dfcafb208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:02.338319 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2638/5281] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:29:02.346959 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b648c8e-18b2-4de5-a2e7-07f672ba07a8 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:02.347249 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b648c8e-18b2-4de5-a2e7-07f672ba07a8 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:02.347529 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b648c8e-18b2-4de5-a2e7-07f672ba07a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:02.367030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-2b648c8e-18b2-4de5-a2e7-07f672ba07a8 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:02.368231 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2b648c8e-18b2-4de5-a2e7-07f672ba07a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:02.377493 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2644/5282] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:29:02.381727 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ef501-121f-422a-ad6d-a18dfcafb208 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:02.392472 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ef501-121f-422a-ad6d-a18dfcafb208 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:02.397728 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24029823-9c74-4eb5-a9a6-5cfd8471bc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:02.398426 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24029823-9c74-4eb5-a9a6-5cfd8471bc84 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:02.398709 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24029823-9c74-4eb5-a9a6-5cfd8471bc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:02.398985 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24029823-9c74-4eb5-a9a6-5cfd8471bc84 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:02.399714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24029823-9c74-4eb5-a9a6-5cfd8471bc84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:29:02.400016 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24029823-9c74-4eb5-a9a6-5cfd8471bc84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:02.401630 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24029823-9c74-4eb5-a9a6-5cfd8471bc84 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:02.414531 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2639/5283] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:29:02.419156 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b648c8e-18b2-4de5-a2e7-07f672ba07a8 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:02.428829 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b648c8e-18b2-4de5-a2e7-07f672ba07a8 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:02.434519 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6d304-fb28-4ea7-80d4-613dee1c3ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:02.434785 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6d304-fb28-4ea7-80d4-613dee1c3ac8 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:02.435063 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6d304-fb28-4ea7-80d4-613dee1c3ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:02.435492 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6d304-fb28-4ea7-80d4-613dee1c3ac8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:02.436198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df6d304-fb28-4ea7-80d4-613dee1c3ac8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:02.438155 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df6d304-fb28-4ea7-80d4-613dee1c3ac8 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:02.546321 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2645/5284] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:29:02 2022] POST /identity/v3/projects => generated 363 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:29:02.550493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24029823-9c74-4eb5-a9a6-5cfd8471bc84 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:02.561628 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24029823-9c74-4eb5-a9a6-5cfd8471bc84 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:02.615594 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7913729-c606-4bd1-bc19-38bd6bb238d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:02.616860 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7913729-c606-4bd1-bc19-38bd6bb238d0 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:02.617156 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7913729-c606-4bd1-bc19-38bd6bb238d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:02.617431 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7913729-c606-4bd1-bc19-38bd6bb238d0 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:02.618157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7913729-c606-4bd1-bc19-38bd6bb238d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:02.620074 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7913729-c606-4bd1-bc19-38bd6bb238d0 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:02.779464 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2640/5285] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:29:02 2022] POST /identity/v3/users => generated 282 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:29:02.783875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6d304-fb28-4ea7-80d4-613dee1c3ac8 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:02.796596 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6d304-fb28-4ea7-80d4-613dee1c3ac8 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:02.802708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6b643-8c45-46dd-a4f4-aa0bc5ee0c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:02.803686 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6b643-8c45-46dd-a4f4-aa0bc5ee0c43 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:02.804700 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6b643-8c45-46dd-a4f4-aa0bc5ee0c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:02.805263 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6b643-8c45-46dd-a4f4-aa0bc5ee0c43 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:02.806392 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6b643-8c45-46dd-a4f4-aa0bc5ee0c43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:02.808312 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6b643-8c45-46dd-a4f4-aa0bc5ee0c43 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:02.825985 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2646/5286] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:29:02.831266 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7913729-c606-4bd1-bc19-38bd6bb238d0 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:02.843291 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7913729-c606-4bd1-bc19-38bd6bb238d0 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:02.848634 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8e52a-fc67-4186-afe8-dcbb0392b5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:02.852586 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8e52a-fc67-4186-afe8-dcbb0392b5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:02.852586 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8e52a-fc67-4186-afe8-dcbb0392b5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:02.852586 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8e52a-fc67-4186-afe8-dcbb0392b5e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:02.852586 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8e52a-fc67-4186-afe8-dcbb0392b5e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:02.852586 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8e52a-fc67-4186-afe8-dcbb0392b5e8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:02.862790 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2641/5287] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:29:02.867665 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6b643-8c45-46dd-a4f4-aa0bc5ee0c43 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:02.878318 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6b643-8c45-46dd-a4f4-aa0bc5ee0c43 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:02.884048 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498dd8c7-9067-48f1-a344-4668b3e04893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:02.884934 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498dd8c7-9067-48f1-a344-4668b3e04893 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:02.885220 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498dd8c7-9067-48f1-a344-4668b3e04893 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:02.885548 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498dd8c7-9067-48f1-a344-4668b3e04893 admin admin] PATH_INFO: `/v3/projects/6eaad91b3a7641449094b33569c87334/users/6194171802354feba1ae14fdfe6a55b3/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:02.907220 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498dd8c7-9067-48f1-a344-4668b3e04893 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eaad91b3a7641449094b33569c87334, user_id=6194171802354feba1ae14fdfe6a55b3, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:02.911714 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498dd8c7-9067-48f1-a344-4668b3e04893 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:03.011247 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2647/5288] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:29:02 2022] PUT /identity/v3/projects/6eaad91b3a7641449094b33569c87334/users/6194171802354feba1ae14fdfe6a55b3/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:29:03.016467 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4bf69-d8dd-4c85-901e-43446a86f5e9 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:03.016766 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4bf69-d8dd-4c85-901e-43446a86f5e9 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:03.017219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4bf69-d8dd-4c85-901e-43446a86f5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:03.051202 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-13c4bf69-d8dd-4c85-901e-43446a86f5e9 None None] MFA Rules not processed for user `6194171802354feba1ae14fdfe6a55b3`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:03.052700 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-13c4bf69-d8dd-4c85-901e-43446a86f5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:03.130669 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2642/5289] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:03 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:29:03.143260 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498dd8c7-9067-48f1-a344-4668b3e04893 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:03.144960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-498dd8c7-9067-48f1-a344-4668b3e04893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:03.209602 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498dd8c7-9067-48f1-a344-4668b3e04893 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:03.214395 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d39f9-0290-49cc-b761-37ccdf557332 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e302b1298dd04d6590e3d079f7b13b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:03.215034 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d39f9-0290-49cc-b761-37ccdf557332 service glance] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:03.215316 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d39f9-0290-49cc-b761-37ccdf557332 service glance] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:03.215583 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d39f9-0290-49cc-b761-37ccdf557332 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:03.225006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d39f9-0290-49cc-b761-37ccdf557332 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:03.226532 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d39f9-0290-49cc-b761-37ccdf557332 service glance] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:03.236172 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2648/5290] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:29:03 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:29:04.162393 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4bf69-d8dd-4c85-901e-43446a86f5e9 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:04.252169 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4bf69-d8dd-4c85-901e-43446a86f5e9 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:04.257651 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f4b45-a899-4871-8d2b-3736dd61a446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:04.258571 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f4b45-a899-4871-8d2b-3736dd61a446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:04.258855 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f4b45-a899-4871-8d2b-3736dd61a446 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:04.259132 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f4b45-a899-4871-8d2b-3736dd61a446 admin admin] PATH_INFO: `/v3/users/6194171802354feba1ae14fdfe6a55b3` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:04.260337 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f4b45-a899-4871-8d2b-3736dd61a446 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6194171802354feba1ae14fdfe6a55b3)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:04.262325 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f4b45-a899-4871-8d2b-3736dd61a446 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:04.447767 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-877f4b45-a899-4871-8d2b-3736dd61a446 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6194171802354feba1ae14fdfe6a55b3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:04.462020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-877f4b45-a899-4871-8d2b-3736dd61a446 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6194171802354feba1ae14fdfe6a55b3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:04.554202 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-877f4b45-a899-4871-8d2b-3736dd61a446 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6194171802354feba1ae14fdfe6a55b3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:04.554905 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-877f4b45-a899-4871-8d2b-3736dd61a446 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6194171802354feba1ae14fdfe6a55b3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:04.562301 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-877f4b45-a899-4871-8d2b-3736dd61a446 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6194171802354feba1ae14fdfe6a55b3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:04.568159 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2643/5291] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:29:04 2022] DELETE /identity/v3/users/6194171802354feba1ae14fdfe6a55b3 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:29:04.573417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87773420-3b4f-4fc4-8f82-f19711f363b0 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:04.573987 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87773420-3b4f-4fc4-8f82-f19711f363b0 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:04.573987 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87773420-3b4f-4fc4-8f82-f19711f363b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:04.590887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-87773420-3b4f-4fc4-8f82-f19711f363b0 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:04.592089 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-87773420-3b4f-4fc4-8f82-f19711f363b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:04.650076 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2649/5292] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:29:04.659842 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f4b45-a899-4871-8d2b-3736dd61a446 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:04.661299 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-877f4b45-a899-4871-8d2b-3736dd61a446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:04.720549 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f4b45-a899-4871-8d2b-3736dd61a446 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:04.724224 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a0d393-6a62-4c58-b272-b912da957ad6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:04.725052 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0d393-6a62-4c58-b272-b912da957ad6 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:04.729403 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0d393-6a62-4c58-b272-b912da957ad6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:04.729403 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0d393-6a62-4c58-b272-b912da957ad6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:04.736673 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a0d393-6a62-4c58-b272-b912da957ad6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:04.738217 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a0d393-6a62-4c58-b272-b912da957ad6 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:04.749592 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2644/5293] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:29:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:29:05.217777 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87773420-3b4f-4fc4-8f82-f19711f363b0 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:05.219928 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-87773420-3b4f-4fc4-8f82-f19711f363b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:05.240342 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87773420-3b4f-4fc4-8f82-f19711f363b0 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:05.246987 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00ecc6-e264-45d2-9fec-328a73c54ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:05.248567 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00ecc6-e264-45d2-9fec-328a73c54ea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:05.249706 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00ecc6-e264-45d2-9fec-328a73c54ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:05.250087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00ecc6-e264-45d2-9fec-328a73c54ea7 admin admin] PATH_INFO: `/v3/projects/6eaad91b3a7641449094b33569c87334` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:05.251521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb00ecc6-e264-45d2-9fec-328a73c54ea7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eaad91b3a7641449094b33569c87334)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:05.253403 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb00ecc6-e264-45d2-9fec-328a73c54ea7 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:05.394989 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-fb00ecc6-e264-45d2-9fec-328a73c54ea7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eaad91b3a7641449094b33569c87334', 'request_id': 'req-fb00ecc6-e264-45d2-9fec-328a73c54ea7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:05.402062 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-fb00ecc6-e264-45d2-9fec-328a73c54ea7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eaad91b3a7641449094b33569c87334', 'request_id': 'req-fb00ecc6-e264-45d2-9fec-328a73c54ea7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:05.408412 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-fb00ecc6-e264-45d2-9fec-328a73c54ea7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eaad91b3a7641449094b33569c87334', 'request_id': 'req-fb00ecc6-e264-45d2-9fec-328a73c54ea7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:05.576318 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-fb00ecc6-e264-45d2-9fec-328a73c54ea7 admin admin] The token cache is being invalidate because project 6eaad91b3a7641449094b33569c87334 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:29:05.577039 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-fb00ecc6-e264-45d2-9fec-328a73c54ea7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:05.577316 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-fb00ecc6-e264-45d2-9fec-328a73c54ea7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:05.578884 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2650/5294] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:29:05 2022] DELETE /identity/v3/projects/6eaad91b3a7641449094b33569c87334 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:29:05.584094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ebf36-ea96-4908-9e44-371cb95c5c03 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:05.584568 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ebf36-ea96-4908-9e44-371cb95c5c03 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:05.584712 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ebf36-ea96-4908-9e44-371cb95c5c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:05.602506 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-af0ebf36-ea96-4908-9e44-371cb95c5c03 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:05.603701 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-af0ebf36-ea96-4908-9e44-371cb95c5c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:05.664472 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2645/5295] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:29:05.672274 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6349b-fc61-4385-be3a-647c329a5428 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:05.672566 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6349b-fc61-4385-be3a-647c329a5428 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:05.674506 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6349b-fc61-4385-be3a-647c329a5428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:05.693327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-f9a6349b-fc61-4385-be3a-647c329a5428 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:05.694556 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f9a6349b-fc61-4385-be3a-647c329a5428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:05.702485 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2651/5296] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:29:05.706857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ebf36-ea96-4908-9e44-371cb95c5c03 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:05.716562 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ebf36-ea96-4908-9e44-371cb95c5c03 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:05.722805 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64513733-b78a-4f1c-ab3f-32c02c5fc12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:05.723484 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64513733-b78a-4f1c-ab3f-32c02c5fc12d admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:05.723774 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64513733-b78a-4f1c-ab3f-32c02c5fc12d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:05.724053 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64513733-b78a-4f1c-ab3f-32c02c5fc12d admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:05.724780 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64513733-b78a-4f1c-ab3f-32c02c5fc12d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:29:05.725086 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64513733-b78a-4f1c-ab3f-32c02c5fc12d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:05.727469 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64513733-b78a-4f1c-ab3f-32c02c5fc12d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:05.739610 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2646/5297] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:29:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:29:05.744379 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a6349b-fc61-4385-be3a-647c329a5428 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:05.753848 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a6349b-fc61-4385-be3a-647c329a5428 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:05.760806 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89dfa09-eeea-4b4b-9547-909d29b02a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:05.761607 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89dfa09-eeea-4b4b-9547-909d29b02a4d admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:05.762095 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89dfa09-eeea-4b4b-9547-909d29b02a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:05.762439 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89dfa09-eeea-4b4b-9547-909d29b02a4d admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:05.763999 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89dfa09-eeea-4b4b-9547-909d29b02a4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:05.766107 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89dfa09-eeea-4b4b-9547-909d29b02a4d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:05.876564 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2652/5298] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:29:05 2022] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:29:05.880814 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64513733-b78a-4f1c-ab3f-32c02c5fc12d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:05.892098 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64513733-b78a-4f1c-ab3f-32c02c5fc12d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:05.952004 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3b646-e26a-4893-aa67-7587442bd190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:05.952743 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3b646-e26a-4893-aa67-7587442bd190 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:05.953038 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3b646-e26a-4893-aa67-7587442bd190 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:05.953317 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3b646-e26a-4893-aa67-7587442bd190 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:05.954082 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3b646-e26a-4893-aa67-7587442bd190 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:05.956346 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3b646-e26a-4893-aa67-7587442bd190 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:06.123974 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2647/5299] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:29:05 2022] POST /identity/v3/users => generated 290 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:29:06.128335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89dfa09-eeea-4b4b-9547-909d29b02a4d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:06.147997 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89dfa09-eeea-4b4b-9547-909d29b02a4d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:06.153410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba31102-cfdc-4bda-a38b-ba1354f11dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:06.154218 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba31102-cfdc-4bda-a38b-ba1354f11dca admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:06.154503 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba31102-cfdc-4bda-a38b-ba1354f11dca admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:06.154783 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba31102-cfdc-4bda-a38b-ba1354f11dca admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:06.155521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba31102-cfdc-4bda-a38b-ba1354f11dca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:06.157193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba31102-cfdc-4bda-a38b-ba1354f11dca admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:06.168605 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2653/5300] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:29:06.172694 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3b646-e26a-4893-aa67-7587442bd190 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:06.182958 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3b646-e26a-4893-aa67-7587442bd190 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:06.188211 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6eb6bb-a60b-4fbc-a2a8-de78dbbac840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:06.188877 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6eb6bb-a60b-4fbc-a2a8-de78dbbac840 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:06.189801 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6eb6bb-a60b-4fbc-a2a8-de78dbbac840 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:06.189801 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6eb6bb-a60b-4fbc-a2a8-de78dbbac840 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:06.190212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6eb6bb-a60b-4fbc-a2a8-de78dbbac840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:06.191850 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6eb6bb-a60b-4fbc-a2a8-de78dbbac840 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:06.203409 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2648/5301] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:29:06.207735 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba31102-cfdc-4bda-a38b-ba1354f11dca admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:06.218772 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba31102-cfdc-4bda-a38b-ba1354f11dca admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:06.223372 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf795a64-5ad0-4d3b-a222-f14aa7791f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:06.224253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf795a64-5ad0-4d3b-a222-f14aa7791f8c admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:06.224533 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf795a64-5ad0-4d3b-a222-f14aa7791f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:06.224808 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf795a64-5ad0-4d3b-a222-f14aa7791f8c admin admin] PATH_INFO: `/v3/projects/d97c2e8dffc346fc8d08abcc00006a4d/users/7baefd8117884ab6ad2656262dba4d1f/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:06.240743 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf795a64-5ad0-4d3b-a222-f14aa7791f8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d97c2e8dffc346fc8d08abcc00006a4d, user_id=7baefd8117884ab6ad2656262dba4d1f, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:06.243477 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf795a64-5ad0-4d3b-a222-f14aa7791f8c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:06.441973 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2654/5302] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:29:06 2022] PUT /identity/v3/projects/d97c2e8dffc346fc8d08abcc00006a4d/users/7baefd8117884ab6ad2656262dba4d1f/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:29:06.452481 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4c91e-54ce-4356-b7fe-afcb9e7081cc None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:06.452803 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4c91e-54ce-4356-b7fe-afcb9e7081cc None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:06.453061 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4c91e-54ce-4356-b7fe-afcb9e7081cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:06.485494 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-e8e4c91e-54ce-4356-b7fe-afcb9e7081cc None None] MFA Rules not processed for user `7baefd8117884ab6ad2656262dba4d1f`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:06.486982 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e8e4c91e-54ce-4356-b7fe-afcb9e7081cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:06.589121 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2649/5303] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:29:06.609857 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf795a64-5ad0-4d3b-a222-f14aa7791f8c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:06.613247 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-cf795a64-5ad0-4d3b-a222-f14aa7791f8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:06.699303 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf795a64-5ad0-4d3b-a222-f14aa7791f8c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:06.703849 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1cf57-519e-4c7f-8777-760abf47494b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e302b1298dd04d6590e3d079f7b13b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:06.704521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1cf57-519e-4c7f-8777-760abf47494b service glance] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:06.704803 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1cf57-519e-4c7f-8777-760abf47494b service glance] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:06.705076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1cf57-519e-4c7f-8777-760abf47494b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:06.716038 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd1cf57-519e-4c7f-8777-760abf47494b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:06.717866 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd1cf57-519e-4c7f-8777-760abf47494b service glance] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:06.729667 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2655/5304] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:29:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:29:07.380968 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4c91e-54ce-4356-b7fe-afcb9e7081cc None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:07.452599 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4c91e-54ce-4356-b7fe-afcb9e7081cc None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:07.457117 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa536a1-1544-484c-b56e-18bd170b2957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:07.549566 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa536a1-1544-484c-b56e-18bd170b2957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:07.549566 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa536a1-1544-484c-b56e-18bd170b2957 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:07.549566 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa536a1-1544-484c-b56e-18bd170b2957 admin admin] PATH_INFO: `/v3/users/7baefd8117884ab6ad2656262dba4d1f` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:07.549566 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa536a1-1544-484c-b56e-18bd170b2957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7baefd8117884ab6ad2656262dba4d1f)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:07.549566 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa536a1-1544-484c-b56e-18bd170b2957 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:08.034416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8aa536a1-1544-484c-b56e-18bd170b2957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7baefd8117884ab6ad2656262dba4d1f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:08.047661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8aa536a1-1544-484c-b56e-18bd170b2957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7baefd8117884ab6ad2656262dba4d1f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:08.145548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8aa536a1-1544-484c-b56e-18bd170b2957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7baefd8117884ab6ad2656262dba4d1f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:08.146197 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8aa536a1-1544-484c-b56e-18bd170b2957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7baefd8117884ab6ad2656262dba4d1f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:08.154286 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8aa536a1-1544-484c-b56e-18bd170b2957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7baefd8117884ab6ad2656262dba4d1f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:08.161303 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2650/5305] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:29:07 2022] DELETE /identity/v3/users/7baefd8117884ab6ad2656262dba4d1f => generated 0 bytes in 781 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:29:08.166402 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72567fcb-2a08-4b11-ae84-cb4f70f138cf None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:08.172039 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72567fcb-2a08-4b11-ae84-cb4f70f138cf None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:08.172039 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72567fcb-2a08-4b11-ae84-cb4f70f138cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:08.192603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-72567fcb-2a08-4b11-ae84-cb4f70f138cf None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:08.193858 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-72567fcb-2a08-4b11-ae84-cb4f70f138cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:08.260268 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2656/5306] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:29:08.271608 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa536a1-1544-484c-b56e-18bd170b2957 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:08.275313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8aa536a1-1544-484c-b56e-18bd170b2957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:08.339982 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa536a1-1544-484c-b56e-18bd170b2957 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:08.343715 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891e421-a936-41a4-827c-2315c82d6480 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:08.344372 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891e421-a936-41a4-827c-2315c82d6480 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:08.344850 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891e421-a936-41a4-827c-2315c82d6480 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:08.344975 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891e421-a936-41a4-827c-2315c82d6480 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:08.355151 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891e421-a936-41a4-827c-2315c82d6480 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:08.356594 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891e421-a936-41a4-827c-2315c82d6480 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:08.366412 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2651/5307] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:29:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:29:08.740456 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72567fcb-2a08-4b11-ae84-cb4f70f138cf None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:08.740456 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-72567fcb-2a08-4b11-ae84-cb4f70f138cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:08.840481 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72567fcb-2a08-4b11-ae84-cb4f70f138cf None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:08.850563 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b8212-f998-4903-b597-23310db247cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:08.852218 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b8212-f998-4903-b597-23310db247cb service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:08.852542 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b8212-f998-4903-b597-23310db247cb service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:08.852825 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b8212-f998-4903-b597-23310db247cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:08.858036 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c80b8212-f998-4903-b597-23310db247cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:08.918434 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b8212-f998-4903-b597-23310db247cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:08.919949 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b8212-f998-4903-b597-23310db247cb service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:08.930987 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2657/5308] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:29:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:29:09.002391 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891e421-a936-41a4-827c-2315c82d6480 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:09.004720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7891e421-a936-41a4-827c-2315c82d6480 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:09.035159 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891e421-a936-41a4-827c-2315c82d6480 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:09.043539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f4320-fa5f-4411-86ed-18af06ddfff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:09.045902 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f4320-fa5f-4411-86ed-18af06ddfff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:09.046318 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f4320-fa5f-4411-86ed-18af06ddfff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:09.046783 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f4320-fa5f-4411-86ed-18af06ddfff0 admin admin] PATH_INFO: `/v3/projects/d97c2e8dffc346fc8d08abcc00006a4d` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:09.048232 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f4320-fa5f-4411-86ed-18af06ddfff0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d97c2e8dffc346fc8d08abcc00006a4d)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:09.050252 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f4320-fa5f-4411-86ed-18af06ddfff0 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:09.239627 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8c5f4320-fa5f-4411-86ed-18af06ddfff0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd97c2e8dffc346fc8d08abcc00006a4d', 'request_id': 'req-8c5f4320-fa5f-4411-86ed-18af06ddfff0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:09.250337 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8c5f4320-fa5f-4411-86ed-18af06ddfff0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd97c2e8dffc346fc8d08abcc00006a4d', 'request_id': 'req-8c5f4320-fa5f-4411-86ed-18af06ddfff0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:09.264423 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8c5f4320-fa5f-4411-86ed-18af06ddfff0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd97c2e8dffc346fc8d08abcc00006a4d', 'request_id': 'req-8c5f4320-fa5f-4411-86ed-18af06ddfff0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:09.393305 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8c5f4320-fa5f-4411-86ed-18af06ddfff0 admin admin] The token cache is being invalidate because project d97c2e8dffc346fc8d08abcc00006a4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:29:09.393589 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8c5f4320-fa5f-4411-86ed-18af06ddfff0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:09.394244 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8c5f4320-fa5f-4411-86ed-18af06ddfff0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:09.395810 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2652/5309] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:29:09 2022] DELETE /identity/v3/projects/d97c2e8dffc346fc8d08abcc00006a4d => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:29:09.401804 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48074740-1d42-49d2-8bc7-e9f7dcaa3b9b None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:09.402277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48074740-1d42-49d2-8bc7-e9f7dcaa3b9b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:09.402410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48074740-1d42-49d2-8bc7-e9f7dcaa3b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:09.421561 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-48074740-1d42-49d2-8bc7-e9f7dcaa3b9b None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:09.422717 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-48074740-1d42-49d2-8bc7-e9f7dcaa3b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:09.495434 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2658/5310] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:29:09.504141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf2944-abfa-4397-91af-1265ece98cb4 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:09.504436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf2944-abfa-4397-91af-1265ece98cb4 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:09.506069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf2944-abfa-4397-91af-1265ece98cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:09.525096 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-cdbf2944-abfa-4397-91af-1265ece98cb4 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:09.526342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-cdbf2944-abfa-4397-91af-1265ece98cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:09.536014 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2653/5311] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:29:09.542045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48074740-1d42-49d2-8bc7-e9f7dcaa3b9b None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:09.553994 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48074740-1d42-49d2-8bc7-e9f7dcaa3b9b None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:09.571296 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e7b0e-8960-45f8-ac02-673eca267aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:09.571978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e7b0e-8960-45f8-ac02-673eca267aad admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:09.572264 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e7b0e-8960-45f8-ac02-673eca267aad admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:09.572627 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e7b0e-8960-45f8-ac02-673eca267aad admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:09.573343 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e7b0e-8960-45f8-ac02-673eca267aad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:29:09.573652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e7b0e-8960-45f8-ac02-673eca267aad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:09.575312 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e7b0e-8960-45f8-ac02-673eca267aad admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:09.591022 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2659/5312] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:29:09.594065 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf2944-abfa-4397-91af-1265ece98cb4 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:09.604430 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf2944-abfa-4397-91af-1265ece98cb4 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:09.609573 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0a3d0-16ba-40b1-bda8-3fe2275a644e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:09.612434 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0a3d0-16ba-40b1-bda8-3fe2275a644e admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:09.612434 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0a3d0-16ba-40b1-bda8-3fe2275a644e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:09.612434 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0a3d0-16ba-40b1-bda8-3fe2275a644e admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:09.612434 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c0a3d0-16ba-40b1-bda8-3fe2275a644e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:09.614191 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c0a3d0-16ba-40b1-bda8-3fe2275a644e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:09.735133 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2654/5313] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:29:09 2022] POST /identity/v3/projects => generated 381 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:29:09.737573 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e7b0e-8960-45f8-ac02-673eca267aad admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:09.748280 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e7b0e-8960-45f8-ac02-673eca267aad admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:09.808177 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1e484-f83a-4577-9bd0-ba3a3eee9da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:09.808847 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1e484-f83a-4577-9bd0-ba3a3eee9da7 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:09.809131 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1e484-f83a-4577-9bd0-ba3a3eee9da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:09.809413 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1e484-f83a-4577-9bd0-ba3a3eee9da7 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:09.810149 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1e484-f83a-4577-9bd0-ba3a3eee9da7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:09.812090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1e484-f83a-4577-9bd0-ba3a3eee9da7 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:09.881712 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dd154-3e3e-4823-860d-6be667f57fbd None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:09.882046 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dd154-3e3e-4823-860d-6be667f57fbd None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:09.882384 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dd154-3e3e-4823-860d-6be667f57fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:09.899739 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-964dd154-3e3e-4823-860d-6be667f57fbd None None] MFA Rules not processed for user `20b4082fa07249e2b6dfb9b4506ab398`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:09.900926 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-964dd154-3e3e-4823-860d-6be667f57fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:09.930898 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2660/5314] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:29:09 2022] POST /identity/v3/users => generated 291 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:29:09.931744 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1e484-f83a-4577-9bd0-ba3a3eee9da7 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:09.942289 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1e484-f83a-4577-9bd0-ba3a3eee9da7 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:09.947250 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200b6a9-2d72-44cf-9441-2dc55a1682c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:09.948634 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200b6a9-2d72-44cf-9441-2dc55a1682c0 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:09.948634 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200b6a9-2d72-44cf-9441-2dc55a1682c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:09.948901 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200b6a9-2d72-44cf-9441-2dc55a1682c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:09.949398 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6200b6a9-2d72-44cf-9441-2dc55a1682c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:09.951407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6200b6a9-2d72-44cf-9441-2dc55a1682c0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:09.958095 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2655/5315] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:29:09.963612 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2661/5316] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:29:09.967287 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964dd154-3e3e-4823-860d-6be667f57fbd None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:09.979098 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964dd154-3e3e-4823-860d-6be667f57fbd None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:09.984549 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129fc0f-fc6b-4f73-acf5-066c172e2ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:09.985224 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129fc0f-fc6b-4f73-acf5-066c172e2ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:09.985511 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129fc0f-fc6b-4f73-acf5-066c172e2ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:09.985818 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129fc0f-fc6b-4f73-acf5-066c172e2ce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:09.986548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4129fc0f-fc6b-4f73-acf5-066c172e2ce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:09.988409 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4129fc0f-fc6b-4f73-acf5-066c172e2ce2 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:10.004924 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2656/5317] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:29:10.005204 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200b6a9-2d72-44cf-9441-2dc55a1682c0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:10.018551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200b6a9-2d72-44cf-9441-2dc55a1682c0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:10.033280 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782f946-7bd0-4e81-ace2-af0a383645ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:10.034210 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782f946-7bd0-4e81-ace2-af0a383645ce admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:10.034549 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782f946-7bd0-4e81-ace2-af0a383645ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:10.040488 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782f946-7bd0-4e81-ace2-af0a383645ce admin admin] PATH_INFO: `/v3/projects/36942406614e4c688cd6205c1abe8338/users/b1e2bb9650c348bf9eac1b66e23d38af/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:10.057783 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6782f946-7bd0-4e81-ace2-af0a383645ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=36942406614e4c688cd6205c1abe8338, user_id=b1e2bb9650c348bf9eac1b66e23d38af, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:10.060551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6782f946-7bd0-4e81-ace2-af0a383645ce admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:10.151879 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2662/5318] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:29:10 2022] PUT /identity/v3/projects/36942406614e4c688cd6205c1abe8338/users/b1e2bb9650c348bf9eac1b66e23d38af/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:29:10.162375 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482665c4-4fb1-4972-b529-a9234ee9d88b None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:10.162922 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482665c4-4fb1-4972-b529-a9234ee9d88b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:10.162922 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482665c4-4fb1-4972-b529-a9234ee9d88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:10.196114 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-482665c4-4fb1-4972-b529-a9234ee9d88b None None] MFA Rules not processed for user `b1e2bb9650c348bf9eac1b66e23d38af`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:10.198348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-482665c4-4fb1-4972-b529-a9234ee9d88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:10.269859 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2657/5319] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:29:10.275077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782f946-7bd0-4e81-ace2-af0a383645ce admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:10.351955 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782f946-7bd0-4e81-ace2-af0a383645ce admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:10.356654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd2571-5e5e-435b-a22e-e526989045d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:10.357313 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd2571-5e5e-435b-a22e-e526989045d6 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:10.357596 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd2571-5e5e-435b-a22e-e526989045d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:10.357902 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd2571-5e5e-435b-a22e-e526989045d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:10.358592 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd2571-5e5e-435b-a22e-e526989045d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:10.360502 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd2571-5e5e-435b-a22e-e526989045d6 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:10.449951 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2663/5320] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:29:10 2022] POST /identity/v3/projects => generated 381 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:29:10.450819 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482665c4-4fb1-4972-b529-a9234ee9d88b None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:10.456717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482665c4-4fb1-4972-b529-a9234ee9d88b None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:10.516413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d81fbb-75bf-4ef5-a739-0fbca5529ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:10.518978 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d81fbb-75bf-4ef5-a739-0fbca5529ea8 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:10.518978 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d81fbb-75bf-4ef5-a739-0fbca5529ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:10.518978 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d81fbb-75bf-4ef5-a739-0fbca5529ea8 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:10.518978 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d81fbb-75bf-4ef5-a739-0fbca5529ea8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:10.520343 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d81fbb-75bf-4ef5-a739-0fbca5529ea8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:10.669388 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2658/5321] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:29:10 2022] POST /identity/v3/users => generated 291 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:29:10.683432 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd2571-5e5e-435b-a22e-e526989045d6 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:10.699195 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d81fbb-75bf-4ef5-a739-0fbca5529ea8 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:10.706420 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e3d81fbb-75bf-4ef5-a739-0fbca5529ea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:10.707673 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd2571-5e5e-435b-a22e-e526989045d6 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:10.711396 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17919607-c51f-42bb-a551-04d77879f0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:10.712534 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17919607-c51f-42bb-a551-04d77879f0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:10.713033 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17919607-c51f-42bb-a551-04d77879f0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:10.713551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17919607-c51f-42bb-a551-04d77879f0c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:10.714937 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17919607-c51f-42bb-a551-04d77879f0c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:10.718591 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17919607-c51f-42bb-a551-04d77879f0c4 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:10.735524 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d81fbb-75bf-4ef5-a739-0fbca5529ea8 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:10.743576 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2664/5322] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:29:10.745165 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17919607-c51f-42bb-a551-04d77879f0c4 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:10.748993 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bb6d2a-4b7d-4901-b183-75c461d0b062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:10.753386 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb6d2a-4b7d-4901-b183-75c461d0b062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:10.753386 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb6d2a-4b7d-4901-b183-75c461d0b062 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:10.753386 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb6d2a-4b7d-4901-b183-75c461d0b062 admin admin] PATH_INFO: `/v3/users/9b5bf2d0e148477a9a233d03bd8989dc` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:10.754000 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bb6d2a-4b7d-4901-b183-75c461d0b062 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b5bf2d0e148477a9a233d03bd8989dc)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:10.758610 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17919607-c51f-42bb-a551-04d77879f0c4 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:10.761129 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bb6d2a-4b7d-4901-b183-75c461d0b062 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:10.764329 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab74c8-476c-49f7-b1c1-49aa237e7689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:10.765539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab74c8-476c-49f7-b1c1-49aa237e7689 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:10.766183 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab74c8-476c-49f7-b1c1-49aa237e7689 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:10.766715 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab74c8-476c-49f7-b1c1-49aa237e7689 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:10.767738 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaab74c8-476c-49f7-b1c1-49aa237e7689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:10.770449 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaab74c8-476c-49f7-b1c1-49aa237e7689 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:10.787677 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2665/5323] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:29:10.799082 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab74c8-476c-49f7-b1c1-49aa237e7689 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:10.808936 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab74c8-476c-49f7-b1c1-49aa237e7689 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:10.817546 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aba8d1-55ec-48a2-ac47-19b62eb9c2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:10.819245 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aba8d1-55ec-48a2-ac47-19b62eb9c2cb admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:10.829867 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aba8d1-55ec-48a2-ac47-19b62eb9c2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:10.829867 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aba8d1-55ec-48a2-ac47-19b62eb9c2cb admin admin] PATH_INFO: `/v3/projects/9b4225adba1d4f318a28fac08b48ce02/users/1d056e2636e14bd787271e088695faa1/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:10.854127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aba8d1-55ec-48a2-ac47-19b62eb9c2cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b4225adba1d4f318a28fac08b48ce02, user_id=1d056e2636e14bd787271e088695faa1, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:10.855964 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aba8d1-55ec-48a2-ac47-19b62eb9c2cb admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:10.971755 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2666/5324] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:29:10 2022] PUT /identity/v3/projects/9b4225adba1d4f318a28fac08b48ce02/users/1d056e2636e14bd787271e088695faa1/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:29:10.983261 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65b59d-f217-4d37-afdc-e15bffd605ab None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:10.985110 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65b59d-f217-4d37-afdc-e15bffd605ab None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:10.985110 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65b59d-f217-4d37-afdc-e15bffd605ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:11.026935 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-fe65b59d-f217-4d37-afdc-e15bffd605ab None None] MFA Rules not processed for user `1d056e2636e14bd787271e088695faa1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:11.028686 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-fe65b59d-f217-4d37-afdc-e15bffd605ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:11.097113 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-54bb6d2a-4b7d-4901-b183-75c461d0b062 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b5bf2d0e148477a9a233d03bd8989dc'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:11.133284 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-54bb6d2a-4b7d-4901-b183-75c461d0b062 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b5bf2d0e148477a9a233d03bd8989dc'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:11.152721 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2667/5325] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:29:11.158507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65b59d-f217-4d37-afdc-e15bffd605ab None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:11.249317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65b59d-f217-4d37-afdc-e15bffd605ab None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:11.254558 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e1a12-c8e4-4c25-90c8-8d6b2dbfe745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:11.255217 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e1a12-c8e4-4c25-90c8-8d6b2dbfe745 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:11.255607 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e1a12-c8e4-4c25-90c8-8d6b2dbfe745 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:11.255940 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e1a12-c8e4-4c25-90c8-8d6b2dbfe745 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:11.256615 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e1a12-c8e4-4c25-90c8-8d6b2dbfe745 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:11.259276 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e1a12-c8e4-4c25-90c8-8d6b2dbfe745 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:11.295724 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-54bb6d2a-4b7d-4901-b183-75c461d0b062 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b5bf2d0e148477a9a233d03bd8989dc'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:11.299054 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-54bb6d2a-4b7d-4901-b183-75c461d0b062 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b5bf2d0e148477a9a233d03bd8989dc'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:11.307749 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-54bb6d2a-4b7d-4901-b183-75c461d0b062 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b5bf2d0e148477a9a233d03bd8989dc'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:11.314953 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2659/5326] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:29:10 2022] DELETE /identity/v3/users/9b5bf2d0e148477a9a233d03bd8989dc => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:29:11.319444 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b992f2d-7925-47fe-96cf-0794cd9ad360 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:11.321877 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b992f2d-7925-47fe-96cf-0794cd9ad360 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:11.321877 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b992f2d-7925-47fe-96cf-0794cd9ad360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:11.339257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-5b992f2d-7925-47fe-96cf-0794cd9ad360 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:11.342854 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5b992f2d-7925-47fe-96cf-0794cd9ad360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:11.409837 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2660/5327] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:29:11.451315 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b992f2d-7925-47fe-96cf-0794cd9ad360 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:11.454559 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5b992f2d-7925-47fe-96cf-0794cd9ad360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:11.503981 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2668/5328] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:29:11 2022] POST /identity/v3/projects => generated 383 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:29:11.505845 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e1a12-c8e4-4c25-90c8-8d6b2dbfe745 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:11.512002 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a23e1a12-c8e4-4c25-90c8-8d6b2dbfe745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:11.642801 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b992f2d-7925-47fe-96cf-0794cd9ad360 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:11.650869 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e1a12-c8e4-4c25-90c8-8d6b2dbfe745 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:11.680756 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ebd3e-ffc4-46ae-a1cf-b5b9bc0c9259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:11.681953 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ebd3e-ffc4-46ae-a1cf-b5b9bc0c9259 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:11.683167 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ebd3e-ffc4-46ae-a1cf-b5b9bc0c9259 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:11.685186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ebd3e-ffc4-46ae-a1cf-b5b9bc0c9259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:11.732569 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96b561-b9d9-4547-92cf-0e26655de2df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:11.733438 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96b561-b9d9-4547-92cf-0e26655de2df service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:11.733736 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96b561-b9d9-4547-92cf-0e26655de2df service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:11.734074 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96b561-b9d9-4547-92cf-0e26655de2df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:11.736130 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ef96b561-b9d9-4547-92cf-0e26655de2df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:11.814030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654ebd3e-ffc4-46ae-a1cf-b5b9bc0c9259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:11.816168 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654ebd3e-ffc4-46ae-a1cf-b5b9bc0c9259 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:11.854060 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2669/5329] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:29:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:29:11.855694 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ebd3e-ffc4-46ae-a1cf-b5b9bc0c9259 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:11.857738 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-654ebd3e-ffc4-46ae-a1cf-b5b9bc0c9259 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:11.874443 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ebd3e-ffc4-46ae-a1cf-b5b9bc0c9259 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:11.880230 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c85453-c7bf-4d4e-b4f3-536bd405cf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:11.880990 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c85453-c7bf-4d4e-b4f3-536bd405cf07 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:11.881276 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c85453-c7bf-4d4e-b4f3-536bd405cf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:11.881613 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c85453-c7bf-4d4e-b4f3-536bd405cf07 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:11.882957 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c85453-c7bf-4d4e-b4f3-536bd405cf07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:11.885500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c85453-c7bf-4d4e-b4f3-536bd405cf07 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:11.907938 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef96b561-b9d9-4547-92cf-0e26655de2df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:11.909941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef96b561-b9d9-4547-92cf-0e26655de2df service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:11.922169 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2661/5330] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:29:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:29:11.980633 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2670/5331] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:29:11 2022] POST /identity/v3/users => generated 298 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:29:11.990778 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96b561-b9d9-4547-92cf-0e26655de2df service cinder] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:12.002406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96b561-b9d9-4547-92cf-0e26655de2df service cinder] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:12.008980 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de8a7d-db8c-4fb5-8865-fd3f810af023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:12.010017 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de8a7d-db8c-4fb5-8865-fd3f810af023 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:12.010431 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de8a7d-db8c-4fb5-8865-fd3f810af023 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:12.010833 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de8a7d-db8c-4fb5-8865-fd3f810af023 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:12.011845 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de8a7d-db8c-4fb5-8865-fd3f810af023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:12.013709 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de8a7d-db8c-4fb5-8865-fd3f810af023 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:12.025377 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2662/5332] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:29:12.030776 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c85453-c7bf-4d4e-b4f3-536bd405cf07 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:12.045263 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c85453-c7bf-4d4e-b4f3-536bd405cf07 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:12.050364 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deaa710-94b3-4f5a-9b73-5c1191372064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:12.051279 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deaa710-94b3-4f5a-9b73-5c1191372064 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:12.051561 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deaa710-94b3-4f5a-9b73-5c1191372064 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:12.051837 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deaa710-94b3-4f5a-9b73-5c1191372064 admin admin] PATH_INFO: `/v3/projects/e3ed5ca1b9e944a1b02c3850b005be33/users/1098520db7804fa6b10fae09108aae75/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:12.070653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deaa710-94b3-4f5a-9b73-5c1191372064 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3ed5ca1b9e944a1b02c3850b005be33, user_id=1098520db7804fa6b10fae09108aae75, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:12.075063 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deaa710-94b3-4f5a-9b73-5c1191372064 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:12.241183 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2671/5333] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:29:12 2022] PUT /identity/v3/projects/e3ed5ca1b9e944a1b02c3850b005be33/users/1098520db7804fa6b10fae09108aae75/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:29:12.245363 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de8a7d-db8c-4fb5-8865-fd3f810af023 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:12.256222 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de8a7d-db8c-4fb5-8865-fd3f810af023 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:12.333274 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deaa710-94b3-4f5a-9b73-5c1191372064 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:12.334650 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9deaa710-94b3-4f5a-9b73-5c1191372064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:12.347185 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfc814-33a0-4395-b8e5-f652aaccbfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:12.348592 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfc814-33a0-4395-b8e5-f652aaccbfc4 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:12.351494 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfc814-33a0-4395-b8e5-f652aaccbfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:12.351494 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfc814-33a0-4395-b8e5-f652aaccbfc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:12.351494 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbfc814-33a0-4395-b8e5-f652aaccbfc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:12.352388 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbfc814-33a0-4395-b8e5-f652aaccbfc4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:12.364366 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2663/5334] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:29:12.368366 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfc814-33a0-4395-b8e5-f652aaccbfc4 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:12.378696 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfc814-33a0-4395-b8e5-f652aaccbfc4 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:12.385472 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d6c68-dfc8-43ea-9e56-0927e6b283f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:12.386393 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d6c68-dfc8-43ea-9e56-0927e6b283f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:12.386676 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d6c68-dfc8-43ea-9e56-0927e6b283f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:12.386954 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d6c68-dfc8-43ea-9e56-0927e6b283f7 admin admin] PATH_INFO: `/v3/projects/e3ed5ca1b9e944a1b02c3850b005be33/users/1098520db7804fa6b10fae09108aae75/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:12.389065 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d6c68-dfc8-43ea-9e56-0927e6b283f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3ed5ca1b9e944a1b02c3850b005be33, user_id=1098520db7804fa6b10fae09108aae75, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:12.391764 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d6c68-dfc8-43ea-9e56-0927e6b283f7 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:12.403876 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2664/5335] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:29:12 2022] PUT /identity/v3/projects/e3ed5ca1b9e944a1b02c3850b005be33/users/1098520db7804fa6b10fae09108aae75/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:29:12.415539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe84ddb-5182-468c-a791-06e852754d89 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:12.415830 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe84ddb-5182-468c-a791-06e852754d89 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:12.416110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe84ddb-5182-468c-a791-06e852754d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:12.421342 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deaa710-94b3-4f5a-9b73-5c1191372064 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:12.444535 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-cbe84ddb-5182-468c-a791-06e852754d89 None None] MFA Rules not processed for user `1098520db7804fa6b10fae09108aae75`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:12.446691 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-cbe84ddb-5182-468c-a791-06e852754d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:12.492396 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bfaeca-6cdf-4d8a-9b5a-6949e7d60563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:12.493176 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfaeca-6cdf-4d8a-9b5a-6949e7d60563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:12.493462 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfaeca-6cdf-4d8a-9b5a-6949e7d60563 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:12.493738 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfaeca-6cdf-4d8a-9b5a-6949e7d60563 admin admin] PATH_INFO: `/v3/projects/cdf6569dac6e40749091f906a707d7a1` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:12.495023 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bfaeca-6cdf-4d8a-9b5a-6949e7d60563 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdf6569dac6e40749091f906a707d7a1)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:12.496925 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bfaeca-6cdf-4d8a-9b5a-6949e7d60563 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:12.524527 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2665/5336] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:29:12.534989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe84ddb-5182-468c-a791-06e852754d89 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:12.536442 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-cbe84ddb-5182-468c-a791-06e852754d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:12.597176 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe84ddb-5182-468c-a791-06e852754d89 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:12.608790 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-80bfaeca-6cdf-4d8a-9b5a-6949e7d60563 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdf6569dac6e40749091f906a707d7a1', 'request_id': 'req-80bfaeca-6cdf-4d8a-9b5a-6949e7d60563'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:12.616343 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-80bfaeca-6cdf-4d8a-9b5a-6949e7d60563 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdf6569dac6e40749091f906a707d7a1', 'request_id': 'req-80bfaeca-6cdf-4d8a-9b5a-6949e7d60563'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:12.623855 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-80bfaeca-6cdf-4d8a-9b5a-6949e7d60563 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdf6569dac6e40749091f906a707d7a1', 'request_id': 'req-80bfaeca-6cdf-4d8a-9b5a-6949e7d60563'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:12.652551 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73535774-9196-4cd3-bc4b-e657a7b79e81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:12.653338 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73535774-9196-4cd3-bc4b-e657a7b79e81 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:12.653727 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73535774-9196-4cd3-bc4b-e657a7b79e81 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:12.654157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73535774-9196-4cd3-bc4b-e657a7b79e81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:12.657085 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-73535774-9196-4cd3-bc4b-e657a7b79e81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:12.700477 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-80bfaeca-6cdf-4d8a-9b5a-6949e7d60563 admin admin] The token cache is being invalidate because project cdf6569dac6e40749091f906a707d7a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:29:12.700964 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-80bfaeca-6cdf-4d8a-9b5a-6949e7d60563 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:12.701766 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-80bfaeca-6cdf-4d8a-9b5a-6949e7d60563 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:12.703569 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2672/5337] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:29:12 2022] DELETE /identity/v3/projects/cdf6569dac6e40749091f906a707d7a1 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:29:12.708444 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad414897-d811-4764-81b4-198a79e7d8fd None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:12.708735 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad414897-d811-4764-81b4-198a79e7d8fd None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:12.709009 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad414897-d811-4764-81b4-198a79e7d8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:12.728647 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-ad414897-d811-4764-81b4-198a79e7d8fd None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:12.731216 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ad414897-d811-4764-81b4-198a79e7d8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:12.734303 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73535774-9196-4cd3-bc4b-e657a7b79e81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:12.735767 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73535774-9196-4cd3-bc4b-e657a7b79e81 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:12.745114 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2666/5338] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:29:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:29:12.810430 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2673/5339] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:29:12.818303 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef991c73-9779-499a-a2d8-da338edbb3dc None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:12.818568 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef991c73-9779-499a-a2d8-da338edbb3dc None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:12.818892 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef991c73-9779-499a-a2d8-da338edbb3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:12.837618 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-ef991c73-9779-499a-a2d8-da338edbb3dc None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:12.842452 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ef991c73-9779-499a-a2d8-da338edbb3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:12.850924 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2667/5340] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:29:12.855760 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad414897-d811-4764-81b4-198a79e7d8fd None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:12.865973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad414897-d811-4764-81b4-198a79e7d8fd None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:12.872686 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ab9fc-113c-4f79-a5c8-6a07c9b0f317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:12.874457 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ab9fc-113c-4f79-a5c8-6a07c9b0f317 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:12.874457 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ab9fc-113c-4f79-a5c8-6a07c9b0f317 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:12.874457 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ab9fc-113c-4f79-a5c8-6a07c9b0f317 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:12.875111 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ab9fc-113c-4f79-a5c8-6a07c9b0f317 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:29:12.875317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ab9fc-113c-4f79-a5c8-6a07c9b0f317 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:12.877086 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ab9fc-113c-4f79-a5c8-6a07c9b0f317 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:12.890583 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2674/5341] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:29:12.896652 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef991c73-9779-499a-a2d8-da338edbb3dc None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:12.907300 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef991c73-9779-499a-a2d8-da338edbb3dc None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:12.912431 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd5068-5d65-48ba-9948-5863d390a00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:12.913116 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd5068-5d65-48ba-9948-5863d390a00b admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:12.913474 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd5068-5d65-48ba-9948-5863d390a00b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:12.914536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd5068-5d65-48ba-9948-5863d390a00b admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:12.914775 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd5068-5d65-48ba-9948-5863d390a00b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:12.917066 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd5068-5d65-48ba-9948-5863d390a00b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:13.033826 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2668/5342] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:29:12 2022] POST /identity/v3/projects => generated 381 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:29:13.038134 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ab9fc-113c-4f79-a5c8-6a07c9b0f317 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:13.049056 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ab9fc-113c-4f79-a5c8-6a07c9b0f317 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:13.110835 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09c05e-cd81-4890-bb22-727f08710ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:13.111509 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09c05e-cd81-4890-bb22-727f08710ca4 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:13.111839 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09c05e-cd81-4890-bb22-727f08710ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:13.112117 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09c05e-cd81-4890-bb22-727f08710ca4 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:13.112807 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c09c05e-cd81-4890-bb22-727f08710ca4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:13.114770 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c09c05e-cd81-4890-bb22-727f08710ca4 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:13.237846 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2675/5343] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:29:13 2022] POST /identity/v3/users => generated 291 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:29:13.242985 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd5068-5d65-48ba-9948-5863d390a00b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:13.253200 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd5068-5d65-48ba-9948-5863d390a00b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:13.258856 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2762794-5950-4833-8446-7f5b029ac0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:13.259518 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2762794-5950-4833-8446-7f5b029ac0e3 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:13.259797 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2762794-5950-4833-8446-7f5b029ac0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:13.260251 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2762794-5950-4833-8446-7f5b029ac0e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:13.260994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2762794-5950-4833-8446-7f5b029ac0e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:13.262693 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2762794-5950-4833-8446-7f5b029ac0e3 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:13.293811 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2669/5344] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:29:13.295561 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09c05e-cd81-4890-bb22-727f08710ca4 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:13.307733 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09c05e-cd81-4890-bb22-727f08710ca4 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:13.314824 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceab1c4-42c3-4ab3-b2d1-0a388dc6523e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:13.314824 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceab1c4-42c3-4ab3-b2d1-0a388dc6523e admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:13.314824 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceab1c4-42c3-4ab3-b2d1-0a388dc6523e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:13.315155 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceab1c4-42c3-4ab3-b2d1-0a388dc6523e admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:13.315786 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceab1c4-42c3-4ab3-b2d1-0a388dc6523e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:13.317428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceab1c4-42c3-4ab3-b2d1-0a388dc6523e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:13.334090 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2676/5345] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:29:13.337662 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2762794-5950-4833-8446-7f5b029ac0e3 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:13.347845 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2762794-5950-4833-8446-7f5b029ac0e3 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:13.353149 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8526341-af48-4ec1-8445-b3100d92f73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:13.354237 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8526341-af48-4ec1-8445-b3100d92f73e admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:13.354519 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8526341-af48-4ec1-8445-b3100d92f73e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:13.354809 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8526341-af48-4ec1-8445-b3100d92f73e admin admin] PATH_INFO: `/v3/projects/3383c2433214484eb41e99aacb653b80/users/baf1d13615bc491ab98d2a644e681c12/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:13.371213 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8526341-af48-4ec1-8445-b3100d92f73e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3383c2433214484eb41e99aacb653b80, user_id=baf1d13615bc491ab98d2a644e681c12, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:13.379619 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8526341-af48-4ec1-8445-b3100d92f73e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:13.583809 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2670/5346] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:29:13 2022] PUT /identity/v3/projects/3383c2433214484eb41e99aacb653b80/users/baf1d13615bc491ab98d2a644e681c12/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:29:13.589379 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9497473-a75e-429d-8888-6b17bac8b623 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:13.589670 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9497473-a75e-429d-8888-6b17bac8b623 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:13.589981 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9497473-a75e-429d-8888-6b17bac8b623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:13.611957 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-b9497473-a75e-429d-8888-6b17bac8b623 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:13.614499 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b9497473-a75e-429d-8888-6b17bac8b623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:13.713244 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2677/5347] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:29:13.723583 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8526341-af48-4ec1-8445-b3100d92f73e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:13.725597 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f8526341-af48-4ec1-8445-b3100d92f73e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:13.813890 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8526341-af48-4ec1-8445-b3100d92f73e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:13.817733 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389d2d2-01ca-4953-8a78-416abd1119a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:13.818662 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389d2d2-01ca-4953-8a78-416abd1119a7 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:13.818953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389d2d2-01ca-4953-8a78-416abd1119a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:13.819340 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389d2d2-01ca-4953-8a78-416abd1119a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:13.832302 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9389d2d2-01ca-4953-8a78-416abd1119a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:13.834075 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9389d2d2-01ca-4953-8a78-416abd1119a7 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:13.848100 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2671/5348] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:29:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:29:14.417413 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9497473-a75e-429d-8888-6b17bac8b623 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:14.419161 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b9497473-a75e-429d-8888-6b17bac8b623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:14.442522 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9497473-a75e-429d-8888-6b17bac8b623 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:14.450189 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531322fa-2af9-4648-918d-a8ba6d443389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:14.451165 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531322fa-2af9-4648-918d-a8ba6d443389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:14.451514 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531322fa-2af9-4648-918d-a8ba6d443389 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:14.451858 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531322fa-2af9-4648-918d-a8ba6d443389 admin admin] PATH_INFO: `/v3/users/1649221dd0a749b0ac9762baa57815fd` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:14.453130 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531322fa-2af9-4648-918d-a8ba6d443389 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1649221dd0a749b0ac9762baa57815fd)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:14.455326 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531322fa-2af9-4648-918d-a8ba6d443389 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:14.634358 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-531322fa-2af9-4648-918d-a8ba6d443389 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1649221dd0a749b0ac9762baa57815fd'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:14.646397 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-531322fa-2af9-4648-918d-a8ba6d443389 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1649221dd0a749b0ac9762baa57815fd'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:14.741543 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-531322fa-2af9-4648-918d-a8ba6d443389 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1649221dd0a749b0ac9762baa57815fd'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:14.755308 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-531322fa-2af9-4648-918d-a8ba6d443389 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1649221dd0a749b0ac9762baa57815fd'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:14.758152 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-531322fa-2af9-4648-918d-a8ba6d443389 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1649221dd0a749b0ac9762baa57815fd'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:14.771541 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2678/5349] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:29:14 2022] DELETE /identity/v3/users/1649221dd0a749b0ac9762baa57815fd => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:29:15.335466 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389d2d2-01ca-4953-8a78-416abd1119a7 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:15.348036 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389d2d2-01ca-4953-8a78-416abd1119a7 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:15.428944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e64c19-ff14-4f9d-99f6-179e15c702e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:15.428944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e64c19-ff14-4f9d-99f6-179e15c702e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:15.428944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e64c19-ff14-4f9d-99f6-179e15c702e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:15.428944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e64c19-ff14-4f9d-99f6-179e15c702e0 admin admin] PATH_INFO: `/v3/projects/a036fe856ad94ef98ff000ee43a9b599` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:15.429534 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e64c19-ff14-4f9d-99f6-179e15c702e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a036fe856ad94ef98ff000ee43a9b599)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:15.430255 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e64c19-ff14-4f9d-99f6-179e15c702e0 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:15.547958 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-80e64c19-ff14-4f9d-99f6-179e15c702e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a036fe856ad94ef98ff000ee43a9b599', 'request_id': 'req-80e64c19-ff14-4f9d-99f6-179e15c702e0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:15.554604 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-80e64c19-ff14-4f9d-99f6-179e15c702e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a036fe856ad94ef98ff000ee43a9b599', 'request_id': 'req-80e64c19-ff14-4f9d-99f6-179e15c702e0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:15.560938 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-80e64c19-ff14-4f9d-99f6-179e15c702e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a036fe856ad94ef98ff000ee43a9b599', 'request_id': 'req-80e64c19-ff14-4f9d-99f6-179e15c702e0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:15.686821 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-80e64c19-ff14-4f9d-99f6-179e15c702e0 admin admin] The token cache is being invalidate because project a036fe856ad94ef98ff000ee43a9b599 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:29:15.687212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-80e64c19-ff14-4f9d-99f6-179e15c702e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:15.688056 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-80e64c19-ff14-4f9d-99f6-179e15c702e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:15.689916 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2672/5350] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:29:15 2022] DELETE /identity/v3/projects/a036fe856ad94ef98ff000ee43a9b599 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:29:15.695190 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625bf99-469b-455f-ac19-c680d7c37de1 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:15.695709 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625bf99-469b-455f-ac19-c680d7c37de1 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:15.695842 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625bf99-469b-455f-ac19-c680d7c37de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:15.728438 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee4da6-03cf-412a-8bd0-dea279a5b4bd None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:15.728982 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee4da6-03cf-412a-8bd0-dea279a5b4bd None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:15.729434 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee4da6-03cf-412a-8bd0-dea279a5b4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:15.742045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-5625bf99-469b-455f-ac19-c680d7c37de1 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:15.747208 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5625bf99-469b-455f-ac19-c680d7c37de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:15.785919 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-d0ee4da6-03cf-412a-8bd0-dea279a5b4bd None None] MFA Rules not processed for user `baf1d13615bc491ab98d2a644e681c12`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:15.787426 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d0ee4da6-03cf-412a-8bd0-dea279a5b4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:15.938385 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2679/5351] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:29:15.946900 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6b139-dfd2-48fa-baf5-04fc7a6ec880 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:15.947283 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6b139-dfd2-48fa-baf5-04fc7a6ec880 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:15.947517 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6b139-dfd2-48fa-baf5-04fc7a6ec880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:15.957915 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2673/5352] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:29:15.962673 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6fc3ae-03e9-436b-94db-abd95cf73c6f None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:15.962964 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6fc3ae-03e9-436b-94db-abd95cf73c6f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:15.963241 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6fc3ae-03e9-436b-94db-abd95cf73c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:15.992304 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-3af6b139-dfd2-48fa-baf5-04fc7a6ec880 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:15.992304 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3af6b139-dfd2-48fa-baf5-04fc7a6ec880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:15.992620 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-be6fc3ae-03e9-436b-94db-abd95cf73c6f None None] MFA Rules not processed for user `baf1d13615bc491ab98d2a644e681c12`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:15.992761 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2680/5353] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:29:15.992876 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-be6fc3ae-03e9-436b-94db-abd95cf73c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:15.995299 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6b139-dfd2-48fa-baf5-04fc7a6ec880 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:15.998617 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2674/5354] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:29:16.007479 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6b139-dfd2-48fa-baf5-04fc7a6ec880 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:16.010001 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6fc3ae-03e9-436b-94db-abd95cf73c6f None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:16.011640 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-be6fc3ae-03e9-436b-94db-abd95cf73c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:16.012357 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc309e-1e5c-40c2-9085-ef8fb16913be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:16.013046 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc309e-1e5c-40c2-9085-ef8fb16913be admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:16.017210 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc309e-1e5c-40c2-9085-ef8fb16913be admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:16.017210 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc309e-1e5c-40c2-9085-ef8fb16913be admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:16.017210 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc309e-1e5c-40c2-9085-ef8fb16913be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:29:16.017210 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc309e-1e5c-40c2-9085-ef8fb16913be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:16.017210 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc309e-1e5c-40c2-9085-ef8fb16913be admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:16.033260 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2681/5355] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:29:16.034577 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc309e-1e5c-40c2-9085-ef8fb16913be admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:16.045728 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc309e-1e5c-40c2-9085-ef8fb16913be admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:16.051928 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4a98c-3837-48f9-9530-9f88aa37ffb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:16.052142 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4a98c-3837-48f9-9530-9f88aa37ffb5 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:16.052280 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4a98c-3837-48f9-9530-9f88aa37ffb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:16.052591 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4a98c-3837-48f9-9530-9f88aa37ffb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:16.053286 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e4a98c-3837-48f9-9530-9f88aa37ffb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:16.055852 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e4a98c-3837-48f9-9530-9f88aa37ffb5 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:16.096839 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6fc3ae-03e9-436b-94db-abd95cf73c6f None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:16.113239 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fac71f-90b8-4c6f-88fb-ddac3f112396 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:16.114545 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fac71f-90b8-4c6f-88fb-ddac3f112396 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:16.115687 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fac71f-90b8-4c6f-88fb-ddac3f112396 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:16.116193 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fac71f-90b8-4c6f-88fb-ddac3f112396 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:16.134996 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fac71f-90b8-4c6f-88fb-ddac3f112396 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:16.137589 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fac71f-90b8-4c6f-88fb-ddac3f112396 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:16.173178 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2675/5356] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:29:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:29:16.248612 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2682/5357] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:29:16 2022] POST /identity/v3/projects => generated 379 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:29:16.252953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fac71f-90b8-4c6f-88fb-ddac3f112396 service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:16.268213 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fac71f-90b8-4c6f-88fb-ddac3f112396 service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:16.401854 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733af79-6dc4-4c27-bd5c-d71d6a600438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:16.405649 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733af79-6dc4-4c27-bd5c-d71d6a600438 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:16.406240 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733af79-6dc4-4c27-bd5c-d71d6a600438 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:16.406592 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733af79-6dc4-4c27-bd5c-d71d6a600438 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:16.407590 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a733af79-6dc4-4c27-bd5c-d71d6a600438 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:16.409653 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a733af79-6dc4-4c27-bd5c-d71d6a600438 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:16.506174 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2676/5358] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:29:16 2022] POST /identity/v3/users => generated 290 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:29:16.511179 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4a98c-3837-48f9-9530-9f88aa37ffb5 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:16.525204 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4a98c-3837-48f9-9530-9f88aa37ffb5 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:16.530264 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719e2e3-c707-49a7-8abc-6ca1f24bc6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:16.531011 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719e2e3-c707-49a7-8abc-6ca1f24bc6a5 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:16.531304 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719e2e3-c707-49a7-8abc-6ca1f24bc6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:16.531693 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719e2e3-c707-49a7-8abc-6ca1f24bc6a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:16.532489 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719e2e3-c707-49a7-8abc-6ca1f24bc6a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:16.534363 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719e2e3-c707-49a7-8abc-6ca1f24bc6a5 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:16.545190 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2683/5359] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:29:16.549772 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733af79-6dc4-4c27-bd5c-d71d6a600438 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:16.562202 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733af79-6dc4-4c27-bd5c-d71d6a600438 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:16.567695 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123cf063-ad17-4464-be48-41dbebb36b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:16.568675 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cf063-ad17-4464-be48-41dbebb36b83 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:16.569053 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cf063-ad17-4464-be48-41dbebb36b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:16.569472 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cf063-ad17-4464-be48-41dbebb36b83 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:16.571072 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123cf063-ad17-4464-be48-41dbebb36b83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:16.572789 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123cf063-ad17-4464-be48-41dbebb36b83 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:16.585809 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2677/5360] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:29:16.588669 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719e2e3-c707-49a7-8abc-6ca1f24bc6a5 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:16.604057 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719e2e3-c707-49a7-8abc-6ca1f24bc6a5 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:16.615428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6ab22-456c-4c00-88d8-508e65ab0c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:16.616377 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6ab22-456c-4c00-88d8-508e65ab0c67 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:16.616658 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6ab22-456c-4c00-88d8-508e65ab0c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:16.617352 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6ab22-456c-4c00-88d8-508e65ab0c67 admin admin] PATH_INFO: `/v3/projects/f3fa1520caa74e8fa7af9cda4044db7c/users/00258107f1e64ee489d35b481aec2198/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:16.635474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a6ab22-456c-4c00-88d8-508e65ab0c67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3fa1520caa74e8fa7af9cda4044db7c, user_id=00258107f1e64ee489d35b481aec2198, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:16.638231 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a6ab22-456c-4c00-88d8-508e65ab0c67 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:16.781134 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2684/5361] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:29:16 2022] PUT /identity/v3/projects/f3fa1520caa74e8fa7af9cda4044db7c/users/00258107f1e64ee489d35b481aec2198/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:29:16.786231 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6dd6cb-b570-440c-a4de-5d1d77ca9af0 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:16.788126 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6dd6cb-b570-440c-a4de-5d1d77ca9af0 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:16.789408 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6dd6cb-b570-440c-a4de-5d1d77ca9af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:16.835842 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-3b6dd6cb-b570-440c-a4de-5d1d77ca9af0 None None] MFA Rules not processed for user `00258107f1e64ee489d35b481aec2198`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:16.837440 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3b6dd6cb-b570-440c-a4de-5d1d77ca9af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:16.997265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d5c01-e196-440d-8ec6-70a4289aa70e None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:16.997265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d5c01-e196-440d-8ec6-70a4289aa70e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:16.997265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d5c01-e196-440d-8ec6-70a4289aa70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:17.005847 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2678/5362] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:29:17.025208 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-831d5c01-e196-440d-8ec6-70a4289aa70e None None] MFA Rules not processed for user `00258107f1e64ee489d35b481aec2198`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:17.026789 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-831d5c01-e196-440d-8ec6-70a4289aa70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:17.035183 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2685/5363] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:29:17.073734 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6dd6cb-b570-440c-a4de-5d1d77ca9af0 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:17.075302 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3b6dd6cb-b570-440c-a4de-5d1d77ca9af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:17.182681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6dd6cb-b570-440c-a4de-5d1d77ca9af0 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:17.189227 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59bc0bc-0705-41c8-b8b3-dd3204843ac1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:17.190040 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59bc0bc-0705-41c8-b8b3-dd3204843ac1 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:17.190424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59bc0bc-0705-41c8-b8b3-dd3204843ac1 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:17.190963 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59bc0bc-0705-41c8-b8b3-dd3204843ac1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:17.203069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59bc0bc-0705-41c8-b8b3-dd3204843ac1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:17.216700 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59bc0bc-0705-41c8-b8b3-dd3204843ac1 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:17.245044 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2679/5364] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:29:17 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:29:24.334094 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d5c01-e196-440d-8ec6-70a4289aa70e None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:24.336272 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-831d5c01-e196-440d-8ec6-70a4289aa70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:24.398665 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d5c01-e196-440d-8ec6-70a4289aa70e None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:24.402742 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cefe53-94ed-47b9-8411-f6223a16b000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:24.403406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cefe53-94ed-47b9-8411-f6223a16b000 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:24.409162 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cefe53-94ed-47b9-8411-f6223a16b000 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:24.409162 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cefe53-94ed-47b9-8411-f6223a16b000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:24.409162 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-98cefe53-94ed-47b9-8411-f6223a16b000 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:24.485020 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cefe53-94ed-47b9-8411-f6223a16b000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:24.486524 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cefe53-94ed-47b9-8411-f6223a16b000 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:24.497620 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2686/5365] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:29:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:29:25.623368 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59bc0bc-0705-41c8-b8b3-dd3204843ac1 service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:25.624835 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c59bc0bc-0705-41c8-b8b3-dd3204843ac1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:25.640128 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59bc0bc-0705-41c8-b8b3-dd3204843ac1 service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:25.643877 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ecbdb2-2951-4153-b2dd-136e7e681b0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:25.644541 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecbdb2-2951-4153-b2dd-136e7e681b0c service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:25.644824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecbdb2-2951-4153-b2dd-136e7e681b0c service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:25.645100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecbdb2-2951-4153-b2dd-136e7e681b0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:25.659178 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b0ecbdb2-2951-4153-b2dd-136e7e681b0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:25.800600 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ecbdb2-2951-4153-b2dd-136e7e681b0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:25.802157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ecbdb2-2951-4153-b2dd-136e7e681b0c service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:25.815857 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2680/5366] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:29:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:29:26.433375 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cefe53-94ed-47b9-8411-f6223a16b000 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:26.435099 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-98cefe53-94ed-47b9-8411-f6223a16b000 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:26.459546 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cefe53-94ed-47b9-8411-f6223a16b000 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:26.465593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf38d8-fe61-48a8-b0d8-171360ad5358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:26.467150 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf38d8-fe61-48a8-b0d8-171360ad5358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:26.467150 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf38d8-fe61-48a8-b0d8-171360ad5358 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:26.467838 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf38d8-fe61-48a8-b0d8-171360ad5358 admin admin] PATH_INFO: `/v3/users/e6c81689d8214c0f85463ad23fbb592f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:26.469305 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf38d8-fe61-48a8-b0d8-171360ad5358 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6c81689d8214c0f85463ad23fbb592f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:26.471460 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf38d8-fe61-48a8-b0d8-171360ad5358 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:26.640464 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-deaf38d8-fe61-48a8-b0d8-171360ad5358 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6c81689d8214c0f85463ad23fbb592f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:26.656372 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-deaf38d8-fe61-48a8-b0d8-171360ad5358 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6c81689d8214c0f85463ad23fbb592f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:26.816694 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-deaf38d8-fe61-48a8-b0d8-171360ad5358 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6c81689d8214c0f85463ad23fbb592f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:26.826233 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-deaf38d8-fe61-48a8-b0d8-171360ad5358 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6c81689d8214c0f85463ad23fbb592f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:26.826233 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-deaf38d8-fe61-48a8-b0d8-171360ad5358 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6c81689d8214c0f85463ad23fbb592f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:26.834516 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2687/5367] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:29:26 2022] DELETE /identity/v3/users/e6c81689d8214c0f85463ad23fbb592f => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:29:26.839626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8ee11-9b12-4a2b-ae0b-7bbb885adc95 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:26.840137 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8ee11-9b12-4a2b-ae0b-7bbb885adc95 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:26.840436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8ee11-9b12-4a2b-ae0b-7bbb885adc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:26.860143 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-edc8ee11-9b12-4a2b-ae0b-7bbb885adc95 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:26.861605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-edc8ee11-9b12-4a2b-ae0b-7bbb885adc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:26.947282 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2681/5368] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:29:26.998979 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf38d8-fe61-48a8-b0d8-171360ad5358 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:27.000555 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-deaf38d8-fe61-48a8-b0d8-171360ad5358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:27.124006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf38d8-fe61-48a8-b0d8-171360ad5358 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:27.128765 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9700b-fbb4-4282-be0c-e80a44a3f1f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:27.129850 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9700b-fbb4-4282-be0c-e80a44a3f1f3 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:27.130392 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9700b-fbb4-4282-be0c-e80a44a3f1f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:27.130938 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9700b-fbb4-4282-be0c-e80a44a3f1f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:27.144727 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a9700b-fbb4-4282-be0c-e80a44a3f1f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:27.146669 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a9700b-fbb4-4282-be0c-e80a44a3f1f3 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:27.159694 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2688/5369] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:29:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:29:27.973589 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e7ff6-92bf-4077-ad72-1bc4038f684f None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:27.974182 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e7ff6-92bf-4077-ad72-1bc4038f684f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:27.974182 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e7ff6-92bf-4077-ad72-1bc4038f684f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:27.994903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-393e7ff6-92bf-4077-ad72-1bc4038f684f None None] MFA Rules not processed for user `20b4082fa07249e2b6dfb9b4506ab398`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:27.996129 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-393e7ff6-92bf-4077-ad72-1bc4038f684f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:28.017925 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9700b-fbb4-4282-be0c-e80a44a3f1f3 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:28.019899 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-04a9700b-fbb4-4282-be0c-e80a44a3f1f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:28.037471 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9700b-fbb4-4282-be0c-e80a44a3f1f3 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:28.054198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbbe60-cf61-46fc-8556-9c92ebc4ce93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:28.055084 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbbe60-cf61-46fc-8556-9c92ebc4ce93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:28.055369 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbbe60-cf61-46fc-8556-9c92ebc4ce93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:28.055642 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbbe60-cf61-46fc-8556-9c92ebc4ce93 admin admin] PATH_INFO: `/v3/projects/8db42a5e42884bc687a546cb4904ef5d` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:28.059480 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abbbe60-cf61-46fc-8556-9c92ebc4ce93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8db42a5e42884bc687a546cb4904ef5d)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:28.063247 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abbbe60-cf61-46fc-8556-9c92ebc4ce93 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:28.121607 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2682/5370] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:29:28.198619 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2abbbe60-cf61-46fc-8556-9c92ebc4ce93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8db42a5e42884bc687a546cb4904ef5d', 'request_id': 'req-2abbbe60-cf61-46fc-8556-9c92ebc4ce93'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:28.208925 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2abbbe60-cf61-46fc-8556-9c92ebc4ce93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8db42a5e42884bc687a546cb4904ef5d', 'request_id': 'req-2abbbe60-cf61-46fc-8556-9c92ebc4ce93'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:28.229687 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2abbbe60-cf61-46fc-8556-9c92ebc4ce93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8db42a5e42884bc687a546cb4904ef5d', 'request_id': 'req-2abbbe60-cf61-46fc-8556-9c92ebc4ce93'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:28.323676 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2abbbe60-cf61-46fc-8556-9c92ebc4ce93 admin admin] The token cache is being invalidate because project 8db42a5e42884bc687a546cb4904ef5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:29:28.323977 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2abbbe60-cf61-46fc-8556-9c92ebc4ce93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:28.327381 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2abbbe60-cf61-46fc-8556-9c92ebc4ce93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:28.329984 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2689/5371] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:29:28 2022] DELETE /identity/v3/projects/8db42a5e42884bc687a546cb4904ef5d => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:29:28.333958 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e7ff6-92bf-4077-ad72-1bc4038f684f None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:28.352908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e7ff6-92bf-4077-ad72-1bc4038f684f None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:28.438394 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424be02b-4587-4254-a417-9112b373d1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:28.439349 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424be02b-4587-4254-a417-9112b373d1ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:28.439825 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424be02b-4587-4254-a417-9112b373d1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:28.440133 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424be02b-4587-4254-a417-9112b373d1ed admin admin] PATH_INFO: `/v3/users/8672bf74eacc4b4990241ef6882596d8` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:28.441698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424be02b-4587-4254-a417-9112b373d1ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=8672bf74eacc4b4990241ef6882596d8)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:28.443873 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424be02b-4587-4254-a417-9112b373d1ed admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:28.669289 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-424be02b-4587-4254-a417-9112b373d1ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8672bf74eacc4b4990241ef6882596d8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:28.689359 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-424be02b-4587-4254-a417-9112b373d1ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8672bf74eacc4b4990241ef6882596d8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:28.776469 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-424be02b-4587-4254-a417-9112b373d1ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8672bf74eacc4b4990241ef6882596d8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:28.777490 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-424be02b-4587-4254-a417-9112b373d1ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8672bf74eacc4b4990241ef6882596d8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:28.787551 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-424be02b-4587-4254-a417-9112b373d1ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8672bf74eacc4b4990241ef6882596d8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:28.798486 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2683/5372] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:29:28 2022] DELETE /identity/v3/users/8672bf74eacc4b4990241ef6882596d8 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:29:28.939879 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbbe60-cf61-46fc-8556-9c92ebc4ce93 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:28.941660 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2abbbe60-cf61-46fc-8556-9c92ebc4ce93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:28.958219 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbbe60-cf61-46fc-8556-9c92ebc4ce93 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:29.033174 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45715581-c2ea-47a7-a39a-418a0aae7b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:29.034147 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45715581-c2ea-47a7-a39a-418a0aae7b75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:29.034432 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45715581-c2ea-47a7-a39a-418a0aae7b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:29.034710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45715581-c2ea-47a7-a39a-418a0aae7b75 admin admin] PATH_INFO: `/v3/users/3383f0c2b1874b15b38dea61e4b8e498` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:29.036009 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45715581-c2ea-47a7-a39a-418a0aae7b75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3383f0c2b1874b15b38dea61e4b8e498)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:29.038005 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45715581-c2ea-47a7-a39a-418a0aae7b75 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:29.322961 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-45715581-c2ea-47a7-a39a-418a0aae7b75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3383f0c2b1874b15b38dea61e4b8e498'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:29.343280 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-45715581-c2ea-47a7-a39a-418a0aae7b75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3383f0c2b1874b15b38dea61e4b8e498'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:29.422378 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-45715581-c2ea-47a7-a39a-418a0aae7b75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3383f0c2b1874b15b38dea61e4b8e498'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:29.435090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-45715581-c2ea-47a7-a39a-418a0aae7b75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3383f0c2b1874b15b38dea61e4b8e498'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:29.436335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-45715581-c2ea-47a7-a39a-418a0aae7b75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3383f0c2b1874b15b38dea61e4b8e498'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:29.451967 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2690/5373] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:29:28 2022] DELETE /identity/v3/users/3383f0c2b1874b15b38dea61e4b8e498 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:29:29.618599 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424be02b-4587-4254-a417-9112b373d1ed admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:29.621104 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-424be02b-4587-4254-a417-9112b373d1ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:29.640354 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424be02b-4587-4254-a417-9112b373d1ed admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:29.672843 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45715581-c2ea-47a7-a39a-418a0aae7b75 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:29.675005 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-45715581-c2ea-47a7-a39a-418a0aae7b75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:29.755685 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e7908-6c7e-4569-9063-35b524ed7d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:29.757357 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e7908-6c7e-4569-9063-35b524ed7d0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:29.757654 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e7908-6c7e-4569-9063-35b524ed7d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:29.757967 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e7908-6c7e-4569-9063-35b524ed7d0a admin admin] PATH_INFO: `/v3/users/00258107f1e64ee489d35b481aec2198` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:29.760791 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e7908-6c7e-4569-9063-35b524ed7d0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=00258107f1e64ee489d35b481aec2198)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:29.763732 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e7908-6c7e-4569-9063-35b524ed7d0a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:29.804007 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45715581-c2ea-47a7-a39a-418a0aae7b75 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:29.810651 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d281d4-dbb0-48fc-8412-66263f0b9e6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:29.811562 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d281d4-dbb0-48fc-8412-66263f0b9e6f service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:29.812016 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d281d4-dbb0-48fc-8412-66263f0b9e6f service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:29.812591 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d281d4-dbb0-48fc-8412-66263f0b9e6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:29.814863 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d8d281d4-dbb0-48fc-8412-66263f0b9e6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:29.893303 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d281d4-dbb0-48fc-8412-66263f0b9e6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:29.895270 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d281d4-dbb0-48fc-8412-66263f0b9e6f service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:29.917273 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2691/5374] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:29:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:29:29.977455 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a66e7908-6c7e-4569-9063-35b524ed7d0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00258107f1e64ee489d35b481aec2198'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:30.007173 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a66e7908-6c7e-4569-9063-35b524ed7d0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00258107f1e64ee489d35b481aec2198'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:30.063758 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d281d4-dbb0-48fc-8412-66263f0b9e6f service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:30.065556 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d8d281d4-dbb0-48fc-8412-66263f0b9e6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:30.085052 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d281d4-dbb0-48fc-8412-66263f0b9e6f service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:30.097010 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfcefaa-f6d8-4901-870a-5dc6d24fb645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:30.103080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a66e7908-6c7e-4569-9063-35b524ed7d0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00258107f1e64ee489d35b481aec2198'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:30.103724 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a66e7908-6c7e-4569-9063-35b524ed7d0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00258107f1e64ee489d35b481aec2198'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:30.106664 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfcefaa-f6d8-4901-870a-5dc6d24fb645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:30.106948 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfcefaa-f6d8-4901-870a-5dc6d24fb645 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:30.107225 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfcefaa-f6d8-4901-870a-5dc6d24fb645 admin admin] PATH_INFO: `/v3/projects/32326a8ded8845399676cda34c002831` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:30.109587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfcefaa-f6d8-4901-870a-5dc6d24fb645 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32326a8ded8845399676cda34c002831)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:30.112615 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a66e7908-6c7e-4569-9063-35b524ed7d0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00258107f1e64ee489d35b481aec2198'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:30.116454 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfcefaa-f6d8-4901-870a-5dc6d24fb645 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:30.126341 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2684/5375] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:29:29 2022] DELETE /identity/v3/users/00258107f1e64ee489d35b481aec2198 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:29:30.127224 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e7908-6c7e-4569-9063-35b524ed7d0a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:30.130492 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a66e7908-6c7e-4569-9063-35b524ed7d0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:30.285444 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e7908-6c7e-4569-9063-35b524ed7d0a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:30.315539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-fdfcefaa-f6d8-4901-870a-5dc6d24fb645 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32326a8ded8845399676cda34c002831', 'request_id': 'req-fdfcefaa-f6d8-4901-870a-5dc6d24fb645'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:30.334380 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-fdfcefaa-f6d8-4901-870a-5dc6d24fb645 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32326a8ded8845399676cda34c002831', 'request_id': 'req-fdfcefaa-f6d8-4901-870a-5dc6d24fb645'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:30.343055 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-fdfcefaa-f6d8-4901-870a-5dc6d24fb645 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32326a8ded8845399676cda34c002831', 'request_id': 'req-fdfcefaa-f6d8-4901-870a-5dc6d24fb645'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:30.400238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0d4fa-77ba-4e80-942c-9628323a8158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:30.401269 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0d4fa-77ba-4e80-942c-9628323a8158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:30.401554 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0d4fa-77ba-4e80-942c-9628323a8158 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:30.401968 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0d4fa-77ba-4e80-942c-9628323a8158 admin admin] PATH_INFO: `/v3/projects/426405d77bbc4e24adcbe789ba3f42f2` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:30.403262 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d0d4fa-77ba-4e80-942c-9628323a8158 admin admin] RBAC: Authorizing `identity:delete_project(project_id=426405d77bbc4e24adcbe789ba3f42f2)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:30.405728 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d0d4fa-77ba-4e80-942c-9628323a8158 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:30.447825 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-fdfcefaa-f6d8-4901-870a-5dc6d24fb645 admin admin] The token cache is being invalidate because project 32326a8ded8845399676cda34c002831 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:29:30.448722 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-fdfcefaa-f6d8-4901-870a-5dc6d24fb645 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:30.450161 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-fdfcefaa-f6d8-4901-870a-5dc6d24fb645 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:30.452052 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2692/5376] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:29:30 2022] DELETE /identity/v3/projects/32326a8ded8845399676cda34c002831 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:29:30.453823 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d0f18-e308-4ecc-a9a6-12be5522284c None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:30.454341 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d0f18-e308-4ecc-a9a6-12be5522284c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:30.455013 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d0f18-e308-4ecc-a9a6-12be5522284c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:30.480399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-2d3d0f18-e308-4ecc-a9a6-12be5522284c None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:30.481968 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2d3d0f18-e308-4ecc-a9a6-12be5522284c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:30.497812 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2693/5377] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:29:30.498907 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d0f18-e308-4ecc-a9a6-12be5522284c None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:30.500871 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2d3d0f18-e308-4ecc-a9a6-12be5522284c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:30.536743 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d0f18-e308-4ecc-a9a6-12be5522284c None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:30.563125 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e5d0d4fa-77ba-4e80-942c-9628323a8158 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '426405d77bbc4e24adcbe789ba3f42f2', 'request_id': 'req-e5d0d4fa-77ba-4e80-942c-9628323a8158'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:30.570338 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e5d0d4fa-77ba-4e80-942c-9628323a8158 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '426405d77bbc4e24adcbe789ba3f42f2', 'request_id': 'req-e5d0d4fa-77ba-4e80-942c-9628323a8158'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:30.578124 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e5d0d4fa-77ba-4e80-942c-9628323a8158 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '426405d77bbc4e24adcbe789ba3f42f2', 'request_id': 'req-e5d0d4fa-77ba-4e80-942c-9628323a8158'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:30.678994 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107c2ae-f9fe-4c52-b361-2476676375ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:30.679405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e5d0d4fa-77ba-4e80-942c-9628323a8158 admin admin] The token cache is being invalidate because project 426405d77bbc4e24adcbe789ba3f42f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:29:30.679405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e5d0d4fa-77ba-4e80-942c-9628323a8158 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:30.679405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e5d0d4fa-77ba-4e80-942c-9628323a8158 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:30.680613 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2685/5378] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:29:30 2022] DELETE /identity/v3/projects/426405d77bbc4e24adcbe789ba3f42f2 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:29:30.680869 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107c2ae-f9fe-4c52-b361-2476676375ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:30.681393 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107c2ae-f9fe-4c52-b361-2476676375ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:30.681924 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107c2ae-f9fe-4c52-b361-2476676375ea admin admin] PATH_INFO: `/v3/users/7a3a063a8fab4af39aed293fef49d42b` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:30.683990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0d4fa-77ba-4e80-942c-9628323a8158 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:30.684889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9107c2ae-f9fe-4c52-b361-2476676375ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a3a063a8fab4af39aed293fef49d42b)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:30.687487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9107c2ae-f9fe-4c52-b361-2476676375ea admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:30.689558 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e5d0d4fa-77ba-4e80-942c-9628323a8158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:30.836266 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0d4fa-77ba-4e80-942c-9628323a8158 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:30.841577 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266388a-6ab5-4751-8728-c7bd60b7df7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:30.842282 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266388a-6ab5-4751-8728-c7bd60b7df7d service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:30.843519 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266388a-6ab5-4751-8728-c7bd60b7df7d service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:30.843806 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266388a-6ab5-4751-8728-c7bd60b7df7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:30.853101 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b266388a-6ab5-4751-8728-c7bd60b7df7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:30.885871 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b266388a-6ab5-4751-8728-c7bd60b7df7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:30.887976 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b266388a-6ab5-4751-8728-c7bd60b7df7d service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:30.904597 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2686/5379] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:29:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:29:30.905841 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266388a-6ab5-4751-8728-c7bd60b7df7d service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:30.907613 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b266388a-6ab5-4751-8728-c7bd60b7df7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:30.934081 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266388a-6ab5-4751-8728-c7bd60b7df7d service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:30.955507 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eceb42-ae0e-4631-9a07-77c7222d9a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:30.957965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eceb42-ae0e-4631-9a07-77c7222d9a6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:30.958272 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eceb42-ae0e-4631-9a07-77c7222d9a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:30.962981 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eceb42-ae0e-4631-9a07-77c7222d9a6c admin admin] PATH_INFO: `/v3/users/665730cc6b9a4b0aa98b0cf6f36246ba` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:30.962981 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eceb42-ae0e-4631-9a07-77c7222d9a6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=665730cc6b9a4b0aa98b0cf6f36246ba)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:30.964129 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9107c2ae-f9fe-4c52-b361-2476676375ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a3a063a8fab4af39aed293fef49d42b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:30.968216 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eceb42-ae0e-4631-9a07-77c7222d9a6c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:30.992196 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9107c2ae-f9fe-4c52-b361-2476676375ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a3a063a8fab4af39aed293fef49d42b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:31.102267 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9107c2ae-f9fe-4c52-b361-2476676375ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a3a063a8fab4af39aed293fef49d42b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:31.116701 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9107c2ae-f9fe-4c52-b361-2476676375ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a3a063a8fab4af39aed293fef49d42b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:31.117847 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9107c2ae-f9fe-4c52-b361-2476676375ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a3a063a8fab4af39aed293fef49d42b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:31.123970 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2694/5380] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:29:30 2022] DELETE /identity/v3/users/7a3a063a8fab4af39aed293fef49d42b => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:29:31.282017 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-87eceb42-ae0e-4631-9a07-77c7222d9a6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '665730cc6b9a4b0aa98b0cf6f36246ba'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:31.310059 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-87eceb42-ae0e-4631-9a07-77c7222d9a6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '665730cc6b9a4b0aa98b0cf6f36246ba'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:31.402785 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-87eceb42-ae0e-4631-9a07-77c7222d9a6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '665730cc6b9a4b0aa98b0cf6f36246ba'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:31.403412 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-87eceb42-ae0e-4631-9a07-77c7222d9a6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '665730cc6b9a4b0aa98b0cf6f36246ba'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:31.414243 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-87eceb42-ae0e-4631-9a07-77c7222d9a6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '665730cc6b9a4b0aa98b0cf6f36246ba'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:31.426115 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2687/5381] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:29:30 2022] DELETE /identity/v3/users/665730cc6b9a4b0aa98b0cf6f36246ba => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:29:32.081916 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107c2ae-f9fe-4c52-b361-2476676375ea admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:32.083533 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9107c2ae-f9fe-4c52-b361-2476676375ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:32.139797 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eceb42-ae0e-4631-9a07-77c7222d9a6c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:32.142457 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-87eceb42-ae0e-4631-9a07-77c7222d9a6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:32.180079 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107c2ae-f9fe-4c52-b361-2476676375ea admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:32.255573 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107bf17f-18d5-4783-a32c-401f539dbc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:32.257325 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107bf17f-18d5-4783-a32c-401f539dbc78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:32.258052 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107bf17f-18d5-4783-a32c-401f539dbc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:32.258506 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107bf17f-18d5-4783-a32c-401f539dbc78 admin admin] PATH_INFO: `/v3/projects/f3fa1520caa74e8fa7af9cda4044db7c` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:32.260059 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107bf17f-18d5-4783-a32c-401f539dbc78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3fa1520caa74e8fa7af9cda4044db7c)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:32.262244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107bf17f-18d5-4783-a32c-401f539dbc78 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:32.271440 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eceb42-ae0e-4631-9a07-77c7222d9a6c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:32.276958 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86462d7d-eb21-495d-ae1c-c590a2685953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:32.278963 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86462d7d-eb21-495d-ae1c-c590a2685953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:32.279618 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86462d7d-eb21-495d-ae1c-c590a2685953 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:32.280123 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86462d7d-eb21-495d-ae1c-c590a2685953 admin admin] PATH_INFO: `/v3/projects/ac69cc13661a4713bcd4b96684c461b3` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:32.281597 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86462d7d-eb21-495d-ae1c-c590a2685953 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac69cc13661a4713bcd4b96684c461b3)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:32.284989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86462d7d-eb21-495d-ae1c-c590a2685953 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:32.420046 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-107bf17f-18d5-4783-a32c-401f539dbc78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3fa1520caa74e8fa7af9cda4044db7c', 'request_id': 'req-107bf17f-18d5-4783-a32c-401f539dbc78'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:32.425401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-107bf17f-18d5-4783-a32c-401f539dbc78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3fa1520caa74e8fa7af9cda4044db7c', 'request_id': 'req-107bf17f-18d5-4783-a32c-401f539dbc78'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:32.431657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-107bf17f-18d5-4783-a32c-401f539dbc78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3fa1520caa74e8fa7af9cda4044db7c', 'request_id': 'req-107bf17f-18d5-4783-a32c-401f539dbc78'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:32.457462 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-86462d7d-eb21-495d-ae1c-c590a2685953 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac69cc13661a4713bcd4b96684c461b3', 'request_id': 'req-86462d7d-eb21-495d-ae1c-c590a2685953'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:32.463545 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-86462d7d-eb21-495d-ae1c-c590a2685953 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac69cc13661a4713bcd4b96684c461b3', 'request_id': 'req-86462d7d-eb21-495d-ae1c-c590a2685953'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:32.484423 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-86462d7d-eb21-495d-ae1c-c590a2685953 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac69cc13661a4713bcd4b96684c461b3', 'request_id': 'req-86462d7d-eb21-495d-ae1c-c590a2685953'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:32.534068 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-107bf17f-18d5-4783-a32c-401f539dbc78 admin admin] The token cache is being invalidate because project f3fa1520caa74e8fa7af9cda4044db7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:29:32.534621 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-107bf17f-18d5-4783-a32c-401f539dbc78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:32.536051 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-107bf17f-18d5-4783-a32c-401f539dbc78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:32.538764 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2695/5382] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:29:32 2022] DELETE /identity/v3/projects/f3fa1520caa74e8fa7af9cda4044db7c => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:29:32.540086 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107bf17f-18d5-4783-a32c-401f539dbc78 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:32.541969 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-107bf17f-18d5-4783-a32c-401f539dbc78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:32.622204 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-86462d7d-eb21-495d-ae1c-c590a2685953 admin admin] The token cache is being invalidate because project ac69cc13661a4713bcd4b96684c461b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:29:32.622809 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-86462d7d-eb21-495d-ae1c-c590a2685953 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:32.623492 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-86462d7d-eb21-495d-ae1c-c590a2685953 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:32.625206 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107bf17f-18d5-4783-a32c-401f539dbc78 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:32.629800 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2688/5383] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:29:32 2022] DELETE /identity/v3/projects/ac69cc13661a4713bcd4b96684c461b3 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:29:32.630935 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86462d7d-eb21-495d-ae1c-c590a2685953 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:32.633304 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-86462d7d-eb21-495d-ae1c-c590a2685953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:32.747920 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad540ce-d063-4ae4-b8ac-4485308544b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:32.748808 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad540ce-d063-4ae4-b8ac-4485308544b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:32.749088 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad540ce-d063-4ae4-b8ac-4485308544b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:32.749362 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad540ce-d063-4ae4-b8ac-4485308544b8 admin admin] PATH_INFO: `/v3/projects/ad82cac5a67f4c21aba328027a9ed73f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:32.755590 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad540ce-d063-4ae4-b8ac-4485308544b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad82cac5a67f4c21aba328027a9ed73f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:32.761424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86462d7d-eb21-495d-ae1c-c590a2685953 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:32.762306 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad540ce-d063-4ae4-b8ac-4485308544b8 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:32.789565 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26675da4-4481-4828-9050-9fa8354c64bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:32.794553 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26675da4-4481-4828-9050-9fa8354c64bc service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:32.799755 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26675da4-4481-4828-9050-9fa8354c64bc service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:32.799755 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26675da4-4481-4828-9050-9fa8354c64bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:32.799755 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-26675da4-4481-4828-9050-9fa8354c64bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:32.908847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26675da4-4481-4828-9050-9fa8354c64bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:32.911700 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26675da4-4481-4828-9050-9fa8354c64bc service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:32.917902 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1ad540ce-d063-4ae4-b8ac-4485308544b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad82cac5a67f4c21aba328027a9ed73f', 'request_id': 'req-1ad540ce-d063-4ae4-b8ac-4485308544b8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:32.925144 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1ad540ce-d063-4ae4-b8ac-4485308544b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad82cac5a67f4c21aba328027a9ed73f', 'request_id': 'req-1ad540ce-d063-4ae4-b8ac-4485308544b8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:32.929985 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2689/5384] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:29:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:29:32.932533 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc990f-e424-427e-b229-9e780dafba5b None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:32.932772 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc990f-e424-427e-b229-9e780dafba5b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:32.933060 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc990f-e424-427e-b229-9e780dafba5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:32.946286 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1ad540ce-d063-4ae4-b8ac-4485308544b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad82cac5a67f4c21aba328027a9ed73f', 'request_id': 'req-1ad540ce-d063-4ae4-b8ac-4485308544b8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:32.973824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-cacc990f-e424-427e-b229-9e780dafba5b None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:32.975176 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-cacc990f-e424-427e-b229-9e780dafba5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:33.056839 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2690/5385] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:29:33.061128 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1ad540ce-d063-4ae4-b8ac-4485308544b8 admin admin] The token cache is being invalidate because project ad82cac5a67f4c21aba328027a9ed73f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:29:33.061493 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1ad540ce-d063-4ae4-b8ac-4485308544b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:33.062265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1ad540ce-d063-4ae4-b8ac-4485308544b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:33.068050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68d7dd-b08d-41cc-9f54-0ae46d25a549 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:33.068418 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2696/5386] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:29:32 2022] DELETE /identity/v3/projects/ad82cac5a67f4c21aba328027a9ed73f => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:29:33.068520 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68d7dd-b08d-41cc-9f54-0ae46d25a549 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:33.068520 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68d7dd-b08d-41cc-9f54-0ae46d25a549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:33.068770 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273cd0c-683f-4958-9704-c1a040d65673 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:33.068770 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273cd0c-683f-4958-9704-c1a040d65673 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:33.068770 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273cd0c-683f-4958-9704-c1a040d65673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:33.095338 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-0e68d7dd-b08d-41cc-9f54-0ae46d25a549 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:33.096583 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0e68d7dd-b08d-41cc-9f54-0ae46d25a549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:33.115456 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2691/5387] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:29:33.116631 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb4133-621a-43f5-8ed6-76cfd45fff13 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:33.116923 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb4133-621a-43f5-8ed6-76cfd45fff13 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:33.117211 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb4133-621a-43f5-8ed6-76cfd45fff13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:33.131018 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-4273cd0c-683f-4958-9704-c1a040d65673 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:33.139488 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4273cd0c-683f-4958-9704-c1a040d65673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:33.163299 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2697/5388] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:29:33.169100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167b601-32af-48f1-bc71-381d99dd4339 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:33.170778 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167b601-32af-48f1-bc71-381d99dd4339 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:33.171057 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-ebbb4133-621a-43f5-8ed6-76cfd45fff13 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:33.176352 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ebbb4133-621a-43f5-8ed6-76cfd45fff13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:33.180022 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167b601-32af-48f1-bc71-381d99dd4339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:33.204433 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2692/5389] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:29:33.205288 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb4133-621a-43f5-8ed6-76cfd45fff13 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:33.227848 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-f167b601-32af-48f1-bc71-381d99dd4339 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:33.229813 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f167b601-32af-48f1-bc71-381d99dd4339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:33.251459 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb4133-621a-43f5-8ed6-76cfd45fff13 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:33.252807 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2698/5390] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:29:33.254542 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b4b54-3642-4fdf-b529-dc0da89ba13a None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:33.255077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b4b54-3642-4fdf-b529-dc0da89ba13a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:33.255572 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b4b54-3642-4fdf-b529-dc0da89ba13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:33.263082 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272b51a-c5c8-48e6-8262-644814bca518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:33.264061 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272b51a-c5c8-48e6-8262-644814bca518 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:33.264399 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272b51a-c5c8-48e6-8262-644814bca518 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:33.264742 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272b51a-c5c8-48e6-8262-644814bca518 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:33.265532 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272b51a-c5c8-48e6-8262-644814bca518 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:29:33.265923 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272b51a-c5c8-48e6-8262-644814bca518 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:33.269874 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272b51a-c5c8-48e6-8262-644814bca518 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:33.288698 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2693/5391] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:29:33.288698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272b51a-c5c8-48e6-8262-644814bca518 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:33.299817 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272b51a-c5c8-48e6-8262-644814bca518 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:33.305455 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-961b4b54-3642-4fdf-b529-dc0da89ba13a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:33.306458 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596f94f-589e-4875-99c5-be13f506d04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:33.306868 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-961b4b54-3642-4fdf-b529-dc0da89ba13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:33.320922 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2699/5392] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:29:33.320922 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b4b54-3642-4fdf-b529-dc0da89ba13a None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:33.321257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596f94f-589e-4875-99c5-be13f506d04e admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:33.321495 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596f94f-589e-4875-99c5-be13f506d04e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:33.322710 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596f94f-589e-4875-99c5-be13f506d04e admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:33.323719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596f94f-589e-4875-99c5-be13f506d04e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:29:33.326995 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596f94f-589e-4875-99c5-be13f506d04e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:33.329394 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596f94f-589e-4875-99c5-be13f506d04e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:33.332917 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b4b54-3642-4fdf-b529-dc0da89ba13a None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:33.341397 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5da9b4-6cb6-40b2-9241-e04f5eb74510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:33.345661 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5da9b4-6cb6-40b2-9241-e04f5eb74510 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:33.345661 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5da9b4-6cb6-40b2-9241-e04f5eb74510 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:33.345661 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5da9b4-6cb6-40b2-9241-e04f5eb74510 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:33.345661 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5da9b4-6cb6-40b2-9241-e04f5eb74510 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:33.351879 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5da9b4-6cb6-40b2-9241-e04f5eb74510 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:33.359325 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2694/5393] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:29:33.364497 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596f94f-589e-4875-99c5-be13f506d04e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:33.387790 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596f94f-589e-4875-99c5-be13f506d04e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:33.409250 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2d048-1f01-44ab-9845-b60ee3b438c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:33.409250 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2d048-1f01-44ab-9845-b60ee3b438c2 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:33.409250 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2d048-1f01-44ab-9845-b60ee3b438c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:33.409250 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2d048-1f01-44ab-9845-b60ee3b438c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:33.410157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2d048-1f01-44ab-9845-b60ee3b438c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:29:33.410157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2d048-1f01-44ab-9845-b60ee3b438c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:33.410157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2d048-1f01-44ab-9845-b60ee3b438c2 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:33.442484 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2695/5394] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:29:33.443625 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2d048-1f01-44ab-9845-b60ee3b438c2 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:33.465450 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2d048-1f01-44ab-9845-b60ee3b438c2 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:33.480825 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2700/5395] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:29:33 2022] POST /identity/v3/projects => generated 399 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:29:33.482585 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5da9b4-6cb6-40b2-9241-e04f5eb74510 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:33.482772 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7c74a-172c-4fc0-be9b-47f51179edcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:33.485172 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7c74a-172c-4fc0-be9b-47f51179edcb admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:33.485889 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7c74a-172c-4fc0-be9b-47f51179edcb admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:33.486427 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7c74a-172c-4fc0-be9b-47f51179edcb admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:33.487619 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b7c74a-172c-4fc0-be9b-47f51179edcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:33.490238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b7c74a-172c-4fc0-be9b-47f51179edcb admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:33.576253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5da9b4-6cb6-40b2-9241-e04f5eb74510 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:33.583873 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba95c9e0-1394-4746-9caf-910e3e3fad68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:33.585590 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95c9e0-1394-4746-9caf-910e3e3fad68 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:33.586396 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95c9e0-1394-4746-9caf-910e3e3fad68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:33.586871 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95c9e0-1394-4746-9caf-910e3e3fad68 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:33.588310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba95c9e0-1394-4746-9caf-910e3e3fad68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:33.591301 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba95c9e0-1394-4746-9caf-910e3e3fad68 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:33.611498 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2696/5396] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:29:33 2022] POST /identity/v3/projects => generated 393 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:29:33.611498 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7c74a-172c-4fc0-be9b-47f51179edcb admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:33.677746 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7c74a-172c-4fc0-be9b-47f51179edcb admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:33.682877 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73364ff4-e93e-451a-934d-0f3734bbe70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:33.683641 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73364ff4-e93e-451a-934d-0f3734bbe70c admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:33.683993 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73364ff4-e93e-451a-934d-0f3734bbe70c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:33.684364 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73364ff4-e93e-451a-934d-0f3734bbe70c admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:33.685126 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73364ff4-e93e-451a-934d-0f3734bbe70c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:33.687194 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73364ff4-e93e-451a-934d-0f3734bbe70c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:33.702859 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2701/5397] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:29:33 2022] POST /identity/v3/projects => generated 385 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:29:33.703647 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba95c9e0-1394-4746-9caf-910e3e3fad68 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:33.775608 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba95c9e0-1394-4746-9caf-910e3e3fad68 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:33.782413 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9e3a2-3a85-4da8-906b-86d7f33aa17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:33.783411 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9e3a2-3a85-4da8-906b-86d7f33aa17e admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:33.783885 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9e3a2-3a85-4da8-906b-86d7f33aa17e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:33.784233 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9e3a2-3a85-4da8-906b-86d7f33aa17e admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:33.785745 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9e3a2-3a85-4da8-906b-86d7f33aa17e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:33.786557 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2697/5398] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:29:33 2022] POST /identity/v3/users => generated 300 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:29:33.788315 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73364ff4-e93e-451a-934d-0f3734bbe70c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:33.789121 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9e3a2-3a85-4da8-906b-86d7f33aa17e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:33.800012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73364ff4-e93e-451a-934d-0f3734bbe70c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:33.805961 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58765b-272a-4f5c-858a-cf1a5a0ea269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:33.817886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58765b-272a-4f5c-858a-cf1a5a0ea269 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:33.817886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58765b-272a-4f5c-858a-cf1a5a0ea269 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:33.817886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58765b-272a-4f5c-858a-cf1a5a0ea269 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:33.817886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff58765b-272a-4f5c-858a-cf1a5a0ea269 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:33.817886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff58765b-272a-4f5c-858a-cf1a5a0ea269 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:33.903973 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2702/5399] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:29:33 2022] POST /identity/v3/users => generated 297 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:29:33.904598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9e3a2-3a85-4da8-906b-86d7f33aa17e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:33.919006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9e3a2-3a85-4da8-906b-86d7f33aa17e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:33.924973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142760f1-a6fb-4745-8267-d055c6e6e030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:33.926082 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142760f1-a6fb-4745-8267-d055c6e6e030 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:33.926370 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142760f1-a6fb-4745-8267-d055c6e6e030 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:33.926751 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142760f1-a6fb-4745-8267-d055c6e6e030 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:33.927476 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142760f1-a6fb-4745-8267-d055c6e6e030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:33.929168 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142760f1-a6fb-4745-8267-d055c6e6e030 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:33.943093 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2703/5400] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:29:33.943093 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97490044-8233-46d2-bbc5-011f4fd040f0 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:33.943093 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97490044-8233-46d2-bbc5-011f4fd040f0 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:33.943093 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97490044-8233-46d2-bbc5-011f4fd040f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:33.960616 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2698/5401] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:29:33 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:29:33.962957 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58765b-272a-4f5c-858a-cf1a5a0ea269 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:33.977938 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-97490044-8233-46d2-bbc5-011f4fd040f0 None None] MFA Rules not processed for user `baf1d13615bc491ab98d2a644e681c12`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:33.978351 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58765b-272a-4f5c-858a-cf1a5a0ea269 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:33.979734 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-97490044-8233-46d2-bbc5-011f4fd040f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:33.983777 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b1c18-de32-42ad-a4d0-e86f93b3eaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:33.984469 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b1c18-de32-42ad-a4d0-e86f93b3eaa1 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:33.984786 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b1c18-de32-42ad-a4d0-e86f93b3eaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:33.985023 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b1c18-de32-42ad-a4d0-e86f93b3eaa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:33.985869 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b1c18-de32-42ad-a4d0-e86f93b3eaa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:33.987826 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b1c18-de32-42ad-a4d0-e86f93b3eaa1 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:34.002599 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2699/5402] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:29:34.002599 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b1c18-de32-42ad-a4d0-e86f93b3eaa1 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:34.017159 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b1c18-de32-42ad-a4d0-e86f93b3eaa1 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:34.023492 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518b8a7-8acf-4d4c-b39e-e7c233a8f653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:34.024464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518b8a7-8acf-4d4c-b39e-e7c233a8f653 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:34.025064 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518b8a7-8acf-4d4c-b39e-e7c233a8f653 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:34.025526 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518b8a7-8acf-4d4c-b39e-e7c233a8f653 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:34.026544 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3518b8a7-8acf-4d4c-b39e-e7c233a8f653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:34.028943 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3518b8a7-8acf-4d4c-b39e-e7c233a8f653 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:34.041443 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2700/5403] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:29:34.042507 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518b8a7-8acf-4d4c-b39e-e7c233a8f653 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:34.062445 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518b8a7-8acf-4d4c-b39e-e7c233a8f653 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:34.066132 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2704/5404] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:29:34.067809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97490044-8233-46d2-bbc5-011f4fd040f0 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:34.068414 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652eb5d5-6439-48f3-8271-26c6e2c48f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:34.080744 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652eb5d5-6439-48f3-8271-26c6e2c48f54 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:34.081056 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652eb5d5-6439-48f3-8271-26c6e2c48f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:34.081809 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652eb5d5-6439-48f3-8271-26c6e2c48f54 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:34.084175 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652eb5d5-6439-48f3-8271-26c6e2c48f54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:34.086451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652eb5d5-6439-48f3-8271-26c6e2c48f54 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:34.087981 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97490044-8233-46d2-bbc5-011f4fd040f0 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:34.096155 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5558e37-66e2-450f-83cd-397ea09b89b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:34.098285 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5558e37-66e2-450f-83cd-397ea09b89b3 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:34.099044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5558e37-66e2-450f-83cd-397ea09b89b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:34.099580 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5558e37-66e2-450f-83cd-397ea09b89b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:34.102072 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5558e37-66e2-450f-83cd-397ea09b89b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:34.105073 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5558e37-66e2-450f-83cd-397ea09b89b3 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:34.124472 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2705/5405] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:29:34.125438 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5558e37-66e2-450f-83cd-397ea09b89b3 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:34.126829 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2701/5406] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:29:34.132152 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652eb5d5-6439-48f3-8271-26c6e2c48f54 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:34.145344 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5558e37-66e2-450f-83cd-397ea09b89b3 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:34.167351 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652eb5d5-6439-48f3-8271-26c6e2c48f54 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:34.170405 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0448c-d9e2-42cf-bc56-7c999cc3d149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:34.170783 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0448c-d9e2-42cf-bc56-7c999cc3d149 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:34.171072 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0448c-d9e2-42cf-bc56-7c999cc3d149 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:34.171349 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0448c-d9e2-42cf-bc56-7c999cc3d149 admin admin] PATH_INFO: `/v3/projects/4e881eef596f442ea5e731596de728a3/users/c9945e69c5714cd4b1d2667969eaef2a/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:34.176388 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dad453-6fdb-48a2-8363-78718df613e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:34.177317 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dad453-6fdb-48a2-8363-78718df613e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:34.177958 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dad453-6fdb-48a2-8363-78718df613e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:34.178880 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dad453-6fdb-48a2-8363-78718df613e2 admin admin] PATH_INFO: `/v3/projects/a5260d9c3a5f4165873b033b64eba1da/users/d5ad157e93c646c896df7d256eedc4b4/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:34.195858 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dad453-6fdb-48a2-8363-78718df613e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5260d9c3a5f4165873b033b64eba1da, user_id=d5ad157e93c646c896df7d256eedc4b4, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:34.199364 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dad453-6fdb-48a2-8363-78718df613e2 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:34.200311 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d0448c-d9e2-42cf-bc56-7c999cc3d149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e881eef596f442ea5e731596de728a3, user_id=c9945e69c5714cd4b1d2667969eaef2a, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:34.204154 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d0448c-d9e2-42cf-bc56-7c999cc3d149 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:34.306405 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2702/5407] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:29:34 2022] PUT /identity/v3/projects/a5260d9c3a5f4165873b033b64eba1da/users/d5ad157e93c646c896df7d256eedc4b4/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:29:34.307250 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dad453-6fdb-48a2-8363-78718df613e2 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:34.309151 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2706/5408] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:29:34 2022] PUT /identity/v3/projects/4e881eef596f442ea5e731596de728a3/users/c9945e69c5714cd4b1d2667969eaef2a/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:29:34.314972 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99147704-9068-44ce-a48a-b98e5eb590a6 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:34.315578 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99147704-9068-44ce-a48a-b98e5eb590a6 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:34.315866 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99147704-9068-44ce-a48a-b98e5eb590a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:34.366240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-99147704-9068-44ce-a48a-b98e5eb590a6 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:34.367964 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-99147704-9068-44ce-a48a-b98e5eb590a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:34.397285 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dad453-6fdb-48a2-8363-78718df613e2 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:34.534434 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2707/5409] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:29:34.535595 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32164ed9-fd7d-459c-9a8c-adc670dce99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:34.538480 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32164ed9-fd7d-459c-9a8c-adc670dce99a admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:34.538965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32164ed9-fd7d-459c-9a8c-adc670dce99a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:34.539755 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32164ed9-fd7d-459c-9a8c-adc670dce99a admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:34.539889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d098d2-929b-40a2-b5ec-c88179b41ee9 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:34.539889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d098d2-929b-40a2-b5ec-c88179b41ee9 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:34.540156 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d098d2-929b-40a2-b5ec-c88179b41ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:34.541460 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32164ed9-fd7d-459c-9a8c-adc670dce99a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:34.544929 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32164ed9-fd7d-459c-9a8c-adc670dce99a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:34.570213 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2703/5410] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:29:34 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:29:34.576179 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32164ed9-fd7d-459c-9a8c-adc670dce99a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:34.624232 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-65d098d2-929b-40a2-b5ec-c88179b41ee9 None None] MFA Rules not processed for user `d5ad157e93c646c896df7d256eedc4b4`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:34.625746 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-65d098d2-929b-40a2-b5ec-c88179b41ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:34.629464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32164ed9-fd7d-459c-9a8c-adc670dce99a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:34.650157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f56e0-881d-42ed-935f-919dd87a1db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:34.651724 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f56e0-881d-42ed-935f-919dd87a1db4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:34.652022 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f56e0-881d-42ed-935f-919dd87a1db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:34.652307 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f56e0-881d-42ed-935f-919dd87a1db4 admin admin] PATH_INFO: `/v3/projects/ebe19df8503d40afbdd17781c0cf915c/users/666ed7c4c48b4a9886026bcb6151f3bc/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:34.709161 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359f56e0-881d-42ed-935f-919dd87a1db4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebe19df8503d40afbdd17781c0cf915c, user_id=666ed7c4c48b4a9886026bcb6151f3bc, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:34.723698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359f56e0-881d-42ed-935f-919dd87a1db4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:34.745915 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2708/5411] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:29:34.750320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d098d2-929b-40a2-b5ec-c88179b41ee9 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:34.751911 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-65d098d2-929b-40a2-b5ec-c88179b41ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:34.858971 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2704/5412] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:29:34 2022] PUT /identity/v3/projects/ebe19df8503d40afbdd17781c0cf915c/users/666ed7c4c48b4a9886026bcb6151f3bc/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:29:34.860183 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f56e0-881d-42ed-935f-919dd87a1db4 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:34.881805 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d098d2-929b-40a2-b5ec-c88179b41ee9 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:34.980435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb05eb7-56f5-4b3e-b556-9ba6497210ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:34.982308 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb05eb7-56f5-4b3e-b556-9ba6497210ed service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:34.982963 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb05eb7-56f5-4b3e-b556-9ba6497210ed service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:34.983491 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb05eb7-56f5-4b3e-b556-9ba6497210ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:34.989785 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f56e0-881d-42ed-935f-919dd87a1db4 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:35.000816 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb05eb7-56f5-4b3e-b556-9ba6497210ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:35.003333 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb05eb7-56f5-4b3e-b556-9ba6497210ed service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:35.007019 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f15a2e-2755-471c-b7e0-bdcdfd9d9efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:35.007019 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f15a2e-2755-471c-b7e0-bdcdfd9d9efe admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:35.007019 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f15a2e-2755-471c-b7e0-bdcdfd9d9efe admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:35.007019 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f15a2e-2755-471c-b7e0-bdcdfd9d9efe admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:35.007503 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f15a2e-2755-471c-b7e0-bdcdfd9d9efe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:35.009258 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f15a2e-2755-471c-b7e0-bdcdfd9d9efe admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:35.024816 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2709/5413] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:29:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:29:35.026799 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37b2ec-56e1-4f5c-8910-92a1b855927a None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:35.027340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37b2ec-56e1-4f5c-8910-92a1b855927a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:35.027863 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37b2ec-56e1-4f5c-8910-92a1b855927a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:35.062619 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-bf37b2ec-56e1-4f5c-8910-92a1b855927a None None] MFA Rules not processed for user `666ed7c4c48b4a9886026bcb6151f3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:35.064945 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-bf37b2ec-56e1-4f5c-8910-92a1b855927a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:35.132911 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2705/5414] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:29:34 2022] POST /identity/v3/projects => generated 393 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:29:35.136831 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f15a2e-2755-471c-b7e0-bdcdfd9d9efe admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:35.156202 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2710/5415] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:29:35.176803 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37b2ec-56e1-4f5c-8910-92a1b855927a None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:35.212826 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37b2ec-56e1-4f5c-8910-92a1b855927a None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:35.266409 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f15a2e-2755-471c-b7e0-bdcdfd9d9efe admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:35.285243 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d57db1-2bc2-438b-b002-d0f8e68949e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:35.285983 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d57db1-2bc2-438b-b002-d0f8e68949e0 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:35.288793 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d57db1-2bc2-438b-b002-d0f8e68949e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:35.288793 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d57db1-2bc2-438b-b002-d0f8e68949e0 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:35.288793 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d57db1-2bc2-438b-b002-d0f8e68949e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:35.290106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d57db1-2bc2-438b-b002-d0f8e68949e0 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:35.333512 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266e317-6403-4026-8271-41a4c6aa200c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:35.334889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266e317-6403-4026-8271-41a4c6aa200c admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:35.335256 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266e317-6403-4026-8271-41a4c6aa200c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:35.335612 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266e317-6403-4026-8271-41a4c6aa200c admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:35.336380 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266e317-6403-4026-8271-41a4c6aa200c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:35.339028 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266e317-6403-4026-8271-41a4c6aa200c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:35.445887 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2706/5416] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:29:35 2022] POST /identity/v3/users => generated 303 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:29:35.449802 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d57db1-2bc2-438b-b002-d0f8e68949e0 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:35.467776 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d57db1-2bc2-438b-b002-d0f8e68949e0 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:35.489519 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc72cd-c74b-41c9-9034-fb2c1f61357b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:35.489519 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc72cd-c74b-41c9-9034-fb2c1f61357b admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:35.489519 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc72cd-c74b-41c9-9034-fb2c1f61357b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:35.489519 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc72cd-c74b-41c9-9034-fb2c1f61357b admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:35.490148 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc72cd-c74b-41c9-9034-fb2c1f61357b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:35.490148 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc72cd-c74b-41c9-9034-fb2c1f61357b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:35.504178 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2707/5417] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:29:35.512778 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc72cd-c74b-41c9-9034-fb2c1f61357b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:35.527707 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc72cd-c74b-41c9-9034-fb2c1f61357b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:35.542386 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10708a-a3aa-49e9-ad9e-7b7d204f494a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:35.543347 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10708a-a3aa-49e9-ad9e-7b7d204f494a admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:35.543736 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10708a-a3aa-49e9-ad9e-7b7d204f494a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:35.544016 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10708a-a3aa-49e9-ad9e-7b7d204f494a admin admin] PATH_INFO: `/v3/projects/29d795c104c049f2aad1fd515824c28e/users/b64d813723724bb7994e745446fa8837/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:35.552408 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2711/5418] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:29:35 2022] POST /identity/v3/projects => generated 383 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:29:35.556995 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266e317-6403-4026-8271-41a4c6aa200c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:35.576030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c10708a-a3aa-49e9-ad9e-7b7d204f494a admin admin] RBAC: Authorizing `identity:create_grant(project_id=29d795c104c049f2aad1fd515824c28e, user_id=b64d813723724bb7994e745446fa8837, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:35.579405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c10708a-a3aa-49e9-ad9e-7b7d204f494a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:35.660518 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2708/5419] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:29:35 2022] PUT /identity/v3/projects/29d795c104c049f2aad1fd515824c28e/users/b64d813723724bb7994e745446fa8837/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:29:35.664972 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10708a-a3aa-49e9-ad9e-7b7d204f494a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:35.666125 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266e317-6403-4026-8271-41a4c6aa200c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:35.735901 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10708a-a3aa-49e9-ad9e-7b7d204f494a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:35.762182 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa777285-0c37-4d01-a7d7-d87edf7be304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:35.763193 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa777285-0c37-4d01-a7d7-d87edf7be304 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:35.764934 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa777285-0c37-4d01-a7d7-d87edf7be304 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:35.765535 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa777285-0c37-4d01-a7d7-d87edf7be304 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:35.766482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa777285-0c37-4d01-a7d7-d87edf7be304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:35.775465 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa777285-0c37-4d01-a7d7-d87edf7be304 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:35.801074 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583b834-697d-47b5-96dc-c5705274ee13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:35.802503 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583b834-697d-47b5-96dc-c5705274ee13 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:35.803570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583b834-697d-47b5-96dc-c5705274ee13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:35.806081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583b834-697d-47b5-96dc-c5705274ee13 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:35.809612 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a583b834-697d-47b5-96dc-c5705274ee13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:35.811252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a583b834-697d-47b5-96dc-c5705274ee13 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:35.827771 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2709/5420] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:29:35.829025 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa777285-0c37-4d01-a7d7-d87edf7be304 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:35.842342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa777285-0c37-4d01-a7d7-d87edf7be304 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:35.848719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217b52e-d4a2-448e-acad-f89863c9b510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:35.850614 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217b52e-d4a2-448e-acad-f89863c9b510 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:35.851387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217b52e-d4a2-448e-acad-f89863c9b510 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:35.851769 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217b52e-d4a2-448e-acad-f89863c9b510 admin admin] PATH_INFO: `/v3/projects/29d795c104c049f2aad1fd515824c28e/users/b64d813723724bb7994e745446fa8837/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:35.855406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217b52e-d4a2-448e-acad-f89863c9b510 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29d795c104c049f2aad1fd515824c28e, user_id=b64d813723724bb7994e745446fa8837, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:35.860221 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217b52e-d4a2-448e-acad-f89863c9b510 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:35.882584 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2710/5421] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:29:35 2022] PUT /identity/v3/projects/29d795c104c049f2aad1fd515824c28e/users/b64d813723724bb7994e745446fa8837/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:29:35.904038 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7012322-f759-4838-9da3-33513b6cfe34 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:35.904038 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7012322-f759-4838-9da3-33513b6cfe34 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:35.904038 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7012322-f759-4838-9da3-33513b6cfe34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:35.941986 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2712/5422] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:29:35 2022] POST /identity/v3/users => generated 298 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:29:35.945239 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583b834-697d-47b5-96dc-c5705274ee13 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:35.960943 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-c7012322-f759-4838-9da3-33513b6cfe34 None None] MFA Rules not processed for user `b64d813723724bb7994e745446fa8837`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:35.963713 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583b834-697d-47b5-96dc-c5705274ee13 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:35.964780 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c7012322-f759-4838-9da3-33513b6cfe34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:36.102820 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e62dc-b500-4f0a-9350-4fd5695fe6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:36.103954 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e62dc-b500-4f0a-9350-4fd5695fe6da admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:36.104086 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e62dc-b500-4f0a-9350-4fd5695fe6da admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:36.104274 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e62dc-b500-4f0a-9350-4fd5695fe6da admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:36.105005 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e62dc-b500-4f0a-9350-4fd5695fe6da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:36.108546 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e62dc-b500-4f0a-9350-4fd5695fe6da admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:36.126764 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2713/5423] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:29:36.126994 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2711/5424] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:35 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:29:36.127112 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e62dc-b500-4f0a-9350-4fd5695fe6da admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:36.135204 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7012322-f759-4838-9da3-33513b6cfe34 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:36.137374 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c7012322-f759-4838-9da3-33513b6cfe34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:36.142558 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e62dc-b500-4f0a-9350-4fd5695fe6da admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:36.150487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8dc46-b5dc-4b4e-9e19-9883b739a010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:36.151807 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8dc46-b5dc-4b4e-9e19-9883b739a010 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:36.152098 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8dc46-b5dc-4b4e-9e19-9883b739a010 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:36.152385 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8dc46-b5dc-4b4e-9e19-9883b739a010 admin admin] PATH_INFO: `/v3/projects/1e8211ae0294466dad4012b125fc416f/users/a69b7272fff74daf96829bc4645b6639/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:36.206295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c8dc46-b5dc-4b4e-9e19-9883b739a010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e8211ae0294466dad4012b125fc416f, user_id=a69b7272fff74daf96829bc4645b6639, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:36.210527 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c8dc46-b5dc-4b4e-9e19-9883b739a010 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:36.215981 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7012322-f759-4838-9da3-33513b6cfe34 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:36.220552 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846adb1-9bfb-46f7-9273-6e3af403220d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:36.221461 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846adb1-9bfb-46f7-9273-6e3af403220d service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:36.221983 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846adb1-9bfb-46f7-9273-6e3af403220d service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:36.222478 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846adb1-9bfb-46f7-9273-6e3af403220d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:36.234266 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846adb1-9bfb-46f7-9273-6e3af403220d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:36.237181 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846adb1-9bfb-46f7-9273-6e3af403220d service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:36.251211 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2712/5425] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:29:36 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:29:36.332130 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846adb1-9bfb-46f7-9273-6e3af403220d service cinder] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:36.344782 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846adb1-9bfb-46f7-9273-6e3af403220d service cinder] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:36.358781 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2714/5426] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:29:36 2022] PUT /identity/v3/projects/1e8211ae0294466dad4012b125fc416f/users/a69b7272fff74daf96829bc4645b6639/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:29:36.363843 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8dc46-b5dc-4b4e-9e19-9883b739a010 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:36.368327 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbeef67-211c-4750-9c20-fc3b3e3b0eeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:36.369293 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbeef67-211c-4750-9c20-fc3b3e3b0eeb service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:36.369831 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbeef67-211c-4750-9c20-fc3b3e3b0eeb service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:36.370614 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbeef67-211c-4750-9c20-fc3b3e3b0eeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:36.450710 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbeef67-211c-4750-9c20-fc3b3e3b0eeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:36.452443 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbeef67-211c-4750-9c20-fc3b3e3b0eeb service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:36.460989 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8dc46-b5dc-4b4e-9e19-9883b739a010 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:36.466493 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec9bce-3864-4daa-8013-27fdeb6c8345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:36.467467 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec9bce-3864-4daa-8013-27fdeb6c8345 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:36.468103 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec9bce-3864-4daa-8013-27fdeb6c8345 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:36.468524 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2713/5427] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:29:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:29:36.468949 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec9bce-3864-4daa-8013-27fdeb6c8345 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:36.469694 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dec9bce-3864-4daa-8013-27fdeb6c8345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:36.471736 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dec9bce-3864-4daa-8013-27fdeb6c8345 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:36.483391 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2715/5428] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:29:36.486948 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbeef67-211c-4750-9c20-fc3b3e3b0eeb service cinder] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:36.503169 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbeef67-211c-4750-9c20-fc3b3e3b0eeb service cinder] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:36.510021 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404cd705-9835-4983-9e0e-8a16b9b88fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:36.510915 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404cd705-9835-4983-9e0e-8a16b9b88fcf admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:36.511194 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404cd705-9835-4983-9e0e-8a16b9b88fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:36.511466 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404cd705-9835-4983-9e0e-8a16b9b88fcf admin admin] PATH_INFO: `/v3/projects/1e8211ae0294466dad4012b125fc416f/users/a69b7272fff74daf96829bc4645b6639/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:36.514072 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404cd705-9835-4983-9e0e-8a16b9b88fcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e8211ae0294466dad4012b125fc416f, user_id=a69b7272fff74daf96829bc4645b6639, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:36.518424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404cd705-9835-4983-9e0e-8a16b9b88fcf admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:36.541835 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2714/5429] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:29:36 2022] PUT /identity/v3/projects/1e8211ae0294466dad4012b125fc416f/users/a69b7272fff74daf96829bc4645b6639/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:29:36.550670 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004e727-77af-49a0-a5e3-505e4b4396ed None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:36.551074 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004e727-77af-49a0-a5e3-505e4b4396ed None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:36.551452 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004e727-77af-49a0-a5e3-505e4b4396ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:36.594815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-2004e727-77af-49a0-a5e3-505e4b4396ed None None] MFA Rules not processed for user `a69b7272fff74daf96829bc4645b6639`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:36.605433 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2004e727-77af-49a0-a5e3-505e4b4396ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:36.780289 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2716/5430] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:29:36.797640 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404cd705-9835-4983-9e0e-8a16b9b88fcf admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:36.799570 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-404cd705-9835-4983-9e0e-8a16b9b88fcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:36.940024 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404cd705-9835-4983-9e0e-8a16b9b88fcf admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:36.957696 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d726f4-fda3-4e48-a627-63a988fd71a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:36.958539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d726f4-fda3-4e48-a627-63a988fd71a8 service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:36.958828 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d726f4-fda3-4e48-a627-63a988fd71a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:36.959108 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d726f4-fda3-4e48-a627-63a988fd71a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:37.069988 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d726f4-fda3-4e48-a627-63a988fd71a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:37.071492 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d726f4-fda3-4e48-a627-63a988fd71a8 service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:37.100454 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2715/5431] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:29:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:29:38.534386 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b612e-f402-4bd2-ad5f-a103c1a1ac69 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:38.535221 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b612e-f402-4bd2-ad5f-a103c1a1ac69 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:38.535676 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b612e-f402-4bd2-ad5f-a103c1a1ac69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:38.604634 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-091b612e-f402-4bd2-ad5f-a103c1a1ac69 None None] MFA Rules not processed for user `c9945e69c5714cd4b1d2667969eaef2a`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:38.605999 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-091b612e-f402-4bd2-ad5f-a103c1a1ac69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:38.752206 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c37c3-963a-4139-98d0-9d2eeee4cfe0 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:38.753354 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c37c3-963a-4139-98d0-9d2eeee4cfe0 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:38.753892 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c37c3-963a-4139-98d0-9d2eeee4cfe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:38.755426 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2717/5432] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:29:38.797728 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-766c37c3-963a-4139-98d0-9d2eeee4cfe0 None None] MFA Rules not processed for user `c9945e69c5714cd4b1d2667969eaef2a`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:38.799263 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-766c37c3-963a-4139-98d0-9d2eeee4cfe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:38.836805 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2716/5433] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:29:38.844574 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b612e-f402-4bd2-ad5f-a103c1a1ac69 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:38.846916 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-091b612e-f402-4bd2-ad5f-a103c1a1ac69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:39.037024 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b612e-f402-4bd2-ad5f-a103c1a1ac69 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:39.044584 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3979a1-0bb8-4047-9d49-5af5a1d01dbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:39.045435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3979a1-0bb8-4047-9d49-5af5a1d01dbc service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:39.045727 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3979a1-0bb8-4047-9d49-5af5a1d01dbc service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:39.046075 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3979a1-0bb8-4047-9d49-5af5a1d01dbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:39.095963 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3979a1-0bb8-4047-9d49-5af5a1d01dbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:39.101683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3979a1-0bb8-4047-9d49-5af5a1d01dbc service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:39.129611 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2718/5434] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:29:38 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:29:41.266600 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c37c3-963a-4139-98d0-9d2eeee4cfe0 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:41.267283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-766c37c3-963a-4139-98d0-9d2eeee4cfe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:41.360618 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c37c3-963a-4139-98d0-9d2eeee4cfe0 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:41.365667 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f462d6-2818-486a-bfe2-07c333e03592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:41.370087 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f462d6-2818-486a-bfe2-07c333e03592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:41.370087 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f462d6-2818-486a-bfe2-07c333e03592 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:41.370087 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f462d6-2818-486a-bfe2-07c333e03592 admin admin] PATH_INFO: `/v3/users/af1585cd61ba445eba82fb0b5c74a460` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:41.405833 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f462d6-2818-486a-bfe2-07c333e03592 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af1585cd61ba445eba82fb0b5c74a460)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:41.408137 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f462d6-2818-486a-bfe2-07c333e03592 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:41.708059 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b0f462d6-2818-486a-bfe2-07c333e03592 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af1585cd61ba445eba82fb0b5c74a460'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:41.728681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b0f462d6-2818-486a-bfe2-07c333e03592 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af1585cd61ba445eba82fb0b5c74a460'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:41.822247 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b0f462d6-2818-486a-bfe2-07c333e03592 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af1585cd61ba445eba82fb0b5c74a460'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:41.823027 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b0f462d6-2818-486a-bfe2-07c333e03592 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af1585cd61ba445eba82fb0b5c74a460'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:41.831233 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b0f462d6-2818-486a-bfe2-07c333e03592 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af1585cd61ba445eba82fb0b5c74a460'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:41.838296 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2717/5435] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:29:41 2022] DELETE /identity/v3/users/af1585cd61ba445eba82fb0b5c74a460 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:29:42.393253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3979a1-0bb8-4047-9d49-5af5a1d01dbc service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:42.406222 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3979a1-0bb8-4047-9d49-5af5a1d01dbc service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:42.518979 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d198c63-3477-42da-a8c3-01a6c2c5a37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:42.519849 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d198c63-3477-42da-a8c3-01a6c2c5a37d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:42.520132 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d198c63-3477-42da-a8c3-01a6c2c5a37d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:42.520622 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d198c63-3477-42da-a8c3-01a6c2c5a37d admin admin] PATH_INFO: `/v3/projects/b81eb3fcf4664f479119191dbc28bf07` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:42.533615 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d198c63-3477-42da-a8c3-01a6c2c5a37d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b81eb3fcf4664f479119191dbc28bf07)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:42.539671 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d198c63-3477-42da-a8c3-01a6c2c5a37d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:42.676018 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7d198c63-3477-42da-a8c3-01a6c2c5a37d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b81eb3fcf4664f479119191dbc28bf07', 'request_id': 'req-7d198c63-3477-42da-a8c3-01a6c2c5a37d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:42.692442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7d198c63-3477-42da-a8c3-01a6c2c5a37d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b81eb3fcf4664f479119191dbc28bf07', 'request_id': 'req-7d198c63-3477-42da-a8c3-01a6c2c5a37d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:42.702330 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7d198c63-3477-42da-a8c3-01a6c2c5a37d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b81eb3fcf4664f479119191dbc28bf07', 'request_id': 'req-7d198c63-3477-42da-a8c3-01a6c2c5a37d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:42.796340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7d198c63-3477-42da-a8c3-01a6c2c5a37d admin admin] The token cache is being invalidate because project b81eb3fcf4664f479119191dbc28bf07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:29:42.797320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7d198c63-3477-42da-a8c3-01a6c2c5a37d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:42.798876 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7d198c63-3477-42da-a8c3-01a6c2c5a37d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:42.805829 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f462d6-2818-486a-bfe2-07c333e03592 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:42.806345 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2719/5436] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:29:42 2022] DELETE /identity/v3/projects/b81eb3fcf4664f479119191dbc28bf07 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:29:42.807415 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b0f462d6-2818-486a-bfe2-07c333e03592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:42.825703 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f462d6-2818-486a-bfe2-07c333e03592 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:42.894253 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5395d84-1da6-40af-9b36-0681347efa8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:42.895320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5395d84-1da6-40af-9b36-0681347efa8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:42.895605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5395d84-1da6-40af-9b36-0681347efa8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:42.896086 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5395d84-1da6-40af-9b36-0681347efa8d admin admin] PATH_INFO: `/v3/users/6d4baa7f101f47abb43077f08e5bcc49` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:42.898102 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5395d84-1da6-40af-9b36-0681347efa8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d4baa7f101f47abb43077f08e5bcc49)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:42.900111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5395d84-1da6-40af-9b36-0681347efa8d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:43.159633 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f5395d84-1da6-40af-9b36-0681347efa8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d4baa7f101f47abb43077f08e5bcc49'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:43.194092 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f5395d84-1da6-40af-9b36-0681347efa8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d4baa7f101f47abb43077f08e5bcc49'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:43.314107 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f5395d84-1da6-40af-9b36-0681347efa8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d4baa7f101f47abb43077f08e5bcc49'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:43.314809 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f5395d84-1da6-40af-9b36-0681347efa8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d4baa7f101f47abb43077f08e5bcc49'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:43.338276 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f5395d84-1da6-40af-9b36-0681347efa8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d4baa7f101f47abb43077f08e5bcc49'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:43.348280 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2718/5437] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:29:42 2022] DELETE /identity/v3/users/6d4baa7f101f47abb43077f08e5bcc49 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:29:43.958497 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d198c63-3477-42da-a8c3-01a6c2c5a37d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:43.969331 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7d198c63-3477-42da-a8c3-01a6c2c5a37d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:44.002699 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d198c63-3477-42da-a8c3-01a6c2c5a37d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:44.120098 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a80aa-44c2-4849-97f9-8e9c658b0041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:44.122282 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a80aa-44c2-4849-97f9-8e9c658b0041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:44.122622 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a80aa-44c2-4849-97f9-8e9c658b0041 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:44.124325 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a80aa-44c2-4849-97f9-8e9c658b0041 admin admin] PATH_INFO: `/v3/projects/304c976f80084864bd575fad9d2fbf90` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:44.127417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275a80aa-44c2-4849-97f9-8e9c658b0041 admin admin] RBAC: Authorizing `identity:delete_project(project_id=304c976f80084864bd575fad9d2fbf90)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:44.128136 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275a80aa-44c2-4849-97f9-8e9c658b0041 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:44.353965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-275a80aa-44c2-4849-97f9-8e9c658b0041 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '304c976f80084864bd575fad9d2fbf90', 'request_id': 'req-275a80aa-44c2-4849-97f9-8e9c658b0041'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:44.364813 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-275a80aa-44c2-4849-97f9-8e9c658b0041 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '304c976f80084864bd575fad9d2fbf90', 'request_id': 'req-275a80aa-44c2-4849-97f9-8e9c658b0041'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:44.383118 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-275a80aa-44c2-4849-97f9-8e9c658b0041 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '304c976f80084864bd575fad9d2fbf90', 'request_id': 'req-275a80aa-44c2-4849-97f9-8e9c658b0041'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:44.490952 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-275a80aa-44c2-4849-97f9-8e9c658b0041 admin admin] The token cache is being invalidate because project 304c976f80084864bd575fad9d2fbf90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:29:44.490952 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-275a80aa-44c2-4849-97f9-8e9c658b0041 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:44.490952 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-275a80aa-44c2-4849-97f9-8e9c658b0041 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:44.491804 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2720/5438] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:29:43 2022] DELETE /identity/v3/projects/304c976f80084864bd575fad9d2fbf90 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:29:44.496893 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd6037-b2c6-4ec7-a5e9-25d1ccfbfd0e None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:44.497508 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd6037-b2c6-4ec7-a5e9-25d1ccfbfd0e None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:44.497852 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd6037-b2c6-4ec7-a5e9-25d1ccfbfd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:44.551362 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-1fbd6037-b2c6-4ec7-a5e9-25d1ccfbfd0e None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:44.555543 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1fbd6037-b2c6-4ec7-a5e9-25d1ccfbfd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:44.637453 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2719/5439] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:29:44.647273 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7623395-6f38-429b-80ca-3a241c685568 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:44.647740 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7623395-6f38-429b-80ca-3a241c685568 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:44.648549 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7623395-6f38-429b-80ca-3a241c685568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:44.678948 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-f7623395-6f38-429b-80ca-3a241c685568 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:44.681057 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f7623395-6f38-429b-80ca-3a241c685568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:44.700949 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2721/5440] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:29:44.702089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd6037-b2c6-4ec7-a5e9-25d1ccfbfd0e None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:44.714041 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd6037-b2c6-4ec7-a5e9-25d1ccfbfd0e None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:44.719128 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793933c6-ae24-4658-a8bc-115337f077fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:44.720665 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793933c6-ae24-4658-a8bc-115337f077fc admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:44.721118 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793933c6-ae24-4658-a8bc-115337f077fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:44.721402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793933c6-ae24-4658-a8bc-115337f077fc admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:44.722308 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793933c6-ae24-4658-a8bc-115337f077fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:29:44.722614 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793933c6-ae24-4658-a8bc-115337f077fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:44.724481 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793933c6-ae24-4658-a8bc-115337f077fc admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:44.737447 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2720/5441] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:29:44.742533 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7623395-6f38-429b-80ca-3a241c685568 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:44.752643 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7623395-6f38-429b-80ca-3a241c685568 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:44.759826 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6dd79-d8d5-495f-8251-6e4fb1fd96dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:44.760704 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6dd79-d8d5-495f-8251-6e4fb1fd96dd admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:44.765654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6dd79-d8d5-495f-8251-6e4fb1fd96dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:44.765654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6dd79-d8d5-495f-8251-6e4fb1fd96dd admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:44.765654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6dd79-d8d5-495f-8251-6e4fb1fd96dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:44.765654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6dd79-d8d5-495f-8251-6e4fb1fd96dd admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:44.931959 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793933c6-ae24-4658-a8bc-115337f077fc admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:44.933084 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2722/5442] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:29:44 2022] POST /identity/v3/projects => generated 383 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:29:44.955863 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793933c6-ae24-4658-a8bc-115337f077fc admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:45.066539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353fcc1-6a70-4ccb-b469-92a4dfc52f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:45.067679 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353fcc1-6a70-4ccb-b469-92a4dfc52f69 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:45.068180 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353fcc1-6a70-4ccb-b469-92a4dfc52f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:45.068642 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353fcc1-6a70-4ccb-b469-92a4dfc52f69 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:45.070160 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e353fcc1-6a70-4ccb-b469-92a4dfc52f69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:45.072366 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e353fcc1-6a70-4ccb-b469-92a4dfc52f69 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:45.179103 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2721/5443] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:29:44 2022] POST /identity/v3/users => generated 292 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:29:45.179653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6dd79-d8d5-495f-8251-6e4fb1fd96dd admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:45.196662 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6dd79-d8d5-495f-8251-6e4fb1fd96dd admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:45.201949 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdca574-13f1-45ee-b8b8-c4ccc6bf9082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:45.203424 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdca574-13f1-45ee-b8b8-c4ccc6bf9082 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:45.203891 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdca574-13f1-45ee-b8b8-c4ccc6bf9082 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:45.204530 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdca574-13f1-45ee-b8b8-c4ccc6bf9082 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:45.205276 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdca574-13f1-45ee-b8b8-c4ccc6bf9082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:45.207348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdca574-13f1-45ee-b8b8-c4ccc6bf9082 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:45.221640 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2723/5444] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:29:45.226102 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353fcc1-6a70-4ccb-b469-92a4dfc52f69 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:45.241002 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353fcc1-6a70-4ccb-b469-92a4dfc52f69 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:45.249234 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a08c34-bb47-46c7-915f-1095b4f8e1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:45.250126 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a08c34-bb47-46c7-915f-1095b4f8e1bd admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:45.250862 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a08c34-bb47-46c7-915f-1095b4f8e1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:45.252299 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a08c34-bb47-46c7-915f-1095b4f8e1bd admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:45.253315 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a08c34-bb47-46c7-915f-1095b4f8e1bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:45.255429 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a08c34-bb47-46c7-915f-1095b4f8e1bd admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:45.276206 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2722/5445] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:29:45 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:29:45.288705 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdca574-13f1-45ee-b8b8-c4ccc6bf9082 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:45.313728 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdca574-13f1-45ee-b8b8-c4ccc6bf9082 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:45.323715 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812416ee-ddaa-4d8d-aef5-caeb7c51c368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:45.325021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812416ee-ddaa-4d8d-aef5-caeb7c51c368 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:45.326062 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812416ee-ddaa-4d8d-aef5-caeb7c51c368 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:45.326600 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812416ee-ddaa-4d8d-aef5-caeb7c51c368 admin admin] PATH_INFO: `/v3/projects/af7d810b16a945cc921509e1c20d101d/users/f3e406059e394bc89a1bb7609c8d4236/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:45.346987 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812416ee-ddaa-4d8d-aef5-caeb7c51c368 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af7d810b16a945cc921509e1c20d101d, user_id=f3e406059e394bc89a1bb7609c8d4236, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:45.350616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812416ee-ddaa-4d8d-aef5-caeb7c51c368 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:45.450665 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2724/5446] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:29:45 2022] PUT /identity/v3/projects/af7d810b16a945cc921509e1c20d101d/users/f3e406059e394bc89a1bb7609c8d4236/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:29:45.452486 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da93376-4e7e-4b2d-816c-276827abca90 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:45.452783 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da93376-4e7e-4b2d-816c-276827abca90 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:45.453068 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da93376-4e7e-4b2d-816c-276827abca90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:45.472675 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-7da93376-4e7e-4b2d-816c-276827abca90 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:45.474089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7da93376-4e7e-4b2d-816c-276827abca90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:45.551862 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2723/5447] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:29:45.576252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812416ee-ddaa-4d8d-aef5-caeb7c51c368 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:45.578412 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-812416ee-ddaa-4d8d-aef5-caeb7c51c368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:45.649885 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812416ee-ddaa-4d8d-aef5-caeb7c51c368 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:45.653990 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c844496-cefc-4f74-96a5-7d654f0325a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:45.654653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c844496-cefc-4f74-96a5-7d654f0325a3 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:45.654940 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c844496-cefc-4f74-96a5-7d654f0325a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:45.655220 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c844496-cefc-4f74-96a5-7d654f0325a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:45.666357 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c844496-cefc-4f74-96a5-7d654f0325a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:45.667781 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c844496-cefc-4f74-96a5-7d654f0325a3 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:45.679640 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2725/5448] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:29:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:29:46.314025 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da93376-4e7e-4b2d-816c-276827abca90 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:46.316979 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7da93376-4e7e-4b2d-816c-276827abca90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:46.447326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da93376-4e7e-4b2d-816c-276827abca90 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:46.454194 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdab93a-11bc-4db6-b791-7fb2187ee104 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:46.454919 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdab93a-11bc-4db6-b791-7fb2187ee104 service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:46.455219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdab93a-11bc-4db6-b791-7fb2187ee104 service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:46.455499 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdab93a-11bc-4db6-b791-7fb2187ee104 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:46.458425 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-cbdab93a-11bc-4db6-b791-7fb2187ee104 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:46.574071 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdab93a-11bc-4db6-b791-7fb2187ee104 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:46.576035 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdab93a-11bc-4db6-b791-7fb2187ee104 service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:46.593614 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2724/5449] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:29:46 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:29:48.794318 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c844496-cefc-4f74-96a5-7d654f0325a3 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:48.796331 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0c844496-cefc-4f74-96a5-7d654f0325a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:48.814759 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c844496-cefc-4f74-96a5-7d654f0325a3 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:48.831231 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f94a5-7af3-42af-a6ff-8a7027974872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:48.832370 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f94a5-7af3-42af-a6ff-8a7027974872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:48.833340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f94a5-7af3-42af-a6ff-8a7027974872 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:48.833340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f94a5-7af3-42af-a6ff-8a7027974872 admin admin] PATH_INFO: `/v3/users/d5ad157e93c646c896df7d256eedc4b4` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:48.835813 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1f94a5-7af3-42af-a6ff-8a7027974872 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5ad157e93c646c896df7d256eedc4b4)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:48.837972 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1f94a5-7af3-42af-a6ff-8a7027974872 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:49.109691 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f711dd4-1e23-471f-8583-4d147a33507d None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:49.111626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f711dd4-1e23-471f-8583-4d147a33507d None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:49.112115 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f711dd4-1e23-471f-8583-4d147a33507d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:49.138336 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2e1f94a5-7af3-42af-a6ff-8a7027974872 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5ad157e93c646c896df7d256eedc4b4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:49.161732 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2e1f94a5-7af3-42af-a6ff-8a7027974872 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5ad157e93c646c896df7d256eedc4b4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:49.177552 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-2f711dd4-1e23-471f-8583-4d147a33507d None None] MFA Rules not processed for user `f3e406059e394bc89a1bb7609c8d4236`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:49.179484 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2f711dd4-1e23-471f-8583-4d147a33507d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:49.236790 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2e1f94a5-7af3-42af-a6ff-8a7027974872 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5ad157e93c646c896df7d256eedc4b4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:49.251803 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2e1f94a5-7af3-42af-a6ff-8a7027974872 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5ad157e93c646c896df7d256eedc4b4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:49.253591 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2e1f94a5-7af3-42af-a6ff-8a7027974872 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5ad157e93c646c896df7d256eedc4b4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:49.288338 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2726/5450] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:29:48 2022] DELETE /identity/v3/users/d5ad157e93c646c896df7d256eedc4b4 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:29:49.292739 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e169092-a5cb-462f-9568-9c163d02f15b None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:49.293235 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e169092-a5cb-462f-9568-9c163d02f15b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:49.293692 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e169092-a5cb-462f-9568-9c163d02f15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:49.331329 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2725/5451] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:29:49.334141 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-7e169092-a5cb-462f-9568-9c163d02f15b None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:49.336024 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7e169092-a5cb-462f-9568-9c163d02f15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:49.344887 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba6775-18f8-4ad5-83e9-51f416ebdda5 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:49.345145 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba6775-18f8-4ad5-83e9-51f416ebdda5 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:49.345480 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba6775-18f8-4ad5-83e9-51f416ebdda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:49.413415 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-39ba6775-18f8-4ad5-83e9-51f416ebdda5 None None] MFA Rules not processed for user `f3e406059e394bc89a1bb7609c8d4236`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:49.415799 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-39ba6775-18f8-4ad5-83e9-51f416ebdda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:49.454563 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2727/5452] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:29:49.472573 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e169092-a5cb-462f-9568-9c163d02f15b None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:49.474088 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7e169092-a5cb-462f-9568-9c163d02f15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:49.497868 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2726/5453] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:29:49.544850 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e169092-a5cb-462f-9568-9c163d02f15b None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:49.548633 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3892f76-d836-428b-82f4-2358536b855a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:49.549300 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3892f76-d836-428b-82f4-2358536b855a service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:49.549586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3892f76-d836-428b-82f4-2358536b855a service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:49.549920 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3892f76-d836-428b-82f4-2358536b855a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:49.560241 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3892f76-d836-428b-82f4-2358536b855a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:49.563112 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3892f76-d836-428b-82f4-2358536b855a service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:49.572093 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2728/5454] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:29:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:29:49.683292 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba6775-18f8-4ad5-83e9-51f416ebdda5 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:49.684758 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-39ba6775-18f8-4ad5-83e9-51f416ebdda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:49.702619 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba6775-18f8-4ad5-83e9-51f416ebdda5 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:49.709778 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092eea7-3e9b-4c32-b17c-bb009912a538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:49.710677 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092eea7-3e9b-4c32-b17c-bb009912a538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:49.710958 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092eea7-3e9b-4c32-b17c-bb009912a538 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:49.711330 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092eea7-3e9b-4c32-b17c-bb009912a538 admin admin] PATH_INFO: `/v3/users/b1e2bb9650c348bf9eac1b66e23d38af` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:49.712795 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092eea7-3e9b-4c32-b17c-bb009912a538 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1e2bb9650c348bf9eac1b66e23d38af)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:49.714892 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092eea7-3e9b-4c32-b17c-bb009912a538 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:49.738333 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3892f76-d836-428b-82f4-2358536b855a service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:49.740525 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f3892f76-d836-428b-82f4-2358536b855a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:49.822730 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3892f76-d836-428b-82f4-2358536b855a service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:49.828991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c06d5b-a192-4265-b041-14a85ac6206f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:49.829925 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c06d5b-a192-4265-b041-14a85ac6206f service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:49.830213 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c06d5b-a192-4265-b041-14a85ac6206f service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:49.830493 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c06d5b-a192-4265-b041-14a85ac6206f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:49.840179 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c06d5b-a192-4265-b041-14a85ac6206f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:49.842076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c06d5b-a192-4265-b041-14a85ac6206f service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:49.853531 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2729/5455] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:29:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:29:49.931755 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2092eea7-3e9b-4c32-b17c-bb009912a538 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1e2bb9650c348bf9eac1b66e23d38af'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:49.949186 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2092eea7-3e9b-4c32-b17c-bb009912a538 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1e2bb9650c348bf9eac1b66e23d38af'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:50.047622 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2092eea7-3e9b-4c32-b17c-bb009912a538 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1e2bb9650c348bf9eac1b66e23d38af'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:50.052019 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2092eea7-3e9b-4c32-b17c-bb009912a538 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1e2bb9650c348bf9eac1b66e23d38af'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:50.067729 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2092eea7-3e9b-4c32-b17c-bb009912a538 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1e2bb9650c348bf9eac1b66e23d38af'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:50.079467 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2727/5456] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:29:49 2022] DELETE /identity/v3/users/b1e2bb9650c348bf9eac1b66e23d38af => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:29:50.084271 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c5552-48f3-4642-923d-e40cf784d2a6 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:50.084559 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c5552-48f3-4642-923d-e40cf784d2a6 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:50.084829 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c5552-48f3-4642-923d-e40cf784d2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:50.103098 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-a17c5552-48f3-4642-923d-e40cf784d2a6 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:50.104299 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a17c5552-48f3-4642-923d-e40cf784d2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:50.147950 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092eea7-3e9b-4c32-b17c-bb009912a538 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:50.150083 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2092eea7-3e9b-4c32-b17c-bb009912a538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:50.186388 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2730/5457] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:29:50.202180 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c5552-48f3-4642-923d-e40cf784d2a6 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:50.207290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a17c5552-48f3-4642-923d-e40cf784d2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:50.247008 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092eea7-3e9b-4c32-b17c-bb009912a538 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:50.256570 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe0143-04e9-4330-bee0-ac69a3df8ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:50.256570 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe0143-04e9-4330-bee0-ac69a3df8ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:50.256570 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe0143-04e9-4330-bee0-ac69a3df8ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:50.256570 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe0143-04e9-4330-bee0-ac69a3df8ca5 admin admin] PATH_INFO: `/v3/projects/a5260d9c3a5f4165873b033b64eba1da` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:50.257150 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe0143-04e9-4330-bee0-ac69a3df8ca5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5260d9c3a5f4165873b033b64eba1da)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:50.260254 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe0143-04e9-4330-bee0-ac69a3df8ca5 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:50.329977 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c5552-48f3-4642-923d-e40cf784d2a6 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:50.341407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be9126-fed5-4ca3-b30e-479bce5dc0ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:50.342260 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be9126-fed5-4ca3-b30e-479bce5dc0ba service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:50.348252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be9126-fed5-4ca3-b30e-479bce5dc0ba service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:50.348252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be9126-fed5-4ca3-b30e-479bce5dc0ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:50.355393 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58be9126-fed5-4ca3-b30e-479bce5dc0ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:50.357684 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58be9126-fed5-4ca3-b30e-479bce5dc0ba service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:50.371896 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2731/5458] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:29:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:29:50.479050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-99fe0143-04e9-4330-bee0-ac69a3df8ca5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5260d9c3a5f4165873b033b64eba1da', 'request_id': 'req-99fe0143-04e9-4330-bee0-ac69a3df8ca5'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:50.486618 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-99fe0143-04e9-4330-bee0-ac69a3df8ca5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5260d9c3a5f4165873b033b64eba1da', 'request_id': 'req-99fe0143-04e9-4330-bee0-ac69a3df8ca5'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:50.494966 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-99fe0143-04e9-4330-bee0-ac69a3df8ca5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5260d9c3a5f4165873b033b64eba1da', 'request_id': 'req-99fe0143-04e9-4330-bee0-ac69a3df8ca5'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:50.628429 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-99fe0143-04e9-4330-bee0-ac69a3df8ca5 admin admin] The token cache is being invalidate because project a5260d9c3a5f4165873b033b64eba1da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:29:50.630823 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-99fe0143-04e9-4330-bee0-ac69a3df8ca5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:50.632870 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-99fe0143-04e9-4330-bee0-ac69a3df8ca5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:50.636209 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2728/5459] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:29:50 2022] DELETE /identity/v3/projects/a5260d9c3a5f4165873b033b64eba1da => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:29:50.639866 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be9126-fed5-4ca3-b30e-479bce5dc0ba service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:50.654680 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be9126-fed5-4ca3-b30e-479bce5dc0ba service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:50.789889 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe0143-04e9-4330-bee0-ac69a3df8ca5 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:50.792003 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-99fe0143-04e9-4330-bee0-ac69a3df8ca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:50.794731 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9710cb-2c2c-4d56-a934-f609fb215d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:50.795593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9710cb-2c2c-4d56-a934-f609fb215d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:50.795938 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9710cb-2c2c-4d56-a934-f609fb215d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:50.796279 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9710cb-2c2c-4d56-a934-f609fb215d3d admin admin] PATH_INFO: `/v3/users/b64d813723724bb7994e745446fa8837` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:50.797872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9710cb-2c2c-4d56-a934-f609fb215d3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b64d813723724bb7994e745446fa8837)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:50.804316 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9710cb-2c2c-4d56-a934-f609fb215d3d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:50.834380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe0143-04e9-4330-bee0-ac69a3df8ca5 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:50.843328 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d5224-8fc7-41b3-8a2b-3cdc95fb584c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:50.846727 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d5224-8fc7-41b3-8a2b-3cdc95fb584c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:50.847232 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d5224-8fc7-41b3-8a2b-3cdc95fb584c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:50.848179 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d5224-8fc7-41b3-8a2b-3cdc95fb584c admin admin] PATH_INFO: `/v3/projects/36942406614e4c688cd6205c1abe8338` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:50.851426 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d5224-8fc7-41b3-8a2b-3cdc95fb584c admin admin] RBAC: Authorizing `identity:delete_project(project_id=36942406614e4c688cd6205c1abe8338)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:50.854453 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d5224-8fc7-41b3-8a2b-3cdc95fb584c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:51.193191 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bc9710cb-2c2c-4d56-a934-f609fb215d3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b64d813723724bb7994e745446fa8837'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:51.195302 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8b2d5224-8fc7-41b3-8a2b-3cdc95fb584c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36942406614e4c688cd6205c1abe8338', 'request_id': 'req-8b2d5224-8fc7-41b3-8a2b-3cdc95fb584c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:51.202876 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8b2d5224-8fc7-41b3-8a2b-3cdc95fb584c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36942406614e4c688cd6205c1abe8338', 'request_id': 'req-8b2d5224-8fc7-41b3-8a2b-3cdc95fb584c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:51.214522 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8b2d5224-8fc7-41b3-8a2b-3cdc95fb584c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36942406614e4c688cd6205c1abe8338', 'request_id': 'req-8b2d5224-8fc7-41b3-8a2b-3cdc95fb584c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:51.227400 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bc9710cb-2c2c-4d56-a934-f609fb215d3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b64d813723724bb7994e745446fa8837'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:51.341747 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8b2d5224-8fc7-41b3-8a2b-3cdc95fb584c admin admin] The token cache is being invalidate because project 36942406614e4c688cd6205c1abe8338 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:29:51.342719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8b2d5224-8fc7-41b3-8a2b-3cdc95fb584c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:51.343392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8b2d5224-8fc7-41b3-8a2b-3cdc95fb584c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:51.345195 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2729/5460] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:29:50 2022] DELETE /identity/v3/projects/36942406614e4c688cd6205c1abe8338 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:29:51.349235 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d5224-8fc7-41b3-8a2b-3cdc95fb584c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:51.351179 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8b2d5224-8fc7-41b3-8a2b-3cdc95fb584c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:51.438692 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d5224-8fc7-41b3-8a2b-3cdc95fb584c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:51.443488 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1fed52-0641-4c6e-be6b-2980f0af9701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:51.444243 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1fed52-0641-4c6e-be6b-2980f0af9701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:51.444530 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1fed52-0641-4c6e-be6b-2980f0af9701 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:51.444836 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1fed52-0641-4c6e-be6b-2980f0af9701 admin admin] PATH_INFO: `/v3/users/1d056e2636e14bd787271e088695faa1` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:51.446172 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1fed52-0641-4c6e-be6b-2980f0af9701 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d056e2636e14bd787271e088695faa1)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:51.448664 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1fed52-0641-4c6e-be6b-2980f0af9701 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:51.461480 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bc9710cb-2c2c-4d56-a934-f609fb215d3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b64d813723724bb7994e745446fa8837'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:51.469844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bc9710cb-2c2c-4d56-a934-f609fb215d3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b64d813723724bb7994e745446fa8837'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:51.470564 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bc9710cb-2c2c-4d56-a934-f609fb215d3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b64d813723724bb7994e745446fa8837'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:51.477393 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2732/5461] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:29:50 2022] DELETE /identity/v3/users/b64d813723724bb7994e745446fa8837 => generated 0 bytes in 838 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:29:51.794776 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7d1fed52-0641-4c6e-be6b-2980f0af9701 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d056e2636e14bd787271e088695faa1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:51.809436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7d1fed52-0641-4c6e-be6b-2980f0af9701 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d056e2636e14bd787271e088695faa1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:51.918278 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7d1fed52-0641-4c6e-be6b-2980f0af9701 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d056e2636e14bd787271e088695faa1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:51.918906 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7d1fed52-0641-4c6e-be6b-2980f0af9701 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d056e2636e14bd787271e088695faa1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:51.926735 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7d1fed52-0641-4c6e-be6b-2980f0af9701 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d056e2636e14bd787271e088695faa1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:51.933288 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2730/5462] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:29:51 2022] DELETE /identity/v3/users/1d056e2636e14bd787271e088695faa1 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:29:51.957908 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9710cb-2c2c-4d56-a934-f609fb215d3d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:51.959457 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-bc9710cb-2c2c-4d56-a934-f609fb215d3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:52.033090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9710cb-2c2c-4d56-a934-f609fb215d3d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:52.095374 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db0077-6a62-4af5-a860-104f6f729ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:52.096323 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db0077-6a62-4af5-a860-104f6f729ce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:52.096526 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db0077-6a62-4af5-a860-104f6f729ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:52.096806 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db0077-6a62-4af5-a860-104f6f729ce2 admin admin] PATH_INFO: `/v3/projects/29d795c104c049f2aad1fd515824c28e` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:52.098060 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db0077-6a62-4af5-a860-104f6f729ce2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29d795c104c049f2aad1fd515824c28e)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:52.107724 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db0077-6a62-4af5-a860-104f6f729ce2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:52.266837 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c6db0077-6a62-4af5-a860-104f6f729ce2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29d795c104c049f2aad1fd515824c28e', 'request_id': 'req-c6db0077-6a62-4af5-a860-104f6f729ce2'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:52.275557 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c6db0077-6a62-4af5-a860-104f6f729ce2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29d795c104c049f2aad1fd515824c28e', 'request_id': 'req-c6db0077-6a62-4af5-a860-104f6f729ce2'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:52.283371 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c6db0077-6a62-4af5-a860-104f6f729ce2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29d795c104c049f2aad1fd515824c28e', 'request_id': 'req-c6db0077-6a62-4af5-a860-104f6f729ce2'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:52.376817 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1fed52-0641-4c6e-be6b-2980f0af9701 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:52.378640 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7d1fed52-0641-4c6e-be6b-2980f0af9701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:52.404996 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1fed52-0641-4c6e-be6b-2980f0af9701 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:52.405262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c6db0077-6a62-4af5-a860-104f6f729ce2 admin admin] The token cache is being invalidate because project 29d795c104c049f2aad1fd515824c28e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:29:52.405262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c6db0077-6a62-4af5-a860-104f6f729ce2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:52.406340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c6db0077-6a62-4af5-a860-104f6f729ce2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:52.415004 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2733/5463] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:29:51 2022] DELETE /identity/v3/projects/29d795c104c049f2aad1fd515824c28e => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:29:52.417441 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ec6a5-511b-43f1-8251-1953c0ab49e0 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:52.417740 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ec6a5-511b-43f1-8251-1953c0ab49e0 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:52.418045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ec6a5-511b-43f1-8251-1953c0ab49e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:52.456924 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-7e0ec6a5-511b-43f1-8251-1953c0ab49e0 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:52.464375 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7e0ec6a5-511b-43f1-8251-1953c0ab49e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:52.496924 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3d346-351a-4ee1-8108-b413e0a7a8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:52.498932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3d346-351a-4ee1-8108-b413e0a7a8e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:52.498932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3d346-351a-4ee1-8108-b413e0a7a8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:52.498932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3d346-351a-4ee1-8108-b413e0a7a8e7 admin admin] PATH_INFO: `/v3/projects/9b4225adba1d4f318a28fac08b48ce02` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:52.499994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3d346-351a-4ee1-8108-b413e0a7a8e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b4225adba1d4f318a28fac08b48ce02)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:52.502828 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3d346-351a-4ee1-8108-b413e0a7a8e7 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:52.578466 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2734/5464] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:29:52.586937 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818c719-5a13-4215-a22f-8f3ffd489174 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:52.587265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818c719-5a13-4215-a22f-8f3ffd489174 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:52.587555 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818c719-5a13-4215-a22f-8f3ffd489174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:52.609452 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-3818c719-5a13-4215-a22f-8f3ffd489174 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:52.613900 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3818c719-5a13-4215-a22f-8f3ffd489174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:52.621818 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2735/5465] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:29:52.623456 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3818c719-5a13-4215-a22f-8f3ffd489174 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:52.634006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3818c719-5a13-4215-a22f-8f3ffd489174 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:52.638929 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf9c48-212c-4c1e-a3f1-3c40e2c2545e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:52.639594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf9c48-212c-4c1e-a3f1-3c40e2c2545e admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:52.641053 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf9c48-212c-4c1e-a3f1-3c40e2c2545e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:52.641053 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf9c48-212c-4c1e-a3f1-3c40e2c2545e admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:52.641053 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdf9c48-212c-4c1e-a3f1-3c40e2c2545e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:29:52.641414 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdf9c48-212c-4c1e-a3f1-3c40e2c2545e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:52.642777 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdf9c48-212c-4c1e-a3f1-3c40e2c2545e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:52.661412 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2736/5466] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:29:52.662226 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf9c48-212c-4c1e-a3f1-3c40e2c2545e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:52.673236 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf9c48-212c-4c1e-a3f1-3c40e2c2545e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:52.679618 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c828482-f57d-4adc-a69c-b51eb41eab7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:52.680350 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c828482-f57d-4adc-a69c-b51eb41eab7a admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:52.680554 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c828482-f57d-4adc-a69c-b51eb41eab7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:52.680836 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c828482-f57d-4adc-a69c-b51eb41eab7a admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:52.681542 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c828482-f57d-4adc-a69c-b51eb41eab7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:52.683508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c828482-f57d-4adc-a69c-b51eb41eab7a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:52.707333 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4be3d346-351a-4ee1-8108-b413e0a7a8e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b4225adba1d4f318a28fac08b48ce02', 'request_id': 'req-4be3d346-351a-4ee1-8108-b413e0a7a8e7'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:52.714270 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4be3d346-351a-4ee1-8108-b413e0a7a8e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b4225adba1d4f318a28fac08b48ce02', 'request_id': 'req-4be3d346-351a-4ee1-8108-b413e0a7a8e7'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:52.720963 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4be3d346-351a-4ee1-8108-b413e0a7a8e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b4225adba1d4f318a28fac08b48ce02', 'request_id': 'req-4be3d346-351a-4ee1-8108-b413e0a7a8e7'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:52.780587 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2737/5467] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:29:52 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:29:52.785904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c828482-f57d-4adc-a69c-b51eb41eab7a admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:52.815307 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4be3d346-351a-4ee1-8108-b413e0a7a8e7 admin admin] The token cache is being invalidate because project 9b4225adba1d4f318a28fac08b48ce02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:29:52.815708 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4be3d346-351a-4ee1-8108-b413e0a7a8e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:52.816656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4be3d346-351a-4ee1-8108-b413e0a7a8e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:52.818395 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2731/5468] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:29:52 2022] DELETE /identity/v3/projects/9b4225adba1d4f318a28fac08b48ce02 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:29:52.822406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3d346-351a-4ee1-8108-b413e0a7a8e7 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:52.823986 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4be3d346-351a-4ee1-8108-b413e0a7a8e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:52.859020 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c828482-f57d-4adc-a69c-b51eb41eab7a admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:52.865934 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774dcde3-0209-4019-9d40-925a0344ec40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:52.866714 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774dcde3-0209-4019-9d40-925a0344ec40 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:52.866890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774dcde3-0209-4019-9d40-925a0344ec40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:52.867160 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774dcde3-0209-4019-9d40-925a0344ec40 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:52.867863 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774dcde3-0209-4019-9d40-925a0344ec40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:52.869912 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774dcde3-0209-4019-9d40-925a0344ec40 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:52.905655 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3d346-351a-4ee1-8108-b413e0a7a8e7 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:52.910532 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752f045-950b-48f2-abcf-c49c0d4215f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:52.911348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752f045-950b-48f2-abcf-c49c0d4215f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:52.911662 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752f045-950b-48f2-abcf-c49c0d4215f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:52.911968 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752f045-950b-48f2-abcf-c49c0d4215f8 admin admin] PATH_INFO: `/v3/users/1098520db7804fa6b10fae09108aae75` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:52.913425 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a752f045-950b-48f2-abcf-c49c0d4215f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1098520db7804fa6b10fae09108aae75)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:52.915542 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a752f045-950b-48f2-abcf-c49c0d4215f8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:53.035159 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2738/5469] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:29:52 2022] POST /identity/v3/users => generated 294 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:29:53.040138 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774dcde3-0209-4019-9d40-925a0344ec40 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:53.044855 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-774dcde3-0209-4019-9d40-925a0344ec40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:53.058784 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774dcde3-0209-4019-9d40-925a0344ec40 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:53.064164 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c806d-3610-488d-a053-e565915033fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:53.064844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c806d-3610-488d-a053-e565915033fe admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:53.065127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c806d-3610-488d-a053-e565915033fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:53.065788 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c806d-3610-488d-a053-e565915033fe admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:53.066216 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c806d-3610-488d-a053-e565915033fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:53.068059 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c806d-3610-488d-a053-e565915033fe admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:53.079414 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2739/5470] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:29:53.083252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c806d-3610-488d-a053-e565915033fe admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:53.094117 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c806d-3610-488d-a053-e565915033fe admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:53.098948 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308882a-9607-463b-9763-6f3fb9d36c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:53.100209 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308882a-9607-463b-9763-6f3fb9d36c9b admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:53.100495 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308882a-9607-463b-9763-6f3fb9d36c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:53.100776 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308882a-9607-463b-9763-6f3fb9d36c9b admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:53.101496 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308882a-9607-463b-9763-6f3fb9d36c9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:53.103237 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308882a-9607-463b-9763-6f3fb9d36c9b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:53.126440 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a752f045-950b-48f2-abcf-c49c0d4215f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1098520db7804fa6b10fae09108aae75'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:53.130377 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2740/5471] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:29:53.137220 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308882a-9607-463b-9763-6f3fb9d36c9b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:53.149020 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308882a-9607-463b-9763-6f3fb9d36c9b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:53.151499 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a752f045-950b-48f2-abcf-c49c0d4215f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1098520db7804fa6b10fae09108aae75'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:53.154212 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a44e1f-69a5-4774-b429-35eb8425bb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:53.154976 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a44e1f-69a5-4774-b429-35eb8425bb16 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:53.155254 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a44e1f-69a5-4774-b429-35eb8425bb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:53.155558 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a44e1f-69a5-4774-b429-35eb8425bb16 admin admin] PATH_INFO: `/v3/projects/2e11234eea08483086a4d36ab22c0198/users/989077b6e83c41cfbd6381b3860296e4/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:53.171656 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a44e1f-69a5-4774-b429-35eb8425bb16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e11234eea08483086a4d36ab22c0198, user_id=989077b6e83c41cfbd6381b3860296e4, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:53.174482 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a44e1f-69a5-4774-b429-35eb8425bb16 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:53.245580 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2741/5472] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:29:53 2022] PUT /identity/v3/projects/2e11234eea08483086a4d36ab22c0198/users/989077b6e83c41cfbd6381b3860296e4/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:29:53.257786 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee70c5d-bccb-43eb-8125-e79d8339e566 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:53.258102 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee70c5d-bccb-43eb-8125-e79d8339e566 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:53.258375 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee70c5d-bccb-43eb-8125-e79d8339e566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:53.287786 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-eee70c5d-bccb-43eb-8125-e79d8339e566 None None] MFA Rules not processed for user `989077b6e83c41cfbd6381b3860296e4`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:53.289129 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-eee70c5d-bccb-43eb-8125-e79d8339e566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:53.301499 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a752f045-950b-48f2-abcf-c49c0d4215f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1098520db7804fa6b10fae09108aae75'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:53.302670 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a752f045-950b-48f2-abcf-c49c0d4215f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1098520db7804fa6b10fae09108aae75'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:53.311174 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a752f045-950b-48f2-abcf-c49c0d4215f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1098520db7804fa6b10fae09108aae75'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:53.317535 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2732/5473] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:29:52 2022] DELETE /identity/v3/users/1098520db7804fa6b10fae09108aae75 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:29:53.369986 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2742/5474] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:29:53.374351 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752f045-950b-48f2-abcf-c49c0d4215f8 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:53.376456 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a752f045-950b-48f2-abcf-c49c0d4215f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:53.470937 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752f045-950b-48f2-abcf-c49c0d4215f8 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:53.478868 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875e283-3929-4b9e-a998-37ca9fce3015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:53.479546 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875e283-3929-4b9e-a998-37ca9fce3015 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:53.479859 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875e283-3929-4b9e-a998-37ca9fce3015 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:53.480138 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875e283-3929-4b9e-a998-37ca9fce3015 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:53.480840 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8875e283-3929-4b9e-a998-37ca9fce3015 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:53.482827 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8875e283-3929-4b9e-a998-37ca9fce3015 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:53.638820 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2733/5475] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:29:53 2022] POST /identity/v3/projects => generated 385 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:29:53.642835 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee70c5d-bccb-43eb-8125-e79d8339e566 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:53.716561 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee70c5d-bccb-43eb-8125-e79d8339e566 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:53.778752 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7879e-1e20-4cdf-a294-4983e55cc7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:53.779566 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7879e-1e20-4cdf-a294-4983e55cc7b1 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:53.779923 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7879e-1e20-4cdf-a294-4983e55cc7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:53.780290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7879e-1e20-4cdf-a294-4983e55cc7b1 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:53.781055 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7879e-1e20-4cdf-a294-4983e55cc7b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:53.783236 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7879e-1e20-4cdf-a294-4983e55cc7b1 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:53.944825 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2743/5476] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:29:53 2022] POST /identity/v3/users => generated 299 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:29:53.948990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875e283-3929-4b9e-a998-37ca9fce3015 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:53.959942 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875e283-3929-4b9e-a998-37ca9fce3015 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:53.964660 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30843c-accd-4957-a5fc-9ba0398325ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:53.965324 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30843c-accd-4957-a5fc-9ba0398325ac admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:53.965608 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30843c-accd-4957-a5fc-9ba0398325ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:53.965926 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30843c-accd-4957-a5fc-9ba0398325ac admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:53.966682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30843c-accd-4957-a5fc-9ba0398325ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:53.968296 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30843c-accd-4957-a5fc-9ba0398325ac admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:53.980493 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2734/5477] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:29:53.986151 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7879e-1e20-4cdf-a294-4983e55cc7b1 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:53.997655 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7879e-1e20-4cdf-a294-4983e55cc7b1 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:54.003516 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb767cc-5159-472e-9512-8c03ec52ece0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:54.003690 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb767cc-5159-472e-9512-8c03ec52ece0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:54.003962 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb767cc-5159-472e-9512-8c03ec52ece0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:54.004156 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb767cc-5159-472e-9512-8c03ec52ece0 admin admin] PATH_INFO: `/v3/projects/48ce55ebf7304fe6a0fb072837734e70/users/bed41f5b256a4e769dace4fdd6e9b693/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:54.009406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30843c-accd-4957-a5fc-9ba0398325ac admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:54.011652 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2c30843c-accd-4957-a5fc-9ba0398325ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:54.023128 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb767cc-5159-472e-9512-8c03ec52ece0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48ce55ebf7304fe6a0fb072837734e70, user_id=bed41f5b256a4e769dace4fdd6e9b693, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:54.026102 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb767cc-5159-472e-9512-8c03ec52ece0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:54.039346 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30843c-accd-4957-a5fc-9ba0398325ac admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:54.044230 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd5c55-a67a-4027-8f2b-b60f3b79321d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:54.044998 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd5c55-a67a-4027-8f2b-b60f3b79321d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:54.045282 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd5c55-a67a-4027-8f2b-b60f3b79321d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:54.045555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd5c55-a67a-4027-8f2b-b60f3b79321d admin admin] PATH_INFO: `/v3/projects/e3ed5ca1b9e944a1b02c3850b005be33` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:54.046805 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fd5c55-a67a-4027-8f2b-b60f3b79321d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3ed5ca1b9e944a1b02c3850b005be33)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:54.048742 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fd5c55-a67a-4027-8f2b-b60f3b79321d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:54.098517 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2744/5478] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:29:53 2022] PUT /identity/v3/projects/48ce55ebf7304fe6a0fb072837734e70/users/bed41f5b256a4e769dace4fdd6e9b693/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:29:54.103498 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb767cc-5159-472e-9512-8c03ec52ece0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:54.164439 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb767cc-5159-472e-9512-8c03ec52ece0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:54.167412 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-08fd5c55-a67a-4027-8f2b-b60f3b79321d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3ed5ca1b9e944a1b02c3850b005be33', 'request_id': 'req-08fd5c55-a67a-4027-8f2b-b60f3b79321d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:54.172843 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-08fd5c55-a67a-4027-8f2b-b60f3b79321d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3ed5ca1b9e944a1b02c3850b005be33', 'request_id': 'req-08fd5c55-a67a-4027-8f2b-b60f3b79321d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:54.179255 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-08fd5c55-a67a-4027-8f2b-b60f3b79321d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3ed5ca1b9e944a1b02c3850b005be33', 'request_id': 'req-08fd5c55-a67a-4027-8f2b-b60f3b79321d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:54.222873 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6fe30-7d99-479f-81ca-a30157cb8d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:54.223698 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6fe30-7d99-479f-81ca-a30157cb8d8f admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:54.224198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6fe30-7d99-479f-81ca-a30157cb8d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:54.224572 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6fe30-7d99-479f-81ca-a30157cb8d8f admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:54.225420 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea6fe30-7d99-479f-81ca-a30157cb8d8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:54.227277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea6fe30-7d99-479f-81ca-a30157cb8d8f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:54.244361 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2745/5479] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:29:54.244557 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-08fd5c55-a67a-4027-8f2b-b60f3b79321d admin admin] The token cache is being invalidate because project e3ed5ca1b9e944a1b02c3850b005be33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:29:54.244557 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-08fd5c55-a67a-4027-8f2b-b60f3b79321d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:54.244557 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-08fd5c55-a67a-4027-8f2b-b60f3b79321d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:54.244557 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2735/5480] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:29:54 2022] DELETE /identity/v3/projects/e3ed5ca1b9e944a1b02c3850b005be33 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:29:54.247652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6fe30-7d99-479f-81ca-a30157cb8d8f admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:54.248619 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90746c5-acef-4d91-8125-c2c94ad1e841 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:54.249096 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90746c5-acef-4d91-8125-c2c94ad1e841 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:54.249584 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90746c5-acef-4d91-8125-c2c94ad1e841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:54.249731 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3ea6fe30-7d99-479f-81ca-a30157cb8d8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:54.262963 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6fe30-7d99-479f-81ca-a30157cb8d8f admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:54.267790 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa7baf9-2d78-4693-957c-91ba75392cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:54.268840 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7baf9-2d78-4693-957c-91ba75392cf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:54.269176 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7baf9-2d78-4693-957c-91ba75392cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:54.269461 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7baf9-2d78-4693-957c-91ba75392cf4 admin admin] PATH_INFO: `/v3/projects/48ce55ebf7304fe6a0fb072837734e70/users/bed41f5b256a4e769dace4fdd6e9b693/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:54.272511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa7baf9-2d78-4693-957c-91ba75392cf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48ce55ebf7304fe6a0fb072837734e70, user_id=bed41f5b256a4e769dace4fdd6e9b693, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:54.275464 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa7baf9-2d78-4693-957c-91ba75392cf4 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:54.283251 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-b90746c5-acef-4d91-8125-c2c94ad1e841 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:54.284634 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b90746c5-acef-4d91-8125-c2c94ad1e841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:54.287803 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2746/5481] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:29:54 2022] PUT /identity/v3/projects/48ce55ebf7304fe6a0fb072837734e70/users/bed41f5b256a4e769dace4fdd6e9b693/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:29:54.298193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540ff33-76da-4eda-a4ad-81e1e2c0be22 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:54.298481 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540ff33-76da-4eda-a4ad-81e1e2c0be22 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:54.298760 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540ff33-76da-4eda-a4ad-81e1e2c0be22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:54.331468 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-8540ff33-76da-4eda-a4ad-81e1e2c0be22 None None] MFA Rules not processed for user `bed41f5b256a4e769dace4fdd6e9b693`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:54.333025 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8540ff33-76da-4eda-a4ad-81e1e2c0be22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:54.363192 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2736/5482] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:29:54.383927 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fbe0d-604f-4430-bc9e-b58455acaa15 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:54.384356 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fbe0d-604f-4430-bc9e-b58455acaa15 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:54.384770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fbe0d-604f-4430-bc9e-b58455acaa15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:54.428743 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-7d9fbe0d-604f-4430-bc9e-b58455acaa15 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:54.430049 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7d9fbe0d-604f-4430-bc9e-b58455acaa15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:54.449500 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2737/5483] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:29:54.454375 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9fbe0d-604f-4430-bc9e-b58455acaa15 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:54.466691 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9fbe0d-604f-4430-bc9e-b58455acaa15 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:54.471571 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6cef0d-0507-457e-bca3-432506ec7471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:54.472295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6cef0d-0507-457e-bca3-432506ec7471 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:54.473073 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6cef0d-0507-457e-bca3-432506ec7471 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:54.473353 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6cef0d-0507-457e-bca3-432506ec7471 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:54.474584 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6cef0d-0507-457e-bca3-432506ec7471 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:29:54.475090 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6cef0d-0507-457e-bca3-432506ec7471 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:54.476931 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6cef0d-0507-457e-bca3-432506ec7471 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:54.481105 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2747/5484] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:29:54.499009 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8540ff33-76da-4eda-a4ad-81e1e2c0be22 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:54.502042 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8540ff33-76da-4eda-a4ad-81e1e2c0be22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:54.513539 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2738/5485] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:29:54.515553 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6cef0d-0507-457e-bca3-432506ec7471 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:54.532800 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6cef0d-0507-457e-bca3-432506ec7471 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:54.542236 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81d0f9-16cc-42cd-8d4f-e92b326d9e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:54.543222 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81d0f9-16cc-42cd-8d4f-e92b326d9e4e admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:54.543709 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81d0f9-16cc-42cd-8d4f-e92b326d9e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:54.544406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81d0f9-16cc-42cd-8d4f-e92b326d9e4e admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:54.545258 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81d0f9-16cc-42cd-8d4f-e92b326d9e4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:54.547615 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81d0f9-16cc-42cd-8d4f-e92b326d9e4e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:54.612570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8540ff33-76da-4eda-a4ad-81e1e2c0be22 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:54.617379 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee357f44-19be-4a70-9fba-93e8acaec380 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:54.618231 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee357f44-19be-4a70-9fba-93e8acaec380 service cinder] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:54.618640 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee357f44-19be-4a70-9fba-93e8acaec380 service cinder] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:54.618935 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee357f44-19be-4a70-9fba-93e8acaec380 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:54.633699 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee357f44-19be-4a70-9fba-93e8acaec380 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:54.633699 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee357f44-19be-4a70-9fba-93e8acaec380 service cinder] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:54.644729 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2748/5486] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:29:54 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:29:54.671983 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2739/5487] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:29:54 2022] POST /identity/v3/projects => generated 399 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:29:54.676954 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee357f44-19be-4a70-9fba-93e8acaec380 service cinder] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:54.699875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee357f44-19be-4a70-9fba-93e8acaec380 service cinder] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:54.844328 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882c64e-494b-4647-9644-0f255fd117af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:54.846773 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882c64e-494b-4647-9644-0f255fd117af admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:54.847057 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882c64e-494b-4647-9644-0f255fd117af admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:54.847340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882c64e-494b-4647-9644-0f255fd117af admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:54.852051 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b882c64e-494b-4647-9644-0f255fd117af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:54.863143 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b882c64e-494b-4647-9644-0f255fd117af admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:54.869420 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81d0f9-16cc-42cd-8d4f-e92b326d9e4e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:54.877487 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81d0f9-16cc-42cd-8d4f-e92b326d9e4e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:54.885475 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fdb313-b335-4917-a15b-5c3dd17655d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:54.886417 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fdb313-b335-4917-a15b-5c3dd17655d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:54.886648 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fdb313-b335-4917-a15b-5c3dd17655d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:54.887102 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fdb313-b335-4917-a15b-5c3dd17655d7 admin admin] PATH_INFO: `/v3/users/989077b6e83c41cfbd6381b3860296e4` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:54.888501 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fdb313-b335-4917-a15b-5c3dd17655d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=989077b6e83c41cfbd6381b3860296e4)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:54.890522 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fdb313-b335-4917-a15b-5c3dd17655d7 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:54.941371 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2749/5488] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:29:54 2022] POST /identity/v3/users => generated 300 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:29:54.945657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882c64e-494b-4647-9644-0f255fd117af admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:54.956585 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882c64e-494b-4647-9644-0f255fd117af admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:54.962238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff65b7-7d77-4c8e-88fe-f56f18bcb630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:54.963171 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff65b7-7d77-4c8e-88fe-f56f18bcb630 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:54.963537 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff65b7-7d77-4c8e-88fe-f56f18bcb630 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:54.963886 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff65b7-7d77-4c8e-88fe-f56f18bcb630 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:54.964684 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff65b7-7d77-4c8e-88fe-f56f18bcb630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:54.966419 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff65b7-7d77-4c8e-88fe-f56f18bcb630 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:54.980438 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2750/5489] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:29:54.981333 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff65b7-7d77-4c8e-88fe-f56f18bcb630 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:54.992129 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff65b7-7d77-4c8e-88fe-f56f18bcb630 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:54.997090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48c7d0-a8a7-4cb2-8ed5-eb596926c15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:54.997774 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48c7d0-a8a7-4cb2-8ed5-eb596926c15b admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:54.998067 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48c7d0-a8a7-4cb2-8ed5-eb596926c15b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:54.998682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48c7d0-a8a7-4cb2-8ed5-eb596926c15b admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:54.999054 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb48c7d0-a8a7-4cb2-8ed5-eb596926c15b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:55.000652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb48c7d0-a8a7-4cb2-8ed5-eb596926c15b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:55.012107 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2751/5490] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:29:55.022308 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48c7d0-a8a7-4cb2-8ed5-eb596926c15b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:55.049076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48c7d0-a8a7-4cb2-8ed5-eb596926c15b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:55.062766 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b64c6e-0912-4873-9bb2-79d40a42f6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:55.063666 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b64c6e-0912-4873-9bb2-79d40a42f6c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:55.063945 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b64c6e-0912-4873-9bb2-79d40a42f6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:55.064220 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b64c6e-0912-4873-9bb2-79d40a42f6c2 admin admin] PATH_INFO: `/v3/projects/6288132730a14d21862e2f522b79f172/users/b701641bb7d04b04a2d17f7cabacf0ba/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:55.085476 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b64c6e-0912-4873-9bb2-79d40a42f6c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6288132730a14d21862e2f522b79f172, user_id=b701641bb7d04b04a2d17f7cabacf0ba, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:55.088195 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b64c6e-0912-4873-9bb2-79d40a42f6c2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:55.150385 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b3fdb313-b335-4917-a15b-5c3dd17655d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '989077b6e83c41cfbd6381b3860296e4'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:55.163586 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b3fdb313-b335-4917-a15b-5c3dd17655d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '989077b6e83c41cfbd6381b3860296e4'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:55.169642 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2752/5491] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:29:55 2022] PUT /identity/v3/projects/6288132730a14d21862e2f522b79f172/users/b701641bb7d04b04a2d17f7cabacf0ba/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:29:55.181168 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c3a20-22ff-44e1-b59a-5bcbb8928975 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:55.181505 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c3a20-22ff-44e1-b59a-5bcbb8928975 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:55.181816 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c3a20-22ff-44e1-b59a-5bcbb8928975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:55.210819 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-422c3a20-22ff-44e1-b59a-5bcbb8928975 None None] MFA Rules not processed for user `b701641bb7d04b04a2d17f7cabacf0ba`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:55.212083 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-422c3a20-22ff-44e1-b59a-5bcbb8928975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:55.273534 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b3fdb313-b335-4917-a15b-5c3dd17655d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '989077b6e83c41cfbd6381b3860296e4'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:55.273534 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b3fdb313-b335-4917-a15b-5c3dd17655d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '989077b6e83c41cfbd6381b3860296e4'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:55.285263 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b3fdb313-b335-4917-a15b-5c3dd17655d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '989077b6e83c41cfbd6381b3860296e4'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:55.293928 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2753/5492] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:29:55.297740 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c3a20-22ff-44e1-b59a-5bcbb8928975 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:55.299515 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2740/5493] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:29:54 2022] DELETE /identity/v3/users/989077b6e83c41cfbd6381b3860296e4 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:29:55.304717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3a624-df56-41db-9996-270adeebc7d3 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:55.306498 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3a624-df56-41db-9996-270adeebc7d3 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:55.306883 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3a624-df56-41db-9996-270adeebc7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:55.350831 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-5ed3a624-df56-41db-9996-270adeebc7d3 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:55.351981 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5ed3a624-df56-41db-9996-270adeebc7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:55.409264 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c3a20-22ff-44e1-b59a-5bcbb8928975 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:55.480175 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c7ba6-0af1-4e69-9362-fec08c5277e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:55.480750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c7ba6-0af1-4e69-9362-fec08c5277e5 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:55.481032 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c7ba6-0af1-4e69-9362-fec08c5277e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:55.481306 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c7ba6-0af1-4e69-9362-fec08c5277e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:55.482050 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c7ba6-0af1-4e69-9362-fec08c5277e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:55.483023 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2741/5494] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:29:55.490081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c7ba6-0af1-4e69-9362-fec08c5277e5 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:55.539529 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3a624-df56-41db-9996-270adeebc7d3 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:55.541051 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5ed3a624-df56-41db-9996-270adeebc7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:55.613987 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3a624-df56-41db-9996-270adeebc7d3 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:55.620630 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f364cebd-b5dc-4ffc-81d0-f405346ff029 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:55.621785 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364cebd-b5dc-4ffc-81d0-f405346ff029 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:55.622241 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364cebd-b5dc-4ffc-81d0-f405346ff029 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:55.622791 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364cebd-b5dc-4ffc-81d0-f405346ff029 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:55.642846 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2754/5495] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:29:55 2022] POST /identity/v3/projects => generated 397 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:29:55.647687 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c7ba6-0af1-4e69-9362-fec08c5277e5 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:55.650666 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-636c7ba6-0af1-4e69-9362-fec08c5277e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:55.652854 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f364cebd-b5dc-4ffc-81d0-f405346ff029 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:55.655999 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f364cebd-b5dc-4ffc-81d0-f405346ff029 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:55.678673 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2742/5496] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:29:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:29:55.748395 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c7ba6-0af1-4e69-9362-fec08c5277e5 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:55.757713 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6529c9-9eef-4bf1-a5bd-44a67202df26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:55.758482 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6529c9-9eef-4bf1-a5bd-44a67202df26 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:55.758763 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6529c9-9eef-4bf1-a5bd-44a67202df26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:55.759069 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6529c9-9eef-4bf1-a5bd-44a67202df26 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:55.759766 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6529c9-9eef-4bf1-a5bd-44a67202df26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:55.761855 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6529c9-9eef-4bf1-a5bd-44a67202df26 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:55.903076 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2755/5497] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:29:55 2022] POST /identity/v3/users => generated 305 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:29:55.911545 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f364cebd-b5dc-4ffc-81d0-f405346ff029 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:55.923451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f364cebd-b5dc-4ffc-81d0-f405346ff029 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:55.935262 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b780411-d87d-4982-b56c-5d76b6b24d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:55.935937 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b780411-d87d-4982-b56c-5d76b6b24d88 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:55.936220 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b780411-d87d-4982-b56c-5d76b6b24d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:55.936582 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b780411-d87d-4982-b56c-5d76b6b24d88 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:55.937206 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b780411-d87d-4982-b56c-5d76b6b24d88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:55.939047 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b780411-d87d-4982-b56c-5d76b6b24d88 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:55.950467 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2743/5498] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:29:55.956297 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6529c9-9eef-4bf1-a5bd-44a67202df26 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:55.971073 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6529c9-9eef-4bf1-a5bd-44a67202df26 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:55.977737 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff4f49-2a5d-43d7-a14b-4909c1d1a613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:55.978672 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff4f49-2a5d-43d7-a14b-4909c1d1a613 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:55.978951 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff4f49-2a5d-43d7-a14b-4909c1d1a613 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:55.979224 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff4f49-2a5d-43d7-a14b-4909c1d1a613 admin admin] PATH_INFO: `/v3/projects/6780790a3cd54b13968a6d757db38d45/users/132529f48fc9458794951ba976e5eeb7/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:55.998858 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aff4f49-2a5d-43d7-a14b-4909c1d1a613 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6780790a3cd54b13968a6d757db38d45, user_id=132529f48fc9458794951ba976e5eeb7, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:56.000921 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aff4f49-2a5d-43d7-a14b-4909c1d1a613 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:56.088987 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2756/5499] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:29:55 2022] PUT /identity/v3/projects/6780790a3cd54b13968a6d757db38d45/users/132529f48fc9458794951ba976e5eeb7/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:29:56.092850 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b780411-d87d-4982-b56c-5d76b6b24d88 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:56.106064 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b780411-d87d-4982-b56c-5d76b6b24d88 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:56.183563 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd746676-8db8-4706-b8f3-e870ecfa94ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:56.184275 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd746676-8db8-4706-b8f3-e870ecfa94ab admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:56.184562 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd746676-8db8-4706-b8f3-e870ecfa94ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:56.185472 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd746676-8db8-4706-b8f3-e870ecfa94ab admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:56.185851 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd746676-8db8-4706-b8f3-e870ecfa94ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:56.187821 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd746676-8db8-4706-b8f3-e870ecfa94ab admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:56.202819 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2744/5500] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:29:56.207102 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff4f49-2a5d-43d7-a14b-4909c1d1a613 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:56.218607 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff4f49-2a5d-43d7-a14b-4909c1d1a613 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:56.223491 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94ce96-66dc-4a83-97de-b01ea83b6e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:56.224933 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94ce96-66dc-4a83-97de-b01ea83b6e16 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:56.225216 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94ce96-66dc-4a83-97de-b01ea83b6e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:56.225493 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94ce96-66dc-4a83-97de-b01ea83b6e16 admin admin] PATH_INFO: `/v3/projects/6780790a3cd54b13968a6d757db38d45/users/132529f48fc9458794951ba976e5eeb7/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:56.227545 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed94ce96-66dc-4a83-97de-b01ea83b6e16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6780790a3cd54b13968a6d757db38d45, user_id=132529f48fc9458794951ba976e5eeb7, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:56.231972 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed94ce96-66dc-4a83-97de-b01ea83b6e16 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:56.242353 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2757/5501] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:29:56 2022] PUT /identity/v3/projects/6780790a3cd54b13968a6d757db38d45/users/132529f48fc9458794951ba976e5eeb7/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:29:56.252736 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc8cb6-60db-439c-b5a1-516004bcae5f None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:56.253100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc8cb6-60db-439c-b5a1-516004bcae5f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:56.253387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc8cb6-60db-439c-b5a1-516004bcae5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:56.298934 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-abdc8cb6-60db-439c-b5a1-516004bcae5f None None] MFA Rules not processed for user `132529f48fc9458794951ba976e5eeb7`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:56.300318 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-abdc8cb6-60db-439c-b5a1-516004bcae5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:56.314399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94ce96-66dc-4a83-97de-b01ea83b6e16 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:56.316405 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ed94ce96-66dc-4a83-97de-b01ea83b6e16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:56.397810 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed94ce96-66dc-4a83-97de-b01ea83b6e16 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:56.409316 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3834b90-7411-4de6-8171-253a2568fdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:56.410235 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3834b90-7411-4de6-8171-253a2568fdce admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:56.410522 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3834b90-7411-4de6-8171-253a2568fdce admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:56.410804 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3834b90-7411-4de6-8171-253a2568fdce admin admin] PATH_INFO: `/v3/projects/2e11234eea08483086a4d36ab22c0198` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:56.412853 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3834b90-7411-4de6-8171-253a2568fdce admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e11234eea08483086a4d36ab22c0198)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:56.416122 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3834b90-7411-4de6-8171-253a2568fdce admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:56.422597 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2745/5502] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:56 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:29:56.435697 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc8cb6-60db-439c-b5a1-516004bcae5f None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:56.438815 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-abdc8cb6-60db-439c-b5a1-516004bcae5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:56.597330 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc8cb6-60db-439c-b5a1-516004bcae5f None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:56.603638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd2ffe-c362-4e96-a0c1-9085daf0dd0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:56.604298 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd2ffe-c362-4e96-a0c1-9085daf0dd0a service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:56.604755 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd2ffe-c362-4e96-a0c1-9085daf0dd0a service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:56.605209 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd2ffe-c362-4e96-a0c1-9085daf0dd0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:56.607398 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8cdd2ffe-c362-4e96-a0c1-9085daf0dd0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:56.680230 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e3834b90-7411-4de6-8171-253a2568fdce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e11234eea08483086a4d36ab22c0198', 'request_id': 'req-e3834b90-7411-4de6-8171-253a2568fdce'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:56.687023 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e3834b90-7411-4de6-8171-253a2568fdce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e11234eea08483086a4d36ab22c0198', 'request_id': 'req-e3834b90-7411-4de6-8171-253a2568fdce'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:56.695290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e3834b90-7411-4de6-8171-253a2568fdce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e11234eea08483086a4d36ab22c0198', 'request_id': 'req-e3834b90-7411-4de6-8171-253a2568fdce'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:56.696437 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd2ffe-c362-4e96-a0c1-9085daf0dd0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:56.698126 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd2ffe-c362-4e96-a0c1-9085daf0dd0a service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:56.708869 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2746/5503] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:29:56 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:29:56.831737 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e3834b90-7411-4de6-8171-253a2568fdce admin admin] The token cache is being invalidate because project 2e11234eea08483086a4d36ab22c0198 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:29:56.832117 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e3834b90-7411-4de6-8171-253a2568fdce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:56.832870 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e3834b90-7411-4de6-8171-253a2568fdce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:56.836212 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2758/5504] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:29:56 2022] DELETE /identity/v3/projects/2e11234eea08483086a4d36ab22c0198 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:29:56.840628 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd2ffe-c362-4e96-a0c1-9085daf0dd0a service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:56.857610 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd2ffe-c362-4e96-a0c1-9085daf0dd0a service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:56.941827 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca15df6-299f-4119-9569-d2d213227b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:56.943055 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca15df6-299f-4119-9569-d2d213227b93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:56.949106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca15df6-299f-4119-9569-d2d213227b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:56.949106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca15df6-299f-4119-9569-d2d213227b93 admin admin] PATH_INFO: `/v3/users/bed41f5b256a4e769dace4fdd6e9b693` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:56.949106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca15df6-299f-4119-9569-d2d213227b93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bed41f5b256a4e769dace4fdd6e9b693)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:56.949106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca15df6-299f-4119-9569-d2d213227b93 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:57.296184 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-bca15df6-299f-4119-9569-d2d213227b93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bed41f5b256a4e769dace4fdd6e9b693'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:57.316675 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-bca15df6-299f-4119-9569-d2d213227b93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bed41f5b256a4e769dace4fdd6e9b693'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:57.468148 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-bca15df6-299f-4119-9569-d2d213227b93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bed41f5b256a4e769dace4fdd6e9b693'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:57.468965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-bca15df6-299f-4119-9569-d2d213227b93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bed41f5b256a4e769dace4fdd6e9b693'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:57.478943 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-bca15df6-299f-4119-9569-d2d213227b93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bed41f5b256a4e769dace4fdd6e9b693'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:57.485550 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2747/5505] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:29:56 2022] DELETE /identity/v3/users/bed41f5b256a4e769dace4fdd6e9b693 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:29:57.753361 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18bd09-9da3-400d-9ec4-d88caf9a85a7 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:57.753948 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18bd09-9da3-400d-9ec4-d88caf9a85a7 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:57.753948 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18bd09-9da3-400d-9ec4-d88caf9a85a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:57.788955 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-de18bd09-9da3-400d-9ec4-d88caf9a85a7 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:57.790594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-de18bd09-9da3-400d-9ec4-d88caf9a85a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:57.868211 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b7df1-8ce4-4bb3-9d22-0c3a77d8c1f7 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:57.868736 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b7df1-8ce4-4bb3-9d22-0c3a77d8c1f7 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:57.873924 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b7df1-8ce4-4bb3-9d22-0c3a77d8c1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:57.877042 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2759/5506] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:29:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:29:57.878826 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18bd09-9da3-400d-9ec4-d88caf9a85a7 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:57.884898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-de18bd09-9da3-400d-9ec4-d88caf9a85a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:57.908444 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-387b7df1-8ce4-4bb3-9d22-0c3a77d8c1f7 None None] MFA Rules not processed for user `baf1d13615bc491ab98d2a644e681c12`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:57.909810 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-387b7df1-8ce4-4bb3-9d22-0c3a77d8c1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:57.985544 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2748/5507] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:29:58.011302 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18bd09-9da3-400d-9ec4-d88caf9a85a7 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:58.016598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ad300-47b2-48aa-b42a-9c4278549378 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:58.017333 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ad300-47b2-48aa-b42a-9c4278549378 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:58.017727 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ad300-47b2-48aa-b42a-9c4278549378 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:58.017991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ad300-47b2-48aa-b42a-9c4278549378 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:58.019879 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-223ad300-47b2-48aa-b42a-9c4278549378 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:58.051197 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b7df1-8ce4-4bb3-9d22-0c3a77d8c1f7 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:58.054607 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-387b7df1-8ce4-4bb3-9d22-0c3a77d8c1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:58.131928 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ad300-47b2-48aa-b42a-9c4278549378 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:58.133737 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ad300-47b2-48aa-b42a-9c4278549378 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:58.145948 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2760/5508] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:29:57 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:29:58.146835 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ad300-47b2-48aa-b42a-9c4278549378 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:58.148220 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-223ad300-47b2-48aa-b42a-9c4278549378 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:58.230960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ad300-47b2-48aa-b42a-9c4278549378 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:58.236535 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a5661-e54a-4772-ac80-3e6c45bac033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:58.237391 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a5661-e54a-4772-ac80-3e6c45bac033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:58.238295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a5661-e54a-4772-ac80-3e6c45bac033 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:58.242606 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a5661-e54a-4772-ac80-3e6c45bac033 admin admin] PATH_INFO: `/v3/projects/48ce55ebf7304fe6a0fb072837734e70` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:58.242606 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a5661-e54a-4772-ac80-3e6c45bac033 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48ce55ebf7304fe6a0fb072837734e70)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:58.242606 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a5661-e54a-4772-ac80-3e6c45bac033 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:58.243402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b7df1-8ce4-4bb3-9d22-0c3a77d8c1f7 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:58.252060 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d796ece-fd87-48ef-a786-3a5cc00bbaa8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:58.252720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d796ece-fd87-48ef-a786-3a5cc00bbaa8 service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:58.253179 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d796ece-fd87-48ef-a786-3a5cc00bbaa8 service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:58.253465 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d796ece-fd87-48ef-a786-3a5cc00bbaa8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:58.263821 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d796ece-fd87-48ef-a786-3a5cc00bbaa8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:58.265443 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d796ece-fd87-48ef-a786-3a5cc00bbaa8 service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:58.294505 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2749/5509] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:29:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 30 21:29:58.610936 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b42a5661-e54a-4772-ac80-3e6c45bac033 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48ce55ebf7304fe6a0fb072837734e70', 'request_id': 'req-b42a5661-e54a-4772-ac80-3e6c45bac033'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:58.622822 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b42a5661-e54a-4772-ac80-3e6c45bac033 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48ce55ebf7304fe6a0fb072837734e70', 'request_id': 'req-b42a5661-e54a-4772-ac80-3e6c45bac033'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:58.637184 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b42a5661-e54a-4772-ac80-3e6c45bac033 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48ce55ebf7304fe6a0fb072837734e70', 'request_id': 'req-b42a5661-e54a-4772-ac80-3e6c45bac033'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:58.794320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b42a5661-e54a-4772-ac80-3e6c45bac033 admin admin] The token cache is being invalidate because project 48ce55ebf7304fe6a0fb072837734e70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:29:58.796020 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b42a5661-e54a-4772-ac80-3e6c45bac033 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:58.796890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b42a5661-e54a-4772-ac80-3e6c45bac033 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:29:58.799070 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2761/5510] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:29:58 2022] DELETE /identity/v3/projects/48ce55ebf7304fe6a0fb072837734e70 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:29:58.804354 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2df32b-fc59-4762-b963-b92a5af56a2c None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:58.805308 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2df32b-fc59-4762-b963-b92a5af56a2c None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:58.806123 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2df32b-fc59-4762-b963-b92a5af56a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:58.833964 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-da2df32b-fc59-4762-b963-b92a5af56a2c None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:58.840575 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-da2df32b-fc59-4762-b963-b92a5af56a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:58.976342 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2750/5511] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:29:58.978186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e740d7d-a945-4398-b338-11f5530c9eb6 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:58.983330 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e740d7d-a945-4398-b338-11f5530c9eb6 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:58.983330 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e740d7d-a945-4398-b338-11f5530c9eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:59.021478 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-5e740d7d-a945-4398-b338-11f5530c9eb6 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:29:59.023960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5e740d7d-a945-4398-b338-11f5530c9eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:29:59.046726 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2762/5512] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:29:59.047900 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2df32b-fc59-4762-b963-b92a5af56a2c None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:59.067091 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2df32b-fc59-4762-b963-b92a5af56a2c None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:59.067091 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b2c77-7565-4c3e-a37f-8425e47bd8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:59.067091 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b2c77-7565-4c3e-a37f-8425e47bd8c6 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:59.067091 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b2c77-7565-4c3e-a37f-8425e47bd8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:59.067540 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b2c77-7565-4c3e-a37f-8425e47bd8c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:59.067937 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b2c77-7565-4c3e-a37f-8425e47bd8c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:29:59.068250 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b2c77-7565-4c3e-a37f-8425e47bd8c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:59.070682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b2c77-7565-4c3e-a37f-8425e47bd8c6 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:59.091434 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2751/5513] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:29:59.092613 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e740d7d-a945-4398-b338-11f5530c9eb6 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:59.106212 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e740d7d-a945-4398-b338-11f5530c9eb6 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:59.134063 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa6163-7632-4f40-8487-3bca0a69cf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:59.137636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa6163-7632-4f40-8487-3bca0a69cf19 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:59.137911 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa6163-7632-4f40-8487-3bca0a69cf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:59.138191 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa6163-7632-4f40-8487-3bca0a69cf19 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:59.143184 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa6163-7632-4f40-8487-3bca0a69cf19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:59.149863 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa6163-7632-4f40-8487-3bca0a69cf19 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:59.308440 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2763/5514] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:29:59 2022] POST /identity/v3/projects => generated 405 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:29:59.313649 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b2c77-7565-4c3e-a37f-8425e47bd8c6 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:59.325690 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b2c77-7565-4c3e-a37f-8425e47bd8c6 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:59.420256 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894bda5-c3ac-473c-90a1-4656c2cef5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:59.421374 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894bda5-c3ac-473c-90a1-4656c2cef5b6 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:59.421857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894bda5-c3ac-473c-90a1-4656c2cef5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:59.422307 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894bda5-c3ac-473c-90a1-4656c2cef5b6 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:59.423379 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8894bda5-c3ac-473c-90a1-4656c2cef5b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:59.425677 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8894bda5-c3ac-473c-90a1-4656c2cef5b6 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:59.561421 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2752/5515] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:29:59 2022] POST /identity/v3/users => generated 303 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:29:59.565524 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa6163-7632-4f40-8487-3bca0a69cf19 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:59.582946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa6163-7632-4f40-8487-3bca0a69cf19 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:59.597569 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb5ecb-5080-4366-8565-c0ee30998a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:59.600769 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb5ecb-5080-4366-8565-c0ee30998a1f admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:59.601070 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb5ecb-5080-4366-8565-c0ee30998a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:59.603202 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb5ecb-5080-4366-8565-c0ee30998a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:59.604041 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb5ecb-5080-4366-8565-c0ee30998a1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:59.611832 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb5ecb-5080-4366-8565-c0ee30998a1f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:59.650869 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894bda5-c3ac-473c-90a1-4656c2cef5b6 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:59.663623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894bda5-c3ac-473c-90a1-4656c2cef5b6 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:59.665664 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2764/5516] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:29:59.698803 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a81ec-a372-4737-9056-2613238ab495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:59.701354 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a81ec-a372-4737-9056-2613238ab495 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:59.704197 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a81ec-a372-4737-9056-2613238ab495 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:59.706178 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a81ec-a372-4737-9056-2613238ab495 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:59.707726 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a81ec-a372-4737-9056-2613238ab495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:59.713083 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a81ec-a372-4737-9056-2613238ab495 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:59.729802 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2753/5517] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:29:59.733640 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb5ecb-5080-4366-8565-c0ee30998a1f admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:29:59.755229 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb5ecb-5080-4366-8565-c0ee30998a1f admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:29:59.774527 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0b9a9-dcb8-468f-8641-cbf3bae18816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:29:59.774527 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0b9a9-dcb8-468f-8641-cbf3bae18816 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:59.774527 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0b9a9-dcb8-468f-8641-cbf3bae18816 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:59.774527 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0b9a9-dcb8-468f-8641-cbf3bae18816 admin admin] PATH_INFO: `/v3/projects/e9ed3ab456a94753a4fe68a0c8e85e65/users/a81f55b9657543adb46748a08ef1e6b7/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:29:59.791268 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0b9a9-dcb8-468f-8641-cbf3bae18816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9ed3ab456a94753a4fe68a0c8e85e65, user_id=a81f55b9657543adb46748a08ef1e6b7, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:29:59.794154 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0b9a9-dcb8-468f-8641-cbf3bae18816 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:29:59.933466 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2765/5518] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:29:59 2022] PUT /identity/v3/projects/e9ed3ab456a94753a4fe68a0c8e85e65/users/a81f55b9657543adb46748a08ef1e6b7/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:29:59.944579 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebee508-5ac6-4f9d-83eb-4ae1a8938ad7 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:29:59.945147 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebee508-5ac6-4f9d-83eb-4ae1a8938ad7 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:29:59.945611 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebee508-5ac6-4f9d-83eb-4ae1a8938ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:00.026141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-3ebee508-5ac6-4f9d-83eb-4ae1a8938ad7 None None] MFA Rules not processed for user `a81f55b9657543adb46748a08ef1e6b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:00.029885 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3ebee508-5ac6-4f9d-83eb-4ae1a8938ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:00.158620 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2754/5519] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:29:59 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:00.164550 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0b9a9-dcb8-468f-8641-cbf3bae18816 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:00.336942 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0b9a9-dcb8-468f-8641-cbf3bae18816 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:00.361182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6312399-682f-4ca1-9ea7-0f30288957af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:00.362508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6312399-682f-4ca1-9ea7-0f30288957af admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:00.362899 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6312399-682f-4ca1-9ea7-0f30288957af admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:00.363304 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6312399-682f-4ca1-9ea7-0f30288957af admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:00.366641 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6312399-682f-4ca1-9ea7-0f30288957af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:00.369975 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6312399-682f-4ca1-9ea7-0f30288957af admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:00.492700 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2766/5520] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:30:00 2022] POST /identity/v3/projects => generated 409 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:30:00.496972 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebee508-5ac6-4f9d-83eb-4ae1a8938ad7 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:00.513225 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebee508-5ac6-4f9d-83eb-4ae1a8938ad7 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:00.706281 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48272cf-1f4e-48f3-812f-3ae1c9cd4155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:00.706972 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48272cf-1f4e-48f3-812f-3ae1c9cd4155 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:00.707368 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48272cf-1f4e-48f3-812f-3ae1c9cd4155 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:00.707798 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48272cf-1f4e-48f3-812f-3ae1c9cd4155 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:00.709481 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48272cf-1f4e-48f3-812f-3ae1c9cd4155 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:00.718663 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48272cf-1f4e-48f3-812f-3ae1c9cd4155 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:00.889327 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2755/5521] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:30:00 2022] POST /identity/v3/users => generated 311 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:30:00.897059 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6312399-682f-4ca1-9ea7-0f30288957af admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:00.912626 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6312399-682f-4ca1-9ea7-0f30288957af admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:00.940020 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5198527-72be-4008-a21b-3b6bc17a0501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:00.943246 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5198527-72be-4008-a21b-3b6bc17a0501 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:00.943805 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5198527-72be-4008-a21b-3b6bc17a0501 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:00.945425 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5198527-72be-4008-a21b-3b6bc17a0501 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:00.948676 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5198527-72be-4008-a21b-3b6bc17a0501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:00.954745 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5198527-72be-4008-a21b-3b6bc17a0501 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:00.989449 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2767/5522] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:30:00.990694 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48272cf-1f4e-48f3-812f-3ae1c9cd4155 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:01.006612 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48272cf-1f4e-48f3-812f-3ae1c9cd4155 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:01.022624 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa429f1d-b2fb-4f32-80ec-9cf9f75f691e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:01.023635 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa429f1d-b2fb-4f32-80ec-9cf9f75f691e admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:01.023924 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa429f1d-b2fb-4f32-80ec-9cf9f75f691e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:01.024208 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa429f1d-b2fb-4f32-80ec-9cf9f75f691e admin admin] PATH_INFO: `/v3/projects/fa81ab6b5d384e43a12ab4da8e4630b6/users/1016082a1cec45439f3ba9d549b43bfa/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:01.058874 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa429f1d-b2fb-4f32-80ec-9cf9f75f691e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa81ab6b5d384e43a12ab4da8e4630b6, user_id=1016082a1cec45439f3ba9d549b43bfa, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:01.063745 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa429f1d-b2fb-4f32-80ec-9cf9f75f691e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:01.187478 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2756/5523] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:30:00 2022] PUT /identity/v3/projects/fa81ab6b5d384e43a12ab4da8e4630b6/users/1016082a1cec45439f3ba9d549b43bfa/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:30:01.192420 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5198527-72be-4008-a21b-3b6bc17a0501 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:01.207282 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5198527-72be-4008-a21b-3b6bc17a0501 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:01.394394 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa4212-6c70-4544-b69a-31db33247852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:01.395351 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa4212-6c70-4544-b69a-31db33247852 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:01.395878 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa4212-6c70-4544-b69a-31db33247852 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:01.396158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa4212-6c70-4544-b69a-31db33247852 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:01.396893 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa4212-6c70-4544-b69a-31db33247852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:01.398561 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa4212-6c70-4544-b69a-31db33247852 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:01.429112 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa429f1d-b2fb-4f32-80ec-9cf9f75f691e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:01.429386 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2768/5524] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:30:01.448349 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa429f1d-b2fb-4f32-80ec-9cf9f75f691e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:01.455436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257578d-e405-48e9-adea-bc2781b8cae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:01.456402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257578d-e405-48e9-adea-bc2781b8cae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:01.456694 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257578d-e405-48e9-adea-bc2781b8cae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:01.456970 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257578d-e405-48e9-adea-bc2781b8cae3 admin admin] PATH_INFO: `/v3/projects/fa81ab6b5d384e43a12ab4da8e4630b6/users/1016082a1cec45439f3ba9d549b43bfa/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:01.460202 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d257578d-e405-48e9-adea-bc2781b8cae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa81ab6b5d384e43a12ab4da8e4630b6, user_id=1016082a1cec45439f3ba9d549b43bfa, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:01.463731 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d257578d-e405-48e9-adea-bc2781b8cae3 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:01.478933 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2757/5525] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:30:01 2022] PUT /identity/v3/projects/fa81ab6b5d384e43a12ab4da8e4630b6/users/1016082a1cec45439f3ba9d549b43bfa/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:30:01.490949 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2ee77-995e-4407-ad3b-ee5adab8acbd None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:01.491283 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2ee77-995e-4407-ad3b-ee5adab8acbd None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:01.491559 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2ee77-995e-4407-ad3b-ee5adab8acbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:01.542989 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-cfd2ee77-995e-4407-ad3b-ee5adab8acbd None None] MFA Rules not processed for user `1016082a1cec45439f3ba9d549b43bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:01.544140 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-cfd2ee77-995e-4407-ad3b-ee5adab8acbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:01.711440 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2769/5526] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:01 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:01.729530 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257578d-e405-48e9-adea-bc2781b8cae3 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:01.731926 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d257578d-e405-48e9-adea-bc2781b8cae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:01.823920 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257578d-e405-48e9-adea-bc2781b8cae3 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:01.828420 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a2c31-a89d-4892-a801-7975e34dd43e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:01.829110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a2c31-a89d-4892-a801-7975e34dd43e service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:01.829392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a2c31-a89d-4892-a801-7975e34dd43e service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:01.829669 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a2c31-a89d-4892-a801-7975e34dd43e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:01.842436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a2c31-a89d-4892-a801-7975e34dd43e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:01.845250 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a2c31-a89d-4892-a801-7975e34dd43e service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:01.859013 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2758/5527] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:30:01 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:30:02.413163 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2ee77-995e-4407-ad3b-ee5adab8acbd None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:02.425239 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2ee77-995e-4407-ad3b-ee5adab8acbd None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:02.432737 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb40f9b-d7a4-4ffa-8870-db492fbf7762 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:02.434978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb40f9b-d7a4-4ffa-8870-db492fbf7762 service cinder] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:02.436389 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb40f9b-d7a4-4ffa-8870-db492fbf7762 service cinder] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:02.436762 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb40f9b-d7a4-4ffa-8870-db492fbf7762 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:02.574061 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb40f9b-d7a4-4ffa-8870-db492fbf7762 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:02.576383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb40f9b-d7a4-4ffa-8870-db492fbf7762 service cinder] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:02.597231 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2770/5528] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:30:02 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:30:04.095462 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21009d-5211-4a9b-b641-310173ae71cc None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:04.095960 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21009d-5211-4a9b-b641-310173ae71cc None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:04.096059 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21009d-5211-4a9b-b641-310173ae71cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:04.135252 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-db21009d-5211-4a9b-b641-310173ae71cc None None] MFA Rules not processed for user `baf1d13615bc491ab98d2a644e681c12`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:04.140322 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-db21009d-5211-4a9b-b641-310173ae71cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:04.269154 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2759/5529] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:06.197609 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb40f9b-d7a4-4ffa-8870-db492fbf7762 service cinder] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:06.199474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-abb40f9b-d7a4-4ffa-8870-db492fbf7762 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:06.374106 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb40f9b-d7a4-4ffa-8870-db492fbf7762 service cinder] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:06.379587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ed415-45be-446b-b595-5b1b8d775da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:06.383450 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ed415-45be-446b-b595-5b1b8d775da4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:06.384139 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ed415-45be-446b-b595-5b1b8d775da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:06.390673 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ed415-45be-446b-b595-5b1b8d775da4 admin admin] PATH_INFO: `/v3/users/c9945e69c5714cd4b1d2667969eaef2a` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:06.390673 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ed415-45be-446b-b595-5b1b8d775da4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9945e69c5714cd4b1d2667969eaef2a)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:06.390673 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ed415-45be-446b-b595-5b1b8d775da4 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:06.630643 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bb9ed415-45be-446b-b595-5b1b8d775da4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9945e69c5714cd4b1d2667969eaef2a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:06.649671 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bb9ed415-45be-446b-b595-5b1b8d775da4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9945e69c5714cd4b1d2667969eaef2a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:06.752639 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bb9ed415-45be-446b-b595-5b1b8d775da4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9945e69c5714cd4b1d2667969eaef2a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:06.762707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bb9ed415-45be-446b-b595-5b1b8d775da4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9945e69c5714cd4b1d2667969eaef2a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:06.763728 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bb9ed415-45be-446b-b595-5b1b8d775da4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9945e69c5714cd4b1d2667969eaef2a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:06.781643 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2771/5530] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:30:06 2022] DELETE /identity/v3/users/c9945e69c5714cd4b1d2667969eaef2a => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:07.310431 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21009d-5211-4a9b-b641-310173ae71cc None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:07.329086 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21009d-5211-4a9b-b641-310173ae71cc None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:07.500953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79533203-17eb-4761-9ee4-3ff0aaee3fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:07.501972 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79533203-17eb-4761-9ee4-3ff0aaee3fc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:07.502273 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79533203-17eb-4761-9ee4-3ff0aaee3fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:07.502584 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79533203-17eb-4761-9ee4-3ff0aaee3fc0 admin admin] PATH_INFO: `/v3/projects/4e881eef596f442ea5e731596de728a3` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:07.504184 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79533203-17eb-4761-9ee4-3ff0aaee3fc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e881eef596f442ea5e731596de728a3)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:07.506742 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79533203-17eb-4761-9ee4-3ff0aaee3fc0 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:07.780879 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-79533203-17eb-4761-9ee4-3ff0aaee3fc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e881eef596f442ea5e731596de728a3', 'request_id': 'req-79533203-17eb-4761-9ee4-3ff0aaee3fc0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:07.790161 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-79533203-17eb-4761-9ee4-3ff0aaee3fc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e881eef596f442ea5e731596de728a3', 'request_id': 'req-79533203-17eb-4761-9ee4-3ff0aaee3fc0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:07.798353 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-79533203-17eb-4761-9ee4-3ff0aaee3fc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e881eef596f442ea5e731596de728a3', 'request_id': 'req-79533203-17eb-4761-9ee4-3ff0aaee3fc0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:07.939901 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-79533203-17eb-4761-9ee4-3ff0aaee3fc0 admin admin] The token cache is being invalidate because project 4e881eef596f442ea5e731596de728a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:30:07.940197 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-79533203-17eb-4761-9ee4-3ff0aaee3fc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:07.940959 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-79533203-17eb-4761-9ee4-3ff0aaee3fc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:07.948684 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f122d8-ed55-4623-ac91-e4ffdbc3c0c7 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:07.949178 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f122d8-ed55-4623-ac91-e4ffdbc3c0c7 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:07.949278 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f122d8-ed55-4623-ac91-e4ffdbc3c0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:07.951256 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2760/5531] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:30:07 2022] DELETE /identity/v3/projects/4e881eef596f442ea5e731596de728a3 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:07.982513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-67f122d8-ed55-4623-ac91-e4ffdbc3c0c7 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:07.984878 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-67f122d8-ed55-4623-ac91-e4ffdbc3c0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:08.224792 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2772/5532] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:08.231947 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db63a86-0cda-4a89-b68b-df46c82d437a None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:08.232290 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db63a86-0cda-4a89-b68b-df46c82d437a None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:08.232632 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db63a86-0cda-4a89-b68b-df46c82d437a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:08.256914 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-4db63a86-0cda-4a89-b68b-df46c82d437a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:08.258390 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4db63a86-0cda-4a89-b68b-df46c82d437a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:08.266871 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2761/5533] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:08.276681 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f122d8-ed55-4623-ac91-e4ffdbc3c0c7 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:08.287323 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f122d8-ed55-4623-ac91-e4ffdbc3c0c7 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:08.292182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16239bae-0d04-4f97-8888-8af81ed4db78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:08.296665 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16239bae-0d04-4f97-8888-8af81ed4db78 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:08.296665 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16239bae-0d04-4f97-8888-8af81ed4db78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:08.296665 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16239bae-0d04-4f97-8888-8af81ed4db78 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:08.296665 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16239bae-0d04-4f97-8888-8af81ed4db78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:30:08.296665 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16239bae-0d04-4f97-8888-8af81ed4db78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:08.296665 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16239bae-0d04-4f97-8888-8af81ed4db78 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:08.309202 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2773/5534] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:30:08.313611 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db63a86-0cda-4a89-b68b-df46c82d437a None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:08.323552 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db63a86-0cda-4a89-b68b-df46c82d437a None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:08.328484 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0598a39-8a67-47f9-96d8-dea70094b37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:08.329168 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0598a39-8a67-47f9-96d8-dea70094b37a admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:08.329446 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0598a39-8a67-47f9-96d8-dea70094b37a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:08.329716 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0598a39-8a67-47f9-96d8-dea70094b37a admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:08.330439 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0598a39-8a67-47f9-96d8-dea70094b37a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:08.332462 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0598a39-8a67-47f9-96d8-dea70094b37a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:08.509623 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2762/5535] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:30:08 2022] POST /identity/v3/projects => generated 373 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:30:08.510632 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16239bae-0d04-4f97-8888-8af81ed4db78 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:08.527509 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16239bae-0d04-4f97-8888-8af81ed4db78 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:08.650037 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb9419-a2ab-49fc-89f9-a6e737aa951f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:08.650962 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb9419-a2ab-49fc-89f9-a6e737aa951f admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:08.651313 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb9419-a2ab-49fc-89f9-a6e737aa951f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:08.651670 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb9419-a2ab-49fc-89f9-a6e737aa951f admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:08.654014 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb9419-a2ab-49fc-89f9-a6e737aa951f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:08.656249 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb9419-a2ab-49fc-89f9-a6e737aa951f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:08.790132 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2774/5536] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:30:08 2022] POST /identity/v3/users => generated 287 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:30:08.796577 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0598a39-8a67-47f9-96d8-dea70094b37a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:08.856103 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0598a39-8a67-47f9-96d8-dea70094b37a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:08.864149 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107f922-f9f4-49d7-949c-af69dbfe971e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:08.865662 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107f922-f9f4-49d7-949c-af69dbfe971e admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:08.866172 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107f922-f9f4-49d7-949c-af69dbfe971e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:08.866605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107f922-f9f4-49d7-949c-af69dbfe971e admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:08.867586 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9107f922-f9f4-49d7-949c-af69dbfe971e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:08.869732 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9107f922-f9f4-49d7-949c-af69dbfe971e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:08.891826 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2763/5537] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:30:08.893887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb9419-a2ab-49fc-89f9-a6e737aa951f admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:08.915799 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb9419-a2ab-49fc-89f9-a6e737aa951f admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:08.930478 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51dd2fc-7232-4640-b6d6-137088e02abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:08.932272 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51dd2fc-7232-4640-b6d6-137088e02abf admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:08.932806 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51dd2fc-7232-4640-b6d6-137088e02abf admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:08.933252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51dd2fc-7232-4640-b6d6-137088e02abf admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:08.934197 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51dd2fc-7232-4640-b6d6-137088e02abf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:08.936008 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51dd2fc-7232-4640-b6d6-137088e02abf admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:08.968934 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2775/5538] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:30:08.970650 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107f922-f9f4-49d7-949c-af69dbfe971e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:08.995690 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107f922-f9f4-49d7-949c-af69dbfe971e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:09.011222 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27030ef8-1d5c-4914-859a-91fd2762653a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:09.017023 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27030ef8-1d5c-4914-859a-91fd2762653a admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:09.017023 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27030ef8-1d5c-4914-859a-91fd2762653a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:09.017023 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27030ef8-1d5c-4914-859a-91fd2762653a admin admin] PATH_INFO: `/v3/projects/b5de501af17b45a596e24e0fe7611ece/users/ea92ff9a9c1142ce8890ab1379535f1b/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:09.075492 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43fd02a-20da-4d88-a81c-33a6f08b6c29 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:09.075787 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43fd02a-20da-4d88-a81c-33a6f08b6c29 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:09.076066 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43fd02a-20da-4d88-a81c-33a6f08b6c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:09.078798 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27030ef8-1d5c-4914-859a-91fd2762653a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5de501af17b45a596e24e0fe7611ece, user_id=ea92ff9a9c1142ce8890ab1379535f1b, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:09.082471 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27030ef8-1d5c-4914-859a-91fd2762653a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:09.122794 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-f43fd02a-20da-4d88-a81c-33a6f08b6c29 None None] MFA Rules not processed for user `baf1d13615bc491ab98d2a644e681c12`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:09.125236 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f43fd02a-20da-4d88-a81c-33a6f08b6c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:09.205812 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2764/5539] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:30:08 2022] PUT /identity/v3/projects/b5de501af17b45a596e24e0fe7611ece/users/ea92ff9a9c1142ce8890ab1379535f1b/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:09.219293 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97206d7-b95c-4aac-9c7a-029307e9ee5b None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:09.220041 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97206d7-b95c-4aac-9c7a-029307e9ee5b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:09.220497 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97206d7-b95c-4aac-9c7a-029307e9ee5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:09.315997 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2776/5540] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:09.389254 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-f97206d7-b95c-4aac-9c7a-029307e9ee5b None None] MFA Rules not processed for user `ea92ff9a9c1142ce8890ab1379535f1b`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:09.393541 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f97206d7-b95c-4aac-9c7a-029307e9ee5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:09.626632 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2765/5541] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:09.646887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c77d5b-29bc-48f5-bc2f-ba579ba7432c None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:09.698035 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c77d5b-29bc-48f5-bc2f-ba579ba7432c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:09.698035 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c77d5b-29bc-48f5-bc2f-ba579ba7432c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:09.698035 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-81c77d5b-29bc-48f5-bc2f-ba579ba7432c None None] MFA Rules not processed for user `ea92ff9a9c1142ce8890ab1379535f1b`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:09.698035 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-81c77d5b-29bc-48f5-bc2f-ba579ba7432c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:09.698035 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2777/5542] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:09.863728 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97206d7-b95c-4aac-9c7a-029307e9ee5b None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:09.865280 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f97206d7-b95c-4aac-9c7a-029307e9ee5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:09.970811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97206d7-b95c-4aac-9c7a-029307e9ee5b None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:09.979555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de648333-37de-4ee1-a399-3958540f4579 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:09.980831 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de648333-37de-4ee1-a399-3958540f4579 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:09.981185 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de648333-37de-4ee1-a399-3958540f4579 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:09.981716 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de648333-37de-4ee1-a399-3958540f4579 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:10.003912 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de648333-37de-4ee1-a399-3958540f4579 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:10.007696 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de648333-37de-4ee1-a399-3958540f4579 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:10.031031 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2766/5543] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:30:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:30:10.593512 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03083b-6a1a-4bc3-a1e4-2d6349c6ab97 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:10.594177 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03083b-6a1a-4bc3-a1e4-2d6349c6ab97 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:10.594527 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03083b-6a1a-4bc3-a1e4-2d6349c6ab97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:10.635026 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-fa03083b-6a1a-4bc3-a1e4-2d6349c6ab97 None None] MFA Rules not processed for user `baf1d13615bc491ab98d2a644e681c12`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:10.636263 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-fa03083b-6a1a-4bc3-a1e4-2d6349c6ab97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:10.775502 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2778/5544] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:10.952531 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69188ef0-b120-42d4-9cf8-2fb0337cf474 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:10.953019 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69188ef0-b120-42d4-9cf8-2fb0337cf474 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:10.953303 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69188ef0-b120-42d4-9cf8-2fb0337cf474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:10.988167 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-69188ef0-b120-42d4-9cf8-2fb0337cf474 None None] MFA Rules not processed for user `ea92ff9a9c1142ce8890ab1379535f1b`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:10.990249 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-69188ef0-b120-42d4-9cf8-2fb0337cf474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:11.012663 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2767/5545] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:11.926225 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d69d3-747d-4c82-a782-2993ab32e18a None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:11.927821 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d69d3-747d-4c82-a782-2993ab32e18a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:11.928308 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d69d3-747d-4c82-a782-2993ab32e18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:11.939667 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69188ef0-b120-42d4-9cf8-2fb0337cf474 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:11.941454 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-69188ef0-b120-42d4-9cf8-2fb0337cf474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:11.952225 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-b47d69d3-747d-4c82-a782-2993ab32e18a None None] MFA Rules not processed for user `baf1d13615bc491ab98d2a644e681c12`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:11.954335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b47d69d3-747d-4c82-a782-2993ab32e18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:11.976390 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2779/5546] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:12.106467 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69188ef0-b120-42d4-9cf8-2fb0337cf474 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:12.112689 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc0a14-d34e-4712-b2fb-4a632f307369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:12.113894 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc0a14-d34e-4712-b2fb-4a632f307369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:12.114774 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc0a14-d34e-4712-b2fb-4a632f307369 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:12.115291 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc0a14-d34e-4712-b2fb-4a632f307369 admin admin] PATH_INFO: `/v3/users/b701641bb7d04b04a2d17f7cabacf0ba` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:12.117058 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc0a14-d34e-4712-b2fb-4a632f307369 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b701641bb7d04b04a2d17f7cabacf0ba)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:12.119489 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc0a14-d34e-4712-b2fb-4a632f307369 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:12.519716 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c8dc0a14-d34e-4712-b2fb-4a632f307369 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b701641bb7d04b04a2d17f7cabacf0ba'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:12.547166 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c8dc0a14-d34e-4712-b2fb-4a632f307369 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b701641bb7d04b04a2d17f7cabacf0ba'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:12.658978 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c8dc0a14-d34e-4712-b2fb-4a632f307369 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b701641bb7d04b04a2d17f7cabacf0ba'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:12.660096 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c8dc0a14-d34e-4712-b2fb-4a632f307369 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b701641bb7d04b04a2d17f7cabacf0ba'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:12.673828 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c8dc0a14-d34e-4712-b2fb-4a632f307369 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b701641bb7d04b04a2d17f7cabacf0ba'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:12.703992 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2768/5547] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:30:11 2022] DELETE /identity/v3/users/b701641bb7d04b04a2d17f7cabacf0ba => generated 0 bytes in 765 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:12.709113 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b087a-9f64-4b37-b40a-f9d2e03397c7 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:12.709487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b087a-9f64-4b37-b40a-f9d2e03397c7 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:12.709867 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b087a-9f64-4b37-b40a-f9d2e03397c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:12.772743 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218c534-1bee-4e18-93df-fb171a13246d None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:12.773465 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218c534-1bee-4e18-93df-fb171a13246d None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:12.773971 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218c534-1bee-4e18-93df-fb171a13246d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:12.779540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-529b087a-9f64-4b37-b40a-f9d2e03397c7 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:12.779540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-529b087a-9f64-4b37-b40a-f9d2e03397c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:12.805547 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-7218c534-1bee-4e18-93df-fb171a13246d None None] MFA Rules not processed for user `baf1d13615bc491ab98d2a644e681c12`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:12.806844 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7218c534-1bee-4e18-93df-fb171a13246d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:12.860661 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2780/5548] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:12.882340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b087a-9f64-4b37-b40a-f9d2e03397c7 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:12.885909 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2769/5549] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:30:12.886075 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-529b087a-9f64-4b37-b40a-f9d2e03397c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:13.090459 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b087a-9f64-4b37-b40a-f9d2e03397c7 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:13.095260 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2eaca1-c06b-45d0-807d-52f7a7163d09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:13.099342 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2eaca1-c06b-45d0-807d-52f7a7163d09 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:13.099342 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2eaca1-c06b-45d0-807d-52f7a7163d09 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:13.099342 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2eaca1-c06b-45d0-807d-52f7a7163d09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:13.111827 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2eaca1-c06b-45d0-807d-52f7a7163d09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:13.113681 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2eaca1-c06b-45d0-807d-52f7a7163d09 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:13.126930 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2781/5550] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:30:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:30:13.544024 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c994ff-fad9-41cf-9863-504179f14dac None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:13.545012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c994ff-fad9-41cf-9863-504179f14dac None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:13.545545 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c994ff-fad9-41cf-9863-504179f14dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:13.568551 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-67c994ff-fad9-41cf-9863-504179f14dac None None] MFA Rules not processed for user `baf1d13615bc491ab98d2a644e681c12`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:13.569817 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-67c994ff-fad9-41cf-9863-504179f14dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:13.586154 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2770/5551] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:13.884541 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2eaca1-c06b-45d0-807d-52f7a7163d09 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:13.884541 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3f2eaca1-c06b-45d0-807d-52f7a7163d09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:13.902373 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2eaca1-c06b-45d0-807d-52f7a7163d09 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:13.919855 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163d209-f950-4a21-a6b5-63e339d9ba3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:13.920947 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163d209-f950-4a21-a6b5-63e339d9ba3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:13.921385 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163d209-f950-4a21-a6b5-63e339d9ba3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:13.922283 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163d209-f950-4a21-a6b5-63e339d9ba3f admin admin] PATH_INFO: `/v3/projects/6288132730a14d21862e2f522b79f172` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:13.928379 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6163d209-f950-4a21-a6b5-63e339d9ba3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6288132730a14d21862e2f522b79f172)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:13.930519 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6163d209-f950-4a21-a6b5-63e339d9ba3f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:14.071705 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5eb79-0cad-46dd-9951-4dbb007945cf None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:14.073148 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5eb79-0cad-46dd-9951-4dbb007945cf None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:14.073148 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5eb79-0cad-46dd-9951-4dbb007945cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:14.104555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-ecd5eb79-0cad-46dd-9951-4dbb007945cf None None] MFA Rules not processed for user `baf1d13615bc491ab98d2a644e681c12`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:14.106262 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ecd5eb79-0cad-46dd-9951-4dbb007945cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:14.124114 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6163d209-f950-4a21-a6b5-63e339d9ba3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6288132730a14d21862e2f522b79f172', 'request_id': 'req-6163d209-f950-4a21-a6b5-63e339d9ba3f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:14.142699 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6163d209-f950-4a21-a6b5-63e339d9ba3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6288132730a14d21862e2f522b79f172', 'request_id': 'req-6163d209-f950-4a21-a6b5-63e339d9ba3f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:14.157735 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6163d209-f950-4a21-a6b5-63e339d9ba3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6288132730a14d21862e2f522b79f172', 'request_id': 'req-6163d209-f950-4a21-a6b5-63e339d9ba3f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:14.191512 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2771/5552] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:14.339590 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6163d209-f950-4a21-a6b5-63e339d9ba3f admin admin] The token cache is being invalidate because project 6288132730a14d21862e2f522b79f172 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:30:14.340030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6163d209-f950-4a21-a6b5-63e339d9ba3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:14.342508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6163d209-f950-4a21-a6b5-63e339d9ba3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:14.347213 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2782/5553] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:30:13 2022] DELETE /identity/v3/projects/6288132730a14d21862e2f522b79f172 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:14.353238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5eb79-0cad-46dd-9951-4dbb007945cf None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:14.483010 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5eb79-0cad-46dd-9951-4dbb007945cf None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:14.488283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d222f-dccb-422d-8e09-e3c4dadcec9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:14.489843 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d222f-dccb-422d-8e09-e3c4dadcec9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:14.490232 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d222f-dccb-422d-8e09-e3c4dadcec9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:14.490614 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d222f-dccb-422d-8e09-e3c4dadcec9b admin admin] PATH_INFO: `/v3/users/132529f48fc9458794951ba976e5eeb7` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:14.491931 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d222f-dccb-422d-8e09-e3c4dadcec9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=132529f48fc9458794951ba976e5eeb7)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:14.498955 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d222f-dccb-422d-8e09-e3c4dadcec9b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:14.762497 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-760d222f-dccb-422d-8e09-e3c4dadcec9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '132529f48fc9458794951ba976e5eeb7'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:14.787095 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-760d222f-dccb-422d-8e09-e3c4dadcec9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '132529f48fc9458794951ba976e5eeb7'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:14.874622 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-760d222f-dccb-422d-8e09-e3c4dadcec9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '132529f48fc9458794951ba976e5eeb7'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:14.876194 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-760d222f-dccb-422d-8e09-e3c4dadcec9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '132529f48fc9458794951ba976e5eeb7'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:14.895255 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-760d222f-dccb-422d-8e09-e3c4dadcec9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '132529f48fc9458794951ba976e5eeb7'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:14.908982 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2772/5554] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:30:14 2022] DELETE /identity/v3/users/132529f48fc9458794951ba976e5eeb7 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:15.038941 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384d32e-885a-4060-95af-b45a80805be7 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:15.039633 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384d32e-885a-4060-95af-b45a80805be7 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:15.040098 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384d32e-885a-4060-95af-b45a80805be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:15.071918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-0384d32e-885a-4060-95af-b45a80805be7 None None] MFA Rules not processed for user `baf1d13615bc491ab98d2a644e681c12`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:15.075857 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0384d32e-885a-4060-95af-b45a80805be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:15.189796 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2783/5555] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:15.205852 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d222f-dccb-422d-8e09-e3c4dadcec9b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:15.208214 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-760d222f-dccb-422d-8e09-e3c4dadcec9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:15.304549 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d222f-dccb-422d-8e09-e3c4dadcec9b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:15.308703 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17300d9-325e-4c22-a5b3-bd07328d48be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:15.309312 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17300d9-325e-4c22-a5b3-bd07328d48be admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:15.312336 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17300d9-325e-4c22-a5b3-bd07328d48be admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:15.312850 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17300d9-325e-4c22-a5b3-bd07328d48be admin admin] PATH_INFO: `/v3/projects/6780790a3cd54b13968a6d757db38d45` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:15.313370 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384d32e-885a-4060-95af-b45a80805be7 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:15.314424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17300d9-325e-4c22-a5b3-bd07328d48be admin admin] RBAC: Authorizing `identity:delete_project(project_id=6780790a3cd54b13968a6d757db38d45)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:15.315724 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0384d32e-885a-4060-95af-b45a80805be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:15.316636 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17300d9-325e-4c22-a5b3-bd07328d48be admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:15.333969 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384d32e-885a-4060-95af-b45a80805be7 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:15.340422 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b845f9-81b3-4565-b19a-454408a45281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:15.341710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b845f9-81b3-4565-b19a-454408a45281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:15.342094 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b845f9-81b3-4565-b19a-454408a45281 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:15.342442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b845f9-81b3-4565-b19a-454408a45281 admin admin] PATH_INFO: `/v3/users/f3e406059e394bc89a1bb7609c8d4236` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:15.343833 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b845f9-81b3-4565-b19a-454408a45281 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3e406059e394bc89a1bb7609c8d4236)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:15.346111 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b845f9-81b3-4565-b19a-454408a45281 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:15.430359 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e17300d9-325e-4c22-a5b3-bd07328d48be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6780790a3cd54b13968a6d757db38d45', 'request_id': 'req-e17300d9-325e-4c22-a5b3-bd07328d48be'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:15.436275 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e17300d9-325e-4c22-a5b3-bd07328d48be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6780790a3cd54b13968a6d757db38d45', 'request_id': 'req-e17300d9-325e-4c22-a5b3-bd07328d48be'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:15.443528 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e17300d9-325e-4c22-a5b3-bd07328d48be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6780790a3cd54b13968a6d757db38d45', 'request_id': 'req-e17300d9-325e-4c22-a5b3-bd07328d48be'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:15.542291 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-82b845f9-81b3-4565-b19a-454408a45281 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3e406059e394bc89a1bb7609c8d4236'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:15.556542 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-82b845f9-81b3-4565-b19a-454408a45281 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3e406059e394bc89a1bb7609c8d4236'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:15.564393 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e17300d9-325e-4c22-a5b3-bd07328d48be admin admin] The token cache is being invalidate because project 6780790a3cd54b13968a6d757db38d45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:30:15.564813 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e17300d9-325e-4c22-a5b3-bd07328d48be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:15.565392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e17300d9-325e-4c22-a5b3-bd07328d48be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:15.567081 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2773/5556] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:30:15 2022] DELETE /identity/v3/projects/6780790a3cd54b13968a6d757db38d45 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:15.572558 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810609d9-1ce5-47b1-93e9-a61284a71360 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:15.573125 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810609d9-1ce5-47b1-93e9-a61284a71360 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:15.573639 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810609d9-1ce5-47b1-93e9-a61284a71360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:15.595720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-810609d9-1ce5-47b1-93e9-a61284a71360 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:15.597360 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-810609d9-1ce5-47b1-93e9-a61284a71360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:15.647006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-82b845f9-81b3-4565-b19a-454408a45281 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3e406059e394bc89a1bb7609c8d4236'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:15.661556 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-82b845f9-81b3-4565-b19a-454408a45281 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3e406059e394bc89a1bb7609c8d4236'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:15.662630 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-82b845f9-81b3-4565-b19a-454408a45281 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3e406059e394bc89a1bb7609c8d4236'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:15.671104 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2784/5557] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:30:15 2022] DELETE /identity/v3/users/f3e406059e394bc89a1bb7609c8d4236 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:15.671583 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2774/5558] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:15.679488 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56832025-2de6-44a8-85fe-378920a73c76 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:15.680092 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56832025-2de6-44a8-85fe-378920a73c76 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:15.680446 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56832025-2de6-44a8-85fe-378920a73c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:15.703434 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-56832025-2de6-44a8-85fe-378920a73c76 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:15.704545 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-56832025-2de6-44a8-85fe-378920a73c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:15.844916 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2785/5559] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:15.846613 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810609d9-1ce5-47b1-93e9-a61284a71360 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:15.849243 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-810609d9-1ce5-47b1-93e9-a61284a71360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:15.868631 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810609d9-1ce5-47b1-93e9-a61284a71360 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:15.877994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46aad6-fafd-4ee5-92a8-e87a9e7336c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:15.878827 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46aad6-fafd-4ee5-92a8-e87a9e7336c4 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:15.879908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46aad6-fafd-4ee5-92a8-e87a9e7336c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:15.880288 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46aad6-fafd-4ee5-92a8-e87a9e7336c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:15.881188 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae46aad6-fafd-4ee5-92a8-e87a9e7336c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:30:15.881604 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae46aad6-fafd-4ee5-92a8-e87a9e7336c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:15.883509 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae46aad6-fafd-4ee5-92a8-e87a9e7336c4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:15.902464 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2775/5560] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:30:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:30:15.906644 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56832025-2de6-44a8-85fe-378920a73c76 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:15.924144 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56832025-2de6-44a8-85fe-378920a73c76 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:15.926560 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52616304-d22c-46af-9070-8c0b8f3dec04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:15.927425 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52616304-d22c-46af-9070-8c0b8f3dec04 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:15.927873 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52616304-d22c-46af-9070-8c0b8f3dec04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:15.928306 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52616304-d22c-46af-9070-8c0b8f3dec04 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:15.929792 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52616304-d22c-46af-9070-8c0b8f3dec04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:15.932279 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52616304-d22c-46af-9070-8c0b8f3dec04 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:16.073800 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2786/5561] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:30:15 2022] POST /identity/v3/projects => generated 365 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:30:16.076551 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46aad6-fafd-4ee5-92a8-e87a9e7336c4 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:16.084485 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52616304-d22c-46af-9070-8c0b8f3dec04 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:16.090616 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46aad6-fafd-4ee5-92a8-e87a9e7336c4 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:16.092463 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-52616304-d22c-46af-9070-8c0b8f3dec04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:16.178604 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f2028-6bbe-4cf7-9cb6-8c662635785c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:16.179300 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f2028-6bbe-4cf7-9cb6-8c662635785c admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:16.179782 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f2028-6bbe-4cf7-9cb6-8c662635785c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:16.180066 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f2028-6bbe-4cf7-9cb6-8c662635785c admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:16.180766 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f2028-6bbe-4cf7-9cb6-8c662635785c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:16.183727 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f2028-6bbe-4cf7-9cb6-8c662635785c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:16.187982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52616304-d22c-46af-9070-8c0b8f3dec04 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:16.204481 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f283f-61d4-475b-9618-4be999dea82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:16.205508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f283f-61d4-475b-9618-4be999dea82c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:16.205952 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f283f-61d4-475b-9618-4be999dea82c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:16.206341 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f283f-61d4-475b-9618-4be999dea82c admin admin] PATH_INFO: `/v3/projects/af7d810b16a945cc921509e1c20d101d` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:16.208257 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99f283f-61d4-475b-9618-4be999dea82c admin admin] RBAC: Authorizing `identity:delete_project(project_id=af7d810b16a945cc921509e1c20d101d)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:16.214716 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99f283f-61d4-475b-9618-4be999dea82c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:16.302095 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2776/5562] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:30:16 2022] POST /identity/v3/users => generated 283 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:30:16.306389 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a468645-2728-4b6e-8f98-9985b18c69b7 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:16.306711 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a468645-2728-4b6e-8f98-9985b18c69b7 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:16.306991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a468645-2728-4b6e-8f98-9985b18c69b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:16.325031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-1a468645-2728-4b6e-8f98-9985b18c69b7 None None] MFA Rules not processed for user `baf1d13615bc491ab98d2a644e681c12`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:16.326283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1a468645-2728-4b6e-8f98-9985b18c69b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:16.358064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e99f283f-61d4-475b-9618-4be999dea82c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af7d810b16a945cc921509e1c20d101d', 'request_id': 'req-e99f283f-61d4-475b-9618-4be999dea82c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:16.363329 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e99f283f-61d4-475b-9618-4be999dea82c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af7d810b16a945cc921509e1c20d101d', 'request_id': 'req-e99f283f-61d4-475b-9618-4be999dea82c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:16.370377 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e99f283f-61d4-475b-9618-4be999dea82c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af7d810b16a945cc921509e1c20d101d', 'request_id': 'req-e99f283f-61d4-475b-9618-4be999dea82c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:16.381985 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2777/5563] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:16.382837 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a468645-2728-4b6e-8f98-9985b18c69b7 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:16.393048 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a468645-2728-4b6e-8f98-9985b18c69b7 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:16.459185 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e99f283f-61d4-475b-9618-4be999dea82c admin admin] The token cache is being invalidate because project af7d810b16a945cc921509e1c20d101d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:30:16.459490 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e99f283f-61d4-475b-9618-4be999dea82c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:16.461038 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e99f283f-61d4-475b-9618-4be999dea82c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:16.469200 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2787/5564] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:30:16 2022] DELETE /identity/v3/projects/af7d810b16a945cc921509e1c20d101d => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:16.471204 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d0baa-5cbe-4b3f-adb9-b938b2ee3bb2 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:16.471487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d0baa-5cbe-4b3f-adb9-b938b2ee3bb2 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:16.471765 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d0baa-5cbe-4b3f-adb9-b938b2ee3bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:16.478959 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c38b3-c4ac-4dfa-9548-eae9bfe00047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:16.479743 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c38b3-c4ac-4dfa-9548-eae9bfe00047 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:16.480102 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c38b3-c4ac-4dfa-9548-eae9bfe00047 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:16.480450 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c38b3-c4ac-4dfa-9548-eae9bfe00047 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:16.481234 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c38b3-c4ac-4dfa-9548-eae9bfe00047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:16.482902 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c38b3-c4ac-4dfa-9548-eae9bfe00047 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:16.494624 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2778/5565] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:30:16.498914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-9b1d0baa-5cbe-4b3f-adb9-b938b2ee3bb2 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:16.499168 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c38b3-c4ac-4dfa-9548-eae9bfe00047 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:16.500453 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9b1d0baa-5cbe-4b3f-adb9-b938b2ee3bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:16.500939 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a01c38b3-c4ac-4dfa-9548-eae9bfe00047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:16.510272 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2788/5566] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:16.516187 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c38b3-c4ac-4dfa-9548-eae9bfe00047 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:16.521199 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d1c1b-9b4e-43b5-8d74-7c6b3a6f90ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:16.522092 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d1c1b-9b4e-43b5-8d74-7c6b3a6f90ed admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:16.522382 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d1c1b-9b4e-43b5-8d74-7c6b3a6f90ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:16.522663 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d1c1b-9b4e-43b5-8d74-7c6b3a6f90ed admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:16.523445 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d1c1b-9b4e-43b5-8d74-7c6b3a6f90ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:16.525557 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d1c1b-9b4e-43b5-8d74-7c6b3a6f90ed admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:16.526434 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c4e28-b467-4309-b352-328a75ae3e19 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:16.526735 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c4e28-b467-4309-b352-328a75ae3e19 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:16.527010 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c4e28-b467-4309-b352-328a75ae3e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:16.538936 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2779/5567] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:30:16.544491 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d1c1b-9b4e-43b5-8d74-7c6b3a6f90ed admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:16.553793 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-2c3c4e28-b467-4309-b352-328a75ae3e19 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:16.555353 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2c3c4e28-b467-4309-b352-328a75ae3e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:16.556525 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d1c1b-9b4e-43b5-8d74-7c6b3a6f90ed admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:16.568105 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2789/5568] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:16.569046 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c4e28-b467-4309-b352-328a75ae3e19 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:16.570184 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a3c7f-d8d2-46be-b7d0-810b3740ab77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:16.571125 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a3c7f-d8d2-46be-b7d0-810b3740ab77 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:16.571412 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a3c7f-d8d2-46be-b7d0-810b3740ab77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:16.571694 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a3c7f-d8d2-46be-b7d0-810b3740ab77 admin admin] PATH_INFO: `/v3/projects/14218f5716604c4c8788c246f5fb3990/users/f235341f64214d12a52311e834d3b674/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:16.579324 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c4e28-b467-4309-b352-328a75ae3e19 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:16.584210 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b117d1-e482-45e8-b0ce-907d2fd17b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:16.584884 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b117d1-e482-45e8-b0ce-907d2fd17b1b admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:16.587945 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b117d1-e482-45e8-b0ce-907d2fd17b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:16.587945 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b117d1-e482-45e8-b0ce-907d2fd17b1b admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:16.587945 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b117d1-e482-45e8-b0ce-907d2fd17b1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:30:16.587945 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b117d1-e482-45e8-b0ce-907d2fd17b1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:16.588351 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b117d1-e482-45e8-b0ce-907d2fd17b1b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:16.590890 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a3c7f-d8d2-46be-b7d0-810b3740ab77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14218f5716604c4c8788c246f5fb3990, user_id=f235341f64214d12a52311e834d3b674, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:16.593893 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a3c7f-d8d2-46be-b7d0-810b3740ab77 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:16.600928 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2790/5569] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:30:16.605374 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b117d1-e482-45e8-b0ce-907d2fd17b1b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:16.616376 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b117d1-e482-45e8-b0ce-907d2fd17b1b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:16.621206 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822123c-c84c-4457-94a0-3dee54ce37a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:16.621947 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822123c-c84c-4457-94a0-3dee54ce37a0 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:16.621947 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822123c-c84c-4457-94a0-3dee54ce37a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:16.622273 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822123c-c84c-4457-94a0-3dee54ce37a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:16.623056 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2822123c-c84c-4457-94a0-3dee54ce37a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:16.625801 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2822123c-c84c-4457-94a0-3dee54ce37a0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:16.670347 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2780/5570] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:30:16 2022] PUT /identity/v3/projects/14218f5716604c4c8788c246f5fb3990/users/f235341f64214d12a52311e834d3b674/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:16.681482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba091f6-2d77-4aea-b34e-8f8f307e8934 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:16.681800 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba091f6-2d77-4aea-b34e-8f8f307e8934 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:16.682085 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba091f6-2d77-4aea-b34e-8f8f307e8934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:16.709822 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-6ba091f6-2d77-4aea-b34e-8f8f307e8934 None None] MFA Rules not processed for user `f235341f64214d12a52311e834d3b674`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:16.711037 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6ba091f6-2d77-4aea-b34e-8f8f307e8934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:16.750228 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2791/5571] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:30:16 2022] POST /identity/v3/projects => generated 393 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:30:16.771453 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822123c-c84c-4457-94a0-3dee54ce37a0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:16.794852 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2781/5572] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:16 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:30:16.796865 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba091f6-2d77-4aea-b34e-8f8f307e8934 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:16.917001 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822123c-c84c-4457-94a0-3dee54ce37a0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:16.930190 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33096089-accd-407c-a9dc-f2e87200ce9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:16.931051 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33096089-accd-407c-a9dc-f2e87200ce9f admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:16.932077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33096089-accd-407c-a9dc-f2e87200ce9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:16.932077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33096089-accd-407c-a9dc-f2e87200ce9f admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:16.932517 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33096089-accd-407c-a9dc-f2e87200ce9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:16.934781 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33096089-accd-407c-a9dc-f2e87200ce9f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:16.945120 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba091f6-2d77-4aea-b34e-8f8f307e8934 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:16.965184 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e86271-895a-481c-a96c-26216a1c25a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:16.966239 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e86271-895a-481c-a96c-26216a1c25a5 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:16.966525 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e86271-895a-481c-a96c-26216a1c25a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:16.966859 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e86271-895a-481c-a96c-26216a1c25a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:16.967638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e86271-895a-481c-a96c-26216a1c25a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:16.973412 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e86271-895a-481c-a96c-26216a1c25a5 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:17.102280 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2792/5573] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:30:16 2022] POST /identity/v3/users => generated 297 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:30:17.108240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33096089-accd-407c-a9dc-f2e87200ce9f admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:17.121023 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33096089-accd-407c-a9dc-f2e87200ce9f admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:17.126979 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdd408-302e-448d-bebd-c045b4d91f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:17.128770 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdd408-302e-448d-bebd-c045b4d91f9c admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:17.128770 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdd408-302e-448d-bebd-c045b4d91f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:17.128770 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdd408-302e-448d-bebd-c045b4d91f9c admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:17.129876 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fdd408-302e-448d-bebd-c045b4d91f9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:17.132041 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fdd408-302e-448d-bebd-c045b4d91f9c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:17.143455 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2793/5574] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:30:17.147900 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdd408-302e-448d-bebd-c045b4d91f9c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:17.158413 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdd408-302e-448d-bebd-c045b4d91f9c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:17.165324 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eae604-038c-49c5-b4cf-39cad50fe5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:17.170809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eae604-038c-49c5-b4cf-39cad50fe5b0 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:17.170809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eae604-038c-49c5-b4cf-39cad50fe5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:17.170809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eae604-038c-49c5-b4cf-39cad50fe5b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:17.170809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eae604-038c-49c5-b4cf-39cad50fe5b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:17.173459 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eae604-038c-49c5-b4cf-39cad50fe5b0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:17.187588 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2782/5575] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:30:16 2022] POST /identity/v3/projects => generated 363 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:30:17.192381 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e86271-895a-481c-a96c-26216a1c25a5 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:17.217478 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2794/5576] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:30:17.223061 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eae604-038c-49c5-b4cf-39cad50fe5b0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:17.241575 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eae604-038c-49c5-b4cf-39cad50fe5b0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:17.305900 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e86271-895a-481c-a96c-26216a1c25a5 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:17.317669 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c077cf-cd43-454b-9b10-12fb778dd856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:17.318388 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c077cf-cd43-454b-9b10-12fb778dd856 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:17.318594 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c077cf-cd43-454b-9b10-12fb778dd856 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:17.319039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c077cf-cd43-454b-9b10-12fb778dd856 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:17.319899 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c077cf-cd43-454b-9b10-12fb778dd856 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:17.321930 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c077cf-cd43-454b-9b10-12fb778dd856 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:17.368907 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b818d7-9862-4233-85d8-3e3a83cac1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:17.370235 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b818d7-9862-4233-85d8-3e3a83cac1b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:17.370528 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b818d7-9862-4233-85d8-3e3a83cac1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:17.370932 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b818d7-9862-4233-85d8-3e3a83cac1b2 admin admin] PATH_INFO: `/v3/projects/9ef2f32360be4d6c87d31bb5307ad696/users/41a26877b24c4687a0c8cc4ffc6d69dd/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:17.395852 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b818d7-9862-4233-85d8-3e3a83cac1b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ef2f32360be4d6c87d31bb5307ad696, user_id=41a26877b24c4687a0c8cc4ffc6d69dd, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:17.398931 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b818d7-9862-4233-85d8-3e3a83cac1b2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:17.488174 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2783/5577] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:30:17 2022] POST /identity/v3/users => generated 288 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:30:17.491013 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c077cf-cd43-454b-9b10-12fb778dd856 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:17.515815 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c077cf-cd43-454b-9b10-12fb778dd856 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:17.522490 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b508d-04c8-47df-82cb-a48559303b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:17.523208 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b508d-04c8-47df-82cb-a48559303b09 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:17.523486 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b508d-04c8-47df-82cb-a48559303b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:17.523763 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b508d-04c8-47df-82cb-a48559303b09 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:17.524486 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b508d-04c8-47df-82cb-a48559303b09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:17.526132 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b508d-04c8-47df-82cb-a48559303b09 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:17.552732 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2795/5578] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:30:17 2022] PUT /identity/v3/projects/9ef2f32360be4d6c87d31bb5307ad696/users/41a26877b24c4687a0c8cc4ffc6d69dd/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:17.557821 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2784/5579] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:30:17.559913 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fab4ff-0987-4062-8cc2-e6ab7d06ee1c None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:17.560215 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fab4ff-0987-4062-8cc2-e6ab7d06ee1c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:17.560494 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fab4ff-0987-4062-8cc2-e6ab7d06ee1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:17.567568 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b508d-04c8-47df-82cb-a48559303b09 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:17.581453 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b508d-04c8-47df-82cb-a48559303b09 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:17.585891 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-71fab4ff-0987-4062-8cc2-e6ab7d06ee1c None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:17.587151 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-71fab4ff-0987-4062-8cc2-e6ab7d06ee1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:17.651544 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d603c-aa41-45ae-b248-4470f20e6605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:17.652365 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d603c-aa41-45ae-b248-4470f20e6605 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:17.652653 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d603c-aa41-45ae-b248-4470f20e6605 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:17.652916 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d603c-aa41-45ae-b248-4470f20e6605 admin admin] PATH_INFO: `/v3/projects/34511e02d71b404bbf183dfdbfa3603b/users/7c36b291312f4044ade3b1729d00244b/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:17.659457 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2796/5580] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:17.669523 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fab4ff-0987-4062-8cc2-e6ab7d06ee1c None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:17.671242 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-71fab4ff-0987-4062-8cc2-e6ab7d06ee1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:17.672715 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d603c-aa41-45ae-b248-4470f20e6605 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34511e02d71b404bbf183dfdbfa3603b, user_id=7c36b291312f4044ade3b1729d00244b, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:17.675703 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d603c-aa41-45ae-b248-4470f20e6605 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:17.737617 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fab4ff-0987-4062-8cc2-e6ab7d06ee1c None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:17.741952 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff648d6-c021-4054-8727-aa2f62734f77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:17.742627 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff648d6-c021-4054-8727-aa2f62734f77 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:17.742909 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff648d6-c021-4054-8727-aa2f62734f77 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:17.744308 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff648d6-c021-4054-8727-aa2f62734f77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:17.753091 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff648d6-c021-4054-8727-aa2f62734f77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:17.754672 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff648d6-c021-4054-8727-aa2f62734f77 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:17.765812 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2797/5581] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:30:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:30:17.768003 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2785/5582] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:30:17 2022] PUT /identity/v3/projects/34511e02d71b404bbf183dfdbfa3603b/users/7c36b291312f4044ade3b1729d00244b/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:17.774209 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff648d6-c021-4054-8727-aa2f62734f77 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:17.781858 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff648d6-c021-4054-8727-aa2f62734f77 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:17.853049 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843cbe94-293a-4169-8256-b64fa932bf68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:17.853723 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843cbe94-293a-4169-8256-b64fa932bf68 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:17.854085 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843cbe94-293a-4169-8256-b64fa932bf68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:17.854363 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843cbe94-293a-4169-8256-b64fa932bf68 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:17.855089 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843cbe94-293a-4169-8256-b64fa932bf68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:17.856877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843cbe94-293a-4169-8256-b64fa932bf68 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:17.867759 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2798/5583] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:30:17.872247 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d603c-aa41-45ae-b248-4470f20e6605 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:17.883224 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d603c-aa41-45ae-b248-4470f20e6605 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:17.889042 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ba387-6e0c-4f50-9ea4-b792c39b2446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:17.890178 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ba387-6e0c-4f50-9ea4-b792c39b2446 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:17.890460 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ba387-6e0c-4f50-9ea4-b792c39b2446 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:17.890935 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ba387-6e0c-4f50-9ea4-b792c39b2446 admin admin] PATH_INFO: `/v3/projects/34511e02d71b404bbf183dfdbfa3603b/users/7c36b291312f4044ade3b1729d00244b/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:17.895327 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ba387-6e0c-4f50-9ea4-b792c39b2446 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34511e02d71b404bbf183dfdbfa3603b, user_id=7c36b291312f4044ade3b1729d00244b, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:17.899986 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ba387-6e0c-4f50-9ea4-b792c39b2446 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:17.923292 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2786/5584] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:30:17 2022] PUT /identity/v3/projects/34511e02d71b404bbf183dfdbfa3603b/users/7c36b291312f4044ade3b1729d00244b/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:30:17.934985 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa362d-573f-485e-93cf-018c4aa85a7e None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:17.935293 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa362d-573f-485e-93cf-018c4aa85a7e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:17.935655 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa362d-573f-485e-93cf-018c4aa85a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:17.969947 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-77aa362d-573f-485e-93cf-018c4aa85a7e None None] MFA Rules not processed for user `7c36b291312f4044ade3b1729d00244b`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:17.971305 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-77aa362d-573f-485e-93cf-018c4aa85a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:18.046964 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2799/5585] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:17 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:18.058429 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ba387-6e0c-4f50-9ea4-b792c39b2446 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:18.060634 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3c4ba387-6e0c-4f50-9ea4-b792c39b2446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:18.150469 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ba387-6e0c-4f50-9ea4-b792c39b2446 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:18.154257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe89539e-3ac3-4fee-a27a-737c83c11708 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:18.154935 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89539e-3ac3-4fee-a27a-737c83c11708 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:18.155449 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89539e-3ac3-4fee-a27a-737c83c11708 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:18.155744 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89539e-3ac3-4fee-a27a-737c83c11708 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:18.169268 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe89539e-3ac3-4fee-a27a-737c83c11708 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:18.169268 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe89539e-3ac3-4fee-a27a-737c83c11708 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:18.193983 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2787/5586] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:30:18 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:30:20.028433 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693a7bf-9040-492f-ae5c-1be93d602506 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:20.029407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693a7bf-9040-492f-ae5c-1be93d602506 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:20.030399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693a7bf-9040-492f-ae5c-1be93d602506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:20.055408 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-6693a7bf-9040-492f-ae5c-1be93d602506 None None] MFA Rules not processed for user `baf1d13615bc491ab98d2a644e681c12`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:20.071251 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6693a7bf-9040-492f-ae5c-1be93d602506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:20.231726 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2800/5587] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:20.536944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe89539e-3ac3-4fee-a27a-737c83c11708 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:20.541114 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-fe89539e-3ac3-4fee-a27a-737c83c11708 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:20.779297 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe89539e-3ac3-4fee-a27a-737c83c11708 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:20.792401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b2fc33-1694-481a-82b5-2a6c80ef6ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:20.793493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2fc33-1694-481a-82b5-2a6c80ef6ab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:20.793869 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2fc33-1694-481a-82b5-2a6c80ef6ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:20.799939 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2fc33-1694-481a-82b5-2a6c80ef6ab3 admin admin] PATH_INFO: `/v3/users/666ed7c4c48b4a9886026bcb6151f3bc` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:20.799939 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b2fc33-1694-481a-82b5-2a6c80ef6ab3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=666ed7c4c48b4a9886026bcb6151f3bc)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:20.799939 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b2fc33-1694-481a-82b5-2a6c80ef6ab3 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:21.160981 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-36b2fc33-1694-481a-82b5-2a6c80ef6ab3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '666ed7c4c48b4a9886026bcb6151f3bc'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:21.218859 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6762ac-fbb0-4032-9621-98de8c8ed65d None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:21.219784 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6762ac-fbb0-4032-9621-98de8c8ed65d None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:21.219784 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6762ac-fbb0-4032-9621-98de8c8ed65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:21.227485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-36b2fc33-1694-481a-82b5-2a6c80ef6ab3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '666ed7c4c48b4a9886026bcb6151f3bc'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:21.246200 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-6c6762ac-fbb0-4032-9621-98de8c8ed65d None None] MFA Rules not processed for user `baf1d13615bc491ab98d2a644e681c12`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:21.248103 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6c6762ac-fbb0-4032-9621-98de8c8ed65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:21.344587 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2801/5588] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:30:21.376064 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-36b2fc33-1694-481a-82b5-2a6c80ef6ab3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '666ed7c4c48b4a9886026bcb6151f3bc'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:21.378797 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-36b2fc33-1694-481a-82b5-2a6c80ef6ab3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '666ed7c4c48b4a9886026bcb6151f3bc'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:21.409964 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-36b2fc33-1694-481a-82b5-2a6c80ef6ab3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '666ed7c4c48b4a9886026bcb6151f3bc'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:21.443876 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2788/5589] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:30:20 2022] DELETE /identity/v3/users/666ed7c4c48b4a9886026bcb6151f3bc => generated 0 bytes in 908 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:21.447268 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6762ac-fbb0-4032-9621-98de8c8ed65d None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:21.449225 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6896c1-b8ea-4252-8eea-cea94bc39e2a None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:21.449735 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6896c1-b8ea-4252-8eea-cea94bc39e2a None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:21.450988 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6896c1-b8ea-4252-8eea-cea94bc39e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:21.511960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6762ac-fbb0-4032-9621-98de8c8ed65d None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:21.520290 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-bd6896c1-b8ea-4252-8eea-cea94bc39e2a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:21.529620 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-bd6896c1-b8ea-4252-8eea-cea94bc39e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:21.694171 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2789/5590] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:21.715194 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6896c1-b8ea-4252-8eea-cea94bc39e2a None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:21.718587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-bd6896c1-b8ea-4252-8eea-cea94bc39e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:21.765217 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c7845-2737-4f41-b98e-ba8e2d76e79a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:21.769494 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c7845-2737-4f41-b98e-ba8e2d76e79a service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:21.770337 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c7845-2737-4f41-b98e-ba8e2d76e79a service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:21.770627 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c7845-2737-4f41-b98e-ba8e2d76e79a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:21.775005 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7f7c7845-2737-4f41-b98e-ba8e2d76e79a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:21.828450 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c7845-2737-4f41-b98e-ba8e2d76e79a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:21.837540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c7845-2737-4f41-b98e-ba8e2d76e79a service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:21.867371 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2802/5591] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:30:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:30:21.943309 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6896c1-b8ea-4252-8eea-cea94bc39e2a None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:21.956556 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690b1fa-4d6f-45ab-a10f-f83a711de82e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:21.957798 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690b1fa-4d6f-45ab-a10f-f83a711de82e service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:21.958118 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690b1fa-4d6f-45ab-a10f-f83a711de82e service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:21.958389 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690b1fa-4d6f-45ab-a10f-f83a711de82e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:21.975781 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690b1fa-4d6f-45ab-a10f-f83a711de82e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:21.978138 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690b1fa-4d6f-45ab-a10f-f83a711de82e service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:22.001035 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c7845-2737-4f41-b98e-ba8e2d76e79a service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:22.002529 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7f7c7845-2737-4f41-b98e-ba8e2d76e79a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:22.005626 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2790/5592] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:30:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:30:22.016640 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c7845-2737-4f41-b98e-ba8e2d76e79a service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:22.028334 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f5948-a3b7-472c-9ee2-77569d8d55c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:22.031259 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f5948-a3b7-472c-9ee2-77569d8d55c3 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:22.033507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f5948-a3b7-472c-9ee2-77569d8d55c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:22.037323 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f5948-a3b7-472c-9ee2-77569d8d55c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:22.045459 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-cd0f5948-a3b7-472c-9ee2-77569d8d55c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:22.334320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f5948-a3b7-472c-9ee2-77569d8d55c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:22.338700 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f5948-a3b7-472c-9ee2-77569d8d55c3 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:22.354254 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2803/5593] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:30:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:30:22.797728 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690b1fa-4d6f-45ab-a10f-f83a711de82e service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:22.800141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d690b1fa-4d6f-45ab-a10f-f83a711de82e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:22.816965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690b1fa-4d6f-45ab-a10f-f83a711de82e service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:22.828043 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a985f80-ee4b-426d-8d58-1a284b137d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:22.828043 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a985f80-ee4b-426d-8d58-1a284b137d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:22.828043 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a985f80-ee4b-426d-8d58-1a284b137d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:22.828504 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a985f80-ee4b-426d-8d58-1a284b137d2d admin admin] PATH_INFO: `/v3/projects/ebe19df8503d40afbdd17781c0cf915c` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:22.831075 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a985f80-ee4b-426d-8d58-1a284b137d2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebe19df8503d40afbdd17781c0cf915c)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:22.834273 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a985f80-ee4b-426d-8d58-1a284b137d2d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:23.060535 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7a985f80-ee4b-426d-8d58-1a284b137d2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebe19df8503d40afbdd17781c0cf915c', 'request_id': 'req-7a985f80-ee4b-426d-8d58-1a284b137d2d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:23.074907 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7a985f80-ee4b-426d-8d58-1a284b137d2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebe19df8503d40afbdd17781c0cf915c', 'request_id': 'req-7a985f80-ee4b-426d-8d58-1a284b137d2d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:23.091056 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7a985f80-ee4b-426d-8d58-1a284b137d2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebe19df8503d40afbdd17781c0cf915c', 'request_id': 'req-7a985f80-ee4b-426d-8d58-1a284b137d2d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:23.212707 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7a985f80-ee4b-426d-8d58-1a284b137d2d admin admin] The token cache is being invalidate because project ebe19df8503d40afbdd17781c0cf915c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:30:23.214490 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7a985f80-ee4b-426d-8d58-1a284b137d2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:23.215047 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7a985f80-ee4b-426d-8d58-1a284b137d2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:23.217044 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2791/5594] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:30:22 2022] DELETE /identity/v3/projects/ebe19df8503d40afbdd17781c0cf915c => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:23.221170 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f5948-a3b7-472c-9ee2-77569d8d55c3 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:23.252265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f5948-a3b7-472c-9ee2-77569d8d55c3 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:23.382370 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab519e8c-cbbc-4388-a2ba-018d4ff39fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:23.383327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab519e8c-cbbc-4388-a2ba-018d4ff39fda admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:23.383784 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab519e8c-cbbc-4388-a2ba-018d4ff39fda admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:23.384267 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab519e8c-cbbc-4388-a2ba-018d4ff39fda admin admin] PATH_INFO: `/v3/users/a69b7272fff74daf96829bc4645b6639` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:23.385831 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab519e8c-cbbc-4388-a2ba-018d4ff39fda admin admin] RBAC: Authorizing `identity:delete_user(user_id=a69b7272fff74daf96829bc4645b6639)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:23.387874 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab519e8c-cbbc-4388-a2ba-018d4ff39fda admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:23.692276 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ab519e8c-cbbc-4388-a2ba-018d4ff39fda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a69b7272fff74daf96829bc4645b6639'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:23.709715 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ab519e8c-cbbc-4388-a2ba-018d4ff39fda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a69b7272fff74daf96829bc4645b6639'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:23.852245 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ab519e8c-cbbc-4388-a2ba-018d4ff39fda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a69b7272fff74daf96829bc4645b6639'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:23.861118 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ab519e8c-cbbc-4388-a2ba-018d4ff39fda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a69b7272fff74daf96829bc4645b6639'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:23.862220 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ab519e8c-cbbc-4388-a2ba-018d4ff39fda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a69b7272fff74daf96829bc4645b6639'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:23.868902 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2804/5595] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:30:23 2022] DELETE /identity/v3/users/a69b7272fff74daf96829bc4645b6639 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:24.255064 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a985f80-ee4b-426d-8d58-1a284b137d2d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:24.257817 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7a985f80-ee4b-426d-8d58-1a284b137d2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:24.428959 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a985f80-ee4b-426d-8d58-1a284b137d2d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:24.500472 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf7b3a-9405-4611-9db7-ab13e993fb27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:24.503470 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf7b3a-9405-4611-9db7-ab13e993fb27 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:24.503470 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf7b3a-9405-4611-9db7-ab13e993fb27 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:24.503470 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf7b3a-9405-4611-9db7-ab13e993fb27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:24.506953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-cbdf7b3a-9405-4611-9db7-ab13e993fb27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:24.632979 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf7b3a-9405-4611-9db7-ab13e993fb27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:24.639716 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf7b3a-9405-4611-9db7-ab13e993fb27 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:24.659294 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2792/5596] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:30:24 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:30:24.773365 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab519e8c-cbbc-4388-a2ba-018d4ff39fda admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:24.776205 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ab519e8c-cbbc-4388-a2ba-018d4ff39fda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:24.923723 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab519e8c-cbbc-4388-a2ba-018d4ff39fda admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:24.929485 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44bb75-214a-4ddb-9acf-7304c41c49a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:24.930959 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44bb75-214a-4ddb-9acf-7304c41c49a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:24.931340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44bb75-214a-4ddb-9acf-7304c41c49a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:24.931804 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44bb75-214a-4ddb-9acf-7304c41c49a6 admin admin] PATH_INFO: `/v3/projects/1e8211ae0294466dad4012b125fc416f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:24.933264 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c44bb75-214a-4ddb-9acf-7304c41c49a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e8211ae0294466dad4012b125fc416f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:24.935958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c44bb75-214a-4ddb-9acf-7304c41c49a6 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:25.181955 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6c44bb75-214a-4ddb-9acf-7304c41c49a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e8211ae0294466dad4012b125fc416f', 'request_id': 'req-6c44bb75-214a-4ddb-9acf-7304c41c49a6'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:25.193788 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6c44bb75-214a-4ddb-9acf-7304c41c49a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e8211ae0294466dad4012b125fc416f', 'request_id': 'req-6c44bb75-214a-4ddb-9acf-7304c41c49a6'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:25.206395 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6c44bb75-214a-4ddb-9acf-7304c41c49a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e8211ae0294466dad4012b125fc416f', 'request_id': 'req-6c44bb75-214a-4ddb-9acf-7304c41c49a6'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:25.326958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6c44bb75-214a-4ddb-9acf-7304c41c49a6 admin admin] The token cache is being invalidate because project 1e8211ae0294466dad4012b125fc416f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:30:25.327614 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6c44bb75-214a-4ddb-9acf-7304c41c49a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:25.329793 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6c44bb75-214a-4ddb-9acf-7304c41c49a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:25.334645 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2805/5597] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:30:24 2022] DELETE /identity/v3/projects/1e8211ae0294466dad4012b125fc416f => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:25.340982 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b2c47-c74c-4881-934f-6dbf764e6822 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:25.341945 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b2c47-c74c-4881-934f-6dbf764e6822 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:25.342297 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b2c47-c74c-4881-934f-6dbf764e6822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:25.398269 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-4e4b2c47-c74c-4881-934f-6dbf764e6822 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:25.403917 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4e4b2c47-c74c-4881-934f-6dbf764e6822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:25.501901 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2793/5598] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:25.503144 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb304e-71fd-4183-abb8-e31fae9ef9c0 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:25.504960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb304e-71fd-4183-abb8-e31fae9ef9c0 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:25.505369 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb304e-71fd-4183-abb8-e31fae9ef9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:25.553786 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-10cb304e-71fd-4183-abb8-e31fae9ef9c0 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:25.556266 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-10cb304e-71fd-4183-abb8-e31fae9ef9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:25.595518 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2806/5599] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:25.597247 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b2c47-c74c-4881-934f-6dbf764e6822 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:25.611765 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b2c47-c74c-4881-934f-6dbf764e6822 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:25.629855 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76c80c-730e-4f44-9839-1ab6c1055785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:25.630545 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76c80c-730e-4f44-9839-1ab6c1055785 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:25.630831 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76c80c-730e-4f44-9839-1ab6c1055785 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:25.631107 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76c80c-730e-4f44-9839-1ab6c1055785 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:25.635628 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d76c80c-730e-4f44-9839-1ab6c1055785 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:30:25.640969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d76c80c-730e-4f44-9839-1ab6c1055785 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:25.640969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d76c80c-730e-4f44-9839-1ab6c1055785 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:25.659051 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb304e-71fd-4183-abb8-e31fae9ef9c0 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:25.667580 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2794/5600] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:30:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:30:25.671522 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb304e-71fd-4183-abb8-e31fae9ef9c0 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:25.678518 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b59ce-d65b-41a3-81a7-e30bc3a4b5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:25.679208 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b59ce-d65b-41a3-81a7-e30bc3a4b5f6 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:25.679507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b59ce-d65b-41a3-81a7-e30bc3a4b5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:25.679765 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b59ce-d65b-41a3-81a7-e30bc3a4b5f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:25.680485 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b59ce-d65b-41a3-81a7-e30bc3a4b5f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:25.682469 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b59ce-d65b-41a3-81a7-e30bc3a4b5f6 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:25.856213 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76c80c-730e-4f44-9839-1ab6c1055785 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:25.867349 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2807/5601] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:30:25 2022] POST /identity/v3/projects => generated 383 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:30:25.875712 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76c80c-730e-4f44-9839-1ab6c1055785 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:26.059175 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9676b5-bf9b-40b6-92f0-1182a8aa954e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:26.063677 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9676b5-bf9b-40b6-92f0-1182a8aa954e admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:26.063677 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9676b5-bf9b-40b6-92f0-1182a8aa954e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:26.063677 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9676b5-bf9b-40b6-92f0-1182a8aa954e admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:26.063677 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9676b5-bf9b-40b6-92f0-1182a8aa954e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:26.066320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9676b5-bf9b-40b6-92f0-1182a8aa954e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:26.197040 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2795/5602] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:30:25 2022] POST /identity/v3/users => generated 292 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:30:26.201099 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b59ce-d65b-41a3-81a7-e30bc3a4b5f6 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:26.212229 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b59ce-d65b-41a3-81a7-e30bc3a4b5f6 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:26.217790 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e94f3-e8c7-444b-9107-896a116e63b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:26.218367 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e94f3-e8c7-444b-9107-896a116e63b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:26.218848 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e94f3-e8c7-444b-9107-896a116e63b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:26.219316 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e94f3-e8c7-444b-9107-896a116e63b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:26.220235 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e94f3-e8c7-444b-9107-896a116e63b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:26.222347 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e94f3-e8c7-444b-9107-896a116e63b8 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:26.249993 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9676b5-bf9b-40b6-92f0-1182a8aa954e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:26.255813 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2808/5603] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:30:26.269428 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9676b5-bf9b-40b6-92f0-1182a8aa954e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:26.283687 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72610b9f-d226-4a4c-a48c-4e0e826b16f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:26.284755 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72610b9f-d226-4a4c-a48c-4e0e826b16f0 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:26.285241 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72610b9f-d226-4a4c-a48c-4e0e826b16f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:26.285689 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72610b9f-d226-4a4c-a48c-4e0e826b16f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:26.286961 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72610b9f-d226-4a4c-a48c-4e0e826b16f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:26.289570 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72610b9f-d226-4a4c-a48c-4e0e826b16f0 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:26.303073 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2796/5604] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:30:26.307236 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e94f3-e8c7-444b-9107-896a116e63b8 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:26.319329 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e94f3-e8c7-444b-9107-896a116e63b8 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:26.325299 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436849f6-0388-4aa8-8d4f-b0946c9f85ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:26.326572 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436849f6-0388-4aa8-8d4f-b0946c9f85ef admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:26.327128 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436849f6-0388-4aa8-8d4f-b0946c9f85ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:26.327773 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436849f6-0388-4aa8-8d4f-b0946c9f85ef admin admin] PATH_INFO: `/v3/projects/a239318b82b54cbebd1c025205c5be40/users/01a013d493904fa3ad77de41f622768f/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:26.348207 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436849f6-0388-4aa8-8d4f-b0946c9f85ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=a239318b82b54cbebd1c025205c5be40, user_id=01a013d493904fa3ad77de41f622768f, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:26.353265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436849f6-0388-4aa8-8d4f-b0946c9f85ef admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:26.489466 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2809/5605] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:30:26 2022] PUT /identity/v3/projects/a239318b82b54cbebd1c025205c5be40/users/01a013d493904fa3ad77de41f622768f/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:26.489993 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692b086-b016-4bda-8830-1ecb69ab3c9f None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:26.490948 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692b086-b016-4bda-8830-1ecb69ab3c9f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:26.498935 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692b086-b016-4bda-8830-1ecb69ab3c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:26.525171 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-f692b086-b016-4bda-8830-1ecb69ab3c9f None None] MFA Rules not processed for user `01a013d493904fa3ad77de41f622768f`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:26.527380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f692b086-b016-4bda-8830-1ecb69ab3c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:26.651425 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2797/5606] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:26.661264 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436849f6-0388-4aa8-8d4f-b0946c9f85ef admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:26.663814 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-436849f6-0388-4aa8-8d4f-b0946c9f85ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:26.749618 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436849f6-0388-4aa8-8d4f-b0946c9f85ef admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:26.753421 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b634b19-c182-48b9-893a-534b7f1dda9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:26.754713 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b634b19-c182-48b9-893a-534b7f1dda9b service cinder] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:26.754998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b634b19-c182-48b9-893a-534b7f1dda9b service cinder] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:26.755279 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b634b19-c182-48b9-893a-534b7f1dda9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:26.769402 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b634b19-c182-48b9-893a-534b7f1dda9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:26.770930 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b634b19-c182-48b9-893a-534b7f1dda9b service cinder] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:26.791524 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2810/5607] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:30:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:30:26.802926 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f692b086-b016-4bda-8830-1ecb69ab3c9f None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:26.938993 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f692b086-b016-4bda-8830-1ecb69ab3c9f None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:26.948898 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd69e48-366d-45dc-bc68-a427d2a8f7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:26.949807 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd69e48-366d-45dc-bc68-a427d2a8f7c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:26.950543 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd69e48-366d-45dc-bc68-a427d2a8f7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:26.950855 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd69e48-366d-45dc-bc68-a427d2a8f7c8 admin admin] PATH_INFO: `/v3/users/01a013d493904fa3ad77de41f622768f` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:26.953187 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd69e48-366d-45dc-bc68-a427d2a8f7c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01a013d493904fa3ad77de41f622768f)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:26.957620 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd69e48-366d-45dc-bc68-a427d2a8f7c8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:26.989978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b634b19-c182-48b9-893a-534b7f1dda9b service cinder] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:26.991734 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9b634b19-c182-48b9-893a-534b7f1dda9b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:27.032802 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b634b19-c182-48b9-893a-534b7f1dda9b service cinder] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:27.050490 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685e1dd-b206-4c2b-8237-822500f85a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:27.051421 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685e1dd-b206-4c2b-8237-822500f85a4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:27.051698 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685e1dd-b206-4c2b-8237-822500f85a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:27.052173 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685e1dd-b206-4c2b-8237-822500f85a4d admin admin] PATH_INFO: `/v3/users/a81f55b9657543adb46748a08ef1e6b7` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:27.055236 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b685e1dd-b206-4c2b-8237-822500f85a4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a81f55b9657543adb46748a08ef1e6b7)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:27.057454 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b685e1dd-b206-4c2b-8237-822500f85a4d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:27.246429 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2bd69e48-366d-45dc-bc68-a427d2a8f7c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01a013d493904fa3ad77de41f622768f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:27.276472 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2bd69e48-366d-45dc-bc68-a427d2a8f7c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01a013d493904fa3ad77de41f622768f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:27.327062 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b685e1dd-b206-4c2b-8237-822500f85a4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a81f55b9657543adb46748a08ef1e6b7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:27.345859 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b685e1dd-b206-4c2b-8237-822500f85a4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a81f55b9657543adb46748a08ef1e6b7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:27.368662 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2bd69e48-366d-45dc-bc68-a427d2a8f7c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01a013d493904fa3ad77de41f622768f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:27.368662 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2bd69e48-366d-45dc-bc68-a427d2a8f7c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01a013d493904fa3ad77de41f622768f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:27.384815 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2bd69e48-366d-45dc-bc68-a427d2a8f7c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01a013d493904fa3ad77de41f622768f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:27.392726 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2798/5608] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:30:26 2022] DELETE /identity/v3/users/01a013d493904fa3ad77de41f622768f => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:27.398669 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf9c43-f733-48c2-9ce9-affb3e652320 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:27.398969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf9c43-f733-48c2-9ce9-affb3e652320 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:27.400195 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf9c43-f733-48c2-9ce9-affb3e652320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:27.424220 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-33bf9c43-f733-48c2-9ce9-affb3e652320 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:27.427852 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-33bf9c43-f733-48c2-9ce9-affb3e652320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:27.466352 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b685e1dd-b206-4c2b-8237-822500f85a4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a81f55b9657543adb46748a08ef1e6b7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:27.489823 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b685e1dd-b206-4c2b-8237-822500f85a4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a81f55b9657543adb46748a08ef1e6b7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:27.491868 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b685e1dd-b206-4c2b-8237-822500f85a4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a81f55b9657543adb46748a08ef1e6b7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:27.511934 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2811/5609] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:30:26 2022] DELETE /identity/v3/users/a81f55b9657543adb46748a08ef1e6b7 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:27.516197 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a2e57-b3d0-402a-a384-d6ecb4e13217 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:27.516708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a2e57-b3d0-402a-a384-d6ecb4e13217 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:27.517098 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a2e57-b3d0-402a-a384-d6ecb4e13217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:27.544175 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-dc6a2e57-b3d0-402a-a384-d6ecb4e13217 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:27.545426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-dc6a2e57-b3d0-402a-a384-d6ecb4e13217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:27.560447 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2799/5610] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:27.601236 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf9c43-f733-48c2-9ce9-affb3e652320 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:27.604552 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-33bf9c43-f733-48c2-9ce9-affb3e652320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:27.797928 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2812/5611] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:30:27.827559 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf9c43-f733-48c2-9ce9-affb3e652320 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:27.912770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41b76e-665c-4a52-821a-8c83ef23a1b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:27.913780 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41b76e-665c-4a52-821a-8c83ef23a1b0 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:27.914310 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41b76e-665c-4a52-821a-8c83ef23a1b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:27.914787 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41b76e-665c-4a52-821a-8c83ef23a1b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:27.926441 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41b76e-665c-4a52-821a-8c83ef23a1b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:27.928186 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41b76e-665c-4a52-821a-8c83ef23a1b0 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:27.970298 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a2e57-b3d0-402a-a384-d6ecb4e13217 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:27.972317 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2800/5612] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:30:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:30:27.989519 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a2e57-b3d0-402a-a384-d6ecb4e13217 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:27.998581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0156c4-4cae-42f5-81d6-26c3510db487 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:27.999496 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0156c4-4cae-42f5-81d6-26c3510db487 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:28.000272 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0156c4-4cae-42f5-81d6-26c3510db487 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:28.000855 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0156c4-4cae-42f5-81d6-26c3510db487 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:28.013056 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0156c4-4cae-42f5-81d6-26c3510db487 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:28.020099 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0156c4-4cae-42f5-81d6-26c3510db487 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:28.034701 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2813/5613] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:30:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:30:28.108160 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41b76e-665c-4a52-821a-8c83ef23a1b0 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:28.110782 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7d41b76e-665c-4a52-821a-8c83ef23a1b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:28.137025 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41b76e-665c-4a52-821a-8c83ef23a1b0 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:28.155918 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68c158-6a8c-4018-b5f2-ddc02bbe7d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:28.156945 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68c158-6a8c-4018-b5f2-ddc02bbe7d32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:28.157339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68c158-6a8c-4018-b5f2-ddc02bbe7d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:28.157814 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68c158-6a8c-4018-b5f2-ddc02bbe7d32 admin admin] PATH_INFO: `/v3/users/f235341f64214d12a52311e834d3b674` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:28.159781 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a68c158-6a8c-4018-b5f2-ddc02bbe7d32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f235341f64214d12a52311e834d3b674)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:28.163567 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a68c158-6a8c-4018-b5f2-ddc02bbe7d32 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:28.194993 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2837d-3e48-45aa-9926-19ae6c9a8f5f None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:28.195494 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2837d-3e48-45aa-9926-19ae6c9a8f5f None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:28.195971 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2837d-3e48-45aa-9926-19ae6c9a8f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:28.249013 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-a5b2837d-3e48-45aa-9926-19ae6c9a8f5f None None] MFA Rules not processed for user `41a26877b24c4687a0c8cc4ffc6d69dd`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:28.250749 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a5b2837d-3e48-45aa-9926-19ae6c9a8f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:28.362709 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2814/5614] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:28.373328 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785920de-fa6c-4e75-ae8e-110a75781c67 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:28.375200 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785920de-fa6c-4e75-ae8e-110a75781c67 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:28.376630 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785920de-fa6c-4e75-ae8e-110a75781c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:28.399033 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-785920de-fa6c-4e75-ae8e-110a75781c67 None None] MFA Rules not processed for user `41a26877b24c4687a0c8cc4ffc6d69dd`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:28.400439 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-785920de-fa6c-4e75-ae8e-110a75781c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:28.413801 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2815/5615] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:28.428881 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785920de-fa6c-4e75-ae8e-110a75781c67 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:28.430827 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-785920de-fa6c-4e75-ae8e-110a75781c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:28.477649 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8a68c158-6a8c-4018-b5f2-ddc02bbe7d32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f235341f64214d12a52311e834d3b674'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:28.496177 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8a68c158-6a8c-4018-b5f2-ddc02bbe7d32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f235341f64214d12a52311e834d3b674'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:28.568031 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785920de-fa6c-4e75-ae8e-110a75781c67 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:28.575854 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8a68c158-6a8c-4018-b5f2-ddc02bbe7d32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f235341f64214d12a52311e834d3b674'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:28.576357 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8a68c158-6a8c-4018-b5f2-ddc02bbe7d32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f235341f64214d12a52311e834d3b674'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:28.577009 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309ea33-d286-4463-8f22-6e62dcdc2309 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:28.578192 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309ea33-d286-4463-8f22-6e62dcdc2309 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:28.578470 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309ea33-d286-4463-8f22-6e62dcdc2309 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:28.579185 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309ea33-d286-4463-8f22-6e62dcdc2309 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:28.585607 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8a68c158-6a8c-4018-b5f2-ddc02bbe7d32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f235341f64214d12a52311e834d3b674'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:28.588371 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c309ea33-d286-4463-8f22-6e62dcdc2309 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:28.590546 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c309ea33-d286-4463-8f22-6e62dcdc2309 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:28.592432 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2801/5616] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:30:28 2022] DELETE /identity/v3/users/f235341f64214d12a52311e834d3b674 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:28.596605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad261070-c3c9-44e7-9886-a7be5af79a9e None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:28.597240 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad261070-c3c9-44e7-9886-a7be5af79a9e None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:28.598328 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad261070-c3c9-44e7-9886-a7be5af79a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:28.603259 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2816/5617] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:30:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:30:28.621025 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-ad261070-c3c9-44e7-9886-a7be5af79a9e None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:28.622715 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ad261070-c3c9-44e7-9886-a7be5af79a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:28.709602 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2802/5618] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:30:28.720604 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309ea33-d286-4463-8f22-6e62dcdc2309 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:28.722289 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c309ea33-d286-4463-8f22-6e62dcdc2309 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:28.739651 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309ea33-d286-4463-8f22-6e62dcdc2309 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:28.846932 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e9ac7-4cea-462d-9048-9a9b81d5d6cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:28.849447 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e9ac7-4cea-462d-9048-9a9b81d5d6cc service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:28.850956 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e9ac7-4cea-462d-9048-9a9b81d5d6cc service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:28.851317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e9ac7-4cea-462d-9048-9a9b81d5d6cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:28.874586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e9ac7-4cea-462d-9048-9a9b81d5d6cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:28.877588 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e9ac7-4cea-462d-9048-9a9b81d5d6cc service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:28.886494 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad261070-c3c9-44e7-9886-a7be5af79a9e None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:28.888615 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ad261070-c3c9-44e7-9886-a7be5af79a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:28.898795 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2817/5619] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:30:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:30:28.926292 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad261070-c3c9-44e7-9886-a7be5af79a9e None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:28.931070 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d58a7f-27b2-4319-8932-d09a83f578f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:28.931971 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d58a7f-27b2-4319-8932-d09a83f578f6 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:28.932838 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d58a7f-27b2-4319-8932-d09a83f578f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:28.932838 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d58a7f-27b2-4319-8932-d09a83f578f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:28.935505 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-61d58a7f-27b2-4319-8932-d09a83f578f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:29.126130 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e9ac7-4cea-462d-9048-9a9b81d5d6cc service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:29.129599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7b9e9ac7-4cea-462d-9048-9a9b81d5d6cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:29.135718 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d58a7f-27b2-4319-8932-d09a83f578f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:29.137200 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d58a7f-27b2-4319-8932-d09a83f578f6 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:29.156008 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e9ac7-4cea-462d-9048-9a9b81d5d6cc service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:29.162392 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2803/5620] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:30:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:30:29.168246 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca29f8-e213-4dcc-ae4f-89c50965e2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:29.169829 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca29f8-e213-4dcc-ae4f-89c50965e2fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:29.170349 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca29f8-e213-4dcc-ae4f-89c50965e2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:29.174061 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca29f8-e213-4dcc-ae4f-89c50965e2fa admin admin] PATH_INFO: `/v3/projects/e9ed3ab456a94753a4fe68a0c8e85e65` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:29.176977 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abca29f8-e213-4dcc-ae4f-89c50965e2fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9ed3ab456a94753a4fe68a0c8e85e65)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:29.183139 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abca29f8-e213-4dcc-ae4f-89c50965e2fa admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:29.393002 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-abca29f8-e213-4dcc-ae4f-89c50965e2fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9ed3ab456a94753a4fe68a0c8e85e65', 'request_id': 'req-abca29f8-e213-4dcc-ae4f-89c50965e2fa'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:29.436295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-abca29f8-e213-4dcc-ae4f-89c50965e2fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9ed3ab456a94753a4fe68a0c8e85e65', 'request_id': 'req-abca29f8-e213-4dcc-ae4f-89c50965e2fa'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:29.451205 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-abca29f8-e213-4dcc-ae4f-89c50965e2fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9ed3ab456a94753a4fe68a0c8e85e65', 'request_id': 'req-abca29f8-e213-4dcc-ae4f-89c50965e2fa'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:29.552180 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d58a7f-27b2-4319-8932-d09a83f578f6 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:29.554093 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-61d58a7f-27b2-4319-8932-d09a83f578f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:29.564064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-abca29f8-e213-4dcc-ae4f-89c50965e2fa admin admin] The token cache is being invalidate because project e9ed3ab456a94753a4fe68a0c8e85e65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:30:29.564405 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-abca29f8-e213-4dcc-ae4f-89c50965e2fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:29.565430 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-abca29f8-e213-4dcc-ae4f-89c50965e2fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:29.571141 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2818/5621] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:30:29 2022] DELETE /identity/v3/projects/e9ed3ab456a94753a4fe68a0c8e85e65 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:30:29.572428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca29f8-e213-4dcc-ae4f-89c50965e2fa admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:29.575570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-abca29f8-e213-4dcc-ae4f-89c50965e2fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:29.577859 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d58a7f-27b2-4319-8932-d09a83f578f6 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:29.676056 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478a3fd-2cd0-42a7-be7f-e67773ae60e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:29.677959 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478a3fd-2cd0-42a7-be7f-e67773ae60e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:29.678253 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478a3fd-2cd0-42a7-be7f-e67773ae60e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:29.678602 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478a3fd-2cd0-42a7-be7f-e67773ae60e7 admin admin] PATH_INFO: `/v3/projects/a239318b82b54cbebd1c025205c5be40` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:29.679923 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478a3fd-2cd0-42a7-be7f-e67773ae60e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a239318b82b54cbebd1c025205c5be40)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:29.682045 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478a3fd-2cd0-42a7-be7f-e67773ae60e7 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:29.688710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca29f8-e213-4dcc-ae4f-89c50965e2fa admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:29.702300 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e618a-dbf9-4434-89ae-0cf653be7afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:29.703191 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e618a-dbf9-4434-89ae-0cf653be7afb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:29.703473 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e618a-dbf9-4434-89ae-0cf653be7afb admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:29.703751 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e618a-dbf9-4434-89ae-0cf653be7afb admin admin] PATH_INFO: `/v3/users/1016082a1cec45439f3ba9d549b43bfa` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:29.705980 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e618a-dbf9-4434-89ae-0cf653be7afb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1016082a1cec45439f3ba9d549b43bfa)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:29.708634 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e618a-dbf9-4434-89ae-0cf653be7afb admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:29.866037 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a478a3fd-2cd0-42a7-be7f-e67773ae60e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a239318b82b54cbebd1c025205c5be40', 'request_id': 'req-a478a3fd-2cd0-42a7-be7f-e67773ae60e7'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:29.884285 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a478a3fd-2cd0-42a7-be7f-e67773ae60e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a239318b82b54cbebd1c025205c5be40', 'request_id': 'req-a478a3fd-2cd0-42a7-be7f-e67773ae60e7'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:29.891187 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a478a3fd-2cd0-42a7-be7f-e67773ae60e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a239318b82b54cbebd1c025205c5be40', 'request_id': 'req-a478a3fd-2cd0-42a7-be7f-e67773ae60e7'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:29.992093 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a478a3fd-2cd0-42a7-be7f-e67773ae60e7 admin admin] The token cache is being invalidate because project a239318b82b54cbebd1c025205c5be40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:30:29.992380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a478a3fd-2cd0-42a7-be7f-e67773ae60e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:29.994035 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a478a3fd-2cd0-42a7-be7f-e67773ae60e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:29.996608 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2804/5622] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:30:29 2022] DELETE /identity/v3/projects/a239318b82b54cbebd1c025205c5be40 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:30:29.997601 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478a3fd-2cd0-42a7-be7f-e67773ae60e7 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:30.002661 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-fe4e618a-dbf9-4434-89ae-0cf653be7afb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1016082a1cec45439f3ba9d549b43bfa'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:30.004548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a478a3fd-2cd0-42a7-be7f-e67773ae60e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:30.015994 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-fe4e618a-dbf9-4434-89ae-0cf653be7afb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1016082a1cec45439f3ba9d549b43bfa'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:30.099124 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478a3fd-2cd0-42a7-be7f-e67773ae60e7 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:30.106316 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7f2da-bedf-49cc-8744-47cca4328d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:30.108848 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7f2da-bedf-49cc-8744-47cca4328d17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:30.108848 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7f2da-bedf-49cc-8744-47cca4328d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:30.108848 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7f2da-bedf-49cc-8744-47cca4328d17 admin admin] PATH_INFO: `/v3/projects/14218f5716604c4c8788c246f5fb3990` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:30.109613 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f7f2da-bedf-49cc-8744-47cca4328d17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14218f5716604c4c8788c246f5fb3990)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:30.111383 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f7f2da-bedf-49cc-8744-47cca4328d17 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:30.154596 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-fe4e618a-dbf9-4434-89ae-0cf653be7afb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1016082a1cec45439f3ba9d549b43bfa'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:30.167237 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-fe4e618a-dbf9-4434-89ae-0cf653be7afb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1016082a1cec45439f3ba9d549b43bfa'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:30.168045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-fe4e618a-dbf9-4434-89ae-0cf653be7afb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1016082a1cec45439f3ba9d549b43bfa'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:30.188032 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2819/5623] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:30:29 2022] DELETE /identity/v3/users/1016082a1cec45439f3ba9d549b43bfa => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:30.199832 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed04b8-17e5-4761-87ae-997890bd450c None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:30.199832 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed04b8-17e5-4761-87ae-997890bd450c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:30.199832 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed04b8-17e5-4761-87ae-997890bd450c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:30.243666 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-75ed04b8-17e5-4761-87ae-997890bd450c None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:30.245037 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-75ed04b8-17e5-4761-87ae-997890bd450c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:30.308665 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-47f7f2da-bedf-49cc-8744-47cca4328d17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14218f5716604c4c8788c246f5fb3990', 'request_id': 'req-47f7f2da-bedf-49cc-8744-47cca4328d17'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:30.314478 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-47f7f2da-bedf-49cc-8744-47cca4328d17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14218f5716604c4c8788c246f5fb3990', 'request_id': 'req-47f7f2da-bedf-49cc-8744-47cca4328d17'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:30.325842 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-47f7f2da-bedf-49cc-8744-47cca4328d17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14218f5716604c4c8788c246f5fb3990', 'request_id': 'req-47f7f2da-bedf-49cc-8744-47cca4328d17'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:30.422544 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2820/5624] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:30.430247 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-47f7f2da-bedf-49cc-8744-47cca4328d17 admin admin] The token cache is being invalidate because project 14218f5716604c4c8788c246f5fb3990 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:30:30.430460 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bde7f-2fc0-4720-96d0-a13e1c050202 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:30.430621 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-47f7f2da-bedf-49cc-8744-47cca4328d17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:30.431224 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bde7f-2fc0-4720-96d0-a13e1c050202 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:30.431382 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-47f7f2da-bedf-49cc-8744-47cca4328d17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:30.431898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bde7f-2fc0-4720-96d0-a13e1c050202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:30.432863 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2805/5625] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:30:29 2022] DELETE /identity/v3/projects/14218f5716604c4c8788c246f5fb3990 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:30.436596 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7f2da-bedf-49cc-8744-47cca4328d17 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:30.438299 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-47f7f2da-bedf-49cc-8744-47cca4328d17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:30.460997 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-a97bde7f-2fc0-4720-96d0-a13e1c050202 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:30.462676 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a97bde7f-2fc0-4720-96d0-a13e1c050202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:30.557484 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2821/5626] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:30:30.559436 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bde7f-2fc0-4720-96d0-a13e1c050202 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:30.573076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bde7f-2fc0-4720-96d0-a13e1c050202 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:30.579727 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089eb72b-4738-4b34-9177-e7162a16328b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:30.580930 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089eb72b-4738-4b34-9177-e7162a16328b admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:30.581336 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089eb72b-4738-4b34-9177-e7162a16328b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:30.582304 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089eb72b-4738-4b34-9177-e7162a16328b admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:30.583191 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089eb72b-4738-4b34-9177-e7162a16328b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:30:30.583603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089eb72b-4738-4b34-9177-e7162a16328b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:30.585784 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089eb72b-4738-4b34-9177-e7162a16328b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:30.591041 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7f2da-bedf-49cc-8744-47cca4328d17 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:30.612663 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2822/5627] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:30:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:30:30.614476 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089eb72b-4738-4b34-9177-e7162a16328b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:30.615074 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6698f9c2-2a28-4581-82d6-a5a5283c9b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:30.616278 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698f9c2-2a28-4581-82d6-a5a5283c9b78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:30.622645 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698f9c2-2a28-4581-82d6-a5a5283c9b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:30.622645 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698f9c2-2a28-4581-82d6-a5a5283c9b78 admin admin] PATH_INFO: `/v3/users/7c36b291312f4044ade3b1729d00244b` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:30.622645 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6698f9c2-2a28-4581-82d6-a5a5283c9b78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c36b291312f4044ade3b1729d00244b)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:30.622645 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6698f9c2-2a28-4581-82d6-a5a5283c9b78 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:30.637217 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089eb72b-4738-4b34-9177-e7162a16328b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:30.650927 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de8bbe-a064-4304-8243-a53f36b973cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:30.651978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de8bbe-a064-4304-8243-a53f36b973cb admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:30.652359 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de8bbe-a064-4304-8243-a53f36b973cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:30.652974 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de8bbe-a064-4304-8243-a53f36b973cb admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:30.653784 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de8bbe-a064-4304-8243-a53f36b973cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:30.657716 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de8bbe-a064-4304-8243-a53f36b973cb admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:30.764084 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2823/5628] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:30:30 2022] POST /identity/v3/projects => generated 375 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:30:30.768193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de8bbe-a064-4304-8243-a53f36b973cb admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:30.830991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6698f9c2-2a28-4581-82d6-a5a5283c9b78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c36b291312f4044ade3b1729d00244b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:30.856171 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de8bbe-a064-4304-8243-a53f36b973cb admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:30.862787 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426ea87-45c4-4f28-9238-61a88bd0443d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:30.863741 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426ea87-45c4-4f28-9238-61a88bd0443d admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:30.864198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426ea87-45c4-4f28-9238-61a88bd0443d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:30.864883 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8426ea87-45c4-4f28-9238-61a88bd0443d admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:30.865640 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6698f9c2-2a28-4581-82d6-a5a5283c9b78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c36b291312f4044ade3b1729d00244b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:30.865973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8426ea87-45c4-4f28-9238-61a88bd0443d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:30.868150 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8426ea87-45c4-4f28-9238-61a88bd0443d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:30.929684 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6698f9c2-2a28-4581-82d6-a5a5283c9b78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c36b291312f4044ade3b1729d00244b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:30.930657 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6698f9c2-2a28-4581-82d6-a5a5283c9b78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c36b291312f4044ade3b1729d00244b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:30.942527 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6698f9c2-2a28-4581-82d6-a5a5283c9b78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c36b291312f4044ade3b1729d00244b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:30.956132 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2806/5629] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:30:30 2022] DELETE /identity/v3/users/7c36b291312f4044ade3b1729d00244b => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:30:30.960706 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6698f9c2-2a28-4581-82d6-a5a5283c9b78 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:30.963750 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6698f9c2-2a28-4581-82d6-a5a5283c9b78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:30.970327 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2824/5630] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:30:30 2022] POST /identity/v3/users => generated 288 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:30:30.979014 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426ea87-45c4-4f28-9238-61a88bd0443d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:30.980866 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8426ea87-45c4-4f28-9238-61a88bd0443d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:31.007429 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8426ea87-45c4-4f28-9238-61a88bd0443d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:31.083412 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6698f9c2-2a28-4581-82d6-a5a5283c9b78 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:31.095333 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e802b1-ed1d-4e12-9868-6c4b0ab9e039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:31.098472 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e802b1-ed1d-4e12-9868-6c4b0ab9e039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:31.100392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e802b1-ed1d-4e12-9868-6c4b0ab9e039 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:31.100392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e802b1-ed1d-4e12-9868-6c4b0ab9e039 admin admin] PATH_INFO: `/v3/projects/fa81ab6b5d384e43a12ab4da8e4630b6` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:31.103678 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e802b1-ed1d-4e12-9868-6c4b0ab9e039 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa81ab6b5d384e43a12ab4da8e4630b6)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:31.106986 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e802b1-ed1d-4e12-9868-6c4b0ab9e039 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:31.158033 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f2945-7256-4344-8bb2-5e93ff9a2cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:31.158708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f2945-7256-4344-8bb2-5e93ff9a2cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:31.159196 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f2945-7256-4344-8bb2-5e93ff9a2cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:31.159651 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f2945-7256-4344-8bb2-5e93ff9a2cc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:31.161591 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f2945-7256-4344-8bb2-5e93ff9a2cc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:31.166513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f2945-7256-4344-8bb2-5e93ff9a2cc7 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:31.188629 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2825/5631] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:30:30 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:30:31.188629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9fe18-0962-4b5c-bb17-bcef179a5874 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:31.188629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9fe18-0962-4b5c-bb17-bcef179a5874 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:31.188629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9fe18-0962-4b5c-bb17-bcef179a5874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:31.227937 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-cee9fe18-0962-4b5c-bb17-bcef179a5874 None None] MFA Rules not processed for user `41a26877b24c4687a0c8cc4ffc6d69dd`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:31.229455 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-cee9fe18-0962-4b5c-bb17-bcef179a5874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:31.293942 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-19e802b1-ed1d-4e12-9868-6c4b0ab9e039 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa81ab6b5d384e43a12ab4da8e4630b6', 'request_id': 'req-19e802b1-ed1d-4e12-9868-6c4b0ab9e039'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:31.300373 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-19e802b1-ed1d-4e12-9868-6c4b0ab9e039 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa81ab6b5d384e43a12ab4da8e4630b6', 'request_id': 'req-19e802b1-ed1d-4e12-9868-6c4b0ab9e039'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:31.309686 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-19e802b1-ed1d-4e12-9868-6c4b0ab9e039 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa81ab6b5d384e43a12ab4da8e4630b6', 'request_id': 'req-19e802b1-ed1d-4e12-9868-6c4b0ab9e039'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:31.365430 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2826/5632] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:31.366694 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9fe18-0962-4b5c-bb17-bcef179a5874 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:31.387876 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-19e802b1-ed1d-4e12-9868-6c4b0ab9e039 admin admin] The token cache is being invalidate because project fa81ab6b5d384e43a12ab4da8e4630b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:30:31.388405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-19e802b1-ed1d-4e12-9868-6c4b0ab9e039 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:31.396219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-19e802b1-ed1d-4e12-9868-6c4b0ab9e039 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:31.396415 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9fe18-0962-4b5c-bb17-bcef179a5874 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:31.402518 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2807/5633] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:30:30 2022] DELETE /identity/v3/projects/fa81ab6b5d384e43a12ab4da8e4630b6 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:31.404147 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef21a9-f5f7-464d-9ef8-131919e611e5 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:31.404549 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef21a9-f5f7-464d-9ef8-131919e611e5 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:31.404844 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef21a9-f5f7-464d-9ef8-131919e611e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:31.464479 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-f9ef21a9-f5f7-464d-9ef8-131919e611e5 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:31.465943 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f9ef21a9-f5f7-464d-9ef8-131919e611e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:31.540372 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343ea5f-4d7b-4936-a402-782acf18e071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:31.541327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343ea5f-4d7b-4936-a402-782acf18e071 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:31.541945 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343ea5f-4d7b-4936-a402-782acf18e071 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:31.542436 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343ea5f-4d7b-4936-a402-782acf18e071 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:31.546695 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8343ea5f-4d7b-4936-a402-782acf18e071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:31.550301 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8343ea5f-4d7b-4936-a402-782acf18e071 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:31.567756 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2827/5634] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:30:31.568905 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343ea5f-4d7b-4936-a402-782acf18e071 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:31.571701 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8343ea5f-4d7b-4936-a402-782acf18e071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:31.592077 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2808/5635] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:31.603057 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b44a00-4013-4faf-afcf-982f95c5cfb3 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:31.603459 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b44a00-4013-4faf-afcf-982f95c5cfb3 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:31.603864 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b44a00-4013-4faf-afcf-982f95c5cfb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:31.609478 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343ea5f-4d7b-4936-a402-782acf18e071 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:31.614626 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656dd0ec-4756-4afe-b3f4-e434419a93e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:31.615549 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656dd0ec-4756-4afe-b3f4-e434419a93e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:31.620656 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656dd0ec-4756-4afe-b3f4-e434419a93e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:31.620656 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656dd0ec-4756-4afe-b3f4-e434419a93e0 admin admin] PATH_INFO: `/v3/projects/e3aa141f37814c6cac51868379a14d43/users/9dd0b7edccf949e3864c3e2210b64a90/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:31.637090 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-d9b44a00-4013-4faf-afcf-982f95c5cfb3 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:31.638056 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d9b44a00-4013-4faf-afcf-982f95c5cfb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:31.660641 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656dd0ec-4756-4afe-b3f4-e434419a93e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3aa141f37814c6cac51868379a14d43, user_id=9dd0b7edccf949e3864c3e2210b64a90, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:31.672467 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656dd0ec-4756-4afe-b3f4-e434419a93e0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:31.677604 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2809/5636] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:31.689493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b44a00-4013-4faf-afcf-982f95c5cfb3 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:31.712630 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b44a00-4013-4faf-afcf-982f95c5cfb3 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:31.724550 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ac64c-feed-4a10-84e3-58971901e683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:31.725491 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ac64c-feed-4a10-84e3-58971901e683 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:31.725491 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ac64c-feed-4a10-84e3-58971901e683 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:31.725899 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ac64c-feed-4a10-84e3-58971901e683 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:31.731276 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65ac64c-feed-4a10-84e3-58971901e683 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:30:31.731625 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65ac64c-feed-4a10-84e3-58971901e683 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:31.733331 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65ac64c-feed-4a10-84e3-58971901e683 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:31.753338 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2810/5637] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:30:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:30:31.757230 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ac64c-feed-4a10-84e3-58971901e683 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:31.776846 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ac64c-feed-4a10-84e3-58971901e683 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:31.780597 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2828/5638] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:30:31 2022] PUT /identity/v3/projects/e3aa141f37814c6cac51868379a14d43/users/9dd0b7edccf949e3864c3e2210b64a90/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:31.793305 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b8bf3-623a-44a6-bbd7-fbde29a55a6e None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:31.809397 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b8bf3-623a-44a6-bbd7-fbde29a55a6e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:31.809397 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b8bf3-623a-44a6-bbd7-fbde29a55a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:31.827978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-241b8bf3-623a-44a6-bbd7-fbde29a55a6e None None] MFA Rules not processed for user `9dd0b7edccf949e3864c3e2210b64a90`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:31.829631 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-241b8bf3-623a-44a6-bbd7-fbde29a55a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:31.861195 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248fb6aa-cc8a-4bf3-bfd7-e34af733d3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:31.866602 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fb6aa-cc8a-4bf3-bfd7-e34af733d3b4 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:31.866930 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fb6aa-cc8a-4bf3-bfd7-e34af733d3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:31.867170 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fb6aa-cc8a-4bf3-bfd7-e34af733d3b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:31.868073 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248fb6aa-cc8a-4bf3-bfd7-e34af733d3b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:31.870596 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248fb6aa-cc8a-4bf3-bfd7-e34af733d3b4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:31.937983 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2829/5639] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:30:31.948984 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b8bf3-623a-44a6-bbd7-fbde29a55a6e None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:31.952627 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-241b8bf3-623a-44a6-bbd7-fbde29a55a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:31.964159 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2811/5640] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:30:31 2022] POST /identity/v3/projects => generated 377 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:30:31.970880 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248fb6aa-cc8a-4bf3-bfd7-e34af733d3b4 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:32.047744 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b8bf3-623a-44a6-bbd7-fbde29a55a6e None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:32.085718 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248fb6aa-cc8a-4bf3-bfd7-e34af733d3b4 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:32.092832 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8be80a-5968-4630-870c-7c84f81c4748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:32.094396 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8be80a-5968-4630-870c-7c84f81c4748 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:32.095000 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8be80a-5968-4630-870c-7c84f81c4748 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:32.095913 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8be80a-5968-4630-870c-7c84f81c4748 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:32.096857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8be80a-5968-4630-870c-7c84f81c4748 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:32.099015 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8be80a-5968-4630-870c-7c84f81c4748 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:32.140626 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790fe6a4-cccb-4188-b818-ffcdbd22b02e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:32.141470 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fe6a4-cccb-4188-b818-ffcdbd22b02e service cinder] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:32.141774 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fe6a4-cccb-4188-b818-ffcdbd22b02e service cinder] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:32.142079 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fe6a4-cccb-4188-b818-ffcdbd22b02e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:32.202440 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2812/5641] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:30:31 2022] POST /identity/v3/users => generated 289 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:30:32.207176 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8be80a-5968-4630-870c-7c84f81c4748 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:32.232024 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8be80a-5968-4630-870c-7c84f81c4748 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:32.240914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790fe6a4-cccb-4188-b818-ffcdbd22b02e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:32.242761 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790fe6a4-cccb-4188-b818-ffcdbd22b02e service cinder] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:32.242906 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5bb2ba-bb9d-4225-ae77-7b44d4542985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:32.244260 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bb2ba-bb9d-4225-ae77-7b44d4542985 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:32.244613 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bb2ba-bb9d-4225-ae77-7b44d4542985 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:32.245543 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bb2ba-bb9d-4225-ae77-7b44d4542985 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:32.246003 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5bb2ba-bb9d-4225-ae77-7b44d4542985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:32.248069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5bb2ba-bb9d-4225-ae77-7b44d4542985 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:32.261749 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2813/5642] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:30:32.265350 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5bb2ba-bb9d-4225-ae77-7b44d4542985 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:32.266707 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2830/5643] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:30:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:30:32.290863 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5bb2ba-bb9d-4225-ae77-7b44d4542985 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:32.296005 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9680a3-e104-41ca-bcc8-54810bebae3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:32.296690 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9680a3-e104-41ca-bcc8-54810bebae3c admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:32.296980 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9680a3-e104-41ca-bcc8-54810bebae3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:32.297260 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9680a3-e104-41ca-bcc8-54810bebae3c admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:32.298029 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9680a3-e104-41ca-bcc8-54810bebae3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:32.299683 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9680a3-e104-41ca-bcc8-54810bebae3c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:32.325301 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2814/5644] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:30:32.327921 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790fe6a4-cccb-4188-b818-ffcdbd22b02e service cinder] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:32.345948 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790fe6a4-cccb-4188-b818-ffcdbd22b02e service cinder] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:32.371887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406230c-d23b-4f63-9351-a94957ac7cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:32.371887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406230c-d23b-4f63-9351-a94957ac7cb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:32.371887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406230c-d23b-4f63-9351-a94957ac7cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:32.371887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406230c-d23b-4f63-9351-a94957ac7cb1 admin admin] PATH_INFO: `/v3/projects/d69ac7619c6f4a80866c33aabb8c3f05/users/4f01361dce6742beb239f0dc2525b05c/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:32.377136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9680a3-e104-41ca-bcc8-54810bebae3c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:32.380402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ec9680a3-e104-41ca-bcc8-54810bebae3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:32.403828 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9680a3-e104-41ca-bcc8-54810bebae3c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:32.413826 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635d021-dd01-44b6-998b-64afa2edbc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:32.414981 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635d021-dd01-44b6-998b-64afa2edbc94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:32.415254 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635d021-dd01-44b6-998b-64afa2edbc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:32.415609 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635d021-dd01-44b6-998b-64afa2edbc94 admin admin] PATH_INFO: `/v3/projects/34511e02d71b404bbf183dfdbfa3603b` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:32.417108 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e635d021-dd01-44b6-998b-64afa2edbc94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34511e02d71b404bbf183dfdbfa3603b)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:32.419347 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e635d021-dd01-44b6-998b-64afa2edbc94 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:32.428045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406230c-d23b-4f63-9351-a94957ac7cb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d69ac7619c6f4a80866c33aabb8c3f05, user_id=4f01361dce6742beb239f0dc2525b05c, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:32.437252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406230c-d23b-4f63-9351-a94957ac7cb1 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:32.561939 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2831/5645] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:30:32 2022] PUT /identity/v3/projects/d69ac7619c6f4a80866c33aabb8c3f05/users/4f01361dce6742beb239f0dc2525b05c/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:32.572938 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479b468-bd26-41da-8897-997c0d5b944a None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:32.573310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479b468-bd26-41da-8897-997c0d5b944a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:32.573666 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479b468-bd26-41da-8897-997c0d5b944a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:32.637575 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e635d021-dd01-44b6-998b-64afa2edbc94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34511e02d71b404bbf183dfdbfa3603b', 'request_id': 'req-e635d021-dd01-44b6-998b-64afa2edbc94'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:32.647520 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e635d021-dd01-44b6-998b-64afa2edbc94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34511e02d71b404bbf183dfdbfa3603b', 'request_id': 'req-e635d021-dd01-44b6-998b-64afa2edbc94'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:32.670688 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e635d021-dd01-44b6-998b-64afa2edbc94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34511e02d71b404bbf183dfdbfa3603b', 'request_id': 'req-e635d021-dd01-44b6-998b-64afa2edbc94'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:32.692726 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-9479b468-bd26-41da-8897-997c0d5b944a None None] MFA Rules not processed for user `4f01361dce6742beb239f0dc2525b05c`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:32.702805 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9479b468-bd26-41da-8897-997c0d5b944a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:32.784482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e635d021-dd01-44b6-998b-64afa2edbc94 admin admin] The token cache is being invalidate because project 34511e02d71b404bbf183dfdbfa3603b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:30:32.787285 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e635d021-dd01-44b6-998b-64afa2edbc94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:32.789570 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e635d021-dd01-44b6-998b-64afa2edbc94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:32.791892 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2815/5646] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:30:32 2022] DELETE /identity/v3/projects/34511e02d71b404bbf183dfdbfa3603b => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:32.797350 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b81ff5-76e1-4ed0-991c-092dd495bd99 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:32.797643 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b81ff5-76e1-4ed0-991c-092dd495bd99 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:32.797968 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b81ff5-76e1-4ed0-991c-092dd495bd99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:32.886389 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-91b81ff5-76e1-4ed0-991c-092dd495bd99 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:32.890702 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-91b81ff5-76e1-4ed0-991c-092dd495bd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:32.909712 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2832/5647] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:32.934500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479b468-bd26-41da-8897-997c0d5b944a None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:32.934500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9479b468-bd26-41da-8897-997c0d5b944a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:33.104878 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2816/5648] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:30:33.119599 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96152271-9e35-4721-b2b3-fa78a1caf2c7 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:33.119915 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96152271-9e35-4721-b2b3-fa78a1caf2c7 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:33.120153 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96152271-9e35-4721-b2b3-fa78a1caf2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:33.124863 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479b468-bd26-41da-8897-997c0d5b944a None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:33.145527 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61578b77-6ca5-4b70-ac10-b4fe1bfc286d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:33.146229 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61578b77-6ca5-4b70-ac10-b4fe1bfc286d service cinder] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:33.146514 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61578b77-6ca5-4b70-ac10-b4fe1bfc286d service cinder] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:33.146788 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61578b77-6ca5-4b70-ac10-b4fe1bfc286d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:33.174560 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61578b77-6ca5-4b70-ac10-b4fe1bfc286d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:33.176141 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61578b77-6ca5-4b70-ac10-b4fe1bfc286d service cinder] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:33.183746 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-96152271-9e35-4721-b2b3-fa78a1caf2c7 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:33.185320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-96152271-9e35-4721-b2b3-fa78a1caf2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:33.209549 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2833/5649] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:30:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:30:33.219804 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2817/5650] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:33.224681 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61578b77-6ca5-4b70-ac10-b4fe1bfc286d service cinder] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:33.262474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61578b77-6ca5-4b70-ac10-b4fe1bfc286d service cinder] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:33.289100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d1859-af9e-411e-afbf-75b0e474b2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:33.291041 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d1859-af9e-411e-afbf-75b0e474b2ed admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:33.291512 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d1859-af9e-411e-afbf-75b0e474b2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:33.292137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d1859-af9e-411e-afbf-75b0e474b2ed admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:33.293139 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d1859-af9e-411e-afbf-75b0e474b2ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:30:33.296750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d1859-af9e-411e-afbf-75b0e474b2ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:33.298790 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d1859-af9e-411e-afbf-75b0e474b2ed admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:33.328477 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2834/5651] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:30:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:30:33.334161 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96152271-9e35-4721-b2b3-fa78a1caf2c7 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:33.369668 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96152271-9e35-4721-b2b3-fa78a1caf2c7 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:33.382960 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056e813-fc4a-4857-8b4b-9292d4203f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:33.382960 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056e813-fc4a-4857-8b4b-9292d4203f02 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:33.382960 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056e813-fc4a-4857-8b4b-9292d4203f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:33.382960 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056e813-fc4a-4857-8b4b-9292d4203f02 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:33.383564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056e813-fc4a-4857-8b4b-9292d4203f02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:33.385226 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056e813-fc4a-4857-8b4b-9292d4203f02 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:33.553857 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2818/5652] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:30:33 2022] POST /identity/v3/projects => generated 373 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:30:33.557358 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d1859-af9e-411e-afbf-75b0e474b2ed admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:33.576384 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d1859-af9e-411e-afbf-75b0e474b2ed admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:33.746360 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61cef3-9dcb-4735-aad6-bf58aa684b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:33.747100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61cef3-9dcb-4735-aad6-bf58aa684b33 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:33.747384 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61cef3-9dcb-4735-aad6-bf58aa684b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:33.747653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61cef3-9dcb-4735-aad6-bf58aa684b33 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:33.748431 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa61cef3-9dcb-4735-aad6-bf58aa684b33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:33.764142 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa61cef3-9dcb-4735-aad6-bf58aa684b33 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:33.911903 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2835/5653] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:30:33 2022] POST /identity/v3/users => generated 287 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:30:33.913498 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056e813-fc4a-4857-8b4b-9292d4203f02 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:33.943333 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056e813-fc4a-4857-8b4b-9292d4203f02 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:33.953885 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f94658-1d20-4987-8d6d-bbdd5248224b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:33.960496 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f94658-1d20-4987-8d6d-bbdd5248224b admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:33.960496 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f94658-1d20-4987-8d6d-bbdd5248224b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:33.960496 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f94658-1d20-4987-8d6d-bbdd5248224b admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:33.960496 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f94658-1d20-4987-8d6d-bbdd5248224b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:33.960496 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f94658-1d20-4987-8d6d-bbdd5248224b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:33.976433 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2819/5654] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:30:33.980427 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61cef3-9dcb-4735-aad6-bf58aa684b33 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:34.000807 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61cef3-9dcb-4735-aad6-bf58aa684b33 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:34.008740 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6f092-92e6-48f3-ab9f-3cbb89eeb71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:34.012324 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6f092-92e6-48f3-ab9f-3cbb89eeb71e admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:34.012324 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6f092-92e6-48f3-ab9f-3cbb89eeb71e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:34.012324 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6f092-92e6-48f3-ab9f-3cbb89eeb71e admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:34.012324 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e6f092-92e6-48f3-ab9f-3cbb89eeb71e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:34.012716 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e6f092-92e6-48f3-ab9f-3cbb89eeb71e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:34.028833 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f94658-1d20-4987-8d6d-bbdd5248224b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:34.030973 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-47f94658-1d20-4987-8d6d-bbdd5248224b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:34.038413 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2836/5655] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:30:34.044233 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6f092-92e6-48f3-ab9f-3cbb89eeb71e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:34.055625 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6f092-92e6-48f3-ab9f-3cbb89eeb71e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:34.061402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f94658-1d20-4987-8d6d-bbdd5248224b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:34.074309 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24456e56-a519-4f96-99cf-9afe2b7b572c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:34.075296 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24456e56-a519-4f96-99cf-9afe2b7b572c admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:34.075589 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24456e56-a519-4f96-99cf-9afe2b7b572c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:34.075869 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24456e56-a519-4f96-99cf-9afe2b7b572c admin admin] PATH_INFO: `/v3/projects/f00f38167d4840b6b20227e3e6a057dd/users/10c586b1308c4b04a0ec245d6de05a17/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:34.084428 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa34ef-926e-4316-8868-259f45e15320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:34.085784 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa34ef-926e-4316-8868-259f45e15320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:34.086105 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa34ef-926e-4316-8868-259f45e15320 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:34.086560 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa34ef-926e-4316-8868-259f45e15320 admin admin] PATH_INFO: `/v3/users/9cc9b55d852942538c3ad8f317dcd73e` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:34.088767 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa34ef-926e-4316-8868-259f45e15320 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cc9b55d852942538c3ad8f317dcd73e)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:34.089895 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa34ef-926e-4316-8868-259f45e15320 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:34.104125 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24456e56-a519-4f96-99cf-9afe2b7b572c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f00f38167d4840b6b20227e3e6a057dd, user_id=10c586b1308c4b04a0ec245d6de05a17, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:34.107201 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24456e56-a519-4f96-99cf-9afe2b7b572c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:34.271351 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2837/5656] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:30:34 2022] PUT /identity/v3/projects/f00f38167d4840b6b20227e3e6a057dd/users/10c586b1308c4b04a0ec245d6de05a17/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:34.296438 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b740d-21b2-4361-a736-b65546dcc0f3 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:34.296438 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b740d-21b2-4361-a736-b65546dcc0f3 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:34.296438 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b740d-21b2-4361-a736-b65546dcc0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:34.329823 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-577b740d-21b2-4361-a736-b65546dcc0f3 None None] MFA Rules not processed for user `10c586b1308c4b04a0ec245d6de05a17`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:34.331186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-577b740d-21b2-4361-a736-b65546dcc0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:34.406373 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-9aaa34ef-926e-4316-8868-259f45e15320 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cc9b55d852942538c3ad8f317dcd73e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:34.427638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-9aaa34ef-926e-4316-8868-259f45e15320 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cc9b55d852942538c3ad8f317dcd73e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:34.431777 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2838/5657] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:34.437639 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b740d-21b2-4361-a736-b65546dcc0f3 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:34.441838 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-577b740d-21b2-4361-a736-b65546dcc0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:34.541315 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b740d-21b2-4361-a736-b65546dcc0f3 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:34.552761 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-9aaa34ef-926e-4316-8868-259f45e15320 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cc9b55d852942538c3ad8f317dcd73e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:34.554336 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-9aaa34ef-926e-4316-8868-259f45e15320 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cc9b55d852942538c3ad8f317dcd73e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:34.563400 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa65e6d-0e6a-4f63-baae-49c036cc0885 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:34.565161 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa65e6d-0e6a-4f63-baae-49c036cc0885 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:34.565449 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa65e6d-0e6a-4f63-baae-49c036cc0885 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:34.565583 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-9aaa34ef-926e-4316-8868-259f45e15320 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cc9b55d852942538c3ad8f317dcd73e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:34.565711 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa65e6d-0e6a-4f63-baae-49c036cc0885 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:34.569166 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-efa65e6d-0e6a-4f63-baae-49c036cc0885 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:34.579342 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2820/5658] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:30:34 2022] DELETE /identity/v3/users/9cc9b55d852942538c3ad8f317dcd73e => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:30:34.583784 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa65e6d-0e6a-4f63-baae-49c036cc0885 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:34.586094 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa65e6d-0e6a-4f63-baae-49c036cc0885 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:34.606199 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2839/5659] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:30:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:30:34.949316 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa34ef-926e-4316-8868-259f45e15320 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:34.952736 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-9aaa34ef-926e-4316-8868-259f45e15320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:35.031498 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa34ef-926e-4316-8868-259f45e15320 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:35.071013 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c25f51-289f-4b63-a03a-2c201a55208d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:35.071013 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c25f51-289f-4b63-a03a-2c201a55208d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:35.071013 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c25f51-289f-4b63-a03a-2c201a55208d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:35.071808 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c25f51-289f-4b63-a03a-2c201a55208d admin admin] PATH_INFO: `/v3/projects/54ceedad6e134d94ac8758f8385a47e0` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:35.074947 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c25f51-289f-4b63-a03a-2c201a55208d admin admin] RBAC: Authorizing `identity:delete_project(project_id=54ceedad6e134d94ac8758f8385a47e0)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:35.079434 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c25f51-289f-4b63-a03a-2c201a55208d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:35.265729 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f9c25f51-289f-4b63-a03a-2c201a55208d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54ceedad6e134d94ac8758f8385a47e0', 'request_id': 'req-f9c25f51-289f-4b63-a03a-2c201a55208d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:35.273850 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f9c25f51-289f-4b63-a03a-2c201a55208d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54ceedad6e134d94ac8758f8385a47e0', 'request_id': 'req-f9c25f51-289f-4b63-a03a-2c201a55208d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:35.280888 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f9c25f51-289f-4b63-a03a-2c201a55208d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54ceedad6e134d94ac8758f8385a47e0', 'request_id': 'req-f9c25f51-289f-4b63-a03a-2c201a55208d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:35.468654 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f9c25f51-289f-4b63-a03a-2c201a55208d admin admin] The token cache is being invalidate because project 54ceedad6e134d94ac8758f8385a47e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:30:35.469908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f9c25f51-289f-4b63-a03a-2c201a55208d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:35.471543 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f9c25f51-289f-4b63-a03a-2c201a55208d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:35.481312 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2821/5660] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:30:34 2022] DELETE /identity/v3/projects/54ceedad6e134d94ac8758f8385a47e0 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:35.483128 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21057845-9164-45c1-83ee-1446833e0252 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:35.483585 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21057845-9164-45c1-83ee-1446833e0252 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:35.483682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21057845-9164-45c1-83ee-1446833e0252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:35.508859 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-21057845-9164-45c1-83ee-1446833e0252 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:35.510327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-21057845-9164-45c1-83ee-1446833e0252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:35.628117 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2840/5661] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:35.637439 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5847475-613e-48e0-8455-f066bbd7eb70 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:35.637439 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5847475-613e-48e0-8455-f066bbd7eb70 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:35.637645 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5847475-613e-48e0-8455-f066bbd7eb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:35.679613 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-c5847475-613e-48e0-8455-f066bbd7eb70 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:35.692857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c5847475-613e-48e0-8455-f066bbd7eb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:35.700287 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2822/5662] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:35.707050 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21057845-9164-45c1-83ee-1446833e0252 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:35.720430 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21057845-9164-45c1-83ee-1446833e0252 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:35.725899 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd240a-037a-4a28-aeb8-d374106241ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:35.726568 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd240a-037a-4a28-aeb8-d374106241ee admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:35.726852 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd240a-037a-4a28-aeb8-d374106241ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:35.727133 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd240a-037a-4a28-aeb8-d374106241ee admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:35.749024 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd240a-037a-4a28-aeb8-d374106241ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:30:35.749496 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd240a-037a-4a28-aeb8-d374106241ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:35.751268 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd240a-037a-4a28-aeb8-d374106241ee admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:35.781692 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2841/5663] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:30:35.788868 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5847475-613e-48e0-8455-f066bbd7eb70 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:35.808869 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5847475-613e-48e0-8455-f066bbd7eb70 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:35.822303 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6f42f-1eee-457a-b61e-b1e95c1e8635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:35.825747 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6f42f-1eee-457a-b61e-b1e95c1e8635 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:35.827873 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6f42f-1eee-457a-b61e-b1e95c1e8635 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:35.829861 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6f42f-1eee-457a-b61e-b1e95c1e8635 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:35.830714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b6f42f-1eee-457a-b61e-b1e95c1e8635 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:35.834208 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b6f42f-1eee-457a-b61e-b1e95c1e8635 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:35.973794 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2823/5664] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:30:35 2022] POST /identity/v3/projects => generated 375 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:30:35.978324 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd240a-037a-4a28-aeb8-d374106241ee admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:35.989884 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd240a-037a-4a28-aeb8-d374106241ee admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:36.091394 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475514c-4cfb-45aa-b8c8-941e1a30c43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:36.092248 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475514c-4cfb-45aa-b8c8-941e1a30c43b admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:36.092590 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475514c-4cfb-45aa-b8c8-941e1a30c43b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:36.092961 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475514c-4cfb-45aa-b8c8-941e1a30c43b admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:36.093708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1475514c-4cfb-45aa-b8c8-941e1a30c43b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:36.095871 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1475514c-4cfb-45aa-b8c8-941e1a30c43b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:36.503550 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2842/5665] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:30:35 2022] POST /identity/v3/users => generated 288 bytes in 526 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:30:36.504557 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6f42f-1eee-457a-b61e-b1e95c1e8635 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:36.515338 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6f42f-1eee-457a-b61e-b1e95c1e8635 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:36.525343 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd72b6-e828-483c-992d-d079ea5957cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:36.526088 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd72b6-e828-483c-992d-d079ea5957cf admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:36.526840 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd72b6-e828-483c-992d-d079ea5957cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:36.527306 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd72b6-e828-483c-992d-d079ea5957cf admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:36.528076 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd72b6-e828-483c-992d-d079ea5957cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:36.529709 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd72b6-e828-483c-992d-d079ea5957cf admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:36.544014 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2824/5666] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:30:36.548397 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475514c-4cfb-45aa-b8c8-941e1a30c43b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:36.565468 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475514c-4cfb-45aa-b8c8-941e1a30c43b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:36.572613 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f985e9-f845-41f4-b7f1-148cf7c08ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:36.573299 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f985e9-f845-41f4-b7f1-148cf7c08ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:36.573586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f985e9-f845-41f4-b7f1-148cf7c08ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:36.573894 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f985e9-f845-41f4-b7f1-148cf7c08ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:36.574625 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f985e9-f845-41f4-b7f1-148cf7c08ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:36.578280 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f985e9-f845-41f4-b7f1-148cf7c08ff1 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:36.618101 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2843/5667] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:30:36.621207 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd72b6-e828-483c-992d-d079ea5957cf admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:36.661329 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd72b6-e828-483c-992d-d079ea5957cf admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:36.702324 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e8cc5-dc1e-4bc1-a7f6-bda3df782bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:36.710856 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e8cc5-dc1e-4bc1-a7f6-bda3df782bc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:36.716268 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e8cc5-dc1e-4bc1-a7f6-bda3df782bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:36.716644 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8e8cc5-dc1e-4bc1-a7f6-bda3df782bc4 admin admin] PATH_INFO: `/v3/projects/6d29f9b7ba27421ea8331a086db7b67a/users/a6debef3260648039eaf39906856f74f/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:36.801936 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e8cc5-dc1e-4bc1-a7f6-bda3df782bc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d29f9b7ba27421ea8331a086db7b67a, user_id=a6debef3260648039eaf39906856f74f, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:36.820453 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8e8cc5-dc1e-4bc1-a7f6-bda3df782bc4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:36.968888 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2825/5668] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:30:36 2022] PUT /identity/v3/projects/6d29f9b7ba27421ea8331a086db7b67a/users/a6debef3260648039eaf39906856f74f/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:36.982610 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2aaa9-ab2e-4677-b6f8-4328dfe31b18 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:36.984980 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2aaa9-ab2e-4677-b6f8-4328dfe31b18 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:36.984980 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2aaa9-ab2e-4677-b6f8-4328dfe31b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:37.049112 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-f5e2aaa9-ab2e-4677-b6f8-4328dfe31b18 None None] MFA Rules not processed for user `a6debef3260648039eaf39906856f74f`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:37.050288 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f5e2aaa9-ab2e-4677-b6f8-4328dfe31b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:37.252616 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2844/5669] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:37.256456 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e8cc5-dc1e-4bc1-a7f6-bda3df782bc4 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:37.441263 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8e8cc5-dc1e-4bc1-a7f6-bda3df782bc4 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:37.450269 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2c320-90b8-49f6-b1cf-3123eed0bb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:37.450269 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2c320-90b8-49f6-b1cf-3123eed0bb52 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:37.450269 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2c320-90b8-49f6-b1cf-3123eed0bb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:37.450269 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2c320-90b8-49f6-b1cf-3123eed0bb52 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:37.452773 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef2c320-90b8-49f6-b1cf-3123eed0bb52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:37.460454 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef2c320-90b8-49f6-b1cf-3123eed0bb52 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:37.606319 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2826/5670] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:30:37 2022] POST /identity/v3/projects => generated 375 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:30:37.611759 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e2aaa9-ab2e-4677-b6f8-4328dfe31b18 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:37.651495 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e2aaa9-ab2e-4677-b6f8-4328dfe31b18 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:37.828085 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ea628-b07c-43e3-8872-b45efb3f4e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:37.828793 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ea628-b07c-43e3-8872-b45efb3f4e7a admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:37.829070 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ea628-b07c-43e3-8872-b45efb3f4e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:37.829534 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ea628-b07c-43e3-8872-b45efb3f4e7a admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:37.830273 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69ea628-b07c-43e3-8872-b45efb3f4e7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:37.832264 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69ea628-b07c-43e3-8872-b45efb3f4e7a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:37.989061 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2845/5671] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:30:37 2022] POST /identity/v3/users => generated 294 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:30:37.990717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2c320-90b8-49f6-b1cf-3123eed0bb52 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:38.020943 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2c320-90b8-49f6-b1cf-3123eed0bb52 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:38.045039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232136a-8674-4d3d-a37f-dd1a0c84a80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:38.045736 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232136a-8674-4d3d-a37f-dd1a0c84a80b admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:38.046093 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232136a-8674-4d3d-a37f-dd1a0c84a80b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:38.046382 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232136a-8674-4d3d-a37f-dd1a0c84a80b admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:38.051276 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d232136a-8674-4d3d-a37f-dd1a0c84a80b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:38.058433 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d232136a-8674-4d3d-a37f-dd1a0c84a80b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:38.107848 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2827/5672] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:30:38.112114 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ea628-b07c-43e3-8872-b45efb3f4e7a admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:38.134208 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ea628-b07c-43e3-8872-b45efb3f4e7a admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:38.172444 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bcd109-7bdc-4331-963f-5a810a62f3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:38.177813 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcd109-7bdc-4331-963f-5a810a62f3f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:38.179711 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcd109-7bdc-4331-963f-5a810a62f3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:38.183466 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcd109-7bdc-4331-963f-5a810a62f3f3 admin admin] PATH_INFO: `/v3/projects/489d04ed0ae348038a2064795f98dc93/users/9213795e28bd484f9d5580af062c302e/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:38.216138 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bcd109-7bdc-4331-963f-5a810a62f3f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=489d04ed0ae348038a2064795f98dc93, user_id=9213795e28bd484f9d5580af062c302e, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:38.225552 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bcd109-7bdc-4331-963f-5a810a62f3f3 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:38.425239 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2846/5673] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:30:38 2022] PUT /identity/v3/projects/489d04ed0ae348038a2064795f98dc93/users/9213795e28bd484f9d5580af062c302e/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:38.428436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232136a-8674-4d3d-a37f-dd1a0c84a80b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:38.449981 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232136a-8674-4d3d-a37f-dd1a0c84a80b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:38.606951 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbab039-1488-436f-b88e-f58c99e278e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:38.609686 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbab039-1488-436f-b88e-f58c99e278e7 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:38.610274 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbab039-1488-436f-b88e-f58c99e278e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:38.610767 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbab039-1488-436f-b88e-f58c99e278e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:38.611732 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbab039-1488-436f-b88e-f58c99e278e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:38.616371 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbab039-1488-436f-b88e-f58c99e278e7 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:38.630386 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2828/5674] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:30:38.632813 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bcd109-7bdc-4331-963f-5a810a62f3f3 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:38.648814 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bcd109-7bdc-4331-963f-5a810a62f3f3 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:38.657098 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbca5d0-9fd9-4916-9438-0fa048dd06f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:38.658135 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbca5d0-9fd9-4916-9438-0fa048dd06f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:38.658412 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbca5d0-9fd9-4916-9438-0fa048dd06f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:38.659065 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbca5d0-9fd9-4916-9438-0fa048dd06f0 admin admin] PATH_INFO: `/v3/projects/489d04ed0ae348038a2064795f98dc93/users/9213795e28bd484f9d5580af062c302e/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:38.665168 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbca5d0-9fd9-4916-9438-0fa048dd06f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=489d04ed0ae348038a2064795f98dc93, user_id=9213795e28bd484f9d5580af062c302e, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:38.669701 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbca5d0-9fd9-4916-9438-0fa048dd06f0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:38.686736 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2847/5675] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:30:38 2022] PUT /identity/v3/projects/489d04ed0ae348038a2064795f98dc93/users/9213795e28bd484f9d5580af062c302e/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:38.697047 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9113725-b4a9-4c1a-8917-2ce96355340e None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:38.697312 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9113725-b4a9-4c1a-8917-2ce96355340e None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:38.697590 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9113725-b4a9-4c1a-8917-2ce96355340e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:38.795657 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-b9113725-b4a9-4c1a-8917-2ce96355340e None None] MFA Rules not processed for user `9213795e28bd484f9d5580af062c302e`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:38.795657 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b9113725-b4a9-4c1a-8917-2ce96355340e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:38.901127 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2829/5676] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:38 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:38.902529 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbca5d0-9fd9-4916-9438-0fa048dd06f0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:38.933420 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbca5d0-9fd9-4916-9438-0fa048dd06f0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:38.940577 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640c55b-2a2a-448e-a0d8-f0d1b96f9007 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9213795e28bd484f9d5580af062c302e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489d04ed0ae348038a2064795f98dc93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:38.942882 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640c55b-2a2a-448e-a0d8-f0d1b96f9007 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:38.943381 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640c55b-2a2a-448e-a0d8-f0d1b96f9007 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:38.944137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640c55b-2a2a-448e-a0d8-f0d1b96f9007 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:38.954042 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1640c55b-2a2a-448e-a0d8-f0d1b96f9007 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:38.957519 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1640c55b-2a2a-448e-a0d8-f0d1b96f9007 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:39.107009 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9113725-b4a9-4c1a-8917-2ce96355340e None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:39.112513 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2848/5677] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:30:38 2022] POST /identity/v3/projects => generated 350 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:30:39.132965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9113725-b4a9-4c1a-8917-2ce96355340e None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:39.246996 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03c98d-ebd1-471b-858f-f3d2094c335c tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9213795e28bd484f9d5580af062c302e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489d04ed0ae348038a2064795f98dc93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:39.249676 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03c98d-ebd1-471b-858f-f3d2094c335c tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:39.252606 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03c98d-ebd1-471b-858f-f3d2094c335c tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:39.252930 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03c98d-ebd1-471b-858f-f3d2094c335c tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:39.254333 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03c98d-ebd1-471b-858f-f3d2094c335c tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:39.256871 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03c98d-ebd1-471b-858f-f3d2094c335c tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:39.421294 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2830/5678] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:30:39 2022] POST /identity/v3/projects => generated 351 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:30:39.425712 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640c55b-2a2a-448e-a0d8-f0d1b96f9007 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:39.443765 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640c55b-2a2a-448e-a0d8-f0d1b96f9007 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:39.552078 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82813661-ef18-49d2-91e3-1514a4c42a6a tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9213795e28bd484f9d5580af062c302e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489d04ed0ae348038a2064795f98dc93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:39.553891 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82813661-ef18-49d2-91e3-1514a4c42a6a tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:39.554183 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82813661-ef18-49d2-91e3-1514a4c42a6a tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:39.555942 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82813661-ef18-49d2-91e3-1514a4c42a6a tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] PATH_INFO: `/v3/users/a6debef3260648039eaf39906856f74f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:39.557266 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82813661-ef18-49d2-91e3-1514a4c42a6a tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: Authorizing `identity:get_user(user_id=a6debef3260648039eaf39906856f74f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:39.560859 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82813661-ef18-49d2-91e3-1514a4c42a6a tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:39.568308 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2849/5679] 10.222.0.23 () {58 vars in 1220 bytes} [Sat Apr 30 21:30:39 2022] GET /identity/v3/users/a6debef3260648039eaf39906856f74f => generated 288 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:30:39.570304 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03c98d-ebd1-471b-858f-f3d2094c335c tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:39.603077 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03c98d-ebd1-471b-858f-f3d2094c335c tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:39.620756 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f8375b-089a-49e5-9290-2b2f15570ad9 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9213795e28bd484f9d5580af062c302e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489d04ed0ae348038a2064795f98dc93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:39.621437 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8375b-089a-49e5-9290-2b2f15570ad9 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:39.622010 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8375b-089a-49e5-9290-2b2f15570ad9 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:39.622252 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8375b-089a-49e5-9290-2b2f15570ad9 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] PATH_INFO: `/v3/credentials` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:39.623369 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f8375b-089a-49e5-9290-2b2f15570ad9 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:39.626106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f8375b-089a-49e5-9290-2b2f15570ad9 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:39.752152 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82813661-ef18-49d2-91e3-1514a4c42a6a tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:39.760373 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2831/5680] 10.222.0.23 () {60 vars in 1161 bytes} [Sat Apr 30 21:30:39 2022] POST /identity/v3/credentials => generated 430 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:30:39.764648 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82813661-ef18-49d2-91e3-1514a4c42a6a tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:39.772641 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba66f08-fb4a-4a01-a85d-f7d3b28c8eb4 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9213795e28bd484f9d5580af062c302e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489d04ed0ae348038a2064795f98dc93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:39.775412 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba66f08-fb4a-4a01-a85d-f7d3b28c8eb4 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:39.775943 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba66f08-fb4a-4a01-a85d-f7d3b28c8eb4 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:39.776527 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba66f08-fb4a-4a01-a85d-f7d3b28c8eb4 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] PATH_INFO: `/v3/credentials/b39a7972fc762408519c9269049621e0be21fefe66959949ae56a96786a9af95` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:39.781868 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba66f08-fb4a-4a01-a85d-f7d3b28c8eb4 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=b39a7972fc762408519c9269049621e0be21fefe66959949ae56a96786a9af95)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:39.783879 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba66f08-fb4a-4a01-a85d-f7d3b28c8eb4 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:39.786661 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba66f08-fb4a-4a01-a85d-f7d3b28c8eb4 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=b39a7972fc762408519c9269049621e0be21fefe66959949ae56a96786a9af95)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:39.788868 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba66f08-fb4a-4a01-a85d-f7d3b28c8eb4 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:39.896844 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2850/5681] 10.222.0.23 () {60 vars in 1357 bytes} [Sat Apr 30 21:30:39 2022] PATCH /identity/v3/credentials/b39a7972fc762408519c9269049621e0be21fefe66959949ae56a96786a9af95 => generated 436 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:30:39.903342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f8375b-089a-49e5-9290-2b2f15570ad9 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:39.919511 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f8375b-089a-49e5-9290-2b2f15570ad9 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:39.929243 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda27d0a-ed7f-4468-a32c-1ff992fb201a tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9213795e28bd484f9d5580af062c302e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489d04ed0ae348038a2064795f98dc93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:39.931113 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda27d0a-ed7f-4468-a32c-1ff992fb201a tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:39.931695 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda27d0a-ed7f-4468-a32c-1ff992fb201a tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:39.932131 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda27d0a-ed7f-4468-a32c-1ff992fb201a tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] PATH_INFO: `/v3/credentials/b39a7972fc762408519c9269049621e0be21fefe66959949ae56a96786a9af95` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:39.935534 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda27d0a-ed7f-4468-a32c-1ff992fb201a tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=b39a7972fc762408519c9269049621e0be21fefe66959949ae56a96786a9af95)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:39.938469 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda27d0a-ed7f-4468-a32c-1ff992fb201a tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:39.942532 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2832/5682] 10.222.0.23 () {58 vars in 1334 bytes} [Sat Apr 30 21:30:39 2022] GET /identity/v3/credentials/b39a7972fc762408519c9269049621e0be21fefe66959949ae56a96786a9af95 => generated 436 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:30:39.947317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba66f08-fb4a-4a01-a85d-f7d3b28c8eb4 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:39.960339 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba66f08-fb4a-4a01-a85d-f7d3b28c8eb4 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:39.981329 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae161645-f8c1-4ebc-add6-5f998b649713 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9213795e28bd484f9d5580af062c302e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489d04ed0ae348038a2064795f98dc93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:39.989617 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae161645-f8c1-4ebc-add6-5f998b649713 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:39.989617 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae161645-f8c1-4ebc-add6-5f998b649713 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:39.989975 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae161645-f8c1-4ebc-add6-5f998b649713 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] PATH_INFO: `/v3/credentials/b39a7972fc762408519c9269049621e0be21fefe66959949ae56a96786a9af95` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:39.999997 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae161645-f8c1-4ebc-add6-5f998b649713 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=b39a7972fc762408519c9269049621e0be21fefe66959949ae56a96786a9af95)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:40.002018 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae161645-f8c1-4ebc-add6-5f998b649713 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:40.109828 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2851/5683] 10.222.0.23 () {58 vars in 1337 bytes} [Sat Apr 30 21:30:39 2022] DELETE /identity/v3/credentials/b39a7972fc762408519c9269049621e0be21fefe66959949ae56a96786a9af95 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:40.116119 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda27d0a-ed7f-4468-a32c-1ff992fb201a tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:40.136080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda27d0a-ed7f-4468-a32c-1ff992fb201a tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:40.144785 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32d4ff-c997-4be2-a42d-be181587619b tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9213795e28bd484f9d5580af062c302e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489d04ed0ae348038a2064795f98dc93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:40.145460 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32d4ff-c997-4be2-a42d-be181587619b tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:40.146407 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32d4ff-c997-4be2-a42d-be181587619b tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:40.147326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32d4ff-c997-4be2-a42d-be181587619b tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] PATH_INFO: `/v3/credentials` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:40.148268 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32d4ff-c997-4be2-a42d-be181587619b tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:40.150191 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32d4ff-c997-4be2-a42d-be181587619b tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:40.264429 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2833/5684] 10.222.0.23 () {60 vars in 1161 bytes} [Sat Apr 30 21:30:40 2022] POST /identity/v3/credentials => generated 431 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:30:40.267639 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae161645-f8c1-4ebc-add6-5f998b649713 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:40.292174 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae161645-f8c1-4ebc-add6-5f998b649713 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:40.293748 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42d08a-8b14-4e00-abae-4b1794cfbc55 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9213795e28bd484f9d5580af062c302e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489d04ed0ae348038a2064795f98dc93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:40.294452 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42d08a-8b14-4e00-abae-4b1794cfbc55 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:40.294885 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42d08a-8b14-4e00-abae-4b1794cfbc55 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:40.297307 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42d08a-8b14-4e00-abae-4b1794cfbc55 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] PATH_INFO: `/v3/credentials` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:40.298134 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d42d08a-8b14-4e00-abae-4b1794cfbc55 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:40.303980 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d42d08a-8b14-4e00-abae-4b1794cfbc55 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:40.438551 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2852/5685] 10.222.0.23 () {60 vars in 1161 bytes} [Sat Apr 30 21:30:40 2022] POST /identity/v3/credentials => generated 431 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:30:40.447436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32d4ff-c997-4be2-a42d-be181587619b tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:40.464309 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32d4ff-c997-4be2-a42d-be181587619b tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:40.471913 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c7606-b4b3-41fa-8bc2-dc12e7a8d623 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9213795e28bd484f9d5580af062c302e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489d04ed0ae348038a2064795f98dc93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:40.474808 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c7606-b4b3-41fa-8bc2-dc12e7a8d623 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:40.480848 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c7606-b4b3-41fa-8bc2-dc12e7a8d623 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:40.481413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c7606-b4b3-41fa-8bc2-dc12e7a8d623 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] PATH_INFO: `/v3/credentials` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:40.482774 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c7606-b4b3-41fa-8bc2-dc12e7a8d623 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:40.491934 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c7606-b4b3-41fa-8bc2-dc12e7a8d623 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:40.509731 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c7606-b4b3-41fa-8bc2-dc12e7a8d623 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:40.512097 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c7606-b4b3-41fa-8bc2-dc12e7a8d623 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:40.513881 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c7606-b4b3-41fa-8bc2-dc12e7a8d623 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:40.515513 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c7606-b4b3-41fa-8bc2-dc12e7a8d623 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:40.517482 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2834/5686] 10.222.0.23 () {58 vars in 1139 bytes} [Sat Apr 30 21:30:40 2022] GET /identity/v3/credentials => generated 947 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:30:40.522349 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42d08a-8b14-4e00-abae-4b1794cfbc55 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:40.546731 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42d08a-8b14-4e00-abae-4b1794cfbc55 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:40.567730 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2a3a5-84b2-4ac3-b158-4b8c609579e3 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9213795e28bd484f9d5580af062c302e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489d04ed0ae348038a2064795f98dc93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:40.569001 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2a3a5-84b2-4ac3-b158-4b8c609579e3 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:40.569358 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2a3a5-84b2-4ac3-b158-4b8c609579e3 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:40.569706 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2a3a5-84b2-4ac3-b158-4b8c609579e3 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] PATH_INFO: `/v3/credentials/bae4b6a1703b0882ea2ac96355ce402868f3a7abe83fecabbd44ce33621e5329` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:40.576458 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c2a3a5-84b2-4ac3-b158-4b8c609579e3 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=bae4b6a1703b0882ea2ac96355ce402868f3a7abe83fecabbd44ce33621e5329)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:40.583448 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c2a3a5-84b2-4ac3-b158-4b8c609579e3 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:40.919830 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2853/5687] 10.222.0.23 () {58 vars in 1337 bytes} [Sat Apr 30 21:30:40 2022] DELETE /identity/v3/credentials/bae4b6a1703b0882ea2ac96355ce402868f3a7abe83fecabbd44ce33621e5329 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:40.924806 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c7606-b4b3-41fa-8bc2-dc12e7a8d623 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:40.939441 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c7606-b4b3-41fa-8bc2-dc12e7a8d623 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:40.948803 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa396d-6076-4230-b2c2-944ddbf91892 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9213795e28bd484f9d5580af062c302e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489d04ed0ae348038a2064795f98dc93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:40.950075 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa396d-6076-4230-b2c2-944ddbf91892 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:40.950404 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa396d-6076-4230-b2c2-944ddbf91892 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:40.951439 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa396d-6076-4230-b2c2-944ddbf91892 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] PATH_INFO: `/v3/credentials/df2c06df3aaf1a6a47752d41a0884a390bc25fed881d037beca1b9dec4126486` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:40.953198 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa396d-6076-4230-b2c2-944ddbf91892 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=df2c06df3aaf1a6a47752d41a0884a390bc25fed881d037beca1b9dec4126486)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:40.966467 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa396d-6076-4230-b2c2-944ddbf91892 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:41.084798 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2835/5688] 10.222.0.23 () {58 vars in 1337 bytes} [Sat Apr 30 21:30:40 2022] DELETE /identity/v3/credentials/df2c06df3aaf1a6a47752d41a0884a390bc25fed881d037beca1b9dec4126486 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:41.090422 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2a3a5-84b2-4ac3-b158-4b8c609579e3 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:41.113930 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2a3a5-84b2-4ac3-b158-4b8c609579e3 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:41.126555 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faee97c-c05f-448f-a21c-54974125209d tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9213795e28bd484f9d5580af062c302e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489d04ed0ae348038a2064795f98dc93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:41.130849 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faee97c-c05f-448f-a21c-54974125209d tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:41.133288 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faee97c-c05f-448f-a21c-54974125209d tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:41.135255 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faee97c-c05f-448f-a21c-54974125209d tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] PATH_INFO: `/v3/projects/114973566e1a43298568417ecf731a8e` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:41.140349 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faee97c-c05f-448f-a21c-54974125209d tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: Authorizing `identity:delete_project(project_id=114973566e1a43298568417ecf731a8e)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:41.143029 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faee97c-c05f-448f-a21c-54974125209d tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:41.328317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1faee97c-c05f-448f-a21c-54974125209d tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '114973566e1a43298568417ecf731a8e', 'request_id': 'req-1faee97c-c05f-448f-a21c-54974125209d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:41.346542 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1faee97c-c05f-448f-a21c-54974125209d tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '114973566e1a43298568417ecf731a8e', 'request_id': 'req-1faee97c-c05f-448f-a21c-54974125209d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:41.358606 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1faee97c-c05f-448f-a21c-54974125209d tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '114973566e1a43298568417ecf731a8e', 'request_id': 'req-1faee97c-c05f-448f-a21c-54974125209d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:41.470465 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1faee97c-c05f-448f-a21c-54974125209d tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] The token cache is being invalidate because project 114973566e1a43298568417ecf731a8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:30:41.471117 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1faee97c-c05f-448f-a21c-54974125209d tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:41.473085 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1faee97c-c05f-448f-a21c-54974125209d tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:41.480290 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa396d-6076-4230-b2c2-944ddbf91892 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:41.481087 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2854/5689] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:30:41 2022] DELETE /identity/v3/projects/114973566e1a43298568417ecf731a8e => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:41.482748 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2ffa396d-6076-4230-b2c2-944ddbf91892 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:41.507661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa396d-6076-4230-b2c2-944ddbf91892 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:41.655810 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff721d07-a8d3-489c-826f-1c81c00f38c5 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9213795e28bd484f9d5580af062c302e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '489d04ed0ae348038a2064795f98dc93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:41.657428 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff721d07-a8d3-489c-826f-1c81c00f38c5 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:41.658302 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff721d07-a8d3-489c-826f-1c81c00f38c5 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:41.658302 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff721d07-a8d3-489c-826f-1c81c00f38c5 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] PATH_INFO: `/v3/projects/79a8de11e38540c8bb0e28d3b4fe8b48` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:41.660736 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff721d07-a8d3-489c-826f-1c81c00f38c5 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: Authorizing `identity:delete_project(project_id=79a8de11e38540c8bb0e28d3b4fe8b48)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:41.666666 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff721d07-a8d3-489c-826f-1c81c00f38c5 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:41.842341 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b77cd7-bb9e-4a65-be02-e3312fff960f None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:41.842858 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b77cd7-bb9e-4a65-be02-e3312fff960f None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:41.844978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b77cd7-bb9e-4a65-be02-e3312fff960f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:41.905312 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-70b77cd7-bb9e-4a65-be02-e3312fff960f None None] MFA Rules not processed for user `baf1d13615bc491ab98d2a644e681c12`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:41.913545 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ff721d07-a8d3-489c-826f-1c81c00f38c5 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79a8de11e38540c8bb0e28d3b4fe8b48', 'request_id': 'req-ff721d07-a8d3-489c-826f-1c81c00f38c5'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:41.918332 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-70b77cd7-bb9e-4a65-be02-e3312fff960f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:41.932349 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ff721d07-a8d3-489c-826f-1c81c00f38c5 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79a8de11e38540c8bb0e28d3b4fe8b48', 'request_id': 'req-ff721d07-a8d3-489c-826f-1c81c00f38c5'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:42.009427 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ff721d07-a8d3-489c-826f-1c81c00f38c5 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79a8de11e38540c8bb0e28d3b4fe8b48', 'request_id': 'req-ff721d07-a8d3-489c-826f-1c81c00f38c5'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:42.117562 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ff721d07-a8d3-489c-826f-1c81c00f38c5 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] The token cache is being invalidate because project 79a8de11e38540c8bb0e28d3b4fe8b48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:30:42.117562 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ff721d07-a8d3-489c-826f-1c81c00f38c5 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:42.121277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ff721d07-a8d3-489c-826f-1c81c00f38c5 tempest-CredentialsTestJSON-1924936454 tempest-CredentialsTestJSON-1924936454-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:42.132580 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2855/5691] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:42.133439 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2836/5691] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:30:41 2022] DELETE /identity/v3/projects/79a8de11e38540c8bb0e28d3b4fe8b48 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:42.155596 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b77cd7-bb9e-4a65-be02-e3312fff960f None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:42.160056 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-70b77cd7-bb9e-4a65-be02-e3312fff960f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:42.367336 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b77cd7-bb9e-4a65-be02-e3312fff960f None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:42.375258 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae11961-885e-49fa-bc33-7c7337006f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:42.375258 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae11961-885e-49fa-bc33-7c7337006f9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:42.375258 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae11961-885e-49fa-bc33-7c7337006f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:42.375578 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae11961-885e-49fa-bc33-7c7337006f9d admin admin] PATH_INFO: `/v3/users/a6debef3260648039eaf39906856f74f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:42.376706 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae11961-885e-49fa-bc33-7c7337006f9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6debef3260648039eaf39906856f74f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:42.381120 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae11961-885e-49fa-bc33-7c7337006f9d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:42.764654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-dae11961-885e-49fa-bc33-7c7337006f9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6debef3260648039eaf39906856f74f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:42.787659 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-dae11961-885e-49fa-bc33-7c7337006f9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6debef3260648039eaf39906856f74f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:42.868500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-dae11961-885e-49fa-bc33-7c7337006f9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6debef3260648039eaf39906856f74f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:42.881638 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-dae11961-885e-49fa-bc33-7c7337006f9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6debef3260648039eaf39906856f74f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:42.882409 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-dae11961-885e-49fa-bc33-7c7337006f9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6debef3260648039eaf39906856f74f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:42.915232 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2856/5692] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:30:42 2022] DELETE /identity/v3/users/a6debef3260648039eaf39906856f74f => generated 0 bytes in 782 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:42.920503 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805cdd8-8528-4cb8-8e8a-ea5c2817be86 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:42.920827 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805cdd8-8528-4cb8-8e8a-ea5c2817be86 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:42.921123 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805cdd8-8528-4cb8-8e8a-ea5c2817be86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:43.029293 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-7805cdd8-8528-4cb8-8e8a-ea5c2817be86 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:43.030599 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7805cdd8-8528-4cb8-8e8a-ea5c2817be86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:43.194312 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2837/5693] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:43.269435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae11961-885e-49fa-bc33-7c7337006f9d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:43.272447 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-dae11961-885e-49fa-bc33-7c7337006f9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:43.482128 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae11961-885e-49fa-bc33-7c7337006f9d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:43.490239 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f00277-03e8-4334-8a96-cae57dda40ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:43.491262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f00277-03e8-4334-8a96-cae57dda40ee service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:43.491730 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f00277-03e8-4334-8a96-cae57dda40ee service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:43.492231 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f00277-03e8-4334-8a96-cae57dda40ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:43.820593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f00277-03e8-4334-8a96-cae57dda40ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:43.820593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f00277-03e8-4334-8a96-cae57dda40ee service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:43.820593 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2857/5694] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:30:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:30:44.399234 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805cdd8-8528-4cb8-8e8a-ea5c2817be86 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:44.401977 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7805cdd8-8528-4cb8-8e8a-ea5c2817be86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:44.420840 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805cdd8-8528-4cb8-8e8a-ea5c2817be86 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:44.431867 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36120ac-4d48-4395-8ccf-d4e46472c451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:44.434189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36120ac-4d48-4395-8ccf-d4e46472c451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:44.434701 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36120ac-4d48-4395-8ccf-d4e46472c451 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:44.440672 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36120ac-4d48-4395-8ccf-d4e46472c451 admin admin] PATH_INFO: `/v3/users/9dd0b7edccf949e3864c3e2210b64a90` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:44.442513 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36120ac-4d48-4395-8ccf-d4e46472c451 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dd0b7edccf949e3864c3e2210b64a90)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:44.444852 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36120ac-4d48-4395-8ccf-d4e46472c451 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:44.481371 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f00277-03e8-4334-8a96-cae57dda40ee service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:44.485677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-30f00277-03e8-4334-8a96-cae57dda40ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:44.516892 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f00277-03e8-4334-8a96-cae57dda40ee service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:44.528622 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f47ff7d-43ef-40d6-9031-ec5498cd3ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:44.532701 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47ff7d-43ef-40d6-9031-ec5498cd3ea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:44.535089 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47ff7d-43ef-40d6-9031-ec5498cd3ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:44.538109 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47ff7d-43ef-40d6-9031-ec5498cd3ea0 admin admin] PATH_INFO: `/v3/projects/6d29f9b7ba27421ea8331a086db7b67a` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:44.539633 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f47ff7d-43ef-40d6-9031-ec5498cd3ea0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d29f9b7ba27421ea8331a086db7b67a)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:44.541859 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f47ff7d-43ef-40d6-9031-ec5498cd3ea0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:44.774561 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b36120ac-4d48-4395-8ccf-d4e46472c451 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dd0b7edccf949e3864c3e2210b64a90'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:44.791209 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9f47ff7d-43ef-40d6-9031-ec5498cd3ea0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d29f9b7ba27421ea8331a086db7b67a', 'request_id': 'req-9f47ff7d-43ef-40d6-9031-ec5498cd3ea0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:44.801326 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9f47ff7d-43ef-40d6-9031-ec5498cd3ea0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d29f9b7ba27421ea8331a086db7b67a', 'request_id': 'req-9f47ff7d-43ef-40d6-9031-ec5498cd3ea0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:44.806365 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b36120ac-4d48-4395-8ccf-d4e46472c451 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dd0b7edccf949e3864c3e2210b64a90'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:44.835858 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9f47ff7d-43ef-40d6-9031-ec5498cd3ea0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d29f9b7ba27421ea8331a086db7b67a', 'request_id': 'req-9f47ff7d-43ef-40d6-9031-ec5498cd3ea0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:44.912248 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b36120ac-4d48-4395-8ccf-d4e46472c451 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dd0b7edccf949e3864c3e2210b64a90'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:44.914547 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b36120ac-4d48-4395-8ccf-d4e46472c451 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dd0b7edccf949e3864c3e2210b64a90'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:44.932911 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b36120ac-4d48-4395-8ccf-d4e46472c451 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dd0b7edccf949e3864c3e2210b64a90'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:44.945598 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2838/5695] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:30:44 2022] DELETE /identity/v3/users/9dd0b7edccf949e3864c3e2210b64a90 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:44.951795 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0184c1d-e641-41e1-93ef-1fee43020613 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:44.952639 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0184c1d-e641-41e1-93ef-1fee43020613 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:44.953257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0184c1d-e641-41e1-93ef-1fee43020613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:44.984013 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-d0184c1d-e641-41e1-93ef-1fee43020613 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:44.987171 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d0184c1d-e641-41e1-93ef-1fee43020613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:45.017043 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9f47ff7d-43ef-40d6-9031-ec5498cd3ea0 admin admin] The token cache is being invalidate because project 6d29f9b7ba27421ea8331a086db7b67a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:30:45.017353 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9f47ff7d-43ef-40d6-9031-ec5498cd3ea0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:45.021006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9f47ff7d-43ef-40d6-9031-ec5498cd3ea0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:45.022858 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2858/5696] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:30:44 2022] DELETE /identity/v3/projects/6d29f9b7ba27421ea8331a086db7b67a => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:45.032450 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f47ff7d-43ef-40d6-9031-ec5498cd3ea0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:45.035168 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9f47ff7d-43ef-40d6-9031-ec5498cd3ea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:45.171367 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2839/5697] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:45.212373 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0184c1d-e641-41e1-93ef-1fee43020613 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:45.215634 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d0184c1d-e641-41e1-93ef-1fee43020613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:45.297369 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f47ff7d-43ef-40d6-9031-ec5498cd3ea0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:45.317772 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce832f-58de-4a72-912d-1284eb510826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:45.319074 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce832f-58de-4a72-912d-1284eb510826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:45.319516 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce832f-58de-4a72-912d-1284eb510826 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:45.319950 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce832f-58de-4a72-912d-1284eb510826 admin admin] PATH_INFO: `/v3/users/9213795e28bd484f9d5580af062c302e` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:45.322790 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce832f-58de-4a72-912d-1284eb510826 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9213795e28bd484f9d5580af062c302e)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:45.325014 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce832f-58de-4a72-912d-1284eb510826 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:45.400506 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0184c1d-e641-41e1-93ef-1fee43020613 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:45.406195 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e793c1-cbd5-4fbb-bb05-f24177d71df2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:45.406999 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e793c1-cbd5-4fbb-bb05-f24177d71df2 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:45.407491 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e793c1-cbd5-4fbb-bb05-f24177d71df2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:45.408026 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e793c1-cbd5-4fbb-bb05-f24177d71df2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:45.420454 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e793c1-cbd5-4fbb-bb05-f24177d71df2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:45.422546 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e793c1-cbd5-4fbb-bb05-f24177d71df2 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:45.438003 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2840/5698] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:30:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:30:45.601878 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-01ce832f-58de-4a72-912d-1284eb510826 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9213795e28bd484f9d5580af062c302e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:45.639132 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-01ce832f-58de-4a72-912d-1284eb510826 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9213795e28bd484f9d5580af062c302e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:45.715289 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-01ce832f-58de-4a72-912d-1284eb510826 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9213795e28bd484f9d5580af062c302e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:45.725012 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-01ce832f-58de-4a72-912d-1284eb510826 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9213795e28bd484f9d5580af062c302e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:45.726311 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-01ce832f-58de-4a72-912d-1284eb510826 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9213795e28bd484f9d5580af062c302e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:45.753094 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2859/5699] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:30:45 2022] DELETE /identity/v3/users/9213795e28bd484f9d5580af062c302e => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:30:47.337508 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e793c1-cbd5-4fbb-bb05-f24177d71df2 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:47.368104 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e793c1-cbd5-4fbb-bb05-f24177d71df2 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:47.516657 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77418f-c8ff-40b1-8b7a-02e60e6a497d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:47.518094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77418f-c8ff-40b1-8b7a-02e60e6a497d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:47.518562 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77418f-c8ff-40b1-8b7a-02e60e6a497d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:47.520680 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77418f-c8ff-40b1-8b7a-02e60e6a497d admin admin] PATH_INFO: `/v3/projects/489d04ed0ae348038a2064795f98dc93` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:47.522912 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77418f-c8ff-40b1-8b7a-02e60e6a497d admin admin] RBAC: Authorizing `identity:delete_project(project_id=489d04ed0ae348038a2064795f98dc93)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:47.527222 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77418f-c8ff-40b1-8b7a-02e60e6a497d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:47.785404 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-fd77418f-c8ff-40b1-8b7a-02e60e6a497d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '489d04ed0ae348038a2064795f98dc93', 'request_id': 'req-fd77418f-c8ff-40b1-8b7a-02e60e6a497d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:47.794662 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-fd77418f-c8ff-40b1-8b7a-02e60e6a497d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '489d04ed0ae348038a2064795f98dc93', 'request_id': 'req-fd77418f-c8ff-40b1-8b7a-02e60e6a497d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:47.811598 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-fd77418f-c8ff-40b1-8b7a-02e60e6a497d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '489d04ed0ae348038a2064795f98dc93', 'request_id': 'req-fd77418f-c8ff-40b1-8b7a-02e60e6a497d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:47.920089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-fd77418f-c8ff-40b1-8b7a-02e60e6a497d admin admin] The token cache is being invalidate because project 489d04ed0ae348038a2064795f98dc93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:30:47.920384 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-fd77418f-c8ff-40b1-8b7a-02e60e6a497d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:47.921062 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-fd77418f-c8ff-40b1-8b7a-02e60e6a497d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:47.926340 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2841/5700] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:30:47 2022] DELETE /identity/v3/projects/489d04ed0ae348038a2064795f98dc93 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:47.931340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543096d7-c846-4836-9b98-07c81f5babdd None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:47.932142 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543096d7-c846-4836-9b98-07c81f5babdd None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:47.932617 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543096d7-c846-4836-9b98-07c81f5babdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:48.078849 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77418f-c8ff-40b1-8b7a-02e60e6a497d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:48.084719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-fd77418f-c8ff-40b1-8b7a-02e60e6a497d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:48.127170 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-543096d7-c846-4836-9b98-07c81f5babdd None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:48.135317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-543096d7-c846-4836-9b98-07c81f5babdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:48.297751 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77418f-c8ff-40b1-8b7a-02e60e6a497d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:48.320069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e97d89-297f-49fd-94c0-1de1e0d54cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:48.327055 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e97d89-297f-49fd-94c0-1de1e0d54cbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:48.328699 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e97d89-297f-49fd-94c0-1de1e0d54cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:48.329726 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e97d89-297f-49fd-94c0-1de1e0d54cbe admin admin] PATH_INFO: `/v3/projects/e3aa141f37814c6cac51868379a14d43` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:48.334469 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e97d89-297f-49fd-94c0-1de1e0d54cbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3aa141f37814c6cac51868379a14d43)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:48.338496 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e97d89-297f-49fd-94c0-1de1e0d54cbe admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:48.350107 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2860/5701] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:48.356728 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76d5b8-4806-4b13-ad6a-4a6652e01e0b None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:48.357247 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76d5b8-4806-4b13-ad6a-4a6652e01e0b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:48.357682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76d5b8-4806-4b13-ad6a-4a6652e01e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:48.396824 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-2e76d5b8-4806-4b13-ad6a-4a6652e01e0b None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:48.398002 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2e76d5b8-4806-4b13-ad6a-4a6652e01e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:48.427276 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2861/5702] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:48.431371 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76d5b8-4806-4b13-ad6a-4a6652e01e0b None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:48.443178 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76d5b8-4806-4b13-ad6a-4a6652e01e0b None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:48.450112 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550f545-31c0-49c0-8f81-8e2e5dbc6d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:48.450983 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550f545-31c0-49c0-8f81-8e2e5dbc6d15 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:48.451562 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550f545-31c0-49c0-8f81-8e2e5dbc6d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:48.451981 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550f545-31c0-49c0-8f81-8e2e5dbc6d15 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:48.452861 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550f545-31c0-49c0-8f81-8e2e5dbc6d15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:30:48.453358 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550f545-31c0-49c0-8f81-8e2e5dbc6d15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:48.455411 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550f545-31c0-49c0-8f81-8e2e5dbc6d15 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:48.496168 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2862/5703] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:30:48.506404 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550f545-31c0-49c0-8f81-8e2e5dbc6d15 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:48.540801 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-96e97d89-297f-49fd-94c0-1de1e0d54cbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3aa141f37814c6cac51868379a14d43', 'request_id': 'req-96e97d89-297f-49fd-94c0-1de1e0d54cbe'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:48.574097 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550f545-31c0-49c0-8f81-8e2e5dbc6d15 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:48.581381 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-96e97d89-297f-49fd-94c0-1de1e0d54cbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3aa141f37814c6cac51868379a14d43', 'request_id': 'req-96e97d89-297f-49fd-94c0-1de1e0d54cbe'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:48.597151 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-96e97d89-297f-49fd-94c0-1de1e0d54cbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3aa141f37814c6cac51868379a14d43', 'request_id': 'req-96e97d89-297f-49fd-94c0-1de1e0d54cbe'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:48.692112 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-96e97d89-297f-49fd-94c0-1de1e0d54cbe admin admin] The token cache is being invalidate because project e3aa141f37814c6cac51868379a14d43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:30:48.692722 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-96e97d89-297f-49fd-94c0-1de1e0d54cbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:48.694353 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-96e97d89-297f-49fd-94c0-1de1e0d54cbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:48.704095 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2842/5704] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:30:48 2022] DELETE /identity/v3/projects/e3aa141f37814c6cac51868379a14d43 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:30:48.707725 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9dd84f-2196-4b2b-89da-37cd721612fd None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:48.708660 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9dd84f-2196-4b2b-89da-37cd721612fd None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:48.709474 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9dd84f-2196-4b2b-89da-37cd721612fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:48.746634 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f75e7-aaed-404a-8642-7b7ecd3038f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:48.748382 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f75e7-aaed-404a-8642-7b7ecd3038f6 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:48.748879 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f75e7-aaed-404a-8642-7b7ecd3038f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:48.749344 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f75e7-aaed-404a-8642-7b7ecd3038f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:48.750511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f75e7-aaed-404a-8642-7b7ecd3038f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:48.754714 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f75e7-aaed-404a-8642-7b7ecd3038f6 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:48.759729 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-5b9dd84f-2196-4b2b-89da-37cd721612fd None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:48.761214 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5b9dd84f-2196-4b2b-89da-37cd721612fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:48.785220 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2843/5705] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:48.795016 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70b7b7-6de3-41b9-bc51-699371276513 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:48.795732 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70b7b7-6de3-41b9-bc51-699371276513 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:48.796657 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70b7b7-6de3-41b9-bc51-699371276513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:48.822820 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-ed70b7b7-6de3-41b9-bc51-699371276513 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:48.824406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ed70b7b7-6de3-41b9-bc51-699371276513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:48.835993 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2844/5706] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:48.851835 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70b7b7-6de3-41b9-bc51-699371276513 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:48.871206 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70b7b7-6de3-41b9-bc51-699371276513 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:48.910491 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2863/5707] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:30:48 2022] POST /identity/v3/projects => generated 371 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:30:48.918779 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f75e7-aaed-404a-8642-7b7ecd3038f6 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:48.930632 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e73f75e7-aaed-404a-8642-7b7ecd3038f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:48.938267 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39793f9d-6dde-473b-a1bd-d1e4fa02ab57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:48.938834 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39793f9d-6dde-473b-a1bd-d1e4fa02ab57 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:48.939118 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39793f9d-6dde-473b-a1bd-d1e4fa02ab57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:48.940123 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39793f9d-6dde-473b-a1bd-d1e4fa02ab57 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:48.941422 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39793f9d-6dde-473b-a1bd-d1e4fa02ab57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:30:48.941731 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39793f9d-6dde-473b-a1bd-d1e4fa02ab57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:48.943391 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39793f9d-6dde-473b-a1bd-d1e4fa02ab57 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:48.995997 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2845/5708] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:30:49.000688 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39793f9d-6dde-473b-a1bd-d1e4fa02ab57 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:49.044837 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39793f9d-6dde-473b-a1bd-d1e4fa02ab57 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:49.205036 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f75e7-aaed-404a-8642-7b7ecd3038f6 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:49.223812 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8354ac4-31a5-4f42-9139-457290dbe6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:49.224539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8354ac4-31a5-4f42-9139-457290dbe6f3 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:49.224977 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8354ac4-31a5-4f42-9139-457290dbe6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:49.225406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8354ac4-31a5-4f42-9139-457290dbe6f3 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:49.226492 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8354ac4-31a5-4f42-9139-457290dbe6f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:49.231951 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8354ac4-31a5-4f42-9139-457290dbe6f3 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:49.259840 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7349f-c27b-4cf5-9797-4c0c951fda17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:49.260738 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7349f-c27b-4cf5-9797-4c0c951fda17 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:49.261133 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7349f-c27b-4cf5-9797-4c0c951fda17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:49.262381 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7349f-c27b-4cf5-9797-4c0c951fda17 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:49.263805 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b7349f-c27b-4cf5-9797-4c0c951fda17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:49.298597 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b7349f-c27b-4cf5-9797-4c0c951fda17 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:49.406858 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2864/5709] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:30:48 2022] POST /identity/v3/users => generated 286 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:30:49.413604 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8354ac4-31a5-4f42-9139-457290dbe6f3 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:49.436115 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2846/5710] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:30:48 2022] POST /identity/v3/projects => generated 371 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:30:49.442622 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7349f-c27b-4cf5-9797-4c0c951fda17 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:49.447945 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8354ac4-31a5-4f42-9139-457290dbe6f3 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:49.611220 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6f7e9-b216-425d-a7b8-8e8102b4e3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:49.612752 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6f7e9-b216-425d-a7b8-8e8102b4e3d8 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:49.613206 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6f7e9-b216-425d-a7b8-8e8102b4e3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:49.614724 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6f7e9-b216-425d-a7b8-8e8102b4e3d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:49.614724 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d6f7e9-b216-425d-a7b8-8e8102b4e3d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:49.616886 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d6f7e9-b216-425d-a7b8-8e8102b4e3d8 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:49.620372 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7349f-c27b-4cf5-9797-4c0c951fda17 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:49.625312 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a998b694-3767-429d-9d94-c1adb5910c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:49.626045 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998b694-3767-429d-9d94-c1adb5910c0f admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:49.626338 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998b694-3767-429d-9d94-c1adb5910c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:49.626630 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998b694-3767-429d-9d94-c1adb5910c0f admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:49.627336 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a998b694-3767-429d-9d94-c1adb5910c0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:49.629878 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a998b694-3767-429d-9d94-c1adb5910c0f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:49.631693 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2865/5711] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:30:49.635627 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6f7e9-b216-425d-a7b8-8e8102b4e3d8 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:49.650527 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6f7e9-b216-425d-a7b8-8e8102b4e3d8 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:49.658010 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f1903-d5fc-4869-bf7a-a85d36b7bb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:49.660036 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f1903-d5fc-4869-bf7a-a85d36b7bb6f admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:49.660510 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f1903-d5fc-4869-bf7a-a85d36b7bb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:49.661444 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f1903-d5fc-4869-bf7a-a85d36b7bb6f admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:49.662570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f1903-d5fc-4869-bf7a-a85d36b7bb6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:49.664821 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f1903-d5fc-4869-bf7a-a85d36b7bb6f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:49.682779 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2866/5712] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:30:49.687915 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f1903-d5fc-4869-bf7a-a85d36b7bb6f admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:49.708555 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f1903-d5fc-4869-bf7a-a85d36b7bb6f admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:49.714818 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b67bbde-fcc0-4b5a-85e5-6634ec254c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:49.715702 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67bbde-fcc0-4b5a-85e5-6634ec254c2e admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:49.716001 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67bbde-fcc0-4b5a-85e5-6634ec254c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:49.716255 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67bbde-fcc0-4b5a-85e5-6634ec254c2e admin admin] PATH_INFO: `/v3/projects/3e2112ef23b240ddb473025b77d55a87/users/ae35dc17bc854b4d8925322571cf39f8/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:49.735671 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b67bbde-fcc0-4b5a-85e5-6634ec254c2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e2112ef23b240ddb473025b77d55a87, user_id=ae35dc17bc854b4d8925322571cf39f8, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:49.739298 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b67bbde-fcc0-4b5a-85e5-6634ec254c2e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:49.797896 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2847/5713] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:30:49 2022] POST /identity/v3/users => generated 286 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:30:49.803326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a998b694-3767-429d-9d94-c1adb5910c0f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:49.818264 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a998b694-3767-429d-9d94-c1adb5910c0f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:49.824410 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442cc6e-5ce1-4e55-a8a5-939f0ff4b83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:49.825347 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442cc6e-5ce1-4e55-a8a5-939f0ff4b83d admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:49.826414 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442cc6e-5ce1-4e55-a8a5-939f0ff4b83d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:49.826414 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442cc6e-5ce1-4e55-a8a5-939f0ff4b83d admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:49.827253 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442cc6e-5ce1-4e55-a8a5-939f0ff4b83d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:49.829128 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442cc6e-5ce1-4e55-a8a5-939f0ff4b83d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:49.844648 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2848/5714] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:30:49.848829 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442cc6e-5ce1-4e55-a8a5-939f0ff4b83d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:49.861685 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442cc6e-5ce1-4e55-a8a5-939f0ff4b83d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:49.869006 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659f357-044d-4a17-8cee-56516cc72894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:49.869394 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659f357-044d-4a17-8cee-56516cc72894 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:49.869938 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659f357-044d-4a17-8cee-56516cc72894 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:49.870316 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659f357-044d-4a17-8cee-56516cc72894 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:49.871274 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9659f357-044d-4a17-8cee-56516cc72894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:49.884676 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2867/5715] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:30:49 2022] PUT /identity/v3/projects/3e2112ef23b240ddb473025b77d55a87/users/ae35dc17bc854b4d8925322571cf39f8/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:49.885627 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9659f357-044d-4a17-8cee-56516cc72894 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:49.896592 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205da35-9d05-4784-940f-b10d11796159 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:49.897405 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205da35-9d05-4784-940f-b10d11796159 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:49.897789 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205da35-9d05-4784-940f-b10d11796159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:49.912378 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2849/5716] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:30:49.921268 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659f357-044d-4a17-8cee-56516cc72894 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:49.927354 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-e205da35-9d05-4784-940f-b10d11796159 None None] MFA Rules not processed for user `ae35dc17bc854b4d8925322571cf39f8`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:49.928654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e205da35-9d05-4784-940f-b10d11796159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:49.932912 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659f357-044d-4a17-8cee-56516cc72894 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:50.041475 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee156f8-2988-4077-b4e7-b6f01bebdf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:50.046282 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee156f8-2988-4077-b4e7-b6f01bebdf7b admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:50.046590 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee156f8-2988-4077-b4e7-b6f01bebdf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:50.046862 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee156f8-2988-4077-b4e7-b6f01bebdf7b admin admin] PATH_INFO: `/v3/projects/83c1c99c0d904b58946a2a623c674759/users/1e5bf319f22145459e3c71d158430d63/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:50.070155 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2868/5717] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:50.075248 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee156f8-2988-4077-b4e7-b6f01bebdf7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=83c1c99c0d904b58946a2a623c674759, user_id=1e5bf319f22145459e3c71d158430d63, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:50.076768 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205da35-9d05-4784-940f-b10d11796159 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:50.079284 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee156f8-2988-4077-b4e7-b6f01bebdf7b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:50.123379 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205da35-9d05-4784-940f-b10d11796159 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:50.150742 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8b309-c464-442b-8b7a-43bf6a35f7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:50.150742 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8b309-c464-442b-8b7a-43bf6a35f7c9 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:50.150742 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8b309-c464-442b-8b7a-43bf6a35f7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:50.150742 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8b309-c464-442b-8b7a-43bf6a35f7c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:50.151045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca8b309-c464-442b-8b7a-43bf6a35f7c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:50.151045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca8b309-c464-442b-8b7a-43bf6a35f7c9 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:50.209626 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2850/5718] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:30:49 2022] PUT /identity/v3/projects/83c1c99c0d904b58946a2a623c674759/users/1e5bf319f22145459e3c71d158430d63/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:50.214849 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee53c4f-f20a-4e83-98a1-eab70e300bfa None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:50.216469 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee53c4f-f20a-4e83-98a1-eab70e300bfa None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:50.216893 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee53c4f-f20a-4e83-98a1-eab70e300bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:50.254785 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-7ee53c4f-f20a-4e83-98a1-eab70e300bfa None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:50.259199 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7ee53c4f-f20a-4e83-98a1-eab70e300bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:50.321242 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2869/5719] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:30:50 2022] POST /identity/v3/projects => generated 369 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:30:50.329540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8b309-c464-442b-8b7a-43bf6a35f7c9 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:50.503388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8b309-c464-442b-8b7a-43bf6a35f7c9 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:50.517688 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79853ee6-b6c3-4204-83c0-577489202323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:50.519158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79853ee6-b6c3-4204-83c0-577489202323 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:50.519451 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79853ee6-b6c3-4204-83c0-577489202323 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:50.519774 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79853ee6-b6c3-4204-83c0-577489202323 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:50.521252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79853ee6-b6c3-4204-83c0-577489202323 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:50.523327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79853ee6-b6c3-4204-83c0-577489202323 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:50.527334 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2851/5720] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:30:50.564980 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee53c4f-f20a-4e83-98a1-eab70e300bfa None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:50.577080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7ee53c4f-f20a-4e83-98a1-eab70e300bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:50.654591 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2870/5721] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:30:50 2022] POST /identity/v3/users => generated 291 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:30:50.656047 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79853ee6-b6c3-4204-83c0-577489202323 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:50.677462 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79853ee6-b6c3-4204-83c0-577489202323 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:50.690383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4319eb7-fd14-417b-bd04-4c8eab72aadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:50.691121 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4319eb7-fd14-417b-bd04-4c8eab72aadf admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:50.691435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4319eb7-fd14-417b-bd04-4c8eab72aadf admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:50.691668 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4319eb7-fd14-417b-bd04-4c8eab72aadf admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:50.692572 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4319eb7-fd14-417b-bd04-4c8eab72aadf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:50.694230 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4319eb7-fd14-417b-bd04-4c8eab72aadf admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:50.723898 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2871/5722] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:30:50.725783 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4319eb7-fd14-417b-bd04-4c8eab72aadf admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:50.747960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4319eb7-fd14-417b-bd04-4c8eab72aadf admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:50.757287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407b74f-dc30-46ea-bf7c-24a5f7186805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:50.758686 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407b74f-dc30-46ea-bf7c-24a5f7186805 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:50.759171 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407b74f-dc30-46ea-bf7c-24a5f7186805 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:50.759672 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407b74f-dc30-46ea-bf7c-24a5f7186805 admin admin] PATH_INFO: `/v3/projects/5cbe90c90e98484ba9032794e156ab2f/users/022a8bd29d8e49b19cdc71a9fe2ca497/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:50.783537 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1407b74f-dc30-46ea-bf7c-24a5f7186805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cbe90c90e98484ba9032794e156ab2f, user_id=022a8bd29d8e49b19cdc71a9fe2ca497, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:50.789226 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1407b74f-dc30-46ea-bf7c-24a5f7186805 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:50.814623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee53c4f-f20a-4e83-98a1-eab70e300bfa None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:50.898231 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2872/5723] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:30:50 2022] PUT /identity/v3/projects/5cbe90c90e98484ba9032794e156ab2f/users/022a8bd29d8e49b19cdc71a9fe2ca497/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:50.904599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407b74f-dc30-46ea-bf7c-24a5f7186805 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:50.966674 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69452bc-9070-4f7c-bd79-1e3dbe361e88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:50.967478 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69452bc-9070-4f7c-bd79-1e3dbe361e88 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:50.967766 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69452bc-9070-4f7c-bd79-1e3dbe361e88 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:50.968044 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69452bc-9070-4f7c-bd79-1e3dbe361e88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:50.997627 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69452bc-9070-4f7c-bd79-1e3dbe361e88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:50.999355 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69452bc-9070-4f7c-bd79-1e3dbe361e88 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:51.029951 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2852/5724] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:30:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:30:51.046506 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407b74f-dc30-46ea-bf7c-24a5f7186805 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:51.052044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f07b3-08d7-466c-a0fb-47e15f3fab73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:51.052758 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f07b3-08d7-466c-a0fb-47e15f3fab73 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:51.053043 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f07b3-08d7-466c-a0fb-47e15f3fab73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:51.053323 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f07b3-08d7-466c-a0fb-47e15f3fab73 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:51.054166 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164f07b3-08d7-466c-a0fb-47e15f3fab73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:51.055797 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164f07b3-08d7-466c-a0fb-47e15f3fab73 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:51.078966 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2873/5725] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:30:51.083284 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69452bc-9070-4f7c-bd79-1e3dbe361e88 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:51.099242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69452bc-9070-4f7c-bd79-1e3dbe361e88 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:51.103081 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f38c16-99d7-424f-b5de-9e3370233087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:51.104579 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f38c16-99d7-424f-b5de-9e3370233087 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:51.104975 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f38c16-99d7-424f-b5de-9e3370233087 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:51.105324 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f38c16-99d7-424f-b5de-9e3370233087 admin admin] PATH_INFO: `/v3/projects/5cbe90c90e98484ba9032794e156ab2f/users/022a8bd29d8e49b19cdc71a9fe2ca497/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:51.108145 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f38c16-99d7-424f-b5de-9e3370233087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cbe90c90e98484ba9032794e156ab2f, user_id=022a8bd29d8e49b19cdc71a9fe2ca497, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:51.113721 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f38c16-99d7-424f-b5de-9e3370233087 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:51.140121 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2853/5726] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:30:51 2022] PUT /identity/v3/projects/5cbe90c90e98484ba9032794e156ab2f/users/022a8bd29d8e49b19cdc71a9fe2ca497/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:51.142438 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd729e-5374-43bb-9dc8-8283c3eee792 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:51.142975 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd729e-5374-43bb-9dc8-8283c3eee792 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:51.144775 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd729e-5374-43bb-9dc8-8283c3eee792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:51.180996 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-b1bd729e-5374-43bb-9dc8-8283c3eee792 None None] MFA Rules not processed for user `022a8bd29d8e49b19cdc71a9fe2ca497`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:51.186827 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b1bd729e-5374-43bb-9dc8-8283c3eee792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:51.317263 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2874/5727] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:51 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:51.321631 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f38c16-99d7-424f-b5de-9e3370233087 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:51.333747 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f38c16-99d7-424f-b5de-9e3370233087 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:51.340527 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611ab87-c85d-4a37-9b7b-e341af41f10d tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '022a8bd29d8e49b19cdc71a9fe2ca497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cbe90c90e98484ba9032794e156ab2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:51.341220 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611ab87-c85d-4a37-9b7b-e341af41f10d tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:51.341491 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611ab87-c85d-4a37-9b7b-e341af41f10d tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:51.341787 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611ab87-c85d-4a37-9b7b-e341af41f10d tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] PATH_INFO: `/v3/services` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:51.342549 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4611ab87-c85d-4a37-9b7b-e341af41f10d tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:51.344165 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4611ab87-c85d-4a37-9b7b-e341af41f10d tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:51.458193 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2854/5728] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:30:51 2022] POST /identity/v3/services => generated 289 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:30:51.461816 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd729e-5374-43bb-9dc8-8283c3eee792 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:51.473932 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd729e-5374-43bb-9dc8-8283c3eee792 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:51.492244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f8293-093d-45ac-b942-a9bc284fa801 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '022a8bd29d8e49b19cdc71a9fe2ca497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cbe90c90e98484ba9032794e156ab2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:51.493430 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f8293-093d-45ac-b942-a9bc284fa801 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:51.493724 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f8293-093d-45ac-b942-a9bc284fa801 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:51.494048 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f8293-093d-45ac-b942-a9bc284fa801 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:51.494815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f8293-093d-45ac-b942-a9bc284fa801 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:51.495895 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-d81f8293-093d-45ac-b942-a9bc284fa801 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:30:51.495895 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:30:51.495895 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:30:51.496812 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f8293-093d-45ac-b942-a9bc284fa801 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:51.685898 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-d81f8293-093d-45ac-b942-a9bc284fa801 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-648218713. To ensure interoperability, identifiers should be a valid uuid. Apr 30 21:30:51.685898 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Apr 30 21:30:51.685898 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:30:51.829207 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2875/5729] 10.222.0.23 () {60 vars in 1155 bytes} [Sat Apr 30 21:30:51 2022] POST /identity/v3/endpoints => generated 359 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:30:51.833740 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611ab87-c85d-4a37-9b7b-e341af41f10d tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:51.850346 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611ab87-c85d-4a37-9b7b-e341af41f10d tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:51.876548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bc774-3828-43be-b970-e6da4dc4807b tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '022a8bd29d8e49b19cdc71a9fe2ca497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cbe90c90e98484ba9032794e156ab2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:51.887933 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bc774-3828-43be-b970-e6da4dc4807b tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:51.888115 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bc774-3828-43be-b970-e6da4dc4807b tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:51.888929 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bc774-3828-43be-b970-e6da4dc4807b tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] PATH_INFO: `/v3/regions/tempest-region-648218713` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:51.895757 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8bc774-3828-43be-b970-e6da4dc4807b tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-648218713)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:51.898860 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8bc774-3828-43be-b970-e6da4dc4807b tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:51.901011 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2855/5730] 10.222.0.23 () {58 vars in 1202 bytes} [Sat Apr 30 21:30:51 2022] GET /identity/v3/regions/tempest-region-648218713 => generated 178 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:30:51.910302 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f8293-093d-45ac-b942-a9bc284fa801 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:51.927126 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f8293-093d-45ac-b942-a9bc284fa801 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:51.936754 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e705746-381a-4c20-a2dc-10670abf4e6e tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '022a8bd29d8e49b19cdc71a9fe2ca497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cbe90c90e98484ba9032794e156ab2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:51.940913 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e705746-381a-4c20-a2dc-10670abf4e6e tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:51.947799 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e705746-381a-4c20-a2dc-10670abf4e6e tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:51.947799 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e705746-381a-4c20-a2dc-10670abf4e6e tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:51.947799 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e705746-381a-4c20-a2dc-10670abf4e6e tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:51.958852 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e705746-381a-4c20-a2dc-10670abf4e6e tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:52.058851 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2876/5731] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:30:51 2022] POST /identity/v3/services => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:30:52.060394 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bc774-3828-43be-b970-e6da4dc4807b tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:52.076144 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bc774-3828-43be-b970-e6da4dc4807b tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:52.114516 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258dd3cd-9f34-4653-b50f-dd071f0b7b5b tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '022a8bd29d8e49b19cdc71a9fe2ca497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cbe90c90e98484ba9032794e156ab2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:52.115356 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258dd3cd-9f34-4653-b50f-dd071f0b7b5b tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:52.115753 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258dd3cd-9f34-4653-b50f-dd071f0b7b5b tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:52.116140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258dd3cd-9f34-4653-b50f-dd071f0b7b5b tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:52.116989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258dd3cd-9f34-4653-b50f-dd071f0b7b5b tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:52.119482 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-258dd3cd-9f34-4653-b50f-dd071f0b7b5b tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:30:52.119482 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:30:52.119482 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:30:52.120417 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258dd3cd-9f34-4653-b50f-dd071f0b7b5b tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:52.219673 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-258dd3cd-9f34-4653-b50f-dd071f0b7b5b tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-62178904. To ensure interoperability, identifiers should be a valid uuid. Apr 30 21:30:52.219673 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Apr 30 21:30:52.219673 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:30:52.324381 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2856/5732] 10.222.0.23 () {60 vars in 1155 bytes} [Sat Apr 30 21:30:52 2022] POST /identity/v3/endpoints => generated 359 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:30:52.328134 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e705746-381a-4c20-a2dc-10670abf4e6e tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:52.339395 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e705746-381a-4c20-a2dc-10670abf4e6e tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:52.359457 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a4fb3-4357-47c6-8374-40a780bcf020 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '022a8bd29d8e49b19cdc71a9fe2ca497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cbe90c90e98484ba9032794e156ab2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:52.360486 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a4fb3-4357-47c6-8374-40a780bcf020 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:52.360873 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a4fb3-4357-47c6-8374-40a780bcf020 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:52.361257 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a4fb3-4357-47c6-8374-40a780bcf020 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] PATH_INFO: `/v3/regions/tempest-region-62178904` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:52.362334 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a4fb3-4357-47c6-8374-40a780bcf020 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-62178904)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:52.363566 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a4fb3-4357-47c6-8374-40a780bcf020 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:52.365586 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2877/5733] 10.222.0.23 () {58 vars in 1199 bytes} [Sat Apr 30 21:30:52 2022] GET /identity/v3/regions/tempest-region-62178904 => generated 176 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:30:52.376802 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258dd3cd-9f34-4653-b50f-dd071f0b7b5b tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:52.390758 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258dd3cd-9f34-4653-b50f-dd071f0b7b5b tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:52.397292 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e6e27-5752-4f3b-b1f5-e9de88e8d92e tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '022a8bd29d8e49b19cdc71a9fe2ca497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cbe90c90e98484ba9032794e156ab2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:52.398098 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e6e27-5752-4f3b-b1f5-e9de88e8d92e tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:52.398379 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e6e27-5752-4f3b-b1f5-e9de88e8d92e tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:52.398668 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e6e27-5752-4f3b-b1f5-e9de88e8d92e tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:52.399449 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e6e27-5752-4f3b-b1f5-e9de88e8d92e tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:52.402903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e6e27-5752-4f3b-b1f5-e9de88e8d92e tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:52.499555 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-cd0e6e27-5752-4f3b-b1f5-e9de88e8d92e tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-18490077. To ensure interoperability, identifiers should be a valid uuid. Apr 30 21:30:52.499555 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Apr 30 21:30:52.499555 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:30:52.616291 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2857/5734] 10.222.0.23 () {60 vars in 1155 bytes} [Sat Apr 30 21:30:52 2022] POST /identity/v3/endpoints => generated 356 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:30:52.621913 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a4fb3-4357-47c6-8374-40a780bcf020 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:52.636770 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a4fb3-4357-47c6-8374-40a780bcf020 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:52.678891 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3c137-ee8e-45ec-a2e7-40901d52394a tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '022a8bd29d8e49b19cdc71a9fe2ca497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cbe90c90e98484ba9032794e156ab2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:52.680844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3c137-ee8e-45ec-a2e7-40901d52394a tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:52.681277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3c137-ee8e-45ec-a2e7-40901d52394a tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:52.681701 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3c137-ee8e-45ec-a2e7-40901d52394a tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] PATH_INFO: `/v3/regions/tempest-region-18490077` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:52.682550 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3c137-ee8e-45ec-a2e7-40901d52394a tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-18490077)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:52.684626 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3c137-ee8e-45ec-a2e7-40901d52394a tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:52.694497 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2878/5735] 10.222.0.23 () {58 vars in 1199 bytes} [Sat Apr 30 21:30:52 2022] GET /identity/v3/regions/tempest-region-18490077 => generated 176 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:30:52.695711 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e6e27-5752-4f3b-b1f5-e9de88e8d92e tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:52.715301 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e6e27-5752-4f3b-b1f5-e9de88e8d92e tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:52.726438 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a678da8-1caf-4910-bb69-a0dcc88b5e29 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '022a8bd29d8e49b19cdc71a9fe2ca497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cbe90c90e98484ba9032794e156ab2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:52.727534 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a678da8-1caf-4910-bb69-a0dcc88b5e29 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:52.727534 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a678da8-1caf-4910-bb69-a0dcc88b5e29 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:52.727979 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a678da8-1caf-4910-bb69-a0dcc88b5e29 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:52.728767 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a678da8-1caf-4910-bb69-a0dcc88b5e29 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:52.729914 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-0a678da8-1caf-4910-bb69-a0dcc88b5e29 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:30:52.729914 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:30:52.729914 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:30:52.733483 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a678da8-1caf-4910-bb69-a0dcc88b5e29 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:52.763099 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3c137-ee8e-45ec-a2e7-40901d52394a tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:52.777847 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3c137-ee8e-45ec-a2e7-40901d52394a tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:52.783038 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2858/5736] 10.222.0.23 () {58 vars in 1133 bytes} [Sat Apr 30 21:30:52 2022] GET /identity/v3/endpoints => generated 4378 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:30:52.791694 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd78070-2e94-451b-93a6-5175325523de tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '022a8bd29d8e49b19cdc71a9fe2ca497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cbe90c90e98484ba9032794e156ab2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:52.792578 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd78070-2e94-451b-93a6-5175325523de tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:52.792841 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd78070-2e94-451b-93a6-5175325523de tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:52.793112 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd78070-2e94-451b-93a6-5175325523de tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] PATH_INFO: `/v3/endpoints/b07e29a794c142348a880b257d2dacee` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:52.810457 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd78070-2e94-451b-93a6-5175325523de tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=b07e29a794c142348a880b257d2dacee)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:52.817498 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-8cd78070-2e94-451b-93a6-5175325523de tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:30:52.817498 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:30:52.817498 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:30:52.818625 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd78070-2e94-451b-93a6-5175325523de tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:52.824927 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a678da8-1caf-4910-bb69-a0dcc88b5e29 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:52.841522 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a678da8-1caf-4910-bb69-a0dcc88b5e29 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:52.842517 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2879/5737] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:30:52 2022] GET /identity/v3/endpoints/b07e29a794c142348a880b257d2dacee => generated 356 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:30:52.847363 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4c279-9dab-4cee-96da-bf1c9d07150c tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '022a8bd29d8e49b19cdc71a9fe2ca497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cbe90c90e98484ba9032794e156ab2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:52.848378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4c279-9dab-4cee-96da-bf1c9d07150c tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:52.848856 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4c279-9dab-4cee-96da-bf1c9d07150c tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:52.849836 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4c279-9dab-4cee-96da-bf1c9d07150c tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] PATH_INFO: `/v3/endpoints/b07e29a794c142348a880b257d2dacee` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:52.852076 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c4c279-9dab-4cee-96da-bf1c9d07150c tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=b07e29a794c142348a880b257d2dacee)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:52.854232 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-22c4c279-9dab-4cee-96da-bf1c9d07150c tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:30:52.854232 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:30:52.854232 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:30:52.855485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c4c279-9dab-4cee-96da-bf1c9d07150c tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:52.968626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-22c4c279-9dab-4cee-96da-bf1c9d07150c tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'b07e29a794c142348a880b257d2dacee', 'request_id': 'req-22c4c279-9dab-4cee-96da-bf1c9d07150c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:52.991428 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2859/5738] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:52 2022] DELETE /identity/v3/endpoints/b07e29a794c142348a880b257d2dacee => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:52.993733 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd78070-2e94-451b-93a6-5175325523de tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:53.004773 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd78070-2e94-451b-93a6-5175325523de tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:53.023157 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70269fea-ece9-482d-96c3-76ed25fb2865 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '022a8bd29d8e49b19cdc71a9fe2ca497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cbe90c90e98484ba9032794e156ab2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:53.024276 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70269fea-ece9-482d-96c3-76ed25fb2865 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:53.024926 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70269fea-ece9-482d-96c3-76ed25fb2865 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:53.025413 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70269fea-ece9-482d-96c3-76ed25fb2865 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:53.026646 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70269fea-ece9-482d-96c3-76ed25fb2865 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:53.027879 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-70269fea-ece9-482d-96c3-76ed25fb2865 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:30:53.027879 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:30:53.027879 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:30:53.031491 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70269fea-ece9-482d-96c3-76ed25fb2865 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:53.042155 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2880/5739] 10.222.0.23 () {58 vars in 1133 bytes} [Sat Apr 30 21:30:52 2022] GET /identity/v3/endpoints => generated 4035 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:30:53.046197 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4c279-9dab-4cee-96da-bf1c9d07150c tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:53.059724 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4c279-9dab-4cee-96da-bf1c9d07150c tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:53.066161 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2636f4-cd7b-4dce-a8fb-4861d9fcf580 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '022a8bd29d8e49b19cdc71a9fe2ca497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cbe90c90e98484ba9032794e156ab2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:53.067559 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2636f4-cd7b-4dce-a8fb-4861d9fcf580 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:53.068039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2636f4-cd7b-4dce-a8fb-4861d9fcf580 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:53.068498 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2636f4-cd7b-4dce-a8fb-4861d9fcf580 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] PATH_INFO: `/v3/endpoints/b07e29a794c142348a880b257d2dacee` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:53.091547 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2636f4-cd7b-4dce-a8fb-4861d9fcf580 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 21:30:53.121445 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-9d2636f4-cd7b-4dce-a8fb-4861d9fcf580 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Could not find endpoint: b07e29a794c142348a880b257d2dacee.: keystone.exception.EndpointNotFound: Could not find endpoint: b07e29a794c142348a880b257d2dacee. Apr 30 21:30:53.121445 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:30:53.121445 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Apr 30 21:30:53.121445 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Apr 30 21:30:53.121445 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Apr 30 21:30:53.121445 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._iter().one() Apr 30 21:30:53.121445 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1408, in one Apr 30 21:30:53.121445 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._only_one_row( Apr 30 21:30:53.121445 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Apr 30 21:30:53.121445 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exc.NoResultFound( Apr 30 21:30:53.121445 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Apr 30 21:30:53.121445 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:30:53.121445 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 21:30:53.121445 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:30:53.121445 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:30:53.121445 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Apr 30 21:30:53.122527 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Apr 30 21:30:53.122527 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Apr 30 21:30:53.122527 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Apr 30 21:30:53.122527 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Apr 30 21:30:53.122527 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Apr 30 21:30:53.122527 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: b07e29a794c142348a880b257d2dacee. Apr 30 21:30:53.122527 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:30:53.122527 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 21:30:53.122527 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:30:53.122527 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:30:53.122527 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:30:53.122527 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:30:53.122527 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:30:53.122527 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:30:53.122527 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:30:53.122527 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:30:53.122527 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:30:53.123794 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:30:53.123794 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:30:53.123794 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:30:53.123794 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Apr 30 21:30:53.123794 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Apr 30 21:30:53.123794 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 21:30:53.123794 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 21:30:53.123794 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 21:30:53.123794 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 21:30:53.123794 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:30:53.123794 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:30:53.123794 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 21:30:53.123794 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 21:30:53.123794 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 21:30:53.123794 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 21:30:53.123794 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 21:30:53.124756 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 21:30:53.124756 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 21:30:53.124756 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 21:30:53.124756 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 21:30:53.124756 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 21:30:53.124756 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 21:30:53.124756 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 21:30:53.124756 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 21:30:53.124756 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 21:30:53.124756 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Apr 30 21:30:53.124756 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Apr 30 21:30:53.124756 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: b07e29a794c142348a880b257d2dacee. Apr 30 21:30:53.124756 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:30:53.126242 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2860/5740] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:53 2022] DELETE /identity/v3/endpoints/b07e29a794c142348a880b257d2dacee => generated 114 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 30 21:30:53.134727 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70269fea-ece9-482d-96c3-76ed25fb2865 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:53.157710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70269fea-ece9-482d-96c3-76ed25fb2865 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:53.171039 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1639b385-55a8-4c88-a1bf-48d5db2e95bf tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '022a8bd29d8e49b19cdc71a9fe2ca497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cbe90c90e98484ba9032794e156ab2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:53.172139 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639b385-55a8-4c88-a1bf-48d5db2e95bf tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:53.172590 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639b385-55a8-4c88-a1bf-48d5db2e95bf tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:53.173057 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639b385-55a8-4c88-a1bf-48d5db2e95bf tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] PATH_INFO: `/v3/regions/tempest-region-18490077` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:53.173911 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1639b385-55a8-4c88-a1bf-48d5db2e95bf tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-18490077)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:53.176566 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-1639b385-55a8-4c88-a1bf-48d5db2e95bf tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:30:53.176566 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:30:53.176566 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:30:53.178152 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1639b385-55a8-4c88-a1bf-48d5db2e95bf tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:53.359106 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-1639b385-55a8-4c88-a1bf-48d5db2e95bf tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-18490077. To ensure interoperability, identifiers should be a valid uuid. Apr 30 21:30:53.359106 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Apr 30 21:30:53.359106 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:30:53.369380 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2881/5741] 10.222.0.23 () {58 vars in 1202 bytes} [Sat Apr 30 21:30:53 2022] DELETE /identity/v3/regions/tempest-region-18490077 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:53.375404 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2636f4-cd7b-4dce-a8fb-4861d9fcf580 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:53.394173 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2636f4-cd7b-4dce-a8fb-4861d9fcf580 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:53.416147 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3642a4-f3d3-4980-82cc-02e1a05224d7 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '022a8bd29d8e49b19cdc71a9fe2ca497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cbe90c90e98484ba9032794e156ab2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:53.416968 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3642a4-f3d3-4980-82cc-02e1a05224d7 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:53.417418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3642a4-f3d3-4980-82cc-02e1a05224d7 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:53.417790 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3642a4-f3d3-4980-82cc-02e1a05224d7 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:53.419112 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3642a4-f3d3-4980-82cc-02e1a05224d7 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:53.421409 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3642a4-f3d3-4980-82cc-02e1a05224d7 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:53.433798 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2861/5742] 10.222.0.23 () {58 vars in 1133 bytes} [Sat Apr 30 21:30:53 2022] GET /identity/v3/endpoints => generated 4035 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:30:53.436516 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1639b385-55a8-4c88-a1bf-48d5db2e95bf tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:53.450905 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1639b385-55a8-4c88-a1bf-48d5db2e95bf tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:53.457862 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6c7fd-6931-4a6e-a48c-915987c283f3 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '022a8bd29d8e49b19cdc71a9fe2ca497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cbe90c90e98484ba9032794e156ab2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:53.459061 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6c7fd-6931-4a6e-a48c-915987c283f3 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:53.459563 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6c7fd-6931-4a6e-a48c-915987c283f3 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:53.460298 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6c7fd-6931-4a6e-a48c-915987c283f3 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:53.461267 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f6c7fd-6931-4a6e-a48c-915987c283f3 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Adding query filter params (service_id=ce74de3cf80040d59fc212a63bd5aee1) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:30:53.461806 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f6c7fd-6931-4a6e-a48c-915987c283f3 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:53.463916 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f6c7fd-6931-4a6e-a48c-915987c283f3 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:53.473810 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2882/5743] 10.222.0.23 () {58 vars in 1220 bytes} [Sat Apr 30 21:30:53 2022] GET /identity/v3/endpoints?service_id=ce74de3cf80040d59fc212a63bd5aee1 => generated 501 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:30:53.477535 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3642a4-f3d3-4980-82cc-02e1a05224d7 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:53.502186 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3642a4-f3d3-4980-82cc-02e1a05224d7 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:53.515893 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02788705-d10f-409d-a0ea-5f7994f7e832 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '022a8bd29d8e49b19cdc71a9fe2ca497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cbe90c90e98484ba9032794e156ab2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:53.516592 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02788705-d10f-409d-a0ea-5f7994f7e832 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:53.516941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02788705-d10f-409d-a0ea-5f7994f7e832 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:53.517233 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02788705-d10f-409d-a0ea-5f7994f7e832 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:53.518011 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02788705-d10f-409d-a0ea-5f7994f7e832 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Adding query filter params (service_id=d821cc88edeb4b17bd0aeaec739d6c87) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:30:53.518529 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02788705-d10f-409d-a0ea-5f7994f7e832 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:53.520634 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02788705-d10f-409d-a0ea-5f7994f7e832 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:53.538870 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2862/5744] 10.222.0.23 () {58 vars in 1220 bytes} [Sat Apr 30 21:30:53 2022] GET /identity/v3/endpoints?service_id=d821cc88edeb4b17bd0aeaec739d6c87 => generated 501 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:30:53.544520 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6c7fd-6931-4a6e-a48c-915987c283f3 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:53.572076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6c7fd-6931-4a6e-a48c-915987c283f3 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:53.594954 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f9086-30f4-41ab-9bae-937abea8583b tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '022a8bd29d8e49b19cdc71a9fe2ca497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cbe90c90e98484ba9032794e156ab2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:53.598272 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f9086-30f4-41ab-9bae-937abea8583b tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:53.599355 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f9086-30f4-41ab-9bae-937abea8583b tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:53.599713 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f9086-30f4-41ab-9bae-937abea8583b tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:53.603297 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351f9086-30f4-41ab-9bae-937abea8583b tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:30:53.604329 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351f9086-30f4-41ab-9bae-937abea8583b tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:53.609417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351f9086-30f4-41ab-9bae-937abea8583b tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:53.629855 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02788705-d10f-409d-a0ea-5f7994f7e832 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:53.640935 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2883/5745] 10.222.0.23 () {58 vars in 1166 bytes} [Sat Apr 30 21:30:53 2022] GET /identity/v3/endpoints?interface=public => generated 3394 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:30:53.643087 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02788705-d10f-409d-a0ea-5f7994f7e832 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:53.650525 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42d919-0f29-42a9-b5f5-d76776c119d6 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '022a8bd29d8e49b19cdc71a9fe2ca497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cbe90c90e98484ba9032794e156ab2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:53.652829 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42d919-0f29-42a9-b5f5-d76776c119d6 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:53.653383 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42d919-0f29-42a9-b5f5-d76776c119d6 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:53.653843 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42d919-0f29-42a9-b5f5-d76776c119d6 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:53.655167 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe42d919-0f29-42a9-b5f5-d76776c119d6 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:30:53.655638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe42d919-0f29-42a9-b5f5-d76776c119d6 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:53.657602 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe42d919-0f29-42a9-b5f5-d76776c119d6 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:53.694428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f9086-30f4-41ab-9bae-937abea8583b tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:53.704258 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2863/5746] 10.222.0.23 () {58 vars in 1170 bytes} [Sat Apr 30 21:30:53 2022] GET /identity/v3/endpoints?interface=internal => generated 476 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:30:53.708686 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f9086-30f4-41ab-9bae-937abea8583b tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:53.715127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f264b2d-cefe-4f7c-a5be-2f6c173293db tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '022a8bd29d8e49b19cdc71a9fe2ca497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cbe90c90e98484ba9032794e156ab2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:53.717928 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f264b2d-cefe-4f7c-a5be-2f6c173293db tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:53.718473 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f264b2d-cefe-4f7c-a5be-2f6c173293db tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:53.718942 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f264b2d-cefe-4f7c-a5be-2f6c173293db tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:53.720004 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f264b2d-cefe-4f7c-a5be-2f6c173293db tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:53.722035 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f264b2d-cefe-4f7c-a5be-2f6c173293db tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:53.906241 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42d919-0f29-42a9-b5f5-d76776c119d6 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:53.911576 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2884/5747] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:30:53 2022] POST /identity/v3/services => generated 287 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:30:53.918341 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f264b2d-cefe-4f7c-a5be-2f6c173293db tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:53.956260 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f264b2d-cefe-4f7c-a5be-2f6c173293db tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:53.965157 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50cc23b-2497-420f-bd97-aad0ee937728 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '022a8bd29d8e49b19cdc71a9fe2ca497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cbe90c90e98484ba9032794e156ab2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:53.965867 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50cc23b-2497-420f-bd97-aad0ee937728 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:53.966164 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50cc23b-2497-420f-bd97-aad0ee937728 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:53.966448 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50cc23b-2497-420f-bd97-aad0ee937728 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:53.967201 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50cc23b-2497-420f-bd97-aad0ee937728 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:53.969674 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50cc23b-2497-420f-bd97-aad0ee937728 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:54.011213 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42d919-0f29-42a9-b5f5-d76776c119d6 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:54.027158 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424594dc-8fe2-4d43-86f2-fa7b89fb2d73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:54.027894 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424594dc-8fe2-4d43-86f2-fa7b89fb2d73 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:54.028180 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424594dc-8fe2-4d43-86f2-fa7b89fb2d73 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:54.028460 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424594dc-8fe2-4d43-86f2-fa7b89fb2d73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:54.030283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-424594dc-8fe2-4d43-86f2-fa7b89fb2d73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:54.042700 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424594dc-8fe2-4d43-86f2-fa7b89fb2d73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:54.044171 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424594dc-8fe2-4d43-86f2-fa7b89fb2d73 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:54.055582 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2864/5748] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:30:53 2022] GET /identity/v3/auth/tokens => generated 3871 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:30:54.114376 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-a50cc23b-2497-420f-bd97-aad0ee937728 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-824626493. To ensure interoperability, identifiers should be a valid uuid. Apr 30 21:30:54.114376 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Apr 30 21:30:54.114376 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:30:54.218722 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2885/5749] 10.222.0.23 () {60 vars in 1155 bytes} [Sat Apr 30 21:30:53 2022] POST /identity/v3/endpoints => generated 358 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:30:54.223420 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424594dc-8fe2-4d43-86f2-fa7b89fb2d73 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:54.246661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424594dc-8fe2-4d43-86f2-fa7b89fb2d73 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:54.291803 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6669682-a78d-4170-accf-3b8562aeebcb tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '022a8bd29d8e49b19cdc71a9fe2ca497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cbe90c90e98484ba9032794e156ab2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:54.292672 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6669682-a78d-4170-accf-3b8562aeebcb tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:54.293369 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6669682-a78d-4170-accf-3b8562aeebcb tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:54.293661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6669682-a78d-4170-accf-3b8562aeebcb tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] PATH_INFO: `/v3/regions/tempest-region-824626493` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:54.294428 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6669682-a78d-4170-accf-3b8562aeebcb tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-824626493)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:54.298132 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6669682-a78d-4170-accf-3b8562aeebcb tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:54.306730 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2865/5750] 10.222.0.23 () {58 vars in 1202 bytes} [Sat Apr 30 21:30:54 2022] GET /identity/v3/regions/tempest-region-824626493 => generated 178 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:30:54.309584 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50cc23b-2497-420f-bd97-aad0ee937728 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:54.333695 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50cc23b-2497-420f-bd97-aad0ee937728 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:54.353068 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c584584-c55b-452b-8b62-b400ed9a72d6 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '022a8bd29d8e49b19cdc71a9fe2ca497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cbe90c90e98484ba9032794e156ab2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:54.353068 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c584584-c55b-452b-8b62-b400ed9a72d6 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:54.353068 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c584584-c55b-452b-8b62-b400ed9a72d6 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:54.354031 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c584584-c55b-452b-8b62-b400ed9a72d6 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] PATH_INFO: `/v3/endpoints/97ff11e664c94863bd65fb13654946da` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:54.372107 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c584584-c55b-452b-8b62-b400ed9a72d6 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=97ff11e664c94863bd65fb13654946da)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:54.373192 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-2c584584-c55b-452b-8b62-b400ed9a72d6 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:30:54.373192 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:30:54.373192 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:30:54.374579 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c584584-c55b-452b-8b62-b400ed9a72d6 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:54.463677 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-2c584584-c55b-452b-8b62-b400ed9a72d6 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-145137548. To ensure interoperability, identifiers should be a valid uuid. Apr 30 21:30:54.463677 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Apr 30 21:30:54.463677 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:30:54.625525 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2886/5751] 10.222.0.23 () {60 vars in 1255 bytes} [Sat Apr 30 21:30:54 2022] PATCH /identity/v3/endpoints/97ff11e664c94863bd65fb13654946da => generated 361 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:30:54.626874 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6669682-a78d-4170-accf-3b8562aeebcb tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:54.656676 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6669682-a78d-4170-accf-3b8562aeebcb tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:54.686907 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7b74a-978f-4767-970c-84af79b58384 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '022a8bd29d8e49b19cdc71a9fe2ca497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cbe90c90e98484ba9032794e156ab2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:54.688002 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7b74a-978f-4767-970c-84af79b58384 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:54.688283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7b74a-978f-4767-970c-84af79b58384 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:54.688700 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7b74a-978f-4767-970c-84af79b58384 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] PATH_INFO: `/v3/regions/tempest-region-145137548` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:54.692141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc7b74a-978f-4767-970c-84af79b58384 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-145137548)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:54.693262 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc7b74a-978f-4767-970c-84af79b58384 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:54.705035 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2866/5752] 10.222.0.23 () {58 vars in 1202 bytes} [Sat Apr 30 21:30:54 2022] GET /identity/v3/regions/tempest-region-145137548 => generated 178 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:30:54.709161 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c584584-c55b-452b-8b62-b400ed9a72d6 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:54.724205 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c584584-c55b-452b-8b62-b400ed9a72d6 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:54.730561 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ed374-6f82-4d42-a841-e77a2f53185b tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '022a8bd29d8e49b19cdc71a9fe2ca497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cbe90c90e98484ba9032794e156ab2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:54.731431 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ed374-6f82-4d42-a841-e77a2f53185b tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:54.731876 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ed374-6f82-4d42-a841-e77a2f53185b tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:54.732717 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ed374-6f82-4d42-a841-e77a2f53185b tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] PATH_INFO: `/v3/endpoints/97ff11e664c94863bd65fb13654946da` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:54.739262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ed374-6f82-4d42-a841-e77a2f53185b tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=97ff11e664c94863bd65fb13654946da)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:54.740550 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-288ed374-6f82-4d42-a841-e77a2f53185b tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:30:54.740550 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:30:54.740550 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:30:54.741821 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ed374-6f82-4d42-a841-e77a2f53185b tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:54.817367 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d60ed-23ee-4afc-a201-6b8f3cbebc0d None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:54.817652 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d60ed-23ee-4afc-a201-6b8f3cbebc0d None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:54.818027 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d60ed-23ee-4afc-a201-6b8f3cbebc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:54.833111 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-288ed374-6f82-4d42-a841-e77a2f53185b tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '97ff11e664c94863bd65fb13654946da', 'request_id': 'req-288ed374-6f82-4d42-a841-e77a2f53185b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:54.844288 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2887/5753] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:54 2022] DELETE /identity/v3/endpoints/97ff11e664c94863bd65fb13654946da => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:30:54.847100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-ef8d60ed-23ee-4afc-a201-6b8f3cbebc0d None None] MFA Rules not processed for user `1e5bf319f22145459e3c71d158430d63`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:54.848693 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ef8d60ed-23ee-4afc-a201-6b8f3cbebc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:54.858864 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ed374-6f82-4d42-a841-e77a2f53185b tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:54.901838 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ed374-6f82-4d42-a841-e77a2f53185b tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:54.916080 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb68c0-559b-490d-9c35-6071a5e438cc tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '022a8bd29d8e49b19cdc71a9fe2ca497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cbe90c90e98484ba9032794e156ab2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:54.917167 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb68c0-559b-490d-9c35-6071a5e438cc tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:54.917450 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb68c0-559b-490d-9c35-6071a5e438cc tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:54.917732 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb68c0-559b-490d-9c35-6071a5e438cc tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] PATH_INFO: `/v3/regions/tempest-region-145137548` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:54.918455 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb68c0-559b-490d-9c35-6071a5e438cc tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-145137548)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:54.923518 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb68c0-559b-490d-9c35-6071a5e438cc tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:54.941901 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2867/5754] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:54 2022] POST /identity/v3/auth/tokens => generated 3998 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:54.958654 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d60ed-23ee-4afc-a201-6b8f3cbebc0d None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:54.960763 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ef8d60ed-23ee-4afc-a201-6b8f3cbebc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:55.041049 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2888/5755] 10.222.0.23 () {58 vars in 1205 bytes} [Sat Apr 30 21:30:54 2022] DELETE /identity/v3/regions/tempest-region-145137548 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:55.047335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb68c0-559b-490d-9c35-6071a5e438cc tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:55.087605 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb68c0-559b-490d-9c35-6071a5e438cc tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:55.090197 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d60ed-23ee-4afc-a201-6b8f3cbebc0d None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:55.092955 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b685e5-b125-4dcc-8eec-0c47d3a4ff16 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '022a8bd29d8e49b19cdc71a9fe2ca497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cbe90c90e98484ba9032794e156ab2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:55.096135 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b685e5-b125-4dcc-8eec-0c47d3a4ff16 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:55.096135 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b685e5-b125-4dcc-8eec-0c47d3a4ff16 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:55.096135 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b685e5-b125-4dcc-8eec-0c47d3a4ff16 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] PATH_INFO: `/v3/regions/tempest-region-824626493` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:55.096135 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b685e5-b125-4dcc-8eec-0c47d3a4ff16 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-824626493)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:55.096721 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b685e5-b125-4dcc-8eec-0c47d3a4ff16 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:55.117141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4546e-3960-49cf-ab5a-253c3946d90b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:55.117997 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4546e-3960-49cf-ab5a-253c3946d90b service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:55.118154 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4546e-3960-49cf-ab5a-253c3946d90b service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:55.119007 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4546e-3960-49cf-ab5a-253c3946d90b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:55.129616 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af4546e-3960-49cf-ab5a-253c3946d90b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:55.131286 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af4546e-3960-49cf-ab5a-253c3946d90b service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:55.189500 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2868/5756] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:30:54 2022] GET /identity/v3/auth/tokens => generated 3998 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:30:55.243556 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2889/5757] 10.222.0.23 () {58 vars in 1205 bytes} [Sat Apr 30 21:30:55 2022] DELETE /identity/v3/regions/tempest-region-824626493 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:55.247670 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4546e-3960-49cf-ab5a-253c3946d90b service cinder] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:55.274677 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4546e-3960-49cf-ab5a-253c3946d90b service cinder] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:55.313075 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5339f9-de82-449e-aa4b-433bf929a399 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '022a8bd29d8e49b19cdc71a9fe2ca497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cbe90c90e98484ba9032794e156ab2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:55.314553 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5339f9-de82-449e-aa4b-433bf929a399 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:55.316176 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5339f9-de82-449e-aa4b-433bf929a399 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:55.316730 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5339f9-de82-449e-aa4b-433bf929a399 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] PATH_INFO: `/v3/services/22310b4cca1d46c9905239e9ae564d75` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:55.317525 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5339f9-de82-449e-aa4b-433bf929a399 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorizing `identity:delete_service(service_id=22310b4cca1d46c9905239e9ae564d75)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:55.324616 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5339f9-de82-449e-aa4b-433bf929a399 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:55.444114 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2869/5758] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:30:55 2022] DELETE /identity/v3/services/22310b4cca1d46c9905239e9ae564d75 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:55.449417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b685e5-b125-4dcc-8eec-0c47d3a4ff16 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:55.468905 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b685e5-b125-4dcc-8eec-0c47d3a4ff16 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:55.494660 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb217ded-a931-4f65-9213-9cfdfc44990d tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '022a8bd29d8e49b19cdc71a9fe2ca497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cbe90c90e98484ba9032794e156ab2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:55.495962 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb217ded-a931-4f65-9213-9cfdfc44990d tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:55.496430 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb217ded-a931-4f65-9213-9cfdfc44990d tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:55.496896 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb217ded-a931-4f65-9213-9cfdfc44990d tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] PATH_INFO: `/v3/endpoints/a8cdba6498d04ff2ab02c5326f3419b7` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:55.506429 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb217ded-a931-4f65-9213-9cfdfc44990d tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=a8cdba6498d04ff2ab02c5326f3419b7)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:55.509185 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb217ded-a931-4f65-9213-9cfdfc44990d tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:55.585309 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cb217ded-a931-4f65-9213-9cfdfc44990d tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'a8cdba6498d04ff2ab02c5326f3419b7', 'request_id': 'req-cb217ded-a931-4f65-9213-9cfdfc44990d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:55.601548 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2890/5759] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:55 2022] DELETE /identity/v3/endpoints/a8cdba6498d04ff2ab02c5326f3419b7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:55.602632 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5339f9-de82-449e-aa4b-433bf929a399 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:55.615389 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5339f9-de82-449e-aa4b-433bf929a399 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:55.633334 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b32c95-ee9b-4d67-8324-7b1a853728bc tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '022a8bd29d8e49b19cdc71a9fe2ca497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cbe90c90e98484ba9032794e156ab2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:55.634813 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b32c95-ee9b-4d67-8324-7b1a853728bc tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:55.635301 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b32c95-ee9b-4d67-8324-7b1a853728bc tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:55.636317 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b32c95-ee9b-4d67-8324-7b1a853728bc tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] PATH_INFO: `/v3/regions/tempest-region-62178904` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:55.637253 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b32c95-ee9b-4d67-8324-7b1a853728bc tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-62178904)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:55.639378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b32c95-ee9b-4d67-8324-7b1a853728bc tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:55.761741 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2870/5760] 10.222.0.23 () {58 vars in 1202 bytes} [Sat Apr 30 21:30:55 2022] DELETE /identity/v3/regions/tempest-region-62178904 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:55.774261 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb217ded-a931-4f65-9213-9cfdfc44990d tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:55.790782 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb217ded-a931-4f65-9213-9cfdfc44990d tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:55.810140 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff582ef3-1343-4bf4-9e80-a406aeb7c855 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '022a8bd29d8e49b19cdc71a9fe2ca497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cbe90c90e98484ba9032794e156ab2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:55.811194 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff582ef3-1343-4bf4-9e80-a406aeb7c855 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:55.811583 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff582ef3-1343-4bf4-9e80-a406aeb7c855 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:55.812116 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff582ef3-1343-4bf4-9e80-a406aeb7c855 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] PATH_INFO: `/v3/services/d821cc88edeb4b17bd0aeaec739d6c87` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:55.813163 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff582ef3-1343-4bf4-9e80-a406aeb7c855 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorizing `identity:delete_service(service_id=d821cc88edeb4b17bd0aeaec739d6c87)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:55.815555 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff582ef3-1343-4bf4-9e80-a406aeb7c855 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:55.955295 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2891/5761] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:30:55 2022] DELETE /identity/v3/services/d821cc88edeb4b17bd0aeaec739d6c87 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:30:55.959482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b32c95-ee9b-4d67-8324-7b1a853728bc tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:55.971731 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b32c95-ee9b-4d67-8324-7b1a853728bc tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:55.990355 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7683d34-121e-476f-9b87-553f53a494ec tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '022a8bd29d8e49b19cdc71a9fe2ca497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cbe90c90e98484ba9032794e156ab2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:55.991210 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7683d34-121e-476f-9b87-553f53a494ec tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:55.991494 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7683d34-121e-476f-9b87-553f53a494ec tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:55.991768 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7683d34-121e-476f-9b87-553f53a494ec tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] PATH_INFO: `/v3/endpoints/93bc5a2485f5446b965d2b96de9ce1f1` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:56.014717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7683d34-121e-476f-9b87-553f53a494ec tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=93bc5a2485f5446b965d2b96de9ce1f1)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:56.016419 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7683d34-121e-476f-9b87-553f53a494ec tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:56.157417 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d7683d34-121e-476f-9b87-553f53a494ec tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '93bc5a2485f5446b965d2b96de9ce1f1', 'request_id': 'req-d7683d34-121e-476f-9b87-553f53a494ec'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:56.186140 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2871/5762] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:30:55 2022] DELETE /identity/v3/endpoints/93bc5a2485f5446b965d2b96de9ce1f1 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:56.189690 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff582ef3-1343-4bf4-9e80-a406aeb7c855 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:56.222234 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff582ef3-1343-4bf4-9e80-a406aeb7c855 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:56.247150 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac86c5-6a2c-491d-a4e7-65fbad6ab8ab tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '022a8bd29d8e49b19cdc71a9fe2ca497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cbe90c90e98484ba9032794e156ab2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:56.247994 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac86c5-6a2c-491d-a4e7-65fbad6ab8ab tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:56.248278 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac86c5-6a2c-491d-a4e7-65fbad6ab8ab tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:56.250998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac86c5-6a2c-491d-a4e7-65fbad6ab8ab tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] PATH_INFO: `/v3/regions/tempest-region-648218713` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:56.250998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac86c5-6a2c-491d-a4e7-65fbad6ab8ab tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-648218713)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:56.251283 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac86c5-6a2c-491d-a4e7-65fbad6ab8ab tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:56.371936 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2892/5763] 10.222.0.23 () {58 vars in 1205 bytes} [Sat Apr 30 21:30:56 2022] DELETE /identity/v3/regions/tempest-region-648218713 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:30:56.375885 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7683d34-121e-476f-9b87-553f53a494ec tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:56.386714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7683d34-121e-476f-9b87-553f53a494ec tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:56.403365 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a45e7b-3d50-4814-888b-7decaa1683f1 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '022a8bd29d8e49b19cdc71a9fe2ca497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cbe90c90e98484ba9032794e156ab2f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:56.404223 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a45e7b-3d50-4814-888b-7decaa1683f1 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:56.404503 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a45e7b-3d50-4814-888b-7decaa1683f1 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:56.404778 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a45e7b-3d50-4814-888b-7decaa1683f1 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] PATH_INFO: `/v3/services/ce74de3cf80040d59fc212a63bd5aee1` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:56.405433 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a45e7b-3d50-4814-888b-7decaa1683f1 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorizing `identity:delete_service(service_id=ce74de3cf80040d59fc212a63bd5aee1)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:56.407282 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a45e7b-3d50-4814-888b-7decaa1683f1 tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:56.519088 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2872/5764] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:30:56 2022] DELETE /identity/v3/services/ce74de3cf80040d59fc212a63bd5aee1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:56.523491 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac86c5-6a2c-491d-a4e7-65fbad6ab8ab tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:56.614462 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac86c5-6a2c-491d-a4e7-65fbad6ab8ab tempest-EndPointsTestJSON-888827212 tempest-EndPointsTestJSON-888827212-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:56.631793 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e53092-96b0-4040-ae31-fc5a0b8a0fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:56.632662 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e53092-96b0-4040-ae31-fc5a0b8a0fb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:56.632944 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e53092-96b0-4040-ae31-fc5a0b8a0fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:56.633219 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e53092-96b0-4040-ae31-fc5a0b8a0fb9 admin admin] PATH_INFO: `/v3/users/ae35dc17bc854b4d8925322571cf39f8` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:56.634622 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e53092-96b0-4040-ae31-fc5a0b8a0fb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae35dc17bc854b4d8925322571cf39f8)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:56.637354 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e53092-96b0-4040-ae31-fc5a0b8a0fb9 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:56.918737 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-27e53092-96b0-4040-ae31-fc5a0b8a0fb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae35dc17bc854b4d8925322571cf39f8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:56.943761 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-27e53092-96b0-4040-ae31-fc5a0b8a0fb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae35dc17bc854b4d8925322571cf39f8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:57.098010 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-27e53092-96b0-4040-ae31-fc5a0b8a0fb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae35dc17bc854b4d8925322571cf39f8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:57.103943 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-27e53092-96b0-4040-ae31-fc5a0b8a0fb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae35dc17bc854b4d8925322571cf39f8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:57.105234 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-27e53092-96b0-4040-ae31-fc5a0b8a0fb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae35dc17bc854b4d8925322571cf39f8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:57.114709 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2893/5765] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:30:56 2022] DELETE /identity/v3/users/ae35dc17bc854b4d8925322571cf39f8 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:57.119080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9541fa-d77d-400f-b1a6-eb29894c32b3 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:57.119588 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9541fa-d77d-400f-b1a6-eb29894c32b3 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:57.119663 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9541fa-d77d-400f-b1a6-eb29894c32b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:57.150799 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-cd9541fa-d77d-400f-b1a6-eb29894c32b3 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:57.152020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-cd9541fa-d77d-400f-b1a6-eb29894c32b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:57.224379 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2873/5766] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:57.236021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e53092-96b0-4040-ae31-fc5a0b8a0fb9 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:57.237867 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-27e53092-96b0-4040-ae31-fc5a0b8a0fb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:57.359524 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e53092-96b0-4040-ae31-fc5a0b8a0fb9 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:57.364626 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac626f6-39aa-4445-a418-072ca8020a7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:57.366627 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac626f6-39aa-4445-a418-072ca8020a7c service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:57.367147 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac626f6-39aa-4445-a418-072ca8020a7c service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:57.367708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac626f6-39aa-4445-a418-072ca8020a7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:57.383042 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac626f6-39aa-4445-a418-072ca8020a7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:57.384892 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac626f6-39aa-4445-a418-072ca8020a7c service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:57.399379 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2894/5767] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:30:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:30:57.615988 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228cf850-ae5b-4ecb-ae65-ed04920ae077 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:57.616567 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228cf850-ae5b-4ecb-ae65-ed04920ae077 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:57.617028 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228cf850-ae5b-4ecb-ae65-ed04920ae077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:57.676164 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-228cf850-ae5b-4ecb-ae65-ed04920ae077 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:57.678967 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-228cf850-ae5b-4ecb-ae65-ed04920ae077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:57.821929 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2874/5768] 10.222.0.23 () {58 vars in 967 bytes} [Sat Apr 30 21:30:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:30:58.018355 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac626f6-39aa-4445-a418-072ca8020a7c service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:58.019827 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-fac626f6-39aa-4445-a418-072ca8020a7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:58.118212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228cf850-ae5b-4ecb-ae65-ed04920ae077 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:58.121966 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-228cf850-ae5b-4ecb-ae65-ed04920ae077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:58.138770 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac626f6-39aa-4445-a418-072ca8020a7c service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:58.147380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228cf850-ae5b-4ecb-ae65-ed04920ae077 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:58.157719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3c3c7-1bb0-4128-b7a7-b6dc7713ff59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:58.159607 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3c3c7-1bb0-4128-b7a7-b6dc7713ff59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:58.160009 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3c3c7-1bb0-4128-b7a7-b6dc7713ff59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:58.160858 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3c3c7-1bb0-4128-b7a7-b6dc7713ff59 admin admin] PATH_INFO: `/v3/projects/3e2112ef23b240ddb473025b77d55a87` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:58.167603 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c3c3c7-1bb0-4128-b7a7-b6dc7713ff59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e2112ef23b240ddb473025b77d55a87)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:58.167603 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c3c3c7-1bb0-4128-b7a7-b6dc7713ff59 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:58.175899 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ebc10b-dd2d-4810-bf72-96808816e097 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:58.186229 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebc10b-dd2d-4810-bf72-96808816e097 service swift] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:58.186556 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebc10b-dd2d-4810-bf72-96808816e097 service swift] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:58.186844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebc10b-dd2d-4810-bf72-96808816e097 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:58.205820 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ebc10b-dd2d-4810-bf72-96808816e097 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:58.207459 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ebc10b-dd2d-4810-bf72-96808816e097 service swift] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:58.231347 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2895/5769] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:30:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:30:58.342912 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-14c3c3c7-1bb0-4128-b7a7-b6dc7713ff59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e2112ef23b240ddb473025b77d55a87', 'request_id': 'req-14c3c3c7-1bb0-4128-b7a7-b6dc7713ff59'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:58.352588 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-14c3c3c7-1bb0-4128-b7a7-b6dc7713ff59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e2112ef23b240ddb473025b77d55a87', 'request_id': 'req-14c3c3c7-1bb0-4128-b7a7-b6dc7713ff59'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:58.361991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-14c3c3c7-1bb0-4128-b7a7-b6dc7713ff59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e2112ef23b240ddb473025b77d55a87', 'request_id': 'req-14c3c3c7-1bb0-4128-b7a7-b6dc7713ff59'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:58.385075 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a4b3f-325c-4ccf-ac4b-b42061fb589e None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:58.385487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a4b3f-325c-4ccf-ac4b-b42061fb589e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:58.385946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a4b3f-325c-4ccf-ac4b-b42061fb589e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:58.407822 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-fe3a4b3f-325c-4ccf-ac4b-b42061fb589e None None] MFA Rules not processed for user `1e5bf319f22145459e3c71d158430d63`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:30:58.409806 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-fe3a4b3f-325c-4ccf-ac4b-b42061fb589e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:58.482016 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-14c3c3c7-1bb0-4128-b7a7-b6dc7713ff59 admin admin] The token cache is being invalidate because project 3e2112ef23b240ddb473025b77d55a87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:30:58.482570 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-14c3c3c7-1bb0-4128-b7a7-b6dc7713ff59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:58.484293 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-14c3c3c7-1bb0-4128-b7a7-b6dc7713ff59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:58.486513 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2875/5770] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:30:58 2022] DELETE /identity/v3/projects/3e2112ef23b240ddb473025b77d55a87 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:30:58.490084 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3c3c7-1bb0-4128-b7a7-b6dc7713ff59 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:58.493882 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-14c3c3c7-1bb0-4128-b7a7-b6dc7713ff59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:30:58.587130 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2896/5771] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:30:58.603801 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3c3c7-1bb0-4128-b7a7-b6dc7713ff59 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:58.609247 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b812e8-a83a-4ced-b7b0-9d0626434b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:58.613688 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b812e8-a83a-4ced-b7b0-9d0626434b5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:58.613688 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b812e8-a83a-4ced-b7b0-9d0626434b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:58.613688 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b812e8-a83a-4ced-b7b0-9d0626434b5a admin admin] PATH_INFO: `/v3/users/022a8bd29d8e49b19cdc71a9fe2ca497` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:58.614443 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b812e8-a83a-4ced-b7b0-9d0626434b5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=022a8bd29d8e49b19cdc71a9fe2ca497)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:58.616619 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b812e8-a83a-4ced-b7b0-9d0626434b5a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:58.821668 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-45b812e8-a83a-4ced-b7b0-9d0626434b5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '022a8bd29d8e49b19cdc71a9fe2ca497'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:58.837897 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-45b812e8-a83a-4ced-b7b0-9d0626434b5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '022a8bd29d8e49b19cdc71a9fe2ca497'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:58.905289 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-45b812e8-a83a-4ced-b7b0-9d0626434b5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '022a8bd29d8e49b19cdc71a9fe2ca497'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:58.906270 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-45b812e8-a83a-4ced-b7b0-9d0626434b5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '022a8bd29d8e49b19cdc71a9fe2ca497'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:58.922699 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-45b812e8-a83a-4ced-b7b0-9d0626434b5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '022a8bd29d8e49b19cdc71a9fe2ca497'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:58.932679 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2876/5772] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:30:58 2022] DELETE /identity/v3/users/022a8bd29d8e49b19cdc71a9fe2ca497 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:30:59.536159 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a4b3f-325c-4ccf-ac4b-b42061fb589e None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:30:59.559692 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a4b3f-325c-4ccf-ac4b-b42061fb589e None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:30:59.658352 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b015a-e0c6-4b9c-8a1e-e5ca6dc8bc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:30:59.659870 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b015a-e0c6-4b9c-8a1e-e5ca6dc8bc6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:59.660146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b015a-e0c6-4b9c-8a1e-e5ca6dc8bc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:59.660663 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b015a-e0c6-4b9c-8a1e-e5ca6dc8bc6a admin admin] PATH_INFO: `/v3/projects/5cbe90c90e98484ba9032794e156ab2f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:30:59.661925 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54b015a-e0c6-4b9c-8a1e-e5ca6dc8bc6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cbe90c90e98484ba9032794e156ab2f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:30:59.665046 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54b015a-e0c6-4b9c-8a1e-e5ca6dc8bc6a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:30:59.840032 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e54b015a-e0c6-4b9c-8a1e-e5ca6dc8bc6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cbe90c90e98484ba9032794e156ab2f', 'request_id': 'req-e54b015a-e0c6-4b9c-8a1e-e5ca6dc8bc6a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:59.854071 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e54b015a-e0c6-4b9c-8a1e-e5ca6dc8bc6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cbe90c90e98484ba9032794e156ab2f', 'request_id': 'req-e54b015a-e0c6-4b9c-8a1e-e5ca6dc8bc6a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:59.877505 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e54b015a-e0c6-4b9c-8a1e-e5ca6dc8bc6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cbe90c90e98484ba9032794e156ab2f', 'request_id': 'req-e54b015a-e0c6-4b9c-8a1e-e5ca6dc8bc6a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:59.970320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e54b015a-e0c6-4b9c-8a1e-e5ca6dc8bc6a admin admin] The token cache is being invalidate because project 5cbe90c90e98484ba9032794e156ab2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:30:59.970623 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e54b015a-e0c6-4b9c-8a1e-e5ca6dc8bc6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:59.971973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e54b015a-e0c6-4b9c-8a1e-e5ca6dc8bc6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:30:59.974425 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2897/5773] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:30:59 2022] DELETE /identity/v3/projects/5cbe90c90e98484ba9032794e156ab2f => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:30:59.979248 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cadbd0-18ee-4188-9578-db7346b8629a None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:30:59.980463 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cadbd0-18ee-4188-9578-db7346b8629a None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:30:59.981366 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cadbd0-18ee-4188-9578-db7346b8629a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:00.002342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-f1cadbd0-18ee-4188-9578-db7346b8629a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:00.003717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f1cadbd0-18ee-4188-9578-db7346b8629a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:00.101707 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2877/5774] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:30:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:00.103573 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da7171-2491-4ded-9b8a-b06194c5a54e None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:00.104287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da7171-2491-4ded-9b8a-b06194c5a54e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:00.109908 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da7171-2491-4ded-9b8a-b06194c5a54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:00.139490 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-e2da7171-2491-4ded-9b8a-b06194c5a54e None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:00.144444 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e2da7171-2491-4ded-9b8a-b06194c5a54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:00.161190 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2898/5775] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:00.163363 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cadbd0-18ee-4188-9578-db7346b8629a None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:00.174781 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cadbd0-18ee-4188-9578-db7346b8629a None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:00.179860 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777b578-a38d-4fc0-bfd2-ff5bc4c36708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:00.180680 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777b578-a38d-4fc0-bfd2-ff5bc4c36708 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:00.180976 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777b578-a38d-4fc0-bfd2-ff5bc4c36708 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:00.181269 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777b578-a38d-4fc0-bfd2-ff5bc4c36708 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:00.182169 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0777b578-a38d-4fc0-bfd2-ff5bc4c36708 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:31:00.183654 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0777b578-a38d-4fc0-bfd2-ff5bc4c36708 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:00.184105 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0777b578-a38d-4fc0-bfd2-ff5bc4c36708 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:00.204395 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2878/5776] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:31:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:31:00.205577 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da7171-2491-4ded-9b8a-b06194c5a54e None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:00.219101 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da7171-2491-4ded-9b8a-b06194c5a54e None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:00.224772 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123dcfa-aed4-4563-9e36-c057ed0e8aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:00.225704 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123dcfa-aed4-4563-9e36-c057ed0e8aba admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:00.225704 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123dcfa-aed4-4563-9e36-c057ed0e8aba admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:00.226017 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123dcfa-aed4-4563-9e36-c057ed0e8aba admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:00.232221 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a123dcfa-aed4-4563-9e36-c057ed0e8aba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:00.232221 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a123dcfa-aed4-4563-9e36-c057ed0e8aba admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:00.402607 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777b578-a38d-4fc0-bfd2-ff5bc4c36708 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:00.406423 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2899/5777] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:31:00 2022] POST /identity/v3/projects => generated 387 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:00.408553 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0777b578-a38d-4fc0-bfd2-ff5bc4c36708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:00.410123 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123dcfa-aed4-4563-9e36-c057ed0e8aba admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:00.571079 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777b578-a38d-4fc0-bfd2-ff5bc4c36708 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:00.608435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123dcfa-aed4-4563-9e36-c057ed0e8aba admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:00.634183 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e2c76-332f-4ac8-9db4-b5b0bd605430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:00.635406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e2c76-332f-4ac8-9db4-b5b0bd605430 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:00.635876 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e2c76-332f-4ac8-9db4-b5b0bd605430 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:00.636330 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e2c76-332f-4ac8-9db4-b5b0bd605430 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:00.637185 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e2c76-332f-4ac8-9db4-b5b0bd605430 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:00.642137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e2c76-332f-4ac8-9db4-b5b0bd605430 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:00.711012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3cc3df-035d-4cb0-8d2d-cfbffb1a8b2c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:00.716088 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cc3df-035d-4cb0-8d2d-cfbffb1a8b2c service placement] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:00.723634 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cc3df-035d-4cb0-8d2d-cfbffb1a8b2c service placement] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:00.723634 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cc3df-035d-4cb0-8d2d-cfbffb1a8b2c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:00.723634 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-fc3cc3df-035d-4cb0-8d2d-cfbffb1a8b2c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:00.738969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3cc3df-035d-4cb0-8d2d-cfbffb1a8b2c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:00.741221 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3cc3df-035d-4cb0-8d2d-cfbffb1a8b2c service placement] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:00.769824 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2879/5778] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:31:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:31:00.779664 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2900/5779] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:31:00 2022] POST /identity/v3/users => generated 294 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:00.785209 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3cc3df-035d-4cb0-8d2d-cfbffb1a8b2c service placement] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:00.810197 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3cc3df-035d-4cb0-8d2d-cfbffb1a8b2c service placement] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:00.826831 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60aa9d-0413-4d59-b14a-2b4cf93abef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:00.827884 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60aa9d-0413-4d59-b14a-2b4cf93abef9 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:00.828314 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60aa9d-0413-4d59-b14a-2b4cf93abef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:00.828677 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60aa9d-0413-4d59-b14a-2b4cf93abef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:00.829626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c60aa9d-0413-4d59-b14a-2b4cf93abef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:00.833031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c60aa9d-0413-4d59-b14a-2b4cf93abef9 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:00.878265 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2880/5780] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:31:00.879649 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e2c76-332f-4ac8-9db4-b5b0bd605430 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:00.895816 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e2c76-332f-4ac8-9db4-b5b0bd605430 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:00.918487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fccb020-b9c3-4276-88ff-139db1cc9bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:00.920040 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fccb020-b9c3-4276-88ff-139db1cc9bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:00.922370 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fccb020-b9c3-4276-88ff-139db1cc9bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:00.922884 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fccb020-b9c3-4276-88ff-139db1cc9bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:00.926555 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fccb020-b9c3-4276-88ff-139db1cc9bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:00.936992 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fccb020-b9c3-4276-88ff-139db1cc9bd8 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:00.954048 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2901/5781] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:31:00.959422 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60aa9d-0413-4d59-b14a-2b4cf93abef9 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:00.976197 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60aa9d-0413-4d59-b14a-2b4cf93abef9 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:00.977311 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fccb020-b9c3-4276-88ff-139db1cc9bd8 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:00.979059 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6fccb020-b9c3-4276-88ff-139db1cc9bd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:00.993262 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c90ff-24ce-4703-ba91-debd6397ad54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:00.994354 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c90ff-24ce-4703-ba91-debd6397ad54 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:00.994650 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c90ff-24ce-4703-ba91-debd6397ad54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:00.994932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c90ff-24ce-4703-ba91-debd6397ad54 admin admin] PATH_INFO: `/v3/projects/bf07897daf624709af2aa4aa41be64b2/users/1961d1d024eb44d89a90266330cb9242/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:01.016636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fccb020-b9c3-4276-88ff-139db1cc9bd8 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:01.024694 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322b800-e6b1-4aa8-8a63-3471c49e3f35 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:01.025494 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322b800-e6b1-4aa8-8a63-3471c49e3f35 service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:01.025935 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322b800-e6b1-4aa8-8a63-3471c49e3f35 service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:01.026414 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322b800-e6b1-4aa8-8a63-3471c49e3f35 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:01.029045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4322b800-e6b1-4aa8-8a63-3471c49e3f35 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:01.047713 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4322b800-e6b1-4aa8-8a63-3471c49e3f35 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:01.049801 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4322b800-e6b1-4aa8-8a63-3471c49e3f35 service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:01.070356 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07c90ff-24ce-4703-ba91-debd6397ad54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf07897daf624709af2aa4aa41be64b2, user_id=1961d1d024eb44d89a90266330cb9242, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:01.075060 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07c90ff-24ce-4703-ba91-debd6397ad54 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:01.085780 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2902/5782] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:31:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:31:01.175510 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2881/5783] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:31:00 2022] PUT /identity/v3/projects/bf07897daf624709af2aa4aa41be64b2/users/1961d1d024eb44d89a90266330cb9242/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:01.188522 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e0694-8770-4ee7-aaef-99c32cbe3c16 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:01.188820 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e0694-8770-4ee7-aaef-99c32cbe3c16 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:01.189103 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e0694-8770-4ee7-aaef-99c32cbe3c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:01.258056 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-892e0694-8770-4ee7-aaef-99c32cbe3c16 None None] MFA Rules not processed for user `1961d1d024eb44d89a90266330cb9242`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:01.259884 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-892e0694-8770-4ee7-aaef-99c32cbe3c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:01.394753 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2903/5784] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:01.399274 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c90ff-24ce-4703-ba91-debd6397ad54 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:01.511044 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c90ff-24ce-4703-ba91-debd6397ad54 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:01.523262 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabcbefd-7207-4466-803f-5a590dc47e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:01.525213 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcbefd-7207-4466-803f-5a590dc47e4a admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:01.525213 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcbefd-7207-4466-803f-5a590dc47e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:01.525213 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcbefd-7207-4466-803f-5a590dc47e4a admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:01.525697 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabcbefd-7207-4466-803f-5a590dc47e4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:01.528069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabcbefd-7207-4466-803f-5a590dc47e4a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:01.626624 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2882/5785] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:31:01 2022] POST /identity/v3/projects => generated 387 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:01.631168 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e0694-8770-4ee7-aaef-99c32cbe3c16 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:01.650000 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e0694-8770-4ee7-aaef-99c32cbe3c16 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:01.758249 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834e989-487a-4a2e-b056-9fa05a80b7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:01.758930 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834e989-487a-4a2e-b056-9fa05a80b7ce admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:01.759708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834e989-487a-4a2e-b056-9fa05a80b7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:01.761301 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834e989-487a-4a2e-b056-9fa05a80b7ce admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:01.762191 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834e989-487a-4a2e-b056-9fa05a80b7ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:01.764820 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834e989-487a-4a2e-b056-9fa05a80b7ce admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:01.925234 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2904/5786] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:31:01 2022] POST /identity/v3/users => generated 300 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:01.932137 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabcbefd-7207-4466-803f-5a590dc47e4a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:01.952389 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabcbefd-7207-4466-803f-5a590dc47e4a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:01.966114 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe752cc-c952-4044-bdcc-463ba4094ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:01.967002 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe752cc-c952-4044-bdcc-463ba4094ced admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:01.967480 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe752cc-c952-4044-bdcc-463ba4094ced admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:01.967824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe752cc-c952-4044-bdcc-463ba4094ced admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:01.968891 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe752cc-c952-4044-bdcc-463ba4094ced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:01.973192 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe752cc-c952-4044-bdcc-463ba4094ced admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:02.002798 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2883/5787] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:31:02.007445 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834e989-487a-4a2e-b056-9fa05a80b7ce admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:02.024193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834e989-487a-4a2e-b056-9fa05a80b7ce admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:02.041031 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841bd0c1-dfc1-4797-b5a1-dfe891503194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:02.042104 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841bd0c1-dfc1-4797-b5a1-dfe891503194 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:02.042388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841bd0c1-dfc1-4797-b5a1-dfe891503194 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:02.042664 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841bd0c1-dfc1-4797-b5a1-dfe891503194 admin admin] PATH_INFO: `/v3/projects/ea3d40544a294961bbdfc28b725eb727/users/ac3bcd0e7de347cfb34d55f6cf14c85f/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:02.062138 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841bd0c1-dfc1-4797-b5a1-dfe891503194 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea3d40544a294961bbdfc28b725eb727, user_id=ac3bcd0e7de347cfb34d55f6cf14c85f, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:02.065092 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841bd0c1-dfc1-4797-b5a1-dfe891503194 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:02.108714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe752cc-c952-4044-bdcc-463ba4094ced admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:02.110445 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-abe752cc-c952-4044-bdcc-463ba4094ced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:02.151695 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2905/5788] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:31:02 2022] PUT /identity/v3/projects/ea3d40544a294961bbdfc28b725eb727/users/ac3bcd0e7de347cfb34d55f6cf14c85f/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:02.157233 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841bd0c1-dfc1-4797-b5a1-dfe891503194 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:02.206049 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe752cc-c952-4044-bdcc-463ba4094ced admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:02.306348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e2aa9-affd-49fa-bc32-2fe0c6832168 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:02.307277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e2aa9-affd-49fa-bc32-2fe0c6832168 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:02.307792 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e2aa9-affd-49fa-bc32-2fe0c6832168 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:02.308271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e2aa9-affd-49fa-bc32-2fe0c6832168 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:02.308826 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841bd0c1-dfc1-4797-b5a1-dfe891503194 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:02.311903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1f5e2aa9-affd-49fa-bc32-2fe0c6832168 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:02.316845 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a077b9-3620-4858-9f7b-daf5d4fed32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:02.317672 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a077b9-3620-4858-9f7b-daf5d4fed32b admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:02.318985 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a077b9-3620-4858-9f7b-daf5d4fed32b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:02.318985 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a077b9-3620-4858-9f7b-daf5d4fed32b admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:02.319858 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a077b9-3620-4858-9f7b-daf5d4fed32b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:02.321728 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a077b9-3620-4858-9f7b-daf5d4fed32b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:02.329536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e2aa9-affd-49fa-bc32-2fe0c6832168 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:02.334255 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e2aa9-affd-49fa-bc32-2fe0c6832168 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:02.348088 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2906/5789] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:31:02.349935 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a077b9-3620-4858-9f7b-daf5d4fed32b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:02.356117 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2884/5790] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:31:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:31:02.384034 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a077b9-3620-4858-9f7b-daf5d4fed32b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:02.390977 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35632db3-c9b9-4882-aa30-441a03522807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:02.392381 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35632db3-c9b9-4882-aa30-441a03522807 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:02.393327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35632db3-c9b9-4882-aa30-441a03522807 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:02.393740 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35632db3-c9b9-4882-aa30-441a03522807 admin admin] PATH_INFO: `/v3/projects/ea3d40544a294961bbdfc28b725eb727/users/ac3bcd0e7de347cfb34d55f6cf14c85f/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:02.396827 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35632db3-c9b9-4882-aa30-441a03522807 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea3d40544a294961bbdfc28b725eb727, user_id=ac3bcd0e7de347cfb34d55f6cf14c85f, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:02.400555 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35632db3-c9b9-4882-aa30-441a03522807 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:02.422760 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2907/5791] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:31:02 2022] PUT /identity/v3/projects/ea3d40544a294961bbdfc28b725eb727/users/ac3bcd0e7de347cfb34d55f6cf14c85f/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:02.435373 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0fcef-4855-4f3b-9bfe-89d7d846b7f5 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:02.435875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0fcef-4855-4f3b-9bfe-89d7d846b7f5 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:02.436330 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0fcef-4855-4f3b-9bfe-89d7d846b7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:02.507701 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-f7a0fcef-4855-4f3b-9bfe-89d7d846b7f5 None None] MFA Rules not processed for user `ac3bcd0e7de347cfb34d55f6cf14c85f`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:02.509875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f7a0fcef-4855-4f3b-9bfe-89d7d846b7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:02.640579 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2885/5792] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:02 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:31:02.653370 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35632db3-c9b9-4882-aa30-441a03522807 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:02.667347 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35632db3-c9b9-4882-aa30-441a03522807 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:02.675264 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2d6a1-b095-4f00-bda9-6e88be85bf1c tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3bcd0e7de347cfb34d55f6cf14c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea3d40544a294961bbdfc28b725eb727', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:02.676311 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2d6a1-b095-4f00-bda9-6e88be85bf1c tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:02.677790 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2d6a1-b095-4f00-bda9-6e88be85bf1c tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:02.678268 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2d6a1-b095-4f00-bda9-6e88be85bf1c tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:02.679176 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2d6a1-b095-4f00-bda9-6e88be85bf1c tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:02.681533 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2d6a1-b095-4f00-bda9-6e88be85bf1c tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:02.887707 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2908/5793] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:31:02 2022] POST /identity/v3/projects => generated 359 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:02.892072 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0fcef-4855-4f3b-9bfe-89d7d846b7f5 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:02.902375 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0fcef-4855-4f3b-9bfe-89d7d846b7f5 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:02.989147 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003c368-452a-4050-9f7f-37cee9d29b8f tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3bcd0e7de347cfb34d55f6cf14c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea3d40544a294961bbdfc28b725eb727', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:02.992947 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003c368-452a-4050-9f7f-37cee9d29b8f tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:02.994631 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003c368-452a-4050-9f7f-37cee9d29b8f tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:02.995100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d003c368-452a-4050-9f7f-37cee9d29b8f tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] PATH_INFO: `/v3/projects/ca9ddd5b8b444765983cbd732d84ee99/tags/tempest-tag-1908410518` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:02.996915 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d003c368-452a-4050-9f7f-37cee9d29b8f tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=ca9ddd5b8b444765983cbd732d84ee99, value=tempest-tag-1908410518)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:02.999977 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d003c368-452a-4050-9f7f-37cee9d29b8f tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:03.156274 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-d003c368-452a-4050-9f7f-37cee9d29b8f tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1908410518. To ensure interoperability, identifiers should be a valid uuid. Apr 30 21:31:03.156274 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Apr 30 21:31:03.156274 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:31:03.162824 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2886/5794] 10.222.0.23 () {60 vars in 1332 bytes} [Sat Apr 30 21:31:02 2022] PUT /identity/v3/projects/ca9ddd5b8b444765983cbd732d84ee99/tags/tempest-tag-1908410518 => generated 0 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 291 bytes (2 switches on core 0) Apr 30 21:31:03.167089 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2d6a1-b095-4f00-bda9-6e88be85bf1c tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:03.177733 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2d6a1-b095-4f00-bda9-6e88be85bf1c tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:03.182248 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4e216-a6f4-453f-800e-886ef4986615 tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3bcd0e7de347cfb34d55f6cf14c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea3d40544a294961bbdfc28b725eb727', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:03.183109 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4e216-a6f4-453f-800e-886ef4986615 tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:03.183394 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4e216-a6f4-453f-800e-886ef4986615 tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:03.183671 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4e216-a6f4-453f-800e-886ef4986615 tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] PATH_INFO: `/v3/projects/ca9ddd5b8b444765983cbd732d84ee99/tags/tempest-tag-1908410518` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:03.195727 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4e216-a6f4-453f-800e-886ef4986615 tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=ca9ddd5b8b444765983cbd732d84ee99, value=tempest-tag-1908410518)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:03.197927 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4e216-a6f4-453f-800e-886ef4986615 tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:03.208129 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2909/5795] 10.222.0.23 () {58 vars in 1313 bytes} [Sat Apr 30 21:31:03 2022] GET /identity/v3/projects/ca9ddd5b8b444765983cbd732d84ee99/tags/tempest-tag-1908410518 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:31:03.212117 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003c368-452a-4050-9f7f-37cee9d29b8f tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:03.222313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d003c368-452a-4050-9f7f-37cee9d29b8f tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:03.227339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72599224-4227-430a-8783-3c48d6dcb9ba tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3bcd0e7de347cfb34d55f6cf14c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea3d40544a294961bbdfc28b725eb727', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:03.228426 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72599224-4227-430a-8783-3c48d6dcb9ba tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:03.228846 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72599224-4227-430a-8783-3c48d6dcb9ba tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:03.230755 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72599224-4227-430a-8783-3c48d6dcb9ba tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] PATH_INFO: `/v3/projects/ca9ddd5b8b444765983cbd732d84ee99/tags` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:03.231312 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72599224-4227-430a-8783-3c48d6dcb9ba tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=ca9ddd5b8b444765983cbd732d84ee99)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:03.233613 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72599224-4227-430a-8783-3c48d6dcb9ba tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:03.415584 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2887/5796] 10.222.0.23 () {60 vars in 1264 bytes} [Sat Apr 30 21:31:03 2022] PUT /identity/v3/projects/ca9ddd5b8b444765983cbd732d84ee99/tags => generated 140 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:31:03.423932 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4e216-a6f4-453f-800e-886ef4986615 tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:03.436152 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4e216-a6f4-453f-800e-886ef4986615 tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:03.443505 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c90d8-eb57-4b1d-adcd-9f3d3626042f tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3bcd0e7de347cfb34d55f6cf14c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea3d40544a294961bbdfc28b725eb727', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:03.444910 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c90d8-eb57-4b1d-adcd-9f3d3626042f tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:03.445332 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c90d8-eb57-4b1d-adcd-9f3d3626042f tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:03.445728 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c90d8-eb57-4b1d-adcd-9f3d3626042f tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] PATH_INFO: `/v3/projects/ca9ddd5b8b444765983cbd732d84ee99/tags` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:03.467233 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c90d8-eb57-4b1d-adcd-9f3d3626042f tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=ca9ddd5b8b444765983cbd732d84ee99)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:03.469345 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c90d8-eb57-4b1d-adcd-9f3d3626042f tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:03.481249 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2910/5797] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Apr 30 21:31:03 2022] GET /identity/v3/projects/ca9ddd5b8b444765983cbd732d84ee99/tags => generated 140 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:31:03.485539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72599224-4227-430a-8783-3c48d6dcb9ba tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:03.496519 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72599224-4227-430a-8783-3c48d6dcb9ba tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:03.501423 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637ca3b-e193-4412-a7af-9a54ed3de11c tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3bcd0e7de347cfb34d55f6cf14c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea3d40544a294961bbdfc28b725eb727', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:03.502995 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637ca3b-e193-4412-a7af-9a54ed3de11c tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:03.504337 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637ca3b-e193-4412-a7af-9a54ed3de11c tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:03.504337 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637ca3b-e193-4412-a7af-9a54ed3de11c tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] PATH_INFO: `/v3/projects/ca9ddd5b8b444765983cbd732d84ee99/tags/tempest-tag-528382551` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:03.504750 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637ca3b-e193-4412-a7af-9a54ed3de11c tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=ca9ddd5b8b444765983cbd732d84ee99, value=tempest-tag-528382551)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:03.507030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637ca3b-e193-4412-a7af-9a54ed3de11c tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:03.673816 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-a637ca3b-e193-4412-a7af-9a54ed3de11c tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-528382551. To ensure interoperability, identifiers should be a valid uuid. Apr 30 21:31:03.673816 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Apr 30 21:31:03.673816 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:31:03.689572 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2888/5798] 10.222.0.23 () {58 vars in 1313 bytes} [Sat Apr 30 21:31:03 2022] DELETE /identity/v3/projects/ca9ddd5b8b444765983cbd732d84ee99/tags/tempest-tag-528382551 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:03.691379 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c90d8-eb57-4b1d-adcd-9f3d3626042f tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:03.704141 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c90d8-eb57-4b1d-adcd-9f3d3626042f tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:03.722783 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67449660-8f86-4624-af84-947cc560b1ae tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3bcd0e7de347cfb34d55f6cf14c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea3d40544a294961bbdfc28b725eb727', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:03.723459 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67449660-8f86-4624-af84-947cc560b1ae tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:03.724413 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67449660-8f86-4624-af84-947cc560b1ae tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:03.724703 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67449660-8f86-4624-af84-947cc560b1ae tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] PATH_INFO: `/v3/projects/ca9ddd5b8b444765983cbd732d84ee99/tags/tempest-tag-528382551` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:03.742391 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67449660-8f86-4624-af84-947cc560b1ae tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=ca9ddd5b8b444765983cbd732d84ee99, value=tempest-tag-528382551)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:03.744575 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67449660-8f86-4624-af84-947cc560b1ae tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:03.766969 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-67449660-8f86-4624-af84-947cc560b1ae tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] Could not find project tag: tempest-tag-528382551.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-528382551. Apr 30 21:31:03.766969 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:31:03.766969 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:31:03.766969 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:31:03.766969 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:31:03.766969 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:31:03.766969 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:31:03.766969 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:31:03.766969 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:31:03.766969 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:31:03.766969 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:31:03.766969 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:31:03.766969 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Apr 30 21:31:03.766969 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Apr 30 21:31:03.768410 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:31:03.768410 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:31:03.768410 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Apr 30 21:31:03.768410 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Apr 30 21:31:03.768410 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-528382551. Apr 30 21:31:03.768410 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:31:03.770445 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2911/5799] 10.222.0.23 () {58 vars in 1310 bytes} [Sat Apr 30 21:31:03 2022] GET /identity/v3/projects/ca9ddd5b8b444765983cbd732d84ee99/tags/tempest-tag-528382551 => generated 106 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 30 21:31:03.774887 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637ca3b-e193-4412-a7af-9a54ed3de11c tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:03.795801 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637ca3b-e193-4412-a7af-9a54ed3de11c tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:03.804765 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb6c6f-408b-451c-bb9a-13caae0a0a21 tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3bcd0e7de347cfb34d55f6cf14c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea3d40544a294961bbdfc28b725eb727', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:03.805314 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb6c6f-408b-451c-bb9a-13caae0a0a21 tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:03.805672 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb6c6f-408b-451c-bb9a-13caae0a0a21 tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:03.806055 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb6c6f-408b-451c-bb9a-13caae0a0a21 tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] PATH_INFO: `/v3/projects/ca9ddd5b8b444765983cbd732d84ee99/tags` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:03.807666 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb6c6f-408b-451c-bb9a-13caae0a0a21 tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=ca9ddd5b8b444765983cbd732d84ee99)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:03.810074 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb6c6f-408b-451c-bb9a-13caae0a0a21 tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:03.971779 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2889/5800] 10.222.0.23 () {58 vars in 1247 bytes} [Sat Apr 30 21:31:03 2022] DELETE /identity/v3/projects/ca9ddd5b8b444765983cbd732d84ee99/tags => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:03.977427 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67449660-8f86-4624-af84-947cc560b1ae tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:03.989296 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67449660-8f86-4624-af84-947cc560b1ae tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:03.997297 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b52a12-064e-48bd-b470-f8af1ba52ca2 tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3bcd0e7de347cfb34d55f6cf14c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea3d40544a294961bbdfc28b725eb727', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:03.998352 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b52a12-064e-48bd-b470-f8af1ba52ca2 tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:03.998739 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b52a12-064e-48bd-b470-f8af1ba52ca2 tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:03.999118 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b52a12-064e-48bd-b470-f8af1ba52ca2 tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] PATH_INFO: `/v3/projects/ca9ddd5b8b444765983cbd732d84ee99/tags` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:04.016545 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b52a12-064e-48bd-b470-f8af1ba52ca2 tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=ca9ddd5b8b444765983cbd732d84ee99)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:04.027712 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b52a12-064e-48bd-b470-f8af1ba52ca2 tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:04.043091 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2912/5801] 10.222.0.23 () {58 vars in 1244 bytes} [Sat Apr 30 21:31:03 2022] GET /identity/v3/projects/ca9ddd5b8b444765983cbd732d84ee99/tags => generated 66 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Apr 30 21:31:04.047160 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb6c6f-408b-451c-bb9a-13caae0a0a21 tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:04.060652 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb6c6f-408b-451c-bb9a-13caae0a0a21 tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:04.068863 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84b793-b3a4-4cb3-aff4-ca1ba01bbebc tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac3bcd0e7de347cfb34d55f6cf14c85f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea3d40544a294961bbdfc28b725eb727', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:04.069746 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84b793-b3a4-4cb3-aff4-ca1ba01bbebc tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:04.070066 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84b793-b3a4-4cb3-aff4-ca1ba01bbebc tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:04.070344 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84b793-b3a4-4cb3-aff4-ca1ba01bbebc tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] PATH_INFO: `/v3/projects/ca9ddd5b8b444765983cbd732d84ee99` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:04.071558 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84b793-b3a4-4cb3-aff4-ca1ba01bbebc tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ca9ddd5b8b444765983cbd732d84ee99)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:04.073486 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84b793-b3a4-4cb3-aff4-ca1ba01bbebc tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:04.259014 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-fc84b793-b3a4-4cb3-aff4-ca1ba01bbebc tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca9ddd5b8b444765983cbd732d84ee99', 'request_id': 'req-fc84b793-b3a4-4cb3-aff4-ca1ba01bbebc'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:04.265713 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-fc84b793-b3a4-4cb3-aff4-ca1ba01bbebc tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca9ddd5b8b444765983cbd732d84ee99', 'request_id': 'req-fc84b793-b3a4-4cb3-aff4-ca1ba01bbebc'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:04.273415 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-fc84b793-b3a4-4cb3-aff4-ca1ba01bbebc tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca9ddd5b8b444765983cbd732d84ee99', 'request_id': 'req-fc84b793-b3a4-4cb3-aff4-ca1ba01bbebc'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:04.393740 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-fc84b793-b3a4-4cb3-aff4-ca1ba01bbebc tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] The token cache is being invalidate because project ca9ddd5b8b444765983cbd732d84ee99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:04.394209 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-fc84b793-b3a4-4cb3-aff4-ca1ba01bbebc tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:04.394791 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-fc84b793-b3a4-4cb3-aff4-ca1ba01bbebc tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:04.397418 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2890/5802] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:31:04 2022] DELETE /identity/v3/projects/ca9ddd5b8b444765983cbd732d84ee99 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:04.402438 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b52a12-064e-48bd-b470-f8af1ba52ca2 tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:04.405316 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-17b52a12-064e-48bd-b470-f8af1ba52ca2 tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:04.513769 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b52a12-064e-48bd-b470-f8af1ba52ca2 tempest-IdentityV3ProjectTagsTest-1750577392 tempest-IdentityV3ProjectTagsTest-1750577392-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:04.595033 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510397ed-389f-4b8a-824b-af3ae6801460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:04.596559 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510397ed-389f-4b8a-824b-af3ae6801460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:04.596840 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510397ed-389f-4b8a-824b-af3ae6801460 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:04.597114 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510397ed-389f-4b8a-824b-af3ae6801460 admin admin] PATH_INFO: `/v3/users/1961d1d024eb44d89a90266330cb9242` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:04.598591 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510397ed-389f-4b8a-824b-af3ae6801460 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1961d1d024eb44d89a90266330cb9242)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:04.601004 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510397ed-389f-4b8a-824b-af3ae6801460 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:04.892866 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-510397ed-389f-4b8a-824b-af3ae6801460 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1961d1d024eb44d89a90266330cb9242'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:04.927717 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-510397ed-389f-4b8a-824b-af3ae6801460 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1961d1d024eb44d89a90266330cb9242'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:05.071256 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-510397ed-389f-4b8a-824b-af3ae6801460 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1961d1d024eb44d89a90266330cb9242'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:05.086150 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-510397ed-389f-4b8a-824b-af3ae6801460 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1961d1d024eb44d89a90266330cb9242'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:05.087257 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-510397ed-389f-4b8a-824b-af3ae6801460 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1961d1d024eb44d89a90266330cb9242'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:05.094092 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2913/5803] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:31:04 2022] DELETE /identity/v3/users/1961d1d024eb44d89a90266330cb9242 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:05.099516 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb758fa-9ca2-4b06-8264-b3b977c51a67 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:05.099806 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb758fa-9ca2-4b06-8264-b3b977c51a67 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:05.100088 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb758fa-9ca2-4b06-8264-b3b977c51a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:05.126775 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-ecb758fa-9ca2-4b06-8264-b3b977c51a67 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:05.128753 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ecb758fa-9ca2-4b06-8264-b3b977c51a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:05.267851 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2891/5804] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:05.426547 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510397ed-389f-4b8a-824b-af3ae6801460 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:05.428857 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-510397ed-389f-4b8a-824b-af3ae6801460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:05.543911 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510397ed-389f-4b8a-824b-af3ae6801460 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:05.551432 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee612c1e-5edf-4e59-8395-bc95fa9c740b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:05.552283 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee612c1e-5edf-4e59-8395-bc95fa9c740b service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:05.554612 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee612c1e-5edf-4e59-8395-bc95fa9c740b service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:05.555025 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee612c1e-5edf-4e59-8395-bc95fa9c740b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:05.580789 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee612c1e-5edf-4e59-8395-bc95fa9c740b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:05.606562 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee612c1e-5edf-4e59-8395-bc95fa9c740b service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:05.652813 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2914/5805] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:31:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:31:05.695779 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb758fa-9ca2-4b06-8264-b3b977c51a67 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:05.697446 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ecb758fa-9ca2-4b06-8264-b3b977c51a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:05.723445 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb758fa-9ca2-4b06-8264-b3b977c51a67 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:05.728921 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a938a-10d7-4117-b7fb-405c486971d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:05.730084 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a938a-10d7-4117-b7fb-405c486971d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:05.730511 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a938a-10d7-4117-b7fb-405c486971d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:05.730931 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a938a-10d7-4117-b7fb-405c486971d1 admin admin] PATH_INFO: `/v3/users/ea92ff9a9c1142ce8890ab1379535f1b` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:05.732312 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a938a-10d7-4117-b7fb-405c486971d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea92ff9a9c1142ce8890ab1379535f1b)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:05.735740 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a938a-10d7-4117-b7fb-405c486971d1 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:05.963492 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-536a938a-10d7-4117-b7fb-405c486971d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea92ff9a9c1142ce8890ab1379535f1b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:05.986773 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-536a938a-10d7-4117-b7fb-405c486971d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea92ff9a9c1142ce8890ab1379535f1b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:06.082538 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-536a938a-10d7-4117-b7fb-405c486971d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea92ff9a9c1142ce8890ab1379535f1b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:06.083179 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-536a938a-10d7-4117-b7fb-405c486971d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea92ff9a9c1142ce8890ab1379535f1b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:06.091303 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-536a938a-10d7-4117-b7fb-405c486971d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea92ff9a9c1142ce8890ab1379535f1b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:06.099818 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2892/5806] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:31:05 2022] DELETE /identity/v3/users/ea92ff9a9c1142ce8890ab1379535f1b => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:06.104169 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce3a16-aefe-4b9c-ab04-c10af36bf58e None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:06.104640 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce3a16-aefe-4b9c-ab04-c10af36bf58e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:06.104714 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce3a16-aefe-4b9c-ab04-c10af36bf58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:06.132639 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-c5ce3a16-aefe-4b9c-ab04-c10af36bf58e None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:06.134005 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c5ce3a16-aefe-4b9c-ab04-c10af36bf58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:06.221495 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2915/5807] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:06.229370 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a938a-10d7-4117-b7fb-405c486971d1 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:06.231958 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-536a938a-10d7-4117-b7fb-405c486971d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:06.372086 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a938a-10d7-4117-b7fb-405c486971d1 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:06.379127 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ecfcb2-bdc1-45f1-b3ed-93c9ec4c59c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:06.379805 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ecfcb2-bdc1-45f1-b3ed-93c9ec4c59c5 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:06.380093 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ecfcb2-bdc1-45f1-b3ed-93c9ec4c59c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:06.380375 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ecfcb2-bdc1-45f1-b3ed-93c9ec4c59c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:06.395681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ecfcb2-bdc1-45f1-b3ed-93c9ec4c59c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:06.395800 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ecfcb2-bdc1-45f1-b3ed-93c9ec4c59c5 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:06.406710 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2893/5808] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:31:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:31:06.542825 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce3a16-aefe-4b9c-ab04-c10af36bf58e None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:06.545545 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c5ce3a16-aefe-4b9c-ab04-c10af36bf58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:06.565352 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce3a16-aefe-4b9c-ab04-c10af36bf58e None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:06.578005 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54036fa-8f8a-4a10-9927-838a64f0f396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:06.579197 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54036fa-8f8a-4a10-9927-838a64f0f396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:06.579639 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54036fa-8f8a-4a10-9927-838a64f0f396 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:06.580118 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54036fa-8f8a-4a10-9927-838a64f0f396 admin admin] PATH_INFO: `/v3/projects/bf07897daf624709af2aa4aa41be64b2` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:06.582215 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54036fa-8f8a-4a10-9927-838a64f0f396 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf07897daf624709af2aa4aa41be64b2)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:06.584560 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54036fa-8f8a-4a10-9927-838a64f0f396 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:06.737934 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e54036fa-8f8a-4a10-9927-838a64f0f396 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf07897daf624709af2aa4aa41be64b2', 'request_id': 'req-e54036fa-8f8a-4a10-9927-838a64f0f396'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:06.764992 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e54036fa-8f8a-4a10-9927-838a64f0f396 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf07897daf624709af2aa4aa41be64b2', 'request_id': 'req-e54036fa-8f8a-4a10-9927-838a64f0f396'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:06.774858 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e54036fa-8f8a-4a10-9927-838a64f0f396 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf07897daf624709af2aa4aa41be64b2', 'request_id': 'req-e54036fa-8f8a-4a10-9927-838a64f0f396'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:06.894277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e54036fa-8f8a-4a10-9927-838a64f0f396 admin admin] The token cache is being invalidate because project bf07897daf624709af2aa4aa41be64b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:06.894277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e54036fa-8f8a-4a10-9927-838a64f0f396 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:06.897372 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e54036fa-8f8a-4a10-9927-838a64f0f396 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:06.899464 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2916/5809] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:31:06 2022] DELETE /identity/v3/projects/bf07897daf624709af2aa4aa41be64b2 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:31:06.906036 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ecfcb2-bdc1-45f1-b3ed-93c9ec4c59c5 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:06.919539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ecfcb2-bdc1-45f1-b3ed-93c9ec4c59c5 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:07.038757 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa62d1-9453-4e8a-85a3-b5466f036991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:07.039651 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa62d1-9453-4e8a-85a3-b5466f036991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:07.039939 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa62d1-9453-4e8a-85a3-b5466f036991 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:07.040226 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa62d1-9453-4e8a-85a3-b5466f036991 admin admin] PATH_INFO: `/v3/users/ac3bcd0e7de347cfb34d55f6cf14c85f` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:07.041876 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa62d1-9453-4e8a-85a3-b5466f036991 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac3bcd0e7de347cfb34d55f6cf14c85f)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:07.044253 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa62d1-9453-4e8a-85a3-b5466f036991 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:07.336941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-acaa62d1-9453-4e8a-85a3-b5466f036991 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac3bcd0e7de347cfb34d55f6cf14c85f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:07.351698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-acaa62d1-9453-4e8a-85a3-b5466f036991 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac3bcd0e7de347cfb34d55f6cf14c85f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:07.362369 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54036fa-8f8a-4a10-9927-838a64f0f396 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:07.364174 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e54036fa-8f8a-4a10-9927-838a64f0f396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:07.382216 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54036fa-8f8a-4a10-9927-838a64f0f396 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:07.400438 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a2eb3-c135-4ad4-ac7d-de518e5b4594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:07.400867 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a2eb3-c135-4ad4-ac7d-de518e5b4594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:07.401152 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a2eb3-c135-4ad4-ac7d-de518e5b4594 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:07.401435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a2eb3-c135-4ad4-ac7d-de518e5b4594 admin admin] PATH_INFO: `/v3/projects/b5de501af17b45a596e24e0fe7611ece` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:07.402732 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a2eb3-c135-4ad4-ac7d-de518e5b4594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5de501af17b45a596e24e0fe7611ece)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:07.404681 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a2eb3-c135-4ad4-ac7d-de518e5b4594 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:07.451400 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-acaa62d1-9453-4e8a-85a3-b5466f036991 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac3bcd0e7de347cfb34d55f6cf14c85f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:07.452648 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-acaa62d1-9453-4e8a-85a3-b5466f036991 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac3bcd0e7de347cfb34d55f6cf14c85f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:07.461689 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-acaa62d1-9453-4e8a-85a3-b5466f036991 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac3bcd0e7de347cfb34d55f6cf14c85f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:07.468496 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2894/5810] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:31:06 2022] DELETE /identity/v3/users/ac3bcd0e7de347cfb34d55f6cf14c85f => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:07.537212 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-190a2eb3-c135-4ad4-ac7d-de518e5b4594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5de501af17b45a596e24e0fe7611ece', 'request_id': 'req-190a2eb3-c135-4ad4-ac7d-de518e5b4594'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:07.543895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-190a2eb3-c135-4ad4-ac7d-de518e5b4594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5de501af17b45a596e24e0fe7611ece', 'request_id': 'req-190a2eb3-c135-4ad4-ac7d-de518e5b4594'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:07.561999 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-190a2eb3-c135-4ad4-ac7d-de518e5b4594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5de501af17b45a596e24e0fe7611ece', 'request_id': 'req-190a2eb3-c135-4ad4-ac7d-de518e5b4594'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:07.669582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-190a2eb3-c135-4ad4-ac7d-de518e5b4594 admin admin] The token cache is being invalidate because project b5de501af17b45a596e24e0fe7611ece was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:07.672411 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-190a2eb3-c135-4ad4-ac7d-de518e5b4594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:07.674563 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-190a2eb3-c135-4ad4-ac7d-de518e5b4594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:07.680327 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2917/5811] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:31:07 2022] DELETE /identity/v3/projects/b5de501af17b45a596e24e0fe7611ece => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:07.685820 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fbd4e-2b3d-436e-978f-1b8872fc728b None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:07.686405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fbd4e-2b3d-436e-978f-1b8872fc728b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:07.686909 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fbd4e-2b3d-436e-978f-1b8872fc728b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:07.709242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-d23fbd4e-2b3d-436e-978f-1b8872fc728b None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:07.710754 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d23fbd4e-2b3d-436e-978f-1b8872fc728b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:07.805117 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2895/5812] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:31:07.814202 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff9f8e-f4c0-462b-8868-8b67c1d0bccf None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:07.815020 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff9f8e-f4c0-462b-8868-8b67c1d0bccf None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:07.815607 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff9f8e-f4c0-462b-8868-8b67c1d0bccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:07.836607 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-a7ff9f8e-f4c0-462b-8868-8b67c1d0bccf None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:07.838119 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a7ff9f8e-f4c0-462b-8868-8b67c1d0bccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:07.846898 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2918/5813] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:07.850929 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23fbd4e-2b3d-436e-978f-1b8872fc728b None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:07.861729 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23fbd4e-2b3d-436e-978f-1b8872fc728b None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:07.866672 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa136056-9195-4056-a336-59fe478eab93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:07.867349 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa136056-9195-4056-a336-59fe478eab93 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:07.867766 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa136056-9195-4056-a336-59fe478eab93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:07.868053 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa136056-9195-4056-a336-59fe478eab93 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:07.870104 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa136056-9195-4056-a336-59fe478eab93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:31:07.871190 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa136056-9195-4056-a336-59fe478eab93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:07.873729 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa136056-9195-4056-a336-59fe478eab93 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:07.889192 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2896/5814] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:31:07.897973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff9f8e-f4c0-462b-8868-8b67c1d0bccf None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:07.905528 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff9f8e-f4c0-462b-8868-8b67c1d0bccf None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:07.911539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09433d0c-6564-4762-81fa-5ab1e078b3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:07.912402 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09433d0c-6564-4762-81fa-5ab1e078b3cf admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:07.912693 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09433d0c-6564-4762-81fa-5ab1e078b3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:07.912975 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09433d0c-6564-4762-81fa-5ab1e078b3cf admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:07.913667 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09433d0c-6564-4762-81fa-5ab1e078b3cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:07.915859 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09433d0c-6564-4762-81fa-5ab1e078b3cf admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:08.027446 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2919/5815] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:31:07 2022] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:08.032951 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa136056-9195-4056-a336-59fe478eab93 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:08.047843 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa136056-9195-4056-a336-59fe478eab93 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:08.137667 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a349a3b-4e52-4d7e-94c9-ac87fb214d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:08.138563 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a349a3b-4e52-4d7e-94c9-ac87fb214d04 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:08.138841 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a349a3b-4e52-4d7e-94c9-ac87fb214d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:08.139115 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a349a3b-4e52-4d7e-94c9-ac87fb214d04 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:08.157102 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a349a3b-4e52-4d7e-94c9-ac87fb214d04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:08.157102 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a349a3b-4e52-4d7e-94c9-ac87fb214d04 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:08.294075 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2897/5816] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:31:08 2022] POST /identity/v3/users => generated 294 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:08.298880 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09433d0c-6564-4762-81fa-5ab1e078b3cf admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:08.311107 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09433d0c-6564-4762-81fa-5ab1e078b3cf admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:08.316404 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cede08c-e488-42fd-91d7-a635a275b0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:08.317070 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cede08c-e488-42fd-91d7-a635a275b0e1 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:08.317356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cede08c-e488-42fd-91d7-a635a275b0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:08.317783 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cede08c-e488-42fd-91d7-a635a275b0e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:08.318543 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cede08c-e488-42fd-91d7-a635a275b0e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:08.320790 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cede08c-e488-42fd-91d7-a635a275b0e1 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:08.321570 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a349a3b-4e52-4d7e-94c9-ac87fb214d04 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:08.323857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6a349a3b-4e52-4d7e-94c9-ac87fb214d04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:08.338867 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2920/5817] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:31:08.343377 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a349a3b-4e52-4d7e-94c9-ac87fb214d04 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:08.343523 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cede08c-e488-42fd-91d7-a635a275b0e1 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:08.347876 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d26066-bb79-46e2-a472-51dfd29cedfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:08.351788 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d26066-bb79-46e2-a472-51dfd29cedfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:08.352367 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d26066-bb79-46e2-a472-51dfd29cedfb admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:08.354929 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d26066-bb79-46e2-a472-51dfd29cedfb admin admin] PATH_INFO: `/v3/projects/ea3d40544a294961bbdfc28b725eb727` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:08.355036 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cede08c-e488-42fd-91d7-a635a275b0e1 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:08.356841 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d26066-bb79-46e2-a472-51dfd29cedfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea3d40544a294961bbdfc28b725eb727)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:08.359384 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d26066-bb79-46e2-a472-51dfd29cedfb admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:08.361336 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303c268-58b6-4e85-886e-262f50ee8b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:08.362103 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303c268-58b6-4e85-886e-262f50ee8b36 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:08.362391 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303c268-58b6-4e85-886e-262f50ee8b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:08.362944 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303c268-58b6-4e85-886e-262f50ee8b36 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:08.363482 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f303c268-58b6-4e85-886e-262f50ee8b36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:08.369179 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f303c268-58b6-4e85-886e-262f50ee8b36 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:08.383251 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2921/5818] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:31:08.387149 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303c268-58b6-4e85-886e-262f50ee8b36 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:08.399764 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303c268-58b6-4e85-886e-262f50ee8b36 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:08.405848 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348aca2-3685-4e0d-85c2-d38302efaa0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:08.407531 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348aca2-3685-4e0d-85c2-d38302efaa0f admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:08.407822 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348aca2-3685-4e0d-85c2-d38302efaa0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:08.408322 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348aca2-3685-4e0d-85c2-d38302efaa0f admin admin] PATH_INFO: `/v3/projects/2351947391ae4026aed02429c78eba17/users/fb884e25340e49d8996128cc01c1691c/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:08.430569 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b348aca2-3685-4e0d-85c2-d38302efaa0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2351947391ae4026aed02429c78eba17, user_id=fb884e25340e49d8996128cc01c1691c, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:08.433915 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b348aca2-3685-4e0d-85c2-d38302efaa0f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:08.543241 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2922/5819] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:31:08 2022] PUT /identity/v3/projects/2351947391ae4026aed02429c78eba17/users/fb884e25340e49d8996128cc01c1691c/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:08.548301 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92696d-8f27-426f-a008-c7df524260ae None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:08.549244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92696d-8f27-426f-a008-c7df524260ae None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:08.549795 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab92696d-8f27-426f-a008-c7df524260ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:08.577890 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-86d26066-bb79-46e2-a472-51dfd29cedfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea3d40544a294961bbdfc28b725eb727', 'request_id': 'req-86d26066-bb79-46e2-a472-51dfd29cedfb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:08.594227 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-ab92696d-8f27-426f-a008-c7df524260ae None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:08.597277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-86d26066-bb79-46e2-a472-51dfd29cedfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea3d40544a294961bbdfc28b725eb727', 'request_id': 'req-86d26066-bb79-46e2-a472-51dfd29cedfb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:08.599194 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ab92696d-8f27-426f-a008-c7df524260ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:08.628982 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-86d26066-bb79-46e2-a472-51dfd29cedfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea3d40544a294961bbdfc28b725eb727', 'request_id': 'req-86d26066-bb79-46e2-a472-51dfd29cedfb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:08.712442 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2923/5820] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:08.715343 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-86d26066-bb79-46e2-a472-51dfd29cedfb admin admin] The token cache is being invalidate because project ea3d40544a294961bbdfc28b725eb727 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:08.716615 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-86d26066-bb79-46e2-a472-51dfd29cedfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:08.718596 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-86d26066-bb79-46e2-a472-51dfd29cedfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:08.720926 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2898/5821] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:31:08 2022] DELETE /identity/v3/projects/ea3d40544a294961bbdfc28b725eb727 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:08.730797 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9871a1-d252-4c99-a204-6369e8e27228 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:08.730797 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9871a1-d252-4c99-a204-6369e8e27228 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:08.730797 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9871a1-d252-4c99-a204-6369e8e27228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:08.731565 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d26066-bb79-46e2-a472-51dfd29cedfb admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:08.732188 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-86d26066-bb79-46e2-a472-51dfd29cedfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:08.788714 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-ba9871a1-d252-4c99-a204-6369e8e27228 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:08.792320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ba9871a1-d252-4c99-a204-6369e8e27228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:08.835954 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2924/5822] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:08.837593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a23af-e8b1-49b7-8454-2489d852b159 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:08.840633 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a23af-e8b1-49b7-8454-2489d852b159 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:08.841075 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a23af-e8b1-49b7-8454-2489d852b159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:08.883529 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d26066-bb79-46e2-a472-51dfd29cedfb admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:08.891931 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-676a23af-e8b1-49b7-8454-2489d852b159 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:08.892614 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075832d-6c75-4be7-8067-c5c6246bdd04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:08.893285 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075832d-6c75-4be7-8067-c5c6246bdd04 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:08.893561 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075832d-6c75-4be7-8067-c5c6246bdd04 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:08.893864 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7075832d-6c75-4be7-8067-c5c6246bdd04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:08.895803 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-676a23af-e8b1-49b7-8454-2489d852b159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:08.903508 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7075832d-6c75-4be7-8067-c5c6246bdd04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:08.917796 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2925/5823] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:08.918633 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7075832d-6c75-4be7-8067-c5c6246bdd04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:08.920110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7075832d-6c75-4be7-8067-c5c6246bdd04 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:08.922546 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a23af-e8b1-49b7-8454-2489d852b159 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:08.932203 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2899/5824] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:31:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:31:08.935121 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a23af-e8b1-49b7-8454-2489d852b159 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:08.941277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4fe57-796a-4995-a8b9-c8b9269dd8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:08.941977 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4fe57-796a-4995-a8b9-c8b9269dd8f2 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:08.942446 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4fe57-796a-4995-a8b9-c8b9269dd8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:08.942875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4fe57-796a-4995-a8b9-c8b9269dd8f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:08.943759 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b4fe57-796a-4995-a8b9-c8b9269dd8f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:31:08.944383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b4fe57-796a-4995-a8b9-c8b9269dd8f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:08.946976 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b4fe57-796a-4995-a8b9-c8b9269dd8f2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:08.965384 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2926/5825] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:31:08.969735 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075832d-6c75-4be7-8067-c5c6246bdd04 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:08.981282 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7075832d-6c75-4be7-8067-c5c6246bdd04 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:08.988105 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4d60d-0b4a-4191-886a-508dfc09e429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:08.989509 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4d60d-0b4a-4191-886a-508dfc09e429 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:08.990005 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4d60d-0b4a-4191-886a-508dfc09e429 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:08.990430 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4d60d-0b4a-4191-886a-508dfc09e429 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:08.991327 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4d60d-0b4a-4191-886a-508dfc09e429 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:08.994442 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4d60d-0b4a-4191-886a-508dfc09e429 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:09.105566 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2900/5826] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:31:08 2022] POST /identity/v3/projects => generated 367 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:09.109965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4fe57-796a-4995-a8b9-c8b9269dd8f2 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:09.154377 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4fe57-796a-4995-a8b9-c8b9269dd8f2 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:09.263360 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7dd6e-bf5c-4600-8dea-40b9ed97e89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:09.263360 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7dd6e-bf5c-4600-8dea-40b9ed97e89e admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:09.263717 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7dd6e-bf5c-4600-8dea-40b9ed97e89e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:09.263998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7dd6e-bf5c-4600-8dea-40b9ed97e89e admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:09.271427 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca7dd6e-bf5c-4600-8dea-40b9ed97e89e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:09.271427 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca7dd6e-bf5c-4600-8dea-40b9ed97e89e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:09.351881 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2927/5827] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:31:09 2022] POST /identity/v3/users => generated 284 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:09.355684 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4d60d-0b4a-4191-886a-508dfc09e429 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:09.376578 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4d60d-0b4a-4191-886a-508dfc09e429 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:09.397881 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6476768-bc5f-4db1-bf66-e8a1fab3fa2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:09.406998 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6476768-bc5f-4db1-bf66-e8a1fab3fa2c admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:09.407335 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6476768-bc5f-4db1-bf66-e8a1fab3fa2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:09.407619 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6476768-bc5f-4db1-bf66-e8a1fab3fa2c admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:09.409133 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6476768-bc5f-4db1-bf66-e8a1fab3fa2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:09.416016 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6476768-bc5f-4db1-bf66-e8a1fab3fa2c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:09.448303 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7dd6e-bf5c-4600-8dea-40b9ed97e89e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:09.448900 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2901/5828] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:31:09.465939 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7dd6e-bf5c-4600-8dea-40b9ed97e89e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:09.480352 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad5dd7-372d-46e6-91f5-2ba5500301f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:09.482327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad5dd7-372d-46e6-91f5-2ba5500301f2 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:09.482839 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad5dd7-372d-46e6-91f5-2ba5500301f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:09.483267 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad5dd7-372d-46e6-91f5-2ba5500301f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:09.484160 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad5dd7-372d-46e6-91f5-2ba5500301f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:09.489514 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad5dd7-372d-46e6-91f5-2ba5500301f2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:09.558505 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6476768-bc5f-4db1-bf66-e8a1fab3fa2c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:09.560134 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2928/5829] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:31:09.575223 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6476768-bc5f-4db1-bf66-e8a1fab3fa2c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:09.608551 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8ad1a-eef0-443a-ad28-58cc4a197bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:09.609991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8ad1a-eef0-443a-ad28-58cc4a197bee admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:09.610288 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8ad1a-eef0-443a-ad28-58cc4a197bee admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:09.610572 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8ad1a-eef0-443a-ad28-58cc4a197bee admin admin] PATH_INFO: `/v3/projects/646fe052aa8d43d5874f7a0e73b589bd/users/3d795d130fbb4d85ae7b14367ba922a6/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:09.669506 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a8ad1a-eef0-443a-ad28-58cc4a197bee admin admin] RBAC: Authorizing `identity:create_grant(project_id=646fe052aa8d43d5874f7a0e73b589bd, user_id=3d795d130fbb4d85ae7b14367ba922a6, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:09.672574 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a8ad1a-eef0-443a-ad28-58cc4a197bee admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:09.790300 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2902/5830] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:31:09 2022] PUT /identity/v3/projects/646fe052aa8d43d5874f7a0e73b589bd/users/3d795d130fbb4d85ae7b14367ba922a6/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:09.802904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b4ff1-e8e6-46d5-923d-3d592eb35bb3 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:09.803484 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b4ff1-e8e6-46d5-923d-3d592eb35bb3 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:09.803918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b4ff1-e8e6-46d5-923d-3d592eb35bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:09.840726 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-289b4ff1-e8e6-46d5-923d-3d592eb35bb3 None None] MFA Rules not processed for user `3d795d130fbb4d85ae7b14367ba922a6`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:09.842836 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-289b4ff1-e8e6-46d5-923d-3d592eb35bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:09.956833 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2929/5831] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:09 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:09.961395 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8ad1a-eef0-443a-ad28-58cc4a197bee admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:10.040500 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8ad1a-eef0-443a-ad28-58cc4a197bee admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:10.045465 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290bf05-0e03-4381-97b4-59aef568cba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:10.046187 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290bf05-0e03-4381-97b4-59aef568cba4 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:10.046477 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290bf05-0e03-4381-97b4-59aef568cba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:10.046754 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290bf05-0e03-4381-97b4-59aef568cba4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:10.047452 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290bf05-0e03-4381-97b4-59aef568cba4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:10.050026 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290bf05-0e03-4381-97b4-59aef568cba4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:10.221369 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2903/5832] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:31:09 2022] POST /identity/v3/projects => generated 369 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:10.225420 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b4ff1-e8e6-46d5-923d-3d592eb35bb3 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:10.237197 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b4ff1-e8e6-46d5-923d-3d592eb35bb3 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:10.309961 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853713c6-5dc7-4384-9471-307025d64701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:10.309961 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853713c6-5dc7-4384-9471-307025d64701 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:10.309961 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853713c6-5dc7-4384-9471-307025d64701 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:10.309961 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853713c6-5dc7-4384-9471-307025d64701 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:10.310358 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853713c6-5dc7-4384-9471-307025d64701 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:10.310437 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853713c6-5dc7-4384-9471-307025d64701 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:10.422984 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2930/5833] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:31:10 2022] POST /identity/v3/users => generated 291 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:31:10.426705 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290bf05-0e03-4381-97b4-59aef568cba4 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:10.438993 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290bf05-0e03-4381-97b4-59aef568cba4 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:10.453177 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c4844-25fb-4a2b-afde-500b4305fe15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:10.455507 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c4844-25fb-4a2b-afde-500b4305fe15 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:10.455507 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c4844-25fb-4a2b-afde-500b4305fe15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:10.455507 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c4844-25fb-4a2b-afde-500b4305fe15 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:10.456201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c4844-25fb-4a2b-afde-500b4305fe15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:10.457915 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c4844-25fb-4a2b-afde-500b4305fe15 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:10.469938 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2904/5834] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:31:10.474983 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853713c6-5dc7-4384-9471-307025d64701 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:10.485426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853713c6-5dc7-4384-9471-307025d64701 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:10.498748 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262707c7-0ca0-4faf-8cc7-03a65f821614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:10.499576 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262707c7-0ca0-4faf-8cc7-03a65f821614 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:10.499848 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262707c7-0ca0-4faf-8cc7-03a65f821614 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:10.500162 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262707c7-0ca0-4faf-8cc7-03a65f821614 admin admin] PATH_INFO: `/v3/projects/b0eadb2408e3432197d962381545e5c6/users/2db8b2c157c9444cb813546aeda84c86/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:10.528878 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262707c7-0ca0-4faf-8cc7-03a65f821614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0eadb2408e3432197d962381545e5c6, user_id=2db8b2c157c9444cb813546aeda84c86, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:10.531655 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262707c7-0ca0-4faf-8cc7-03a65f821614 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:10.615522 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2931/5835] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:31:10 2022] PUT /identity/v3/projects/b0eadb2408e3432197d962381545e5c6/users/2db8b2c157c9444cb813546aeda84c86/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:31:10.619558 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c4844-25fb-4a2b-afde-500b4305fe15 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:10.633642 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c4844-25fb-4a2b-afde-500b4305fe15 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:10.741375 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a2adc8-a095-434a-a6c7-215aa614fcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:10.742269 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a2adc8-a095-434a-a6c7-215aa614fcf4 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:10.742685 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a2adc8-a095-434a-a6c7-215aa614fcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:10.743061 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a2adc8-a095-434a-a6c7-215aa614fcf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:10.744990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a2adc8-a095-434a-a6c7-215aa614fcf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:10.747358 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a2adc8-a095-434a-a6c7-215aa614fcf4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:10.763642 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2905/5836] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:31:10.768069 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262707c7-0ca0-4faf-8cc7-03a65f821614 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:10.783325 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262707c7-0ca0-4faf-8cc7-03a65f821614 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:10.797823 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e1efd-3951-4b33-951c-2faaf8a8c36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:10.797823 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e1efd-3951-4b33-951c-2faaf8a8c36d admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:10.797823 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e1efd-3951-4b33-951c-2faaf8a8c36d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:10.797823 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e1efd-3951-4b33-951c-2faaf8a8c36d admin admin] PATH_INFO: `/v3/projects/b0eadb2408e3432197d962381545e5c6/users/2db8b2c157c9444cb813546aeda84c86/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:10.798247 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e1efd-3951-4b33-951c-2faaf8a8c36d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0eadb2408e3432197d962381545e5c6, user_id=2db8b2c157c9444cb813546aeda84c86, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:10.799676 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e1efd-3951-4b33-951c-2faaf8a8c36d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:10.811555 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2932/5837] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:31:10 2022] PUT /identity/v3/projects/b0eadb2408e3432197d962381545e5c6/users/2db8b2c157c9444cb813546aeda84c86/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:10.822511 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a226ce4-72ed-4bc6-a8c8-c1e4f6aa22b2 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:10.822888 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a226ce4-72ed-4bc6-a8c8-c1e4f6aa22b2 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:10.823646 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a226ce4-72ed-4bc6-a8c8-c1e4f6aa22b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:10.893000 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-6a226ce4-72ed-4bc6-a8c8-c1e4f6aa22b2 None None] MFA Rules not processed for user `2db8b2c157c9444cb813546aeda84c86`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:10.902762 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6a226ce4-72ed-4bc6-a8c8-c1e4f6aa22b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:11.000787 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08434a5d-da9b-464b-80a9-18707473bd89 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:11.001302 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08434a5d-da9b-464b-80a9-18707473bd89 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:11.001978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08434a5d-da9b-464b-80a9-18707473bd89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:11.059046 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-08434a5d-da9b-464b-80a9-18707473bd89 None None] MFA Rules not processed for user `fb884e25340e49d8996128cc01c1691c`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:11.061249 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-08434a5d-da9b-464b-80a9-18707473bd89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:11.079693 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2906/5838] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:10 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:11.084939 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a226ce4-72ed-4bc6-a8c8-c1e4f6aa22b2 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:11.097945 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a226ce4-72ed-4bc6-a8c8-c1e4f6aa22b2 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:11.103570 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495bdae5-a226-45b0-aafb-bf01c4cef4cc tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:11.104322 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bdae5-a226-45b0-aafb-bf01c4cef4cc tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:11.109865 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bdae5-a226-45b0-aafb-bf01c4cef4cc tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:11.109865 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bdae5-a226-45b0-aafb-bf01c4cef4cc tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:11.113418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495bdae5-a226-45b0-aafb-bf01c4cef4cc tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:11.115742 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495bdae5-a226-45b0-aafb-bf01c4cef4cc tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:11.191505 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2933/5839] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:31:11.208751 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64808a70-8f2d-4350-9c9b-95ad4a31e83c None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:11.209120 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64808a70-8f2d-4350-9c9b-95ad4a31e83c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:11.209473 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64808a70-8f2d-4350-9c9b-95ad4a31e83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:11.235369 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-64808a70-8f2d-4350-9c9b-95ad4a31e83c None None] MFA Rules not processed for user `fb884e25340e49d8996128cc01c1691c`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:11.238166 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-64808a70-8f2d-4350-9c9b-95ad4a31e83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:11.250781 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2934/5840] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:31:11.255497 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2907/5841] 10.222.0.23 () {60 vars in 1151 bytes} [Sat Apr 30 21:31:11 2022] POST /identity/v3/projects => generated 328 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:31:11.257348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64808a70-8f2d-4350-9c9b-95ad4a31e83c None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:11.265136 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-64808a70-8f2d-4350-9c9b-95ad4a31e83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:11.296010 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495bdae5-a226-45b0-aafb-bf01c4cef4cc tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:11.415888 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64808a70-8f2d-4350-9c9b-95ad4a31e83c None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:11.493073 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495bdae5-a226-45b0-aafb-bf01c4cef4cc tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:11.501424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3411e0d-08c8-4479-813f-7cef710dca2c tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:11.502261 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3411e0d-08c8-4479-813f-7cef710dca2c tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:11.502700 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3411e0d-08c8-4479-813f-7cef710dca2c tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:11.503298 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3411e0d-08c8-4479-813f-7cef710dca2c tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:11.504654 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3411e0d-08c8-4479-813f-7cef710dca2c tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:11.510567 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3411e0d-08c8-4479-813f-7cef710dca2c tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:11.519813 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e7382-364b-4cac-975b-3a8c134b5307 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:11.521602 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e7382-364b-4cac-975b-3a8c134b5307 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:11.522027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e7382-364b-4cac-975b-3a8c134b5307 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:11.522512 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e7382-364b-4cac-975b-3a8c134b5307 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:11.639602 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e7382-364b-4cac-975b-3a8c134b5307 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:11.641240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e7382-364b-4cac-975b-3a8c134b5307 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:11.659651 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2935/5842] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:31:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:31:11.664468 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2908/5843] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:31:11 2022] POST /identity/v3/users => generated 413 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:11.676669 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e7382-364b-4cac-975b-3a8c134b5307 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:11.688166 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e7382-364b-4cac-975b-3a8c134b5307 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:11.696108 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523986c-a4eb-47d2-aadc-e5dc916e5cc4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:11.697052 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523986c-a4eb-47d2-aadc-e5dc916e5cc4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:11.697455 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523986c-a4eb-47d2-aadc-e5dc916e5cc4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:11.697923 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523986c-a4eb-47d2-aadc-e5dc916e5cc4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:11.712247 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523986c-a4eb-47d2-aadc-e5dc916e5cc4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:11.714273 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523986c-a4eb-47d2-aadc-e5dc916e5cc4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:11.826191 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2936/5844] 10.222.0.23 () {60 vars in 1142 bytes} [Sat Apr 30 21:31:11 2022] POST /identity/v3/roles => generated 244 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:11.831173 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3411e0d-08c8-4479-813f-7cef710dca2c tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:11.853166 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3411e0d-08c8-4479-813f-7cef710dca2c tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:11.861484 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1a43e-7af1-40ff-94c1-c22cae992bfc tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:11.862308 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1a43e-7af1-40ff-94c1-c22cae992bfc tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:11.866332 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1a43e-7af1-40ff-94c1-c22cae992bfc tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:11.866332 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1a43e-7af1-40ff-94c1-c22cae992bfc tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:11.866966 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1a43e-7af1-40ff-94c1-c22cae992bfc tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:11.868989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1a43e-7af1-40ff-94c1-c22cae992bfc tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:11.984884 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2909/5845] 10.222.0.23 () {60 vars in 1142 bytes} [Sat Apr 30 21:31:11 2022] POST /identity/v3/roles => generated 247 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:11.990057 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523986c-a4eb-47d2-aadc-e5dc916e5cc4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:12.009004 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523986c-a4eb-47d2-aadc-e5dc916e5cc4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:12.031330 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01751271-d9b8-4ff0-a1d5-4b96f38cf61a tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:12.032261 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01751271-d9b8-4ff0-a1d5-4b96f38cf61a tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:12.032546 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01751271-d9b8-4ff0-a1d5-4b96f38cf61a tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:12.032850 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01751271-d9b8-4ff0-a1d5-4b96f38cf61a tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/projects/b58b2b9502484beea3e4f3416ce93139/users/1cb343e1884346c9816852d49b00e96e/roles/deae237eabe145abba8040273fa85b45` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:12.058920 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01751271-d9b8-4ff0-a1d5-4b96f38cf61a tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b58b2b9502484beea3e4f3416ce93139, user_id=1cb343e1884346c9816852d49b00e96e, role_id=deae237eabe145abba8040273fa85b45)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:12.062486 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01751271-d9b8-4ff0-a1d5-4b96f38cf61a tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:12.121471 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1a43e-7af1-40ff-94c1-c22cae992bfc tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:12.128653 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b7f1a43e-7af1-40ff-94c1-c22cae992bfc tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:12.184207 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1a43e-7af1-40ff-94c1-c22cae992bfc tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:12.186081 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2937/5846] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:31:11 2022] PUT /identity/v3/projects/b58b2b9502484beea3e4f3416ce93139/users/1cb343e1884346c9816852d49b00e96e/roles/deae237eabe145abba8040273fa85b45 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:12.187182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01751271-d9b8-4ff0-a1d5-4b96f38cf61a tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:12.305601 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01751271-d9b8-4ff0-a1d5-4b96f38cf61a tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:12.312304 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc736325-399f-4d34-9e3e-650b23037d8e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:12.312759 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc736325-399f-4d34-9e3e-650b23037d8e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:12.313122 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc736325-399f-4d34-9e3e-650b23037d8e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:12.313328 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc736325-399f-4d34-9e3e-650b23037d8e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/projects/b58b2b9502484beea3e4f3416ce93139/users/1cb343e1884346c9816852d49b00e96e/roles/b2e16296963f4162a70af4eca17bad93` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:12.318297 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc736325-399f-4d34-9e3e-650b23037d8e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b58b2b9502484beea3e4f3416ce93139, user_id=1cb343e1884346c9816852d49b00e96e, role_id=b2e16296963f4162a70af4eca17bad93)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:12.319943 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc736325-399f-4d34-9e3e-650b23037d8e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:12.346668 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c9d3b-a58e-4310-9c86-49e6d942db23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:12.349074 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c9d3b-a58e-4310-9c86-49e6d942db23 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:12.349374 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c9d3b-a58e-4310-9c86-49e6d942db23 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:12.349660 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c9d3b-a58e-4310-9c86-49e6d942db23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:12.352024 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-9e7c9d3b-a58e-4310-9c86-49e6d942db23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:12.376326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c9d3b-a58e-4310-9c86-49e6d942db23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:12.383502 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c9d3b-a58e-4310-9c86-49e6d942db23 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:12.401558 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2910/5847] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:31:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:31:12.416946 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2938/5848] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:31:12 2022] PUT /identity/v3/projects/b58b2b9502484beea3e4f3416ce93139/users/1cb343e1884346c9816852d49b00e96e/roles/b2e16296963f4162a70af4eca17bad93 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:12.421342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c9d3b-a58e-4310-9c86-49e6d942db23 service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:12.453725 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c9d3b-a58e-4310-9c86-49e6d942db23 service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:12.547254 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd14e8-4321-4a06-a01f-6c0bf61a8e58 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:12.547573 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd14e8-4321-4a06-a01f-6c0bf61a8e58 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:12.547858 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd14e8-4321-4a06-a01f-6c0bf61a8e58 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:12.548135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd14e8-4321-4a06-a01f-6c0bf61a8e58 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:12.549146 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd14e8-4321-4a06-a01f-6c0bf61a8e58 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:12.551189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd14e8-4321-4a06-a01f-6c0bf61a8e58 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:12.599860 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2911/5849] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:31:12 2022] GET /identity/v3/users => generated 8048 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:31:12.604547 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f12d8-e544-4219-a6e2-8a97f5c41133 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:12.605088 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f12d8-e544-4219-a6e2-8a97f5c41133 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:12.605088 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f12d8-e544-4219-a6e2-8a97f5c41133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:12.676136 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-9a3f12d8-e544-4219-a6e2-8a97f5c41133 None None] MFA Rules not processed for user `1cb343e1884346c9816852d49b00e96e`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:12.677473 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9a3f12d8-e544-4219-a6e2-8a97f5c41133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:12.755117 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2939/5850] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:12 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:12.771503 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33763e5a-6cdd-4b60-9c67-210a0bcd77b5 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:12.772079 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33763e5a-6cdd-4b60-9c67-210a0bcd77b5 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:12.772395 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33763e5a-6cdd-4b60-9c67-210a0bcd77b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:12.819039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-33763e5a-6cdd-4b60-9c67-210a0bcd77b5 None None] MFA Rules not processed for user `1cb343e1884346c9816852d49b00e96e`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:12.820524 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-33763e5a-6cdd-4b60-9c67-210a0bcd77b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:12.833105 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2912/5851] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:12 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:12.837478 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f12d8-e544-4219-a6e2-8a97f5c41133 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:12.850580 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f12d8-e544-4219-a6e2-8a97f5c41133 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:12.856371 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c30fdf-ec7d-4c43-b298-1e6513d0693f tempest-TrustsV3TestJSON-699186449 tempest-user-408102238] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cb343e1884346c9816852d49b00e96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b58b2b9502484beea3e4f3416ce93139', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1774792757', 'tempest-NotDelegatedRole-1517380742'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:12.856899 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c30fdf-ec7d-4c43-b298-1e6513d0693f tempest-TrustsV3TestJSON-699186449 tempest-user-408102238] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:12.857204 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c30fdf-ec7d-4c43-b298-1e6513d0693f tempest-TrustsV3TestJSON-699186449 tempest-user-408102238] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:12.857469 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c30fdf-ec7d-4c43-b298-1e6513d0693f tempest-TrustsV3TestJSON-699186449 tempest-user-408102238] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:12.858410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c30fdf-ec7d-4c43-b298-1e6513d0693f tempest-TrustsV3TestJSON-699186449 tempest-user-408102238] RBAC: Authorizing `identity:create_trust()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:12.859831 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c30fdf-ec7d-4c43-b298-1e6513d0693f tempest-TrustsV3TestJSON-699186449 tempest-user-408102238] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:13.061458 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2940/5852] 10.222.0.23 () {60 vars in 1173 bytes} [Sat Apr 30 21:31:12 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:31:13.066709 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33763e5a-6cdd-4b60-9c67-210a0bcd77b5 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:13.089457 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33763e5a-6cdd-4b60-9c67-210a0bcd77b5 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:13.097203 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895cbeb-75b0-4659-962e-de0d6792fa28 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:13.098441 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895cbeb-75b0-4659-962e-de0d6792fa28 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:13.099434 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895cbeb-75b0-4659-962e-de0d6792fa28 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:13.100240 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895cbeb-75b0-4659-962e-de0d6792fa28 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:13.101080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f895cbeb-75b0-4659-962e-de0d6792fa28 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:13.102251 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-f895cbeb-75b0-4659-962e-de0d6792fa28 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:31:13.102251 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:31:13.102251 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:31:13.104020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f895cbeb-75b0-4659-962e-de0d6792fa28 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:13.121882 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c30fdf-ec7d-4c43-b298-1e6513d0693f tempest-TrustsV3TestJSON-699186449 tempest-user-408102238] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:13.122780 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2913/5853] 10.222.0.23 () {58 vars in 1154 bytes} [Sat Apr 30 21:31:13 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:31:13.151612 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c30fdf-ec7d-4c43-b298-1e6513d0693f tempest-TrustsV3TestJSON-699186449 tempest-user-408102238] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:13.172943 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a8dda-7a14-49f7-9d6d-362ec7dccf69 tempest-TrustsV3TestJSON-699186449 tempest-user-408102238] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cb343e1884346c9816852d49b00e96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b58b2b9502484beea3e4f3416ce93139', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1774792757', 'tempest-NotDelegatedRole-1517380742'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:13.177072 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a8dda-7a14-49f7-9d6d-362ec7dccf69 tempest-TrustsV3TestJSON-699186449 tempest-user-408102238] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:13.177363 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a8dda-7a14-49f7-9d6d-362ec7dccf69 tempest-TrustsV3TestJSON-699186449 tempest-user-408102238] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:13.177801 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a8dda-7a14-49f7-9d6d-362ec7dccf69 tempest-TrustsV3TestJSON-699186449 tempest-user-408102238] PATH_INFO: `/v3/OS-TRUST/trusts/15ba38205269491fbec60b3aa08e18ff` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:13.203363 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19a8dda-7a14-49f7-9d6d-362ec7dccf69 tempest-TrustsV3TestJSON-699186449 tempest-user-408102238] RBAC: Authorizing `identity:delete_trust(trust_id=15ba38205269491fbec60b3aa08e18ff)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:13.204892 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19a8dda-7a14-49f7-9d6d-362ec7dccf69 tempest-TrustsV3TestJSON-699186449 tempest-user-408102238] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:13.302939 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b19a8dda-7a14-49f7-9d6d-362ec7dccf69 tempest-TrustsV3TestJSON-699186449 tempest-user-408102238] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '15ba38205269491fbec60b3aa08e18ff', 'request_id': 'req-b19a8dda-7a14-49f7-9d6d-362ec7dccf69'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:13.304479 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b19a8dda-7a14-49f7-9d6d-362ec7dccf69 tempest-TrustsV3TestJSON-699186449 tempest-user-408102238] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '15ba38205269491fbec60b3aa08e18ff', 'request_id': 'req-b19a8dda-7a14-49f7-9d6d-362ec7dccf69'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:13.305055 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895cbeb-75b0-4659-962e-de0d6792fa28 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:13.307223 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f895cbeb-75b0-4659-962e-de0d6792fa28 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:13.428435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b19a8dda-7a14-49f7-9d6d-362ec7dccf69 tempest-TrustsV3TestJSON-699186449 tempest-user-408102238] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '15ba38205269491fbec60b3aa08e18ff', 'request_id': 'req-b19a8dda-7a14-49f7-9d6d-362ec7dccf69'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:13.441883 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2941/5854] 10.222.0.23 () {58 vars in 1253 bytes} [Sat Apr 30 21:31:13 2022] DELETE /identity/v3/OS-TRUST/trusts/15ba38205269491fbec60b3aa08e18ff => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:31:13.443310 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895cbeb-75b0-4659-962e-de0d6792fa28 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:13.445814 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a8dda-7a14-49f7-9d6d-362ec7dccf69 tempest-TrustsV3TestJSON-699186449 tempest-user-408102238] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:13.447793 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b19a8dda-7a14-49f7-9d6d-362ec7dccf69 tempest-TrustsV3TestJSON-699186449 tempest-user-408102238] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:13.448734 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f69733-1c6a-4ca8-a615-641d5192ba79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:13.449613 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f69733-1c6a-4ca8-a615-641d5192ba79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:13.452130 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f69733-1c6a-4ca8-a615-641d5192ba79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:13.452423 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f69733-1c6a-4ca8-a615-641d5192ba79 admin admin] PATH_INFO: `/v3/users/fb884e25340e49d8996128cc01c1691c` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:13.453668 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f69733-1c6a-4ca8-a615-641d5192ba79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb884e25340e49d8996128cc01c1691c)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:13.456388 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f69733-1c6a-4ca8-a615-641d5192ba79 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:13.476178 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a8dda-7a14-49f7-9d6d-362ec7dccf69 tempest-TrustsV3TestJSON-699186449 tempest-user-408102238] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:13.481645 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadac400-1f93-41fb-916b-097e0b105a50 tempest-TrustsV3TestJSON-699186449 tempest-user-408102238] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cb343e1884346c9816852d49b00e96e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b58b2b9502484beea3e4f3416ce93139', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1774792757', 'tempest-NotDelegatedRole-1517380742'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:13.482625 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadac400-1f93-41fb-916b-097e0b105a50 tempest-TrustsV3TestJSON-699186449 tempest-user-408102238] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:13.482843 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadac400-1f93-41fb-916b-097e0b105a50 tempest-TrustsV3TestJSON-699186449 tempest-user-408102238] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:13.486025 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadac400-1f93-41fb-916b-097e0b105a50 tempest-TrustsV3TestJSON-699186449 tempest-user-408102238] PATH_INFO: `/v3/OS-TRUST/trusts/15ba38205269491fbec60b3aa08e18ff` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:13.536429 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-eadac400-1f93-41fb-916b-097e0b105a50 tempest-TrustsV3TestJSON-699186449 tempest-user-408102238] Could not find trust: 15ba38205269491fbec60b3aa08e18ff.: keystone.exception.TrustNotFound: Could not find trust: 15ba38205269491fbec60b3aa08e18ff. Apr 30 21:31:13.536429 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:31:13.536429 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:31:13.536429 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:31:13.536429 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:31:13.536429 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:31:13.536429 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:31:13.536429 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:31:13.536429 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:31:13.536429 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:31:13.536429 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:31:13.536429 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:31:13.536429 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Apr 30 21:31:13.536429 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Apr 30 21:31:13.536429 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Apr 30 21:31:13.537383 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Apr 30 21:31:13.537383 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Apr 30 21:31:13.537383 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Apr 30 21:31:13.537383 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Apr 30 21:31:13.537383 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Apr 30 21:31:13.537383 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:31:13.537383 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:31:13.537383 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Apr 30 21:31:13.537383 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Apr 30 21:31:13.537383 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Apr 30 21:31:13.537383 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Apr 30 21:31:13.537383 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 15ba38205269491fbec60b3aa08e18ff. Apr 30 21:31:13.537383 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:31:13.538588 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2942/5855] 10.222.0.23 () {58 vars in 1250 bytes} [Sat Apr 30 21:31:13 2022] GET /identity/v3/OS-TRUST/trusts/15ba38205269491fbec60b3aa08e18ff => generated 111 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Apr 30 21:31:13.548240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadac400-1f93-41fb-916b-097e0b105a50 tempest-TrustsV3TestJSON-699186449 tempest-user-408102238] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:13.548240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-eadac400-1f93-41fb-916b-097e0b105a50 tempest-TrustsV3TestJSON-699186449 tempest-user-408102238] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:13.576748 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadac400-1f93-41fb-916b-097e0b105a50 tempest-TrustsV3TestJSON-699186449 tempest-user-408102238] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:13.581176 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36abd729-c82a-4f8d-aa96-572ff3dac6ba tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:13.582203 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abd729-c82a-4f8d-aa96-572ff3dac6ba tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:13.582565 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abd729-c82a-4f8d-aa96-572ff3dac6ba tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:13.583149 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abd729-c82a-4f8d-aa96-572ff3dac6ba tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/roles/b2e16296963f4162a70af4eca17bad93` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:13.584948 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36abd729-c82a-4f8d-aa96-572ff3dac6ba tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b2e16296963f4162a70af4eca17bad93)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:13.587328 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36abd729-c82a-4f8d-aa96-572ff3dac6ba tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:13.684450 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b8f69733-1c6a-4ca8-a615-641d5192ba79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb884e25340e49d8996128cc01c1691c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:13.712447 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b8f69733-1c6a-4ca8-a615-641d5192ba79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb884e25340e49d8996128cc01c1691c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:13.861586 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b8f69733-1c6a-4ca8-a615-641d5192ba79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb884e25340e49d8996128cc01c1691c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:13.862268 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b8f69733-1c6a-4ca8-a615-641d5192ba79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb884e25340e49d8996128cc01c1691c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:13.869938 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b8f69733-1c6a-4ca8-a615-641d5192ba79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb884e25340e49d8996128cc01c1691c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:13.875963 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2914/5856] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:31:13 2022] DELETE /identity/v3/users/fb884e25340e49d8996128cc01c1691c => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:31:13.918990 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-36abd729-c82a-4f8d-aa96-572ff3dac6ba tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invalidating the token cache because role b2e16296963f4162a70af4eca17bad93 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:13.920337 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-36abd729-c82a-4f8d-aa96-572ff3dac6ba tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:13.921366 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-36abd729-c82a-4f8d-aa96-572ff3dac6ba tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:13.924143 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2943/5857] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:31:13 2022] DELETE /identity/v3/roles/b2e16296963f4162a70af4eca17bad93 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:13.928244 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f69733-1c6a-4ca8-a615-641d5192ba79 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:13.932286 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b8f69733-1c6a-4ca8-a615-641d5192ba79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:14.038093 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f69733-1c6a-4ca8-a615-641d5192ba79 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:14.209193 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068573af-cae4-4125-89a7-b91003c66a8e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:14.210285 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068573af-cae4-4125-89a7-b91003c66a8e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:14.210677 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068573af-cae4-4125-89a7-b91003c66a8e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:14.211070 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068573af-cae4-4125-89a7-b91003c66a8e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/roles/deae237eabe145abba8040273fa85b45` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:14.212886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068573af-cae4-4125-89a7-b91003c66a8e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:delete_role(role_id=deae237eabe145abba8040273fa85b45)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:14.214844 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068573af-cae4-4125-89a7-b91003c66a8e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:14.372370 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36abd729-c82a-4f8d-aa96-572ff3dac6ba tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:14.374615 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-36abd729-c82a-4f8d-aa96-572ff3dac6ba tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:14.455548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-068573af-cae4-4125-89a7-b91003c66a8e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invalidating the token cache because role deae237eabe145abba8040273fa85b45 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:14.456537 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-068573af-cae4-4125-89a7-b91003c66a8e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:14.458564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-068573af-cae4-4125-89a7-b91003c66a8e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:14.464877 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2915/5858] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:31:13 2022] DELETE /identity/v3/roles/deae237eabe145abba8040273fa85b45 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:14.468849 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068573af-cae4-4125-89a7-b91003c66a8e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:14.472552 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-068573af-cae4-4125-89a7-b91003c66a8e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:14.512267 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36abd729-c82a-4f8d-aa96-572ff3dac6ba tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:14.579021 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068573af-cae4-4125-89a7-b91003c66a8e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:14.585562 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bdbf4-ccc0-4547-a3f2-dbe09d5d11c0 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:14.586673 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bdbf4-ccc0-4547-a3f2-dbe09d5d11c0 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:14.587017 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bdbf4-ccc0-4547-a3f2-dbe09d5d11c0 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:14.587360 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bdbf4-ccc0-4547-a3f2-dbe09d5d11c0 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/users/1cb343e1884346c9816852d49b00e96e` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:14.588669 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4bdbf4-ccc0-4547-a3f2-dbe09d5d11c0 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1cb343e1884346c9816852d49b00e96e)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:14.590933 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4bdbf4-ccc0-4547-a3f2-dbe09d5d11c0 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:14.611599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff4a34-b267-467a-8910-69c5b610f34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:14.612484 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff4a34-b267-467a-8910-69c5b610f34a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:14.617925 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff4a34-b267-467a-8910-69c5b610f34a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:14.617925 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff4a34-b267-467a-8910-69c5b610f34a admin admin] PATH_INFO: `/v3/projects/2351947391ae4026aed02429c78eba17` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:14.617925 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff4a34-b267-467a-8910-69c5b610f34a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2351947391ae4026aed02429c78eba17)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:14.618241 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff4a34-b267-467a-8910-69c5b610f34a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:14.786069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-db4bdbf4-ccc0-4547-a3f2-dbe09d5d11c0 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cb343e1884346c9816852d49b00e96e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:14.794049 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-baff4a34-b267-467a-8910-69c5b610f34a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2351947391ae4026aed02429c78eba17', 'request_id': 'req-baff4a34-b267-467a-8910-69c5b610f34a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:14.804173 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-db4bdbf4-ccc0-4547-a3f2-dbe09d5d11c0 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cb343e1884346c9816852d49b00e96e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:14.812190 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-baff4a34-b267-467a-8910-69c5b610f34a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2351947391ae4026aed02429c78eba17', 'request_id': 'req-baff4a34-b267-467a-8910-69c5b610f34a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:14.825389 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-baff4a34-b267-467a-8910-69c5b610f34a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2351947391ae4026aed02429c78eba17', 'request_id': 'req-baff4a34-b267-467a-8910-69c5b610f34a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:14.894227 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-db4bdbf4-ccc0-4547-a3f2-dbe09d5d11c0 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cb343e1884346c9816852d49b00e96e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:14.894948 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-db4bdbf4-ccc0-4547-a3f2-dbe09d5d11c0 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cb343e1884346c9816852d49b00e96e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:14.904383 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-db4bdbf4-ccc0-4547-a3f2-dbe09d5d11c0 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cb343e1884346c9816852d49b00e96e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:14.915321 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2916/5859] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:31:14 2022] DELETE /identity/v3/users/1cb343e1884346c9816852d49b00e96e => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:14.920486 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bdbf4-ccc0-4547-a3f2-dbe09d5d11c0 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:14.922237 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-db4bdbf4-ccc0-4547-a3f2-dbe09d5d11c0 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:14.990285 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-baff4a34-b267-467a-8910-69c5b610f34a admin admin] The token cache is being invalidate because project 2351947391ae4026aed02429c78eba17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:14.990866 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-baff4a34-b267-467a-8910-69c5b610f34a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:14.992021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-baff4a34-b267-467a-8910-69c5b610f34a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:14.994398 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2944/5860] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:31:14 2022] DELETE /identity/v3/projects/2351947391ae4026aed02429c78eba17 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:14.999297 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0f5ba-3bf5-42ba-8e24-76820d9c5886 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:14.999589 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0f5ba-3bf5-42ba-8e24-76820d9c5886 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:14.999865 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0f5ba-3bf5-42ba-8e24-76820d9c5886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:15.036143 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-86e0f5ba-3bf5-42ba-8e24-76820d9c5886 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:15.042729 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-86e0f5ba-3bf5-42ba-8e24-76820d9c5886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:15.057109 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bdbf4-ccc0-4547-a3f2-dbe09d5d11c0 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:15.070302 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d08bfe-2959-4740-9c42-77bdb85646f4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:15.071184 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d08bfe-2959-4740-9c42-77bdb85646f4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:15.071474 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d08bfe-2959-4740-9c42-77bdb85646f4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:15.071758 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d08bfe-2959-4740-9c42-77bdb85646f4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/projects/b58b2b9502484beea3e4f3416ce93139` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:15.077360 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d08bfe-2959-4740-9c42-77bdb85646f4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b58b2b9502484beea3e4f3416ce93139)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:15.087469 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d08bfe-2959-4740-9c42-77bdb85646f4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:15.196200 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2945/5861] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:15.206785 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5e38d-7a80-4563-9bb2-36c5dae84bab None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:15.207102 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5e38d-7a80-4563-9bb2-36c5dae84bab None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:15.207352 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5e38d-7a80-4563-9bb2-36c5dae84bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:15.233588 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-75b5e38d-7a80-4563-9bb2-36c5dae84bab None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:15.235589 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-75b5e38d-7a80-4563-9bb2-36c5dae84bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:15.253254 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2946/5862] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:15.263920 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5e38d-7a80-4563-9bb2-36c5dae84bab None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:15.301472 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5e38d-7a80-4563-9bb2-36c5dae84bab None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:15.377448 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa720d6-33e8-40ea-bf90-3008f773cde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:15.378623 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa720d6-33e8-40ea-bf90-3008f773cde2 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:15.378801 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa720d6-33e8-40ea-bf90-3008f773cde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:15.379062 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa720d6-33e8-40ea-bf90-3008f773cde2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:15.379798 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa720d6-33e8-40ea-bf90-3008f773cde2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:31:15.380108 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa720d6-33e8-40ea-bf90-3008f773cde2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:15.381890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa720d6-33e8-40ea-bf90-3008f773cde2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:15.390068 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c6d08bfe-2959-4740-9c42-77bdb85646f4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b58b2b9502484beea3e4f3416ce93139', 'request_id': 'req-c6d08bfe-2959-4740-9c42-77bdb85646f4'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:15.397546 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2947/5863] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:31:15.397546 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa720d6-33e8-40ea-bf90-3008f773cde2 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:15.397931 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-baa720d6-33e8-40ea-bf90-3008f773cde2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:15.400350 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c6d08bfe-2959-4740-9c42-77bdb85646f4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b58b2b9502484beea3e4f3416ce93139', 'request_id': 'req-c6d08bfe-2959-4740-9c42-77bdb85646f4'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:15.408232 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c6d08bfe-2959-4740-9c42-77bdb85646f4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b58b2b9502484beea3e4f3416ce93139', 'request_id': 'req-c6d08bfe-2959-4740-9c42-77bdb85646f4'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:15.415032 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa720d6-33e8-40ea-bf90-3008f773cde2 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:15.420916 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6afcdb5-f183-4787-8ba7-afab45fde38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:15.424267 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6afcdb5-f183-4787-8ba7-afab45fde38c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:15.424267 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6afcdb5-f183-4787-8ba7-afab45fde38c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:15.424267 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6afcdb5-f183-4787-8ba7-afab45fde38c admin admin] PATH_INFO: `/v3/users/4f01361dce6742beb239f0dc2525b05c` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:15.424958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6afcdb5-f183-4787-8ba7-afab45fde38c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f01361dce6742beb239f0dc2525b05c)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:15.427001 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6afcdb5-f183-4787-8ba7-afab45fde38c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:15.521942 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c6d08bfe-2959-4740-9c42-77bdb85646f4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] The token cache is being invalidate because project b58b2b9502484beea3e4f3416ce93139 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:15.522247 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c6d08bfe-2959-4740-9c42-77bdb85646f4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:15.523176 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c6d08bfe-2959-4740-9c42-77bdb85646f4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:15.528888 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2917/5864] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:31:14 2022] DELETE /identity/v3/projects/b58b2b9502484beea3e4f3416ce93139 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:15.535518 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d08bfe-2959-4740-9c42-77bdb85646f4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:15.550877 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c6d08bfe-2959-4740-9c42-77bdb85646f4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:15.596295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f6afcdb5-f183-4787-8ba7-afab45fde38c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f01361dce6742beb239f0dc2525b05c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:15.617987 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f6afcdb5-f183-4787-8ba7-afab45fde38c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f01361dce6742beb239f0dc2525b05c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:15.662079 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d08bfe-2959-4740-9c42-77bdb85646f4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:15.672834 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e20ac-54fa-4a73-8d92-aa8420029b9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:15.674065 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e20ac-54fa-4a73-8d92-aa8420029b9c service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:15.674354 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e20ac-54fa-4a73-8d92-aa8420029b9c service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:15.674962 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e20ac-54fa-4a73-8d92-aa8420029b9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:15.678346 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-390e20ac-54fa-4a73-8d92-aa8420029b9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:15.696437 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e20ac-54fa-4a73-8d92-aa8420029b9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:15.698676 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e20ac-54fa-4a73-8d92-aa8420029b9c service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:15.715013 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2918/5865] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:31:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:31:15.715013 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e20ac-54fa-4a73-8d92-aa8420029b9c service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:15.715969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-390e20ac-54fa-4a73-8d92-aa8420029b9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:15.730030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e20ac-54fa-4a73-8d92-aa8420029b9c service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:15.736495 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f6afcdb5-f183-4787-8ba7-afab45fde38c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f01361dce6742beb239f0dc2525b05c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:15.736633 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf2076-c039-4919-bbf1-dfebf7f8bc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:15.736633 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf2076-c039-4919-bbf1-dfebf7f8bc57 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:15.736633 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf2076-c039-4919-bbf1-dfebf7f8bc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:15.736971 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf2076-c039-4919-bbf1-dfebf7f8bc57 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:15.737498 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf2076-c039-4919-bbf1-dfebf7f8bc57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:15.739462 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf2076-c039-4919-bbf1-dfebf7f8bc57 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:15.741170 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f6afcdb5-f183-4787-8ba7-afab45fde38c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f01361dce6742beb239f0dc2525b05c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:15.741936 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f6afcdb5-f183-4787-8ba7-afab45fde38c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f01361dce6742beb239f0dc2525b05c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:15.749565 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2948/5866] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:31:15 2022] DELETE /identity/v3/users/4f01361dce6742beb239f0dc2525b05c => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:15.754136 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6afcdb5-f183-4787-8ba7-afab45fde38c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:15.755555 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f6afcdb5-f183-4787-8ba7-afab45fde38c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:15.879996 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2919/5867] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:31:15 2022] POST /identity/v3/projects => generated 371 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:15.883206 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f151ab2-13bd-4560-b9f8-4f31010c1e4f None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:15.884731 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6afcdb5-f183-4787-8ba7-afab45fde38c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:15.885454 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f151ab2-13bd-4560-b9f8-4f31010c1e4f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:15.885785 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f151ab2-13bd-4560-b9f8-4f31010c1e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:15.948927 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-4f151ab2-13bd-4560-b9f8-4f31010c1e4f None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:15.951417 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4f151ab2-13bd-4560-b9f8-4f31010c1e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:15.988165 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755b7f0-5a39-418d-af8e-1c78104fb664 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:15.989856 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755b7f0-5a39-418d-af8e-1c78104fb664 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:15.989856 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755b7f0-5a39-418d-af8e-1c78104fb664 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:15.990222 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755b7f0-5a39-418d-af8e-1c78104fb664 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:15.991428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8755b7f0-5a39-418d-af8e-1c78104fb664 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:15.994008 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8755b7f0-5a39-418d-af8e-1c78104fb664 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:16.065866 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2920/5868] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:16.070455 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f151ab2-13bd-4560-b9f8-4f31010c1e4f None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:16.072809 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4f151ab2-13bd-4560-b9f8-4f31010c1e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:16.090648 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f151ab2-13bd-4560-b9f8-4f31010c1e4f None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:16.097106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05edf67-151d-4b2a-9e6c-d0ef8accea3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:16.103519 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2949/5869] 10.222.0.23 () {60 vars in 1151 bytes} [Sat Apr 30 21:31:15 2022] POST /identity/v3/projects => generated 328 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:16.103650 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05edf67-151d-4b2a-9e6c-d0ef8accea3d admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:16.103650 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05edf67-151d-4b2a-9e6c-d0ef8accea3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:16.103650 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05edf67-151d-4b2a-9e6c-d0ef8accea3d admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:16.103650 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05edf67-151d-4b2a-9e6c-d0ef8accea3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:16.103650 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05edf67-151d-4b2a-9e6c-d0ef8accea3d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:16.106821 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755b7f0-5a39-418d-af8e-1c78104fb664 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:16.244897 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2921/5870] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:31:16 2022] POST /identity/v3/users => generated 286 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:16.246039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05edf67-151d-4b2a-9e6c-d0ef8accea3d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:16.248578 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a05edf67-151d-4b2a-9e6c-d0ef8accea3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:16.252171 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755b7f0-5a39-418d-af8e-1c78104fb664 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:16.258918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a55b5a-0829-40b9-99bc-fa17f27d105d tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:16.259602 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a55b5a-0829-40b9-99bc-fa17f27d105d tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:16.259887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a55b5a-0829-40b9-99bc-fa17f27d105d tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:16.263418 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a55b5a-0829-40b9-99bc-fa17f27d105d tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:16.263418 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a55b5a-0829-40b9-99bc-fa17f27d105d tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:16.263418 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a55b5a-0829-40b9-99bc-fa17f27d105d tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:16.326874 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05edf67-151d-4b2a-9e6c-d0ef8accea3d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:16.396347 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2950/5871] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:31:16 2022] POST /identity/v3/users => generated 416 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:31:16.398431 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a55b5a-0829-40b9-99bc-fa17f27d105d tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:16.433656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5bf12-60ca-4992-8b23-aceaaad5c0cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:16.434826 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5bf12-60ca-4992-8b23-aceaaad5c0cc service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:16.434826 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5bf12-60ca-4992-8b23-aceaaad5c0cc service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:16.439335 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5bf12-60ca-4992-8b23-aceaaad5c0cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:16.518139 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a55b5a-0829-40b9-99bc-fa17f27d105d tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:16.528274 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca1789-f54c-48e9-a273-464347d98e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:16.529467 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca1789-f54c-48e9-a273-464347d98e05 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:16.529907 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca1789-f54c-48e9-a273-464347d98e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:16.530200 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca1789-f54c-48e9-a273-464347d98e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:16.531631 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca1789-f54c-48e9-a273-464347d98e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:16.534383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca1789-f54c-48e9-a273-464347d98e05 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:16.551570 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2951/5872] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:31:16.552695 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca1789-f54c-48e9-a273-464347d98e05 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:16.559787 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe5bf12-60ca-4992-8b23-aceaaad5c0cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:16.561427 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe5bf12-60ca-4992-8b23-aceaaad5c0cc service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:16.567683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca1789-f54c-48e9-a273-464347d98e05 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:16.574408 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082f35f-38cd-47e5-8a49-0479ccbd97bd tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:16.575441 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082f35f-38cd-47e5-8a49-0479ccbd97bd tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:16.575792 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082f35f-38cd-47e5-8a49-0479ccbd97bd tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:16.576132 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082f35f-38cd-47e5-8a49-0479ccbd97bd tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:16.578822 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d082f35f-38cd-47e5-8a49-0479ccbd97bd tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:16.579399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d082f35f-38cd-47e5-8a49-0479ccbd97bd tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:16.585258 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2922/5873] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:31:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:31:16.597498 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1601b-3167-46e1-9c46-6cb14e898b6e None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:16.597882 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1601b-3167-46e1-9c46-6cb14e898b6e None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:16.598308 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1601b-3167-46e1-9c46-6cb14e898b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:16.619447 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-34b1601b-3167-46e1-9c46-6cb14e898b6e None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:16.620857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-34b1601b-3167-46e1-9c46-6cb14e898b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:16.726996 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2952/5874] 10.222.0.23 () {60 vars in 1142 bytes} [Sat Apr 30 21:31:16 2022] POST /identity/v3/roles => generated 244 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:16.726996 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082f35f-38cd-47e5-8a49-0479ccbd97bd tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:16.774356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082f35f-38cd-47e5-8a49-0479ccbd97bd tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:16.787317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5e419-74f1-4d1f-b3ef-01938dace6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:16.788020 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5e419-74f1-4d1f-b3ef-01938dace6d6 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:16.788308 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5e419-74f1-4d1f-b3ef-01938dace6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:16.788587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5e419-74f1-4d1f-b3ef-01938dace6d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:16.792158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5e419-74f1-4d1f-b3ef-01938dace6d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:16.813775 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5e419-74f1-4d1f-b3ef-01938dace6d6 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:16.814037 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2923/5875] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:31:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:16.814037 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1601b-3167-46e1-9c46-6cb14e898b6e None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:16.822381 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2953/5876] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:31:16 2022] GET /identity/v3/roles => generated 1655 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:31:16.827155 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5e419-74f1-4d1f-b3ef-01938dace6d6 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:16.836183 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-26e5e419-74f1-4d1f-b3ef-01938dace6d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:16.837989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1601b-3167-46e1-9c46-6cb14e898b6e None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:16.847462 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c23072-8d53-4919-b7d7-4d4ab59beff3 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:16.848636 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c23072-8d53-4919-b7d7-4d4ab59beff3 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:16.849146 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c23072-8d53-4919-b7d7-4d4ab59beff3 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:16.849633 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c23072-8d53-4919-b7d7-4d4ab59beff3 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:16.851462 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c23072-8d53-4919-b7d7-4d4ab59beff3 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:16.855672 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c23072-8d53-4919-b7d7-4d4ab59beff3 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:16.992892 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2924/5877] 10.222.0.23 () {60 vars in 1142 bytes} [Sat Apr 30 21:31:16 2022] POST /identity/v3/roles => generated 245 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:16.993786 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c23072-8d53-4919-b7d7-4d4ab59beff3 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:17.013871 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c23072-8d53-4919-b7d7-4d4ab59beff3 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:17.038090 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c8e91-9a71-4f34-8cd8-a917d443c757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:17.041863 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c8e91-9a71-4f34-8cd8-a917d443c757 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:17.041863 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c8e91-9a71-4f34-8cd8-a917d443c757 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:17.041863 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c8e91-9a71-4f34-8cd8-a917d443c757 admin admin] PATH_INFO: `/v3/projects/2c946abda3d8459aa2480bf829748f68/users/49f11329a72b457286c1b8d9d468792c/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:17.057961 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5e419-74f1-4d1f-b3ef-01938dace6d6 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:17.080904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8c8c0-fd55-45cd-8f4e-c4db93d1edab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:17.080904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8c8c0-fd55-45cd-8f4e-c4db93d1edab service swift] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:17.080904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8c8c0-fd55-45cd-8f4e-c4db93d1edab service swift] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:17.080904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8c8c0-fd55-45cd-8f4e-c4db93d1edab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:17.099291 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c8e91-9a71-4f34-8cd8-a917d443c757 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c946abda3d8459aa2480bf829748f68, user_id=49f11329a72b457286c1b8d9d468792c, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:17.103600 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c8e91-9a71-4f34-8cd8-a917d443c757 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:17.112287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a8c8c0-fd55-45cd-8f4e-c4db93d1edab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:17.114076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a8c8c0-fd55-45cd-8f4e-c4db93d1edab service swift] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:17.134471 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2954/5878] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:31:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:31:17.136263 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8c8c0-fd55-45cd-8f4e-c4db93d1edab service swift] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:17.150292 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8c8c0-fd55-45cd-8f4e-c4db93d1edab service swift] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:17.155990 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95a3eb-af03-4985-8bf0-3d3eb093cc4f tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:17.157282 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95a3eb-af03-4985-8bf0-3d3eb093cc4f tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:17.158528 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95a3eb-af03-4985-8bf0-3d3eb093cc4f tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:17.158887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95a3eb-af03-4985-8bf0-3d3eb093cc4f tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/projects/856a48d840934c6dac2ad0d5b612532f/users/52516dfa134f4f3a9555b3ed3e693f01/roles/dd09aec594394ac5b553f9a77d72c3db` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:17.203811 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e95a3eb-af03-4985-8bf0-3d3eb093cc4f tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:create_grant(project_id=856a48d840934c6dac2ad0d5b612532f, user_id=52516dfa134f4f3a9555b3ed3e693f01, role_id=dd09aec594394ac5b553f9a77d72c3db)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:17.208877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e95a3eb-af03-4985-8bf0-3d3eb093cc4f tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:17.327776 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2925/5879] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:31:16 2022] PUT /identity/v3/projects/2c946abda3d8459aa2480bf829748f68/users/49f11329a72b457286c1b8d9d468792c/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:17.341170 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ca5cd-38bc-422c-becd-e24814489c07 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:17.344207 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ca5cd-38bc-422c-becd-e24814489c07 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:17.344207 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ca5cd-38bc-422c-becd-e24814489c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:17.395160 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-260ca5cd-38bc-422c-becd-e24814489c07 None None] MFA Rules not processed for user `49f11329a72b457286c1b8d9d468792c`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:17.396510 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-260ca5cd-38bc-422c-becd-e24814489c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:17.417070 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2955/5880] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:31:17 2022] PUT /identity/v3/projects/856a48d840934c6dac2ad0d5b612532f/users/52516dfa134f4f3a9555b3ed3e693f01/roles/dd09aec594394ac5b553f9a77d72c3db => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:17.421096 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95a3eb-af03-4985-8bf0-3d3eb093cc4f tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:17.511969 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2926/5881] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:31:17.513468 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ca5cd-38bc-422c-becd-e24814489c07 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:17.613370 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ca5cd-38bc-422c-becd-e24814489c07 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:17.670184 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95a3eb-af03-4985-8bf0-3d3eb093cc4f tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:17.682456 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d3304d-1f26-4e3e-80ca-b4ee129670d1 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:17.683375 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3304d-1f26-4e3e-80ca-b4ee129670d1 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:17.684343 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3304d-1f26-4e3e-80ca-b4ee129670d1 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:17.684667 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3304d-1f26-4e3e-80ca-b4ee129670d1 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/projects/856a48d840934c6dac2ad0d5b612532f/users/52516dfa134f4f3a9555b3ed3e693f01/roles/e712d9fb766b43e5b1b66dfd8497c97e` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:17.690677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d3304d-1f26-4e3e-80ca-b4ee129670d1 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:create_grant(project_id=856a48d840934c6dac2ad0d5b612532f, user_id=52516dfa134f4f3a9555b3ed3e693f01, role_id=e712d9fb766b43e5b1b66dfd8497c97e)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:17.693895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d3304d-1f26-4e3e-80ca-b4ee129670d1 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:17.706652 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e5181-f742-4c53-85e8-234e8d3ad7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:17.707200 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e5181-f742-4c53-85e8-234e8d3ad7ec admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:17.709672 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e5181-f742-4c53-85e8-234e8d3ad7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:17.710024 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e5181-f742-4c53-85e8-234e8d3ad7ec admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:17.710695 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e5181-f742-4c53-85e8-234e8d3ad7ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:17.713308 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e5181-f742-4c53-85e8-234e8d3ad7ec admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:17.793671 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2956/5882] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:31:17 2022] PUT /identity/v3/projects/856a48d840934c6dac2ad0d5b612532f/users/52516dfa134f4f3a9555b3ed3e693f01/roles/e712d9fb766b43e5b1b66dfd8497c97e => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:31:17.797143 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d3304d-1f26-4e3e-80ca-b4ee129670d1 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:17.800943 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-28d3304d-1f26-4e3e-80ca-b4ee129670d1 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:17.841429 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2927/5883] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:31:17 2022] POST /identity/v3/projects => generated 373 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:17.842159 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e5181-f742-4c53-85e8-234e8d3ad7ec admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:17.944344 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d3304d-1f26-4e3e-80ca-b4ee129670d1 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:18.008362 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e5181-f742-4c53-85e8-234e8d3ad7ec admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:18.014382 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27827e9f-10fc-477e-9587-4364a6ed9302 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:18.016344 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27827e9f-10fc-477e-9587-4364a6ed9302 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:18.016344 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27827e9f-10fc-477e-9587-4364a6ed9302 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:18.016344 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27827e9f-10fc-477e-9587-4364a6ed9302 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:18.018239 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27827e9f-10fc-477e-9587-4364a6ed9302 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:18.020531 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27827e9f-10fc-477e-9587-4364a6ed9302 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:18.055276 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79bd129-fed8-48ae-8a60-0357fffde510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:18.060246 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bd129-fed8-48ae-8a60-0357fffde510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:18.061202 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bd129-fed8-48ae-8a60-0357fffde510 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:18.062115 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bd129-fed8-48ae-8a60-0357fffde510 admin admin] PATH_INFO: `/v3/projects/d69ac7619c6f4a80866c33aabb8c3f05` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:18.064406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79bd129-fed8-48ae-8a60-0357fffde510 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d69ac7619c6f4a80866c33aabb8c3f05)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:18.066899 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79bd129-fed8-48ae-8a60-0357fffde510 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:18.076445 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2928/5884] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:31:17 2022] GET /identity/v3/users => generated 7763 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:31:18.077568 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27827e9f-10fc-477e-9587-4364a6ed9302 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:18.095890 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27827e9f-10fc-477e-9587-4364a6ed9302 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:18.103115 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097e0f4-0e53-4029-bcbe-1bfa6b3f50f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:18.103797 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097e0f4-0e53-4029-bcbe-1bfa6b3f50f7 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:18.104081 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097e0f4-0e53-4029-bcbe-1bfa6b3f50f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:18.104357 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097e0f4-0e53-4029-bcbe-1bfa6b3f50f7 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:18.105046 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e097e0f4-0e53-4029-bcbe-1bfa6b3f50f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:18.107652 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e097e0f4-0e53-4029-bcbe-1bfa6b3f50f7 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:18.228492 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2929/5885] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:31:18 2022] POST /identity/v3/users => generated 293 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:18.231033 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b248ec3-892a-4831-925a-6402597aa1ed None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:18.233514 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b248ec3-892a-4831-925a-6402597aa1ed None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:18.233514 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b248ec3-892a-4831-925a-6402597aa1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:18.237701 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d79bd129-fed8-48ae-8a60-0357fffde510 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd69ac7619c6f4a80866c33aabb8c3f05', 'request_id': 'req-d79bd129-fed8-48ae-8a60-0357fffde510'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:18.247429 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d79bd129-fed8-48ae-8a60-0357fffde510 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd69ac7619c6f4a80866c33aabb8c3f05', 'request_id': 'req-d79bd129-fed8-48ae-8a60-0357fffde510'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:18.255997 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d79bd129-fed8-48ae-8a60-0357fffde510 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd69ac7619c6f4a80866c33aabb8c3f05', 'request_id': 'req-d79bd129-fed8-48ae-8a60-0357fffde510'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:18.339026 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d79bd129-fed8-48ae-8a60-0357fffde510 admin admin] The token cache is being invalidate because project d69ac7619c6f4a80866c33aabb8c3f05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:18.339129 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d79bd129-fed8-48ae-8a60-0357fffde510 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:18.340777 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d79bd129-fed8-48ae-8a60-0357fffde510 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:18.342538 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2957/5886] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:31:17 2022] DELETE /identity/v3/projects/d69ac7619c6f4a80866c33aabb8c3f05 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:18.348061 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79bd129-fed8-48ae-8a60-0357fffde510 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:18.358461 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d79bd129-fed8-48ae-8a60-0357fffde510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:18.361180 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-4b248ec3-892a-4831-925a-6402597aa1ed None None] MFA Rules not processed for user `52516dfa134f4f3a9555b3ed3e693f01`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:18.362444 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4b248ec3-892a-4831-925a-6402597aa1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:18.446674 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79bd129-fed8-48ae-8a60-0357fffde510 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:18.456612 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ff872-762f-4d31-ad99-85e98a666e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:18.457300 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ff872-762f-4d31-ad99-85e98a666e46 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:18.459969 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ff872-762f-4d31-ad99-85e98a666e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:18.460267 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ff872-762f-4d31-ad99-85e98a666e46 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:18.461034 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ff872-762f-4d31-ad99-85e98a666e46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:18.462804 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ff872-762f-4d31-ad99-85e98a666e46 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:18.495537 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2958/5887] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:31:18 2022] GET /identity/v3/roles => generated 1891 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:31:18.495537 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74a583-bb3b-4b19-8265-f4063ded5277 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:18.495537 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74a583-bb3b-4b19-8265-f4063ded5277 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:18.495537 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74a583-bb3b-4b19-8265-f4063ded5277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:18.520350 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2930/5888] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:18 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:18.521321 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b248ec3-892a-4831-925a-6402597aa1ed None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:18.538781 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-ad74a583-bb3b-4b19-8265-f4063ded5277 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:18.539936 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ad74a583-bb3b-4b19-8265-f4063ded5277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:18.557953 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2959/5889] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:18.559412 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b248ec3-892a-4831-925a-6402597aa1ed None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:18.560838 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93074b8-9637-438e-b471-e82a7ed5dd1a None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:18.561132 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93074b8-9637-438e-b471-e82a7ed5dd1a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:18.561418 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93074b8-9637-438e-b471-e82a7ed5dd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:18.579008 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe36b9f-10d0-4eba-8abb-c7c75847842f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:18.580695 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe36b9f-10d0-4eba-8abb-c7c75847842f admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:18.580977 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe36b9f-10d0-4eba-8abb-c7c75847842f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:18.581254 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe36b9f-10d0-4eba-8abb-c7c75847842f admin admin] PATH_INFO: `/v3/projects/64fb1f98bb3946649a4962c19dc224aa/users/77917dd3885b49fb9b3d5b9e9efb2210/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:18.589744 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-e93074b8-9637-438e-b471-e82a7ed5dd1a None None] MFA Rules not processed for user `52516dfa134f4f3a9555b3ed3e693f01`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:18.593003 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e93074b8-9637-438e-b471-e82a7ed5dd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:18.604402 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2960/5890] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:18 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:18.605806 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cad44c-23d7-4202-ab5b-60295188a71a None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:18.606109 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cad44c-23d7-4202-ab5b-60295188a71a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:18.606446 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cad44c-23d7-4202-ab5b-60295188a71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:18.609345 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe36b9f-10d0-4eba-8abb-c7c75847842f admin admin] RBAC: Authorizing `identity:create_grant(project_id=64fb1f98bb3946649a4962c19dc224aa, user_id=77917dd3885b49fb9b3d5b9e9efb2210, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:18.612343 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe36b9f-10d0-4eba-8abb-c7c75847842f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:18.635942 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-23cad44c-23d7-4202-ab5b-60295188a71a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:18.638931 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-23cad44c-23d7-4202-ab5b-60295188a71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:18.647459 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2961/5891] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:18.648718 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cad44c-23d7-4202-ab5b-60295188a71a None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:18.661010 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cad44c-23d7-4202-ab5b-60295188a71a None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:18.667824 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4aa5fe-feb7-4b7f-8042-7a19c6b7a22d tempest-TrustsV3TestJSON-405166717 tempest-user-1113677880] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52516dfa134f4f3a9555b3ed3e693f01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '856a48d840934c6dac2ad0d5b612532f', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-10224511', 'tempest-DelegatedRole-1637901526'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:18.668816 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4aa5fe-feb7-4b7f-8042-7a19c6b7a22d tempest-TrustsV3TestJSON-405166717 tempest-user-1113677880] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:18.669335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4aa5fe-feb7-4b7f-8042-7a19c6b7a22d tempest-TrustsV3TestJSON-405166717 tempest-user-1113677880] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:18.669681 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4aa5fe-feb7-4b7f-8042-7a19c6b7a22d tempest-TrustsV3TestJSON-405166717 tempest-user-1113677880] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:18.670586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4aa5fe-feb7-4b7f-8042-7a19c6b7a22d tempest-TrustsV3TestJSON-405166717 tempest-user-1113677880] RBAC: Authorizing `identity:create_trust()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:18.671840 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4aa5fe-feb7-4b7f-8042-7a19c6b7a22d tempest-TrustsV3TestJSON-405166717 tempest-user-1113677880] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:18.716599 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2931/5892] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:31:18 2022] PUT /identity/v3/projects/64fb1f98bb3946649a4962c19dc224aa/users/77917dd3885b49fb9b3d5b9e9efb2210/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:18.718846 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe36b9f-10d0-4eba-8abb-c7c75847842f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:18.839572 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe36b9f-10d0-4eba-8abb-c7c75847842f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:18.849377 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c76e6c7-fd82-4c4e-8bc8-30e89c62416b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:18.850121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76e6c7-fd82-4c4e-8bc8-30e89c62416b admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:18.850411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76e6c7-fd82-4c4e-8bc8-30e89c62416b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:18.850689 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76e6c7-fd82-4c4e-8bc8-30e89c62416b admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:18.851427 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c76e6c7-fd82-4c4e-8bc8-30e89c62416b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:31:18.851756 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c76e6c7-fd82-4c4e-8bc8-30e89c62416b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:18.859937 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c76e6c7-fd82-4c4e-8bc8-30e89c62416b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:18.876810 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2962/5893] 10.222.0.23 () {60 vars in 1173 bytes} [Sat Apr 30 21:31:18 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:18.879583 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4aa5fe-feb7-4b7f-8042-7a19c6b7a22d tempest-TrustsV3TestJSON-405166717 tempest-user-1113677880] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:18.903452 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2932/5894] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:31:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:31:18.907487 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c76e6c7-fd82-4c4e-8bc8-30e89c62416b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:18.931950 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4aa5fe-feb7-4b7f-8042-7a19c6b7a22d tempest-TrustsV3TestJSON-405166717 tempest-user-1113677880] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:18.961919 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d6875-21dc-4d20-80aa-5d8106043a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:18.963511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d6875-21dc-4d20-80aa-5d8106043a26 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:18.963511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d6875-21dc-4d20-80aa-5d8106043a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:18.963511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d6875-21dc-4d20-80aa-5d8106043a26 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:18.968383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d6875-21dc-4d20-80aa-5d8106043a26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:18.977747 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d6875-21dc-4d20-80aa-5d8106043a26 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:19.016709 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2963/5895] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:31:18 2022] GET /identity/v3/roles => generated 1891 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:31:19.018876 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d6875-21dc-4d20-80aa-5d8106043a26 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:19.036711 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c76e6c7-fd82-4c4e-8bc8-30e89c62416b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:19.037637 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d6875-21dc-4d20-80aa-5d8106043a26 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:19.043100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f1fb0-561d-4f8d-82a4-fe55ca0960f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:19.044110 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f1fb0-561d-4f8d-82a4-fe55ca0960f8 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:19.044534 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f1fb0-561d-4f8d-82a4-fe55ca0960f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:19.044965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f1fb0-561d-4f8d-82a4-fe55ca0960f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:19.046047 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f1fb0-561d-4f8d-82a4-fe55ca0960f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:19.048210 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f1fb0-561d-4f8d-82a4-fe55ca0960f8 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:19.048382 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919cb3d1-402d-4f53-9c20-e9ecb9c9bc4e tempest-TrustsV3TestJSON-405166717 tempest-user-1113677880] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52516dfa134f4f3a9555b3ed3e693f01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '856a48d840934c6dac2ad0d5b612532f', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-10224511', 'tempest-DelegatedRole-1637901526'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:19.049014 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cb3d1-402d-4f53-9c20-e9ecb9c9bc4e tempest-TrustsV3TestJSON-405166717 tempest-user-1113677880] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:19.049303 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cb3d1-402d-4f53-9c20-e9ecb9c9bc4e tempest-TrustsV3TestJSON-405166717 tempest-user-1113677880] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:19.049584 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cb3d1-402d-4f53-9c20-e9ecb9c9bc4e tempest-TrustsV3TestJSON-405166717 tempest-user-1113677880] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:19.050339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919cb3d1-402d-4f53-9c20-e9ecb9c9bc4e tempest-TrustsV3TestJSON-405166717 tempest-user-1113677880] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:19.052363 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919cb3d1-402d-4f53-9c20-e9ecb9c9bc4e tempest-TrustsV3TestJSON-405166717 tempest-user-1113677880] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:19.074214 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2933/5896] 10.222.0.23 () {58 vars in 1251 bytes} [Sat Apr 30 21:31:18 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=52516dfa134f4f3a9555b3ed3e693f01 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:31:19.075125 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919cb3d1-402d-4f53-9c20-e9ecb9c9bc4e tempest-TrustsV3TestJSON-405166717 tempest-user-1113677880] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:19.116708 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919cb3d1-402d-4f53-9c20-e9ecb9c9bc4e tempest-TrustsV3TestJSON-405166717 tempest-user-1113677880] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:19.116708 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca891c3-a3e1-4411-a984-fda40fafcf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:19.116708 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca891c3-a3e1-4411-a984-fda40fafcf52 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:19.116708 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca891c3-a3e1-4411-a984-fda40fafcf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:19.117187 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca891c3-a3e1-4411-a984-fda40fafcf52 admin admin] PATH_INFO: `/v3/projects/64fb1f98bb3946649a4962c19dc224aa/users/77917dd3885b49fb9b3d5b9e9efb2210/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:19.117187 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca891c3-a3e1-4411-a984-fda40fafcf52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64fb1f98bb3946649a4962c19dc224aa, user_id=77917dd3885b49fb9b3d5b9e9efb2210, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:19.118675 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca891c3-a3e1-4411-a984-fda40fafcf52 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:19.140254 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2934/5897] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:31:19 2022] PUT /identity/v3/projects/64fb1f98bb3946649a4962c19dc224aa/users/77917dd3885b49fb9b3d5b9e9efb2210/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:19.140254 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca891c3-a3e1-4411-a984-fda40fafcf52 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:19.199261 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2964/5898] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:31:19 2022] POST /identity/v3/projects => generated 383 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:19.199261 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618272e-88e3-433d-87b5-8a4c1654a4af None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:19.199261 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618272e-88e3-433d-87b5-8a4c1654a4af None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:19.199261 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618272e-88e3-433d-87b5-8a4c1654a4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:19.206893 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca891c3-a3e1-4411-a984-fda40fafcf52 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:19.271453 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-0618272e-88e3-433d-87b5-8a4c1654a4af None None] MFA Rules not processed for user `77917dd3885b49fb9b3d5b9e9efb2210`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:19.272882 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0618272e-88e3-433d-87b5-8a4c1654a4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:19.293489 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7537490-2b77-4b4d-8706-ad31c10c5f70 tempest-TrustsV3TestJSON-405166717 tempest-user-1113677880] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52516dfa134f4f3a9555b3ed3e693f01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '856a48d840934c6dac2ad0d5b612532f', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-10224511', 'tempest-DelegatedRole-1637901526'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:19.294317 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7537490-2b77-4b4d-8706-ad31c10c5f70 tempest-TrustsV3TestJSON-405166717 tempest-user-1113677880] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:19.294604 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7537490-2b77-4b4d-8706-ad31c10c5f70 tempest-TrustsV3TestJSON-405166717 tempest-user-1113677880] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:19.295296 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7537490-2b77-4b4d-8706-ad31c10c5f70 tempest-TrustsV3TestJSON-405166717 tempest-user-1113677880] PATH_INFO: `/v3/OS-TRUST/trusts/3e1ea87a18db4698823a309629d245dc` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:19.312283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7537490-2b77-4b4d-8706-ad31c10c5f70 tempest-TrustsV3TestJSON-405166717 tempest-user-1113677880] RBAC: Authorizing `identity:delete_trust(trust_id=3e1ea87a18db4698823a309629d245dc)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:19.312283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7537490-2b77-4b4d-8706-ad31c10c5f70 tempest-TrustsV3TestJSON-405166717 tempest-user-1113677880] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:19.398191 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e7537490-2b77-4b4d-8706-ad31c10c5f70 tempest-TrustsV3TestJSON-405166717 tempest-user-1113677880] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '3e1ea87a18db4698823a309629d245dc', 'request_id': 'req-e7537490-2b77-4b4d-8706-ad31c10c5f70'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:19.399140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e7537490-2b77-4b4d-8706-ad31c10c5f70 tempest-TrustsV3TestJSON-405166717 tempest-user-1113677880] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '3e1ea87a18db4698823a309629d245dc', 'request_id': 'req-e7537490-2b77-4b4d-8706-ad31c10c5f70'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:19.490408 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e7537490-2b77-4b4d-8706-ad31c10c5f70 tempest-TrustsV3TestJSON-405166717 tempest-user-1113677880] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '3e1ea87a18db4698823a309629d245dc', 'request_id': 'req-e7537490-2b77-4b4d-8706-ad31c10c5f70'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:19.509803 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2935/5899] 10.222.0.23 () {58 vars in 1253 bytes} [Sat Apr 30 21:31:19 2022] DELETE /identity/v3/OS-TRUST/trusts/3e1ea87a18db4698823a309629d245dc => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:19.509803 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7537490-2b77-4b4d-8706-ad31c10c5f70 tempest-TrustsV3TestJSON-405166717 tempest-user-1113677880] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:19.509803 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e7537490-2b77-4b4d-8706-ad31c10c5f70 tempest-TrustsV3TestJSON-405166717 tempest-user-1113677880] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:19.547001 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2965/5900] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:19 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:19.551851 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618272e-88e3-433d-87b5-8a4c1654a4af None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:19.582889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618272e-88e3-433d-87b5-8a4c1654a4af None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:19.610055 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a182c95-4bfc-4725-8e7b-366be2120d7e tempest-TrustsV3TestJSON-405166717 tempest-user-1113677880] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52516dfa134f4f3a9555b3ed3e693f01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '856a48d840934c6dac2ad0d5b612532f', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-10224511', 'tempest-DelegatedRole-1637901526'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:19.612236 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a182c95-4bfc-4725-8e7b-366be2120d7e tempest-TrustsV3TestJSON-405166717 tempest-user-1113677880] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:19.612678 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a182c95-4bfc-4725-8e7b-366be2120d7e tempest-TrustsV3TestJSON-405166717 tempest-user-1113677880] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:19.613110 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a182c95-4bfc-4725-8e7b-366be2120d7e tempest-TrustsV3TestJSON-405166717 tempest-user-1113677880] PATH_INFO: `/v3/OS-TRUST/trusts/3e1ea87a18db4698823a309629d245dc` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:19.655080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7537490-2b77-4b4d-8706-ad31c10c5f70 tempest-TrustsV3TestJSON-405166717 tempest-user-1113677880] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:19.660143 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-3a182c95-4bfc-4725-8e7b-366be2120d7e tempest-TrustsV3TestJSON-405166717 tempest-user-1113677880] Could not find trust: 3e1ea87a18db4698823a309629d245dc.: keystone.exception.TrustNotFound: Could not find trust: 3e1ea87a18db4698823a309629d245dc. Apr 30 21:31:19.660143 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:31:19.660143 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:31:19.660143 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:31:19.660143 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:31:19.660143 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:31:19.660143 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:31:19.660143 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:31:19.660143 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:31:19.660143 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:31:19.660143 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:31:19.660143 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:31:19.660143 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Apr 30 21:31:19.660143 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Apr 30 21:31:19.660143 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Apr 30 21:31:19.666242 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Apr 30 21:31:19.666242 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Apr 30 21:31:19.666242 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Apr 30 21:31:19.666242 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Apr 30 21:31:19.666242 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Apr 30 21:31:19.666242 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:31:19.666242 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:31:19.666242 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Apr 30 21:31:19.666242 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Apr 30 21:31:19.666242 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Apr 30 21:31:19.666242 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Apr 30 21:31:19.666242 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 3e1ea87a18db4698823a309629d245dc. Apr 30 21:31:19.666242 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:31:19.666242 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2966/5901] 10.222.0.23 () {58 vars in 1250 bytes} [Sat Apr 30 21:31:19 2022] GET /identity/v3/OS-TRUST/trusts/3e1ea87a18db4698823a309629d245dc => generated 111 bytes in 118 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 30 21:31:19.669803 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a182c95-4bfc-4725-8e7b-366be2120d7e tempest-TrustsV3TestJSON-405166717 tempest-user-1113677880] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:19.670007 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98863d0-e54f-4f9a-9cf1-008d3e2339ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:19.671263 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98863d0-e54f-4f9a-9cf1-008d3e2339ef admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:19.671263 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98863d0-e54f-4f9a-9cf1-008d3e2339ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:19.671263 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98863d0-e54f-4f9a-9cf1-008d3e2339ef admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:19.672246 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98863d0-e54f-4f9a-9cf1-008d3e2339ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:19.674148 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3a182c95-4bfc-4725-8e7b-366be2120d7e tempest-TrustsV3TestJSON-405166717 tempest-user-1113677880] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:19.676026 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98863d0-e54f-4f9a-9cf1-008d3e2339ef admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:19.707430 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a182c95-4bfc-4725-8e7b-366be2120d7e tempest-TrustsV3TestJSON-405166717 tempest-user-1113677880] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:19.727459 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9cc335-88a6-49a0-934b-451486935658 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77917dd3885b49fb9b3d5b9e9efb2210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64fb1f98bb3946649a4962c19dc224aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:19.728426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9cc335-88a6-49a0-934b-451486935658 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:19.729256 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9cc335-88a6-49a0-934b-451486935658 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:19.729680 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9cc335-88a6-49a0-934b-451486935658 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:19.730807 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9cc335-88a6-49a0-934b-451486935658 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:19.733033 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9cc335-88a6-49a0-934b-451486935658 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:19.783959 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2936/5902] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:31:19 2022] POST /identity/v3/users => generated 292 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:19.785148 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98863d0-e54f-4f9a-9cf1-008d3e2339ef admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:19.788868 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e98863d0-e54f-4f9a-9cf1-008d3e2339ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:19.865740 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2967/5903] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:31:19 2022] POST /identity/v3/services => generated 288 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:19.867210 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9cc335-88a6-49a0-934b-451486935658 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:19.921114 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98863d0-e54f-4f9a-9cf1-008d3e2339ef admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:19.933980 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9cc335-88a6-49a0-934b-451486935658 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:19.945559 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5674055-2efd-4171-995f-eb6c022dcd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:19.946529 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5674055-2efd-4171-995f-eb6c022dcd46 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:19.947003 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5674055-2efd-4171-995f-eb6c022dcd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:19.947476 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5674055-2efd-4171-995f-eb6c022dcd46 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:19.948358 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5674055-2efd-4171-995f-eb6c022dcd46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:19.949469 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f5924-90d3-4e50-8b7a-603eab0d7a09 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:19.950505 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f5924-90d3-4e50-8b7a-603eab0d7a09 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:19.951092 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f5924-90d3-4e50-8b7a-603eab0d7a09 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:19.951612 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f5924-90d3-4e50-8b7a-603eab0d7a09 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/roles/e712d9fb766b43e5b1b66dfd8497c97e` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:19.952198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5674055-2efd-4171-995f-eb6c022dcd46 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:19.953106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f5924-90d3-4e50-8b7a-603eab0d7a09 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e712d9fb766b43e5b1b66dfd8497c97e)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:19.957466 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f5924-90d3-4e50-8b7a-603eab0d7a09 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:19.967239 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2968/5904] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:31:19 2022] GET /identity/v3/roles => generated 1891 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:31:19.971080 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5674055-2efd-4171-995f-eb6c022dcd46 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:20.015213 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5674055-2efd-4171-995f-eb6c022dcd46 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:20.026348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c141f-ee55-4079-80f2-530875701ce5 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77917dd3885b49fb9b3d5b9e9efb2210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64fb1f98bb3946649a4962c19dc224aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:20.027478 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c141f-ee55-4079-80f2-530875701ce5 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:20.027958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c141f-ee55-4079-80f2-530875701ce5 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:20.028436 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c141f-ee55-4079-80f2-530875701ce5 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:20.029798 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c141f-ee55-4079-80f2-530875701ce5 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:20.031633 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-6b0c141f-ee55-4079-80f2-530875701ce5 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:31:20.031633 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:31:20.031633 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:31:20.033668 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c141f-ee55-4079-80f2-530875701ce5 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:20.103834 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2969/5905] 10.222.0.23 () {60 vars in 1212 bytes} [Sat Apr 30 21:31:19 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:20.105035 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c141f-ee55-4079-80f2-530875701ce5 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:20.128510 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c141f-ee55-4079-80f2-530875701ce5 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:20.133574 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf6abf-a069-4ea2-88c2-b239b48a756b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:20.136627 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf6abf-a069-4ea2-88c2-b239b48a756b admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:20.136627 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf6abf-a069-4ea2-88c2-b239b48a756b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:20.136627 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf6abf-a069-4ea2-88c2-b239b48a756b admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:20.140386 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf6abf-a069-4ea2-88c2-b239b48a756b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:20.143100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf6abf-a069-4ea2-88c2-b239b48a756b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:20.160144 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2970/5906] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:31:20 2022] GET /identity/v3/roles => generated 1891 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:31:20.161213 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf6abf-a069-4ea2-88c2-b239b48a756b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:20.176268 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf6abf-a069-4ea2-88c2-b239b48a756b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:20.182045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a46504-109d-4d5d-b157-1da6e0fea53a tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77917dd3885b49fb9b3d5b9e9efb2210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64fb1f98bb3946649a4962c19dc224aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:20.182734 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a46504-109d-4d5d-b157-1da6e0fea53a tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:20.183027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a46504-109d-4d5d-b157-1da6e0fea53a tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:20.183361 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a46504-109d-4d5d-b157-1da6e0fea53a tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:20.184150 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a46504-109d-4d5d-b157-1da6e0fea53a tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:20.185865 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a46504-109d-4d5d-b157-1da6e0fea53a tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:20.194314 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-cc6f5924-90d3-4e50-8b7a-603eab0d7a09 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invalidating the token cache because role e712d9fb766b43e5b1b66dfd8497c97e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:20.194902 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-cc6f5924-90d3-4e50-8b7a-603eab0d7a09 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:20.195360 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-cc6f5924-90d3-4e50-8b7a-603eab0d7a09 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:20.203184 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2937/5907] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:31:19 2022] DELETE /identity/v3/roles/e712d9fb766b43e5b1b66dfd8497c97e => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:20.207238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f5924-90d3-4e50-8b7a-603eab0d7a09 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:20.212965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-cc6f5924-90d3-4e50-8b7a-603eab0d7a09 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:20.302525 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2971/5908] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:31:20 2022] POST /identity/v3/services => generated 288 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:20.304162 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a46504-109d-4d5d-b157-1da6e0fea53a tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:20.308727 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-00a46504-109d-4d5d-b157-1da6e0fea53a tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:20.349833 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f5924-90d3-4e50-8b7a-603eab0d7a09 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:20.374198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a46504-109d-4d5d-b157-1da6e0fea53a tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:20.396317 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097ded3-d131-43b6-8720-3942cea30319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:20.399194 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097ded3-d131-43b6-8720-3942cea30319 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:20.402089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097ded3-d131-43b6-8720-3942cea30319 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:20.403164 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097ded3-d131-43b6-8720-3942cea30319 admin admin] PATH_INFO: `/v3/projects/449fb8e48bdd4f9cb3311e729795435f/users/c25664f1ee004401a909079f12339c47/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:20.435062 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f097ded3-d131-43b6-8720-3942cea30319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=449fb8e48bdd4f9cb3311e729795435f, user_id=c25664f1ee004401a909079f12339c47, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:20.445498 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f097ded3-d131-43b6-8720-3942cea30319 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:20.548278 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626f03d-782b-4748-b423-92df3e5494b4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:20.550210 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626f03d-782b-4748-b423-92df3e5494b4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:20.554038 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626f03d-782b-4748-b423-92df3e5494b4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:20.558238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626f03d-782b-4748-b423-92df3e5494b4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/roles/dd09aec594394ac5b553f9a77d72c3db` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:20.558238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9626f03d-782b-4748-b423-92df3e5494b4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:delete_role(role_id=dd09aec594394ac5b553f9a77d72c3db)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:20.559823 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9626f03d-782b-4748-b423-92df3e5494b4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:20.561384 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2938/5909] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:31:20 2022] PUT /identity/v3/projects/449fb8e48bdd4f9cb3311e729795435f/users/c25664f1ee004401a909079f12339c47/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:20.562373 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097ded3-d131-43b6-8720-3942cea30319 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:20.566819 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f097ded3-d131-43b6-8720-3942cea30319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:20.707449 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097ded3-d131-43b6-8720-3942cea30319 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:20.712892 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660714ef-4c15-451e-b1d3-628a16a62db3 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77917dd3885b49fb9b3d5b9e9efb2210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64fb1f98bb3946649a4962c19dc224aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:20.713419 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660714ef-4c15-451e-b1d3-628a16a62db3 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:20.713680 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660714ef-4c15-451e-b1d3-628a16a62db3 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:20.714137 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660714ef-4c15-451e-b1d3-628a16a62db3 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:20.714733 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660714ef-4c15-451e-b1d3-628a16a62db3 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:20.715777 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-660714ef-4c15-451e-b1d3-628a16a62db3 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:31:20.715777 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:31:20.715777 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:31:20.717041 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660714ef-4c15-451e-b1d3-628a16a62db3 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:20.814313 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2939/5910] 10.222.0.23 () {60 vars in 1212 bytes} [Sat Apr 30 21:31:20 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 331 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:20.814313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a9663-01d7-4a9c-a4d9-b441073c00f7 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:20.814313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a9663-01d7-4a9c-a4d9-b441073c00f7 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:20.814313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a9663-01d7-4a9c-a4d9-b441073c00f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:20.850018 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-e41a9663-01d7-4a9c-a4d9-b441073c00f7 None None] MFA Rules not processed for user `c25664f1ee004401a909079f12339c47`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:20.851683 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e41a9663-01d7-4a9c-a4d9-b441073c00f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:20.891650 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9626f03d-782b-4748-b423-92df3e5494b4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invalidating the token cache because role dd09aec594394ac5b553f9a77d72c3db has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:20.891650 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9626f03d-782b-4748-b423-92df3e5494b4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:20.891650 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9626f03d-782b-4748-b423-92df3e5494b4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:20.896416 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2972/5911] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:31:20 2022] DELETE /identity/v3/roles/dd09aec594394ac5b553f9a77d72c3db => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:20.897925 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626f03d-782b-4748-b423-92df3e5494b4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:20.904468 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9626f03d-782b-4748-b423-92df3e5494b4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:21.029511 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2940/5912] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:20 2022] POST /identity/v3/auth/tokens => generated 3516 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:21.029875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a9663-01d7-4a9c-a4d9-b441073c00f7 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:21.032352 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e41a9663-01d7-4a9c-a4d9-b441073c00f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:21.067910 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626f03d-782b-4748-b423-92df3e5494b4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:21.073521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6bb657-414d-419e-85b7-6e5664aa9453 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77917dd3885b49fb9b3d5b9e9efb2210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64fb1f98bb3946649a4962c19dc224aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:21.074624 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bb657-414d-419e-85b7-6e5664aa9453 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:21.075276 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bb657-414d-419e-85b7-6e5664aa9453 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:21.075783 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bb657-414d-419e-85b7-6e5664aa9453 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:21.076714 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6bb657-414d-419e-85b7-6e5664aa9453 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:21.077990 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-ae6bb657-414d-419e-85b7-6e5664aa9453 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:31:21.077990 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:31:21.077990 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:31:21.079258 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6bb657-414d-419e-85b7-6e5664aa9453 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:21.090307 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2973/5913] 10.222.0.23 () {58 vars in 1190 bytes} [Sat Apr 30 21:31:20 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 762 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:31:21.092736 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6bb657-414d-419e-85b7-6e5664aa9453 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:21.096167 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ae6bb657-414d-419e-85b7-6e5664aa9453 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:21.205799 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6bb657-414d-419e-85b7-6e5664aa9453 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:21.210468 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a9663-01d7-4a9c-a4d9-b441073c00f7 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:21.218453 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae245a4-10d0-442b-84f4-fca4cfe5cf90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:21.228861 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae245a4-10d0-442b-84f4-fca4cfe5cf90 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:21.230007 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae245a4-10d0-442b-84f4-fca4cfe5cf90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:21.230410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae245a4-10d0-442b-84f4-fca4cfe5cf90 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:21.232706 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae245a4-10d0-442b-84f4-fca4cfe5cf90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:21.238382 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae245a4-10d0-442b-84f4-fca4cfe5cf90 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:21.362041 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faacd8f-a254-4cfc-b22b-b5f9b74dfba4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:21.363071 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faacd8f-a254-4cfc-b22b-b5f9b74dfba4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:21.363493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faacd8f-a254-4cfc-b22b-b5f9b74dfba4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:21.364730 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faacd8f-a254-4cfc-b22b-b5f9b74dfba4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/users/52516dfa134f4f3a9555b3ed3e693f01` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:21.366381 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faacd8f-a254-4cfc-b22b-b5f9b74dfba4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:delete_user(user_id=52516dfa134f4f3a9555b3ed3e693f01)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:21.368696 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faacd8f-a254-4cfc-b22b-b5f9b74dfba4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:21.410635 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2974/5914] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:31:21 2022] POST /identity/v3/projects => generated 387 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:21.414793 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae245a4-10d0-442b-84f4-fca4cfe5cf90 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:21.581337 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae245a4-10d0-442b-84f4-fca4cfe5cf90 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:21.586076 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6faacd8f-a254-4cfc-b22b-b5f9b74dfba4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52516dfa134f4f3a9555b3ed3e693f01'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:21.598524 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2213f-6308-41b3-bb72-824af6eb8f00 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77917dd3885b49fb9b3d5b9e9efb2210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64fb1f98bb3946649a4962c19dc224aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:21.599569 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2213f-6308-41b3-bb72-824af6eb8f00 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:21.599965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2213f-6308-41b3-bb72-824af6eb8f00 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:21.600535 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2213f-6308-41b3-bb72-824af6eb8f00 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/3844717316364e86847752fd5a66a56b` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:21.601386 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a2213f-6308-41b3-bb72-824af6eb8f00 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=3844717316364e86847752fd5a66a56b)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:21.602278 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6faacd8f-a254-4cfc-b22b-b5f9b74dfba4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52516dfa134f4f3a9555b3ed3e693f01'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:21.602659 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-79a2213f-6308-41b3-bb72-824af6eb8f00 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:31:21.602659 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:31:21.602659 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:31:21.603789 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a2213f-6308-41b3-bb72-824af6eb8f00 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:21.618502 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2975/5915] 10.222.0.23 () {58 vars in 1289 bytes} [Sat Apr 30 21:31:21 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/3844717316364e86847752fd5a66a56b => generated 331 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:31:21.618502 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2213f-6308-41b3-bb72-824af6eb8f00 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:21.692671 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6faacd8f-a254-4cfc-b22b-b5f9b74dfba4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52516dfa134f4f3a9555b3ed3e693f01'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:21.693321 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6faacd8f-a254-4cfc-b22b-b5f9b74dfba4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52516dfa134f4f3a9555b3ed3e693f01'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:21.700559 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2213f-6308-41b3-bb72-824af6eb8f00 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:21.706467 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2196ff-5278-44f5-8dc5-c62eaa6800bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:21.707217 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2196ff-5278-44f5-8dc5-c62eaa6800bf admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:21.707734 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2196ff-5278-44f5-8dc5-c62eaa6800bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:21.708081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2196ff-5278-44f5-8dc5-c62eaa6800bf admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:21.708849 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2196ff-5278-44f5-8dc5-c62eaa6800bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:21.710181 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6faacd8f-a254-4cfc-b22b-b5f9b74dfba4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52516dfa134f4f3a9555b3ed3e693f01'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:21.711327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2196ff-5278-44f5-8dc5-c62eaa6800bf admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:21.736911 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2941/5916] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:31:21 2022] DELETE /identity/v3/users/52516dfa134f4f3a9555b3ed3e693f01 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:21.742051 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faacd8f-a254-4cfc-b22b-b5f9b74dfba4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:21.742051 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6faacd8f-a254-4cfc-b22b-b5f9b74dfba4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:21.835336 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2976/5917] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:31:21 2022] POST /identity/v3/users => generated 301 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:21.840426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2196ff-5278-44f5-8dc5-c62eaa6800bf admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:21.840426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8e2196ff-5278-44f5-8dc5-c62eaa6800bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:21.842900 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faacd8f-a254-4cfc-b22b-b5f9b74dfba4 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:21.848643 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ebdf9-4bca-45d3-ad07-0441f1b88abe tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77917dd3885b49fb9b3d5b9e9efb2210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64fb1f98bb3946649a4962c19dc224aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:21.849787 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ebdf9-4bca-45d3-ad07-0441f1b88abe tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:21.850446 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ebdf9-4bca-45d3-ad07-0441f1b88abe tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:21.850889 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ebdf9-4bca-45d3-ad07-0441f1b88abe tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/3844717316364e86847752fd5a66a56b` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:21.851709 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ebdf9-4bca-45d3-ad07-0441f1b88abe tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=3844717316364e86847752fd5a66a56b)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:21.852897 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-dc5ebdf9-4bca-45d3-ad07-0441f1b88abe tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:31:21.852897 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:31:21.852897 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:31:21.854357 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ebdf9-4bca-45d3-ad07-0441f1b88abe tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:21.865141 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2942/5918] 10.222.0.23 () {58 vars in 1290 bytes} [Sat Apr 30 21:31:21 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/3844717316364e86847752fd5a66a56b => generated 0 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Apr 30 21:31:21.866376 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ebdf9-4bca-45d3-ad07-0441f1b88abe tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:21.869116 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-dc5ebdf9-4bca-45d3-ad07-0441f1b88abe tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:21.951803 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ebdf9-4bca-45d3-ad07-0441f1b88abe tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:21.957562 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c79c6-16f6-48c9-b647-97b0f78e4919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:21.964458 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c79c6-16f6-48c9-b647-97b0f78e4919 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:21.964458 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c79c6-16f6-48c9-b647-97b0f78e4919 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:21.964458 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c79c6-16f6-48c9-b647-97b0f78e4919 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:21.964458 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c79c6-16f6-48c9-b647-97b0f78e4919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:21.964458 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c79c6-16f6-48c9-b647-97b0f78e4919 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:21.977384 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2943/5919] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:31:21.978741 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c79c6-16f6-48c9-b647-97b0f78e4919 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:21.991320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c79c6-16f6-48c9-b647-97b0f78e4919 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:21.999600 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe75d02-c784-4ae3-aa33-c1f78b9ea929 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77917dd3885b49fb9b3d5b9e9efb2210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64fb1f98bb3946649a4962c19dc224aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:22.000715 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe75d02-c784-4ae3-aa33-c1f78b9ea929 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:22.001796 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe75d02-c784-4ae3-aa33-c1f78b9ea929 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:22.002230 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe75d02-c784-4ae3-aa33-c1f78b9ea929 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/3844717316364e86847752fd5a66a56b` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:22.003198 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe75d02-c784-4ae3-aa33-c1f78b9ea929 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=3844717316364e86847752fd5a66a56b)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:22.004382 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-8fe75d02-c784-4ae3-aa33-c1f78b9ea929 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:31:22.004382 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:31:22.004382 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:31:22.005603 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe75d02-c784-4ae3-aa33-c1f78b9ea929 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:22.062886 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2196ff-5278-44f5-8dc5-c62eaa6800bf admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:22.103263 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2944/5920] 10.222.0.23 () {58 vars in 1292 bytes} [Sat Apr 30 21:31:21 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/3844717316364e86847752fd5a66a56b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:22.104380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe75d02-c784-4ae3-aa33-c1f78b9ea929 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:22.128276 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe75d02-c784-4ae3-aa33-c1f78b9ea929 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:22.148885 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f3da5-feb8-494f-85da-95b3e76e1969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:22.150175 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f3da5-feb8-494f-85da-95b3e76e1969 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:22.155228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f3da5-feb8-494f-85da-95b3e76e1969 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:22.155228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f3da5-feb8-494f-85da-95b3e76e1969 admin admin] PATH_INFO: `/v3/projects/e79cc8b468e84b62b91c1946fd37c8bd/users/5f2b520ae828416c8aebffabbc5577c9/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:22.200380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f3da5-feb8-494f-85da-95b3e76e1969 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e79cc8b468e84b62b91c1946fd37c8bd, user_id=5f2b520ae828416c8aebffabbc5577c9, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:22.221436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f3da5-feb8-494f-85da-95b3e76e1969 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:22.237009 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a4474-116d-4608-9504-67b017d8abe7 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:22.237629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a4474-116d-4608-9504-67b017d8abe7 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:22.237942 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a4474-116d-4608-9504-67b017d8abe7 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:22.238239 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a4474-116d-4608-9504-67b017d8abe7 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/projects/856a48d840934c6dac2ad0d5b612532f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:22.240326 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a4474-116d-4608-9504-67b017d8abe7 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:delete_project(project_id=856a48d840934c6dac2ad0d5b612532f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:22.242537 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a4474-116d-4608-9504-67b017d8abe7 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:22.335464 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2945/5921] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:31:22 2022] PUT /identity/v3/projects/e79cc8b468e84b62b91c1946fd37c8bd/users/5f2b520ae828416c8aebffabbc5577c9/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:22.343691 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f3da5-feb8-494f-85da-95b3e76e1969 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:22.552514 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b41a4474-116d-4608-9504-67b017d8abe7 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '856a48d840934c6dac2ad0d5b612532f', 'request_id': 'req-b41a4474-116d-4608-9504-67b017d8abe7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:22.572897 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b41a4474-116d-4608-9504-67b017d8abe7 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '856a48d840934c6dac2ad0d5b612532f', 'request_id': 'req-b41a4474-116d-4608-9504-67b017d8abe7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:22.593809 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f3da5-feb8-494f-85da-95b3e76e1969 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:22.603474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b41a4474-116d-4608-9504-67b017d8abe7 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '856a48d840934c6dac2ad0d5b612532f', 'request_id': 'req-b41a4474-116d-4608-9504-67b017d8abe7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:22.683423 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b41a4474-116d-4608-9504-67b017d8abe7 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] The token cache is being invalidate because project 856a48d840934c6dac2ad0d5b612532f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:22.683806 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b41a4474-116d-4608-9504-67b017d8abe7 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:22.685458 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b41a4474-116d-4608-9504-67b017d8abe7 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:22.687464 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2977/5922] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:31:21 2022] DELETE /identity/v3/projects/856a48d840934c6dac2ad0d5b612532f => generated 0 bytes in 852 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:22.693815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10da78-e922-434b-b209-d57293fa379d None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:22.694103 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10da78-e922-434b-b209-d57293fa379d None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:22.694393 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10da78-e922-434b-b209-d57293fa379d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:22.718531 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f020054-bd85-4e3f-905e-d52ea33b7772 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77917dd3885b49fb9b3d5b9e9efb2210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64fb1f98bb3946649a4962c19dc224aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:22.719216 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f020054-bd85-4e3f-905e-d52ea33b7772 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:22.719522 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f020054-bd85-4e3f-905e-d52ea33b7772 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:22.719756 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f020054-bd85-4e3f-905e-d52ea33b7772 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:22.721015 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f020054-bd85-4e3f-905e-d52ea33b7772 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:22.722078 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-2f020054-bd85-4e3f-905e-d52ea33b7772 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:31:22.722078 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:31:22.722078 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:31:22.725363 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f020054-bd85-4e3f-905e-d52ea33b7772 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:22.733987 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2946/5923] 10.222.0.23 () {58 vars in 1190 bytes} [Sat Apr 30 21:31:22 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 450 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:31:22.736781 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f020054-bd85-4e3f-905e-d52ea33b7772 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:22.737689 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2f020054-bd85-4e3f-905e-d52ea33b7772 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:22.740524 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-fa10da78-e922-434b-b209-d57293fa379d None None] MFA Rules not processed for user `5f2b520ae828416c8aebffabbc5577c9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:22.742834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-fa10da78-e922-434b-b209-d57293fa379d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:22.841816 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2978/5924] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:22 2022] POST /identity/v3/auth/tokens => generated 3527 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:22.841816 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10da78-e922-434b-b209-d57293fa379d None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:22.849547 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-fa10da78-e922-434b-b209-d57293fa379d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:22.892570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10da78-e922-434b-b209-d57293fa379d None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:22.904897 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562519e-0ec5-4f6e-b698-15b43c241d8e tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77917dd3885b49fb9b3d5b9e9efb2210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64fb1f98bb3946649a4962c19dc224aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:22.905789 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562519e-0ec5-4f6e-b698-15b43c241d8e tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:22.906187 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562519e-0ec5-4f6e-b698-15b43c241d8e tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:22.906516 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562519e-0ec5-4f6e-b698-15b43c241d8e tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/3844717316364e86847752fd5a66a56b` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:22.907301 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f562519e-0ec5-4f6e-b698-15b43c241d8e tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=3844717316364e86847752fd5a66a56b)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:22.908385 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-f562519e-0ec5-4f6e-b698-15b43c241d8e tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:31:22.908385 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:31:22.908385 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:31:22.912279 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f020054-bd85-4e3f-905e-d52ea33b7772 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:22.913708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f562519e-0ec5-4f6e-b698-15b43c241d8e tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:22.926633 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ddf4f-1f61-4e94-a21b-c005e2153b1b tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:22.926989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ddf4f-1f61-4e94-a21b-c005e2153b1b tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:22.927336 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ddf4f-1f61-4e94-a21b-c005e2153b1b tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:22.927681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ddf4f-1f61-4e94-a21b-c005e2153b1b tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:22.937265 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ddf4f-1f61-4e94-a21b-c005e2153b1b tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:22.938046 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ddf4f-1f61-4e94-a21b-c005e2153b1b tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:22.954511 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-f562519e-0ec5-4f6e-b698-15b43c241d8e tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] Could not find Endpoint Group: 3844717316364e86847752fd5a66a56b.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 3844717316364e86847752fd5a66a56b. Apr 30 21:31:22.954511 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:31:22.954511 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:31:22.954511 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:31:22.954511 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:31:22.954511 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:31:22.954511 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:31:22.954511 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:31:22.954511 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:31:22.954511 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:31:22.954511 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:31:22.954511 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:31:22.954511 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Apr 30 21:31:22.954511 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Apr 30 21:31:22.955447 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Apr 30 21:31:22.955447 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Apr 30 21:31:22.955447 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Apr 30 21:31:22.955447 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Apr 30 21:31:22.955447 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 3844717316364e86847752fd5a66a56b. Apr 30 21:31:22.955447 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:31:22.963401 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2979/5925] 10.222.0.23 () {58 vars in 1292 bytes} [Sat Apr 30 21:31:22 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/3844717316364e86847752fd5a66a56b => generated 120 bytes in 120 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 30 21:31:22.964528 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562519e-0ec5-4f6e-b698-15b43c241d8e tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:22.982191 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562519e-0ec5-4f6e-b698-15b43c241d8e tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:22.999981 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04955421-0d9d-4395-8ff2-cca5e1a34d41 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77917dd3885b49fb9b3d5b9e9efb2210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64fb1f98bb3946649a4962c19dc224aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:23.000882 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04955421-0d9d-4395-8ff2-cca5e1a34d41 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:23.001202 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04955421-0d9d-4395-8ff2-cca5e1a34d41 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:23.001480 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04955421-0d9d-4395-8ff2-cca5e1a34d41 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] PATH_INFO: `/v3/services/1ede34538b354bce8dfefbb70426457c` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:23.002840 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04955421-0d9d-4395-8ff2-cca5e1a34d41 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: Authorizing `identity:delete_service(service_id=1ede34538b354bce8dfefbb70426457c)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:23.004122 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04955421-0d9d-4395-8ff2-cca5e1a34d41 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:23.045981 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2947/5926] 10.222.0.23 () {60 vars in 1151 bytes} [Sat Apr 30 21:31:22 2022] POST /identity/v3/projects => generated 328 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:23.046846 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ddf4f-1f61-4e94-a21b-c005e2153b1b tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:23.057306 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-042ddf4f-1f61-4e94-a21b-c005e2153b1b tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:23.135131 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2980/5927] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:31:22 2022] DELETE /identity/v3/services/1ede34538b354bce8dfefbb70426457c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:23.140111 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04955421-0d9d-4395-8ff2-cca5e1a34d41 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:23.193647 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04955421-0d9d-4395-8ff2-cca5e1a34d41 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:23.285797 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ddf4f-1f61-4e94-a21b-c005e2153b1b tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:23.326906 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf9612-5fb0-4f78-8d17-6024d1a98be2 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:23.327599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf9612-5fb0-4f78-8d17-6024d1a98be2 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:23.327888 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf9612-5fb0-4f78-8d17-6024d1a98be2 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:23.328169 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf9612-5fb0-4f78-8d17-6024d1a98be2 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:23.328938 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf9612-5fb0-4f78-8d17-6024d1a98be2 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:23.331904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf9612-5fb0-4f78-8d17-6024d1a98be2 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:23.339519 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e203986-fe0b-4950-91fd-0ccc0ad2265b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:23.340659 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e203986-fe0b-4950-91fd-0ccc0ad2265b service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:23.343915 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e203986-fe0b-4950-91fd-0ccc0ad2265b service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:23.346887 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e203986-fe0b-4950-91fd-0ccc0ad2265b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:23.479700 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2981/5928] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:31:23 2022] POST /identity/v3/users => generated 413 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:23.480990 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf9612-5fb0-4f78-8d17-6024d1a98be2 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:23.520532 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e203986-fe0b-4950-91fd-0ccc0ad2265b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:23.530557 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e203986-fe0b-4950-91fd-0ccc0ad2265b service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:23.565199 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2948/5929] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:31:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 680 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:31:23.567657 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e203986-fe0b-4950-91fd-0ccc0ad2265b service swift] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:23.582718 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e203986-fe0b-4950-91fd-0ccc0ad2265b service swift] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:23.616783 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94130b3-a45f-44c7-ba56-426b3c9798ba tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:23.618169 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94130b3-a45f-44c7-ba56-426b3c9798ba tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:23.620462 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94130b3-a45f-44c7-ba56-426b3c9798ba tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:23.621198 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94130b3-a45f-44c7-ba56-426b3c9798ba tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:23.625640 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94130b3-a45f-44c7-ba56-426b3c9798ba tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:23.629966 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94130b3-a45f-44c7-ba56-426b3c9798ba tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:23.712132 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf9612-5fb0-4f78-8d17-6024d1a98be2 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:23.723451 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef213f32-3837-4347-aa48-d4ce9e5dff3b tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77917dd3885b49fb9b3d5b9e9efb2210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64fb1f98bb3946649a4962c19dc224aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:23.724241 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef213f32-3837-4347-aa48-d4ce9e5dff3b tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:23.725383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef213f32-3837-4347-aa48-d4ce9e5dff3b tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:23.725884 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef213f32-3837-4347-aa48-d4ce9e5dff3b tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:23.726863 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef213f32-3837-4347-aa48-d4ce9e5dff3b tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:23.729045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef213f32-3837-4347-aa48-d4ce9e5dff3b tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:23.943823 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2949/5930] 10.222.0.23 () {60 vars in 1142 bytes} [Sat Apr 30 21:31:23 2022] POST /identity/v3/roles => generated 243 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:23.954977 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94130b3-a45f-44c7-ba56-426b3c9798ba tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:23.961940 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2982/5931] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:31:23 2022] POST /identity/v3/services => generated 288 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:23.965443 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94130b3-a45f-44c7-ba56-426b3c9798ba tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:23.968481 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef213f32-3837-4347-aa48-d4ce9e5dff3b tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:23.996549 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef213f32-3837-4347-aa48-d4ce9e5dff3b tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:24.003980 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373dd32-52ab-4ca6-8139-5a2079095503 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:24.004978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a41063-219c-4e5a-803e-54b6b0b1002b tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77917dd3885b49fb9b3d5b9e9efb2210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64fb1f98bb3946649a4962c19dc224aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:24.005252 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373dd32-52ab-4ca6-8139-5a2079095503 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:24.005629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a41063-219c-4e5a-803e-54b6b0b1002b tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:24.005914 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373dd32-52ab-4ca6-8139-5a2079095503 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:24.006220 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a41063-219c-4e5a-803e-54b6b0b1002b tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:24.006506 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a41063-219c-4e5a-803e-54b6b0b1002b tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:24.006666 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373dd32-52ab-4ca6-8139-5a2079095503 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:24.007244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a41063-219c-4e5a-803e-54b6b0b1002b tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:24.007709 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6373dd32-52ab-4ca6-8139-5a2079095503 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:24.008940 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a41063-219c-4e5a-803e-54b6b0b1002b tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:24.009868 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6373dd32-52ab-4ca6-8139-5a2079095503 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:24.089377 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2950/5932] 10.222.0.23 () {60 vars in 1142 bytes} [Sat Apr 30 21:31:23 2022] POST /identity/v3/roles => generated 247 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:24.093058 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373dd32-52ab-4ca6-8139-5a2079095503 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:24.099928 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2983/5933] 10.222.0.23 () {60 vars in 1212 bytes} [Sat Apr 30 21:31:23 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:24.108522 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a41063-219c-4e5a-803e-54b6b0b1002b tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:24.122866 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373dd32-52ab-4ca6-8139-5a2079095503 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:24.136397 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a41063-219c-4e5a-803e-54b6b0b1002b tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:24.141733 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1909e0-6570-4795-b3f6-132310144188 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:24.144080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1909e0-6570-4795-b3f6-132310144188 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:24.144560 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1909e0-6570-4795-b3f6-132310144188 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:24.145387 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08ba4d-3572-4202-829f-6a91b1e3f02e tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77917dd3885b49fb9b3d5b9e9efb2210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64fb1f98bb3946649a4962c19dc224aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:24.145996 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1909e0-6570-4795-b3f6-132310144188 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/projects/0fad689fc01b44f4b4cc7047df21ae29/users/9d20689d23e249c8a09328eacc1f43c6/roles/6a9fd03b38374fb0a175dc2347ce077f` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:24.148586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08ba4d-3572-4202-829f-6a91b1e3f02e tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:24.148916 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08ba4d-3572-4202-829f-6a91b1e3f02e tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:24.149672 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08ba4d-3572-4202-829f-6a91b1e3f02e tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:24.149970 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f08ba4d-3572-4202-829f-6a91b1e3f02e tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:24.151619 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f08ba4d-3572-4202-829f-6a91b1e3f02e tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:24.172944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1909e0-6570-4795-b3f6-132310144188 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0fad689fc01b44f4b4cc7047df21ae29, user_id=9d20689d23e249c8a09328eacc1f43c6, role_id=6a9fd03b38374fb0a175dc2347ce077f)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:24.177100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1909e0-6570-4795-b3f6-132310144188 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:24.329074 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2951/5934] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:31:24 2022] PUT /identity/v3/projects/0fad689fc01b44f4b4cc7047df21ae29/users/9d20689d23e249c8a09328eacc1f43c6/roles/6a9fd03b38374fb0a175dc2347ce077f => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:31:24.333436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1909e0-6570-4795-b3f6-132310144188 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:24.367033 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2984/5935] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:31:24 2022] POST /identity/v3/services => generated 287 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:31:24.367940 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08ba4d-3572-4202-829f-6a91b1e3f02e tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:24.409995 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08ba4d-3572-4202-829f-6a91b1e3f02e tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:24.542226 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1909e0-6570-4795-b3f6-132310144188 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:24.589578 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dfc337-a6af-4be1-b51e-230c69e3ef74 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:24.591126 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfc337-a6af-4be1-b51e-230c69e3ef74 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:24.591456 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfc337-a6af-4be1-b51e-230c69e3ef74 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:24.591700 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfc337-a6af-4be1-b51e-230c69e3ef74 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/projects/0fad689fc01b44f4b4cc7047df21ae29/users/9d20689d23e249c8a09328eacc1f43c6/roles/3828b4f089074ada91986c21a182199a` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:24.598290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e91792-147f-46d5-b4a3-f2eabf1ae9f9 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77917dd3885b49fb9b3d5b9e9efb2210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64fb1f98bb3946649a4962c19dc224aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:24.599539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e91792-147f-46d5-b4a3-f2eabf1ae9f9 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:24.600581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e91792-147f-46d5-b4a3-f2eabf1ae9f9 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:24.601061 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e91792-147f-46d5-b4a3-f2eabf1ae9f9 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/1444a421e8784ee58c517ff93d1e4ec1` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:24.602085 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e91792-147f-46d5-b4a3-f2eabf1ae9f9 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=1444a421e8784ee58c517ff93d1e4ec1)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:24.603565 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-73e91792-147f-46d5-b4a3-f2eabf1ae9f9 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:31:24.603565 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:31:24.603565 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:31:24.605297 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e91792-147f-46d5-b4a3-f2eabf1ae9f9 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:24.606386 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dfc337-a6af-4be1-b51e-230c69e3ef74 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0fad689fc01b44f4b4cc7047df21ae29, user_id=9d20689d23e249c8a09328eacc1f43c6, role_id=3828b4f089074ada91986c21a182199a)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:24.609077 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dfc337-a6af-4be1-b51e-230c69e3ef74 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:24.753718 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2985/5936] 10.222.0.23 () {60 vars in 1312 bytes} [Sat Apr 30 21:31:24 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/1444a421e8784ee58c517ff93d1e4ec1 => generated 336 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:31:24.757842 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e91792-147f-46d5-b4a3-f2eabf1ae9f9 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:24.776161 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e91792-147f-46d5-b4a3-f2eabf1ae9f9 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:24.795290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386e3d1-5452-40ef-be15-eaa0f57bf41d tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77917dd3885b49fb9b3d5b9e9efb2210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64fb1f98bb3946649a4962c19dc224aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:24.797732 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386e3d1-5452-40ef-be15-eaa0f57bf41d tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:24.798418 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386e3d1-5452-40ef-be15-eaa0f57bf41d tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:24.799577 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386e3d1-5452-40ef-be15-eaa0f57bf41d tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] PATH_INFO: `/v3/services/506253ec097443de853d358fd6f71af2` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:24.800357 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4386e3d1-5452-40ef-be15-eaa0f57bf41d tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: Authorizing `identity:delete_service(service_id=506253ec097443de853d358fd6f71af2)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:24.801293 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2952/5937] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:31:24 2022] PUT /identity/v3/projects/0fad689fc01b44f4b4cc7047df21ae29/users/9d20689d23e249c8a09328eacc1f43c6/roles/3828b4f089074ada91986c21a182199a => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:24.804009 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4386e3d1-5452-40ef-be15-eaa0f57bf41d tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:24.805309 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dfc337-a6af-4be1-b51e-230c69e3ef74 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:24.902015 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2986/5938] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:31:24 2022] DELETE /identity/v3/services/506253ec097443de853d358fd6f71af2 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:24.903024 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386e3d1-5452-40ef-be15-eaa0f57bf41d tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:24.988764 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386e3d1-5452-40ef-be15-eaa0f57bf41d tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:24.996681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dfc337-a6af-4be1-b51e-230c69e3ef74 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:25.043371 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef786fb8-1df7-45fc-8fa9-b466880fd24f tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:25.044070 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef786fb8-1df7-45fc-8fa9-b466880fd24f tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:25.046088 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef786fb8-1df7-45fc-8fa9-b466880fd24f tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:25.049917 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef786fb8-1df7-45fc-8fa9-b466880fd24f tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:25.050966 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef786fb8-1df7-45fc-8fa9-b466880fd24f tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:25.054242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef786fb8-1df7-45fc-8fa9-b466880fd24f tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:25.169999 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2953/5939] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:31:24 2022] GET /identity/v3/users => generated 8619 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:31:25.172132 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce462c-d41e-4a3a-a313-a128ff7e3ed3 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77917dd3885b49fb9b3d5b9e9efb2210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64fb1f98bb3946649a4962c19dc224aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:25.173741 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce462c-d41e-4a3a-a313-a128ff7e3ed3 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:25.174216 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce462c-d41e-4a3a-a313-a128ff7e3ed3 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:25.174651 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce462c-d41e-4a3a-a313-a128ff7e3ed3 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/1444a421e8784ee58c517ff93d1e4ec1` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:25.175478 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce462c-d41e-4a3a-a313-a128ff7e3ed3 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=1444a421e8784ee58c517ff93d1e4ec1)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:25.176102 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c89f95-e6aa-42e3-96b2-e089b7f92b92 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:25.176475 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c89f95-e6aa-42e3-96b2-e089b7f92b92 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:25.177863 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce462c-d41e-4a3a-a313-a128ff7e3ed3 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:25.178815 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c89f95-e6aa-42e3-96b2-e089b7f92b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:25.269964 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-79c89f95-e6aa-42e3-96b2-e089b7f92b92 None None] MFA Rules not processed for user `9d20689d23e249c8a09328eacc1f43c6`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:25.272429 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-79c89f95-e6aa-42e3-96b2-e089b7f92b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:25.294068 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2987/5940] 10.222.0.23 () {58 vars in 1292 bytes} [Sat Apr 30 21:31:24 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/1444a421e8784ee58c517ff93d1e4ec1 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:25.299900 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce462c-d41e-4a3a-a313-a128ff7e3ed3 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:25.325199 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce462c-d41e-4a3a-a313-a128ff7e3ed3 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:25.342745 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584afe21-cbcd-4f8e-a913-7832d96876ef tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77917dd3885b49fb9b3d5b9e9efb2210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64fb1f98bb3946649a4962c19dc224aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:25.343131 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584afe21-cbcd-4f8e-a913-7832d96876ef tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:25.343422 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584afe21-cbcd-4f8e-a913-7832d96876ef tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:25.343704 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584afe21-cbcd-4f8e-a913-7832d96876ef tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] PATH_INFO: `/v3/services/6b6208b201bd497fb6bea92d4670575a` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:25.344376 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584afe21-cbcd-4f8e-a913-7832d96876ef tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: Authorizing `identity:delete_service(service_id=6b6208b201bd497fb6bea92d4670575a)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:25.346736 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584afe21-cbcd-4f8e-a913-7832d96876ef tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:25.443911 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2954/5941] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:25 2022] POST /identity/v3/auth/tokens => generated 3534 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:31:25.445666 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f979825-b01e-448e-8847-05ac585a2d70 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:25.446015 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f979825-b01e-448e-8847-05ac585a2d70 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:25.446303 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f979825-b01e-448e-8847-05ac585a2d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:25.483176 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-0f979825-b01e-448e-8847-05ac585a2d70 None None] MFA Rules not processed for user `9d20689d23e249c8a09328eacc1f43c6`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:25.486323 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0f979825-b01e-448e-8847-05ac585a2d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:25.489030 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2988/5942] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:31:25 2022] DELETE /identity/v3/services/6b6208b201bd497fb6bea92d4670575a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:25.494591 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584afe21-cbcd-4f8e-a913-7832d96876ef tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:25.521588 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584afe21-cbcd-4f8e-a913-7832d96876ef tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:25.524583 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2955/5943] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:25 2022] POST /identity/v3/auth/tokens => generated 3401 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:31:25.528036 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639141d1-57ac-4dfa-8f1c-e74e8234272b tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77917dd3885b49fb9b3d5b9e9efb2210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64fb1f98bb3946649a4962c19dc224aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:25.529110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f979825-b01e-448e-8847-05ac585a2d70 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:25.529235 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639141d1-57ac-4dfa-8f1c-e74e8234272b tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:25.530128 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639141d1-57ac-4dfa-8f1c-e74e8234272b tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:25.530929 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639141d1-57ac-4dfa-8f1c-e74e8234272b tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/6f2e7fcd13a1481895f45d838b2ae80c` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:25.531467 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639141d1-57ac-4dfa-8f1c-e74e8234272b tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=6f2e7fcd13a1481895f45d838b2ae80c)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:25.533781 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639141d1-57ac-4dfa-8f1c-e74e8234272b tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:25.545749 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f979825-b01e-448e-8847-05ac585a2d70 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:25.553039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f6838-503f-4a42-a96b-ed733e6172e0 tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20689d23e249c8a09328eacc1f43c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fad689fc01b44f4b4cc7047df21ae29', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-188171204', 'tempest-NotDelegatedRole-1404223167'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:25.555464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f6838-503f-4a42-a96b-ed733e6172e0 tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:25.555464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f6838-503f-4a42-a96b-ed733e6172e0 tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:25.555464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f6838-503f-4a42-a96b-ed733e6172e0 tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:25.555464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f6838-503f-4a42-a96b-ed733e6172e0 tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] RBAC: Authorizing `identity:create_trust()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:25.556764 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f6838-503f-4a42-a96b-ed733e6172e0 tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:25.621045 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2989/5944] 10.222.0.23 () {58 vars in 1292 bytes} [Sat Apr 30 21:31:25 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/6f2e7fcd13a1481895f45d838b2ae80c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:31:25.624521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639141d1-57ac-4dfa-8f1c-e74e8234272b tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:25.649406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639141d1-57ac-4dfa-8f1c-e74e8234272b tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:25.665343 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6b9f3-b77a-42d5-a51b-b2acdf672510 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77917dd3885b49fb9b3d5b9e9efb2210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64fb1f98bb3946649a4962c19dc224aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:25.668327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6b9f3-b77a-42d5-a51b-b2acdf672510 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:25.668327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6b9f3-b77a-42d5-a51b-b2acdf672510 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:25.677502 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6b9f3-b77a-42d5-a51b-b2acdf672510 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] PATH_INFO: `/v3/services/3a4d0c8fe9054361a32f874a2468aba7` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:25.678157 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6b9f3-b77a-42d5-a51b-b2acdf672510 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: Authorizing `identity:delete_service(service_id=3a4d0c8fe9054361a32f874a2468aba7)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:25.681485 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6b9f3-b77a-42d5-a51b-b2acdf672510 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:25.799542 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2956/5945] 10.222.0.23 () {60 vars in 1173 bytes} [Sat Apr 30 21:31:25 2022] POST /identity/v3/OS-TRUST/trusts => generated 858 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:25.805095 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f6838-503f-4a42-a96b-ed733e6172e0 tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:25.824131 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f6838-503f-4a42-a96b-ed733e6172e0 tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:25.827545 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2990/5946] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:31:25 2022] DELETE /identity/v3/services/3a4d0c8fe9054361a32f874a2468aba7 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:25.831547 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6b9f3-b77a-42d5-a51b-b2acdf672510 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:25.835025 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f4d6b9f3-b77a-42d5-a51b-b2acdf672510 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:25.866608 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c032fd9-e3a9-4e88-92dc-03a50956ed42 tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20689d23e249c8a09328eacc1f43c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fad689fc01b44f4b4cc7047df21ae29', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-188171204', 'tempest-NotDelegatedRole-1404223167'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:25.867467 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c032fd9-e3a9-4e88-92dc-03a50956ed42 tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:25.867755 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c032fd9-e3a9-4e88-92dc-03a50956ed42 tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:25.868033 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c032fd9-e3a9-4e88-92dc-03a50956ed42 tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] PATH_INFO: `/v3/OS-TRUST/trusts/9e8dfc80754541108e8d54d098af9f39` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:25.879785 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c032fd9-e3a9-4e88-92dc-03a50956ed42 tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] RBAC: Authorizing `identity:get_trust(trust_id=9e8dfc80754541108e8d54d098af9f39)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:25.883236 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c032fd9-e3a9-4e88-92dc-03a50956ed42 tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:25.910421 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2957/5947] 10.222.0.23 () {58 vars in 1250 bytes} [Sat Apr 30 21:31:25 2022] GET /identity/v3/OS-TRUST/trusts/9e8dfc80754541108e8d54d098af9f39 => generated 858 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:31:25.911385 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c032fd9-e3a9-4e88-92dc-03a50956ed42 tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:25.920772 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c032fd9-e3a9-4e88-92dc-03a50956ed42 tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:25.927135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a01d50-edd9-4d05-95b9-28ada5b20b6e tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20689d23e249c8a09328eacc1f43c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fad689fc01b44f4b4cc7047df21ae29', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-188171204', 'tempest-NotDelegatedRole-1404223167'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:25.927841 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a01d50-edd9-4d05-95b9-28ada5b20b6e tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:25.928137 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a01d50-edd9-4d05-95b9-28ada5b20b6e tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:25.928421 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a01d50-edd9-4d05-95b9-28ada5b20b6e tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] PATH_INFO: `/v3/OS-TRUST/trusts/9e8dfc80754541108e8d54d098af9f39/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:25.935104 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a01d50-edd9-4d05-95b9-28ada5b20b6e tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=9e8dfc80754541108e8d54d098af9f39)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:25.936641 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a01d50-edd9-4d05-95b9-28ada5b20b6e tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:25.948567 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6b9f3-b77a-42d5-a51b-b2acdf672510 tempest-EndPointGroupsTest-1314495691 tempest-EndPointGroupsTest-1314495691-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:25.950809 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2958/5948] 10.222.0.23 () {58 vars in 1268 bytes} [Sat Apr 30 21:31:25 2022] GET /identity/v3/OS-TRUST/trusts/9e8dfc80754541108e8d54d098af9f39/roles => generated 370 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:31:25.958780 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a01d50-edd9-4d05-95b9-28ada5b20b6e tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:25.959016 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b5d4f-b73f-4bf7-a226-b836f5b88edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:25.959016 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b5d4f-b73f-4bf7-a226-b836f5b88edd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:25.959016 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b5d4f-b73f-4bf7-a226-b836f5b88edd admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:25.959016 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b5d4f-b73f-4bf7-a226-b836f5b88edd admin admin] PATH_INFO: `/v3/users/49f11329a72b457286c1b8d9d468792c` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:25.959314 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b5d4f-b73f-4bf7-a226-b836f5b88edd admin admin] RBAC: Authorizing `identity:delete_user(user_id=49f11329a72b457286c1b8d9d468792c)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:25.961276 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b5d4f-b73f-4bf7-a226-b836f5b88edd admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:25.961459 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a01d50-edd9-4d05-95b9-28ada5b20b6e tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:25.974044 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5a61c-a295-414a-8606-7f2c832f60ad tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20689d23e249c8a09328eacc1f43c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fad689fc01b44f4b4cc7047df21ae29', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-188171204', 'tempest-NotDelegatedRole-1404223167'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:25.980186 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5a61c-a295-414a-8606-7f2c832f60ad tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:25.980186 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5a61c-a295-414a-8606-7f2c832f60ad tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:25.980186 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5a61c-a295-414a-8606-7f2c832f60ad tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] PATH_INFO: `/v3/OS-TRUST/trusts/9e8dfc80754541108e8d54d098af9f39/roles/6a9fd03b38374fb0a175dc2347ce077f` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:25.983295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c5a61c-a295-414a-8606-7f2c832f60ad tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] RBAC: Authorizing `identity:get_role_for_trust(trust_id=9e8dfc80754541108e8d54d098af9f39, role_id=6a9fd03b38374fb0a175dc2347ce077f)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:25.984783 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c5a61c-a295-414a-8606-7f2c832f60ad tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:26.000022 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2959/5949] 10.222.0.23 () {58 vars in 1367 bytes} [Sat Apr 30 21:31:25 2022] GET /identity/v3/OS-TRUST/trusts/9e8dfc80754541108e8d54d098af9f39/roles/6a9fd03b38374fb0a175dc2347ce077f => generated 243 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:31:26.000968 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5a61c-a295-414a-8606-7f2c832f60ad tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:26.011571 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5a61c-a295-414a-8606-7f2c832f60ad tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:26.016085 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f35e24-7dc6-41e6-9bf3-ca652f0dcecd tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20689d23e249c8a09328eacc1f43c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fad689fc01b44f4b4cc7047df21ae29', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-188171204', 'tempest-NotDelegatedRole-1404223167'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:26.017482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f35e24-7dc6-41e6-9bf3-ca652f0dcecd tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] REQUEST_METHOD: `HEAD` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:26.017782 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f35e24-7dc6-41e6-9bf3-ca652f0dcecd tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:26.018104 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f35e24-7dc6-41e6-9bf3-ca652f0dcecd tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] PATH_INFO: `/v3/OS-TRUST/trusts/9e8dfc80754541108e8d54d098af9f39/roles/6a9fd03b38374fb0a175dc2347ce077f` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:26.025403 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f35e24-7dc6-41e6-9bf3-ca652f0dcecd tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] RBAC: Authorizing `identity:get_role_for_trust(trust_id=9e8dfc80754541108e8d54d098af9f39, role_id=6a9fd03b38374fb0a175dc2347ce077f)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:26.026919 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f35e24-7dc6-41e6-9bf3-ca652f0dcecd tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:26.038828 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2960/5950] 10.222.0.23 () {58 vars in 1368 bytes} [Sat Apr 30 21:31:26 2022] HEAD /identity/v3/OS-TRUST/trusts/9e8dfc80754541108e8d54d098af9f39/roles/6a9fd03b38374fb0a175dc2347ce077f => generated 0 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Apr 30 21:31:26.039769 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f35e24-7dc6-41e6-9bf3-ca652f0dcecd tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:26.075258 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f35e24-7dc6-41e6-9bf3-ca652f0dcecd tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:26.087346 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0adff-5666-45ef-980c-6b17a3e8bb5e tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20689d23e249c8a09328eacc1f43c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fad689fc01b44f4b4cc7047df21ae29', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-188171204', 'tempest-NotDelegatedRole-1404223167'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:26.089028 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0adff-5666-45ef-980c-6b17a3e8bb5e tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:26.089523 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0adff-5666-45ef-980c-6b17a3e8bb5e tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:26.090100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0adff-5666-45ef-980c-6b17a3e8bb5e tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] PATH_INFO: `/v3/OS-TRUST/trusts/9e8dfc80754541108e8d54d098af9f39/roles/3828b4f089074ada91986c21a182199a` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:26.099120 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c0adff-5666-45ef-980c-6b17a3e8bb5e tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] RBAC: Authorizing `identity:get_role_for_trust(trust_id=9e8dfc80754541108e8d54d098af9f39, role_id=3828b4f089074ada91986c21a182199a)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:26.101107 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c0adff-5666-45ef-980c-6b17a3e8bb5e tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:26.118768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-f3c0adff-5666-45ef-980c-6b17a3e8bb5e tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] Could not find role: 3828b4f089074ada91986c21a182199a.: keystone.exception.RoleNotFound: Could not find role: 3828b4f089074ada91986c21a182199a. Apr 30 21:31:26.118768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:31:26.118768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:31:26.118768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:31:26.118768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:31:26.118768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:31:26.118768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:31:26.118768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:31:26.118768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:31:26.118768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:31:26.118768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:31:26.118768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:31:26.118768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Apr 30 21:31:26.118768 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 21:31:26.119582 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 3828b4f089074ada91986c21a182199a. Apr 30 21:31:26.119582 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:31:26.125128 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2961/5951] 10.222.0.23 () {58 vars in 1367 bytes} [Sat Apr 30 21:31:26 2022] GET /identity/v3/OS-TRUST/trusts/9e8dfc80754541108e8d54d098af9f39/roles/3828b4f089074ada91986c21a182199a => generated 110 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 30 21:31:26.126279 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0adff-5666-45ef-980c-6b17a3e8bb5e tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:26.150270 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0adff-5666-45ef-980c-6b17a3e8bb5e tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:26.169028 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85bb7b8-36b7-4ed0-969e-699ab84e3194 tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20689d23e249c8a09328eacc1f43c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fad689fc01b44f4b4cc7047df21ae29', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-188171204', 'tempest-NotDelegatedRole-1404223167'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:26.170750 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85bb7b8-36b7-4ed0-969e-699ab84e3194 tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] REQUEST_METHOD: `HEAD` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:26.171255 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85bb7b8-36b7-4ed0-969e-699ab84e3194 tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:26.171746 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85bb7b8-36b7-4ed0-969e-699ab84e3194 tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] PATH_INFO: `/v3/OS-TRUST/trusts/9e8dfc80754541108e8d54d098af9f39/roles/3828b4f089074ada91986c21a182199a` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:26.190620 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85bb7b8-36b7-4ed0-969e-699ab84e3194 tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] RBAC: Authorizing `identity:get_role_for_trust(trust_id=9e8dfc80754541108e8d54d098af9f39, role_id=3828b4f089074ada91986c21a182199a)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:26.192529 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85bb7b8-36b7-4ed0-969e-699ab84e3194 tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:26.224566 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-e85bb7b8-36b7-4ed0-969e-699ab84e3194 tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] Could not find role: 3828b4f089074ada91986c21a182199a.: keystone.exception.RoleNotFound: Could not find role: 3828b4f089074ada91986c21a182199a. Apr 30 21:31:26.224566 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:31:26.224566 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:31:26.224566 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:31:26.224566 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:31:26.224566 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:31:26.224566 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:31:26.224566 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:31:26.224566 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:31:26.224566 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:31:26.224566 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:31:26.224566 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:31:26.224566 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Apr 30 21:31:26.224566 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 21:31:26.225717 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 3828b4f089074ada91986c21a182199a. Apr 30 21:31:26.225717 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:31:26.236207 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2962/5952] 10.222.0.23 () {58 vars in 1368 bytes} [Sat Apr 30 21:31:26 2022] HEAD /identity/v3/OS-TRUST/trusts/9e8dfc80754541108e8d54d098af9f39/roles/3828b4f089074ada91986c21a182199a => generated 0 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Apr 30 21:31:26.237875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451c4e6-9c13-4a64-9add-971b17316c0f None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:26.238173 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451c4e6-9c13-4a64-9add-971b17316c0f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:26.238460 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451c4e6-9c13-4a64-9add-971b17316c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:26.267220 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-560b5d4f-b73f-4bf7-a226-b836f5b88edd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49f11329a72b457286c1b8d9d468792c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:26.287848 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-c451c4e6-9c13-4a64-9add-971b17316c0f None None] MFA Rules not processed for user `1e5bf319f22145459e3c71d158430d63`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:26.289564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c451c4e6-9c13-4a64-9add-971b17316c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:26.310668 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-560b5d4f-b73f-4bf7-a226-b836f5b88edd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49f11329a72b457286c1b8d9d468792c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:26.377688 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2963/5953] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:26.377688 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451c4e6-9c13-4a64-9add-971b17316c0f None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:26.402499 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-560b5d4f-b73f-4bf7-a226-b836f5b88edd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49f11329a72b457286c1b8d9d468792c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:26.421729 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-560b5d4f-b73f-4bf7-a226-b836f5b88edd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49f11329a72b457286c1b8d9d468792c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:26.424959 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451c4e6-9c13-4a64-9add-971b17316c0f None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:26.425980 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-560b5d4f-b73f-4bf7-a226-b836f5b88edd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49f11329a72b457286c1b8d9d468792c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:26.444111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7519be-4d1a-45f6-bea0-0e7d11725371 tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20689d23e249c8a09328eacc1f43c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fad689fc01b44f4b4cc7047df21ae29', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-188171204', 'tempest-NotDelegatedRole-1404223167'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:26.446604 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7519be-4d1a-45f6-bea0-0e7d11725371 tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:26.446903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7519be-4d1a-45f6-bea0-0e7d11725371 tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:26.447197 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7519be-4d1a-45f6-bea0-0e7d11725371 tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] PATH_INFO: `/v3/OS-TRUST/trusts/9e8dfc80754541108e8d54d098af9f39` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:26.452515 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2991/5954] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:31:25 2022] DELETE /identity/v3/users/49f11329a72b457286c1b8d9d468792c => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:26.456460 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14769c5c-369e-4cc6-a5fe-e3b560db04b9 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:26.456755 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14769c5c-369e-4cc6-a5fe-e3b560db04b9 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:26.457042 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14769c5c-369e-4cc6-a5fe-e3b560db04b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:26.469189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7519be-4d1a-45f6-bea0-0e7d11725371 tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] RBAC: Authorizing `identity:delete_trust(trust_id=9e8dfc80754541108e8d54d098af9f39)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:26.474961 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7519be-4d1a-45f6-bea0-0e7d11725371 tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:26.514734 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-14769c5c-369e-4cc6-a5fe-e3b560db04b9 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:26.515998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-14769c5c-369e-4cc6-a5fe-e3b560db04b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:26.571474 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2f7519be-4d1a-45f6-bea0-0e7d11725371 tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '9e8dfc80754541108e8d54d098af9f39', 'request_id': 'req-2f7519be-4d1a-45f6-bea0-0e7d11725371'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:26.574198 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2f7519be-4d1a-45f6-bea0-0e7d11725371 tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '9e8dfc80754541108e8d54d098af9f39', 'request_id': 'req-2f7519be-4d1a-45f6-bea0-0e7d11725371'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:26.662007 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2f7519be-4d1a-45f6-bea0-0e7d11725371 tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '9e8dfc80754541108e8d54d098af9f39', 'request_id': 'req-2f7519be-4d1a-45f6-bea0-0e7d11725371'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:26.663061 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2992/5955] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:26.674693 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14769c5c-369e-4cc6-a5fe-e3b560db04b9 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:26.676427 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-14769c5c-369e-4cc6-a5fe-e3b560db04b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:26.678636 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2964/5956] 10.222.0.23 () {58 vars in 1253 bytes} [Sat Apr 30 21:31:26 2022] DELETE /identity/v3/OS-TRUST/trusts/9e8dfc80754541108e8d54d098af9f39 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:26.682955 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7519be-4d1a-45f6-bea0-0e7d11725371 tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:26.686295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2f7519be-4d1a-45f6-bea0-0e7d11725371 tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:26.760952 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7519be-4d1a-45f6-bea0-0e7d11725371 tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:26.928826 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14769c5c-369e-4cc6-a5fe-e3b560db04b9 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:26.941195 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a272f1e6-2bf0-4d77-b4c3-97edab72ac17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:26.942286 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272f1e6-2bf0-4d77-b4c3-97edab72ac17 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:26.942787 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272f1e6-2bf0-4d77-b4c3-97edab72ac17 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:26.945328 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272f1e6-2bf0-4d77-b4c3-97edab72ac17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:26.947866 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a272f1e6-2bf0-4d77-b4c3-97edab72ac17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:26.961525 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7daec2-9246-4210-9604-b47bb7cda567 tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d20689d23e249c8a09328eacc1f43c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fad689fc01b44f4b4cc7047df21ae29', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-188171204', 'tempest-NotDelegatedRole-1404223167'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:26.962410 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7daec2-9246-4210-9604-b47bb7cda567 tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:26.962702 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7daec2-9246-4210-9604-b47bb7cda567 tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:26.962984 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7daec2-9246-4210-9604-b47bb7cda567 tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] PATH_INFO: `/v3/OS-TRUST/trusts/9e8dfc80754541108e8d54d098af9f39` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:26.971293 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a272f1e6-2bf0-4d77-b4c3-97edab72ac17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:26.973063 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a272f1e6-2bf0-4d77-b4c3-97edab72ac17 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:26.989114 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-0f7daec2-9246-4210-9604-b47bb7cda567 tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] Could not find trust: 9e8dfc80754541108e8d54d098af9f39.: keystone.exception.TrustNotFound: Could not find trust: 9e8dfc80754541108e8d54d098af9f39. Apr 30 21:31:26.989114 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:31:26.989114 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:31:26.989114 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:31:26.989114 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:31:26.989114 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:31:26.989114 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:31:26.989114 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:31:26.989114 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:31:26.989114 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:31:26.989114 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:31:26.989114 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:31:26.989114 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Apr 30 21:31:26.989114 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Apr 30 21:31:26.989114 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Apr 30 21:31:26.990274 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Apr 30 21:31:26.990274 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Apr 30 21:31:26.990274 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Apr 30 21:31:26.990274 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Apr 30 21:31:26.990274 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Apr 30 21:31:26.990274 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:31:26.990274 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:31:26.990274 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Apr 30 21:31:26.990274 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Apr 30 21:31:26.990274 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Apr 30 21:31:26.990274 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Apr 30 21:31:26.990274 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 9e8dfc80754541108e8d54d098af9f39. Apr 30 21:31:26.990274 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:31:26.995860 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2993/5957] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:31:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:31:27.000817 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2965/5958] 10.222.0.23 () {58 vars in 1250 bytes} [Sat Apr 30 21:31:26 2022] GET /identity/v3/OS-TRUST/trusts/9e8dfc80754541108e8d54d098af9f39 => generated 111 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 30 21:31:27.006942 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a272f1e6-2bf0-4d77-b4c3-97edab72ac17 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:27.008603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a272f1e6-2bf0-4d77-b4c3-97edab72ac17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:27.343885 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a272f1e6-2bf0-4d77-b4c3-97edab72ac17 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:27.359819 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17bc45-547c-40de-8328-875cfa740598 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:27.362082 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17bc45-547c-40de-8328-875cfa740598 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:27.362577 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17bc45-547c-40de-8328-875cfa740598 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:27.363052 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17bc45-547c-40de-8328-875cfa740598 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/roles/3828b4f089074ada91986c21a182199a` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:27.371956 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af17bc45-547c-40de-8328-875cfa740598 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3828b4f089074ada91986c21a182199a)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:27.375644 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af17bc45-547c-40de-8328-875cfa740598 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:27.591449 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-af17bc45-547c-40de-8328-875cfa740598 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invalidating the token cache because role 3828b4f089074ada91986c21a182199a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:27.591937 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-af17bc45-547c-40de-8328-875cfa740598 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:27.592954 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-af17bc45-547c-40de-8328-875cfa740598 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:27.599752 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2994/5959] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:31:27 2022] DELETE /identity/v3/roles/3828b4f089074ada91986c21a182199a => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:27.601063 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7daec2-9246-4210-9604-b47bb7cda567 tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:27.604111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0f7daec2-9246-4210-9604-b47bb7cda567 tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:27.657012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7daec2-9246-4210-9604-b47bb7cda567 tempest-TrustsV3TestJSON-579817989 tempest-user-551690640] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:27.813178 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d76efe-e911-43eb-b6ca-8f69529d7c6e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:27.815039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d76efe-e911-43eb-b6ca-8f69529d7c6e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:27.819235 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d76efe-e911-43eb-b6ca-8f69529d7c6e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:27.820615 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d76efe-e911-43eb-b6ca-8f69529d7c6e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/roles/6a9fd03b38374fb0a175dc2347ce077f` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:27.826612 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d76efe-e911-43eb-b6ca-8f69529d7c6e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6a9fd03b38374fb0a175dc2347ce077f)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:27.830807 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d76efe-e911-43eb-b6ca-8f69529d7c6e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:27.852885 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17bc45-547c-40de-8328-875cfa740598 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:27.855872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-af17bc45-547c-40de-8328-875cfa740598 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:28.040504 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17bc45-547c-40de-8328-875cfa740598 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:28.041563 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-91d76efe-e911-43eb-b6ca-8f69529d7c6e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invalidating the token cache because role 6a9fd03b38374fb0a175dc2347ce077f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:28.041992 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-91d76efe-e911-43eb-b6ca-8f69529d7c6e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:28.042871 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-91d76efe-e911-43eb-b6ca-8f69529d7c6e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:28.048649 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2966/5960] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:31:27 2022] DELETE /identity/v3/roles/6a9fd03b38374fb0a175dc2347ce077f => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:28.049833 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d76efe-e911-43eb-b6ca-8f69529d7c6e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:28.052851 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c16f7-8c47-42c2-a6aa-9b60aa6a4fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:28.053744 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-91d76efe-e911-43eb-b6ca-8f69529d7c6e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:28.059300 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c16f7-8c47-42c2-a6aa-9b60aa6a4fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:28.059300 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c16f7-8c47-42c2-a6aa-9b60aa6a4fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:28.059909 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c16f7-8c47-42c2-a6aa-9b60aa6a4fa3 admin admin] PATH_INFO: `/v3/projects/2c946abda3d8459aa2480bf829748f68` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:28.061460 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c16f7-8c47-42c2-a6aa-9b60aa6a4fa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c946abda3d8459aa2480bf829748f68)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:28.065246 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c16f7-8c47-42c2-a6aa-9b60aa6a4fa3 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:28.169960 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d76efe-e911-43eb-b6ca-8f69529d7c6e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:28.183073 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f731a-1907-447f-b0e6-309bc8f7c212 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:28.183073 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f731a-1907-447f-b0e6-309bc8f7c212 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:28.183073 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f731a-1907-447f-b0e6-309bc8f7c212 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:28.183384 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f731a-1907-447f-b0e6-309bc8f7c212 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/users/9d20689d23e249c8a09328eacc1f43c6` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:28.187156 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f731a-1907-447f-b0e6-309bc8f7c212 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9d20689d23e249c8a09328eacc1f43c6)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:28.189504 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f731a-1907-447f-b0e6-309bc8f7c212 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:28.263706 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-726c16f7-8c47-42c2-a6aa-9b60aa6a4fa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c946abda3d8459aa2480bf829748f68', 'request_id': 'req-726c16f7-8c47-42c2-a6aa-9b60aa6a4fa3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:28.301137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-726c16f7-8c47-42c2-a6aa-9b60aa6a4fa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c946abda3d8459aa2480bf829748f68', 'request_id': 'req-726c16f7-8c47-42c2-a6aa-9b60aa6a4fa3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:28.328361 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-726c16f7-8c47-42c2-a6aa-9b60aa6a4fa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c946abda3d8459aa2480bf829748f68', 'request_id': 'req-726c16f7-8c47-42c2-a6aa-9b60aa6a4fa3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:28.369172 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1a6f731a-1907-447f-b0e6-309bc8f7c212 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d20689d23e249c8a09328eacc1f43c6'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:28.397805 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1a6f731a-1907-447f-b0e6-309bc8f7c212 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d20689d23e249c8a09328eacc1f43c6'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:28.411043 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-726c16f7-8c47-42c2-a6aa-9b60aa6a4fa3 admin admin] The token cache is being invalidate because project 2c946abda3d8459aa2480bf829748f68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:28.411337 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-726c16f7-8c47-42c2-a6aa-9b60aa6a4fa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:28.412126 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-726c16f7-8c47-42c2-a6aa-9b60aa6a4fa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:28.414796 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2995/5961] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:31:27 2022] DELETE /identity/v3/projects/2c946abda3d8459aa2480bf829748f68 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:31:28.418219 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c16f7-8c47-42c2-a6aa-9b60aa6a4fa3 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:28.420635 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-726c16f7-8c47-42c2-a6aa-9b60aa6a4fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:28.499535 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1a6f731a-1907-447f-b0e6-309bc8f7c212 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d20689d23e249c8a09328eacc1f43c6'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:28.500910 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1a6f731a-1907-447f-b0e6-309bc8f7c212 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d20689d23e249c8a09328eacc1f43c6'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:28.518536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1a6f731a-1907-447f-b0e6-309bc8f7c212 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d20689d23e249c8a09328eacc1f43c6'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:28.534957 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2967/5962] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:31:28 2022] DELETE /identity/v3/users/9d20689d23e249c8a09328eacc1f43c6 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:28.537977 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f731a-1907-447f-b0e6-309bc8f7c212 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:28.546352 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1a6f731a-1907-447f-b0e6-309bc8f7c212 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:28.610921 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c16f7-8c47-42c2-a6aa-9b60aa6a4fa3 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:28.730209 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f731a-1907-447f-b0e6-309bc8f7c212 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:28.747534 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c13f25-13f4-4d82-bb7d-a44631d39c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:28.747811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9716fe-8a3c-428f-bade-61b322f652b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:28.748739 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9716fe-8a3c-428f-bade-61b322f652b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:28.748917 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c13f25-13f4-4d82-bb7d-a44631d39c47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:28.749211 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c13f25-13f4-4d82-bb7d-a44631d39c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:28.749327 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9716fe-8a3c-428f-bade-61b322f652b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:28.749543 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9716fe-8a3c-428f-bade-61b322f652b4 admin admin] PATH_INFO: `/v3/users/77917dd3885b49fb9b3d5b9e9efb2210` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:28.749746 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c13f25-13f4-4d82-bb7d-a44631d39c47 admin admin] PATH_INFO: `/v3/users/c25664f1ee004401a909079f12339c47` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:28.751861 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c13f25-13f4-4d82-bb7d-a44631d39c47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c25664f1ee004401a909079f12339c47)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:28.752054 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9716fe-8a3c-428f-bade-61b322f652b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77917dd3885b49fb9b3d5b9e9efb2210)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:28.754556 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c13f25-13f4-4d82-bb7d-a44631d39c47 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:28.755787 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9716fe-8a3c-428f-bade-61b322f652b4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:28.976723 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-66c13f25-13f4-4d82-bb7d-a44631d39c47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c25664f1ee004401a909079f12339c47'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:29.020319 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6b9716fe-8a3c-428f-bade-61b322f652b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77917dd3885b49fb9b3d5b9e9efb2210'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:29.023384 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-66c13f25-13f4-4d82-bb7d-a44631d39c47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c25664f1ee004401a909079f12339c47'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:29.070844 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6b9716fe-8a3c-428f-bade-61b322f652b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77917dd3885b49fb9b3d5b9e9efb2210'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:29.107211 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-66c13f25-13f4-4d82-bb7d-a44631d39c47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c25664f1ee004401a909079f12339c47'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:29.117114 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-66c13f25-13f4-4d82-bb7d-a44631d39c47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c25664f1ee004401a909079f12339c47'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:29.123690 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-66c13f25-13f4-4d82-bb7d-a44631d39c47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c25664f1ee004401a909079f12339c47'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:29.129193 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2996/5963] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:31:28 2022] DELETE /identity/v3/users/c25664f1ee004401a909079f12339c47 => generated 0 bytes in 714 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:29.130256 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c13f25-13f4-4d82-bb7d-a44631d39c47 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:29.133436 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-66c13f25-13f4-4d82-bb7d-a44631d39c47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:29.197178 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6b9716fe-8a3c-428f-bade-61b322f652b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77917dd3885b49fb9b3d5b9e9efb2210'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:29.198289 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6b9716fe-8a3c-428f-bade-61b322f652b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77917dd3885b49fb9b3d5b9e9efb2210'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:29.209672 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6b9716fe-8a3c-428f-bade-61b322f652b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77917dd3885b49fb9b3d5b9e9efb2210'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:29.225202 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c13f25-13f4-4d82-bb7d-a44631d39c47 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:29.230448 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f28f9-c2ca-4e1c-b348-6045b2bc673b tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:29.231333 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f28f9-c2ca-4e1c-b348-6045b2bc673b tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:29.231623 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f28f9-c2ca-4e1c-b348-6045b2bc673b tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:29.231900 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f28f9-c2ca-4e1c-b348-6045b2bc673b tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/projects/0fad689fc01b44f4b4cc7047df21ae29` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:29.236887 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2968/5964] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:31:28 2022] DELETE /identity/v3/users/77917dd3885b49fb9b3d5b9e9efb2210 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:29.245391 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56a39f-5dfd-42b5-8984-f1c622cb517b None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:29.245391 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56a39f-5dfd-42b5-8984-f1c622cb517b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:29.245391 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56a39f-5dfd-42b5-8984-f1c622cb517b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:29.245642 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f28f9-c2ca-4e1c-b348-6045b2bc673b tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0fad689fc01b44f4b4cc7047df21ae29)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:29.247421 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f28f9-c2ca-4e1c-b348-6045b2bc673b tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:29.322019 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-af56a39f-5dfd-42b5-8984-f1c622cb517b None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:29.331247 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-af56a39f-5dfd-42b5-8984-f1c622cb517b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:29.465115 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2969/5965] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:29.497064 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56a39f-5dfd-42b5-8984-f1c622cb517b None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:29.498683 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-af56a39f-5dfd-42b5-8984-f1c622cb517b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:29.644870 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56a39f-5dfd-42b5-8984-f1c622cb517b None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:29.665604 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-084f28f9-c2ca-4e1c-b348-6045b2bc673b tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fad689fc01b44f4b4cc7047df21ae29', 'request_id': 'req-084f28f9-c2ca-4e1c-b348-6045b2bc673b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:29.673407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-084f28f9-c2ca-4e1c-b348-6045b2bc673b tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fad689fc01b44f4b4cc7047df21ae29', 'request_id': 'req-084f28f9-c2ca-4e1c-b348-6045b2bc673b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:29.718811 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-084f28f9-c2ca-4e1c-b348-6045b2bc673b tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fad689fc01b44f4b4cc7047df21ae29', 'request_id': 'req-084f28f9-c2ca-4e1c-b348-6045b2bc673b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:29.769011 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c59da14-720c-4122-a794-7255a4e90a92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:29.770642 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59da14-720c-4122-a794-7255a4e90a92 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:29.772486 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59da14-720c-4122-a794-7255a4e90a92 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:29.773000 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59da14-720c-4122-a794-7255a4e90a92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:29.819450 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-084f28f9-c2ca-4e1c-b348-6045b2bc673b tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] The token cache is being invalidate because project 0fad689fc01b44f4b4cc7047df21ae29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:29.819751 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-084f28f9-c2ca-4e1c-b348-6045b2bc673b tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:29.820592 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-084f28f9-c2ca-4e1c-b348-6045b2bc673b tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:29.823199 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2997/5966] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:31:29 2022] DELETE /identity/v3/projects/0fad689fc01b44f4b4cc7047df21ae29 => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:29.828879 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f28f9-c2ca-4e1c-b348-6045b2bc673b tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:29.830720 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-084f28f9-c2ca-4e1c-b348-6045b2bc673b tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:29.953569 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c59da14-720c-4122-a794-7255a4e90a92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:29.956810 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c59da14-720c-4122-a794-7255a4e90a92 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:29.990414 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2970/5967] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:31:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:31:30.084936 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f28f9-c2ca-4e1c-b348-6045b2bc673b tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:30.092159 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6dd5fb-04d9-4731-a9cf-8d2dc7d4d8b0 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:30.093128 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6dd5fb-04d9-4731-a9cf-8d2dc7d4d8b0 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:30.093572 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6dd5fb-04d9-4731-a9cf-8d2dc7d4d8b0 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:30.107573 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6dd5fb-04d9-4731-a9cf-8d2dc7d4d8b0 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:30.111479 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6dd5fb-04d9-4731-a9cf-8d2dc7d4d8b0 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:30.115372 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6dd5fb-04d9-4731-a9cf-8d2dc7d4d8b0 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:30.276855 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c59da14-720c-4122-a794-7255a4e90a92 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:30.278683 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1c59da14-720c-4122-a794-7255a4e90a92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:30.283258 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2998/5968] 10.222.0.23 () {60 vars in 1151 bytes} [Sat Apr 30 21:31:29 2022] POST /identity/v3/projects => generated 329 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:30.304185 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c59da14-720c-4122-a794-7255a4e90a92 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:30.363370 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6dd5fb-04d9-4731-a9cf-8d2dc7d4d8b0 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:30.365146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-bb6dd5fb-04d9-4731-a9cf-8d2dc7d4d8b0 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:30.569638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a58366-cfd8-4412-b1b2-9703859e885d tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:30.570821 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a58366-cfd8-4412-b1b2-9703859e885d tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:30.571211 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a58366-cfd8-4412-b1b2-9703859e885d tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:30.571841 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a58366-cfd8-4412-b1b2-9703859e885d tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:30.572723 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a58366-cfd8-4412-b1b2-9703859e885d tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:30.576574 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a58366-cfd8-4412-b1b2-9703859e885d tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:30.582591 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6dd5fb-04d9-4731-a9cf-8d2dc7d4d8b0 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:30.600279 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49afb955-bdb7-4421-8099-9fde123a831c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:30.601455 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afb955-bdb7-4421-8099-9fde123a831c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:30.601979 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afb955-bdb7-4421-8099-9fde123a831c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:30.602488 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afb955-bdb7-4421-8099-9fde123a831c admin admin] PATH_INFO: `/v3/projects/64fb1f98bb3946649a4962c19dc224aa` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:30.603951 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49afb955-bdb7-4421-8099-9fde123a831c admin admin] RBAC: Authorizing `identity:delete_project(project_id=64fb1f98bb3946649a4962c19dc224aa)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:30.606159 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49afb955-bdb7-4421-8099-9fde123a831c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:30.684770 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2971/5969] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:31:30 2022] POST /identity/v3/users => generated 416 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:30.686509 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a58366-cfd8-4412-b1b2-9703859e885d tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:30.702643 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a58366-cfd8-4412-b1b2-9703859e885d tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:30.722117 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817ede9-9ebb-44c7-8d0a-b94e5c68edb0 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:30.723233 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817ede9-9ebb-44c7-8d0a-b94e5c68edb0 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:30.724204 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817ede9-9ebb-44c7-8d0a-b94e5c68edb0 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:30.724536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817ede9-9ebb-44c7-8d0a-b94e5c68edb0 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:30.724536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4817ede9-9ebb-44c7-8d0a-b94e5c68edb0 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:30.724536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4817ede9-9ebb-44c7-8d0a-b94e5c68edb0 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:30.847743 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2972/5970] 10.222.0.23 () {60 vars in 1142 bytes} [Sat Apr 30 21:31:30 2022] POST /identity/v3/roles => generated 244 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:31:30.849528 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817ede9-9ebb-44c7-8d0a-b94e5c68edb0 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:30.871157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817ede9-9ebb-44c7-8d0a-b94e5c68edb0 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:30.884016 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-49afb955-bdb7-4421-8099-9fde123a831c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64fb1f98bb3946649a4962c19dc224aa', 'request_id': 'req-49afb955-bdb7-4421-8099-9fde123a831c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:30.903345 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-49afb955-bdb7-4421-8099-9fde123a831c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64fb1f98bb3946649a4962c19dc224aa', 'request_id': 'req-49afb955-bdb7-4421-8099-9fde123a831c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:30.927924 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-49afb955-bdb7-4421-8099-9fde123a831c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64fb1f98bb3946649a4962c19dc224aa', 'request_id': 'req-49afb955-bdb7-4421-8099-9fde123a831c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:31.031432 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719823c-d9f0-4cac-9540-3bbca7b27eb1 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:31.032297 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719823c-d9f0-4cac-9540-3bbca7b27eb1 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:31.032672 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719823c-d9f0-4cac-9540-3bbca7b27eb1 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:31.033030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719823c-d9f0-4cac-9540-3bbca7b27eb1 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:31.033904 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0719823c-d9f0-4cac-9540-3bbca7b27eb1 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:31.036680 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0719823c-d9f0-4cac-9540-3bbca7b27eb1 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:31.218707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-49afb955-bdb7-4421-8099-9fde123a831c admin admin] The token cache is being invalidate because project 64fb1f98bb3946649a4962c19dc224aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:31.220191 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-49afb955-bdb7-4421-8099-9fde123a831c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:31.221788 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-49afb955-bdb7-4421-8099-9fde123a831c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:31.225350 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 2999/5971] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:31:30 2022] DELETE /identity/v3/projects/64fb1f98bb3946649a4962c19dc224aa => generated 0 bytes in 862 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:31.226630 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49afb955-bdb7-4421-8099-9fde123a831c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:31.248475 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2973/5972] 10.222.0.23 () {60 vars in 1142 bytes} [Sat Apr 30 21:31:30 2022] POST /identity/v3/roles => generated 247 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:31.250069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719823c-d9f0-4cac-9540-3bbca7b27eb1 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:31.253049 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0719823c-d9f0-4cac-9540-3bbca7b27eb1 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:31.265860 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-49afb955-bdb7-4421-8099-9fde123a831c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:31.376534 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49afb955-bdb7-4421-8099-9fde123a831c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:31.381057 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1e490-07d1-4659-b15c-6e9f11733ef8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:31.381710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1e490-07d1-4659-b15c-6e9f11733ef8 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:31.382327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1e490-07d1-4659-b15c-6e9f11733ef8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:31.382503 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1e490-07d1-4659-b15c-6e9f11733ef8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:31.386932 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-eed1e490-07d1-4659-b15c-6e9f11733ef8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:31.471201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719823c-d9f0-4cac-9540-3bbca7b27eb1 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:31.484118 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1369345-2bae-4062-94a2-e89fd2342b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:31.485003 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1369345-2bae-4062-94a2-e89fd2342b4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:31.485356 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1369345-2bae-4062-94a2-e89fd2342b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:31.485631 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1369345-2bae-4062-94a2-e89fd2342b4d admin admin] PATH_INFO: `/v3/projects/449fb8e48bdd4f9cb3311e729795435f` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:31.489396 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1369345-2bae-4062-94a2-e89fd2342b4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=449fb8e48bdd4f9cb3311e729795435f)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:31.492252 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1369345-2bae-4062-94a2-e89fd2342b4d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:31.525076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1e490-07d1-4659-b15c-6e9f11733ef8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:31.527140 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1e490-07d1-4659-b15c-6e9f11733ef8 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:31.582504 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3000/5973] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:31:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:31:31.585183 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7469e1-a0b7-4fd5-9194-4e809e3feb5a None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:31.588667 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7469e1-a0b7-4fd5-9194-4e809e3feb5a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:31.593583 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7469e1-a0b7-4fd5-9194-4e809e3feb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:31.630790 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-ac7469e1-a0b7-4fd5-9194-4e809e3feb5a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:31.636069 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ac7469e1-a0b7-4fd5-9194-4e809e3feb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:31.679361 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3001/5974] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:31.679361 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7469e1-a0b7-4fd5-9194-4e809e3feb5a None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:31.679361 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ac7469e1-a0b7-4fd5-9194-4e809e3feb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:31.702115 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7469e1-a0b7-4fd5-9194-4e809e3feb5a None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:31.718221 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a1369345-2bae-4062-94a2-e89fd2342b4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '449fb8e48bdd4f9cb3311e729795435f', 'request_id': 'req-a1369345-2bae-4062-94a2-e89fd2342b4d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:31.736934 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a1369345-2bae-4062-94a2-e89fd2342b4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '449fb8e48bdd4f9cb3311e729795435f', 'request_id': 'req-a1369345-2bae-4062-94a2-e89fd2342b4d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:31.747082 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a1369345-2bae-4062-94a2-e89fd2342b4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '449fb8e48bdd4f9cb3311e729795435f', 'request_id': 'req-a1369345-2bae-4062-94a2-e89fd2342b4d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:31.804836 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83d92d-ee0d-498e-bda4-e72c75987b7a tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:31.806379 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83d92d-ee0d-498e-bda4-e72c75987b7a tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:31.806883 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83d92d-ee0d-498e-bda4-e72c75987b7a tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:31.807349 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83d92d-ee0d-498e-bda4-e72c75987b7a tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/projects/ed9ce72f439e4c4db9157141d737900c/users/8cf190a0d5ff48cb900175e96693f6e6/roles/0351a68e94454816bfb4adfbbe32a93c` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:31.833681 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83d92d-ee0d-498e-bda4-e72c75987b7a tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ed9ce72f439e4c4db9157141d737900c, user_id=8cf190a0d5ff48cb900175e96693f6e6, role_id=0351a68e94454816bfb4adfbbe32a93c)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:31.837370 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83d92d-ee0d-498e-bda4-e72c75987b7a tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:31.855580 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a1369345-2bae-4062-94a2-e89fd2342b4d admin admin] The token cache is being invalidate because project 449fb8e48bdd4f9cb3311e729795435f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:31.856234 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a1369345-2bae-4062-94a2-e89fd2342b4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:31.856890 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a1369345-2bae-4062-94a2-e89fd2342b4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:31.867240 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2974/5975] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:31:31 2022] DELETE /identity/v3/projects/449fb8e48bdd4f9cb3311e729795435f => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:31.870885 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc5b68-3e82-45bf-a291-8188a265923f None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:31.870885 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc5b68-3e82-45bf-a291-8188a265923f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:31.870885 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc5b68-3e82-45bf-a291-8188a265923f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:31.905729 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-17bc5b68-3e82-45bf-a291-8188a265923f None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:31.907094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-17bc5b68-3e82-45bf-a291-8188a265923f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:31.958290 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3002/5976] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:31:31 2022] PUT /identity/v3/projects/ed9ce72f439e4c4db9157141d737900c/users/8cf190a0d5ff48cb900175e96693f6e6/roles/0351a68e94454816bfb4adfbbe32a93c => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:31.959505 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83d92d-ee0d-498e-bda4-e72c75987b7a tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:31.963210 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4a83d92d-ee0d-498e-bda4-e72c75987b7a tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:32.075427 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2975/5977] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:32.077036 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc5b68-3e82-45bf-a291-8188a265923f None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:32.079935 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-17bc5b68-3e82-45bf-a291-8188a265923f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:32.114985 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc5b68-3e82-45bf-a291-8188a265923f None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:32.217895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83d92d-ee0d-498e-bda4-e72c75987b7a tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:32.232867 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44ce25-345d-4521-9244-241cc4f2bb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:32.236218 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad292d-f3ac-4bd9-8835-612c45969d6e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:32.236664 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44ce25-345d-4521-9244-241cc4f2bb13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:32.237160 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44ce25-345d-4521-9244-241cc4f2bb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:32.238087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44ce25-345d-4521-9244-241cc4f2bb13 admin admin] PATH_INFO: `/v3/users/5f2b520ae828416c8aebffabbc5577c9` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:32.238464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad292d-f3ac-4bd9-8835-612c45969d6e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:32.239280 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad292d-f3ac-4bd9-8835-612c45969d6e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:32.240439 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad292d-f3ac-4bd9-8835-612c45969d6e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/projects/ed9ce72f439e4c4db9157141d737900c/users/8cf190a0d5ff48cb900175e96693f6e6/roles/a8457ea0120b4e64a905139b2b0a1ca0` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:32.242053 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44ce25-345d-4521-9244-241cc4f2bb13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f2b520ae828416c8aebffabbc5577c9)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:32.244902 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44ce25-345d-4521-9244-241cc4f2bb13 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:32.246898 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad292d-f3ac-4bd9-8835-612c45969d6e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ed9ce72f439e4c4db9157141d737900c, user_id=8cf190a0d5ff48cb900175e96693f6e6, role_id=a8457ea0120b4e64a905139b2b0a1ca0)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:32.253275 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad292d-f3ac-4bd9-8835-612c45969d6e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:32.356565 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2976/5978] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:31:32 2022] PUT /identity/v3/projects/ed9ce72f439e4c4db9157141d737900c/users/8cf190a0d5ff48cb900175e96693f6e6/roles/a8457ea0120b4e64a905139b2b0a1ca0 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:32.359429 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad292d-f3ac-4bd9-8835-612c45969d6e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:32.473233 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad292d-f3ac-4bd9-8835-612c45969d6e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:32.478969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0550a0-d0e5-4ef9-98e7-6aca25ee7c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:32.480357 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0550a0-d0e5-4ef9-98e7-6aca25ee7c30 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:32.480863 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0550a0-d0e5-4ef9-98e7-6aca25ee7c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:32.481347 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0550a0-d0e5-4ef9-98e7-6aca25ee7c30 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:32.482330 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0550a0-d0e5-4ef9-98e7-6aca25ee7c30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:31:32.483075 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0550a0-d0e5-4ef9-98e7-6aca25ee7c30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:32.484957 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0550a0-d0e5-4ef9-98e7-6aca25ee7c30 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:32.551605 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2977/5979] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:31:32.557105 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0550a0-d0e5-4ef9-98e7-6aca25ee7c30 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:32.660254 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2d44ce25-345d-4521-9244-241cc4f2bb13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f2b520ae828416c8aebffabbc5577c9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:32.700057 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2d44ce25-345d-4521-9244-241cc4f2bb13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f2b520ae828416c8aebffabbc5577c9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:32.755137 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0550a0-d0e5-4ef9-98e7-6aca25ee7c30 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:32.763135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33b797-cf84-421b-bed4-c8bf9bb586de tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:32.763886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33b797-cf84-421b-bed4-c8bf9bb586de tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:32.764180 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33b797-cf84-421b-bed4-c8bf9bb586de tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:32.764473 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33b797-cf84-421b-bed4-c8bf9bb586de tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:32.765368 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd33b797-cf84-421b-bed4-c8bf9bb586de tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:32.768126 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd33b797-cf84-421b-bed4-c8bf9bb586de tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:32.769820 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2d44ce25-345d-4521-9244-241cc4f2bb13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f2b520ae828416c8aebffabbc5577c9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:32.778423 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2d44ce25-345d-4521-9244-241cc4f2bb13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f2b520ae828416c8aebffabbc5577c9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:32.779728 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2d44ce25-345d-4521-9244-241cc4f2bb13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f2b520ae828416c8aebffabbc5577c9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:32.797307 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3003/5980] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:31:31 2022] DELETE /identity/v3/users/5f2b520ae828416c8aebffabbc5577c9 => generated 0 bytes in 838 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:32.798905 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44ce25-345d-4521-9244-241cc4f2bb13 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:32.802083 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2d44ce25-345d-4521-9244-241cc4f2bb13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:32.861001 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2978/5981] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:31:32 2022] GET /identity/v3/users => generated 7486 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:31:32.867227 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce9b50-61c5-427f-b3ff-e40afadbaa50 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:32.868770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce9b50-61c5-427f-b3ff-e40afadbaa50 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:32.869194 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce9b50-61c5-427f-b3ff-e40afadbaa50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:32.972416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-6fce9b50-61c5-427f-b3ff-e40afadbaa50 None None] MFA Rules not processed for user `8cf190a0d5ff48cb900175e96693f6e6`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:32.978554 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6fce9b50-61c5-427f-b3ff-e40afadbaa50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:32.997242 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44ce25-345d-4521-9244-241cc4f2bb13 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:33.010955 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d9646-71a8-413b-8206-604adba064f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:33.012776 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d9646-71a8-413b-8206-604adba064f6 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:33.014052 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d9646-71a8-413b-8206-604adba064f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:33.014491 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d9646-71a8-413b-8206-604adba064f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:33.017250 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d9646-71a8-413b-8206-604adba064f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:33.022542 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d9646-71a8-413b-8206-604adba064f6 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:33.138991 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2979/5982] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:32 2022] POST /identity/v3/auth/tokens => generated 3271 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:33.146427 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3004/5983] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:31:32 2022] POST /identity/v3/projects => generated 373 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:33.147894 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2303f0-b4b3-4311-88a8-d6ed4b4d2018 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:33.147894 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2303f0-b4b3-4311-88a8-d6ed4b4d2018 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:33.147894 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2303f0-b4b3-4311-88a8-d6ed4b4d2018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:33.148129 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d9646-71a8-413b-8206-604adba064f6 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:33.210470 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-3b2303f0-b4b3-4311-88a8-d6ed4b4d2018 None None] MFA Rules not processed for user `8cf190a0d5ff48cb900175e96693f6e6`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:33.211727 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3b2303f0-b4b3-4311-88a8-d6ed4b4d2018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:33.344891 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d9646-71a8-413b-8206-604adba064f6 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:33.351399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac435d-bbb4-45b1-8206-336438a3f7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:33.351527 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac435d-bbb4-45b1-8206-336438a3f7b4 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:33.351817 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac435d-bbb4-45b1-8206-336438a3f7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:33.352101 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac435d-bbb4-45b1-8206-336438a3f7b4 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:33.352806 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac435d-bbb4-45b1-8206-336438a3f7b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:33.355422 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac435d-bbb4-45b1-8206-336438a3f7b4 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:33.389809 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2980/5984] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:33 2022] POST /identity/v3/auth/tokens => generated 3271 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:33.402802 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2303f0-b4b3-4311-88a8-d6ed4b4d2018 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:33.417327 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2303f0-b4b3-4311-88a8-d6ed4b4d2018 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:33.435150 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb793b-8ca8-44df-9543-cc5f9b8b198e tempest-TrustsV3TestJSON-2056919421 tempest-user-1165473904] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cf190a0d5ff48cb900175e96693f6e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed9ce72f439e4c4db9157141d737900c', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1232374203', 'tempest-NotDelegatedRole-1232177111'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:33.436036 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb793b-8ca8-44df-9543-cc5f9b8b198e tempest-TrustsV3TestJSON-2056919421 tempest-user-1165473904] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:33.436560 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb793b-8ca8-44df-9543-cc5f9b8b198e tempest-TrustsV3TestJSON-2056919421 tempest-user-1165473904] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:33.437588 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb793b-8ca8-44df-9543-cc5f9b8b198e tempest-TrustsV3TestJSON-2056919421 tempest-user-1165473904] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:33.439285 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb793b-8ca8-44df-9543-cc5f9b8b198e tempest-TrustsV3TestJSON-2056919421 tempest-user-1165473904] RBAC: Authorizing `identity:create_trust()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:33.441170 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb793b-8ca8-44df-9543-cc5f9b8b198e tempest-TrustsV3TestJSON-2056919421 tempest-user-1165473904] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:33.472598 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3005/5985] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:31:33 2022] POST /identity/v3/users => generated 287 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:33.479954 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac435d-bbb4-45b1-8206-336438a3f7b4 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:33.526294 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac435d-bbb4-45b1-8206-336438a3f7b4 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:33.543860 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b147c-4fac-4d70-aa40-936cae7618a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:33.544840 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b147c-4fac-4d70-aa40-936cae7618a0 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:33.545361 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b147c-4fac-4d70-aa40-936cae7618a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:33.545878 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b147c-4fac-4d70-aa40-936cae7618a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:33.546856 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b147c-4fac-4d70-aa40-936cae7618a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:33.550160 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b147c-4fac-4d70-aa40-936cae7618a0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:33.587462 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3006/5986] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:31:33 2022] GET /identity/v3/roles => generated 1893 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:31:33.597256 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b147c-4fac-4d70-aa40-936cae7618a0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:33.611040 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b147c-4fac-4d70-aa40-936cae7618a0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:33.622777 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9d960-feb2-448b-82fe-dc82b6711e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:33.624818 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9d960-feb2-448b-82fe-dc82b6711e00 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:33.625269 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9d960-feb2-448b-82fe-dc82b6711e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:33.625835 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9d960-feb2-448b-82fe-dc82b6711e00 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:33.626789 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f9d960-feb2-448b-82fe-dc82b6711e00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:33.638930 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f9d960-feb2-448b-82fe-dc82b6711e00 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:33.660130 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3007/5987] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:31:33 2022] GET /identity/v3/roles => generated 1893 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:31:33.665750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9d960-feb2-448b-82fe-dc82b6711e00 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:33.704925 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9d960-feb2-448b-82fe-dc82b6711e00 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:33.712375 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a1c64-e14a-472f-a3e9-c2b7efcce2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:33.713584 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a1c64-e14a-472f-a3e9-c2b7efcce2d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:33.714131 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a1c64-e14a-472f-a3e9-c2b7efcce2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:33.714624 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a1c64-e14a-472f-a3e9-c2b7efcce2d4 admin admin] PATH_INFO: `/v3/projects/40baf40cdec643a8b0c3626bfdc125c6/users/ff193dc7f3e54c5c8cd4335319d247e4/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:33.745063 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275a1c64-e14a-472f-a3e9-c2b7efcce2d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40baf40cdec643a8b0c3626bfdc125c6, user_id=ff193dc7f3e54c5c8cd4335319d247e4, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:33.753462 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275a1c64-e14a-472f-a3e9-c2b7efcce2d4 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:33.765377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-6ecb793b-8ca8-44df-9543-cc5f9b8b198e tempest-TrustsV3TestJSON-2056919421 tempest-user-1165473904] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Apr 30 21:31:33.765377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:31:33.765377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 67, in parse_isotime Apr 30 21:31:33.765377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Apr 30 21:31:33.765377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Apr 30 21:31:33.765377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Apr 30 21:31:33.765377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Apr 30 21:31:33.765377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:31:33.765377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 21:31:33.765377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:31:33.765377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:31:33.765377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Apr 30 21:31:33.765377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Apr 30 21:31:33.765377 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 69, in parse_isotime Apr 30 21:31:33.766889 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise ValueError(str(e)) Apr 30 21:31:33.766889 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Apr 30 21:31:33.766889 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:31:33.766889 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 21:31:33.766889 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:31:33.766889 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:31:33.766889 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:31:33.766889 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:31:33.766889 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:31:33.766889 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:31:33.766889 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:31:33.766889 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:31:33.766889 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:31:33.766889 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:31:33.766889 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:31:33.766889 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:31:33.766889 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Apr 30 21:31:33.766889 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Apr 30 21:31:33.767926 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Apr 30 21:31:33.767926 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Apr 30 21:31:33.767926 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Apr 30 21:31:33.767926 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Apr 30 21:31:33.767926 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Apr 30 21:31:33.767926 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:31:33.781694 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2981/5988] 10.222.0.23 () {60 vars in 1173 bytes} [Sat Apr 30 21:31:33 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 379 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Apr 30 21:31:33.783191 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb793b-8ca8-44df-9543-cc5f9b8b198e tempest-TrustsV3TestJSON-2056919421 tempest-user-1165473904] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:33.788510 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6ecb793b-8ca8-44df-9543-cc5f9b8b198e tempest-TrustsV3TestJSON-2056919421 tempest-user-1165473904] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:33.846429 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3008/5989] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:31:33 2022] PUT /identity/v3/projects/40baf40cdec643a8b0c3626bfdc125c6/users/ff193dc7f3e54c5c8cd4335319d247e4/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:33.849841 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debe243-f961-4084-b7f0-4f1a73c94eb5 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:33.850992 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debe243-f961-4084-b7f0-4f1a73c94eb5 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:33.851878 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debe243-f961-4084-b7f0-4f1a73c94eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:33.948822 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-6debe243-f961-4084-b7f0-4f1a73c94eb5 None None] MFA Rules not processed for user `ff193dc7f3e54c5c8cd4335319d247e4`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:33.957091 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6debe243-f961-4084-b7f0-4f1a73c94eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:34.042136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb793b-8ca8-44df-9543-cc5f9b8b198e tempest-TrustsV3TestJSON-2056919421 tempest-user-1165473904] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:34.174703 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3009/5990] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:34.179113 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debe243-f961-4084-b7f0-4f1a73c94eb5 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:34.184694 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df2692-c584-4f3b-ab80-c93be9425559 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:34.186283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df2692-c584-4f3b-ab80-c93be9425559 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:34.186979 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df2692-c584-4f3b-ab80-c93be9425559 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:34.186979 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df2692-c584-4f3b-ab80-c93be9425559 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/roles/a8457ea0120b4e64a905139b2b0a1ca0` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:34.194991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2df2692-c584-4f3b-ab80-c93be9425559 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a8457ea0120b4e64a905139b2b0a1ca0)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:34.196645 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2df2692-c584-4f3b-ab80-c93be9425559 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:34.288019 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debe243-f961-4084-b7f0-4f1a73c94eb5 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:34.294633 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d27180-bfd8-450f-876f-71f8251a12dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:34.295606 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d27180-bfd8-450f-876f-71f8251a12dd admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:34.296045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d27180-bfd8-450f-876f-71f8251a12dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:34.296477 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d27180-bfd8-450f-876f-71f8251a12dd admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:34.300864 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d27180-bfd8-450f-876f-71f8251a12dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:34.303111 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d27180-bfd8-450f-876f-71f8251a12dd admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:34.402392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c2df2692-c584-4f3b-ab80-c93be9425559 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invalidating the token cache because role a8457ea0120b4e64a905139b2b0a1ca0 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:34.402691 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c2df2692-c584-4f3b-ab80-c93be9425559 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:34.403461 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c2df2692-c584-4f3b-ab80-c93be9425559 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:34.408939 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2982/5991] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:31:33 2022] DELETE /identity/v3/roles/a8457ea0120b4e64a905139b2b0a1ca0 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:34.410309 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df2692-c584-4f3b-ab80-c93be9425559 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:34.412150 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c2df2692-c584-4f3b-ab80-c93be9425559 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:34.423219 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3010/5992] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:31:34 2022] POST /identity/v3/projects => generated 373 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:34.429250 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d27180-bfd8-450f-876f-71f8251a12dd admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:34.432693 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-54d27180-bfd8-450f-876f-71f8251a12dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:34.580163 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df2692-c584-4f3b-ab80-c93be9425559 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:34.604895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d27180-bfd8-450f-876f-71f8251a12dd admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:34.622758 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3c724-e143-4bbf-8418-c3994ebf3563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:34.624636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3c724-e143-4bbf-8418-c3994ebf3563 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:34.625130 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3c724-e143-4bbf-8418-c3994ebf3563 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:34.626300 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3c724-e143-4bbf-8418-c3994ebf3563 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:34.627551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3c724-e143-4bbf-8418-c3994ebf3563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:34.634349 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3c724-e143-4bbf-8418-c3994ebf3563 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:34.701222 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f7017-93ce-4451-9ffa-37fc7b593a8c tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:34.702133 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f7017-93ce-4451-9ffa-37fc7b593a8c tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:34.702420 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f7017-93ce-4451-9ffa-37fc7b593a8c tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:34.702700 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f7017-93ce-4451-9ffa-37fc7b593a8c tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/roles/0351a68e94454816bfb4adfbbe32a93c` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:34.704778 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f7017-93ce-4451-9ffa-37fc7b593a8c tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0351a68e94454816bfb4adfbbe32a93c)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:34.706465 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f7017-93ce-4451-9ffa-37fc7b593a8c tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:34.789233 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3011/5993] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:31:34 2022] POST /identity/v3/users => generated 293 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:34.794358 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3c724-e143-4bbf-8418-c3994ebf3563 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:34.828487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3c724-e143-4bbf-8418-c3994ebf3563 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:34.852800 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd96d4-5676-498d-afe8-c12f4ffaeaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:34.854366 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd96d4-5676-498d-afe8-c12f4ffaeaee admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:34.855416 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd96d4-5676-498d-afe8-c12f4ffaeaee admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:34.855909 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd96d4-5676-498d-afe8-c12f4ffaeaee admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:34.856889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd96d4-5676-498d-afe8-c12f4ffaeaee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:34.859253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd96d4-5676-498d-afe8-c12f4ffaeaee admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:34.895711 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3012/5994] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:31:34 2022] GET /identity/v3/roles => generated 1655 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:31:34.897610 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd96d4-5676-498d-afe8-c12f4ffaeaee admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:34.929619 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd96d4-5676-498d-afe8-c12f4ffaeaee admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:34.955199 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09367c-a695-4d49-b0bd-c01d5fa3beb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:34.956113 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09367c-a695-4d49-b0bd-c01d5fa3beb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:34.957678 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09367c-a695-4d49-b0bd-c01d5fa3beb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:34.957994 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09367c-a695-4d49-b0bd-c01d5fa3beb8 admin admin] PATH_INFO: `/v3/projects/d1239213ab65408db7b6faeadf44a331/users/5c02a6c45cb74d05b2ca67caf4b56683/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:34.959216 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-880f7017-93ce-4451-9ffa-37fc7b593a8c tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invalidating the token cache because role 0351a68e94454816bfb4adfbbe32a93c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:34.970134 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-880f7017-93ce-4451-9ffa-37fc7b593a8c tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:34.970134 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-880f7017-93ce-4451-9ffa-37fc7b593a8c tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:34.970134 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2983/5995] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:31:34 2022] DELETE /identity/v3/roles/0351a68e94454816bfb4adfbbe32a93c => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:31:34.971503 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f7017-93ce-4451-9ffa-37fc7b593a8c tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:34.978438 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-880f7017-93ce-4451-9ffa-37fc7b593a8c tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:34.999176 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b09367c-a695-4d49-b0bd-c01d5fa3beb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1239213ab65408db7b6faeadf44a331, user_id=5c02a6c45cb74d05b2ca67caf4b56683, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:35.003875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b09367c-a695-4d49-b0bd-c01d5fa3beb8 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:35.112187 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3013/5996] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:31:34 2022] PUT /identity/v3/projects/d1239213ab65408db7b6faeadf44a331/users/5c02a6c45cb74d05b2ca67caf4b56683/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:35.116032 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09367c-a695-4d49-b0bd-c01d5fa3beb8 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:35.119198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1b09367c-a695-4d49-b0bd-c01d5fa3beb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:35.177012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f7017-93ce-4451-9ffa-37fc7b593a8c tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:35.311697 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09367c-a695-4d49-b0bd-c01d5fa3beb8 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:35.345636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51c58d-8a4c-4050-8663-ec20e4f00869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:35.346396 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51c58d-8a4c-4050-8663-ec20e4f00869 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:35.346675 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51c58d-8a4c-4050-8663-ec20e4f00869 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:35.346958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51c58d-8a4c-4050-8663-ec20e4f00869 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:35.350918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51c58d-8a4c-4050-8663-ec20e4f00869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:35.351696 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a250f5a2-9174-487d-bf8c-76433e56fefd tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:35.352844 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250f5a2-9174-487d-bf8c-76433e56fefd tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:35.356847 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51c58d-8a4c-4050-8663-ec20e4f00869 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:35.359506 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250f5a2-9174-487d-bf8c-76433e56fefd tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:35.359798 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250f5a2-9174-487d-bf8c-76433e56fefd tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/users/8cf190a0d5ff48cb900175e96693f6e6` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:35.367309 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a250f5a2-9174-487d-bf8c-76433e56fefd tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8cf190a0d5ff48cb900175e96693f6e6)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:35.372300 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a250f5a2-9174-487d-bf8c-76433e56fefd tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:35.382764 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3014/5997] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:31:35.385410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51c58d-8a4c-4050-8663-ec20e4f00869 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:35.400285 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51c58d-8a4c-4050-8663-ec20e4f00869 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:35.429146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26d003-7ed5-493a-9fab-b9c0125cd064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:35.430097 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26d003-7ed5-493a-9fab-b9c0125cd064 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:35.430381 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26d003-7ed5-493a-9fab-b9c0125cd064 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:35.431750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26d003-7ed5-493a-9fab-b9c0125cd064 admin admin] PATH_INFO: `/v3/projects/d1239213ab65408db7b6faeadf44a331/users/5c02a6c45cb74d05b2ca67caf4b56683/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:35.436915 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b26d003-7ed5-493a-9fab-b9c0125cd064 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1239213ab65408db7b6faeadf44a331, user_id=5c02a6c45cb74d05b2ca67caf4b56683, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:35.448042 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b26d003-7ed5-493a-9fab-b9c0125cd064 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:35.490069 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3015/5998] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:31:35 2022] PUT /identity/v3/projects/d1239213ab65408db7b6faeadf44a331/users/5c02a6c45cb74d05b2ca67caf4b56683/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:35.508420 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633912c-77ce-4ddd-9258-fe4bfeb068f6 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:35.508546 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633912c-77ce-4ddd-9258-fe4bfeb068f6 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:35.508754 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633912c-77ce-4ddd-9258-fe4bfeb068f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:35.573929 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a250f5a2-9174-487d-bf8c-76433e56fefd tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cf190a0d5ff48cb900175e96693f6e6'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:35.582272 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-3633912c-77ce-4ddd-9258-fe4bfeb068f6 None None] MFA Rules not processed for user `5c02a6c45cb74d05b2ca67caf4b56683`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:35.587810 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3633912c-77ce-4ddd-9258-fe4bfeb068f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:35.599474 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a250f5a2-9174-487d-bf8c-76433e56fefd tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cf190a0d5ff48cb900175e96693f6e6'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:35.701016 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a250f5a2-9174-487d-bf8c-76433e56fefd tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cf190a0d5ff48cb900175e96693f6e6'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:35.701704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a250f5a2-9174-487d-bf8c-76433e56fefd tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cf190a0d5ff48cb900175e96693f6e6'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:35.710325 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a250f5a2-9174-487d-bf8c-76433e56fefd tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cf190a0d5ff48cb900175e96693f6e6'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:35.731447 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2984/5999] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:31:34 2022] DELETE /identity/v3/users/8cf190a0d5ff48cb900175e96693f6e6 => generated 0 bytes in 761 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:35.737287 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a250f5a2-9174-487d-bf8c-76433e56fefd tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:35.738771 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a250f5a2-9174-487d-bf8c-76433e56fefd tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:35.827265 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3016/6000] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:35 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:35.832210 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3633912c-77ce-4ddd-9258-fe4bfeb068f6 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:35.867805 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3633912c-77ce-4ddd-9258-fe4bfeb068f6 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:35.944557 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a250f5a2-9174-487d-bf8c-76433e56fefd tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:35.974939 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5f2bf-2f69-44cd-ba18-41056c32aa03 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:35.978856 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5f2bf-2f69-44cd-ba18-41056c32aa03 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:35.978856 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5f2bf-2f69-44cd-ba18-41056c32aa03 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:35.978856 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5f2bf-2f69-44cd-ba18-41056c32aa03 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/projects/ed9ce72f439e4c4db9157141d737900c` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:35.978856 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5f2bf-2f69-44cd-ba18-41056c32aa03 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ed9ce72f439e4c4db9157141d737900c)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:35.983308 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5f2bf-2f69-44cd-ba18-41056c32aa03 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:36.081442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76b7df-221b-4c48-817b-c8ec5ec2859b tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:36.082459 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76b7df-221b-4c48-817b-c8ec5ec2859b tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:36.083025 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76b7df-221b-4c48-817b-c8ec5ec2859b tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:36.083404 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76b7df-221b-4c48-817b-c8ec5ec2859b tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:36.084347 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76b7df-221b-4c48-817b-c8ec5ec2859b tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:36.088308 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76b7df-221b-4c48-817b-c8ec5ec2859b tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:36.194834 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-70c5f2bf-2f69-44cd-ba18-41056c32aa03 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed9ce72f439e4c4db9157141d737900c', 'request_id': 'req-70c5f2bf-2f69-44cd-ba18-41056c32aa03'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:36.213084 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-70c5f2bf-2f69-44cd-ba18-41056c32aa03 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed9ce72f439e4c4db9157141d737900c', 'request_id': 'req-70c5f2bf-2f69-44cd-ba18-41056c32aa03'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:36.229176 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3017/6001] 10.222.0.23 () {60 vars in 1148 bytes} [Sat Apr 30 21:31:35 2022] POST /identity/v3/domains => generated 276 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:36.229176 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76b7df-221b-4c48-817b-c8ec5ec2859b tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:36.233467 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-70c5f2bf-2f69-44cd-ba18-41056c32aa03 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed9ce72f439e4c4db9157141d737900c', 'request_id': 'req-70c5f2bf-2f69-44cd-ba18-41056c32aa03'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:36.250904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5c76b7df-221b-4c48-817b-c8ec5ec2859b tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:36.351974 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-70c5f2bf-2f69-44cd-ba18-41056c32aa03 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] The token cache is being invalidate because project ed9ce72f439e4c4db9157141d737900c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:36.353282 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-70c5f2bf-2f69-44cd-ba18-41056c32aa03 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:36.355339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-70c5f2bf-2f69-44cd-ba18-41056c32aa03 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:36.357874 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2985/6002] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:31:35 2022] DELETE /identity/v3/projects/ed9ce72f439e4c4db9157141d737900c => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:31:36.358886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5f2bf-2f69-44cd-ba18-41056c32aa03 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:36.363548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-70c5f2bf-2f69-44cd-ba18-41056c32aa03 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:36.493083 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76b7df-221b-4c48-817b-c8ec5ec2859b tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:36.506631 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e383039f-7902-4207-88df-34fb1fd8eb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:36.513317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e383039f-7902-4207-88df-34fb1fd8eb0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:36.514506 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e383039f-7902-4207-88df-34fb1fd8eb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:36.516390 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e383039f-7902-4207-88df-34fb1fd8eb0b admin admin] PATH_INFO: `/v3/projects/e79cc8b468e84b62b91c1946fd37c8bd` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:36.519754 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e383039f-7902-4207-88df-34fb1fd8eb0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e79cc8b468e84b62b91c1946fd37c8bd)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:36.527361 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e383039f-7902-4207-88df-34fb1fd8eb0b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:36.566213 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5f2bf-2f69-44cd-ba18-41056c32aa03 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:36.700067 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731d98c-6158-41bc-a70f-7a7e8f756af1 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:36.700336 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e383039f-7902-4207-88df-34fb1fd8eb0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e79cc8b468e84b62b91c1946fd37c8bd', 'request_id': 'req-e383039f-7902-4207-88df-34fb1fd8eb0b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:36.704854 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731d98c-6158-41bc-a70f-7a7e8f756af1 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:36.704854 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731d98c-6158-41bc-a70f-7a7e8f756af1 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:36.704854 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731d98c-6158-41bc-a70f-7a7e8f756af1 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:36.705951 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a731d98c-6158-41bc-a70f-7a7e8f756af1 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:36.714553 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e383039f-7902-4207-88df-34fb1fd8eb0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e79cc8b468e84b62b91c1946fd37c8bd', 'request_id': 'req-e383039f-7902-4207-88df-34fb1fd8eb0b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:36.715738 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a731d98c-6158-41bc-a70f-7a7e8f756af1 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:36.730474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e383039f-7902-4207-88df-34fb1fd8eb0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e79cc8b468e84b62b91c1946fd37c8bd', 'request_id': 'req-e383039f-7902-4207-88df-34fb1fd8eb0b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:36.814119 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e383039f-7902-4207-88df-34fb1fd8eb0b admin admin] The token cache is being invalidate because project e79cc8b468e84b62b91c1946fd37c8bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:36.814423 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e383039f-7902-4207-88df-34fb1fd8eb0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:36.821060 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e383039f-7902-4207-88df-34fb1fd8eb0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:36.823308 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3018/6003] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:31:36 2022] DELETE /identity/v3/projects/e79cc8b468e84b62b91c1946fd37c8bd => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:36.823777 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e383039f-7902-4207-88df-34fb1fd8eb0b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:36.825650 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e383039f-7902-4207-88df-34fb1fd8eb0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:36.902379 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2986/6004] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:31:36 2022] POST /identity/v3/projects => generated 401 bytes in 543 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:36.905628 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731d98c-6158-41bc-a70f-7a7e8f756af1 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:36.912148 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a731d98c-6158-41bc-a70f-7a7e8f756af1 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:37.039210 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e383039f-7902-4207-88df-34fb1fd8eb0b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:37.165969 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b879786-b4c2-4b9a-8543-9fc6a458dba1 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:37.166994 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b879786-b4c2-4b9a-8543-9fc6a458dba1 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:37.167288 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b879786-b4c2-4b9a-8543-9fc6a458dba1 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:37.167571 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b879786-b4c2-4b9a-8543-9fc6a458dba1 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:37.168437 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b879786-b4c2-4b9a-8543-9fc6a458dba1 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:37.170489 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b879786-b4c2-4b9a-8543-9fc6a458dba1 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:37.276789 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3019/6005] 10.222.0.23 () {60 vars in 1151 bytes} [Sat Apr 30 21:31:36 2022] POST /identity/v3/projects => generated 328 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:37.281442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b879786-b4c2-4b9a-8543-9fc6a458dba1 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:37.288179 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731d98c-6158-41bc-a70f-7a7e8f756af1 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:37.434397 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716088b2-47b6-4c89-be03-55bef383b5d5 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:37.436263 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716088b2-47b6-4c89-be03-55bef383b5d5 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:37.436555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716088b2-47b6-4c89-be03-55bef383b5d5 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:37.436903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716088b2-47b6-4c89-be03-55bef383b5d5 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/groups` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:37.437620 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716088b2-47b6-4c89-be03-55bef383b5d5 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:37.440328 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716088b2-47b6-4c89-be03-55bef383b5d5 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:37.481347 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b879786-b4c2-4b9a-8543-9fc6a458dba1 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:37.489243 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e459ff1-781a-4021-92b8-73ee8e7709aa tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:37.490207 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e459ff1-781a-4021-92b8-73ee8e7709aa tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:37.490638 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e459ff1-781a-4021-92b8-73ee8e7709aa tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:37.491069 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e459ff1-781a-4021-92b8-73ee8e7709aa tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:37.492095 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e459ff1-781a-4021-92b8-73ee8e7709aa tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:37.495230 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e459ff1-781a-4021-92b8-73ee8e7709aa tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:37.579151 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2987/6006] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:31:36 2022] POST /identity/v3/groups => generated 301 bytes in 676 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:37.583891 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716088b2-47b6-4c89-be03-55bef383b5d5 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:37.598487 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3020/6007] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:31:37 2022] POST /identity/v3/users => generated 413 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:37.602516 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e459ff1-781a-4021-92b8-73ee8e7709aa tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:37.625187 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716088b2-47b6-4c89-be03-55bef383b5d5 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:37.638425 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e459ff1-781a-4021-92b8-73ee8e7709aa tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:37.642320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92bd10-7a84-45f5-8d69-17e755dab769 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:37.643144 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92bd10-7a84-45f5-8d69-17e755dab769 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:37.643521 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92bd10-7a84-45f5-8d69-17e755dab769 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:37.643901 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92bd10-7a84-45f5-8d69-17e755dab769 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:37.644824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92bd10-7a84-45f5-8d69-17e755dab769 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:37.647006 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92bd10-7a84-45f5-8d69-17e755dab769 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:37.665131 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e4d5d-705f-413c-b3ad-cfb00e3e9fae tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:37.665860 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e4d5d-705f-413c-b3ad-cfb00e3e9fae tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:37.666199 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e4d5d-705f-413c-b3ad-cfb00e3e9fae tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:37.669667 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e4d5d-705f-413c-b3ad-cfb00e3e9fae tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:37.669667 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e4d5d-705f-413c-b3ad-cfb00e3e9fae tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:37.669667 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e4d5d-705f-413c-b3ad-cfb00e3e9fae tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:37.764557 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2988/6008] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:31:37 2022] POST /identity/v3/users => generated 445 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:37.767695 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3021/6009] 10.222.0.23 () {60 vars in 1142 bytes} [Sat Apr 30 21:31:37 2022] POST /identity/v3/roles => generated 243 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:37.770625 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92bd10-7a84-45f5-8d69-17e755dab769 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:37.771751 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e4d5d-705f-413c-b3ad-cfb00e3e9fae tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:37.794488 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e4d5d-705f-413c-b3ad-cfb00e3e9fae tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:37.801404 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92bd10-7a84-45f5-8d69-17e755dab769 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:37.805294 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88e720-6605-4e15-9610-66e7986845e5 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:37.806091 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88e720-6605-4e15-9610-66e7986845e5 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:37.806396 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88e720-6605-4e15-9610-66e7986845e5 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:37.806700 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88e720-6605-4e15-9610-66e7986845e5 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:37.807457 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d88e720-6605-4e15-9610-66e7986845e5 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:37.815719 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d88e720-6605-4e15-9610-66e7986845e5 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:37.821955 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1599a-a8d1-41de-8cec-2e737f5a62dd tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:37.830588 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1599a-a8d1-41de-8cec-2e737f5a62dd tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:37.831878 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1599a-a8d1-41de-8cec-2e737f5a62dd tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:37.834888 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1599a-a8d1-41de-8cec-2e737f5a62dd tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:37.834888 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b1599a-a8d1-41de-8cec-2e737f5a62dd tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:37.839319 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b1599a-a8d1-41de-8cec-2e737f5a62dd tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:37.953021 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3022/6010] 10.222.0.23 () {60 vars in 1142 bytes} [Sat Apr 30 21:31:37 2022] POST /identity/v3/roles => generated 247 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:37.957116 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88e720-6605-4e15-9610-66e7986845e5 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:37.977964 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88e720-6605-4e15-9610-66e7986845e5 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:37.981037 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2989/6011] 10.222.0.23 () {60 vars in 1142 bytes} [Sat Apr 30 21:31:37 2022] POST /identity/v3/roles => generated 240 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:37.985699 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1599a-a8d1-41de-8cec-2e737f5a62dd tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:37.995395 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568da813-c87e-4027-9606-a81e514d4d9a tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:37.997015 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568da813-c87e-4027-9606-a81e514d4d9a tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:37.997320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568da813-c87e-4027-9606-a81e514d4d9a tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:37.997601 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568da813-c87e-4027-9606-a81e514d4d9a tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/projects/052b48440542427b9ca6aa382f4b41a5/users/a9d4d32965da43af8ff39caa2393ab76/roles/e8f8c6917f9540e7b0f06918a287c958` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:38.006778 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1599a-a8d1-41de-8cec-2e737f5a62dd tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:38.023599 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1128e-47d2-4eb2-88e0-03f92d18ad4d tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:38.024404 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1128e-47d2-4eb2-88e0-03f92d18ad4d tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:38.024695 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1128e-47d2-4eb2-88e0-03f92d18ad4d tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:38.025161 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1128e-47d2-4eb2-88e0-03f92d18ad4d tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/38c92b31618b42dfbc3260610be4eba2/groups/edb6c931de744ca68ac08dc0694fbe5c/roles/949be978ca244014af00200e2ecbd6cb/inherited_to_projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:38.036340 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d1128e-47d2-4eb2-88e0-03f92d18ad4d tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:create_grant(project_id=38c92b31618b42dfbc3260610be4eba2, group_id=edb6c931de744ca68ac08dc0694fbe5c, role_id=949be978ca244014af00200e2ecbd6cb)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:38.039957 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d1128e-47d2-4eb2-88e0-03f92d18ad4d tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:38.049936 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568da813-c87e-4027-9606-a81e514d4d9a tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:create_grant(project_id=052b48440542427b9ca6aa382f4b41a5, user_id=a9d4d32965da43af8ff39caa2393ab76, role_id=e8f8c6917f9540e7b0f06918a287c958)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:38.060195 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568da813-c87e-4027-9606-a81e514d4d9a tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:38.154209 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2990/6012] 10.222.0.23 () {60 vars in 1584 bytes} [Sat Apr 30 21:31:37 2022] PUT /identity/v3/OS-INHERIT/projects/38c92b31618b42dfbc3260610be4eba2/groups/edb6c931de744ca68ac08dc0694fbe5c/roles/949be978ca244014af00200e2ecbd6cb/inherited_to_projects => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:38.159514 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1128e-47d2-4eb2-88e0-03f92d18ad4d tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:38.271260 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1128e-47d2-4eb2-88e0-03f92d18ad4d tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:38.281001 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5654b79-e485-40d6-8c1a-a5c85fa2b0b7 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:38.282631 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5654b79-e485-40d6-8c1a-a5c85fa2b0b7 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:38.282917 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5654b79-e485-40d6-8c1a-a5c85fa2b0b7 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:38.283205 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5654b79-e485-40d6-8c1a-a5c85fa2b0b7 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/38c92b31618b42dfbc3260610be4eba2/groups/edb6c931de744ca68ac08dc0694fbe5c/roles/949be978ca244014af00200e2ecbd6cb/inherited_to_projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:38.293737 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5654b79-e485-40d6-8c1a-a5c85fa2b0b7 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:check_grant(project_id=38c92b31618b42dfbc3260610be4eba2, group_id=edb6c931de744ca68ac08dc0694fbe5c, role_id=949be978ca244014af00200e2ecbd6cb)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:38.299423 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5654b79-e485-40d6-8c1a-a5c85fa2b0b7 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:38.310767 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2991/6013] 10.222.0.23 () {58 vars in 1566 bytes} [Sat Apr 30 21:31:38 2022] HEAD /identity/v3/OS-INHERIT/projects/38c92b31618b42dfbc3260610be4eba2/groups/edb6c931de744ca68ac08dc0694fbe5c/roles/949be978ca244014af00200e2ecbd6cb/inherited_to_projects => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:38.314745 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5654b79-e485-40d6-8c1a-a5c85fa2b0b7 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:38.334057 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5654b79-e485-40d6-8c1a-a5c85fa2b0b7 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:38.342576 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30e5e0-ed86-4f9c-8620-8de323773969 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:38.343043 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30e5e0-ed86-4f9c-8620-8de323773969 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:38.343324 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30e5e0-ed86-4f9c-8620-8de323773969 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:38.346115 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30e5e0-ed86-4f9c-8620-8de323773969 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/38c92b31618b42dfbc3260610be4eba2/groups/edb6c931de744ca68ac08dc0694fbe5c/roles/949be978ca244014af00200e2ecbd6cb/inherited_to_projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:38.349315 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a30e5e0-ed86-4f9c-8620-8de323773969 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=38c92b31618b42dfbc3260610be4eba2, group_id=edb6c931de744ca68ac08dc0694fbe5c, role_id=949be978ca244014af00200e2ecbd6cb)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:38.353698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a30e5e0-ed86-4f9c-8620-8de323773969 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:38.360605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4a30e5e0-ed86-4f9c-8620-8de323773969 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invalidating the token cache because role 949be978ca244014af00200e2ecbd6cb was removed from group edb6c931de744ca68ac08dc0694fbe5c on project 38c92b31618b42dfbc3260610be4eba2. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:38.360944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4a30e5e0-ed86-4f9c-8620-8de323773969 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:38.361746 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4a30e5e0-ed86-4f9c-8620-8de323773969 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:38.368255 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3023/6014] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:31:37 2022] PUT /identity/v3/projects/052b48440542427b9ca6aa382f4b41a5/users/a9d4d32965da43af8ff39caa2393ab76/roles/e8f8c6917f9540e7b0f06918a287c958 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:38.370978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568da813-c87e-4027-9606-a81e514d4d9a tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:38.373235 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-568da813-c87e-4027-9606-a81e514d4d9a tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:38.454403 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568da813-c87e-4027-9606-a81e514d4d9a tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:38.459203 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56b494-7aba-45ce-9199-d2ff6e56facf tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:38.460112 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56b494-7aba-45ce-9199-d2ff6e56facf tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:38.460397 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56b494-7aba-45ce-9199-d2ff6e56facf tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:38.460679 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56b494-7aba-45ce-9199-d2ff6e56facf tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/projects/052b48440542427b9ca6aa382f4b41a5/users/a9d4d32965da43af8ff39caa2393ab76/roles/678bcaaaf9b54f0fa15a36d7ec910d7f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:38.463017 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56b494-7aba-45ce-9199-d2ff6e56facf tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:create_grant(project_id=052b48440542427b9ca6aa382f4b41a5, user_id=a9d4d32965da43af8ff39caa2393ab76, role_id=678bcaaaf9b54f0fa15a36d7ec910d7f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:38.465691 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56b494-7aba-45ce-9199-d2ff6e56facf tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:38.512709 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2992/6015] 10.222.0.23 () {58 vars in 1568 bytes} [Sat Apr 30 21:31:38 2022] DELETE /identity/v3/OS-INHERIT/projects/38c92b31618b42dfbc3260610be4eba2/groups/edb6c931de744ca68ac08dc0694fbe5c/roles/949be978ca244014af00200e2ecbd6cb/inherited_to_projects => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:38.517304 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30e5e0-ed86-4f9c-8620-8de323773969 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:38.518810 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4a30e5e0-ed86-4f9c-8620-8de323773969 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:38.578333 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3024/6016] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:31:38 2022] PUT /identity/v3/projects/052b48440542427b9ca6aa382f4b41a5/users/a9d4d32965da43af8ff39caa2393ab76/roles/678bcaaaf9b54f0fa15a36d7ec910d7f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:31:38.579396 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56b494-7aba-45ce-9199-d2ff6e56facf tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:38.629027 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30e5e0-ed86-4f9c-8620-8de323773969 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:38.755606 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56b494-7aba-45ce-9199-d2ff6e56facf tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:38.770174 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00beac71-77db-4ee3-9aba-768ae2bf67f2 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:38.771344 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00beac71-77db-4ee3-9aba-768ae2bf67f2 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:38.771632 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00beac71-77db-4ee3-9aba-768ae2bf67f2 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:38.771911 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00beac71-77db-4ee3-9aba-768ae2bf67f2 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/roles/949be978ca244014af00200e2ecbd6cb` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:38.773480 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00beac71-77db-4ee3-9aba-768ae2bf67f2 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:delete_role(role_id=949be978ca244014af00200e2ecbd6cb)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:38.775947 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00beac71-77db-4ee3-9aba-768ae2bf67f2 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:38.779207 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bcfba6-0682-4ba5-ab05-eba49fd025e0 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:38.779913 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bcfba6-0682-4ba5-ab05-eba49fd025e0 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:38.780569 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bcfba6-0682-4ba5-ab05-eba49fd025e0 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:38.781073 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bcfba6-0682-4ba5-ab05-eba49fd025e0 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:38.781980 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bcfba6-0682-4ba5-ab05-eba49fd025e0 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:38.786090 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-53bcfba6-0682-4ba5-ab05-eba49fd025e0 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:31:38.786090 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(msg) Apr 30 21:31:38.786090 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:31:38.788711 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bcfba6-0682-4ba5-ab05-eba49fd025e0 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:38.877090 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3025/6017] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:31:38 2022] GET /identity/v3/users => generated 8481 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:31:38.882587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5cdfa-c6b3-45eb-8f0d-14afbffbc159 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:38.882884 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5cdfa-c6b3-45eb-8f0d-14afbffbc159 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:38.883168 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5cdfa-c6b3-45eb-8f0d-14afbffbc159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:38.891214 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-00beac71-77db-4ee3-9aba-768ae2bf67f2 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invalidating the token cache because role 949be978ca244014af00200e2ecbd6cb has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:38.891637 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-00beac71-77db-4ee3-9aba-768ae2bf67f2 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:38.894425 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-00beac71-77db-4ee3-9aba-768ae2bf67f2 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:38.898521 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2993/6018] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:31:38 2022] DELETE /identity/v3/roles/949be978ca244014af00200e2ecbd6cb => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:31:38.903017 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00beac71-77db-4ee3-9aba-768ae2bf67f2 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:38.926848 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-00beac71-77db-4ee3-9aba-768ae2bf67f2 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:39.042400 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-98e5cdfa-c6b3-45eb-8f0d-14afbffbc159 None None] MFA Rules not processed for user `a9d4d32965da43af8ff39caa2393ab76`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:39.045658 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-98e5cdfa-c6b3-45eb-8f0d-14afbffbc159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:39.165781 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00beac71-77db-4ee3-9aba-768ae2bf67f2 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:39.193452 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b421cb-9adc-4584-b213-e6f1d255ffc9 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:39.194180 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b421cb-9adc-4584-b213-e6f1d255ffc9 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:39.194464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b421cb-9adc-4584-b213-e6f1d255ffc9 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:39.194740 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b421cb-9adc-4584-b213-e6f1d255ffc9 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:39.196005 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b421cb-9adc-4584-b213-e6f1d255ffc9 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:39.197123 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b421cb-9adc-4584-b213-e6f1d255ffc9 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:39.262510 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3026/6019] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:38 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:39.264321 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a6f42-4034-4883-b40f-46e3b604878a None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:39.264614 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a6f42-4034-4883-b40f-46e3b604878a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:39.264895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a6f42-4034-4883-b40f-46e3b604878a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:39.306191 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-608a6f42-4034-4883-b40f-46e3b604878a None None] MFA Rules not processed for user `a9d4d32965da43af8ff39caa2393ab76`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:39.307437 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-608a6f42-4034-4883-b40f-46e3b604878a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:39.324942 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3027/6020] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:39.333307 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a6f42-4034-4883-b40f-46e3b604878a None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:39.341483 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2994/6021] 10.222.0.23 () {60 vars in 1142 bytes} [Sat Apr 30 21:31:38 2022] POST /identity/v3/roles => generated 240 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:39.342064 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b421cb-9adc-4584-b213-e6f1d255ffc9 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:39.346436 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a6f42-4034-4883-b40f-46e3b604878a None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:39.359150 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e128199-37ee-40eb-81e6-01f3d23246a5 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9d4d32965da43af8ff39caa2393ab76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '052b48440542427b9ca6aa382f4b41a5', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1804736004', 'tempest-DelegatedRole-301341990'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:39.361111 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e128199-37ee-40eb-81e6-01f3d23246a5 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:39.361111 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e128199-37ee-40eb-81e6-01f3d23246a5 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:39.361111 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e128199-37ee-40eb-81e6-01f3d23246a5 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:39.361334 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e128199-37ee-40eb-81e6-01f3d23246a5 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] RBAC: Authorizing `identity:create_trust()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:39.362525 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e128199-37ee-40eb-81e6-01f3d23246a5 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:39.366856 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b421cb-9adc-4584-b213-e6f1d255ffc9 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:39.386292 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0dbb8-a985-4880-970d-25c778fdeebb tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:39.388105 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0dbb8-a985-4880-970d-25c778fdeebb tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:39.388576 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0dbb8-a985-4880-970d-25c778fdeebb tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:39.389058 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0dbb8-a985-4880-970d-25c778fdeebb tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/38c92b31618b42dfbc3260610be4eba2/users/77bbff5f394145dbafc1429fb9da2a5d/roles/28bb408ae095451fa563b4fe3ec04bf6/inherited_to_projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:39.445266 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf0dbb8-a985-4880-970d-25c778fdeebb tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:create_grant(project_id=38c92b31618b42dfbc3260610be4eba2, user_id=77bbff5f394145dbafc1429fb9da2a5d, role_id=28bb408ae095451fa563b4fe3ec04bf6)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:39.448316 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf0dbb8-a985-4880-970d-25c778fdeebb tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:39.553229 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3028/6022] 10.222.0.23 () {60 vars in 1173 bytes} [Sat Apr 30 21:31:39 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:39.558925 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e128199-37ee-40eb-81e6-01f3d23246a5 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:39.576013 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e128199-37ee-40eb-81e6-01f3d23246a5 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:39.586974 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2995/6023] 10.222.0.23 () {60 vars in 1581 bytes} [Sat Apr 30 21:31:39 2022] PUT /identity/v3/OS-INHERIT/projects/38c92b31618b42dfbc3260610be4eba2/users/77bbff5f394145dbafc1429fb9da2a5d/roles/28bb408ae095451fa563b4fe3ec04bf6/inherited_to_projects => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:31:39.596485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0dbb8-a985-4880-970d-25c778fdeebb tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:39.603502 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa574b-4dde-45b0-b466-76c0a2534dfd tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9d4d32965da43af8ff39caa2393ab76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '052b48440542427b9ca6aa382f4b41a5', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1804736004', 'tempest-DelegatedRole-301341990'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:39.604399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa574b-4dde-45b0-b466-76c0a2534dfd tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:39.604724 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa574b-4dde-45b0-b466-76c0a2534dfd tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:39.607610 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa574b-4dde-45b0-b466-76c0a2534dfd tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] PATH_INFO: `/v3/OS-TRUST/trusts/b9a7ae7f91cf42f7a2a84321d5dd7af0` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:39.659886 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa574b-4dde-45b0-b466-76c0a2534dfd tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] RBAC: Authorizing `identity:get_trust(trust_id=b9a7ae7f91cf42f7a2a84321d5dd7af0)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:39.659886 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa574b-4dde-45b0-b466-76c0a2534dfd tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:39.682497 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3029/6024] 10.222.0.23 () {58 vars in 1250 bytes} [Sat Apr 30 21:31:39 2022] GET /identity/v3/OS-TRUST/trusts/b9a7ae7f91cf42f7a2a84321d5dd7af0 => generated 833 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:31:39.692704 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa574b-4dde-45b0-b466-76c0a2534dfd tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:39.715042 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa574b-4dde-45b0-b466-76c0a2534dfd tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:39.819857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0dbb8-a985-4880-970d-25c778fdeebb tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:39.833320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d612eb0-669d-4e25-a6ff-cfea73591442 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:39.836978 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d612eb0-669d-4e25-a6ff-cfea73591442 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:39.837287 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d612eb0-669d-4e25-a6ff-cfea73591442 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:39.837579 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d612eb0-669d-4e25-a6ff-cfea73591442 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/38c92b31618b42dfbc3260610be4eba2/users/77bbff5f394145dbafc1429fb9da2a5d/roles/28bb408ae095451fa563b4fe3ec04bf6/inherited_to_projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:39.852944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d612eb0-669d-4e25-a6ff-cfea73591442 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:check_grant(project_id=38c92b31618b42dfbc3260610be4eba2, user_id=77bbff5f394145dbafc1429fb9da2a5d, role_id=28bb408ae095451fa563b4fe3ec04bf6)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:39.855898 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d612eb0-669d-4e25-a6ff-cfea73591442 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:39.881879 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc6fc0-42ec-4278-9b37-faada85da464 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9d4d32965da43af8ff39caa2393ab76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '052b48440542427b9ca6aa382f4b41a5', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1804736004', 'tempest-DelegatedRole-301341990'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:39.888647 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc6fc0-42ec-4278-9b37-faada85da464 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:39.888647 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc6fc0-42ec-4278-9b37-faada85da464 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:39.888647 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc6fc0-42ec-4278-9b37-faada85da464 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] PATH_INFO: `/v3/OS-TRUST/trusts/b9a7ae7f91cf42f7a2a84321d5dd7af0/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:39.889933 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2996/6025] 10.222.0.23 () {58 vars in 1563 bytes} [Sat Apr 30 21:31:39 2022] HEAD /identity/v3/OS-INHERIT/projects/38c92b31618b42dfbc3260610be4eba2/users/77bbff5f394145dbafc1429fb9da2a5d/roles/28bb408ae095451fa563b4fe3ec04bf6/inherited_to_projects => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:39.892082 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc6fc0-42ec-4278-9b37-faada85da464 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=b9a7ae7f91cf42f7a2a84321d5dd7af0)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:39.893712 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc6fc0-42ec-4278-9b37-faada85da464 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:39.894349 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d612eb0-669d-4e25-a6ff-cfea73591442 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:39.908736 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3030/6026] 10.222.0.23 () {58 vars in 1268 bytes} [Sat Apr 30 21:31:39 2022] GET /identity/v3/OS-TRUST/trusts/b9a7ae7f91cf42f7a2a84321d5dd7af0/roles => generated 370 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:31:39.920402 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc6fc0-42ec-4278-9b37-faada85da464 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:39.939402 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc6fc0-42ec-4278-9b37-faada85da464 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:39.939602 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d612eb0-669d-4e25-a6ff-cfea73591442 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:39.945998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceccdd4-76b3-4ece-869e-79b9c36200b4 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9d4d32965da43af8ff39caa2393ab76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '052b48440542427b9ca6aa382f4b41a5', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1804736004', 'tempest-DelegatedRole-301341990'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:39.947120 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceccdd4-76b3-4ece-869e-79b9c36200b4 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:39.947633 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceccdd4-76b3-4ece-869e-79b9c36200b4 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:39.948085 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceccdd4-76b3-4ece-869e-79b9c36200b4 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] PATH_INFO: `/v3/OS-TRUST/trusts/b9a7ae7f91cf42f7a2a84321d5dd7af0/roles/e8f8c6917f9540e7b0f06918a287c958` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:39.951906 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff7ea6-2dc2-4962-97fe-eeea68d019c2 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:39.956838 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff7ea6-2dc2-4962-97fe-eeea68d019c2 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:39.957929 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff7ea6-2dc2-4962-97fe-eeea68d019c2 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:39.958225 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff7ea6-2dc2-4962-97fe-eeea68d019c2 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/38c92b31618b42dfbc3260610be4eba2/users/77bbff5f394145dbafc1429fb9da2a5d/roles/28bb408ae095451fa563b4fe3ec04bf6/inherited_to_projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:39.961356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceccdd4-76b3-4ece-869e-79b9c36200b4 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] RBAC: Authorizing `identity:get_role_for_trust(trust_id=b9a7ae7f91cf42f7a2a84321d5dd7af0, role_id=e8f8c6917f9540e7b0f06918a287c958)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:39.968146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceccdd4-76b3-4ece-869e-79b9c36200b4 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:39.976227 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff7ea6-2dc2-4962-97fe-eeea68d019c2 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=38c92b31618b42dfbc3260610be4eba2, user_id=77bbff5f394145dbafc1429fb9da2a5d, role_id=28bb408ae095451fa563b4fe3ec04bf6)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:39.985667 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3031/6027] 10.222.0.23 () {58 vars in 1367 bytes} [Sat Apr 30 21:31:39 2022] GET /identity/v3/OS-TRUST/trusts/b9a7ae7f91cf42f7a2a84321d5dd7af0/roles/e8f8c6917f9540e7b0f06918a287c958 => generated 243 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:31:39.985883 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff7ea6-2dc2-4962-97fe-eeea68d019c2 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:39.987238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceccdd4-76b3-4ece-869e-79b9c36200b4 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:39.999939 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-dbff7ea6-2dc2-4962-97fe-eeea68d019c2 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invalidating the token cache because role 28bb408ae095451fa563b4fe3ec04bf6 was removed from user 77bbff5f394145dbafc1429fb9da2a5d on project 38c92b31618b42dfbc3260610be4eba2. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:40.001124 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-dbff7ea6-2dc2-4962-97fe-eeea68d019c2 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:40.002395 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-dbff7ea6-2dc2-4962-97fe-eeea68d019c2 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:40.006000 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceccdd4-76b3-4ece-869e-79b9c36200b4 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:40.020131 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd89c35e-fd21-4805-814f-48cc01b70418 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9d4d32965da43af8ff39caa2393ab76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '052b48440542427b9ca6aa382f4b41a5', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1804736004', 'tempest-DelegatedRole-301341990'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:40.021633 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89c35e-fd21-4805-814f-48cc01b70418 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] REQUEST_METHOD: `HEAD` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:40.021956 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89c35e-fd21-4805-814f-48cc01b70418 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:40.022244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89c35e-fd21-4805-814f-48cc01b70418 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] PATH_INFO: `/v3/OS-TRUST/trusts/b9a7ae7f91cf42f7a2a84321d5dd7af0/roles/e8f8c6917f9540e7b0f06918a287c958` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:40.030708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd89c35e-fd21-4805-814f-48cc01b70418 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] RBAC: Authorizing `identity:get_role_for_trust(trust_id=b9a7ae7f91cf42f7a2a84321d5dd7af0, role_id=e8f8c6917f9540e7b0f06918a287c958)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:40.033385 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd89c35e-fd21-4805-814f-48cc01b70418 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:40.046979 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3032/6028] 10.222.0.23 () {58 vars in 1368 bytes} [Sat Apr 30 21:31:39 2022] HEAD /identity/v3/OS-TRUST/trusts/b9a7ae7f91cf42f7a2a84321d5dd7af0/roles/e8f8c6917f9540e7b0f06918a287c958 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:31:40.049351 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd89c35e-fd21-4805-814f-48cc01b70418 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:40.051756 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-dd89c35e-fd21-4805-814f-48cc01b70418 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:40.069347 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd89c35e-fd21-4805-814f-48cc01b70418 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:40.076364 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02c2e5-5234-43ba-a9e6-cbf3e95f85b4 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9d4d32965da43af8ff39caa2393ab76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '052b48440542427b9ca6aa382f4b41a5', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1804736004', 'tempest-DelegatedRole-301341990'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:40.077256 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02c2e5-5234-43ba-a9e6-cbf3e95f85b4 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:40.077546 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02c2e5-5234-43ba-a9e6-cbf3e95f85b4 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:40.078218 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02c2e5-5234-43ba-a9e6-cbf3e95f85b4 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] PATH_INFO: `/v3/OS-TRUST/trusts/b9a7ae7f91cf42f7a2a84321d5dd7af0/roles/678bcaaaf9b54f0fa15a36d7ec910d7f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:40.094881 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2997/6029] 10.222.0.23 () {58 vars in 1565 bytes} [Sat Apr 30 21:31:39 2022] DELETE /identity/v3/OS-INHERIT/projects/38c92b31618b42dfbc3260610be4eba2/users/77bbff5f394145dbafc1429fb9da2a5d/roles/28bb408ae095451fa563b4fe3ec04bf6/inherited_to_projects => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:40.096147 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff7ea6-2dc2-4962-97fe-eeea68d019c2 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:40.097982 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-dbff7ea6-2dc2-4962-97fe-eeea68d019c2 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:40.105259 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f02c2e5-5234-43ba-a9e6-cbf3e95f85b4 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] RBAC: Authorizing `identity:get_role_for_trust(trust_id=b9a7ae7f91cf42f7a2a84321d5dd7af0, role_id=678bcaaaf9b54f0fa15a36d7ec910d7f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:40.107153 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f02c2e5-5234-43ba-a9e6-cbf3e95f85b4 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:40.141946 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-2f02c2e5-5234-43ba-a9e6-cbf3e95f85b4 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] Could not find role: 678bcaaaf9b54f0fa15a36d7ec910d7f.: keystone.exception.RoleNotFound: Could not find role: 678bcaaaf9b54f0fa15a36d7ec910d7f. Apr 30 21:31:40.141946 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:31:40.141946 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:31:40.141946 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:31:40.141946 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:31:40.141946 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:31:40.141946 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:31:40.141946 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:31:40.141946 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:31:40.141946 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:31:40.141946 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:31:40.141946 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:31:40.141946 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Apr 30 21:31:40.141946 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 21:31:40.143163 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 678bcaaaf9b54f0fa15a36d7ec910d7f. Apr 30 21:31:40.143163 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:31:40.144672 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3033/6030] 10.222.0.23 () {58 vars in 1367 bytes} [Sat Apr 30 21:31:40 2022] GET /identity/v3/OS-TRUST/trusts/b9a7ae7f91cf42f7a2a84321d5dd7af0/roles/678bcaaaf9b54f0fa15a36d7ec910d7f => generated 110 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 30 21:31:40.154682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02c2e5-5234-43ba-a9e6-cbf3e95f85b4 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:40.170641 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02c2e5-5234-43ba-a9e6-cbf3e95f85b4 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:40.201244 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff7ea6-2dc2-4962-97fe-eeea68d019c2 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:40.214814 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf343b6-68b7-411c-b122-732214b11bb2 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:40.215624 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf343b6-68b7-411c-b122-732214b11bb2 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:40.215928 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf343b6-68b7-411c-b122-732214b11bb2 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:40.216190 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf343b6-68b7-411c-b122-732214b11bb2 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/roles/28bb408ae095451fa563b4fe3ec04bf6` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:40.217788 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf343b6-68b7-411c-b122-732214b11bb2 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:delete_role(role_id=28bb408ae095451fa563b4fe3ec04bf6)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:40.219632 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf343b6-68b7-411c-b122-732214b11bb2 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:40.260073 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d60de-3871-4d0e-a15d-449ab838030f tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9d4d32965da43af8ff39caa2393ab76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '052b48440542427b9ca6aa382f4b41a5', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1804736004', 'tempest-DelegatedRole-301341990'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:40.261463 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d60de-3871-4d0e-a15d-449ab838030f tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] REQUEST_METHOD: `HEAD` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:40.261767 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d60de-3871-4d0e-a15d-449ab838030f tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:40.262059 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d60de-3871-4d0e-a15d-449ab838030f tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] PATH_INFO: `/v3/OS-TRUST/trusts/b9a7ae7f91cf42f7a2a84321d5dd7af0/roles/678bcaaaf9b54f0fa15a36d7ec910d7f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:40.294494 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d60de-3871-4d0e-a15d-449ab838030f tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] RBAC: Authorizing `identity:get_role_for_trust(trust_id=b9a7ae7f91cf42f7a2a84321d5dd7af0, role_id=678bcaaaf9b54f0fa15a36d7ec910d7f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:40.296117 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d60de-3871-4d0e-a15d-449ab838030f tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:40.317083 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-739d60de-3871-4d0e-a15d-449ab838030f tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] Could not find role: 678bcaaaf9b54f0fa15a36d7ec910d7f.: keystone.exception.RoleNotFound: Could not find role: 678bcaaaf9b54f0fa15a36d7ec910d7f. Apr 30 21:31:40.317083 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:31:40.317083 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:31:40.317083 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:31:40.317083 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:31:40.317083 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:31:40.317083 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:31:40.317083 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:31:40.317083 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:31:40.317083 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:31:40.317083 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:31:40.317083 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:31:40.317083 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Apr 30 21:31:40.317083 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 21:31:40.318160 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 678bcaaaf9b54f0fa15a36d7ec910d7f. Apr 30 21:31:40.318160 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:31:40.321307 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3034/6031] 10.222.0.23 () {58 vars in 1368 bytes} [Sat Apr 30 21:31:40 2022] HEAD /identity/v3/OS-TRUST/trusts/b9a7ae7f91cf42f7a2a84321d5dd7af0/roles/678bcaaaf9b54f0fa15a36d7ec910d7f => generated 0 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Apr 30 21:31:40.322544 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d60de-3871-4d0e-a15d-449ab838030f tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:40.333550 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d60de-3871-4d0e-a15d-449ab838030f tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:40.346765 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3107b36-bf6a-45d1-8a5a-3fd8cb53f8d2 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9d4d32965da43af8ff39caa2393ab76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '052b48440542427b9ca6aa382f4b41a5', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1804736004', 'tempest-DelegatedRole-301341990'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:40.347681 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3107b36-bf6a-45d1-8a5a-3fd8cb53f8d2 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:40.347964 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3107b36-bf6a-45d1-8a5a-3fd8cb53f8d2 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:40.348240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3107b36-bf6a-45d1-8a5a-3fd8cb53f8d2 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] PATH_INFO: `/v3/OS-TRUST/trusts/b9a7ae7f91cf42f7a2a84321d5dd7af0` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:40.349857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-caf343b6-68b7-411c-b122-732214b11bb2 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invalidating the token cache because role 28bb408ae095451fa563b4fe3ec04bf6 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:40.349857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-caf343b6-68b7-411c-b122-732214b11bb2 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:40.350418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-caf343b6-68b7-411c-b122-732214b11bb2 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:40.353464 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2998/6032] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:31:40 2022] DELETE /identity/v3/roles/28bb408ae095451fa563b4fe3ec04bf6 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:31:40.359597 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf343b6-68b7-411c-b122-732214b11bb2 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:40.362494 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-caf343b6-68b7-411c-b122-732214b11bb2 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:40.364330 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3107b36-bf6a-45d1-8a5a-3fd8cb53f8d2 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] RBAC: Authorizing `identity:delete_trust(trust_id=b9a7ae7f91cf42f7a2a84321d5dd7af0)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:40.370146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3107b36-bf6a-45d1-8a5a-3fd8cb53f8d2 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:40.506738 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a3107b36-bf6a-45d1-8a5a-3fd8cb53f8d2 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'b9a7ae7f91cf42f7a2a84321d5dd7af0', 'request_id': 'req-a3107b36-bf6a-45d1-8a5a-3fd8cb53f8d2'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:40.509999 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a3107b36-bf6a-45d1-8a5a-3fd8cb53f8d2 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'b9a7ae7f91cf42f7a2a84321d5dd7af0', 'request_id': 'req-a3107b36-bf6a-45d1-8a5a-3fd8cb53f8d2'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:40.523784 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf343b6-68b7-411c-b122-732214b11bb2 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:40.539682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096e116-58ad-4411-9485-30f495ff97fc tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:40.540388 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096e116-58ad-4411-9485-30f495ff97fc tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:40.540675 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096e116-58ad-4411-9485-30f495ff97fc tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:40.540954 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096e116-58ad-4411-9485-30f495ff97fc tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:40.542152 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6096e116-58ad-4411-9485-30f495ff97fc tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:40.543818 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6096e116-58ad-4411-9485-30f495ff97fc tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:40.587344 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a3107b36-bf6a-45d1-8a5a-3fd8cb53f8d2 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'b9a7ae7f91cf42f7a2a84321d5dd7af0', 'request_id': 'req-a3107b36-bf6a-45d1-8a5a-3fd8cb53f8d2'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:40.601167 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3035/6033] 10.222.0.23 () {58 vars in 1253 bytes} [Sat Apr 30 21:31:40 2022] DELETE /identity/v3/OS-TRUST/trusts/b9a7ae7f91cf42f7a2a84321d5dd7af0 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:40.605621 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3107b36-bf6a-45d1-8a5a-3fd8cb53f8d2 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:40.608001 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a3107b36-bf6a-45d1-8a5a-3fd8cb53f8d2 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:40.623363 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 2999/6034] 10.222.0.23 () {60 vars in 1142 bytes} [Sat Apr 30 21:31:40 2022] POST /identity/v3/roles => generated 239 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:40.627910 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096e116-58ad-4411-9485-30f495ff97fc tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:40.629645 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6096e116-58ad-4411-9485-30f495ff97fc tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:40.655775 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096e116-58ad-4411-9485-30f495ff97fc tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:40.674738 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3107b36-bf6a-45d1-8a5a-3fd8cb53f8d2 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:40.675897 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194636e-6165-419d-bfc0-aededd80ee47 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:40.676907 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194636e-6165-419d-bfc0-aededd80ee47 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:40.677292 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194636e-6165-419d-bfc0-aededd80ee47 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:40.677843 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194636e-6165-419d-bfc0-aededd80ee47 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/fc673e25728f463f8016d6d8ddfaa2ec/groups/edb6c931de744ca68ac08dc0694fbe5c/roles/f7f4667ef7484ca2a859e72d428cf364/inherited_to_projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:40.681608 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3194636e-6165-419d-bfc0-aededd80ee47 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=fc673e25728f463f8016d6d8ddfaa2ec, group_id=edb6c931de744ca68ac08dc0694fbe5c, role_id=f7f4667ef7484ca2a859e72d428cf364)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:40.684862 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3194636e-6165-419d-bfc0-aededd80ee47 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:40.793997 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3000/6035] 10.222.0.23 () {60 vars in 1581 bytes} [Sat Apr 30 21:31:40 2022] PUT /identity/v3/OS-INHERIT/domains/fc673e25728f463f8016d6d8ddfaa2ec/groups/edb6c931de744ca68ac08dc0694fbe5c/roles/f7f4667ef7484ca2a859e72d428cf364/inherited_to_projects => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:40.798811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194636e-6165-419d-bfc0-aededd80ee47 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:40.815525 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891871f-2272-4e39-9724-ae576484d368 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9d4d32965da43af8ff39caa2393ab76', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '052b48440542427b9ca6aa382f4b41a5', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1804736004', 'tempest-DelegatedRole-301341990'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:40.816926 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891871f-2272-4e39-9724-ae576484d368 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:40.817269 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891871f-2272-4e39-9724-ae576484d368 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:40.817553 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891871f-2272-4e39-9724-ae576484d368 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] PATH_INFO: `/v3/OS-TRUST/trusts/b9a7ae7f91cf42f7a2a84321d5dd7af0` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:40.837829 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-6891871f-2272-4e39-9724-ae576484d368 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] Could not find trust: b9a7ae7f91cf42f7a2a84321d5dd7af0.: keystone.exception.TrustNotFound: Could not find trust: b9a7ae7f91cf42f7a2a84321d5dd7af0. Apr 30 21:31:40.837829 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:31:40.837829 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:31:40.837829 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:31:40.837829 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:31:40.837829 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:31:40.837829 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:31:40.837829 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:31:40.837829 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:31:40.837829 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:31:40.837829 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:31:40.837829 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:31:40.837829 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Apr 30 21:31:40.837829 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Apr 30 21:31:40.837829 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Apr 30 21:31:40.838816 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Apr 30 21:31:40.838816 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Apr 30 21:31:40.838816 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Apr 30 21:31:40.838816 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Apr 30 21:31:40.838816 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Apr 30 21:31:40.838816 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:31:40.838816 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:31:40.838816 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Apr 30 21:31:40.838816 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Apr 30 21:31:40.838816 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Apr 30 21:31:40.838816 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Apr 30 21:31:40.838816 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: b9a7ae7f91cf42f7a2a84321d5dd7af0. Apr 30 21:31:40.838816 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:31:40.839651 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3036/6036] 10.222.0.23 () {58 vars in 1250 bytes} [Sat Apr 30 21:31:40 2022] GET /identity/v3/OS-TRUST/trusts/b9a7ae7f91cf42f7a2a84321d5dd7af0 => generated 111 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 30 21:31:40.843872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891871f-2272-4e39-9724-ae576484d368 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:40.846611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6891871f-2272-4e39-9724-ae576484d368 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:41.048012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194636e-6165-419d-bfc0-aededd80ee47 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:41.061807 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84693c89-182f-40f3-8eee-e3268c0d2026 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:41.063913 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891871f-2272-4e39-9724-ae576484d368 tempest-TrustsV3TestJSON-225958417 tempest-user-639978336] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:41.066573 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84693c89-182f-40f3-8eee-e3268c0d2026 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:41.066890 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84693c89-182f-40f3-8eee-e3268c0d2026 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:41.067179 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84693c89-182f-40f3-8eee-e3268c0d2026 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/fc673e25728f463f8016d6d8ddfaa2ec/groups/edb6c931de744ca68ac08dc0694fbe5c/roles/inherited_to_projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:41.069904 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84693c89-182f-40f3-8eee-e3268c0d2026 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=fc673e25728f463f8016d6d8ddfaa2ec, group_id=edb6c931de744ca68ac08dc0694fbe5c)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:41.072587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84693c89-182f-40f3-8eee-e3268c0d2026 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:41.122524 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3001/6037] 10.222.0.23 () {58 vars in 1463 bytes} [Sat Apr 30 21:31:40 2022] GET /identity/v3/OS-INHERIT/domains/fc673e25728f463f8016d6d8ddfaa2ec/groups/edb6c931de744ca68ac08dc0694fbe5c/roles/inherited_to_projects => generated 447 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:31:41.122524 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84693c89-182f-40f3-8eee-e3268c0d2026 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:41.163130 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84693c89-182f-40f3-8eee-e3268c0d2026 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:41.176239 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d97318-90dd-40dc-9023-3f614a256bc9 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:41.176958 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d97318-90dd-40dc-9023-3f614a256bc9 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:41.180095 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d97318-90dd-40dc-9023-3f614a256bc9 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:41.180095 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d97318-90dd-40dc-9023-3f614a256bc9 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/fc673e25728f463f8016d6d8ddfaa2ec/groups/edb6c931de744ca68ac08dc0694fbe5c/roles/f7f4667ef7484ca2a859e72d428cf364/inherited_to_projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:41.180529 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d97318-90dd-40dc-9023-3f614a256bc9 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=fc673e25728f463f8016d6d8ddfaa2ec, group_id=edb6c931de744ca68ac08dc0694fbe5c, role_id=f7f4667ef7484ca2a859e72d428cf364)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:41.183276 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d97318-90dd-40dc-9023-3f614a256bc9 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:41.211954 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3002/6038] 10.222.0.23 () {58 vars in 1563 bytes} [Sat Apr 30 21:31:41 2022] HEAD /identity/v3/OS-INHERIT/domains/fc673e25728f463f8016d6d8ddfaa2ec/groups/edb6c931de744ca68ac08dc0694fbe5c/roles/f7f4667ef7484ca2a859e72d428cf364/inherited_to_projects => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:41.217080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d97318-90dd-40dc-9023-3f614a256bc9 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:41.249371 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d97318-90dd-40dc-9023-3f614a256bc9 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:41.286193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0cfa7a-eb7d-4460-8f84-e2bd31fb0322 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:41.287078 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0cfa7a-eb7d-4460-8f84-e2bd31fb0322 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:41.287358 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0cfa7a-eb7d-4460-8f84-e2bd31fb0322 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:41.287906 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0cfa7a-eb7d-4460-8f84-e2bd31fb0322 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/roles/678bcaaaf9b54f0fa15a36d7ec910d7f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:41.288759 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8196a1-294e-4b36-b9ba-74dc34d01fc1 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:41.289626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8196a1-294e-4b36-b9ba-74dc34d01fc1 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:41.289940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8196a1-294e-4b36-b9ba-74dc34d01fc1 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:41.290219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8196a1-294e-4b36-b9ba-74dc34d01fc1 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/fc673e25728f463f8016d6d8ddfaa2ec/groups/edb6c931de744ca68ac08dc0694fbe5c/roles/f7f4667ef7484ca2a859e72d428cf364/inherited_to_projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:41.295440 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0cfa7a-eb7d-4460-8f84-e2bd31fb0322 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:delete_role(role_id=678bcaaaf9b54f0fa15a36d7ec910d7f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:41.297234 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0cfa7a-eb7d-4460-8f84-e2bd31fb0322 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:41.298892 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8196a1-294e-4b36-b9ba-74dc34d01fc1 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=fc673e25728f463f8016d6d8ddfaa2ec, group_id=edb6c931de744ca68ac08dc0694fbe5c, role_id=f7f4667ef7484ca2a859e72d428cf364)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:41.301592 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8196a1-294e-4b36-b9ba-74dc34d01fc1 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:41.335617 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-dc8196a1-294e-4b36-b9ba-74dc34d01fc1 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invalidating the token cache because role f7f4667ef7484ca2a859e72d428cf364 was removed from group edb6c931de744ca68ac08dc0694fbe5c on domain fc673e25728f463f8016d6d8ddfaa2ec. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:41.335921 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-dc8196a1-294e-4b36-b9ba-74dc34d01fc1 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:41.338157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-dc8196a1-294e-4b36-b9ba-74dc34d01fc1 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:41.565165 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3003/6039] 10.222.0.23 () {58 vars in 1565 bytes} [Sat Apr 30 21:31:41 2022] DELETE /identity/v3/OS-INHERIT/domains/fc673e25728f463f8016d6d8ddfaa2ec/groups/edb6c931de744ca68ac08dc0694fbe5c/roles/f7f4667ef7484ca2a859e72d428cf364/inherited_to_projects => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:41.569494 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8196a1-294e-4b36-b9ba-74dc34d01fc1 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:41.572056 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-dc8196a1-294e-4b36-b9ba-74dc34d01fc1 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:41.589153 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2d0cfa7a-eb7d-4460-8f84-e2bd31fb0322 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invalidating the token cache because role 678bcaaaf9b54f0fa15a36d7ec910d7f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:41.589365 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2d0cfa7a-eb7d-4460-8f84-e2bd31fb0322 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:41.590127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2d0cfa7a-eb7d-4460-8f84-e2bd31fb0322 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:41.593723 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3037/6040] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:31:40 2022] DELETE /identity/v3/roles/678bcaaaf9b54f0fa15a36d7ec910d7f => generated 0 bytes in 751 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:41.597733 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0cfa7a-eb7d-4460-8f84-e2bd31fb0322 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:41.600282 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2d0cfa7a-eb7d-4460-8f84-e2bd31fb0322 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:41.784106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8196a1-294e-4b36-b9ba-74dc34d01fc1 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:41.805200 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0cfa7a-eb7d-4460-8f84-e2bd31fb0322 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:41.828043 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ddb42b-bf6e-4111-aef0-09c340077302 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:41.829600 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ddb42b-bf6e-4111-aef0-09c340077302 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:41.843407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ddb42b-bf6e-4111-aef0-09c340077302 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:41.843407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ddb42b-bf6e-4111-aef0-09c340077302 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/roles/e8f8c6917f9540e7b0f06918a287c958` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:41.843407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ddb42b-bf6e-4111-aef0-09c340077302 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e8f8c6917f9540e7b0f06918a287c958)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:41.843407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ddb42b-bf6e-4111-aef0-09c340077302 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:41.875508 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d807c49-96d5-4885-bc28-c4e7c306d4c5 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:41.876699 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d807c49-96d5-4885-bc28-c4e7c306d4c5 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:41.877091 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d807c49-96d5-4885-bc28-c4e7c306d4c5 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:41.877440 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d807c49-96d5-4885-bc28-c4e7c306d4c5 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/roles/f7f4667ef7484ca2a859e72d428cf364` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:41.879446 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d807c49-96d5-4885-bc28-c4e7c306d4c5 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f7f4667ef7484ca2a859e72d428cf364)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:41.880959 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d807c49-96d5-4885-bc28-c4e7c306d4c5 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:42.102008 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-95ddb42b-bf6e-4111-aef0-09c340077302 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invalidating the token cache because role e8f8c6917f9540e7b0f06918a287c958 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:42.102264 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-95ddb42b-bf6e-4111-aef0-09c340077302 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:42.105043 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-95ddb42b-bf6e-4111-aef0-09c340077302 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:42.107093 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3038/6041] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:31:41 2022] DELETE /identity/v3/roles/e8f8c6917f9540e7b0f06918a287c958 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:31:42.111316 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ddb42b-bf6e-4111-aef0-09c340077302 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:42.113005 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-95ddb42b-bf6e-4111-aef0-09c340077302 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:42.149386 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7d807c49-96d5-4885-bc28-c4e7c306d4c5 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invalidating the token cache because role f7f4667ef7484ca2a859e72d428cf364 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:42.149691 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7d807c49-96d5-4885-bc28-c4e7c306d4c5 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:42.150485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7d807c49-96d5-4885-bc28-c4e7c306d4c5 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:42.152442 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3004/6042] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:31:41 2022] DELETE /identity/v3/roles/f7f4667ef7484ca2a859e72d428cf364 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:42.157349 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d807c49-96d5-4885-bc28-c4e7c306d4c5 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:42.161790 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7d807c49-96d5-4885-bc28-c4e7c306d4c5 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:42.231498 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ddb42b-bf6e-4111-aef0-09c340077302 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:42.352040 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1fa2f-939e-4d79-9e62-792aa39e9778 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:42.354255 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1fa2f-939e-4d79-9e62-792aa39e9778 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:42.356120 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1fa2f-939e-4d79-9e62-792aa39e9778 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:42.357179 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1fa2f-939e-4d79-9e62-792aa39e9778 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/users/a9d4d32965da43af8ff39caa2393ab76` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:42.360366 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc1fa2f-939e-4d79-9e62-792aa39e9778 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a9d4d32965da43af8ff39caa2393ab76)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:42.363289 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc1fa2f-939e-4d79-9e62-792aa39e9778 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:42.394644 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d807c49-96d5-4885-bc28-c4e7c306d4c5 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:42.416656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab538ac4-c452-4cd4-b7b9-28d93819611e tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:42.417615 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab538ac4-c452-4cd4-b7b9-28d93819611e tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:42.418275 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab538ac4-c452-4cd4-b7b9-28d93819611e tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:42.418744 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab538ac4-c452-4cd4-b7b9-28d93819611e tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:42.419685 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab538ac4-c452-4cd4-b7b9-28d93819611e tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:42.421443 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab538ac4-c452-4cd4-b7b9-28d93819611e tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:42.659694 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3005/6043] 10.222.0.23 () {60 vars in 1142 bytes} [Sat Apr 30 21:31:42 2022] POST /identity/v3/roles => generated 240 bytes in 503 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:31:42.664226 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab538ac4-c452-4cd4-b7b9-28d93819611e tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:42.677775 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8dc1fa2f-939e-4d79-9e62-792aa39e9778 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9d4d32965da43af8ff39caa2393ab76'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:42.684167 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab538ac4-c452-4cd4-b7b9-28d93819611e tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:42.691124 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6e068-78f2-4308-8395-946699001328 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:42.691996 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6e068-78f2-4308-8395-946699001328 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:42.692287 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6e068-78f2-4308-8395-946699001328 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:42.695054 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6e068-78f2-4308-8395-946699001328 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/fc673e25728f463f8016d6d8ddfaa2ec/users/77bbff5f394145dbafc1429fb9da2a5d/roles/7c1ffa71b0bd4eb08d0f0487361d6780/inherited_to_projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:42.695886 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8dc1fa2f-939e-4d79-9e62-792aa39e9778 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9d4d32965da43af8ff39caa2393ab76'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:42.697721 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6e068-78f2-4308-8395-946699001328 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=fc673e25728f463f8016d6d8ddfaa2ec, user_id=77bbff5f394145dbafc1429fb9da2a5d, role_id=7c1ffa71b0bd4eb08d0f0487361d6780)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:42.700608 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6e068-78f2-4308-8395-946699001328 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:42.763813 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8dc1fa2f-939e-4d79-9e62-792aa39e9778 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9d4d32965da43af8ff39caa2393ab76'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:42.769718 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3006/6044] 10.222.0.23 () {60 vars in 1578 bytes} [Sat Apr 30 21:31:42 2022] PUT /identity/v3/OS-INHERIT/domains/fc673e25728f463f8016d6d8ddfaa2ec/users/77bbff5f394145dbafc1429fb9da2a5d/roles/7c1ffa71b0bd4eb08d0f0487361d6780/inherited_to_projects => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:42.773897 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6e068-78f2-4308-8395-946699001328 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:42.774311 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8dc1fa2f-939e-4d79-9e62-792aa39e9778 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9d4d32965da43af8ff39caa2393ab76'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:42.776178 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8dc1fa2f-939e-4d79-9e62-792aa39e9778 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9d4d32965da43af8ff39caa2393ab76'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:42.793932 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3039/6045] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:31:42 2022] DELETE /identity/v3/users/a9d4d32965da43af8ff39caa2393ab76 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:31:42.795940 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1fa2f-939e-4d79-9e62-792aa39e9778 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:42.799836 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8dc1fa2f-939e-4d79-9e62-792aa39e9778 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:42.924261 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6e068-78f2-4308-8395-946699001328 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:42.940109 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1fa2f-939e-4d79-9e62-792aa39e9778 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:42.959053 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5e599-85b9-4166-90c2-db6d98e96fff tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:42.960652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5e599-85b9-4166-90c2-db6d98e96fff tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:42.961046 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5e599-85b9-4166-90c2-db6d98e96fff tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:42.961434 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5e599-85b9-4166-90c2-db6d98e96fff tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/projects/052b48440542427b9ca6aa382f4b41a5` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:42.964042 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e5e599-85b9-4166-90c2-db6d98e96fff tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:delete_project(project_id=052b48440542427b9ca6aa382f4b41a5)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:42.966869 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e5e599-85b9-4166-90c2-db6d98e96fff tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:43.055406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd28fe1-579a-45c2-ae8a-4c0916486979 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:43.066554 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd28fe1-579a-45c2-ae8a-4c0916486979 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:43.066717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd28fe1-579a-45c2-ae8a-4c0916486979 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:43.066933 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd28fe1-579a-45c2-ae8a-4c0916486979 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/fc673e25728f463f8016d6d8ddfaa2ec/users/77bbff5f394145dbafc1429fb9da2a5d/roles/inherited_to_projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:43.068895 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd28fe1-579a-45c2-ae8a-4c0916486979 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=fc673e25728f463f8016d6d8ddfaa2ec, user_id=77bbff5f394145dbafc1429fb9da2a5d)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:43.071586 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd28fe1-579a-45c2-ae8a-4c0916486979 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:43.089928 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3007/6046] 10.222.0.23 () {58 vars in 1460 bytes} [Sat Apr 30 21:31:42 2022] GET /identity/v3/OS-INHERIT/domains/fc673e25728f463f8016d6d8ddfaa2ec/users/77bbff5f394145dbafc1429fb9da2a5d/roles/inherited_to_projects => generated 447 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:31:43.093010 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd28fe1-579a-45c2-ae8a-4c0916486979 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:43.095605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0dd28fe1-579a-45c2-ae8a-4c0916486979 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:43.114068 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd28fe1-579a-45c2-ae8a-4c0916486979 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:43.124714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c4f1f-ba08-44b6-ab65-77f269ff85a2 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:43.124714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c4f1f-ba08-44b6-ab65-77f269ff85a2 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `HEAD` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:43.124714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c4f1f-ba08-44b6-ab65-77f269ff85a2 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:43.124972 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c4f1f-ba08-44b6-ab65-77f269ff85a2 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/fc673e25728f463f8016d6d8ddfaa2ec/users/77bbff5f394145dbafc1429fb9da2a5d/roles/7c1ffa71b0bd4eb08d0f0487361d6780/inherited_to_projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:43.125984 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c4f1f-ba08-44b6-ab65-77f269ff85a2 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=fc673e25728f463f8016d6d8ddfaa2ec, user_id=77bbff5f394145dbafc1429fb9da2a5d, role_id=7c1ffa71b0bd4eb08d0f0487361d6780)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:43.128735 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c4f1f-ba08-44b6-ab65-77f269ff85a2 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:43.138261 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3008/6047] 10.222.0.23 () {58 vars in 1560 bytes} [Sat Apr 30 21:31:43 2022] HEAD /identity/v3/OS-INHERIT/domains/fc673e25728f463f8016d6d8ddfaa2ec/users/77bbff5f394145dbafc1429fb9da2a5d/roles/7c1ffa71b0bd4eb08d0f0487361d6780/inherited_to_projects => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:43.141838 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c4f1f-ba08-44b6-ab65-77f269ff85a2 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:43.157328 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c4f1f-ba08-44b6-ab65-77f269ff85a2 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:43.246896 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a2e5e599-85b9-4166-90c2-db6d98e96fff tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '052b48440542427b9ca6aa382f4b41a5', 'request_id': 'req-a2e5e599-85b9-4166-90c2-db6d98e96fff'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:43.271451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072519fc-7457-42a6-9e4f-3063a051fe74 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:43.271451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072519fc-7457-42a6-9e4f-3063a051fe74 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:43.271451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072519fc-7457-42a6-9e4f-3063a051fe74 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:43.271819 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072519fc-7457-42a6-9e4f-3063a051fe74 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/fc673e25728f463f8016d6d8ddfaa2ec/users/77bbff5f394145dbafc1429fb9da2a5d/roles/7c1ffa71b0bd4eb08d0f0487361d6780/inherited_to_projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:43.271909 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072519fc-7457-42a6-9e4f-3063a051fe74 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=fc673e25728f463f8016d6d8ddfaa2ec, user_id=77bbff5f394145dbafc1429fb9da2a5d, role_id=7c1ffa71b0bd4eb08d0f0487361d6780)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:43.274810 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072519fc-7457-42a6-9e4f-3063a051fe74 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:43.280508 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-072519fc-7457-42a6-9e4f-3063a051fe74 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invalidating the token cache because role 7c1ffa71b0bd4eb08d0f0487361d6780 was removed from user 77bbff5f394145dbafc1429fb9da2a5d on domain fc673e25728f463f8016d6d8ddfaa2ec. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:43.280863 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-072519fc-7457-42a6-9e4f-3063a051fe74 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:43.282260 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-072519fc-7457-42a6-9e4f-3063a051fe74 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:43.287877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a2e5e599-85b9-4166-90c2-db6d98e96fff tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '052b48440542427b9ca6aa382f4b41a5', 'request_id': 'req-a2e5e599-85b9-4166-90c2-db6d98e96fff'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:43.297553 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a2e5e599-85b9-4166-90c2-db6d98e96fff tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '052b48440542427b9ca6aa382f4b41a5', 'request_id': 'req-a2e5e599-85b9-4166-90c2-db6d98e96fff'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:43.394012 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3009/6048] 10.222.0.23 () {58 vars in 1562 bytes} [Sat Apr 30 21:31:43 2022] DELETE /identity/v3/OS-INHERIT/domains/fc673e25728f463f8016d6d8ddfaa2ec/users/77bbff5f394145dbafc1429fb9da2a5d/roles/7c1ffa71b0bd4eb08d0f0487361d6780/inherited_to_projects => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:43.399670 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072519fc-7457-42a6-9e4f-3063a051fe74 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:43.401681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-072519fc-7457-42a6-9e4f-3063a051fe74 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:43.453679 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a2e5e599-85b9-4166-90c2-db6d98e96fff tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] The token cache is being invalidate because project 052b48440542427b9ca6aa382f4b41a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:43.454102 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a2e5e599-85b9-4166-90c2-db6d98e96fff tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:43.455997 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a2e5e599-85b9-4166-90c2-db6d98e96fff tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:43.458694 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3040/6049] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:31:42 2022] DELETE /identity/v3/projects/052b48440542427b9ca6aa382f4b41a5 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:43.464606 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5e599-85b9-4166-90c2-db6d98e96fff tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:43.467544 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a2e5e599-85b9-4166-90c2-db6d98e96fff tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:43.610768 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072519fc-7457-42a6-9e4f-3063a051fe74 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:43.624560 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6397a-1cda-4d30-b085-1a4b9764d774 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:43.626742 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6397a-1cda-4d30-b085-1a4b9764d774 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:43.628736 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6397a-1cda-4d30-b085-1a4b9764d774 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:43.633343 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6397a-1cda-4d30-b085-1a4b9764d774 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/roles/7c1ffa71b0bd4eb08d0f0487361d6780` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:43.636392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6397a-1cda-4d30-b085-1a4b9764d774 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7c1ffa71b0bd4eb08d0f0487361d6780)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:43.639256 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6397a-1cda-4d30-b085-1a4b9764d774 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:43.658864 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5e599-85b9-4166-90c2-db6d98e96fff tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:43.750627 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ac819-fe42-4687-9111-3c5c9b95f697 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:43.751476 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ac819-fe42-4687-9111-3c5c9b95f697 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:43.751835 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ac819-fe42-4687-9111-3c5c9b95f697 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:43.752310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ac819-fe42-4687-9111-3c5c9b95f697 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:43.753209 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5ac819-fe42-4687-9111-3c5c9b95f697 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:43.755858 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5ac819-fe42-4687-9111-3c5c9b95f697 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:43.794183 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2ea6397a-1cda-4d30-b085-1a4b9764d774 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invalidating the token cache because role 7c1ffa71b0bd4eb08d0f0487361d6780 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:43.794183 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2ea6397a-1cda-4d30-b085-1a4b9764d774 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:43.794183 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2ea6397a-1cda-4d30-b085-1a4b9764d774 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:43.795643 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3010/6050] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:31:43 2022] DELETE /identity/v3/roles/7c1ffa71b0bd4eb08d0f0487361d6780 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:43.800710 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6397a-1cda-4d30-b085-1a4b9764d774 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:43.802249 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2ea6397a-1cda-4d30-b085-1a4b9764d774 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:43.913642 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3041/6051] 10.222.0.23 () {60 vars in 1151 bytes} [Sat Apr 30 21:31:43 2022] POST /identity/v3/projects => generated 329 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:43.918513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ac819-fe42-4687-9111-3c5c9b95f697 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:43.920918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5f5ac819-fe42-4687-9111-3c5c9b95f697 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:43.924652 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6397a-1cda-4d30-b085-1a4b9764d774 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:44.008306 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764d941-705b-4400-8f8b-b6f083d7f49b tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:44.009452 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764d941-705b-4400-8f8b-b6f083d7f49b tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:44.009933 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764d941-705b-4400-8f8b-b6f083d7f49b tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:44.010367 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764d941-705b-4400-8f8b-b6f083d7f49b tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:44.012055 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f764d941-705b-4400-8f8b-b6f083d7f49b tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:44.014016 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f764d941-705b-4400-8f8b-b6f083d7f49b tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:44.027531 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ac819-fe42-4687-9111-3c5c9b95f697 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:44.033611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195c5b1-7ed4-4eb1-98a3-e2164ffb86ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:44.034931 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195c5b1-7ed4-4eb1-98a3-e2164ffb86ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:44.035278 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195c5b1-7ed4-4eb1-98a3-e2164ffb86ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:44.035619 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195c5b1-7ed4-4eb1-98a3-e2164ffb86ec admin admin] PATH_INFO: `/v3/users/20b4082fa07249e2b6dfb9b4506ab398` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:44.037028 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1195c5b1-7ed4-4eb1-98a3-e2164ffb86ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=20b4082fa07249e2b6dfb9b4506ab398)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:44.045063 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1195c5b1-7ed4-4eb1-98a3-e2164ffb86ec admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:44.160034 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3011/6052] 10.222.0.23 () {60 vars in 1142 bytes} [Sat Apr 30 21:31:43 2022] POST /identity/v3/roles => generated 239 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:44.161256 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764d941-705b-4400-8f8b-b6f083d7f49b tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:44.163859 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f764d941-705b-4400-8f8b-b6f083d7f49b tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:44.295313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764d941-705b-4400-8f8b-b6f083d7f49b tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:44.295313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145aa6ad-74ed-4f4f-b960-1689961a14c7 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:44.295313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145aa6ad-74ed-4f4f-b960-1689961a14c7 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:44.296008 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145aa6ad-74ed-4f4f-b960-1689961a14c7 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:44.296008 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145aa6ad-74ed-4f4f-b960-1689961a14c7 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:44.296008 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145aa6ad-74ed-4f4f-b960-1689961a14c7 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:44.296193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1195c5b1-7ed4-4eb1-98a3-e2164ffb86ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20b4082fa07249e2b6dfb9b4506ab398'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:44.296708 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145aa6ad-74ed-4f4f-b960-1689961a14c7 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:44.322688 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1195c5b1-7ed4-4eb1-98a3-e2164ffb86ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20b4082fa07249e2b6dfb9b4506ab398'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:44.412712 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3012/6053] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:31:44 2022] POST /identity/v3/users => generated 413 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:44.413406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145aa6ad-74ed-4f4f-b960-1689961a14c7 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:44.419015 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1195c5b1-7ed4-4eb1-98a3-e2164ffb86ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20b4082fa07249e2b6dfb9b4506ab398'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:44.430429 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1195c5b1-7ed4-4eb1-98a3-e2164ffb86ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20b4082fa07249e2b6dfb9b4506ab398'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:44.430718 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145aa6ad-74ed-4f4f-b960-1689961a14c7 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:44.431202 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1195c5b1-7ed4-4eb1-98a3-e2164ffb86ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20b4082fa07249e2b6dfb9b4506ab398'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:44.440680 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3042/6054] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:31:43 2022] DELETE /identity/v3/users/20b4082fa07249e2b6dfb9b4506ab398 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:44.444516 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195c5b1-7ed4-4eb1-98a3-e2164ffb86ec admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:44.446795 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1195c5b1-7ed4-4eb1-98a3-e2164ffb86ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:44.454018 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0d0c8-b0e6-437c-b857-f97007ed929d tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:44.454882 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0d0c8-b0e6-437c-b857-f97007ed929d tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:44.455171 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0d0c8-b0e6-437c-b857-f97007ed929d tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:44.455589 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0d0c8-b0e6-437c-b857-f97007ed929d tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:44.456305 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd0d0c8-b0e6-437c-b857-f97007ed929d tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:44.458457 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd0d0c8-b0e6-437c-b857-f97007ed929d tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:44.514686 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195c5b1-7ed4-4eb1-98a3-e2164ffb86ec admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:44.519900 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc7af9-6075-4b9a-9d57-91ef76d512dc tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:44.520563 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc7af9-6075-4b9a-9d57-91ef76d512dc tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:44.520849 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc7af9-6075-4b9a-9d57-91ef76d512dc tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:44.521124 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc7af9-6075-4b9a-9d57-91ef76d512dc tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:44.521890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fc7af9-6075-4b9a-9d57-91ef76d512dc tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:44.523493 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fc7af9-6075-4b9a-9d57-91ef76d512dc tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:44.575134 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3013/6055] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:31:44 2022] POST /identity/v3/projects => generated 410 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:44.580347 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0d0c8-b0e6-437c-b857-f97007ed929d tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:44.582084 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0fd0d0c8-b0e6-437c-b857-f97007ed929d tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:44.620838 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3043/6056] 10.222.0.23 () {60 vars in 1142 bytes} [Sat Apr 30 21:31:44 2022] POST /identity/v3/roles => generated 244 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:44.625020 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc7af9-6075-4b9a-9d57-91ef76d512dc tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:44.652100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc7af9-6075-4b9a-9d57-91ef76d512dc tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:44.666369 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0d0c8-b0e6-437c-b857-f97007ed929d tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:44.671656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9528d-c39e-4d3f-817c-fe49d11463b3 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:44.673143 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9528d-c39e-4d3f-817c-fe49d11463b3 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:44.673444 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9528d-c39e-4d3f-817c-fe49d11463b3 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:44.673726 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9528d-c39e-4d3f-817c-fe49d11463b3 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/fc673e25728f463f8016d6d8ddfaa2ec/users/77bbff5f394145dbafc1429fb9da2a5d/roles/74a16c0cb5e54af59abb82d776839c0d/inherited_to_projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:44.679482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce9528d-c39e-4d3f-817c-fe49d11463b3 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=fc673e25728f463f8016d6d8ddfaa2ec, user_id=77bbff5f394145dbafc1429fb9da2a5d, role_id=74a16c0cb5e54af59abb82d776839c0d)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:44.679482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce9528d-c39e-4d3f-817c-fe49d11463b3 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:44.725461 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b83b11-aebe-47f8-9225-5ab2c7186f8e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:44.736834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b83b11-aebe-47f8-9225-5ab2c7186f8e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:44.736834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b83b11-aebe-47f8-9225-5ab2c7186f8e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:44.736834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b83b11-aebe-47f8-9225-5ab2c7186f8e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:44.737694 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b83b11-aebe-47f8-9225-5ab2c7186f8e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:44.743058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b83b11-aebe-47f8-9225-5ab2c7186f8e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:44.763065 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3014/6057] 10.222.0.23 () {60 vars in 1578 bytes} [Sat Apr 30 21:31:44 2022] PUT /identity/v3/OS-INHERIT/domains/fc673e25728f463f8016d6d8ddfaa2ec/users/77bbff5f394145dbafc1429fb9da2a5d/roles/74a16c0cb5e54af59abb82d776839c0d/inherited_to_projects => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:31:44.765197 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9528d-c39e-4d3f-817c-fe49d11463b3 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:44.766932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2ce9528d-c39e-4d3f-817c-fe49d11463b3 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:44.829015 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3044/6058] 10.222.0.23 () {60 vars in 1142 bytes} [Sat Apr 30 21:31:44 2022] POST /identity/v3/roles => generated 246 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:44.829240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b83b11-aebe-47f8-9225-5ab2c7186f8e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:44.842141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9528d-c39e-4d3f-817c-fe49d11463b3 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:44.842695 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b83b11-aebe-47f8-9225-5ab2c7186f8e tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:44.852257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba79104-f975-44db-b776-e9f303e927c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:44.856086 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba79104-f975-44db-b776-e9f303e927c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:44.856086 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba79104-f975-44db-b776-e9f303e927c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:44.856086 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba79104-f975-44db-b776-e9f303e927c5 admin admin] PATH_INFO: `/v3/projects/3364787934af4f59b17a58b380fe95da` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:44.862564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba79104-f975-44db-b776-e9f303e927c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3364787934af4f59b17a58b380fe95da)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:44.863921 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba79104-f975-44db-b776-e9f303e927c5 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:44.917633 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305b879-c3b4-4850-abce-9ca578fcb8f6 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:44.917633 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305b879-c3b4-4850-abce-9ca578fcb8f6 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:44.917633 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305b879-c3b4-4850-abce-9ca578fcb8f6 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:44.917998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305b879-c3b4-4850-abce-9ca578fcb8f6 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:44.917998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c305b879-c3b4-4850-abce-9ca578fcb8f6 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Adding query filter params (scope.project.id=38c92b31618b42dfbc3260610be4eba2, user.id=77bbff5f394145dbafc1429fb9da2a5d) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:31:44.917998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c305b879-c3b4-4850-abce-9ca578fcb8f6 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:44.918314 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c305b879-c3b4-4850-abce-9ca578fcb8f6 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:44.999254 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-eba79104-f975-44db-b776-e9f303e927c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3364787934af4f59b17a58b380fe95da', 'request_id': 'req-eba79104-f975-44db-b776-e9f303e927c5'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:45.001681 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3045/6059] 10.222.0.23 () {58 vars in 1355 bytes} [Sat Apr 30 21:31:44 2022] GET /identity/v3/role_assignments?scope.project.id=38c92b31618b42dfbc3260610be4eba2&user.id=77bbff5f394145dbafc1429fb9da2a5d&effective => generated 648 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:31:45.005720 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305b879-c3b4-4850-abce-9ca578fcb8f6 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:45.011425 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-eba79104-f975-44db-b776-e9f303e927c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3364787934af4f59b17a58b380fe95da', 'request_id': 'req-eba79104-f975-44db-b776-e9f303e927c5'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:45.026566 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-eba79104-f975-44db-b776-e9f303e927c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3364787934af4f59b17a58b380fe95da', 'request_id': 'req-eba79104-f975-44db-b776-e9f303e927c5'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:45.075143 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305b879-c3b4-4850-abce-9ca578fcb8f6 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:45.136981 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-eba79104-f975-44db-b776-e9f303e927c5 admin admin] The token cache is being invalidate because project 3364787934af4f59b17a58b380fe95da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:45.137254 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-eba79104-f975-44db-b776-e9f303e927c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:45.144030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-eba79104-f975-44db-b776-e9f303e927c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:45.146383 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3015/6060] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:31:44 2022] DELETE /identity/v3/projects/3364787934af4f59b17a58b380fe95da => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:45.147352 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba79104-f975-44db-b776-e9f303e927c5 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:45.149091 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e906633-6b46-4a68-ac83-5b82fbca3446 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:45.150291 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e906633-6b46-4a68-ac83-5b82fbca3446 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:45.150434 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-eba79104-f975-44db-b776-e9f303e927c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:45.150842 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e906633-6b46-4a68-ac83-5b82fbca3446 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:45.151707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e906633-6b46-4a68-ac83-5b82fbca3446 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/projects/e08f02df53774c9a9d096e3cf5fc78e5/users/1d88ae489bee47b199190279dc1744e9/roles/2949386770dc485e9f5d43609264d368` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:45.169438 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e906633-6b46-4a68-ac83-5b82fbca3446 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e08f02df53774c9a9d096e3cf5fc78e5, user_id=1d88ae489bee47b199190279dc1744e9, role_id=2949386770dc485e9f5d43609264d368)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:45.173023 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e906633-6b46-4a68-ac83-5b82fbca3446 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:45.239846 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba79104-f975-44db-b776-e9f303e927c5 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:45.249381 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3046/6061] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:31:45 2022] PUT /identity/v3/projects/e08f02df53774c9a9d096e3cf5fc78e5/users/1d88ae489bee47b199190279dc1744e9/roles/2949386770dc485e9f5d43609264d368 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:45.252946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70f339-18ab-4412-b75c-3048b1ff0562 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:45.254345 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70f339-18ab-4412-b75c-3048b1ff0562 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:45.255933 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70f339-18ab-4412-b75c-3048b1ff0562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:45.295079 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-7b70f339-18ab-4412-b75c-3048b1ff0562 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:45.296476 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7b70f339-18ab-4412-b75c-3048b1ff0562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:45.319808 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b13a2b-7cdb-4ec0-899d-934b28086b2e tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:45.321174 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b13a2b-7cdb-4ec0-899d-934b28086b2e tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:45.321465 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b13a2b-7cdb-4ec0-899d-934b28086b2e tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:45.321746 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b13a2b-7cdb-4ec0-899d-934b28086b2e tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:45.322683 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b13a2b-7cdb-4ec0-899d-934b28086b2e tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Adding query filter params (scope.project.id=7208c28ade57438ea8965bb3eaac8d53, user.id=77bbff5f394145dbafc1429fb9da2a5d) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:31:45.324103 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b13a2b-7cdb-4ec0-899d-934b28086b2e tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:45.332994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b13a2b-7cdb-4ec0-899d-934b28086b2e tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:45.371070 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3047/6062] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:45.372120 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70f339-18ab-4412-b75c-3048b1ff0562 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:45.373574 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7b70f339-18ab-4412-b75c-3048b1ff0562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:45.398688 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3016/6063] 10.222.0.23 () {58 vars in 1355 bytes} [Sat Apr 30 21:31:45 2022] GET /identity/v3/role_assignments?scope.project.id=7208c28ade57438ea8965bb3eaac8d53&user.id=77bbff5f394145dbafc1429fb9da2a5d&effective => generated 648 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:31:45.403222 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883632f-0d2e-40c6-b317-1317c2d6b35f None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:45.403618 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883632f-0d2e-40c6-b317-1317c2d6b35f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:45.404003 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883632f-0d2e-40c6-b317-1317c2d6b35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:45.424289 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-3883632f-0d2e-40c6-b317-1317c2d6b35f None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:45.426136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3883632f-0d2e-40c6-b317-1317c2d6b35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:45.435820 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3017/6064] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:45.436784 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883632f-0d2e-40c6-b317-1317c2d6b35f None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:45.450954 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883632f-0d2e-40c6-b317-1317c2d6b35f None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:45.457058 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1cda1-bf18-4c4d-8287-f2b23926f3fe tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:45.458185 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1cda1-bf18-4c4d-8287-f2b23926f3fe tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:45.458545 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1cda1-bf18-4c4d-8287-f2b23926f3fe tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:45.459048 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1cda1-bf18-4c4d-8287-f2b23926f3fe tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/fc673e25728f463f8016d6d8ddfaa2ec/users/77bbff5f394145dbafc1429fb9da2a5d/roles/74a16c0cb5e54af59abb82d776839c0d/inherited_to_projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:45.461525 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b1cda1-bf18-4c4d-8287-f2b23926f3fe tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=fc673e25728f463f8016d6d8ddfaa2ec, user_id=77bbff5f394145dbafc1429fb9da2a5d, role_id=74a16c0cb5e54af59abb82d776839c0d)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:45.464504 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b1cda1-bf18-4c4d-8287-f2b23926f3fe tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:45.470559 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-88b1cda1-bf18-4c4d-8287-f2b23926f3fe tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invalidating the token cache because role 74a16c0cb5e54af59abb82d776839c0d was removed from user 77bbff5f394145dbafc1429fb9da2a5d on domain fc673e25728f463f8016d6d8ddfaa2ec. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:45.470920 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-88b1cda1-bf18-4c4d-8287-f2b23926f3fe tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:45.473644 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70f339-18ab-4412-b75c-3048b1ff0562 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:45.473798 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-88b1cda1-bf18-4c4d-8287-f2b23926f3fe tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:45.476990 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b76086-ed80-4709-9773-287071c22584 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:45.478031 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b76086-ed80-4709-9773-287071c22584 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:45.478322 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b76086-ed80-4709-9773-287071c22584 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:45.478602 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b76086-ed80-4709-9773-287071c22584 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/projects/e08f02df53774c9a9d096e3cf5fc78e5/users/1d88ae489bee47b199190279dc1744e9/roles/bde9f0d153a84a3faf0d0782f9ea29ad` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:45.481783 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b76086-ed80-4709-9773-287071c22584 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e08f02df53774c9a9d096e3cf5fc78e5, user_id=1d88ae489bee47b199190279dc1744e9, role_id=bde9f0d153a84a3faf0d0782f9ea29ad)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:45.483965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b76086-ed80-4709-9773-287071c22584 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:45.564234 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3018/6065] 10.222.0.23 () {58 vars in 1562 bytes} [Sat Apr 30 21:31:45 2022] DELETE /identity/v3/OS-INHERIT/domains/fc673e25728f463f8016d6d8ddfaa2ec/users/77bbff5f394145dbafc1429fb9da2a5d/roles/74a16c0cb5e54af59abb82d776839c0d/inherited_to_projects => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:45.565650 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1cda1-bf18-4c4d-8287-f2b23926f3fe tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:45.567795 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-88b1cda1-bf18-4c4d-8287-f2b23926f3fe tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:45.599121 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3048/6066] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:31:45 2022] PUT /identity/v3/projects/e08f02df53774c9a9d096e3cf5fc78e5/users/1d88ae489bee47b199190279dc1744e9/roles/bde9f0d153a84a3faf0d0782f9ea29ad => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:45.600330 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b76086-ed80-4709-9773-287071c22584 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:45.608324 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-25b76086-ed80-4709-9773-287071c22584 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:45.652009 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1cda1-bf18-4c4d-8287-f2b23926f3fe tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:45.700617 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b76086-ed80-4709-9773-287071c22584 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:45.710291 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9ce08-d85e-4ea2-b1ca-71886f132001 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:45.712046 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9ce08-d85e-4ea2-b1ca-71886f132001 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:45.712951 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9ce08-d85e-4ea2-b1ca-71886f132001 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:45.713259 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9ce08-d85e-4ea2-b1ca-71886f132001 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:45.714273 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d9ce08-d85e-4ea2-b1ca-71886f132001 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Adding query filter params (scope.project.id=38c92b31618b42dfbc3260610be4eba2, user.id=77bbff5f394145dbafc1429fb9da2a5d) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:31:45.714581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d9ce08-d85e-4ea2-b1ca-71886f132001 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:45.716716 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d9ce08-d85e-4ea2-b1ca-71886f132001 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:45.726609 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02312501-d610-4550-9802-ce6743b46a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:45.727290 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02312501-d610-4550-9802-ce6743b46a0c admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:45.727566 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02312501-d610-4550-9802-ce6743b46a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:45.727838 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02312501-d610-4550-9802-ce6743b46a0c admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:45.728551 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02312501-d610-4550-9802-ce6743b46a0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:31:45.728856 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02312501-d610-4550-9802-ce6743b46a0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:45.730493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02312501-d610-4550-9802-ce6743b46a0c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:45.752376 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3019/6067] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:31:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:31:45.753338 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02312501-d610-4550-9802-ce6743b46a0c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:45.755496 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-02312501-d610-4550-9802-ce6743b46a0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:45.822178 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3049/6068] 10.222.0.23 () {58 vars in 1355 bytes} [Sat Apr 30 21:31:45 2022] GET /identity/v3/role_assignments?scope.project.id=38c92b31618b42dfbc3260610be4eba2&user.id=77bbff5f394145dbafc1429fb9da2a5d&effective => generated 228 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:31:45.823454 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9ce08-d85e-4ea2-b1ca-71886f132001 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:45.845866 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9ce08-d85e-4ea2-b1ca-71886f132001 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:45.852127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa1a9c1-9886-4c61-923f-76edc88fea60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:45.853296 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1a9c1-9886-4c61-923f-76edc88fea60 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:45.853823 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1a9c1-9886-4c61-923f-76edc88fea60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:45.854304 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1a9c1-9886-4c61-923f-76edc88fea60 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:45.855200 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa1a9c1-9886-4c61-923f-76edc88fea60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:45.858809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa1a9c1-9886-4c61-923f-76edc88fea60 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:45.873515 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02312501-d610-4550-9802-ce6743b46a0c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:45.884831 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d27ea-47db-4d53-b674-71656011aa44 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:45.885530 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d27ea-47db-4d53-b674-71656011aa44 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:45.885971 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d27ea-47db-4d53-b674-71656011aa44 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:45.886256 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d27ea-47db-4d53-b674-71656011aa44 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:45.888192 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d27ea-47db-4d53-b674-71656011aa44 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:45.890410 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d27ea-47db-4d53-b674-71656011aa44 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:45.927996 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3020/6069] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:31:45 2022] GET /identity/v3/users => generated 8201 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:31:45.928989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d27ea-47db-4d53-b674-71656011aa44 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:45.942449 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d27ea-47db-4d53-b674-71656011aa44 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:45.947717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcafddbc-7def-4910-b64f-fca51ba8870e tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:45.948313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafddbc-7def-4910-b64f-fca51ba8870e tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:45.948599 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafddbc-7def-4910-b64f-fca51ba8870e tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:45.948880 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafddbc-7def-4910-b64f-fca51ba8870e tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:45.949714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcafddbc-7def-4910-b64f-fca51ba8870e tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Adding query filter params (scope.project.id=7208c28ade57438ea8965bb3eaac8d53, user.id=77bbff5f394145dbafc1429fb9da2a5d) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:31:45.950035 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcafddbc-7def-4910-b64f-fca51ba8870e tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:45.951903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcafddbc-7def-4910-b64f-fca51ba8870e tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:46.002772 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3050/6070] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:31:45 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:46.004298 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06139145-0f2e-4286-ae5c-c45b8f381675 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:46.004592 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06139145-0f2e-4286-ae5c-c45b8f381675 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:46.004891 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06139145-0f2e-4286-ae5c-c45b8f381675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:46.009278 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3021/6071] 10.222.0.23 () {58 vars in 1355 bytes} [Sat Apr 30 21:31:45 2022] GET /identity/v3/role_assignments?scope.project.id=7208c28ade57438ea8965bb3eaac8d53&user.id=77bbff5f394145dbafc1429fb9da2a5d&effective => generated 228 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:31:46.009278 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcafddbc-7def-4910-b64f-fca51ba8870e tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:46.022699 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcafddbc-7def-4910-b64f-fca51ba8870e tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:46.075667 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-06139145-0f2e-4286-ae5c-c45b8f381675 None None] MFA Rules not processed for user `1d88ae489bee47b199190279dc1744e9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:46.076846 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-06139145-0f2e-4286-ae5c-c45b8f381675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:46.090228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e1d799-0955-41d6-b6d5-3f1336af8f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:46.090950 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1d799-0955-41d6-b6d5-3f1336af8f41 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:46.091235 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1d799-0955-41d6-b6d5-3f1336af8f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:46.091507 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1d799-0955-41d6-b6d5-3f1336af8f41 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:46.092196 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e1d799-0955-41d6-b6d5-3f1336af8f41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:46.095228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e1d799-0955-41d6-b6d5-3f1336af8f41 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:46.177059 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3051/6072] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:46 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:46.184760 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06139145-0f2e-4286-ae5c-c45b8f381675 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:46.224326 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3022/6073] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:31:46 2022] POST /identity/v3/users => generated 290 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:46.225851 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8709f-1dc1-410b-b7a9-c8c2f1f83c07 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:46.226114 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8709f-1dc1-410b-b7a9-c8c2f1f83c07 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:46.226443 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8709f-1dc1-410b-b7a9-c8c2f1f83c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:46.265496 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-17c8709f-1dc1-410b-b7a9-c8c2f1f83c07 None None] MFA Rules not processed for user `1d88ae489bee47b199190279dc1744e9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:46.267408 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-17c8709f-1dc1-410b-b7a9-c8c2f1f83c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:46.285724 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3023/6074] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:46 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:46.286940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8709f-1dc1-410b-b7a9-c8c2f1f83c07 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:46.294674 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06139145-0f2e-4286-ae5c-c45b8f381675 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:46.328972 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f21e47-8ab4-4d2a-a109-5cebd00407e5 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:46.339512 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f21e47-8ab4-4d2a-a109-5cebd00407e5 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:46.339512 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f21e47-8ab4-4d2a-a109-5cebd00407e5 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:46.340620 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f21e47-8ab4-4d2a-a109-5cebd00407e5 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/projects/7208c28ade57438ea8965bb3eaac8d53` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:46.340733 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8709f-1dc1-410b-b7a9-c8c2f1f83c07 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:46.345448 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f21e47-8ab4-4d2a-a109-5cebd00407e5 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7208c28ade57438ea8965bb3eaac8d53)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:46.347520 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f21e47-8ab4-4d2a-a109-5cebd00407e5 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:46.349288 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddaea83-3a5d-4a1f-82f5-a0747479ec64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:46.350430 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddaea83-3a5d-4a1f-82f5-a0747479ec64 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:46.350430 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddaea83-3a5d-4a1f-82f5-a0747479ec64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:46.350737 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddaea83-3a5d-4a1f-82f5-a0747479ec64 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:46.351475 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddaea83-3a5d-4a1f-82f5-a0747479ec64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:46.353220 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddaea83-3a5d-4a1f-82f5-a0747479ec64 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:46.379358 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3024/6075] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:31:46 2022] GET /identity/v3/roles => generated 2122 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:31:46.380297 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddaea83-3a5d-4a1f-82f5-a0747479ec64 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:46.402582 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddaea83-3a5d-4a1f-82f5-a0747479ec64 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:46.407629 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232d173-41f7-4ad1-ac9d-93fec70b1013 tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d88ae489bee47b199190279dc1744e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e08f02df53774c9a9d096e3cf5fc78e5', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1753590089', 'tempest-NotDelegatedRole-399878472'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:46.408370 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232d173-41f7-4ad1-ac9d-93fec70b1013 tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:46.409578 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232d173-41f7-4ad1-ac9d-93fec70b1013 tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:46.409578 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232d173-41f7-4ad1-ac9d-93fec70b1013 tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:46.410676 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b232d173-41f7-4ad1-ac9d-93fec70b1013 tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] RBAC: Authorizing `identity:create_trust()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:46.411898 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b232d173-41f7-4ad1-ac9d-93fec70b1013 tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:46.521328 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-77f21e47-8ab4-4d2a-a109-5cebd00407e5 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7208c28ade57438ea8965bb3eaac8d53', 'request_id': 'req-77f21e47-8ab4-4d2a-a109-5cebd00407e5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:46.527990 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-77f21e47-8ab4-4d2a-a109-5cebd00407e5 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7208c28ade57438ea8965bb3eaac8d53', 'request_id': 'req-77f21e47-8ab4-4d2a-a109-5cebd00407e5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:46.534975 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-77f21e47-8ab4-4d2a-a109-5cebd00407e5 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7208c28ade57438ea8965bb3eaac8d53', 'request_id': 'req-77f21e47-8ab4-4d2a-a109-5cebd00407e5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:46.592341 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3025/6076] 10.222.0.23 () {60 vars in 1173 bytes} [Sat Apr 30 21:31:46 2022] POST /identity/v3/OS-TRUST/trusts => generated 835 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:46.594667 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232d173-41f7-4ad1-ac9d-93fec70b1013 tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:46.611148 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232d173-41f7-4ad1-ac9d-93fec70b1013 tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:46.661564 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-77f21e47-8ab4-4d2a-a109-5cebd00407e5 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] The token cache is being invalidate because project 7208c28ade57438ea8965bb3eaac8d53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:46.661564 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-77f21e47-8ab4-4d2a-a109-5cebd00407e5 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:46.662911 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-77f21e47-8ab4-4d2a-a109-5cebd00407e5 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:46.665199 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3052/6077] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:31:46 2022] DELETE /identity/v3/projects/7208c28ade57438ea8965bb3eaac8d53 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:46.666824 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f21e47-8ab4-4d2a-a109-5cebd00407e5 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:46.669030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-77f21e47-8ab4-4d2a-a109-5cebd00407e5 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:46.690095 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099086e-ca27-4c86-a91f-f000d1f5c8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:46.690951 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099086e-ca27-4c86-a91f-f000d1f5c8b6 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:46.691240 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099086e-ca27-4c86-a91f-f000d1f5c8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:46.691717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099086e-ca27-4c86-a91f-f000d1f5c8b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:46.692807 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d099086e-ca27-4c86-a91f-f000d1f5c8b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:46.695050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d099086e-ca27-4c86-a91f-f000d1f5c8b6 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:46.717240 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3026/6078] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:31:46 2022] GET /identity/v3/roles => generated 2122 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:31:46.717240 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099086e-ca27-4c86-a91f-f000d1f5c8b6 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:46.717240 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d099086e-ca27-4c86-a91f-f000d1f5c8b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:46.757600 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f21e47-8ab4-4d2a-a109-5cebd00407e5 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:46.764119 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b93a2c-e254-4131-b7ef-c15649116fc0 tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d88ae489bee47b199190279dc1744e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e08f02df53774c9a9d096e3cf5fc78e5', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1753590089', 'tempest-NotDelegatedRole-399878472'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:46.764957 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b93a2c-e254-4131-b7ef-c15649116fc0 tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:46.765239 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b93a2c-e254-4131-b7ef-c15649116fc0 tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:46.765539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b93a2c-e254-4131-b7ef-c15649116fc0 tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] PATH_INFO: `/v3/OS-TRUST/trusts/4eee8d58d2f34779aee54949f41ba0c2` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:46.775259 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b93a2c-e254-4131-b7ef-c15649116fc0 tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] RBAC: Authorizing `identity:get_trust(trust_id=4eee8d58d2f34779aee54949f41ba0c2)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:46.776724 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b93a2c-e254-4131-b7ef-c15649116fc0 tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:46.787286 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3053/6079] 10.222.0.23 () {58 vars in 1250 bytes} [Sat Apr 30 21:31:46 2022] GET /identity/v3/OS-TRUST/trusts/4eee8d58d2f34779aee54949f41ba0c2 => generated 835 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:31:46.788133 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b93a2c-e254-4131-b7ef-c15649116fc0 tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:46.790151 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b5b93a2c-e254-4131-b7ef-c15649116fc0 tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:46.793983 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d099086e-ca27-4c86-a91f-f000d1f5c8b6 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:46.801504 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ec230-3c56-4140-8a68-ebb394ef5bdb tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:46.802484 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ec230-3c56-4140-8a68-ebb394ef5bdb tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:46.802835 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ec230-3c56-4140-8a68-ebb394ef5bdb tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:46.803223 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ec230-3c56-4140-8a68-ebb394ef5bdb tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/roles/74a16c0cb5e54af59abb82d776839c0d` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:46.804791 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ec230-3c56-4140-8a68-ebb394ef5bdb tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:delete_role(role_id=74a16c0cb5e54af59abb82d776839c0d)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:46.806542 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ec230-3c56-4140-8a68-ebb394ef5bdb tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:46.808735 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b93a2c-e254-4131-b7ef-c15649116fc0 tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:46.814859 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b0403-0829-479e-893f-432f1226ac0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:46.816028 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b0403-0829-479e-893f-432f1226ac0a admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:46.816647 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b0403-0829-479e-893f-432f1226ac0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:46.816766 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b0403-0829-479e-893f-432f1226ac0a admin admin] PATH_INFO: `/v3/projects/35c149f6d0184da2ad1f324dda8b5d1a/users/5036e109752841e890d804f5e96d04cb/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:46.840961 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b0403-0829-479e-893f-432f1226ac0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=35c149f6d0184da2ad1f324dda8b5d1a, user_id=5036e109752841e890d804f5e96d04cb, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:46.843874 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8b0403-0829-479e-893f-432f1226ac0a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:46.929259 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c97ec230-3c56-4140-8a68-ebb394ef5bdb tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invalidating the token cache because role 74a16c0cb5e54af59abb82d776839c0d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:46.930288 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c97ec230-3c56-4140-8a68-ebb394ef5bdb tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:46.930860 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3054/6080] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:31:46 2022] PUT /identity/v3/projects/35c149f6d0184da2ad1f324dda8b5d1a/users/5036e109752841e890d804f5e96d04cb/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:46.931701 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c97ec230-3c56-4140-8a68-ebb394ef5bdb tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:46.931812 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b0403-0829-479e-893f-432f1226ac0a admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:46.936349 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3027/6081] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:31:46 2022] DELETE /identity/v3/roles/74a16c0cb5e54af59abb82d776839c0d => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:46.941636 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1b5d3-245d-4992-9a7a-c1e81d7e3aff None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:46.944653 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1b5d3-245d-4992-9a7a-c1e81d7e3aff None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:46.945175 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1b5d3-245d-4992-9a7a-c1e81d7e3aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:46.998687 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-5ea1b5d3-245d-4992-9a7a-c1e81d7e3aff None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:47.003054 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5ea1b5d3-245d-4992-9a7a-c1e81d7e3aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:47.090437 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8b0403-0829-479e-893f-432f1226ac0a admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:47.135262 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3028/6082] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:47.139176 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1b5d3-245d-4992-9a7a-c1e81d7e3aff None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:47.142761 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5ea1b5d3-245d-4992-9a7a-c1e81d7e3aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:47.217385 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a89905-c8ca-4be1-86cd-487df1b63a25 tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d88ae489bee47b199190279dc1744e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e08f02df53774c9a9d096e3cf5fc78e5', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1753590089', 'tempest-NotDelegatedRole-399878472'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:47.218283 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a89905-c8ca-4be1-86cd-487df1b63a25 tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:47.218563 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a89905-c8ca-4be1-86cd-487df1b63a25 tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:47.219041 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a89905-c8ca-4be1-86cd-487df1b63a25 tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] PATH_INFO: `/v3/OS-TRUST/trusts/4eee8d58d2f34779aee54949f41ba0c2/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:47.233901 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a89905-c8ca-4be1-86cd-487df1b63a25 tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=4eee8d58d2f34779aee54949f41ba0c2)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:47.235929 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a89905-c8ca-4be1-86cd-487df1b63a25 tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:47.256366 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3055/6083] 10.222.0.23 () {58 vars in 1268 bytes} [Sat Apr 30 21:31:46 2022] GET /identity/v3/OS-TRUST/trusts/4eee8d58d2f34779aee54949f41ba0c2/roles => generated 371 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:31:47.256366 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a89905-c8ca-4be1-86cd-487df1b63a25 tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:47.260786 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-02a89905-c8ca-4be1-86cd-487df1b63a25 tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:47.319285 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1b5d3-245d-4992-9a7a-c1e81d7e3aff None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:47.339375 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bddb066-c9db-40d8-a1d0-e011aba3c6d6 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:47.341515 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddb066-c9db-40d8-a1d0-e011aba3c6d6 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:47.341920 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddb066-c9db-40d8-a1d0-e011aba3c6d6 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:47.344537 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddb066-c9db-40d8-a1d0-e011aba3c6d6 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:47.344784 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bddb066-c9db-40d8-a1d0-e011aba3c6d6 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:47.347263 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bddb066-c9db-40d8-a1d0-e011aba3c6d6 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:47.410358 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a89905-c8ca-4be1-86cd-487df1b63a25 tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:47.423844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438fa70-1cbc-480b-97d3-db2fedbfddf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:47.424549 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438fa70-1cbc-480b-97d3-db2fedbfddf3 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:47.424833 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438fa70-1cbc-480b-97d3-db2fedbfddf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:47.425112 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438fa70-1cbc-480b-97d3-db2fedbfddf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:47.446976 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f438fa70-1cbc-480b-97d3-db2fedbfddf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:47.448621 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f438fa70-1cbc-480b-97d3-db2fedbfddf3 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:47.477925 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3056/6084] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:31:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:31:47.483356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438fa70-1cbc-480b-97d3-db2fedbfddf3 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:47.490009 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f438fa70-1cbc-480b-97d3-db2fedbfddf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:47.502425 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3029/6085] 10.222.0.23 () {60 vars in 1142 bytes} [Sat Apr 30 21:31:47 2022] POST /identity/v3/roles => generated 239 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:47.506406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bddb066-c9db-40d8-a1d0-e011aba3c6d6 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:47.531768 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438fa70-1cbc-480b-97d3-db2fedbfddf3 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:47.531768 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2552958-998d-418a-bd17-408af4f40912 tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d88ae489bee47b199190279dc1744e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e08f02df53774c9a9d096e3cf5fc78e5', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1753590089', 'tempest-NotDelegatedRole-399878472'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:47.531768 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2552958-998d-418a-bd17-408af4f40912 tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:47.532715 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2552958-998d-418a-bd17-408af4f40912 tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:47.532715 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2552958-998d-418a-bd17-408af4f40912 tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] PATH_INFO: `/v3/OS-TRUST/trusts/4eee8d58d2f34779aee54949f41ba0c2/roles/2949386770dc485e9f5d43609264d368` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:47.534989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bddb066-c9db-40d8-a1d0-e011aba3c6d6 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:47.544580 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2552958-998d-418a-bd17-408af4f40912 tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] RBAC: Authorizing `identity:get_role_for_trust(trust_id=4eee8d58d2f34779aee54949f41ba0c2, role_id=2949386770dc485e9f5d43609264d368)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:47.546086 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2552958-998d-418a-bd17-408af4f40912 tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:47.554917 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554205c-09fa-4b53-a0eb-04685527a943 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:47.556002 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554205c-09fa-4b53-a0eb-04685527a943 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:47.556747 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554205c-09fa-4b53-a0eb-04685527a943 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:47.557846 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554205c-09fa-4b53-a0eb-04685527a943 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:47.558772 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2554205c-09fa-4b53-a0eb-04685527a943 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:47.561343 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2554205c-09fa-4b53-a0eb-04685527a943 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:47.567872 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3057/6086] 10.222.0.23 () {58 vars in 1367 bytes} [Sat Apr 30 21:31:47 2022] GET /identity/v3/OS-TRUST/trusts/4eee8d58d2f34779aee54949f41ba0c2/roles/2949386770dc485e9f5d43609264d368 => generated 244 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:31:47.572210 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2552958-998d-418a-bd17-408af4f40912 tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:47.598788 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2552958-998d-418a-bd17-408af4f40912 tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:47.615877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d6237-2019-4321-8ef2-86178b535f1d tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d88ae489bee47b199190279dc1744e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e08f02df53774c9a9d096e3cf5fc78e5', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1753590089', 'tempest-NotDelegatedRole-399878472'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:47.616724 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d6237-2019-4321-8ef2-86178b535f1d tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] REQUEST_METHOD: `HEAD` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:47.622258 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d6237-2019-4321-8ef2-86178b535f1d tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:47.622557 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d6237-2019-4321-8ef2-86178b535f1d tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] PATH_INFO: `/v3/OS-TRUST/trusts/4eee8d58d2f34779aee54949f41ba0c2/roles/2949386770dc485e9f5d43609264d368` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:47.631696 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d6237-2019-4321-8ef2-86178b535f1d tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] RBAC: Authorizing `identity:get_role_for_trust(trust_id=4eee8d58d2f34779aee54949f41ba0c2, role_id=2949386770dc485e9f5d43609264d368)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:47.633326 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d6237-2019-4321-8ef2-86178b535f1d tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:47.647105 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3058/6087] 10.222.0.23 () {58 vars in 1368 bytes} [Sat Apr 30 21:31:47 2022] HEAD /identity/v3/OS-TRUST/trusts/4eee8d58d2f34779aee54949f41ba0c2/roles/2949386770dc485e9f5d43609264d368 => generated 0 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:31:47.651462 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d6237-2019-4321-8ef2-86178b535f1d tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:47.671198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d6237-2019-4321-8ef2-86178b535f1d tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:47.681401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a866bfa-6251-4ac1-a754-2d7810a0234a tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d88ae489bee47b199190279dc1744e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e08f02df53774c9a9d096e3cf5fc78e5', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1753590089', 'tempest-NotDelegatedRole-399878472'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:47.683731 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a866bfa-6251-4ac1-a754-2d7810a0234a tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:47.684289 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a866bfa-6251-4ac1-a754-2d7810a0234a tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:47.685183 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a866bfa-6251-4ac1-a754-2d7810a0234a tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] PATH_INFO: `/v3/OS-TRUST/trusts/4eee8d58d2f34779aee54949f41ba0c2/roles/bde9f0d153a84a3faf0d0782f9ea29ad` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:47.721398 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a866bfa-6251-4ac1-a754-2d7810a0234a tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] RBAC: Authorizing `identity:get_role_for_trust(trust_id=4eee8d58d2f34779aee54949f41ba0c2, role_id=bde9f0d153a84a3faf0d0782f9ea29ad)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:47.721398 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a866bfa-6251-4ac1-a754-2d7810a0234a tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:47.721398 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-7a866bfa-6251-4ac1-a754-2d7810a0234a tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] Could not find role: bde9f0d153a84a3faf0d0782f9ea29ad.: keystone.exception.RoleNotFound: Could not find role: bde9f0d153a84a3faf0d0782f9ea29ad. Apr 30 21:31:47.721398 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:31:47.721398 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:31:47.721398 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:31:47.721398 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:31:47.721398 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:31:47.721398 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:31:47.721398 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:31:47.722037 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:31:47.722037 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:31:47.722037 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:31:47.722037 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:31:47.722037 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Apr 30 21:31:47.722037 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 21:31:47.722037 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: bde9f0d153a84a3faf0d0782f9ea29ad. Apr 30 21:31:47.722037 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:31:47.724125 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3059/6088] 10.222.0.23 () {58 vars in 1367 bytes} [Sat Apr 30 21:31:47 2022] GET /identity/v3/OS-TRUST/trusts/4eee8d58d2f34779aee54949f41ba0c2/roles/bde9f0d153a84a3faf0d0782f9ea29ad => generated 110 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Apr 30 21:31:47.725175 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a866bfa-6251-4ac1-a754-2d7810a0234a tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:47.756169 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a866bfa-6251-4ac1-a754-2d7810a0234a tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:47.756169 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34915716-6451-4643-8d81-4ce21e71db6f tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d88ae489bee47b199190279dc1744e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e08f02df53774c9a9d096e3cf5fc78e5', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1753590089', 'tempest-NotDelegatedRole-399878472'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:47.756169 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34915716-6451-4643-8d81-4ce21e71db6f tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] REQUEST_METHOD: `HEAD` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:47.756463 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34915716-6451-4643-8d81-4ce21e71db6f tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:47.756463 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34915716-6451-4643-8d81-4ce21e71db6f tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] PATH_INFO: `/v3/OS-TRUST/trusts/4eee8d58d2f34779aee54949f41ba0c2/roles/bde9f0d153a84a3faf0d0782f9ea29ad` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:47.756463 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34915716-6451-4643-8d81-4ce21e71db6f tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] RBAC: Authorizing `identity:get_role_for_trust(trust_id=4eee8d58d2f34779aee54949f41ba0c2, role_id=bde9f0d153a84a3faf0d0782f9ea29ad)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:47.756463 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34915716-6451-4643-8d81-4ce21e71db6f tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:47.769219 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-34915716-6451-4643-8d81-4ce21e71db6f tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] Could not find role: bde9f0d153a84a3faf0d0782f9ea29ad.: keystone.exception.RoleNotFound: Could not find role: bde9f0d153a84a3faf0d0782f9ea29ad. Apr 30 21:31:47.769219 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:31:47.769219 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:31:47.769219 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:31:47.769219 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:31:47.769219 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:31:47.769219 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:31:47.769219 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:31:47.769219 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:31:47.769219 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:31:47.769219 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:31:47.769219 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:31:47.769219 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Apr 30 21:31:47.769219 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Apr 30 21:31:47.770451 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: bde9f0d153a84a3faf0d0782f9ea29ad. Apr 30 21:31:47.770451 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:31:47.770619 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3060/6089] 10.222.0.23 () {58 vars in 1368 bytes} [Sat Apr 30 21:31:47 2022] HEAD /identity/v3/OS-TRUST/trusts/4eee8d58d2f34779aee54949f41ba0c2/roles/bde9f0d153a84a3faf0d0782f9ea29ad => generated 0 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Apr 30 21:31:47.775106 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34915716-6451-4643-8d81-4ce21e71db6f tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:47.792272 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3030/6090] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:31:47 2022] POST /identity/v3/projects => generated 409 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:47.795133 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554205c-09fa-4b53-a0eb-04685527a943 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:47.795474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34915716-6451-4643-8d81-4ce21e71db6f tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:47.856315 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ed171-60fb-4c81-aff2-7b0820d3a6bc tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d88ae489bee47b199190279dc1744e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e08f02df53774c9a9d096e3cf5fc78e5', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1753590089', 'tempest-NotDelegatedRole-399878472'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:47.857250 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ed171-60fb-4c81-aff2-7b0820d3a6bc tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:47.857613 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ed171-60fb-4c81-aff2-7b0820d3a6bc tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:47.857989 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ed171-60fb-4c81-aff2-7b0820d3a6bc tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] PATH_INFO: `/v3/OS-TRUST/trusts/4eee8d58d2f34779aee54949f41ba0c2` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:47.864844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ed171-60fb-4c81-aff2-7b0820d3a6bc tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] RBAC: Authorizing `identity:delete_trust(trust_id=4eee8d58d2f34779aee54949f41ba0c2)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:47.868408 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ed171-60fb-4c81-aff2-7b0820d3a6bc tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:47.962766 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554205c-09fa-4b53-a0eb-04685527a943 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:47.975027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-356ed171-60fb-4c81-aff2-7b0820d3a6bc tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '4eee8d58d2f34779aee54949f41ba0c2', 'request_id': 'req-356ed171-60fb-4c81-aff2-7b0820d3a6bc'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:47.975629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-356ed171-60fb-4c81-aff2-7b0820d3a6bc tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '4eee8d58d2f34779aee54949f41ba0c2', 'request_id': 'req-356ed171-60fb-4c81-aff2-7b0820d3a6bc'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:47.983615 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c358e3-9730-47a1-ad8a-e43ee5ecc3a6 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:47.988142 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c358e3-9730-47a1-ad8a-e43ee5ecc3a6 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:47.988142 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c358e3-9730-47a1-ad8a-e43ee5ecc3a6 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:47.988142 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c358e3-9730-47a1-ad8a-e43ee5ecc3a6 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/38c92b31618b42dfbc3260610be4eba2/users/77bbff5f394145dbafc1429fb9da2a5d/roles/345c29bad152442db064ca75af7b160d/inherited_to_projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:47.992900 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c358e3-9730-47a1-ad8a-e43ee5ecc3a6 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:create_grant(project_id=38c92b31618b42dfbc3260610be4eba2, user_id=77bbff5f394145dbafc1429fb9da2a5d, role_id=345c29bad152442db064ca75af7b160d)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:48.003094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c358e3-9730-47a1-ad8a-e43ee5ecc3a6 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:48.064474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-356ed171-60fb-4c81-aff2-7b0820d3a6bc tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '4eee8d58d2f34779aee54949f41ba0c2', 'request_id': 'req-356ed171-60fb-4c81-aff2-7b0820d3a6bc'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:48.073637 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3061/6091] 10.222.0.23 () {58 vars in 1253 bytes} [Sat Apr 30 21:31:47 2022] DELETE /identity/v3/OS-TRUST/trusts/4eee8d58d2f34779aee54949f41ba0c2 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:31:48.078610 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ed171-60fb-4c81-aff2-7b0820d3a6bc tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:48.081102 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-356ed171-60fb-4c81-aff2-7b0820d3a6bc tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:48.106261 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3031/6092] 10.222.0.23 () {60 vars in 1581 bytes} [Sat Apr 30 21:31:47 2022] PUT /identity/v3/OS-INHERIT/projects/38c92b31618b42dfbc3260610be4eba2/users/77bbff5f394145dbafc1429fb9da2a5d/roles/345c29bad152442db064ca75af7b160d/inherited_to_projects => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:48.106261 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c358e3-9730-47a1-ad8a-e43ee5ecc3a6 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:48.106467 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ed171-60fb-4c81-aff2-7b0820d3a6bc tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:48.109723 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-16c358e3-9730-47a1-ad8a-e43ee5ecc3a6 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:48.239532 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad0c64-4297-460f-ae90-7d0e1923b5b0 tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d88ae489bee47b199190279dc1744e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e08f02df53774c9a9d096e3cf5fc78e5', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1753590089', 'tempest-NotDelegatedRole-399878472'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:48.240361 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad0c64-4297-460f-ae90-7d0e1923b5b0 tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:48.240981 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad0c64-4297-460f-ae90-7d0e1923b5b0 tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:48.241270 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad0c64-4297-460f-ae90-7d0e1923b5b0 tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] PATH_INFO: `/v3/OS-TRUST/trusts/4eee8d58d2f34779aee54949f41ba0c2` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:48.269991 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-57ad0c64-4297-460f-ae90-7d0e1923b5b0 tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] Could not find trust: 4eee8d58d2f34779aee54949f41ba0c2.: keystone.exception.TrustNotFound: Could not find trust: 4eee8d58d2f34779aee54949f41ba0c2. Apr 30 21:31:48.269991 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:31:48.269991 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:31:48.269991 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:31:48.269991 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:31:48.269991 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:31:48.269991 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:31:48.269991 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:31:48.269991 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:31:48.269991 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:31:48.269991 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:31:48.269991 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:31:48.269991 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Apr 30 21:31:48.269991 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Apr 30 21:31:48.269991 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Apr 30 21:31:48.271442 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Apr 30 21:31:48.271442 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Apr 30 21:31:48.271442 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Apr 30 21:31:48.271442 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Apr 30 21:31:48.271442 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Apr 30 21:31:48.271442 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:31:48.271442 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:31:48.271442 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Apr 30 21:31:48.271442 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Apr 30 21:31:48.271442 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Apr 30 21:31:48.271442 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Apr 30 21:31:48.271442 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 4eee8d58d2f34779aee54949f41ba0c2. Apr 30 21:31:48.271442 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:31:48.271442 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3062/6093] 10.222.0.23 () {58 vars in 1250 bytes} [Sat Apr 30 21:31:48 2022] GET /identity/v3/OS-TRUST/trusts/4eee8d58d2f34779aee54949f41ba0c2 => generated 111 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Apr 30 21:31:48.272409 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad0c64-4297-460f-ae90-7d0e1923b5b0 tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:48.273593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-57ad0c64-4297-460f-ae90-7d0e1923b5b0 tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:48.296442 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c358e3-9730-47a1-ad8a-e43ee5ecc3a6 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:48.306132 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e215e1-30a1-4d8f-a4f2-447d7b7b1c0a tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:48.306814 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e215e1-30a1-4d8f-a4f2-447d7b7b1c0a tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:48.307097 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e215e1-30a1-4d8f-a4f2-447d7b7b1c0a tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:48.307369 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e215e1-30a1-4d8f-a4f2-447d7b7b1c0a tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:48.308625 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e215e1-30a1-4d8f-a4f2-447d7b7b1c0a tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Adding query filter params (scope.project.id=0575af0e583748a5914cfb1c52449860, user.id=77bbff5f394145dbafc1429fb9da2a5d) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:31:48.308948 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e215e1-30a1-4d8f-a4f2-447d7b7b1c0a tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:48.310880 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e215e1-30a1-4d8f-a4f2-447d7b7b1c0a tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:48.373801 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad0c64-4297-460f-ae90-7d0e1923b5b0 tempest-TrustsV3TestJSON-1017301014 tempest-user-488467894] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:48.382270 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e737459-5c9d-4038-b51d-941020256ca8 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:48.383764 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e737459-5c9d-4038-b51d-941020256ca8 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:48.384158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e737459-5c9d-4038-b51d-941020256ca8 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:48.384672 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e737459-5c9d-4038-b51d-941020256ca8 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/roles/bde9f0d153a84a3faf0d0782f9ea29ad` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:48.386436 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e737459-5c9d-4038-b51d-941020256ca8 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:delete_role(role_id=bde9f0d153a84a3faf0d0782f9ea29ad)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:48.388369 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e737459-5c9d-4038-b51d-941020256ca8 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:48.438505 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3032/6094] 10.222.0.23 () {58 vars in 1355 bytes} [Sat Apr 30 21:31:48 2022] GET /identity/v3/role_assignments?scope.project.id=0575af0e583748a5914cfb1c52449860&user.id=77bbff5f394145dbafc1429fb9da2a5d&effective => generated 649 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:31:48.439540 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e215e1-30a1-4d8f-a4f2-447d7b7b1c0a tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:48.445656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c2e215e1-30a1-4d8f-a4f2-447d7b7b1c0a tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:48.568929 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e215e1-30a1-4d8f-a4f2-447d7b7b1c0a tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:48.586568 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7ada4-ee36-4794-8ee7-041fb6ff2a25 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e302b1298dd04d6590e3d079f7b13b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:48.586568 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7ada4-ee36-4794-8ee7-041fb6ff2a25 service glance] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:48.586568 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7ada4-ee36-4794-8ee7-041fb6ff2a25 service glance] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:48.586568 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7ada4-ee36-4794-8ee7-041fb6ff2a25 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:48.586889 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f6b7ada4-ee36-4794-8ee7-041fb6ff2a25 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:48.612471 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9e737459-5c9d-4038-b51d-941020256ca8 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invalidating the token cache because role bde9f0d153a84a3faf0d0782f9ea29ad has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:48.613084 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9e737459-5c9d-4038-b51d-941020256ca8 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:48.613459 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9e737459-5c9d-4038-b51d-941020256ca8 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:48.616184 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3063/6095] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:31:48 2022] DELETE /identity/v3/roles/bde9f0d153a84a3faf0d0782f9ea29ad => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:31:48.617015 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e737459-5c9d-4038-b51d-941020256ca8 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:48.619075 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9e737459-5c9d-4038-b51d-941020256ca8 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:48.696694 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7ada4-ee36-4794-8ee7-041fb6ff2a25 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:48.698288 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7ada4-ee36-4794-8ee7-041fb6ff2a25 service glance] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:48.710146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e737459-5c9d-4038-b51d-941020256ca8 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:48.720327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576add31-12a0-4a17-9fef-217852390b4e tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:48.721541 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576add31-12a0-4a17-9fef-217852390b4e tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:48.721961 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576add31-12a0-4a17-9fef-217852390b4e tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:48.723220 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576add31-12a0-4a17-9fef-217852390b4e tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/38c92b31618b42dfbc3260610be4eba2/users/77bbff5f394145dbafc1429fb9da2a5d/roles/345c29bad152442db064ca75af7b160d/inherited_to_projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:48.726767 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576add31-12a0-4a17-9fef-217852390b4e tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=38c92b31618b42dfbc3260610be4eba2, user_id=77bbff5f394145dbafc1429fb9da2a5d, role_id=345c29bad152442db064ca75af7b160d)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:48.730834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576add31-12a0-4a17-9fef-217852390b4e tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:48.735599 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3033/6096] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:31:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:31:48.741715 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-576add31-12a0-4a17-9fef-217852390b4e tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invalidating the token cache because role 345c29bad152442db064ca75af7b160d was removed from user 77bbff5f394145dbafc1429fb9da2a5d on project 38c92b31618b42dfbc3260610be4eba2. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:48.742160 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-576add31-12a0-4a17-9fef-217852390b4e tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:48.744616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-576add31-12a0-4a17-9fef-217852390b4e tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:48.749633 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7ada4-ee36-4794-8ee7-041fb6ff2a25 service glance] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:48.767050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7ada4-ee36-4794-8ee7-041fb6ff2a25 service glance] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:48.839166 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5033e-6ba9-462e-8fdd-8c602d1770b1 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:48.840170 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5033e-6ba9-462e-8fdd-8c602d1770b1 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:48.840563 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5033e-6ba9-462e-8fdd-8c602d1770b1 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:48.840974 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5033e-6ba9-462e-8fdd-8c602d1770b1 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/roles/2949386770dc485e9f5d43609264d368` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:48.850035 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3064/6097] 10.222.0.23 () {58 vars in 1565 bytes} [Sat Apr 30 21:31:48 2022] DELETE /identity/v3/OS-INHERIT/projects/38c92b31618b42dfbc3260610be4eba2/users/77bbff5f394145dbafc1429fb9da2a5d/roles/345c29bad152442db064ca75af7b160d/inherited_to_projects => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:48.852300 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5033e-6ba9-462e-8fdd-8c602d1770b1 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2949386770dc485e9f5d43609264d368)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:48.854221 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576add31-12a0-4a17-9fef-217852390b4e tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:48.856490 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-576add31-12a0-4a17-9fef-217852390b4e tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:48.861792 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5033e-6ba9-462e-8fdd-8c602d1770b1 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:48.965290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576add31-12a0-4a17-9fef-217852390b4e tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:48.981131 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077bc1f5-26e5-4b9f-a8dc-499fc8f1b98f tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:48.983161 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bc1f5-26e5-4b9f-a8dc-499fc8f1b98f tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:48.983611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bc1f5-26e5-4b9f-a8dc-499fc8f1b98f tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:48.984042 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bc1f5-26e5-4b9f-a8dc-499fc8f1b98f tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:48.985523 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077bc1f5-26e5-4b9f-a8dc-499fc8f1b98f tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Adding query filter params (scope.project.id=0575af0e583748a5914cfb1c52449860, user.id=77bbff5f394145dbafc1429fb9da2a5d) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:31:48.986044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077bc1f5-26e5-4b9f-a8dc-499fc8f1b98f tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:48.988213 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077bc1f5-26e5-4b9f-a8dc-499fc8f1b98f tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:49.064777 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3065/6098] 10.222.0.23 () {58 vars in 1355 bytes} [Sat Apr 30 21:31:48 2022] GET /identity/v3/role_assignments?scope.project.id=0575af0e583748a5914cfb1c52449860&user.id=77bbff5f394145dbafc1429fb9da2a5d&effective => generated 228 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:31:49.065584 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077bc1f5-26e5-4b9f-a8dc-499fc8f1b98f tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:49.067410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-077bc1f5-26e5-4b9f-a8dc-499fc8f1b98f tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:49.123370 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5ed5033e-6ba9-462e-8fdd-8c602d1770b1 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invalidating the token cache because role 2949386770dc485e9f5d43609264d368 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:49.124597 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5ed5033e-6ba9-462e-8fdd-8c602d1770b1 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:49.125880 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5ed5033e-6ba9-462e-8fdd-8c602d1770b1 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:49.130101 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3034/6099] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:31:48 2022] DELETE /identity/v3/roles/2949386770dc485e9f5d43609264d368 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:49.131201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5033e-6ba9-462e-8fdd-8c602d1770b1 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:49.137692 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5ed5033e-6ba9-462e-8fdd-8c602d1770b1 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:49.192973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077bc1f5-26e5-4b9f-a8dc-499fc8f1b98f tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:49.285171 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fdac5c-f9c8-4fbf-970b-6a55b93a7669 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:49.285872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fdac5c-f9c8-4fbf-970b-6a55b93a7669 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:49.286257 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fdac5c-f9c8-4fbf-970b-6a55b93a7669 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:49.286493 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fdac5c-f9c8-4fbf-970b-6a55b93a7669 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:49.289679 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-67fdac5c-f9c8-4fbf-970b-6a55b93a7669 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:49.301517 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5033e-6ba9-462e-8fdd-8c602d1770b1 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:49.305110 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fdac5c-f9c8-4fbf-970b-6a55b93a7669 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:49.308087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fdac5c-f9c8-4fbf-970b-6a55b93a7669 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:49.313112 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbd2cb-adec-44c9-b15c-bc9e1d9a8b52 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:49.314983 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbd2cb-adec-44c9-b15c-bc9e1d9a8b52 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:49.314983 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbd2cb-adec-44c9-b15c-bc9e1d9a8b52 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:49.314983 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbd2cb-adec-44c9-b15c-bc9e1d9a8b52 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/projects/0575af0e583748a5914cfb1c52449860` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:49.321116 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3066/6100] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:31:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:31:49.323005 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fdac5c-f9c8-4fbf-970b-6a55b93a7669 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:49.323186 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbd2cb-adec-44c9-b15c-bc9e1d9a8b52 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0575af0e583748a5914cfb1c52449860)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:49.324791 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-67fdac5c-f9c8-4fbf-970b-6a55b93a7669 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:49.325062 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbd2cb-adec-44c9-b15c-bc9e1d9a8b52 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:49.462256 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fdac5c-f9c8-4fbf-970b-6a55b93a7669 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:49.515339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4adbd2cb-adec-44c9-b15c-bc9e1d9a8b52 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0575af0e583748a5914cfb1c52449860', 'request_id': 'req-4adbd2cb-adec-44c9-b15c-bc9e1d9a8b52'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:49.525820 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4adbd2cb-adec-44c9-b15c-bc9e1d9a8b52 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0575af0e583748a5914cfb1c52449860', 'request_id': 'req-4adbd2cb-adec-44c9-b15c-bc9e1d9a8b52'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:49.535141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4adbd2cb-adec-44c9-b15c-bc9e1d9a8b52 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0575af0e583748a5914cfb1c52449860', 'request_id': 'req-4adbd2cb-adec-44c9-b15c-bc9e1d9a8b52'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:49.552586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ad05c-45fb-484b-967d-45ad22ac8555 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:49.553422 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ad05c-45fb-484b-967d-45ad22ac8555 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:49.553705 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ad05c-45fb-484b-967d-45ad22ac8555 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:49.554058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ad05c-45fb-484b-967d-45ad22ac8555 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/users/1d88ae489bee47b199190279dc1744e9` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:49.555446 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ad05c-45fb-484b-967d-45ad22ac8555 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1d88ae489bee47b199190279dc1744e9)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:49.557551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ad05c-45fb-484b-967d-45ad22ac8555 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:49.614410 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4adbd2cb-adec-44c9-b15c-bc9e1d9a8b52 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] The token cache is being invalidate because project 0575af0e583748a5914cfb1c52449860 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:49.620669 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4adbd2cb-adec-44c9-b15c-bc9e1d9a8b52 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:49.620669 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4adbd2cb-adec-44c9-b15c-bc9e1d9a8b52 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:49.620669 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3035/6101] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:31:49 2022] DELETE /identity/v3/projects/0575af0e583748a5914cfb1c52449860 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:49.620669 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbd2cb-adec-44c9-b15c-bc9e1d9a8b52 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:49.621153 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4adbd2cb-adec-44c9-b15c-bc9e1d9a8b52 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:49.698012 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0f9ad05c-45fb-484b-967d-45ad22ac8555 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d88ae489bee47b199190279dc1744e9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:49.702676 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbd2cb-adec-44c9-b15c-bc9e1d9a8b52 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:49.713680 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cbca9d-1cb9-40d9-a80e-1cf2cb2ce1a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:49.714393 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbca9d-1cb9-40d9-a80e-1cf2cb2ce1a8 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:49.714920 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbca9d-1cb9-40d9-a80e-1cf2cb2ce1a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:49.715271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbca9d-1cb9-40d9-a80e-1cf2cb2ce1a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:49.719488 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-60cbca9d-1cb9-40d9-a80e-1cf2cb2ce1a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:49.719573 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0f9ad05c-45fb-484b-967d-45ad22ac8555 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d88ae489bee47b199190279dc1744e9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:49.810976 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0f9ad05c-45fb-484b-967d-45ad22ac8555 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d88ae489bee47b199190279dc1744e9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:49.823789 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0f9ad05c-45fb-484b-967d-45ad22ac8555 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d88ae489bee47b199190279dc1744e9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:49.824791 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0f9ad05c-45fb-484b-967d-45ad22ac8555 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d88ae489bee47b199190279dc1744e9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:49.842195 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3067/6102] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:31:49 2022] DELETE /identity/v3/users/1d88ae489bee47b199190279dc1744e9 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:49.844428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ad05c-45fb-484b-967d-45ad22ac8555 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:49.844606 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cbca9d-1cb9-40d9-a80e-1cf2cb2ce1a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:49.847249 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cbca9d-1cb9-40d9-a80e-1cf2cb2ce1a8 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:49.858269 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0f9ad05c-45fb-484b-967d-45ad22ac8555 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:49.871423 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3036/6103] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:31:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:31:49.872904 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cbca9d-1cb9-40d9-a80e-1cf2cb2ce1a8 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:49.876662 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-60cbca9d-1cb9-40d9-a80e-1cf2cb2ce1a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:49.901778 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cbca9d-1cb9-40d9-a80e-1cf2cb2ce1a8 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:49.959872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ad05c-45fb-484b-967d-45ad22ac8555 tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:49.967355 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ccb6b-5c91-450d-a20b-6e2b29d80b83 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:49.968343 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ccb6b-5c91-450d-a20b-6e2b29d80b83 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:49.969268 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ccb6b-5c91-450d-a20b-6e2b29d80b83 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:49.969600 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ccb6b-5c91-450d-a20b-6e2b29d80b83 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/roles/345c29bad152442db064ca75af7b160d` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:49.971848 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ccb6b-5c91-450d-a20b-6e2b29d80b83 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:delete_role(role_id=345c29bad152442db064ca75af7b160d)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:49.973551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ccb6b-5c91-450d-a20b-6e2b29d80b83 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:50.006024 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d90bef3-f388-4fb7-88d7-af40fe9a31ea tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2db8b2c157c9444cb813546aeda84c86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0eadb2408e3432197d962381545e5c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:50.008799 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90bef3-f388-4fb7-88d7-af40fe9a31ea tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:50.009115 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90bef3-f388-4fb7-88d7-af40fe9a31ea tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:50.009400 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d90bef3-f388-4fb7-88d7-af40fe9a31ea tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] PATH_INFO: `/v3/projects/e08f02df53774c9a9d096e3cf5fc78e5` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:50.011798 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90bef3-f388-4fb7-88d7-af40fe9a31ea tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e08f02df53774c9a9d096e3cf5fc78e5)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:50.013829 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d90bef3-f388-4fb7-88d7-af40fe9a31ea tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:50.094799 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-063ccb6b-5c91-450d-a20b-6e2b29d80b83 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invalidating the token cache because role 345c29bad152442db064ca75af7b160d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:50.095092 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-063ccb6b-5c91-450d-a20b-6e2b29d80b83 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:50.104448 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-063ccb6b-5c91-450d-a20b-6e2b29d80b83 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:50.104448 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3068/6104] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:31:49 2022] DELETE /identity/v3/roles/345c29bad152442db064ca75af7b160d => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:50.104448 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ccb6b-5c91-450d-a20b-6e2b29d80b83 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:50.105586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-063ccb6b-5c91-450d-a20b-6e2b29d80b83 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:50.223857 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ccb6b-5c91-450d-a20b-6e2b29d80b83 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:50.347517 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3d90bef3-f388-4fb7-88d7-af40fe9a31ea tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e08f02df53774c9a9d096e3cf5fc78e5', 'request_id': 'req-3d90bef3-f388-4fb7-88d7-af40fe9a31ea'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:50.360543 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3d90bef3-f388-4fb7-88d7-af40fe9a31ea tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e08f02df53774c9a9d096e3cf5fc78e5', 'request_id': 'req-3d90bef3-f388-4fb7-88d7-af40fe9a31ea'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:50.362514 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d01a6-df3f-4186-8d81-cce92d7b0fcd tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:50.363720 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d01a6-df3f-4186-8d81-cce92d7b0fcd tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:50.366522 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d01a6-df3f-4186-8d81-cce92d7b0fcd tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:50.366841 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d01a6-df3f-4186-8d81-cce92d7b0fcd tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/users/77bbff5f394145dbafc1429fb9da2a5d` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:50.369616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d01a6-df3f-4186-8d81-cce92d7b0fcd tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:delete_user(user_id=77bbff5f394145dbafc1429fb9da2a5d)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:50.372867 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d01a6-df3f-4186-8d81-cce92d7b0fcd tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:50.374422 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3d90bef3-f388-4fb7-88d7-af40fe9a31ea tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e08f02df53774c9a9d096e3cf5fc78e5', 'request_id': 'req-3d90bef3-f388-4fb7-88d7-af40fe9a31ea'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:50.476013 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3d90bef3-f388-4fb7-88d7-af40fe9a31ea tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] The token cache is being invalidate because project e08f02df53774c9a9d096e3cf5fc78e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:50.482119 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3d90bef3-f388-4fb7-88d7-af40fe9a31ea tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:50.482119 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3d90bef3-f388-4fb7-88d7-af40fe9a31ea tempest-TrustsV3TestJSON-1986458556 tempest-TrustsV3TestJSON-1986458556-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:50.484275 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3037/6105] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:31:49 2022] DELETE /identity/v3/projects/e08f02df53774c9a9d096e3cf5fc78e5 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:50.486452 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d6e72-f11a-4982-89ec-df0c4dd73244 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:50.486912 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d6e72-f11a-4982-89ec-df0c4dd73244 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:50.487488 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d6e72-f11a-4982-89ec-df0c4dd73244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:50.527789 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e52d01a6-df3f-4186-8d81-cce92d7b0fcd tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77bbff5f394145dbafc1429fb9da2a5d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:50.535157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-e04d6e72-f11a-4982-89ec-df0c4dd73244 None None] MFA Rules not processed for user `5036e109752841e890d804f5e96d04cb`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:50.536477 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e04d6e72-f11a-4982-89ec-df0c4dd73244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:50.545086 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e52d01a6-df3f-4186-8d81-cce92d7b0fcd tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77bbff5f394145dbafc1429fb9da2a5d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:50.627909 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e52d01a6-df3f-4186-8d81-cce92d7b0fcd tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77bbff5f394145dbafc1429fb9da2a5d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:50.635254 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e52d01a6-df3f-4186-8d81-cce92d7b0fcd tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77bbff5f394145dbafc1429fb9da2a5d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:50.636618 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e52d01a6-df3f-4186-8d81-cce92d7b0fcd tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77bbff5f394145dbafc1429fb9da2a5d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:50.647798 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3069/6106] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:31:50 2022] DELETE /identity/v3/users/77bbff5f394145dbafc1429fb9da2a5d => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:31:50.648964 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d01a6-df3f-4186-8d81-cce92d7b0fcd tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:50.650247 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3038/6107] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:50.651497 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04d6e72-f11a-4982-89ec-df0c4dd73244 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:50.653907 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e04d6e72-f11a-4982-89ec-df0c4dd73244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:50.662771 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e52d01a6-df3f-4186-8d81-cce92d7b0fcd tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:50.675110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04d6e72-f11a-4982-89ec-df0c4dd73244 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:50.764149 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d01a6-df3f-4186-8d81-cce92d7b0fcd tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:50.769288 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c97ced-11bd-411f-bb5e-137b7af705ea tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:50.770178 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1ee82-e956-4c77-a2ef-7351f419b785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:50.770470 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c97ced-11bd-411f-bb5e-137b7af705ea tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:50.770861 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c97ced-11bd-411f-bb5e-137b7af705ea tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:50.771262 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c97ced-11bd-411f-bb5e-137b7af705ea tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/groups/edb6c931de744ca68ac08dc0694fbe5c` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:50.771928 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1ee82-e956-4c77-a2ef-7351f419b785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:50.772355 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1ee82-e956-4c77-a2ef-7351f419b785 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:50.772906 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1ee82-e956-4c77-a2ef-7351f419b785 admin admin] PATH_INFO: `/v3/users/3d795d130fbb4d85ae7b14367ba922a6` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:50.773614 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c97ced-11bd-411f-bb5e-137b7af705ea tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:delete_group(group_id=edb6c931de744ca68ac08dc0694fbe5c)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:50.774657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1ee82-e956-4c77-a2ef-7351f419b785 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d795d130fbb4d85ae7b14367ba922a6)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:50.776963 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c97ced-11bd-411f-bb5e-137b7af705ea tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:50.778032 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1ee82-e956-4c77-a2ef-7351f419b785 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:50.949828 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3039/6108] 10.222.0.23 () {58 vars in 1226 bytes} [Sat Apr 30 21:31:50 2022] DELETE /identity/v3/groups/edb6c931de744ca68ac08dc0694fbe5c => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:50.954775 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c97ced-11bd-411f-bb5e-137b7af705ea tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:50.954775 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-99c97ced-11bd-411f-bb5e-137b7af705ea tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:51.001593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f1c1ee82-e956-4c77-a2ef-7351f419b785 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d795d130fbb4d85ae7b14367ba922a6'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:51.041263 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f1c1ee82-e956-4c77-a2ef-7351f419b785 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d795d130fbb4d85ae7b14367ba922a6'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:51.115219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c97ced-11bd-411f-bb5e-137b7af705ea tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:51.120308 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f1c1ee82-e956-4c77-a2ef-7351f419b785 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d795d130fbb4d85ae7b14367ba922a6'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:51.131664 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0792e4-4392-4885-aac0-5657fc16a093 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:51.132494 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0792e4-4392-4885-aac0-5657fc16a093 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:51.132886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0792e4-4392-4885-aac0-5657fc16a093 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:51.133318 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0792e4-4392-4885-aac0-5657fc16a093 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:51.136420 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-9f0792e4-4392-4885-aac0-5657fc16a093 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:51.136868 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f1c1ee82-e956-4c77-a2ef-7351f419b785 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d795d130fbb4d85ae7b14367ba922a6'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:51.139299 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f1c1ee82-e956-4c77-a2ef-7351f419b785 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d795d130fbb4d85ae7b14367ba922a6'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:51.164643 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3070/6109] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:31:50 2022] DELETE /identity/v3/users/3d795d130fbb4d85ae7b14367ba922a6 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:51.164643 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1ee82-e956-4c77-a2ef-7351f419b785 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:51.171476 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f1c1ee82-e956-4c77-a2ef-7351f419b785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:51.287359 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1ee82-e956-4c77-a2ef-7351f419b785 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:51.305386 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4ff3d-b993-466f-b198-b9e300dc35de tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:51.306416 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4ff3d-b993-466f-b198-b9e300dc35de tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:51.306761 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4ff3d-b993-466f-b198-b9e300dc35de tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:51.311642 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4ff3d-b993-466f-b198-b9e300dc35de tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/projects/38c92b31618b42dfbc3260610be4eba2` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:51.311785 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0792e4-4392-4885-aac0-5657fc16a093 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:51.312730 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4ff3d-b993-466f-b198-b9e300dc35de tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:delete_project(project_id=38c92b31618b42dfbc3260610be4eba2)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:51.314042 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0792e4-4392-4885-aac0-5657fc16a093 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:51.314952 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4ff3d-b993-466f-b198-b9e300dc35de tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:51.328398 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3040/6110] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:31:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:31:51.345973 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9ac7d-1304-41c1-bc21-65b3790ff52f None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:51.346483 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9ac7d-1304-41c1-bc21-65b3790ff52f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:51.346987 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9ac7d-1304-41c1-bc21-65b3790ff52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:51.404924 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-67e9ac7d-1304-41c1-bc21-65b3790ff52f None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:51.407100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-67e9ac7d-1304-41c1-bc21-65b3790ff52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:51.478971 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-89f4ff3d-b993-466f-b198-b9e300dc35de tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38c92b31618b42dfbc3260610be4eba2', 'request_id': 'req-89f4ff3d-b993-466f-b198-b9e300dc35de'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:51.493990 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-89f4ff3d-b993-466f-b198-b9e300dc35de tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38c92b31618b42dfbc3260610be4eba2', 'request_id': 'req-89f4ff3d-b993-466f-b198-b9e300dc35de'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:51.497177 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3041/6111] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:51.503990 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-89f4ff3d-b993-466f-b198-b9e300dc35de tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38c92b31618b42dfbc3260610be4eba2', 'request_id': 'req-89f4ff3d-b993-466f-b198-b9e300dc35de'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:51.511068 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9ac7d-1304-41c1-bc21-65b3790ff52f None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:51.513448 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-67e9ac7d-1304-41c1-bc21-65b3790ff52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:51.586122 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-89f4ff3d-b993-466f-b198-b9e300dc35de tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] The token cache is being invalidate because project 38c92b31618b42dfbc3260610be4eba2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:51.586415 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-89f4ff3d-b993-466f-b198-b9e300dc35de tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:51.587739 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-89f4ff3d-b993-466f-b198-b9e300dc35de tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:51.591497 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3071/6112] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:31:51 2022] DELETE /identity/v3/projects/38c92b31618b42dfbc3260610be4eba2 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:51.596864 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4ff3d-b993-466f-b198-b9e300dc35de tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:51.599934 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-89f4ff3d-b993-466f-b198-b9e300dc35de tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:51.622579 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9ac7d-1304-41c1-bc21-65b3790ff52f None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:51.684043 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5d014-9ad1-4b7f-b13d-f445e0447dfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:51.684770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5d014-9ad1-4b7f-b13d-f445e0447dfe service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:51.685062 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5d014-9ad1-4b7f-b13d-f445e0447dfe service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:51.685340 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5d014-9ad1-4b7f-b13d-f445e0447dfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:51.688282 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-bdd5d014-9ad1-4b7f-b13d-f445e0447dfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:51.743512 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4ff3d-b993-466f-b198-b9e300dc35de tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:51.760588 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f71f1-88e9-4a57-9a8d-cbd72b033c0b tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:51.761451 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f71f1-88e9-4a57-9a8d-cbd72b033c0b tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:51.761866 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f71f1-88e9-4a57-9a8d-cbd72b033c0b tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:51.762116 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f71f1-88e9-4a57-9a8d-cbd72b033c0b tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/domains/fc673e25728f463f8016d6d8ddfaa2ec` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:51.764385 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f71f1-88e9-4a57-9a8d-cbd72b033c0b tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=fc673e25728f463f8016d6d8ddfaa2ec)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:51.766103 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f71f1-88e9-4a57-9a8d-cbd72b033c0b tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:51.807117 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd5d014-9ad1-4b7f-b13d-f445e0447dfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:51.808617 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd5d014-9ad1-4b7f-b13d-f445e0447dfe service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:51.813213 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4c2f71f1-88e9-4a57-9a8d-cbd72b033c0b tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'fc673e25728f463f8016d6d8ddfaa2ec'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:51.815056 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4c2f71f1-88e9-4a57-9a8d-cbd72b033c0b tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'fc673e25728f463f8016d6d8ddfaa2ec'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:51.832044 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3042/6113] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:31:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:31:51.913850 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4c2f71f1-88e9-4a57-9a8d-cbd72b033c0b tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'fc673e25728f463f8016d6d8ddfaa2ec'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:51.918577 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4c2f71f1-88e9-4a57-9a8d-cbd72b033c0b tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'fc673e25728f463f8016d6d8ddfaa2ec'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:51.931975 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3072/6114] 10.222.0.23 () {60 vars in 1248 bytes} [Sat Apr 30 21:31:51 2022] PATCH /identity/v3/domains/fc673e25728f463f8016d6d8ddfaa2ec => generated 277 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:31:51.932080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5d014-9ad1-4b7f-b13d-f445e0447dfe service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:51.944430 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5d014-9ad1-4b7f-b13d-f445e0447dfe service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:52.106994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c6a84-ecd6-4288-a451-7a8d22f1ab99 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c02a6c45cb74d05b2ca67caf4b56683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1239213ab65408db7b6faeadf44a331', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:52.108192 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c6a84-ecd6-4288-a451-7a8d22f1ab99 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:52.108686 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c6a84-ecd6-4288-a451-7a8d22f1ab99 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:52.109180 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c6a84-ecd6-4288-a451-7a8d22f1ab99 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] PATH_INFO: `/v3/domains/fc673e25728f463f8016d6d8ddfaa2ec` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:52.123997 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c6a84-ecd6-4288-a451-7a8d22f1ab99 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=fc673e25728f463f8016d6d8ddfaa2ec)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:52.127656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c6a84-ecd6-4288-a451-7a8d22f1ab99 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:52.153718 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c24c6a84-ecd6-4288-a451-7a8d22f1ab99 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'fc673e25728f463f8016d6d8ddfaa2ec'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:52.161040 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c24c6a84-ecd6-4288-a451-7a8d22f1ab99 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'fc673e25728f463f8016d6d8ddfaa2ec'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:52.286217 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c24c6a84-ecd6-4288-a451-7a8d22f1ab99 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc673e25728f463f8016d6d8ddfaa2ec', 'request_id': 'req-c24c6a84-ecd6-4288-a451-7a8d22f1ab99'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:52.294156 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c24c6a84-ecd6-4288-a451-7a8d22f1ab99 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc673e25728f463f8016d6d8ddfaa2ec', 'request_id': 'req-c24c6a84-ecd6-4288-a451-7a8d22f1ab99'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:52.304941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c24c6a84-ecd6-4288-a451-7a8d22f1ab99 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc673e25728f463f8016d6d8ddfaa2ec', 'request_id': 'req-c24c6a84-ecd6-4288-a451-7a8d22f1ab99'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:52.435491 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c24c6a84-ecd6-4288-a451-7a8d22f1ab99 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] The token cache is being invalidate because project fc673e25728f463f8016d6d8ddfaa2ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:52.436268 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c24c6a84-ecd6-4288-a451-7a8d22f1ab99 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:52.436780 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c24c6a84-ecd6-4288-a451-7a8d22f1ab99 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:52.444726 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c24c6a84-ecd6-4288-a451-7a8d22f1ab99 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'fc673e25728f463f8016d6d8ddfaa2ec', 'request_id': 'req-c24c6a84-ecd6-4288-a451-7a8d22f1ab99'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:52.445515 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c24c6a84-ecd6-4288-a451-7a8d22f1ab99 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'fc673e25728f463f8016d6d8ddfaa2ec', 'request_id': 'req-c24c6a84-ecd6-4288-a451-7a8d22f1ab99'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:52.446256 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c24c6a84-ecd6-4288-a451-7a8d22f1ab99 tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'fc673e25728f463f8016d6d8ddfaa2ec', 'request_id': 'req-c24c6a84-ecd6-4288-a451-7a8d22f1ab99'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:52.455418 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3043/6115] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:31:51 2022] DELETE /identity/v3/domains/fc673e25728f463f8016d6d8ddfaa2ec => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:52.459594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f71f1-88e9-4a57-9a8d-cbd72b033c0b tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:52.461048 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4c2f71f1-88e9-4a57-9a8d-cbd72b033c0b tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:52.544675 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f71f1-88e9-4a57-9a8d-cbd72b033c0b tempest-InheritsV3TestJSON-1700149873 tempest-InheritsV3TestJSON-1700149873-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:52.602379 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c4a0c-5163-4e18-8036-0afbdb2c41e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:52.603249 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c4a0c-5163-4e18-8036-0afbdb2c41e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:52.603529 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c4a0c-5163-4e18-8036-0afbdb2c41e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:52.603808 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c4a0c-5163-4e18-8036-0afbdb2c41e4 admin admin] PATH_INFO: `/v3/users/ff193dc7f3e54c5c8cd4335319d247e4` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:52.605007 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c4a0c-5163-4e18-8036-0afbdb2c41e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff193dc7f3e54c5c8cd4335319d247e4)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:52.607099 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c4a0c-5163-4e18-8036-0afbdb2c41e4 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:52.850913 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cc0c4a0c-5163-4e18-8036-0afbdb2c41e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff193dc7f3e54c5c8cd4335319d247e4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:52.862896 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cc0c4a0c-5163-4e18-8036-0afbdb2c41e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff193dc7f3e54c5c8cd4335319d247e4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:52.952584 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cc0c4a0c-5163-4e18-8036-0afbdb2c41e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff193dc7f3e54c5c8cd4335319d247e4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:52.964370 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cc0c4a0c-5163-4e18-8036-0afbdb2c41e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff193dc7f3e54c5c8cd4335319d247e4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:52.965034 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cc0c4a0c-5163-4e18-8036-0afbdb2c41e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff193dc7f3e54c5c8cd4335319d247e4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:52.974384 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3073/6116] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:31:52 2022] DELETE /identity/v3/users/ff193dc7f3e54c5c8cd4335319d247e4 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:52.976789 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3173e-5cab-4bc4-9752-5457f45f6e43 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:52.977159 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3173e-5cab-4bc4-9752-5457f45f6e43 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:52.977502 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3173e-5cab-4bc4-9752-5457f45f6e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:53.001357 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-0ad3173e-5cab-4bc4-9752-5457f45f6e43 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:53.002341 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0ad3173e-5cab-4bc4-9752-5457f45f6e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:53.147591 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3044/6117] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:53.159939 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c4a0c-5163-4e18-8036-0afbdb2c41e4 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:53.164716 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-cc0c4a0c-5163-4e18-8036-0afbdb2c41e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:53.268374 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c4a0c-5163-4e18-8036-0afbdb2c41e4 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:53.276862 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e763e-8648-452a-8607-a95b50dee5a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:53.277728 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e763e-8648-452a-8607-a95b50dee5a0 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:53.278050 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e763e-8648-452a-8607-a95b50dee5a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:53.278334 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e763e-8648-452a-8607-a95b50dee5a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:53.292733 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e763e-8648-452a-8607-a95b50dee5a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:53.295021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e763e-8648-452a-8607-a95b50dee5a0 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:53.307175 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3074/6118] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:31:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:31:53.473180 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3173e-5cab-4bc4-9752-5457f45f6e43 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:53.474645 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0ad3173e-5cab-4bc4-9752-5457f45f6e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:53.489154 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3173e-5cab-4bc4-9752-5457f45f6e43 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:53.494326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8cfc7-2006-496e-9f96-70a884e1b697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:53.495447 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8cfc7-2006-496e-9f96-70a884e1b697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:53.496090 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8cfc7-2006-496e-9f96-70a884e1b697 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:53.496235 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8cfc7-2006-496e-9f96-70a884e1b697 admin admin] PATH_INFO: `/v3/projects/646fe052aa8d43d5874f7a0e73b589bd` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:53.498140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d8cfc7-2006-496e-9f96-70a884e1b697 admin admin] RBAC: Authorizing `identity:delete_project(project_id=646fe052aa8d43d5874f7a0e73b589bd)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:53.500472 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d8cfc7-2006-496e-9f96-70a884e1b697 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:53.678327 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b8d8cfc7-2006-496e-9f96-70a884e1b697 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '646fe052aa8d43d5874f7a0e73b589bd', 'request_id': 'req-b8d8cfc7-2006-496e-9f96-70a884e1b697'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:53.685566 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b8d8cfc7-2006-496e-9f96-70a884e1b697 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '646fe052aa8d43d5874f7a0e73b589bd', 'request_id': 'req-b8d8cfc7-2006-496e-9f96-70a884e1b697'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:53.693748 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b8d8cfc7-2006-496e-9f96-70a884e1b697 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '646fe052aa8d43d5874f7a0e73b589bd', 'request_id': 'req-b8d8cfc7-2006-496e-9f96-70a884e1b697'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:53.819860 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b8d8cfc7-2006-496e-9f96-70a884e1b697 admin admin] The token cache is being invalidate because project 646fe052aa8d43d5874f7a0e73b589bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:53.820290 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b8d8cfc7-2006-496e-9f96-70a884e1b697 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:53.821048 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b8d8cfc7-2006-496e-9f96-70a884e1b697 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:53.826080 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3045/6119] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:31:53 2022] DELETE /identity/v3/projects/646fe052aa8d43d5874f7a0e73b589bd => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:53.829991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e763e-8648-452a-8607-a95b50dee5a0 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:53.841683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e763e-8648-452a-8607-a95b50dee5a0 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:53.917103 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a717e1-78aa-429b-b7fc-f5c814d65328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:53.918201 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a717e1-78aa-429b-b7fc-f5c814d65328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:53.918586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a717e1-78aa-429b-b7fc-f5c814d65328 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:53.918988 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a717e1-78aa-429b-b7fc-f5c814d65328 admin admin] PATH_INFO: `/v3/users/2db8b2c157c9444cb813546aeda84c86` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:53.922915 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a717e1-78aa-429b-b7fc-f5c814d65328 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2db8b2c157c9444cb813546aeda84c86)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:53.926680 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a717e1-78aa-429b-b7fc-f5c814d65328 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:54.171104 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8cfc7-2006-496e-9f96-70a884e1b697 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:54.173670 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b8d8cfc7-2006-496e-9f96-70a884e1b697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:54.189462 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8cfc7-2006-496e-9f96-70a884e1b697 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:54.195881 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a896d5-b162-4cbe-b452-eae764135452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:54.196680 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a896d5-b162-4cbe-b452-eae764135452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:54.197142 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a896d5-b162-4cbe-b452-eae764135452 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:54.197435 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a896d5-b162-4cbe-b452-eae764135452 admin admin] PATH_INFO: `/v3/projects/40baf40cdec643a8b0c3626bfdc125c6` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:54.202187 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a896d5-b162-4cbe-b452-eae764135452 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40baf40cdec643a8b0c3626bfdc125c6)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:54.205405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a896d5-b162-4cbe-b452-eae764135452 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:54.300918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a7a717e1-78aa-429b-b7fc-f5c814d65328 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2db8b2c157c9444cb813546aeda84c86'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:54.338211 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a7a717e1-78aa-429b-b7fc-f5c814d65328 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2db8b2c157c9444cb813546aeda84c86'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:54.355470 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-32a896d5-b162-4cbe-b452-eae764135452 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40baf40cdec643a8b0c3626bfdc125c6', 'request_id': 'req-32a896d5-b162-4cbe-b452-eae764135452'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:54.371862 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-32a896d5-b162-4cbe-b452-eae764135452 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40baf40cdec643a8b0c3626bfdc125c6', 'request_id': 'req-32a896d5-b162-4cbe-b452-eae764135452'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:54.379016 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-32a896d5-b162-4cbe-b452-eae764135452 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40baf40cdec643a8b0c3626bfdc125c6', 'request_id': 'req-32a896d5-b162-4cbe-b452-eae764135452'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:54.430143 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a7a717e1-78aa-429b-b7fc-f5c814d65328 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2db8b2c157c9444cb813546aeda84c86'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:54.441160 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a7a717e1-78aa-429b-b7fc-f5c814d65328 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2db8b2c157c9444cb813546aeda84c86'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:54.441979 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a7a717e1-78aa-429b-b7fc-f5c814d65328 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2db8b2c157c9444cb813546aeda84c86'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:54.449336 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3075/6120] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:31:53 2022] DELETE /identity/v3/users/2db8b2c157c9444cb813546aeda84c86 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:54.450694 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a717e1-78aa-429b-b7fc-f5c814d65328 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:54.454293 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a7a717e1-78aa-429b-b7fc-f5c814d65328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:54.561885 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-32a896d5-b162-4cbe-b452-eae764135452 admin admin] The token cache is being invalidate because project 40baf40cdec643a8b0c3626bfdc125c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:54.562381 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-32a896d5-b162-4cbe-b452-eae764135452 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:54.565097 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-32a896d5-b162-4cbe-b452-eae764135452 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:54.567329 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3046/6121] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:31:54 2022] DELETE /identity/v3/projects/40baf40cdec643a8b0c3626bfdc125c6 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:31:54.568706 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ceb3fe-9e45-41d4-a34d-b2273dba7d8d None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:54.568999 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ceb3fe-9e45-41d4-a34d-b2273dba7d8d None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:54.569265 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ceb3fe-9e45-41d4-a34d-b2273dba7d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:54.602228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-39ceb3fe-9e45-41d4-a34d-b2273dba7d8d None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:54.603884 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-39ceb3fe-9e45-41d4-a34d-b2273dba7d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:54.632199 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a717e1-78aa-429b-b7fc-f5c814d65328 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:54.643719 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720ae54-30da-4cb6-ab7c-a770a1fbf721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:54.647050 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720ae54-30da-4cb6-ab7c-a770a1fbf721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:54.647050 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720ae54-30da-4cb6-ab7c-a770a1fbf721 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:54.647050 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720ae54-30da-4cb6-ab7c-a770a1fbf721 admin admin] PATH_INFO: `/v3/users/5036e109752841e890d804f5e96d04cb` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:54.647050 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5720ae54-30da-4cb6-ab7c-a770a1fbf721 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5036e109752841e890d804f5e96d04cb)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:54.648481 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5720ae54-30da-4cb6-ab7c-a770a1fbf721 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:54.756644 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3047/6122] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:31:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:54.756644 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ceb3fe-9e45-41d4-a34d-b2273dba7d8d None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:54.756644 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-39ceb3fe-9e45-41d4-a34d-b2273dba7d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:54.784640 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ceb3fe-9e45-41d4-a34d-b2273dba7d8d None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:54.790929 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1c14f-8dbb-4171-b520-a5ff71eeb430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:54.799411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1c14f-8dbb-4171-b520-a5ff71eeb430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:54.799411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1c14f-8dbb-4171-b520-a5ff71eeb430 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:54.799411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1c14f-8dbb-4171-b520-a5ff71eeb430 admin admin] PATH_INFO: `/v3/users/5c02a6c45cb74d05b2ca67caf4b56683` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:54.799411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1c14f-8dbb-4171-b520-a5ff71eeb430 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c02a6c45cb74d05b2ca67caf4b56683)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:54.799411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1c14f-8dbb-4171-b520-a5ff71eeb430 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:54.920733 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5720ae54-30da-4cb6-ab7c-a770a1fbf721 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5036e109752841e890d804f5e96d04cb'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:54.952453 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5720ae54-30da-4cb6-ab7c-a770a1fbf721 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5036e109752841e890d804f5e96d04cb'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:55.041526 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5ec1c14f-8dbb-4171-b520-a5ff71eeb430 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c02a6c45cb74d05b2ca67caf4b56683'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:55.049424 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5720ae54-30da-4cb6-ab7c-a770a1fbf721 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5036e109752841e890d804f5e96d04cb'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:55.060035 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5720ae54-30da-4cb6-ab7c-a770a1fbf721 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5036e109752841e890d804f5e96d04cb'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:55.061402 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5720ae54-30da-4cb6-ab7c-a770a1fbf721 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5036e109752841e890d804f5e96d04cb'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:55.072842 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5ec1c14f-8dbb-4171-b520-a5ff71eeb430 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c02a6c45cb74d05b2ca67caf4b56683'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:55.088155 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3076/6123] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:31:54 2022] DELETE /identity/v3/users/5036e109752841e890d804f5e96d04cb => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:55.089271 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720ae54-30da-4cb6-ab7c-a770a1fbf721 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:55.095237 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5720ae54-30da-4cb6-ab7c-a770a1fbf721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:55.158649 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5ec1c14f-8dbb-4171-b520-a5ff71eeb430 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c02a6c45cb74d05b2ca67caf4b56683'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:55.164139 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5ec1c14f-8dbb-4171-b520-a5ff71eeb430 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c02a6c45cb74d05b2ca67caf4b56683'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:55.171268 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5ec1c14f-8dbb-4171-b520-a5ff71eeb430 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c02a6c45cb74d05b2ca67caf4b56683'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:55.199421 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3048/6124] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:31:54 2022] DELETE /identity/v3/users/5c02a6c45cb74d05b2ca67caf4b56683 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:55.250388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720ae54-30da-4cb6-ab7c-a770a1fbf721 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:55.357687 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4079c0a-5f52-411e-8e5c-10d573735f0a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:55.358412 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4079c0a-5f52-411e-8e5c-10d573735f0a service swift] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:55.358697 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4079c0a-5f52-411e-8e5c-10d573735f0a service swift] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:55.359005 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4079c0a-5f52-411e-8e5c-10d573735f0a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:55.361137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b4079c0a-5f52-411e-8e5c-10d573735f0a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:55.452045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4079c0a-5f52-411e-8e5c-10d573735f0a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:55.455252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4079c0a-5f52-411e-8e5c-10d573735f0a service swift] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:55.488852 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3077/6125] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:31:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:31:55.710622 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1c14f-8dbb-4171-b520-a5ff71eeb430 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:55.713073 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5ec1c14f-8dbb-4171-b520-a5ff71eeb430 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:55.936303 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1c14f-8dbb-4171-b520-a5ff71eeb430 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:55.945515 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d19b0-36c0-4683-ac8f-657e45daaa97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:55.946779 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d19b0-36c0-4683-ac8f-657e45daaa97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:55.947247 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d19b0-36c0-4683-ac8f-657e45daaa97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:55.947690 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d19b0-36c0-4683-ac8f-657e45daaa97 admin admin] PATH_INFO: `/v3/projects/35c149f6d0184da2ad1f324dda8b5d1a` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:55.950745 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d19b0-36c0-4683-ac8f-657e45daaa97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35c149f6d0184da2ad1f324dda8b5d1a)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:55.953741 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d19b0-36c0-4683-ac8f-657e45daaa97 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:56.071556 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4079c0a-5f52-411e-8e5c-10d573735f0a service swift] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:56.073814 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b4079c0a-5f52-411e-8e5c-10d573735f0a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:56.101836 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4079c0a-5f52-411e-8e5c-10d573735f0a service swift] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:56.115249 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455286b6-7f98-4fee-857b-47636b9f8cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:56.117564 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455286b6-7f98-4fee-857b-47636b9f8cae admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:56.120071 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455286b6-7f98-4fee-857b-47636b9f8cae admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:56.120594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455286b6-7f98-4fee-857b-47636b9f8cae admin admin] PATH_INFO: `/v3/projects/b0eadb2408e3432197d962381545e5c6` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:56.123942 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455286b6-7f98-4fee-857b-47636b9f8cae admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0eadb2408e3432197d962381545e5c6)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:56.129397 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455286b6-7f98-4fee-857b-47636b9f8cae admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:56.209399 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f46d19b0-36c0-4683-ac8f-657e45daaa97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35c149f6d0184da2ad1f324dda8b5d1a', 'request_id': 'req-f46d19b0-36c0-4683-ac8f-657e45daaa97'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:56.231893 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f46d19b0-36c0-4683-ac8f-657e45daaa97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35c149f6d0184da2ad1f324dda8b5d1a', 'request_id': 'req-f46d19b0-36c0-4683-ac8f-657e45daaa97'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:56.261838 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f46d19b0-36c0-4683-ac8f-657e45daaa97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35c149f6d0184da2ad1f324dda8b5d1a', 'request_id': 'req-f46d19b0-36c0-4683-ac8f-657e45daaa97'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:56.409661 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-455286b6-7f98-4fee-857b-47636b9f8cae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0eadb2408e3432197d962381545e5c6', 'request_id': 'req-455286b6-7f98-4fee-857b-47636b9f8cae'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:56.423872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-455286b6-7f98-4fee-857b-47636b9f8cae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0eadb2408e3432197d962381545e5c6', 'request_id': 'req-455286b6-7f98-4fee-857b-47636b9f8cae'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:56.434017 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f46d19b0-36c0-4683-ac8f-657e45daaa97 admin admin] The token cache is being invalidate because project 35c149f6d0184da2ad1f324dda8b5d1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:56.434583 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f46d19b0-36c0-4683-ac8f-657e45daaa97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:56.435404 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f46d19b0-36c0-4683-ac8f-657e45daaa97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:56.441076 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3049/6126] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:31:55 2022] DELETE /identity/v3/projects/35c149f6d0184da2ad1f324dda8b5d1a => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:56.442424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d19b0-36c0-4683-ac8f-657e45daaa97 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:56.449262 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f46d19b0-36c0-4683-ac8f-657e45daaa97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:56.451265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-455286b6-7f98-4fee-857b-47636b9f8cae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0eadb2408e3432197d962381545e5c6', 'request_id': 'req-455286b6-7f98-4fee-857b-47636b9f8cae'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:56.590931 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d19b0-36c0-4683-ac8f-657e45daaa97 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:56.597947 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-455286b6-7f98-4fee-857b-47636b9f8cae admin admin] The token cache is being invalidate because project b0eadb2408e3432197d962381545e5c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:56.598245 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-455286b6-7f98-4fee-857b-47636b9f8cae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:56.606748 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-455286b6-7f98-4fee-857b-47636b9f8cae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:56.610196 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3078/6127] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:31:56 2022] DELETE /identity/v3/projects/b0eadb2408e3432197d962381545e5c6 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:56.611634 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e522327-988f-4c83-8a47-4980352770f2 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:56.612229 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e522327-988f-4c83-8a47-4980352770f2 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:56.612229 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e522327-988f-4c83-8a47-4980352770f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:56.668051 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efef8af-1fce-4a93-b8de-f9559c355e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:56.669409 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efef8af-1fce-4a93-b8de-f9559c355e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:56.669974 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efef8af-1fce-4a93-b8de-f9559c355e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:56.670293 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efef8af-1fce-4a93-b8de-f9559c355e56 admin admin] PATH_INFO: `/v3/projects/d1239213ab65408db7b6faeadf44a331` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:56.672600 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efef8af-1fce-4a93-b8de-f9559c355e56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1239213ab65408db7b6faeadf44a331)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:56.674000 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-2e522327-988f-4c83-8a47-4980352770f2 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:56.675499 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efef8af-1fce-4a93-b8de-f9559c355e56 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:56.676143 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2e522327-988f-4c83-8a47-4980352770f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:56.693549 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3079/6128] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:56.695598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ccc4f-e5b3-4872-943a-50067953d477 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:56.696354 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ccc4f-e5b3-4872-943a-50067953d477 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:56.697171 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ccc4f-e5b3-4872-943a-50067953d477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:56.721288 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-5e8ccc4f-e5b3-4872-943a-50067953d477 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:56.722540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5e8ccc4f-e5b3-4872-943a-50067953d477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:56.823697 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8efef8af-1fce-4a93-b8de-f9559c355e56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1239213ab65408db7b6faeadf44a331', 'request_id': 'req-8efef8af-1fce-4a93-b8de-f9559c355e56'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:56.832176 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3080/6129] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:31:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:56.834600 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a85605-ff84-4427-8d45-36c9608b17b5 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:56.836758 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a85605-ff84-4427-8d45-36c9608b17b5 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:56.837114 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a85605-ff84-4427-8d45-36c9608b17b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:56.848762 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8efef8af-1fce-4a93-b8de-f9559c355e56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1239213ab65408db7b6faeadf44a331', 'request_id': 'req-8efef8af-1fce-4a93-b8de-f9559c355e56'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:56.862416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8efef8af-1fce-4a93-b8de-f9559c355e56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1239213ab65408db7b6faeadf44a331', 'request_id': 'req-8efef8af-1fce-4a93-b8de-f9559c355e56'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:56.879363 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-70a85605-ff84-4427-8d45-36c9608b17b5 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:56.880861 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-70a85605-ff84-4427-8d45-36c9608b17b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:56.977426 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8efef8af-1fce-4a93-b8de-f9559c355e56 admin admin] The token cache is being invalidate because project d1239213ab65408db7b6faeadf44a331 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:31:56.978151 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8efef8af-1fce-4a93-b8de-f9559c355e56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:56.979409 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8efef8af-1fce-4a93-b8de-f9559c355e56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:31:56.983217 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3050/6130] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:31:56 2022] DELETE /identity/v3/projects/d1239213ab65408db7b6faeadf44a331 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:56.989561 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f3248-218f-49ed-b106-3ab650e7b9cb None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:56.994483 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f3248-218f-49ed-b106-3ab650e7b9cb None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:56.995378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f3248-218f-49ed-b106-3ab650e7b9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:57.052264 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3081/6131] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:57.057491 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a85605-ff84-4427-8d45-36c9608b17b5 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:57.059347 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-70a85605-ff84-4427-8d45-36c9608b17b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:57.072564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-8d3f3248-218f-49ed-b106-3ab650e7b9cb None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:57.077054 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8d3f3248-218f-49ed-b106-3ab650e7b9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:57.111202 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3051/6132] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:57.113723 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e44df2-db5f-4f2a-8d82-63e46abc4e6b None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:57.116136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e44df2-db5f-4f2a-8d82-63e46abc4e6b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:57.116589 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e44df2-db5f-4f2a-8d82-63e46abc4e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:57.181238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-c5e44df2-db5f-4f2a-8d82-63e46abc4e6b None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:57.191610 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c5e44df2-db5f-4f2a-8d82-63e46abc4e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:57.209549 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3052/6133] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:57.211351 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896e985-5b25-4af9-be82-0d1cfb459fc5 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:57.211911 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896e985-5b25-4af9-be82-0d1cfb459fc5 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:57.212477 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896e985-5b25-4af9-be82-0d1cfb459fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:57.242204 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a85605-ff84-4427-8d45-36c9608b17b5 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:57.254394 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb34d34-ce40-4086-975c-e607ede702b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:57.254394 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb34d34-ce40-4086-975c-e607ede702b9 service swift] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:57.254394 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb34d34-ce40-4086-975c-e607ede702b9 service swift] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:57.254394 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb34d34-ce40-4086-975c-e607ede702b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:57.255335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9bb34d34-ce40-4086-975c-e607ede702b9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:57.267795 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-3896e985-5b25-4af9-be82-0d1cfb459fc5 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:57.269556 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3896e985-5b25-4af9-be82-0d1cfb459fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:57.307767 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3053/6134] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:57.308441 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896e985-5b25-4af9-be82-0d1cfb459fc5 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:57.331576 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896e985-5b25-4af9-be82-0d1cfb459fc5 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:57.340713 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4305836-20e0-41d8-9a35-8b6f5a48fe43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:57.342149 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4305836-20e0-41d8-9a35-8b6f5a48fe43 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:57.342705 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4305836-20e0-41d8-9a35-8b6f5a48fe43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:57.347180 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4305836-20e0-41d8-9a35-8b6f5a48fe43 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:57.348379 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4305836-20e0-41d8-9a35-8b6f5a48fe43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:31:57.348966 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4305836-20e0-41d8-9a35-8b6f5a48fe43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:57.350880 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4305836-20e0-41d8-9a35-8b6f5a48fe43 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:57.378213 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3054/6135] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:31:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:31:57.381679 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55392a0f-ec93-4b00-bd18-7d5d6852951f None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:57.382508 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55392a0f-ec93-4b00-bd18-7d5d6852951f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:57.382971 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55392a0f-ec93-4b00-bd18-7d5d6852951f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:57.403522 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-55392a0f-ec93-4b00-bd18-7d5d6852951f None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:57.405257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-55392a0f-ec93-4b00-bd18-7d5d6852951f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:57.416730 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3055/6136] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:57.418625 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55392a0f-ec93-4b00-bd18-7d5d6852951f None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:57.433657 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55392a0f-ec93-4b00-bd18-7d5d6852951f None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:57.441549 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c47bc0-ed35-4c17-8e7a-58031a53214b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:57.442642 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c47bc0-ed35-4c17-8e7a-58031a53214b admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:57.443422 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c47bc0-ed35-4c17-8e7a-58031a53214b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:57.443962 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c47bc0-ed35-4c17-8e7a-58031a53214b admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:57.445059 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c47bc0-ed35-4c17-8e7a-58031a53214b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:31:57.445596 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c47bc0-ed35-4c17-8e7a-58031a53214b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:57.447518 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c47bc0-ed35-4c17-8e7a-58031a53214b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:57.461095 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb34d34-ce40-4086-975c-e607ede702b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:57.462925 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb34d34-ce40-4086-975c-e607ede702b9 service swift] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:57.468044 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3056/6137] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:31:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:31:57.469247 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c47bc0-ed35-4c17-8e7a-58031a53214b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:57.483791 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c47bc0-ed35-4c17-8e7a-58031a53214b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:57.490833 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3082/6138] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:31:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:31:57.491801 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb34d34-ce40-4086-975c-e607ede702b9 service swift] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:57.492968 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ef3d9-d620-4e10-abe1-c73539c1ff63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:57.494001 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ef3d9-d620-4e10-abe1-c73539c1ff63 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:57.494698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ef3d9-d620-4e10-abe1-c73539c1ff63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:57.495772 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ef3d9-d620-4e10-abe1-c73539c1ff63 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:57.496693 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ef3d9-d620-4e10-abe1-c73539c1ff63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:57.500792 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ef3d9-d620-4e10-abe1-c73539c1ff63 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:57.517209 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb34d34-ce40-4086-975c-e607ede702b9 service swift] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:57.539037 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926fb9b-958b-49ac-8433-ba7f42635ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:57.542426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926fb9b-958b-49ac-8433-ba7f42635ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:57.542426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926fb9b-958b-49ac-8433-ba7f42635ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:57.542426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926fb9b-958b-49ac-8433-ba7f42635ad6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:57.542426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926fb9b-958b-49ac-8433-ba7f42635ad6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:31:57.542426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926fb9b-958b-49ac-8433-ba7f42635ad6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:57.546831 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926fb9b-958b-49ac-8433-ba7f42635ad6 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:57.579900 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3083/6139] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:31:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:31:57.579900 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926fb9b-958b-49ac-8433-ba7f42635ad6 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:57.603694 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3057/6140] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:31:57 2022] POST /identity/v3/projects => generated 375 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:57.605069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ef3d9-d620-4e10-abe1-c73539c1ff63 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:57.621389 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926fb9b-958b-49ac-8433-ba7f42635ad6 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:57.793623 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e180d9-223c-401c-8228-536188b35c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:57.794795 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e180d9-223c-401c-8228-536188b35c70 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:57.795178 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e180d9-223c-401c-8228-536188b35c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:57.795371 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e180d9-223c-401c-8228-536188b35c70 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:57.803191 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ef3d9-d620-4e10-abe1-c73539c1ff63 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:57.804062 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e180d9-223c-401c-8228-536188b35c70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:57.808947 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e180d9-223c-401c-8228-536188b35c70 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:57.820085 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a877e2-a477-4b3d-bbdd-b7140e0647bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:57.821565 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a877e2-a477-4b3d-bbdd-b7140e0647bb admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:57.821881 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a877e2-a477-4b3d-bbdd-b7140e0647bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:57.822162 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a877e2-a477-4b3d-bbdd-b7140e0647bb admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:57.823985 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a877e2-a477-4b3d-bbdd-b7140e0647bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:57.827534 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a877e2-a477-4b3d-bbdd-b7140e0647bb admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:57.934264 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3084/6141] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:31:57 2022] POST /identity/v3/projects => generated 385 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:57.934264 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e180d9-223c-401c-8228-536188b35c70 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:57.951467 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3058/6142] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:31:57 2022] POST /identity/v3/projects => generated 393 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:57.952515 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a877e2-a477-4b3d-bbdd-b7140e0647bb admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:58.078909 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a877e2-a477-4b3d-bbdd-b7140e0647bb admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:58.088597 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8d969-7ab8-4449-be2e-b70979815309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:58.089333 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8d969-7ab8-4449-be2e-b70979815309 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:58.089575 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8d969-7ab8-4449-be2e-b70979815309 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:58.089963 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8d969-7ab8-4449-be2e-b70979815309 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:58.090669 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f8d969-7ab8-4449-be2e-b70979815309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:58.094200 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f8d969-7ab8-4449-be2e-b70979815309 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:58.155249 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e180d9-223c-401c-8228-536188b35c70 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:58.174484 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c0bf6-da84-4b09-8fd3-61c9fa40ada4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:58.175021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c0bf6-da84-4b09-8fd3-61c9fa40ada4 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:58.175310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c0bf6-da84-4b09-8fd3-61c9fa40ada4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:58.175597 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c0bf6-da84-4b09-8fd3-61c9fa40ada4 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:58.176316 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4c0bf6-da84-4b09-8fd3-61c9fa40ada4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:58.178335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4c0bf6-da84-4b09-8fd3-61c9fa40ada4 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:58.196290 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3059/6143] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:31:57 2022] POST /identity/v3/users => generated 299 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:58.196290 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8d969-7ab8-4449-be2e-b70979815309 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:58.231498 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8d969-7ab8-4449-be2e-b70979815309 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:58.246482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c595af-3dc2-4041-a777-a84d77228d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:58.247269 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c595af-3dc2-4041-a777-a84d77228d51 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:58.247629 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c595af-3dc2-4041-a777-a84d77228d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:58.247980 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c595af-3dc2-4041-a777-a84d77228d51 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:58.250151 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c595af-3dc2-4041-a777-a84d77228d51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:58.254133 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c595af-3dc2-4041-a777-a84d77228d51 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:58.298706 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3085/6144] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:31:57 2022] POST /identity/v3/users => generated 288 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:58.299901 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c0bf6-da84-4b09-8fd3-61c9fa40ada4 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:58.334541 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c0bf6-da84-4b09-8fd3-61c9fa40ada4 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:58.350318 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3edf5-8a02-464a-a49a-8fd5f37e797e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:58.356308 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3edf5-8a02-464a-a49a-8fd5f37e797e admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:58.356308 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3edf5-8a02-464a-a49a-8fd5f37e797e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:58.356308 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3edf5-8a02-464a-a49a-8fd5f37e797e admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:58.356308 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d3edf5-8a02-464a-a49a-8fd5f37e797e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:58.357665 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d3edf5-8a02-464a-a49a-8fd5f37e797e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:58.358401 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3060/6145] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:31:58 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:31:58.359780 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c595af-3dc2-4041-a777-a84d77228d51 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:58.389482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c595af-3dc2-4041-a777-a84d77228d51 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:58.400753 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed63c0-007b-4563-bc2b-1dcd50f535e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:58.401442 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed63c0-007b-4563-bc2b-1dcd50f535e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:58.401731 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed63c0-007b-4563-bc2b-1dcd50f535e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:58.402131 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed63c0-007b-4563-bc2b-1dcd50f535e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:58.402886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed63c0-007b-4563-bc2b-1dcd50f535e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:58.410759 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed63c0-007b-4563-bc2b-1dcd50f535e0 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:58.411466 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3086/6146] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:31:58.412683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3edf5-8a02-464a-a49a-8fd5f37e797e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:58.444457 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3edf5-8a02-464a-a49a-8fd5f37e797e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:58.458002 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3061/6147] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:31:58.458002 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed63c0-007b-4563-bc2b-1dcd50f535e0 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:58.464636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df90e17-b2c7-46cf-9bdb-b31d8a9caf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:58.467378 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df90e17-b2c7-46cf-9bdb-b31d8a9caf9c admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:58.467679 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df90e17-b2c7-46cf-9bdb-b31d8a9caf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:58.468020 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df90e17-b2c7-46cf-9bdb-b31d8a9caf9c admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:58.472373 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df90e17-b2c7-46cf-9bdb-b31d8a9caf9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:58.477036 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df90e17-b2c7-46cf-9bdb-b31d8a9caf9c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:58.499950 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed63c0-007b-4563-bc2b-1dcd50f535e0 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:58.512120 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911379b4-6dde-4dbd-92fe-0bf82786d773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:58.513434 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911379b4-6dde-4dbd-92fe-0bf82786d773 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:58.513966 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911379b4-6dde-4dbd-92fe-0bf82786d773 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:58.514458 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911379b4-6dde-4dbd-92fe-0bf82786d773 admin admin] PATH_INFO: `/v3/projects/c6f5fd53a3944e8e9a4d9fbb1e6060ef/users/7a2dca900ba748f58c290f52931d8007/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:58.534424 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3087/6148] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:31:58.535445 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df90e17-b2c7-46cf-9bdb-b31d8a9caf9c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:58.551821 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911379b4-6dde-4dbd-92fe-0bf82786d773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6f5fd53a3944e8e9a4d9fbb1e6060ef, user_id=7a2dca900ba748f58c290f52931d8007, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:58.559401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911379b4-6dde-4dbd-92fe-0bf82786d773 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:58.576714 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df90e17-b2c7-46cf-9bdb-b31d8a9caf9c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:58.590569 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837f924-259a-4d0e-8a2e-9b9ec6624888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:58.591268 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837f924-259a-4d0e-8a2e-9b9ec6624888 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:58.591557 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837f924-259a-4d0e-8a2e-9b9ec6624888 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:58.591831 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837f924-259a-4d0e-8a2e-9b9ec6624888 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:58.597468 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f837f924-259a-4d0e-8a2e-9b9ec6624888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:58.604667 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f837f924-259a-4d0e-8a2e-9b9ec6624888 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:58.635613 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3088/6149] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:31:58.636936 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837f924-259a-4d0e-8a2e-9b9ec6624888 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:58.653401 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3062/6150] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:31:58 2022] PUT /identity/v3/projects/c6f5fd53a3944e8e9a4d9fbb1e6060ef/users/7a2dca900ba748f58c290f52931d8007/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:58.654571 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911379b4-6dde-4dbd-92fe-0bf82786d773 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:58.675140 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837f924-259a-4d0e-8a2e-9b9ec6624888 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:58.849707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b6b6c-cb94-46b5-9864-2618a715da41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:58.851458 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b6b6c-cb94-46b5-9864-2618a715da41 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:58.852478 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b6b6c-cb94-46b5-9864-2618a715da41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:58.854627 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b6b6c-cb94-46b5-9864-2618a715da41 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:58.855639 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b6b6c-cb94-46b5-9864-2618a715da41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:58.861639 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b6b6c-cb94-46b5-9864-2618a715da41 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:58.910192 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3089/6151] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:31:58.918468 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b6b6c-cb94-46b5-9864-2618a715da41 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:58.923976 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911379b4-6dde-4dbd-92fe-0bf82786d773 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:58.943916 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72269a9e-1130-454b-96f5-a9dd8ade41ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:58.950202 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72269a9e-1130-454b-96f5-a9dd8ade41ad admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:58.950503 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72269a9e-1130-454b-96f5-a9dd8ade41ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:58.950790 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72269a9e-1130-454b-96f5-a9dd8ade41ad admin admin] PATH_INFO: `/v3/projects/7328d5d6d45a4e80820e1a57f9f9a81c/users/f5f04392a4c94046bc7da53b4dffb0e3/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:58.971825 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b6b6c-cb94-46b5-9864-2618a715da41 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:58.989444 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d21d88-fdb3-4b16-a1f6-0ec728f8d25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:58.993062 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d21d88-fdb3-4b16-a1f6-0ec728f8d25e admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:58.993839 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d21d88-fdb3-4b16-a1f6-0ec728f8d25e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:58.994322 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d21d88-fdb3-4b16-a1f6-0ec728f8d25e admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:58.995928 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d21d88-fdb3-4b16-a1f6-0ec728f8d25e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:58.998035 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d21d88-fdb3-4b16-a1f6-0ec728f8d25e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:58.998911 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72269a9e-1130-454b-96f5-a9dd8ade41ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=7328d5d6d45a4e80820e1a57f9f9a81c, user_id=f5f04392a4c94046bc7da53b4dffb0e3, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:59.005397 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72269a9e-1130-454b-96f5-a9dd8ade41ad admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:59.020524 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3090/6152] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:31:59.021681 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d21d88-fdb3-4b16-a1f6-0ec728f8d25e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:59.039037 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d21d88-fdb3-4b16-a1f6-0ec728f8d25e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:59.112769 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412ee79-0617-468f-ba2a-2c1a0ecdf5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:59.113706 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412ee79-0617-468f-ba2a-2c1a0ecdf5b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:59.122026 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412ee79-0617-468f-ba2a-2c1a0ecdf5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:59.122475 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412ee79-0617-468f-ba2a-2c1a0ecdf5b8 admin admin] PATH_INFO: `/v3/projects/58837c5ee6cf4adcaa7a8405d8dc9ea5/users/30d9db0558374844ada689e1629daa71/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:59.138656 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3063/6153] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:31:58 2022] PUT /identity/v3/projects/7328d5d6d45a4e80820e1a57f9f9a81c/users/f5f04392a4c94046bc7da53b4dffb0e3/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:59.139338 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72269a9e-1130-454b-96f5-a9dd8ade41ad admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:31:59.236725 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8412ee79-0617-468f-ba2a-2c1a0ecdf5b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58837c5ee6cf4adcaa7a8405d8dc9ea5, user_id=30d9db0558374844ada689e1629daa71, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:59.250467 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8412ee79-0617-468f-ba2a-2c1a0ecdf5b8 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:59.463066 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72269a9e-1130-454b-96f5-a9dd8ade41ad admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:31:59.503094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c59069-f10d-4842-879b-4b99db1d3116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:31:59.504327 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c59069-f10d-4842-879b-4b99db1d3116 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:59.505118 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c59069-f10d-4842-879b-4b99db1d3116 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:59.506139 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c59069-f10d-4842-879b-4b99db1d3116 admin admin] PATH_INFO: `/v3/projects/c6f5fd53a3944e8e9a4d9fbb1e6060ef/users/7a2dca900ba748f58c290f52931d8007/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:59.512240 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c59069-f10d-4842-879b-4b99db1d3116 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6f5fd53a3944e8e9a4d9fbb1e6060ef, user_id=7a2dca900ba748f58c290f52931d8007, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:31:59.519117 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c59069-f10d-4842-879b-4b99db1d3116 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:31:59.572019 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3064/6154] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:31:59 2022] PUT /identity/v3/projects/c6f5fd53a3944e8e9a4d9fbb1e6060ef/users/7a2dca900ba748f58c290f52931d8007/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:59.578776 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e030d40-7b43-4a73-8238-ea893d2a1e73 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:59.579278 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e030d40-7b43-4a73-8238-ea893d2a1e73 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:59.579567 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e030d40-7b43-4a73-8238-ea893d2a1e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:59.593896 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3091/6155] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:31:59 2022] PUT /identity/v3/projects/58837c5ee6cf4adcaa7a8405d8dc9ea5/users/30d9db0558374844ada689e1629daa71/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:31:59.596260 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18542d48-d226-4fcf-81c1-4e86bec72a32 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:59.599371 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18542d48-d226-4fcf-81c1-4e86bec72a32 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:59.599690 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18542d48-d226-4fcf-81c1-4e86bec72a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:59.616416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-7e030d40-7b43-4a73-8238-ea893d2a1e73 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:59.617855 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7e030d40-7b43-4a73-8238-ea893d2a1e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:59.714639 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-18542d48-d226-4fcf-81c1-4e86bec72a32 None None] MFA Rules not processed for user `7a2dca900ba748f58c290f52931d8007`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:59.723425 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-18542d48-d226-4fcf-81c1-4e86bec72a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:59.810072 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3065/6156] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:59.810072 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413afef4-8597-4657-b304-707b26b9834b None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:31:59.810072 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413afef4-8597-4657-b304-707b26b9834b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:31:59.810072 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413afef4-8597-4657-b304-707b26b9834b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:31:59.906215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-413afef4-8597-4657-b304-707b26b9834b None None] MFA Rules not processed for user `30d9db0558374844ada689e1629daa71`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:31:59.919333 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-413afef4-8597-4657-b304-707b26b9834b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:31:59.998610 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3092/6157] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:31:59.998610 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18542d48-d226-4fcf-81c1-4e86bec72a32 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:00.002273 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-18542d48-d226-4fcf-81c1-4e86bec72a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:00.177300 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3066/6158] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:31:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:32:00.178216 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413afef4-8597-4657-b304-707b26b9834b None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:00.205472 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18542d48-d226-4fcf-81c1-4e86bec72a32 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:00.210359 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413afef4-8597-4657-b304-707b26b9834b None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:00.223664 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3b3f3-9bda-4b26-86fa-b31cec94d40c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:00.224365 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3b3f3-9bda-4b26-86fa-b31cec94d40c service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:00.224653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3b3f3-9bda-4b26-86fa-b31cec94d40c service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:00.224980 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3b3f3-9bda-4b26-86fa-b31cec94d40c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:00.232300 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10a73c-abb9-4290-a7c9-a17d0fc6a12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:00.236346 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10a73c-abb9-4290-a7c9-a17d0fc6a12a admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:00.236346 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10a73c-abb9-4290-a7c9-a17d0fc6a12a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:00.236346 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10a73c-abb9-4290-a7c9-a17d0fc6a12a admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:00.236346 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce10a73c-abb9-4290-a7c9-a17d0fc6a12a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:00.236900 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb3b3f3-9bda-4b26-86fa-b31cec94d40c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:00.237568 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce10a73c-abb9-4290-a7c9-a17d0fc6a12a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:00.238540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb3b3f3-9bda-4b26-86fa-b31cec94d40c service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:00.256449 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3093/6159] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:31:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:32:00.259410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3b3f3-9bda-4b26-86fa-b31cec94d40c service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:00.290044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3b3f3-9bda-4b26-86fa-b31cec94d40c service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:00.302820 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708cb1c9-ffd1-4c40-9943-5dcc46161dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:00.303516 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cb1c9-ffd1-4c40-9943-5dcc46161dac admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:00.303803 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cb1c9-ffd1-4c40-9943-5dcc46161dac admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:00.304140 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cb1c9-ffd1-4c40-9943-5dcc46161dac admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:00.306692 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708cb1c9-ffd1-4c40-9943-5dcc46161dac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:00.308792 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708cb1c9-ffd1-4c40-9943-5dcc46161dac admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:00.389294 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3067/6160] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:32:00 2022] POST /identity/v3/projects => generated 385 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:32:00.391343 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10a73c-abb9-4290-a7c9-a17d0fc6a12a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:00.409937 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3094/6161] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:32:00 2022] POST /identity/v3/projects => generated 397 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:32:00.411682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708cb1c9-ffd1-4c40-9943-5dcc46161dac admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:00.564174 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708cb1c9-ffd1-4c40-9943-5dcc46161dac admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:00.578742 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cb837-12c7-474e-aaa9-35f71c473d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:00.579348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cb837-12c7-474e-aaa9-35f71c473d06 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:00.579632 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cb837-12c7-474e-aaa9-35f71c473d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:00.579909 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cb837-12c7-474e-aaa9-35f71c473d06 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:00.580603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cb837-12c7-474e-aaa9-35f71c473d06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:00.581942 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10a73c-abb9-4290-a7c9-a17d0fc6a12a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:00.582595 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cb837-12c7-474e-aaa9-35f71c473d06 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:00.587438 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef6947-3de0-4b07-844f-8c2ba572643f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:00.588674 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef6947-3de0-4b07-844f-8c2ba572643f admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:00.589289 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef6947-3de0-4b07-844f-8c2ba572643f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:00.589680 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef6947-3de0-4b07-844f-8c2ba572643f admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:00.590698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ef6947-3de0-4b07-844f-8c2ba572643f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:00.593121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ef6947-3de0-4b07-844f-8c2ba572643f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:00.722498 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3068/6162] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:32:00 2022] POST /identity/v3/users => generated 293 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:32:00.723916 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef6947-3de0-4b07-844f-8c2ba572643f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:00.739224 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3095/6163] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:32:00 2022] POST /identity/v3/users => generated 305 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:32:00.740312 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cb837-12c7-474e-aaa9-35f71c473d06 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:00.758306 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef6947-3de0-4b07-844f-8c2ba572643f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:00.769096 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cb837-12c7-474e-aaa9-35f71c473d06 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:00.778247 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c85207-4bfd-441e-98d6-3dc2924f3338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:00.780588 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c85207-4bfd-441e-98d6-3dc2924f3338 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:00.782091 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c85207-4bfd-441e-98d6-3dc2924f3338 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:00.783195 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c85207-4bfd-441e-98d6-3dc2924f3338 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:00.787084 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c85207-4bfd-441e-98d6-3dc2924f3338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:00.792009 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c85207-4bfd-441e-98d6-3dc2924f3338 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:00.792240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d44c5-e6b0-44ac-913c-1f3ea3b5f0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:00.792862 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d44c5-e6b0-44ac-913c-1f3ea3b5f0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:00.793142 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d44c5-e6b0-44ac-913c-1f3ea3b5f0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:00.793486 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d44c5-e6b0-44ac-913c-1f3ea3b5f0f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:00.794162 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d44c5-e6b0-44ac-913c-1f3ea3b5f0f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:00.795766 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d44c5-e6b0-44ac-913c-1f3ea3b5f0f2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:00.828508 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3069/6164] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:32:00.830203 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c85207-4bfd-441e-98d6-3dc2924f3338 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:00.831874 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3096/6165] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:32:00.832728 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d44c5-e6b0-44ac-913c-1f3ea3b5f0f2 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:00.846726 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d44c5-e6b0-44ac-913c-1f3ea3b5f0f2 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:00.852081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac6da6-7da4-4cef-8ed8-a0a56bc8d9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:00.853237 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac6da6-7da4-4cef-8ed8-a0a56bc8d9d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:00.853682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac6da6-7da4-4cef-8ed8-a0a56bc8d9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:00.854142 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac6da6-7da4-4cef-8ed8-a0a56bc8d9d2 admin admin] PATH_INFO: `/v3/projects/8ee2c106a8674868aadc6e310694c241/users/d36e3413cf2b4d1e83466bff1b3d48a4/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:00.873108 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c85207-4bfd-441e-98d6-3dc2924f3338 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:00.894665 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac6da6-7da4-4cef-8ed8-a0a56bc8d9d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ee2c106a8674868aadc6e310694c241, user_id=d36e3413cf2b4d1e83466bff1b3d48a4, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:00.898181 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac6da6-7da4-4cef-8ed8-a0a56bc8d9d2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:00.899776 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872221c-5923-495d-b370-6cbfeb1f4699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:00.907343 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872221c-5923-495d-b370-6cbfeb1f4699 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:00.909524 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872221c-5923-495d-b370-6cbfeb1f4699 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:00.909956 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872221c-5923-495d-b370-6cbfeb1f4699 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:00.912565 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d872221c-5923-495d-b370-6cbfeb1f4699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:00.918083 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d872221c-5923-495d-b370-6cbfeb1f4699 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:00.995314 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3070/6166] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:32:00.996184 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872221c-5923-495d-b370-6cbfeb1f4699 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:01.005750 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3097/6167] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:32:00 2022] PUT /identity/v3/projects/8ee2c106a8674868aadc6e310694c241/users/d36e3413cf2b4d1e83466bff1b3d48a4/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:32:01.007819 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac6da6-7da4-4cef-8ed8-a0a56bc8d9d2 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:01.051165 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872221c-5923-495d-b370-6cbfeb1f4699 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:01.210748 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac6da6-7da4-4cef-8ed8-a0a56bc8d9d2 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:01.224909 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d122f8-3b76-4b48-929a-076843805ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:01.229092 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d122f8-3b76-4b48-929a-076843805ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:01.229641 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d122f8-3b76-4b48-929a-076843805ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:01.229984 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d122f8-3b76-4b48-929a-076843805ca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:01.242976 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d122f8-3b76-4b48-929a-076843805ca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:01.244810 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d122f8-3b76-4b48-929a-076843805ca9 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:01.295489 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feeb3f9-9331-4248-beae-75ce85fdc74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:01.296413 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3098/6168] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:32:01.296974 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feeb3f9-9331-4248-beae-75ce85fdc74a admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:01.297497 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feeb3f9-9331-4248-beae-75ce85fdc74a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:01.297801 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feeb3f9-9331-4248-beae-75ce85fdc74a admin admin] PATH_INFO: `/v3/projects/369d881ea2a747aababdba3f7b35d421/users/eae8335b02834626ae6a525d35a0fb2e/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:01.298788 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d122f8-3b76-4b48-929a-076843805ca9 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:01.324231 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d122f8-3b76-4b48-929a-076843805ca9 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:01.330802 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feeb3f9-9331-4248-beae-75ce85fdc74a admin admin] RBAC: Authorizing `identity:create_grant(project_id=369d881ea2a747aababdba3f7b35d421, user_id=eae8335b02834626ae6a525d35a0fb2e, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:01.342378 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00b2b6-5dbe-451d-b688-e97dabfd1af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:01.343991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00b2b6-5dbe-451d-b688-e97dabfd1af8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:01.344266 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00b2b6-5dbe-451d-b688-e97dabfd1af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:01.344549 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00b2b6-5dbe-451d-b688-e97dabfd1af8 admin admin] PATH_INFO: `/v3/projects/8ee2c106a8674868aadc6e310694c241/users/d36e3413cf2b4d1e83466bff1b3d48a4/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:01.347059 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feeb3f9-9331-4248-beae-75ce85fdc74a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:01.347206 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a00b2b6-5dbe-451d-b688-e97dabfd1af8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ee2c106a8674868aadc6e310694c241, user_id=d36e3413cf2b4d1e83466bff1b3d48a4, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:01.368208 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a00b2b6-5dbe-451d-b688-e97dabfd1af8 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:01.398614 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3099/6169] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:32:01 2022] PUT /identity/v3/projects/8ee2c106a8674868aadc6e310694c241/users/d36e3413cf2b4d1e83466bff1b3d48a4/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:32:01.400290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf191fe-a9fe-4864-a901-b57beef83153 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:01.400585 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf191fe-a9fe-4864-a901-b57beef83153 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:01.400933 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf191fe-a9fe-4864-a901-b57beef83153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:01.422547 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3071/6170] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:32:00 2022] PUT /identity/v3/projects/369d881ea2a747aababdba3f7b35d421/users/eae8335b02834626ae6a525d35a0fb2e/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:32:01.439232 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b7398-f188-43b8-b0c1-3d0ed40c49fb None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:01.439714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b7398-f188-43b8-b0c1-3d0ed40c49fb None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:01.440127 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b7398-f188-43b8-b0c1-3d0ed40c49fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:01.455655 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-9cf191fe-a9fe-4864-a901-b57beef83153 None None] MFA Rules not processed for user `d36e3413cf2b4d1e83466bff1b3d48a4`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:32:01.460900 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9cf191fe-a9fe-4864-a901-b57beef83153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:01.549677 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-540b7398-f188-43b8-b0c1-3d0ed40c49fb None None] MFA Rules not processed for user `eae8335b02834626ae6a525d35a0fb2e`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:32:01.552095 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-540b7398-f188-43b8-b0c1-3d0ed40c49fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:01.673225 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3100/6171] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:32:01 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:32:01.674968 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf191fe-a9fe-4864-a901-b57beef83153 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:01.733280 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3072/6172] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:32:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:32:01.839328 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf191fe-a9fe-4864-a901-b57beef83153 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:01.849921 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd015292-6f46-44d1-82ec-b965c76acc8e tempest-ProjectsNegativeStaticTestJSON-66279807 tempest-ProjectsNegativeStaticTestJSON-66279807-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d9db0558374844ada689e1629daa71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58837c5ee6cf4adcaa7a8405d8dc9ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:01.850860 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd015292-6f46-44d1-82ec-b965c76acc8e tempest-ProjectsNegativeStaticTestJSON-66279807 tempest-ProjectsNegativeStaticTestJSON-66279807-project] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:01.851518 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd015292-6f46-44d1-82ec-b965c76acc8e tempest-ProjectsNegativeStaticTestJSON-66279807 tempest-ProjectsNegativeStaticTestJSON-66279807-project] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:01.852140 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd015292-6f46-44d1-82ec-b965c76acc8e tempest-ProjectsNegativeStaticTestJSON-66279807 tempest-ProjectsNegativeStaticTestJSON-66279807-project] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:01.853166 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd015292-6f46-44d1-82ec-b965c76acc8e tempest-ProjectsNegativeStaticTestJSON-66279807 tempest-ProjectsNegativeStaticTestJSON-66279807-project] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:01.860165 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-bd015292-6f46-44d1-82ec-b965c76acc8e tempest-ProjectsNegativeStaticTestJSON-66279807 tempest-ProjectsNegativeStaticTestJSON-66279807-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Apr 30 21:32:01.860165 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:32:01.860165 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:32:01.860165 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:32:01.860165 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:32:01.860165 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:32:01.860165 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:32:01.860165 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:32:01.860165 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:32:01.860165 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:32:01.860165 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:32:01.860165 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:32:01.860165 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Apr 30 21:32:01.860165 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Apr 30 21:32:01.861776 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Apr 30 21:32:01.861776 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application enforcer_obj._enforce( Apr 30 21:32:01.861776 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Apr 30 21:32:01.861776 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Apr 30 21:32:01.861776 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Apr 30 21:32:01.861776 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Apr 30 21:32:01.861776 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Apr 30 21:32:01.861776 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:32:01.867871 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3101/6173] 10.222.0.23 () {60 vars in 1151 bytes} [Sat Apr 30 21:32:01 2022] POST /identity/v3/projects => generated 136 bytes in 194 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Apr 30 21:32:01.868790 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b7398-f188-43b8-b0c1-3d0ed40c49fb None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:01.898411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b7398-f188-43b8-b0c1-3d0ed40c49fb None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:01.907058 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e2a46-c41f-4497-bf92-a1043c0bb042 tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd36e3413cf2b4d1e83466bff1b3d48a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c106a8674868aadc6e310694c241', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:01.910197 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e2a46-c41f-4497-bf92-a1043c0bb042 tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:01.910708 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e2a46-c41f-4497-bf92-a1043c0bb042 tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:01.911248 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e2a46-c41f-4497-bf92-a1043c0bb042 tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:01.912128 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e2a46-c41f-4497-bf92-a1043c0bb042 tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:01.916341 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e2a46-c41f-4497-bf92-a1043c0bb042 tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:01.972656 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-560e2a46-c41f-4497-bf92-a1043c0bb042 tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] Invalid input for field 'name': '' is too short Apr 30 21:32:01.972656 ncdv-master-1 devstack@keystone.service[91017]: Failed validating 'minLength' in schema['properties']['name']: Apr 30 21:32:01.972656 ncdv-master-1 devstack@keystone.service[91017]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Apr 30 21:32:01.972656 ncdv-master-1 devstack@keystone.service[91017]: On instance['name']: Apr 30 21:32:01.972656 ncdv-master-1 devstack@keystone.service[91017]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Apr 30 21:32:01.972656 ncdv-master-1 devstack@keystone.service[91017]: Failed validating 'minLength' in schema['properties']['name']: Apr 30 21:32:01.972656 ncdv-master-1 devstack@keystone.service[91017]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Apr 30 21:32:01.972656 ncdv-master-1 devstack@keystone.service[91017]: On instance['name']: Apr 30 21:32:01.972656 ncdv-master-1 devstack@keystone.service[91017]: '' Apr 30 21:32:01.972656 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:32:01.972656 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Apr 30 21:32:01.972656 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Apr 30 21:32:01.972656 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Apr 30 21:32:01.972656 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise error Apr 30 21:32:01.972656 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Apr 30 21:32:01.972656 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:32:01.972656 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Apr 30 21:32:01.972656 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Apr 30 21:32:01.972656 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:32:01.972656 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application On instance['name']: Apr 30 21:32:01.972656 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application '' Apr 30 21:32:01.972656 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:32:01.972656 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 21:32:01.979096 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:32:01.979096 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:32:01.979096 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:32:01.979096 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:32:01.979096 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:32:01.979096 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:32:01.979096 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:32:01.979096 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:32:01.979096 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:32:01.979096 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:32:01.979096 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:32:01.979096 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:32:01.979096 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Apr 30 21:32:01.979096 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Apr 30 21:32:01.979096 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Apr 30 21:32:01.979096 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Apr 30 21:32:01.979096 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Apr 30 21:32:01.980311 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Apr 30 21:32:01.980311 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Apr 30 21:32:01.980311 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:32:01.980311 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Apr 30 21:32:01.980311 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Apr 30 21:32:01.980311 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:32:01.980311 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application On instance['name']: Apr 30 21:32:01.980311 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application '' Apr 30 21:32:01.980311 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:32:01.980311 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3073/6174] 10.222.0.23 () {60 vars in 1151 bytes} [Sat Apr 30 21:32:01 2022] POST /identity/v3/projects => generated 283 bytes in 106 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Apr 30 21:32:01.982155 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd015292-6f46-44d1-82ec-b965c76acc8e tempest-ProjectsNegativeStaticTestJSON-66279807 tempest-ProjectsNegativeStaticTestJSON-66279807-project] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:02.006349 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd015292-6f46-44d1-82ec-b965c76acc8e tempest-ProjectsNegativeStaticTestJSON-66279807 tempest-ProjectsNegativeStaticTestJSON-66279807-project] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:02.023953 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ece01-7600-48a4-990a-f48a007a465c tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd36e3413cf2b4d1e83466bff1b3d48a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c106a8674868aadc6e310694c241', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:02.029935 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ece01-7600-48a4-990a-f48a007a465c tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:02.030531 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ece01-7600-48a4-990a-f48a007a465c tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:02.031703 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ece01-7600-48a4-990a-f48a007a465c tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:02.032640 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ece01-7600-48a4-990a-f48a007a465c tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:02.035163 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ece01-7600-48a4-990a-f48a007a465c tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:02.051436 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-3a0ece01-7600-48a4-990a-f48a007a465c tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Apr 30 21:32:02.051436 ncdv-master-1 devstack@keystone.service[91018]: Failed validating 'maxLength' in schema['properties']['name']: Apr 30 21:32:02.051436 ncdv-master-1 devstack@keystone.service[91018]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Apr 30 21:32:02.051436 ncdv-master-1 devstack@keystone.service[91018]: On instance['name']: Apr 30 21:32:02.051436 ncdv-master-1 devstack@keystone.service[91018]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Apr 30 21:32:02.051436 ncdv-master-1 devstack@keystone.service[91018]: Failed validating 'maxLength' in schema['properties']['name']: Apr 30 21:32:02.051436 ncdv-master-1 devstack@keystone.service[91018]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Apr 30 21:32:02.051436 ncdv-master-1 devstack@keystone.service[91018]: On instance['name']: Apr 30 21:32:02.051436 ncdv-master-1 devstack@keystone.service[91018]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Apr 30 21:32:02.051436 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:32:02.051436 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Apr 30 21:32:02.051436 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Apr 30 21:32:02.051436 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Apr 30 21:32:02.051436 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise error Apr 30 21:32:02.051436 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Apr 30 21:32:02.051436 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:32:02.051436 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Apr 30 21:32:02.051436 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Apr 30 21:32:02.052831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:32:02.052831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application On instance['name']: Apr 30 21:32:02.052831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Apr 30 21:32:02.052831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:32:02.052831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 21:32:02.052831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:32:02.052831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:32:02.052831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:32:02.052831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:32:02.052831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:32:02.052831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:32:02.052831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:32:02.052831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:32:02.052831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:32:02.052831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:32:02.052831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:32:02.052831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:32:02.052831 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Apr 30 21:32:02.053967 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Apr 30 21:32:02.053967 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Apr 30 21:32:02.053967 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Apr 30 21:32:02.053967 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Apr 30 21:32:02.053967 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Apr 30 21:32:02.053967 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Apr 30 21:32:02.053967 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:32:02.053967 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Apr 30 21:32:02.053967 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Apr 30 21:32:02.053967 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:32:02.053967 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application On instance['name']: Apr 30 21:32:02.053967 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Apr 30 21:32:02.053967 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:32:02.064958 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e2a46-c41f-4497-bf92-a1043c0bb042 tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:02.070245 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3102/6175] 10.222.0.23 () {60 vars in 1151 bytes} [Sat Apr 30 21:32:01 2022] POST /identity/v3/projects => generated 412 bytes in 84 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Apr 30 21:32:02.127597 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e2a46-c41f-4497-bf92-a1043c0bb042 tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:02.150399 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee537f4f-7575-4795-8593-e67a42ad80ba tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd36e3413cf2b4d1e83466bff1b3d48a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c106a8674868aadc6e310694c241', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:02.154429 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee537f4f-7575-4795-8593-e67a42ad80ba tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:02.154735 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee537f4f-7575-4795-8593-e67a42ad80ba tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:02.155034 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee537f4f-7575-4795-8593-e67a42ad80ba tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] PATH_INFO: `/v3/projects/6187539f73ac475287d58b0c84da66d0` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:02.185134 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee537f4f-7575-4795-8593-e67a42ad80ba tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6187539f73ac475287d58b0c84da66d0)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:02.193675 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee537f4f-7575-4795-8593-e67a42ad80ba tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:02.261477 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-ee537f4f-7575-4795-8593-e67a42ad80ba tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] Could not find project: 6187539f73ac475287d58b0c84da66d0.: keystone.exception.ProjectNotFound: Could not find project: 6187539f73ac475287d58b0c84da66d0. Apr 30 21:32:02.261477 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:32:02.261477 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:32:02.261477 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:32:02.261477 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:32:02.261477 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:32:02.261477 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:32:02.261477 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:32:02.261477 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:32:02.261477 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:32:02.261477 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:32:02.261477 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:32:02.261477 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Apr 30 21:32:02.261477 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Apr 30 21:32:02.262644 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:32:02.262644 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:32:02.262644 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Apr 30 21:32:02.262644 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Apr 30 21:32:02.262644 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 21:32:02.262644 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 21:32:02.262644 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 21:32:02.262644 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 21:32:02.262644 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 6187539f73ac475287d58b0c84da66d0. Apr 30 21:32:02.262644 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:32:02.272055 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3074/6176] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:32:02 2022] DELETE /identity/v3/projects/6187539f73ac475287d58b0c84da66d0 => generated 113 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Apr 30 21:32:02.281543 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ece01-7600-48a4-990a-f48a007a465c tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:02.310555 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ece01-7600-48a4-990a-f48a007a465c tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:02.321220 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74f8a1-a17b-46ee-8339-2619e686e3c0 tempest-ProjectsNegativeStaticTestJSON-66279807 tempest-ProjectsNegativeStaticTestJSON-66279807-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30d9db0558374844ada689e1629daa71', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58837c5ee6cf4adcaa7a8405d8dc9ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:02.322176 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74f8a1-a17b-46ee-8339-2619e686e3c0 tempest-ProjectsNegativeStaticTestJSON-66279807 tempest-ProjectsNegativeStaticTestJSON-66279807-project] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:02.324604 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74f8a1-a17b-46ee-8339-2619e686e3c0 tempest-ProjectsNegativeStaticTestJSON-66279807 tempest-ProjectsNegativeStaticTestJSON-66279807-project] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:02.325313 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74f8a1-a17b-46ee-8339-2619e686e3c0 tempest-ProjectsNegativeStaticTestJSON-66279807 tempest-ProjectsNegativeStaticTestJSON-66279807-project] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:02.326306 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74f8a1-a17b-46ee-8339-2619e686e3c0 tempest-ProjectsNegativeStaticTestJSON-66279807 tempest-ProjectsNegativeStaticTestJSON-66279807-project] RBAC: Authorizing `identity:list_projects()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:02.346033 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-3b74f8a1-a17b-46ee-8339-2619e686e3c0 tempest-ProjectsNegativeStaticTestJSON-66279807 tempest-ProjectsNegativeStaticTestJSON-66279807-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Apr 30 21:32:02.346033 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:32:02.346033 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:32:02.346033 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:32:02.346033 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:32:02.346033 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:32:02.346033 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:32:02.346033 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:32:02.346033 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:32:02.346033 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:32:02.346033 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:32:02.346033 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:32:02.346033 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Apr 30 21:32:02.346033 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._list_projects() Apr 30 21:32:02.347155 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Apr 30 21:32:02.347155 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Apr 30 21:32:02.347155 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Apr 30 21:32:02.347155 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application enforcer_obj._enforce( Apr 30 21:32:02.347155 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Apr 30 21:32:02.347155 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Apr 30 21:32:02.347155 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Apr 30 21:32:02.347155 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Apr 30 21:32:02.347155 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Apr 30 21:32:02.347155 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:32:02.349214 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3103/6177] 10.222.0.23 () {58 vars in 1130 bytes} [Sat Apr 30 21:32:02 2022] GET /identity/v3/projects => generated 135 bytes in 69 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Apr 30 21:32:02.358114 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee537f4f-7575-4795-8593-e67a42ad80ba tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:02.374094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee537f4f-7575-4795-8593-e67a42ad80ba tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:02.395184 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d00aa1-575c-456a-b8c4-bf2868051e0d tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd36e3413cf2b4d1e83466bff1b3d48a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c106a8674868aadc6e310694c241', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:02.396646 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d00aa1-575c-456a-b8c4-bf2868051e0d tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:02.396956 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d00aa1-575c-456a-b8c4-bf2868051e0d tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:02.400039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d00aa1-575c-456a-b8c4-bf2868051e0d tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:02.403792 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d00aa1-575c-456a-b8c4-bf2868051e0d tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:02.430022 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d00aa1-575c-456a-b8c4-bf2868051e0d tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:02.610088 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3075/6178] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:32:02 2022] POST /identity/v3/projects => generated 359 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:32:02.611543 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74f8a1-a17b-46ee-8339-2619e686e3c0 tempest-ProjectsNegativeStaticTestJSON-66279807 tempest-ProjectsNegativeStaticTestJSON-66279807-project] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:02.639172 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74f8a1-a17b-46ee-8339-2619e686e3c0 tempest-ProjectsNegativeStaticTestJSON-66279807 tempest-ProjectsNegativeStaticTestJSON-66279807-project] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:02.932010 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6d1dc-62da-4820-92a2-4d44beefa97b tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd36e3413cf2b4d1e83466bff1b3d48a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c106a8674868aadc6e310694c241', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:02.932835 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6d1dc-62da-4820-92a2-4d44beefa97b tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:02.933033 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6d1dc-62da-4820-92a2-4d44beefa97b tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:02.933362 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6d1dc-62da-4820-92a2-4d44beefa97b tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:02.934107 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6d1dc-62da-4820-92a2-4d44beefa97b tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:02.936379 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6d1dc-62da-4820-92a2-4d44beefa97b tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:02.995982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.sql.core [None req-7df6d1dc-62da-4820-92a2-4d44beefa97b tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-1396062383' for key 'project.ixu_project_name_domain_id'") Apr 30 21:32:02.995982 ncdv-master-1 devstack@keystone.service[91018]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Apr 30 21:32:02.995982 ncdv-master-1 devstack@keystone.service[91018]: [parameters: {'id': 'f6b1df839779494facabe91e38c3a4ce', 'name': 'tempest-project-dup-1396062383', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Apr 30 21:32:02.995982 ncdv-master-1 devstack@keystone.service[91018]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91018) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 30 21:32:03.070290 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-7df6d1dc-62da-4820-92a2-4d44beefa97b tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1396062383, project id f6b1df839779494facabe91e38c3a4ce.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1396062383, project id f6b1df839779494facabe91e38c3a4ce. Apr 30 21:32:03.070290 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:32:03.070290 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Apr 30 21:32:03.070290 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self.dialect.do_execute( Apr 30 21:32:03.070290 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Apr 30 21:32:03.070290 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Apr 30 21:32:03.070290 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Apr 30 21:32:03.070290 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application result = self._query(query) Apr 30 21:32:03.070290 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Apr 30 21:32:03.070290 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application conn.query(q) Apr 30 21:32:03.070290 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Apr 30 21:32:03.070290 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Apr 30 21:32:03.071516 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Apr 30 21:32:03.071516 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application result.read() Apr 30 21:32:03.071516 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Apr 30 21:32:03.071516 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Apr 30 21:32:03.071516 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Apr 30 21:32:03.071516 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application packet.raise_for_error() Apr 30 21:32:03.071516 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Apr 30 21:32:03.071516 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Apr 30 21:32:03.071516 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Apr 30 21:32:03.071516 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Apr 30 21:32:03.071516 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-1396062383' for key 'project.ixu_project_name_domain_id'") Apr 30 21:32:03.071516 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:32:03.071516 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Apr 30 21:32:03.071516 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:32:03.071516 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:32:03.071516 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Apr 30 21:32:03.071516 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return method(*args, **kwargs) Apr 30 21:32:03.072610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Apr 30 21:32:03.072610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return project_ref.to_dict() Apr 30 21:32:03.072610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Apr 30 21:32:03.072610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application next(self.gen) Apr 30 21:32:03.072610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Apr 30 21:32:03.072610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application yield resource Apr 30 21:32:03.072610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Apr 30 21:32:03.072610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application next(self.gen) Apr 30 21:32:03.072610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Apr 30 21:32:03.072610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self.session.rollback() Apr 30 21:32:03.072610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Apr 30 21:32:03.072610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self.force_reraise() Apr 30 21:32:03.072610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Apr 30 21:32:03.072610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise self.value Apr 30 21:32:03.072610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Apr 30 21:32:03.072610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Apr 30 21:32:03.072610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Apr 30 21:32:03.072610 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application session.commit() Apr 30 21:32:03.074158 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1431, in commit Apr 30 21:32:03.074158 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Apr 30 21:32:03.074158 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Apr 30 21:32:03.074158 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self._prepare_impl() Apr 30 21:32:03.074158 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Apr 30 21:32:03.074158 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self.session.flush() Apr 30 21:32:03.074158 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3363, in flush Apr 30 21:32:03.074158 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self._flush(objects) Apr 30 21:32:03.074158 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3503, in _flush Apr 30 21:32:03.074158 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Apr 30 21:32:03.074158 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Apr 30 21:32:03.074158 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application compat.raise_( Apr 30 21:32:03.074158 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Apr 30 21:32:03.074158 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception Apr 30 21:32:03.074158 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3463, in _flush Apr 30 21:32:03.074158 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application flush_context.execute() Apr 30 21:32:03.074158 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Apr 30 21:32:03.075152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rec.execute(self) Apr 30 21:32:03.075152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Apr 30 21:32:03.075152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Apr 30 21:32:03.075152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Apr 30 21:32:03.075152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application _emit_insert_statements( Apr 30 21:32:03.075152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Apr 30 21:32:03.075152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application c = connection._execute_20( Apr 30 21:32:03.075152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Apr 30 21:32:03.075152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Apr 30 21:32:03.075152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Apr 30 21:32:03.075152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Apr 30 21:32:03.075152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Apr 30 21:32:03.075152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ret = self._execute_context( Apr 30 21:32:03.075152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Apr 30 21:32:03.075152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Apr 30 21:32:03.075152 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Apr 30 21:32:03.076155 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Apr 30 21:32:03.076155 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Apr 30 21:32:03.076155 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception Apr 30 21:32:03.076155 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Apr 30 21:32:03.076155 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self.dialect.do_execute( Apr 30 21:32:03.076155 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Apr 30 21:32:03.076155 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Apr 30 21:32:03.076155 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Apr 30 21:32:03.076155 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application result = self._query(query) Apr 30 21:32:03.076155 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Apr 30 21:32:03.076155 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application conn.query(q) Apr 30 21:32:03.076155 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Apr 30 21:32:03.076155 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Apr 30 21:32:03.076155 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Apr 30 21:32:03.076155 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application result.read() Apr 30 21:32:03.076155 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Apr 30 21:32:03.076155 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Apr 30 21:32:03.077090 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Apr 30 21:32:03.077090 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application packet.raise_for_error() Apr 30 21:32:03.077090 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Apr 30 21:32:03.077090 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Apr 30 21:32:03.077090 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Apr 30 21:32:03.077090 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Apr 30 21:32:03.077090 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-1396062383' for key 'project.ixu_project_name_domain_id'") Apr 30 21:32:03.077090 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Apr 30 21:32:03.077090 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [parameters: {'id': 'f6b1df839779494facabe91e38c3a4ce', 'name': 'tempest-project-dup-1396062383', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Apr 30 21:32:03.077090 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Apr 30 21:32:03.077090 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:32:03.077090 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 21:32:03.077090 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:32:03.077090 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:32:03.077090 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Apr 30 21:32:03.082324 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Apr 30 21:32:03.082324 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Apr 30 21:32:03.082324 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Apr 30 21:32:03.082324 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-1396062383 at domain ID default. Apr 30 21:32:03.082324 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:32:03.082324 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 21:32:03.082324 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:32:03.082324 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:32:03.082324 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:32:03.082324 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:32:03.082324 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:32:03.082324 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:32:03.082324 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:32:03.082324 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:32:03.082324 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:32:03.082324 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:32:03.082324 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:32:03.085657 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:32:03.085657 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Apr 30 21:32:03.085657 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Apr 30 21:32:03.085657 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:32:03.085657 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:32:03.085657 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Apr 30 21:32:03.085657 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.Conflict( Apr 30 21:32:03.085657 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-1396062383, project id f6b1df839779494facabe91e38c3a4ce. Apr 30 21:32:03.085657 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:32:03.085657 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3104/6179] 10.222.0.23 () {60 vars in 1151 bytes} [Sat Apr 30 21:32:02 2022] POST /identity/v3/projects => generated 285 bytes in 463 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 30 21:32:03.095615 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d00aa1-575c-456a-b8c4-bf2868051e0d tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:03.107828 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d00aa1-575c-456a-b8c4-bf2868051e0d tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:03.119564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472cdb8e-df84-470f-a757-f6735412e33f tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd36e3413cf2b4d1e83466bff1b3d48a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ee2c106a8674868aadc6e310694c241', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:03.120451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472cdb8e-df84-470f-a757-f6735412e33f tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:03.120903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472cdb8e-df84-470f-a757-f6735412e33f tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:03.121174 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472cdb8e-df84-470f-a757-f6735412e33f tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] PATH_INFO: `/v3/projects/b8dcceff4735425ba798ea4ec3a02727` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:03.123403 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472cdb8e-df84-470f-a757-f6735412e33f tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b8dcceff4735425ba798ea4ec3a02727)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:03.128351 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472cdb8e-df84-470f-a757-f6735412e33f tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:03.340930 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-472cdb8e-df84-470f-a757-f6735412e33f tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8dcceff4735425ba798ea4ec3a02727', 'request_id': 'req-472cdb8e-df84-470f-a757-f6735412e33f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:03.350571 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-472cdb8e-df84-470f-a757-f6735412e33f tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8dcceff4735425ba798ea4ec3a02727', 'request_id': 'req-472cdb8e-df84-470f-a757-f6735412e33f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:03.361617 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-472cdb8e-df84-470f-a757-f6735412e33f tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8dcceff4735425ba798ea4ec3a02727', 'request_id': 'req-472cdb8e-df84-470f-a757-f6735412e33f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:03.450814 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-472cdb8e-df84-470f-a757-f6735412e33f tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] The token cache is being invalidate because project b8dcceff4735425ba798ea4ec3a02727 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:32:03.451410 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-472cdb8e-df84-470f-a757-f6735412e33f tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:03.452442 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-472cdb8e-df84-470f-a757-f6735412e33f tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:03.463892 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6d1dc-62da-4820-92a2-4d44beefa97b tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:03.465424 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3076/6180] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:32:03 2022] DELETE /identity/v3/projects/b8dcceff4735425ba798ea4ec3a02727 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:32:03.475301 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7df6d1dc-62da-4820-92a2-4d44beefa97b tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:03.622780 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6d1dc-62da-4820-92a2-4d44beefa97b tempest-ProjectsNegativeStaticTestJSON-1798702705 tempest-ProjectsNegativeStaticTestJSON-1798702705-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:03.753932 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385490f7-e871-425b-9326-dd66c9c7b8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:03.755177 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385490f7-e871-425b-9326-dd66c9c7b8c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:03.755635 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385490f7-e871-425b-9326-dd66c9c7b8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:03.756088 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385490f7-e871-425b-9326-dd66c9c7b8c2 admin admin] PATH_INFO: `/v3/users/30d9db0558374844ada689e1629daa71` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:03.757895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385490f7-e871-425b-9326-dd66c9c7b8c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30d9db0558374844ada689e1629daa71)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:03.761079 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385490f7-e871-425b-9326-dd66c9c7b8c2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:03.986984 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-385490f7-e871-425b-9326-dd66c9c7b8c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30d9db0558374844ada689e1629daa71'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:04.010340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-385490f7-e871-425b-9326-dd66c9c7b8c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30d9db0558374844ada689e1629daa71'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:04.106224 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-385490f7-e871-425b-9326-dd66c9c7b8c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30d9db0558374844ada689e1629daa71'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:04.115281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-385490f7-e871-425b-9326-dd66c9c7b8c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30d9db0558374844ada689e1629daa71'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:04.120111 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-385490f7-e871-425b-9326-dd66c9c7b8c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30d9db0558374844ada689e1629daa71'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:04.138391 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3105/6181] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:32:03 2022] DELETE /identity/v3/users/30d9db0558374844ada689e1629daa71 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:32:04.148186 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11f01d-f597-4f00-98bb-14c8246b8668 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:04.148744 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11f01d-f597-4f00-98bb-14c8246b8668 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:04.149182 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11f01d-f597-4f00-98bb-14c8246b8668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:04.201565 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-5a11f01d-f597-4f00-98bb-14c8246b8668 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:32:04.207487 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5a11f01d-f597-4f00-98bb-14c8246b8668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:04.351118 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3077/6182] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:32:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:32:04.433677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385490f7-e871-425b-9326-dd66c9c7b8c2 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:04.436738 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-385490f7-e871-425b-9326-dd66c9c7b8c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:04.612703 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385490f7-e871-425b-9326-dd66c9c7b8c2 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:04.616959 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717058e-14c3-4d4b-a594-4155d7cf9c32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:04.617859 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717058e-14c3-4d4b-a594-4155d7cf9c32 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:04.618332 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717058e-14c3-4d4b-a594-4155d7cf9c32 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:04.618766 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717058e-14c3-4d4b-a594-4155d7cf9c32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:04.637620 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6717058e-14c3-4d4b-a594-4155d7cf9c32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:04.639381 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6717058e-14c3-4d4b-a594-4155d7cf9c32 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:04.666400 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3106/6183] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:32:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:32:06.675701 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11f01d-f597-4f00-98bb-14c8246b8668 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:06.677331 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5a11f01d-f597-4f00-98bb-14c8246b8668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:06.696041 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11f01d-f597-4f00-98bb-14c8246b8668 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:06.718644 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60f4ae-69bd-4636-9cf0-0d552481e711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:06.719979 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60f4ae-69bd-4636-9cf0-0d552481e711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:06.719979 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60f4ae-69bd-4636-9cf0-0d552481e711 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:06.720185 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60f4ae-69bd-4636-9cf0-0d552481e711 admin admin] PATH_INFO: `/v3/projects/58837c5ee6cf4adcaa7a8405d8dc9ea5` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:06.735110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60f4ae-69bd-4636-9cf0-0d552481e711 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58837c5ee6cf4adcaa7a8405d8dc9ea5)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:06.740594 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60f4ae-69bd-4636-9cf0-0d552481e711 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:06.973451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-fa60f4ae-69bd-4636-9cf0-0d552481e711 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58837c5ee6cf4adcaa7a8405d8dc9ea5', 'request_id': 'req-fa60f4ae-69bd-4636-9cf0-0d552481e711'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:06.996864 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-fa60f4ae-69bd-4636-9cf0-0d552481e711 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58837c5ee6cf4adcaa7a8405d8dc9ea5', 'request_id': 'req-fa60f4ae-69bd-4636-9cf0-0d552481e711'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:07.049697 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-fa60f4ae-69bd-4636-9cf0-0d552481e711 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58837c5ee6cf4adcaa7a8405d8dc9ea5', 'request_id': 'req-fa60f4ae-69bd-4636-9cf0-0d552481e711'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:07.162815 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-fa60f4ae-69bd-4636-9cf0-0d552481e711 admin admin] The token cache is being invalidate because project 58837c5ee6cf4adcaa7a8405d8dc9ea5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:32:07.164369 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-fa60f4ae-69bd-4636-9cf0-0d552481e711 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:07.165121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-fa60f4ae-69bd-4636-9cf0-0d552481e711 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:07.168419 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3078/6184] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:32:06 2022] DELETE /identity/v3/projects/58837c5ee6cf4adcaa7a8405d8dc9ea5 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:32:07.172655 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717058e-14c3-4d4b-a594-4155d7cf9c32 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:07.189570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717058e-14c3-4d4b-a594-4155d7cf9c32 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:07.461971 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602aeef-447f-4966-8cf6-f8976aee6601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:07.464381 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602aeef-447f-4966-8cf6-f8976aee6601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:07.464680 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602aeef-447f-4966-8cf6-f8976aee6601 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:07.465002 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602aeef-447f-4966-8cf6-f8976aee6601 admin admin] PATH_INFO: `/v3/users/d36e3413cf2b4d1e83466bff1b3d48a4` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:07.473257 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602aeef-447f-4966-8cf6-f8976aee6601 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d36e3413cf2b4d1e83466bff1b3d48a4)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:07.475381 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602aeef-447f-4966-8cf6-f8976aee6601 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:07.808122 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9602aeef-447f-4966-8cf6-f8976aee6601 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd36e3413cf2b4d1e83466bff1b3d48a4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:07.875892 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9602aeef-447f-4966-8cf6-f8976aee6601 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd36e3413cf2b4d1e83466bff1b3d48a4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:07.982498 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9602aeef-447f-4966-8cf6-f8976aee6601 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd36e3413cf2b4d1e83466bff1b3d48a4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:07.994875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9602aeef-447f-4966-8cf6-f8976aee6601 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd36e3413cf2b4d1e83466bff1b3d48a4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:07.997537 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9602aeef-447f-4966-8cf6-f8976aee6601 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd36e3413cf2b4d1e83466bff1b3d48a4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:08.040285 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3107/6185] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:32:07 2022] DELETE /identity/v3/users/d36e3413cf2b4d1e83466bff1b3d48a4 => generated 0 bytes in 864 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:32:10.369626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60f4ae-69bd-4636-9cf0-0d552481e711 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:10.371141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-fa60f4ae-69bd-4636-9cf0-0d552481e711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:10.418256 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60f4ae-69bd-4636-9cf0-0d552481e711 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:10.574597 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d3837-f0ed-493b-adca-d30f246487b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:10.575554 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d3837-f0ed-493b-adca-d30f246487b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:10.575839 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d3837-f0ed-493b-adca-d30f246487b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:10.576393 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d3837-f0ed-493b-adca-d30f246487b5 admin admin] PATH_INFO: `/v3/projects/8ee2c106a8674868aadc6e310694c241` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:10.578345 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d3837-f0ed-493b-adca-d30f246487b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ee2c106a8674868aadc6e310694c241)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:10.580500 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d3837-f0ed-493b-adca-d30f246487b5 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:10.786071 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-051d3837-f0ed-493b-adca-d30f246487b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ee2c106a8674868aadc6e310694c241', 'request_id': 'req-051d3837-f0ed-493b-adca-d30f246487b5'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:10.803407 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-051d3837-f0ed-493b-adca-d30f246487b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ee2c106a8674868aadc6e310694c241', 'request_id': 'req-051d3837-f0ed-493b-adca-d30f246487b5'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:10.832063 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-051d3837-f0ed-493b-adca-d30f246487b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ee2c106a8674868aadc6e310694c241', 'request_id': 'req-051d3837-f0ed-493b-adca-d30f246487b5'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:10.957020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-051d3837-f0ed-493b-adca-d30f246487b5 admin admin] The token cache is being invalidate because project 8ee2c106a8674868aadc6e310694c241 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:32:10.957020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-051d3837-f0ed-493b-adca-d30f246487b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:10.967356 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-051d3837-f0ed-493b-adca-d30f246487b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:10.978322 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3079/6186] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:32:10 2022] DELETE /identity/v3/projects/8ee2c106a8674868aadc6e310694c241 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:32:10.979576 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7441d-0acc-4b3e-a9b2-775489f8ccc2 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:10.980122 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7441d-0acc-4b3e-a9b2-775489f8ccc2 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:10.980122 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7441d-0acc-4b3e-a9b2-775489f8ccc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:11.026094 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-d2b7441d-0acc-4b3e-a9b2-775489f8ccc2 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:32:11.030256 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d2b7441d-0acc-4b3e-a9b2-775489f8ccc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:11.231628 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3108/6187] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:32:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:32:11.240216 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70ef77-840b-4992-8194-e9d239dbb800 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:11.240760 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70ef77-840b-4992-8194-e9d239dbb800 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:11.241731 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd70ef77-840b-4992-8194-e9d239dbb800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:11.292828 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-cd70ef77-840b-4992-8194-e9d239dbb800 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:32:11.294111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-cd70ef77-840b-4992-8194-e9d239dbb800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:11.340536 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3080/6188] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:32:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:32:11.341816 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7441d-0acc-4b3e-a9b2-775489f8ccc2 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:11.358797 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7441d-0acc-4b3e-a9b2-775489f8ccc2 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:11.364851 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d7d3e-d5f8-4ab7-904d-473427ac03b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:11.369507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d7d3e-d5f8-4ab7-904d-473427ac03b0 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:11.369507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d7d3e-d5f8-4ab7-904d-473427ac03b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:11.369507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d7d3e-d5f8-4ab7-904d-473427ac03b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:11.369507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971d7d3e-d5f8-4ab7-904d-473427ac03b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:32:11.369507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971d7d3e-d5f8-4ab7-904d-473427ac03b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:11.369507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971d7d3e-d5f8-4ab7-904d-473427ac03b0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:11.403165 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3109/6189] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:32:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:32:11.407545 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70ef77-840b-4992-8194-e9d239dbb800 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:11.423431 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd70ef77-840b-4992-8194-e9d239dbb800 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:11.462165 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d40c1a-0dde-4071-8b15-b6b48a19a738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:11.462865 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d40c1a-0dde-4071-8b15-b6b48a19a738 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:11.463155 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d40c1a-0dde-4071-8b15-b6b48a19a738 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:11.463432 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d40c1a-0dde-4071-8b15-b6b48a19a738 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:11.464155 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d40c1a-0dde-4071-8b15-b6b48a19a738 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:11.481806 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d40c1a-0dde-4071-8b15-b6b48a19a738 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:11.622518 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3081/6190] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:32:11 2022] POST /identity/v3/projects => generated 397 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:32:11.627802 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d7d3e-d5f8-4ab7-904d-473427ac03b0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:11.651922 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d7d3e-d5f8-4ab7-904d-473427ac03b0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:11.830823 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf590617-986e-4bc4-98ab-9ba04995236b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:11.831799 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf590617-986e-4bc4-98ab-9ba04995236b admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:11.832319 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf590617-986e-4bc4-98ab-9ba04995236b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:11.832757 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf590617-986e-4bc4-98ab-9ba04995236b admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:11.833782 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf590617-986e-4bc4-98ab-9ba04995236b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:11.835909 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf590617-986e-4bc4-98ab-9ba04995236b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:11.932336 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3110/6191] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:32:11 2022] POST /identity/v3/users => generated 305 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:32:11.937277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d40c1a-0dde-4071-8b15-b6b48a19a738 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:11.962063 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d40c1a-0dde-4071-8b15-b6b48a19a738 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:11.977368 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d29ea2-a9aa-4e79-96b9-f8a0deb263b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:11.978335 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d29ea2-a9aa-4e79-96b9-f8a0deb263b7 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:11.978735 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d29ea2-a9aa-4e79-96b9-f8a0deb263b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:11.979202 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d29ea2-a9aa-4e79-96b9-f8a0deb263b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:11.982073 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d29ea2-a9aa-4e79-96b9-f8a0deb263b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:11.984485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d29ea2-a9aa-4e79-96b9-f8a0deb263b7 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:12.028166 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3082/6192] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:32:12.029985 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf590617-986e-4bc4-98ab-9ba04995236b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:12.045064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf590617-986e-4bc4-98ab-9ba04995236b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:12.073393 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd187c5-7f64-4104-92f1-455efaa18683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:12.075488 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd187c5-7f64-4104-92f1-455efaa18683 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:12.078010 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd187c5-7f64-4104-92f1-455efaa18683 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:12.078593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd187c5-7f64-4104-92f1-455efaa18683 admin admin] PATH_INFO: `/v3/projects/797be23272aa466a9d79a02d84c87a83/users/df386c4d1f6e41219db33dcd30c80540/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:12.162894 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd187c5-7f64-4104-92f1-455efaa18683 admin admin] RBAC: Authorizing `identity:create_grant(project_id=797be23272aa466a9d79a02d84c87a83, user_id=df386c4d1f6e41219db33dcd30c80540, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:12.165936 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd187c5-7f64-4104-92f1-455efaa18683 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:12.285369 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3111/6193] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:32:12 2022] PUT /identity/v3/projects/797be23272aa466a9d79a02d84c87a83/users/df386c4d1f6e41219db33dcd30c80540/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:32:12.290452 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d29ea2-a9aa-4e79-96b9-f8a0deb263b7 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:12.314963 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d29ea2-a9aa-4e79-96b9-f8a0deb263b7 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:12.521359 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219aa3bf-4503-4e18-b005-49c9d1add3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:12.522467 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219aa3bf-4503-4e18-b005-49c9d1add3f7 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:12.522917 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219aa3bf-4503-4e18-b005-49c9d1add3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:12.523484 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219aa3bf-4503-4e18-b005-49c9d1add3f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:12.524544 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219aa3bf-4503-4e18-b005-49c9d1add3f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:12.526696 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219aa3bf-4503-4e18-b005-49c9d1add3f7 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:12.551417 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3083/6194] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:32:12.651010 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd187c5-7f64-4104-92f1-455efaa18683 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:12.680181 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd187c5-7f64-4104-92f1-455efaa18683 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:12.709420 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed86e4-f01a-4bac-8608-4b603cf6bad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:12.711723 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed86e4-f01a-4bac-8608-4b603cf6bad4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:12.714444 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed86e4-f01a-4bac-8608-4b603cf6bad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:12.714731 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed86e4-f01a-4bac-8608-4b603cf6bad4 admin admin] PATH_INFO: `/v3/projects/797be23272aa466a9d79a02d84c87a83/users/df386c4d1f6e41219db33dcd30c80540/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:12.718597 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed86e4-f01a-4bac-8608-4b603cf6bad4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=797be23272aa466a9d79a02d84c87a83, user_id=df386c4d1f6e41219db33dcd30c80540, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:12.723530 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed86e4-f01a-4bac-8608-4b603cf6bad4 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:12.757864 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3112/6195] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:32:12 2022] PUT /identity/v3/projects/797be23272aa466a9d79a02d84c87a83/users/df386c4d1f6e41219db33dcd30c80540/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:32:12.765198 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e7827-ad51-48f5-977f-7fd4485b9e4d None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:12.765586 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e7827-ad51-48f5-977f-7fd4485b9e4d None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:12.765933 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e7827-ad51-48f5-977f-7fd4485b9e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:12.803616 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-9d2e7827-ad51-48f5-977f-7fd4485b9e4d None None] MFA Rules not processed for user `df386c4d1f6e41219db33dcd30c80540`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:32:12.808721 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-9d2e7827-ad51-48f5-977f-7fd4485b9e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:13.131894 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed86e4-f01a-4bac-8608-4b603cf6bad4 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:13.136496 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3084/6196] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:32:12 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:32:13.340219 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed86e4-f01a-4bac-8608-4b603cf6bad4 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:13.353118 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3944b3-f915-4116-b647-4e19dde33c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:13.354176 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3944b3-f915-4116-b647-4e19dde33c5a admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:13.354640 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3944b3-f915-4116-b647-4e19dde33c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:13.355078 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3944b3-f915-4116-b647-4e19dde33c5a admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:13.355956 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3944b3-f915-4116-b647-4e19dde33c5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:13.362428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3944b3-f915-4116-b647-4e19dde33c5a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:13.513415 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3113/6197] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:32:13 2022] POST /identity/v3/projects => generated 397 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:32:13.518790 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e7827-ad51-48f5-977f-7fd4485b9e4d None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:13.539847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e7827-ad51-48f5-977f-7fd4485b9e4d None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:13.701456 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269b89f-5c6f-4126-af55-8391e8247d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:13.704752 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269b89f-5c6f-4126-af55-8391e8247d1b admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:13.704752 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269b89f-5c6f-4126-af55-8391e8247d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:13.704752 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269b89f-5c6f-4126-af55-8391e8247d1b admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:13.704752 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d269b89f-5c6f-4126-af55-8391e8247d1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:13.706289 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d269b89f-5c6f-4126-af55-8391e8247d1b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:13.815452 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3085/6198] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:32:13 2022] POST /identity/v3/users => generated 299 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:32:13.819881 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3944b3-f915-4116-b647-4e19dde33c5a admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:13.843838 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3944b3-f915-4116-b647-4e19dde33c5a admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:13.855491 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b1eb3-d3ba-4c2e-9bbc-629aaea8825f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:13.856468 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b1eb3-d3ba-4c2e-9bbc-629aaea8825f admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:13.857870 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b1eb3-d3ba-4c2e-9bbc-629aaea8825f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:13.858880 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b1eb3-d3ba-4c2e-9bbc-629aaea8825f admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:13.865174 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b1eb3-d3ba-4c2e-9bbc-629aaea8825f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:13.867100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b1eb3-d3ba-4c2e-9bbc-629aaea8825f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:13.887374 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3114/6199] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:32:13.891471 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269b89f-5c6f-4126-af55-8391e8247d1b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:13.910327 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269b89f-5c6f-4126-af55-8391e8247d1b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:13.924694 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af7963-7528-4120-82cb-774a97faf0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:13.925859 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af7963-7528-4120-82cb-774a97faf0df admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:13.926149 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af7963-7528-4120-82cb-774a97faf0df admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:13.926427 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af7963-7528-4120-82cb-774a97faf0df admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:13.927794 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af7963-7528-4120-82cb-774a97faf0df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:13.929111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af7963-7528-4120-82cb-774a97faf0df admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:13.962201 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3086/6200] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:32:13.966003 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b1eb3-d3ba-4c2e-9bbc-629aaea8825f admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:13.980360 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b1eb3-d3ba-4c2e-9bbc-629aaea8825f admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:13.986860 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c53cc-306d-476f-adb2-85684a202dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:13.987109 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c53cc-306d-476f-adb2-85684a202dd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:13.987338 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c53cc-306d-476f-adb2-85684a202dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:13.987616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c53cc-306d-476f-adb2-85684a202dd9 admin admin] PATH_INFO: `/v3/projects/a1bf82d8523f41b09ea8efb81356dd03/users/d273415b74414764bc353cedbc7c237d/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:14.036649 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c53cc-306d-476f-adb2-85684a202dd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1bf82d8523f41b09ea8efb81356dd03, user_id=d273415b74414764bc353cedbc7c237d, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:14.039411 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c53cc-306d-476f-adb2-85684a202dd9 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:14.161508 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3115/6201] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:32:13 2022] PUT /identity/v3/projects/a1bf82d8523f41b09ea8efb81356dd03/users/d273415b74414764bc353cedbc7c237d/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:32:14.172097 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbf523-8378-484f-8bf0-cdca29271f92 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:14.173235 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbf523-8378-484f-8bf0-cdca29271f92 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:14.173681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbf523-8378-484f-8bf0-cdca29271f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:14.254220 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-abbbf523-8378-484f-8bf0-cdca29271f92 None None] MFA Rules not processed for user `d273415b74414764bc353cedbc7c237d`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:32:14.255472 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-abbbf523-8378-484f-8bf0-cdca29271f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:14.442419 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3087/6202] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:32:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:32:15.545184 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894ebc9-8764-4943-9550-81dd61dbc4be None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:15.545859 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894ebc9-8764-4943-9550-81dd61dbc4be None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:15.546266 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894ebc9-8764-4943-9550-81dd61dbc4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:15.678133 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-5894ebc9-8764-4943-9550-81dd61dbc4be None None] MFA Rules not processed for user `f5f04392a4c94046bc7da53b4dffb0e3`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:32:15.679753 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5894ebc9-8764-4943-9550-81dd61dbc4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:15.995763 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd8e60-cfa0-4765-aef2-47e235260ce9 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:15.997460 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd8e60-cfa0-4765-aef2-47e235260ce9 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:15.999003 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd8e60-cfa0-4765-aef2-47e235260ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:16.005794 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3116/6203] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:32:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:32:16.041320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-42fd8e60-cfa0-4765-aef2-47e235260ce9 None None] MFA Rules not processed for user `f5f04392a4c94046bc7da53b4dffb0e3`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:32:16.046502 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-42fd8e60-cfa0-4765-aef2-47e235260ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:16.067644 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3088/6204] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:32:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:32:16.077023 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894ebc9-8764-4943-9550-81dd61dbc4be None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:16.078671 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5894ebc9-8764-4943-9550-81dd61dbc4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:16.087686 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd8e60-cfa0-4765-aef2-47e235260ce9 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:16.089457 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-42fd8e60-cfa0-4765-aef2-47e235260ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:16.204701 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd8e60-cfa0-4765-aef2-47e235260ce9 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:16.216281 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c142779-c354-4a88-852a-20c3a04f3cb1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e302b1298dd04d6590e3d079f7b13b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:16.216966 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c142779-c354-4a88-852a-20c3a04f3cb1 service glance] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:16.217728 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c142779-c354-4a88-852a-20c3a04f3cb1 service glance] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:16.217728 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c142779-c354-4a88-852a-20c3a04f3cb1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:16.242422 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2c142779-c354-4a88-852a-20c3a04f3cb1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:16.260806 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894ebc9-8764-4943-9550-81dd61dbc4be None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:16.268442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b724ac-5cfb-4f0f-adea-b7ff564b92cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:16.269443 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b724ac-5cfb-4f0f-adea-b7ff564b92cf service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:16.269982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b724ac-5cfb-4f0f-adea-b7ff564b92cf service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:16.275368 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b724ac-5cfb-4f0f-adea-b7ff564b92cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:16.315016 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b724ac-5cfb-4f0f-adea-b7ff564b92cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:16.318002 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b724ac-5cfb-4f0f-adea-b7ff564b92cf service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:16.330887 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3117/6205] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:32:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:32:16.409255 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c142779-c354-4a88-852a-20c3a04f3cb1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:16.409912 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c142779-c354-4a88-852a-20c3a04f3cb1 service glance] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:16.422986 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3089/6206] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:32:16 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:32:16.611012 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b724ac-5cfb-4f0f-adea-b7ff564b92cf service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:16.637912 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b724ac-5cfb-4f0f-adea-b7ff564b92cf service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:16.662784 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f6f0a-8bd4-4ecb-8c4b-46a052599b9a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e302b1298dd04d6590e3d079f7b13b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:16.664154 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f6f0a-8bd4-4ecb-8c4b-46a052599b9a service glance] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:16.665300 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f6f0a-8bd4-4ecb-8c4b-46a052599b9a service glance] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:16.665951 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f6f0a-8bd4-4ecb-8c4b-46a052599b9a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:16.800620 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f6f0a-8bd4-4ecb-8c4b-46a052599b9a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:16.806135 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f6f0a-8bd4-4ecb-8c4b-46a052599b9a service glance] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:16.838889 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3118/6207] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:32:16 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:32:19.366351 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c142779-c354-4a88-852a-20c3a04f3cb1 service glance] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:19.535864 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c142779-c354-4a88-852a-20c3a04f3cb1 service glance] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:19.539070 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce741f4d-68da-48c0-adaa-2ac516468bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:19.540115 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce741f4d-68da-48c0-adaa-2ac516468bea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:19.540523 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce741f4d-68da-48c0-adaa-2ac516468bea admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:19.541006 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce741f4d-68da-48c0-adaa-2ac516468bea admin admin] PATH_INFO: `/v3/users/df386c4d1f6e41219db33dcd30c80540` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:19.542607 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce741f4d-68da-48c0-adaa-2ac516468bea admin admin] RBAC: Authorizing `identity:delete_user(user_id=df386c4d1f6e41219db33dcd30c80540)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:19.545844 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce741f4d-68da-48c0-adaa-2ac516468bea admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:19.810471 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ce741f4d-68da-48c0-adaa-2ac516468bea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df386c4d1f6e41219db33dcd30c80540'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:19.849738 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ce741f4d-68da-48c0-adaa-2ac516468bea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df386c4d1f6e41219db33dcd30c80540'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:19.999920 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ce741f4d-68da-48c0-adaa-2ac516468bea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df386c4d1f6e41219db33dcd30c80540'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:19.999920 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ce741f4d-68da-48c0-adaa-2ac516468bea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df386c4d1f6e41219db33dcd30c80540'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:20.004045 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ce741f4d-68da-48c0-adaa-2ac516468bea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df386c4d1f6e41219db33dcd30c80540'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:20.038529 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3090/6208] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:32:19 2022] DELETE /identity/v3/users/df386c4d1f6e41219db33dcd30c80540 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:32:20.040518 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9dff64-e0a7-4cc3-83d8-39331db5689a None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:20.041030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9dff64-e0a7-4cc3-83d8-39331db5689a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:20.041126 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9dff64-e0a7-4cc3-83d8-39331db5689a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:20.075878 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-eb9dff64-e0a7-4cc3-83d8-39331db5689a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:32:20.085389 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-eb9dff64-e0a7-4cc3-83d8-39331db5689a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:20.225947 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3119/6209] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:32:20.235182 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce741f4d-68da-48c0-adaa-2ac516468bea admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:20.236827 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ce741f4d-68da-48c0-adaa-2ac516468bea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:20.471082 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce741f4d-68da-48c0-adaa-2ac516468bea admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:20.489437 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2bcc66-c46e-491b-8253-6ff3a0a2351a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:20.490187 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2bcc66-c46e-491b-8253-6ff3a0a2351a service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:20.490486 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2bcc66-c46e-491b-8253-6ff3a0a2351a service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:20.490753 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2bcc66-c46e-491b-8253-6ff3a0a2351a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:20.556747 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2bcc66-c46e-491b-8253-6ff3a0a2351a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:20.558266 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2bcc66-c46e-491b-8253-6ff3a0a2351a service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:20.591445 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3091/6210] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:32:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:32:20.666003 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9dff64-e0a7-4cc3-83d8-39331db5689a None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:20.668041 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-eb9dff64-e0a7-4cc3-83d8-39331db5689a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:20.693364 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9dff64-e0a7-4cc3-83d8-39331db5689a None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:20.706049 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef94b9-df67-465c-8e76-8380bf5bc6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:20.709252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef94b9-df67-465c-8e76-8380bf5bc6ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:20.710848 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef94b9-df67-465c-8e76-8380bf5bc6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:20.711663 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef94b9-df67-465c-8e76-8380bf5bc6ae admin admin] PATH_INFO: `/v3/users/7a2dca900ba748f58c290f52931d8007` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:20.715334 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ef94b9-df67-465c-8e76-8380bf5bc6ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a2dca900ba748f58c290f52931d8007)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:20.721789 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ef94b9-df67-465c-8e76-8380bf5bc6ae admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:21.128816 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-03ef94b9-df67-465c-8e76-8380bf5bc6ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a2dca900ba748f58c290f52931d8007'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:21.212231 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-03ef94b9-df67-465c-8e76-8380bf5bc6ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a2dca900ba748f58c290f52931d8007'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:21.304059 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-03ef94b9-df67-465c-8e76-8380bf5bc6ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a2dca900ba748f58c290f52931d8007'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:21.313593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-03ef94b9-df67-465c-8e76-8380bf5bc6ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a2dca900ba748f58c290f52931d8007'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:21.316097 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-03ef94b9-df67-465c-8e76-8380bf5bc6ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a2dca900ba748f58c290f52931d8007'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:21.338810 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3120/6211] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:32:20 2022] DELETE /identity/v3/users/7a2dca900ba748f58c290f52931d8007 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:32:21.339317 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2b167-be22-4d0e-9e9e-79fd4caee446 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:21.340081 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2b167-be22-4d0e-9e9e-79fd4caee446 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:21.340374 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2b167-be22-4d0e-9e9e-79fd4caee446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:21.379047 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-93f2b167-be22-4d0e-9e9e-79fd4caee446 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:32:21.380673 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-93f2b167-be22-4d0e-9e9e-79fd4caee446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:21.471880 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef94b9-df67-465c-8e76-8380bf5bc6ae admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:21.474338 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-03ef94b9-df67-465c-8e76-8380bf5bc6ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:21.560900 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3092/6212] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:32:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:32:21.600189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2b167-be22-4d0e-9e9e-79fd4caee446 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:21.602088 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-93f2b167-be22-4d0e-9e9e-79fd4caee446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:21.627693 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef94b9-df67-465c-8e76-8380bf5bc6ae admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:21.647074 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd22703-8f9f-4283-931b-f5ca948f13d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:21.648419 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd22703-8f9f-4283-931b-f5ca948f13d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:21.648649 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd22703-8f9f-4283-931b-f5ca948f13d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:21.648773 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd22703-8f9f-4283-931b-f5ca948f13d5 admin admin] PATH_INFO: `/v3/projects/797be23272aa466a9d79a02d84c87a83` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:21.656259 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd22703-8f9f-4283-931b-f5ca948f13d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=797be23272aa466a9d79a02d84c87a83)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:21.656259 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd22703-8f9f-4283-931b-f5ca948f13d5 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:21.769353 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2b167-be22-4d0e-9e9e-79fd4caee446 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:21.775091 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71a15a-13b9-46bf-ab67-9b12395306fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:21.775970 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71a15a-13b9-46bf-ab67-9b12395306fa service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:21.776507 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71a15a-13b9-46bf-ab67-9b12395306fa service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:21.777229 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71a15a-13b9-46bf-ab67-9b12395306fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:21.833652 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71a15a-13b9-46bf-ab67-9b12395306fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:21.839963 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2dd22703-8f9f-4283-931b-f5ca948f13d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '797be23272aa466a9d79a02d84c87a83', 'request_id': 'req-2dd22703-8f9f-4283-931b-f5ca948f13d5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:21.845687 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71a15a-13b9-46bf-ab67-9b12395306fa service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:21.872646 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2dd22703-8f9f-4283-931b-f5ca948f13d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '797be23272aa466a9d79a02d84c87a83', 'request_id': 'req-2dd22703-8f9f-4283-931b-f5ca948f13d5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:21.891982 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3093/6213] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:32:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:32:21.896725 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2dd22703-8f9f-4283-931b-f5ca948f13d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '797be23272aa466a9d79a02d84c87a83', 'request_id': 'req-2dd22703-8f9f-4283-931b-f5ca948f13d5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:22.008664 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2dd22703-8f9f-4283-931b-f5ca948f13d5 admin admin] The token cache is being invalidate because project 797be23272aa466a9d79a02d84c87a83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:32:22.009169 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2dd22703-8f9f-4283-931b-f5ca948f13d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:22.011077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2dd22703-8f9f-4283-931b-f5ca948f13d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:22.016133 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3121/6214] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:32:21 2022] DELETE /identity/v3/projects/797be23272aa466a9d79a02d84c87a83 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:32:22.017651 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71a15a-13b9-46bf-ab67-9b12395306fa service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:22.046493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71a15a-13b9-46bf-ab67-9b12395306fa service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:22.141321 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7076e2-e86e-4573-bc82-87c994042bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:22.142441 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7076e2-e86e-4573-bc82-87c994042bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:22.142865 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7076e2-e86e-4573-bc82-87c994042bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:22.143361 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7076e2-e86e-4573-bc82-87c994042bcd admin admin] PATH_INFO: `/v3/users/d273415b74414764bc353cedbc7c237d` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:22.144985 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7076e2-e86e-4573-bc82-87c994042bcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d273415b74414764bc353cedbc7c237d)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:22.147614 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7076e2-e86e-4573-bc82-87c994042bcd admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:22.918627 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-aa7076e2-e86e-4573-bc82-87c994042bcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd273415b74414764bc353cedbc7c237d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:22.934980 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-aa7076e2-e86e-4573-bc82-87c994042bcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd273415b74414764bc353cedbc7c237d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:23.085622 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-aa7076e2-e86e-4573-bc82-87c994042bcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd273415b74414764bc353cedbc7c237d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:23.087930 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-aa7076e2-e86e-4573-bc82-87c994042bcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd273415b74414764bc353cedbc7c237d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:23.099853 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-aa7076e2-e86e-4573-bc82-87c994042bcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd273415b74414764bc353cedbc7c237d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:23.123355 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3094/6215] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:32:22 2022] DELETE /identity/v3/users/d273415b74414764bc353cedbc7c237d => generated 0 bytes in 1105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:32:24.004237 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd22703-8f9f-4283-931b-f5ca948f13d5 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:24.005859 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2dd22703-8f9f-4283-931b-f5ca948f13d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:24.027012 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd22703-8f9f-4283-931b-f5ca948f13d5 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:24.139843 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4576f9d0-c75c-4ebf-a3b5-7ba49ab831ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:24.141034 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576f9d0-c75c-4ebf-a3b5-7ba49ab831ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:24.145948 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576f9d0-c75c-4ebf-a3b5-7ba49ab831ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:24.145948 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576f9d0-c75c-4ebf-a3b5-7ba49ab831ea admin admin] PATH_INFO: `/v3/projects/c6f5fd53a3944e8e9a4d9fbb1e6060ef` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:24.151407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4576f9d0-c75c-4ebf-a3b5-7ba49ab831ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6f5fd53a3944e8e9a4d9fbb1e6060ef)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:24.156192 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4576f9d0-c75c-4ebf-a3b5-7ba49ab831ea admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:24.435361 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4576f9d0-c75c-4ebf-a3b5-7ba49ab831ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6f5fd53a3944e8e9a4d9fbb1e6060ef', 'request_id': 'req-4576f9d0-c75c-4ebf-a3b5-7ba49ab831ea'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:24.458223 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4576f9d0-c75c-4ebf-a3b5-7ba49ab831ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6f5fd53a3944e8e9a4d9fbb1e6060ef', 'request_id': 'req-4576f9d0-c75c-4ebf-a3b5-7ba49ab831ea'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:24.471656 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4576f9d0-c75c-4ebf-a3b5-7ba49ab831ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6f5fd53a3944e8e9a4d9fbb1e6060ef', 'request_id': 'req-4576f9d0-c75c-4ebf-a3b5-7ba49ab831ea'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:24.592279 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4576f9d0-c75c-4ebf-a3b5-7ba49ab831ea admin admin] The token cache is being invalidate because project c6f5fd53a3944e8e9a4d9fbb1e6060ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:32:24.593316 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4576f9d0-c75c-4ebf-a3b5-7ba49ab831ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:24.595756 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4576f9d0-c75c-4ebf-a3b5-7ba49ab831ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:24.603452 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3122/6216] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:32:24 2022] DELETE /identity/v3/projects/c6f5fd53a3944e8e9a4d9fbb1e6060ef => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:32:24.617547 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7076e2-e86e-4573-bc82-87c994042bcd admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:24.619443 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-aa7076e2-e86e-4573-bc82-87c994042bcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:24.645750 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7076e2-e86e-4573-bc82-87c994042bcd admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:24.811777 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8449a28-e723-47bf-a951-33c85961335f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:24.812974 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8449a28-e723-47bf-a951-33c85961335f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:24.825044 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8449a28-e723-47bf-a951-33c85961335f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:24.825674 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8449a28-e723-47bf-a951-33c85961335f admin admin] PATH_INFO: `/v3/users/eae8335b02834626ae6a525d35a0fb2e` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:24.827834 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8449a28-e723-47bf-a951-33c85961335f admin admin] RBAC: Authorizing `identity:delete_user(user_id=eae8335b02834626ae6a525d35a0fb2e)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:24.830219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8449a28-e723-47bf-a951-33c85961335f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:25.136518 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e8449a28-e723-47bf-a951-33c85961335f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eae8335b02834626ae6a525d35a0fb2e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:25.187022 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e8449a28-e723-47bf-a951-33c85961335f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eae8335b02834626ae6a525d35a0fb2e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:25.332280 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e8449a28-e723-47bf-a951-33c85961335f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eae8335b02834626ae6a525d35a0fb2e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:25.334573 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e8449a28-e723-47bf-a951-33c85961335f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eae8335b02834626ae6a525d35a0fb2e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:25.345052 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e8449a28-e723-47bf-a951-33c85961335f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eae8335b02834626ae6a525d35a0fb2e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:25.366280 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3095/6217] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:32:24 2022] DELETE /identity/v3/users/eae8335b02834626ae6a525d35a0fb2e => generated 0 bytes in 749 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:32:25.384290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4576f9d0-c75c-4ebf-a3b5-7ba49ab831ea admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:25.386742 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4576f9d0-c75c-4ebf-a3b5-7ba49ab831ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:25.412448 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4576f9d0-c75c-4ebf-a3b5-7ba49ab831ea admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:25.578598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12efd45f-18d1-41d6-a685-509588f4d2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:25.579804 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efd45f-18d1-41d6-a685-509588f4d2e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:25.580602 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efd45f-18d1-41d6-a685-509588f4d2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:25.581033 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efd45f-18d1-41d6-a685-509588f4d2e1 admin admin] PATH_INFO: `/v3/projects/a1bf82d8523f41b09ea8efb81356dd03` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:25.584172 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12efd45f-18d1-41d6-a685-509588f4d2e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1bf82d8523f41b09ea8efb81356dd03)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:25.586429 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12efd45f-18d1-41d6-a685-509588f4d2e1 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:25.758224 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-12efd45f-18d1-41d6-a685-509588f4d2e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1bf82d8523f41b09ea8efb81356dd03', 'request_id': 'req-12efd45f-18d1-41d6-a685-509588f4d2e1'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:25.765451 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-12efd45f-18d1-41d6-a685-509588f4d2e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1bf82d8523f41b09ea8efb81356dd03', 'request_id': 'req-12efd45f-18d1-41d6-a685-509588f4d2e1'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:25.773639 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-12efd45f-18d1-41d6-a685-509588f4d2e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1bf82d8523f41b09ea8efb81356dd03', 'request_id': 'req-12efd45f-18d1-41d6-a685-509588f4d2e1'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:25.907050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eea9b0-a6b1-4068-b5b1-f1cda1aa8353 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:25.907670 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eea9b0-a6b1-4068-b5b1-f1cda1aa8353 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:25.907670 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eea9b0-a6b1-4068-b5b1-f1cda1aa8353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:25.918170 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-12efd45f-18d1-41d6-a685-509588f4d2e1 admin admin] The token cache is being invalidate because project a1bf82d8523f41b09ea8efb81356dd03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:32:25.918170 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-12efd45f-18d1-41d6-a685-509588f4d2e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:25.921190 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-12efd45f-18d1-41d6-a685-509588f4d2e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:25.927678 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3123/6218] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:32:25 2022] DELETE /identity/v3/projects/a1bf82d8523f41b09ea8efb81356dd03 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:32:25.930097 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df490a1-d102-4190-8093-f43979800f33 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:25.973786 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-32eea9b0-a6b1-4068-b5b1-f1cda1aa8353 None None] MFA Rules not processed for user `41a26877b24c4687a0c8cc4ffc6d69dd`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:32:25.975371 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-32eea9b0-a6b1-4068-b5b1-f1cda1aa8353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:25.976360 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df490a1-d102-4190-8093-f43979800f33 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:25.979317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df490a1-d102-4190-8093-f43979800f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:26.141959 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-0df490a1-d102-4190-8093-f43979800f33 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:32:26.141959 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0df490a1-d102-4190-8093-f43979800f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:26.142880 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3096/6219] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:32:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:32:26.173649 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3124/6220] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:32:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:32:26.178859 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808cd3d-95d8-4e2f-9003-9c5af34443e7 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:26.179180 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808cd3d-95d8-4e2f-9003-9c5af34443e7 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:26.179413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808cd3d-95d8-4e2f-9003-9c5af34443e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:26.218191 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-2808cd3d-95d8-4e2f-9003-9c5af34443e7 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:32:26.220151 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2808cd3d-95d8-4e2f-9003-9c5af34443e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:26.233944 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3097/6221] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:32:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:32:26.236263 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df490a1-d102-4190-8093-f43979800f33 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:26.248364 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df490a1-d102-4190-8093-f43979800f33 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:26.255834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a398e79-b96b-415d-8dcd-8c8e5b93be0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:26.257104 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a398e79-b96b-415d-8dcd-8c8e5b93be0d admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:26.257663 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a398e79-b96b-415d-8dcd-8c8e5b93be0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:26.258256 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a398e79-b96b-415d-8dcd-8c8e5b93be0d admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:26.260252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a398e79-b96b-415d-8dcd-8c8e5b93be0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:32:26.260788 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a398e79-b96b-415d-8dcd-8c8e5b93be0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:26.262891 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a398e79-b96b-415d-8dcd-8c8e5b93be0d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:26.286840 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3125/6222] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:32:26.294621 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808cd3d-95d8-4e2f-9003-9c5af34443e7 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:26.307004 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808cd3d-95d8-4e2f-9003-9c5af34443e7 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:26.315633 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7d4f8-cb21-4e52-a6ea-e75da8f98454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:26.320036 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7d4f8-cb21-4e52-a6ea-e75da8f98454 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:26.320036 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7d4f8-cb21-4e52-a6ea-e75da8f98454 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:26.320036 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7d4f8-cb21-4e52-a6ea-e75da8f98454 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:26.320036 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7d4f8-cb21-4e52-a6ea-e75da8f98454 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:26.320036 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7d4f8-cb21-4e52-a6ea-e75da8f98454 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:26.403894 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57aa15-5c36-41dc-9f62-126f67b31b5f None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:26.405016 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57aa15-5c36-41dc-9f62-126f67b31b5f None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:26.405255 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57aa15-5c36-41dc-9f62-126f67b31b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:26.437406 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3098/6223] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:32:26 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:32:26.439759 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7d4f8-cb21-4e52-a6ea-e75da8f98454 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:26.557480 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-ab57aa15-5c36-41dc-9f62-126f67b31b5f None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:32:26.558774 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ab57aa15-5c36-41dc-9f62-126f67b31b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:26.560110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7d4f8-cb21-4e52-a6ea-e75da8f98454 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:26.578160 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a7bbf-3830-484c-8e07-6903305f8d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:26.578857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a7bbf-3830-484c-8e07-6903305f8d11 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:26.579148 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a7bbf-3830-484c-8e07-6903305f8d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:26.579433 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a7bbf-3830-484c-8e07-6903305f8d11 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:26.582868 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a7bbf-3830-484c-8e07-6903305f8d11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:26.587090 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a7bbf-3830-484c-8e07-6903305f8d11 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:26.713554 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3099/6224] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:32:26 2022] POST /identity/v3/users => generated 287 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:32:26.718805 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a7bbf-3830-484c-8e07-6903305f8d11 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:26.755872 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a7bbf-3830-484c-8e07-6903305f8d11 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:26.778909 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244969da-c414-4b0f-9604-658fd3259c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:26.780178 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244969da-c414-4b0f-9604-658fd3259c03 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:26.780470 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244969da-c414-4b0f-9604-658fd3259c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:26.780761 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244969da-c414-4b0f-9604-658fd3259c03 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:26.781506 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244969da-c414-4b0f-9604-658fd3259c03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:26.792028 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244969da-c414-4b0f-9604-658fd3259c03 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:26.795510 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3126/6225] 10.222.0.23 () {58 vars in 967 bytes} [Sat Apr 30 21:32:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:32:26.814160 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57aa15-5c36-41dc-9f62-126f67b31b5f None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:26.815618 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ab57aa15-5c36-41dc-9f62-126f67b31b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:26.838970 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3100/6226] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:32:26.843239 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244969da-c414-4b0f-9604-658fd3259c03 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:26.867056 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244969da-c414-4b0f-9604-658fd3259c03 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:26.883080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f3ee3-417d-4a51-9b53-4b60c0503eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:26.889282 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f3ee3-417d-4a51-9b53-4b60c0503eca admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:26.889933 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f3ee3-417d-4a51-9b53-4b60c0503eca admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:26.890357 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f3ee3-417d-4a51-9b53-4b60c0503eca admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:26.891312 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f3ee3-417d-4a51-9b53-4b60c0503eca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:26.893429 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f3ee3-417d-4a51-9b53-4b60c0503eca admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:26.908941 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3101/6227] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:32:26.913216 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f3ee3-417d-4a51-9b53-4b60c0503eca admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:26.926184 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f3ee3-417d-4a51-9b53-4b60c0503eca admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:26.937905 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d338b-c538-476e-a31e-0d42f35abd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:26.939111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d338b-c538-476e-a31e-0d42f35abd56 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:26.939886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d338b-c538-476e-a31e-0d42f35abd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:26.940455 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d338b-c538-476e-a31e-0d42f35abd56 admin admin] PATH_INFO: `/v3/projects/a1c3513665964382aab6ef50ae08ef66/users/46807d62ce6841b28324dd9a8846e155/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:26.966132 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d338b-c538-476e-a31e-0d42f35abd56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1c3513665964382aab6ef50ae08ef66, user_id=46807d62ce6841b28324dd9a8846e155, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:26.969905 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d338b-c538-476e-a31e-0d42f35abd56 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:27.021951 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57aa15-5c36-41dc-9f62-126f67b31b5f None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:27.033578 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7eee2d-e46b-4306-8509-31dae6165e81 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:27.034788 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7eee2d-e46b-4306-8509-31dae6165e81 service swift] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:27.035765 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7eee2d-e46b-4306-8509-31dae6165e81 service swift] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:27.036398 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7eee2d-e46b-4306-8509-31dae6165e81 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:27.053486 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7eee2d-e46b-4306-8509-31dae6165e81 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:27.053486 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7eee2d-e46b-4306-8509-31dae6165e81 service swift] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:27.064117 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3102/6228] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:32:26 2022] PUT /identity/v3/projects/a1c3513665964382aab6ef50ae08ef66/users/46807d62ce6841b28324dd9a8846e155/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:32:27.071328 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3127/6229] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:32:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 30 21:32:27.077090 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb2f88-fb65-44f3-858c-5008037607bd None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:27.077579 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb2f88-fb65-44f3-858c-5008037607bd None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:27.079436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cb2f88-fb65-44f3-858c-5008037607bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:27.143630 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-f8cb2f88-fb65-44f3-858c-5008037607bd None None] MFA Rules not processed for user `46807d62ce6841b28324dd9a8846e155`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:32:27.147588 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f8cb2f88-fb65-44f3-858c-5008037607bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:27.268371 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7eee2d-e46b-4306-8509-31dae6165e81 service swift] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:27.270020 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0f7eee2d-e46b-4306-8509-31dae6165e81 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:27.310925 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7eee2d-e46b-4306-8509-31dae6165e81 service swift] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:27.334738 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3103/6230] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:32:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:32:27.340007 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb2f88-fb65-44f3-858c-5008037607bd None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:27.481724 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd1fe2-8d1e-429b-a2f0-3ba79f3c8f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:27.487133 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd1fe2-8d1e-429b-a2f0-3ba79f3c8f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:27.487133 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd1fe2-8d1e-429b-a2f0-3ba79f3c8f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:27.487329 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd1fe2-8d1e-429b-a2f0-3ba79f3c8f00 admin admin] PATH_INFO: `/v3/projects/369d881ea2a747aababdba3f7b35d421` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:27.490673 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd1fe2-8d1e-429b-a2f0-3ba79f3c8f00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=369d881ea2a747aababdba3f7b35d421)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:27.492576 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd1fe2-8d1e-429b-a2f0-3ba79f3c8f00 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:27.505710 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cb2f88-fb65-44f3-858c-5008037607bd None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:27.525610 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c34f4d-de6c-4af9-9808-0c57cfa32236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:27.526873 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c34f4d-de6c-4af9-9808-0c57cfa32236 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:27.527386 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c34f4d-de6c-4af9-9808-0c57cfa32236 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:27.527884 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c34f4d-de6c-4af9-9808-0c57cfa32236 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:27.528805 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c34f4d-de6c-4af9-9808-0c57cfa32236 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:27.533635 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c34f4d-de6c-4af9-9808-0c57cfa32236 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:27.715411 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5ddd1fe2-8d1e-429b-a2f0-3ba79f3c8f00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '369d881ea2a747aababdba3f7b35d421', 'request_id': 'req-5ddd1fe2-8d1e-429b-a2f0-3ba79f3c8f00'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:27.721172 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3104/6231] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:32:27 2022] POST /identity/v3/projects => generated 373 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:32:27.724864 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5ddd1fe2-8d1e-429b-a2f0-3ba79f3c8f00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '369d881ea2a747aababdba3f7b35d421', 'request_id': 'req-5ddd1fe2-8d1e-429b-a2f0-3ba79f3c8f00'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:27.725336 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c34f4d-de6c-4af9-9808-0c57cfa32236 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:27.734516 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5ddd1fe2-8d1e-429b-a2f0-3ba79f3c8f00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '369d881ea2a747aababdba3f7b35d421', 'request_id': 'req-5ddd1fe2-8d1e-429b-a2f0-3ba79f3c8f00'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:27.852404 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5ddd1fe2-8d1e-429b-a2f0-3ba79f3c8f00 admin admin] The token cache is being invalidate because project 369d881ea2a747aababdba3f7b35d421 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:32:27.852404 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5ddd1fe2-8d1e-429b-a2f0-3ba79f3c8f00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:27.856284 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5ddd1fe2-8d1e-429b-a2f0-3ba79f3c8f00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:27.863580 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c34f4d-de6c-4af9-9808-0c57cfa32236 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:27.863966 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3128/6232] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:32:27 2022] DELETE /identity/v3/projects/369d881ea2a747aababdba3f7b35d421 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:32:27.866879 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fae6e-546a-4ea2-81d9-3b923210cb5c None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:27.867364 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fae6e-546a-4ea2-81d9-3b923210cb5c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:27.868358 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fae6e-546a-4ea2-81d9-3b923210cb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:27.877013 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69526748-2ad5-429a-aaa5-7464bea4e342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:27.881129 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69526748-2ad5-429a-aaa5-7464bea4e342 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:27.885620 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69526748-2ad5-429a-aaa5-7464bea4e342 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:27.885620 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69526748-2ad5-429a-aaa5-7464bea4e342 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:27.885620 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69526748-2ad5-429a-aaa5-7464bea4e342 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:27.887989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69526748-2ad5-429a-aaa5-7464bea4e342 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:27.903146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-111fae6e-546a-4ea2-81d9-3b923210cb5c None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:32:27.905267 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-111fae6e-546a-4ea2-81d9-3b923210cb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:27.943476 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3129/6233] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:32:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:32:27.945738 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31599e-28c3-4e8e-ac62-fe0473620e17 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:27.945738 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31599e-28c3-4e8e-ac62-fe0473620e17 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:27.946157 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31599e-28c3-4e8e-ac62-fe0473620e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:27.973242 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-ee31599e-28c3-4e8e-ac62-fe0473620e17 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:32:27.973242 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ee31599e-28c3-4e8e-ac62-fe0473620e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:27.985213 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3130/6234] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:32:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:32:27.986515 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee31599e-28c3-4e8e-ac62-fe0473620e17 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:27.996880 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee31599e-28c3-4e8e-ac62-fe0473620e17 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:28.002553 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f2274-1f88-4b09-87fd-7054cd879222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:28.003657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f2274-1f88-4b09-87fd-7054cd879222 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:28.004154 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f2274-1f88-4b09-87fd-7054cd879222 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:28.004580 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f2274-1f88-4b09-87fd-7054cd879222 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:28.010311 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68f2274-1f88-4b09-87fd-7054cd879222 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:32:28.010970 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68f2274-1f88-4b09-87fd-7054cd879222 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:28.013065 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68f2274-1f88-4b09-87fd-7054cd879222 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:28.033686 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3131/6235] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:32:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:32:28.035482 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f2274-1f88-4b09-87fd-7054cd879222 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:28.046602 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3105/6236] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:32:27 2022] POST /identity/v3/users => generated 293 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:32:28.049812 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f2274-1f88-4b09-87fd-7054cd879222 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:28.055457 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69526748-2ad5-429a-aaa5-7464bea4e342 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:28.063282 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a0963-fd9e-495e-a78a-530821144965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:28.068332 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a0963-fd9e-495e-a78a-530821144965 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:28.068610 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a0963-fd9e-495e-a78a-530821144965 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:28.075434 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a0963-fd9e-495e-a78a-530821144965 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:28.075434 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a0963-fd9e-495e-a78a-530821144965 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:28.075434 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a0963-fd9e-495e-a78a-530821144965 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:28.082267 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-69526748-2ad5-429a-aaa5-7464bea4e342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:28.172319 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69526748-2ad5-429a-aaa5-7464bea4e342 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:28.195209 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6f813-f0c7-4c2e-bd63-bee0b282eb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:28.197730 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6f813-f0c7-4c2e-bd63-bee0b282eb2e admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:28.198413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6f813-f0c7-4c2e-bd63-bee0b282eb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:28.198702 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6f813-f0c7-4c2e-bd63-bee0b282eb2e admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:28.200911 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca6f813-f0c7-4c2e-bd63-bee0b282eb2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:28.203932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca6f813-f0c7-4c2e-bd63-bee0b282eb2e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:28.242256 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3106/6237] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:32:28.246768 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6f813-f0c7-4c2e-bd63-bee0b282eb2e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:28.256890 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3132/6238] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:32:28 2022] POST /identity/v3/projects => generated 381 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:32:28.261279 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a0963-fd9e-495e-a78a-530821144965 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:28.295628 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6f813-f0c7-4c2e-bd63-bee0b282eb2e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:28.472431 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a0963-fd9e-495e-a78a-530821144965 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:28.479878 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c9df9-35da-4ed1-9075-4c7bbba6edb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:28.480866 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c9df9-35da-4ed1-9075-4c7bbba6edb6 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:28.481344 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c9df9-35da-4ed1-9075-4c7bbba6edb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:28.481635 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c9df9-35da-4ed1-9075-4c7bbba6edb6 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:28.483041 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c9df9-35da-4ed1-9075-4c7bbba6edb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:28.485473 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c9df9-35da-4ed1-9075-4c7bbba6edb6 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:28.556047 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23dae3-305c-4a82-b2a9-cbbe96250504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:28.557546 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23dae3-305c-4a82-b2a9-cbbe96250504 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:28.558647 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23dae3-305c-4a82-b2a9-cbbe96250504 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:28.558993 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23dae3-305c-4a82-b2a9-cbbe96250504 admin admin] PATH_INFO: `/v3/projects/67840bbcba2145ada20b8d2784746cb3/users/a423e642bf63494d81d134c4313af10a/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:28.585393 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3133/6239] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:32:28 2022] POST /identity/v3/users => generated 297 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:32:28.586381 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c9df9-35da-4ed1-9075-4c7bbba6edb6 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:28.625510 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23dae3-305c-4a82-b2a9-cbbe96250504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67840bbcba2145ada20b8d2784746cb3, user_id=a423e642bf63494d81d134c4313af10a, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:28.642594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c9df9-35da-4ed1-9075-4c7bbba6edb6 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:28.657038 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23dae3-305c-4a82-b2a9-cbbe96250504 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:28.663580 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ebf45-7341-4691-845f-14b509faf60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:28.664448 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ebf45-7341-4691-845f-14b509faf60b admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:28.664718 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ebf45-7341-4691-845f-14b509faf60b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:28.664996 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ebf45-7341-4691-845f-14b509faf60b admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:28.665739 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ebf45-7341-4691-845f-14b509faf60b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:28.671331 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ebf45-7341-4691-845f-14b509faf60b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:28.708148 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3134/6240] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:32:28.709064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ebf45-7341-4691-845f-14b509faf60b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:28.722419 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ebf45-7341-4691-845f-14b509faf60b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:28.730820 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b37f6-adb2-457f-9716-5c7dc2b6ca9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:28.732248 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b37f6-adb2-457f-9716-5c7dc2b6ca9b admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:28.733127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b37f6-adb2-457f-9716-5c7dc2b6ca9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:28.736609 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b37f6-adb2-457f-9716-5c7dc2b6ca9b admin admin] PATH_INFO: `/v3/projects/29b03db28cde48b2aed32e52035e0d2e/users/74f881494ec747edb2bfe8097232df08/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:28.745873 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3107/6241] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:32:28 2022] PUT /identity/v3/projects/67840bbcba2145ada20b8d2784746cb3/users/a423e642bf63494d81d134c4313af10a/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:32:28.746520 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23dae3-305c-4a82-b2a9-cbbe96250504 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:28.784775 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b37f6-adb2-457f-9716-5c7dc2b6ca9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=29b03db28cde48b2aed32e52035e0d2e, user_id=74f881494ec747edb2bfe8097232df08, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:28.790823 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b37f6-adb2-457f-9716-5c7dc2b6ca9b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:28.893823 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3135/6242] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:32:28 2022] PUT /identity/v3/projects/29b03db28cde48b2aed32e52035e0d2e/users/74f881494ec747edb2bfe8097232df08/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:32:28.900268 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b37f6-adb2-457f-9716-5c7dc2b6ca9b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:28.916841 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23dae3-305c-4a82-b2a9-cbbe96250504 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:29.077345 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b37f6-adb2-457f-9716-5c7dc2b6ca9b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:29.088410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e2ab5-44db-47d9-82dc-853e4cb9991b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:29.089169 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e2ab5-44db-47d9-82dc-853e4cb9991b admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:29.089460 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e2ab5-44db-47d9-82dc-853e4cb9991b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:29.089862 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e2ab5-44db-47d9-82dc-853e4cb9991b admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:29.090623 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e2ab5-44db-47d9-82dc-853e4cb9991b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:29.092710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e2ab5-44db-47d9-82dc-853e4cb9991b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:29.123926 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3136/6243] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:32:29.126569 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e2ab5-44db-47d9-82dc-853e4cb9991b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:29.133277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2e9ff-16a2-44a4-aac1-3185fb4bc31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:29.140291 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2e9ff-16a2-44a4-aac1-3185fb4bc31d admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:29.141894 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2e9ff-16a2-44a4-aac1-3185fb4bc31d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:29.143330 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2e9ff-16a2-44a4-aac1-3185fb4bc31d admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:29.144264 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2e9ff-16a2-44a4-aac1-3185fb4bc31d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:29.155563 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2e9ff-16a2-44a4-aac1-3185fb4bc31d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:29.160262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e2ab5-44db-47d9-82dc-853e4cb9991b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:29.176606 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf9e11c-2366-410b-940f-2601d7972631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:29.177785 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9e11c-2366-410b-940f-2601d7972631 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:29.180416 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9e11c-2366-410b-940f-2601d7972631 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:29.180911 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9e11c-2366-410b-940f-2601d7972631 admin admin] PATH_INFO: `/v3/projects/29b03db28cde48b2aed32e52035e0d2e/users/74f881494ec747edb2bfe8097232df08/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:29.187438 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3108/6244] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 439 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:32:29.188801 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf9e11c-2366-410b-940f-2601d7972631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29b03db28cde48b2aed32e52035e0d2e, user_id=74f881494ec747edb2bfe8097232df08, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:29.190699 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2e9ff-16a2-44a4-aac1-3185fb4bc31d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:29.196675 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf9e11c-2366-410b-940f-2601d7972631 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:29.211667 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2e9ff-16a2-44a4-aac1-3185fb4bc31d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:29.224011 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3137/6245] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:32:29 2022] PUT /identity/v3/projects/29b03db28cde48b2aed32e52035e0d2e/users/74f881494ec747edb2bfe8097232df08/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:32:29.334764 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fb113-1462-4de0-8092-2442c2caa197 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:29.338171 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fb113-1462-4de0-8092-2442c2caa197 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:29.338171 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fb113-1462-4de0-8092-2442c2caa197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:29.347964 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90256919-3b93-49c8-b1b4-7979db63ec15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:29.348909 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90256919-3b93-49c8-b1b4-7979db63ec15 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:29.349198 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90256919-3b93-49c8-b1b4-7979db63ec15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:29.349501 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90256919-3b93-49c8-b1b4-7979db63ec15 admin admin] PATH_INFO: `/v3/projects/67840bbcba2145ada20b8d2784746cb3/users/a423e642bf63494d81d134c4313af10a/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:29.366859 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90256919-3b93-49c8-b1b4-7979db63ec15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67840bbcba2145ada20b8d2784746cb3, user_id=a423e642bf63494d81d134c4313af10a, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:29.382348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90256919-3b93-49c8-b1b4-7979db63ec15 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:29.397620 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-9a0fb113-1462-4de0-8092-2442c2caa197 None None] MFA Rules not processed for user `74f881494ec747edb2bfe8097232df08`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:32:29.400030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9a0fb113-1462-4de0-8092-2442c2caa197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:29.411711 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3109/6246] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:32:29 2022] PUT /identity/v3/projects/67840bbcba2145ada20b8d2784746cb3/users/a423e642bf63494d81d134c4313af10a/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:32:29.424948 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc49c4-2e4a-4951-a58f-13c2621dab45 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:29.425485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc49c4-2e4a-4951-a58f-13c2621dab45 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:29.426174 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc49c4-2e4a-4951-a58f-13c2621dab45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:29.473148 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-91dc49c4-2e4a-4951-a58f-13c2621dab45 None None] MFA Rules not processed for user `a423e642bf63494d81d134c4313af10a`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:32:29.474941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-91dc49c4-2e4a-4951-a58f-13c2621dab45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:29.599814 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3138/6247] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:32:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:32:29.602817 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0fb113-1462-4de0-8092-2442c2caa197 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:29.716310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0fb113-1462-4de0-8092-2442c2caa197 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:29.723967 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b5107-38da-45aa-979b-cb07594c5467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:29.725097 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b5107-38da-45aa-979b-cb07594c5467 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:29.725709 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b5107-38da-45aa-979b-cb07594c5467 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:29.726318 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b5107-38da-45aa-979b-cb07594c5467 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:29.727595 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b5107-38da-45aa-979b-cb07594c5467 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:29.732242 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b5107-38da-45aa-979b-cb07594c5467 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:29.778415 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3110/6248] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:32:29 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:32:29.783396 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc49c4-2e4a-4951-a58f-13c2621dab45 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:29.805155 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc49c4-2e4a-4951-a58f-13c2621dab45 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:29.817804 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f9b51-4a2a-456b-98ec-18cd1ae3f471 tempest-QuotasNegativeTest-1594742059 tempest-QuotasNegativeTest-1594742059-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a423e642bf63494d81d134c4313af10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67840bbcba2145ada20b8d2784746cb3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:29.819980 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f9b51-4a2a-456b-98ec-18cd1ae3f471 tempest-QuotasNegativeTest-1594742059 tempest-QuotasNegativeTest-1594742059-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:29.820268 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f9b51-4a2a-456b-98ec-18cd1ae3f471 tempest-QuotasNegativeTest-1594742059 tempest-QuotasNegativeTest-1594742059-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:29.820545 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f9b51-4a2a-456b-98ec-18cd1ae3f471 tempest-QuotasNegativeTest-1594742059 tempest-QuotasNegativeTest-1594742059-project-admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:29.823853 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f9b51-4a2a-456b-98ec-18cd1ae3f471 tempest-QuotasNegativeTest-1594742059 tempest-QuotasNegativeTest-1594742059-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:32:29.826444 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f9b51-4a2a-456b-98ec-18cd1ae3f471 tempest-QuotasNegativeTest-1594742059 tempest-QuotasNegativeTest-1594742059-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:29.832819 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f9b51-4a2a-456b-98ec-18cd1ae3f471 tempest-QuotasNegativeTest-1594742059 tempest-QuotasNegativeTest-1594742059-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:29.857001 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3139/6249] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:32:29 2022] POST /identity/v3/projects => generated 379 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:32:29.861437 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b5107-38da-45aa-979b-cb07594c5467 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:29.864815 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3111/6250] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:32:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:32:29.869165 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f9b51-4a2a-456b-98ec-18cd1ae3f471 tempest-QuotasNegativeTest-1594742059 tempest-QuotasNegativeTest-1594742059-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:29.927734 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f9b51-4a2a-456b-98ec-18cd1ae3f471 tempest-QuotasNegativeTest-1594742059 tempest-QuotasNegativeTest-1594742059-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:29.990437 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b5107-38da-45aa-979b-cb07594c5467 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:30.031725 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5bb0b7-d6f7-48f2-bcaf-16ec34d86f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:30.031725 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5bb0b7-d6f7-48f2-bcaf-16ec34d86f53 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:30.031725 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5bb0b7-d6f7-48f2-bcaf-16ec34d86f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:30.031725 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5bb0b7-d6f7-48f2-bcaf-16ec34d86f53 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:30.033869 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5bb0b7-d6f7-48f2-bcaf-16ec34d86f53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:30.050310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5bb0b7-d6f7-48f2-bcaf-16ec34d86f53 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:30.148413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bc84f-fdf8-4f91-948b-2e91d332e2aa tempest-QuotasNegativeTest-1594742059 tempest-QuotasNegativeTest-1594742059-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a423e642bf63494d81d134c4313af10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67840bbcba2145ada20b8d2784746cb3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:30.149117 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bc84f-fdf8-4f91-948b-2e91d332e2aa tempest-QuotasNegativeTest-1594742059 tempest-QuotasNegativeTest-1594742059-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:30.150720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bc84f-fdf8-4f91-948b-2e91d332e2aa tempest-QuotasNegativeTest-1594742059 tempest-QuotasNegativeTest-1594742059-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:30.151931 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bc84f-fdf8-4f91-948b-2e91d332e2aa tempest-QuotasNegativeTest-1594742059 tempest-QuotasNegativeTest-1594742059-project-admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:30.152826 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890bc84f-fdf8-4f91-948b-2e91d332e2aa tempest-QuotasNegativeTest-1594742059 tempest-QuotasNegativeTest-1594742059-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:30.166596 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890bc84f-fdf8-4f91-948b-2e91d332e2aa tempest-QuotasNegativeTest-1594742059 tempest-QuotasNegativeTest-1594742059-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:30.176556 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3140/6251] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:32:29 2022] POST /identity/v3/users => generated 290 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:32:30.180835 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5bb0b7-d6f7-48f2-bcaf-16ec34d86f53 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:30.196663 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5bb0b7-d6f7-48f2-bcaf-16ec34d86f53 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:30.218334 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6e2e2-6ade-4895-818a-a447c02ec52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:30.219062 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6e2e2-6ade-4895-818a-a447c02ec52d admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:30.219358 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6e2e2-6ade-4895-818a-a447c02ec52d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:30.219625 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6e2e2-6ade-4895-818a-a447c02ec52d admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:30.220375 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba6e2e2-6ade-4895-818a-a447c02ec52d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:30.234607 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba6e2e2-6ade-4895-818a-a447c02ec52d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:30.259681 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3141/6252] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:32:30.270978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6e2e2-6ade-4895-818a-a447c02ec52d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:30.291759 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6e2e2-6ade-4895-818a-a447c02ec52d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:30.299505 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3112/6253] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:32:29 2022] POST /identity/v3/projects => generated 349 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:32:30.301309 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bc84f-fdf8-4f91-948b-2e91d332e2aa tempest-QuotasNegativeTest-1594742059 tempest-QuotasNegativeTest-1594742059-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:30.303511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e41ca-9988-4952-b7c2-b9a373ac66e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:30.306350 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e41ca-9988-4952-b7c2-b9a373ac66e9 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:30.306653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e41ca-9988-4952-b7c2-b9a373ac66e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:30.309163 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e41ca-9988-4952-b7c2-b9a373ac66e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:30.309965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e41ca-9988-4952-b7c2-b9a373ac66e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:30.312172 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e41ca-9988-4952-b7c2-b9a373ac66e9 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:30.328922 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3142/6254] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:32:30.332946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e41ca-9988-4952-b7c2-b9a373ac66e9 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:30.345664 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e41ca-9988-4952-b7c2-b9a373ac66e9 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:30.438024 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bc84f-fdf8-4f91-948b-2e91d332e2aa tempest-QuotasNegativeTest-1594742059 tempest-QuotasNegativeTest-1594742059-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:30.444394 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eca217-ef02-4b59-9c8f-8fc9db760d20 tempest-QuotasNegativeTest-1594742059 tempest-QuotasNegativeTest-1594742059-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a423e642bf63494d81d134c4313af10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67840bbcba2145ada20b8d2784746cb3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:30.445220 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eca217-ef02-4b59-9c8f-8fc9db760d20 tempest-QuotasNegativeTest-1594742059 tempest-QuotasNegativeTest-1594742059-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:30.445623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eca217-ef02-4b59-9c8f-8fc9db760d20 tempest-QuotasNegativeTest-1594742059 tempest-QuotasNegativeTest-1594742059-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:30.446061 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eca217-ef02-4b59-9c8f-8fc9db760d20 tempest-QuotasNegativeTest-1594742059 tempest-QuotasNegativeTest-1594742059-project-admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:30.447090 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eca217-ef02-4b59-9c8f-8fc9db760d20 tempest-QuotasNegativeTest-1594742059 tempest-QuotasNegativeTest-1594742059-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:32:30.447518 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eca217-ef02-4b59-9c8f-8fc9db760d20 tempest-QuotasNegativeTest-1594742059 tempest-QuotasNegativeTest-1594742059-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:30.449703 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eca217-ef02-4b59-9c8f-8fc9db760d20 tempest-QuotasNegativeTest-1594742059 tempest-QuotasNegativeTest-1594742059-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:30.469667 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3113/6255] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:32:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:32:30.473556 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3f3bf-e802-443d-a48d-08e4865af408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:30.474501 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3f3bf-e802-443d-a48d-08e4865af408 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:30.474784 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3f3bf-e802-443d-a48d-08e4865af408 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:30.475065 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3f3bf-e802-443d-a48d-08e4865af408 admin admin] PATH_INFO: `/v3/projects/52e373831873455a8033cecb91bd0fe6/users/dd1f5f1f7d18497a90062498bba2bc65/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:30.485107 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eca217-ef02-4b59-9c8f-8fc9db760d20 tempest-QuotasNegativeTest-1594742059 tempest-QuotasNegativeTest-1594742059-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:30.491313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-89eca217-ef02-4b59-9c8f-8fc9db760d20 tempest-QuotasNegativeTest-1594742059 tempest-QuotasNegativeTest-1594742059-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:30.512893 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a3f3bf-e802-443d-a48d-08e4865af408 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52e373831873455a8033cecb91bd0fe6, user_id=dd1f5f1f7d18497a90062498bba2bc65, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:30.517988 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a3f3bf-e802-443d-a48d-08e4865af408 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:30.626287 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eca217-ef02-4b59-9c8f-8fc9db760d20 tempest-QuotasNegativeTest-1594742059 tempest-QuotasNegativeTest-1594742059-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:30.651060 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3143/6256] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:32:30 2022] PUT /identity/v3/projects/52e373831873455a8033cecb91bd0fe6/users/dd1f5f1f7d18497a90062498bba2bc65/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:32:30.654818 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc44f3-9ea5-4700-bb77-7e630051445b None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:30.660653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc44f3-9ea5-4700-bb77-7e630051445b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:30.660653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc44f3-9ea5-4700-bb77-7e630051445b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:30.713944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8dfab7-da7d-488a-8031-cbd5701e7c50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:30.714628 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8dfab7-da7d-488a-8031-cbd5701e7c50 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:30.715020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8dfab7-da7d-488a-8031-cbd5701e7c50 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:30.715567 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8dfab7-da7d-488a-8031-cbd5701e7c50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:30.776072 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-78fc44f3-9ea5-4700-bb77-7e630051445b None None] MFA Rules not processed for user `dd1f5f1f7d18497a90062498bba2bc65`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:32:30.781873 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-78fc44f3-9ea5-4700-bb77-7e630051445b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:30.877800 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8dfab7-da7d-488a-8031-cbd5701e7c50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:30.887235 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8dfab7-da7d-488a-8031-cbd5701e7c50 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:30.892743 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3114/6257] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:32:30 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:32:31.058399 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3144/6258] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:32:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:32:31.065203 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8dfab7-da7d-488a-8031-cbd5701e7c50 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:31.066789 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-bd8dfab7-da7d-488a-8031-cbd5701e7c50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:31.178022 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8dfab7-da7d-488a-8031-cbd5701e7c50 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:31.189443 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7fa01c-653d-446a-8801-f26f1f9157d2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e302b1298dd04d6590e3d079f7b13b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:31.190400 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fa01c-653d-446a-8801-f26f1f9157d2 service glance] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:31.197544 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fa01c-653d-446a-8801-f26f1f9157d2 service glance] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:31.197544 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fa01c-653d-446a-8801-f26f1f9157d2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:31.366851 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7fa01c-653d-446a-8801-f26f1f9157d2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:31.371240 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7fa01c-653d-446a-8801-f26f1f9157d2 service glance] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:31.398484 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3115/6259] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:32:31 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:32:32.750514 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc44f3-9ea5-4700-bb77-7e630051445b None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:32.838265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc44f3-9ea5-4700-bb77-7e630051445b None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:32.844128 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410dc73c-ff44-4201-8e42-2c7a60fba600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:32.845414 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410dc73c-ff44-4201-8e42-2c7a60fba600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:32.845961 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410dc73c-ff44-4201-8e42-2c7a60fba600 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:32.846344 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410dc73c-ff44-4201-8e42-2c7a60fba600 admin admin] PATH_INFO: `/v3/users/74f881494ec747edb2bfe8097232df08` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:32.854789 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410dc73c-ff44-4201-8e42-2c7a60fba600 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74f881494ec747edb2bfe8097232df08)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:32.860008 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410dc73c-ff44-4201-8e42-2c7a60fba600 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:33.110298 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-410dc73c-ff44-4201-8e42-2c7a60fba600 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74f881494ec747edb2bfe8097232df08'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:33.134721 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-410dc73c-ff44-4201-8e42-2c7a60fba600 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74f881494ec747edb2bfe8097232df08'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:33.211882 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-410dc73c-ff44-4201-8e42-2c7a60fba600 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74f881494ec747edb2bfe8097232df08'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:33.221596 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-410dc73c-ff44-4201-8e42-2c7a60fba600 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74f881494ec747edb2bfe8097232df08'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:33.222803 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-410dc73c-ff44-4201-8e42-2c7a60fba600 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74f881494ec747edb2bfe8097232df08'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:33.229499 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3145/6260] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:32:32 2022] DELETE /identity/v3/users/74f881494ec747edb2bfe8097232df08 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:32:33.235505 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f817ce0-3f12-4d94-aa95-acd2bd988787 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:33.235985 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f817ce0-3f12-4d94-aa95-acd2bd988787 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:33.237579 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f817ce0-3f12-4d94-aa95-acd2bd988787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:33.289170 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-2f817ce0-3f12-4d94-aa95-acd2bd988787 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:32:33.290783 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2f817ce0-3f12-4d94-aa95-acd2bd988787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:33.430433 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3116/6261] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:32:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:32:33.476230 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410dc73c-ff44-4201-8e42-2c7a60fba600 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:33.482901 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-410dc73c-ff44-4201-8e42-2c7a60fba600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:33.565070 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410dc73c-ff44-4201-8e42-2c7a60fba600 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:33.645697 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8ae9a-b76f-4d7e-ad55-25767db628d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:33.645697 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8ae9a-b76f-4d7e-ad55-25767db628d9 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:33.645697 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8ae9a-b76f-4d7e-ad55-25767db628d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:33.645697 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8ae9a-b76f-4d7e-ad55-25767db628d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:33.647991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8ae9a-b76f-4d7e-ad55-25767db628d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:33.647991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8ae9a-b76f-4d7e-ad55-25767db628d9 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:33.647991 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3146/6262] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:32:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:32:34.886952 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f817ce0-3f12-4d94-aa95-acd2bd988787 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:34.889220 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2f817ce0-3f12-4d94-aa95-acd2bd988787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:34.906059 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f817ce0-3f12-4d94-aa95-acd2bd988787 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:34.912824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7fcf8-c48e-40ec-a2e1-de106b0760ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:34.914072 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7fcf8-c48e-40ec-a2e1-de106b0760ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:34.914572 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7fcf8-c48e-40ec-a2e1-de106b0760ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:34.915052 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7fcf8-c48e-40ec-a2e1-de106b0760ab admin admin] PATH_INFO: `/v3/projects/29b03db28cde48b2aed32e52035e0d2e` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:34.916555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f7fcf8-c48e-40ec-a2e1-de106b0760ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=29b03db28cde48b2aed32e52035e0d2e)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:34.918912 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f7fcf8-c48e-40ec-a2e1-de106b0760ab admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:35.136993 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-53f7fcf8-c48e-40ec-a2e1-de106b0760ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29b03db28cde48b2aed32e52035e0d2e', 'request_id': 'req-53f7fcf8-c48e-40ec-a2e1-de106b0760ab'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:35.144558 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-53f7fcf8-c48e-40ec-a2e1-de106b0760ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29b03db28cde48b2aed32e52035e0d2e', 'request_id': 'req-53f7fcf8-c48e-40ec-a2e1-de106b0760ab'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:35.152522 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-53f7fcf8-c48e-40ec-a2e1-de106b0760ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29b03db28cde48b2aed32e52035e0d2e', 'request_id': 'req-53f7fcf8-c48e-40ec-a2e1-de106b0760ab'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:35.285057 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-53f7fcf8-c48e-40ec-a2e1-de106b0760ab admin admin] The token cache is being invalidate because project 29b03db28cde48b2aed32e52035e0d2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:32:35.285355 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-53f7fcf8-c48e-40ec-a2e1-de106b0760ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:35.286246 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-53f7fcf8-c48e-40ec-a2e1-de106b0760ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:35.288280 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3117/6263] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:32:34 2022] DELETE /identity/v3/projects/29b03db28cde48b2aed32e52035e0d2e => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:32:35.292257 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8ae9a-b76f-4d7e-ad55-25767db628d9 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:35.307271 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8ae9a-b76f-4d7e-ad55-25767db628d9 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:35.452198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0742bb2-2335-49a3-8a40-01c132d638c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:35.453208 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0742bb2-2335-49a3-8a40-01c132d638c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:35.453569 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0742bb2-2335-49a3-8a40-01c132d638c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:35.453972 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0742bb2-2335-49a3-8a40-01c132d638c1 admin admin] PATH_INFO: `/v3/users/dd1f5f1f7d18497a90062498bba2bc65` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:35.455719 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0742bb2-2335-49a3-8a40-01c132d638c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd1f5f1f7d18497a90062498bba2bc65)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:35.457490 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0742bb2-2335-49a3-8a40-01c132d638c1 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:35.669781 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c0742bb2-2335-49a3-8a40-01c132d638c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd1f5f1f7d18497a90062498bba2bc65'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:35.728239 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c0742bb2-2335-49a3-8a40-01c132d638c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd1f5f1f7d18497a90062498bba2bc65'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:35.796674 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c0742bb2-2335-49a3-8a40-01c132d638c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd1f5f1f7d18497a90062498bba2bc65'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:35.807194 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c0742bb2-2335-49a3-8a40-01c132d638c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd1f5f1f7d18497a90062498bba2bc65'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:35.807911 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c0742bb2-2335-49a3-8a40-01c132d638c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd1f5f1f7d18497a90062498bba2bc65'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:35.822360 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3147/6264] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:32:35 2022] DELETE /identity/v3/users/dd1f5f1f7d18497a90062498bba2bc65 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:32:35.850215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe39aa-7144-4545-8c80-d368aa8b3950 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:35.850661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe39aa-7144-4545-8c80-d368aa8b3950 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:35.851023 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe39aa-7144-4545-8c80-d368aa8b3950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:35.873566 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-31fe39aa-7144-4545-8c80-d368aa8b3950 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:32:35.874991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-31fe39aa-7144-4545-8c80-d368aa8b3950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:35.982663 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3118/6265] 10.222.0.23 () {58 vars in 967 bytes} [Sat Apr 30 21:32:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:32:35.996580 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0742bb2-2335-49a3-8a40-01c132d638c1 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:35.998507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c0742bb2-2335-49a3-8a40-01c132d638c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:36.172121 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0742bb2-2335-49a3-8a40-01c132d638c1 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:36.178745 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0d47e-2a70-428c-a27e-19b445abcf6f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:36.179611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0d47e-2a70-428c-a27e-19b445abcf6f service swift] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:36.179902 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0d47e-2a70-428c-a27e-19b445abcf6f service swift] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:36.180182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0d47e-2a70-428c-a27e-19b445abcf6f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:36.208090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd0d47e-2a70-428c-a27e-19b445abcf6f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:36.208090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd0d47e-2a70-428c-a27e-19b445abcf6f service swift] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:36.215359 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3148/6266] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:32:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:32:37.292362 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe39aa-7144-4545-8c80-d368aa8b3950 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:37.294099 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-31fe39aa-7144-4545-8c80-d368aa8b3950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:37.350044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0d47e-2a70-428c-a27e-19b445abcf6f service swift] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:37.351717 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-acd0d47e-2a70-428c-a27e-19b445abcf6f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:37.511078 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe39aa-7144-4545-8c80-d368aa8b3950 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:37.516790 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e2538d-d808-4313-bd0f-d38ec5bbd9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:37.517954 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2538d-d808-4313-bd0f-d38ec5bbd9ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:37.518396 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2538d-d808-4313-bd0f-d38ec5bbd9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:37.518833 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2538d-d808-4313-bd0f-d38ec5bbd9ad admin admin] PATH_INFO: `/v3/projects/52e373831873455a8033cecb91bd0fe6` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:37.520625 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e2538d-d808-4313-bd0f-d38ec5bbd9ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=52e373831873455a8033cecb91bd0fe6)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:37.525882 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e2538d-d808-4313-bd0f-d38ec5bbd9ad admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:37.532963 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0d47e-2a70-428c-a27e-19b445abcf6f service swift] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:37.548513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06887c9-1982-42e3-acc6-927e1f7bbd58 tempest-QuotasNegativeTest-1594742059 tempest-QuotasNegativeTest-1594742059-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a423e642bf63494d81d134c4313af10a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67840bbcba2145ada20b8d2784746cb3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:37.551267 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06887c9-1982-42e3-acc6-927e1f7bbd58 tempest-QuotasNegativeTest-1594742059 tempest-QuotasNegativeTest-1594742059-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:37.551642 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06887c9-1982-42e3-acc6-927e1f7bbd58 tempest-QuotasNegativeTest-1594742059 tempest-QuotasNegativeTest-1594742059-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:37.551935 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06887c9-1982-42e3-acc6-927e1f7bbd58 tempest-QuotasNegativeTest-1594742059 tempest-QuotasNegativeTest-1594742059-project-admin] PATH_INFO: `/v3/projects/4689415c1cdd49d18f085e14553f1697` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:37.556833 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06887c9-1982-42e3-acc6-927e1f7bbd58 tempest-QuotasNegativeTest-1594742059 tempest-QuotasNegativeTest-1594742059-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4689415c1cdd49d18f085e14553f1697)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:37.566797 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06887c9-1982-42e3-acc6-927e1f7bbd58 tempest-QuotasNegativeTest-1594742059 tempest-QuotasNegativeTest-1594742059-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:37.718249 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a5e2538d-d808-4313-bd0f-d38ec5bbd9ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52e373831873455a8033cecb91bd0fe6', 'request_id': 'req-a5e2538d-d808-4313-bd0f-d38ec5bbd9ad'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:37.733132 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a5e2538d-d808-4313-bd0f-d38ec5bbd9ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52e373831873455a8033cecb91bd0fe6', 'request_id': 'req-a5e2538d-d808-4313-bd0f-d38ec5bbd9ad'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:37.739752 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d06887c9-1982-42e3-acc6-927e1f7bbd58 tempest-QuotasNegativeTest-1594742059 tempest-QuotasNegativeTest-1594742059-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4689415c1cdd49d18f085e14553f1697', 'request_id': 'req-d06887c9-1982-42e3-acc6-927e1f7bbd58'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:37.748364 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d06887c9-1982-42e3-acc6-927e1f7bbd58 tempest-QuotasNegativeTest-1594742059 tempest-QuotasNegativeTest-1594742059-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4689415c1cdd49d18f085e14553f1697', 'request_id': 'req-d06887c9-1982-42e3-acc6-927e1f7bbd58'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:37.762362 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a5e2538d-d808-4313-bd0f-d38ec5bbd9ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52e373831873455a8033cecb91bd0fe6', 'request_id': 'req-a5e2538d-d808-4313-bd0f-d38ec5bbd9ad'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:37.762499 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d06887c9-1982-42e3-acc6-927e1f7bbd58 tempest-QuotasNegativeTest-1594742059 tempest-QuotasNegativeTest-1594742059-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4689415c1cdd49d18f085e14553f1697', 'request_id': 'req-d06887c9-1982-42e3-acc6-927e1f7bbd58'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:37.911647 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a5e2538d-d808-4313-bd0f-d38ec5bbd9ad admin admin] The token cache is being invalidate because project 52e373831873455a8033cecb91bd0fe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:32:37.911937 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a5e2538d-d808-4313-bd0f-d38ec5bbd9ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:37.912807 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a5e2538d-d808-4313-bd0f-d38ec5bbd9ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:37.914980 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3119/6267] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:32:37 2022] DELETE /identity/v3/projects/52e373831873455a8033cecb91bd0fe6 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:32:37.920669 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152ed41-d389-4417-9ef0-b8afc6129126 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:37.920957 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152ed41-d389-4417-9ef0-b8afc6129126 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:37.921250 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152ed41-d389-4417-9ef0-b8afc6129126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:38.008164 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d06887c9-1982-42e3-acc6-927e1f7bbd58 tempest-QuotasNegativeTest-1594742059 tempest-QuotasNegativeTest-1594742059-project-admin] The token cache is being invalidate because project 4689415c1cdd49d18f085e14553f1697 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:32:38.008454 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d06887c9-1982-42e3-acc6-927e1f7bbd58 tempest-QuotasNegativeTest-1594742059 tempest-QuotasNegativeTest-1594742059-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:38.009156 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d06887c9-1982-42e3-acc6-927e1f7bbd58 tempest-QuotasNegativeTest-1594742059 tempest-QuotasNegativeTest-1594742059-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:38.024233 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3149/6268] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:32:37 2022] DELETE /identity/v3/projects/4689415c1cdd49d18f085e14553f1697 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:32:38.024647 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-0152ed41-d389-4417-9ef0-b8afc6129126 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:32:38.027274 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06887c9-1982-42e3-acc6-927e1f7bbd58 tempest-QuotasNegativeTest-1594742059 tempest-QuotasNegativeTest-1594742059-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:38.033092 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0152ed41-d389-4417-9ef0-b8afc6129126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:38.034771 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d06887c9-1982-42e3-acc6-927e1f7bbd58 tempest-QuotasNegativeTest-1594742059 tempest-QuotasNegativeTest-1594742059-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:38.199875 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3120/6269] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:32:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:32:38.207214 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06887c9-1982-42e3-acc6-927e1f7bbd58 tempest-QuotasNegativeTest-1594742059 tempest-QuotasNegativeTest-1594742059-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:38.213467 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb2cc6-92db-428c-92cf-fdde932fb908 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:38.213998 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb2cc6-92db-428c-92cf-fdde932fb908 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:38.214424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb2cc6-92db-428c-92cf-fdde932fb908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:38.234340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92845993-f554-4b4c-aeb9-7822362c0056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:38.235186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92845993-f554-4b4c-aeb9-7822362c0056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:38.235605 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92845993-f554-4b4c-aeb9-7822362c0056 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:38.235737 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92845993-f554-4b4c-aeb9-7822362c0056 admin admin] PATH_INFO: `/v3/users/46807d62ce6841b28324dd9a8846e155` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:38.237259 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92845993-f554-4b4c-aeb9-7822362c0056 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46807d62ce6841b28324dd9a8846e155)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:38.239224 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92845993-f554-4b4c-aeb9-7822362c0056 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:38.252463 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-1dbb2cc6-92db-428c-92cf-fdde932fb908 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:32:38.252463 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1dbb2cc6-92db-428c-92cf-fdde932fb908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:38.278648 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3121/6270] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:32:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:32:38.284069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb2cc6-92db-428c-92cf-fdde932fb908 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:38.301371 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb2cc6-92db-428c-92cf-fdde932fb908 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:38.314609 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae0cd4-cd8a-49a1-b493-c4e5a9f846d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:38.315594 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae0cd4-cd8a-49a1-b493-c4e5a9f846d2 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:38.315883 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae0cd4-cd8a-49a1-b493-c4e5a9f846d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:38.316165 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae0cd4-cd8a-49a1-b493-c4e5a9f846d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:38.316918 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae0cd4-cd8a-49a1-b493-c4e5a9f846d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:32:38.317228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae0cd4-cd8a-49a1-b493-c4e5a9f846d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:38.318929 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae0cd4-cd8a-49a1-b493-c4e5a9f846d2 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:38.334022 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3122/6271] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:32:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:32:38.338388 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae0cd4-cd8a-49a1-b493-c4e5a9f846d2 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:38.367967 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae0cd4-cd8a-49a1-b493-c4e5a9f846d2 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:38.393617 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7beada-afda-47f4-9167-fcefe548a7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:38.394832 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7beada-afda-47f4-9167-fcefe548a7c4 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:38.400328 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7beada-afda-47f4-9167-fcefe548a7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:38.400953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7beada-afda-47f4-9167-fcefe548a7c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:38.402180 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7beada-afda-47f4-9167-fcefe548a7c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:38.410498 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7beada-afda-47f4-9167-fcefe548a7c4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:38.527539 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3123/6272] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:32:38 2022] POST /identity/v3/projects => generated 385 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:32:38.531556 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-92845993-f554-4b4c-aeb9-7822362c0056 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46807d62ce6841b28324dd9a8846e155'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:38.533349 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7beada-afda-47f4-9167-fcefe548a7c4 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:38.547841 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-92845993-f554-4b4c-aeb9-7822362c0056 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46807d62ce6841b28324dd9a8846e155'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:38.647157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7beada-afda-47f4-9167-fcefe548a7c4 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:38.649372 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bfb712-9b8e-46c8-8561-fa207581857a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:38.650110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfb712-9b8e-46c8-8561-fa207581857a admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:38.650398 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfb712-9b8e-46c8-8561-fa207581857a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:38.650675 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfb712-9b8e-46c8-8561-fa207581857a admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:38.651414 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bfb712-9b8e-46c8-8561-fa207581857a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:38.653559 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bfb712-9b8e-46c8-8561-fa207581857a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:38.699833 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-92845993-f554-4b4c-aeb9-7822362c0056 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46807d62ce6841b28324dd9a8846e155'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:38.708433 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-92845993-f554-4b4c-aeb9-7822362c0056 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46807d62ce6841b28324dd9a8846e155'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:38.713410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-92845993-f554-4b4c-aeb9-7822362c0056 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46807d62ce6841b28324dd9a8846e155'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:38.717675 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3150/6273] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:32:38 2022] DELETE /identity/v3/users/46807d62ce6841b28324dd9a8846e155 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:32:38.736164 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a7951-e472-4467-ad10-7d51201cb579 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:38.737429 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a7951-e472-4467-ad10-7d51201cb579 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:38.738764 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a7951-e472-4467-ad10-7d51201cb579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:38.774118 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3124/6274] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:32:38 2022] POST /identity/v3/users => generated 293 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:32:38.775081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-4e1a7951-e472-4467-ad10-7d51201cb579 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:32:38.777238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bfb712-9b8e-46c8-8561-fa207581857a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:38.779730 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4e1a7951-e472-4467-ad10-7d51201cb579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:38.781206 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-29bfb712-9b8e-46c8-8561-fa207581857a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:38.825372 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bfb712-9b8e-46c8-8561-fa207581857a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:38.896257 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3151/6275] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:32:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:32:38.915381 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a7951-e472-4467-ad10-7d51201cb579 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:38.921594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4e1a7951-e472-4467-ad10-7d51201cb579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:38.926889 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5087d8ae-895d-4dcf-b057-779c4a3c73cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:38.927588 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087d8ae-895d-4dcf-b057-779c4a3c73cf admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:38.927874 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087d8ae-895d-4dcf-b057-779c4a3c73cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:38.928148 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087d8ae-895d-4dcf-b057-779c4a3c73cf admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:38.929267 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5087d8ae-895d-4dcf-b057-779c4a3c73cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:38.933459 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5087d8ae-895d-4dcf-b057-779c4a3c73cf admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:38.956969 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3125/6276] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:32:38.960975 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5087d8ae-895d-4dcf-b057-779c4a3c73cf admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:38.988183 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5087d8ae-895d-4dcf-b057-779c4a3c73cf admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:38.993529 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2f6e0-c03a-4530-9169-647346e5b95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:38.994178 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2f6e0-c03a-4530-9169-647346e5b95d admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:38.994466 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2f6e0-c03a-4530-9169-647346e5b95d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:38.994743 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2f6e0-c03a-4530-9169-647346e5b95d admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:38.995467 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2f6e0-c03a-4530-9169-647346e5b95d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:38.997319 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2f6e0-c03a-4530-9169-647346e5b95d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:39.017919 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3126/6277] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:32:39.023860 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2f6e0-c03a-4530-9169-647346e5b95d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:39.038149 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a7951-e472-4467-ad10-7d51201cb579 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:39.042321 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d110a-19a2-478a-a26e-33ec66650a00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:39.047991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d110a-19a2-478a-a26e-33ec66650a00 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:39.047991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d110a-19a2-478a-a26e-33ec66650a00 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:39.047991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d110a-19a2-478a-a26e-33ec66650a00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:39.048286 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2f6e0-c03a-4530-9169-647346e5b95d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:39.051806 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb23cd-86c9-4fcb-a927-205a7ca0d009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:39.052811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb23cd-86c9-4fcb-a927-205a7ca0d009 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:39.053399 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb23cd-86c9-4fcb-a927-205a7ca0d009 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:39.053749 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb23cd-86c9-4fcb-a927-205a7ca0d009 admin admin] PATH_INFO: `/v3/projects/9f5e0f9efa654f5dae365ec38503ccba/users/130ec0598cde462797d418f5e32947fe/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:39.067703 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d110a-19a2-478a-a26e-33ec66650a00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:39.069553 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d110a-19a2-478a-a26e-33ec66650a00 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:39.070179 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb23cd-86c9-4fcb-a927-205a7ca0d009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f5e0f9efa654f5dae365ec38503ccba, user_id=130ec0598cde462797d418f5e32947fe, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:39.072944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb23cd-86c9-4fcb-a927-205a7ca0d009 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:39.083656 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3152/6278] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:32:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:32:39.182838 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3127/6279] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:32:39 2022] PUT /identity/v3/projects/9f5e0f9efa654f5dae365ec38503ccba/users/130ec0598cde462797d418f5e32947fe/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:32:39.195023 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09310de1-def3-46ca-a588-bc9eaf958e4b None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:39.195908 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09310de1-def3-46ca-a588-bc9eaf958e4b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:39.195908 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09310de1-def3-46ca-a588-bc9eaf958e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:39.229717 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-09310de1-def3-46ca-a588-bc9eaf958e4b None None] MFA Rules not processed for user `130ec0598cde462797d418f5e32947fe`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:32:39.231258 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-09310de1-def3-46ca-a588-bc9eaf958e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:39.323119 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3153/6280] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:32:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:32:39.323321 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb23cd-86c9-4fcb-a927-205a7ca0d009 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:39.396529 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb23cd-86c9-4fcb-a927-205a7ca0d009 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:39.401515 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c060d1a-6459-4a3e-8d99-f72efc99ce2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:39.402219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c060d1a-6459-4a3e-8d99-f72efc99ce2f admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:39.402503 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c060d1a-6459-4a3e-8d99-f72efc99ce2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:39.402777 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c060d1a-6459-4a3e-8d99-f72efc99ce2f admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:39.403469 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c060d1a-6459-4a3e-8d99-f72efc99ce2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:39.405545 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c060d1a-6459-4a3e-8d99-f72efc99ce2f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:39.598943 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3128/6281] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:32:39 2022] POST /identity/v3/projects => generated 383 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:32:39.602730 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09310de1-def3-46ca-a588-bc9eaf958e4b None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:39.618345 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09310de1-def3-46ca-a588-bc9eaf958e4b None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:39.706303 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42867306-9d56-44c9-9029-5200626cfcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:39.706810 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42867306-9d56-44c9-9029-5200626cfcd0 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:39.707094 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42867306-9d56-44c9-9029-5200626cfcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:39.707371 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42867306-9d56-44c9-9029-5200626cfcd0 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:39.708064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42867306-9d56-44c9-9029-5200626cfcd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:39.710059 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42867306-9d56-44c9-9029-5200626cfcd0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:39.820155 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3154/6282] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:32:39 2022] POST /identity/v3/users => generated 298 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:32:39.825529 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c060d1a-6459-4a3e-8d99-f72efc99ce2f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:39.848062 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c060d1a-6459-4a3e-8d99-f72efc99ce2f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:39.853567 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c827224-3408-49d8-acac-447f3f6cff93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:39.854792 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c827224-3408-49d8-acac-447f3f6cff93 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:39.855141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c827224-3408-49d8-acac-447f3f6cff93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:39.855572 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c827224-3408-49d8-acac-447f3f6cff93 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:39.856416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c827224-3408-49d8-acac-447f3f6cff93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:39.859542 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c827224-3408-49d8-acac-447f3f6cff93 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:39.871940 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3129/6283] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:32:39.877011 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42867306-9d56-44c9-9029-5200626cfcd0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:39.891111 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42867306-9d56-44c9-9029-5200626cfcd0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:39.896938 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607567c-8bd9-4737-b83a-9a7c52db8a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:39.897719 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607567c-8bd9-4737-b83a-9a7c52db8a4e admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:39.898468 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607567c-8bd9-4737-b83a-9a7c52db8a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:39.898468 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607567c-8bd9-4737-b83a-9a7c52db8a4e admin admin] PATH_INFO: `/v3/projects/7a6bb5ada2f848e6a2b90c68b56c232d/users/c33a0871f1b047a4b8ce395958e6b102/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:39.914506 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d607567c-8bd9-4737-b83a-9a7c52db8a4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a6bb5ada2f848e6a2b90c68b56c232d, user_id=c33a0871f1b047a4b8ce395958e6b102, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:39.917356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d607567c-8bd9-4737-b83a-9a7c52db8a4e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:39.952549 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c827224-3408-49d8-acac-447f3f6cff93 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:39.954368 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3c827224-3408-49d8-acac-447f3f6cff93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:39.977321 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c827224-3408-49d8-acac-447f3f6cff93 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:39.983646 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41bb0ec-80d3-429a-897f-6006996ec64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:39.983646 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41bb0ec-80d3-429a-897f-6006996ec64f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:39.983646 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41bb0ec-80d3-429a-897f-6006996ec64f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:39.983951 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41bb0ec-80d3-429a-897f-6006996ec64f admin admin] PATH_INFO: `/v3/projects/a1c3513665964382aab6ef50ae08ef66` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:39.987156 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41bb0ec-80d3-429a-897f-6006996ec64f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1c3513665964382aab6ef50ae08ef66)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:39.987847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41bb0ec-80d3-429a-897f-6006996ec64f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:40.020127 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3155/6284] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:32:39 2022] PUT /identity/v3/projects/7a6bb5ada2f848e6a2b90c68b56c232d/users/c33a0871f1b047a4b8ce395958e6b102/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:32:40.023691 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607567c-8bd9-4737-b83a-9a7c52db8a4e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:40.085501 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607567c-8bd9-4737-b83a-9a7c52db8a4e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:40.090574 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e8bfc-a1c6-4d24-9f60-9df6fa4476a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:40.091806 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e8bfc-a1c6-4d24-9f60-9df6fa4476a4 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:40.092154 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e8bfc-a1c6-4d24-9f60-9df6fa4476a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:40.092423 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e8bfc-a1c6-4d24-9f60-9df6fa4476a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:40.093153 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87e8bfc-a1c6-4d24-9f60-9df6fa4476a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:40.095533 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87e8bfc-a1c6-4d24-9f60-9df6fa4476a4 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:40.106078 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3156/6285] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:32:40.110883 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e8bfc-a1c6-4d24-9f60-9df6fa4476a4 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:40.128063 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e8bfc-a1c6-4d24-9f60-9df6fa4476a4 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:40.132848 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d277b5-1bcf-4fc4-96aa-41087382bc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:40.137712 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d277b5-1bcf-4fc4-96aa-41087382bc87 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:40.137712 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d277b5-1bcf-4fc4-96aa-41087382bc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:40.137712 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d277b5-1bcf-4fc4-96aa-41087382bc87 admin admin] PATH_INFO: `/v3/projects/7a6bb5ada2f848e6a2b90c68b56c232d/users/c33a0871f1b047a4b8ce395958e6b102/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:40.137712 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d277b5-1bcf-4fc4-96aa-41087382bc87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a6bb5ada2f848e6a2b90c68b56c232d, user_id=c33a0871f1b047a4b8ce395958e6b102, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:40.139513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d277b5-1bcf-4fc4-96aa-41087382bc87 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:40.152717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c41bb0ec-80d3-429a-897f-6006996ec64f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1c3513665964382aab6ef50ae08ef66', 'request_id': 'req-c41bb0ec-80d3-429a-897f-6006996ec64f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:40.157839 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3157/6286] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:32:40 2022] PUT /identity/v3/projects/7a6bb5ada2f848e6a2b90c68b56c232d/users/c33a0871f1b047a4b8ce395958e6b102/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:32:40.166699 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c41bb0ec-80d3-429a-897f-6006996ec64f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1c3513665964382aab6ef50ae08ef66', 'request_id': 'req-c41bb0ec-80d3-429a-897f-6006996ec64f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:40.170428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc9a03-de84-42e7-85e0-9edb19b3077b None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:40.170723 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc9a03-de84-42e7-85e0-9edb19b3077b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:40.171004 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc9a03-de84-42e7-85e0-9edb19b3077b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:40.173902 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c41bb0ec-80d3-429a-897f-6006996ec64f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1c3513665964382aab6ef50ae08ef66', 'request_id': 'req-c41bb0ec-80d3-429a-897f-6006996ec64f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:40.221031 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-85dc9a03-de84-42e7-85e0-9edb19b3077b None None] MFA Rules not processed for user `c33a0871f1b047a4b8ce395958e6b102`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:32:40.222305 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-85dc9a03-de84-42e7-85e0-9edb19b3077b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:40.311869 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c41bb0ec-80d3-429a-897f-6006996ec64f admin admin] The token cache is being invalidate because project a1c3513665964382aab6ef50ae08ef66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:32:40.312259 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c41bb0ec-80d3-429a-897f-6006996ec64f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:40.313092 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c41bb0ec-80d3-429a-897f-6006996ec64f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:40.316107 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3130/6287] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:32:39 2022] DELETE /identity/v3/projects/a1c3513665964382aab6ef50ae08ef66 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:32:40.320637 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41bb0ec-80d3-429a-897f-6006996ec64f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:40.326363 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c41bb0ec-80d3-429a-897f-6006996ec64f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:40.339382 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3158/6288] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:32:40 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:32:40.352427 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc9a03-de84-42e7-85e0-9edb19b3077b None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:40.355761 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-85dc9a03-de84-42e7-85e0-9edb19b3077b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:40.459563 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc9a03-de84-42e7-85e0-9edb19b3077b None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:40.463535 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41bb0ec-80d3-429a-897f-6006996ec64f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:40.466648 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e48d1-2c6c-4de6-91fa-c6b2f8b23539 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:40.469833 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e48d1-2c6c-4de6-91fa-c6b2f8b23539 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:40.470756 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e48d1-2c6c-4de6-91fa-c6b2f8b23539 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:40.471102 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e48d1-2c6c-4de6-91fa-c6b2f8b23539 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:40.473399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-781e48d1-2c6c-4de6-91fa-c6b2f8b23539 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:40.546813 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd1690-b28d-49a8-b5dd-b4e33d2c1a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:40.548009 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd1690-b28d-49a8-b5dd-b4e33d2c1a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:40.548300 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd1690-b28d-49a8-b5dd-b4e33d2c1a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:40.548580 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd1690-b28d-49a8-b5dd-b4e33d2c1a0a admin admin] PATH_INFO: `/v3/users/a423e642bf63494d81d134c4313af10a` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:40.550188 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd1690-b28d-49a8-b5dd-b4e33d2c1a0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a423e642bf63494d81d134c4313af10a)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:40.552366 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd1690-b28d-49a8-b5dd-b4e33d2c1a0a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:40.569669 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e48d1-2c6c-4de6-91fa-c6b2f8b23539 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:40.572080 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e48d1-2c6c-4de6-91fa-c6b2f8b23539 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:40.586879 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3159/6289] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:32:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:32:40.755968 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-17dd1690-b28d-49a8-b5dd-b4e33d2c1a0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a423e642bf63494d81d134c4313af10a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:40.771623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-17dd1690-b28d-49a8-b5dd-b4e33d2c1a0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a423e642bf63494d81d134c4313af10a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:40.853158 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-17dd1690-b28d-49a8-b5dd-b4e33d2c1a0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a423e642bf63494d81d134c4313af10a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:40.853959 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-17dd1690-b28d-49a8-b5dd-b4e33d2c1a0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a423e642bf63494d81d134c4313af10a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:40.862287 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-17dd1690-b28d-49a8-b5dd-b4e33d2c1a0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a423e642bf63494d81d134c4313af10a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:40.868480 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3131/6290] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:32:40 2022] DELETE /identity/v3/users/a423e642bf63494d81d134c4313af10a => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:32:41.466403 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e48d1-2c6c-4de6-91fa-c6b2f8b23539 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:41.467869 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-781e48d1-2c6c-4de6-91fa-c6b2f8b23539 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:41.490255 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e48d1-2c6c-4de6-91fa-c6b2f8b23539 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:41.555249 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab362b4-dca0-4d90-a605-5071566ae2a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:41.555914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab362b4-dca0-4d90-a605-5071566ae2a9 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:41.556497 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab362b4-dca0-4d90-a605-5071566ae2a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:41.556791 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab362b4-dca0-4d90-a605-5071566ae2a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:41.558691 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-bab362b4-dca0-4d90-a605-5071566ae2a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:41.696736 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab362b4-dca0-4d90-a605-5071566ae2a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:41.698261 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab362b4-dca0-4d90-a605-5071566ae2a9 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:41.722911 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3160/6291] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:32:41 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:32:41.954140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd1690-b28d-49a8-b5dd-b4e33d2c1a0a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:41.955630 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-17dd1690-b28d-49a8-b5dd-b4e33d2c1a0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:42.070902 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd1690-b28d-49a8-b5dd-b4e33d2c1a0a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:42.077927 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58f125-be07-49c4-8a9a-c1fe8b17c0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:42.078862 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58f125-be07-49c4-8a9a-c1fe8b17c0f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:42.079119 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58f125-be07-49c4-8a9a-c1fe8b17c0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:42.079818 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58f125-be07-49c4-8a9a-c1fe8b17c0f3 admin admin] PATH_INFO: `/v3/projects/67840bbcba2145ada20b8d2784746cb3` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:42.081848 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58f125-be07-49c4-8a9a-c1fe8b17c0f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67840bbcba2145ada20b8d2784746cb3)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:42.084121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58f125-be07-49c4-8a9a-c1fe8b17c0f3 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:42.267121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-be58f125-be07-49c4-8a9a-c1fe8b17c0f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67840bbcba2145ada20b8d2784746cb3', 'request_id': 'req-be58f125-be07-49c4-8a9a-c1fe8b17c0f3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:42.292818 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-be58f125-be07-49c4-8a9a-c1fe8b17c0f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67840bbcba2145ada20b8d2784746cb3', 'request_id': 'req-be58f125-be07-49c4-8a9a-c1fe8b17c0f3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:42.308645 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-be58f125-be07-49c4-8a9a-c1fe8b17c0f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67840bbcba2145ada20b8d2784746cb3', 'request_id': 'req-be58f125-be07-49c4-8a9a-c1fe8b17c0f3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:42.464629 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-be58f125-be07-49c4-8a9a-c1fe8b17c0f3 admin admin] The token cache is being invalidate because project 67840bbcba2145ada20b8d2784746cb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:32:42.473714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-be58f125-be07-49c4-8a9a-c1fe8b17c0f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:42.473714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-be58f125-be07-49c4-8a9a-c1fe8b17c0f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:42.473714 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3132/6292] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:32:41 2022] DELETE /identity/v3/projects/67840bbcba2145ada20b8d2784746cb3 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:32:42.474211 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066bb29-cadb-451f-9966-a3df152ea6da None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:42.474211 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066bb29-cadb-451f-9966-a3df152ea6da None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:42.474718 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066bb29-cadb-451f-9966-a3df152ea6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:42.514809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-5066bb29-cadb-451f-9966-a3df152ea6da None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:32:42.516016 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5066bb29-cadb-451f-9966-a3df152ea6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:42.641283 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3161/6293] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:32:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:32:42.651182 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8aba3a-bf5e-45b8-9ad5-eacb25ee28d5 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:42.651531 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8aba3a-bf5e-45b8-9ad5-eacb25ee28d5 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:42.651827 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8aba3a-bf5e-45b8-9ad5-eacb25ee28d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:42.683715 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-7f8aba3a-bf5e-45b8-9ad5-eacb25ee28d5 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:32:42.687839 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7f8aba3a-bf5e-45b8-9ad5-eacb25ee28d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:42.723564 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3133/6294] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:32:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:32:42.724493 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066bb29-cadb-451f-9966-a3df152ea6da None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:42.738127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066bb29-cadb-451f-9966-a3df152ea6da None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:42.744843 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d9dc4-d4ab-44d0-972c-35bc8e25ed1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:42.745672 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d9dc4-d4ab-44d0-972c-35bc8e25ed1e admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:42.746198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d9dc4-d4ab-44d0-972c-35bc8e25ed1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:42.746692 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d9dc4-d4ab-44d0-972c-35bc8e25ed1e admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:42.747865 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d9dc4-d4ab-44d0-972c-35bc8e25ed1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:32:42.748363 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d9dc4-d4ab-44d0-972c-35bc8e25ed1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:42.750746 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d9dc4-d4ab-44d0-972c-35bc8e25ed1e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:42.773272 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3162/6295] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:32:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:32:42.777922 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8aba3a-bf5e-45b8-9ad5-eacb25ee28d5 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:42.794985 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8aba3a-bf5e-45b8-9ad5-eacb25ee28d5 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:42.801565 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a3427-c12f-43fa-9c83-405e713175e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:42.803199 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a3427-c12f-43fa-9c83-405e713175e2 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:42.803739 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a3427-c12f-43fa-9c83-405e713175e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:42.804134 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a3427-c12f-43fa-9c83-405e713175e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:42.805294 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a3427-c12f-43fa-9c83-405e713175e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:42.807628 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a3427-c12f-43fa-9c83-405e713175e2 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:42.919425 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3134/6296] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:32:42 2022] POST /identity/v3/projects => generated 397 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:32:42.919920 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d9dc4-d4ab-44d0-972c-35bc8e25ed1e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:42.937797 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d9dc4-d4ab-44d0-972c-35bc8e25ed1e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:43.078834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d07ef-ed06-4345-9656-5efb810a389f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:43.082586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d07ef-ed06-4345-9656-5efb810a389f admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:43.083568 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d07ef-ed06-4345-9656-5efb810a389f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:43.084032 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d07ef-ed06-4345-9656-5efb810a389f admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:43.086492 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58d07ef-ed06-4345-9656-5efb810a389f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:43.090921 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58d07ef-ed06-4345-9656-5efb810a389f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:43.219681 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3163/6297] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:32:42 2022] POST /identity/v3/users => generated 299 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:32:43.227442 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a3427-c12f-43fa-9c83-405e713175e2 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:43.240178 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a3427-c12f-43fa-9c83-405e713175e2 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:43.246423 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0232fa6-6333-4e4a-add8-58e2614a546e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:43.249175 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0232fa6-6333-4e4a-add8-58e2614a546e admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:43.249175 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0232fa6-6333-4e4a-add8-58e2614a546e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:43.249175 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0232fa6-6333-4e4a-add8-58e2614a546e admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:43.249175 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0232fa6-6333-4e4a-add8-58e2614a546e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:43.251029 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0232fa6-6333-4e4a-add8-58e2614a546e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:43.270570 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3135/6298] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:32:43.272080 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d07ef-ed06-4345-9656-5efb810a389f admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:43.284416 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d07ef-ed06-4345-9656-5efb810a389f admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:43.293377 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049af58-e160-496e-996e-9152481392a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:43.294689 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049af58-e160-496e-996e-9152481392a6 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:43.295075 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049af58-e160-496e-996e-9152481392a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:43.295579 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049af58-e160-496e-996e-9152481392a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:43.297671 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049af58-e160-496e-996e-9152481392a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:43.299712 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049af58-e160-496e-996e-9152481392a6 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:43.314117 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3164/6299] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:32:43.322933 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0232fa6-6333-4e4a-add8-58e2614a546e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:43.337431 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0232fa6-6333-4e4a-add8-58e2614a546e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:43.344098 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6475fd6-286a-4d1f-ac84-fb193b77713a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:43.345823 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6475fd6-286a-4d1f-ac84-fb193b77713a admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:43.346133 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6475fd6-286a-4d1f-ac84-fb193b77713a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:43.346448 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6475fd6-286a-4d1f-ac84-fb193b77713a admin admin] PATH_INFO: `/v3/projects/fa9b9b28cba848a0b480fd18d2ac01ac/users/6725b003c4f3462aa2ad104fdfab28a2/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:43.366316 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6475fd6-286a-4d1f-ac84-fb193b77713a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa9b9b28cba848a0b480fd18d2ac01ac, user_id=6725b003c4f3462aa2ad104fdfab28a2, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:43.369484 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6475fd6-286a-4d1f-ac84-fb193b77713a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:43.484691 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3136/6300] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:32:43 2022] PUT /identity/v3/projects/fa9b9b28cba848a0b480fd18d2ac01ac/users/6725b003c4f3462aa2ad104fdfab28a2/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:32:43.501122 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5da8e-4ea3-4fdd-b865-6454c2c83cd4 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:43.501683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5da8e-4ea3-4fdd-b865-6454c2c83cd4 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:43.501683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5da8e-4ea3-4fdd-b865-6454c2c83cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:43.533374 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-35c5da8e-4ea3-4fdd-b865-6454c2c83cd4 None None] MFA Rules not processed for user `6725b003c4f3462aa2ad104fdfab28a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:32:43.535100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-35c5da8e-4ea3-4fdd-b865-6454c2c83cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:43.625742 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3165/6301] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:32:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:32:43.684767 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6475fd6-286a-4d1f-ac84-fb193b77713a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:43.687788 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e6475fd6-286a-4d1f-ac84-fb193b77713a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:43.830920 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6475fd6-286a-4d1f-ac84-fb193b77713a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:43.836670 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab82241-afa4-44fb-aa93-d5fae32111b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:43.839386 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab82241-afa4-44fb-aa93-d5fae32111b9 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:43.839881 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab82241-afa4-44fb-aa93-d5fae32111b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:43.840403 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab82241-afa4-44fb-aa93-d5fae32111b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:43.853437 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab82241-afa4-44fb-aa93-d5fae32111b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:43.855283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab82241-afa4-44fb-aa93-d5fae32111b9 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:43.867599 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3137/6302] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:32:43 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:32:44.458853 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5da8e-4ea3-4fdd-b865-6454c2c83cd4 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:44.460361 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-35c5da8e-4ea3-4fdd-b865-6454c2c83cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:44.568794 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5da8e-4ea3-4fdd-b865-6454c2c83cd4 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:44.574898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb3c4e-c501-4204-ab97-3e171045af55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:44.577133 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb3c4e-c501-4204-ab97-3e171045af55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:44.577133 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb3c4e-c501-4204-ab97-3e171045af55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:44.577576 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb3c4e-c501-4204-ab97-3e171045af55 admin admin] PATH_INFO: `/v3/users/1e5bf319f22145459e3c71d158430d63` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:44.579276 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb3c4e-c501-4204-ab97-3e171045af55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e5bf319f22145459e3c71d158430d63)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:44.582152 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb3c4e-c501-4204-ab97-3e171045af55 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:44.800902 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e0bb3c4e-c501-4204-ab97-3e171045af55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e5bf319f22145459e3c71d158430d63'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:44.817919 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e0bb3c4e-c501-4204-ab97-3e171045af55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e5bf319f22145459e3c71d158430d63'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:44.905653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e0bb3c4e-c501-4204-ab97-3e171045af55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e5bf319f22145459e3c71d158430d63'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:44.914897 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e0bb3c4e-c501-4204-ab97-3e171045af55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e5bf319f22145459e3c71d158430d63'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:44.915598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e0bb3c4e-c501-4204-ab97-3e171045af55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e5bf319f22145459e3c71d158430d63'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:44.921889 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3166/6303] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:32:44 2022] DELETE /identity/v3/users/1e5bf319f22145459e3c71d158430d63 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:32:45.558687 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab82241-afa4-44fb-aa93-d5fae32111b9 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:45.578130 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab82241-afa4-44fb-aa93-d5fae32111b9 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:45.683729 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834777a1-85a2-43c5-a522-fcab94d0fd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:45.685811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834777a1-85a2-43c5-a522-fcab94d0fd50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:45.686107 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834777a1-85a2-43c5-a522-fcab94d0fd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:45.686390 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834777a1-85a2-43c5-a522-fcab94d0fd50 admin admin] PATH_INFO: `/v3/projects/83c1c99c0d904b58946a2a623c674759` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:45.687811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834777a1-85a2-43c5-a522-fcab94d0fd50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83c1c99c0d904b58946a2a623c674759)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:45.689824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834777a1-85a2-43c5-a522-fcab94d0fd50 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:45.850954 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-834777a1-85a2-43c5-a522-fcab94d0fd50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83c1c99c0d904b58946a2a623c674759', 'request_id': 'req-834777a1-85a2-43c5-a522-fcab94d0fd50'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:45.876144 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-834777a1-85a2-43c5-a522-fcab94d0fd50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83c1c99c0d904b58946a2a623c674759', 'request_id': 'req-834777a1-85a2-43c5-a522-fcab94d0fd50'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:45.892143 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-834777a1-85a2-43c5-a522-fcab94d0fd50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83c1c99c0d904b58946a2a623c674759', 'request_id': 'req-834777a1-85a2-43c5-a522-fcab94d0fd50'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:45.969495 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-834777a1-85a2-43c5-a522-fcab94d0fd50 admin admin] The token cache is being invalidate because project 83c1c99c0d904b58946a2a623c674759 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:32:45.970089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-834777a1-85a2-43c5-a522-fcab94d0fd50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:45.971927 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-834777a1-85a2-43c5-a522-fcab94d0fd50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:45.974385 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3138/6304] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:32:45 2022] DELETE /identity/v3/projects/83c1c99c0d904b58946a2a623c674759 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:32:45.979389 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb00a2d-bc1b-4adf-aa5d-5a7f46902308 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:45.979881 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb00a2d-bc1b-4adf-aa5d-5a7f46902308 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:45.979987 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb00a2d-bc1b-4adf-aa5d-5a7f46902308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:46.007948 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-ceb00a2d-bc1b-4adf-aa5d-5a7f46902308 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:32:46.009666 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ceb00a2d-bc1b-4adf-aa5d-5a7f46902308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:46.139727 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3167/6305] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:32:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:32:46.147817 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f3685-3ee9-4b8b-ba3d-71bd22ab9a58 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:46.148339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f3685-3ee9-4b8b-ba3d-71bd22ab9a58 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:46.148838 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f3685-3ee9-4b8b-ba3d-71bd22ab9a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:46.168636 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-656f3685-3ee9-4b8b-ba3d-71bd22ab9a58 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:32:46.170546 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-656f3685-3ee9-4b8b-ba3d-71bd22ab9a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:46.178823 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3139/6306] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:32:46.183058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb00a2d-bc1b-4adf-aa5d-5a7f46902308 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:46.192850 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb00a2d-bc1b-4adf-aa5d-5a7f46902308 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:46.197608 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b368211-4cea-40c5-989f-228541668368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:46.198309 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b368211-4cea-40c5-989f-228541668368 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:46.198592 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b368211-4cea-40c5-989f-228541668368 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:46.198869 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b368211-4cea-40c5-989f-228541668368 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:46.199593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b368211-4cea-40c5-989f-228541668368 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:32:46.199902 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b368211-4cea-40c5-989f-228541668368 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:46.201621 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b368211-4cea-40c5-989f-228541668368 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:46.217545 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3168/6307] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:32:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:32:46.222907 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f3685-3ee9-4b8b-ba3d-71bd22ab9a58 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:46.248008 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f3685-3ee9-4b8b-ba3d-71bd22ab9a58 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:46.255576 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1cfc00-95c3-469d-80fd-1cada5058149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:46.256542 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cfc00-95c3-469d-80fd-1cada5058149 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:46.257092 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cfc00-95c3-469d-80fd-1cada5058149 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:46.257599 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cfc00-95c3-469d-80fd-1cada5058149 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:46.258549 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1cfc00-95c3-469d-80fd-1cada5058149 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:46.261652 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1cfc00-95c3-469d-80fd-1cada5058149 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:46.398992 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3140/6308] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:32:46 2022] POST /identity/v3/projects => generated 373 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:32:46.405366 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b368211-4cea-40c5-989f-228541668368 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:46.418187 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b368211-4cea-40c5-989f-228541668368 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:46.565648 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa64615-b40d-4605-ba36-6edb47ef22ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:46.566640 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa64615-b40d-4605-ba36-6edb47ef22ba admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:46.567271 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa64615-b40d-4605-ba36-6edb47ef22ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:46.567707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa64615-b40d-4605-ba36-6edb47ef22ba admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:46.568797 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa64615-b40d-4605-ba36-6edb47ef22ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:46.571599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa64615-b40d-4605-ba36-6edb47ef22ba admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:46.726255 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3169/6309] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:32:46 2022] POST /identity/v3/users => generated 287 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:32:46.732701 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1cfc00-95c3-469d-80fd-1cada5058149 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:46.752689 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1cfc00-95c3-469d-80fd-1cada5058149 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:46.760418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e8daa-ffa7-4fc0-beca-edb68e844e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:46.761172 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e8daa-ffa7-4fc0-beca-edb68e844e1b admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:46.761458 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e8daa-ffa7-4fc0-beca-edb68e844e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:46.761736 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e8daa-ffa7-4fc0-beca-edb68e844e1b admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:46.762507 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e8daa-ffa7-4fc0-beca-edb68e844e1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:46.765491 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e8daa-ffa7-4fc0-beca-edb68e844e1b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:46.778216 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3141/6310] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:32:46.783064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa64615-b40d-4605-ba36-6edb47ef22ba admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:46.796297 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa64615-b40d-4605-ba36-6edb47ef22ba admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:46.799425 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256599af-56a7-4bdd-8153-b895851d8276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:46.800277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256599af-56a7-4bdd-8153-b895851d8276 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:46.800628 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256599af-56a7-4bdd-8153-b895851d8276 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:46.801036 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256599af-56a7-4bdd-8153-b895851d8276 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:46.801850 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256599af-56a7-4bdd-8153-b895851d8276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:46.803527 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256599af-56a7-4bdd-8153-b895851d8276 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:46.822680 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3170/6311] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:32:46.833165 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e8daa-ffa7-4fc0-beca-edb68e844e1b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:46.844877 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e8daa-ffa7-4fc0-beca-edb68e844e1b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:46.851018 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54360335-d6ab-4f95-936a-83e6e153e06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:46.852014 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54360335-d6ab-4f95-936a-83e6e153e06a admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:46.852378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54360335-d6ab-4f95-936a-83e6e153e06a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:46.852731 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54360335-d6ab-4f95-936a-83e6e153e06a admin admin] PATH_INFO: `/v3/projects/280a6ce7a084421bbd267c7ac5c907ca/users/7757dd58d9db44f89d86bf2217719d09/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:46.883191 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54360335-d6ab-4f95-936a-83e6e153e06a admin admin] RBAC: Authorizing `identity:create_grant(project_id=280a6ce7a084421bbd267c7ac5c907ca, user_id=7757dd58d9db44f89d86bf2217719d09, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:46.890471 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54360335-d6ab-4f95-936a-83e6e153e06a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:46.985724 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3142/6312] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:32:46 2022] PUT /identity/v3/projects/280a6ce7a084421bbd267c7ac5c907ca/users/7757dd58d9db44f89d86bf2217719d09/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:32:46.995711 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76973113-4d9b-4877-96f9-04f8cfbbb89e None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:46.996679 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76973113-4d9b-4877-96f9-04f8cfbbb89e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:46.997262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76973113-4d9b-4877-96f9-04f8cfbbb89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:47.052186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-76973113-4d9b-4877-96f9-04f8cfbbb89e None None] MFA Rules not processed for user `7757dd58d9db44f89d86bf2217719d09`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:32:47.053335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-76973113-4d9b-4877-96f9-04f8cfbbb89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:47.308379 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3171/6313] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:32:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:32:47.322540 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54360335-d6ab-4f95-936a-83e6e153e06a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:47.329858 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-54360335-d6ab-4f95-936a-83e6e153e06a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:47.455179 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54360335-d6ab-4f95-936a-83e6e153e06a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:47.460969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688382f1-b885-4394-b597-c4b777a5bc5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:47.462431 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688382f1-b885-4394-b597-c4b777a5bc5a service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:47.462820 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688382f1-b885-4394-b597-c4b777a5bc5a service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:47.463583 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688382f1-b885-4394-b597-c4b777a5bc5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:47.476832 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688382f1-b885-4394-b597-c4b777a5bc5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:47.479815 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688382f1-b885-4394-b597-c4b777a5bc5a service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:47.494900 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3143/6314] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:32:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:32:50.603752 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769edea0-e60d-46b1-a984-ecca75cd0901 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:50.604205 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769edea0-e60d-46b1-a984-ecca75cd0901 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:50.604205 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769edea0-e60d-46b1-a984-ecca75cd0901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:50.629010 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-769edea0-e60d-46b1-a984-ecca75cd0901 None None] MFA Rules not processed for user `7757dd58d9db44f89d86bf2217719d09`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:32:50.630951 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-769edea0-e60d-46b1-a984-ecca75cd0901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:50.641860 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3172/6315] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:32:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:32:50.781151 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688382f1-b885-4394-b597-c4b777a5bc5a service cinder] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:50.785140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-688382f1-b885-4394-b597-c4b777a5bc5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:50.918729 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688382f1-b885-4394-b597-c4b777a5bc5a service cinder] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:50.935533 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6efb49-b326-4e3d-90fb-674a584e0a46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:50.936208 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6efb49-b326-4e3d-90fb-674a584e0a46 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:50.936491 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6efb49-b326-4e3d-90fb-674a584e0a46 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:50.936766 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6efb49-b326-4e3d-90fb-674a584e0a46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:50.952120 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-fa6efb49-b326-4e3d-90fb-674a584e0a46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:50.975341 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6efb49-b326-4e3d-90fb-674a584e0a46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:50.977980 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6efb49-b326-4e3d-90fb-674a584e0a46 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:51.030577 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3144/6316] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:32:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:32:59.483397 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769edea0-e60d-46b1-a984-ecca75cd0901 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:32:59.490131 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-769edea0-e60d-46b1-a984-ecca75cd0901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:32:59.599847 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769edea0-e60d-46b1-a984-ecca75cd0901 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:32:59.606929 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec4977-ebb4-4c4d-b902-813d42622916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:32:59.607895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec4977-ebb4-4c4d-b902-813d42622916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:59.608255 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec4977-ebb4-4c4d-b902-813d42622916 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:59.608595 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec4977-ebb4-4c4d-b902-813d42622916 admin admin] PATH_INFO: `/v3/users/130ec0598cde462797d418f5e32947fe` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:59.609909 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec4977-ebb4-4c4d-b902-813d42622916 admin admin] RBAC: Authorizing `identity:delete_user(user_id=130ec0598cde462797d418f5e32947fe)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:32:59.612094 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec4977-ebb4-4c4d-b902-813d42622916 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:32:59.808871 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-20ec4977-ebb4-4c4d-b902-813d42622916 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '130ec0598cde462797d418f5e32947fe'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:59.821606 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-20ec4977-ebb4-4c4d-b902-813d42622916 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '130ec0598cde462797d418f5e32947fe'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:59.915804 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-20ec4977-ebb4-4c4d-b902-813d42622916 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '130ec0598cde462797d418f5e32947fe'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:59.924902 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-20ec4977-ebb4-4c4d-b902-813d42622916 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '130ec0598cde462797d418f5e32947fe'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:59.926010 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-20ec4977-ebb4-4c4d-b902-813d42622916 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '130ec0598cde462797d418f5e32947fe'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:32:59.932652 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3173/6317] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:32:59 2022] DELETE /identity/v3/users/130ec0598cde462797d418f5e32947fe => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:32:59.938238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d07c3-4adb-424a-b72f-1bf8269512a2 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:32:59.938808 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d07c3-4adb-424a-b72f-1bf8269512a2 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:32:59.938808 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d07c3-4adb-424a-b72f-1bf8269512a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:32:59.958487 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-f33d07c3-4adb-424a-b72f-1bf8269512a2 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:32:59.959736 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f33d07c3-4adb-424a-b72f-1bf8269512a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:00.026965 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3145/6318] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:32:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:33:00.037069 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec4977-ebb4-4c4d-b902-813d42622916 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:00.038885 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-20ec4977-ebb4-4c4d-b902-813d42622916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:00.113501 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec4977-ebb4-4c4d-b902-813d42622916 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:00.117340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343e84a-5b9b-4354-9457-b31ff92f07f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:00.118301 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343e84a-5b9b-4354-9457-b31ff92f07f2 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:00.118750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343e84a-5b9b-4354-9457-b31ff92f07f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:00.119184 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343e84a-5b9b-4354-9457-b31ff92f07f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:00.130488 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343e84a-5b9b-4354-9457-b31ff92f07f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:00.132089 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343e84a-5b9b-4354-9457-b31ff92f07f2 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:00.143953 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3174/6319] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:33:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:33:00.461551 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d07c3-4adb-424a-b72f-1bf8269512a2 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:00.465165 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f33d07c3-4adb-424a-b72f-1bf8269512a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:00.482425 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d07c3-4adb-424a-b72f-1bf8269512a2 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:00.488124 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e125b15-ab60-4473-8845-616f5bbe3afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:00.489478 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e125b15-ab60-4473-8845-616f5bbe3afb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:00.490087 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e125b15-ab60-4473-8845-616f5bbe3afb admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:00.490735 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e125b15-ab60-4473-8845-616f5bbe3afb admin admin] PATH_INFO: `/v3/projects/9f5e0f9efa654f5dae365ec38503ccba` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:00.492202 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e125b15-ab60-4473-8845-616f5bbe3afb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f5e0f9efa654f5dae365ec38503ccba)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:00.495500 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e125b15-ab60-4473-8845-616f5bbe3afb admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:00.664106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4e125b15-ab60-4473-8845-616f5bbe3afb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f5e0f9efa654f5dae365ec38503ccba', 'request_id': 'req-4e125b15-ab60-4473-8845-616f5bbe3afb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:00.681251 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4e125b15-ab60-4473-8845-616f5bbe3afb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f5e0f9efa654f5dae365ec38503ccba', 'request_id': 'req-4e125b15-ab60-4473-8845-616f5bbe3afb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:00.689458 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4e125b15-ab60-4473-8845-616f5bbe3afb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f5e0f9efa654f5dae365ec38503ccba', 'request_id': 'req-4e125b15-ab60-4473-8845-616f5bbe3afb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:00.776850 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4e125b15-ab60-4473-8845-616f5bbe3afb admin admin] The token cache is being invalidate because project 9f5e0f9efa654f5dae365ec38503ccba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:33:00.777533 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4e125b15-ab60-4473-8845-616f5bbe3afb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:00.779135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4e125b15-ab60-4473-8845-616f5bbe3afb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:00.781559 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3146/6320] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:33:00 2022] DELETE /identity/v3/projects/9f5e0f9efa654f5dae365ec38503ccba => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:00.785538 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343e84a-5b9b-4354-9457-b31ff92f07f2 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:00.797179 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343e84a-5b9b-4354-9457-b31ff92f07f2 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:00.886302 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6937664-191a-4bf7-a4cb-51ec259f5314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:00.888654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6937664-191a-4bf7-a4cb-51ec259f5314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:00.888946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6937664-191a-4bf7-a4cb-51ec259f5314 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:00.889224 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6937664-191a-4bf7-a4cb-51ec259f5314 admin admin] PATH_INFO: `/v3/users/c33a0871f1b047a4b8ce395958e6b102` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:00.890574 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6937664-191a-4bf7-a4cb-51ec259f5314 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c33a0871f1b047a4b8ce395958e6b102)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:00.892612 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6937664-191a-4bf7-a4cb-51ec259f5314 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:01.103668 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f6937664-191a-4bf7-a4cb-51ec259f5314 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c33a0871f1b047a4b8ce395958e6b102'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:01.141824 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f6937664-191a-4bf7-a4cb-51ec259f5314 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c33a0871f1b047a4b8ce395958e6b102'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:01.236426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f6937664-191a-4bf7-a4cb-51ec259f5314 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c33a0871f1b047a4b8ce395958e6b102'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:01.250496 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f6937664-191a-4bf7-a4cb-51ec259f5314 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c33a0871f1b047a4b8ce395958e6b102'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:01.251971 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f6937664-191a-4bf7-a4cb-51ec259f5314 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c33a0871f1b047a4b8ce395958e6b102'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:01.292204 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3175/6321] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:33:00 2022] DELETE /identity/v3/users/c33a0871f1b047a4b8ce395958e6b102 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:01.769571 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e125b15-ab60-4473-8845-616f5bbe3afb admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:01.771282 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4e125b15-ab60-4473-8845-616f5bbe3afb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:01.788264 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e125b15-ab60-4473-8845-616f5bbe3afb admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:01.851652 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc08df4-68b9-4850-92b8-d7dcddc1ca40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:01.852528 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc08df4-68b9-4850-92b8-d7dcddc1ca40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:01.852810 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc08df4-68b9-4850-92b8-d7dcddc1ca40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:01.853237 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc08df4-68b9-4850-92b8-d7dcddc1ca40 admin admin] PATH_INFO: `/v3/projects/7a6bb5ada2f848e6a2b90c68b56c232d` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:01.854720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc08df4-68b9-4850-92b8-d7dcddc1ca40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a6bb5ada2f848e6a2b90c68b56c232d)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:01.857530 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc08df4-68b9-4850-92b8-d7dcddc1ca40 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:01.993720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2bc08df4-68b9-4850-92b8-d7dcddc1ca40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a6bb5ada2f848e6a2b90c68b56c232d', 'request_id': 'req-2bc08df4-68b9-4850-92b8-d7dcddc1ca40'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:01.999869 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2bc08df4-68b9-4850-92b8-d7dcddc1ca40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a6bb5ada2f848e6a2b90c68b56c232d', 'request_id': 'req-2bc08df4-68b9-4850-92b8-d7dcddc1ca40'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:02.006875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2bc08df4-68b9-4850-92b8-d7dcddc1ca40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a6bb5ada2f848e6a2b90c68b56c232d', 'request_id': 'req-2bc08df4-68b9-4850-92b8-d7dcddc1ca40'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:02.087212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2bc08df4-68b9-4850-92b8-d7dcddc1ca40 admin admin] The token cache is being invalidate because project 7a6bb5ada2f848e6a2b90c68b56c232d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:33:02.087607 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2bc08df4-68b9-4850-92b8-d7dcddc1ca40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:02.088383 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2bc08df4-68b9-4850-92b8-d7dcddc1ca40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:02.090112 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3147/6322] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:33:01 2022] DELETE /identity/v3/projects/7a6bb5ada2f848e6a2b90c68b56c232d => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:02.095677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82300173-6ed5-42f1-aab4-af00488810e3 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:02.096648 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82300173-6ed5-42f1-aab4-af00488810e3 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:02.096944 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82300173-6ed5-42f1-aab4-af00488810e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:02.115498 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-82300173-6ed5-42f1-aab4-af00488810e3 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:02.117002 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-82300173-6ed5-42f1-aab4-af00488810e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:02.180111 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3176/6323] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:33:02.189873 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914d417-2abc-4e7c-8051-fda3e01d5e59 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:02.190211 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914d417-2abc-4e7c-8051-fda3e01d5e59 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:02.190449 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914d417-2abc-4e7c-8051-fda3e01d5e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:02.208958 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-1914d417-2abc-4e7c-8051-fda3e01d5e59 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:02.210214 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1914d417-2abc-4e7c-8051-fda3e01d5e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:02.218444 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3148/6324] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:33:02.222816 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82300173-6ed5-42f1-aab4-af00488810e3 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:02.233473 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82300173-6ed5-42f1-aab4-af00488810e3 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:02.238476 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e6a63-0bdd-496f-a329-32b0107d4bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:02.250615 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e6a63-0bdd-496f-a329-32b0107d4bbf admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:02.250615 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e6a63-0bdd-496f-a329-32b0107d4bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:02.250615 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e6a63-0bdd-496f-a329-32b0107d4bbf admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:02.250615 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e6a63-0bdd-496f-a329-32b0107d4bbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:33:02.250615 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e6a63-0bdd-496f-a329-32b0107d4bbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:02.250615 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e6a63-0bdd-496f-a329-32b0107d4bbf admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:02.261206 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3177/6325] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:33:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:33:02.262847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914d417-2abc-4e7c-8051-fda3e01d5e59 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:02.302612 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914d417-2abc-4e7c-8051-fda3e01d5e59 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:02.308605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35d06a-6781-46c1-a701-7c9ed7f95793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:02.310247 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35d06a-6781-46c1-a701-7c9ed7f95793 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:02.310914 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35d06a-6781-46c1-a701-7c9ed7f95793 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:02.311415 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35d06a-6781-46c1-a701-7c9ed7f95793 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:02.312570 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35d06a-6781-46c1-a701-7c9ed7f95793 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:02.314863 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35d06a-6781-46c1-a701-7c9ed7f95793 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:02.452588 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3149/6326] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:33:02 2022] POST /identity/v3/projects => generated 369 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:33:02.464227 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e6a63-0bdd-496f-a329-32b0107d4bbf admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:02.479351 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e6a63-0bdd-496f-a329-32b0107d4bbf admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:02.575714 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e88ac-f6ef-4ad1-b41a-ede1d595a09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:02.577444 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e88ac-f6ef-4ad1-b41a-ede1d595a09c admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:02.578187 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e88ac-f6ef-4ad1-b41a-ede1d595a09c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:02.578652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e88ac-f6ef-4ad1-b41a-ede1d595a09c admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:02.579587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e88ac-f6ef-4ad1-b41a-ede1d595a09c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:02.586544 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e88ac-f6ef-4ad1-b41a-ede1d595a09c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:02.696567 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3178/6327] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:33:02 2022] POST /identity/v3/users => generated 285 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:33:02.702146 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35d06a-6781-46c1-a701-7c9ed7f95793 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:02.718541 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35d06a-6781-46c1-a701-7c9ed7f95793 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:02.724366 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f956b-f621-41cc-8ff5-bc0b813aba9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:02.725648 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f956b-f621-41cc-8ff5-bc0b813aba9d admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:02.726337 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f956b-f621-41cc-8ff5-bc0b813aba9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:02.726899 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f956b-f621-41cc-8ff5-bc0b813aba9d admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:02.728809 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f956b-f621-41cc-8ff5-bc0b813aba9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:02.730880 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f956b-f621-41cc-8ff5-bc0b813aba9d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:02.745672 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3150/6328] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:33:02.749096 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e88ac-f6ef-4ad1-b41a-ede1d595a09c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:02.762848 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e88ac-f6ef-4ad1-b41a-ede1d595a09c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:02.779823 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e837c7-f029-4cfb-aae2-f01dedd2702b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:02.784383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e837c7-f029-4cfb-aae2-f01dedd2702b admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:02.784383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e837c7-f029-4cfb-aae2-f01dedd2702b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:02.784383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e837c7-f029-4cfb-aae2-f01dedd2702b admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:02.784383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e837c7-f029-4cfb-aae2-f01dedd2702b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:02.784383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e837c7-f029-4cfb-aae2-f01dedd2702b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:02.816818 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3179/6329] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:33:02.820478 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f956b-f621-41cc-8ff5-bc0b813aba9d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:02.833158 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f956b-f621-41cc-8ff5-bc0b813aba9d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:02.860725 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bf0a9-37e0-4cc7-b374-0099f5e9364e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:02.861648 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bf0a9-37e0-4cc7-b374-0099f5e9364e admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:02.861960 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bf0a9-37e0-4cc7-b374-0099f5e9364e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:02.862244 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bf0a9-37e0-4cc7-b374-0099f5e9364e admin admin] PATH_INFO: `/v3/projects/550652796d154770baf0a73e08f865dc/users/53c34db031e74351979ccf78c73f44c8/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:02.883681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7bf0a9-37e0-4cc7-b374-0099f5e9364e admin admin] RBAC: Authorizing `identity:create_grant(project_id=550652796d154770baf0a73e08f865dc, user_id=53c34db031e74351979ccf78c73f44c8, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:02.883681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7bf0a9-37e0-4cc7-b374-0099f5e9364e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:03.002246 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3151/6330] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:33:02 2022] PUT /identity/v3/projects/550652796d154770baf0a73e08f865dc/users/53c34db031e74351979ccf78c73f44c8/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:03.013673 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95fd13b-019b-490b-b006-8242e269b913 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:03.013991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95fd13b-019b-490b-b006-8242e269b913 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:03.014409 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95fd13b-019b-490b-b006-8242e269b913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:03.063032 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-c95fd13b-019b-490b-b006-8242e269b913 None None] MFA Rules not processed for user `53c34db031e74351979ccf78c73f44c8`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:03.063943 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c95fd13b-019b-490b-b006-8242e269b913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:03.178932 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3180/6331] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:03 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:33:03.182229 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bf0a9-37e0-4cc7-b374-0099f5e9364e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:03.258261 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bf0a9-37e0-4cc7-b374-0099f5e9364e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:03.289351 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ace062-bdd6-40e2-b7a5-85bfb6eb18be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:03.290321 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ace062-bdd6-40e2-b7a5-85bfb6eb18be admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:03.291320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ace062-bdd6-40e2-b7a5-85bfb6eb18be admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:03.291639 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ace062-bdd6-40e2-b7a5-85bfb6eb18be admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:03.292387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ace062-bdd6-40e2-b7a5-85bfb6eb18be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:03.297382 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ace062-bdd6-40e2-b7a5-85bfb6eb18be admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:03.463846 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3152/6332] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:33:03 2022] POST /identity/v3/projects => generated 367 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:33:03.467985 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95fd13b-019b-490b-b006-8242e269b913 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:03.484272 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95fd13b-019b-490b-b006-8242e269b913 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:03.616493 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a182988-4e8c-464c-a2b6-3433dbd4ac88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:03.617479 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a182988-4e8c-464c-a2b6-3433dbd4ac88 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:03.623099 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a182988-4e8c-464c-a2b6-3433dbd4ac88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:03.623099 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a182988-4e8c-464c-a2b6-3433dbd4ac88 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:03.623099 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a182988-4e8c-464c-a2b6-3433dbd4ac88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:03.623099 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a182988-4e8c-464c-a2b6-3433dbd4ac88 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:03.719437 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3181/6333] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:33:03 2022] POST /identity/v3/users => generated 290 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:33:03.721647 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ace062-bdd6-40e2-b7a5-85bfb6eb18be admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:03.747323 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ace062-bdd6-40e2-b7a5-85bfb6eb18be admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:03.752360 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf156e-d3ce-485d-a214-9154e76ed67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:03.753041 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf156e-d3ce-485d-a214-9154e76ed67f admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:03.753327 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf156e-d3ce-485d-a214-9154e76ed67f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:03.753634 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf156e-d3ce-485d-a214-9154e76ed67f admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:03.754563 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf156e-d3ce-485d-a214-9154e76ed67f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:03.759910 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf156e-d3ce-485d-a214-9154e76ed67f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:03.773875 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3153/6334] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:33:03.775541 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a182988-4e8c-464c-a2b6-3433dbd4ac88 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:03.790970 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a182988-4e8c-464c-a2b6-3433dbd4ac88 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:03.796828 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3dfbcb-f1d3-4a0f-bf4a-e1aafff1b6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:03.798090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3dfbcb-f1d3-4a0f-bf4a-e1aafff1b6bb admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:03.798859 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3dfbcb-f1d3-4a0f-bf4a-e1aafff1b6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:03.798859 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3dfbcb-f1d3-4a0f-bf4a-e1aafff1b6bb admin admin] PATH_INFO: `/v3/projects/306af5b78d2b45dcb9dedf50d1250f91/users/4308901beda44daca7b4f3388ed12b25/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:03.849724 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3dfbcb-f1d3-4a0f-bf4a-e1aafff1b6bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=306af5b78d2b45dcb9dedf50d1250f91, user_id=4308901beda44daca7b4f3388ed12b25, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:03.852837 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3dfbcb-f1d3-4a0f-bf4a-e1aafff1b6bb admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:03.929630 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3182/6335] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:33:03 2022] PUT /identity/v3/projects/306af5b78d2b45dcb9dedf50d1250f91/users/4308901beda44daca7b4f3388ed12b25/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:33:03.934683 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf156e-d3ce-485d-a214-9154e76ed67f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:03.956960 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf156e-d3ce-485d-a214-9154e76ed67f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:04.073933 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f487a-1a12-4311-9364-6dfc609bd439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:04.074978 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f487a-1a12-4311-9364-6dfc609bd439 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:04.075403 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f487a-1a12-4311-9364-6dfc609bd439 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:04.075832 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f487a-1a12-4311-9364-6dfc609bd439 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:04.076696 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f487a-1a12-4311-9364-6dfc609bd439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:04.078884 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f487a-1a12-4311-9364-6dfc609bd439 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:04.090774 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3154/6336] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:33:04.095326 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3dfbcb-f1d3-4a0f-bf4a-e1aafff1b6bb admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:04.111223 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3dfbcb-f1d3-4a0f-bf4a-e1aafff1b6bb admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:04.115949 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b302ff-fb81-41d1-809f-cec21111d846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:04.116856 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b302ff-fb81-41d1-809f-cec21111d846 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:04.117134 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b302ff-fb81-41d1-809f-cec21111d846 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:04.117409 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b302ff-fb81-41d1-809f-cec21111d846 admin admin] PATH_INFO: `/v3/projects/306af5b78d2b45dcb9dedf50d1250f91/users/4308901beda44daca7b4f3388ed12b25/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:04.119544 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b302ff-fb81-41d1-809f-cec21111d846 admin admin] RBAC: Authorizing `identity:create_grant(project_id=306af5b78d2b45dcb9dedf50d1250f91, user_id=4308901beda44daca7b4f3388ed12b25, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:04.122371 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b302ff-fb81-41d1-809f-cec21111d846 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:04.133230 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3183/6337] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:33:04 2022] PUT /identity/v3/projects/306af5b78d2b45dcb9dedf50d1250f91/users/4308901beda44daca7b4f3388ed12b25/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:04.146914 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca88cb-e069-4036-9d28-bb6c7ba772c8 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:04.147270 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca88cb-e069-4036-9d28-bb6c7ba772c8 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:04.147683 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca88cb-e069-4036-9d28-bb6c7ba772c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:04.189951 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-8dca88cb-e069-4036-9d28-bb6c7ba772c8 None None] MFA Rules not processed for user `4308901beda44daca7b4f3388ed12b25`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:04.191599 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8dca88cb-e069-4036-9d28-bb6c7ba772c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:04.274459 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3155/6338] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:04 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:33:04.286020 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b302ff-fb81-41d1-809f-cec21111d846 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:04.289118 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-37b302ff-fb81-41d1-809f-cec21111d846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:04.358200 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b302ff-fb81-41d1-809f-cec21111d846 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:04.364277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c16a5-4dac-4d82-a0a1-409afb7874c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:04.364277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c16a5-4dac-4d82-a0a1-409afb7874c5 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:04.364277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c16a5-4dac-4d82-a0a1-409afb7874c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:04.364277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c16a5-4dac-4d82-a0a1-409afb7874c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:04.374454 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c16a5-4dac-4d82-a0a1-409afb7874c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:04.375923 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c16a5-4dac-4d82-a0a1-409afb7874c5 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:04.387675 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3184/6339] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:33:04 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:33:05.592621 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca88cb-e069-4036-9d28-bb6c7ba772c8 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:05.594188 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8dca88cb-e069-4036-9d28-bb6c7ba772c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:05.724291 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca88cb-e069-4036-9d28-bb6c7ba772c8 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:05.738982 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe422c3-cdc7-403d-9cd8-584a6109f743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:05.740177 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe422c3-cdc7-403d-9cd8-584a6109f743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:05.740924 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe422c3-cdc7-403d-9cd8-584a6109f743 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:05.741366 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe422c3-cdc7-403d-9cd8-584a6109f743 admin admin] PATH_INFO: `/v3/users/baf1d13615bc491ab98d2a644e681c12` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:05.742845 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe422c3-cdc7-403d-9cd8-584a6109f743 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baf1d13615bc491ab98d2a644e681c12)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:05.745905 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe422c3-cdc7-403d-9cd8-584a6109f743 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:05.930518 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-dbe422c3-cdc7-403d-9cd8-584a6109f743 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baf1d13615bc491ab98d2a644e681c12'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:05.963799 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-dbe422c3-cdc7-403d-9cd8-584a6109f743 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baf1d13615bc491ab98d2a644e681c12'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:06.052414 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-dbe422c3-cdc7-403d-9cd8-584a6109f743 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baf1d13615bc491ab98d2a644e681c12'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:06.053440 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-dbe422c3-cdc7-403d-9cd8-584a6109f743 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baf1d13615bc491ab98d2a644e681c12'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:06.062066 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-dbe422c3-cdc7-403d-9cd8-584a6109f743 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baf1d13615bc491ab98d2a644e681c12'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:06.077916 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3156/6340] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:33:05 2022] DELETE /identity/v3/users/baf1d13615bc491ab98d2a644e681c12 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:06.720907 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c16a5-4dac-4d82-a0a1-409afb7874c5 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:06.738682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c16a5-4dac-4d82-a0a1-409afb7874c5 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:06.867347 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e31253-2593-4767-b7ba-6f10c6cee681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:06.869041 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e31253-2593-4767-b7ba-6f10c6cee681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:06.869504 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e31253-2593-4767-b7ba-6f10c6cee681 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:06.870050 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e31253-2593-4767-b7ba-6f10c6cee681 admin admin] PATH_INFO: `/v3/projects/3383c2433214484eb41e99aacb653b80` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:06.874794 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e31253-2593-4767-b7ba-6f10c6cee681 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3383c2433214484eb41e99aacb653b80)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:06.878116 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e31253-2593-4767-b7ba-6f10c6cee681 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:06.994706 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a7e31253-2593-4767-b7ba-6f10c6cee681 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3383c2433214484eb41e99aacb653b80', 'request_id': 'req-a7e31253-2593-4767-b7ba-6f10c6cee681'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:07.004309 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a7e31253-2593-4767-b7ba-6f10c6cee681 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3383c2433214484eb41e99aacb653b80', 'request_id': 'req-a7e31253-2593-4767-b7ba-6f10c6cee681'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:07.012767 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a7e31253-2593-4767-b7ba-6f10c6cee681 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3383c2433214484eb41e99aacb653b80', 'request_id': 'req-a7e31253-2593-4767-b7ba-6f10c6cee681'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:07.082527 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a7e31253-2593-4767-b7ba-6f10c6cee681 admin admin] The token cache is being invalidate because project 3383c2433214484eb41e99aacb653b80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:33:07.083158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a7e31253-2593-4767-b7ba-6f10c6cee681 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:07.084112 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a7e31253-2593-4767-b7ba-6f10c6cee681 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:07.087021 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3185/6341] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:33:06 2022] DELETE /identity/v3/projects/3383c2433214484eb41e99aacb653b80 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:07.092640 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503c220-a758-4b85-8ae0-8d9d76a0ca02 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:07.093704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503c220-a758-4b85-8ae0-8d9d76a0ca02 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:07.094166 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503c220-a758-4b85-8ae0-8d9d76a0ca02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:07.134523 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-a503c220-a758-4b85-8ae0-8d9d76a0ca02 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:07.135768 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a503c220-a758-4b85-8ae0-8d9d76a0ca02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:07.235366 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3157/6342] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:33:07.243979 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073007d7-e73d-48ef-99c0-48e2f16cac1b None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:07.244282 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073007d7-e73d-48ef-99c0-48e2f16cac1b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:07.244568 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073007d7-e73d-48ef-99c0-48e2f16cac1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:07.277331 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-073007d7-e73d-48ef-99c0-48e2f16cac1b None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:07.280898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-073007d7-e73d-48ef-99c0-48e2f16cac1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:07.291089 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3186/6343] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:33:07.295136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503c220-a758-4b85-8ae0-8d9d76a0ca02 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:07.310286 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503c220-a758-4b85-8ae0-8d9d76a0ca02 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:07.318912 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8accca-1c4e-41de-a5a4-42e16325ab6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:07.320061 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8accca-1c4e-41de-a5a4-42e16325ab6c admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:07.320501 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8accca-1c4e-41de-a5a4-42e16325ab6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:07.320945 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8accca-1c4e-41de-a5a4-42e16325ab6c admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:07.322313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8accca-1c4e-41de-a5a4-42e16325ab6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:33:07.322787 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8accca-1c4e-41de-a5a4-42e16325ab6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:07.326829 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8accca-1c4e-41de-a5a4-42e16325ab6c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:07.354733 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3158/6344] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:33:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:33:07.359063 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073007d7-e73d-48ef-99c0-48e2f16cac1b None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:07.372535 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073007d7-e73d-48ef-99c0-48e2f16cac1b None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:07.386519 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c7734-f601-4d2c-9b94-a21c29ee06c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:07.388208 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c7734-f601-4d2c-9b94-a21c29ee06c5 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:07.388208 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c7734-f601-4d2c-9b94-a21c29ee06c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:07.388442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c7734-f601-4d2c-9b94-a21c29ee06c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:07.388957 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c7734-f601-4d2c-9b94-a21c29ee06c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:07.390919 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c7734-f601-4d2c-9b94-a21c29ee06c5 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:07.532306 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3187/6345] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:33:07 2022] POST /identity/v3/projects => generated 365 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:33:07.537830 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8accca-1c4e-41de-a5a4-42e16325ab6c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:07.552980 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8accca-1c4e-41de-a5a4-42e16325ab6c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:07.695248 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f66d6-2c83-4ed3-9131-6b0b55e11a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:07.696194 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f66d6-2c83-4ed3-9131-6b0b55e11a61 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:07.696713 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f66d6-2c83-4ed3-9131-6b0b55e11a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:07.697216 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f66d6-2c83-4ed3-9131-6b0b55e11a61 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:07.698244 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f66d6-2c83-4ed3-9131-6b0b55e11a61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:07.700514 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f66d6-2c83-4ed3-9131-6b0b55e11a61 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:07.793130 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3159/6346] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:33:07 2022] POST /identity/v3/users => generated 283 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:33:07.796680 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c7734-f601-4d2c-9b94-a21c29ee06c5 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:07.812008 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c7734-f601-4d2c-9b94-a21c29ee06c5 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:07.818834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf1f3d-ea36-4f7c-86bb-1effaca0ed50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:07.819859 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf1f3d-ea36-4f7c-86bb-1effaca0ed50 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:07.820793 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf1f3d-ea36-4f7c-86bb-1effaca0ed50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:07.821451 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf1f3d-ea36-4f7c-86bb-1effaca0ed50 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:07.823025 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf1f3d-ea36-4f7c-86bb-1effaca0ed50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:07.828973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf1f3d-ea36-4f7c-86bb-1effaca0ed50 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:07.844600 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3188/6347] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:33:07.850351 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f66d6-2c83-4ed3-9131-6b0b55e11a61 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:07.864914 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f66d6-2c83-4ed3-9131-6b0b55e11a61 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:07.876566 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8483394-c94c-4659-822b-3cddb81d7272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:07.877948 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8483394-c94c-4659-822b-3cddb81d7272 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:07.878440 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8483394-c94c-4659-822b-3cddb81d7272 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:07.878947 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8483394-c94c-4659-822b-3cddb81d7272 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:07.880501 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8483394-c94c-4659-822b-3cddb81d7272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:07.882652 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8483394-c94c-4659-822b-3cddb81d7272 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:07.909189 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf1f3d-ea36-4f7c-86bb-1effaca0ed50 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:07.911289 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3160/6348] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:33:07.926087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf1f3d-ea36-4f7c-86bb-1effaca0ed50 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:07.938617 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad20f8-7bf5-4e83-b370-ff53b38e31e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:07.940125 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad20f8-7bf5-4e83-b370-ff53b38e31e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:07.940525 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad20f8-7bf5-4e83-b370-ff53b38e31e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:07.941588 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad20f8-7bf5-4e83-b370-ff53b38e31e2 admin admin] PATH_INFO: `/v3/projects/e2f460bf9ccf4f54b9262eabcd98ca79/users/87d9edc65dd248dca51a7421e9bbd335/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:07.964288 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad20f8-7bf5-4e83-b370-ff53b38e31e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2f460bf9ccf4f54b9262eabcd98ca79, user_id=87d9edc65dd248dca51a7421e9bbd335, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:07.968699 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad20f8-7bf5-4e83-b370-ff53b38e31e2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:08.080547 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3189/6349] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:33:07 2022] PUT /identity/v3/projects/e2f460bf9ccf4f54b9262eabcd98ca79/users/87d9edc65dd248dca51a7421e9bbd335/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:08.101548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1558507-72bc-499b-8a1a-f37b8388dd3c None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:08.101548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1558507-72bc-499b-8a1a-f37b8388dd3c None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:08.101548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1558507-72bc-499b-8a1a-f37b8388dd3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:08.155919 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-a1558507-72bc-499b-8a1a-f37b8388dd3c None None] MFA Rules not processed for user `87d9edc65dd248dca51a7421e9bbd335`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:08.164807 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a1558507-72bc-499b-8a1a-f37b8388dd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:08.304418 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3161/6350] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:08 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:33:08.322495 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad20f8-7bf5-4e83-b370-ff53b38e31e2 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:08.327045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6fad20f8-7bf5-4e83-b370-ff53b38e31e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:08.446466 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad20f8-7bf5-4e83-b370-ff53b38e31e2 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:08.453926 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472dbc01-5924-44dc-810f-dd7667a44da3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:08.454599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472dbc01-5924-44dc-810f-dd7667a44da3 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:08.454873 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472dbc01-5924-44dc-810f-dd7667a44da3 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:08.455158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472dbc01-5924-44dc-810f-dd7667a44da3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:08.466448 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472dbc01-5924-44dc-810f-dd7667a44da3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:08.468151 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472dbc01-5924-44dc-810f-dd7667a44da3 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:08.484829 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3190/6351] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:33:08 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:33:08.541254 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1558507-72bc-499b-8a1a-f37b8388dd3c None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:08.635490 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1558507-72bc-499b-8a1a-f37b8388dd3c None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:08.644330 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13b96a-20d6-48e7-8a9c-4ad31fd85f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:08.645376 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13b96a-20d6-48e7-8a9c-4ad31fd85f48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:08.645726 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13b96a-20d6-48e7-8a9c-4ad31fd85f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:08.646109 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13b96a-20d6-48e7-8a9c-4ad31fd85f48 admin admin] PATH_INFO: `/v3/users/87d9edc65dd248dca51a7421e9bbd335` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:08.647485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13b96a-20d6-48e7-8a9c-4ad31fd85f48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87d9edc65dd248dca51a7421e9bbd335)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:08.649529 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13b96a-20d6-48e7-8a9c-4ad31fd85f48 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:08.914959 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ba13b96a-20d6-48e7-8a9c-4ad31fd85f48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87d9edc65dd248dca51a7421e9bbd335'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:08.935855 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ba13b96a-20d6-48e7-8a9c-4ad31fd85f48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87d9edc65dd248dca51a7421e9bbd335'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:09.036029 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ba13b96a-20d6-48e7-8a9c-4ad31fd85f48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87d9edc65dd248dca51a7421e9bbd335'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:09.036795 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ba13b96a-20d6-48e7-8a9c-4ad31fd85f48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87d9edc65dd248dca51a7421e9bbd335'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:09.047081 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ba13b96a-20d6-48e7-8a9c-4ad31fd85f48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87d9edc65dd248dca51a7421e9bbd335'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:09.054085 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3162/6352] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:33:08 2022] DELETE /identity/v3/users/87d9edc65dd248dca51a7421e9bbd335 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:09.058985 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fb41b-22b2-46ca-adf5-a50485849dec None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:09.059521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fb41b-22b2-46ca-adf5-a50485849dec None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:09.059521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fb41b-22b2-46ca-adf5-a50485849dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:09.080543 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-1b4fb41b-22b2-46ca-adf5-a50485849dec None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:09.081870 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1b4fb41b-22b2-46ca-adf5-a50485849dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:09.200792 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3191/6353] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:33:09.225875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13b96a-20d6-48e7-8a9c-4ad31fd85f48 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:09.229127 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ba13b96a-20d6-48e7-8a9c-4ad31fd85f48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:09.318628 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13b96a-20d6-48e7-8a9c-4ad31fd85f48 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:09.323052 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259fd80c-9f45-4d85-b89c-9d26740647b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:09.323950 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259fd80c-9f45-4d85-b89c-9d26740647b2 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:09.324552 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259fd80c-9f45-4d85-b89c-9d26740647b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:09.325134 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259fd80c-9f45-4d85-b89c-9d26740647b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:09.351577 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259fd80c-9f45-4d85-b89c-9d26740647b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:09.354057 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259fd80c-9f45-4d85-b89c-9d26740647b2 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:09.367285 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3163/6354] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:33:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:33:10.374839 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4fb41b-22b2-46ca-adf5-a50485849dec None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:10.376382 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1b4fb41b-22b2-46ca-adf5-a50485849dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:10.389985 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4fb41b-22b2-46ca-adf5-a50485849dec None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:10.405917 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02101fdb-d713-415b-8b1a-8efeb34c0641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:10.407473 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02101fdb-d713-415b-8b1a-8efeb34c0641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:10.408023 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02101fdb-d713-415b-8b1a-8efeb34c0641 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:10.408473 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02101fdb-d713-415b-8b1a-8efeb34c0641 admin admin] PATH_INFO: `/v3/projects/e2f460bf9ccf4f54b9262eabcd98ca79` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:10.410139 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02101fdb-d713-415b-8b1a-8efeb34c0641 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2f460bf9ccf4f54b9262eabcd98ca79)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:10.412413 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02101fdb-d713-415b-8b1a-8efeb34c0641 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:10.424576 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259fd80c-9f45-4d85-b89c-9d26740647b2 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:10.426548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-259fd80c-9f45-4d85-b89c-9d26740647b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:10.447810 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259fd80c-9f45-4d85-b89c-9d26740647b2 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:10.462547 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280be7f-b449-4293-bbf7-00fd9ee25b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:10.463435 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280be7f-b449-4293-bbf7-00fd9ee25b04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:10.463714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280be7f-b449-4293-bbf7-00fd9ee25b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:10.463989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280be7f-b449-4293-bbf7-00fd9ee25b04 admin admin] PATH_INFO: `/v3/users/6725b003c4f3462aa2ad104fdfab28a2` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:10.465947 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280be7f-b449-4293-bbf7-00fd9ee25b04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6725b003c4f3462aa2ad104fdfab28a2)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:10.467908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280be7f-b449-4293-bbf7-00fd9ee25b04 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:10.618126 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-02101fdb-d713-415b-8b1a-8efeb34c0641 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2f460bf9ccf4f54b9262eabcd98ca79', 'request_id': 'req-02101fdb-d713-415b-8b1a-8efeb34c0641'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:10.637221 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-02101fdb-d713-415b-8b1a-8efeb34c0641 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2f460bf9ccf4f54b9262eabcd98ca79', 'request_id': 'req-02101fdb-d713-415b-8b1a-8efeb34c0641'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:10.663613 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-02101fdb-d713-415b-8b1a-8efeb34c0641 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2f460bf9ccf4f54b9262eabcd98ca79', 'request_id': 'req-02101fdb-d713-415b-8b1a-8efeb34c0641'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:10.772090 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5280be7f-b449-4293-bbf7-00fd9ee25b04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6725b003c4f3462aa2ad104fdfab28a2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:10.802582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-02101fdb-d713-415b-8b1a-8efeb34c0641 admin admin] The token cache is being invalidate because project e2f460bf9ccf4f54b9262eabcd98ca79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:33:10.806535 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-02101fdb-d713-415b-8b1a-8efeb34c0641 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:10.806535 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-02101fdb-d713-415b-8b1a-8efeb34c0641 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:10.806535 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3192/6355] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:33:10 2022] DELETE /identity/v3/projects/e2f460bf9ccf4f54b9262eabcd98ca79 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:10.807229 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5280be7f-b449-4293-bbf7-00fd9ee25b04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6725b003c4f3462aa2ad104fdfab28a2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:10.820769 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36159c5-1127-4f38-a03f-80d11d077fae None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:10.821222 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36159c5-1127-4f38-a03f-80d11d077fae None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:10.821860 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36159c5-1127-4f38-a03f-80d11d077fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:10.895082 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-f36159c5-1127-4f38-a03f-80d11d077fae None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:10.900228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5280be7f-b449-4293-bbf7-00fd9ee25b04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6725b003c4f3462aa2ad104fdfab28a2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:10.905562 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5280be7f-b449-4293-bbf7-00fd9ee25b04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6725b003c4f3462aa2ad104fdfab28a2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:10.916187 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f36159c5-1127-4f38-a03f-80d11d077fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:10.921320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5280be7f-b449-4293-bbf7-00fd9ee25b04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6725b003c4f3462aa2ad104fdfab28a2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:10.939117 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3164/6356] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:33:10 2022] DELETE /identity/v3/users/6725b003c4f3462aa2ad104fdfab28a2 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:10.948722 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373b63c-51e5-470f-8fae-5cf503bf601d None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:10.948722 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373b63c-51e5-470f-8fae-5cf503bf601d None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:10.948722 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373b63c-51e5-470f-8fae-5cf503bf601d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:10.993347 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-5373b63c-51e5-470f-8fae-5cf503bf601d None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:10.997607 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5373b63c-51e5-470f-8fae-5cf503bf601d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:11.095416 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3193/6357] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:33:11.103136 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b73897-3c58-4bf8-9b17-bb58bbf6bcc0 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:11.103904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b73897-3c58-4bf8-9b17-bb58bbf6bcc0 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:11.104441 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b73897-3c58-4bf8-9b17-bb58bbf6bcc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:11.113097 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3165/6358] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:33:11.122470 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373b63c-51e5-470f-8fae-5cf503bf601d None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:11.123948 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5373b63c-51e5-470f-8fae-5cf503bf601d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:11.139148 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-19b73897-3c58-4bf8-9b17-bb58bbf6bcc0 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:11.140362 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-19b73897-3c58-4bf8-9b17-bb58bbf6bcc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:11.155007 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3194/6359] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:33:11.160006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b73897-3c58-4bf8-9b17-bb58bbf6bcc0 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:11.176508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b73897-3c58-4bf8-9b17-bb58bbf6bcc0 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:11.187748 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee15f61-95fd-4507-906e-0e779d843104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:11.188773 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee15f61-95fd-4507-906e-0e779d843104 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:11.195525 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee15f61-95fd-4507-906e-0e779d843104 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:11.195525 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee15f61-95fd-4507-906e-0e779d843104 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:11.195525 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee15f61-95fd-4507-906e-0e779d843104 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:33:11.195525 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee15f61-95fd-4507-906e-0e779d843104 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:11.196873 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee15f61-95fd-4507-906e-0e779d843104 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:11.216146 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3195/6360] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:33:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:33:11.221884 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373b63c-51e5-470f-8fae-5cf503bf601d None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:11.230229 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee15f61-95fd-4507-906e-0e779d843104 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:11.233352 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa0ea5-2bf9-4793-bfb9-b2eb953b7674 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:11.234256 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa0ea5-2bf9-4793-bfb9-b2eb953b7674 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:11.235508 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa0ea5-2bf9-4793-bfb9-b2eb953b7674 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:11.236811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa0ea5-2bf9-4793-bfb9-b2eb953b7674 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:11.247503 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee15f61-95fd-4507-906e-0e779d843104 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:11.254965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6600228-5de9-4003-a8f2-e370717cb9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:11.255718 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6600228-5de9-4003-a8f2-e370717cb9cd admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:11.256141 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6600228-5de9-4003-a8f2-e370717cb9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:11.256469 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6600228-5de9-4003-a8f2-e370717cb9cd admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:11.256849 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa0ea5-2bf9-4793-bfb9-b2eb953b7674 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:11.258050 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6600228-5de9-4003-a8f2-e370717cb9cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:11.258997 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa0ea5-2bf9-4793-bfb9-b2eb953b7674 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:11.259992 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6600228-5de9-4003-a8f2-e370717cb9cd admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:11.273241 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3166/6361] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:33:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:33:11.368228 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3196/6362] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:33:11 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:33:11.372963 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa0ea5-2bf9-4793-bfb9-b2eb953b7674 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:11.383433 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa0ea5-2bf9-4793-bfb9-b2eb953b7674 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:11.446492 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925af337-c011-4aea-aa74-15d9c2876c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:11.447173 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925af337-c011-4aea-aa74-15d9c2876c1a admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:11.447455 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925af337-c011-4aea-aa74-15d9c2876c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:11.447732 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925af337-c011-4aea-aa74-15d9c2876c1a admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:11.448424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925af337-c011-4aea-aa74-15d9c2876c1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:11.451020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925af337-c011-4aea-aa74-15d9c2876c1a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:11.552286 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3167/6363] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:33:11 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:33:11.556242 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6600228-5de9-4003-a8f2-e370717cb9cd admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:11.568770 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6600228-5de9-4003-a8f2-e370717cb9cd admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:11.573998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30291152-66cb-4c81-9b9d-73bf332d1173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:11.574754 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30291152-66cb-4c81-9b9d-73bf332d1173 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:11.575035 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30291152-66cb-4c81-9b9d-73bf332d1173 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:11.575312 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30291152-66cb-4c81-9b9d-73bf332d1173 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:11.576048 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30291152-66cb-4c81-9b9d-73bf332d1173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:11.577885 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30291152-66cb-4c81-9b9d-73bf332d1173 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:11.592269 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3197/6364] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:33:11.593745 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925af337-c011-4aea-aa74-15d9c2876c1a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:11.604735 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925af337-c011-4aea-aa74-15d9c2876c1a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:11.610306 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ace2ac-e61d-4a86-a9a4-b9ea6415223f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:11.611089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ace2ac-e61d-4a86-a9a4-b9ea6415223f admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:11.611380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ace2ac-e61d-4a86-a9a4-b9ea6415223f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:11.611652 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ace2ac-e61d-4a86-a9a4-b9ea6415223f admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:11.612370 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ace2ac-e61d-4a86-a9a4-b9ea6415223f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:11.613993 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ace2ac-e61d-4a86-a9a4-b9ea6415223f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:11.624420 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3168/6365] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:33:11.628938 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30291152-66cb-4c81-9b9d-73bf332d1173 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:11.639015 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30291152-66cb-4c81-9b9d-73bf332d1173 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:11.643873 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae117d11-d78a-4975-a734-e0d275819e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:11.644781 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae117d11-d78a-4975-a734-e0d275819e86 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:11.645060 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae117d11-d78a-4975-a734-e0d275819e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:11.645332 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae117d11-d78a-4975-a734-e0d275819e86 admin admin] PATH_INFO: `/v3/projects/a79a12e15b8741baa60f90568895439a/users/0c4337b3a3ef4b16a0d3c9d5b06c1aaf/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:11.662233 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae117d11-d78a-4975-a734-e0d275819e86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a79a12e15b8741baa60f90568895439a, user_id=0c4337b3a3ef4b16a0d3c9d5b06c1aaf, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:11.665151 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae117d11-d78a-4975-a734-e0d275819e86 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:11.762410 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3198/6366] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:33:11 2022] PUT /identity/v3/projects/a79a12e15b8741baa60f90568895439a/users/0c4337b3a3ef4b16a0d3c9d5b06c1aaf/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:33:11.773247 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f6f85-d4e5-4ca9-97c4-b46f4e8ac27f None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:11.773807 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f6f85-d4e5-4ca9-97c4-b46f4e8ac27f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:11.774109 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f6f85-d4e5-4ca9-97c4-b46f4e8ac27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:11.814379 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-318f6f85-d4e5-4ca9-97c4-b46f4e8ac27f None None] MFA Rules not processed for user `0c4337b3a3ef4b16a0d3c9d5b06c1aaf`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:11.815796 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-318f6f85-d4e5-4ca9-97c4-b46f4e8ac27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:11.900281 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3169/6367] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:33:11.904744 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae117d11-d78a-4975-a734-e0d275819e86 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:12.007253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae117d11-d78a-4975-a734-e0d275819e86 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:12.012851 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed974d-fc9b-40f8-8e3c-5e02321d43e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:12.013621 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed974d-fc9b-40f8-8e3c-5e02321d43e6 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:12.015166 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed974d-fc9b-40f8-8e3c-5e02321d43e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:12.015471 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed974d-fc9b-40f8-8e3c-5e02321d43e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:12.016332 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed974d-fc9b-40f8-8e3c-5e02321d43e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:12.020384 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed974d-fc9b-40f8-8e3c-5e02321d43e6 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:12.139831 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3199/6368] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:33:11 2022] POST /identity/v3/projects => generated 385 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:33:12.144772 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f6f85-d4e5-4ca9-97c4-b46f4e8ac27f None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:12.163861 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f6f85-d4e5-4ca9-97c4-b46f4e8ac27f None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:12.245154 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66018e-7623-42e0-83f1-d6d54e707065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:12.245868 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66018e-7623-42e0-83f1-d6d54e707065 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:12.251630 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66018e-7623-42e0-83f1-d6d54e707065 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:12.251993 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66018e-7623-42e0-83f1-d6d54e707065 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:12.253209 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66018e-7623-42e0-83f1-d6d54e707065 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:12.260679 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66018e-7623-42e0-83f1-d6d54e707065 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:12.371620 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3170/6369] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:33:12 2022] POST /identity/v3/users => generated 299 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:33:12.372887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed974d-fc9b-40f8-8e3c-5e02321d43e6 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:12.394638 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed974d-fc9b-40f8-8e3c-5e02321d43e6 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:12.404586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd4c14-1713-4b95-bf72-7d7aaacdef98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:12.406774 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd4c14-1713-4b95-bf72-7d7aaacdef98 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:12.407215 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd4c14-1713-4b95-bf72-7d7aaacdef98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:12.407689 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd4c14-1713-4b95-bf72-7d7aaacdef98 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:12.409265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd4c14-1713-4b95-bf72-7d7aaacdef98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:12.412606 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd4c14-1713-4b95-bf72-7d7aaacdef98 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:12.434865 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3200/6370] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:33:12.435356 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66018e-7623-42e0-83f1-d6d54e707065 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:12.449875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66018e-7623-42e0-83f1-d6d54e707065 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:12.457509 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146d5ae-77b1-4be5-99be-4ed3c21e75a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:12.459409 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146d5ae-77b1-4be5-99be-4ed3c21e75a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:12.459925 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146d5ae-77b1-4be5-99be-4ed3c21e75a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:12.460438 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146d5ae-77b1-4be5-99be-4ed3c21e75a3 admin admin] PATH_INFO: `/v3/projects/ee9b5678cac54f69bc88d6be2091f648/users/0168e90a79ce45408c71d2ec4c964b05/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:12.488337 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4146d5ae-77b1-4be5-99be-4ed3c21e75a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee9b5678cac54f69bc88d6be2091f648, user_id=0168e90a79ce45408c71d2ec4c964b05, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:12.491806 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4146d5ae-77b1-4be5-99be-4ed3c21e75a3 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:12.579710 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3171/6371] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:33:12 2022] PUT /identity/v3/projects/ee9b5678cac54f69bc88d6be2091f648/users/0168e90a79ce45408c71d2ec4c964b05/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:12.584243 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd4c14-1713-4b95-bf72-7d7aaacdef98 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:12.598106 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd4c14-1713-4b95-bf72-7d7aaacdef98 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:12.709524 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0504fd25-668a-4090-a4f4-7c3b8ba1949c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:12.710383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504fd25-668a-4090-a4f4-7c3b8ba1949c admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:12.710762 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504fd25-668a-4090-a4f4-7c3b8ba1949c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:12.711493 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504fd25-668a-4090-a4f4-7c3b8ba1949c admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:12.712290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0504fd25-668a-4090-a4f4-7c3b8ba1949c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:12.717584 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0504fd25-668a-4090-a4f4-7c3b8ba1949c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:12.738543 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3201/6372] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:33:12.739845 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146d5ae-77b1-4be5-99be-4ed3c21e75a3 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:12.765233 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146d5ae-77b1-4be5-99be-4ed3c21e75a3 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:12.775833 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458e7c7-c42f-44f1-bc64-c16f06bf741b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:12.777028 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458e7c7-c42f-44f1-bc64-c16f06bf741b admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:12.777987 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458e7c7-c42f-44f1-bc64-c16f06bf741b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:12.778268 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458e7c7-c42f-44f1-bc64-c16f06bf741b admin admin] PATH_INFO: `/v3/projects/ee9b5678cac54f69bc88d6be2091f648/users/0168e90a79ce45408c71d2ec4c964b05/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:12.782693 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b458e7c7-c42f-44f1-bc64-c16f06bf741b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee9b5678cac54f69bc88d6be2091f648, user_id=0168e90a79ce45408c71d2ec4c964b05, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:12.787541 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b458e7c7-c42f-44f1-bc64-c16f06bf741b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:12.801221 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3172/6373] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:33:12 2022] PUT /identity/v3/projects/ee9b5678cac54f69bc88d6be2091f648/users/0168e90a79ce45408c71d2ec4c964b05/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:12.813433 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54f7a8-cceb-4967-92f1-5eea7111a4ca None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:12.814060 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54f7a8-cceb-4967-92f1-5eea7111a4ca None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:12.814528 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54f7a8-cceb-4967-92f1-5eea7111a4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:12.834760 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458e7c7-c42f-44f1-bc64-c16f06bf741b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:12.837073 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b458e7c7-c42f-44f1-bc64-c16f06bf741b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:12.888915 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-6a54f7a8-cceb-4967-92f1-5eea7111a4ca None None] MFA Rules not processed for user `0168e90a79ce45408c71d2ec4c964b05`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:12.890424 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6a54f7a8-cceb-4967-92f1-5eea7111a4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:13.090294 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458e7c7-c42f-44f1-bc64-c16f06bf741b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:13.099679 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3202/6374] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:33:13.100958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b60ccb-768a-4f1b-8f42-096f040dfcb0 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:13.101523 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b60ccb-768a-4f1b-8f42-096f040dfcb0 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:13.101837 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b60ccb-768a-4f1b-8f42-096f040dfcb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:13.105071 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80504d3e-c782-4720-9e88-6c75ede523ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:13.106329 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80504d3e-c782-4720-9e88-6c75ede523ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:13.106783 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80504d3e-c782-4720-9e88-6c75ede523ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:13.107210 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80504d3e-c782-4720-9e88-6c75ede523ad admin admin] PATH_INFO: `/v3/projects/fa9b9b28cba848a0b480fd18d2ac01ac` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:13.108813 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80504d3e-c782-4720-9e88-6c75ede523ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa9b9b28cba848a0b480fd18d2ac01ac)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:13.115015 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80504d3e-c782-4720-9e88-6c75ede523ad admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:13.141777 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-86b60ccb-768a-4f1b-8f42-096f040dfcb0 None None] MFA Rules not processed for user `f5f04392a4c94046bc7da53b4dffb0e3`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:13.142965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-86b60ccb-768a-4f1b-8f42-096f040dfcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:13.257634 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3203/6375] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:33:13.297846 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b60ccb-768a-4f1b-8f42-096f040dfcb0 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:13.325335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b60ccb-768a-4f1b-8f42-096f040dfcb0 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:13.363601 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-80504d3e-c782-4720-9e88-6c75ede523ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa9b9b28cba848a0b480fd18d2ac01ac', 'request_id': 'req-80504d3e-c782-4720-9e88-6c75ede523ad'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:13.384453 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-80504d3e-c782-4720-9e88-6c75ede523ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa9b9b28cba848a0b480fd18d2ac01ac', 'request_id': 'req-80504d3e-c782-4720-9e88-6c75ede523ad'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:13.399908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-80504d3e-c782-4720-9e88-6c75ede523ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa9b9b28cba848a0b480fd18d2ac01ac', 'request_id': 'req-80504d3e-c782-4720-9e88-6c75ede523ad'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:13.448946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9cb07f-be7e-4ebc-bc83-26920475f757 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0168e90a79ce45408c71d2ec4c964b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee9b5678cac54f69bc88d6be2091f648', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:13.452606 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9cb07f-be7e-4ebc-bc83-26920475f757 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:13.453047 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9cb07f-be7e-4ebc-bc83-26920475f757 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:13.453485 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9cb07f-be7e-4ebc-bc83-26920475f757 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] PATH_INFO: `/v3/services` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:13.454993 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9cb07f-be7e-4ebc-bc83-26920475f757 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:13.463605 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9cb07f-be7e-4ebc-bc83-26920475f757 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:13.486909 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-80504d3e-c782-4720-9e88-6c75ede523ad admin admin] The token cache is being invalidate because project fa9b9b28cba848a0b480fd18d2ac01ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:33:13.487459 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-80504d3e-c782-4720-9e88-6c75ede523ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:13.492214 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-80504d3e-c782-4720-9e88-6c75ede523ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:13.493115 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3173/6376] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:33:12 2022] DELETE /identity/v3/projects/fa9b9b28cba848a0b480fd18d2ac01ac => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:13.497452 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1e626-87a5-4adb-b23d-7a74375b3725 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:13.497745 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1e626-87a5-4adb-b23d-7a74375b3725 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:13.498087 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1e626-87a5-4adb-b23d-7a74375b3725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:13.523082 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-72d1e626-87a5-4adb-b23d-7a74375b3725 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:13.524694 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-72d1e626-87a5-4adb-b23d-7a74375b3725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:13.536155 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3204/6377] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:33:13 2022] POST /identity/v3/services => generated 289 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:33:13.541863 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9cb07f-be7e-4ebc-bc83-26920475f757 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:13.545667 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1d9cb07f-be7e-4ebc-bc83-26920475f757 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:13.582973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9cb07f-be7e-4ebc-bc83-26920475f757 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:13.588520 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1249e2-13d2-40cc-8f87-7870ceef01a0 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0168e90a79ce45408c71d2ec4c964b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee9b5678cac54f69bc88d6be2091f648', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:13.589243 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1249e2-13d2-40cc-8f87-7870ceef01a0 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:13.590180 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1249e2-13d2-40cc-8f87-7870ceef01a0 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:13.590803 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1249e2-13d2-40cc-8f87-7870ceef01a0 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:13.591779 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1249e2-13d2-40cc-8f87-7870ceef01a0 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:13.593638 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1249e2-13d2-40cc-8f87-7870ceef01a0 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:13.600961 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-aa1249e2-13d2-40cc-8f87-7870ceef01a0 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Apr 30 21:33:13.600961 ncdv-master-1 devstack@keystone.service[91018]: Failed validating 'type' in schema['properties']['enabled']: Apr 30 21:33:13.600961 ncdv-master-1 devstack@keystone.service[91018]: {'enum': [True, False, None], 'type': 'boolean'} Apr 30 21:33:13.600961 ncdv-master-1 devstack@keystone.service[91018]: On instance['enabled']: Apr 30 21:33:13.600961 ncdv-master-1 devstack@keystone.service[91018]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Apr 30 21:33:13.600961 ncdv-master-1 devstack@keystone.service[91018]: Failed validating 'type' in schema['properties']['enabled']: Apr 30 21:33:13.600961 ncdv-master-1 devstack@keystone.service[91018]: {'enum': [True, False, None], 'type': 'boolean'} Apr 30 21:33:13.600961 ncdv-master-1 devstack@keystone.service[91018]: On instance['enabled']: Apr 30 21:33:13.600961 ncdv-master-1 devstack@keystone.service[91018]: 'False' Apr 30 21:33:13.600961 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:33:13.600961 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Apr 30 21:33:13.600961 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Apr 30 21:33:13.600961 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Apr 30 21:33:13.600961 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise error Apr 30 21:33:13.600961 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Apr 30 21:33:13.600961 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:33:13.600961 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Apr 30 21:33:13.600961 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Apr 30 21:33:13.600961 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:33:13.600961 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application On instance['enabled']: Apr 30 21:33:13.600961 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application 'False' Apr 30 21:33:13.600961 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:33:13.600961 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 21:33:13.609005 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:33:13.609005 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:33:13.609005 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:33:13.609005 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:33:13.609005 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:33:13.609005 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:33:13.609005 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:33:13.609005 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:33:13.609005 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:33:13.609005 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:33:13.609005 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:33:13.609005 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:33:13.609005 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Apr 30 21:33:13.609005 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Apr 30 21:33:13.609005 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Apr 30 21:33:13.609005 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Apr 30 21:33:13.609005 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Apr 30 21:33:13.610313 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Apr 30 21:33:13.610313 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Apr 30 21:33:13.610313 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:33:13.610313 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Apr 30 21:33:13.610313 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Apr 30 21:33:13.610313 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:33:13.610313 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application On instance['enabled']: Apr 30 21:33:13.610313 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application 'False' Apr 30 21:33:13.610313 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:33:13.610313 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3205/6378] 10.222.0.23 () {60 vars in 1155 bytes} [Sat Apr 30 21:33:13 2022] POST /identity/v3/endpoints => generated 283 bytes in 62 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Apr 30 21:33:13.612765 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1249e2-13d2-40cc-8f87-7870ceef01a0 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:13.634239 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3174/6379] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:13 2022] POST /identity/v3/auth/tokens => generated 3363 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:33:13.641711 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1249e2-13d2-40cc-8f87-7870ceef01a0 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:13.645424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd011e17-7945-486b-be67-27ee9a7767a8 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:13.646022 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd011e17-7945-486b-be67-27ee9a7767a8 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:13.646545 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd011e17-7945-486b-be67-27ee9a7767a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:13.653804 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8761f4e-50a5-43ea-8e9d-56dba6bb2873 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0168e90a79ce45408c71d2ec4c964b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee9b5678cac54f69bc88d6be2091f648', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:13.660354 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8761f4e-50a5-43ea-8e9d-56dba6bb2873 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:13.660854 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8761f4e-50a5-43ea-8e9d-56dba6bb2873 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:13.661294 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8761f4e-50a5-43ea-8e9d-56dba6bb2873 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:13.662777 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8761f4e-50a5-43ea-8e9d-56dba6bb2873 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:13.664762 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8761f4e-50a5-43ea-8e9d-56dba6bb2873 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:13.675533 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-f8761f4e-50a5-43ea-8e9d-56dba6bb2873 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Apr 30 21:33:13.675533 ncdv-master-1 devstack@keystone.service[91018]: Failed validating 'type' in schema['properties']['enabled']: Apr 30 21:33:13.675533 ncdv-master-1 devstack@keystone.service[91018]: {'enum': [True, False, None], 'type': 'boolean'} Apr 30 21:33:13.675533 ncdv-master-1 devstack@keystone.service[91018]: On instance['enabled']: Apr 30 21:33:13.675533 ncdv-master-1 devstack@keystone.service[91018]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Apr 30 21:33:13.675533 ncdv-master-1 devstack@keystone.service[91018]: Failed validating 'type' in schema['properties']['enabled']: Apr 30 21:33:13.675533 ncdv-master-1 devstack@keystone.service[91018]: {'enum': [True, False, None], 'type': 'boolean'} Apr 30 21:33:13.675533 ncdv-master-1 devstack@keystone.service[91018]: On instance['enabled']: Apr 30 21:33:13.675533 ncdv-master-1 devstack@keystone.service[91018]: 'True' Apr 30 21:33:13.675533 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:33:13.675533 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Apr 30 21:33:13.675533 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Apr 30 21:33:13.675533 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Apr 30 21:33:13.675533 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise error Apr 30 21:33:13.675533 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Apr 30 21:33:13.675533 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:33:13.675533 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Apr 30 21:33:13.675533 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Apr 30 21:33:13.675533 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:33:13.675533 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application On instance['enabled']: Apr 30 21:33:13.675533 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application 'True' Apr 30 21:33:13.675533 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:33:13.675533 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 21:33:13.677246 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:33:13.677246 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:33:13.677246 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:33:13.677246 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:33:13.677246 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:33:13.677246 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:33:13.677246 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:33:13.677246 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:33:13.677246 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:33:13.677246 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:33:13.677246 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:33:13.677246 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:33:13.677246 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Apr 30 21:33:13.677246 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Apr 30 21:33:13.677246 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Apr 30 21:33:13.677246 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Apr 30 21:33:13.677246 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Apr 30 21:33:13.678360 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Apr 30 21:33:13.678360 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Apr 30 21:33:13.678360 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:33:13.678360 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Apr 30 21:33:13.678360 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Apr 30 21:33:13.678360 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:33:13.678360 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application On instance['enabled']: Apr 30 21:33:13.678360 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application 'True' Apr 30 21:33:13.678360 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:33:13.685437 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3206/6380] 10.222.0.23 () {60 vars in 1155 bytes} [Sat Apr 30 21:33:13 2022] POST /identity/v3/endpoints => generated 281 bytes in 73 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Apr 30 21:33:13.689421 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-bd011e17-7945-486b-be67-27ee9a7767a8 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:13.697580 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8761f4e-50a5-43ea-8e9d-56dba6bb2873 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:13.697713 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-bd011e17-7945-486b-be67-27ee9a7767a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:13.707031 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8761f4e-50a5-43ea-8e9d-56dba6bb2873 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:13.707472 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3175/6381] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:13 2022] POST /identity/v3/auth/tokens => generated 3363 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:33:13.708693 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd011e17-7945-486b-be67-27ee9a7767a8 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:13.719884 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dbb097-7668-4cd3-9661-61e0d3faac71 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0168e90a79ce45408c71d2ec4c964b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee9b5678cac54f69bc88d6be2091f648', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:13.720642 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd011e17-7945-486b-be67-27ee9a7767a8 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:13.723470 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbb097-7668-4cd3-9661-61e0d3faac71 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:13.723470 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbb097-7668-4cd3-9661-61e0d3faac71 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:13.723470 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbb097-7668-4cd3-9661-61e0d3faac71 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:13.723470 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dbb097-7668-4cd3-9661-61e0d3faac71 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:13.724986 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dbb097-7668-4cd3-9661-61e0d3faac71 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:13.726713 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c743f2c3-3e92-4bb6-9982-243dda71a0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:13.728069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743f2c3-3e92-4bb6-9982-243dda71a0b7 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:13.728622 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743f2c3-3e92-4bb6-9982-243dda71a0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:13.729007 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743f2c3-3e92-4bb6-9982-243dda71a0b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:13.729951 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c743f2c3-3e92-4bb6-9982-243dda71a0b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:33:13.730930 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c743f2c3-3e92-4bb6-9982-243dda71a0b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:13.732869 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c743f2c3-3e92-4bb6-9982-243dda71a0b7 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:13.761213 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3176/6382] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:33:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:33:13.762417 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c743f2c3-3e92-4bb6-9982-243dda71a0b7 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:13.784638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c743f2c3-3e92-4bb6-9982-243dda71a0b7 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:13.790062 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd52c9-d561-40ff-9900-c2152a7b8477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:13.791340 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd52c9-d561-40ff-9900-c2152a7b8477 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:13.791851 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd52c9-d561-40ff-9900-c2152a7b8477 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:13.792364 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd52c9-d561-40ff-9900-c2152a7b8477 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:13.794111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd52c9-d561-40ff-9900-c2152a7b8477 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:13.797523 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd52c9-d561-40ff-9900-c2152a7b8477 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:13.847243 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-20dbb097-7668-4cd3-9661-61e0d3faac71 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-278701679. To ensure interoperability, identifiers should be a valid uuid. Apr 30 21:33:13.847243 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Apr 30 21:33:13.847243 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:33:13.918242 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3177/6383] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:33:13 2022] POST /identity/v3/projects => generated 387 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:33:13.922493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd52c9-d561-40ff-9900-c2152a7b8477 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:13.947352 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3207/6384] 10.222.0.23 () {60 vars in 1155 bytes} [Sat Apr 30 21:33:13 2022] POST /identity/v3/endpoints => generated 359 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:33:13.948866 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dbb097-7668-4cd3-9661-61e0d3faac71 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:13.998864 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dbb097-7668-4cd3-9661-61e0d3faac71 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:14.136074 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd52c9-d561-40ff-9900-c2152a7b8477 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:14.174448 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed898f-a375-4791-9847-00a75cc9117d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:14.175146 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed898f-a375-4791-9847-00a75cc9117d admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:14.175435 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed898f-a375-4791-9847-00a75cc9117d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:14.175717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed898f-a375-4791-9847-00a75cc9117d admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:14.176593 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ed898f-a375-4791-9847-00a75cc9117d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:14.184461 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ed898f-a375-4791-9847-00a75cc9117d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:14.191561 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd74a0-caa2-403a-a3d1-1547d7839499 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0168e90a79ce45408c71d2ec4c964b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee9b5678cac54f69bc88d6be2091f648', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:14.192412 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd74a0-caa2-403a-a3d1-1547d7839499 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:14.192695 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd74a0-caa2-403a-a3d1-1547d7839499 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:14.192973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd74a0-caa2-403a-a3d1-1547d7839499 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] PATH_INFO: `/v3/regions/tempest-region-278701679` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:14.193749 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd74a0-caa2-403a-a3d1-1547d7839499 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-278701679)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:14.198995 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd74a0-caa2-403a-a3d1-1547d7839499 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:14.207570 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3208/6385] 10.222.0.23 () {58 vars in 1202 bytes} [Sat Apr 30 21:33:13 2022] GET /identity/v3/regions/tempest-region-278701679 => generated 178 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:33:14.208471 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd74a0-caa2-403a-a3d1-1547d7839499 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:14.220457 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd74a0-caa2-403a-a3d1-1547d7839499 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:14.236834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9edb2-4779-4d32-8f9f-9e4dac8ae1f4 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0168e90a79ce45408c71d2ec4c964b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee9b5678cac54f69bc88d6be2091f648', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:14.236834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9edb2-4779-4d32-8f9f-9e4dac8ae1f4 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:14.236834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9edb2-4779-4d32-8f9f-9e4dac8ae1f4 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:14.237387 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9edb2-4779-4d32-8f9f-9e4dac8ae1f4 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] PATH_INFO: `/v3/endpoints/10c954fcea094b2880e535cd0028ab35` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:14.237387 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9edb2-4779-4d32-8f9f-9e4dac8ae1f4 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=10c954fcea094b2880e535cd0028ab35)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:14.237387 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9edb2-4779-4d32-8f9f-9e4dac8ae1f4 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:14.247788 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-2ed9edb2-4779-4d32-8f9f-9e4dac8ae1f4 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Apr 30 21:33:14.247788 ncdv-master-1 devstack@keystone.service[91018]: Failed validating 'type' in schema['properties']['enabled']: Apr 30 21:33:14.247788 ncdv-master-1 devstack@keystone.service[91018]: {'enum': [True, False, None], 'type': 'boolean'} Apr 30 21:33:14.247788 ncdv-master-1 devstack@keystone.service[91018]: On instance['enabled']: Apr 30 21:33:14.247788 ncdv-master-1 devstack@keystone.service[91018]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Apr 30 21:33:14.247788 ncdv-master-1 devstack@keystone.service[91018]: Failed validating 'type' in schema['properties']['enabled']: Apr 30 21:33:14.247788 ncdv-master-1 devstack@keystone.service[91018]: {'enum': [True, False, None], 'type': 'boolean'} Apr 30 21:33:14.247788 ncdv-master-1 devstack@keystone.service[91018]: On instance['enabled']: Apr 30 21:33:14.247788 ncdv-master-1 devstack@keystone.service[91018]: 'False' Apr 30 21:33:14.247788 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:33:14.247788 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Apr 30 21:33:14.247788 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Apr 30 21:33:14.247788 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Apr 30 21:33:14.247788 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise error Apr 30 21:33:14.247788 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Apr 30 21:33:14.247788 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:33:14.247788 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Apr 30 21:33:14.247788 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Apr 30 21:33:14.247788 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:33:14.247788 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application On instance['enabled']: Apr 30 21:33:14.247788 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application 'False' Apr 30 21:33:14.247788 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:33:14.247788 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 21:33:14.249358 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:33:14.249358 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:33:14.249358 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:33:14.249358 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:33:14.249358 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:33:14.249358 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:33:14.249358 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:33:14.249358 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:33:14.249358 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:33:14.249358 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:33:14.249358 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:33:14.249358 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:33:14.249358 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Apr 30 21:33:14.249358 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Apr 30 21:33:14.249358 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Apr 30 21:33:14.249358 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Apr 30 21:33:14.249358 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Apr 30 21:33:14.250452 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Apr 30 21:33:14.250452 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Apr 30 21:33:14.250452 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:33:14.250452 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Apr 30 21:33:14.250452 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Apr 30 21:33:14.250452 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:33:14.250452 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application On instance['enabled']: Apr 30 21:33:14.250452 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application 'False' Apr 30 21:33:14.250452 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:33:14.252548 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3209/6386] 10.222.0.23 () {60 vars in 1254 bytes} [Sat Apr 30 21:33:14 2022] PATCH /identity/v3/endpoints/10c954fcea094b2880e535cd0028ab35 => generated 283 bytes in 44 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Apr 30 21:33:14.253412 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9edb2-4779-4d32-8f9f-9e4dac8ae1f4 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:14.264844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9edb2-4779-4d32-8f9f-9e4dac8ae1f4 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:14.270252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c0e8b-7505-465f-acf2-fffee4b5de56 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0168e90a79ce45408c71d2ec4c964b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee9b5678cac54f69bc88d6be2091f648', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:14.271114 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c0e8b-7505-465f-acf2-fffee4b5de56 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:14.271466 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c0e8b-7505-465f-acf2-fffee4b5de56 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:14.271891 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c0e8b-7505-465f-acf2-fffee4b5de56 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] PATH_INFO: `/v3/endpoints/10c954fcea094b2880e535cd0028ab35` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:14.273399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c0e8b-7505-465f-acf2-fffee4b5de56 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=10c954fcea094b2880e535cd0028ab35)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:14.275089 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c0e8b-7505-465f-acf2-fffee4b5de56 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:14.310998 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3178/6387] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:33:13 2022] POST /identity/v3/users => generated 294 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:33:14.312137 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed898f-a375-4791-9847-00a75cc9117d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:14.334411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed898f-a375-4791-9847-00a75cc9117d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:14.343593 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a5f5a-83ea-4d31-93d7-943a19a463a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:14.344843 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a5f5a-83ea-4d31-93d7-943a19a463a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:14.347280 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a5f5a-83ea-4d31-93d7-943a19a463a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:14.347280 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a5f5a-83ea-4d31-93d7-943a19a463a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:14.348067 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a5f5a-83ea-4d31-93d7-943a19a463a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:14.368317 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a5f5a-83ea-4d31-93d7-943a19a463a1 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:14.388275 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9f2c0e8b-7505-465f-acf2-fffee4b5de56 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '10c954fcea094b2880e535cd0028ab35', 'request_id': 'req-9f2c0e8b-7505-465f-acf2-fffee4b5de56'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:14.392157 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3179/6388] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:33:14.394180 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a5f5a-83ea-4d31-93d7-943a19a463a1 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:14.407181 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a5f5a-83ea-4d31-93d7-943a19a463a1 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:14.407558 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3210/6389] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:14 2022] DELETE /identity/v3/endpoints/10c954fcea094b2880e535cd0028ab35 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:14.413569 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c0e8b-7505-465f-acf2-fffee4b5de56 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:14.432016 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d257a38-8825-4972-aa96-5c2f1c1cc1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:14.432962 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d257a38-8825-4972-aa96-5c2f1c1cc1b7 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:14.433083 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d257a38-8825-4972-aa96-5c2f1c1cc1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:14.433874 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d257a38-8825-4972-aa96-5c2f1c1cc1b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:14.434925 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d257a38-8825-4972-aa96-5c2f1c1cc1b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:14.436896 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d257a38-8825-4972-aa96-5c2f1c1cc1b7 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:14.456333 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3180/6390] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:33:14.456531 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c0e8b-7505-465f-acf2-fffee4b5de56 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:14.461410 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d257a38-8825-4972-aa96-5c2f1c1cc1b7 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:14.463674 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a354e9c-dd8b-4ea5-b645-799de8c1009c tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0168e90a79ce45408c71d2ec4c964b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee9b5678cac54f69bc88d6be2091f648', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:14.464527 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a354e9c-dd8b-4ea5-b645-799de8c1009c tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:14.464855 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a354e9c-dd8b-4ea5-b645-799de8c1009c tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:14.465156 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a354e9c-dd8b-4ea5-b645-799de8c1009c tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] PATH_INFO: `/v3/regions/tempest-region-278701679` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:14.465874 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a354e9c-dd8b-4ea5-b645-799de8c1009c tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-278701679)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:14.467421 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a354e9c-dd8b-4ea5-b645-799de8c1009c tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:14.482138 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d257a38-8825-4972-aa96-5c2f1c1cc1b7 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:14.496931 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ac0d1-f124-4080-93ca-73c772f0c875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:14.500132 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ac0d1-f124-4080-93ca-73c772f0c875 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:14.500426 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ac0d1-f124-4080-93ca-73c772f0c875 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:14.500774 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ac0d1-f124-4080-93ca-73c772f0c875 admin admin] PATH_INFO: `/v3/projects/4dd861b3869e413a8aa1d2d6ccae518f/users/6cbdf51f15024f41a02160af715f8d46/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:14.538763 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ac0d1-f124-4080-93ca-73c772f0c875 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dd861b3869e413a8aa1d2d6ccae518f, user_id=6cbdf51f15024f41a02160af715f8d46, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:14.541719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ac0d1-f124-4080-93ca-73c772f0c875 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:14.601950 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3211/6391] 10.222.0.23 () {58 vars in 1205 bytes} [Sat Apr 30 21:33:14 2022] DELETE /identity/v3/regions/tempest-region-278701679 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:14.616055 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a354e9c-dd8b-4ea5-b645-799de8c1009c tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:14.629290 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3181/6392] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:33:14 2022] PUT /identity/v3/projects/4dd861b3869e413a8aa1d2d6ccae518f/users/6cbdf51f15024f41a02160af715f8d46/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:14.640795 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecc194-0a10-4228-9966-41b8fe440a03 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:14.641088 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecc194-0a10-4228-9966-41b8fe440a03 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:14.641371 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecc194-0a10-4228-9966-41b8fe440a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:14.649150 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a354e9c-dd8b-4ea5-b645-799de8c1009c tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:14.698479 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-39ecc194-0a10-4228-9966-41b8fe440a03 None None] MFA Rules not processed for user `6cbdf51f15024f41a02160af715f8d46`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:14.699769 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-39ecc194-0a10-4228-9966-41b8fe440a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:14.758401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e9169-3c32-49cb-a796-da2f977ca9d4 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0168e90a79ce45408c71d2ec4c964b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee9b5678cac54f69bc88d6be2091f648', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:14.762394 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e9169-3c32-49cb-a796-da2f977ca9d4 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:14.762394 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e9169-3c32-49cb-a796-da2f977ca9d4 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:14.762394 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e9169-3c32-49cb-a796-da2f977ca9d4 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:14.762394 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26e9169-3c32-49cb-a796-da2f977ca9d4 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:14.764158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26e9169-3c32-49cb-a796-da2f977ca9d4 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:14.816773 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3182/6393] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:14 2022] POST /identity/v3/auth/tokens => generated 3388 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:33:14.828084 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ecc194-0a10-4228-9966-41b8fe440a03 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:14.829899 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-39ecc194-0a10-4228-9966-41b8fe440a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:14.917460 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ecc194-0a10-4228-9966-41b8fe440a03 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:14.921903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c016cd-4e60-4985-9748-b3bf9b02400d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:14.922561 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c016cd-4e60-4985-9748-b3bf9b02400d service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:14.922845 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c016cd-4e60-4985-9748-b3bf9b02400d service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:14.923121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c016cd-4e60-4985-9748-b3bf9b02400d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:14.926668 ncdv-master-1 devstack@keystone.service[91018]: WARNING py.warnings [None req-a26e9169-3c32-49cb-a796-da2f977ca9d4 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-707344314. To ensure interoperability, identifiers should be a valid uuid. Apr 30 21:33:14.926668 ncdv-master-1 devstack@keystone.service[91018]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Apr 30 21:33:14.926668 ncdv-master-1 devstack@keystone.service[91018]: Apr 30 21:33:14.932335 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c016cd-4e60-4985-9748-b3bf9b02400d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:14.935201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c016cd-4e60-4985-9748-b3bf9b02400d service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:14.946634 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3183/6394] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:33:14 2022] GET /identity/v3/auth/tokens => generated 3388 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:33:15.158484 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3212/6395] 10.222.0.23 () {60 vars in 1155 bytes} [Sat Apr 30 21:33:14 2022] POST /identity/v3/endpoints => generated 359 bytes in 545 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:33:15.162656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c016cd-4e60-4985-9748-b3bf9b02400d service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:15.192520 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c016cd-4e60-4985-9748-b3bf9b02400d service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:15.243766 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fbb52-0bb3-4adf-b0b2-0304af2c99ef tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0168e90a79ce45408c71d2ec4c964b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee9b5678cac54f69bc88d6be2091f648', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:15.243766 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fbb52-0bb3-4adf-b0b2-0304af2c99ef tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:15.243766 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fbb52-0bb3-4adf-b0b2-0304af2c99ef tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:15.244398 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fbb52-0bb3-4adf-b0b2-0304af2c99ef tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] PATH_INFO: `/v3/regions/tempest-region-707344314` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:15.245074 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27fbb52-0bb3-4adf-b0b2-0304af2c99ef tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-707344314)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:15.247232 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27fbb52-0bb3-4adf-b0b2-0304af2c99ef tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:15.253304 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3184/6396] 10.222.0.23 () {58 vars in 1202 bytes} [Sat Apr 30 21:33:15 2022] GET /identity/v3/regions/tempest-region-707344314 => generated 178 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:33:15.253930 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e9169-3c32-49cb-a796-da2f977ca9d4 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:15.289653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e9169-3c32-49cb-a796-da2f977ca9d4 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:15.303867 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826360c0-c497-40c5-a1c8-7ff32b2953a5 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0168e90a79ce45408c71d2ec4c964b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee9b5678cac54f69bc88d6be2091f648', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:15.305614 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826360c0-c497-40c5-a1c8-7ff32b2953a5 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:15.309818 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826360c0-c497-40c5-a1c8-7ff32b2953a5 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:15.310232 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826360c0-c497-40c5-a1c8-7ff32b2953a5 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] PATH_INFO: `/v3/endpoints/a80a1d45964041af8e96b53e393a1dfc` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:15.321587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826360c0-c497-40c5-a1c8-7ff32b2953a5 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=a80a1d45964041af8e96b53e393a1dfc)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:15.326104 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826360c0-c497-40c5-a1c8-7ff32b2953a5 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:15.338748 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-826360c0-c497-40c5-a1c8-7ff32b2953a5 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Apr 30 21:33:15.338748 ncdv-master-1 devstack@keystone.service[91018]: Failed validating 'type' in schema['properties']['enabled']: Apr 30 21:33:15.338748 ncdv-master-1 devstack@keystone.service[91018]: {'enum': [True, False, None], 'type': 'boolean'} Apr 30 21:33:15.338748 ncdv-master-1 devstack@keystone.service[91018]: On instance['enabled']: Apr 30 21:33:15.338748 ncdv-master-1 devstack@keystone.service[91018]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Apr 30 21:33:15.338748 ncdv-master-1 devstack@keystone.service[91018]: Failed validating 'type' in schema['properties']['enabled']: Apr 30 21:33:15.338748 ncdv-master-1 devstack@keystone.service[91018]: {'enum': [True, False, None], 'type': 'boolean'} Apr 30 21:33:15.338748 ncdv-master-1 devstack@keystone.service[91018]: On instance['enabled']: Apr 30 21:33:15.338748 ncdv-master-1 devstack@keystone.service[91018]: 'True' Apr 30 21:33:15.338748 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:33:15.338748 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Apr 30 21:33:15.338748 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Apr 30 21:33:15.338748 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Apr 30 21:33:15.338748 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise error Apr 30 21:33:15.338748 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Apr 30 21:33:15.338748 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:33:15.338748 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Apr 30 21:33:15.338748 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Apr 30 21:33:15.338748 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:33:15.338748 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application On instance['enabled']: Apr 30 21:33:15.338748 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application 'True' Apr 30 21:33:15.338748 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:33:15.338748 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 21:33:15.340362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:33:15.340362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:33:15.340362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:33:15.340362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:33:15.340362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:33:15.340362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:33:15.340362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:33:15.340362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:33:15.340362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:33:15.340362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:33:15.340362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:33:15.340362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:33:15.340362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Apr 30 21:33:15.340362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Apr 30 21:33:15.340362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Apr 30 21:33:15.340362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Apr 30 21:33:15.340362 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Apr 30 21:33:15.341331 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Apr 30 21:33:15.341331 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Apr 30 21:33:15.341331 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:33:15.341331 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Apr 30 21:33:15.341331 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Apr 30 21:33:15.341331 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:33:15.341331 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application On instance['enabled']: Apr 30 21:33:15.341331 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application 'True' Apr 30 21:33:15.341331 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:33:15.341331 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3213/6397] 10.222.0.23 () {60 vars in 1254 bytes} [Sat Apr 30 21:33:15 2022] PATCH /identity/v3/endpoints/a80a1d45964041af8e96b53e393a1dfc => generated 281 bytes in 88 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Apr 30 21:33:15.344861 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fbb52-0bb3-4adf-b0b2-0304af2c99ef tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:15.361098 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fbb52-0bb3-4adf-b0b2-0304af2c99ef tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:15.369179 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7718de-703f-4809-8e72-866e5748a047 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0168e90a79ce45408c71d2ec4c964b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee9b5678cac54f69bc88d6be2091f648', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:15.370501 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7718de-703f-4809-8e72-866e5748a047 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:15.371735 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7718de-703f-4809-8e72-866e5748a047 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:15.372252 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7718de-703f-4809-8e72-866e5748a047 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] PATH_INFO: `/v3/endpoints/a80a1d45964041af8e96b53e393a1dfc` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:15.375857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7718de-703f-4809-8e72-866e5748a047 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=a80a1d45964041af8e96b53e393a1dfc)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:15.378221 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7718de-703f-4809-8e72-866e5748a047 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:15.520553 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1d7718de-703f-4809-8e72-866e5748a047 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'a80a1d45964041af8e96b53e393a1dfc', 'request_id': 'req-1d7718de-703f-4809-8e72-866e5748a047'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:15.536087 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3185/6398] 10.222.0.23 () {58 vars in 1235 bytes} [Sat Apr 30 21:33:15 2022] DELETE /identity/v3/endpoints/a80a1d45964041af8e96b53e393a1dfc => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:33:15.539965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826360c0-c497-40c5-a1c8-7ff32b2953a5 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:15.567460 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826360c0-c497-40c5-a1c8-7ff32b2953a5 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:15.591164 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9b957-1d14-4e39-b759-ee78d8768827 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0168e90a79ce45408c71d2ec4c964b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee9b5678cac54f69bc88d6be2091f648', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:15.592682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9b957-1d14-4e39-b759-ee78d8768827 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:15.592682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9b957-1d14-4e39-b759-ee78d8768827 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:15.592889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9b957-1d14-4e39-b759-ee78d8768827 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] PATH_INFO: `/v3/regions/tempest-region-707344314` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:15.593484 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a9b957-1d14-4e39-b759-ee78d8768827 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-707344314)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:15.595812 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a9b957-1d14-4e39-b759-ee78d8768827 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:15.697310 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3214/6399] 10.222.0.23 () {58 vars in 1205 bytes} [Sat Apr 30 21:33:15 2022] DELETE /identity/v3/regions/tempest-region-707344314 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:15.704728 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7718de-703f-4809-8e72-866e5748a047 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:15.719265 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7718de-703f-4809-8e72-866e5748a047 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:15.743325 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542422ca-3b27-40cb-9d56-29c0059d9a2e tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0168e90a79ce45408c71d2ec4c964b05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee9b5678cac54f69bc88d6be2091f648', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:15.744680 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542422ca-3b27-40cb-9d56-29c0059d9a2e tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:15.747284 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542422ca-3b27-40cb-9d56-29c0059d9a2e tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:15.747765 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542422ca-3b27-40cb-9d56-29c0059d9a2e tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] PATH_INFO: `/v3/services/6bb14c291c3d470197c4965916d4b8ba` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:15.748884 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542422ca-3b27-40cb-9d56-29c0059d9a2e tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] RBAC: Authorizing `identity:delete_service(service_id=6bb14c291c3d470197c4965916d4b8ba)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:15.750605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542422ca-3b27-40cb-9d56-29c0059d9a2e tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:15.918343 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3186/6400] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:33:15 2022] DELETE /identity/v3/services/6bb14c291c3d470197c4965916d4b8ba => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:15.923207 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9b957-1d14-4e39-b759-ee78d8768827 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:15.924994 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-80a9b957-1d14-4e39-b759-ee78d8768827 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:16.089062 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9b957-1d14-4e39-b759-ee78d8768827 tempest-EndpointsNegativeTestJSON-372656836 tempest-EndpointsNegativeTestJSON-372656836-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:16.125511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdece267-6f62-457a-af3b-c68190f9548c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:16.126794 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdece267-6f62-457a-af3b-c68190f9548c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:16.127387 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdece267-6f62-457a-af3b-c68190f9548c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:16.127837 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdece267-6f62-457a-af3b-c68190f9548c admin admin] PATH_INFO: `/v3/users/0c4337b3a3ef4b16a0d3c9d5b06c1aaf` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:16.129562 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdece267-6f62-457a-af3b-c68190f9548c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c4337b3a3ef4b16a0d3c9d5b06c1aaf)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:16.132025 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdece267-6f62-457a-af3b-c68190f9548c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:16.503738 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bdece267-6f62-457a-af3b-c68190f9548c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c4337b3a3ef4b16a0d3c9d5b06c1aaf'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:16.535124 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bdece267-6f62-457a-af3b-c68190f9548c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c4337b3a3ef4b16a0d3c9d5b06c1aaf'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:16.669734 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bdece267-6f62-457a-af3b-c68190f9548c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c4337b3a3ef4b16a0d3c9d5b06c1aaf'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:16.678131 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bdece267-6f62-457a-af3b-c68190f9548c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c4337b3a3ef4b16a0d3c9d5b06c1aaf'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:16.678854 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bdece267-6f62-457a-af3b-c68190f9548c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c4337b3a3ef4b16a0d3c9d5b06c1aaf'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:16.686643 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3215/6401] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:33:15 2022] DELETE /identity/v3/users/0c4337b3a3ef4b16a0d3c9d5b06c1aaf => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:16.691309 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac8f49-ed35-4af2-8783-e84ab22fd5ea None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:16.697133 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac8f49-ed35-4af2-8783-e84ab22fd5ea None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:16.697133 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac8f49-ed35-4af2-8783-e84ab22fd5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:16.713285 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-d8ac8f49-ed35-4af2-8783-e84ab22fd5ea None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:16.733474 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d8ac8f49-ed35-4af2-8783-e84ab22fd5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:16.870605 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3187/6402] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:33:16.880870 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdece267-6f62-457a-af3b-c68190f9548c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:16.882470 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-bdece267-6f62-457a-af3b-c68190f9548c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:16.907034 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac8f49-ed35-4af2-8783-e84ab22fd5ea None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:16.908532 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d8ac8f49-ed35-4af2-8783-e84ab22fd5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:17.071175 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac8f49-ed35-4af2-8783-e84ab22fd5ea None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:17.076818 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a6efe-f180-4652-ae76-ae06f3e1e4ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:17.077872 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a6efe-f180-4652-ae76-ae06f3e1e4ff service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:17.078428 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a6efe-f180-4652-ae76-ae06f3e1e4ff service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:17.078909 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a6efe-f180-4652-ae76-ae06f3e1e4ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:17.103687 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7a6efe-f180-4652-ae76-ae06f3e1e4ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:17.107411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7a6efe-f180-4652-ae76-ae06f3e1e4ff service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:17.123533 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdece267-6f62-457a-af3b-c68190f9548c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:17.135063 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3188/6403] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:33:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:33:17.135936 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be6c9d3-109c-4bea-bcd8-cafb6f14596d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:17.138038 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6c9d3-109c-4bea-bcd8-cafb6f14596d service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:17.138345 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6c9d3-109c-4bea-bcd8-cafb6f14596d service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:17.138629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6c9d3-109c-4bea-bcd8-cafb6f14596d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:17.144086 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6be6c9d3-109c-4bea-bcd8-cafb6f14596d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:17.165054 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be6c9d3-109c-4bea-bcd8-cafb6f14596d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:17.166785 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be6c9d3-109c-4bea-bcd8-cafb6f14596d service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:17.196591 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3216/6404] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:33:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:33:17.607066 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a6efe-f180-4652-ae76-ae06f3e1e4ff service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:17.608486 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ec7a6efe-f180-4652-ae76-ae06f3e1e4ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:17.639322 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a6efe-f180-4652-ae76-ae06f3e1e4ff service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:17.683988 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a5ef5-1ec7-4bc1-aa99-2149e09e2ba8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:17.684910 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a5ef5-1ec7-4bc1-aa99-2149e09e2ba8 service placement] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:17.685400 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a5ef5-1ec7-4bc1-aa99-2149e09e2ba8 service placement] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:17.685952 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a5ef5-1ec7-4bc1-aa99-2149e09e2ba8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:17.694619 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c82a5ef5-1ec7-4bc1-aa99-2149e09e2ba8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:17.720704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a5ef5-1ec7-4bc1-aa99-2149e09e2ba8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:17.722676 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a5ef5-1ec7-4bc1-aa99-2149e09e2ba8 service placement] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:17.748812 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3189/6405] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:33:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:33:18.466818 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be6c9d3-109c-4bea-bcd8-cafb6f14596d service placement] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:18.468423 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6be6c9d3-109c-4bea-bcd8-cafb6f14596d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:18.495063 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be6c9d3-109c-4bea-bcd8-cafb6f14596d service placement] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:18.513517 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e81d96-8275-4596-a876-d0976db49e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:18.514583 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e81d96-8275-4596-a876-d0976db49e73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:18.514877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e81d96-8275-4596-a876-d0976db49e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:18.515159 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e81d96-8275-4596-a876-d0976db49e73 admin admin] PATH_INFO: `/v3/projects/a79a12e15b8741baa60f90568895439a` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:18.523032 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e81d96-8275-4596-a876-d0976db49e73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a79a12e15b8741baa60f90568895439a)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:18.525172 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e81d96-8275-4596-a876-d0976db49e73 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:18.718228 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-60e81d96-8275-4596-a876-d0976db49e73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a79a12e15b8741baa60f90568895439a', 'request_id': 'req-60e81d96-8275-4596-a876-d0976db49e73'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:18.728094 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-60e81d96-8275-4596-a876-d0976db49e73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a79a12e15b8741baa60f90568895439a', 'request_id': 'req-60e81d96-8275-4596-a876-d0976db49e73'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:18.740260 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-60e81d96-8275-4596-a876-d0976db49e73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a79a12e15b8741baa60f90568895439a', 'request_id': 'req-60e81d96-8275-4596-a876-d0976db49e73'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:18.884961 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-60e81d96-8275-4596-a876-d0976db49e73 admin admin] The token cache is being invalidate because project a79a12e15b8741baa60f90568895439a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:33:18.885259 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-60e81d96-8275-4596-a876-d0976db49e73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:18.890674 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-60e81d96-8275-4596-a876-d0976db49e73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:18.890674 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3217/6406] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:33:18 2022] DELETE /identity/v3/projects/a79a12e15b8741baa60f90568895439a => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:33:18.892299 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a5ef5-1ec7-4bc1-aa99-2149e09e2ba8 service placement] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:18.911267 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a5ef5-1ec7-4bc1-aa99-2149e09e2ba8 service placement] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:19.007047 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c527b-6c43-417e-9178-d78e0db2cea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:19.008251 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c527b-6c43-417e-9178-d78e0db2cea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:19.008686 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c527b-6c43-417e-9178-d78e0db2cea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:19.009143 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c527b-6c43-417e-9178-d78e0db2cea5 admin admin] PATH_INFO: `/v3/users/0168e90a79ce45408c71d2ec4c964b05` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:19.012726 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c527b-6c43-417e-9178-d78e0db2cea5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0168e90a79ce45408c71d2ec4c964b05)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:19.016750 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c527b-6c43-417e-9178-d78e0db2cea5 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:19.316180 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2f5c527b-6c43-417e-9178-d78e0db2cea5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0168e90a79ce45408c71d2ec4c964b05'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:19.342556 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2f5c527b-6c43-417e-9178-d78e0db2cea5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0168e90a79ce45408c71d2ec4c964b05'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:19.446244 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2f5c527b-6c43-417e-9178-d78e0db2cea5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0168e90a79ce45408c71d2ec4c964b05'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:19.446920 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2f5c527b-6c43-417e-9178-d78e0db2cea5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0168e90a79ce45408c71d2ec4c964b05'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:19.466330 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2f5c527b-6c43-417e-9178-d78e0db2cea5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0168e90a79ce45408c71d2ec4c964b05'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:19.483994 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3190/6407] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:33:18 2022] DELETE /identity/v3/users/0168e90a79ce45408c71d2ec4c964b05 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:19.757438 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e81d96-8275-4596-a876-d0976db49e73 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:19.760201 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-60e81d96-8275-4596-a876-d0976db49e73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:19.952098 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e81d96-8275-4596-a876-d0976db49e73 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:20.069402 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8307bf8-0a43-4111-b0ef-67d01141b6cc tempest-RoutersAdminTest-159610588 tempest-RoutersAdminTest-159610588-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4308901beda44daca7b4f3388ed12b25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306af5b78d2b45dcb9dedf50d1250f91', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:20.071400 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8307bf8-0a43-4111-b0ef-67d01141b6cc tempest-RoutersAdminTest-159610588 tempest-RoutersAdminTest-159610588-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:20.071696 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8307bf8-0a43-4111-b0ef-67d01141b6cc tempest-RoutersAdminTest-159610588 tempest-RoutersAdminTest-159610588-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:20.073168 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8307bf8-0a43-4111-b0ef-67d01141b6cc tempest-RoutersAdminTest-159610588 tempest-RoutersAdminTest-159610588-project-admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:20.076871 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8307bf8-0a43-4111-b0ef-67d01141b6cc tempest-RoutersAdminTest-159610588 tempest-RoutersAdminTest-159610588-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:33:20.082029 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8307bf8-0a43-4111-b0ef-67d01141b6cc tempest-RoutersAdminTest-159610588 tempest-RoutersAdminTest-159610588-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:20.087923 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8307bf8-0a43-4111-b0ef-67d01141b6cc tempest-RoutersAdminTest-159610588 tempest-RoutersAdminTest-159610588-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:20.117899 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3218/6408] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:33:20.123569 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c527b-6c43-417e-9178-d78e0db2cea5 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:20.126731 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2f5c527b-6c43-417e-9178-d78e0db2cea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:20.178230 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c527b-6c43-417e-9178-d78e0db2cea5 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:20.186196 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac67481-70cf-459b-9a86-da5d536f8dc3 tempest-RoutersAdminTest-159610588 tempest-RoutersAdminTest-159610588-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4308901beda44daca7b4f3388ed12b25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306af5b78d2b45dcb9dedf50d1250f91', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:20.187274 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac67481-70cf-459b-9a86-da5d536f8dc3 tempest-RoutersAdminTest-159610588 tempest-RoutersAdminTest-159610588-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:20.187743 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac67481-70cf-459b-9a86-da5d536f8dc3 tempest-RoutersAdminTest-159610588 tempest-RoutersAdminTest-159610588-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:20.188397 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac67481-70cf-459b-9a86-da5d536f8dc3 tempest-RoutersAdminTest-159610588 tempest-RoutersAdminTest-159610588-project-admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:20.191233 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac67481-70cf-459b-9a86-da5d536f8dc3 tempest-RoutersAdminTest-159610588 tempest-RoutersAdminTest-159610588-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:20.194504 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac67481-70cf-459b-9a86-da5d536f8dc3 tempest-RoutersAdminTest-159610588 tempest-RoutersAdminTest-159610588-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:20.347746 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3191/6409] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:33:20 2022] POST /identity/v3/projects => generated 349 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:33:20.348173 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8307bf8-0a43-4111-b0ef-67d01141b6cc tempest-RoutersAdminTest-159610588 tempest-RoutersAdminTest-159610588-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:20.363556 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8307bf8-0a43-4111-b0ef-67d01141b6cc tempest-RoutersAdminTest-159610588 tempest-RoutersAdminTest-159610588-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:20.543597 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea0be2-11ad-45fa-b14d-61ca8c516e10 tempest-RoutersAdminTest-159610588 tempest-RoutersAdminTest-159610588-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4308901beda44daca7b4f3388ed12b25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306af5b78d2b45dcb9dedf50d1250f91', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:20.544296 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea0be2-11ad-45fa-b14d-61ca8c516e10 tempest-RoutersAdminTest-159610588 tempest-RoutersAdminTest-159610588-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:20.544587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea0be2-11ad-45fa-b14d-61ca8c516e10 tempest-RoutersAdminTest-159610588 tempest-RoutersAdminTest-159610588-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:20.544871 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea0be2-11ad-45fa-b14d-61ca8c516e10 tempest-RoutersAdminTest-159610588 tempest-RoutersAdminTest-159610588-project-admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:20.545658 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea0be2-11ad-45fa-b14d-61ca8c516e10 tempest-RoutersAdminTest-159610588 tempest-RoutersAdminTest-159610588-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:33:20.549145 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea0be2-11ad-45fa-b14d-61ca8c516e10 tempest-RoutersAdminTest-159610588 tempest-RoutersAdminTest-159610588-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:20.554493 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea0be2-11ad-45fa-b14d-61ca8c516e10 tempest-RoutersAdminTest-159610588 tempest-RoutersAdminTest-159610588-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:20.590379 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3219/6410] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:33:20.817800 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac67481-70cf-459b-9a86-da5d536f8dc3 tempest-RoutersAdminTest-159610588 tempest-RoutersAdminTest-159610588-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:20.820330 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-bac67481-70cf-459b-9a86-da5d536f8dc3 tempest-RoutersAdminTest-159610588 tempest-RoutersAdminTest-159610588-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:20.938560 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac67481-70cf-459b-9a86-da5d536f8dc3 tempest-RoutersAdminTest-159610588 tempest-RoutersAdminTest-159610588-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:20.946527 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7baad5-9ce3-442c-b5d9-ab2ad08f16da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:20.947417 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7baad5-9ce3-442c-b5d9-ab2ad08f16da admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:20.947704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7baad5-9ce3-442c-b5d9-ab2ad08f16da admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:20.947983 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7baad5-9ce3-442c-b5d9-ab2ad08f16da admin admin] PATH_INFO: `/v3/projects/ee9b5678cac54f69bc88d6be2091f648` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:20.953132 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7baad5-9ce3-442c-b5d9-ab2ad08f16da admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee9b5678cac54f69bc88d6be2091f648)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:20.955593 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7baad5-9ce3-442c-b5d9-ab2ad08f16da admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:21.110464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-da7baad5-9ce3-442c-b5d9-ab2ad08f16da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee9b5678cac54f69bc88d6be2091f648', 'request_id': 'req-da7baad5-9ce3-442c-b5d9-ab2ad08f16da'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:21.119778 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-da7baad5-9ce3-442c-b5d9-ab2ad08f16da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee9b5678cac54f69bc88d6be2091f648', 'request_id': 'req-da7baad5-9ce3-442c-b5d9-ab2ad08f16da'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:21.130250 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-da7baad5-9ce3-442c-b5d9-ab2ad08f16da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee9b5678cac54f69bc88d6be2091f648', 'request_id': 'req-da7baad5-9ce3-442c-b5d9-ab2ad08f16da'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:21.232326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-da7baad5-9ce3-442c-b5d9-ab2ad08f16da admin admin] The token cache is being invalidate because project ee9b5678cac54f69bc88d6be2091f648 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:33:21.235831 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-da7baad5-9ce3-442c-b5d9-ab2ad08f16da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:21.235831 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-da7baad5-9ce3-442c-b5d9-ab2ad08f16da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:21.240458 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425ab28-462a-43a3-ad14-07f00212b2c8 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:21.240951 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425ab28-462a-43a3-ad14-07f00212b2c8 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:21.241104 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425ab28-462a-43a3-ad14-07f00212b2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:21.254638 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3192/6411] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:33:20 2022] DELETE /identity/v3/projects/ee9b5678cac54f69bc88d6be2091f648 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:21.289496 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-d425ab28-462a-43a3-ad14-07f00212b2c8 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:21.291549 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d425ab28-462a-43a3-ad14-07f00212b2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:21.395535 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3220/6412] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:33:21.396342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165c00d-440f-4d54-b9ea-1e758e897cf2 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:21.396637 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165c00d-440f-4d54-b9ea-1e758e897cf2 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:21.396920 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165c00d-440f-4d54-b9ea-1e758e897cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:21.436255 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-c165c00d-440f-4d54-b9ea-1e758e897cf2 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:21.438965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c165c00d-440f-4d54-b9ea-1e758e897cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:21.453221 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3193/6413] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:33:21.457887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425ab28-462a-43a3-ad14-07f00212b2c8 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:21.482506 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425ab28-462a-43a3-ad14-07f00212b2c8 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:21.500533 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b214d-8373-44b5-8625-e78c150496a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:21.501405 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b214d-8373-44b5-8625-e78c150496a9 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:21.501871 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b214d-8373-44b5-8625-e78c150496a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:21.502337 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b214d-8373-44b5-8625-e78c150496a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:21.503326 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b214d-8373-44b5-8625-e78c150496a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:33:21.503808 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b214d-8373-44b5-8625-e78c150496a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:21.511002 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b214d-8373-44b5-8625-e78c150496a9 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:21.533007 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3221/6414] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:33:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:33:21.539716 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165c00d-440f-4d54-b9ea-1e758e897cf2 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:21.556331 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165c00d-440f-4d54-b9ea-1e758e897cf2 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:21.570228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e1428-5e28-4a00-99e7-7fa0bfe5bf40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:21.571357 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e1428-5e28-4a00-99e7-7fa0bfe5bf40 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:21.571638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e1428-5e28-4a00-99e7-7fa0bfe5bf40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:21.572010 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e1428-5e28-4a00-99e7-7fa0bfe5bf40 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:21.572717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e1428-5e28-4a00-99e7-7fa0bfe5bf40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:21.591783 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e1428-5e28-4a00-99e7-7fa0bfe5bf40 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:21.703016 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3194/6415] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:33:21 2022] POST /identity/v3/projects => generated 389 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:33:21.707581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b214d-8373-44b5-8625-e78c150496a9 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:21.723268 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b214d-8373-44b5-8625-e78c150496a9 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:21.814754 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725edf9b-ea30-43c3-8db7-e588d8e19f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:21.815440 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725edf9b-ea30-43c3-8db7-e588d8e19f15 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:21.815720 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725edf9b-ea30-43c3-8db7-e588d8e19f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:21.815994 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725edf9b-ea30-43c3-8db7-e588d8e19f15 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:21.816727 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725edf9b-ea30-43c3-8db7-e588d8e19f15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:21.819565 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725edf9b-ea30-43c3-8db7-e588d8e19f15 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:21.945471 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3222/6416] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:33:21 2022] POST /identity/v3/users => generated 295 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:33:21.950560 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e1428-5e28-4a00-99e7-7fa0bfe5bf40 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:21.967047 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e1428-5e28-4a00-99e7-7fa0bfe5bf40 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:21.981843 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e0a68-9643-4c4b-8625-0af1e3b12f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:21.982699 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e0a68-9643-4c4b-8625-0af1e3b12f77 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:21.985221 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e0a68-9643-4c4b-8625-0af1e3b12f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:21.985221 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e0a68-9643-4c4b-8625-0af1e3b12f77 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:21.988931 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e0a68-9643-4c4b-8625-0af1e3b12f77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:21.995748 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e0a68-9643-4c4b-8625-0af1e3b12f77 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:22.015988 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3195/6417] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:33:22.020460 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725edf9b-ea30-43c3-8db7-e588d8e19f15 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:22.035873 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725edf9b-ea30-43c3-8db7-e588d8e19f15 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:22.045204 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0d779-2157-4044-920b-4d984ff39701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:22.046404 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0d779-2157-4044-920b-4d984ff39701 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:22.046850 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0d779-2157-4044-920b-4d984ff39701 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:22.047286 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0d779-2157-4044-920b-4d984ff39701 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:22.048261 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a0d779-2157-4044-920b-4d984ff39701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:22.051950 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a0d779-2157-4044-920b-4d984ff39701 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:22.082582 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e0a68-9643-4c4b-8625-0af1e3b12f77 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:22.091301 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3223/6418] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:33:22.102194 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0d779-2157-4044-920b-4d984ff39701 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:22.107403 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e0a68-9643-4c4b-8625-0af1e3b12f77 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:22.107697 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-98a0d779-2157-4044-920b-4d984ff39701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:22.119581 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3363d19-ee7f-46f5-b744-918def8554dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:22.120518 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3363d19-ee7f-46f5-b744-918def8554dc admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:22.120806 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3363d19-ee7f-46f5-b744-918def8554dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:22.121083 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3363d19-ee7f-46f5-b744-918def8554dc admin admin] PATH_INFO: `/v3/projects/83eaf21051504a7e8943227646e964b7/users/5e3fdd1a926943968d0d9cd4656cb35e/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:22.164441 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3363d19-ee7f-46f5-b744-918def8554dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=83eaf21051504a7e8943227646e964b7, user_id=5e3fdd1a926943968d0d9cd4656cb35e, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:22.169293 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3363d19-ee7f-46f5-b744-918def8554dc admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:22.242712 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0d779-2157-4044-920b-4d984ff39701 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:22.255355 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cdb97-a244-408b-acf6-9b9d38babbb1 tempest-RoutersAdminTest-159610588 tempest-RoutersAdminTest-159610588-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4308901beda44daca7b4f3388ed12b25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '306af5b78d2b45dcb9dedf50d1250f91', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:22.256370 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cdb97-a244-408b-acf6-9b9d38babbb1 tempest-RoutersAdminTest-159610588 tempest-RoutersAdminTest-159610588-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:22.256725 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cdb97-a244-408b-acf6-9b9d38babbb1 tempest-RoutersAdminTest-159610588 tempest-RoutersAdminTest-159610588-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:22.257077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cdb97-a244-408b-acf6-9b9d38babbb1 tempest-RoutersAdminTest-159610588 tempest-RoutersAdminTest-159610588-project-admin] PATH_INFO: `/v3/projects/6925687ebfb344f3af033319124648aa` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:22.258404 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9cdb97-a244-408b-acf6-9b9d38babbb1 tempest-RoutersAdminTest-159610588 tempest-RoutersAdminTest-159610588-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6925687ebfb344f3af033319124648aa)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:22.260437 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9cdb97-a244-408b-acf6-9b9d38babbb1 tempest-RoutersAdminTest-159610588 tempest-RoutersAdminTest-159610588-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:22.341297 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3196/6419] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:33:22 2022] PUT /identity/v3/projects/83eaf21051504a7e8943227646e964b7/users/5e3fdd1a926943968d0d9cd4656cb35e/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:22.343731 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d875c-0f66-4100-808b-8dfb371ee92e None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:22.344203 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d875c-0f66-4100-808b-8dfb371ee92e None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:22.346799 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d875c-0f66-4100-808b-8dfb371ee92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:22.445371 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bb9cdb97-a244-408b-acf6-9b9d38babbb1 tempest-RoutersAdminTest-159610588 tempest-RoutersAdminTest-159610588-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6925687ebfb344f3af033319124648aa', 'request_id': 'req-bb9cdb97-a244-408b-acf6-9b9d38babbb1'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:22.458971 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-795d875c-0f66-4100-808b-8dfb371ee92e None None] MFA Rules not processed for user `5e3fdd1a926943968d0d9cd4656cb35e`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:22.460203 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-795d875c-0f66-4100-808b-8dfb371ee92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:22.462271 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bb9cdb97-a244-408b-acf6-9b9d38babbb1 tempest-RoutersAdminTest-159610588 tempest-RoutersAdminTest-159610588-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6925687ebfb344f3af033319124648aa', 'request_id': 'req-bb9cdb97-a244-408b-acf6-9b9d38babbb1'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:22.487282 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bb9cdb97-a244-408b-acf6-9b9d38babbb1 tempest-RoutersAdminTest-159610588 tempest-RoutersAdminTest-159610588-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6925687ebfb344f3af033319124648aa', 'request_id': 'req-bb9cdb97-a244-408b-acf6-9b9d38babbb1'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:22.600236 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bb9cdb97-a244-408b-acf6-9b9d38babbb1 tempest-RoutersAdminTest-159610588 tempest-RoutersAdminTest-159610588-project-admin] The token cache is being invalidate because project 6925687ebfb344f3af033319124648aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:33:22.605241 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bb9cdb97-a244-408b-acf6-9b9d38babbb1 tempest-RoutersAdminTest-159610588 tempest-RoutersAdminTest-159610588-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:22.605241 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bb9cdb97-a244-408b-acf6-9b9d38babbb1 tempest-RoutersAdminTest-159610588 tempest-RoutersAdminTest-159610588-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:22.607926 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3224/6420] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:33:22 2022] DELETE /identity/v3/projects/6925687ebfb344f3af033319124648aa => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:22.623080 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3197/6421] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:33:22.628157 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cdb97-a244-408b-acf6-9b9d38babbb1 tempest-RoutersAdminTest-159610588 tempest-RoutersAdminTest-159610588-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:22.630590 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-bb9cdb97-a244-408b-acf6-9b9d38babbb1 tempest-RoutersAdminTest-159610588 tempest-RoutersAdminTest-159610588-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:22.634764 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d875c-0f66-4100-808b-8dfb371ee92e None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:22.645243 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-795d875c-0f66-4100-808b-8dfb371ee92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:22.765997 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d875c-0f66-4100-808b-8dfb371ee92e None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:22.775934 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b220db-d717-4152-9803-55e6d5380a6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:22.777440 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b220db-d717-4152-9803-55e6d5380a6c service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:22.778059 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b220db-d717-4152-9803-55e6d5380a6c service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:22.778578 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b220db-d717-4152-9803-55e6d5380a6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:22.782526 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-36b220db-d717-4152-9803-55e6d5380a6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:22.833077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cdb97-a244-408b-acf6-9b9d38babbb1 tempest-RoutersAdminTest-159610588 tempest-RoutersAdminTest-159610588-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:22.849750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae291dcc-06f4-489e-89b9-18bb11ccb132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:22.853033 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae291dcc-06f4-489e-89b9-18bb11ccb132 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:22.853364 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae291dcc-06f4-489e-89b9-18bb11ccb132 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:22.853644 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae291dcc-06f4-489e-89b9-18bb11ccb132 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:22.854394 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae291dcc-06f4-489e-89b9-18bb11ccb132 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:22.861291 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae291dcc-06f4-489e-89b9-18bb11ccb132 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:22.920883 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b220db-d717-4152-9803-55e6d5380a6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:22.922429 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b220db-d717-4152-9803-55e6d5380a6c service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:22.959529 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3198/6422] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:33:22 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:33:23.045877 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3225/6423] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:33:22 2022] POST /identity/v3/projects => generated 389 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:33:23.049488 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b220db-d717-4152-9803-55e6d5380a6c service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:23.084766 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b220db-d717-4152-9803-55e6d5380a6c service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:23.273783 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f246ae6-de17-4c50-be55-243ffc7c3446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:23.273783 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f246ae6-de17-4c50-be55-243ffc7c3446 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:23.273783 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f246ae6-de17-4c50-be55-243ffc7c3446 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:23.273783 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f246ae6-de17-4c50-be55-243ffc7c3446 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:23.279416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f246ae6-de17-4c50-be55-243ffc7c3446 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:23.279416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f246ae6-de17-4c50-be55-243ffc7c3446 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:23.380673 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3199/6424] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:33:23 2022] POST /identity/v3/users => generated 301 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:33:23.385093 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae291dcc-06f4-489e-89b9-18bb11ccb132 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:23.399814 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae291dcc-06f4-489e-89b9-18bb11ccb132 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:23.415331 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d2928-1a56-4ef9-8215-34f5b36ab55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:23.416388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d2928-1a56-4ef9-8215-34f5b36ab55b admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:23.416869 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d2928-1a56-4ef9-8215-34f5b36ab55b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:23.417369 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d2928-1a56-4ef9-8215-34f5b36ab55b admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:23.418853 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d2928-1a56-4ef9-8215-34f5b36ab55b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:23.420708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d2928-1a56-4ef9-8215-34f5b36ab55b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:23.451607 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3226/6425] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:33:23 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:33:23.456392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f246ae6-de17-4c50-be55-243ffc7c3446 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:23.473003 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f246ae6-de17-4c50-be55-243ffc7c3446 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:23.487168 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5caa7d-fdb6-4245-a46f-333d0796d3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:23.488088 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5caa7d-fdb6-4245-a46f-333d0796d3f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:23.488375 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5caa7d-fdb6-4245-a46f-333d0796d3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:23.488652 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5caa7d-fdb6-4245-a46f-333d0796d3f7 admin admin] PATH_INFO: `/v3/projects/4940b3033c5548d6bbfb4d93e141c01e/users/2f896c58f5064509ba6afc2d96873b9f/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:23.521205 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5caa7d-fdb6-4245-a46f-333d0796d3f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4940b3033c5548d6bbfb4d93e141c01e, user_id=2f896c58f5064509ba6afc2d96873b9f, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:23.524006 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5caa7d-fdb6-4245-a46f-333d0796d3f7 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:23.624714 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3200/6426] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:33:23 2022] PUT /identity/v3/projects/4940b3033c5548d6bbfb4d93e141c01e/users/2f896c58f5064509ba6afc2d96873b9f/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:23.624907 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d2928-1a56-4ef9-8215-34f5b36ab55b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:23.647954 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d2928-1a56-4ef9-8215-34f5b36ab55b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:23.774757 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b7eee-2bc1-4c0a-9e9c-61ce3ba04982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:23.776116 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b7eee-2bc1-4c0a-9e9c-61ce3ba04982 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:23.776590 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b7eee-2bc1-4c0a-9e9c-61ce3ba04982 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:23.778847 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b7eee-2bc1-4c0a-9e9c-61ce3ba04982 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:23.779859 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b7eee-2bc1-4c0a-9e9c-61ce3ba04982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:23.782044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b7eee-2bc1-4c0a-9e9c-61ce3ba04982 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:23.802697 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3227/6427] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:33:23 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:33:23.806818 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5caa7d-fdb6-4245-a46f-333d0796d3f7 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:23.826480 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5caa7d-fdb6-4245-a46f-333d0796d3f7 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:23.840336 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8ffa3-b860-478b-ab99-a2ad09f4f7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:23.841258 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8ffa3-b860-478b-ab99-a2ad09f4f7a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:23.841537 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8ffa3-b860-478b-ab99-a2ad09f4f7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:23.844992 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8ffa3-b860-478b-ab99-a2ad09f4f7a4 admin admin] PATH_INFO: `/v3/projects/4940b3033c5548d6bbfb4d93e141c01e/users/2f896c58f5064509ba6afc2d96873b9f/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:23.855163 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d8ffa3-b860-478b-ab99-a2ad09f4f7a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4940b3033c5548d6bbfb4d93e141c01e, user_id=2f896c58f5064509ba6afc2d96873b9f, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:23.858179 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d8ffa3-b860-478b-ab99-a2ad09f4f7a4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:23.879087 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3201/6428] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:33:23 2022] PUT /identity/v3/projects/4940b3033c5548d6bbfb4d93e141c01e/users/2f896c58f5064509ba6afc2d96873b9f/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:23.896082 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b61af-3ca7-46ba-b0fe-85a621886aa6 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:23.896546 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b61af-3ca7-46ba-b0fe-85a621886aa6 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:23.896987 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b61af-3ca7-46ba-b0fe-85a621886aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:23.944809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-de3b61af-3ca7-46ba-b0fe-85a621886aa6 None None] MFA Rules not processed for user `2f896c58f5064509ba6afc2d96873b9f`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:23.949384 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-de3b61af-3ca7-46ba-b0fe-85a621886aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:24.034235 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3228/6429] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:23 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:33:24.038198 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8ffa3-b860-478b-ab99-a2ad09f4f7a4 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:24.058949 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8ffa3-b860-478b-ab99-a2ad09f4f7a4 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:24.069495 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5b8e8-45f9-48d8-b73c-b235499f1974 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f896c58f5064509ba6afc2d96873b9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4940b3033c5548d6bbfb4d93e141c01e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:24.070767 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5b8e8-45f9-48d8-b73c-b235499f1974 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:24.071310 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5b8e8-45f9-48d8-b73c-b235499f1974 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:24.071944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5b8e8-45f9-48d8-b73c-b235499f1974 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] PATH_INFO: `/v3/projects/83eaf21051504a7e8943227646e964b7` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:24.073685 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f5b8e8-45f9-48d8-b73c-b235499f1974 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] RBAC: Authorizing `identity:get_project(project_id=83eaf21051504a7e8943227646e964b7)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:24.076887 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f5b8e8-45f9-48d8-b73c-b235499f1974 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:24.087337 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b61af-3ca7-46ba-b0fe-85a621886aa6 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:24.099810 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3202/6430] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:33:24 2022] GET /identity/v3/projects/83eaf21051504a7e8943227646e964b7 => generated 389 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:33:24.111144 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b61af-3ca7-46ba-b0fe-85a621886aa6 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:24.118605 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643ee14-31f5-49b4-afad-f7a0f70f6b86 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f896c58f5064509ba6afc2d96873b9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4940b3033c5548d6bbfb4d93e141c01e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:24.125922 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643ee14-31f5-49b4-afad-f7a0f70f6b86 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:24.125922 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643ee14-31f5-49b4-afad-f7a0f70f6b86 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:24.125922 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643ee14-31f5-49b4-afad-f7a0f70f6b86 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:24.125922 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a643ee14-31f5-49b4-afad-f7a0f70f6b86 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:24.126342 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a643ee14-31f5-49b4-afad-f7a0f70f6b86 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:24.253852 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3229/6431] 10.222.0.23 () {60 vars in 1151 bytes} [Sat Apr 30 21:33:24 2022] POST /identity/v3/projects => generated 338 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:33:24.254093 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5b8e8-45f9-48d8-b73c-b235499f1974 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:24.267123 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5b8e8-45f9-48d8-b73c-b235499f1974 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:24.344583 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3307a7-4925-4c81-8f00-273336f4eb7c tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f896c58f5064509ba6afc2d96873b9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4940b3033c5548d6bbfb4d93e141c01e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:24.344583 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3307a7-4925-4c81-8f00-273336f4eb7c tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:24.344583 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3307a7-4925-4c81-8f00-273336f4eb7c tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:24.345810 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3307a7-4925-4c81-8f00-273336f4eb7c tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:24.345810 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3307a7-4925-4c81-8f00-273336f4eb7c tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:24.345810 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3307a7-4925-4c81-8f00-273336f4eb7c tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:24.376762 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3203/6432] 10.222.0.23 () {58 vars in 1130 bytes} [Sat Apr 30 21:33:24 2022] GET /identity/v3/projects => generated 6186 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:33:24.378835 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643ee14-31f5-49b4-afad-f7a0f70f6b86 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:24.390489 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643ee14-31f5-49b4-afad-f7a0f70f6b86 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:24.396595 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f790e96-0c58-4104-b612-1d503ff3bcdc tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f896c58f5064509ba6afc2d96873b9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4940b3033c5548d6bbfb4d93e141c01e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:24.402475 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f790e96-0c58-4104-b612-1d503ff3bcdc tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:24.402475 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f790e96-0c58-4104-b612-1d503ff3bcdc tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:24.402475 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f790e96-0c58-4104-b612-1d503ff3bcdc tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] PATH_INFO: `/v3/projects/83eaf21051504a7e8943227646e964b7` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:24.402475 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f790e96-0c58-4104-b612-1d503ff3bcdc tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] RBAC: Authorizing `identity:get_project(project_id=83eaf21051504a7e8943227646e964b7)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:24.402892 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f790e96-0c58-4104-b612-1d503ff3bcdc tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:24.404825 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3230/6433] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:33:24 2022] GET /identity/v3/projects/83eaf21051504a7e8943227646e964b7 => generated 389 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:33:24.409600 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3307a7-4925-4c81-8f00-273336f4eb7c tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:24.420325 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3307a7-4925-4c81-8f00-273336f4eb7c tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:24.426478 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28bd6d-a245-4cd3-843a-e7f5e433866e tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f896c58f5064509ba6afc2d96873b9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4940b3033c5548d6bbfb4d93e141c01e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:24.427415 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28bd6d-a245-4cd3-843a-e7f5e433866e tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:24.427906 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28bd6d-a245-4cd3-843a-e7f5e433866e tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:24.428432 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28bd6d-a245-4cd3-843a-e7f5e433866e tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] PATH_INFO: `/v3/projects/e56d3eabe9f64c45a0d74e2328e4bcac` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:24.431311 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b28bd6d-a245-4cd3-843a-e7f5e433866e tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] RBAC: Authorizing `identity:get_project(project_id=e56d3eabe9f64c45a0d74e2328e4bcac)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:24.438329 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b28bd6d-a245-4cd3-843a-e7f5e433866e tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:24.443281 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3204/6434] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:33:24 2022] GET /identity/v3/projects/e56d3eabe9f64c45a0d74e2328e4bcac => generated 338 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:33:24.449969 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f790e96-0c58-4104-b612-1d503ff3bcdc tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:24.463886 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f790e96-0c58-4104-b612-1d503ff3bcdc tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:24.470927 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301d6e8-9b46-4d31-bdd1-cb5ed810bba4 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f896c58f5064509ba6afc2d96873b9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4940b3033c5548d6bbfb4d93e141c01e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:24.471392 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301d6e8-9b46-4d31-bdd1-cb5ed810bba4 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:24.471392 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301d6e8-9b46-4d31-bdd1-cb5ed810bba4 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:24.471581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301d6e8-9b46-4d31-bdd1-cb5ed810bba4 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:24.472320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e301d6e8-9b46-4d31-bdd1-cb5ed810bba4 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:24.474982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e301d6e8-9b46-4d31-bdd1-cb5ed810bba4 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:24.507457 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28bd6d-a245-4cd3-843a-e7f5e433866e tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:24.513425 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3231/6435] 10.222.0.23 () {58 vars in 1130 bytes} [Sat Apr 30 21:33:24 2022] GET /identity/v3/projects => generated 6186 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:33:24.518865 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28bd6d-a245-4cd3-843a-e7f5e433866e tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:24.525452 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada85437-3a83-4eea-b468-a1801e684db0 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f896c58f5064509ba6afc2d96873b9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4940b3033c5548d6bbfb4d93e141c01e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:24.526393 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada85437-3a83-4eea-b468-a1801e684db0 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:24.527268 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada85437-3a83-4eea-b468-a1801e684db0 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:24.527584 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada85437-3a83-4eea-b468-a1801e684db0 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:24.528366 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada85437-3a83-4eea-b468-a1801e684db0 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:33:24.528887 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada85437-3a83-4eea-b468-a1801e684db0 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:24.536018 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada85437-3a83-4eea-b468-a1801e684db0 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:24.571765 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3205/6436] 10.222.0.23 () {58 vars in 1165 bytes} [Sat Apr 30 21:33:24 2022] GET /identity/v3/projects?domain_id=default => generated 5855 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:33:24.587639 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301d6e8-9b46-4d31-bdd1-cb5ed810bba4 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:24.590063 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301d6e8-9b46-4d31-bdd1-cb5ed810bba4 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:24.596512 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7c096-d64e-4e66-953f-c460f50bf567 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f896c58f5064509ba6afc2d96873b9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4940b3033c5548d6bbfb4d93e141c01e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:24.598124 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7c096-d64e-4e66-953f-c460f50bf567 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:24.599505 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7c096-d64e-4e66-953f-c460f50bf567 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:24.599977 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7c096-d64e-4e66-953f-c460f50bf567 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:24.600938 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e7c096-d64e-4e66-953f-c460f50bf567 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:24.603098 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e7c096-d64e-4e66-953f-c460f50bf567 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:24.651186 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3232/6437] 10.222.0.23 () {58 vars in 1130 bytes} [Sat Apr 30 21:33:24 2022] GET /identity/v3/projects => generated 6186 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:33:24.652905 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada85437-3a83-4eea-b468-a1801e684db0 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:24.668469 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada85437-3a83-4eea-b468-a1801e684db0 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:24.675953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9875892-4bd7-40e3-a744-2f33e2c3901c tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f896c58f5064509ba6afc2d96873b9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4940b3033c5548d6bbfb4d93e141c01e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:24.676913 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9875892-4bd7-40e3-a744-2f33e2c3901c tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:24.677414 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9875892-4bd7-40e3-a744-2f33e2c3901c tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:24.678286 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9875892-4bd7-40e3-a744-2f33e2c3901c tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:24.680045 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9875892-4bd7-40e3-a744-2f33e2c3901c tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:33:24.680565 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9875892-4bd7-40e3-a744-2f33e2c3901c tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:24.683011 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9875892-4bd7-40e3-a744-2f33e2c3901c tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:24.744479 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7c096-d64e-4e66-953f-c460f50bf567 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:24.753556 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3206/6438] 10.222.0.23 () {58 vars in 1165 bytes} [Sat Apr 30 21:33:24 2022] GET /identity/v3/projects?domain_id=default => generated 5855 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:33:24.757635 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7c096-d64e-4e66-953f-c460f50bf567 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:24.763764 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c83ecb-e705-4866-9eb4-dc8e75abf5a6 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f896c58f5064509ba6afc2d96873b9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4940b3033c5548d6bbfb4d93e141c01e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:24.764779 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c83ecb-e705-4866-9eb4-dc8e75abf5a6 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:24.765326 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c83ecb-e705-4866-9eb4-dc8e75abf5a6 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:24.765839 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c83ecb-e705-4866-9eb4-dc8e75abf5a6 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:24.766673 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c83ecb-e705-4866-9eb4-dc8e75abf5a6 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:24.768792 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c83ecb-e705-4866-9eb4-dc8e75abf5a6 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:24.800125 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3233/6439] 10.222.0.23 () {58 vars in 1130 bytes} [Sat Apr 30 21:33:24 2022] GET /identity/v3/projects => generated 6186 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:33:24.801370 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9875892-4bd7-40e3-a744-2f33e2c3901c tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:24.818087 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9875892-4bd7-40e3-a744-2f33e2c3901c tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:24.824405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f436c-1fe7-45fa-a0ba-d2e84cbae06a tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f896c58f5064509ba6afc2d96873b9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4940b3033c5548d6bbfb4d93e141c01e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:24.825337 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f436c-1fe7-45fa-a0ba-d2e84cbae06a tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:24.825824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f436c-1fe7-45fa-a0ba-d2e84cbae06a tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:24.826270 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f436c-1fe7-45fa-a0ba-d2e84cbae06a tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:24.827918 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f436c-1fe7-45fa-a0ba-d2e84cbae06a tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-1840599073) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:33:24.828480 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f436c-1fe7-45fa-a0ba-d2e84cbae06a tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:24.830749 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f436c-1fe7-45fa-a0ba-d2e84cbae06a tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:24.859145 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c83ecb-e705-4866-9eb4-dc8e75abf5a6 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:24.867546 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3207/6440] 10.222.0.23 () {58 vars in 1231 bytes} [Sat Apr 30 21:33:24 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-1840599073 => generated 537 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:33:24.873216 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c83ecb-e705-4866-9eb4-dc8e75abf5a6 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:24.884491 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e4093-4cc0-42cd-8dcd-8430e1763475 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f896c58f5064509ba6afc2d96873b9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4940b3033c5548d6bbfb4d93e141c01e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:24.884491 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e4093-4cc0-42cd-8dcd-8430e1763475 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:24.884491 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e4093-4cc0-42cd-8dcd-8430e1763475 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:24.884781 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e4093-4cc0-42cd-8dcd-8430e1763475 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] PATH_INFO: `/v3/projects/e56d3eabe9f64c45a0d74e2328e4bcac` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:24.886718 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e4093-4cc0-42cd-8dcd-8430e1763475 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e56d3eabe9f64c45a0d74e2328e4bcac)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:24.888647 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e4093-4cc0-42cd-8dcd-8430e1763475 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:25.068868 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7b8e4093-4cc0-42cd-8dcd-8430e1763475 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e56d3eabe9f64c45a0d74e2328e4bcac', 'request_id': 'req-7b8e4093-4cc0-42cd-8dcd-8430e1763475'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:25.080244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7b8e4093-4cc0-42cd-8dcd-8430e1763475 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e56d3eabe9f64c45a0d74e2328e4bcac', 'request_id': 'req-7b8e4093-4cc0-42cd-8dcd-8430e1763475'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:25.091618 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7b8e4093-4cc0-42cd-8dcd-8430e1763475 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e56d3eabe9f64c45a0d74e2328e4bcac', 'request_id': 'req-7b8e4093-4cc0-42cd-8dcd-8430e1763475'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:25.172882 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7b8e4093-4cc0-42cd-8dcd-8430e1763475 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] The token cache is being invalidate because project e56d3eabe9f64c45a0d74e2328e4bcac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:33:25.173249 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7b8e4093-4cc0-42cd-8dcd-8430e1763475 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:25.173973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7b8e4093-4cc0-42cd-8dcd-8430e1763475 tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:25.175585 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3234/6441] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:33:24 2022] DELETE /identity/v3/projects/e56d3eabe9f64c45a0d74e2328e4bcac => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:25.180072 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f436c-1fe7-45fa-a0ba-d2e84cbae06a tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:25.181906 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7d9f436c-1fe7-45fa-a0ba-d2e84cbae06a tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:25.296682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f436c-1fe7-45fa-a0ba-d2e84cbae06a tempest-ListProjectsStaticTestJSON-1699295633 tempest-ListProjectsStaticTestJSON-1699295633-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:25.405488 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261cc9d6-f292-4618-bd30-33b2235371f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:25.407688 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261cc9d6-f292-4618-bd30-33b2235371f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:25.408207 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261cc9d6-f292-4618-bd30-33b2235371f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:25.408708 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261cc9d6-f292-4618-bd30-33b2235371f4 admin admin] PATH_INFO: `/v3/users/5e3fdd1a926943968d0d9cd4656cb35e` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:25.412344 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261cc9d6-f292-4618-bd30-33b2235371f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e3fdd1a926943968d0d9cd4656cb35e)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:25.414386 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261cc9d6-f292-4618-bd30-33b2235371f4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:25.733623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-261cc9d6-f292-4618-bd30-33b2235371f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e3fdd1a926943968d0d9cd4656cb35e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:25.750647 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-261cc9d6-f292-4618-bd30-33b2235371f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e3fdd1a926943968d0d9cd4656cb35e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:25.812962 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-261cc9d6-f292-4618-bd30-33b2235371f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e3fdd1a926943968d0d9cd4656cb35e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:25.816853 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-261cc9d6-f292-4618-bd30-33b2235371f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e3fdd1a926943968d0d9cd4656cb35e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:25.831435 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-261cc9d6-f292-4618-bd30-33b2235371f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e3fdd1a926943968d0d9cd4656cb35e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:25.844442 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3208/6442] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:33:25 2022] DELETE /identity/v3/users/5e3fdd1a926943968d0d9cd4656cb35e => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:25.849374 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0daf02-fb4d-4fb0-b280-c130b6bd2212 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:25.850287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0daf02-fb4d-4fb0-b280-c130b6bd2212 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:25.850910 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0daf02-fb4d-4fb0-b280-c130b6bd2212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:25.900057 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-8e0daf02-fb4d-4fb0-b280-c130b6bd2212 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:25.902926 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8e0daf02-fb4d-4fb0-b280-c130b6bd2212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:26.012150 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3235/6443] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:33:26.024440 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261cc9d6-f292-4618-bd30-33b2235371f4 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:26.026271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-261cc9d6-f292-4618-bd30-33b2235371f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:26.122598 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261cc9d6-f292-4618-bd30-33b2235371f4 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:26.128132 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6845e02-5dea-42fc-8ec9-fd168bbdb055 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:26.129251 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6845e02-5dea-42fc-8ec9-fd168bbdb055 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:26.129704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6845e02-5dea-42fc-8ec9-fd168bbdb055 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:26.130239 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6845e02-5dea-42fc-8ec9-fd168bbdb055 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:26.147038 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6845e02-5dea-42fc-8ec9-fd168bbdb055 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:26.148683 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6845e02-5dea-42fc-8ec9-fd168bbdb055 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:26.161314 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3209/6444] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:33:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:33:27.318643 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0daf02-fb4d-4fb0-b280-c130b6bd2212 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:27.322859 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8e0daf02-fb4d-4fb0-b280-c130b6bd2212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:27.353128 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0daf02-fb4d-4fb0-b280-c130b6bd2212 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:27.363859 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777bcec-150f-436c-8b23-924c54cd8523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:27.367272 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777bcec-150f-436c-8b23-924c54cd8523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:27.367675 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777bcec-150f-436c-8b23-924c54cd8523 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:27.368060 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777bcec-150f-436c-8b23-924c54cd8523 admin admin] PATH_INFO: `/v3/projects/83eaf21051504a7e8943227646e964b7` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:27.369489 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777bcec-150f-436c-8b23-924c54cd8523 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83eaf21051504a7e8943227646e964b7)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:27.373275 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777bcec-150f-436c-8b23-924c54cd8523 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:27.507196 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2777bcec-150f-436c-8b23-924c54cd8523 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83eaf21051504a7e8943227646e964b7', 'request_id': 'req-2777bcec-150f-436c-8b23-924c54cd8523'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:27.525948 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2777bcec-150f-436c-8b23-924c54cd8523 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83eaf21051504a7e8943227646e964b7', 'request_id': 'req-2777bcec-150f-436c-8b23-924c54cd8523'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:27.550105 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2777bcec-150f-436c-8b23-924c54cd8523 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83eaf21051504a7e8943227646e964b7', 'request_id': 'req-2777bcec-150f-436c-8b23-924c54cd8523'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:27.632740 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2777bcec-150f-436c-8b23-924c54cd8523 admin admin] The token cache is being invalidate because project 83eaf21051504a7e8943227646e964b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:33:27.633246 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2777bcec-150f-436c-8b23-924c54cd8523 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:27.634180 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2777bcec-150f-436c-8b23-924c54cd8523 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:27.637281 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3236/6445] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:33:27 2022] DELETE /identity/v3/projects/83eaf21051504a7e8943227646e964b7 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:27.641673 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6845e02-5dea-42fc-8ec9-fd168bbdb055 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:27.654284 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6845e02-5dea-42fc-8ec9-fd168bbdb055 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:27.767714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9789e85-6078-497a-bacd-e8f2aeb0d22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:27.768726 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9789e85-6078-497a-bacd-e8f2aeb0d22e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:27.769080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9789e85-6078-497a-bacd-e8f2aeb0d22e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:27.769426 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9789e85-6078-497a-bacd-e8f2aeb0d22e admin admin] PATH_INFO: `/v3/users/2f896c58f5064509ba6afc2d96873b9f` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:27.770913 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9789e85-6078-497a-bacd-e8f2aeb0d22e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f896c58f5064509ba6afc2d96873b9f)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:27.773232 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9789e85-6078-497a-bacd-e8f2aeb0d22e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:28.079030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e9789e85-6078-497a-bacd-e8f2aeb0d22e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f896c58f5064509ba6afc2d96873b9f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:28.100523 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e9789e85-6078-497a-bacd-e8f2aeb0d22e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f896c58f5064509ba6afc2d96873b9f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:28.206664 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e9789e85-6078-497a-bacd-e8f2aeb0d22e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f896c58f5064509ba6afc2d96873b9f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:28.207705 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e9789e85-6078-497a-bacd-e8f2aeb0d22e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f896c58f5064509ba6afc2d96873b9f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:28.224790 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e9789e85-6078-497a-bacd-e8f2aeb0d22e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f896c58f5064509ba6afc2d96873b9f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:28.234654 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3210/6446] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:33:27 2022] DELETE /identity/v3/users/2f896c58f5064509ba6afc2d96873b9f => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:29.094984 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777bcec-150f-436c-8b23-924c54cd8523 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:29.097576 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2777bcec-150f-436c-8b23-924c54cd8523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:29.114189 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777bcec-150f-436c-8b23-924c54cd8523 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:29.328266 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b864b-6e21-4a0e-9b29-a5c5824359c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:29.329428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b864b-6e21-4a0e-9b29-a5c5824359c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:29.329893 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b864b-6e21-4a0e-9b29-a5c5824359c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:29.335922 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b864b-6e21-4a0e-9b29-a5c5824359c0 admin admin] PATH_INFO: `/v3/projects/4940b3033c5548d6bbfb4d93e141c01e` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:29.335922 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b864b-6e21-4a0e-9b29-a5c5824359c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4940b3033c5548d6bbfb4d93e141c01e)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:29.341211 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b864b-6e21-4a0e-9b29-a5c5824359c0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:29.495647 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cd1b864b-6e21-4a0e-9b29-a5c5824359c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4940b3033c5548d6bbfb4d93e141c01e', 'request_id': 'req-cd1b864b-6e21-4a0e-9b29-a5c5824359c0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:29.501528 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cd1b864b-6e21-4a0e-9b29-a5c5824359c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4940b3033c5548d6bbfb4d93e141c01e', 'request_id': 'req-cd1b864b-6e21-4a0e-9b29-a5c5824359c0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:29.508383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cd1b864b-6e21-4a0e-9b29-a5c5824359c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4940b3033c5548d6bbfb4d93e141c01e', 'request_id': 'req-cd1b864b-6e21-4a0e-9b29-a5c5824359c0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:29.613049 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cd1b864b-6e21-4a0e-9b29-a5c5824359c0 admin admin] The token cache is being invalidate because project 4940b3033c5548d6bbfb4d93e141c01e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:33:29.613609 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cd1b864b-6e21-4a0e-9b29-a5c5824359c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:29.614732 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cd1b864b-6e21-4a0e-9b29-a5c5824359c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:29.621476 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3237/6447] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:33:29 2022] DELETE /identity/v3/projects/4940b3033c5548d6bbfb4d93e141c01e => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:29.623723 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2984698-45dd-4443-ad12-f061e293c8b6 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:29.624183 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2984698-45dd-4443-ad12-f061e293c8b6 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:29.624506 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2984698-45dd-4443-ad12-f061e293c8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:29.653548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-f2984698-45dd-4443-ad12-f061e293c8b6 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:29.655163 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f2984698-45dd-4443-ad12-f061e293c8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:29.788827 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3211/6448] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:33:29.796750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3082d2-ac2a-4f60-aecb-6933350f7556 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:29.796750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3082d2-ac2a-4f60-aecb-6933350f7556 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:29.796750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3082d2-ac2a-4f60-aecb-6933350f7556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:29.833137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-ab3082d2-ac2a-4f60-aecb-6933350f7556 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:29.834605 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ab3082d2-ac2a-4f60-aecb-6933350f7556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:29.845123 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3238/6449] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:33:29.849977 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2984698-45dd-4443-ad12-f061e293c8b6 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:29.863519 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2984698-45dd-4443-ad12-f061e293c8b6 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:29.873007 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55d35f-be1c-46a1-a6ef-8d318d469e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:29.873819 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55d35f-be1c-46a1-a6ef-8d318d469e0c admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:29.874117 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55d35f-be1c-46a1-a6ef-8d318d469e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:29.874822 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55d35f-be1c-46a1-a6ef-8d318d469e0c admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:29.876352 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a55d35f-be1c-46a1-a6ef-8d318d469e0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:33:29.876678 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a55d35f-be1c-46a1-a6ef-8d318d469e0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:29.880514 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a55d35f-be1c-46a1-a6ef-8d318d469e0c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:29.897859 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3212/6450] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:33:29.901860 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3082d2-ac2a-4f60-aecb-6933350f7556 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:29.919494 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3082d2-ac2a-4f60-aecb-6933350f7556 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:29.925522 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36155b98-9b2f-406b-b363-8ced466b60d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:29.926551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36155b98-9b2f-406b-b363-8ced466b60d4 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:29.927003 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36155b98-9b2f-406b-b363-8ced466b60d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:29.927465 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36155b98-9b2f-406b-b363-8ced466b60d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:29.928317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36155b98-9b2f-406b-b363-8ced466b60d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:29.930919 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36155b98-9b2f-406b-b363-8ced466b60d4 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:30.012464 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3239/6451] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:33:29 2022] POST /identity/v3/projects => generated 365 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:33:30.013820 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55d35f-be1c-46a1-a6ef-8d318d469e0c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:30.030078 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55d35f-be1c-46a1-a6ef-8d318d469e0c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:30.186159 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c923a-bbf1-4247-823f-4153f7f2b646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:30.186865 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c923a-bbf1-4247-823f-4153f7f2b646 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:30.187156 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c923a-bbf1-4247-823f-4153f7f2b646 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:30.187490 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c923a-bbf1-4247-823f-4153f7f2b646 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:30.188165 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c923a-bbf1-4247-823f-4153f7f2b646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:30.190425 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c923a-bbf1-4247-823f-4153f7f2b646 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:30.390308 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3213/6452] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:33:30 2022] POST /identity/v3/users => generated 283 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:33:30.394540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36155b98-9b2f-406b-b363-8ced466b60d4 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:30.412886 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36155b98-9b2f-406b-b363-8ced466b60d4 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:30.430933 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd7921-dbf3-48d8-8124-9219cb15bbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:30.435829 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd7921-dbf3-48d8-8124-9219cb15bbdf admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:30.435829 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd7921-dbf3-48d8-8124-9219cb15bbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:30.435829 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd7921-dbf3-48d8-8124-9219cb15bbdf admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:30.435829 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd7921-dbf3-48d8-8124-9219cb15bbdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:30.435829 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd7921-dbf3-48d8-8124-9219cb15bbdf admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:30.459611 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3240/6453] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:33:30.460167 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c923a-bbf1-4247-823f-4153f7f2b646 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:30.487296 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c923a-bbf1-4247-823f-4153f7f2b646 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:30.497816 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfbd158-b8eb-4f77-9d10-7ed67e9dbc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:30.498613 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbd158-b8eb-4f77-9d10-7ed67e9dbc4c admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:30.498977 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbd158-b8eb-4f77-9d10-7ed67e9dbc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:30.499339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbd158-b8eb-4f77-9d10-7ed67e9dbc4c admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:30.500156 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfbd158-b8eb-4f77-9d10-7ed67e9dbc4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:30.501979 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfbd158-b8eb-4f77-9d10-7ed67e9dbc4c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:30.534061 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd7921-dbf3-48d8-8124-9219cb15bbdf admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:30.543574 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3214/6454] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:33:30.547259 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd7921-dbf3-48d8-8124-9219cb15bbdf admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:30.553695 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a6ac6-c527-4e06-8fde-c4338e8edc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:30.569041 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a6ac6-c527-4e06-8fde-c4338e8edc86 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:30.569041 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a6ac6-c527-4e06-8fde-c4338e8edc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:30.569041 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a6ac6-c527-4e06-8fde-c4338e8edc86 admin admin] PATH_INFO: `/v3/projects/82e9b019378a4c62b265b226722e07cc/users/f5c3795c1b90478f9f105f0ff700f93c/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:30.577655 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a6ac6-c527-4e06-8fde-c4338e8edc86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82e9b019378a4c62b265b226722e07cc, user_id=f5c3795c1b90478f9f105f0ff700f93c, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:30.582458 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a6ac6-c527-4e06-8fde-c4338e8edc86 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:30.675963 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3241/6455] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:33:30 2022] PUT /identity/v3/projects/82e9b019378a4c62b265b226722e07cc/users/f5c3795c1b90478f9f105f0ff700f93c/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:30.687936 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c15d18-d2b1-4cc2-8e42-9468c87ee603 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:30.688428 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c15d18-d2b1-4cc2-8e42-9468c87ee603 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:30.688511 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c15d18-d2b1-4cc2-8e42-9468c87ee603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:30.732326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-05c15d18-d2b1-4cc2-8e42-9468c87ee603 None None] MFA Rules not processed for user `f5c3795c1b90478f9f105f0ff700f93c`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:30.734592 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-05c15d18-d2b1-4cc2-8e42-9468c87ee603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:30.839786 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3215/6456] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:30 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:33:30.846051 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a6ac6-c527-4e06-8fde-c4338e8edc86 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:31.008905 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a6ac6-c527-4e06-8fde-c4338e8edc86 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:31.020263 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53769fa4-1039-426b-b668-443e65b0b068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:31.020945 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53769fa4-1039-426b-b668-443e65b0b068 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:31.024550 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53769fa4-1039-426b-b668-443e65b0b068 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:31.024550 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53769fa4-1039-426b-b668-443e65b0b068 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:31.024550 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53769fa4-1039-426b-b668-443e65b0b068 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:31.027857 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53769fa4-1039-426b-b668-443e65b0b068 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:31.153553 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3242/6457] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:33:30 2022] POST /identity/v3/projects => generated 365 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:33:31.155348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c15d18-d2b1-4cc2-8e42-9468c87ee603 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:31.173667 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c15d18-d2b1-4cc2-8e42-9468c87ee603 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:31.302674 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54772a20-d376-4c2b-8603-0927826b9b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:31.303507 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54772a20-d376-4c2b-8603-0927826b9b7a admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:31.303906 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54772a20-d376-4c2b-8603-0927826b9b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:31.304270 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54772a20-d376-4c2b-8603-0927826b9b7a admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:31.305077 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54772a20-d376-4c2b-8603-0927826b9b7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:31.307599 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54772a20-d376-4c2b-8603-0927826b9b7a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:31.463725 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3216/6458] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:33:31 2022] POST /identity/v3/users => generated 289 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:33:31.468562 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53769fa4-1039-426b-b668-443e65b0b068 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:31.483710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53769fa4-1039-426b-b668-443e65b0b068 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:31.489547 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80736e2-e1dc-49e9-ae84-1eb04484005d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:31.491086 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80736e2-e1dc-49e9-ae84-1eb04484005d admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:31.491594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80736e2-e1dc-49e9-ae84-1eb04484005d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:31.492094 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80736e2-e1dc-49e9-ae84-1eb04484005d admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:31.493075 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80736e2-e1dc-49e9-ae84-1eb04484005d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:31.495054 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80736e2-e1dc-49e9-ae84-1eb04484005d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:31.516116 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3243/6459] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:33:31.521180 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54772a20-d376-4c2b-8603-0927826b9b7a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:31.535876 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54772a20-d376-4c2b-8603-0927826b9b7a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:31.540997 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac5d9f-bd0b-47b5-8d2a-8e5f396f8abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:31.547886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac5d9f-bd0b-47b5-8d2a-8e5f396f8abe admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:31.547886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac5d9f-bd0b-47b5-8d2a-8e5f396f8abe admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:31.547886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac5d9f-bd0b-47b5-8d2a-8e5f396f8abe admin admin] PATH_INFO: `/v3/projects/ba65a239dd3040139ff864c26e0ab388/users/8b2fca9bb98141ecb609f52137f91e96/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:31.580885 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac5d9f-bd0b-47b5-8d2a-8e5f396f8abe admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba65a239dd3040139ff864c26e0ab388, user_id=8b2fca9bb98141ecb609f52137f91e96, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:31.585080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac5d9f-bd0b-47b5-8d2a-8e5f396f8abe admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:31.702650 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3217/6460] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:33:31 2022] PUT /identity/v3/projects/ba65a239dd3040139ff864c26e0ab388/users/8b2fca9bb98141ecb609f52137f91e96/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:33:31.706946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80736e2-e1dc-49e9-ae84-1eb04484005d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:31.724246 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80736e2-e1dc-49e9-ae84-1eb04484005d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:31.821502 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481eadc-4624-40b2-9060-9e03f9a0ffa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:31.822283 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481eadc-4624-40b2-9060-9e03f9a0ffa4 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:31.822571 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481eadc-4624-40b2-9060-9e03f9a0ffa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:31.825327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481eadc-4624-40b2-9060-9e03f9a0ffa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:31.826317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0481eadc-4624-40b2-9060-9e03f9a0ffa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:31.828408 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0481eadc-4624-40b2-9060-9e03f9a0ffa4 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:31.878123 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac5d9f-bd0b-47b5-8d2a-8e5f396f8abe admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:31.879259 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3244/6461] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:33:31.912348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac5d9f-bd0b-47b5-8d2a-8e5f396f8abe admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:31.924796 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8d7bd-c7b7-4198-be22-c6600a2fcf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:31.933270 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8d7bd-c7b7-4198-be22-c6600a2fcf71 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:31.933270 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8d7bd-c7b7-4198-be22-c6600a2fcf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:31.933270 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8d7bd-c7b7-4198-be22-c6600a2fcf71 admin admin] PATH_INFO: `/v3/projects/ba65a239dd3040139ff864c26e0ab388/users/8b2fca9bb98141ecb609f52137f91e96/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:31.940644 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff8d7bd-c7b7-4198-be22-c6600a2fcf71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba65a239dd3040139ff864c26e0ab388, user_id=8b2fca9bb98141ecb609f52137f91e96, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:31.954167 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff8d7bd-c7b7-4198-be22-c6600a2fcf71 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:31.992429 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3218/6462] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:33:31 2022] PUT /identity/v3/projects/ba65a239dd3040139ff864c26e0ab388/users/8b2fca9bb98141ecb609f52137f91e96/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:32.010134 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524bd49-c10d-4278-ba70-d53d42d4edd3 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:32.010134 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524bd49-c10d-4278-ba70-d53d42d4edd3 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:32.011724 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524bd49-c10d-4278-ba70-d53d42d4edd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:32.062081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-5524bd49-c10d-4278-ba70-d53d42d4edd3 None None] MFA Rules not processed for user `8b2fca9bb98141ecb609f52137f91e96`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:32.067942 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5524bd49-c10d-4278-ba70-d53d42d4edd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:32.209375 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3245/6463] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:32 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:33:32.215404 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8d7bd-c7b7-4198-be22-c6600a2fcf71 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:32.250166 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8d7bd-c7b7-4198-be22-c6600a2fcf71 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:32.261222 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07305097-03e0-4f46-aef3-704004579d17 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2fca9bb98141ecb609f52137f91e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba65a239dd3040139ff864c26e0ab388', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:32.261222 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07305097-03e0-4f46-aef3-704004579d17 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:32.261222 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07305097-03e0-4f46-aef3-704004579d17 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:32.261625 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07305097-03e0-4f46-aef3-704004579d17 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:32.263133 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07305097-03e0-4f46-aef3-704004579d17 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:32.264917 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07305097-03e0-4f46-aef3-704004579d17 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:32.405032 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3219/6464] 10.222.0.23 () {60 vars in 1148 bytes} [Sat Apr 30 21:33:32 2022] POST /identity/v3/domains => generated 275 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:33:32.409261 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524bd49-c10d-4278-ba70-d53d42d4edd3 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:32.420678 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524bd49-c10d-4278-ba70-d53d42d4edd3 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:32.485229 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca2b81-704d-40ae-ab1d-6d5f22335151 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2fca9bb98141ecb609f52137f91e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba65a239dd3040139ff864c26e0ab388', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:32.486840 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca2b81-704d-40ae-ab1d-6d5f22335151 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:32.487099 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca2b81-704d-40ae-ab1d-6d5f22335151 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:32.487380 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca2b81-704d-40ae-ab1d-6d5f22335151 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:32.489198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca2b81-704d-40ae-ab1d-6d5f22335151 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:32.492612 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca2b81-704d-40ae-ab1d-6d5f22335151 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:32.602221 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3246/6465] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:33:32 2022] POST /identity/v3/users => generated 347 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:33:32.603867 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07305097-03e0-4f46-aef3-704004579d17 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:32.619109 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07305097-03e0-4f46-aef3-704004579d17 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:32.630348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693672f-a16d-431f-93df-27bc8b3f55f4 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2fca9bb98141ecb609f52137f91e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba65a239dd3040139ff864c26e0ab388', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:32.641384 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693672f-a16d-431f-93df-27bc8b3f55f4 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:32.641384 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693672f-a16d-431f-93df-27bc8b3f55f4 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:32.641384 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693672f-a16d-431f-93df-27bc8b3f55f4 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:32.641384 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5693672f-a16d-431f-93df-27bc8b3f55f4 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:32.641384 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5693672f-a16d-431f-93df-27bc8b3f55f4 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:32.789536 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3220/6466] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:33:32 2022] POST /identity/v3/users => generated 324 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:33:32.793300 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca2b81-704d-40ae-ab1d-6d5f22335151 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:32.815945 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca2b81-704d-40ae-ab1d-6d5f22335151 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:32.827833 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ee706-c05a-4e12-b3cf-bd16b8b545fa tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2fca9bb98141ecb609f52137f91e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba65a239dd3040139ff864c26e0ab388', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:32.828750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ee706-c05a-4e12-b3cf-bd16b8b545fa tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:32.829037 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ee706-c05a-4e12-b3cf-bd16b8b545fa tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:32.829501 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ee706-c05a-4e12-b3cf-bd16b8b545fa tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] PATH_INFO: `/v3/users/d9345bc80f6d478c8da64951d65f07ea` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:32.871411 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ee706-c05a-4e12-b3cf-bd16b8b545fa tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] RBAC: Authorizing `identity:get_user(user_id=d9345bc80f6d478c8da64951d65f07ea)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:32.877300 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ee706-c05a-4e12-b3cf-bd16b8b545fa tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:32.887369 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3247/6467] 10.222.0.23 () {58 vars in 1220 bytes} [Sat Apr 30 21:33:32 2022] GET /identity/v3/users/d9345bc80f6d478c8da64951d65f07ea => generated 347 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:33:32.888198 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693672f-a16d-431f-93df-27bc8b3f55f4 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:32.910182 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693672f-a16d-431f-93df-27bc8b3f55f4 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:32.935030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0e3c2-895e-4ee3-93b4-44623ac18a33 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2fca9bb98141ecb609f52137f91e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba65a239dd3040139ff864c26e0ab388', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:32.936552 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0e3c2-895e-4ee3-93b4-44623ac18a33 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:32.937018 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0e3c2-895e-4ee3-93b4-44623ac18a33 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:32.937481 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0e3c2-895e-4ee3-93b4-44623ac18a33 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:32.944053 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0e3c2-895e-4ee3-93b4-44623ac18a33 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] RBAC: Adding query filter params (domain_id=a45e6830185b4b6eb783dcddf0eb0451) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:33:32.944758 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0e3c2-895e-4ee3-93b4-44623ac18a33 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:32.947068 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0e3c2-895e-4ee3-93b4-44623ac18a33 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:33.003901 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3221/6468] 10.222.0.23 () {58 vars in 1206 bytes} [Sat Apr 30 21:33:32 2022] GET /identity/v3/users?domain_id=a45e6830185b4b6eb783dcddf0eb0451 => generated 484 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:33:33.009302 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ee706-c05a-4e12-b3cf-bd16b8b545fa tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:33.023619 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ee706-c05a-4e12-b3cf-bd16b8b545fa tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:33.042799 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e8bbd-aa12-458b-96d4-776ebdb5e64e tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2fca9bb98141ecb609f52137f91e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba65a239dd3040139ff864c26e0ab388', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:33.044070 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e8bbd-aa12-458b-96d4-776ebdb5e64e tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:33.044369 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e8bbd-aa12-458b-96d4-776ebdb5e64e tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:33.044657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e8bbd-aa12-458b-96d4-776ebdb5e64e tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:33.045445 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e8bbd-aa12-458b-96d4-776ebdb5e64e tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:33.063148 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e8bbd-aa12-458b-96d4-776ebdb5e64e tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:33.151022 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3248/6469] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:33:33 2022] GET /identity/v3/users => generated 8289 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:33:33.151343 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0e3c2-895e-4ee3-93b4-44623ac18a33 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:33.166313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0e3c2-895e-4ee3-93b4-44623ac18a33 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:33.172767 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ce4cb-4023-4b07-ade4-ad2f5c168103 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2fca9bb98141ecb609f52137f91e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba65a239dd3040139ff864c26e0ab388', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:33.173471 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ce4cb-4023-4b07-ade4-ad2f5c168103 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:33.173833 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ce4cb-4023-4b07-ade4-ad2f5c168103 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:33.174102 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ce4cb-4023-4b07-ade4-ad2f5c168103 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:33.174937 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9ce4cb-4023-4b07-ade4-ad2f5c168103 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] RBAC: Adding query filter params (name=tempest-test_user-997137024) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:33:33.175419 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9ce4cb-4023-4b07-ade4-ad2f5c168103 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:33.177928 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9ce4cb-4023-4b07-ade4-ad2f5c168103 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:33.237386 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3222/6470] 10.222.0.23 () {58 vars in 1186 bytes} [Sat Apr 30 21:33:33 2022] GET /identity/v3/users?name=tempest-test_user-997137024 => generated 474 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:33:33.242977 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e8bbd-aa12-458b-96d4-776ebdb5e64e tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:33.259636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e8bbd-aa12-458b-96d4-776ebdb5e64e tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:33.267247 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa07487a-b85b-413e-9772-eaf41a227273 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2fca9bb98141ecb609f52137f91e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba65a239dd3040139ff864c26e0ab388', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:33.267467 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07487a-b85b-413e-9772-eaf41a227273 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:33.267644 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07487a-b85b-413e-9772-eaf41a227273 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:33.267953 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07487a-b85b-413e-9772-eaf41a227273 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:33.268716 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa07487a-b85b-413e-9772-eaf41a227273 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:33:33.269032 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa07487a-b85b-413e-9772-eaf41a227273 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:33.271140 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa07487a-b85b-413e-9772-eaf41a227273 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:33.333397 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ce4cb-4023-4b07-ade4-ad2f5c168103 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:33.347329 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3249/6471] 10.222.0.23 () {58 vars in 1148 bytes} [Sat Apr 30 21:33:33 2022] GET /identity/v3/users?enabled=False => generated 432 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:33:33.348465 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ce4cb-4023-4b07-ade4-ad2f5c168103 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:33.366464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19217d3c-a148-4ca9-bfcf-65783d1dab79 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2fca9bb98141ecb609f52137f91e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba65a239dd3040139ff864c26e0ab388', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:33.367395 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19217d3c-a148-4ca9-bfcf-65783d1dab79 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:33.367688 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19217d3c-a148-4ca9-bfcf-65783d1dab79 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:33.367975 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19217d3c-a148-4ca9-bfcf-65783d1dab79 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] PATH_INFO: `/v3/users/98ac49346c9d4951b6325b1d02b3c661` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:33.403656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19217d3c-a148-4ca9-bfcf-65783d1dab79 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] RBAC: Authorizing `identity:delete_user(user_id=98ac49346c9d4951b6325b1d02b3c661)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:33.406236 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19217d3c-a148-4ca9-bfcf-65783d1dab79 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:33.673365 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-19217d3c-a148-4ca9-bfcf-65783d1dab79 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98ac49346c9d4951b6325b1d02b3c661'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:33.707497 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-19217d3c-a148-4ca9-bfcf-65783d1dab79 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98ac49346c9d4951b6325b1d02b3c661'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:33.788834 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-19217d3c-a148-4ca9-bfcf-65783d1dab79 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98ac49346c9d4951b6325b1d02b3c661'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:33.789855 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-19217d3c-a148-4ca9-bfcf-65783d1dab79 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98ac49346c9d4951b6325b1d02b3c661'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:33.802092 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-19217d3c-a148-4ca9-bfcf-65783d1dab79 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98ac49346c9d4951b6325b1d02b3c661'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:33.819224 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3223/6472] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:33:33 2022] DELETE /identity/v3/users/98ac49346c9d4951b6325b1d02b3c661 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:33:33.824014 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa07487a-b85b-413e-9772-eaf41a227273 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:33.826226 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-aa07487a-b85b-413e-9772-eaf41a227273 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:33.850343 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa07487a-b85b-413e-9772-eaf41a227273 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:33.937052 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cbc465-b48b-4059-818b-acb4458f8ed3 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2fca9bb98141ecb609f52137f91e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba65a239dd3040139ff864c26e0ab388', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:33.937992 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbc465-b48b-4059-818b-acb4458f8ed3 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:33.938340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbc465-b48b-4059-818b-acb4458f8ed3 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:33.938631 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbc465-b48b-4059-818b-acb4458f8ed3 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] PATH_INFO: `/v3/users/d9345bc80f6d478c8da64951d65f07ea` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:33.939919 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cbc465-b48b-4059-818b-acb4458f8ed3 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d9345bc80f6d478c8da64951d65f07ea)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:33.941837 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cbc465-b48b-4059-818b-acb4458f8ed3 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:34.075083 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-56cbc465-b48b-4059-818b-acb4458f8ed3 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9345bc80f6d478c8da64951d65f07ea'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:34.127311 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-56cbc465-b48b-4059-818b-acb4458f8ed3 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9345bc80f6d478c8da64951d65f07ea'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:34.233779 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-56cbc465-b48b-4059-818b-acb4458f8ed3 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9345bc80f6d478c8da64951d65f07ea'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:34.242421 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-56cbc465-b48b-4059-818b-acb4458f8ed3 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9345bc80f6d478c8da64951d65f07ea'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:34.243676 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-56cbc465-b48b-4059-818b-acb4458f8ed3 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9345bc80f6d478c8da64951d65f07ea'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:34.258358 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19217d3c-a148-4ca9-bfcf-65783d1dab79 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:34.259698 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3250/6473] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:33:33 2022] DELETE /identity/v3/users/d9345bc80f6d478c8da64951d65f07ea => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:34.294288 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19217d3c-a148-4ca9-bfcf-65783d1dab79 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:34.369279 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3997af-9f90-488a-b948-c7fffe5df1e5 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2fca9bb98141ecb609f52137f91e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba65a239dd3040139ff864c26e0ab388', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:34.370402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3997af-9f90-488a-b948-c7fffe5df1e5 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:34.371133 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3997af-9f90-488a-b948-c7fffe5df1e5 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:34.371133 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3997af-9f90-488a-b948-c7fffe5df1e5 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] PATH_INFO: `/v3/domains/a45e6830185b4b6eb783dcddf0eb0451` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:34.373034 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3997af-9f90-488a-b948-c7fffe5df1e5 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a45e6830185b4b6eb783dcddf0eb0451)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:34.375030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3997af-9f90-488a-b948-c7fffe5df1e5 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:34.407151 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-eb3997af-9f90-488a-b948-c7fffe5df1e5 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a45e6830185b4b6eb783dcddf0eb0451'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:34.408240 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-eb3997af-9f90-488a-b948-c7fffe5df1e5 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a45e6830185b4b6eb783dcddf0eb0451'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:34.521882 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-eb3997af-9f90-488a-b948-c7fffe5df1e5 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a45e6830185b4b6eb783dcddf0eb0451'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:34.523780 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-eb3997af-9f90-488a-b948-c7fffe5df1e5 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a45e6830185b4b6eb783dcddf0eb0451'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:34.532769 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cbc465-b48b-4059-818b-acb4458f8ed3 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:34.534296 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-56cbc465-b48b-4059-818b-acb4458f8ed3 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:34.544260 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3224/6474] 10.222.0.23 () {60 vars in 1248 bytes} [Sat Apr 30 21:33:34 2022] PATCH /identity/v3/domains/a45e6830185b4b6eb783dcddf0eb0451 => generated 276 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:33:34.555380 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cbc465-b48b-4059-818b-acb4458f8ed3 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:34.674783 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ccde83-816b-45f5-8146-96fa3e50dfd7 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b2fca9bb98141ecb609f52137f91e96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba65a239dd3040139ff864c26e0ab388', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:34.676680 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccde83-816b-45f5-8146-96fa3e50dfd7 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:34.678314 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccde83-816b-45f5-8146-96fa3e50dfd7 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:34.678611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccde83-816b-45f5-8146-96fa3e50dfd7 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] PATH_INFO: `/v3/domains/a45e6830185b4b6eb783dcddf0eb0451` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:34.709349 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ccde83-816b-45f5-8146-96fa3e50dfd7 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a45e6830185b4b6eb783dcddf0eb0451)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:34.712845 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ccde83-816b-45f5-8146-96fa3e50dfd7 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:34.750539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-26ccde83-816b-45f5-8146-96fa3e50dfd7 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a45e6830185b4b6eb783dcddf0eb0451'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:34.756242 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-26ccde83-816b-45f5-8146-96fa3e50dfd7 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a45e6830185b4b6eb783dcddf0eb0451'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:34.940426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-26ccde83-816b-45f5-8146-96fa3e50dfd7 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a45e6830185b4b6eb783dcddf0eb0451', 'request_id': 'req-26ccde83-816b-45f5-8146-96fa3e50dfd7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:34.958780 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-26ccde83-816b-45f5-8146-96fa3e50dfd7 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a45e6830185b4b6eb783dcddf0eb0451', 'request_id': 'req-26ccde83-816b-45f5-8146-96fa3e50dfd7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:34.980114 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-26ccde83-816b-45f5-8146-96fa3e50dfd7 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a45e6830185b4b6eb783dcddf0eb0451', 'request_id': 'req-26ccde83-816b-45f5-8146-96fa3e50dfd7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:35.070134 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-26ccde83-816b-45f5-8146-96fa3e50dfd7 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] The token cache is being invalidate because project a45e6830185b4b6eb783dcddf0eb0451 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:33:35.070972 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-26ccde83-816b-45f5-8146-96fa3e50dfd7 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:35.072049 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-26ccde83-816b-45f5-8146-96fa3e50dfd7 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:35.091603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-26ccde83-816b-45f5-8146-96fa3e50dfd7 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a45e6830185b4b6eb783dcddf0eb0451', 'request_id': 'req-26ccde83-816b-45f5-8146-96fa3e50dfd7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:35.093622 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-26ccde83-816b-45f5-8146-96fa3e50dfd7 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a45e6830185b4b6eb783dcddf0eb0451', 'request_id': 'req-26ccde83-816b-45f5-8146-96fa3e50dfd7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:35.094261 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-26ccde83-816b-45f5-8146-96fa3e50dfd7 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a45e6830185b4b6eb783dcddf0eb0451', 'request_id': 'req-26ccde83-816b-45f5-8146-96fa3e50dfd7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:35.105829 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3251/6475] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:33:34 2022] DELETE /identity/v3/domains/a45e6830185b4b6eb783dcddf0eb0451 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:35.108702 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3997af-9f90-488a-b948-c7fffe5df1e5 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:35.110428 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-eb3997af-9f90-488a-b948-c7fffe5df1e5 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:35.233987 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3997af-9f90-488a-b948-c7fffe5df1e5 tempest-UsersV3TestJSON-682673580 tempest-UsersV3TestJSON-682673580-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:35.455616 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26b804-999e-4ba0-a2ce-e0a62059411b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:35.458546 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26b804-999e-4ba0-a2ce-e0a62059411b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:35.463329 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26b804-999e-4ba0-a2ce-e0a62059411b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:35.463914 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26b804-999e-4ba0-a2ce-e0a62059411b admin admin] PATH_INFO: `/v3/users/f5c3795c1b90478f9f105f0ff700f93c` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:35.465495 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26b804-999e-4ba0-a2ce-e0a62059411b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5c3795c1b90478f9f105f0ff700f93c)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:35.467859 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26b804-999e-4ba0-a2ce-e0a62059411b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:35.754189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-9e26b804-999e-4ba0-a2ce-e0a62059411b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5c3795c1b90478f9f105f0ff700f93c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:35.809450 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-9e26b804-999e-4ba0-a2ce-e0a62059411b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5c3795c1b90478f9f105f0ff700f93c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:35.930578 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-9e26b804-999e-4ba0-a2ce-e0a62059411b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5c3795c1b90478f9f105f0ff700f93c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:35.931302 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-9e26b804-999e-4ba0-a2ce-e0a62059411b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5c3795c1b90478f9f105f0ff700f93c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:35.944687 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-9e26b804-999e-4ba0-a2ce-e0a62059411b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5c3795c1b90478f9f105f0ff700f93c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:35.961220 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3225/6476] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:33:35 2022] DELETE /identity/v3/users/f5c3795c1b90478f9f105f0ff700f93c => generated 0 bytes in 853 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:35.966176 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4c6ee-e4fa-4707-bf13-f8dca4b40449 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:35.966692 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4c6ee-e4fa-4707-bf13-f8dca4b40449 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:35.966796 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4c6ee-e4fa-4707-bf13-f8dca4b40449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:36.004085 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-aea4c6ee-e4fa-4707-bf13-f8dca4b40449 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:36.004085 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-aea4c6ee-e4fa-4707-bf13-f8dca4b40449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:36.160663 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3252/6477] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:33:36.175225 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26b804-999e-4ba0-a2ce-e0a62059411b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:36.184555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-9e26b804-999e-4ba0-a2ce-e0a62059411b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:36.362377 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26b804-999e-4ba0-a2ce-e0a62059411b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:36.370743 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a8575-b1f6-4beb-aca9-fbb5551e209d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:36.371532 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a8575-b1f6-4beb-aca9-fbb5551e209d service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:36.372229 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a8575-b1f6-4beb-aca9-fbb5551e209d service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:36.372591 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a8575-b1f6-4beb-aca9-fbb5551e209d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:36.394641 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a8575-b1f6-4beb-aca9-fbb5551e209d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:36.399417 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a8575-b1f6-4beb-aca9-fbb5551e209d service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:36.445835 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3226/6478] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:33:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:33:38.112179 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4c6ee-e4fa-4707-bf13-f8dca4b40449 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:38.114397 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-aea4c6ee-e4fa-4707-bf13-f8dca4b40449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:38.142652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4c6ee-e4fa-4707-bf13-f8dca4b40449 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:38.157495 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0ccd8-10db-4021-97d4-0e7e4a6b9f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:38.158664 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0ccd8-10db-4021-97d4-0e7e4a6b9f8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:38.159100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0ccd8-10db-4021-97d4-0e7e4a6b9f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:38.159540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0ccd8-10db-4021-97d4-0e7e4a6b9f8c admin admin] PATH_INFO: `/v3/projects/82e9b019378a4c62b265b226722e07cc` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:38.160935 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e0ccd8-10db-4021-97d4-0e7e4a6b9f8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=82e9b019378a4c62b265b226722e07cc)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:38.163265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e0ccd8-10db-4021-97d4-0e7e4a6b9f8c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:38.366169 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-94e0ccd8-10db-4021-97d4-0e7e4a6b9f8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82e9b019378a4c62b265b226722e07cc', 'request_id': 'req-94e0ccd8-10db-4021-97d4-0e7e4a6b9f8c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:38.380227 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-94e0ccd8-10db-4021-97d4-0e7e4a6b9f8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82e9b019378a4c62b265b226722e07cc', 'request_id': 'req-94e0ccd8-10db-4021-97d4-0e7e4a6b9f8c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:38.420599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-94e0ccd8-10db-4021-97d4-0e7e4a6b9f8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82e9b019378a4c62b265b226722e07cc', 'request_id': 'req-94e0ccd8-10db-4021-97d4-0e7e4a6b9f8c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:38.514049 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-94e0ccd8-10db-4021-97d4-0e7e4a6b9f8c admin admin] The token cache is being invalidate because project 82e9b019378a4c62b265b226722e07cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:33:38.514766 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-94e0ccd8-10db-4021-97d4-0e7e4a6b9f8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:38.515801 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-94e0ccd8-10db-4021-97d4-0e7e4a6b9f8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:38.518724 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3253/6479] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:33:38 2022] DELETE /identity/v3/projects/82e9b019378a4c62b265b226722e07cc => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:38.522817 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a8575-b1f6-4beb-aca9-fbb5551e209d service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:38.538702 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a8575-b1f6-4beb-aca9-fbb5551e209d service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:38.745427 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f02e3e-1cd1-4693-bb35-e124add7e500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:38.746351 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f02e3e-1cd1-4693-bb35-e124add7e500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:38.746641 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f02e3e-1cd1-4693-bb35-e124add7e500 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:38.746920 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f02e3e-1cd1-4693-bb35-e124add7e500 admin admin] PATH_INFO: `/v3/users/8b2fca9bb98141ecb609f52137f91e96` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:38.748271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f02e3e-1cd1-4693-bb35-e124add7e500 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b2fca9bb98141ecb609f52137f91e96)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:38.750263 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f02e3e-1cd1-4693-bb35-e124add7e500 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:39.020703 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-07f02e3e-1cd1-4693-bb35-e124add7e500 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b2fca9bb98141ecb609f52137f91e96'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:39.039146 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-07f02e3e-1cd1-4693-bb35-e124add7e500 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b2fca9bb98141ecb609f52137f91e96'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:39.131845 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-07f02e3e-1cd1-4693-bb35-e124add7e500 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b2fca9bb98141ecb609f52137f91e96'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:39.132809 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-07f02e3e-1cd1-4693-bb35-e124add7e500 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b2fca9bb98141ecb609f52137f91e96'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:39.152056 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-07f02e3e-1cd1-4693-bb35-e124add7e500 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b2fca9bb98141ecb609f52137f91e96'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:39.159661 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3227/6480] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:33:38 2022] DELETE /identity/v3/users/8b2fca9bb98141ecb609f52137f91e96 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:40.445902 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0ccd8-10db-4021-97d4-0e7e4a6b9f8c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:40.448058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-94e0ccd8-10db-4021-97d4-0e7e4a6b9f8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:40.470090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0ccd8-10db-4021-97d4-0e7e4a6b9f8c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:40.611447 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373b146-aac4-42ca-b2aa-5da535cec30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:40.612474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373b146-aac4-42ca-b2aa-5da535cec30c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:40.614202 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373b146-aac4-42ca-b2aa-5da535cec30c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:40.614567 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373b146-aac4-42ca-b2aa-5da535cec30c admin admin] PATH_INFO: `/v3/projects/ba65a239dd3040139ff864c26e0ab388` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:40.617288 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a373b146-aac4-42ca-b2aa-5da535cec30c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba65a239dd3040139ff864c26e0ab388)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:40.621673 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a373b146-aac4-42ca-b2aa-5da535cec30c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:40.758307 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a373b146-aac4-42ca-b2aa-5da535cec30c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba65a239dd3040139ff864c26e0ab388', 'request_id': 'req-a373b146-aac4-42ca-b2aa-5da535cec30c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:40.768363 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a373b146-aac4-42ca-b2aa-5da535cec30c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba65a239dd3040139ff864c26e0ab388', 'request_id': 'req-a373b146-aac4-42ca-b2aa-5da535cec30c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:40.777178 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a373b146-aac4-42ca-b2aa-5da535cec30c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba65a239dd3040139ff864c26e0ab388', 'request_id': 'req-a373b146-aac4-42ca-b2aa-5da535cec30c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:40.883831 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a373b146-aac4-42ca-b2aa-5da535cec30c admin admin] The token cache is being invalidate because project ba65a239dd3040139ff864c26e0ab388 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:33:40.884465 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a373b146-aac4-42ca-b2aa-5da535cec30c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:40.887340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a373b146-aac4-42ca-b2aa-5da535cec30c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:40.889647 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3254/6481] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:33:40 2022] DELETE /identity/v3/projects/ba65a239dd3040139ff864c26e0ab388 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:33:40.894958 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f657a32-b92e-417e-9d56-1a0ed0d57180 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:40.895493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f657a32-b92e-417e-9d56-1a0ed0d57180 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:40.895578 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f657a32-b92e-417e-9d56-1a0ed0d57180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:40.933722 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-4f657a32-b92e-417e-9d56-1a0ed0d57180 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:40.934993 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4f657a32-b92e-417e-9d56-1a0ed0d57180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:41.036944 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3228/6482] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:33:41.038153 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905fc72-7f11-439c-9883-18bb8df734aa None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:41.038449 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905fc72-7f11-439c-9883-18bb8df734aa None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:41.038728 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7905fc72-7f11-439c-9883-18bb8df734aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:41.095610 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-7905fc72-7f11-439c-9883-18bb8df734aa None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:41.105953 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7905fc72-7f11-439c-9883-18bb8df734aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:41.115857 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3255/6483] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:33:41.120924 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f657a32-b92e-417e-9d56-1a0ed0d57180 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:41.131129 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f657a32-b92e-417e-9d56-1a0ed0d57180 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:41.147642 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01816fde-f1a2-4df8-be45-59f249fdcb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:41.148340 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01816fde-f1a2-4df8-be45-59f249fdcb3d admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:41.148626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01816fde-f1a2-4df8-be45-59f249fdcb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:41.148911 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01816fde-f1a2-4df8-be45-59f249fdcb3d admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:41.153950 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01816fde-f1a2-4df8-be45-59f249fdcb3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:33:41.153950 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01816fde-f1a2-4df8-be45-59f249fdcb3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:41.153950 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01816fde-f1a2-4df8-be45-59f249fdcb3d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:41.177906 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3229/6484] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:33:41.183598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905fc72-7f11-439c-9883-18bb8df734aa None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:41.198181 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7905fc72-7f11-439c-9883-18bb8df734aa None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:41.208740 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cade5b-c82c-43a3-a2b7-1b5297b196ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:41.212806 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cade5b-c82c-43a3-a2b7-1b5297b196ed admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:41.213497 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cade5b-c82c-43a3-a2b7-1b5297b196ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:41.215229 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cade5b-c82c-43a3-a2b7-1b5297b196ed admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:41.216299 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cade5b-c82c-43a3-a2b7-1b5297b196ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:41.219055 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cade5b-c82c-43a3-a2b7-1b5297b196ed admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:41.313095 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3256/6485] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:33:41 2022] POST /identity/v3/projects => generated 367 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:33:41.317264 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01816fde-f1a2-4df8-be45-59f249fdcb3d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:41.331447 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01816fde-f1a2-4df8-be45-59f249fdcb3d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:41.434150 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790d62f-3159-46d7-9cba-5342c13a32c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:41.434985 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790d62f-3159-46d7-9cba-5342c13a32c5 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:41.435324 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790d62f-3159-46d7-9cba-5342c13a32c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:41.435540 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790d62f-3159-46d7-9cba-5342c13a32c5 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:41.436859 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d790d62f-3159-46d7-9cba-5342c13a32c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:41.442081 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d790d62f-3159-46d7-9cba-5342c13a32c5 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:41.534090 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3230/6486] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:33:41 2022] POST /identity/v3/users => generated 284 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:33:41.545194 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cade5b-c82c-43a3-a2b7-1b5297b196ed admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:41.561214 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cade5b-c82c-43a3-a2b7-1b5297b196ed admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:41.566989 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee3cb7-5347-4775-9a33-94dec12e1045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:41.567961 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee3cb7-5347-4775-9a33-94dec12e1045 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:41.568757 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee3cb7-5347-4775-9a33-94dec12e1045 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:41.569530 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee3cb7-5347-4775-9a33-94dec12e1045 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:41.571254 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee3cb7-5347-4775-9a33-94dec12e1045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:41.574454 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee3cb7-5347-4775-9a33-94dec12e1045 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:41.596124 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3257/6487] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:33:41.600260 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790d62f-3159-46d7-9cba-5342c13a32c5 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:41.614420 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790d62f-3159-46d7-9cba-5342c13a32c5 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:41.627648 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a5a46-48a6-4c3a-8bb3-090397866b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:41.628900 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a5a46-48a6-4c3a-8bb3-090397866b0c admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:41.628900 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a5a46-48a6-4c3a-8bb3-090397866b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:41.629279 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a5a46-48a6-4c3a-8bb3-090397866b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:41.631621 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a5a46-48a6-4c3a-8bb3-090397866b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:41.633504 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a5a46-48a6-4c3a-8bb3-090397866b0c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:41.652429 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3231/6488] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:33:41.663745 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee3cb7-5347-4775-9a33-94dec12e1045 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:41.679094 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee3cb7-5347-4775-9a33-94dec12e1045 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:41.686517 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6fbc9-478b-4861-9985-8c016141a8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:41.687851 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6fbc9-478b-4861-9985-8c016141a8c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:41.688292 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6fbc9-478b-4861-9985-8c016141a8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:41.688724 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6fbc9-478b-4861-9985-8c016141a8c7 admin admin] PATH_INFO: `/v3/projects/c72fefa5b62349d186f37e7b723b5fc6/users/8263ab31eb534e0f9b0c1b0a721c5773/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:41.716865 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e6fbc9-478b-4861-9985-8c016141a8c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c72fefa5b62349d186f37e7b723b5fc6, user_id=8263ab31eb534e0f9b0c1b0a721c5773, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:41.720178 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e6fbc9-478b-4861-9985-8c016141a8c7 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:41.825292 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3258/6489] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:33:41 2022] PUT /identity/v3/projects/c72fefa5b62349d186f37e7b723b5fc6/users/8263ab31eb534e0f9b0c1b0a721c5773/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:41.826473 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d9828-41af-435f-a9db-c28a798710a1 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:41.826677 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d9828-41af-435f-a9db-c28a798710a1 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:41.826954 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d9828-41af-435f-a9db-c28a798710a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:41.869389 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-eb4d9828-41af-435f-a9db-c28a798710a1 None None] MFA Rules not processed for user `8263ab31eb534e0f9b0c1b0a721c5773`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:41.871139 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-eb4d9828-41af-435f-a9db-c28a798710a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:41.986048 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3232/6490] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:41 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:33:41.986682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6fbc9-478b-4861-9985-8c016141a8c7 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:42.128615 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6fbc9-478b-4861-9985-8c016141a8c7 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:42.146230 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b64de-53d8-4846-a9ef-43a085e26f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:42.148325 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b64de-53d8-4846-a9ef-43a085e26f20 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:42.148734 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b64de-53d8-4846-a9ef-43a085e26f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:42.149851 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b64de-53d8-4846-a9ef-43a085e26f20 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:42.155930 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b64de-53d8-4846-a9ef-43a085e26f20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:42.156870 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b64de-53d8-4846-a9ef-43a085e26f20 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:42.278887 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3259/6491] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:33:41 2022] POST /identity/v3/projects => generated 365 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:33:42.282794 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d9828-41af-435f-a9db-c28a798710a1 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:42.298058 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d9828-41af-435f-a9db-c28a798710a1 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:42.370134 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e542b18-1e97-4060-a27b-751e021c19bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:42.374295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e542b18-1e97-4060-a27b-751e021c19bf admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:42.374295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e542b18-1e97-4060-a27b-751e021c19bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:42.374295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e542b18-1e97-4060-a27b-751e021c19bf admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:42.374295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e542b18-1e97-4060-a27b-751e021c19bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:42.374814 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e542b18-1e97-4060-a27b-751e021c19bf admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:42.470749 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3233/6492] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:33:42 2022] POST /identity/v3/users => generated 289 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:33:42.471901 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b64de-53d8-4846-a9ef-43a085e26f20 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:42.484618 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b64de-53d8-4846-a9ef-43a085e26f20 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:42.494622 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c90945-4784-4905-a2df-fbad954a3a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:42.495992 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c90945-4784-4905-a2df-fbad954a3a38 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:42.499539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c90945-4784-4905-a2df-fbad954a3a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:42.499539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c90945-4784-4905-a2df-fbad954a3a38 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:42.499539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c90945-4784-4905-a2df-fbad954a3a38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:42.499539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c90945-4784-4905-a2df-fbad954a3a38 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:42.510780 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3260/6493] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:33:42.515061 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e542b18-1e97-4060-a27b-751e021c19bf admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:42.530351 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e542b18-1e97-4060-a27b-751e021c19bf admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:42.536682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df79d8-bd70-45a6-b2f7-f640fe07031e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:42.537939 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df79d8-bd70-45a6-b2f7-f640fe07031e admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:42.538519 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df79d8-bd70-45a6-b2f7-f640fe07031e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:42.539010 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df79d8-bd70-45a6-b2f7-f640fe07031e admin admin] PATH_INFO: `/v3/projects/a31755f1e2c245378f9b0dc987394120/users/e8edf391d172412580831b03939699f4/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:42.568482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df79d8-bd70-45a6-b2f7-f640fe07031e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a31755f1e2c245378f9b0dc987394120, user_id=e8edf391d172412580831b03939699f4, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:42.571598 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df79d8-bd70-45a6-b2f7-f640fe07031e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:42.645401 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3234/6494] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:33:42 2022] PUT /identity/v3/projects/a31755f1e2c245378f9b0dc987394120/users/e8edf391d172412580831b03939699f4/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:33:42.649365 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c90945-4784-4905-a2df-fbad954a3a38 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:42.663677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c90945-4784-4905-a2df-fbad954a3a38 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:42.765399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4887ddb8-8e68-4813-a3de-07080f930b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:42.768949 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887ddb8-8e68-4813-a3de-07080f930b3b admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:42.769460 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887ddb8-8e68-4813-a3de-07080f930b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:42.769948 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887ddb8-8e68-4813-a3de-07080f930b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:42.770903 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4887ddb8-8e68-4813-a3de-07080f930b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:42.779588 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4887ddb8-8e68-4813-a3de-07080f930b3b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:42.804508 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3261/6495] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:33:42.804970 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df79d8-bd70-45a6-b2f7-f640fe07031e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:42.828061 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df79d8-bd70-45a6-b2f7-f640fe07031e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:42.843356 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ebe6db-c4e9-447b-9489-32730c6da03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:42.844486 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebe6db-c4e9-447b-9489-32730c6da03c admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:42.849121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebe6db-c4e9-447b-9489-32730c6da03c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:42.849665 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebe6db-c4e9-447b-9489-32730c6da03c admin admin] PATH_INFO: `/v3/projects/a31755f1e2c245378f9b0dc987394120/users/e8edf391d172412580831b03939699f4/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:42.856054 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ebe6db-c4e9-447b-9489-32730c6da03c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a31755f1e2c245378f9b0dc987394120, user_id=e8edf391d172412580831b03939699f4, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:42.861960 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ebe6db-c4e9-447b-9489-32730c6da03c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:42.892299 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3235/6496] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:33:42 2022] PUT /identity/v3/projects/a31755f1e2c245378f9b0dc987394120/users/e8edf391d172412580831b03939699f4/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:42.902902 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c8737-b712-48ca-88a6-b2f41ec9db0e None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:42.903189 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c8737-b712-48ca-88a6-b2f41ec9db0e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:42.903801 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51c8737-b712-48ca-88a6-b2f41ec9db0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:42.934585 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-b51c8737-b712-48ca-88a6-b2f41ec9db0e None None] MFA Rules not processed for user `e8edf391d172412580831b03939699f4`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:42.935836 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b51c8737-b712-48ca-88a6-b2f41ec9db0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:43.027490 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ebe6db-c4e9-447b-9489-32730c6da03c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:43.033291 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3262/6497] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:42 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:33:43.038987 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ebe6db-c4e9-447b-9489-32730c6da03c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:43.045368 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c05430-9aa8-440b-93f9-7379be8bf9e1 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8edf391d172412580831b03939699f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a31755f1e2c245378f9b0dc987394120', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:43.046416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c05430-9aa8-440b-93f9-7379be8bf9e1 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:43.046861 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c05430-9aa8-440b-93f9-7379be8bf9e1 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:43.047606 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c05430-9aa8-440b-93f9-7379be8bf9e1 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:43.048751 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c05430-9aa8-440b-93f9-7379be8bf9e1 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:43.051130 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c05430-9aa8-440b-93f9-7379be8bf9e1 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:43.185842 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3236/6498] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:33:43 2022] POST /identity/v3/projects => generated 360 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:33:43.190137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c8737-b712-48ca-88a6-b2f41ec9db0e None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:43.200650 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51c8737-b712-48ca-88a6-b2f41ec9db0e None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:43.268472 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e32cdd-b4db-458a-aa0c-57fbc5025163 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8edf391d172412580831b03939699f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a31755f1e2c245378f9b0dc987394120', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:43.269085 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e32cdd-b4db-458a-aa0c-57fbc5025163 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:43.269374 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e32cdd-b4db-458a-aa0c-57fbc5025163 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:43.269657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e32cdd-b4db-458a-aa0c-57fbc5025163 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:43.270598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e32cdd-b4db-458a-aa0c-57fbc5025163 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:43.272732 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e32cdd-b4db-458a-aa0c-57fbc5025163 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:43.408410 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3263/6499] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:33:43 2022] POST /identity/v3/users => generated 373 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:33:43.412676 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c05430-9aa8-440b-93f9-7379be8bf9e1 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:43.424335 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c05430-9aa8-440b-93f9-7379be8bf9e1 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:43.429549 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2537d-b891-4e22-a5c7-c7aefdd31c2c tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8edf391d172412580831b03939699f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a31755f1e2c245378f9b0dc987394120', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:43.430743 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2537d-b891-4e22-a5c7-c7aefdd31c2c tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:43.431091 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2537d-b891-4e22-a5c7-c7aefdd31c2c tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:43.431431 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2537d-b891-4e22-a5c7-c7aefdd31c2c tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] PATH_INFO: `/v3/users/8a058bc4ae9b407d8d97c1ffc5e189f8` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:43.452268 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2537d-b891-4e22-a5c7-c7aefdd31c2c tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorizing `identity:get_user(user_id=8a058bc4ae9b407d8d97c1ffc5e189f8)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:43.454681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2537d-b891-4e22-a5c7-c7aefdd31c2c tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:43.456637 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3237/6500] 10.222.0.23 () {58 vars in 1220 bytes} [Sat Apr 30 21:33:43 2022] GET /identity/v3/users/8a058bc4ae9b407d8d97c1ffc5e189f8 => generated 373 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:33:43.462046 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e32cdd-b4db-458a-aa0c-57fbc5025163 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:43.472560 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e32cdd-b4db-458a-aa0c-57fbc5025163 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:43.477544 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bee5a-59ca-4387-9786-1e2d6daf260c tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8edf391d172412580831b03939699f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a31755f1e2c245378f9b0dc987394120', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:43.478495 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bee5a-59ca-4387-9786-1e2d6daf260c tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:43.481988 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bee5a-59ca-4387-9786-1e2d6daf260c tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:43.481988 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bee5a-59ca-4387-9786-1e2d6daf260c tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] PATH_INFO: `/v3/users/8a058bc4ae9b407d8d97c1ffc5e189f8` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:43.482724 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971bee5a-59ca-4387-9786-1e2d6daf260c tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8a058bc4ae9b407d8d97c1ffc5e189f8)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:43.485927 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971bee5a-59ca-4387-9786-1e2d6daf260c tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:43.642541 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-971bee5a-59ca-4387-9786-1e2d6daf260c tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a058bc4ae9b407d8d97c1ffc5e189f8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:43.658865 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-971bee5a-59ca-4387-9786-1e2d6daf260c tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a058bc4ae9b407d8d97c1ffc5e189f8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:43.753199 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-971bee5a-59ca-4387-9786-1e2d6daf260c tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a058bc4ae9b407d8d97c1ffc5e189f8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:43.762408 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-971bee5a-59ca-4387-9786-1e2d6daf260c tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a058bc4ae9b407d8d97c1ffc5e189f8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:43.764228 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-971bee5a-59ca-4387-9786-1e2d6daf260c tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a058bc4ae9b407d8d97c1ffc5e189f8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:43.772157 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3264/6501] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:33:43 2022] DELETE /identity/v3/users/8a058bc4ae9b407d8d97c1ffc5e189f8 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:43.776597 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2537d-b891-4e22-a5c7-c7aefdd31c2c tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:43.779347 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-aea2537d-b891-4e22-a5c7-c7aefdd31c2c tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:43.792687 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2537d-b891-4e22-a5c7-c7aefdd31c2c tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:43.852128 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947be60-3f04-4d2a-a792-a6574c737049 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8edf391d172412580831b03939699f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a31755f1e2c245378f9b0dc987394120', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:43.853004 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947be60-3f04-4d2a-a792-a6574c737049 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:43.853290 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947be60-3f04-4d2a-a792-a6574c737049 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:43.853569 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947be60-3f04-4d2a-a792-a6574c737049 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] PATH_INFO: `/v3/projects/c5365b97489d4960b89a13af678895e5` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:43.855415 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947be60-3f04-4d2a-a792-a6574c737049 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c5365b97489d4960b89a13af678895e5)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:43.857885 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947be60-3f04-4d2a-a792-a6574c737049 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:44.041292 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3947be60-3f04-4d2a-a792-a6574c737049 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5365b97489d4960b89a13af678895e5', 'request_id': 'req-3947be60-3f04-4d2a-a792-a6574c737049'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:44.047789 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3947be60-3f04-4d2a-a792-a6574c737049 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5365b97489d4960b89a13af678895e5', 'request_id': 'req-3947be60-3f04-4d2a-a792-a6574c737049'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:44.057176 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3947be60-3f04-4d2a-a792-a6574c737049 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5365b97489d4960b89a13af678895e5', 'request_id': 'req-3947be60-3f04-4d2a-a792-a6574c737049'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:44.092078 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bee5a-59ca-4387-9786-1e2d6daf260c tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:44.095917 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-971bee5a-59ca-4387-9786-1e2d6daf260c tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:44.152920 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3947be60-3f04-4d2a-a792-a6574c737049 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] The token cache is being invalidate because project c5365b97489d4960b89a13af678895e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:33:44.153569 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3947be60-3f04-4d2a-a792-a6574c737049 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:44.159258 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3947be60-3f04-4d2a-a792-a6574c737049 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:44.161911 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3238/6502] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:33:43 2022] DELETE /identity/v3/projects/c5365b97489d4960b89a13af678895e5 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:44.167996 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947be60-3f04-4d2a-a792-a6574c737049 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:44.172534 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3947be60-3f04-4d2a-a792-a6574c737049 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:44.196282 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bee5a-59ca-4387-9786-1e2d6daf260c tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:44.274917 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baae800-f81a-453a-8f4a-cadb6bcc39e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:44.276770 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baae800-f81a-453a-8f4a-cadb6bcc39e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:44.277123 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baae800-f81a-453a-8f4a-cadb6bcc39e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:44.277360 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947be60-3f04-4d2a-a792-a6574c737049 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:44.277565 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baae800-f81a-453a-8f4a-cadb6bcc39e8 admin admin] PATH_INFO: `/v3/users/6cbdf51f15024f41a02160af715f8d46` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:44.284879 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baae800-f81a-453a-8f4a-cadb6bcc39e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cbdf51f15024f41a02160af715f8d46)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:44.284976 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baae800-f81a-453a-8f4a-cadb6bcc39e8 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:44.286902 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014e6a3-03ec-49b8-849b-b3b5e6b2535f tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8edf391d172412580831b03939699f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a31755f1e2c245378f9b0dc987394120', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:44.288211 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014e6a3-03ec-49b8-849b-b3b5e6b2535f tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:44.288511 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014e6a3-03ec-49b8-849b-b3b5e6b2535f tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:44.288796 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014e6a3-03ec-49b8-849b-b3b5e6b2535f tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:44.289490 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9014e6a3-03ec-49b8-849b-b3b5e6b2535f tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:44.292021 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9014e6a3-03ec-49b8-849b-b3b5e6b2535f tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:44.372446 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3239/6503] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:33:44 2022] POST /identity/v3/projects => generated 359 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:33:44.376581 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014e6a3-03ec-49b8-849b-b3b5e6b2535f tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:44.452629 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014e6a3-03ec-49b8-849b-b3b5e6b2535f tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:44.457549 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9be676-7d0d-45fc-a5be-5b2458c53b3d tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8edf391d172412580831b03939699f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a31755f1e2c245378f9b0dc987394120', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:44.458403 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9be676-7d0d-45fc-a5be-5b2458c53b3d tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:44.458700 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9be676-7d0d-45fc-a5be-5b2458c53b3d tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:44.459163 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9be676-7d0d-45fc-a5be-5b2458c53b3d tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:44.460087 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9be676-7d0d-45fc-a5be-5b2458c53b3d tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:44.462989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9be676-7d0d-45fc-a5be-5b2458c53b3d tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:44.516995 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3baae800-f81a-453a-8f4a-cadb6bcc39e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cbdf51f15024f41a02160af715f8d46'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:44.529627 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3baae800-f81a-453a-8f4a-cadb6bcc39e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cbdf51f15024f41a02160af715f8d46'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:44.590816 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3240/6504] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:33:44 2022] POST /identity/v3/users => generated 414 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:33:44.592190 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9be676-7d0d-45fc-a5be-5b2458c53b3d tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:44.606839 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9be676-7d0d-45fc-a5be-5b2458c53b3d tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:44.613548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba04b8-00a9-4ecc-be8f-f5972b24dc83 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8edf391d172412580831b03939699f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a31755f1e2c245378f9b0dc987394120', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:44.614499 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba04b8-00a9-4ecc-be8f-f5972b24dc83 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:44.614980 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba04b8-00a9-4ecc-be8f-f5972b24dc83 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:44.615533 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba04b8-00a9-4ecc-be8f-f5972b24dc83 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:44.616786 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba04b8-00a9-4ecc-be8f-f5972b24dc83 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:44.618916 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba04b8-00a9-4ecc-be8f-f5972b24dc83 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:44.622472 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3baae800-f81a-453a-8f4a-cadb6bcc39e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cbdf51f15024f41a02160af715f8d46'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:44.631350 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3baae800-f81a-453a-8f4a-cadb6bcc39e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cbdf51f15024f41a02160af715f8d46'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:44.632660 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3baae800-f81a-453a-8f4a-cadb6bcc39e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cbdf51f15024f41a02160af715f8d46'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:44.640809 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3265/6505] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:33:44 2022] DELETE /identity/v3/users/6cbdf51f15024f41a02160af715f8d46 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:33:44.647320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887a7fc-169a-43f2-be85-bcdbd6ed7600 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:44.647320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887a7fc-169a-43f2-be85-bcdbd6ed7600 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:44.647320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887a7fc-169a-43f2-be85-bcdbd6ed7600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:44.667907 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-8887a7fc-169a-43f2-be85-bcdbd6ed7600 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:44.670117 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8887a7fc-169a-43f2-be85-bcdbd6ed7600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:44.716652 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3241/6506] 10.222.0.23 () {60 vars in 1142 bytes} [Sat Apr 30 21:33:44 2022] POST /identity/v3/roles => generated 240 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:33:44.720800 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba04b8-00a9-4ecc-be8f-f5972b24dc83 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:44.725954 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-18ba04b8-00a9-4ecc-be8f-f5972b24dc83 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:44.743897 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba04b8-00a9-4ecc-be8f-f5972b24dc83 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:44.785285 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3266/6507] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:33:44.817158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887a7fc-169a-43f2-be85-bcdbd6ed7600 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:44.819283 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8887a7fc-169a-43f2-be85-bcdbd6ed7600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:44.825895 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46bbddb-3c12-403a-a5ae-6ae056c833ca tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8edf391d172412580831b03939699f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a31755f1e2c245378f9b0dc987394120', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:44.826932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46bbddb-3c12-403a-a5ae-6ae056c833ca tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:44.827464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46bbddb-3c12-403a-a5ae-6ae056c833ca tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:44.827821 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46bbddb-3c12-403a-a5ae-6ae056c833ca tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] PATH_INFO: `/v3/users/b855283b72b1450f9c771e6441c223a1` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:44.847903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46bbddb-3c12-403a-a5ae-6ae056c833ca tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorizing `identity:get_user(user_id=b855283b72b1450f9c771e6441c223a1)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:44.850434 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46bbddb-3c12-403a-a5ae-6ae056c833ca tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:44.855570 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3242/6508] 10.222.0.23 () {58 vars in 1220 bytes} [Sat Apr 30 21:33:44 2022] GET /identity/v3/users/b855283b72b1450f9c771e6441c223a1 => generated 414 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:33:44.856828 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46bbddb-3c12-403a-a5ae-6ae056c833ca tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:44.867816 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46bbddb-3c12-403a-a5ae-6ae056c833ca tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:44.873315 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d294ad-588d-41d5-834b-2bb0c3ac1592 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8edf391d172412580831b03939699f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a31755f1e2c245378f9b0dc987394120', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:44.876402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d294ad-588d-41d5-834b-2bb0c3ac1592 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:44.876402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d294ad-588d-41d5-834b-2bb0c3ac1592 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:44.876402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d294ad-588d-41d5-834b-2bb0c3ac1592 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] PATH_INFO: `/v3/roles/b99347356f7841b9a966077fe0ac8c61` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:44.876402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d294ad-588d-41d5-834b-2bb0c3ac1592 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorizing `identity:get_role(role_id=b99347356f7841b9a966077fe0ac8c61)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:44.877519 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-61d294ad-588d-41d5-834b-2bb0c3ac1592 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:33:44.877519 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:33:44.877519 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:33:44.881897 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d294ad-588d-41d5-834b-2bb0c3ac1592 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:44.881897 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3243/6509] 10.222.0.23 () {58 vars in 1220 bytes} [Sat Apr 30 21:33:44 2022] GET /identity/v3/roles/b99347356f7841b9a966077fe0ac8c61 => generated 240 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:33:44.889467 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d294ad-588d-41d5-834b-2bb0c3ac1592 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:44.903702 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d294ad-588d-41d5-834b-2bb0c3ac1592 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:44.912099 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887a7fc-169a-43f2-be85-bcdbd6ed7600 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:44.916349 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da145e-1469-4cae-a579-09565bfa3fec tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8edf391d172412580831b03939699f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a31755f1e2c245378f9b0dc987394120', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:44.917466 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da145e-1469-4cae-a579-09565bfa3fec tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:44.918031 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a8c2b-99d4-4ca7-aaea-4e24dc2c4e16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:44.918436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da145e-1469-4cae-a579-09565bfa3fec tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:44.918699 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a8c2b-99d4-4ca7-aaea-4e24dc2c4e16 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:44.918988 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a8c2b-99d4-4ca7-aaea-4e24dc2c4e16 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:44.919272 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a8c2b-99d4-4ca7-aaea-4e24dc2c4e16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:44.919581 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da145e-1469-4cae-a579-09565bfa3fec tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:44.921064 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da145e-1469-4cae-a579-09565bfa3fec tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:44.923943 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da145e-1469-4cae-a579-09565bfa3fec tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:44.931080 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3a8c2b-99d4-4ca7-aaea-4e24dc2c4e16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:44.932616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3a8c2b-99d4-4ca7-aaea-4e24dc2c4e16 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:44.946273 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3267/6510] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:33:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:33:45.042093 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3244/6511] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:33:44 2022] POST /identity/v3/projects => generated 359 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:33:45.045936 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a8c2b-99d4-4ca7-aaea-4e24dc2c4e16 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:45.058300 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a8c2b-99d4-4ca7-aaea-4e24dc2c4e16 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:45.128221 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb8350-e176-4a2c-9655-369279ddedf2 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8edf391d172412580831b03939699f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a31755f1e2c245378f9b0dc987394120', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:45.129362 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb8350-e176-4a2c-9655-369279ddedf2 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:45.130127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb8350-e176-4a2c-9655-369279ddedf2 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:45.130127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb8350-e176-4a2c-9655-369279ddedf2 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] PATH_INFO: `/v3/projects/43bf40d91e314d61b02252e8f1e1d398` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:45.132444 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb8350-e176-4a2c-9655-369279ddedf2 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorizing `identity:get_project(project_id=43bf40d91e314d61b02252e8f1e1d398)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:45.133976 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb8350-e176-4a2c-9655-369279ddedf2 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:45.139373 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3268/6512] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:33:45 2022] GET /identity/v3/projects/43bf40d91e314d61b02252e8f1e1d398 => generated 359 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:33:45.141447 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da145e-1469-4cae-a579-09565bfa3fec tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:45.153912 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da145e-1469-4cae-a579-09565bfa3fec tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:45.159341 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a258c-4021-49b2-97aa-c4da5a338d6b tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8edf391d172412580831b03939699f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a31755f1e2c245378f9b0dc987394120', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:45.160363 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a258c-4021-49b2-97aa-c4da5a338d6b tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:45.160693 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a258c-4021-49b2-97aa-c4da5a338d6b tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:45.160982 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a258c-4021-49b2-97aa-c4da5a338d6b tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] PATH_INFO: `/v3/projects/43bf40d91e314d61b02252e8f1e1d398/users/b855283b72b1450f9c771e6441c223a1/roles/b99347356f7841b9a966077fe0ac8c61` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:45.163767 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a258c-4021-49b2-97aa-c4da5a338d6b tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorizing `identity:create_grant(project_id=43bf40d91e314d61b02252e8f1e1d398, user_id=b855283b72b1450f9c771e6441c223a1, role_id=b99347356f7841b9a966077fe0ac8c61)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:45.167614 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a258c-4021-49b2-97aa-c4da5a338d6b tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:45.299467 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3245/6513] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:33:45 2022] PUT /identity/v3/projects/43bf40d91e314d61b02252e8f1e1d398/users/b855283b72b1450f9c771e6441c223a1/roles/b99347356f7841b9a966077fe0ac8c61 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:45.303824 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb8350-e176-4a2c-9655-369279ddedf2 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:45.316693 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb8350-e176-4a2c-9655-369279ddedf2 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:45.372536 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bbc99f-51df-4fe9-8eb9-0240e6013504 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8edf391d172412580831b03939699f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a31755f1e2c245378f9b0dc987394120', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:45.373212 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbc99f-51df-4fe9-8eb9-0240e6013504 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:45.373505 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbc99f-51df-4fe9-8eb9-0240e6013504 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:45.373956 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbc99f-51df-4fe9-8eb9-0240e6013504 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:45.374664 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bbc99f-51df-4fe9-8eb9-0240e6013504 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:45.376786 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bbc99f-51df-4fe9-8eb9-0240e6013504 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:45.395851 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a258c-4021-49b2-97aa-c4da5a338d6b tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:45.398513 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-cd8a258c-4021-49b2-97aa-c4da5a338d6b tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:45.479504 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a258c-4021-49b2-97aa-c4da5a338d6b tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:45.484247 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03137b5c-c6bd-40ae-9b72-f389b088fd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:45.485104 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03137b5c-c6bd-40ae-9b72-f389b088fd8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:45.485387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03137b5c-c6bd-40ae-9b72-f389b088fd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:45.485824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03137b5c-c6bd-40ae-9b72-f389b088fd8c admin admin] PATH_INFO: `/v3/projects/4dd861b3869e413a8aa1d2d6ccae518f` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:45.487017 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03137b5c-c6bd-40ae-9b72-f389b088fd8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dd861b3869e413a8aa1d2d6ccae518f)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:45.490726 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3269/6514] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:33:45 2022] POST /identity/v3/projects => generated 358 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:33:45.491537 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03137b5c-c6bd-40ae-9b72-f389b088fd8c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:45.492068 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bbc99f-51df-4fe9-8eb9-0240e6013504 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:45.557004 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bbc99f-51df-4fe9-8eb9-0240e6013504 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:45.563004 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f67c0-795d-402f-9c88-ed8157d46612 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8edf391d172412580831b03939699f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a31755f1e2c245378f9b0dc987394120', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:45.563930 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f67c0-795d-402f-9c88-ed8157d46612 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:45.564217 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f67c0-795d-402f-9c88-ed8157d46612 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:45.564494 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f67c0-795d-402f-9c88-ed8157d46612 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] PATH_INFO: `/v3/projects/eb042fa5ff5948e5993276ff6a738536` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:45.565730 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f67c0-795d-402f-9c88-ed8157d46612 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorizing `identity:get_project(project_id=eb042fa5ff5948e5993276ff6a738536)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:45.568469 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f67c0-795d-402f-9c88-ed8157d46612 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:45.570185 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3270/6515] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:33:45 2022] GET /identity/v3/projects/eb042fa5ff5948e5993276ff6a738536 => generated 358 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:33:45.574856 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f67c0-795d-402f-9c88-ed8157d46612 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:45.584984 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f67c0-795d-402f-9c88-ed8157d46612 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:45.590528 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c0ac9-153c-491d-94a5-7d5ef84586f1 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8edf391d172412580831b03939699f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a31755f1e2c245378f9b0dc987394120', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:45.591458 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c0ac9-153c-491d-94a5-7d5ef84586f1 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:45.591745 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c0ac9-153c-491d-94a5-7d5ef84586f1 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:45.592023 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c0ac9-153c-491d-94a5-7d5ef84586f1 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] PATH_INFO: `/v3/projects/eb042fa5ff5948e5993276ff6a738536/users/b855283b72b1450f9c771e6441c223a1/roles/b99347356f7841b9a966077fe0ac8c61` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:45.594456 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63c0ac9-153c-491d-94a5-7d5ef84586f1 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorizing `identity:create_grant(project_id=eb042fa5ff5948e5993276ff6a738536, user_id=b855283b72b1450f9c771e6441c223a1, role_id=b99347356f7841b9a966077fe0ac8c61)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:45.597385 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63c0ac9-153c-491d-94a5-7d5ef84586f1 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:45.719871 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3271/6516] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:33:45 2022] PUT /identity/v3/projects/eb042fa5ff5948e5993276ff6a738536/users/b855283b72b1450f9c771e6441c223a1/roles/b99347356f7841b9a966077fe0ac8c61 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:33:45.720721 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c0ac9-153c-491d-94a5-7d5ef84586f1 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:45.723284 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e63c0ac9-153c-491d-94a5-7d5ef84586f1 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:45.727709 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-03137b5c-c6bd-40ae-9b72-f389b088fd8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dd861b3869e413a8aa1d2d6ccae518f', 'request_id': 'req-03137b5c-c6bd-40ae-9b72-f389b088fd8c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:45.735195 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-03137b5c-c6bd-40ae-9b72-f389b088fd8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dd861b3869e413a8aa1d2d6ccae518f', 'request_id': 'req-03137b5c-c6bd-40ae-9b72-f389b088fd8c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:45.741844 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-03137b5c-c6bd-40ae-9b72-f389b088fd8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dd861b3869e413a8aa1d2d6ccae518f', 'request_id': 'req-03137b5c-c6bd-40ae-9b72-f389b088fd8c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:45.795392 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c0ac9-153c-491d-94a5-7d5ef84586f1 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:45.830554 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-03137b5c-c6bd-40ae-9b72-f389b088fd8c admin admin] The token cache is being invalidate because project 4dd861b3869e413a8aa1d2d6ccae518f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:33:45.830554 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-03137b5c-c6bd-40ae-9b72-f389b088fd8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:45.830554 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-03137b5c-c6bd-40ae-9b72-f389b088fd8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:45.831474 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3246/6517] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:33:45 2022] DELETE /identity/v3/projects/4dd861b3869e413a8aa1d2d6ccae518f => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:45.832291 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03137b5c-c6bd-40ae-9b72-f389b088fd8c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:45.833608 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-03137b5c-c6bd-40ae-9b72-f389b088fd8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:45.861404 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d7d53e-01bb-40a3-9dab-85efacb4a36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:45.862328 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7d53e-01bb-40a3-9dab-85efacb4a36a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:45.862618 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7d53e-01bb-40a3-9dab-85efacb4a36a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:45.862902 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7d53e-01bb-40a3-9dab-85efacb4a36a admin admin] PATH_INFO: `/v3/users/10c586b1308c4b04a0ec245d6de05a17` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:45.864148 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d7d53e-01bb-40a3-9dab-85efacb4a36a admin admin] RBAC: Authorizing `identity:delete_user(user_id=10c586b1308c4b04a0ec245d6de05a17)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:45.866347 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d7d53e-01bb-40a3-9dab-85efacb4a36a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:45.903294 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03137b5c-c6bd-40ae-9b72-f389b088fd8c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:45.908291 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a85bd-120c-40be-b929-430c6b67703a tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8edf391d172412580831b03939699f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a31755f1e2c245378f9b0dc987394120', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:45.909271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a85bd-120c-40be-b929-430c6b67703a tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:45.909563 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a85bd-120c-40be-b929-430c6b67703a tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:45.909877 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a85bd-120c-40be-b929-430c6b67703a tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] PATH_INFO: `/v3/users/b855283b72b1450f9c771e6441c223a1/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:45.911164 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1a85bd-120c-40be-b929-430c6b67703a tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=b855283b72b1450f9c771e6441c223a1)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:45.913280 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1a85bd-120c-40be-b929-430c6b67703a tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:45.954667 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3247/6518] 10.222.0.23 () {58 vars in 1247 bytes} [Sat Apr 30 21:33:45 2022] GET /identity/v3/users/b855283b72b1450f9c771e6441c223a1/projects => generated 841 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:33:45.954667 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3dbeb3-f053-42ec-80c7-1379315fe7c8 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:45.954667 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3dbeb3-f053-42ec-80c7-1379315fe7c8 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:45.954667 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3dbeb3-f053-42ec-80c7-1379315fe7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:45.971696 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-2d3dbeb3-f053-42ec-80c7-1379315fe7c8 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:45.972913 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2d3dbeb3-f053-42ec-80c7-1379315fe7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:45.981874 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3248/6519] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:33:45.982690 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3dbeb3-f053-42ec-80c7-1379315fe7c8 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:45.992900 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3dbeb3-f053-42ec-80c7-1379315fe7c8 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:45.997655 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3e2a4-7a91-4714-8ddd-0db137d8e921 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8edf391d172412580831b03939699f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a31755f1e2c245378f9b0dc987394120', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:45.998538 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3e2a4-7a91-4714-8ddd-0db137d8e921 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:45.998825 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3e2a4-7a91-4714-8ddd-0db137d8e921 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:45.999107 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3e2a4-7a91-4714-8ddd-0db137d8e921 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] PATH_INFO: `/v3/projects/eb042fa5ff5948e5993276ff6a738536` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:46.000310 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b3e2a4-7a91-4714-8ddd-0db137d8e921 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorizing `identity:delete_project(project_id=eb042fa5ff5948e5993276ff6a738536)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:46.002279 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b3e2a4-7a91-4714-8ddd-0db137d8e921 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:46.073011 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d8d7d53e-01bb-40a3-9dab-85efacb4a36a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10c586b1308c4b04a0ec245d6de05a17'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:46.092059 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d8d7d53e-01bb-40a3-9dab-85efacb4a36a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10c586b1308c4b04a0ec245d6de05a17'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:46.267094 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d8d7d53e-01bb-40a3-9dab-85efacb4a36a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10c586b1308c4b04a0ec245d6de05a17'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:46.276776 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d8d7d53e-01bb-40a3-9dab-85efacb4a36a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10c586b1308c4b04a0ec245d6de05a17'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:46.283629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d8d7d53e-01bb-40a3-9dab-85efacb4a36a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10c586b1308c4b04a0ec245d6de05a17'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:46.284696 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a2b3e2a4-7a91-4714-8ddd-0db137d8e921 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb042fa5ff5948e5993276ff6a738536', 'request_id': 'req-a2b3e2a4-7a91-4714-8ddd-0db137d8e921'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:46.291073 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3272/6520] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:33:45 2022] DELETE /identity/v3/users/10c586b1308c4b04a0ec245d6de05a17 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:46.291230 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a2b3e2a4-7a91-4714-8ddd-0db137d8e921 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb042fa5ff5948e5993276ff6a738536', 'request_id': 'req-a2b3e2a4-7a91-4714-8ddd-0db137d8e921'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:46.293096 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11ad03-2ce7-4be2-a10a-d0709ffa1a1d None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:46.293282 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11ad03-2ce7-4be2-a10a-d0709ffa1a1d None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:46.293791 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11ad03-2ce7-4be2-a10a-d0709ffa1a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:46.316601 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-be11ad03-2ce7-4be2-a10a-d0709ffa1a1d None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:46.317963 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-be11ad03-2ce7-4be2-a10a-d0709ffa1a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:46.408545 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3273/6521] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:33:46.408545 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ec326-e235-4c10-8eb1-75484d4cfaa5 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:46.408545 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ec326-e235-4c10-8eb1-75484d4cfaa5 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:46.408545 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ec326-e235-4c10-8eb1-75484d4cfaa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:46.429864 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-bc2ec326-e235-4c10-8eb1-75484d4cfaa5 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:46.431511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-bc2ec326-e235-4c10-8eb1-75484d4cfaa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:46.446054 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3274/6522] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:33:46.447012 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ec326-e235-4c10-8eb1-75484d4cfaa5 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:46.457620 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ec326-e235-4c10-8eb1-75484d4cfaa5 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:46.467492 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39426f8-bfa6-443e-bdfb-7ae03cba2e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:46.468256 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39426f8-bfa6-443e-bdfb-7ae03cba2e21 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:46.468656 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39426f8-bfa6-443e-bdfb-7ae03cba2e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:46.468817 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39426f8-bfa6-443e-bdfb-7ae03cba2e21 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:46.469778 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39426f8-bfa6-443e-bdfb-7ae03cba2e21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:33:46.469908 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39426f8-bfa6-443e-bdfb-7ae03cba2e21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:46.471516 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39426f8-bfa6-443e-bdfb-7ae03cba2e21 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:46.488879 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3275/6523] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:33:46.492075 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a2b3e2a4-7a91-4714-8ddd-0db137d8e921 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb042fa5ff5948e5993276ff6a738536', 'request_id': 'req-a2b3e2a4-7a91-4714-8ddd-0db137d8e921'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:46.492199 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39426f8-bfa6-443e-bdfb-7ae03cba2e21 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:46.492199 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d39426f8-bfa6-443e-bdfb-7ae03cba2e21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:46.549060 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39426f8-bfa6-443e-bdfb-7ae03cba2e21 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:46.553450 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9611e8-06ac-4c33-81be-0f1c725cdbdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:46.556584 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9611e8-06ac-4c33-81be-0f1c725cdbdf service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:46.556584 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9611e8-06ac-4c33-81be-0f1c725cdbdf service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:46.556584 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9611e8-06ac-4c33-81be-0f1c725cdbdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:46.564519 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9611e8-06ac-4c33-81be-0f1c725cdbdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:46.565988 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9611e8-06ac-4c33-81be-0f1c725cdbdf service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:46.576007 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3276/6524] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:33:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:33:46.576864 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9611e8-06ac-4c33-81be-0f1c725cdbdf service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:46.586557 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9611e8-06ac-4c33-81be-0f1c725cdbdf service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:46.599533 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284eb102-560c-4e24-a5b6-9dc0630edb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:46.600690 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284eb102-560c-4e24-a5b6-9dc0630edb8d admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:46.601160 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284eb102-560c-4e24-a5b6-9dc0630edb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:46.602652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284eb102-560c-4e24-a5b6-9dc0630edb8d admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:46.602652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284eb102-560c-4e24-a5b6-9dc0630edb8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:46.607481 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284eb102-560c-4e24-a5b6-9dc0630edb8d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:46.633112 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a2b3e2a4-7a91-4714-8ddd-0db137d8e921 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] The token cache is being invalidate because project eb042fa5ff5948e5993276ff6a738536 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:33:46.633460 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a2b3e2a4-7a91-4714-8ddd-0db137d8e921 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:46.634154 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a2b3e2a4-7a91-4714-8ddd-0db137d8e921 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:46.636353 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3249/6525] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:33:45 2022] DELETE /identity/v3/projects/eb042fa5ff5948e5993276ff6a738536 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:46.642626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3e2a4-7a91-4714-8ddd-0db137d8e921 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:46.644093 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a2b3e2a4-7a91-4714-8ddd-0db137d8e921 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:46.735476 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3e2a4-7a91-4714-8ddd-0db137d8e921 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:46.744150 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3277/6526] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:33:46 2022] POST /identity/v3/projects => generated 383 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:33:46.761395 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284eb102-560c-4e24-a5b6-9dc0630edb8d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:46.763352 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-284eb102-560c-4e24-a5b6-9dc0630edb8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:46.810805 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff591b-61e0-4962-b18b-37ed6507e841 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8edf391d172412580831b03939699f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a31755f1e2c245378f9b0dc987394120', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:46.812269 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff591b-61e0-4962-b18b-37ed6507e841 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:46.812269 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff591b-61e0-4962-b18b-37ed6507e841 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:46.812558 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff591b-61e0-4962-b18b-37ed6507e841 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] PATH_INFO: `/v3/projects/43bf40d91e314d61b02252e8f1e1d398` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:46.813932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff591b-61e0-4962-b18b-37ed6507e841 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorizing `identity:delete_project(project_id=43bf40d91e314d61b02252e8f1e1d398)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:46.816140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff591b-61e0-4962-b18b-37ed6507e841 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:46.839525 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284eb102-560c-4e24-a5b6-9dc0630edb8d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:46.846530 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eed72c-657d-476f-9639-22546d02286e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:46.847215 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eed72c-657d-476f-9639-22546d02286e admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:46.847500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eed72c-657d-476f-9639-22546d02286e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:46.847779 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eed72c-657d-476f-9639-22546d02286e admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:46.848527 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eed72c-657d-476f-9639-22546d02286e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:46.850926 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eed72c-657d-476f-9639-22546d02286e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:46.964198 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3278/6527] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:33:46 2022] POST /identity/v3/users => generated 292 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:33:46.964198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eed72c-657d-476f-9639-22546d02286e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:46.964689 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-96eed72c-657d-476f-9639-22546d02286e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:46.978187 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eed72c-657d-476f-9639-22546d02286e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:46.983574 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a043e23-c2bf-4462-b05c-c3c88fe9a3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:46.984543 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a043e23-c2bf-4462-b05c-c3c88fe9a3f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:46.984824 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a043e23-c2bf-4462-b05c-c3c88fe9a3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:46.985164 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a043e23-c2bf-4462-b05c-c3c88fe9a3f1 admin admin] PATH_INFO: `/v3/projects/f00f38167d4840b6b20227e3e6a057dd` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:46.986363 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a043e23-c2bf-4462-b05c-c3c88fe9a3f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f00f38167d4840b6b20227e3e6a057dd)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:46.988328 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a043e23-c2bf-4462-b05c-c3c88fe9a3f1 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:47.181856 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-faff591b-61e0-4962-b18b-37ed6507e841 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43bf40d91e314d61b02252e8f1e1d398', 'request_id': 'req-faff591b-61e0-4962-b18b-37ed6507e841'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:47.183697 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8a043e23-c2bf-4462-b05c-c3c88fe9a3f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f00f38167d4840b6b20227e3e6a057dd', 'request_id': 'req-8a043e23-c2bf-4462-b05c-c3c88fe9a3f1'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:47.187158 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-faff591b-61e0-4962-b18b-37ed6507e841 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43bf40d91e314d61b02252e8f1e1d398', 'request_id': 'req-faff591b-61e0-4962-b18b-37ed6507e841'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:47.192516 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8a043e23-c2bf-4462-b05c-c3c88fe9a3f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f00f38167d4840b6b20227e3e6a057dd', 'request_id': 'req-8a043e23-c2bf-4462-b05c-c3c88fe9a3f1'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:47.193324 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-faff591b-61e0-4962-b18b-37ed6507e841 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43bf40d91e314d61b02252e8f1e1d398', 'request_id': 'req-faff591b-61e0-4962-b18b-37ed6507e841'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:47.197351 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8a043e23-c2bf-4462-b05c-c3c88fe9a3f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f00f38167d4840b6b20227e3e6a057dd', 'request_id': 'req-8a043e23-c2bf-4462-b05c-c3c88fe9a3f1'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:47.318532 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-faff591b-61e0-4962-b18b-37ed6507e841 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] The token cache is being invalidate because project 43bf40d91e314d61b02252e8f1e1d398 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:33:47.318999 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-faff591b-61e0-4962-b18b-37ed6507e841 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:47.319519 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-faff591b-61e0-4962-b18b-37ed6507e841 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:47.321356 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3250/6528] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:33:46 2022] DELETE /identity/v3/projects/43bf40d91e314d61b02252e8f1e1d398 => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:47.321951 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff591b-61e0-4962-b18b-37ed6507e841 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:47.323373 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-faff591b-61e0-4962-b18b-37ed6507e841 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:47.388199 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff591b-61e0-4962-b18b-37ed6507e841 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:47.404871 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8a043e23-c2bf-4462-b05c-c3c88fe9a3f1 admin admin] The token cache is being invalidate because project f00f38167d4840b6b20227e3e6a057dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:33:47.405173 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8a043e23-c2bf-4462-b05c-c3c88fe9a3f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:47.406996 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8a043e23-c2bf-4462-b05c-c3c88fe9a3f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:47.409252 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3279/6529] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:33:46 2022] DELETE /identity/v3/projects/f00f38167d4840b6b20227e3e6a057dd => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:47.410065 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a043e23-c2bf-4462-b05c-c3c88fe9a3f1 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:47.411458 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8a043e23-c2bf-4462-b05c-c3c88fe9a3f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:47.469350 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d21f7-4a9b-4daf-8081-eeb6395b0214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:47.470729 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d21f7-4a9b-4daf-8081-eeb6395b0214 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:47.471027 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d21f7-4a9b-4daf-8081-eeb6395b0214 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:47.471565 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d21f7-4a9b-4daf-8081-eeb6395b0214 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:47.472385 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d21f7-4a9b-4daf-8081-eeb6395b0214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:47.474989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d21f7-4a9b-4daf-8081-eeb6395b0214 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:47.491378 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3251/6530] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:33:47 2022] GET /identity/v3/roles => generated 1651 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:33:47.493283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6542744-34cd-4fbc-ae91-11d788a2e301 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:47.493283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6542744-34cd-4fbc-ae91-11d788a2e301 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:47.493555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6542744-34cd-4fbc-ae91-11d788a2e301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:47.496586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a043e23-c2bf-4462-b05c-c3c88fe9a3f1 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:47.503222 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f27434-c176-4955-bf98-c2cec97cb761 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8edf391d172412580831b03939699f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a31755f1e2c245378f9b0dc987394120', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:47.504463 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f27434-c176-4955-bf98-c2cec97cb761 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:47.504820 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f27434-c176-4955-bf98-c2cec97cb761 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:47.505174 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f27434-c176-4955-bf98-c2cec97cb761 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] PATH_INFO: `/v3/roles/b99347356f7841b9a966077fe0ac8c61` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:47.510057 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f27434-c176-4955-bf98-c2cec97cb761 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b99347356f7841b9a966077fe0ac8c61)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:47.511815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f27434-c176-4955-bf98-c2cec97cb761 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:47.515762 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-b6542744-34cd-4fbc-ae91-11d788a2e301 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:47.517608 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b6542744-34cd-4fbc-ae91-11d788a2e301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:47.528823 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3252/6531] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:33:47.529136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6542744-34cd-4fbc-ae91-11d788a2e301 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:47.540526 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b6542744-34cd-4fbc-ae91-11d788a2e301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:47.558960 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6542744-34cd-4fbc-ae91-11d788a2e301 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:47.567512 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafeb5cf-1708-4c56-8a70-183455f70d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:47.568598 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafeb5cf-1708-4c56-8a70-183455f70d78 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:47.569070 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafeb5cf-1708-4c56-8a70-183455f70d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:47.569494 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafeb5cf-1708-4c56-8a70-183455f70d78 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:47.570752 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafeb5cf-1708-4c56-8a70-183455f70d78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:47.573355 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafeb5cf-1708-4c56-8a70-183455f70d78 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:47.588900 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3253/6532] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:33:47 2022] GET /identity/v3/roles => generated 1651 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:33:47.592841 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32fd5c-5916-4444-8f0d-057be09b86fb None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:47.593149 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32fd5c-5916-4444-8f0d-057be09b86fb None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:47.593412 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32fd5c-5916-4444-8f0d-057be09b86fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:47.612115 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-ba32fd5c-5916-4444-8f0d-057be09b86fb None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:47.613344 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ba32fd5c-5916-4444-8f0d-057be09b86fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:47.622213 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3254/6533] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:33:47.623018 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32fd5c-5916-4444-8f0d-057be09b86fb None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:47.636040 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32fd5c-5916-4444-8f0d-057be09b86fb None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:47.641221 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99480064-b061-4654-88ac-623831fd6cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:47.642466 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99480064-b061-4654-88ac-623831fd6cc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:47.642907 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99480064-b061-4654-88ac-623831fd6cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:47.643360 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99480064-b061-4654-88ac-623831fd6cc3 admin admin] PATH_INFO: `/v3/projects/8f529526273f453188e2726e72e49b08/users/6e8493acf90649d38e8432d35a4faa9e/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:47.663566 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f0f27434-c176-4955-bf98-c2cec97cb761 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invalidating the token cache because role b99347356f7841b9a966077fe0ac8c61 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:33:47.663863 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f0f27434-c176-4955-bf98-c2cec97cb761 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:47.664548 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f0f27434-c176-4955-bf98-c2cec97cb761 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:47.667013 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3280/6534] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:33:47 2022] DELETE /identity/v3/roles/b99347356f7841b9a966077fe0ac8c61 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:47.667809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f27434-c176-4955-bf98-c2cec97cb761 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:47.669540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f0f27434-c176-4955-bf98-c2cec97cb761 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:47.671952 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99480064-b061-4654-88ac-623831fd6cc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f529526273f453188e2726e72e49b08, user_id=6e8493acf90649d38e8432d35a4faa9e, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:47.674708 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99480064-b061-4654-88ac-623831fd6cc3 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:47.753326 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f27434-c176-4955-bf98-c2cec97cb761 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:47.758073 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d0e80-efd0-4794-a748-f65cc3c173cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:47.758735 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d0e80-efd0-4794-a748-f65cc3c173cc admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:47.759037 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d0e80-efd0-4794-a748-f65cc3c173cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:47.759301 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d0e80-efd0-4794-a748-f65cc3c173cc admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:47.760058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d0e80-efd0-4794-a748-f65cc3c173cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:33:47.760366 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d0e80-efd0-4794-a748-f65cc3c173cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:47.761983 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d0e80-efd0-4794-a748-f65cc3c173cc admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:47.777358 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3255/6535] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:33:47 2022] PUT /identity/v3/projects/8f529526273f453188e2726e72e49b08/users/6e8493acf90649d38e8432d35a4faa9e/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:47.777865 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3281/6536] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:33:47.779012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99480064-b061-4654-88ac-623831fd6cc3 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:47.781983 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-99480064-b061-4654-88ac-623831fd6cc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:47.787481 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d0e80-efd0-4794-a748-f65cc3c173cc admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:47.801086 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d0e80-efd0-4794-a748-f65cc3c173cc admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:47.872711 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99480064-b061-4654-88ac-623831fd6cc3 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:47.875208 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a3649-3785-41df-ad2f-07fc315e9f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:47.875886 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a3649-3785-41df-ad2f-07fc315e9f7e admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:47.876171 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a3649-3785-41df-ad2f-07fc315e9f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:47.876450 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a3649-3785-41df-ad2f-07fc315e9f7e admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:47.877353 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a3649-3785-41df-ad2f-07fc315e9f7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:47.879611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a3649-3785-41df-ad2f-07fc315e9f7e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:47.881869 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8be5b-99d0-470b-96d9-a662d8ca2cd4 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8edf391d172412580831b03939699f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a31755f1e2c245378f9b0dc987394120', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:47.883043 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8be5b-99d0-470b-96d9-a662d8ca2cd4 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:47.883424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8be5b-99d0-470b-96d9-a662d8ca2cd4 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:47.883928 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8be5b-99d0-470b-96d9-a662d8ca2cd4 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] PATH_INFO: `/v3/users/b855283b72b1450f9c771e6441c223a1` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:47.886351 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc8be5b-99d0-470b-96d9-a662d8ca2cd4 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b855283b72b1450f9c771e6441c223a1)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:47.888946 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc8be5b-99d0-470b-96d9-a662d8ca2cd4 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:47.996240 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3282/6537] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:33:47 2022] POST /identity/v3/projects => generated 393 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:33:47.998368 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd2498-6ddc-4a4c-a025-a4a62e52d87e None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:47.998368 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd2498-6ddc-4a4c-a025-a4a62e52d87e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:47.998368 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd2498-6ddc-4a4c-a025-a4a62e52d87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:48.026411 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-c3fd2498-6ddc-4a4c-a025-a4a62e52d87e None None] MFA Rules not processed for user `6e8493acf90649d38e8432d35a4faa9e`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:48.027756 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c3fd2498-6ddc-4a4c-a025-a4a62e52d87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:48.032145 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5fc8be5b-99d0-470b-96d9-a662d8ca2cd4 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b855283b72b1450f9c771e6441c223a1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:48.044340 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5fc8be5b-99d0-470b-96d9-a662d8ca2cd4 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b855283b72b1450f9c771e6441c223a1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:48.099939 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3283/6538] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:33:48.100770 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd2498-6ddc-4a4c-a025-a4a62e52d87e None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:48.125801 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5fc8be5b-99d0-470b-96d9-a662d8ca2cd4 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b855283b72b1450f9c771e6441c223a1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:48.129959 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5fc8be5b-99d0-470b-96d9-a662d8ca2cd4 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b855283b72b1450f9c771e6441c223a1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:48.135982 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5fc8be5b-99d0-470b-96d9-a662d8ca2cd4 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b855283b72b1450f9c771e6441c223a1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:48.142244 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3256/6539] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:33:47 2022] DELETE /identity/v3/users/b855283b72b1450f9c771e6441c223a1 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:48.143140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8be5b-99d0-470b-96d9-a662d8ca2cd4 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:48.144579 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5fc8be5b-99d0-470b-96d9-a662d8ca2cd4 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:48.172205 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd2498-6ddc-4a4c-a025-a4a62e52d87e None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:48.207301 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8be5b-99d0-470b-96d9-a662d8ca2cd4 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:48.211246 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf15720-9fbb-46d3-9076-fd10ef5ddcb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:48.211897 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf15720-9fbb-46d3-9076-fd10ef5ddcb5 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:48.212180 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf15720-9fbb-46d3-9076-fd10ef5ddcb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:48.212532 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf15720-9fbb-46d3-9076-fd10ef5ddcb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:48.215173 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ccf15720-9fbb-46d3-9076-fd10ef5ddcb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:48.232188 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c22941-5eed-44ed-8163-d0d75efcd34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:48.233398 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c22941-5eed-44ed-8163-d0d75efcd34d admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:48.233866 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c22941-5eed-44ed-8163-d0d75efcd34d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:48.234302 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c22941-5eed-44ed-8163-d0d75efcd34d admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:48.235181 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c22941-5eed-44ed-8163-d0d75efcd34d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:48.237346 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c22941-5eed-44ed-8163-d0d75efcd34d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:48.279388 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf15720-9fbb-46d3-9076-fd10ef5ddcb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:48.281139 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf15720-9fbb-46d3-9076-fd10ef5ddcb5 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:48.290260 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3257/6540] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:33:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:33:48.291066 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf15720-9fbb-46d3-9076-fd10ef5ddcb5 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:48.292932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ccf15720-9fbb-46d3-9076-fd10ef5ddcb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:48.326874 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3284/6541] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:33:48 2022] POST /identity/v3/users => generated 297 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:33:48.330869 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c22941-5eed-44ed-8163-d0d75efcd34d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:48.333155 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c4c22941-5eed-44ed-8163-d0d75efcd34d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:48.346908 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c22941-5eed-44ed-8163-d0d75efcd34d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:48.352228 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e5856-6687-4d1d-bafc-7ce96e1afa63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:48.352871 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e5856-6687-4d1d-bafc-7ce96e1afa63 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:48.353159 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e5856-6687-4d1d-bafc-7ce96e1afa63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:48.353439 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e5856-6687-4d1d-bafc-7ce96e1afa63 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:48.355754 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e5856-6687-4d1d-bafc-7ce96e1afa63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:48.357465 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e5856-6687-4d1d-bafc-7ce96e1afa63 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:48.370879 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf15720-9fbb-46d3-9076-fd10ef5ddcb5 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:48.375079 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3285/6542] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:33:48.376681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702403e-8f50-4b54-adf9-da9b62f568e9 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8edf391d172412580831b03939699f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a31755f1e2c245378f9b0dc987394120', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:48.377590 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702403e-8f50-4b54-adf9-da9b62f568e9 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:48.377995 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702403e-8f50-4b54-adf9-da9b62f568e9 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:48.378524 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702403e-8f50-4b54-adf9-da9b62f568e9 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] PATH_INFO: `/v3/projects/c44d1c1b4c3a4a34b61026d776902d18` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:48.379744 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b702403e-8f50-4b54-adf9-da9b62f568e9 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c44d1c1b4c3a4a34b61026d776902d18)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:48.380047 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e5856-6687-4d1d-bafc-7ce96e1afa63 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:48.382245 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b702403e-8f50-4b54-adf9-da9b62f568e9 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:48.397033 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e5856-6687-4d1d-bafc-7ce96e1afa63 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:48.408158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fe173-ab7a-4a3d-87b4-da4e18b75001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:48.410726 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fe173-ab7a-4a3d-87b4-da4e18b75001 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:48.411597 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fe173-ab7a-4a3d-87b4-da4e18b75001 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:48.412033 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fe173-ab7a-4a3d-87b4-da4e18b75001 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:48.413181 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7fe173-ab7a-4a3d-87b4-da4e18b75001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:48.416976 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7fe173-ab7a-4a3d-87b4-da4e18b75001 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:48.429459 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3286/6543] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:33:48.434143 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fe173-ab7a-4a3d-87b4-da4e18b75001 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:48.445474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fe173-ab7a-4a3d-87b4-da4e18b75001 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:48.451206 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd8545-18e2-4fbf-9571-9581a1da2737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:48.452150 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd8545-18e2-4fbf-9571-9581a1da2737 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:48.452470 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd8545-18e2-4fbf-9571-9581a1da2737 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:48.452752 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd8545-18e2-4fbf-9571-9581a1da2737 admin admin] PATH_INFO: `/v3/projects/7171c6cf76ac4e179123a5d3905d6a5c/users/299f9adca26d4506bc471e70940b10c6/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:48.468004 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acd8545-18e2-4fbf-9571-9581a1da2737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7171c6cf76ac4e179123a5d3905d6a5c, user_id=299f9adca26d4506bc471e70940b10c6, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:48.470860 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acd8545-18e2-4fbf-9571-9581a1da2737 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:48.563664 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3287/6544] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:33:48 2022] PUT /identity/v3/projects/7171c6cf76ac4e179123a5d3905d6a5c/users/299f9adca26d4506bc471e70940b10c6/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:33:48.573856 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c278c89-bdf8-4d45-9414-6a230837b431 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:48.574183 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c278c89-bdf8-4d45-9414-6a230837b431 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:48.574425 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c278c89-bdf8-4d45-9414-6a230837b431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:48.586190 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b702403e-8f50-4b54-adf9-da9b62f568e9 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c44d1c1b4c3a4a34b61026d776902d18', 'request_id': 'req-b702403e-8f50-4b54-adf9-da9b62f568e9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:48.594594 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b702403e-8f50-4b54-adf9-da9b62f568e9 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c44d1c1b4c3a4a34b61026d776902d18', 'request_id': 'req-b702403e-8f50-4b54-adf9-da9b62f568e9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:48.607400 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-0c278c89-bdf8-4d45-9414-6a230837b431 None None] MFA Rules not processed for user `299f9adca26d4506bc471e70940b10c6`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:48.607613 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b702403e-8f50-4b54-adf9-da9b62f568e9 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c44d1c1b4c3a4a34b61026d776902d18', 'request_id': 'req-b702403e-8f50-4b54-adf9-da9b62f568e9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:48.610875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0c278c89-bdf8-4d45-9414-6a230837b431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:48.662899 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b702403e-8f50-4b54-adf9-da9b62f568e9 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] The token cache is being invalidate because project c44d1c1b4c3a4a34b61026d776902d18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:33:48.663341 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b702403e-8f50-4b54-adf9-da9b62f568e9 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:48.668994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b702403e-8f50-4b54-adf9-da9b62f568e9 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:48.668994 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3258/6545] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:33:48 2022] DELETE /identity/v3/projects/c44d1c1b4c3a4a34b61026d776902d18 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:48.672047 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702403e-8f50-4b54-adf9-da9b62f568e9 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:48.673223 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b702403e-8f50-4b54-adf9-da9b62f568e9 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:48.693450 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3288/6546] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:33:48.710120 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c278c89-bdf8-4d45-9414-6a230837b431 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:48.712549 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0c278c89-bdf8-4d45-9414-6a230837b431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:48.749413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702403e-8f50-4b54-adf9-da9b62f568e9 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:48.754850 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e95c99-1a76-4f9e-bb55-925318e4bd95 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8edf391d172412580831b03939699f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a31755f1e2c245378f9b0dc987394120', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:48.756091 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e95c99-1a76-4f9e-bb55-925318e4bd95 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:48.756474 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e95c99-1a76-4f9e-bb55-925318e4bd95 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:48.756855 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e95c99-1a76-4f9e-bb55-925318e4bd95 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] PATH_INFO: `/v3/users/8263ab31eb534e0f9b0c1b0a721c5773` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:48.758860 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e95c99-1a76-4f9e-bb55-925318e4bd95 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorizing `identity:update_user(user_id=8263ab31eb534e0f9b0c1b0a721c5773)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:48.760783 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-55e95c99-1a76-4f9e-bb55-925318e4bd95 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 30 21:33:48.760783 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 21:33:48.760783 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 21:33:48.762385 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e95c99-1a76-4f9e-bb55-925318e4bd95 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:48.791443 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c278c89-bdf8-4d45-9414-6a230837b431 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:48.795906 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f3bed-bd20-4102-92be-f271c14ca21b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:48.796628 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f3bed-bd20-4102-92be-f271c14ca21b service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:48.796999 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f3bed-bd20-4102-92be-f271c14ca21b service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:48.797346 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f3bed-bd20-4102-92be-f271c14ca21b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:48.808364 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f3bed-bd20-4102-92be-f271c14ca21b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:48.810012 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f3bed-bd20-4102-92be-f271c14ca21b service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:48.820025 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3289/6547] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:33:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:33:48.848207 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-55e95c99-1a76-4f9e-bb55-925318e4bd95 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '8263ab31eb534e0f9b0c1b0a721c5773'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:48.920426 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-55e95c99-1a76-4f9e-bb55-925318e4bd95 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invalidating the token cache because user 8263ab31eb534e0f9b0c1b0a721c5773 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:33:48.920734 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-55e95c99-1a76-4f9e-bb55-925318e4bd95 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:48.924662 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-55e95c99-1a76-4f9e-bb55-925318e4bd95 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:48.924662 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3259/6548] 10.222.0.23 () {60 vars in 1242 bytes} [Sat Apr 30 21:33:48 2022] PATCH /identity/v3/users/8263ab31eb534e0f9b0c1b0a721c5773 => generated 297 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:33:48.928238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0e6e4-07f5-45a2-a04c-00b660a0b044 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:48.928714 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0e6e4-07f5-45a2-a04c-00b660a0b044 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:48.928991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0e6e4-07f5-45a2-a04c-00b660a0b044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:48.977463 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-08a0e6e4-07f5-45a2-a04c-00b660a0b044 None None] MFA Rules not processed for user `8263ab31eb534e0f9b0c1b0a721c5773`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:48.977463 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-08a0e6e4-07f5-45a2-a04c-00b660a0b044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:48.984194 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3290/6549] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:48 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 21:33:48.990413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e95c99-1a76-4f9e-bb55-925318e4bd95 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:48.990413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-55e95c99-1a76-4f9e-bb55-925318e4bd95 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:49.005875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e95c99-1a76-4f9e-bb55-925318e4bd95 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:49.015989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e9cf4b-19f6-4140-a72e-33ade45a8acd tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8edf391d172412580831b03939699f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a31755f1e2c245378f9b0dc987394120', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:49.018844 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9cf4b-19f6-4140-a72e-33ade45a8acd tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:49.019381 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9cf4b-19f6-4140-a72e-33ade45a8acd tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:49.020034 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9cf4b-19f6-4140-a72e-33ade45a8acd tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] PATH_INFO: `/v3/users/8263ab31eb534e0f9b0c1b0a721c5773` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:49.022876 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e9cf4b-19f6-4140-a72e-33ade45a8acd tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorizing `identity:update_user(user_id=8263ab31eb534e0f9b0c1b0a721c5773)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:49.026012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e9cf4b-19f6-4140-a72e-33ade45a8acd tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:49.127674 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a7e9cf4b-19f6-4140-a72e-33ade45a8acd tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '8263ab31eb534e0f9b0c1b0a721c5773'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:49.227674 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a7e9cf4b-19f6-4140-a72e-33ade45a8acd tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invalidating the token cache because user 8263ab31eb534e0f9b0c1b0a721c5773 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:33:49.237271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a7e9cf4b-19f6-4140-a72e-33ade45a8acd tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:49.237271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a7e9cf4b-19f6-4140-a72e-33ade45a8acd tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:49.237271 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3260/6550] 10.222.0.23 () {60 vars in 1242 bytes} [Sat Apr 30 21:33:48 2022] PATCH /identity/v3/users/8263ab31eb534e0f9b0c1b0a721c5773 => generated 297 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:33:49.237558 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0e6e4-07f5-45a2-a04c-00b660a0b044 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:49.249881 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0e6e4-07f5-45a2-a04c-00b660a0b044 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:49.256329 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee1962-b329-440b-b607-1176820bda0a tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8edf391d172412580831b03939699f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a31755f1e2c245378f9b0dc987394120', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:49.256329 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee1962-b329-440b-b607-1176820bda0a tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:49.256329 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee1962-b329-440b-b607-1176820bda0a tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:49.256809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee1962-b329-440b-b607-1176820bda0a tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] PATH_INFO: `/v3/users/8263ab31eb534e0f9b0c1b0a721c5773` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:49.274871 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee1962-b329-440b-b607-1176820bda0a tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorizing `identity:update_user(user_id=8263ab31eb534e0f9b0c1b0a721c5773)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:49.277722 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee1962-b329-440b-b607-1176820bda0a tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:49.424686 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c4ee1962-b329-440b-b607-1176820bda0a tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '8263ab31eb534e0f9b0c1b0a721c5773'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:49.531052 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c4ee1962-b329-440b-b607-1176820bda0a tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invalidating the token cache because user 8263ab31eb534e0f9b0c1b0a721c5773 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:33:49.531480 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c4ee1962-b329-440b-b607-1176820bda0a tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:49.532160 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c4ee1962-b329-440b-b607-1176820bda0a tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:49.538815 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3291/6551] 10.222.0.23 () {60 vars in 1242 bytes} [Sat Apr 30 21:33:49 2022] PATCH /identity/v3/users/8263ab31eb534e0f9b0c1b0a721c5773 => generated 297 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:33:49.539486 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42df7c-7846-467a-9b8a-c0090a1da1cf None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:49.539960 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42df7c-7846-467a-9b8a-c0090a1da1cf None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:49.540069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42df7c-7846-467a-9b8a-c0090a1da1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:49.588605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-8b42df7c-7846-467a-9b8a-c0090a1da1cf None None] MFA Rules not processed for user `8263ab31eb534e0f9b0c1b0a721c5773`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:49.589871 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8b42df7c-7846-467a-9b8a-c0090a1da1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:49.594592 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3261/6552] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:49 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 21:33:49.597794 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee1962-b329-440b-b607-1176820bda0a tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:49.602166 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c4ee1962-b329-440b-b607-1176820bda0a tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:49.625692 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee1962-b329-440b-b607-1176820bda0a tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:49.632624 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6897779-4515-494c-bb76-4ef08943fe55 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8edf391d172412580831b03939699f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a31755f1e2c245378f9b0dc987394120', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:49.638036 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6897779-4515-494c-bb76-4ef08943fe55 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:49.641937 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6897779-4515-494c-bb76-4ef08943fe55 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:49.641937 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6897779-4515-494c-bb76-4ef08943fe55 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] PATH_INFO: `/v3/users/8263ab31eb534e0f9b0c1b0a721c5773` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:49.644336 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6897779-4515-494c-bb76-4ef08943fe55 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorizing `identity:update_user(user_id=8263ab31eb534e0f9b0c1b0a721c5773)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:49.649015 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6897779-4515-494c-bb76-4ef08943fe55 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:49.765239 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f6897779-4515-494c-bb76-4ef08943fe55 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '8263ab31eb534e0f9b0c1b0a721c5773'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:49.845785 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f6897779-4515-494c-bb76-4ef08943fe55 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invalidating the token cache because user 8263ab31eb534e0f9b0c1b0a721c5773 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:33:49.846332 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f6897779-4515-494c-bb76-4ef08943fe55 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:49.846557 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f6897779-4515-494c-bb76-4ef08943fe55 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:49.850393 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3292/6553] 10.222.0.23 () {60 vars in 1242 bytes} [Sat Apr 30 21:33:49 2022] PATCH /identity/v3/users/8263ab31eb534e0f9b0c1b0a721c5773 => generated 297 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:33:49.863143 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42df7c-7846-467a-9b8a-c0090a1da1cf None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:49.877353 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42df7c-7846-467a-9b8a-c0090a1da1cf None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:49.890466 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e85700-5a11-405d-a6c3-1db85a79a224 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8edf391d172412580831b03939699f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a31755f1e2c245378f9b0dc987394120', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:49.890466 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e85700-5a11-405d-a6c3-1db85a79a224 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:49.890466 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e85700-5a11-405d-a6c3-1db85a79a224 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:49.890816 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e85700-5a11-405d-a6c3-1db85a79a224 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:49.890816 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e85700-5a11-405d-a6c3-1db85a79a224 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:49.890816 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e85700-5a11-405d-a6c3-1db85a79a224 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:50.015286 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3262/6554] 10.222.0.23 () {60 vars in 1142 bytes} [Sat Apr 30 21:33:49 2022] POST /identity/v3/users => generated 265 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:33:50.019312 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6897779-4515-494c-bb76-4ef08943fe55 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:50.020849 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f6897779-4515-494c-bb76-4ef08943fe55 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:50.037128 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6897779-4515-494c-bb76-4ef08943fe55 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:50.042164 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a1ca7-2ad4-4175-8b87-2a5c0180c549 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8edf391d172412580831b03939699f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a31755f1e2c245378f9b0dc987394120', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:50.043252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a1ca7-2ad4-4175-8b87-2a5c0180c549 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:50.045257 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a1ca7-2ad4-4175-8b87-2a5c0180c549 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:50.045257 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a1ca7-2ad4-4175-8b87-2a5c0180c549 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] PATH_INFO: `/v3/users/ee802dd70f3b47349bd6c04b8896baeb/password` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:50.206914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-103a1ca7-2ad4-4175-8b87-2a5c0180c549 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'ee802dd70f3b47349bd6c04b8896baeb'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:50.333896 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3293/6555] 10.222.0.23 () {60 vars in 1268 bytes} [Sat Apr 30 21:33:50 2022] POST /identity/v3/users/ee802dd70f3b47349bd6c04b8896baeb/password => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:51.338909 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd0abf-ae45-4f6c-a405-32d8a187a16f None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:51.339368 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd0abf-ae45-4f6c-a405-32d8a187a16f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:51.340338 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fd0abf-ae45-4f6c-a405-32d8a187a16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:51.364375 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-c6fd0abf-ae45-4f6c-a405-32d8a187a16f None None] MFA Rules not processed for user `ee802dd70f3b47349bd6c04b8896baeb`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:51.365930 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c6fd0abf-ae45-4f6c-a405-32d8a187a16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:51.369463 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3263/6556] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:51 2022] POST /identity/v3/auth/tokens => generated 330 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 30 21:33:51.373498 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a1ca7-2ad4-4175-8b87-2a5c0180c549 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:51.383550 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a1ca7-2ad4-4175-8b87-2a5c0180c549 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:51.388203 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dbfcef-0d60-4f38-b8e3-bc12c4c9d27f tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8edf391d172412580831b03939699f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a31755f1e2c245378f9b0dc987394120', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:51.389055 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbfcef-0d60-4f38-b8e3-bc12c4c9d27f tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:51.389417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbfcef-0d60-4f38-b8e3-bc12c4c9d27f tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:51.389601 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dbfcef-0d60-4f38-b8e3-bc12c4c9d27f tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:51.396175 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dbfcef-0d60-4f38-b8e3-bc12c4c9d27f tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:51.410467 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dbfcef-0d60-4f38-b8e3-bc12c4c9d27f tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:51.418645 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3294/6557] 10.222.0.23 () {56 vars in 1262 bytes} [Sat Apr 30 21:33:51 2022] GET /identity/v3/auth/tokens => generated 330 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 30 21:33:51.422693 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd0abf-ae45-4f6c-a405-32d8a187a16f None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:51.438073 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fd0abf-ae45-4f6c-a405-32d8a187a16f None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:51.443781 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72738f-94d7-4c49-b41e-b8c812a3705b tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8edf391d172412580831b03939699f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a31755f1e2c245378f9b0dc987394120', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:51.445329 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72738f-94d7-4c49-b41e-b8c812a3705b tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:51.446013 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72738f-94d7-4c49-b41e-b8c812a3705b tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:51.446502 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72738f-94d7-4c49-b41e-b8c812a3705b tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] PATH_INFO: `/v3/users/ee802dd70f3b47349bd6c04b8896baeb` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:51.449243 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa72738f-94d7-4c49-b41e-b8c812a3705b tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ee802dd70f3b47349bd6c04b8896baeb)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:51.451906 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa72738f-94d7-4c49-b41e-b8c812a3705b tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:51.576729 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-fa72738f-94d7-4c49-b41e-b8c812a3705b tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee802dd70f3b47349bd6c04b8896baeb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:51.614435 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-fa72738f-94d7-4c49-b41e-b8c812a3705b tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee802dd70f3b47349bd6c04b8896baeb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:51.691245 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-fa72738f-94d7-4c49-b41e-b8c812a3705b tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee802dd70f3b47349bd6c04b8896baeb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:51.692494 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-fa72738f-94d7-4c49-b41e-b8c812a3705b tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee802dd70f3b47349bd6c04b8896baeb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:51.700789 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-fa72738f-94d7-4c49-b41e-b8c812a3705b tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee802dd70f3b47349bd6c04b8896baeb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:51.713745 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3264/6558] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:33:51 2022] DELETE /identity/v3/users/ee802dd70f3b47349bd6c04b8896baeb => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:51.719293 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dbfcef-0d60-4f38-b8e3-bc12c4c9d27f tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:51.732156 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dbfcef-0d60-4f38-b8e3-bc12c4c9d27f tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:51.807534 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277b09d-976b-4287-8927-37b96b774d64 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8edf391d172412580831b03939699f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a31755f1e2c245378f9b0dc987394120', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:51.808612 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277b09d-976b-4287-8927-37b96b774d64 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:51.809131 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277b09d-976b-4287-8927-37b96b774d64 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:51.809618 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277b09d-976b-4287-8927-37b96b774d64 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:51.811315 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a277b09d-976b-4287-8927-37b96b774d64 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:51.815603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a277b09d-976b-4287-8927-37b96b774d64 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:51.935792 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3295/6559] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:33:51 2022] POST /identity/v3/users => generated 367 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:33:51.939412 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72738f-94d7-4c49-b41e-b8c812a3705b tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:51.941778 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-fa72738f-94d7-4c49-b41e-b8c812a3705b tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:51.961624 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72738f-94d7-4c49-b41e-b8c812a3705b tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:51.967778 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df462ad4-7042-4c38-a520-96fc6ed42cab tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8edf391d172412580831b03939699f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a31755f1e2c245378f9b0dc987394120', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:51.968587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df462ad4-7042-4c38-a520-96fc6ed42cab tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:51.969345 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df462ad4-7042-4c38-a520-96fc6ed42cab tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:51.969727 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df462ad4-7042-4c38-a520-96fc6ed42cab tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:51.970771 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df462ad4-7042-4c38-a520-96fc6ed42cab tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:51.972932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df462ad4-7042-4c38-a520-96fc6ed42cab tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:52.155708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277b09d-976b-4287-8927-37b96b774d64 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:52.167345 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3265/6560] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:33:51 2022] POST /identity/v3/projects => generated 359 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:33:52.173092 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277b09d-976b-4287-8927-37b96b774d64 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:52.310197 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2013fa-030b-4795-89f1-52ad9b52e193 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8edf391d172412580831b03939699f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a31755f1e2c245378f9b0dc987394120', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:52.316244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2013fa-030b-4795-89f1-52ad9b52e193 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:52.316244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2013fa-030b-4795-89f1-52ad9b52e193 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:52.316244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2013fa-030b-4795-89f1-52ad9b52e193 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] PATH_INFO: `/v3/users/1172f4e7545749e186151ec5019e7a2d` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:52.332013 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2013fa-030b-4795-89f1-52ad9b52e193 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorizing `identity:update_user(user_id=1172f4e7545749e186151ec5019e7a2d)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:52.334424 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2013fa-030b-4795-89f1-52ad9b52e193 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:52.508737 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3296/6561] 10.222.0.23 () {60 vars in 1243 bytes} [Sat Apr 30 21:33:52 2022] PATCH /identity/v3/users/1172f4e7545749e186151ec5019e7a2d => generated 523 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:33:52.512627 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df462ad4-7042-4c38-a520-96fc6ed42cab tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:52.528552 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df462ad4-7042-4c38-a520-96fc6ed42cab tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:52.560457 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e63c3-e5b2-454d-964e-27ae2c515930 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8edf391d172412580831b03939699f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a31755f1e2c245378f9b0dc987394120', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:52.561391 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e63c3-e5b2-454d-964e-27ae2c515930 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:52.561883 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e63c3-e5b2-454d-964e-27ae2c515930 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:52.562342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e63c3-e5b2-454d-964e-27ae2c515930 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] PATH_INFO: `/v3/users/1172f4e7545749e186151ec5019e7a2d` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:52.593164 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e63c3-e5b2-454d-964e-27ae2c515930 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorizing `identity:get_user(user_id=1172f4e7545749e186151ec5019e7a2d)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:52.598302 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e63c3-e5b2-454d-964e-27ae2c515930 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:52.603327 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3266/6562] 10.222.0.23 () {58 vars in 1220 bytes} [Sat Apr 30 21:33:52 2022] GET /identity/v3/users/1172f4e7545749e186151ec5019e7a2d => generated 389 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:33:52.605587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2013fa-030b-4795-89f1-52ad9b52e193 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:52.630035 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2013fa-030b-4795-89f1-52ad9b52e193 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:52.636492 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431d364-a3f0-42cb-8f66-739ead9fc8c3 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8edf391d172412580831b03939699f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a31755f1e2c245378f9b0dc987394120', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:52.637448 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431d364-a3f0-42cb-8f66-739ead9fc8c3 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:52.638129 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431d364-a3f0-42cb-8f66-739ead9fc8c3 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:52.638675 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431d364-a3f0-42cb-8f66-739ead9fc8c3 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] PATH_INFO: `/v3/projects/1b425bf2d52a4a5aad460a0b4885daf0` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:52.641281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6431d364-a3f0-42cb-8f66-739ead9fc8c3 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1b425bf2d52a4a5aad460a0b4885daf0)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:52.643415 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6431d364-a3f0-42cb-8f66-739ead9fc8c3 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:52.801700 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6431d364-a3f0-42cb-8f66-739ead9fc8c3 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b425bf2d52a4a5aad460a0b4885daf0', 'request_id': 'req-6431d364-a3f0-42cb-8f66-739ead9fc8c3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:52.815930 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6431d364-a3f0-42cb-8f66-739ead9fc8c3 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b425bf2d52a4a5aad460a0b4885daf0', 'request_id': 'req-6431d364-a3f0-42cb-8f66-739ead9fc8c3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:52.831157 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6431d364-a3f0-42cb-8f66-739ead9fc8c3 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b425bf2d52a4a5aad460a0b4885daf0', 'request_id': 'req-6431d364-a3f0-42cb-8f66-739ead9fc8c3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:52.940384 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6431d364-a3f0-42cb-8f66-739ead9fc8c3 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] The token cache is being invalidate because project 1b425bf2d52a4a5aad460a0b4885daf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:33:52.941226 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6431d364-a3f0-42cb-8f66-739ead9fc8c3 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:52.942973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6431d364-a3f0-42cb-8f66-739ead9fc8c3 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:52.948687 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3297/6563] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:33:52 2022] DELETE /identity/v3/projects/1b425bf2d52a4a5aad460a0b4885daf0 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:52.952761 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e63c3-e5b2-454d-964e-27ae2c515930 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:52.959334 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6e1e63c3-e5b2-454d-964e-27ae2c515930 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:52.974392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e63c3-e5b2-454d-964e-27ae2c515930 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:53.116831 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b0b2fb-f90e-4df7-87db-4a3c8870eb1c tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8edf391d172412580831b03939699f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a31755f1e2c245378f9b0dc987394120', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:53.118582 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0b2fb-f90e-4df7-87db-4a3c8870eb1c tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:53.119069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0b2fb-f90e-4df7-87db-4a3c8870eb1c tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:53.119947 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0b2fb-f90e-4df7-87db-4a3c8870eb1c tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] PATH_INFO: `/v3/users/1172f4e7545749e186151ec5019e7a2d` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:53.122530 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b0b2fb-f90e-4df7-87db-4a3c8870eb1c tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1172f4e7545749e186151ec5019e7a2d)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:53.126083 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b0b2fb-f90e-4df7-87db-4a3c8870eb1c tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:53.337384 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-43b0b2fb-f90e-4df7-87db-4a3c8870eb1c tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1172f4e7545749e186151ec5019e7a2d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:53.353616 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-43b0b2fb-f90e-4df7-87db-4a3c8870eb1c tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1172f4e7545749e186151ec5019e7a2d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:53.530008 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-43b0b2fb-f90e-4df7-87db-4a3c8870eb1c tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1172f4e7545749e186151ec5019e7a2d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:53.531036 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-43b0b2fb-f90e-4df7-87db-4a3c8870eb1c tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1172f4e7545749e186151ec5019e7a2d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:53.539824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-43b0b2fb-f90e-4df7-87db-4a3c8870eb1c tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1172f4e7545749e186151ec5019e7a2d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:53.560430 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3267/6564] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:33:52 2022] DELETE /identity/v3/users/1172f4e7545749e186151ec5019e7a2d => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:53.561705 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431d364-a3f0-42cb-8f66-739ead9fc8c3 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:53.563875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6431d364-a3f0-42cb-8f66-739ead9fc8c3 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:53.753024 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431d364-a3f0-42cb-8f66-739ead9fc8c3 tempest-UsersV3TestJSON-853963198 tempest-UsersV3TestJSON-853963198-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:53.830537 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c494e6-f463-4637-bf36-ec07b69a87c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:53.831797 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c494e6-f463-4637-bf36-ec07b69a87c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:53.832512 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c494e6-f463-4637-bf36-ec07b69a87c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:53.833430 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c494e6-f463-4637-bf36-ec07b69a87c2 admin admin] PATH_INFO: `/v3/users/8263ab31eb534e0f9b0c1b0a721c5773` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:53.858514 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c494e6-f463-4637-bf36-ec07b69a87c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8263ab31eb534e0f9b0c1b0a721c5773)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:53.860651 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c494e6-f463-4637-bf36-ec07b69a87c2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:54.059392 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b5c494e6-f463-4637-bf36-ec07b69a87c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8263ab31eb534e0f9b0c1b0a721c5773'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:54.079619 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b5c494e6-f463-4637-bf36-ec07b69a87c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8263ab31eb534e0f9b0c1b0a721c5773'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:54.166002 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b5c494e6-f463-4637-bf36-ec07b69a87c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8263ab31eb534e0f9b0c1b0a721c5773'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:54.197162 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b5c494e6-f463-4637-bf36-ec07b69a87c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8263ab31eb534e0f9b0c1b0a721c5773'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:54.198884 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b5c494e6-f463-4637-bf36-ec07b69a87c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8263ab31eb534e0f9b0c1b0a721c5773'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:54.208933 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3298/6565] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:33:53 2022] DELETE /identity/v3/users/8263ab31eb534e0f9b0c1b0a721c5773 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:33:54.213473 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f138c-1447-4878-9b88-2c348321b459 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:54.215077 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f138c-1447-4878-9b88-2c348321b459 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:54.215077 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f138c-1447-4878-9b88-2c348321b459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:54.234397 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-c09f138c-1447-4878-9b88-2c348321b459 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:54.237699 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c09f138c-1447-4878-9b88-2c348321b459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:54.379525 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3268/6566] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:33:54.388572 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c494e6-f463-4637-bf36-ec07b69a87c2 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:54.391057 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b5c494e6-f463-4637-bf36-ec07b69a87c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:54.494340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c494e6-f463-4637-bf36-ec07b69a87c2 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:54.499624 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84552958-34a0-4c5d-aa57-7bfadffa87b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:54.504558 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84552958-34a0-4c5d-aa57-7bfadffa87b7 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:54.504558 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84552958-34a0-4c5d-aa57-7bfadffa87b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:54.504558 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84552958-34a0-4c5d-aa57-7bfadffa87b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:54.512336 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84552958-34a0-4c5d-aa57-7bfadffa87b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:54.513880 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84552958-34a0-4c5d-aa57-7bfadffa87b7 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:54.538075 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3299/6567] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:33:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:33:56.761110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f138c-1447-4878-9b88-2c348321b459 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:56.762609 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c09f138c-1447-4878-9b88-2c348321b459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:56.783420 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f138c-1447-4878-9b88-2c348321b459 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:56.797112 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c687b79-d1fc-4f3a-9d0e-848fe9d3915a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:56.804309 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c687b79-d1fc-4f3a-9d0e-848fe9d3915a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:56.804770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c687b79-d1fc-4f3a-9d0e-848fe9d3915a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:56.805230 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c687b79-d1fc-4f3a-9d0e-848fe9d3915a admin admin] PATH_INFO: `/v3/projects/c72fefa5b62349d186f37e7b723b5fc6` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:56.807172 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c687b79-d1fc-4f3a-9d0e-848fe9d3915a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c72fefa5b62349d186f37e7b723b5fc6)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:56.809313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c687b79-d1fc-4f3a-9d0e-848fe9d3915a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:57.006519 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5c687b79-d1fc-4f3a-9d0e-848fe9d3915a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c72fefa5b62349d186f37e7b723b5fc6', 'request_id': 'req-5c687b79-d1fc-4f3a-9d0e-848fe9d3915a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:57.013830 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5c687b79-d1fc-4f3a-9d0e-848fe9d3915a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c72fefa5b62349d186f37e7b723b5fc6', 'request_id': 'req-5c687b79-d1fc-4f3a-9d0e-848fe9d3915a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:57.020360 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5c687b79-d1fc-4f3a-9d0e-848fe9d3915a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c72fefa5b62349d186f37e7b723b5fc6', 'request_id': 'req-5c687b79-d1fc-4f3a-9d0e-848fe9d3915a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:57.095569 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5c687b79-d1fc-4f3a-9d0e-848fe9d3915a admin admin] The token cache is being invalidate because project c72fefa5b62349d186f37e7b723b5fc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:33:57.095951 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5c687b79-d1fc-4f3a-9d0e-848fe9d3915a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:57.108671 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5c687b79-d1fc-4f3a-9d0e-848fe9d3915a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:57.114674 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3269/6568] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:33:56 2022] DELETE /identity/v3/projects/c72fefa5b62349d186f37e7b723b5fc6 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:57.120046 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84552958-34a0-4c5d-aa57-7bfadffa87b7 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:57.145612 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84552958-34a0-4c5d-aa57-7bfadffa87b7 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:57.225530 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a49e5-9302-432e-8433-1c0cbdeeb52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:57.226472 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a49e5-9302-432e-8433-1c0cbdeeb52e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:57.227092 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a49e5-9302-432e-8433-1c0cbdeeb52e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:57.227394 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a49e5-9302-432e-8433-1c0cbdeeb52e admin admin] PATH_INFO: `/v3/users/e8edf391d172412580831b03939699f4` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:57.228653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592a49e5-9302-432e-8433-1c0cbdeeb52e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8edf391d172412580831b03939699f4)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:57.230652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592a49e5-9302-432e-8433-1c0cbdeeb52e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:57.485471 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-592a49e5-9302-432e-8433-1c0cbdeeb52e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8edf391d172412580831b03939699f4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:57.504695 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-592a49e5-9302-432e-8433-1c0cbdeeb52e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8edf391d172412580831b03939699f4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:57.616213 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-592a49e5-9302-432e-8433-1c0cbdeeb52e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8edf391d172412580831b03939699f4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:57.631129 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-592a49e5-9302-432e-8433-1c0cbdeeb52e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8edf391d172412580831b03939699f4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:57.633004 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-592a49e5-9302-432e-8433-1c0cbdeeb52e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8edf391d172412580831b03939699f4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:57.645575 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3300/6569] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:33:57 2022] DELETE /identity/v3/users/e8edf391d172412580831b03939699f4 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:58.486978 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c687b79-d1fc-4f3a-9d0e-848fe9d3915a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:58.488446 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5c687b79-d1fc-4f3a-9d0e-848fe9d3915a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:58.504062 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c687b79-d1fc-4f3a-9d0e-848fe9d3915a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:58.582418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90b4ef-2ee6-4709-9769-8fc5e617e1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:58.582418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90b4ef-2ee6-4709-9769-8fc5e617e1b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:58.582418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90b4ef-2ee6-4709-9769-8fc5e617e1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:58.582418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90b4ef-2ee6-4709-9769-8fc5e617e1b3 admin admin] PATH_INFO: `/v3/projects/a31755f1e2c245378f9b0dc987394120` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:58.585064 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a90b4ef-2ee6-4709-9769-8fc5e617e1b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a31755f1e2c245378f9b0dc987394120)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:58.589244 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a90b4ef-2ee6-4709-9769-8fc5e617e1b3 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:58.789222 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2a90b4ef-2ee6-4709-9769-8fc5e617e1b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a31755f1e2c245378f9b0dc987394120', 'request_id': 'req-2a90b4ef-2ee6-4709-9769-8fc5e617e1b3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:58.798831 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2a90b4ef-2ee6-4709-9769-8fc5e617e1b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a31755f1e2c245378f9b0dc987394120', 'request_id': 'req-2a90b4ef-2ee6-4709-9769-8fc5e617e1b3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:58.811659 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2a90b4ef-2ee6-4709-9769-8fc5e617e1b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a31755f1e2c245378f9b0dc987394120', 'request_id': 'req-2a90b4ef-2ee6-4709-9769-8fc5e617e1b3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:58.879541 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2a90b4ef-2ee6-4709-9769-8fc5e617e1b3 admin admin] The token cache is being invalidate because project a31755f1e2c245378f9b0dc987394120 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:33:58.886646 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2a90b4ef-2ee6-4709-9769-8fc5e617e1b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:58.886646 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2a90b4ef-2ee6-4709-9769-8fc5e617e1b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:33:58.889257 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90de31d-08fc-4be1-977c-c1762afec85d None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:58.889732 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90de31d-08fc-4be1-977c-c1762afec85d None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:58.889925 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90de31d-08fc-4be1-977c-c1762afec85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:58.892130 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3270/6570] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:33:58 2022] DELETE /identity/v3/projects/a31755f1e2c245378f9b0dc987394120 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:58.913899 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-e90de31d-08fc-4be1-977c-c1762afec85d None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:58.915466 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e90de31d-08fc-4be1-977c-c1762afec85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:59.008592 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3301/6571] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:33:59.018260 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba64b0-d012-448c-9d1d-842a20aa0a06 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:59.018545 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba64b0-d012-448c-9d1d-842a20aa0a06 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:59.018880 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba64b0-d012-448c-9d1d-842a20aa0a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:59.045953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-1aba64b0-d012-448c-9d1d-842a20aa0a06 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:59.048613 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1aba64b0-d012-448c-9d1d-842a20aa0a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:59.064124 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3271/6572] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:33:59.067080 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90de31d-08fc-4be1-977c-c1762afec85d None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:59.079770 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90de31d-08fc-4be1-977c-c1762afec85d None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:59.106091 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed44d57-59c9-45f7-bbae-6c576c6f5db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:59.107095 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed44d57-59c9-45f7-bbae-6c576c6f5db0 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:59.107619 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed44d57-59c9-45f7-bbae-6c576c6f5db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:59.107981 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443f56d-5380-4a2c-bde3-79dade1d8fa7 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:59.108137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed44d57-59c9-45f7-bbae-6c576c6f5db0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:59.108825 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443f56d-5380-4a2c-bde3-79dade1d8fa7 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:59.108949 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed44d57-59c9-45f7-bbae-6c576c6f5db0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:33:59.109157 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed44d57-59c9-45f7-bbae-6c576c6f5db0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:59.109572 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443f56d-5380-4a2c-bde3-79dade1d8fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:59.110904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed44d57-59c9-45f7-bbae-6c576c6f5db0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:59.137078 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3302/6573] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:33:59.138543 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed44d57-59c9-45f7-bbae-6c576c6f5db0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:59.140792 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-1443f56d-5380-4a2c-bde3-79dade1d8fa7 None None] MFA Rules not processed for user `41a26877b24c4687a0c8cc4ffc6d69dd`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:59.142089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1443f56d-5380-4a2c-bde3-79dade1d8fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:33:59.153401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed44d57-59c9-45f7-bbae-6c576c6f5db0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:59.159529 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e44ff7-8730-4e97-aff5-87954dad8735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:59.160172 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e44ff7-8730-4e97-aff5-87954dad8735 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:59.160457 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e44ff7-8730-4e97-aff5-87954dad8735 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:59.160735 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e44ff7-8730-4e97-aff5-87954dad8735 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:59.161424 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e44ff7-8730-4e97-aff5-87954dad8735 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:59.164429 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e44ff7-8730-4e97-aff5-87954dad8735 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:59.236089 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3272/6574] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:33:59.292996 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3303/6575] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:33:59 2022] POST /identity/v3/projects => generated 367 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:33:59.297777 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443f56d-5380-4a2c-bde3-79dade1d8fa7 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:59.310695 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443f56d-5380-4a2c-bde3-79dade1d8fa7 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:59.400082 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3055e63d-0f48-4c9b-98f3-73076f0368cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:59.400786 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055e63d-0f48-4c9b-98f3-73076f0368cc admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:59.401075 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055e63d-0f48-4c9b-98f3-73076f0368cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:59.401430 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055e63d-0f48-4c9b-98f3-73076f0368cc admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:59.402079 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3055e63d-0f48-4c9b-98f3-73076f0368cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:59.404111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3055e63d-0f48-4c9b-98f3-73076f0368cc admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:59.543432 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3273/6576] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:33:59 2022] POST /identity/v3/users => generated 284 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:33:59.548979 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e44ff7-8730-4e97-aff5-87954dad8735 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:59.565125 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e44ff7-8730-4e97-aff5-87954dad8735 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:59.573183 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98b053-f1ae-4443-8987-0749bcb1e11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:59.574587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98b053-f1ae-4443-8987-0749bcb1e11c admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:59.574876 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98b053-f1ae-4443-8987-0749bcb1e11c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:59.575161 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98b053-f1ae-4443-8987-0749bcb1e11c admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:59.575941 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98b053-f1ae-4443-8987-0749bcb1e11c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:59.577688 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98b053-f1ae-4443-8987-0749bcb1e11c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:59.594966 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3304/6577] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:33:59.596416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3055e63d-0f48-4c9b-98f3-73076f0368cc admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:59.611900 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3055e63d-0f48-4c9b-98f3-73076f0368cc admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:59.619995 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89927235-9bb1-4c27-8d79-5cafeee4e6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:59.621221 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89927235-9bb1-4c27-8d79-5cafeee4e6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:59.621610 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89927235-9bb1-4c27-8d79-5cafeee4e6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:59.622030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89927235-9bb1-4c27-8d79-5cafeee4e6a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:59.622928 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89927235-9bb1-4c27-8d79-5cafeee4e6a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:59.624710 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89927235-9bb1-4c27-8d79-5cafeee4e6a3 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:59.675330 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3274/6578] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:33:59.680229 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98b053-f1ae-4443-8987-0749bcb1e11c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:33:59.708318 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98b053-f1ae-4443-8987-0749bcb1e11c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:33:59.723219 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95ff48-e7ee-4de6-9927-92c2a1149f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:33:59.724140 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95ff48-e7ee-4de6-9927-92c2a1149f6e admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:59.724421 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95ff48-e7ee-4de6-9927-92c2a1149f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:59.724694 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95ff48-e7ee-4de6-9927-92c2a1149f6e admin admin] PATH_INFO: `/v3/projects/d7250a7673cd487fb3d4e11884ef7716/users/ecdb3f680e404b188eec5bee2bb69427/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:59.757019 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95ff48-e7ee-4de6-9927-92c2a1149f6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7250a7673cd487fb3d4e11884ef7716, user_id=ecdb3f680e404b188eec5bee2bb69427, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:33:59.760889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95ff48-e7ee-4de6-9927-92c2a1149f6e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:33:59.865651 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3305/6579] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:33:59 2022] PUT /identity/v3/projects/d7250a7673cd487fb3d4e11884ef7716/users/ecdb3f680e404b188eec5bee2bb69427/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:33:59.959794 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceede099-191c-4a5b-9c84-ceb5488f7282 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:33:59.960462 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceede099-191c-4a5b-9c84-ceb5488f7282 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:33:59.961026 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceede099-191c-4a5b-9c84-ceb5488f7282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:33:59.996948 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-ceede099-191c-4a5b-9c84-ceb5488f7282 None None] MFA Rules not processed for user `ecdb3f680e404b188eec5bee2bb69427`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:33:59.998397 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ceede099-191c-4a5b-9c84-ceb5488f7282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:00.077002 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3275/6580] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:33:59 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:00.089036 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95ff48-e7ee-4de6-9927-92c2a1149f6e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:00.112636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95ff48-e7ee-4de6-9927-92c2a1149f6e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:00.123335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6223d-ba4c-4f4e-859a-21bc582af066 tempest-TestApiDiscovery-177336750 tempest-TestApiDiscovery-177336750-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecdb3f680e404b188eec5bee2bb69427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7250a7673cd487fb3d4e11884ef7716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:00.124124 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6223d-ba4c-4f4e-859a-21bc582af066 tempest-TestApiDiscovery-177336750 tempest-TestApiDiscovery-177336750-project] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:00.126700 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6223d-ba4c-4f4e-859a-21bc582af066 tempest-TestApiDiscovery-177336750 tempest-TestApiDiscovery-177336750-project] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:00.127418 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6223d-ba4c-4f4e-859a-21bc582af066 tempest-TestApiDiscovery-177336750 tempest-TestApiDiscovery-177336750-project] PATH_INFO: `/v3` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:00.129633 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3306/6581] 10.222.0.23 () {58 vars in 1103 bytes} [Sat Apr 30 21:34:00 2022] GET /identity/v3 => generated 255 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:34:00.142114 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceede099-191c-4a5b-9c84-ceb5488f7282 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:00.153359 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceede099-191c-4a5b-9c84-ceb5488f7282 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:00.158278 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c5f68a-5ecf-4305-9021-504530e571ee tempest-TestApiDiscovery-177336750 tempest-TestApiDiscovery-177336750-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecdb3f680e404b188eec5bee2bb69427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7250a7673cd487fb3d4e11884ef7716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:00.164092 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5f68a-5ecf-4305-9021-504530e571ee tempest-TestApiDiscovery-177336750 tempest-TestApiDiscovery-177336750-project] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:00.164092 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5f68a-5ecf-4305-9021-504530e571ee tempest-TestApiDiscovery-177336750 tempest-TestApiDiscovery-177336750-project] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:00.164092 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5f68a-5ecf-4305-9021-504530e571ee tempest-TestApiDiscovery-177336750 tempest-TestApiDiscovery-177336750-project] PATH_INFO: `/v3` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:00.164092 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3276/6582] 10.222.0.23 () {58 vars in 1103 bytes} [Sat Apr 30 21:34:00 2022] GET /identity/v3 => generated 255 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:34:00.169126 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6223d-ba4c-4f4e-859a-21bc582af066 tempest-TestApiDiscovery-177336750 tempest-TestApiDiscovery-177336750-project] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:00.183538 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6223d-ba4c-4f4e-859a-21bc582af066 tempest-TestApiDiscovery-177336750 tempest-TestApiDiscovery-177336750-project] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:00.189553 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843a0cb-548e-41b4-9929-716507e212c6 tempest-TestApiDiscovery-177336750 tempest-TestApiDiscovery-177336750-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecdb3f680e404b188eec5bee2bb69427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7250a7673cd487fb3d4e11884ef7716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:00.190386 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843a0cb-548e-41b4-9929-716507e212c6 tempest-TestApiDiscovery-177336750 tempest-TestApiDiscovery-177336750-project] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:00.194099 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843a0cb-548e-41b4-9929-716507e212c6 tempest-TestApiDiscovery-177336750 tempest-TestApiDiscovery-177336750-project] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:00.194099 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843a0cb-548e-41b4-9929-716507e212c6 tempest-TestApiDiscovery-177336750 tempest-TestApiDiscovery-177336750-project] PATH_INFO: `/v3` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:00.202248 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc8e69-179c-431c-94a6-83a48ee1f3d2 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:00.203600 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc8e69-179c-431c-94a6-83a48ee1f3d2 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:00.204322 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc8e69-179c-431c-94a6-83a48ee1f3d2 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:00.206151 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3277/6583] 10.222.0.23 () {56 vars in 894 bytes} [Sat Apr 30 21:34:00 2022] GET /identity/ => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:34:00.206689 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3307/6584] 10.222.0.23 () {58 vars in 1103 bytes} [Sat Apr 30 21:34:00 2022] GET /identity/v3 => generated 255 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:34:00.213454 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cc37b-a102-488b-b8b1-67dca6de78be None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:00.214276 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cc37b-a102-488b-b8b1-67dca6de78be None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:00.214796 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cc37b-a102-488b-b8b1-67dca6de78be None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:00.216849 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3278/6585] 10.222.0.23 () {56 vars in 894 bytes} [Sat Apr 30 21:34:00 2022] GET /identity/ => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:34:00.237513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843a0cb-548e-41b4-9929-716507e212c6 tempest-TestApiDiscovery-177336750 tempest-TestApiDiscovery-177336750-project] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:00.337572 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843a0cb-548e-41b4-9929-716507e212c6 tempest-TestApiDiscovery-177336750 tempest-TestApiDiscovery-177336750-project] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:00.344459 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81ca13-dcc7-4add-b904-e0a6ff29f327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:00.346011 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81ca13-dcc7-4add-b904-e0a6ff29f327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:00.346879 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81ca13-dcc7-4add-b904-e0a6ff29f327 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:00.347356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81ca13-dcc7-4add-b904-e0a6ff29f327 admin admin] PATH_INFO: `/v3/users/ecdb3f680e404b188eec5bee2bb69427` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:00.349401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d81ca13-dcc7-4add-b904-e0a6ff29f327 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecdb3f680e404b188eec5bee2bb69427)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:00.352319 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d81ca13-dcc7-4add-b904-e0a6ff29f327 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:00.610275 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1d81ca13-dcc7-4add-b904-e0a6ff29f327 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecdb3f680e404b188eec5bee2bb69427'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:00.627342 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1d81ca13-dcc7-4add-b904-e0a6ff29f327 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecdb3f680e404b188eec5bee2bb69427'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:00.699214 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1d81ca13-dcc7-4add-b904-e0a6ff29f327 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecdb3f680e404b188eec5bee2bb69427'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:00.722286 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1d81ca13-dcc7-4add-b904-e0a6ff29f327 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecdb3f680e404b188eec5bee2bb69427'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:00.725043 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1d81ca13-dcc7-4add-b904-e0a6ff29f327 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecdb3f680e404b188eec5bee2bb69427'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:00.738090 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3308/6586] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:34:00 2022] DELETE /identity/v3/users/ecdb3f680e404b188eec5bee2bb69427 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:34:00.739427 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50207c7-8ce3-4fab-bf46-2b0497df7fbe None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:00.739912 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50207c7-8ce3-4fab-bf46-2b0497df7fbe None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:00.740043 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50207c7-8ce3-4fab-bf46-2b0497df7fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:00.764850 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-c50207c7-8ce3-4fab-bf46-2b0497df7fbe None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:00.766242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c50207c7-8ce3-4fab-bf46-2b0497df7fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:00.871089 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3279/6587] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:34:00.881354 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81ca13-dcc7-4add-b904-e0a6ff29f327 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:00.886526 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1d81ca13-dcc7-4add-b904-e0a6ff29f327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:01.005388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81ca13-dcc7-4add-b904-e0a6ff29f327 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:01.010158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c14d0-01df-4a91-98ba-86ace90c915e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:01.010850 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c14d0-01df-4a91-98ba-86ace90c915e service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:01.011142 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c14d0-01df-4a91-98ba-86ace90c915e service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:01.011422 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c14d0-01df-4a91-98ba-86ace90c915e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:01.022645 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c14d0-01df-4a91-98ba-86ace90c915e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:01.026022 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c14d0-01df-4a91-98ba-86ace90c915e service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:01.036111 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3309/6588] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:34:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:34:01.098169 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50207c7-8ce3-4fab-bf46-2b0497df7fbe None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:01.099993 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c50207c7-8ce3-4fab-bf46-2b0497df7fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:01.113265 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50207c7-8ce3-4fab-bf46-2b0497df7fbe None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:01.118179 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca80d3e-b06e-408f-91ff-6587d3653beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:01.119871 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca80d3e-b06e-408f-91ff-6587d3653beb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:01.120155 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca80d3e-b06e-408f-91ff-6587d3653beb admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:01.120624 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca80d3e-b06e-408f-91ff-6587d3653beb admin admin] PATH_INFO: `/v3/users/6e8493acf90649d38e8432d35a4faa9e` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:01.121938 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca80d3e-b06e-408f-91ff-6587d3653beb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e8493acf90649d38e8432d35a4faa9e)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:01.123910 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca80d3e-b06e-408f-91ff-6587d3653beb admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:01.388988 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1ca80d3e-b06e-408f-91ff-6587d3653beb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e8493acf90649d38e8432d35a4faa9e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:01.404386 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1ca80d3e-b06e-408f-91ff-6587d3653beb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e8493acf90649d38e8432d35a4faa9e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:01.516894 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c14d0-01df-4a91-98ba-86ace90c915e service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:01.518699 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-236c14d0-01df-4a91-98ba-86ace90c915e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:01.537661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1ca80d3e-b06e-408f-91ff-6587d3653beb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e8493acf90649d38e8432d35a4faa9e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:01.537661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1ca80d3e-b06e-408f-91ff-6587d3653beb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e8493acf90649d38e8432d35a4faa9e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:01.542001 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1ca80d3e-b06e-408f-91ff-6587d3653beb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e8493acf90649d38e8432d35a4faa9e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:01.543278 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c14d0-01df-4a91-98ba-86ace90c915e service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:01.548535 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3280/6589] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:34:01 2022] DELETE /identity/v3/users/6e8493acf90649d38e8432d35a4faa9e => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:34:01.550280 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ddec08-e403-42b2-8438-b9c6e3a347de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:01.551848 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddec08-e403-42b2-8438-b9c6e3a347de admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:01.552292 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddec08-e403-42b2-8438-b9c6e3a347de admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:01.552733 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddec08-e403-42b2-8438-b9c6e3a347de admin admin] PATH_INFO: `/v3/users/299f9adca26d4506bc471e70940b10c6` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:01.552920 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9284e98-88c7-4967-b480-031eb578c20d None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:01.553210 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9284e98-88c7-4967-b480-031eb578c20d None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:01.553489 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9284e98-88c7-4967-b480-031eb578c20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:01.554773 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ddec08-e403-42b2-8438-b9c6e3a347de admin admin] RBAC: Authorizing `identity:delete_user(user_id=299f9adca26d4506bc471e70940b10c6)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:01.557660 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ddec08-e403-42b2-8438-b9c6e3a347de admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:01.575711 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-d9284e98-88c7-4967-b480-031eb578c20d None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:01.577347 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d9284e98-88c7-4967-b480-031eb578c20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:01.638810 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3281/6590] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:34:01.648840 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9284e98-88c7-4967-b480-031eb578c20d None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:01.653951 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d9284e98-88c7-4967-b480-031eb578c20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:01.727216 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9284e98-88c7-4967-b480-031eb578c20d None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:01.731816 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f492e2-7596-4240-97a2-524a33be6956 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:01.732994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f492e2-7596-4240-97a2-524a33be6956 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:01.733740 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f492e2-7596-4240-97a2-524a33be6956 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:01.734226 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f492e2-7596-4240-97a2-524a33be6956 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:01.734807 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b2ddec08-e403-42b2-8438-b9c6e3a347de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '299f9adca26d4506bc471e70940b10c6'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:01.751467 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f492e2-7596-4240-97a2-524a33be6956 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:01.753206 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f492e2-7596-4240-97a2-524a33be6956 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:01.753590 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b2ddec08-e403-42b2-8438-b9c6e3a347de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '299f9adca26d4506bc471e70940b10c6'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:01.778580 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3282/6591] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:34:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:34:01.827966 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b2ddec08-e403-42b2-8438-b9c6e3a347de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '299f9adca26d4506bc471e70940b10c6'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:01.838835 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b2ddec08-e403-42b2-8438-b9c6e3a347de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '299f9adca26d4506bc471e70940b10c6'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:01.839751 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b2ddec08-e403-42b2-8438-b9c6e3a347de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '299f9adca26d4506bc471e70940b10c6'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:01.847775 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3310/6592] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:34:01 2022] DELETE /identity/v3/users/299f9adca26d4506bc471e70940b10c6 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:34:01.852519 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff4206-7307-42c0-a5d6-d77ea465f08d None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:01.852952 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff4206-7307-42c0-a5d6-d77ea465f08d None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:01.853938 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff4206-7307-42c0-a5d6-d77ea465f08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:01.883662 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-38ff4206-7307-42c0-a5d6-d77ea465f08d None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:01.886725 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-38ff4206-7307-42c0-a5d6-d77ea465f08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:01.994812 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3283/6593] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:34:02.007274 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ddec08-e403-42b2-8438-b9c6e3a347de admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:02.008783 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b2ddec08-e403-42b2-8438-b9c6e3a347de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:02.084010 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ddec08-e403-42b2-8438-b9c6e3a347de admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:02.088530 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf9c64-6d76-4c48-bdf5-6c2b1540717d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:02.089459 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf9c64-6d76-4c48-bdf5-6c2b1540717d service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:02.089818 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf9c64-6d76-4c48-bdf5-6c2b1540717d service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:02.091854 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf9c64-6d76-4c48-bdf5-6c2b1540717d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:02.099718 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaf9c64-6d76-4c48-bdf5-6c2b1540717d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:02.101153 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaf9c64-6d76-4c48-bdf5-6c2b1540717d service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:02.115400 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff4206-7307-42c0-a5d6-d77ea465f08d None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:02.116373 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3311/6594] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:34:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:34:02.117739 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-38ff4206-7307-42c0-a5d6-d77ea465f08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:02.139288 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff4206-7307-42c0-a5d6-d77ea465f08d None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:02.139288 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63365bcf-8157-44eb-b959-48183bbf001f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:02.139288 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63365bcf-8157-44eb-b959-48183bbf001f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:02.139288 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63365bcf-8157-44eb-b959-48183bbf001f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:02.139680 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63365bcf-8157-44eb-b959-48183bbf001f admin admin] PATH_INFO: `/v3/projects/8f529526273f453188e2726e72e49b08` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:02.141712 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63365bcf-8157-44eb-b959-48183bbf001f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f529526273f453188e2726e72e49b08)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:02.144179 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63365bcf-8157-44eb-b959-48183bbf001f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:02.303372 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-63365bcf-8157-44eb-b959-48183bbf001f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f529526273f453188e2726e72e49b08', 'request_id': 'req-63365bcf-8157-44eb-b959-48183bbf001f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:02.309140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-63365bcf-8157-44eb-b959-48183bbf001f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f529526273f453188e2726e72e49b08', 'request_id': 'req-63365bcf-8157-44eb-b959-48183bbf001f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:02.315886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-63365bcf-8157-44eb-b959-48183bbf001f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f529526273f453188e2726e72e49b08', 'request_id': 'req-63365bcf-8157-44eb-b959-48183bbf001f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:02.350506 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf9c64-6d76-4c48-bdf5-6c2b1540717d service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:02.352062 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4aaf9c64-6d76-4c48-bdf5-6c2b1540717d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:02.365542 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf9c64-6d76-4c48-bdf5-6c2b1540717d service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:02.423189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-63365bcf-8157-44eb-b959-48183bbf001f admin admin] The token cache is being invalidate because project 8f529526273f453188e2726e72e49b08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:34:02.423189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-63365bcf-8157-44eb-b959-48183bbf001f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:02.423189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-63365bcf-8157-44eb-b959-48183bbf001f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:02.423189 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3284/6595] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:34:02 2022] DELETE /identity/v3/projects/8f529526273f453188e2726e72e49b08 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:34:02.423189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48bd96-5700-4405-8000-32672e50ff99 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:02.423793 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48bd96-5700-4405-8000-32672e50ff99 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:02.423793 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48bd96-5700-4405-8000-32672e50ff99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:02.430036 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-2c48bd96-5700-4405-8000-32672e50ff99 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:02.432057 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2c48bd96-5700-4405-8000-32672e50ff99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:02.443779 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d98186-0147-4912-a862-b70629d7b091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:02.444652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d98186-0147-4912-a862-b70629d7b091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:02.448865 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d98186-0147-4912-a862-b70629d7b091 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:02.448865 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d98186-0147-4912-a862-b70629d7b091 admin admin] PATH_INFO: `/v3/projects/d7250a7673cd487fb3d4e11884ef7716` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:02.448865 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d98186-0147-4912-a862-b70629d7b091 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7250a7673cd487fb3d4e11884ef7716)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:02.450876 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d98186-0147-4912-a862-b70629d7b091 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:02.501307 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3285/6596] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:02.538832 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c48bd96-5700-4405-8000-32672e50ff99 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:02.540433 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2c48bd96-5700-4405-8000-32672e50ff99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:02.573079 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c48bd96-5700-4405-8000-32672e50ff99 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:02.589836 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb3d2c4-f544-4273-ab49-ebdfbb07cdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:02.592748 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3d2c4-f544-4273-ab49-ebdfbb07cdf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:02.592748 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3d2c4-f544-4273-ab49-ebdfbb07cdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:02.592748 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3d2c4-f544-4273-ab49-ebdfbb07cdf7 admin admin] PATH_INFO: `/v3/projects/7171c6cf76ac4e179123a5d3905d6a5c` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:02.592748 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb3d2c4-f544-4273-ab49-ebdfbb07cdf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7171c6cf76ac4e179123a5d3905d6a5c)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:02.595332 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb3d2c4-f544-4273-ab49-ebdfbb07cdf7 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:02.619681 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d4d98186-0147-4912-a862-b70629d7b091 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7250a7673cd487fb3d4e11884ef7716', 'request_id': 'req-d4d98186-0147-4912-a862-b70629d7b091'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:02.630827 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d4d98186-0147-4912-a862-b70629d7b091 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7250a7673cd487fb3d4e11884ef7716', 'request_id': 'req-d4d98186-0147-4912-a862-b70629d7b091'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:02.636258 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d4d98186-0147-4912-a862-b70629d7b091 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7250a7673cd487fb3d4e11884ef7716', 'request_id': 'req-d4d98186-0147-4912-a862-b70629d7b091'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:02.745607 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d4d98186-0147-4912-a862-b70629d7b091 admin admin] The token cache is being invalidate because project d7250a7673cd487fb3d4e11884ef7716 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:34:02.746057 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d4d98186-0147-4912-a862-b70629d7b091 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:02.746824 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d4d98186-0147-4912-a862-b70629d7b091 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:02.752136 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3312/6597] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:34:02 2022] DELETE /identity/v3/projects/d7250a7673cd487fb3d4e11884ef7716 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:34:02.752136 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d7d40-259c-4578-86f4-17318ab2c5bc None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:02.752136 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d7d40-259c-4578-86f4-17318ab2c5bc None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:02.752136 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d7d40-259c-4578-86f4-17318ab2c5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:02.772711 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8eb3d2c4-f544-4273-ab49-ebdfbb07cdf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7171c6cf76ac4e179123a5d3905d6a5c', 'request_id': 'req-8eb3d2c4-f544-4273-ab49-ebdfbb07cdf7'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:02.777618 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-d77d7d40-259c-4578-86f4-17318ab2c5bc None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:02.779237 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8eb3d2c4-f544-4273-ab49-ebdfbb07cdf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7171c6cf76ac4e179123a5d3905d6a5c', 'request_id': 'req-8eb3d2c4-f544-4273-ab49-ebdfbb07cdf7'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:02.779547 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d77d7d40-259c-4578-86f4-17318ab2c5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:02.789700 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8eb3d2c4-f544-4273-ab49-ebdfbb07cdf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7171c6cf76ac4e179123a5d3905d6a5c', 'request_id': 'req-8eb3d2c4-f544-4273-ab49-ebdfbb07cdf7'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:02.856157 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3313/6598] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:02.857487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a13c47-7fbd-4d25-aacb-6132991e5563 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:02.857800 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a13c47-7fbd-4d25-aacb-6132991e5563 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:02.858077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a13c47-7fbd-4d25-aacb-6132991e5563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:02.876801 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-09a13c47-7fbd-4d25-aacb-6132991e5563 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:02.878244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-09a13c47-7fbd-4d25-aacb-6132991e5563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:02.886831 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3314/6599] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:02.887622 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a13c47-7fbd-4d25-aacb-6132991e5563 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:02.895042 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8eb3d2c4-f544-4273-ab49-ebdfbb07cdf7 admin admin] The token cache is being invalidate because project 7171c6cf76ac4e179123a5d3905d6a5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:34:02.895336 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8eb3d2c4-f544-4273-ab49-ebdfbb07cdf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:02.896691 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8eb3d2c4-f544-4273-ab49-ebdfbb07cdf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:02.899278 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3286/6600] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:34:02 2022] DELETE /identity/v3/projects/7171c6cf76ac4e179123a5d3905d6a5c => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:34:02.906180 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a13c47-7fbd-4d25-aacb-6132991e5563 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:02.907198 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2de91-a403-4bd5-80e2-aa22ad97ce14 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:02.907691 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2de91-a403-4bd5-80e2-aa22ad97ce14 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:02.907980 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2de91-a403-4bd5-80e2-aa22ad97ce14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:02.933192 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25f8ff-4a80-4e3f-b6ca-d802117eb2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:02.934004 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25f8ff-4a80-4e3f-b6ca-d802117eb2e7 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:02.934485 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25f8ff-4a80-4e3f-b6ca-d802117eb2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:02.934892 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25f8ff-4a80-4e3f-b6ca-d802117eb2e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:02.935911 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25f8ff-4a80-4e3f-b6ca-d802117eb2e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:34:02.936340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25f8ff-4a80-4e3f-b6ca-d802117eb2e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:02.938489 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25f8ff-4a80-4e3f-b6ca-d802117eb2e7 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:02.946628 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-23a2de91-a403-4bd5-80e2-aa22ad97ce14 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:02.948744 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-23a2de91-a403-4bd5-80e2-aa22ad97ce14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:02.958188 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3315/6601] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:34:02.960037 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46ba02-acbd-4dd7-b67a-eccf37061f27 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:02.961174 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46ba02-acbd-4dd7-b67a-eccf37061f27 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:02.963482 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3287/6602] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:02.964299 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46ba02-acbd-4dd7-b67a-eccf37061f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:02.967648 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2de91-a403-4bd5-80e2-aa22ad97ce14 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:02.969519 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-23a2de91-a403-4bd5-80e2-aa22ad97ce14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:02.985000 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2de91-a403-4bd5-80e2-aa22ad97ce14 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:02.988407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-5a46ba02-acbd-4dd7-b67a-eccf37061f27 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:02.989662 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5a46ba02-acbd-4dd7-b67a-eccf37061f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:02.990430 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a862e56e-0ca4-4095-bc76-2f168edf2bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:02.991300 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862e56e-0ca4-4095-bc76-2f168edf2bb0 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:02.991742 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862e56e-0ca4-4095-bc76-2f168edf2bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:02.992393 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862e56e-0ca4-4095-bc76-2f168edf2bb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:02.993243 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a862e56e-0ca4-4095-bc76-2f168edf2bb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:02.996080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a862e56e-0ca4-4095-bc76-2f168edf2bb0 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:03.005468 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3316/6603] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:03.008852 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46ba02-acbd-4dd7-b67a-eccf37061f27 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:03.018036 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46ba02-acbd-4dd7-b67a-eccf37061f27 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:03.022872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9b141-334a-463f-afbf-63ad891eeb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:03.023604 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9b141-334a-463f-afbf-63ad891eeb43 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:03.023890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9b141-334a-463f-afbf-63ad891eeb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:03.024168 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9b141-334a-463f-afbf-63ad891eeb43 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:03.025613 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9b141-334a-463f-afbf-63ad891eeb43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:34:03.025973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9b141-334a-463f-afbf-63ad891eeb43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:03.028010 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9b141-334a-463f-afbf-63ad891eeb43 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:03.044140 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3317/6604] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:34:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:34:03.044140 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca57a52-71ec-4192-b8e0-8cdbb483b6ee None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:03.044140 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca57a52-71ec-4192-b8e0-8cdbb483b6ee None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:03.044140 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca57a52-71ec-4192-b8e0-8cdbb483b6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:03.065171 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-bca57a52-71ec-4192-b8e0-8cdbb483b6ee None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:03.066587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-bca57a52-71ec-4192-b8e0-8cdbb483b6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:03.078675 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3318/6605] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:03.079195 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca57a52-71ec-4192-b8e0-8cdbb483b6ee None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:03.091023 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca57a52-71ec-4192-b8e0-8cdbb483b6ee None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:03.097628 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d9744-cafa-4c2c-acad-b0401ad13b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:03.097628 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d9744-cafa-4c2c-acad-b0401ad13b4c admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:03.097628 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d9744-cafa-4c2c-acad-b0401ad13b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:03.097628 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d9744-cafa-4c2c-acad-b0401ad13b4c admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:03.098183 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d9744-cafa-4c2c-acad-b0401ad13b4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:03.100897 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d9744-cafa-4c2c-acad-b0401ad13b4c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:03.116291 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3288/6606] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:34:02 2022] POST /identity/v3/projects => generated 377 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:34:03.117394 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a862e56e-0ca4-4095-bc76-2f168edf2bb0 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:03.191019 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a862e56e-0ca4-4095-bc76-2f168edf2bb0 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:03.196010 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3319/6607] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:34:03 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:34:03.196894 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d9744-cafa-4c2c-acad-b0401ad13b4c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:03.197238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8aa797-d0a0-495b-a33c-8f4d69417c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:03.198113 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8aa797-d0a0-495b-a33c-8f4d69417c7c admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:03.198586 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8aa797-d0a0-495b-a33c-8f4d69417c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:03.198852 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8aa797-d0a0-495b-a33c-8f4d69417c7c admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:03.199887 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8aa797-d0a0-495b-a33c-8f4d69417c7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:34:03.200458 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8aa797-d0a0-495b-a33c-8f4d69417c7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:03.202305 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8aa797-d0a0-495b-a33c-8f4d69417c7c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:03.215782 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3289/6608] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:34:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:34:03.220508 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8aa797-d0a0-495b-a33c-8f4d69417c7c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:03.231062 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8aa797-d0a0-495b-a33c-8f4d69417c7c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:03.276676 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d9744-cafa-4c2c-acad-b0401ad13b4c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:03.294902 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca6e11-25bd-458a-a005-3f6f9d031f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:03.296049 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca6e11-25bd-458a-a005-3f6f9d031f26 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:03.296714 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca6e11-25bd-458a-a005-3f6f9d031f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:03.296849 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca6e11-25bd-458a-a005-3f6f9d031f26 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:03.297656 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca6e11-25bd-458a-a005-3f6f9d031f26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:03.299820 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca6e11-25bd-458a-a005-3f6f9d031f26 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:03.331789 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0fc43-afb5-4ba1-8a57-426ed3cdd8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:03.332919 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0fc43-afb5-4ba1-8a57-426ed3cdd8c3 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:03.334750 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0fc43-afb5-4ba1-8a57-426ed3cdd8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:03.334750 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0fc43-afb5-4ba1-8a57-426ed3cdd8c3 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:03.335152 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db0fc43-afb5-4ba1-8a57-426ed3cdd8c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:03.340134 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db0fc43-afb5-4ba1-8a57-426ed3cdd8c3 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:03.420682 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3320/6609] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:34:03 2022] POST /identity/v3/users => generated 289 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:34:03.420682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca6e11-25bd-458a-a005-3f6f9d031f26 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:03.428116 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca6e11-25bd-458a-a005-3f6f9d031f26 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:03.434036 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58973c-f022-4de1-8686-613ac2d194e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:03.438084 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58973c-f022-4de1-8686-613ac2d194e0 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:03.438084 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58973c-f022-4de1-8686-613ac2d194e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:03.438084 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58973c-f022-4de1-8686-613ac2d194e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:03.438084 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f58973c-f022-4de1-8686-613ac2d194e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:03.438084 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f58973c-f022-4de1-8686-613ac2d194e0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:03.440690 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3290/6610] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:34:03 2022] POST /identity/v3/users => generated 287 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:34:03.441821 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0fc43-afb5-4ba1-8a57-426ed3cdd8c3 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:03.452418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0fc43-afb5-4ba1-8a57-426ed3cdd8c3 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:03.457161 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37290b09-a1d0-4352-a616-ecaf6d1c6563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:03.460787 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37290b09-a1d0-4352-a616-ecaf6d1c6563 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:03.460787 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37290b09-a1d0-4352-a616-ecaf6d1c6563 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:03.460787 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37290b09-a1d0-4352-a616-ecaf6d1c6563 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:03.460787 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37290b09-a1d0-4352-a616-ecaf6d1c6563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:03.461156 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37290b09-a1d0-4352-a616-ecaf6d1c6563 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:03.471053 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3291/6611] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:34:03.472144 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37290b09-a1d0-4352-a616-ecaf6d1c6563 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:03.484012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37290b09-a1d0-4352-a616-ecaf6d1c6563 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:03.489026 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05bf948-dce4-453b-b3d9-44e23023b1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:03.489681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bf948-dce4-453b-b3d9-44e23023b1fd admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:03.490014 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bf948-dce4-453b-b3d9-44e23023b1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:03.490295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bf948-dce4-453b-b3d9-44e23023b1fd admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:03.491012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05bf948-dce4-453b-b3d9-44e23023b1fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:03.492657 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05bf948-dce4-453b-b3d9-44e23023b1fd admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:03.503892 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3292/6612] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:34:03.504676 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05bf948-dce4-453b-b3d9-44e23023b1fd admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:03.514070 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05bf948-dce4-453b-b3d9-44e23023b1fd admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:03.518741 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d1d72-4f71-4ede-b501-a090fb6b0702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:03.519382 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d1d72-4f71-4ede-b501-a090fb6b0702 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:03.519667 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d1d72-4f71-4ede-b501-a090fb6b0702 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:03.520269 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d1d72-4f71-4ede-b501-a090fb6b0702 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:03.520646 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d1d72-4f71-4ede-b501-a090fb6b0702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:03.522283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d1d72-4f71-4ede-b501-a090fb6b0702 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:03.537622 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3293/6613] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:34:03.538702 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d1d72-4f71-4ede-b501-a090fb6b0702 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:03.551213 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d1d72-4f71-4ede-b501-a090fb6b0702 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:03.556939 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9da3b4-95a5-4265-bcb6-8205076ea041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:03.557621 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9da3b4-95a5-4265-bcb6-8205076ea041 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:03.557939 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9da3b4-95a5-4265-bcb6-8205076ea041 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:03.558228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9da3b4-95a5-4265-bcb6-8205076ea041 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:03.558953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9da3b4-95a5-4265-bcb6-8205076ea041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:03.560584 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9da3b4-95a5-4265-bcb6-8205076ea041 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:03.570693 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3294/6614] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:34:03.571501 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9da3b4-95a5-4265-bcb6-8205076ea041 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:03.583945 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9da3b4-95a5-4265-bcb6-8205076ea041 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:03.587347 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3321/6615] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:34:03 2022] POST /identity/v3/projects => generated 361 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:34:03.588361 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58973c-f022-4de1-8686-613ac2d194e0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:03.657520 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf312ef2-c6c9-4353-8e2b-93f253cacc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:03.658466 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf312ef2-c6c9-4353-8e2b-93f253cacc90 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:03.658758 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf312ef2-c6c9-4353-8e2b-93f253cacc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:03.659120 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf312ef2-c6c9-4353-8e2b-93f253cacc90 admin admin] PATH_INFO: `/v3/projects/a8277b862dc44ec4acbc06b818751991/users/b8be783f6ce04ba1830c5d260e586af0/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:03.661643 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58973c-f022-4de1-8686-613ac2d194e0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:03.668547 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13cfb9c-0951-4489-aef9-60e2def9878d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:03.671253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cfb9c-0951-4489-aef9-60e2def9878d admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:03.671253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cfb9c-0951-4489-aef9-60e2def9878d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:03.671253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cfb9c-0951-4489-aef9-60e2def9878d admin admin] PATH_INFO: `/v3/projects/45da23cdd94348df9d029194fb4a220e/users/d5d79bdadb2d403eaebfd59b972333b0/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:03.677008 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf312ef2-c6c9-4353-8e2b-93f253cacc90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8277b862dc44ec4acbc06b818751991, user_id=b8be783f6ce04ba1830c5d260e586af0, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:03.680672 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf312ef2-c6c9-4353-8e2b-93f253cacc90 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:03.686286 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13cfb9c-0951-4489-aef9-60e2def9878d admin admin] RBAC: Authorizing `identity:create_grant(project_id=45da23cdd94348df9d029194fb4a220e, user_id=d5d79bdadb2d403eaebfd59b972333b0, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:03.689017 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13cfb9c-0951-4489-aef9-60e2def9878d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:03.783392 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3295/6616] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:34:03 2022] PUT /identity/v3/projects/a8277b862dc44ec4acbc06b818751991/users/b8be783f6ce04ba1830c5d260e586af0/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:34:03.784384 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf312ef2-c6c9-4353-8e2b-93f253cacc90 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:03.805054 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3322/6617] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:34:03 2022] PUT /identity/v3/projects/45da23cdd94348df9d029194fb4a220e/users/d5d79bdadb2d403eaebfd59b972333b0/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:34:03.806420 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af671b-cd76-404b-b0f8-cf16d610e27e None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:03.817835 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af671b-cd76-404b-b0f8-cf16d610e27e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:03.817835 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af671b-cd76-404b-b0f8-cf16d610e27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:03.843271 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-c9af671b-cd76-404b-b0f8-cf16d610e27e None None] MFA Rules not processed for user `b8be783f6ce04ba1830c5d260e586af0`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:03.855236 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c9af671b-cd76-404b-b0f8-cf16d610e27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:03.878287 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf312ef2-c6c9-4353-8e2b-93f253cacc90 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:03.919679 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3323/6618] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:03.919679 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa97fde-f6c6-4b5e-a1bf-7baba222c5a8 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:03.919679 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa97fde-f6c6-4b5e-a1bf-7baba222c5a8 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:03.919679 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa97fde-f6c6-4b5e-a1bf-7baba222c5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:03.951581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-bfa97fde-f6c6-4b5e-a1bf-7baba222c5a8 None None] MFA Rules not processed for user `d5d79bdadb2d403eaebfd59b972333b0`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:03.953098 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cba895-0872-4e7f-9d8e-688cf495eac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:03.953828 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-bfa97fde-f6c6-4b5e-a1bf-7baba222c5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:03.954054 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cba895-0872-4e7f-9d8e-688cf495eac3 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:03.954054 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cba895-0872-4e7f-9d8e-688cf495eac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:03.954280 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cba895-0872-4e7f-9d8e-688cf495eac3 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:03.955052 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cba895-0872-4e7f-9d8e-688cf495eac3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:03.957480 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cba895-0872-4e7f-9d8e-688cf495eac3 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:04.032193 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3324/6619] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:04.033059 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa97fde-f6c6-4b5e-a1bf-7baba222c5a8 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:04.034380 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-bfa97fde-f6c6-4b5e-a1bf-7baba222c5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:04.045823 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3296/6620] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:34:03 2022] POST /identity/v3/users => generated 281 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:34:04.046902 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cba895-0872-4e7f-9d8e-688cf495eac3 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:04.059935 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cba895-0872-4e7f-9d8e-688cf495eac3 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:04.067562 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f47757-5a5f-4468-8804-797860524fb0 tempest-DefaultDomainTestJSON-1077178 tempest-DefaultDomainTestJSON-1077178-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5d79bdadb2d403eaebfd59b972333b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45da23cdd94348df9d029194fb4a220e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:04.068840 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f47757-5a5f-4468-8804-797860524fb0 tempest-DefaultDomainTestJSON-1077178 tempest-DefaultDomainTestJSON-1077178-project] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:04.069049 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f47757-5a5f-4468-8804-797860524fb0 tempest-DefaultDomainTestJSON-1077178 tempest-DefaultDomainTestJSON-1077178-project] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:04.075895 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f47757-5a5f-4468-8804-797860524fb0 tempest-DefaultDomainTestJSON-1077178 tempest-DefaultDomainTestJSON-1077178-project] PATH_INFO: `/v3/domains/default` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:04.078447 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f47757-5a5f-4468-8804-797860524fb0 tempest-DefaultDomainTestJSON-1077178 tempest-DefaultDomainTestJSON-1077178-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:04.080402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f47757-5a5f-4468-8804-797860524fb0 tempest-DefaultDomainTestJSON-1077178 tempest-DefaultDomainTestJSON-1077178-project] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:04.082641 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3297/6621] 10.222.0.23 () {58 vars in 1151 bytes} [Sat Apr 30 21:34:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:34:04.083355 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f47757-5a5f-4468-8804-797860524fb0 tempest-DefaultDomainTestJSON-1077178 tempest-DefaultDomainTestJSON-1077178-project] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:04.096211 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f47757-5a5f-4468-8804-797860524fb0 tempest-DefaultDomainTestJSON-1077178 tempest-DefaultDomainTestJSON-1077178-project] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:04.101662 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1474363-a4f2-4573-a0fd-c4e9e3f9fb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:04.102494 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1474363-a4f2-4573-a0fd-c4e9e3f9fb4b admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:04.102900 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1474363-a4f2-4573-a0fd-c4e9e3f9fb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:04.103828 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1474363-a4f2-4573-a0fd-c4e9e3f9fb4b admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:04.104799 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1474363-a4f2-4573-a0fd-c4e9e3f9fb4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:04.106722 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1474363-a4f2-4573-a0fd-c4e9e3f9fb4b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:04.120232 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3298/6622] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:34:04.120232 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1474363-a4f2-4573-a0fd-c4e9e3f9fb4b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:04.121089 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa97fde-f6c6-4b5e-a1bf-7baba222c5a8 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:04.125310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ed553-96db-4301-ab72-8d0b249b2ac3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:04.126212 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ed553-96db-4301-ab72-8d0b249b2ac3 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:04.126512 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ed553-96db-4301-ab72-8d0b249b2ac3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:04.126875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ed553-96db-4301-ab72-8d0b249b2ac3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:04.131453 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1474363-a4f2-4573-a0fd-c4e9e3f9fb4b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:04.143005 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ed553-96db-4301-ab72-8d0b249b2ac3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:04.145269 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ed553-96db-4301-ab72-8d0b249b2ac3 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:04.156571 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b642702-0725-4aac-8eee-68e8bd91fcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:04.158259 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b642702-0725-4aac-8eee-68e8bd91fcbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:04.158703 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b642702-0725-4aac-8eee-68e8bd91fcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:04.159163 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b642702-0725-4aac-8eee-68e8bd91fcbe admin admin] PATH_INFO: `/v3/users/d5d79bdadb2d403eaebfd59b972333b0` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:04.160577 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b642702-0725-4aac-8eee-68e8bd91fcbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5d79bdadb2d403eaebfd59b972333b0)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:04.162946 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b642702-0725-4aac-8eee-68e8bd91fcbe admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:04.171164 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3325/6623] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:34:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:34:04.177427 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ed553-96db-4301-ab72-8d0b249b2ac3 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:04.198318 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ed553-96db-4301-ab72-8d0b249b2ac3 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:04.208601 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1acb1-76de-4707-8576-6dd8b932f56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:04.210156 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1acb1-76de-4707-8576-6dd8b932f56f admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:04.210598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1acb1-76de-4707-8576-6dd8b932f56f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:04.213672 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1acb1-76de-4707-8576-6dd8b932f56f admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:04.213672 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a1acb1-76de-4707-8576-6dd8b932f56f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:04.214089 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a1acb1-76de-4707-8576-6dd8b932f56f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:04.233437 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3326/6624] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:34:04.233437 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1acb1-76de-4707-8576-6dd8b932f56f admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:04.245470 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1acb1-76de-4707-8576-6dd8b932f56f admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:04.251303 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d3bd4-9538-4517-84df-dac2acd93391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:04.252312 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d3bd4-9538-4517-84df-dac2acd93391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:04.253044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d3bd4-9538-4517-84df-dac2acd93391 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:04.253514 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d3bd4-9538-4517-84df-dac2acd93391 admin admin] PATH_INFO: `/v3/users/b8be783f6ce04ba1830c5d260e586af0` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:04.254789 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d3bd4-9538-4517-84df-dac2acd93391 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8be783f6ce04ba1830c5d260e586af0)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:04.257157 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d3bd4-9538-4517-84df-dac2acd93391 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:04.430776 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6b642702-0725-4aac-8eee-68e8bd91fcbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5d79bdadb2d403eaebfd59b972333b0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:04.447177 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6b642702-0725-4aac-8eee-68e8bd91fcbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5d79bdadb2d403eaebfd59b972333b0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:04.538671 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-991d3bd4-9538-4517-84df-dac2acd93391 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8be783f6ce04ba1830c5d260e586af0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:04.552844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-991d3bd4-9538-4517-84df-dac2acd93391 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8be783f6ce04ba1830c5d260e586af0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:04.570687 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6b642702-0725-4aac-8eee-68e8bd91fcbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5d79bdadb2d403eaebfd59b972333b0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:04.571437 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6b642702-0725-4aac-8eee-68e8bd91fcbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5d79bdadb2d403eaebfd59b972333b0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:04.591445 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6b642702-0725-4aac-8eee-68e8bd91fcbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5d79bdadb2d403eaebfd59b972333b0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:04.602764 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3299/6625] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:34:04 2022] DELETE /identity/v3/users/d5d79bdadb2d403eaebfd59b972333b0 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:34:04.603744 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b642702-0725-4aac-8eee-68e8bd91fcbe admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:04.605152 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6b642702-0725-4aac-8eee-68e8bd91fcbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:04.676424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b642702-0725-4aac-8eee-68e8bd91fcbe admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:04.681591 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee6c83-1cc0-4bb4-8d2e-49d297800a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:04.682515 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee6c83-1cc0-4bb4-8d2e-49d297800a3a admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:04.682800 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee6c83-1cc0-4bb4-8d2e-49d297800a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:04.683076 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee6c83-1cc0-4bb4-8d2e-49d297800a3a admin admin] PATH_INFO: `/v3/projects/0b290be8f5354a0cbfa5a80c43108d0f/users/8dce43c992e940938369490d6c20dfdb/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:04.699844 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee6c83-1cc0-4bb4-8d2e-49d297800a3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b290be8f5354a0cbfa5a80c43108d0f, user_id=8dce43c992e940938369490d6c20dfdb, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:04.702612 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee6c83-1cc0-4bb4-8d2e-49d297800a3a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:04.713773 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-991d3bd4-9538-4517-84df-dac2acd93391 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8be783f6ce04ba1830c5d260e586af0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:04.721919 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-991d3bd4-9538-4517-84df-dac2acd93391 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8be783f6ce04ba1830c5d260e586af0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:04.722570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-991d3bd4-9538-4517-84df-dac2acd93391 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8be783f6ce04ba1830c5d260e586af0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:04.729017 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3327/6626] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:34:04 2022] DELETE /identity/v3/users/b8be783f6ce04ba1830c5d260e586af0 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:34:04.733148 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8c394-edbd-4594-8feb-7e3b2cf2fac1 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:04.733467 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8c394-edbd-4594-8feb-7e3b2cf2fac1 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:04.733730 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8c394-edbd-4594-8feb-7e3b2cf2fac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:04.754054 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-73a8c394-edbd-4594-8feb-7e3b2cf2fac1 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:04.755195 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-73a8c394-edbd-4594-8feb-7e3b2cf2fac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:04.810492 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3300/6627] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:34:04 2022] PUT /identity/v3/projects/0b290be8f5354a0cbfa5a80c43108d0f/users/8dce43c992e940938369490d6c20dfdb/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:34:04.811783 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13560edb-1206-4bad-ac20-84bb82a87946 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:04.812081 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13560edb-1206-4bad-ac20-84bb82a87946 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:04.812357 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13560edb-1206-4bad-ac20-84bb82a87946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:04.841058 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-13560edb-1206-4bad-ac20-84bb82a87946 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:04.843095 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-13560edb-1206-4bad-ac20-84bb82a87946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:04.846059 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3328/6628] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:04.859232 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8c394-edbd-4594-8feb-7e3b2cf2fac1 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:04.861278 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-73a8c394-edbd-4594-8feb-7e3b2cf2fac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:04.914833 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3301/6629] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:04.914833 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779ad30-33b5-42c2-bb32-97f626e99f05 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:04.914833 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779ad30-33b5-42c2-bb32-97f626e99f05 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:04.914833 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779ad30-33b5-42c2-bb32-97f626e99f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:04.941128 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8c394-edbd-4594-8feb-7e3b2cf2fac1 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:04.943167 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-b779ad30-33b5-42c2-bb32-97f626e99f05 None None] MFA Rules not processed for user `8dce43c992e940938369490d6c20dfdb`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:04.944475 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b779ad30-33b5-42c2-bb32-97f626e99f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:05.017611 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3302/6630] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:04 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:05.018735 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779ad30-33b5-42c2-bb32-97f626e99f05 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:05.021868 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2897056-a0f7-4dbb-9f5f-62cbde9d7853 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:05.022642 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2897056-a0f7-4dbb-9f5f-62cbde9d7853 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:05.026235 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2897056-a0f7-4dbb-9f5f-62cbde9d7853 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:05.031934 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2897056-a0f7-4dbb-9f5f-62cbde9d7853 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:05.033202 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779ad30-33b5-42c2-bb32-97f626e99f05 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:05.037791 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e126369-1e00-44c7-9ab4-3d1eeb37f940 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:05.038540 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e126369-1e00-44c7-9ab4-3d1eeb37f940 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:05.039223 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e126369-1e00-44c7-9ab4-3d1eeb37f940 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:05.039223 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e126369-1e00-44c7-9ab4-3d1eeb37f940 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:05.042124 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2897056-a0f7-4dbb-9f5f-62cbde9d7853 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:05.044903 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2897056-a0f7-4dbb-9f5f-62cbde9d7853 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:05.050957 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e126369-1e00-44c7-9ab4-3d1eeb37f940 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:05.052601 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e126369-1e00-44c7-9ab4-3d1eeb37f940 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:05.058182 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3329/6631] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:34:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:34:05.059646 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2897056-a0f7-4dbb-9f5f-62cbde9d7853 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:05.061650 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e2897056-a0f7-4dbb-9f5f-62cbde9d7853 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:05.063765 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3303/6632] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:34:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:34:05.076408 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2897056-a0f7-4dbb-9f5f-62cbde9d7853 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:05.081285 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b97f3d-40f3-4639-bcd8-386bc5c05a56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:05.082175 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b97f3d-40f3-4639-bcd8-386bc5c05a56 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:05.082647 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b97f3d-40f3-4639-bcd8-386bc5c05a56 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:05.082931 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b97f3d-40f3-4639-bcd8-386bc5c05a56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:05.093410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b97f3d-40f3-4639-bcd8-386bc5c05a56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:05.095009 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b97f3d-40f3-4639-bcd8-386bc5c05a56 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:05.108280 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3330/6633] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:34:05 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:34:05.982340 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e126369-1e00-44c7-9ab4-3d1eeb37f940 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:05.984787 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4e126369-1e00-44c7-9ab4-3d1eeb37f940 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:06.008275 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e126369-1e00-44c7-9ab4-3d1eeb37f940 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:06.023122 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9089a56-5dec-41e8-826f-6f81c553a9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:06.024028 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9089a56-5dec-41e8-826f-6f81c553a9f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:06.024303 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9089a56-5dec-41e8-826f-6f81c553a9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:06.024574 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9089a56-5dec-41e8-826f-6f81c553a9f8 admin admin] PATH_INFO: `/v3/projects/45da23cdd94348df9d029194fb4a220e` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:06.028564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9089a56-5dec-41e8-826f-6f81c553a9f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45da23cdd94348df9d029194fb4a220e)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:06.037892 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9089a56-5dec-41e8-826f-6f81c553a9f8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:06.108513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b97f3d-40f3-4639-bcd8-386bc5c05a56 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:06.111540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b5b97f3d-40f3-4639-bcd8-386bc5c05a56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:06.146075 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b97f3d-40f3-4639-bcd8-386bc5c05a56 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:06.163591 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5faf4ef-65ed-4b71-b1b0-ebd250d7e97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:06.164540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5faf4ef-65ed-4b71-b1b0-ebd250d7e97f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:06.164832 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5faf4ef-65ed-4b71-b1b0-ebd250d7e97f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:06.165231 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5faf4ef-65ed-4b71-b1b0-ebd250d7e97f admin admin] PATH_INFO: `/v3/projects/a8277b862dc44ec4acbc06b818751991` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:06.171534 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5faf4ef-65ed-4b71-b1b0-ebd250d7e97f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8277b862dc44ec4acbc06b818751991)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:06.173685 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5faf4ef-65ed-4b71-b1b0-ebd250d7e97f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:06.232727 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a9089a56-5dec-41e8-826f-6f81c553a9f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45da23cdd94348df9d029194fb4a220e', 'request_id': 'req-a9089a56-5dec-41e8-826f-6f81c553a9f8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:06.250371 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a9089a56-5dec-41e8-826f-6f81c553a9f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45da23cdd94348df9d029194fb4a220e', 'request_id': 'req-a9089a56-5dec-41e8-826f-6f81c553a9f8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:06.264655 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a9089a56-5dec-41e8-826f-6f81c553a9f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45da23cdd94348df9d029194fb4a220e', 'request_id': 'req-a9089a56-5dec-41e8-826f-6f81c553a9f8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:06.379392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a9089a56-5dec-41e8-826f-6f81c553a9f8 admin admin] The token cache is being invalidate because project 45da23cdd94348df9d029194fb4a220e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:34:06.380548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a9089a56-5dec-41e8-826f-6f81c553a9f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:06.386363 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a9089a56-5dec-41e8-826f-6f81c553a9f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:06.390297 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3304/6634] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:34:05 2022] DELETE /identity/v3/projects/45da23cdd94348df9d029194fb4a220e => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:34:06.396195 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dafad3-578d-4cd3-aa2c-9f5a31ad9335 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:06.398004 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dafad3-578d-4cd3-aa2c-9f5a31ad9335 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:06.398482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dafad3-578d-4cd3-aa2c-9f5a31ad9335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:06.415996 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a5faf4ef-65ed-4b71-b1b0-ebd250d7e97f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8277b862dc44ec4acbc06b818751991', 'request_id': 'req-a5faf4ef-65ed-4b71-b1b0-ebd250d7e97f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:06.435000 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-30dafad3-578d-4cd3-aa2c-9f5a31ad9335 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:06.437157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-30dafad3-578d-4cd3-aa2c-9f5a31ad9335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:06.440193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a5faf4ef-65ed-4b71-b1b0-ebd250d7e97f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8277b862dc44ec4acbc06b818751991', 'request_id': 'req-a5faf4ef-65ed-4b71-b1b0-ebd250d7e97f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:06.451160 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a5faf4ef-65ed-4b71-b1b0-ebd250d7e97f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8277b862dc44ec4acbc06b818751991', 'request_id': 'req-a5faf4ef-65ed-4b71-b1b0-ebd250d7e97f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:06.523817 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3305/6635] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:06.531661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1772b-1f21-4b73-b91e-b5662ab48c26 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:06.532210 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1772b-1f21-4b73-b91e-b5662ab48c26 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:06.532676 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1772b-1f21-4b73-b91e-b5662ab48c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:06.554392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-85e1772b-1f21-4b73-b91e-b5662ab48c26 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:06.555691 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-85e1772b-1f21-4b73-b91e-b5662ab48c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:06.564963 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a5faf4ef-65ed-4b71-b1b0-ebd250d7e97f admin admin] The token cache is being invalidate because project a8277b862dc44ec4acbc06b818751991 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:34:06.565845 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a5faf4ef-65ed-4b71-b1b0-ebd250d7e97f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:06.569970 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a5faf4ef-65ed-4b71-b1b0-ebd250d7e97f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:06.569970 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3331/6636] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:34:06 2022] DELETE /identity/v3/projects/a8277b862dc44ec4acbc06b818751991 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:34:06.574169 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3306/6637] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:06.575367 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1772b-1f21-4b73-b91e-b5662ab48c26 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:06.576790 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4f8ab-0950-459f-b9e1-70d4ffc1ac10 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:06.577091 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4f8ab-0950-459f-b9e1-70d4ffc1ac10 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:06.577377 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4f8ab-0950-459f-b9e1-70d4ffc1ac10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:06.590409 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1772b-1f21-4b73-b91e-b5662ab48c26 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:06.598047 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097d639-1683-4fe1-b74b-177ba5e1adb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:06.603910 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-b6b4f8ab-0950-459f-b9e1-70d4ffc1ac10 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:06.604182 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097d639-1683-4fe1-b74b-177ba5e1adb8 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:06.604182 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097d639-1683-4fe1-b74b-177ba5e1adb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:06.604182 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097d639-1683-4fe1-b74b-177ba5e1adb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:06.604388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b6b4f8ab-0950-459f-b9e1-70d4ffc1ac10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:06.604485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6097d639-1683-4fe1-b74b-177ba5e1adb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:34:06.604485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6097d639-1683-4fe1-b74b-177ba5e1adb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:06.604485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6097d639-1683-4fe1-b74b-177ba5e1adb8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:06.609238 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3332/6638] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:34:06.616935 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ad911-7993-4dc6-9128-cae0e951069e None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:06.617125 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ad911-7993-4dc6-9128-cae0e951069e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:06.617410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ad911-7993-4dc6-9128-cae0e951069e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:06.620281 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3307/6639] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:34:06.624315 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097d639-1683-4fe1-b74b-177ba5e1adb8 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:06.626110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6097d639-1683-4fe1-b74b-177ba5e1adb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:06.640694 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097d639-1683-4fe1-b74b-177ba5e1adb8 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:06.648741 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-623ad911-7993-4dc6-9128-cae0e951069e None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:06.650294 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-623ad911-7993-4dc6-9128-cae0e951069e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:06.651371 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3207c93-4a03-4b26-b6b7-9e1e2410cb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:06.652236 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3207c93-4a03-4b26-b6b7-9e1e2410cb9f admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:06.652489 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3207c93-4a03-4b26-b6b7-9e1e2410cb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:06.652881 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3207c93-4a03-4b26-b6b7-9e1e2410cb9f admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:06.653591 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3207c93-4a03-4b26-b6b7-9e1e2410cb9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:06.656535 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3207c93-4a03-4b26-b6b7-9e1e2410cb9f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:06.662954 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3333/6640] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:06.673522 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ad911-7993-4dc6-9128-cae0e951069e None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:06.685071 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ad911-7993-4dc6-9128-cae0e951069e None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:06.691998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea642d9-2c1d-4f0b-8924-81ab39a8f040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:06.692744 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea642d9-2c1d-4f0b-8924-81ab39a8f040 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:06.695721 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea642d9-2c1d-4f0b-8924-81ab39a8f040 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:06.695721 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea642d9-2c1d-4f0b-8924-81ab39a8f040 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:06.695721 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea642d9-2c1d-4f0b-8924-81ab39a8f040 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:34:06.695721 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea642d9-2c1d-4f0b-8924-81ab39a8f040 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:06.697474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea642d9-2c1d-4f0b-8924-81ab39a8f040 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:06.725967 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3334/6641] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:34:06.727245 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea642d9-2c1d-4f0b-8924-81ab39a8f040 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:06.738206 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea642d9-2c1d-4f0b-8924-81ab39a8f040 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:06.746624 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393a943-dea4-49ec-a45c-06aec50c84e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:06.747677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393a943-dea4-49ec-a45c-06aec50c84e7 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:06.748165 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393a943-dea4-49ec-a45c-06aec50c84e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:06.748463 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393a943-dea4-49ec-a45c-06aec50c84e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:06.749218 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c393a943-dea4-49ec-a45c-06aec50c84e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:06.751204 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c393a943-dea4-49ec-a45c-06aec50c84e7 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:06.785784 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3308/6642] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:34:06 2022] POST /identity/v3/projects => generated 393 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:34:06.789717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3207c93-4a03-4b26-b6b7-9e1e2410cb9f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:06.880149 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3335/6643] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:34:06 2022] POST /identity/v3/projects => generated 373 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:34:06.881531 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393a943-dea4-49ec-a45c-06aec50c84e7 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:06.912243 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3207c93-4a03-4b26-b6b7-9e1e2410cb9f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:06.967607 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393a943-dea4-49ec-a45c-06aec50c84e7 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:06.973421 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b61af-016c-4b8b-8d99-da01c5085507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:06.974131 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b61af-016c-4b8b-8d99-da01c5085507 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:06.974526 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b61af-016c-4b8b-8d99-da01c5085507 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:06.975107 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b61af-016c-4b8b-8d99-da01c5085507 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:06.975857 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b61af-016c-4b8b-8d99-da01c5085507 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:06.978707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b61af-016c-4b8b-8d99-da01c5085507 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:06.993199 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f4138-6360-4872-819b-ee876568395c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:06.994740 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f4138-6360-4872-819b-ee876568395c admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:06.995263 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f4138-6360-4872-819b-ee876568395c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:06.995552 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f4138-6360-4872-819b-ee876568395c admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:06.996306 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f4138-6360-4872-819b-ee876568395c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:06.998379 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f4138-6360-4872-819b-ee876568395c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:07.134493 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3336/6644] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:34:06 2022] POST /identity/v3/users => generated 287 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:34:07.135543 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b61af-016c-4b8b-8d99-da01c5085507 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:07.145358 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b61af-016c-4b8b-8d99-da01c5085507 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:07.152464 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e052a-8aa6-490e-8817-fdbf30c545ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:07.153501 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e052a-8aa6-490e-8817-fdbf30c545ad admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:07.153816 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e052a-8aa6-490e-8817-fdbf30c545ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:07.154101 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e052a-8aa6-490e-8817-fdbf30c545ad admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:07.155115 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1e052a-8aa6-490e-8817-fdbf30c545ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:07.156768 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1e052a-8aa6-490e-8817-fdbf30c545ad admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:07.171901 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3337/6645] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:34:07.172710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e052a-8aa6-490e-8817-fdbf30c545ad admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:07.183584 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e052a-8aa6-490e-8817-fdbf30c545ad admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:07.188467 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87679344-80bc-41ea-82a0-6eac5075b224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:07.189252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87679344-80bc-41ea-82a0-6eac5075b224 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:07.189539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87679344-80bc-41ea-82a0-6eac5075b224 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:07.189996 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87679344-80bc-41ea-82a0-6eac5075b224 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:07.190779 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87679344-80bc-41ea-82a0-6eac5075b224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:07.192332 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3309/6646] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:34:06 2022] POST /identity/v3/users => generated 303 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:34:07.192748 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87679344-80bc-41ea-82a0-6eac5075b224 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:07.193135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f4138-6360-4872-819b-ee876568395c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:07.204293 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f4138-6360-4872-819b-ee876568395c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:07.205177 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3338/6647] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:34:07.209095 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87679344-80bc-41ea-82a0-6eac5075b224 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:07.212723 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec948b-1409-4386-99be-504e569535b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:07.213409 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec948b-1409-4386-99be-504e569535b3 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:07.213697 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec948b-1409-4386-99be-504e569535b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:07.214010 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec948b-1409-4386-99be-504e569535b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:07.214749 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec948b-1409-4386-99be-504e569535b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:07.216379 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec948b-1409-4386-99be-504e569535b3 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:07.220780 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87679344-80bc-41ea-82a0-6eac5075b224 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:07.226559 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d01f4e-a25a-4903-b72a-422464c2b2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:07.228688 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3310/6648] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:34:07.228800 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d01f4e-a25a-4903-b72a-422464c2b2f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:07.228800 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d01f4e-a25a-4903-b72a-422464c2b2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:07.228800 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d01f4e-a25a-4903-b72a-422464c2b2f6 admin admin] PATH_INFO: `/v3/projects/e755f57c175e43d7b08df778af0e3b04/users/7195793f260a45659c4c2ca5feb83928/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:07.233117 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec948b-1409-4386-99be-504e569535b3 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:07.242627 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec948b-1409-4386-99be-504e569535b3 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:07.244731 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d01f4e-a25a-4903-b72a-422464c2b2f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e755f57c175e43d7b08df778af0e3b04, user_id=7195793f260a45659c4c2ca5feb83928, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:07.247432 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d01f4e-a25a-4903-b72a-422464c2b2f6 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:07.247552 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb73634-4d75-49f6-b4f0-e9b2b5cabedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:07.248724 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb73634-4d75-49f6-b4f0-e9b2b5cabedd admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:07.248892 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb73634-4d75-49f6-b4f0-e9b2b5cabedd admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:07.253805 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb73634-4d75-49f6-b4f0-e9b2b5cabedd admin admin] PATH_INFO: `/v3/projects/9b2cbe8cba4b45d9ae35131f8555e105/users/5e50f6997cd545fe9e4b0e74c0d18996/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:07.265663 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb73634-4d75-49f6-b4f0-e9b2b5cabedd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b2cbe8cba4b45d9ae35131f8555e105, user_id=5e50f6997cd545fe9e4b0e74c0d18996, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:07.268422 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb73634-4d75-49f6-b4f0-e9b2b5cabedd admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:07.338175 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3339/6649] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:34:07 2022] PUT /identity/v3/projects/e755f57c175e43d7b08df778af0e3b04/users/7195793f260a45659c4c2ca5feb83928/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:34:07.343752 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef384e-0598-4365-bf55-181b9ce4cca8 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:07.344050 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef384e-0598-4365-bf55-181b9ce4cca8 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:07.344339 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef384e-0598-4365-bf55-181b9ce4cca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:07.376219 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-91ef384e-0598-4365-bf55-181b9ce4cca8 None None] MFA Rules not processed for user `7195793f260a45659c4c2ca5feb83928`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:07.377450 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-91ef384e-0598-4365-bf55-181b9ce4cca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:07.400267 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3311/6650] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:34:07 2022] PUT /identity/v3/projects/9b2cbe8cba4b45d9ae35131f8555e105/users/5e50f6997cd545fe9e4b0e74c0d18996/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:34:07.406879 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb73634-4d75-49f6-b4f0-e9b2b5cabedd admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:07.518584 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb73634-4d75-49f6-b4f0-e9b2b5cabedd admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:07.533110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fdc43b-d106-4aea-a816-38cacce0b069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:07.534116 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fdc43b-d106-4aea-a816-38cacce0b069 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:07.534552 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fdc43b-d106-4aea-a816-38cacce0b069 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:07.535034 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fdc43b-d106-4aea-a816-38cacce0b069 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:07.536001 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fdc43b-d106-4aea-a816-38cacce0b069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:07.539573 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fdc43b-d106-4aea-a816-38cacce0b069 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:07.553012 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3340/6651] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:34:07.558190 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef384e-0598-4365-bf55-181b9ce4cca8 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:07.565122 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3312/6652] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:34:07.569065 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fdc43b-d106-4aea-a816-38cacce0b069 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:07.594623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fdc43b-d106-4aea-a816-38cacce0b069 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:07.608252 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68f248-e16a-45f9-a0de-09da494bd8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:07.609737 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68f248-e16a-45f9-a0de-09da494bd8f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:07.610202 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68f248-e16a-45f9-a0de-09da494bd8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:07.610639 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68f248-e16a-45f9-a0de-09da494bd8f5 admin admin] PATH_INFO: `/v3/projects/9b2cbe8cba4b45d9ae35131f8555e105/users/5e50f6997cd545fe9e4b0e74c0d18996/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:07.616439 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd68f248-e16a-45f9-a0de-09da494bd8f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b2cbe8cba4b45d9ae35131f8555e105, user_id=5e50f6997cd545fe9e4b0e74c0d18996, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:07.628831 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd68f248-e16a-45f9-a0de-09da494bd8f5 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:07.650625 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3313/6653] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:34:07 2022] PUT /identity/v3/projects/9b2cbe8cba4b45d9ae35131f8555e105/users/5e50f6997cd545fe9e4b0e74c0d18996/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:34:07.661525 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6d602-33c1-413b-8b14-334bf6b9601e None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:07.662514 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6d602-33c1-413b-8b14-334bf6b9601e None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:07.662963 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6d602-33c1-413b-8b14-334bf6b9601e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:07.711613 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-39c6d602-33c1-413b-8b14-334bf6b9601e None None] MFA Rules not processed for user `5e50f6997cd545fe9e4b0e74c0d18996`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:07.721567 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-39c6d602-33c1-413b-8b14-334bf6b9601e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:07.819392 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef384e-0598-4365-bf55-181b9ce4cca8 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:07.839788 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3314/6654] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:07 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:34:07.840788 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6d602-33c1-413b-8b14-334bf6b9601e None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:07.896532 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a3003-bb13-4aeb-a78d-4f12313d84ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:07.897745 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a3003-bb13-4aeb-a78d-4f12313d84ee admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:07.898171 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a3003-bb13-4aeb-a78d-4f12313d84ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:07.898548 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a3003-bb13-4aeb-a78d-4f12313d84ee admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:07.899509 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a3003-bb13-4aeb-a78d-4f12313d84ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:07.902581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a3003-bb13-4aeb-a78d-4f12313d84ee admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:07.941406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6d602-33c1-413b-8b14-334bf6b9601e None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:07.950503 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe160f-395c-49f9-b6eb-caeb0d50a6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:07.951238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe160f-395c-49f9-b6eb-caeb0d50a6af admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:07.951524 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe160f-395c-49f9-b6eb-caeb0d50a6af admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:07.951805 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe160f-395c-49f9-b6eb-caeb0d50a6af admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:07.952559 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe160f-395c-49f9-b6eb-caeb0d50a6af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:07.955471 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe160f-395c-49f9-b6eb-caeb0d50a6af admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:07.999565 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3341/6655] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:34:07 2022] POST /identity/v3/projects => generated 371 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:34:08.004719 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a3003-bb13-4aeb-a78d-4f12313d84ee admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:08.060330 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3315/6656] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:34:07 2022] POST /identity/v3/projects => generated 391 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:34:08.064760 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe160f-395c-49f9-b6eb-caeb0d50a6af admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:08.147854 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a3003-bb13-4aeb-a78d-4f12313d84ee admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:08.249633 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e358b-3b34-413d-8b16-205f47105efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:08.251058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e358b-3b34-413d-8b16-205f47105efc admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:08.251058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e358b-3b34-413d-8b16-205f47105efc admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:08.251058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e358b-3b34-413d-8b16-205f47105efc admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:08.251682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e358b-3b34-413d-8b16-205f47105efc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:08.254428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e358b-3b34-413d-8b16-205f47105efc admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:08.261319 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe160f-395c-49f9-b6eb-caeb0d50a6af admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:08.269653 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ef705-2aad-4f7e-92ef-47a0fef87770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:08.272411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ef705-2aad-4f7e-92ef-47a0fef87770 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:08.273510 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ef705-2aad-4f7e-92ef-47a0fef87770 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:08.273984 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ef705-2aad-4f7e-92ef-47a0fef87770 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:08.275706 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ef705-2aad-4f7e-92ef-47a0fef87770 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:08.279368 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ef705-2aad-4f7e-92ef-47a0fef87770 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:08.371934 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3342/6657] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:34:08 2022] POST /identity/v3/users => generated 292 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:34:08.373177 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e358b-3b34-413d-8b16-205f47105efc admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:08.384957 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e358b-3b34-413d-8b16-205f47105efc admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:08.390374 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e75e8-b6f6-4b23-b5fc-d924bde14020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:08.396701 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e75e8-b6f6-4b23-b5fc-d924bde14020 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:08.396701 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e75e8-b6f6-4b23-b5fc-d924bde14020 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:08.396701 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e75e8-b6f6-4b23-b5fc-d924bde14020 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:08.396701 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e75e8-b6f6-4b23-b5fc-d924bde14020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:08.396701 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e75e8-b6f6-4b23-b5fc-d924bde14020 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:08.397384 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3316/6658] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:34:08 2022] POST /identity/v3/users => generated 296 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:34:08.400764 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ef705-2aad-4f7e-92ef-47a0fef87770 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:08.407305 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3343/6659] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:34:08.411869 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e75e8-b6f6-4b23-b5fc-d924bde14020 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:08.413648 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ef705-2aad-4f7e-92ef-47a0fef87770 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:08.423453 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e75e8-b6f6-4b23-b5fc-d924bde14020 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:08.423643 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9b105-591c-483a-ac17-533fd5466b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:08.424209 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9b105-591c-483a-ac17-533fd5466b2b admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:08.424490 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9b105-591c-483a-ac17-533fd5466b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:08.424764 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9b105-591c-483a-ac17-533fd5466b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:08.426337 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a9b105-591c-483a-ac17-533fd5466b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:08.428612 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a9b105-591c-483a-ac17-533fd5466b2b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:08.430242 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8210b4-2323-4dd8-b3b7-44ee349279d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:08.431268 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8210b4-2323-4dd8-b3b7-44ee349279d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:08.431781 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8210b4-2323-4dd8-b3b7-44ee349279d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:08.432152 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8210b4-2323-4dd8-b3b7-44ee349279d3 admin admin] PATH_INFO: `/v3/projects/306169be24624972b5874cecf1b44d9a/users/a42271c3474340efb8ea7eb7114a3033/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:08.451844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8210b4-2323-4dd8-b3b7-44ee349279d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=306169be24624972b5874cecf1b44d9a, user_id=a42271c3474340efb8ea7eb7114a3033, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:08.457939 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8210b4-2323-4dd8-b3b7-44ee349279d3 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:08.465435 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3317/6660] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:34:08.468977 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9b105-591c-483a-ac17-533fd5466b2b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:08.483133 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9b105-591c-483a-ac17-533fd5466b2b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:08.490962 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223e32f-ca8e-4c38-b039-b1f2f7afcb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:08.491985 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223e32f-ca8e-4c38-b039-b1f2f7afcb2d admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:08.492479 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223e32f-ca8e-4c38-b039-b1f2f7afcb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:08.492943 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223e32f-ca8e-4c38-b039-b1f2f7afcb2d admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:08.493970 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2223e32f-ca8e-4c38-b039-b1f2f7afcb2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:08.496988 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2223e32f-ca8e-4c38-b039-b1f2f7afcb2d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:08.539798 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3318/6661] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:34:08.541322 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223e32f-ca8e-4c38-b039-b1f2f7afcb2d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:08.565090 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3344/6662] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:34:08 2022] PUT /identity/v3/projects/306169be24624972b5874cecf1b44d9a/users/a42271c3474340efb8ea7eb7114a3033/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:34:08.565546 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223e32f-ca8e-4c38-b039-b1f2f7afcb2d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:08.566685 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8210b4-2323-4dd8-b3b7-44ee349279d3 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:08.676998 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518e7f5-2b94-468a-9cd5-a0a35552e743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:08.678469 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518e7f5-2b94-468a-9cd5-a0a35552e743 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:08.679895 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518e7f5-2b94-468a-9cd5-a0a35552e743 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:08.682189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518e7f5-2b94-468a-9cd5-a0a35552e743 admin admin] PATH_INFO: `/v3/projects/6a729ecb44744fc7b60ab41b80b7d521/users/4030e0a7ff8a497abfe9ff96439d4899/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:08.690328 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8210b4-2323-4dd8-b3b7-44ee349279d3 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:08.698474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb2fc32-1548-4e14-a95b-b623e4fbf6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:08.699689 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2fc32-1548-4e14-a95b-b623e4fbf6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:08.700332 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2fc32-1548-4e14-a95b-b623e4fbf6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:08.700617 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2fc32-1548-4e14-a95b-b623e4fbf6a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:08.701595 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb2fc32-1548-4e14-a95b-b623e4fbf6a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:08.703305 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb2fc32-1548-4e14-a95b-b623e4fbf6a0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:08.703871 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2518e7f5-2b94-468a-9cd5-a0a35552e743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a729ecb44744fc7b60ab41b80b7d521, user_id=4030e0a7ff8a497abfe9ff96439d4899, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:08.707192 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2518e7f5-2b94-468a-9cd5-a0a35552e743 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:08.730924 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3345/6663] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:34:08.734771 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb2fc32-1548-4e14-a95b-b623e4fbf6a0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:08.748274 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb2fc32-1548-4e14-a95b-b623e4fbf6a0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:08.761478 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff785aa-1cae-450d-a3c6-9d7b2c95578b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:08.762345 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff785aa-1cae-450d-a3c6-9d7b2c95578b admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:08.762735 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff785aa-1cae-450d-a3c6-9d7b2c95578b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:08.763224 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff785aa-1cae-450d-a3c6-9d7b2c95578b admin admin] PATH_INFO: `/v3/projects/306169be24624972b5874cecf1b44d9a/users/a42271c3474340efb8ea7eb7114a3033/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:08.765777 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff785aa-1cae-450d-a3c6-9d7b2c95578b admin admin] RBAC: Authorizing `identity:create_grant(project_id=306169be24624972b5874cecf1b44d9a, user_id=a42271c3474340efb8ea7eb7114a3033, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:08.768619 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff785aa-1cae-450d-a3c6-9d7b2c95578b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:08.781717 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3346/6664] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:34:08 2022] PUT /identity/v3/projects/306169be24624972b5874cecf1b44d9a/users/a42271c3474340efb8ea7eb7114a3033/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:34:08.803263 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae11a2d-e016-4c88-91e2-1f5f2057151b None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:08.803561 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae11a2d-e016-4c88-91e2-1f5f2057151b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:08.803843 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae11a2d-e016-4c88-91e2-1f5f2057151b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:08.811884 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3319/6665] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:34:08 2022] PUT /identity/v3/projects/6a729ecb44744fc7b60ab41b80b7d521/users/4030e0a7ff8a497abfe9ff96439d4899/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:34:08.817203 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d808fcb-d783-4ed1-81f1-fba8de67d6fb None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:08.817203 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d808fcb-d783-4ed1-81f1-fba8de67d6fb None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:08.817203 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d808fcb-d783-4ed1-81f1-fba8de67d6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:08.860626 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-3ae11a2d-e016-4c88-91e2-1f5f2057151b None None] MFA Rules not processed for user `a42271c3474340efb8ea7eb7114a3033`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:08.862419 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3ae11a2d-e016-4c88-91e2-1f5f2057151b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:08.874847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-1d808fcb-d783-4ed1-81f1-fba8de67d6fb None None] MFA Rules not processed for user `4030e0a7ff8a497abfe9ff96439d4899`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:08.877417 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1d808fcb-d783-4ed1-81f1-fba8de67d6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:08.989464 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3347/6666] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:08 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:08.990792 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3320/6667] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:09.006199 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae11a2d-e016-4c88-91e2-1f5f2057151b None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:09.008102 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3ae11a2d-e016-4c88-91e2-1f5f2057151b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:09.010929 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d808fcb-d783-4ed1-81f1-fba8de67d6fb None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:09.012653 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1d808fcb-d783-4ed1-81f1-fba8de67d6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:09.137615 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d808fcb-d783-4ed1-81f1-fba8de67d6fb None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:09.143902 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae11a2d-e016-4c88-91e2-1f5f2057151b None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:09.144772 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353be8d-392b-49b7-aba6-4021698e00cc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e302b1298dd04d6590e3d079f7b13b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:09.145749 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353be8d-392b-49b7-aba6-4021698e00cc service glance] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:09.146356 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353be8d-392b-49b7-aba6-4021698e00cc service glance] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:09.146853 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353be8d-392b-49b7-aba6-4021698e00cc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:09.149090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552b038-db17-40e2-aa4c-e93581b6ebb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:09.150766 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552b038-db17-40e2-aa4c-e93581b6ebb8 service cinder] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:09.151214 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552b038-db17-40e2-aa4c-e93581b6ebb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:09.151967 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552b038-db17-40e2-aa4c-e93581b6ebb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:09.191955 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4552b038-db17-40e2-aa4c-e93581b6ebb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:09.194309 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4552b038-db17-40e2-aa4c-e93581b6ebb8 service cinder] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:09.230289 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3348/6668] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:34:09 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:34:09.299082 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b353be8d-392b-49b7-aba6-4021698e00cc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:09.300876 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b353be8d-392b-49b7-aba6-4021698e00cc service glance] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:09.323659 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3321/6669] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:34:09 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:34:09.563170 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552b038-db17-40e2-aa4c-e93581b6ebb8 service cinder] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:09.578566 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552b038-db17-40e2-aa4c-e93581b6ebb8 service cinder] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:09.606377 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e13f2b-0740-4810-8110-b8135d4f2880 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:09.606377 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e13f2b-0740-4810-8110-b8135d4f2880 service cinder] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:09.606377 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e13f2b-0740-4810-8110-b8135d4f2880 service cinder] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:09.606377 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e13f2b-0740-4810-8110-b8135d4f2880 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:09.750248 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e13f2b-0740-4810-8110-b8135d4f2880 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:09.752475 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e13f2b-0740-4810-8110-b8135d4f2880 service cinder] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:09.794256 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3349/6670] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:34:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:34:11.449976 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353be8d-392b-49b7-aba6-4021698e00cc service glance] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:11.576060 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353be8d-392b-49b7-aba6-4021698e00cc service glance] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:11.583355 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397a4a0-9aeb-4ce7-b27e-562cbe867260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:11.584301 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397a4a0-9aeb-4ce7-b27e-562cbe867260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:11.584597 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397a4a0-9aeb-4ce7-b27e-562cbe867260 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:11.584905 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397a4a0-9aeb-4ce7-b27e-562cbe867260 admin admin] PATH_INFO: `/v3/users/5e50f6997cd545fe9e4b0e74c0d18996` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:11.586383 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9397a4a0-9aeb-4ce7-b27e-562cbe867260 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e50f6997cd545fe9e4b0e74c0d18996)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:11.590467 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9397a4a0-9aeb-4ce7-b27e-562cbe867260 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:11.836835 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-9397a4a0-9aeb-4ce7-b27e-562cbe867260 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e50f6997cd545fe9e4b0e74c0d18996'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:11.861569 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-9397a4a0-9aeb-4ce7-b27e-562cbe867260 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e50f6997cd545fe9e4b0e74c0d18996'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:11.948550 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-9397a4a0-9aeb-4ce7-b27e-562cbe867260 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e50f6997cd545fe9e4b0e74c0d18996'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:11.949627 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-9397a4a0-9aeb-4ce7-b27e-562cbe867260 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e50f6997cd545fe9e4b0e74c0d18996'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:11.957851 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-9397a4a0-9aeb-4ce7-b27e-562cbe867260 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e50f6997cd545fe9e4b0e74c0d18996'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:11.967574 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3322/6671] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:34:11 2022] DELETE /identity/v3/users/5e50f6997cd545fe9e4b0e74c0d18996 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:34:11.972595 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c0572-cef5-4063-9324-21f6ef89d77c None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:11.973194 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c0572-cef5-4063-9324-21f6ef89d77c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:11.973194 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c0572-cef5-4063-9324-21f6ef89d77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:11.993699 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-7d3c0572-cef5-4063-9324-21f6ef89d77c None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:11.995159 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7d3c0572-cef5-4063-9324-21f6ef89d77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:12.106019 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3350/6672] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:12.124857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397a4a0-9aeb-4ce7-b27e-562cbe867260 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:12.127396 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-9397a4a0-9aeb-4ce7-b27e-562cbe867260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:12.227182 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397a4a0-9aeb-4ce7-b27e-562cbe867260 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:12.235774 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd2b35-3bd5-4c97-896f-80b8a2e3e517 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:12.242540 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd2b35-3bd5-4c97-896f-80b8a2e3e517 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:12.242939 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd2b35-3bd5-4c97-896f-80b8a2e3e517 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:12.243685 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd2b35-3bd5-4c97-896f-80b8a2e3e517 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:12.258951 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd2b35-3bd5-4c97-896f-80b8a2e3e517 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:12.260913 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd2b35-3bd5-4c97-896f-80b8a2e3e517 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:12.280316 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3323/6673] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:34:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:34:13.444699 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c0572-cef5-4063-9324-21f6ef89d77c None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:13.447361 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7d3c0572-cef5-4063-9324-21f6ef89d77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:13.464244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c0572-cef5-4063-9324-21f6ef89d77c None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:13.471250 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb125c-78b0-4eae-a323-9eaf00807718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:13.472354 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb125c-78b0-4eae-a323-9eaf00807718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:13.472694 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb125c-78b0-4eae-a323-9eaf00807718 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:13.472966 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb125c-78b0-4eae-a323-9eaf00807718 admin admin] PATH_INFO: `/v3/projects/9b2cbe8cba4b45d9ae35131f8555e105` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:13.474205 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb125c-78b0-4eae-a323-9eaf00807718 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b2cbe8cba4b45d9ae35131f8555e105)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:13.476167 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb125c-78b0-4eae-a323-9eaf00807718 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:13.658058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-32cb125c-78b0-4eae-a323-9eaf00807718 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b2cbe8cba4b45d9ae35131f8555e105', 'request_id': 'req-32cb125c-78b0-4eae-a323-9eaf00807718'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:13.663535 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-32cb125c-78b0-4eae-a323-9eaf00807718 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b2cbe8cba4b45d9ae35131f8555e105', 'request_id': 'req-32cb125c-78b0-4eae-a323-9eaf00807718'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:13.670304 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-32cb125c-78b0-4eae-a323-9eaf00807718 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b2cbe8cba4b45d9ae35131f8555e105', 'request_id': 'req-32cb125c-78b0-4eae-a323-9eaf00807718'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:13.755420 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-32cb125c-78b0-4eae-a323-9eaf00807718 admin admin] The token cache is being invalidate because project 9b2cbe8cba4b45d9ae35131f8555e105 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:34:13.755715 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-32cb125c-78b0-4eae-a323-9eaf00807718 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:13.757265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-32cb125c-78b0-4eae-a323-9eaf00807718 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:13.759080 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3351/6674] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:34:13 2022] DELETE /identity/v3/projects/9b2cbe8cba4b45d9ae35131f8555e105 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:34:13.763478 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd2b35-3bd5-4c97-896f-80b8a2e3e517 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:13.772977 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd2b35-3bd5-4c97-896f-80b8a2e3e517 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:13.841133 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94abb5cf-35d5-43da-abeb-3bbfb1824259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:13.842046 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abb5cf-35d5-43da-abeb-3bbfb1824259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:13.842549 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abb5cf-35d5-43da-abeb-3bbfb1824259 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:13.842835 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abb5cf-35d5-43da-abeb-3bbfb1824259 admin admin] PATH_INFO: `/v3/users/4030e0a7ff8a497abfe9ff96439d4899` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:13.844233 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94abb5cf-35d5-43da-abeb-3bbfb1824259 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4030e0a7ff8a497abfe9ff96439d4899)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:13.846216 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94abb5cf-35d5-43da-abeb-3bbfb1824259 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:14.004464 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb125c-78b0-4eae-a323-9eaf00807718 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:14.005977 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-32cb125c-78b0-4eae-a323-9eaf00807718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:14.019721 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb125c-78b0-4eae-a323-9eaf00807718 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:14.025001 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515827fe-43a3-4d63-9d97-cbd49cf988e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:14.027081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515827fe-43a3-4d63-9d97-cbd49cf988e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:14.027081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515827fe-43a3-4d63-9d97-cbd49cf988e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:14.027081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515827fe-43a3-4d63-9d97-cbd49cf988e6 admin admin] PATH_INFO: `/v3/users/53c34db031e74351979ccf78c73f44c8` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:14.027590 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515827fe-43a3-4d63-9d97-cbd49cf988e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53c34db031e74351979ccf78c73f44c8)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:14.029773 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515827fe-43a3-4d63-9d97-cbd49cf988e6 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:14.030525 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-94abb5cf-35d5-43da-abeb-3bbfb1824259 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4030e0a7ff8a497abfe9ff96439d4899'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:14.042294 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-94abb5cf-35d5-43da-abeb-3bbfb1824259 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4030e0a7ff8a497abfe9ff96439d4899'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:14.130699 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-94abb5cf-35d5-43da-abeb-3bbfb1824259 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4030e0a7ff8a497abfe9ff96439d4899'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:14.131352 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-94abb5cf-35d5-43da-abeb-3bbfb1824259 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4030e0a7ff8a497abfe9ff96439d4899'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:14.139930 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-94abb5cf-35d5-43da-abeb-3bbfb1824259 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4030e0a7ff8a497abfe9ff96439d4899'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:14.146338 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3324/6675] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:34:13 2022] DELETE /identity/v3/users/4030e0a7ff8a497abfe9ff96439d4899 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:34:14.293085 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-515827fe-43a3-4d63-9d97-cbd49cf988e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53c34db031e74351979ccf78c73f44c8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:14.304596 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-515827fe-43a3-4d63-9d97-cbd49cf988e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53c34db031e74351979ccf78c73f44c8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:14.404894 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-515827fe-43a3-4d63-9d97-cbd49cf988e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53c34db031e74351979ccf78c73f44c8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:14.412429 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-515827fe-43a3-4d63-9d97-cbd49cf988e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53c34db031e74351979ccf78c73f44c8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:14.413133 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-515827fe-43a3-4d63-9d97-cbd49cf988e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53c34db031e74351979ccf78c73f44c8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:14.425061 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3352/6676] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:34:14 2022] DELETE /identity/v3/users/53c34db031e74351979ccf78c73f44c8 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:34:14.426468 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb1d36-5332-463f-a273-34377b80e268 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:14.426809 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb1d36-5332-463f-a273-34377b80e268 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:14.427149 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb1d36-5332-463f-a273-34377b80e268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:14.447469 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-11bb1d36-5332-463f-a273-34377b80e268 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:14.448636 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-11bb1d36-5332-463f-a273-34377b80e268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:14.527351 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3325/6677] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:14.538147 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515827fe-43a3-4d63-9d97-cbd49cf988e6 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:14.539598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-515827fe-43a3-4d63-9d97-cbd49cf988e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:14.612460 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515827fe-43a3-4d63-9d97-cbd49cf988e6 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:14.616184 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becac5ca-bc7b-4e9f-80e5-d3842e7251e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:14.617003 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becac5ca-bc7b-4e9f-80e5-d3842e7251e4 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:14.617295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becac5ca-bc7b-4e9f-80e5-d3842e7251e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:14.617579 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becac5ca-bc7b-4e9f-80e5-d3842e7251e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:14.627402 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becac5ca-bc7b-4e9f-80e5-d3842e7251e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:14.628882 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becac5ca-bc7b-4e9f-80e5-d3842e7251e4 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:14.641000 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3353/6678] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:34:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:34:14.702077 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb1d36-5332-463f-a273-34377b80e268 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:14.704064 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-11bb1d36-5332-463f-a273-34377b80e268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:14.719823 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb1d36-5332-463f-a273-34377b80e268 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:14.731849 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9db336-3cd8-4e93-b4e7-59de7f35d524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:14.732786 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9db336-3cd8-4e93-b4e7-59de7f35d524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:14.740543 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9db336-3cd8-4e93-b4e7-59de7f35d524 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:14.740543 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9db336-3cd8-4e93-b4e7-59de7f35d524 admin admin] PATH_INFO: `/v3/projects/6a729ecb44744fc7b60ab41b80b7d521` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:14.740543 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9db336-3cd8-4e93-b4e7-59de7f35d524 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a729ecb44744fc7b60ab41b80b7d521)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:14.740543 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9db336-3cd8-4e93-b4e7-59de7f35d524 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:14.918704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7c9db336-3cd8-4e93-b4e7-59de7f35d524 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a729ecb44744fc7b60ab41b80b7d521', 'request_id': 'req-7c9db336-3cd8-4e93-b4e7-59de7f35d524'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:14.926303 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7c9db336-3cd8-4e93-b4e7-59de7f35d524 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a729ecb44744fc7b60ab41b80b7d521', 'request_id': 'req-7c9db336-3cd8-4e93-b4e7-59de7f35d524'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:14.937870 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7c9db336-3cd8-4e93-b4e7-59de7f35d524 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a729ecb44744fc7b60ab41b80b7d521', 'request_id': 'req-7c9db336-3cd8-4e93-b4e7-59de7f35d524'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:14.994276 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7c9db336-3cd8-4e93-b4e7-59de7f35d524 admin admin] The token cache is being invalidate because project 6a729ecb44744fc7b60ab41b80b7d521 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:34:14.994938 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7c9db336-3cd8-4e93-b4e7-59de7f35d524 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:14.995707 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7c9db336-3cd8-4e93-b4e7-59de7f35d524 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:14.997724 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3326/6679] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:34:14 2022] DELETE /identity/v3/projects/6a729ecb44744fc7b60ab41b80b7d521 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:34:15.011730 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfad66-8d33-4cd8-bc85-efda5410710c None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:15.012446 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfad66-8d33-4cd8-bc85-efda5410710c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:15.012918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfad66-8d33-4cd8-bc85-efda5410710c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:15.038573 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-7bdfad66-8d33-4cd8-bc85-efda5410710c None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:15.040200 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7bdfad66-8d33-4cd8-bc85-efda5410710c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:15.108360 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3354/6680] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:15.116339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea9eed-32c3-40a3-a1eb-3acf9a7583b4 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:15.116631 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea9eed-32c3-40a3-a1eb-3acf9a7583b4 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:15.116913 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea9eed-32c3-40a3-a1eb-3acf9a7583b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:15.136408 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-94ea9eed-32c3-40a3-a1eb-3acf9a7583b4 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:15.137610 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-94ea9eed-32c3-40a3-a1eb-3acf9a7583b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:15.145545 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3327/6681] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:15.149868 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfad66-8d33-4cd8-bc85-efda5410710c None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:15.159751 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfad66-8d33-4cd8-bc85-efda5410710c None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:15.164348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191c19c-f789-4b7f-ae2a-3ef73bf002bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:15.164997 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191c19c-f789-4b7f-ae2a-3ef73bf002bf admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:15.165279 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191c19c-f789-4b7f-ae2a-3ef73bf002bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:15.165558 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191c19c-f789-4b7f-ae2a-3ef73bf002bf admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:15.166308 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191c19c-f789-4b7f-ae2a-3ef73bf002bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:34:15.166615 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191c19c-f789-4b7f-ae2a-3ef73bf002bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:15.168215 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191c19c-f789-4b7f-ae2a-3ef73bf002bf admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:15.179744 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3355/6682] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:34:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:34:15.184212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea9eed-32c3-40a3-a1eb-3acf9a7583b4 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:15.193310 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea9eed-32c3-40a3-a1eb-3acf9a7583b4 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:15.199401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f9dde-b31b-4266-b3d5-8cca91fb3ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:15.200089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f9dde-b31b-4266-b3d5-8cca91fb3ac6 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:15.200374 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f9dde-b31b-4266-b3d5-8cca91fb3ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:15.200678 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f9dde-b31b-4266-b3d5-8cca91fb3ac6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:15.201341 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f9dde-b31b-4266-b3d5-8cca91fb3ac6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:15.203340 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f9dde-b31b-4266-b3d5-8cca91fb3ac6 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:15.231062 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191c19c-f789-4b7f-ae2a-3ef73bf002bf admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:15.248968 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4191c19c-f789-4b7f-ae2a-3ef73bf002bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:15.266117 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191c19c-f789-4b7f-ae2a-3ef73bf002bf admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:15.292463 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5c628-f4a4-423b-82e9-3ab2a0643b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:15.292463 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5c628-f4a4-423b-82e9-3ab2a0643b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:15.292463 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5c628-f4a4-423b-82e9-3ab2a0643b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:15.292463 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5c628-f4a4-423b-82e9-3ab2a0643b0b admin admin] PATH_INFO: `/v3/projects/550652796d154770baf0a73e08f865dc` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:15.293130 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa5c628-f4a4-423b-82e9-3ab2a0643b0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=550652796d154770baf0a73e08f865dc)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:15.293354 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa5c628-f4a4-423b-82e9-3ab2a0643b0b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:15.387997 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3328/6683] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:34:15 2022] POST /identity/v3/projects => generated 375 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:34:15.391988 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f9dde-b31b-4266-b3d5-8cca91fb3ac6 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:15.454625 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f9dde-b31b-4266-b3d5-8cca91fb3ac6 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:15.459455 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b71187-b3a5-4711-b788-3377e9ee1889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:15.460219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b71187-b3a5-4711-b788-3377e9ee1889 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:15.460656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b71187-b3a5-4711-b788-3377e9ee1889 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:15.460920 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b71187-b3a5-4711-b788-3377e9ee1889 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:15.461612 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b71187-b3a5-4711-b788-3377e9ee1889 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:15.464112 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b71187-b3a5-4711-b788-3377e9ee1889 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:15.543406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-baa5c628-f4a4-423b-82e9-3ab2a0643b0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '550652796d154770baf0a73e08f865dc', 'request_id': 'req-baa5c628-f4a4-423b-82e9-3ab2a0643b0b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:15.554583 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-baa5c628-f4a4-423b-82e9-3ab2a0643b0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '550652796d154770baf0a73e08f865dc', 'request_id': 'req-baa5c628-f4a4-423b-82e9-3ab2a0643b0b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:15.562990 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-baa5c628-f4a4-423b-82e9-3ab2a0643b0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '550652796d154770baf0a73e08f865dc', 'request_id': 'req-baa5c628-f4a4-423b-82e9-3ab2a0643b0b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:15.611518 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3329/6684] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:34:15 2022] POST /identity/v3/users => generated 288 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:34:15.616116 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b71187-b3a5-4711-b788-3377e9ee1889 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:15.636515 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b71187-b3a5-4711-b788-3377e9ee1889 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:15.707122 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-baa5c628-f4a4-423b-82e9-3ab2a0643b0b admin admin] The token cache is being invalidate because project 550652796d154770baf0a73e08f865dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:34:15.707417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-baa5c628-f4a4-423b-82e9-3ab2a0643b0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:15.708082 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-baa5c628-f4a4-423b-82e9-3ab2a0643b0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:15.710496 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3356/6685] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:34:15 2022] DELETE /identity/v3/projects/550652796d154770baf0a73e08f865dc => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:34:15.714017 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d3b23-7096-4043-9109-d2c3f07da843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:15.714515 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5c628-f4a4-423b-82e9-3ab2a0643b0b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:15.714987 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d3b23-7096-4043-9109-d2c3f07da843 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:15.715279 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d3b23-7096-4043-9109-d2c3f07da843 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:15.715552 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d3b23-7096-4043-9109-d2c3f07da843 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:15.716286 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76d3b23-7096-4043-9109-d2c3f07da843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:15.716563 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-baa5c628-f4a4-423b-82e9-3ab2a0643b0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:15.717971 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76d3b23-7096-4043-9109-d2c3f07da843 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:15.729421 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3330/6686] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:34:15.732199 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5c628-f4a4-423b-82e9-3ab2a0643b0b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:15.733225 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d3b23-7096-4043-9109-d2c3f07da843 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:15.739609 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384ae66-6168-40d0-a0e3-37fbfbc900fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:15.740497 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384ae66-6168-40d0-a0e3-37fbfbc900fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:15.740840 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384ae66-6168-40d0-a0e3-37fbfbc900fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:15.741051 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384ae66-6168-40d0-a0e3-37fbfbc900fb admin admin] PATH_INFO: `/v3/users/4308901beda44daca7b4f3388ed12b25` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:15.742302 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d384ae66-6168-40d0-a0e3-37fbfbc900fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4308901beda44daca7b4f3388ed12b25)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:15.749247 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d76d3b23-7096-4043-9109-d2c3f07da843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:15.749411 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d384ae66-6168-40d0-a0e3-37fbfbc900fb admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:15.761537 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d3b23-7096-4043-9109-d2c3f07da843 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:15.768451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918bdcc9-ca3e-4702-858c-f06c2617a60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:15.769598 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918bdcc9-ca3e-4702-858c-f06c2617a60a admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:15.770338 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918bdcc9-ca3e-4702-858c-f06c2617a60a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:15.771348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918bdcc9-ca3e-4702-858c-f06c2617a60a admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:15.772273 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918bdcc9-ca3e-4702-858c-f06c2617a60a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:15.774754 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918bdcc9-ca3e-4702-858c-f06c2617a60a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:15.787405 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3331/6687] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:34:15.792513 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918bdcc9-ca3e-4702-858c-f06c2617a60a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:15.821328 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918bdcc9-ca3e-4702-858c-f06c2617a60a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:15.834999 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c419480-fbdc-4a59-956e-b23cb5ae7cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:15.836474 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c419480-fbdc-4a59-956e-b23cb5ae7cd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:15.837403 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c419480-fbdc-4a59-956e-b23cb5ae7cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:15.839709 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c419480-fbdc-4a59-956e-b23cb5ae7cd9 admin admin] PATH_INFO: `/v3/projects/2562de6a475f41c4bf69cf69b5c08958/users/f080ae62cdd749bc8283c2be57e8072a/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:15.858275 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c419480-fbdc-4a59-956e-b23cb5ae7cd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2562de6a475f41c4bf69cf69b5c08958, user_id=f080ae62cdd749bc8283c2be57e8072a, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:15.862844 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c419480-fbdc-4a59-956e-b23cb5ae7cd9 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:15.939601 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d384ae66-6168-40d0-a0e3-37fbfbc900fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4308901beda44daca7b4f3388ed12b25'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:15.959063 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3332/6688] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:34:15 2022] PUT /identity/v3/projects/2562de6a475f41c4bf69cf69b5c08958/users/f080ae62cdd749bc8283c2be57e8072a/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:34:15.969653 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab81e5d-3d7e-4c1f-a497-28d2a7d49d21 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:15.970072 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab81e5d-3d7e-4c1f-a497-28d2a7d49d21 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:15.970351 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab81e5d-3d7e-4c1f-a497-28d2a7d49d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:15.983733 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d384ae66-6168-40d0-a0e3-37fbfbc900fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4308901beda44daca7b4f3388ed12b25'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:16.010529 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-7ab81e5d-3d7e-4c1f-a497-28d2a7d49d21 None None] MFA Rules not processed for user `f080ae62cdd749bc8283c2be57e8072a`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:16.011948 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7ab81e5d-3d7e-4c1f-a497-28d2a7d49d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:16.050398 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d384ae66-6168-40d0-a0e3-37fbfbc900fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4308901beda44daca7b4f3388ed12b25'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:16.059557 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d384ae66-6168-40d0-a0e3-37fbfbc900fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4308901beda44daca7b4f3388ed12b25'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:16.059557 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d384ae66-6168-40d0-a0e3-37fbfbc900fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4308901beda44daca7b4f3388ed12b25'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:16.066485 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3357/6689] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:34:15 2022] DELETE /identity/v3/users/4308901beda44daca7b4f3388ed12b25 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:34:16.092736 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3333/6690] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:16.097356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384ae66-6168-40d0-a0e3-37fbfbc900fb admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:16.098931 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d384ae66-6168-40d0-a0e3-37fbfbc900fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:16.189717 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384ae66-6168-40d0-a0e3-37fbfbc900fb admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:16.196105 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c4ba7-73a0-475a-a244-07b0247604c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:16.197425 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c4ba7-73a0-475a-a244-07b0247604c6 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:16.197749 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c4ba7-73a0-475a-a244-07b0247604c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:16.198102 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c4ba7-73a0-475a-a244-07b0247604c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:16.198811 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830c4ba7-73a0-475a-a244-07b0247604c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:16.200999 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830c4ba7-73a0-475a-a244-07b0247604c6 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:16.340583 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab81e5d-3d7e-4c1f-a497-28d2a7d49d21 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:16.345800 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3358/6691] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:34:16 2022] POST /identity/v3/projects => generated 375 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:34:16.425726 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c4ba7-73a0-475a-a244-07b0247604c6 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:16.428252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-830c4ba7-73a0-475a-a244-07b0247604c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:16.452456 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab81e5d-3d7e-4c1f-a497-28d2a7d49d21 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:16.538172 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c4ba7-73a0-475a-a244-07b0247604c6 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:16.544683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb560196-82e9-44d2-b769-a02038ef2961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:16.545727 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb560196-82e9-44d2-b769-a02038ef2961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:16.546162 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb560196-82e9-44d2-b769-a02038ef2961 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:16.546675 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb560196-82e9-44d2-b769-a02038ef2961 admin admin] PATH_INFO: `/v3/projects/306af5b78d2b45dcb9dedf50d1250f91` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:16.548061 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb560196-82e9-44d2-b769-a02038ef2961 admin admin] RBAC: Authorizing `identity:delete_project(project_id=306af5b78d2b45dcb9dedf50d1250f91)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:16.550544 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb560196-82e9-44d2-b769-a02038ef2961 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:16.552346 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d1936-469a-4d7a-8b30-c98f6f009491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:16.553343 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d1936-469a-4d7a-8b30-c98f6f009491 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:16.553821 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d1936-469a-4d7a-8b30-c98f6f009491 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:16.554116 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d1936-469a-4d7a-8b30-c98f6f009491 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:16.555226 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d1936-469a-4d7a-8b30-c98f6f009491 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:16.558137 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d1936-469a-4d7a-8b30-c98f6f009491 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:16.693871 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3334/6692] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:34:16 2022] POST /identity/v3/users => generated 294 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:34:16.698122 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d1936-469a-4d7a-8b30-c98f6f009491 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:16.719333 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d1936-469a-4d7a-8b30-c98f6f009491 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:16.722002 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cb560196-82e9-44d2-b769-a02038ef2961 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '306af5b78d2b45dcb9dedf50d1250f91', 'request_id': 'req-cb560196-82e9-44d2-b769-a02038ef2961'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:16.741852 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cb560196-82e9-44d2-b769-a02038ef2961 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '306af5b78d2b45dcb9dedf50d1250f91', 'request_id': 'req-cb560196-82e9-44d2-b769-a02038ef2961'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:16.752997 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cb560196-82e9-44d2-b769-a02038ef2961 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '306af5b78d2b45dcb9dedf50d1250f91', 'request_id': 'req-cb560196-82e9-44d2-b769-a02038ef2961'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:16.796724 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5444b0-83e8-477b-85d3-9265b27fb478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:16.797539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5444b0-83e8-477b-85d3-9265b27fb478 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:16.797967 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5444b0-83e8-477b-85d3-9265b27fb478 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:16.798352 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5444b0-83e8-477b-85d3-9265b27fb478 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:16.799540 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5444b0-83e8-477b-85d3-9265b27fb478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:16.801655 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5444b0-83e8-477b-85d3-9265b27fb478 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:16.819094 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3335/6693] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:34:16.820435 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5444b0-83e8-477b-85d3-9265b27fb478 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:16.832741 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5444b0-83e8-477b-85d3-9265b27fb478 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:16.838483 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580e2be-1827-47ee-8501-1258f643c9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:16.839528 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580e2be-1827-47ee-8501-1258f643c9a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:16.840171 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580e2be-1827-47ee-8501-1258f643c9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:16.840556 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580e2be-1827-47ee-8501-1258f643c9a8 admin admin] PATH_INFO: `/v3/projects/fce178cda8fd4f5b903c14a8686e5abf/users/2351a756599e4bac8bcd9d2c1f311fa2/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:16.858628 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cb560196-82e9-44d2-b769-a02038ef2961 admin admin] The token cache is being invalidate because project 306af5b78d2b45dcb9dedf50d1250f91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:34:16.858966 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cb560196-82e9-44d2-b769-a02038ef2961 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:16.859154 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580e2be-1827-47ee-8501-1258f643c9a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fce178cda8fd4f5b903c14a8686e5abf, user_id=2351a756599e4bac8bcd9d2c1f311fa2, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:16.859675 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cb560196-82e9-44d2-b769-a02038ef2961 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:16.864708 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3359/6694] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:34:16 2022] DELETE /identity/v3/projects/306af5b78d2b45dcb9dedf50d1250f91 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:34:16.864913 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580e2be-1827-47ee-8501-1258f643c9a8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:16.866949 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df596054-74b0-494c-939a-c9f968e81828 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:16.867504 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df596054-74b0-494c-939a-c9f968e81828 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:16.867799 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df596054-74b0-494c-939a-c9f968e81828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:16.912325 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-df596054-74b0-494c-939a-c9f968e81828 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:16.913615 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-df596054-74b0-494c-939a-c9f968e81828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:16.928660 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3360/6695] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:16.947225 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867ee1e-a7fc-44b2-8a3e-eb220535fee6 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:16.947865 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867ee1e-a7fc-44b2-8a3e-eb220535fee6 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:16.948335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867ee1e-a7fc-44b2-8a3e-eb220535fee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:16.970478 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3336/6696] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:34:16 2022] PUT /identity/v3/projects/fce178cda8fd4f5b903c14a8686e5abf/users/2351a756599e4bac8bcd9d2c1f311fa2/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:34:16.971642 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580e2be-1827-47ee-8501-1258f643c9a8 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:16.973668 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b580e2be-1827-47ee-8501-1258f643c9a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:16.993948 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-4867ee1e-a7fc-44b2-8a3e-eb220535fee6 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:16.996849 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4867ee1e-a7fc-44b2-8a3e-eb220535fee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:17.058032 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580e2be-1827-47ee-8501-1258f643c9a8 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:17.064005 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e13c66-9906-48c3-b5bf-10c7823b21c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:17.064787 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e13c66-9906-48c3-b5bf-10c7823b21c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:17.065175 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e13c66-9906-48c3-b5bf-10c7823b21c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:17.066384 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e13c66-9906-48c3-b5bf-10c7823b21c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:17.066384 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e13c66-9906-48c3-b5bf-10c7823b21c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:17.068105 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e13c66-9906-48c3-b5bf-10c7823b21c7 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:17.086130 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3337/6697] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:34:17.091262 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e13c66-9906-48c3-b5bf-10c7823b21c7 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:17.103685 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e13c66-9906-48c3-b5bf-10c7823b21c7 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:17.110272 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43556844-fcd5-4d4c-9a62-097ce7e32cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:17.111075 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43556844-fcd5-4d4c-9a62-097ce7e32cf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:17.111435 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43556844-fcd5-4d4c-9a62-097ce7e32cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:17.111792 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43556844-fcd5-4d4c-9a62-097ce7e32cf5 admin admin] PATH_INFO: `/v3/projects/fce178cda8fd4f5b903c14a8686e5abf/users/2351a756599e4bac8bcd9d2c1f311fa2/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:17.114291 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43556844-fcd5-4d4c-9a62-097ce7e32cf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fce178cda8fd4f5b903c14a8686e5abf, user_id=2351a756599e4bac8bcd9d2c1f311fa2, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:17.117071 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43556844-fcd5-4d4c-9a62-097ce7e32cf5 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:17.146609 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3338/6698] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:34:17 2022] PUT /identity/v3/projects/fce178cda8fd4f5b903c14a8686e5abf/users/2351a756599e4bac8bcd9d2c1f311fa2/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:34:17.154321 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae150f-ebbb-4e89-bc11-7b166d5493c4 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:17.155772 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae150f-ebbb-4e89-bc11-7b166d5493c4 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:17.156281 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae150f-ebbb-4e89-bc11-7b166d5493c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:17.161304 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3361/6699] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:17.162325 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867ee1e-a7fc-44b2-8a3e-eb220535fee6 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:17.176736 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867ee1e-a7fc-44b2-8a3e-eb220535fee6 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:17.204587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-a8ae150f-ebbb-4e89-bc11-7b166d5493c4 None None] MFA Rules not processed for user `2351a756599e4bac8bcd9d2c1f311fa2`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:17.205674 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a8ae150f-ebbb-4e89-bc11-7b166d5493c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:17.264632 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ad919-1375-4f4d-8ba2-f14b1fec86c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:17.265432 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ad919-1375-4f4d-8ba2-f14b1fec86c3 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:17.265851 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ad919-1375-4f4d-8ba2-f14b1fec86c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:17.266463 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ad919-1375-4f4d-8ba2-f14b1fec86c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:17.272405 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ad919-1375-4f4d-8ba2-f14b1fec86c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:34:17.272405 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ad919-1375-4f4d-8ba2-f14b1fec86c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:17.272405 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ad919-1375-4f4d-8ba2-f14b1fec86c3 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:17.285383 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3362/6700] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:34:17.289638 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ad919-1375-4f4d-8ba2-f14b1fec86c3 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:17.315578 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ad919-1375-4f4d-8ba2-f14b1fec86c3 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:17.320336 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f65527-37ca-457a-ae5c-cae9c27c8b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:17.322105 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f65527-37ca-457a-ae5c-cae9c27c8b2b admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:17.322547 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f65527-37ca-457a-ae5c-cae9c27c8b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:17.322895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f65527-37ca-457a-ae5c-cae9c27c8b2b admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:17.339682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f65527-37ca-457a-ae5c-cae9c27c8b2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:17.344145 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f65527-37ca-457a-ae5c-cae9c27c8b2b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:17.360004 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3339/6701] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:17 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:17.378856 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae150f-ebbb-4e89-bc11-7b166d5493c4 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:17.380677 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a8ae150f-ebbb-4e89-bc11-7b166d5493c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:17.465850 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3363/6702] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:34:17 2022] POST /identity/v3/projects => generated 385 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:34:17.471002 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f65527-37ca-457a-ae5c-cae9c27c8b2b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:17.505534 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae150f-ebbb-4e89-bc11-7b166d5493c4 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:17.560442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f65527-37ca-457a-ae5c-cae9c27c8b2b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:17.565428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3de9e-30f5-4254-a80a-03334a2274f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:17.566060 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3de9e-30f5-4254-a80a-03334a2274f4 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:17.566340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3de9e-30f5-4254-a80a-03334a2274f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:17.566623 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3de9e-30f5-4254-a80a-03334a2274f4 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:17.567351 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f3de9e-30f5-4254-a80a-03334a2274f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:17.569306 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f3de9e-30f5-4254-a80a-03334a2274f4 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:17.569830 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d23a0-5a2e-45a9-a7f7-440e983bb790 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:17.570490 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d23a0-5a2e-45a9-a7f7-440e983bb790 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:17.571501 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d23a0-5a2e-45a9-a7f7-440e983bb790 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:17.571785 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d23a0-5a2e-45a9-a7f7-440e983bb790 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:17.638264 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d23a0-5a2e-45a9-a7f7-440e983bb790 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:17.639962 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d23a0-5a2e-45a9-a7f7-440e983bb790 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:17.651133 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3340/6703] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:34:17 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:34:17.693618 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3364/6704] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:34:17 2022] POST /identity/v3/users => generated 293 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:34:17.695049 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d23a0-5a2e-45a9-a7f7-440e983bb790 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:17.705794 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d23a0-5a2e-45a9-a7f7-440e983bb790 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:17.710691 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16929127-a001-4958-a8b0-f745d98302f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:17.711558 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16929127-a001-4958-a8b0-f745d98302f1 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:17.712543 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16929127-a001-4958-a8b0-f745d98302f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:17.712820 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16929127-a001-4958-a8b0-f745d98302f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:17.713538 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16929127-a001-4958-a8b0-f745d98302f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:17.715196 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16929127-a001-4958-a8b0-f745d98302f1 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:17.726285 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3341/6705] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:34:17.731079 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3de9e-30f5-4254-a80a-03334a2274f4 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:17.753293 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3de9e-30f5-4254-a80a-03334a2274f4 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:17.759620 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17296e2-585e-4a5d-89bd-ab847dc54add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:17.760410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17296e2-585e-4a5d-89bd-ab847dc54add admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:17.760770 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17296e2-585e-4a5d-89bd-ab847dc54add admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:17.761119 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17296e2-585e-4a5d-89bd-ab847dc54add admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:17.762148 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17296e2-585e-4a5d-89bd-ab847dc54add admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:17.763941 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17296e2-585e-4a5d-89bd-ab847dc54add admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:17.776581 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3365/6706] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:34:17.780949 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16929127-a001-4958-a8b0-f745d98302f1 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:17.792350 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16929127-a001-4958-a8b0-f745d98302f1 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:17.797212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59560b81-d3fc-4635-9efd-28f85ed533e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:17.798163 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59560b81-d3fc-4635-9efd-28f85ed533e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:17.798445 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59560b81-d3fc-4635-9efd-28f85ed533e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:17.798725 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59560b81-d3fc-4635-9efd-28f85ed533e6 admin admin] PATH_INFO: `/v3/projects/4addf46841b248ed8778845b6110a53d/users/e5c790248f61499da3fec4245ae63792/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:17.814950 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59560b81-d3fc-4635-9efd-28f85ed533e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4addf46841b248ed8778845b6110a53d, user_id=e5c790248f61499da3fec4245ae63792, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:17.821317 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59560b81-d3fc-4635-9efd-28f85ed533e6 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:17.937647 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3342/6707] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:34:17 2022] PUT /identity/v3/projects/4addf46841b248ed8778845b6110a53d/users/e5c790248f61499da3fec4245ae63792/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:34:17.948540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9193100-c7c3-42d8-b004-7016f6856a9f None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:17.948836 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9193100-c7c3-42d8-b004-7016f6856a9f None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:17.949108 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9193100-c7c3-42d8-b004-7016f6856a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:17.979018 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-a9193100-c7c3-42d8-b004-7016f6856a9f None None] MFA Rules not processed for user `e5c790248f61499da3fec4245ae63792`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:17.980251 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a9193100-c7c3-42d8-b004-7016f6856a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:18.050764 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3366/6708] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:18.055201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59560b81-d3fc-4635-9efd-28f85ed533e6 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:18.151495 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59560b81-d3fc-4635-9efd-28f85ed533e6 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:18.160199 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59616ea5-2c09-48e9-9b68-d726d09d777c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:18.161163 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59616ea5-2c09-48e9-9b68-d726d09d777c admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:18.164451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59616ea5-2c09-48e9-9b68-d726d09d777c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:18.164451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59616ea5-2c09-48e9-9b68-d726d09d777c admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:18.164451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59616ea5-2c09-48e9-9b68-d726d09d777c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:18.167329 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59616ea5-2c09-48e9-9b68-d726d09d777c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:18.258267 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3343/6709] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:34:18 2022] POST /identity/v3/projects => generated 385 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:34:18.263018 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9193100-c7c3-42d8-b004-7016f6856a9f None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:18.283808 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9193100-c7c3-42d8-b004-7016f6856a9f None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:18.354308 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1695981-0e02-463e-b8cb-546ccf7695c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:18.354308 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1695981-0e02-463e-b8cb-546ccf7695c8 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:18.354308 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1695981-0e02-463e-b8cb-546ccf7695c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:18.354308 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1695981-0e02-463e-b8cb-546ccf7695c8 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:18.356598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1695981-0e02-463e-b8cb-546ccf7695c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:18.357255 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1695981-0e02-463e-b8cb-546ccf7695c8 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:18.505802 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3367/6710] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:34:18 2022] POST /identity/v3/users => generated 299 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:34:18.509349 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59616ea5-2c09-48e9-9b68-d726d09d777c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:18.520943 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59616ea5-2c09-48e9-9b68-d726d09d777c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:18.527029 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a19f6-2c96-4ab1-a13b-8a5e59b338bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:18.527726 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a19f6-2c96-4ab1-a13b-8a5e59b338bf admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:18.528012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a19f6-2c96-4ab1-a13b-8a5e59b338bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:18.528292 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a19f6-2c96-4ab1-a13b-8a5e59b338bf admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:18.529047 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a19f6-2c96-4ab1-a13b-8a5e59b338bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:18.531070 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a19f6-2c96-4ab1-a13b-8a5e59b338bf admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:18.543753 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3344/6711] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:34:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:34:18.548162 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1695981-0e02-463e-b8cb-546ccf7695c8 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:18.560087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1695981-0e02-463e-b8cb-546ccf7695c8 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:18.565286 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace58fc0-49e2-442e-b48a-7d5207c9f817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:18.566246 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace58fc0-49e2-442e-b48a-7d5207c9f817 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:18.566528 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace58fc0-49e2-442e-b48a-7d5207c9f817 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:18.566808 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace58fc0-49e2-442e-b48a-7d5207c9f817 admin admin] PATH_INFO: `/v3/projects/f62512e7f9914015b8e0a0872f0d0f3f/users/ccce67dc9c494e61ba478bb8640a94a2/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:18.595215 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace58fc0-49e2-442e-b48a-7d5207c9f817 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f62512e7f9914015b8e0a0872f0d0f3f, user_id=ccce67dc9c494e61ba478bb8640a94a2, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:18.598062 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace58fc0-49e2-442e-b48a-7d5207c9f817 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:18.677327 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3368/6712] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:34:18 2022] PUT /identity/v3/projects/f62512e7f9914015b8e0a0872f0d0f3f/users/ccce67dc9c494e61ba478bb8640a94a2/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:34:18.681646 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a19f6-2c96-4ab1-a13b-8a5e59b338bf admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:18.698402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a19f6-2c96-4ab1-a13b-8a5e59b338bf admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:18.789046 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559782d5-714c-45f6-9330-410bddccfd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:18.789791 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559782d5-714c-45f6-9330-410bddccfd56 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:18.790077 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559782d5-714c-45f6-9330-410bddccfd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:18.790385 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559782d5-714c-45f6-9330-410bddccfd56 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:18.791127 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559782d5-714c-45f6-9330-410bddccfd56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:18.793081 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559782d5-714c-45f6-9330-410bddccfd56 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:18.804398 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3345/6713] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:34:18 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:34:18.808945 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace58fc0-49e2-442e-b48a-7d5207c9f817 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:18.819494 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace58fc0-49e2-442e-b48a-7d5207c9f817 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:18.832474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d5bba-99e9-4307-a132-7496a8a8367f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:18.833395 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d5bba-99e9-4307-a132-7496a8a8367f admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:18.833678 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d5bba-99e9-4307-a132-7496a8a8367f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:18.833991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d5bba-99e9-4307-a132-7496a8a8367f admin admin] PATH_INFO: `/v3/projects/f62512e7f9914015b8e0a0872f0d0f3f/users/ccce67dc9c494e61ba478bb8640a94a2/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:18.836013 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d5bba-99e9-4307-a132-7496a8a8367f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f62512e7f9914015b8e0a0872f0d0f3f, user_id=ccce67dc9c494e61ba478bb8640a94a2, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:18.838798 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d5bba-99e9-4307-a132-7496a8a8367f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:18.855811 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3369/6714] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:34:18 2022] PUT /identity/v3/projects/f62512e7f9914015b8e0a0872f0d0f3f/users/ccce67dc9c494e61ba478bb8640a94a2/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:34:18.861891 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513a045-93b4-4386-937d-c5dd6941ed32 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:18.862183 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513a045-93b4-4386-937d-c5dd6941ed32 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:18.862464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513a045-93b4-4386-937d-c5dd6941ed32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:18.892254 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-0513a045-93b4-4386-937d-c5dd6941ed32 None None] MFA Rules not processed for user `ccce67dc9c494e61ba478bb8640a94a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:18.893482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0513a045-93b4-4386-937d-c5dd6941ed32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:18.977941 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3346/6715] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:18 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:18.988757 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d5bba-99e9-4307-a132-7496a8a8367f admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:19.062623 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d5bba-99e9-4307-a132-7496a8a8367f admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:19.067100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b86a636-1cc7-4f6f-9c11-9627199ac952 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:19.067878 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86a636-1cc7-4f6f-9c11-9627199ac952 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:19.068171 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86a636-1cc7-4f6f-9c11-9627199ac952 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:19.068495 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86a636-1cc7-4f6f-9c11-9627199ac952 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:19.079280 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b86a636-1cc7-4f6f-9c11-9627199ac952 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:19.080851 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b86a636-1cc7-4f6f-9c11-9627199ac952 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:19.094273 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3370/6716] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:34:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:34:20.741963 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513a045-93b4-4386-937d-c5dd6941ed32 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:20.814174 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513a045-93b4-4386-937d-c5dd6941ed32 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:20.819021 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf869c-3c58-4eb4-b303-b7d08d3a6086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:20.819913 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf869c-3c58-4eb4-b303-b7d08d3a6086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:20.820202 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf869c-3c58-4eb4-b303-b7d08d3a6086 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:20.820485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf869c-3c58-4eb4-b303-b7d08d3a6086 admin admin] PATH_INFO: `/v3/users/f080ae62cdd749bc8283c2be57e8072a` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:20.822370 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cf869c-3c58-4eb4-b303-b7d08d3a6086 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f080ae62cdd749bc8283c2be57e8072a)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:20.824330 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cf869c-3c58-4eb4-b303-b7d08d3a6086 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:21.040455 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d1cf869c-3c58-4eb4-b303-b7d08d3a6086 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f080ae62cdd749bc8283c2be57e8072a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:21.059432 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d1cf869c-3c58-4eb4-b303-b7d08d3a6086 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f080ae62cdd749bc8283c2be57e8072a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:21.141682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d1cf869c-3c58-4eb4-b303-b7d08d3a6086 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f080ae62cdd749bc8283c2be57e8072a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:21.142657 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d1cf869c-3c58-4eb4-b303-b7d08d3a6086 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f080ae62cdd749bc8283c2be57e8072a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:21.152932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d1cf869c-3c58-4eb4-b303-b7d08d3a6086 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f080ae62cdd749bc8283c2be57e8072a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:21.161394 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3347/6717] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:34:20 2022] DELETE /identity/v3/users/f080ae62cdd749bc8283c2be57e8072a => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:34:21.166436 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1359508-4501-4d79-8ede-547e381bb65a None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:21.166933 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1359508-4501-4d79-8ede-547e381bb65a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:21.167044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1359508-4501-4d79-8ede-547e381bb65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:21.191158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-f1359508-4501-4d79-8ede-547e381bb65a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:21.192837 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f1359508-4501-4d79-8ede-547e381bb65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:21.291365 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3371/6718] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:21.325308 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf869c-3c58-4eb4-b303-b7d08d3a6086 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:21.326888 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d1cf869c-3c58-4eb4-b303-b7d08d3a6086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:21.403665 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf869c-3c58-4eb4-b303-b7d08d3a6086 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:21.407606 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7325c-214b-4828-9274-b67f1c84004a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:21.408263 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7325c-214b-4828-9274-b67f1c84004a service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:21.408541 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7325c-214b-4828-9274-b67f1c84004a service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:21.408904 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7325c-214b-4828-9274-b67f1c84004a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:21.418237 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff7325c-214b-4828-9274-b67f1c84004a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:21.419732 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff7325c-214b-4828-9274-b67f1c84004a service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:21.429155 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3348/6719] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:34:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:34:22.129087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1359508-4501-4d79-8ede-547e381bb65a None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:22.130579 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f1359508-4501-4d79-8ede-547e381bb65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:22.153718 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1359508-4501-4d79-8ede-547e381bb65a None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:22.171722 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e54f56-32cf-4bc7-8a25-a9a350b56d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:22.174113 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e54f56-32cf-4bc7-8a25-a9a350b56d11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:22.174464 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e54f56-32cf-4bc7-8a25-a9a350b56d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:22.174809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e54f56-32cf-4bc7-8a25-a9a350b56d11 admin admin] PATH_INFO: `/v3/projects/2562de6a475f41c4bf69cf69b5c08958` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:22.176204 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e54f56-32cf-4bc7-8a25-a9a350b56d11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2562de6a475f41c4bf69cf69b5c08958)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:22.178518 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e54f56-32cf-4bc7-8a25-a9a350b56d11 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:22.329609 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-52e54f56-32cf-4bc7-8a25-a9a350b56d11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2562de6a475f41c4bf69cf69b5c08958', 'request_id': 'req-52e54f56-32cf-4bc7-8a25-a9a350b56d11'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:22.334999 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-52e54f56-32cf-4bc7-8a25-a9a350b56d11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2562de6a475f41c4bf69cf69b5c08958', 'request_id': 'req-52e54f56-32cf-4bc7-8a25-a9a350b56d11'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:22.342059 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-52e54f56-32cf-4bc7-8a25-a9a350b56d11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2562de6a475f41c4bf69cf69b5c08958', 'request_id': 'req-52e54f56-32cf-4bc7-8a25-a9a350b56d11'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:22.418083 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-52e54f56-32cf-4bc7-8a25-a9a350b56d11 admin admin] The token cache is being invalidate because project 2562de6a475f41c4bf69cf69b5c08958 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:34:22.418373 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-52e54f56-32cf-4bc7-8a25-a9a350b56d11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:22.420402 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-52e54f56-32cf-4bc7-8a25-a9a350b56d11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:22.422105 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3372/6720] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:34:22 2022] DELETE /identity/v3/projects/2562de6a475f41c4bf69cf69b5c08958 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:34:22.426553 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7325c-214b-4828-9274-b67f1c84004a service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:22.438231 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7325c-214b-4828-9274-b67f1c84004a service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:22.501249 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33dacac-6629-41c3-bb20-84a0e0ae53e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:22.502820 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33dacac-6629-41c3-bb20-84a0e0ae53e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:22.503372 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33dacac-6629-41c3-bb20-84a0e0ae53e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:22.503847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33dacac-6629-41c3-bb20-84a0e0ae53e1 admin admin] PATH_INFO: `/v3/users/2351a756599e4bac8bcd9d2c1f311fa2` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:22.505785 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33dacac-6629-41c3-bb20-84a0e0ae53e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2351a756599e4bac8bcd9d2c1f311fa2)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:22.509419 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33dacac-6629-41c3-bb20-84a0e0ae53e1 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:22.773002 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c33dacac-6629-41c3-bb20-84a0e0ae53e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2351a756599e4bac8bcd9d2c1f311fa2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:22.823177 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c33dacac-6629-41c3-bb20-84a0e0ae53e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2351a756599e4bac8bcd9d2c1f311fa2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:22.901348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e54f56-32cf-4bc7-8a25-a9a350b56d11 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:22.905811 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-52e54f56-32cf-4bc7-8a25-a9a350b56d11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:22.935589 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e54f56-32cf-4bc7-8a25-a9a350b56d11 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:22.949713 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44e1ee-c5b5-4621-8a0d-51ec5aa249ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:22.950650 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44e1ee-c5b5-4621-8a0d-51ec5aa249ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:22.950930 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44e1ee-c5b5-4621-8a0d-51ec5aa249ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:22.952504 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44e1ee-c5b5-4621-8a0d-51ec5aa249ed admin admin] PATH_INFO: `/v3/users/e5c790248f61499da3fec4245ae63792` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:22.953986 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e44e1ee-c5b5-4621-8a0d-51ec5aa249ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5c790248f61499da3fec4245ae63792)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:22.956951 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e44e1ee-c5b5-4621-8a0d-51ec5aa249ed admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:22.970229 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c33dacac-6629-41c3-bb20-84a0e0ae53e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2351a756599e4bac8bcd9d2c1f311fa2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:22.970751 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c33dacac-6629-41c3-bb20-84a0e0ae53e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2351a756599e4bac8bcd9d2c1f311fa2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:22.999042 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c33dacac-6629-41c3-bb20-84a0e0ae53e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2351a756599e4bac8bcd9d2c1f311fa2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:23.015749 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3349/6721] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:34:22 2022] DELETE /identity/v3/users/2351a756599e4bac8bcd9d2c1f311fa2 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:34:23.184606 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6e44e1ee-c5b5-4621-8a0d-51ec5aa249ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5c790248f61499da3fec4245ae63792'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:23.197164 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6e44e1ee-c5b5-4621-8a0d-51ec5aa249ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5c790248f61499da3fec4245ae63792'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:23.291215 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6e44e1ee-c5b5-4621-8a0d-51ec5aa249ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5c790248f61499da3fec4245ae63792'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:23.299854 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6e44e1ee-c5b5-4621-8a0d-51ec5aa249ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5c790248f61499da3fec4245ae63792'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:23.300555 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6e44e1ee-c5b5-4621-8a0d-51ec5aa249ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5c790248f61499da3fec4245ae63792'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:23.307292 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3373/6722] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:34:22 2022] DELETE /identity/v3/users/e5c790248f61499da3fec4245ae63792 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:34:23.313518 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaee7a1-7459-4f1b-9270-31b4cf723bd2 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:23.317384 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaee7a1-7459-4f1b-9270-31b4cf723bd2 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:23.317384 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaee7a1-7459-4f1b-9270-31b4cf723bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:23.335119 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-baaee7a1-7459-4f1b-9270-31b4cf723bd2 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:23.337017 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-baaee7a1-7459-4f1b-9270-31b4cf723bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:23.402051 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3350/6723] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:23.415796 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44e1ee-c5b5-4621-8a0d-51ec5aa249ed admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:23.417499 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6e44e1ee-c5b5-4621-8a0d-51ec5aa249ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:23.527007 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44e1ee-c5b5-4621-8a0d-51ec5aa249ed admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:23.535817 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985cd5c-5b82-4c42-ace8-af792dd6f49a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:23.535817 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985cd5c-5b82-4c42-ace8-af792dd6f49a service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:23.535817 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985cd5c-5b82-4c42-ace8-af792dd6f49a service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:23.535817 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985cd5c-5b82-4c42-ace8-af792dd6f49a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:23.547616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985cd5c-5b82-4c42-ace8-af792dd6f49a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:23.549596 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985cd5c-5b82-4c42-ace8-af792dd6f49a service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:23.563868 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3374/6724] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:34:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:34:23.704119 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaee7a1-7459-4f1b-9270-31b4cf723bd2 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:23.705658 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-baaee7a1-7459-4f1b-9270-31b4cf723bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:23.719302 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaee7a1-7459-4f1b-9270-31b4cf723bd2 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:23.735772 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505cb48-4b0b-4b7c-ad6c-33cbf445eec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:23.737084 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505cb48-4b0b-4b7c-ad6c-33cbf445eec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:23.737893 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505cb48-4b0b-4b7c-ad6c-33cbf445eec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:23.737991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505cb48-4b0b-4b7c-ad6c-33cbf445eec0 admin admin] PATH_INFO: `/v3/projects/fce178cda8fd4f5b903c14a8686e5abf` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:23.740082 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505cb48-4b0b-4b7c-ad6c-33cbf445eec0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fce178cda8fd4f5b903c14a8686e5abf)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:23.742033 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505cb48-4b0b-4b7c-ad6c-33cbf445eec0 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:23.921189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d505cb48-4b0b-4b7c-ad6c-33cbf445eec0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fce178cda8fd4f5b903c14a8686e5abf', 'request_id': 'req-d505cb48-4b0b-4b7c-ad6c-33cbf445eec0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:23.931385 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d505cb48-4b0b-4b7c-ad6c-33cbf445eec0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fce178cda8fd4f5b903c14a8686e5abf', 'request_id': 'req-d505cb48-4b0b-4b7c-ad6c-33cbf445eec0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:23.939387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d505cb48-4b0b-4b7c-ad6c-33cbf445eec0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fce178cda8fd4f5b903c14a8686e5abf', 'request_id': 'req-d505cb48-4b0b-4b7c-ad6c-33cbf445eec0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:24.049252 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d505cb48-4b0b-4b7c-ad6c-33cbf445eec0 admin admin] The token cache is being invalidate because project fce178cda8fd4f5b903c14a8686e5abf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:34:24.049626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d505cb48-4b0b-4b7c-ad6c-33cbf445eec0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:24.050462 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d505cb48-4b0b-4b7c-ad6c-33cbf445eec0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:24.056964 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3351/6725] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:34:23 2022] DELETE /identity/v3/projects/fce178cda8fd4f5b903c14a8686e5abf => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:34:24.057616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b10999-8e2c-4459-89d9-a7b6a24dae35 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:24.058014 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b10999-8e2c-4459-89d9-a7b6a24dae35 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:24.058384 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b10999-8e2c-4459-89d9-a7b6a24dae35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:24.078730 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-93b10999-8e2c-4459-89d9-a7b6a24dae35 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:24.080418 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-93b10999-8e2c-4459-89d9-a7b6a24dae35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:24.125442 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505cb48-4b0b-4b7c-ad6c-33cbf445eec0 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:24.127037 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d505cb48-4b0b-4b7c-ad6c-33cbf445eec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:24.241521 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505cb48-4b0b-4b7c-ad6c-33cbf445eec0 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:24.253057 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ebe09-ed43-489b-8dda-f18462e49e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:24.254022 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ebe09-ed43-489b-8dda-f18462e49e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:24.254481 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ebe09-ed43-489b-8dda-f18462e49e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:24.255133 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ebe09-ed43-489b-8dda-f18462e49e8c admin admin] PATH_INFO: `/v3/projects/4addf46841b248ed8778845b6110a53d` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:24.257078 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ebe09-ed43-489b-8dda-f18462e49e8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4addf46841b248ed8778845b6110a53d)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:24.259783 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ebe09-ed43-489b-8dda-f18462e49e8c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:24.261615 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3375/6726] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:24.269866 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6fb666-1b22-4267-aaec-aafa00cd061d None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:24.272396 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6fb666-1b22-4267-aaec-aafa00cd061d None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:24.272396 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6fb666-1b22-4267-aaec-aafa00cd061d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:24.301360 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-dd6fb666-1b22-4267-aaec-aafa00cd061d None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:24.302774 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-dd6fb666-1b22-4267-aaec-aafa00cd061d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:24.318788 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3376/6727] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:24.323091 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6fb666-1b22-4267-aaec-aafa00cd061d None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:24.335836 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6fb666-1b22-4267-aaec-aafa00cd061d None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:24.345836 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265da829-a46f-4289-a223-127c4c26512c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:24.346834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265da829-a46f-4289-a223-127c4c26512c admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:24.347351 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265da829-a46f-4289-a223-127c4c26512c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:24.347822 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265da829-a46f-4289-a223-127c4c26512c admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:24.349464 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265da829-a46f-4289-a223-127c4c26512c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:34:24.350249 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265da829-a46f-4289-a223-127c4c26512c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:24.352334 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265da829-a46f-4289-a223-127c4c26512c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:24.369263 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3377/6728] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:34:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:34:24.374919 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265da829-a46f-4289-a223-127c4c26512c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:24.389110 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265da829-a46f-4289-a223-127c4c26512c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:24.404027 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-261ebe09-ed43-489b-8dda-f18462e49e8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4addf46841b248ed8778845b6110a53d', 'request_id': 'req-261ebe09-ed43-489b-8dda-f18462e49e8c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:24.411585 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-261ebe09-ed43-489b-8dda-f18462e49e8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4addf46841b248ed8778845b6110a53d', 'request_id': 'req-261ebe09-ed43-489b-8dda-f18462e49e8c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:24.423226 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-261ebe09-ed43-489b-8dda-f18462e49e8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4addf46841b248ed8778845b6110a53d', 'request_id': 'req-261ebe09-ed43-489b-8dda-f18462e49e8c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:24.471566 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b547a4-41c2-4ce5-a241-7df7d0cebd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:24.472228 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b547a4-41c2-4ce5-a241-7df7d0cebd82 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:24.472507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b547a4-41c2-4ce5-a241-7df7d0cebd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:24.472784 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b547a4-41c2-4ce5-a241-7df7d0cebd82 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:24.473497 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b547a4-41c2-4ce5-a241-7df7d0cebd82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:24.475451 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b547a4-41c2-4ce5-a241-7df7d0cebd82 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:24.555967 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-261ebe09-ed43-489b-8dda-f18462e49e8c admin admin] The token cache is being invalidate because project 4addf46841b248ed8778845b6110a53d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:34:24.556261 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-261ebe09-ed43-489b-8dda-f18462e49e8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:24.556903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-261ebe09-ed43-489b-8dda-f18462e49e8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:24.558580 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3352/6729] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:34:24 2022] DELETE /identity/v3/projects/4addf46841b248ed8778845b6110a53d => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:34:24.562285 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ebe09-ed43-489b-8dda-f18462e49e8c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:24.563624 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-261ebe09-ed43-489b-8dda-f18462e49e8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:24.576885 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ebe09-ed43-489b-8dda-f18462e49e8c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:24.581689 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238affb9-1c1c-4ef2-aa5a-0adbccc048d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:24.582569 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238affb9-1c1c-4ef2-aa5a-0adbccc048d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:24.593095 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238affb9-1c1c-4ef2-aa5a-0adbccc048d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:24.593095 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238affb9-1c1c-4ef2-aa5a-0adbccc048d2 admin admin] PATH_INFO: `/v3/users/ccce67dc9c494e61ba478bb8640a94a2` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:24.593095 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238affb9-1c1c-4ef2-aa5a-0adbccc048d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccce67dc9c494e61ba478bb8640a94a2)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:24.593095 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238affb9-1c1c-4ef2-aa5a-0adbccc048d2 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:24.632117 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3378/6730] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:34:24 2022] POST /identity/v3/projects => generated 371 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:34:24.634638 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b547a4-41c2-4ce5-a241-7df7d0cebd82 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:24.636375 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e5b547a4-41c2-4ce5-a241-7df7d0cebd82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:24.730553 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b547a4-41c2-4ce5-a241-7df7d0cebd82 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:24.735646 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e776c2-348a-45a9-82dd-cf5fb39d03f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:24.736348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e776c2-348a-45a9-82dd-cf5fb39d03f0 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:24.736632 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e776c2-348a-45a9-82dd-cf5fb39d03f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:24.736906 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e776c2-348a-45a9-82dd-cf5fb39d03f0 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:24.742297 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e776c2-348a-45a9-82dd-cf5fb39d03f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:24.742297 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e776c2-348a-45a9-82dd-cf5fb39d03f0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:24.901049 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-238affb9-1c1c-4ef2-aa5a-0adbccc048d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccce67dc9c494e61ba478bb8640a94a2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:24.916190 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3379/6731] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:34:24 2022] POST /identity/v3/users => generated 286 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:34:24.921013 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e776c2-348a-45a9-82dd-cf5fb39d03f0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:24.923844 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-238affb9-1c1c-4ef2-aa5a-0adbccc048d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccce67dc9c494e61ba478bb8640a94a2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:24.939120 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e776c2-348a-45a9-82dd-cf5fb39d03f0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:24.939600 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9549868-98f6-4981-b5aa-fa6bc7614b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:24.940275 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9549868-98f6-4981-b5aa-fa6bc7614b77 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:24.940558 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9549868-98f6-4981-b5aa-fa6bc7614b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:24.942101 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9549868-98f6-4981-b5aa-fa6bc7614b77 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:24.943103 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9549868-98f6-4981-b5aa-fa6bc7614b77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:24.944870 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9549868-98f6-4981-b5aa-fa6bc7614b77 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:24.956212 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3380/6732] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:34:24.963404 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9549868-98f6-4981-b5aa-fa6bc7614b77 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:24.972123 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9549868-98f6-4981-b5aa-fa6bc7614b77 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:24.980066 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf4356-381f-4fb5-94aa-20c3bf927ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:24.980066 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf4356-381f-4fb5-94aa-20c3bf927ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:24.980066 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf4356-381f-4fb5-94aa-20c3bf927ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:24.980066 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf4356-381f-4fb5-94aa-20c3bf927ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:24.980763 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf4356-381f-4fb5-94aa-20c3bf927ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:24.982424 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf4356-381f-4fb5-94aa-20c3bf927ed5 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:24.994298 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3381/6733] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:34:24.999040 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf4356-381f-4fb5-94aa-20c3bf927ed5 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:25.009429 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf4356-381f-4fb5-94aa-20c3bf927ed5 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:25.018110 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de4d94-afd4-4c9c-99d9-17f90df4c79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:25.018110 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de4d94-afd4-4c9c-99d9-17f90df4c79f admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:25.018110 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de4d94-afd4-4c9c-99d9-17f90df4c79f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:25.019165 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de4d94-afd4-4c9c-99d9-17f90df4c79f admin admin] PATH_INFO: `/v3/projects/63f9299458224a9ab673c2dab6be2814/users/08404a8b49774f9bb204f92e433ff156/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:25.040404 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de4d94-afd4-4c9c-99d9-17f90df4c79f admin admin] RBAC: Authorizing `identity:create_grant(project_id=63f9299458224a9ab673c2dab6be2814, user_id=08404a8b49774f9bb204f92e433ff156, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:25.044065 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de4d94-afd4-4c9c-99d9-17f90df4c79f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:25.073128 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-238affb9-1c1c-4ef2-aa5a-0adbccc048d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccce67dc9c494e61ba478bb8640a94a2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:25.073867 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-238affb9-1c1c-4ef2-aa5a-0adbccc048d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccce67dc9c494e61ba478bb8640a94a2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:25.081637 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-238affb9-1c1c-4ef2-aa5a-0adbccc048d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccce67dc9c494e61ba478bb8640a94a2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:25.088649 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3353/6734] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:34:24 2022] DELETE /identity/v3/users/ccce67dc9c494e61ba478bb8640a94a2 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:34:25.206588 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3382/6735] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:34:24 2022] PUT /identity/v3/projects/63f9299458224a9ab673c2dab6be2814/users/08404a8b49774f9bb204f92e433ff156/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:34:25.220430 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c4346-bb17-4f8b-9406-1422eaaa00c7 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:25.220856 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c4346-bb17-4f8b-9406-1422eaaa00c7 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:25.221212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c4346-bb17-4f8b-9406-1422eaaa00c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:25.251284 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-4e0c4346-bb17-4f8b-9406-1422eaaa00c7 None None] MFA Rules not processed for user `08404a8b49774f9bb204f92e433ff156`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:25.253408 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4e0c4346-bb17-4f8b-9406-1422eaaa00c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:25.363655 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3354/6736] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:25.374201 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de4d94-afd4-4c9c-99d9-17f90df4c79f admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:25.376598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f4de4d94-afd4-4c9c-99d9-17f90df4c79f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:25.391302 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c4346-bb17-4f8b-9406-1422eaaa00c7 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:25.393173 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4e0c4346-bb17-4f8b-9406-1422eaaa00c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:25.494926 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de4d94-afd4-4c9c-99d9-17f90df4c79f admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:25.499831 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ca38b-1c11-4ba4-bfa7-ba60220d1243 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:25.500490 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ca38b-1c11-4ba4-bfa7-ba60220d1243 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:25.500890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ca38b-1c11-4ba4-bfa7-ba60220d1243 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:25.501037 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ca38b-1c11-4ba4-bfa7-ba60220d1243 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:25.510445 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ca38b-1c11-4ba4-bfa7-ba60220d1243 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:25.518177 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ca38b-1c11-4ba4-bfa7-ba60220d1243 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:25.518402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c4346-bb17-4f8b-9406-1422eaaa00c7 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:25.522947 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f04a4-c8ba-40d8-accd-035dcaf8d5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:25.525276 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f04a4-c8ba-40d8-accd-035dcaf8d5bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:25.525913 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f04a4-c8ba-40d8-accd-035dcaf8d5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:25.526511 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f04a4-c8ba-40d8-accd-035dcaf8d5bd admin admin] PATH_INFO: `/v3/projects/f62512e7f9914015b8e0a0872f0d0f3f` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:25.527489 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3383/6737] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:34:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:34:25.529664 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f04a4-c8ba-40d8-accd-035dcaf8d5bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f62512e7f9914015b8e0a0872f0d0f3f)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:25.532536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f04a4-c8ba-40d8-accd-035dcaf8d5bd admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:25.645871 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-420f04a4-c8ba-40d8-accd-035dcaf8d5bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f62512e7f9914015b8e0a0872f0d0f3f', 'request_id': 'req-420f04a4-c8ba-40d8-accd-035dcaf8d5bd'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:25.654538 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-420f04a4-c8ba-40d8-accd-035dcaf8d5bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f62512e7f9914015b8e0a0872f0d0f3f', 'request_id': 'req-420f04a4-c8ba-40d8-accd-035dcaf8d5bd'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:25.662973 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-420f04a4-c8ba-40d8-accd-035dcaf8d5bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f62512e7f9914015b8e0a0872f0d0f3f', 'request_id': 'req-420f04a4-c8ba-40d8-accd-035dcaf8d5bd'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:25.757527 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-420f04a4-c8ba-40d8-accd-035dcaf8d5bd admin admin] The token cache is being invalidate because project f62512e7f9914015b8e0a0872f0d0f3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:34:25.757859 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-420f04a4-c8ba-40d8-accd-035dcaf8d5bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:25.758549 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-420f04a4-c8ba-40d8-accd-035dcaf8d5bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:25.763148 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3355/6738] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:34:25 2022] DELETE /identity/v3/projects/f62512e7f9914015b8e0a0872f0d0f3f => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:34:25.766197 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156ed89-caed-4145-b475-00556447338e None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:25.766500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156ed89-caed-4145-b475-00556447338e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:25.766767 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e156ed89-caed-4145-b475-00556447338e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:25.788934 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-e156ed89-caed-4145-b475-00556447338e None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:25.790692 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e156ed89-caed-4145-b475-00556447338e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:25.870667 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3384/6739] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:25.870786 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635ae30-7fe9-4e37-a9cb-fb12155c33e7 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:25.870786 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635ae30-7fe9-4e37-a9cb-fb12155c33e7 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:25.870786 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635ae30-7fe9-4e37-a9cb-fb12155c33e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:25.894684 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-0635ae30-7fe9-4e37-a9cb-fb12155c33e7 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:25.896150 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0635ae30-7fe9-4e37-a9cb-fb12155c33e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:25.915934 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3356/6740] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:25.919877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156ed89-caed-4145-b475-00556447338e None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:25.936467 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e156ed89-caed-4145-b475-00556447338e None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:25.938283 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ed27b-4eaa-4b73-ae08-531db850a975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:25.938954 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ed27b-4eaa-4b73-ae08-531db850a975 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:25.939237 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ed27b-4eaa-4b73-ae08-531db850a975 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:25.939512 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ed27b-4eaa-4b73-ae08-531db850a975 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:25.940239 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ed27b-4eaa-4b73-ae08-531db850a975 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:34:25.940551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ed27b-4eaa-4b73-ae08-531db850a975 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:25.942260 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ed27b-4eaa-4b73-ae08-531db850a975 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:25.967803 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3385/6741] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:34:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:34:25.969174 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635ae30-7fe9-4e37-a9cb-fb12155c33e7 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:25.981281 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635ae30-7fe9-4e37-a9cb-fb12155c33e7 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:25.991256 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10835848-0ecc-491b-9e9c-c770f6b809d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:25.992082 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10835848-0ecc-491b-9e9c-c770f6b809d8 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:25.992506 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10835848-0ecc-491b-9e9c-c770f6b809d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:25.993411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10835848-0ecc-491b-9e9c-c770f6b809d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:25.994289 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10835848-0ecc-491b-9e9c-c770f6b809d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:25.996493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10835848-0ecc-491b-9e9c-c770f6b809d8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:26.114350 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3357/6742] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:34:25 2022] POST /identity/v3/projects => generated 367 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:34:26.117252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ed27b-4eaa-4b73-ae08-531db850a975 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:26.131286 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ed27b-4eaa-4b73-ae08-531db850a975 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:26.207697 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea6258-1386-4f10-8dd4-b99309e350d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:26.209802 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea6258-1386-4f10-8dd4-b99309e350d0 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:26.210071 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea6258-1386-4f10-8dd4-b99309e350d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:26.210401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea6258-1386-4f10-8dd4-b99309e350d0 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:26.211092 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfea6258-1386-4f10-8dd4-b99309e350d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:26.215145 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfea6258-1386-4f10-8dd4-b99309e350d0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:26.251562 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10835848-0ecc-491b-9e9c-c770f6b809d8 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:26.252366 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-10835848-0ecc-491b-9e9c-c770f6b809d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:26.266600 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10835848-0ecc-491b-9e9c-c770f6b809d8 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:26.279761 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0757e-846a-4a06-af49-b628819191ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:26.280910 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0757e-846a-4a06-af49-b628819191ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:26.281284 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0757e-846a-4a06-af49-b628819191ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:26.281565 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0757e-846a-4a06-af49-b628819191ef admin admin] PATH_INFO: `/v3/users/08404a8b49774f9bb204f92e433ff156` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:26.282822 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0757e-846a-4a06-af49-b628819191ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=08404a8b49774f9bb204f92e433ff156)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:26.284784 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0757e-846a-4a06-af49-b628819191ef admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:26.338227 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3386/6743] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:34:26 2022] POST /identity/v3/users => generated 284 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:34:26.342434 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea6258-1386-4f10-8dd4-b99309e350d0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:26.354742 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea6258-1386-4f10-8dd4-b99309e350d0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:26.360044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c5abe-145f-45de-812d-ce88c9944f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:26.365076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c5abe-145f-45de-812d-ce88c9944f24 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:26.365076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c5abe-145f-45de-812d-ce88c9944f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:26.365076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c5abe-145f-45de-812d-ce88c9944f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:26.365076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745c5abe-145f-45de-812d-ce88c9944f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:26.365076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745c5abe-145f-45de-812d-ce88c9944f24 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:26.384769 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3387/6744] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:34:26.388508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c5abe-145f-45de-812d-ce88c9944f24 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:26.402952 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c5abe-145f-45de-812d-ce88c9944f24 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:26.411223 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d6deb-6509-4c38-86e7-cf1b0c3c18d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:26.412902 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d6deb-6509-4c38-86e7-cf1b0c3c18d1 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:26.413307 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d6deb-6509-4c38-86e7-cf1b0c3c18d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:26.413644 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d6deb-6509-4c38-86e7-cf1b0c3c18d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:26.414806 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d6deb-6509-4c38-86e7-cf1b0c3c18d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:26.417810 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d6deb-6509-4c38-86e7-cf1b0c3c18d1 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:26.440321 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3388/6745] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:34:26.441292 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d6deb-6509-4c38-86e7-cf1b0c3c18d1 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:26.459711 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d6deb-6509-4c38-86e7-cf1b0c3c18d1 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:26.471499 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e31f6a-a115-4691-b3d7-5f82076143a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:26.472407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e31f6a-a115-4691-b3d7-5f82076143a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:26.477333 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e31f6a-a115-4691-b3d7-5f82076143a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:26.477333 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e31f6a-a115-4691-b3d7-5f82076143a8 admin admin] PATH_INFO: `/v3/projects/5cc6a2a737624602a6c35664ef12ee53/users/1a3877d9751e460ca0a3a710c5cf099b/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:26.501791 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e31f6a-a115-4691-b3d7-5f82076143a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cc6a2a737624602a6c35664ef12ee53, user_id=1a3877d9751e460ca0a3a710c5cf099b, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:26.506132 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e31f6a-a115-4691-b3d7-5f82076143a8 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:26.561377 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a8d0757e-846a-4a06-af49-b628819191ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08404a8b49774f9bb204f92e433ff156'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:26.573903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a8d0757e-846a-4a06-af49-b628819191ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08404a8b49774f9bb204f92e433ff156'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:26.605586 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3389/6746] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:34:26 2022] PUT /identity/v3/projects/5cc6a2a737624602a6c35664ef12ee53/users/1a3877d9751e460ca0a3a710c5cf099b/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:34:26.616235 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931fa10-42bb-44c0-bd2a-eab4cf3f288c None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:26.616524 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931fa10-42bb-44c0-bd2a-eab4cf3f288c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:26.616801 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931fa10-42bb-44c0-bd2a-eab4cf3f288c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:26.646266 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-9931fa10-42bb-44c0-bd2a-eab4cf3f288c None None] MFA Rules not processed for user `1a3877d9751e460ca0a3a710c5cf099b`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:26.646967 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a8d0757e-846a-4a06-af49-b628819191ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08404a8b49774f9bb204f92e433ff156'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:26.647694 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a8d0757e-846a-4a06-af49-b628819191ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08404a8b49774f9bb204f92e433ff156'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:26.650438 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9931fa10-42bb-44c0-bd2a-eab4cf3f288c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:26.660964 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a8d0757e-846a-4a06-af49-b628819191ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08404a8b49774f9bb204f92e433ff156'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:26.670115 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3358/6747] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:34:26 2022] DELETE /identity/v3/users/08404a8b49774f9bb204f92e433ff156 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:34:26.676104 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618e5be-3a0c-44f1-8914-7f7e6a25fb4a None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:26.678208 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618e5be-3a0c-44f1-8914-7f7e6a25fb4a None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:26.678208 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618e5be-3a0c-44f1-8914-7f7e6a25fb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:26.705540 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-2618e5be-3a0c-44f1-8914-7f7e6a25fb4a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:26.707174 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2618e5be-3a0c-44f1-8914-7f7e6a25fb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:26.756548 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3390/6748] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:26 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:34:26.768226 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931fa10-42bb-44c0-bd2a-eab4cf3f288c None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:26.769882 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9931fa10-42bb-44c0-bd2a-eab4cf3f288c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:26.790875 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3359/6749] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:26.802103 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618e5be-3a0c-44f1-8914-7f7e6a25fb4a None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:26.803739 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2618e5be-3a0c-44f1-8914-7f7e6a25fb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:26.837675 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931fa10-42bb-44c0-bd2a-eab4cf3f288c None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:26.878138 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618e5be-3a0c-44f1-8914-7f7e6a25fb4a None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:26.882244 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992dfe0c-36bd-4434-b39f-b3e1f978cd8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:26.883333 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992dfe0c-36bd-4434-b39f-b3e1f978cd8b service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:26.883333 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992dfe0c-36bd-4434-b39f-b3e1f978cd8b service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:26.883859 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992dfe0c-36bd-4434-b39f-b3e1f978cd8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:26.894031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992dfe0c-36bd-4434-b39f-b3e1f978cd8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:26.895355 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e156155-a81e-47c2-b4ba-de97b140d2aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:26.895695 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992dfe0c-36bd-4434-b39f-b3e1f978cd8b service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:26.896152 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e156155-a81e-47c2-b4ba-de97b140d2aa service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:26.896512 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e156155-a81e-47c2-b4ba-de97b140d2aa service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:26.896872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e156155-a81e-47c2-b4ba-de97b140d2aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:26.908295 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3360/6750] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:34:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:34:26.964196 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e156155-a81e-47c2-b4ba-de97b140d2aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:26.965740 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e156155-a81e-47c2-b4ba-de97b140d2aa service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:26.976774 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3391/6751] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:34:26 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:34:27.627940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992dfe0c-36bd-4434-b39f-b3e1f978cd8b service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:27.629470 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-992dfe0c-36bd-4434-b39f-b3e1f978cd8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:27.646049 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992dfe0c-36bd-4434-b39f-b3e1f978cd8b service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:27.655002 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f947d-1f3c-4055-a3ed-e4934b12b00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:27.656299 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f947d-1f3c-4055-a3ed-e4934b12b00e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:27.656686 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f947d-1f3c-4055-a3ed-e4934b12b00e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:27.657192 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f947d-1f3c-4055-a3ed-e4934b12b00e admin admin] PATH_INFO: `/v3/projects/63f9299458224a9ab673c2dab6be2814` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:27.659953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f947d-1f3c-4055-a3ed-e4934b12b00e admin admin] RBAC: Authorizing `identity:delete_project(project_id=63f9299458224a9ab673c2dab6be2814)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:27.663966 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f947d-1f3c-4055-a3ed-e4934b12b00e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:27.857582 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e09f947d-1f3c-4055-a3ed-e4934b12b00e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63f9299458224a9ab673c2dab6be2814', 'request_id': 'req-e09f947d-1f3c-4055-a3ed-e4934b12b00e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:27.873252 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e09f947d-1f3c-4055-a3ed-e4934b12b00e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63f9299458224a9ab673c2dab6be2814', 'request_id': 'req-e09f947d-1f3c-4055-a3ed-e4934b12b00e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:27.881009 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e09f947d-1f3c-4055-a3ed-e4934b12b00e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63f9299458224a9ab673c2dab6be2814', 'request_id': 'req-e09f947d-1f3c-4055-a3ed-e4934b12b00e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:28.011528 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e09f947d-1f3c-4055-a3ed-e4934b12b00e admin admin] The token cache is being invalidate because project 63f9299458224a9ab673c2dab6be2814 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:34:28.012010 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e09f947d-1f3c-4055-a3ed-e4934b12b00e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:28.013736 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e09f947d-1f3c-4055-a3ed-e4934b12b00e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:28.015652 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3361/6752] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:34:27 2022] DELETE /identity/v3/projects/63f9299458224a9ab673c2dab6be2814 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:34:28.021980 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36a98c-7dcc-48fa-9f5c-d61612100955 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:28.022500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36a98c-7dcc-48fa-9f5c-d61612100955 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:28.022500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36a98c-7dcc-48fa-9f5c-d61612100955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:28.043029 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-3e36a98c-7dcc-48fa-9f5c-d61612100955 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:28.044493 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3e36a98c-7dcc-48fa-9f5c-d61612100955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:28.121920 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3392/6753] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:28.132062 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50cf32-8034-4e92-8f03-663e41d53a0b None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:28.132344 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50cf32-8034-4e92-8f03-663e41d53a0b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:28.132822 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50cf32-8034-4e92-8f03-663e41d53a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:28.169140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-fc50cf32-8034-4e92-8f03-663e41d53a0b None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:28.172738 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-fc50cf32-8034-4e92-8f03-663e41d53a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:28.192373 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3362/6754] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:28.198408 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36a98c-7dcc-48fa-9f5c-d61612100955 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:28.218209 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36a98c-7dcc-48fa-9f5c-d61612100955 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:28.232254 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d744b-ef99-478b-937b-ca3fcd4c92e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:28.232949 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d744b-ef99-478b-937b-ca3fcd4c92e2 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:28.233234 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d744b-ef99-478b-937b-ca3fcd4c92e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:28.233523 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d744b-ef99-478b-937b-ca3fcd4c92e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:28.234442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d744b-ef99-478b-937b-ca3fcd4c92e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:34:28.234759 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d744b-ef99-478b-937b-ca3fcd4c92e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:28.236406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d744b-ef99-478b-937b-ca3fcd4c92e2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:28.253847 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3393/6755] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:34:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:34:28.256920 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50cf32-8034-4e92-8f03-663e41d53a0b None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:28.269304 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50cf32-8034-4e92-8f03-663e41d53a0b None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:28.275703 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24245e71-88ea-4577-9429-3bf72b323a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:28.276747 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24245e71-88ea-4577-9429-3bf72b323a62 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:28.277663 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24245e71-88ea-4577-9429-3bf72b323a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:28.278180 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24245e71-88ea-4577-9429-3bf72b323a62 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:28.279724 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24245e71-88ea-4577-9429-3bf72b323a62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:28.282178 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24245e71-88ea-4577-9429-3bf72b323a62 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:28.432220 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d744b-ef99-478b-937b-ca3fcd4c92e2 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:28.447246 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3363/6756] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:34:28 2022] POST /identity/v3/projects => generated 373 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:34:28.449620 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d744b-ef99-478b-937b-ca3fcd4c92e2 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:28.635973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d6a14-4b0a-407d-8606-f9dc08588473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:28.640780 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d6a14-4b0a-407d-8606-f9dc08588473 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:28.646480 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d6a14-4b0a-407d-8606-f9dc08588473 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:28.646480 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d6a14-4b0a-407d-8606-f9dc08588473 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:28.646839 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d6a14-4b0a-407d-8606-f9dc08588473 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:28.652422 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d6a14-4b0a-407d-8606-f9dc08588473 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:28.798064 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3394/6757] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:34:28 2022] POST /identity/v3/users => generated 287 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:34:28.800002 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24245e71-88ea-4577-9429-3bf72b323a62 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:28.825161 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24245e71-88ea-4577-9429-3bf72b323a62 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:28.833547 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99658d-bd9d-47f4-ac96-92ed20f1bcb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:28.834780 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99658d-bd9d-47f4-ac96-92ed20f1bcb5 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:28.837120 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99658d-bd9d-47f4-ac96-92ed20f1bcb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:28.837872 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99658d-bd9d-47f4-ac96-92ed20f1bcb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:28.840424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc99658d-bd9d-47f4-ac96-92ed20f1bcb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:28.842617 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc99658d-bd9d-47f4-ac96-92ed20f1bcb5 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:28.858678 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3364/6758] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:34:28.863231 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d6a14-4b0a-407d-8606-f9dc08588473 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:28.879758 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d6a14-4b0a-407d-8606-f9dc08588473 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:28.906489 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da3da4-b1d1-4924-985c-6d11d0b91f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:28.907853 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da3da4-b1d1-4924-985c-6d11d0b91f47 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:28.908696 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da3da4-b1d1-4924-985c-6d11d0b91f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:28.909200 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da3da4-b1d1-4924-985c-6d11d0b91f47 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:28.910997 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da3da4-b1d1-4924-985c-6d11d0b91f47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:28.913297 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da3da4-b1d1-4924-985c-6d11d0b91f47 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:28.930894 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3395/6759] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:34:28.935880 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99658d-bd9d-47f4-ac96-92ed20f1bcb5 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:28.956862 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99658d-bd9d-47f4-ac96-92ed20f1bcb5 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:28.964118 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db532e-902f-4bea-991a-0e47e16f5bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:28.965281 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db532e-902f-4bea-991a-0e47e16f5bb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:28.965810 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db532e-902f-4bea-991a-0e47e16f5bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:28.966325 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db532e-902f-4bea-991a-0e47e16f5bb6 admin admin] PATH_INFO: `/v3/projects/b7849b281e984e1c95e26b3fb1acf8a1/users/5ca906e8711f47c2b5d84393215822b5/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:29.000896 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6db532e-902f-4bea-991a-0e47e16f5bb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7849b281e984e1c95e26b3fb1acf8a1, user_id=5ca906e8711f47c2b5d84393215822b5, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:29.009162 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6db532e-902f-4bea-991a-0e47e16f5bb6 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:29.119947 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3365/6760] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:34:28 2022] PUT /identity/v3/projects/b7849b281e984e1c95e26b3fb1acf8a1/users/5ca906e8711f47c2b5d84393215822b5/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:34:29.130739 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b951f9b-2564-465b-8db1-327f6bdda19a None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:29.131236 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b951f9b-2564-465b-8db1-327f6bdda19a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:29.131629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b951f9b-2564-465b-8db1-327f6bdda19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:29.177595 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-1b951f9b-2564-465b-8db1-327f6bdda19a None None] MFA Rules not processed for user `5ca906e8711f47c2b5d84393215822b5`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:29.179216 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1b951f9b-2564-465b-8db1-327f6bdda19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:29.294579 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3396/6761] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:29.319551 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db532e-902f-4bea-991a-0e47e16f5bb6 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:29.321495 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d6db532e-902f-4bea-991a-0e47e16f5bb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:29.436416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db532e-902f-4bea-991a-0e47e16f5bb6 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:29.454948 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8106c7-4df4-4633-af6f-d09156fe37e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:29.456064 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8106c7-4df4-4633-af6f-d09156fe37e8 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:29.456576 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8106c7-4df4-4633-af6f-d09156fe37e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:29.457071 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8106c7-4df4-4633-af6f-d09156fe37e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:29.471796 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8106c7-4df4-4633-af6f-d09156fe37e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:29.480251 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8106c7-4df4-4633-af6f-d09156fe37e8 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:29.488358 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3366/6762] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:34:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:34:31.076509 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b951f9b-2564-465b-8db1-327f6bdda19a None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:31.079660 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1b951f9b-2564-465b-8db1-327f6bdda19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:31.184346 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b951f9b-2564-465b-8db1-327f6bdda19a None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:31.191720 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3675bfe-72ed-4328-b5e9-0361ac3b93aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:31.193162 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3675bfe-72ed-4328-b5e9-0361ac3b93aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:31.193816 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3675bfe-72ed-4328-b5e9-0361ac3b93aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:31.194410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3675bfe-72ed-4328-b5e9-0361ac3b93aa admin admin] PATH_INFO: `/v3/users/f5f04392a4c94046bc7da53b4dffb0e3` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:31.197015 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3675bfe-72ed-4328-b5e9-0361ac3b93aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5f04392a4c94046bc7da53b4dffb0e3)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:31.199408 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3675bfe-72ed-4328-b5e9-0361ac3b93aa admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:31.452883 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f3675bfe-72ed-4328-b5e9-0361ac3b93aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5f04392a4c94046bc7da53b4dffb0e3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:31.476164 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f3675bfe-72ed-4328-b5e9-0361ac3b93aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5f04392a4c94046bc7da53b4dffb0e3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:31.547097 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f3675bfe-72ed-4328-b5e9-0361ac3b93aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5f04392a4c94046bc7da53b4dffb0e3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:31.555150 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f3675bfe-72ed-4328-b5e9-0361ac3b93aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5f04392a4c94046bc7da53b4dffb0e3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:31.556125 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f3675bfe-72ed-4328-b5e9-0361ac3b93aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5f04392a4c94046bc7da53b4dffb0e3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:31.562328 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3397/6763] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:34:31 2022] DELETE /identity/v3/users/f5f04392a4c94046bc7da53b4dffb0e3 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:34:31.806212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8106c7-4df4-4633-af6f-d09156fe37e8 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:31.827964 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8106c7-4df4-4633-af6f-d09156fe37e8 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:31.909270 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe06cd-caa4-4733-bdbb-9122e46c459a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:31.910296 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe06cd-caa4-4733-bdbb-9122e46c459a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:31.910667 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe06cd-caa4-4733-bdbb-9122e46c459a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:31.911008 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe06cd-caa4-4733-bdbb-9122e46c459a admin admin] PATH_INFO: `/v3/projects/7328d5d6d45a4e80820e1a57f9f9a81c` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:31.912285 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe06cd-caa4-4733-bdbb-9122e46c459a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7328d5d6d45a4e80820e1a57f9f9a81c)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:31.914978 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe06cd-caa4-4733-bdbb-9122e46c459a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:32.033709 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-dbfe06cd-caa4-4733-bdbb-9122e46c459a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7328d5d6d45a4e80820e1a57f9f9a81c', 'request_id': 'req-dbfe06cd-caa4-4733-bdbb-9122e46c459a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:32.039009 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-dbfe06cd-caa4-4733-bdbb-9122e46c459a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7328d5d6d45a4e80820e1a57f9f9a81c', 'request_id': 'req-dbfe06cd-caa4-4733-bdbb-9122e46c459a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:32.045679 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-dbfe06cd-caa4-4733-bdbb-9122e46c459a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7328d5d6d45a4e80820e1a57f9f9a81c', 'request_id': 'req-dbfe06cd-caa4-4733-bdbb-9122e46c459a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:32.119290 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-dbfe06cd-caa4-4733-bdbb-9122e46c459a admin admin] The token cache is being invalidate because project 7328d5d6d45a4e80820e1a57f9f9a81c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:34:32.119587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-dbfe06cd-caa4-4733-bdbb-9122e46c459a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:32.120257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-dbfe06cd-caa4-4733-bdbb-9122e46c459a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:32.122142 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3367/6764] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:34:31 2022] DELETE /identity/v3/projects/7328d5d6d45a4e80820e1a57f9f9a81c => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:34:32.126795 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30b576-d792-44e3-bd33-5951ae2bd21f None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:32.127294 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30b576-d792-44e3-bd33-5951ae2bd21f None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:32.127386 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30b576-d792-44e3-bd33-5951ae2bd21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:32.145018 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-8e30b576-d792-44e3-bd33-5951ae2bd21f None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:32.146319 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8e30b576-d792-44e3-bd33-5951ae2bd21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:32.214898 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3398/6765] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:32.221114 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ebba9-ea06-4dbb-a64f-7f10cc4431d1 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:32.221411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ebba9-ea06-4dbb-a64f-7f10cc4431d1 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:32.221851 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ebba9-ea06-4dbb-a64f-7f10cc4431d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:32.241466 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-a43ebba9-ea06-4dbb-a64f-7f10cc4431d1 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:32.243251 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a43ebba9-ea06-4dbb-a64f-7f10cc4431d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:32.252139 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3368/6766] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:32.266835 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30b576-d792-44e3-bd33-5951ae2bd21f None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:32.270867 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30b576-d792-44e3-bd33-5951ae2bd21f None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:32.275345 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61813c1-c89e-4fe1-b65d-b42f6a64858a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:32.275677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61813c1-c89e-4fe1-b65d-b42f6a64858a admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:32.276034 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61813c1-c89e-4fe1-b65d-b42f6a64858a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:32.276333 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61813c1-c89e-4fe1-b65d-b42f6a64858a admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:32.277106 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61813c1-c89e-4fe1-b65d-b42f6a64858a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:34:32.277352 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61813c1-c89e-4fe1-b65d-b42f6a64858a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:32.279767 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61813c1-c89e-4fe1-b65d-b42f6a64858a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:32.311363 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3399/6767] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:34:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:34:32.315870 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ebba9-ea06-4dbb-a64f-7f10cc4431d1 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:32.328657 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ebba9-ea06-4dbb-a64f-7f10cc4431d1 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:32.334299 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d06d7e-fc8f-4098-9f3f-167f89e1a76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:32.335894 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d06d7e-fc8f-4098-9f3f-167f89e1a76f admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:32.336381 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d06d7e-fc8f-4098-9f3f-167f89e1a76f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:32.336815 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d06d7e-fc8f-4098-9f3f-167f89e1a76f admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:32.337787 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d06d7e-fc8f-4098-9f3f-167f89e1a76f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:32.340423 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d06d7e-fc8f-4098-9f3f-167f89e1a76f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:32.444589 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3369/6768] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:34:32 2022] POST /identity/v3/projects => generated 405 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:34:32.449198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61813c1-c89e-4fe1-b65d-b42f6a64858a admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:32.461921 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61813c1-c89e-4fe1-b65d-b42f6a64858a admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:32.536892 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e534f79-1cea-43eb-a8a2-0bef3713c904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:32.537587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e534f79-1cea-43eb-a8a2-0bef3713c904 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:32.537906 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e534f79-1cea-43eb-a8a2-0bef3713c904 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:32.541179 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e534f79-1cea-43eb-a8a2-0bef3713c904 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:32.541179 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e534f79-1cea-43eb-a8a2-0bef3713c904 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:32.541415 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e534f79-1cea-43eb-a8a2-0bef3713c904 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:32.639974 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3400/6769] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:34:32 2022] POST /identity/v3/users => generated 303 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:34:32.644094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d06d7e-fc8f-4098-9f3f-167f89e1a76f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:32.655604 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d06d7e-fc8f-4098-9f3f-167f89e1a76f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:32.660784 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee9ec07-f5f9-4b3e-b9b3-dfce8759c06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:32.661463 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9ec07-f5f9-4b3e-b9b3-dfce8759c06f admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:32.661918 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9ec07-f5f9-4b3e-b9b3-dfce8759c06f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:32.662200 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9ec07-f5f9-4b3e-b9b3-dfce8759c06f admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:32.663051 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee9ec07-f5f9-4b3e-b9b3-dfce8759c06f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:32.664924 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee9ec07-f5f9-4b3e-b9b3-dfce8759c06f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:32.683523 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3370/6770] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:34:32.687247 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e534f79-1cea-43eb-a8a2-0bef3713c904 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:32.712161 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e534f79-1cea-43eb-a8a2-0bef3713c904 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:32.728837 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d1793-8685-4992-9ed8-eba895f0782a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:32.729724 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d1793-8685-4992-9ed8-eba895f0782a admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:32.730027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d1793-8685-4992-9ed8-eba895f0782a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:32.735262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d1793-8685-4992-9ed8-eba895f0782a admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:32.735262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d1793-8685-4992-9ed8-eba895f0782a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:32.735262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d1793-8685-4992-9ed8-eba895f0782a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:32.751670 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3401/6771] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:34:32.756565 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee9ec07-f5f9-4b3e-b9b3-dfce8759c06f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:32.767650 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee9ec07-f5f9-4b3e-b9b3-dfce8759c06f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:32.772542 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11b628-1849-4b6e-a393-22168e11e51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:32.774092 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11b628-1849-4b6e-a393-22168e11e51c admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:32.774559 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11b628-1849-4b6e-a393-22168e11e51c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:32.774845 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11b628-1849-4b6e-a393-22168e11e51c admin admin] PATH_INFO: `/v3/projects/e374475a40f64506bf36664ff452ea96/users/bde6c559633341eab2d1241f79f7a3dc/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:32.795057 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a11b628-1849-4b6e-a393-22168e11e51c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e374475a40f64506bf36664ff452ea96, user_id=bde6c559633341eab2d1241f79f7a3dc, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:32.798622 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a11b628-1849-4b6e-a393-22168e11e51c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:32.921191 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3371/6772] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:34:32 2022] PUT /identity/v3/projects/e374475a40f64506bf36664ff452ea96/users/bde6c559633341eab2d1241f79f7a3dc/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:34:32.923149 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc9fce-5fdc-41cd-a1b2-cb9b0a35e6d3 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:32.923447 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc9fce-5fdc-41cd-a1b2-cb9b0a35e6d3 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:32.923726 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc9fce-5fdc-41cd-a1b2-cb9b0a35e6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:32.955515 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-a8dc9fce-5fdc-41cd-a1b2-cb9b0a35e6d3 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:32.956959 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a8dc9fce-5fdc-41cd-a1b2-cb9b0a35e6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:33.032452 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3402/6773] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:33.047485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11b628-1849-4b6e-a393-22168e11e51c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:33.053021 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5a11b628-1849-4b6e-a393-22168e11e51c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:33.114932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11b628-1849-4b6e-a393-22168e11e51c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:33.119411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea2dd2-3623-40b5-84b3-f2b85535cf89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:33.120128 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea2dd2-3623-40b5-84b3-f2b85535cf89 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:33.120479 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea2dd2-3623-40b5-84b3-f2b85535cf89 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:33.120818 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea2dd2-3623-40b5-84b3-f2b85535cf89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:33.130365 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea2dd2-3623-40b5-84b3-f2b85535cf89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:33.131970 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea2dd2-3623-40b5-84b3-f2b85535cf89 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:33.141590 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3372/6774] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:34:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:34:35.561153 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75b3a6-5bca-423a-85bf-c4e39167ab1c None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:35.562560 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75b3a6-5bca-423a-85bf-c4e39167ab1c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:35.562934 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c75b3a6-5bca-423a-85bf-c4e39167ab1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:35.602247 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-0c75b3a6-5bca-423a-85bf-c4e39167ab1c None None] MFA Rules not processed for user `bde6c559633341eab2d1241f79f7a3dc`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:35.606022 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0c75b3a6-5bca-423a-85bf-c4e39167ab1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:35.683494 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3403/6775] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:35 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:35.688436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea2dd2-3623-40b5-84b3-f2b85535cf89 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:35.701185 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea2dd2-3623-40b5-84b3-f2b85535cf89 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:35.712314 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc44f11-e223-45ab-b383-9ec062f124ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:35.713392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc44f11-e223-45ab-b383-9ec062f124ee admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:35.713927 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc44f11-e223-45ab-b383-9ec062f124ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:35.714385 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc44f11-e223-45ab-b383-9ec062f124ee admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:35.715242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc44f11-e223-45ab-b383-9ec062f124ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:35.717423 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc44f11-e223-45ab-b383-9ec062f124ee admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:35.797609 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3373/6776] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:34:35 2022] POST /identity/v3/projects => generated 403 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:34:35.798952 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75b3a6-5bca-423a-85bf-c4e39167ab1c None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:35.813433 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c75b3a6-5bca-423a-85bf-c4e39167ab1c None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:35.886047 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf239c74-d3c8-4346-834b-e5071433f384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:35.886914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf239c74-d3c8-4346-834b-e5071433f384 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:35.887294 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf239c74-d3c8-4346-834b-e5071433f384 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:35.887893 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf239c74-d3c8-4346-834b-e5071433f384 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:35.888695 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf239c74-d3c8-4346-834b-e5071433f384 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:35.890979 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf239c74-d3c8-4346-834b-e5071433f384 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:36.009486 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3404/6777] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:34:35 2022] POST /identity/v3/users => generated 302 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:34:36.011914 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc44f11-e223-45ab-b383-9ec062f124ee admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:36.026953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc44f11-e223-45ab-b383-9ec062f124ee admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:36.036286 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbfd819-411f-4d3d-afc5-07b646c9f7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:36.037895 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbfd819-411f-4d3d-afc5-07b646c9f7ed admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:36.038588 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbfd819-411f-4d3d-afc5-07b646c9f7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:36.040248 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbfd819-411f-4d3d-afc5-07b646c9f7ed admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:36.041237 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbfd819-411f-4d3d-afc5-07b646c9f7ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:36.044314 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbfd819-411f-4d3d-afc5-07b646c9f7ed admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:36.063356 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3374/6778] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:34:36.073939 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf239c74-d3c8-4346-834b-e5071433f384 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:36.086314 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf239c74-d3c8-4346-834b-e5071433f384 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:36.091789 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b774a-caa2-40bc-9317-a1c128673147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:36.092844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b774a-caa2-40bc-9317-a1c128673147 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:36.093427 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b774a-caa2-40bc-9317-a1c128673147 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:36.093955 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b774a-caa2-40bc-9317-a1c128673147 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:36.094870 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b774a-caa2-40bc-9317-a1c128673147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:36.096735 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b774a-caa2-40bc-9317-a1c128673147 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:36.110297 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3405/6779] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:34:36.114400 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbfd819-411f-4d3d-afc5-07b646c9f7ed admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:36.138884 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbfd819-411f-4d3d-afc5-07b646c9f7ed admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:36.175360 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40be81-6602-4c05-b931-16457e35e6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:36.176843 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40be81-6602-4c05-b931-16457e35e6f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:36.177336 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40be81-6602-4c05-b931-16457e35e6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:36.178114 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40be81-6602-4c05-b931-16457e35e6f9 admin admin] PATH_INFO: `/v3/projects/5994b70466a14d378c557473048ae49f/users/1f27c1e40cba46c9b8ef8f4c8124cd93/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:36.255509 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab40be81-6602-4c05-b931-16457e35e6f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5994b70466a14d378c557473048ae49f, user_id=1f27c1e40cba46c9b8ef8f4c8124cd93, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:36.260075 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab40be81-6602-4c05-b931-16457e35e6f9 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:36.377259 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3375/6780] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:34:36 2022] PUT /identity/v3/projects/5994b70466a14d378c557473048ae49f/users/1f27c1e40cba46c9b8ef8f4c8124cd93/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:34:38.263759 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230aba63-c729-4eba-bd80-05b1f418657b None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:38.263759 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230aba63-c729-4eba-bd80-05b1f418657b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:38.264245 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230aba63-c729-4eba-bd80-05b1f418657b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:38.310703 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-230aba63-c729-4eba-bd80-05b1f418657b None None] MFA Rules not processed for user `1f27c1e40cba46c9b8ef8f4c8124cd93`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:38.312519 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-230aba63-c729-4eba-bd80-05b1f418657b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:38.437813 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3406/6781] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:38.447822 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b00df8-95b4-4346-a6ea-28331dfc9255 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:38.449053 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b00df8-95b4-4346-a6ea-28331dfc9255 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:38.451090 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b00df8-95b4-4346-a6ea-28331dfc9255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:38.469703 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-98b00df8-95b4-4346-a6ea-28331dfc9255 None None] MFA Rules not processed for user `bde6c559633341eab2d1241f79f7a3dc`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:38.471220 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-98b00df8-95b4-4346-a6ea-28331dfc9255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:38.558750 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3376/6782] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:38 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:38.582109 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230aba63-c729-4eba-bd80-05b1f418657b None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:38.582109 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-230aba63-c729-4eba-bd80-05b1f418657b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:38.708605 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230aba63-c729-4eba-bd80-05b1f418657b None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:38.716389 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1bc79-5b92-4fdd-9c3b-05edec472003 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:38.717078 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1bc79-5b92-4fdd-9c3b-05edec472003 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:38.717401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1bc79-5b92-4fdd-9c3b-05edec472003 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:38.718179 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1bc79-5b92-4fdd-9c3b-05edec472003 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:38.729462 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd1bc79-5b92-4fdd-9c3b-05edec472003 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:38.731418 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd1bc79-5b92-4fdd-9c3b-05edec472003 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:38.758303 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3407/6783] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:34:38 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:34:39.184815 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b00df8-95b4-4346-a6ea-28331dfc9255 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:39.308005 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b00df8-95b4-4346-a6ea-28331dfc9255 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:39.328246 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f66516-a6f1-4cea-9a42-6709f001ec50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:39.333515 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f66516-a6f1-4cea-9a42-6709f001ec50 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:39.333515 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f66516-a6f1-4cea-9a42-6709f001ec50 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:39.333515 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f66516-a6f1-4cea-9a42-6709f001ec50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:39.350649 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e6f66516-a6f1-4cea-9a42-6709f001ec50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:39.380829 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f66516-a6f1-4cea-9a42-6709f001ec50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:39.384486 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f66516-a6f1-4cea-9a42-6709f001ec50 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:39.410464 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3377/6784] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:34:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:34:52.655898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1bc79-5b92-4fdd-9c3b-05edec472003 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:52.658011 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7dd1bc79-5b92-4fdd-9c3b-05edec472003 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:52.740880 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1bc79-5b92-4fdd-9c3b-05edec472003 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:52.755579 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30c569-5ac0-42ee-97ef-4e6c9f2200cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:52.756269 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30c569-5ac0-42ee-97ef-4e6c9f2200cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:52.756730 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30c569-5ac0-42ee-97ef-4e6c9f2200cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:52.757274 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30c569-5ac0-42ee-97ef-4e6c9f2200cb admin admin] PATH_INFO: `/v3/users/5ca906e8711f47c2b5d84393215822b5` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:52.758792 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f30c569-5ac0-42ee-97ef-4e6c9f2200cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ca906e8711f47c2b5d84393215822b5)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:52.760907 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f30c569-5ac0-42ee-97ef-4e6c9f2200cb admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:53.013891 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1f30c569-5ac0-42ee-97ef-4e6c9f2200cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ca906e8711f47c2b5d84393215822b5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:53.036092 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1f30c569-5ac0-42ee-97ef-4e6c9f2200cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ca906e8711f47c2b5d84393215822b5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:53.101572 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1f30c569-5ac0-42ee-97ef-4e6c9f2200cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ca906e8711f47c2b5d84393215822b5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:53.110898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1f30c569-5ac0-42ee-97ef-4e6c9f2200cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ca906e8711f47c2b5d84393215822b5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:53.111913 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1f30c569-5ac0-42ee-97ef-4e6c9f2200cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ca906e8711f47c2b5d84393215822b5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:53.125838 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3408/6785] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:34:52 2022] DELETE /identity/v3/users/5ca906e8711f47c2b5d84393215822b5 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:34:53.128270 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6baf2e-2f7b-42a3-b204-33bf48cd2916 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:53.128758 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6baf2e-2f7b-42a3-b204-33bf48cd2916 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:53.128871 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6baf2e-2f7b-42a3-b204-33bf48cd2916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:53.162168 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-1a6baf2e-2f7b-42a3-b204-33bf48cd2916 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:53.164010 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1a6baf2e-2f7b-42a3-b204-33bf48cd2916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:53.264621 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3378/6786] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:53.339600 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30c569-5ac0-42ee-97ef-4e6c9f2200cb admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:53.343010 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1f30c569-5ac0-42ee-97ef-4e6c9f2200cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:53.422779 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30c569-5ac0-42ee-97ef-4e6c9f2200cb admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:53.428081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d61d2e-f870-493b-bf2f-5fe9df9cb961 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:53.429401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d61d2e-f870-493b-bf2f-5fe9df9cb961 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:53.429808 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d61d2e-f870-493b-bf2f-5fe9df9cb961 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:53.430203 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d61d2e-f870-493b-bf2f-5fe9df9cb961 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:53.442162 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d61d2e-f870-493b-bf2f-5fe9df9cb961 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:53.443860 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d61d2e-f870-493b-bf2f-5fe9df9cb961 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:53.462903 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3409/6787] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:34:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:34:53.945401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6baf2e-2f7b-42a3-b204-33bf48cd2916 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:53.946889 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1a6baf2e-2f7b-42a3-b204-33bf48cd2916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:53.962341 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6baf2e-2f7b-42a3-b204-33bf48cd2916 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:53.973995 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a36684d-c3c9-4b7c-b965-7a37ef448dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:53.974972 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36684d-c3c9-4b7c-b965-7a37ef448dc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:53.975318 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36684d-c3c9-4b7c-b965-7a37ef448dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:53.976765 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36684d-c3c9-4b7c-b965-7a37ef448dc9 admin admin] PATH_INFO: `/v3/projects/b7849b281e984e1c95e26b3fb1acf8a1` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:53.978256 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a36684d-c3c9-4b7c-b965-7a37ef448dc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7849b281e984e1c95e26b3fb1acf8a1)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:53.980284 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a36684d-c3c9-4b7c-b965-7a37ef448dc9 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:54.103023 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-9a36684d-c3c9-4b7c-b965-7a37ef448dc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7849b281e984e1c95e26b3fb1acf8a1', 'request_id': 'req-9a36684d-c3c9-4b7c-b965-7a37ef448dc9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:54.111682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-9a36684d-c3c9-4b7c-b965-7a37ef448dc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7849b281e984e1c95e26b3fb1acf8a1', 'request_id': 'req-9a36684d-c3c9-4b7c-b965-7a37ef448dc9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:54.119886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-9a36684d-c3c9-4b7c-b965-7a37ef448dc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7849b281e984e1c95e26b3fb1acf8a1', 'request_id': 'req-9a36684d-c3c9-4b7c-b965-7a37ef448dc9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:54.228485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-9a36684d-c3c9-4b7c-b965-7a37ef448dc9 admin admin] The token cache is being invalidate because project b7849b281e984e1c95e26b3fb1acf8a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:34:54.230114 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-9a36684d-c3c9-4b7c-b965-7a37ef448dc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:54.230452 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-9a36684d-c3c9-4b7c-b965-7a37ef448dc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:34:54.232049 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3379/6788] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:34:53 2022] DELETE /identity/v3/projects/b7849b281e984e1c95e26b3fb1acf8a1 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:34:54.236927 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5764fb3-f1af-4378-93ae-51ba30d883d7 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:54.237437 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5764fb3-f1af-4378-93ae-51ba30d883d7 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:54.237525 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5764fb3-f1af-4378-93ae-51ba30d883d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:54.264682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-e5764fb3-f1af-4378-93ae-51ba30d883d7 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:54.264682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e5764fb3-f1af-4378-93ae-51ba30d883d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:54.337316 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3410/6789] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:54.345501 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421dc42f-7f66-4520-a051-c013489e7a56 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:54.346210 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421dc42f-7f66-4520-a051-c013489e7a56 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:54.346949 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421dc42f-7f66-4520-a051-c013489e7a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:54.375299 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-421dc42f-7f66-4520-a051-c013489e7a56 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:54.379771 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-421dc42f-7f66-4520-a051-c013489e7a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:54.394600 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5764fb3-f1af-4378-93ae-51ba30d883d7 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:54.403571 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3380/6790] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:54.408912 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5764fb3-f1af-4378-93ae-51ba30d883d7 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:54.429716 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c7876-0fa5-4fed-bdbb-f7fe56ab9759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:54.431704 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c7876-0fa5-4fed-bdbb-f7fe56ab9759 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:54.431992 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c7876-0fa5-4fed-bdbb-f7fe56ab9759 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:54.432271 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c7876-0fa5-4fed-bdbb-f7fe56ab9759 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:54.433805 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c7876-0fa5-4fed-bdbb-f7fe56ab9759 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:34:54.434949 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c7876-0fa5-4fed-bdbb-f7fe56ab9759 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:54.437385 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c7876-0fa5-4fed-bdbb-f7fe56ab9759 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:54.453870 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3411/6791] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:34:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:34:54.456515 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421dc42f-7f66-4520-a051-c013489e7a56 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:54.467554 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421dc42f-7f66-4520-a051-c013489e7a56 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:54.472992 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c17c9e-548b-4bf4-845e-f28263cfa1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:54.474526 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c17c9e-548b-4bf4-845e-f28263cfa1ec admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:54.474887 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c17c9e-548b-4bf4-845e-f28263cfa1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:54.475246 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c17c9e-548b-4bf4-845e-f28263cfa1ec admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:54.476129 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c17c9e-548b-4bf4-845e-f28263cfa1ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:54.478893 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c17c9e-548b-4bf4-845e-f28263cfa1ec admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:54.688449 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c7876-0fa5-4fed-bdbb-f7fe56ab9759 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:54.696636 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3381/6792] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:34:54 2022] POST /identity/v3/projects => generated 363 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:34:54.702268 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c7876-0fa5-4fed-bdbb-f7fe56ab9759 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:54.778768 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702bbbc-fe1d-4f72-a1f5-514227a24640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:54.779705 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702bbbc-fe1d-4f72-a1f5-514227a24640 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:54.779705 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702bbbc-fe1d-4f72-a1f5-514227a24640 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:54.779968 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702bbbc-fe1d-4f72-a1f5-514227a24640 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:54.780664 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9702bbbc-fe1d-4f72-a1f5-514227a24640 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:54.782963 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9702bbbc-fe1d-4f72-a1f5-514227a24640 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:54.946976 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3412/6793] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:34:54 2022] POST /identity/v3/users => generated 282 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:34:54.951261 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c17c9e-548b-4bf4-845e-f28263cfa1ec admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:54.963256 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c17c9e-548b-4bf4-845e-f28263cfa1ec admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:54.967943 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ada372-12ce-4652-8a99-23ca3302e864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:54.968617 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ada372-12ce-4652-8a99-23ca3302e864 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:54.968901 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ada372-12ce-4652-8a99-23ca3302e864 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:54.969194 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ada372-12ce-4652-8a99-23ca3302e864 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:54.969946 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ada372-12ce-4652-8a99-23ca3302e864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:54.972494 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ada372-12ce-4652-8a99-23ca3302e864 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:54.985485 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3382/6794] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:34:54.986838 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702bbbc-fe1d-4f72-a1f5-514227a24640 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:54.997188 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702bbbc-fe1d-4f72-a1f5-514227a24640 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:55.002123 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28090af-810e-415a-bd4a-cbf8c8608fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:55.002800 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28090af-810e-415a-bd4a-cbf8c8608fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:55.003087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28090af-810e-415a-bd4a-cbf8c8608fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:55.003368 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28090af-810e-415a-bd4a-cbf8c8608fa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:55.005129 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28090af-810e-415a-bd4a-cbf8c8608fa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:55.007997 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28090af-810e-415a-bd4a-cbf8c8608fa1 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:55.020072 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3413/6795] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:34:55.024506 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ada372-12ce-4652-8a99-23ca3302e864 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:55.035895 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ada372-12ce-4652-8a99-23ca3302e864 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:55.040587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc09f1-f9e6-402c-b46d-2d33652f25a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:55.041472 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc09f1-f9e6-402c-b46d-2d33652f25a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:55.042122 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc09f1-f9e6-402c-b46d-2d33652f25a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:55.042401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc09f1-f9e6-402c-b46d-2d33652f25a0 admin admin] PATH_INFO: `/v3/projects/61cf3c186d6347bda4f0558e9d809056/users/9d7f9c196db74ff98dfd74722e44c19f/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:55.060702 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc09f1-f9e6-402c-b46d-2d33652f25a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61cf3c186d6347bda4f0558e9d809056, user_id=9d7f9c196db74ff98dfd74722e44c19f, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:55.064032 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc09f1-f9e6-402c-b46d-2d33652f25a0 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:55.150405 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3383/6796] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:34:55 2022] PUT /identity/v3/projects/61cf3c186d6347bda4f0558e9d809056/users/9d7f9c196db74ff98dfd74722e44c19f/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:34:55.162039 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a3046-54ea-43bd-8f27-4d138afb5788 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:55.162568 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a3046-54ea-43bd-8f27-4d138afb5788 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:55.162907 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a3046-54ea-43bd-8f27-4d138afb5788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:55.195443 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-871a3046-54ea-43bd-8f27-4d138afb5788 None None] MFA Rules not processed for user `9d7f9c196db74ff98dfd74722e44c19f`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:34:55.196766 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-871a3046-54ea-43bd-8f27-4d138afb5788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:55.341294 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3414/6797] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:34:55 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:34:55.348833 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc09f1-f9e6-402c-b46d-2d33652f25a0 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:55.351414 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b4dc09f1-f9e6-402c-b46d-2d33652f25a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:55.428493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc09f1-f9e6-402c-b46d-2d33652f25a0 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:55.433138 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74126854-b149-40e8-a6f1-afeab14c463a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:55.434114 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74126854-b149-40e8-a6f1-afeab14c463a service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:55.434565 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74126854-b149-40e8-a6f1-afeab14c463a service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:55.435033 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74126854-b149-40e8-a6f1-afeab14c463a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:55.445056 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74126854-b149-40e8-a6f1-afeab14c463a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:55.446589 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74126854-b149-40e8-a6f1-afeab14c463a service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:55.466814 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3384/6798] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:34:55 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:34:58.389042 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a3046-54ea-43bd-8f27-4d138afb5788 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:34:58.392329 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-871a3046-54ea-43bd-8f27-4d138afb5788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:58.487083 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a3046-54ea-43bd-8f27-4d138afb5788 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:34:58.505027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1f477-39f0-47b4-a45b-e5cca6ed5c9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:34:58.505027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1f477-39f0-47b4-a45b-e5cca6ed5c9d service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:34:58.505027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1f477-39f0-47b4-a45b-e5cca6ed5c9d service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:34:58.505027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1f477-39f0-47b4-a45b-e5cca6ed5c9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:34:58.505356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d5d1f477-39f0-47b4-a45b-e5cca6ed5c9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:34:58.590379 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1f477-39f0-47b4-a45b-e5cca6ed5c9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:34:58.592052 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1f477-39f0-47b4-a45b-e5cca6ed5c9d service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:34:58.625158 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3415/6799] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:34:58 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:35:05.798189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74126854-b149-40e8-a6f1-afeab14c463a service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:05.803325 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-74126854-b149-40e8-a6f1-afeab14c463a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:05.963567 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74126854-b149-40e8-a6f1-afeab14c463a service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:05.980626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb297706-68ba-449a-96b7-725f6302d35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:05.981589 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb297706-68ba-449a-96b7-725f6302d35c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:05.981927 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb297706-68ba-449a-96b7-725f6302d35c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:05.983456 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb297706-68ba-449a-96b7-725f6302d35c admin admin] PATH_INFO: `/v3/users/bde6c559633341eab2d1241f79f7a3dc` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:05.986380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb297706-68ba-449a-96b7-725f6302d35c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bde6c559633341eab2d1241f79f7a3dc)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:05.992496 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb297706-68ba-449a-96b7-725f6302d35c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:06.196068 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-bb297706-68ba-449a-96b7-725f6302d35c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bde6c559633341eab2d1241f79f7a3dc'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:06.225325 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-bb297706-68ba-449a-96b7-725f6302d35c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bde6c559633341eab2d1241f79f7a3dc'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:06.304680 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-bb297706-68ba-449a-96b7-725f6302d35c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bde6c559633341eab2d1241f79f7a3dc'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:06.305160 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-bb297706-68ba-449a-96b7-725f6302d35c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bde6c559633341eab2d1241f79f7a3dc'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:06.314003 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-bb297706-68ba-449a-96b7-725f6302d35c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bde6c559633341eab2d1241f79f7a3dc'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:06.322227 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3385/6800] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:35:05 2022] DELETE /identity/v3/users/bde6c559633341eab2d1241f79f7a3dc => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:35:06.451045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1f477-39f0-47b4-a45b-e5cca6ed5c9d service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:06.452685 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d5d1f477-39f0-47b4-a45b-e5cca6ed5c9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:06.468556 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1f477-39f0-47b4-a45b-e5cca6ed5c9d service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:06.531237 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec53dec-4481-4caa-a839-c73b0e4d6ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:06.532197 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec53dec-4481-4caa-a839-c73b0e4d6ef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:06.532476 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec53dec-4481-4caa-a839-c73b0e4d6ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:06.532747 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec53dec-4481-4caa-a839-c73b0e4d6ef2 admin admin] PATH_INFO: `/v3/users/8dce43c992e940938369490d6c20dfdb` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:06.533963 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec53dec-4481-4caa-a839-c73b0e4d6ef2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dce43c992e940938369490d6c20dfdb)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:06.535874 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec53dec-4481-4caa-a839-c73b0e4d6ef2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:06.657900 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb297706-68ba-449a-96b7-725f6302d35c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:06.659471 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-bb297706-68ba-449a-96b7-725f6302d35c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:06.694694 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb297706-68ba-449a-96b7-725f6302d35c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:06.700061 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c219bba-4cb6-46ba-aa71-cf961fd2da89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:06.701201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c219bba-4cb6-46ba-aa71-cf961fd2da89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:06.701703 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c219bba-4cb6-46ba-aa71-cf961fd2da89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:06.702220 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c219bba-4cb6-46ba-aa71-cf961fd2da89 admin admin] PATH_INFO: `/v3/projects/e374475a40f64506bf36664ff452ea96` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:06.703648 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c219bba-4cb6-46ba-aa71-cf961fd2da89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e374475a40f64506bf36664ff452ea96)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:06.705852 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c219bba-4cb6-46ba-aa71-cf961fd2da89 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:06.821615 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-eec53dec-4481-4caa-a839-c73b0e4d6ef2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dce43c992e940938369490d6c20dfdb'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:06.841517 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-eec53dec-4481-4caa-a839-c73b0e4d6ef2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dce43c992e940938369490d6c20dfdb'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:06.855913 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0c219bba-4cb6-46ba-aa71-cf961fd2da89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e374475a40f64506bf36664ff452ea96', 'request_id': 'req-0c219bba-4cb6-46ba-aa71-cf961fd2da89'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:06.861991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0c219bba-4cb6-46ba-aa71-cf961fd2da89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e374475a40f64506bf36664ff452ea96', 'request_id': 'req-0c219bba-4cb6-46ba-aa71-cf961fd2da89'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:06.868614 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0c219bba-4cb6-46ba-aa71-cf961fd2da89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e374475a40f64506bf36664ff452ea96', 'request_id': 'req-0c219bba-4cb6-46ba-aa71-cf961fd2da89'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:06.935142 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-eec53dec-4481-4caa-a839-c73b0e4d6ef2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dce43c992e940938369490d6c20dfdb'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:06.942956 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-eec53dec-4481-4caa-a839-c73b0e4d6ef2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dce43c992e940938369490d6c20dfdb'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:06.943652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-eec53dec-4481-4caa-a839-c73b0e4d6ef2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dce43c992e940938369490d6c20dfdb'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:06.951126 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3416/6801] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:35:06 2022] DELETE /identity/v3/users/8dce43c992e940938369490d6c20dfdb => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:35:06.955114 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc936d-18c5-442f-a10b-b187383d5580 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:06.955552 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc936d-18c5-442f-a10b-b187383d5580 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:06.956072 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc936d-18c5-442f-a10b-b187383d5580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:06.986284 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-2ddc936d-18c5-442f-a10b-b187383d5580 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:35:06.987501 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2ddc936d-18c5-442f-a10b-b187383d5580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:07.054864 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0c219bba-4cb6-46ba-aa71-cf961fd2da89 admin admin] The token cache is being invalidate because project e374475a40f64506bf36664ff452ea96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:35:07.055438 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0c219bba-4cb6-46ba-aa71-cf961fd2da89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:07.056950 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0c219bba-4cb6-46ba-aa71-cf961fd2da89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:07.060221 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3386/6803] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:35:06 2022] DELETE /identity/v3/projects/e374475a40f64506bf36664ff452ea96 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:35:07.060432 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3417/6803] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:35:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:35:07.063875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc936d-18c5-442f-a10b-b187383d5580 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:07.065522 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2ddc936d-18c5-442f-a10b-b187383d5580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:07.070003 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c219bba-4cb6-46ba-aa71-cf961fd2da89 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:07.071985 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0c219bba-4cb6-46ba-aa71-cf961fd2da89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:07.081711 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc936d-18c5-442f-a10b-b187383d5580 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:07.095812 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3288b7-6f02-434e-a7cb-1dd2400be9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:07.096701 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3288b7-6f02-434e-a7cb-1dd2400be9bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:07.096983 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3288b7-6f02-434e-a7cb-1dd2400be9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:07.097256 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3288b7-6f02-434e-a7cb-1dd2400be9bc admin admin] PATH_INFO: `/v3/users/1f27c1e40cba46c9b8ef8f4c8124cd93` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:07.099392 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3288b7-6f02-434e-a7cb-1dd2400be9bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f27c1e40cba46c9b8ef8f4c8124cd93)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:07.102346 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3288b7-6f02-434e-a7cb-1dd2400be9bc admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:07.173456 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c219bba-4cb6-46ba-aa71-cf961fd2da89 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:07.256579 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790907cf-a97f-4a67-bba9-c0ed7b44d243 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:07.257500 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790907cf-a97f-4a67-bba9-c0ed7b44d243 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:07.257871 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790907cf-a97f-4a67-bba9-c0ed7b44d243 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:07.258225 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790907cf-a97f-4a67-bba9-c0ed7b44d243 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:07.261218 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-790907cf-a97f-4a67-bba9-c0ed7b44d243 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:07.288310 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790907cf-a97f-4a67-bba9-c0ed7b44d243 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:07.290325 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790907cf-a97f-4a67-bba9-c0ed7b44d243 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:07.302611 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3387/6804] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:35:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:35:07.349509 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6a3288b7-6f02-434e-a7cb-1dd2400be9bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f27c1e40cba46c9b8ef8f4c8124cd93'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:07.374139 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6a3288b7-6f02-434e-a7cb-1dd2400be9bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f27c1e40cba46c9b8ef8f4c8124cd93'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:07.472017 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6a3288b7-6f02-434e-a7cb-1dd2400be9bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f27c1e40cba46c9b8ef8f4c8124cd93'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:07.483159 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6a3288b7-6f02-434e-a7cb-1dd2400be9bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f27c1e40cba46c9b8ef8f4c8124cd93'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:07.485207 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6a3288b7-6f02-434e-a7cb-1dd2400be9bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f27c1e40cba46c9b8ef8f4c8124cd93'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:07.499501 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3418/6805] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:35:07 2022] DELETE /identity/v3/users/1f27c1e40cba46c9b8ef8f4c8124cd93 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:35:07.755493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790907cf-a97f-4a67-bba9-c0ed7b44d243 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:07.759704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-790907cf-a97f-4a67-bba9-c0ed7b44d243 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:07.775843 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790907cf-a97f-4a67-bba9-c0ed7b44d243 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:07.914181 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf8da3-bf12-4a30-b664-621dd8dc6639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:07.917083 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf8da3-bf12-4a30-b664-621dd8dc6639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:07.917526 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf8da3-bf12-4a30-b664-621dd8dc6639 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:07.917996 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf8da3-bf12-4a30-b664-621dd8dc6639 admin admin] PATH_INFO: `/v3/projects/0b290be8f5354a0cbfa5a80c43108d0f` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:07.919536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf8da3-bf12-4a30-b664-621dd8dc6639 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b290be8f5354a0cbfa5a80c43108d0f)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:07.922116 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf8da3-bf12-4a30-b664-621dd8dc6639 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:08.057486 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-52cf8da3-bf12-4a30-b664-621dd8dc6639 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b290be8f5354a0cbfa5a80c43108d0f', 'request_id': 'req-52cf8da3-bf12-4a30-b664-621dd8dc6639'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:08.064511 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-52cf8da3-bf12-4a30-b664-621dd8dc6639 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b290be8f5354a0cbfa5a80c43108d0f', 'request_id': 'req-52cf8da3-bf12-4a30-b664-621dd8dc6639'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:08.075485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-52cf8da3-bf12-4a30-b664-621dd8dc6639 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b290be8f5354a0cbfa5a80c43108d0f', 'request_id': 'req-52cf8da3-bf12-4a30-b664-621dd8dc6639'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:08.106201 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3288b7-6f02-434e-a7cb-1dd2400be9bc admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:08.107523 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6a3288b7-6f02-434e-a7cb-1dd2400be9bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:08.130920 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3288b7-6f02-434e-a7cb-1dd2400be9bc admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:08.198512 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-52cf8da3-bf12-4a30-b664-621dd8dc6639 admin admin] The token cache is being invalidate because project 0b290be8f5354a0cbfa5a80c43108d0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:35:08.198917 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-52cf8da3-bf12-4a30-b664-621dd8dc6639 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:08.199723 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-52cf8da3-bf12-4a30-b664-621dd8dc6639 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:08.201564 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3388/6806] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:35:07 2022] DELETE /identity/v3/projects/0b290be8f5354a0cbfa5a80c43108d0f => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:35:08.206723 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44474c86-9272-41ea-96fd-8854556eba12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:08.206894 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa2184-9e14-418a-b40e-fdb8211a02b2 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:08.207012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa2184-9e14-418a-b40e-fdb8211a02b2 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:08.207289 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa2184-9e14-418a-b40e-fdb8211a02b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:08.207587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44474c86-9272-41ea-96fd-8854556eba12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:08.207871 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44474c86-9272-41ea-96fd-8854556eba12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:08.208148 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44474c86-9272-41ea-96fd-8854556eba12 admin admin] PATH_INFO: `/v3/projects/5994b70466a14d378c557473048ae49f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:08.210042 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44474c86-9272-41ea-96fd-8854556eba12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5994b70466a14d378c557473048ae49f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:08.211992 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44474c86-9272-41ea-96fd-8854556eba12 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:08.230906 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-d2aa2184-9e14-418a-b40e-fdb8211a02b2 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:35:08.235434 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d2aa2184-9e14-418a-b40e-fdb8211a02b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:08.246379 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3389/6807] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:35:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:35:08.254200 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f1496-3405-4704-b13d-a6fc53df8321 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:08.254490 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f1496-3405-4704-b13d-a6fc53df8321 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:08.254770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f1496-3405-4704-b13d-a6fc53df8321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:08.280991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-c71f1496-3405-4704-b13d-a6fc53df8321 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:35:08.282835 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c71f1496-3405-4704-b13d-a6fc53df8321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:08.294046 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3390/6808] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:35:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:35:08.298406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f1496-3405-4704-b13d-a6fc53df8321 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:08.309929 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f1496-3405-4704-b13d-a6fc53df8321 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:08.315549 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7caf6-7534-4eaa-ab37-48fc0b3125e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:08.316444 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7caf6-7534-4eaa-ab37-48fc0b3125e3 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:08.316835 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7caf6-7534-4eaa-ab37-48fc0b3125e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:08.316983 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7caf6-7534-4eaa-ab37-48fc0b3125e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:08.318205 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7caf6-7534-4eaa-ab37-48fc0b3125e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:35:08.318485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7caf6-7534-4eaa-ab37-48fc0b3125e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:08.320762 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7caf6-7534-4eaa-ab37-48fc0b3125e3 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:08.340445 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3391/6809] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:35:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:35:08.345539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7caf6-7534-4eaa-ab37-48fc0b3125e3 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:08.357652 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7caf6-7534-4eaa-ab37-48fc0b3125e3 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:08.365154 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d623f-3eb5-4a73-a8bf-80f2b607bcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:08.366113 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d623f-3eb5-4a73-a8bf-80f2b607bcad admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:08.366587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d623f-3eb5-4a73-a8bf-80f2b607bcad admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:08.367048 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d623f-3eb5-4a73-a8bf-80f2b607bcad admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:08.367898 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d623f-3eb5-4a73-a8bf-80f2b607bcad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:08.370202 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d623f-3eb5-4a73-a8bf-80f2b607bcad admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:08.385170 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-44474c86-9272-41ea-96fd-8854556eba12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5994b70466a14d378c557473048ae49f', 'request_id': 'req-44474c86-9272-41ea-96fd-8854556eba12'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:08.398423 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-44474c86-9272-41ea-96fd-8854556eba12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5994b70466a14d378c557473048ae49f', 'request_id': 'req-44474c86-9272-41ea-96fd-8854556eba12'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:08.407116 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-44474c86-9272-41ea-96fd-8854556eba12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5994b70466a14d378c557473048ae49f', 'request_id': 'req-44474c86-9272-41ea-96fd-8854556eba12'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:08.493845 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3392/6810] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:35:08 2022] POST /identity/v3/projects => generated 375 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:35:08.495624 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d623f-3eb5-4a73-a8bf-80f2b607bcad admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:08.528741 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-44474c86-9272-41ea-96fd-8854556eba12 admin admin] The token cache is being invalidate because project 5994b70466a14d378c557473048ae49f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:35:08.529839 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-44474c86-9272-41ea-96fd-8854556eba12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:08.531205 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-44474c86-9272-41ea-96fd-8854556eba12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:08.533446 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3419/6811] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:35:08 2022] DELETE /identity/v3/projects/5994b70466a14d378c557473048ae49f => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:35:08.546624 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07be34-3ee2-4a2d-b3ed-eee203f14566 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:08.547715 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07be34-3ee2-4a2d-b3ed-eee203f14566 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:08.548180 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07be34-3ee2-4a2d-b3ed-eee203f14566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:08.586048 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-2b07be34-3ee2-4a2d-b3ed-eee203f14566 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:35:08.587412 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2b07be34-3ee2-4a2d-b3ed-eee203f14566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:08.683503 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d623f-3eb5-4a73-a8bf-80f2b607bcad admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:08.690097 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8350096-b275-4209-b3e9-230f65d72734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:08.690915 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8350096-b275-4209-b3e9-230f65d72734 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:08.691497 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8350096-b275-4209-b3e9-230f65d72734 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:08.691888 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8350096-b275-4209-b3e9-230f65d72734 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:08.692697 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8350096-b275-4209-b3e9-230f65d72734 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:08.696627 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8350096-b275-4209-b3e9-230f65d72734 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:08.719954 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3420/6812] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:35:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:35:08.728502 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0a941-526d-4f00-9167-1330113cbed5 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:08.729207 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0a941-526d-4f00-9167-1330113cbed5 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:08.733208 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0a941-526d-4f00-9167-1330113cbed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:08.773944 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-cca0a941-526d-4f00-9167-1330113cbed5 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:35:08.775323 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-cca0a941-526d-4f00-9167-1330113cbed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:08.796043 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3421/6813] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:35:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:35:08.800577 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0a941-526d-4f00-9167-1330113cbed5 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:08.817147 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0a941-526d-4f00-9167-1330113cbed5 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:08.836670 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3393/6814] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:35:08 2022] POST /identity/v3/users => generated 288 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:35:08.841369 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8350096-b275-4209-b3e9-230f65d72734 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:08.864052 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d8350096-b275-4209-b3e9-230f65d72734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:08.868560 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d8b24-493a-4617-b8fa-3a17a49fbd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:08.869304 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d8b24-493a-4617-b8fa-3a17a49fbd17 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:08.873750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d8b24-493a-4617-b8fa-3a17a49fbd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:08.874088 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d8b24-493a-4617-b8fa-3a17a49fbd17 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:08.884645 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d8b24-493a-4617-b8fa-3a17a49fbd17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:35:08.884960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d8b24-493a-4617-b8fa-3a17a49fbd17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:08.886631 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d8b24-493a-4617-b8fa-3a17a49fbd17 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:08.896611 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8350096-b275-4209-b3e9-230f65d72734 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:08.913483 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef2b2f-6853-49d3-94b6-9bdb3293a422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:08.915281 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3422/6815] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:35:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:35:08.915923 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef2b2f-6853-49d3-94b6-9bdb3293a422 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:08.917215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef2b2f-6853-49d3-94b6-9bdb3293a422 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:08.917215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef2b2f-6853-49d3-94b6-9bdb3293a422 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:08.917687 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef2b2f-6853-49d3-94b6-9bdb3293a422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:08.919369 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef2b2f-6853-49d3-94b6-9bdb3293a422 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:08.921607 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d8b24-493a-4617-b8fa-3a17a49fbd17 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:08.937448 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d8b24-493a-4617-b8fa-3a17a49fbd17 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:08.939129 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3394/6816] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:35:08.940025 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef2b2f-6853-49d3-94b6-9bdb3293a422 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:08.952017 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8d1bb-59b7-4b7b-96e0-60e0cfdea39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:08.952214 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef2b2f-6853-49d3-94b6-9bdb3293a422 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:08.953684 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8d1bb-59b7-4b7b-96e0-60e0cfdea39b admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:08.955988 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8d1bb-59b7-4b7b-96e0-60e0cfdea39b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:08.955988 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8d1bb-59b7-4b7b-96e0-60e0cfdea39b admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:08.955988 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8d1bb-59b7-4b7b-96e0-60e0cfdea39b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:08.957365 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04dcef-d985-445e-a9a7-8ec7f465a793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:08.958189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04dcef-d985-445e-a9a7-8ec7f465a793 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:08.958730 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04dcef-d985-445e-a9a7-8ec7f465a793 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:08.959255 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04dcef-d985-445e-a9a7-8ec7f465a793 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:08.960033 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8d1bb-59b7-4b7b-96e0-60e0cfdea39b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:08.960518 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e04dcef-d985-445e-a9a7-8ec7f465a793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:08.962431 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e04dcef-d985-445e-a9a7-8ec7f465a793 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:08.979725 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3395/6817] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:35:08.989051 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04dcef-d985-445e-a9a7-8ec7f465a793 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:09.011510 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04dcef-d985-445e-a9a7-8ec7f465a793 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:09.021889 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5fd406-907e-49ac-9fce-b0c92d30bd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:09.023500 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fd406-907e-49ac-9fce-b0c92d30bd0d admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:09.024868 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fd406-907e-49ac-9fce-b0c92d30bd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:09.025459 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5fd406-907e-49ac-9fce-b0c92d30bd0d admin admin] PATH_INFO: `/v3/projects/ce5451096cf34308801ae3863daa4b6d/users/04d70b7e123f45c28ae76ce9c4f5f5bb/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:09.044421 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5fd406-907e-49ac-9fce-b0c92d30bd0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce5451096cf34308801ae3863daa4b6d, user_id=04d70b7e123f45c28ae76ce9c4f5f5bb, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:09.050318 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5fd406-907e-49ac-9fce-b0c92d30bd0d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:09.074449 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3423/6818] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:35:08 2022] POST /identity/v3/projects => generated 375 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:35:09.078831 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8d1bb-59b7-4b7b-96e0-60e0cfdea39b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:09.122728 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3396/6819] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:35:08 2022] PUT /identity/v3/projects/ce5451096cf34308801ae3863daa4b6d/users/04d70b7e123f45c28ae76ce9c4f5f5bb/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:35:09.130593 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f660f7-250f-4c82-888e-cf2fe9b9b1b8 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:09.131150 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f660f7-250f-4c82-888e-cf2fe9b9b1b8 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:09.131595 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f660f7-250f-4c82-888e-cf2fe9b9b1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:09.168836 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-01f660f7-250f-4c82-888e-cf2fe9b9b1b8 None None] MFA Rules not processed for user `04d70b7e123f45c28ae76ce9c4f5f5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:35:09.172422 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-01f660f7-250f-4c82-888e-cf2fe9b9b1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:09.188942 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8d1bb-59b7-4b7b-96e0-60e0cfdea39b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:09.255225 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3397/6820] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:35:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:35:09.255412 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44cb371-2adf-413a-b6f7-7ef7d4d28f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:09.262499 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cb371-2adf-413a-b6f7-7ef7d4d28f9c admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:09.263609 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cb371-2adf-413a-b6f7-7ef7d4d28f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:09.263796 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f660f7-250f-4c82-888e-cf2fe9b9b1b8 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:09.264363 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cb371-2adf-413a-b6f7-7ef7d4d28f9c admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:09.265337 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44cb371-2adf-413a-b6f7-7ef7d4d28f9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:09.265731 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-01f660f7-250f-4c82-888e-cf2fe9b9b1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:09.268649 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44cb371-2adf-413a-b6f7-7ef7d4d28f9c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:09.397342 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3424/6821] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:35:09 2022] POST /identity/v3/users => generated 288 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:35:09.402116 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44cb371-2adf-413a-b6f7-7ef7d4d28f9c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:09.408632 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f660f7-250f-4c82-888e-cf2fe9b9b1b8 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:09.414855 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72a611-0cf3-43f0-b5cb-57491f94071f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:09.415836 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72a611-0cf3-43f0-b5cb-57491f94071f service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:09.416311 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72a611-0cf3-43f0-b5cb-57491f94071f service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:09.417181 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72a611-0cf3-43f0-b5cb-57491f94071f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:09.433128 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce72a611-0cf3-43f0-b5cb-57491f94071f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:09.435830 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce72a611-0cf3-43f0-b5cb-57491f94071f service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:09.442750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44cb371-2adf-413a-b6f7-7ef7d4d28f9c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:09.453666 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3398/6822] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:35:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:35:09.457592 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f301ed5-c0ae-4730-8326-432398c18583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:09.458472 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f301ed5-c0ae-4730-8326-432398c18583 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:09.459051 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f301ed5-c0ae-4730-8326-432398c18583 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:09.460358 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f301ed5-c0ae-4730-8326-432398c18583 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:09.461664 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f301ed5-c0ae-4730-8326-432398c18583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:09.465160 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f301ed5-c0ae-4730-8326-432398c18583 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:09.484656 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3425/6823] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:35:09.488353 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72a611-0cf3-43f0-b5cb-57491f94071f service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:09.507446 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72a611-0cf3-43f0-b5cb-57491f94071f service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:09.515720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df61d27-6b34-476d-a217-42e715ed41fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:09.516817 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df61d27-6b34-476d-a217-42e715ed41fd admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:09.517277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df61d27-6b34-476d-a217-42e715ed41fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:09.517717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df61d27-6b34-476d-a217-42e715ed41fd admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:09.518767 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df61d27-6b34-476d-a217-42e715ed41fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:09.521146 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df61d27-6b34-476d-a217-42e715ed41fd admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:09.544233 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3399/6824] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:35:09.553912 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f301ed5-c0ae-4730-8326-432398c18583 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:09.557925 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f301ed5-c0ae-4730-8326-432398c18583 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:09.563269 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf09f47-e67b-48e3-906a-ee019979bcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:09.564502 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf09f47-e67b-48e3-906a-ee019979bcbb admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:09.565077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf09f47-e67b-48e3-906a-ee019979bcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:09.565565 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf09f47-e67b-48e3-906a-ee019979bcbb admin admin] PATH_INFO: `/v3/projects/b74e36d3bb384eeb92da16d1b201fc9a/users/e9fa67fb4ad4472183b95067597f043e/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:09.582955 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf09f47-e67b-48e3-906a-ee019979bcbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b74e36d3bb384eeb92da16d1b201fc9a, user_id=e9fa67fb4ad4472183b95067597f043e, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:09.587126 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf09f47-e67b-48e3-906a-ee019979bcbb admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:09.752277 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3426/6825] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:35:09 2022] PUT /identity/v3/projects/b74e36d3bb384eeb92da16d1b201fc9a/users/e9fa67fb4ad4472183b95067597f043e/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:35:09.757018 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd99eb-6cc8-4d7d-a1cb-a0d9fb37cd00 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:09.757312 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd99eb-6cc8-4d7d-a1cb-a0d9fb37cd00 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:09.757599 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd99eb-6cc8-4d7d-a1cb-a0d9fb37cd00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:09.776373 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-29fd99eb-6cc8-4d7d-a1cb-a0d9fb37cd00 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:35:09.777737 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-29fd99eb-6cc8-4d7d-a1cb-a0d9fb37cd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:09.898803 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3400/6826] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:35:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:35:09.929084 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf09f47-e67b-48e3-906a-ee019979bcbb admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:09.930965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-abf09f47-e67b-48e3-906a-ee019979bcbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:10.060211 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf09f47-e67b-48e3-906a-ee019979bcbb admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:10.066171 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c86e07-acd7-4853-878c-c87f4347b7b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:10.067632 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c86e07-acd7-4853-878c-c87f4347b7b4 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:10.067931 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c86e07-acd7-4853-878c-c87f4347b7b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:10.071319 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c86e07-acd7-4853-878c-c87f4347b7b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:10.085249 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c86e07-acd7-4853-878c-c87f4347b7b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:10.087104 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c86e07-acd7-4853-878c-c87f4347b7b4 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:10.103827 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3427/6827] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:35:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:35:19.005197 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd99eb-6cc8-4d7d-a1cb-a0d9fb37cd00 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:19.008478 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-29fd99eb-6cc8-4d7d-a1cb-a0d9fb37cd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:19.044137 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd99eb-6cc8-4d7d-a1cb-a0d9fb37cd00 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:19.058039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decbb4fb-4ffc-47a6-9036-ec22e46842dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:19.058975 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbb4fb-4ffc-47a6-9036-ec22e46842dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:19.059710 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbb4fb-4ffc-47a6-9036-ec22e46842dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:19.060159 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbb4fb-4ffc-47a6-9036-ec22e46842dd admin admin] PATH_INFO: `/v3/users/1a3877d9751e460ca0a3a710c5cf099b` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:19.063056 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decbb4fb-4ffc-47a6-9036-ec22e46842dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a3877d9751e460ca0a3a710c5cf099b)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:19.067582 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decbb4fb-4ffc-47a6-9036-ec22e46842dd admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:19.355226 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-decbb4fb-4ffc-47a6-9036-ec22e46842dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a3877d9751e460ca0a3a710c5cf099b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:19.402289 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-decbb4fb-4ffc-47a6-9036-ec22e46842dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a3877d9751e460ca0a3a710c5cf099b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:19.466196 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-decbb4fb-4ffc-47a6-9036-ec22e46842dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a3877d9751e460ca0a3a710c5cf099b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:19.466836 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-decbb4fb-4ffc-47a6-9036-ec22e46842dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a3877d9751e460ca0a3a710c5cf099b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:19.480081 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-decbb4fb-4ffc-47a6-9036-ec22e46842dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a3877d9751e460ca0a3a710c5cf099b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:19.493124 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3401/6828] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:35:19 2022] DELETE /identity/v3/users/1a3877d9751e460ca0a3a710c5cf099b => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:35:19.497591 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab8840-1a83-4b38-9312-20dc23d9b1d2 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:19.498499 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab8840-1a83-4b38-9312-20dc23d9b1d2 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:19.498499 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab8840-1a83-4b38-9312-20dc23d9b1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:19.530886 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-75ab8840-1a83-4b38-9312-20dc23d9b1d2 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:35:19.534430 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-75ab8840-1a83-4b38-9312-20dc23d9b1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:19.675012 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3428/6829] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:35:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:35:19.683860 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decbb4fb-4ffc-47a6-9036-ec22e46842dd admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:19.685459 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-decbb4fb-4ffc-47a6-9036-ec22e46842dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:19.822677 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decbb4fb-4ffc-47a6-9036-ec22e46842dd admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:19.827583 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245478a1-8d81-49c4-9bf4-a6ff7200722d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:19.828464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245478a1-8d81-49c4-9bf4-a6ff7200722d service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:19.828853 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245478a1-8d81-49c4-9bf4-a6ff7200722d service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:19.830067 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245478a1-8d81-49c4-9bf4-a6ff7200722d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:19.842161 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245478a1-8d81-49c4-9bf4-a6ff7200722d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:19.844674 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245478a1-8d81-49c4-9bf4-a6ff7200722d service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:19.874264 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3402/6830] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:35:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:35:20.376868 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab8840-1a83-4b38-9312-20dc23d9b1d2 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:20.378568 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-75ab8840-1a83-4b38-9312-20dc23d9b1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:20.424420 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab8840-1a83-4b38-9312-20dc23d9b1d2 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:20.439327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127cface-3c90-4440-963b-b00e8b9b620d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:20.440470 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127cface-3c90-4440-963b-b00e8b9b620d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:20.440937 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127cface-3c90-4440-963b-b00e8b9b620d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:20.441375 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127cface-3c90-4440-963b-b00e8b9b620d admin admin] PATH_INFO: `/v3/projects/5cc6a2a737624602a6c35664ef12ee53` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:20.443719 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127cface-3c90-4440-963b-b00e8b9b620d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cc6a2a737624602a6c35664ef12ee53)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:20.445871 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127cface-3c90-4440-963b-b00e8b9b620d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:20.628025 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-127cface-3c90-4440-963b-b00e8b9b620d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cc6a2a737624602a6c35664ef12ee53', 'request_id': 'req-127cface-3c90-4440-963b-b00e8b9b620d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:20.648621 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-127cface-3c90-4440-963b-b00e8b9b620d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cc6a2a737624602a6c35664ef12ee53', 'request_id': 'req-127cface-3c90-4440-963b-b00e8b9b620d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:20.662681 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-127cface-3c90-4440-963b-b00e8b9b620d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cc6a2a737624602a6c35664ef12ee53', 'request_id': 'req-127cface-3c90-4440-963b-b00e8b9b620d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:20.785540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-127cface-3c90-4440-963b-b00e8b9b620d admin admin] The token cache is being invalidate because project 5cc6a2a737624602a6c35664ef12ee53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:35:20.786288 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-127cface-3c90-4440-963b-b00e8b9b620d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:20.790293 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-127cface-3c90-4440-963b-b00e8b9b620d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:20.793489 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3429/6831] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:35:20 2022] DELETE /identity/v3/projects/5cc6a2a737624602a6c35664ef12ee53 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:35:20.799257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38523fcb-07ee-45ff-8897-8246eccb94ef None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:20.799823 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38523fcb-07ee-45ff-8897-8246eccb94ef None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:20.799823 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38523fcb-07ee-45ff-8897-8246eccb94ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:20.823016 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-38523fcb-07ee-45ff-8897-8246eccb94ef None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:35:20.825917 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-38523fcb-07ee-45ff-8897-8246eccb94ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:20.953342 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3403/6832] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:35:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:35:20.963874 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d8bed-742f-485e-b7fc-e2290f4dddf3 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:20.964392 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d8bed-742f-485e-b7fc-e2290f4dddf3 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:20.964742 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d8bed-742f-485e-b7fc-e2290f4dddf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:20.998219 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-d60d8bed-742f-485e-b7fc-e2290f4dddf3 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:35:21.000373 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d60d8bed-742f-485e-b7fc-e2290f4dddf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:21.017089 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3430/6833] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:35:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:35:21.020314 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38523fcb-07ee-45ff-8897-8246eccb94ef None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:21.032194 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38523fcb-07ee-45ff-8897-8246eccb94ef None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:21.043608 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fbdc8-6b21-4f28-ad01-d26226a8b663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:21.045473 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fbdc8-6b21-4f28-ad01-d26226a8b663 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:21.046192 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fbdc8-6b21-4f28-ad01-d26226a8b663 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:21.046602 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fbdc8-6b21-4f28-ad01-d26226a8b663 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:21.047634 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8fbdc8-6b21-4f28-ad01-d26226a8b663 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:35:21.048026 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8fbdc8-6b21-4f28-ad01-d26226a8b663 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:21.049841 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8fbdc8-6b21-4f28-ad01-d26226a8b663 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:21.069104 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3404/6834] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:35:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:35:21.073729 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d8bed-742f-485e-b7fc-e2290f4dddf3 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:21.087586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d8bed-742f-485e-b7fc-e2290f4dddf3 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:21.115506 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673591c-63ed-40d8-849b-5ff6f72e7915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:21.118209 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673591c-63ed-40d8-849b-5ff6f72e7915 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:21.119814 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673591c-63ed-40d8-849b-5ff6f72e7915 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:21.120167 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673591c-63ed-40d8-849b-5ff6f72e7915 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:21.122092 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2673591c-63ed-40d8-849b-5ff6f72e7915 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:21.127839 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2673591c-63ed-40d8-849b-5ff6f72e7915 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:21.296783 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3431/6835] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:35:21 2022] POST /identity/v3/projects => generated 369 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:35:21.301011 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fbdc8-6b21-4f28-ad01-d26226a8b663 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:21.313123 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fbdc8-6b21-4f28-ad01-d26226a8b663 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:21.391265 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b609d-349e-487b-9697-56b193a79057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:21.392889 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b609d-349e-487b-9697-56b193a79057 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:21.393497 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b609d-349e-487b-9697-56b193a79057 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:21.394174 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b609d-349e-487b-9697-56b193a79057 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:21.395873 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324b609d-349e-487b-9697-56b193a79057 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:21.408084 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324b609d-349e-487b-9697-56b193a79057 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:21.597182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673591c-63ed-40d8-849b-5ff6f72e7915 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:21.598124 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3405/6836] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:35:21 2022] POST /identity/v3/users => generated 285 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:35:21.609061 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673591c-63ed-40d8-849b-5ff6f72e7915 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:21.618246 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93a8f2-ea4f-4221-8d36-afdc447a4a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:21.619477 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93a8f2-ea4f-4221-8d36-afdc447a4a45 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:21.620005 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93a8f2-ea4f-4221-8d36-afdc447a4a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:21.620441 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93a8f2-ea4f-4221-8d36-afdc447a4a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:21.621419 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b93a8f2-ea4f-4221-8d36-afdc447a4a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:21.624134 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b93a8f2-ea4f-4221-8d36-afdc447a4a45 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:21.637747 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3432/6837] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:35:21.642100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b609d-349e-487b-9697-56b193a79057 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:21.655522 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b609d-349e-487b-9697-56b193a79057 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:21.660944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8aa64-bb77-4f7c-a08a-e903baf0b895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:21.661641 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8aa64-bb77-4f7c-a08a-e903baf0b895 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:21.662617 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8aa64-bb77-4f7c-a08a-e903baf0b895 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:21.662906 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8aa64-bb77-4f7c-a08a-e903baf0b895 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:21.663731 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8aa64-bb77-4f7c-a08a-e903baf0b895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:21.666663 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8aa64-bb77-4f7c-a08a-e903baf0b895 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:21.680282 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3406/6838] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:35:21.684973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93a8f2-ea4f-4221-8d36-afdc447a4a45 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:21.696548 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93a8f2-ea4f-4221-8d36-afdc447a4a45 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:21.701368 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e1da4-1719-4d14-b9cb-72650282f39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:21.702298 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e1da4-1719-4d14-b9cb-72650282f39e admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:21.702584 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e1da4-1719-4d14-b9cb-72650282f39e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:21.702859 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e1da4-1719-4d14-b9cb-72650282f39e admin admin] PATH_INFO: `/v3/projects/5319e09e05a74925b8417ce40be5f90d/users/2bb2f228681d4bc2875fd58aa928ace4/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:21.756432 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e1da4-1719-4d14-b9cb-72650282f39e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5319e09e05a74925b8417ce40be5f90d, user_id=2bb2f228681d4bc2875fd58aa928ace4, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:21.761926 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e1da4-1719-4d14-b9cb-72650282f39e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:21.888982 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3433/6839] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:35:21 2022] PUT /identity/v3/projects/5319e09e05a74925b8417ce40be5f90d/users/2bb2f228681d4bc2875fd58aa928ace4/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:35:21.907872 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7fded-93fa-4751-a179-787bd750362b None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:21.909199 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7fded-93fa-4751-a179-787bd750362b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:21.913136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7fded-93fa-4751-a179-787bd750362b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:21.964895 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-13a7fded-93fa-4751-a179-787bd750362b None None] MFA Rules not processed for user `2bb2f228681d4bc2875fd58aa928ace4`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:35:21.967649 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-13a7fded-93fa-4751-a179-787bd750362b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:22.074290 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3407/6840] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:35:21 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:35:22.104073 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e1da4-1719-4d14-b9cb-72650282f39e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:22.106622 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4a8e1da4-1719-4d14-b9cb-72650282f39e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:22.249583 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e1da4-1719-4d14-b9cb-72650282f39e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:22.260967 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1a426-a3e5-4a83-ba27-0dfcf45523ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:22.263020 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1a426-a3e5-4a83-ba27-0dfcf45523ce service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:22.263305 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1a426-a3e5-4a83-ba27-0dfcf45523ce service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:22.263584 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1a426-a3e5-4a83-ba27-0dfcf45523ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:22.290568 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc1a426-a3e5-4a83-ba27-0dfcf45523ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:22.292051 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc1a426-a3e5-4a83-ba27-0dfcf45523ce service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:22.302408 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3434/6841] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:35:22 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:35:23.583088 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7fded-93fa-4751-a179-787bd750362b None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:23.583088 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-13a7fded-93fa-4751-a179-787bd750362b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:23.624730 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7fded-93fa-4751-a179-787bd750362b None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:23.634432 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade728c-8287-4a1c-924f-073c19e3cb66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:23.635498 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade728c-8287-4a1c-924f-073c19e3cb66 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:23.637427 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade728c-8287-4a1c-924f-073c19e3cb66 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:23.638283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade728c-8287-4a1c-924f-073c19e3cb66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:23.640662 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-eade728c-8287-4a1c-924f-073c19e3cb66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:23.887815 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade728c-8287-4a1c-924f-073c19e3cb66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:23.889458 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade728c-8287-4a1c-924f-073c19e3cb66 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:23.935492 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3408/6842] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:35:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:35:24.346152 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7730139-8b23-40ea-a0da-0a496b2aa54a None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:24.346767 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7730139-8b23-40ea-a0da-0a496b2aa54a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:24.346981 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7730139-8b23-40ea-a0da-0a496b2aa54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:24.393011 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-f7730139-8b23-40ea-a0da-0a496b2aa54a None None] MFA Rules not processed for user `e9fa67fb4ad4472183b95067597f043e`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:35:24.394905 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f7730139-8b23-40ea-a0da-0a496b2aa54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:24.496570 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3435/6843] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:35:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:35:24.503518 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade728c-8287-4a1c-924f-073c19e3cb66 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:24.505473 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-eade728c-8287-4a1c-924f-073c19e3cb66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:24.547240 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade728c-8287-4a1c-924f-073c19e3cb66 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:24.560850 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f466b9d6-9c41-43a0-a9aa-1b48d36ab625 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:24.562408 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466b9d6-9c41-43a0-a9aa-1b48d36ab625 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:24.565458 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466b9d6-9c41-43a0-a9aa-1b48d36ab625 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:24.565458 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466b9d6-9c41-43a0-a9aa-1b48d36ab625 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:24.580559 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f466b9d6-9c41-43a0-a9aa-1b48d36ab625 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:24.585618 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f466b9d6-9c41-43a0-a9aa-1b48d36ab625 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:24.614053 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3409/6844] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:35:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:35:27.630391 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7730139-8b23-40ea-a0da-0a496b2aa54a None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:27.649731 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7730139-8b23-40ea-a0da-0a496b2aa54a None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:27.658378 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c865d5-f511-4cd1-86fe-0a713ad60ce4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:27.659429 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c865d5-f511-4cd1-86fe-0a713ad60ce4 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:27.659937 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c865d5-f511-4cd1-86fe-0a713ad60ce4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:27.660404 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c865d5-f511-4cd1-86fe-0a713ad60ce4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:27.664313 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-02c865d5-f511-4cd1-86fe-0a713ad60ce4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:27.770274 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c865d5-f511-4cd1-86fe-0a713ad60ce4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:27.773152 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c865d5-f511-4cd1-86fe-0a713ad60ce4 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:27.801386 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3436/6845] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:35:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:35:31.721120 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04c4c9-6df9-4c80-bc8f-0cb2e9f092a0 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:31.721608 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04c4c9-6df9-4c80-bc8f-0cb2e9f092a0 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:31.721845 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04c4c9-6df9-4c80-bc8f-0cb2e9f092a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:31.749442 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-7b04c4c9-6df9-4c80-bc8f-0cb2e9f092a0 None None] MFA Rules not processed for user `e9fa67fb4ad4472183b95067597f043e`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:35:31.749442 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7b04c4c9-6df9-4c80-bc8f-0cb2e9f092a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:31.754961 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3410/6846] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:35:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:35:31.814073 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c865d5-f511-4cd1-86fe-0a713ad60ce4 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:31.819871 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-02c865d5-f511-4cd1-86fe-0a713ad60ce4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:31.910289 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c865d5-f511-4cd1-86fe-0a713ad60ce4 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:31.919657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1433a-bb6a-4048-a001-926f04f21f86 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e302b1298dd04d6590e3d079f7b13b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:31.921679 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1433a-bb6a-4048-a001-926f04f21f86 service glance] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:31.922936 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1433a-bb6a-4048-a001-926f04f21f86 service glance] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:31.923226 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1433a-bb6a-4048-a001-926f04f21f86 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:31.928671 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3fd1433a-bb6a-4048-a001-926f04f21f86 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:31.970497 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd1433a-bb6a-4048-a001-926f04f21f86 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:31.972611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd1433a-bb6a-4048-a001-926f04f21f86 service glance] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:32.022474 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3437/6847] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:35:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:35:33.034862 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04c4c9-6df9-4c80-bc8f-0cb2e9f092a0 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:33.049001 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04c4c9-6df9-4c80-bc8f-0cb2e9f092a0 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:33.053927 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e837f71a-74b6-4f10-85a7-86a389caf58a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:33.055701 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837f71a-74b6-4f10-85a7-86a389caf58a service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:33.056093 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837f71a-74b6-4f10-85a7-86a389caf58a service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:33.056572 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837f71a-74b6-4f10-85a7-86a389caf58a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:33.058825 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e837f71a-74b6-4f10-85a7-86a389caf58a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:33.074013 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e837f71a-74b6-4f10-85a7-86a389caf58a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:33.076159 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e837f71a-74b6-4f10-85a7-86a389caf58a service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:33.088425 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3411/6848] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:35:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:35:37.381834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1433a-bb6a-4048-a001-926f04f21f86 service glance] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:37.383296 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3fd1433a-bb6a-4048-a001-926f04f21f86 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:37.400262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1433a-bb6a-4048-a001-926f04f21f86 service glance] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:37.423614 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8683f9-d37d-462a-a01a-e5063b5b872a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:37.424374 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8683f9-d37d-462a-a01a-e5063b5b872a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:37.424964 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8683f9-d37d-462a-a01a-e5063b5b872a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:37.425448 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8683f9-d37d-462a-a01a-e5063b5b872a admin admin] PATH_INFO: `/v3/users/41a26877b24c4687a0c8cc4ffc6d69dd` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:37.427797 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8683f9-d37d-462a-a01a-e5063b5b872a admin admin] RBAC: Authorizing `identity:delete_user(user_id=41a26877b24c4687a0c8cc4ffc6d69dd)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:37.430212 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8683f9-d37d-462a-a01a-e5063b5b872a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:37.649215 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4b8683f9-d37d-462a-a01a-e5063b5b872a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41a26877b24c4687a0c8cc4ffc6d69dd'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:37.664426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4b8683f9-d37d-462a-a01a-e5063b5b872a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41a26877b24c4687a0c8cc4ffc6d69dd'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:37.728153 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4b8683f9-d37d-462a-a01a-e5063b5b872a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41a26877b24c4687a0c8cc4ffc6d69dd'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:37.736983 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4b8683f9-d37d-462a-a01a-e5063b5b872a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41a26877b24c4687a0c8cc4ffc6d69dd'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:37.737741 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4b8683f9-d37d-462a-a01a-e5063b5b872a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41a26877b24c4687a0c8cc4ffc6d69dd'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:37.748368 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3438/6849] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:35:37 2022] DELETE /identity/v3/users/41a26877b24c4687a0c8cc4ffc6d69dd => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:35:38.386526 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e837f71a-74b6-4f10-85a7-86a389caf58a service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:38.449370 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e837f71a-74b6-4f10-85a7-86a389caf58a service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:38.558024 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37580a95-d1b3-45ca-996a-0c79cfe73046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:38.559187 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37580a95-d1b3-45ca-996a-0c79cfe73046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:38.559725 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37580a95-d1b3-45ca-996a-0c79cfe73046 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:38.560195 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37580a95-d1b3-45ca-996a-0c79cfe73046 admin admin] PATH_INFO: `/v3/projects/9ef2f32360be4d6c87d31bb5307ad696` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:38.587533 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37580a95-d1b3-45ca-996a-0c79cfe73046 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ef2f32360be4d6c87d31bb5307ad696)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:38.589497 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37580a95-d1b3-45ca-996a-0c79cfe73046 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:38.756953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-37580a95-d1b3-45ca-996a-0c79cfe73046 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ef2f32360be4d6c87d31bb5307ad696', 'request_id': 'req-37580a95-d1b3-45ca-996a-0c79cfe73046'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:38.764052 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-37580a95-d1b3-45ca-996a-0c79cfe73046 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ef2f32360be4d6c87d31bb5307ad696', 'request_id': 'req-37580a95-d1b3-45ca-996a-0c79cfe73046'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:38.770573 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-37580a95-d1b3-45ca-996a-0c79cfe73046 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ef2f32360be4d6c87d31bb5307ad696', 'request_id': 'req-37580a95-d1b3-45ca-996a-0c79cfe73046'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:38.875873 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-37580a95-d1b3-45ca-996a-0c79cfe73046 admin admin] The token cache is being invalidate because project 9ef2f32360be4d6c87d31bb5307ad696 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:35:38.876170 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-37580a95-d1b3-45ca-996a-0c79cfe73046 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:38.878575 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-37580a95-d1b3-45ca-996a-0c79cfe73046 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:38.881019 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3412/6850] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:35:38 2022] DELETE /identity/v3/projects/9ef2f32360be4d6c87d31bb5307ad696 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:35:38.886259 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09092632-1c35-4479-ab49-5bbc28b5817a None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:38.886812 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09092632-1c35-4479-ab49-5bbc28b5817a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:38.887309 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09092632-1c35-4479-ab49-5bbc28b5817a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:38.921586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-09092632-1c35-4479-ab49-5bbc28b5817a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:35:38.930189 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-09092632-1c35-4479-ab49-5bbc28b5817a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:39.048498 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3439/6851] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:35:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:35:39.050498 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2bdf35-4c29-4c80-954e-4b49c202a850 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:39.051013 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2bdf35-4c29-4c80-954e-4b49c202a850 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:39.051397 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2bdf35-4c29-4c80-954e-4b49c202a850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:39.088998 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-da2bdf35-4c29-4c80-954e-4b49c202a850 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:35:39.093868 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-da2bdf35-4c29-4c80-954e-4b49c202a850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:39.114256 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3413/6852] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:35:39.132555 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09092632-1c35-4479-ab49-5bbc28b5817a None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:39.143829 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09092632-1c35-4479-ab49-5bbc28b5817a None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:39.156023 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad2f99-790c-4def-ac2a-24b360bd1f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:39.156511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad2f99-790c-4def-ac2a-24b360bd1f50 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:39.156806 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad2f99-790c-4def-ac2a-24b360bd1f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:39.157087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad2f99-790c-4def-ac2a-24b360bd1f50 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:39.157986 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad2f99-790c-4def-ac2a-24b360bd1f50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:35:39.158269 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad2f99-790c-4def-ac2a-24b360bd1f50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:39.160580 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad2f99-790c-4def-ac2a-24b360bd1f50 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:39.176078 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3440/6853] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:35:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:35:39.181109 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2bdf35-4c29-4c80-954e-4b49c202a850 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:39.193783 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2bdf35-4c29-4c80-954e-4b49c202a850 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:39.199339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ca35b-d6ef-48b7-973d-3dc418b208b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:39.200071 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ca35b-d6ef-48b7-973d-3dc418b208b3 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:39.200563 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ca35b-d6ef-48b7-973d-3dc418b208b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:39.200884 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ca35b-d6ef-48b7-973d-3dc418b208b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:39.201607 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ca35b-d6ef-48b7-973d-3dc418b208b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:39.204531 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ca35b-d6ef-48b7-973d-3dc418b208b3 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:39.306749 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3414/6854] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:35:39 2022] POST /identity/v3/projects => generated 365 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:35:39.311772 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad2f99-790c-4def-ac2a-24b360bd1f50 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:39.326245 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad2f99-790c-4def-ac2a-24b360bd1f50 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:39.409100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5043a4a-d356-4d03-8824-999a384b4eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:39.409840 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5043a4a-d356-4d03-8824-999a384b4eac admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:39.410127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5043a4a-d356-4d03-8824-999a384b4eac admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:39.410587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5043a4a-d356-4d03-8824-999a384b4eac admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:39.412055 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5043a4a-d356-4d03-8824-999a384b4eac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:39.414230 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5043a4a-d356-4d03-8824-999a384b4eac admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:39.534858 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3441/6855] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:35:39 2022] POST /identity/v3/users => generated 283 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:35:39.540461 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ca35b-d6ef-48b7-973d-3dc418b208b3 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:39.583038 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ca35b-d6ef-48b7-973d-3dc418b208b3 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:39.646207 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563dfef9-e147-4199-bb99-7e760ceaf521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:39.649655 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563dfef9-e147-4199-bb99-7e760ceaf521 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:39.653044 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563dfef9-e147-4199-bb99-7e760ceaf521 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:39.653352 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563dfef9-e147-4199-bb99-7e760ceaf521 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:39.654178 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563dfef9-e147-4199-bb99-7e760ceaf521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:39.658609 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563dfef9-e147-4199-bb99-7e760ceaf521 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:39.694160 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3415/6856] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:35:39.698523 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5043a4a-d356-4d03-8824-999a384b4eac admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:39.716217 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5043a4a-d356-4d03-8824-999a384b4eac admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:39.732407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79a3c6-5f2a-4721-ab0c-81b3ce24b388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:39.733361 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79a3c6-5f2a-4721-ab0c-81b3ce24b388 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:39.734529 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79a3c6-5f2a-4721-ab0c-81b3ce24b388 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:39.734933 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79a3c6-5f2a-4721-ab0c-81b3ce24b388 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:39.736480 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f79a3c6-5f2a-4721-ab0c-81b3ce24b388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:39.746405 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f79a3c6-5f2a-4721-ab0c-81b3ce24b388 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:39.762591 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3442/6857] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:35:39.767117 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563dfef9-e147-4199-bb99-7e760ceaf521 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:39.783738 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563dfef9-e147-4199-bb99-7e760ceaf521 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:39.791155 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54535d0b-9281-419e-accd-fcf5a495c99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:39.796222 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54535d0b-9281-419e-accd-fcf5a495c99e admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:39.805812 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54535d0b-9281-419e-accd-fcf5a495c99e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:39.805812 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54535d0b-9281-419e-accd-fcf5a495c99e admin admin] PATH_INFO: `/v3/projects/e02e106ab99f4decadf747b3ebf025c7/users/3107c6d79451405a963c5816d92055b3/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:39.846477 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54535d0b-9281-419e-accd-fcf5a495c99e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e02e106ab99f4decadf747b3ebf025c7, user_id=3107c6d79451405a963c5816d92055b3, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:39.850130 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54535d0b-9281-419e-accd-fcf5a495c99e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:39.959737 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3416/6858] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:35:39 2022] PUT /identity/v3/projects/e02e106ab99f4decadf747b3ebf025c7/users/3107c6d79451405a963c5816d92055b3/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:35:39.965128 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3927a-314f-4cf8-80c8-90fc2a30e924 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:39.965598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3927a-314f-4cf8-80c8-90fc2a30e924 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:39.965684 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3927a-314f-4cf8-80c8-90fc2a30e924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:40.002407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-61d3927a-314f-4cf8-80c8-90fc2a30e924 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:35:40.002407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-61d3927a-314f-4cf8-80c8-90fc2a30e924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:40.131597 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3443/6859] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:35:40.164208 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54535d0b-9281-419e-accd-fcf5a495c99e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:40.166057 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-54535d0b-9281-419e-accd-fcf5a495c99e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:40.294571 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54535d0b-9281-419e-accd-fcf5a495c99e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:40.313954 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1e5d9-ae01-4867-8147-6bf8a0953b27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:40.317387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1e5d9-ae01-4867-8147-6bf8a0953b27 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:40.317387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1e5d9-ae01-4867-8147-6bf8a0953b27 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:40.317387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1e5d9-ae01-4867-8147-6bf8a0953b27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:40.370933 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a1e5d9-ae01-4867-8147-6bf8a0953b27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:40.372681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a1e5d9-ae01-4867-8147-6bf8a0953b27 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:40.397433 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3417/6860] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:35:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:35:44.555102 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84cc4b-a93b-4357-b656-273945e6f74c None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:44.555622 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84cc4b-a93b-4357-b656-273945e6f74c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:44.555717 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84cc4b-a93b-4357-b656-273945e6f74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:44.610490 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-bb84cc4b-a93b-4357-b656-273945e6f74c None None] MFA Rules not processed for user `3107c6d79451405a963c5816d92055b3`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:35:44.613713 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-bb84cc4b-a93b-4357-b656-273945e6f74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:44.694204 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3444/6861] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:35:44 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:35:44.704725 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b9fe6-8739-478f-8ffa-d29378611d64 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:44.705263 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b9fe6-8739-478f-8ffa-d29378611d64 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:44.705388 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b9fe6-8739-478f-8ffa-d29378611d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:44.725737 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-8d4b9fe6-8739-478f-8ffa-d29378611d64 None None] MFA Rules not processed for user `3107c6d79451405a963c5816d92055b3`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:35:44.728377 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8d4b9fe6-8739-478f-8ffa-d29378611d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:44.740294 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3418/6862] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:35:44 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:35:44.753452 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84cc4b-a93b-4357-b656-273945e6f74c None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:44.755521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-bb84cc4b-a93b-4357-b656-273945e6f74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:44.869076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84cc4b-a93b-4357-b656-273945e6f74c None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:44.879427 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf8814-4f48-4829-9197-0c4cac3fe310 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:44.879427 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf8814-4f48-4829-9197-0c4cac3fe310 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:44.879427 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf8814-4f48-4829-9197-0c4cac3fe310 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:44.879427 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf8814-4f48-4829-9197-0c4cac3fe310 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:44.886864 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cf8814-4f48-4829-9197-0c4cac3fe310 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:44.889272 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cf8814-4f48-4829-9197-0c4cac3fe310 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:44.898178 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3445/6863] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:35:44 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:35:46.906192 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b9fe6-8739-478f-8ffa-d29378611d64 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:46.907728 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8d4b9fe6-8739-478f-8ffa-d29378611d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:46.923538 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b9fe6-8739-478f-8ffa-d29378611d64 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:46.928109 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275551c-d621-4132-addf-2c3d06c1255d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:46.928990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275551c-d621-4132-addf-2c3d06c1255d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:46.929277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275551c-d621-4132-addf-2c3d06c1255d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:46.929560 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275551c-d621-4132-addf-2c3d06c1255d admin admin] PATH_INFO: `/v3/users/04d70b7e123f45c28ae76ce9c4f5f5bb` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:46.930799 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275551c-d621-4132-addf-2c3d06c1255d admin admin] RBAC: Authorizing `identity:delete_user(user_id=04d70b7e123f45c28ae76ce9c4f5f5bb)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:46.954062 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275551c-d621-4132-addf-2c3d06c1255d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:47.260096 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0275551c-d621-4132-addf-2c3d06c1255d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04d70b7e123f45c28ae76ce9c4f5f5bb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:47.273714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0275551c-d621-4132-addf-2c3d06c1255d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04d70b7e123f45c28ae76ce9c4f5f5bb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:47.373170 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0275551c-d621-4132-addf-2c3d06c1255d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04d70b7e123f45c28ae76ce9c4f5f5bb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:47.375373 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0275551c-d621-4132-addf-2c3d06c1255d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04d70b7e123f45c28ae76ce9c4f5f5bb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:47.388375 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0275551c-d621-4132-addf-2c3d06c1255d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04d70b7e123f45c28ae76ce9c4f5f5bb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:47.398350 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3419/6864] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:35:46 2022] DELETE /identity/v3/users/04d70b7e123f45c28ae76ce9c4f5f5bb => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:35:47.404081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfedfa-b85e-41fd-9b0b-612e0c224eef None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:47.405051 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfedfa-b85e-41fd-9b0b-612e0c224eef None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:47.405336 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfedfa-b85e-41fd-9b0b-612e0c224eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:47.424039 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-ebdfedfa-b85e-41fd-9b0b-612e0c224eef None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:35:47.425475 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ebdfedfa-b85e-41fd-9b0b-612e0c224eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:47.504480 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3446/6865] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:35:47.514553 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275551c-d621-4132-addf-2c3d06c1255d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:47.516111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0275551c-d621-4132-addf-2c3d06c1255d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:47.584089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275551c-d621-4132-addf-2c3d06c1255d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:47.587930 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100edf6a-801b-4713-aa8b-723a4636aca2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:47.588582 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100edf6a-801b-4713-aa8b-723a4636aca2 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:47.589167 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100edf6a-801b-4713-aa8b-723a4636aca2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:47.589446 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100edf6a-801b-4713-aa8b-723a4636aca2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:47.599192 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100edf6a-801b-4713-aa8b-723a4636aca2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:47.600672 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100edf6a-801b-4713-aa8b-723a4636aca2 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:47.610692 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3420/6866] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:35:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:35:47.947653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdfedfa-b85e-41fd-9b0b-612e0c224eef None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:47.947653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ebdfedfa-b85e-41fd-9b0b-612e0c224eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:47.971743 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdfedfa-b85e-41fd-9b0b-612e0c224eef None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:47.979572 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e50695-38c4-419a-8b2e-f18ba477e0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:47.980465 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e50695-38c4-419a-8b2e-f18ba477e0bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:47.980752 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e50695-38c4-419a-8b2e-f18ba477e0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:47.981032 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e50695-38c4-419a-8b2e-f18ba477e0bf admin admin] PATH_INFO: `/v3/projects/ce5451096cf34308801ae3863daa4b6d` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:47.982274 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e50695-38c4-419a-8b2e-f18ba477e0bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce5451096cf34308801ae3863daa4b6d)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:47.984547 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e50695-38c4-419a-8b2e-f18ba477e0bf admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:48.161685 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-52e50695-38c4-419a-8b2e-f18ba477e0bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce5451096cf34308801ae3863daa4b6d', 'request_id': 'req-52e50695-38c4-419a-8b2e-f18ba477e0bf'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:48.173788 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-52e50695-38c4-419a-8b2e-f18ba477e0bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce5451096cf34308801ae3863daa4b6d', 'request_id': 'req-52e50695-38c4-419a-8b2e-f18ba477e0bf'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:48.184586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-52e50695-38c4-419a-8b2e-f18ba477e0bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce5451096cf34308801ae3863daa4b6d', 'request_id': 'req-52e50695-38c4-419a-8b2e-f18ba477e0bf'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:48.308473 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-52e50695-38c4-419a-8b2e-f18ba477e0bf admin admin] The token cache is being invalidate because project ce5451096cf34308801ae3863daa4b6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:35:48.308770 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-52e50695-38c4-419a-8b2e-f18ba477e0bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:48.309459 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-52e50695-38c4-419a-8b2e-f18ba477e0bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:35:48.311454 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3447/6867] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:35:47 2022] DELETE /identity/v3/projects/ce5451096cf34308801ae3863daa4b6d => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:35:48.317608 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a41007-9be8-4fc2-98de-b658e82e2eed None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:48.320031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a41007-9be8-4fc2-98de-b658e82e2eed None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:48.320031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a41007-9be8-4fc2-98de-b658e82e2eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:48.342958 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-21a41007-9be8-4fc2-98de-b658e82e2eed None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:35:48.344245 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-21a41007-9be8-4fc2-98de-b658e82e2eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:48.455615 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3421/6868] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:35:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:35:48.464453 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b4510-3dd0-419a-838c-61a7cfdccf2d None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:48.464953 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b4510-3dd0-419a-838c-61a7cfdccf2d None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:48.466917 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b4510-3dd0-419a-838c-61a7cfdccf2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:48.507490 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-106b4510-3dd0-419a-838c-61a7cfdccf2d None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:35:48.509078 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-106b4510-3dd0-419a-838c-61a7cfdccf2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:48.530105 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3448/6869] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:35:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:35:48.534162 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a41007-9be8-4fc2-98de-b658e82e2eed None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:48.554160 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a41007-9be8-4fc2-98de-b658e82e2eed None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:48.589538 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55a4af-fdb4-4809-bd99-7768695612ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:48.594956 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55a4af-fdb4-4809-bd99-7768695612ee admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:48.595167 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55a4af-fdb4-4809-bd99-7768695612ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:48.596820 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55a4af-fdb4-4809-bd99-7768695612ee admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:48.599041 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55a4af-fdb4-4809-bd99-7768695612ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:35:48.599363 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55a4af-fdb4-4809-bd99-7768695612ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:48.606096 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55a4af-fdb4-4809-bd99-7768695612ee admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:48.642534 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3422/6870] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:35:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:35:48.647666 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b4510-3dd0-419a-838c-61a7cfdccf2d None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:48.664225 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b4510-3dd0-419a-838c-61a7cfdccf2d None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:48.682388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906d10f-e607-4391-aab9-763515dfaa90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:48.690414 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906d10f-e607-4391-aab9-763515dfaa90 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:48.690414 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906d10f-e607-4391-aab9-763515dfaa90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:48.690414 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906d10f-e607-4391-aab9-763515dfaa90 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:48.690414 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7906d10f-e607-4391-aab9-763515dfaa90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:48.690414 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7906d10f-e607-4391-aab9-763515dfaa90 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:48.872508 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3449/6871] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:35:48 2022] POST /identity/v3/projects => generated 355 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:35:48.876524 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55a4af-fdb4-4809-bd99-7768695612ee admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:48.891935 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55a4af-fdb4-4809-bd99-7768695612ee admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:49.034689 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a9393-f141-4222-b038-54d526e56533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:49.036004 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a9393-f141-4222-b038-54d526e56533 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:49.036230 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a9393-f141-4222-b038-54d526e56533 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:49.036457 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a9393-f141-4222-b038-54d526e56533 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:49.045818 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a9393-f141-4222-b038-54d526e56533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:49.047851 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a9393-f141-4222-b038-54d526e56533 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:49.161678 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3423/6872] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:35:48 2022] POST /identity/v3/users => generated 278 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:35:49.163008 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906d10f-e607-4391-aab9-763515dfaa90 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:49.185503 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906d10f-e607-4391-aab9-763515dfaa90 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:49.224909 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2da073-ec02-4992-a3e7-cb55b8379be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:49.224909 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2da073-ec02-4992-a3e7-cb55b8379be5 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:49.224909 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2da073-ec02-4992-a3e7-cb55b8379be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:49.224909 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2da073-ec02-4992-a3e7-cb55b8379be5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:49.225316 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2da073-ec02-4992-a3e7-cb55b8379be5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:49.227284 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2da073-ec02-4992-a3e7-cb55b8379be5 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:49.253176 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3450/6873] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:35:49.255648 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a9393-f141-4222-b038-54d526e56533 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:49.285653 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a9393-f141-4222-b038-54d526e56533 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:49.298064 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da543718-5ba4-4c43-98f8-d76b2b0b32aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:49.302895 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da543718-5ba4-4c43-98f8-d76b2b0b32aa admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:49.302895 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da543718-5ba4-4c43-98f8-d76b2b0b32aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:49.302895 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da543718-5ba4-4c43-98f8-d76b2b0b32aa admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:49.302895 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da543718-5ba4-4c43-98f8-d76b2b0b32aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:49.305703 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da543718-5ba4-4c43-98f8-d76b2b0b32aa admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:49.317397 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3424/6874] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:35:49.322372 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2da073-ec02-4992-a3e7-cb55b8379be5 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:49.333071 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2da073-ec02-4992-a3e7-cb55b8379be5 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:49.338375 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab2a37-1da2-476c-9782-d4224ee4a879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:49.339572 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab2a37-1da2-476c-9782-d4224ee4a879 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:49.339928 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab2a37-1da2-476c-9782-d4224ee4a879 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:49.340328 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab2a37-1da2-476c-9782-d4224ee4a879 admin admin] PATH_INFO: `/v3/projects/228c9fcbe55946858e8c46db94e0f921/users/5ee252de0fb74adda84ee09c01e84eeb/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:49.358717 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab2a37-1da2-476c-9782-d4224ee4a879 admin admin] RBAC: Authorizing `identity:create_grant(project_id=228c9fcbe55946858e8c46db94e0f921, user_id=5ee252de0fb74adda84ee09c01e84eeb, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:49.361824 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab2a37-1da2-476c-9782-d4224ee4a879 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:49.438915 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3451/6875] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:35:49 2022] PUT /identity/v3/projects/228c9fcbe55946858e8c46db94e0f921/users/5ee252de0fb74adda84ee09c01e84eeb/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:35:49.458420 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24656c9-6805-48c3-8fde-afffcbd42a6e None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:49.458420 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24656c9-6805-48c3-8fde-afffcbd42a6e None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:49.458420 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24656c9-6805-48c3-8fde-afffcbd42a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:49.496259 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-e24656c9-6805-48c3-8fde-afffcbd42a6e None None] MFA Rules not processed for user `5ee252de0fb74adda84ee09c01e84eeb`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:35:49.497660 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e24656c9-6805-48c3-8fde-afffcbd42a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:49.589556 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3425/6876] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:35:49 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:35:49.590894 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab2a37-1da2-476c-9782-d4224ee4a879 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:49.712909 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab2a37-1da2-476c-9782-d4224ee4a879 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:49.730050 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beba57b-ac03-406e-9923-4687d65ce052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:49.731051 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beba57b-ac03-406e-9923-4687d65ce052 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:49.731511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beba57b-ac03-406e-9923-4687d65ce052 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:49.732185 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beba57b-ac03-406e-9923-4687d65ce052 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:49.733129 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beba57b-ac03-406e-9923-4687d65ce052 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:49.735128 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beba57b-ac03-406e-9923-4687d65ce052 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:49.885190 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3452/6877] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:35:49 2022] POST /identity/v3/projects => generated 357 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:35:49.888969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24656c9-6805-48c3-8fde-afffcbd42a6e None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:49.902810 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24656c9-6805-48c3-8fde-afffcbd42a6e None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:49.996318 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35accd5-ea05-4e93-924c-03238fd31a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:49.997333 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35accd5-ea05-4e93-924c-03238fd31a9c admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:49.997886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35accd5-ea05-4e93-924c-03238fd31a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:49.998390 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35accd5-ea05-4e93-924c-03238fd31a9c admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:49.999254 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35accd5-ea05-4e93-924c-03238fd31a9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:50.003439 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35accd5-ea05-4e93-924c-03238fd31a9c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:50.137475 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3426/6878] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:35:49 2022] POST /identity/v3/users => generated 285 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:35:50.137920 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beba57b-ac03-406e-9923-4687d65ce052 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:50.167665 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beba57b-ac03-406e-9923-4687d65ce052 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:50.174603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1868c-dd7f-49a7-80ba-749a3b79ece6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:50.178612 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1868c-dd7f-49a7-80ba-749a3b79ece6 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:50.179518 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1868c-dd7f-49a7-80ba-749a3b79ece6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:50.182146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1868c-dd7f-49a7-80ba-749a3b79ece6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:50.183180 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1868c-dd7f-49a7-80ba-749a3b79ece6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:50.193700 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1868c-dd7f-49a7-80ba-749a3b79ece6 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:50.224586 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3453/6879] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:35:50 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:35:50.228588 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35accd5-ea05-4e93-924c-03238fd31a9c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:50.243427 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35accd5-ea05-4e93-924c-03238fd31a9c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:50.249242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a101010-7bfe-4335-a866-badaf9c989e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:50.250186 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a101010-7bfe-4335-a866-badaf9c989e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:50.250475 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a101010-7bfe-4335-a866-badaf9c989e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:50.250786 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a101010-7bfe-4335-a866-badaf9c989e2 admin admin] PATH_INFO: `/v3/projects/1581d64855e948ca9b28bae7fa6c7ffc/users/668d6c095cee419bb830ce8b1c547aa4/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:50.296482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a101010-7bfe-4335-a866-badaf9c989e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1581d64855e948ca9b28bae7fa6c7ffc, user_id=668d6c095cee419bb830ce8b1c547aa4, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:50.298246 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a101010-7bfe-4335-a866-badaf9c989e2 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:50.368574 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3427/6880] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:35:50 2022] PUT /identity/v3/projects/1581d64855e948ca9b28bae7fa6c7ffc/users/668d6c095cee419bb830ce8b1c547aa4/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:35:50.381993 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1868c-dd7f-49a7-80ba-749a3b79ece6 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:50.400590 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1868c-dd7f-49a7-80ba-749a3b79ece6 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:50.494826 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72bea73-bc2f-466a-a111-abad91cb0775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:50.494826 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bea73-bc2f-466a-a111-abad91cb0775 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:50.494826 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bea73-bc2f-466a-a111-abad91cb0775 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:50.494826 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bea73-bc2f-466a-a111-abad91cb0775 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:50.495175 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72bea73-bc2f-466a-a111-abad91cb0775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:50.495175 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72bea73-bc2f-466a-a111-abad91cb0775 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:50.513862 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a101010-7bfe-4335-a866-badaf9c989e2 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:50.525973 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3454/6881] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:35:50 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:35:50.529683 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a101010-7bfe-4335-a866-badaf9c989e2 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:50.537854 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423d166-a271-42d5-b2be-cc1e2a8c5af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:50.538853 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423d166-a271-42d5-b2be-cc1e2a8c5af6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:50.539506 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423d166-a271-42d5-b2be-cc1e2a8c5af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:50.539952 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423d166-a271-42d5-b2be-cc1e2a8c5af6 admin admin] PATH_INFO: `/v3/projects/1581d64855e948ca9b28bae7fa6c7ffc/users/668d6c095cee419bb830ce8b1c547aa4/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:50.547883 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423d166-a271-42d5-b2be-cc1e2a8c5af6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1581d64855e948ca9b28bae7fa6c7ffc, user_id=668d6c095cee419bb830ce8b1c547aa4, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:50.547883 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423d166-a271-42d5-b2be-cc1e2a8c5af6 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:50.571089 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3428/6882] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:35:50 2022] PUT /identity/v3/projects/1581d64855e948ca9b28bae7fa6c7ffc/users/668d6c095cee419bb830ce8b1c547aa4/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:35:50.576869 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d9507-3ba1-4f72-afaa-4f3bfbb88d1e None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:50.577163 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d9507-3ba1-4f72-afaa-4f3bfbb88d1e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:50.577447 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d9507-3ba1-4f72-afaa-4f3bfbb88d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:50.616158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-cb5d9507-3ba1-4f72-afaa-4f3bfbb88d1e None None] MFA Rules not processed for user `668d6c095cee419bb830ce8b1c547aa4`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:35:50.617984 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-cb5d9507-3ba1-4f72-afaa-4f3bfbb88d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:50.693563 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3455/6883] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:35:50 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:35:50.705924 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423d166-a271-42d5-b2be-cc1e2a8c5af6 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:50.709527 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6423d166-a271-42d5-b2be-cc1e2a8c5af6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:50.775371 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423d166-a271-42d5-b2be-cc1e2a8c5af6 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:50.780538 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b044e-4d2b-47e2-8ba1-afa8e719e031 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:50.781227 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b044e-4d2b-47e2-8ba1-afa8e719e031 service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:50.781564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b044e-4d2b-47e2-8ba1-afa8e719e031 service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:50.782099 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b044e-4d2b-47e2-8ba1-afa8e719e031 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:50.793144 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b044e-4d2b-47e2-8ba1-afa8e719e031 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:50.795295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b044e-4d2b-47e2-8ba1-afa8e719e031 service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:50.828354 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3429/6884] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:35:50 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:35:51.113501 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d9507-3ba1-4f72-afaa-4f3bfbb88d1e None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:51.132646 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d9507-3ba1-4f72-afaa-4f3bfbb88d1e None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:51.136912 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18bc9a-485b-41c9-aa13-ea8e65ab756c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:51.138075 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18bc9a-485b-41c9-aa13-ea8e65ab756c service cinder] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:51.138461 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18bc9a-485b-41c9-aa13-ea8e65ab756c service cinder] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:51.139604 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18bc9a-485b-41c9-aa13-ea8e65ab756c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:51.290865 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18bc9a-485b-41c9-aa13-ea8e65ab756c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:51.292941 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18bc9a-485b-41c9-aa13-ea8e65ab756c service cinder] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:51.304239 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3456/6885] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:35:51 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:35:54.292842 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b044e-4d2b-47e2-8ba1-afa8e719e031 service cinder] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:35:54.294614 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d57b044e-4d2b-47e2-8ba1-afa8e719e031 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:54.429874 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b044e-4d2b-47e2-8ba1-afa8e719e031 service cinder] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:35:54.434543 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e32594-32f9-4c5d-b7d8-e581c2b06748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:35:54.435395 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e32594-32f9-4c5d-b7d8-e581c2b06748 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:35:54.435841 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e32594-32f9-4c5d-b7d8-e581c2b06748 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:35:54.436457 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e32594-32f9-4c5d-b7d8-e581c2b06748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:35:54.438498 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-61e32594-32f9-4c5d-b7d8-e581c2b06748 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:35:54.455531 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e32594-32f9-4c5d-b7d8-e581c2b06748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:35:54.457018 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e32594-32f9-4c5d-b7d8-e581c2b06748 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:35:54.470391 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3430/6886] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:35:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:36:05.263688 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676aa34-95c6-4b51-b606-5f1d31be521e None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:05.264327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676aa34-95c6-4b51-b606-5f1d31be521e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:05.264617 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676aa34-95c6-4b51-b606-5f1d31be521e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:05.299191 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-b676aa34-95c6-4b51-b606-5f1d31be521e None None] MFA Rules not processed for user `3107c6d79451405a963c5816d92055b3`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:05.300723 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b676aa34-95c6-4b51-b606-5f1d31be521e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:05.379299 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3457/6887] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:05 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:36:06.429597 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e32594-32f9-4c5d-b7d8-e581c2b06748 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:06.431877 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-61e32594-32f9-4c5d-b7d8-e581c2b06748 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:06.571146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676aa34-95c6-4b51-b606-5f1d31be521e None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:06.572831 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b676aa34-95c6-4b51-b606-5f1d31be521e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:06.574940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e32594-32f9-4c5d-b7d8-e581c2b06748 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:06.583453 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306ccbc-9d6c-4962-b23e-a7a3f94eb363 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:06.584705 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306ccbc-9d6c-4962-b23e-a7a3f94eb363 service placement] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:06.585158 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306ccbc-9d6c-4962-b23e-a7a3f94eb363 service placement] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:06.586221 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306ccbc-9d6c-4962-b23e-a7a3f94eb363 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:06.588614 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f306ccbc-9d6c-4962-b23e-a7a3f94eb363 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:06.601048 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676aa34-95c6-4b51-b606-5f1d31be521e None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:06.608216 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306ccbc-9d6c-4962-b23e-a7a3f94eb363 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:06.610650 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f306ccbc-9d6c-4962-b23e-a7a3f94eb363 service placement] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:06.617066 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc3080-a56a-456b-8ca3-445a6ff777c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:06.617881 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc3080-a56a-456b-8ca3-445a6ff777c3 service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:06.618193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc3080-a56a-456b-8ca3-445a6ff777c3 service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:06.618490 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc3080-a56a-456b-8ca3-445a6ff777c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:06.621795 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f4fc3080-a56a-456b-8ca3-445a6ff777c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:06.627743 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3431/6888] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:36:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:36:06.648035 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc3080-a56a-456b-8ca3-445a6ff777c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:06.650669 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc3080-a56a-456b-8ca3-445a6ff777c3 service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:06.669801 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3458/6889] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:36:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:36:06.832765 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefbd1c-2048-4c1a-b4e3-409a6e0ee7fe None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:06.833183 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefbd1c-2048-4c1a-b4e3-409a6e0ee7fe None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:06.833548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefbd1c-2048-4c1a-b4e3-409a6e0ee7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:06.855193 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-cfefbd1c-2048-4c1a-b4e3-409a6e0ee7fe None None] MFA Rules not processed for user `3107c6d79451405a963c5816d92055b3`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:06.857174 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-cfefbd1c-2048-4c1a-b4e3-409a6e0ee7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:06.877160 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3432/6890] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:06 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:36:07.388522 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc3080-a56a-456b-8ca3-445a6ff777c3 service placement] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:07.403611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc3080-a56a-456b-8ca3-445a6ff777c3 service placement] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:07.410527 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71de1fe-f96d-4d17-a251-02393a21c2dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:07.411994 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71de1fe-f96d-4d17-a251-02393a21c2dd service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:07.412400 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71de1fe-f96d-4d17-a251-02393a21c2dd service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:07.412734 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71de1fe-f96d-4d17-a251-02393a21c2dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:07.414987 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d71de1fe-f96d-4d17-a251-02393a21c2dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:07.435008 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71de1fe-f96d-4d17-a251-02393a21c2dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:07.437554 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71de1fe-f96d-4d17-a251-02393a21c2dd service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:07.466558 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3459/6891] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:36:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:36:11.336375 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfefbd1c-2048-4c1a-b4e3-409a6e0ee7fe None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:11.338039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-cfefbd1c-2048-4c1a-b4e3-409a6e0ee7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:11.364706 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfefbd1c-2048-4c1a-b4e3-409a6e0ee7fe None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:11.396830 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0c900-d965-4b5f-a129-9bb791c08922 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:11.397712 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0c900-d965-4b5f-a129-9bb791c08922 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:11.398186 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0c900-d965-4b5f-a129-9bb791c08922 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:11.399517 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0c900-d965-4b5f-a129-9bb791c08922 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:11.404549 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e3c0c900-d965-4b5f-a129-9bb791c08922 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:11.431002 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c0c900-d965-4b5f-a129-9bb791c08922 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:11.451157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c0c900-d965-4b5f-a129-9bb791c08922 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:11.495429 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3433/6892] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:36:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:36:13.145059 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71de1fe-f96d-4d17-a251-02393a21c2dd service placement] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:13.147299 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d71de1fe-f96d-4d17-a251-02393a21c2dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:13.297390 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71de1fe-f96d-4d17-a251-02393a21c2dd service placement] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:13.305843 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6fc06c-fa97-47f3-9c5f-9d38b5f85355 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:13.306679 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6fc06c-fa97-47f3-9c5f-9d38b5f85355 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:13.307069 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6fc06c-fa97-47f3-9c5f-9d38b5f85355 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:13.307506 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6fc06c-fa97-47f3-9c5f-9d38b5f85355 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:13.310039 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-bb6fc06c-fa97-47f3-9c5f-9d38b5f85355 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:13.333893 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6fc06c-fa97-47f3-9c5f-9d38b5f85355 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:13.335634 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6fc06c-fa97-47f3-9c5f-9d38b5f85355 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:13.351225 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3460/6893] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:36:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:36:20.375783 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0c900-d965-4b5f-a129-9bb791c08922 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:20.425841 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0c900-d965-4b5f-a129-9bb791c08922 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:20.444331 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8aaf80-8645-400f-b49e-7dc8bdc5fc56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:20.446485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8aaf80-8645-400f-b49e-7dc8bdc5fc56 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:20.447020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8aaf80-8645-400f-b49e-7dc8bdc5fc56 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:20.447715 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8aaf80-8645-400f-b49e-7dc8bdc5fc56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:20.450429 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3d8aaf80-8645-400f-b49e-7dc8bdc5fc56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:20.469297 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8aaf80-8645-400f-b49e-7dc8bdc5fc56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:20.472036 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8aaf80-8645-400f-b49e-7dc8bdc5fc56 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:20.505025 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3434/6894] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:36:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:36:25.496703 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6fc06c-fa97-47f3-9c5f-9d38b5f85355 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:25.501011 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-bb6fc06c-fa97-47f3-9c5f-9d38b5f85355 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:25.573120 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6fc06c-fa97-47f3-9c5f-9d38b5f85355 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:25.591261 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124850b4-a877-42e5-bb0f-29749c3a23c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:25.594584 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124850b4-a877-42e5-bb0f-29749c3a23c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:25.594862 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124850b4-a877-42e5-bb0f-29749c3a23c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:25.595150 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124850b4-a877-42e5-bb0f-29749c3a23c9 admin admin] PATH_INFO: `/v3/users/7195793f260a45659c4c2ca5feb83928` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:25.597031 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124850b4-a877-42e5-bb0f-29749c3a23c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7195793f260a45659c4c2ca5feb83928)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:25.599846 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124850b4-a877-42e5-bb0f-29749c3a23c9 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:25.796180 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-124850b4-a877-42e5-bb0f-29749c3a23c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7195793f260a45659c4c2ca5feb83928'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:25.827846 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-124850b4-a877-42e5-bb0f-29749c3a23c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7195793f260a45659c4c2ca5feb83928'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:25.915095 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-124850b4-a877-42e5-bb0f-29749c3a23c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7195793f260a45659c4c2ca5feb83928'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:25.924828 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-124850b4-a877-42e5-bb0f-29749c3a23c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7195793f260a45659c4c2ca5feb83928'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:25.925647 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-124850b4-a877-42e5-bb0f-29749c3a23c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7195793f260a45659c4c2ca5feb83928'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:25.942836 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3461/6895] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:36:25 2022] DELETE /identity/v3/users/7195793f260a45659c4c2ca5feb83928 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:36:25.944867 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781bdfa-bc9f-4841-96b6-f8803ead2a1f None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:25.944867 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781bdfa-bc9f-4841-96b6-f8803ead2a1f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:25.945388 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8781bdfa-bc9f-4841-96b6-f8803ead2a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:25.968997 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-8781bdfa-bc9f-4841-96b6-f8803ead2a1f None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:25.970563 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8781bdfa-bc9f-4841-96b6-f8803ead2a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:26.038716 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3435/6896] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:36:26.091520 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124850b4-a877-42e5-bb0f-29749c3a23c9 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:26.093117 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-124850b4-a877-42e5-bb0f-29749c3a23c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:26.217892 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124850b4-a877-42e5-bb0f-29749c3a23c9 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:26.222893 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03326c-6334-47a0-a702-ad384a5f5952 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:26.224931 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03326c-6334-47a0-a702-ad384a5f5952 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:26.225422 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03326c-6334-47a0-a702-ad384a5f5952 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:26.225944 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03326c-6334-47a0-a702-ad384a5f5952 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:26.238713 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03326c-6334-47a0-a702-ad384a5f5952 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:26.240891 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03326c-6334-47a0-a702-ad384a5f5952 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:26.256301 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3462/6897] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:36:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:36:27.272197 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781bdfa-bc9f-4841-96b6-f8803ead2a1f None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:27.274602 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8781bdfa-bc9f-4841-96b6-f8803ead2a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:27.310125 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8781bdfa-bc9f-4841-96b6-f8803ead2a1f None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:27.323269 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aadc9f-e80f-4c01-b59b-7d5d80dfb883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:27.327625 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aadc9f-e80f-4c01-b59b-7d5d80dfb883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:27.328196 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aadc9f-e80f-4c01-b59b-7d5d80dfb883 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:27.328647 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aadc9f-e80f-4c01-b59b-7d5d80dfb883 admin admin] PATH_INFO: `/v3/projects/e755f57c175e43d7b08df778af0e3b04` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:27.331539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aadc9f-e80f-4c01-b59b-7d5d80dfb883 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e755f57c175e43d7b08df778af0e3b04)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:27.340054 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aadc9f-e80f-4c01-b59b-7d5d80dfb883 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:27.527579 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-88aadc9f-e80f-4c01-b59b-7d5d80dfb883 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e755f57c175e43d7b08df778af0e3b04', 'request_id': 'req-88aadc9f-e80f-4c01-b59b-7d5d80dfb883'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:27.542565 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-88aadc9f-e80f-4c01-b59b-7d5d80dfb883 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e755f57c175e43d7b08df778af0e3b04', 'request_id': 'req-88aadc9f-e80f-4c01-b59b-7d5d80dfb883'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:27.550981 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-88aadc9f-e80f-4c01-b59b-7d5d80dfb883 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e755f57c175e43d7b08df778af0e3b04', 'request_id': 'req-88aadc9f-e80f-4c01-b59b-7d5d80dfb883'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:27.663180 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-88aadc9f-e80f-4c01-b59b-7d5d80dfb883 admin admin] The token cache is being invalidate because project e755f57c175e43d7b08df778af0e3b04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:36:27.663637 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-88aadc9f-e80f-4c01-b59b-7d5d80dfb883 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:27.664562 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-88aadc9f-e80f-4c01-b59b-7d5d80dfb883 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:27.666837 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3436/6898] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:36:27 2022] DELETE /identity/v3/projects/e755f57c175e43d7b08df778af0e3b04 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:36:27.670647 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03326c-6334-47a0-a702-ad384a5f5952 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:27.681187 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03326c-6334-47a0-a702-ad384a5f5952 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:27.756000 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365666d6-b7a8-41af-bebd-cfcf33e4f639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:27.757472 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365666d6-b7a8-41af-bebd-cfcf33e4f639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:27.758450 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365666d6-b7a8-41af-bebd-cfcf33e4f639 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:27.758910 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365666d6-b7a8-41af-bebd-cfcf33e4f639 admin admin] PATH_INFO: `/v3/users/a42271c3474340efb8ea7eb7114a3033` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:27.760266 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365666d6-b7a8-41af-bebd-cfcf33e4f639 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a42271c3474340efb8ea7eb7114a3033)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:27.762329 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365666d6-b7a8-41af-bebd-cfcf33e4f639 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:28.011036 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-365666d6-b7a8-41af-bebd-cfcf33e4f639 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a42271c3474340efb8ea7eb7114a3033'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:28.023306 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-365666d6-b7a8-41af-bebd-cfcf33e4f639 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a42271c3474340efb8ea7eb7114a3033'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:28.115480 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-365666d6-b7a8-41af-bebd-cfcf33e4f639 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a42271c3474340efb8ea7eb7114a3033'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:28.126851 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-365666d6-b7a8-41af-bebd-cfcf33e4f639 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a42271c3474340efb8ea7eb7114a3033'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:28.129142 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-365666d6-b7a8-41af-bebd-cfcf33e4f639 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a42271c3474340efb8ea7eb7114a3033'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:28.139554 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3463/6899] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:36:27 2022] DELETE /identity/v3/users/a42271c3474340efb8ea7eb7114a3033 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:36:28.801041 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aadc9f-e80f-4c01-b59b-7d5d80dfb883 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:28.801041 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-88aadc9f-e80f-4c01-b59b-7d5d80dfb883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:28.821801 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aadc9f-e80f-4c01-b59b-7d5d80dfb883 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:28.950833 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf5a17-b309-4c5a-b261-1d63fecd37dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:28.951733 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf5a17-b309-4c5a-b261-1d63fecd37dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:28.952020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf5a17-b309-4c5a-b261-1d63fecd37dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:28.952298 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf5a17-b309-4c5a-b261-1d63fecd37dc admin admin] PATH_INFO: `/v3/projects/306169be24624972b5874cecf1b44d9a` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:28.953495 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf5a17-b309-4c5a-b261-1d63fecd37dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=306169be24624972b5874cecf1b44d9a)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:28.955574 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf5a17-b309-4c5a-b261-1d63fecd37dc admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:29.120487 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b0cf5a17-b309-4c5a-b261-1d63fecd37dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '306169be24624972b5874cecf1b44d9a', 'request_id': 'req-b0cf5a17-b309-4c5a-b261-1d63fecd37dc'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:29.138852 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b0cf5a17-b309-4c5a-b261-1d63fecd37dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '306169be24624972b5874cecf1b44d9a', 'request_id': 'req-b0cf5a17-b309-4c5a-b261-1d63fecd37dc'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:29.149655 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b0cf5a17-b309-4c5a-b261-1d63fecd37dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '306169be24624972b5874cecf1b44d9a', 'request_id': 'req-b0cf5a17-b309-4c5a-b261-1d63fecd37dc'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:29.287936 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b0cf5a17-b309-4c5a-b261-1d63fecd37dc admin admin] The token cache is being invalidate because project 306169be24624972b5874cecf1b44d9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:36:29.289217 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b0cf5a17-b309-4c5a-b261-1d63fecd37dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:29.290235 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b0cf5a17-b309-4c5a-b261-1d63fecd37dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:29.293865 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3437/6900] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:36:28 2022] DELETE /identity/v3/projects/306169be24624972b5874cecf1b44d9a => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:36:29.299572 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322ffa9-b17a-48b7-94d0-e55799e55ee8 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:29.300671 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322ffa9-b17a-48b7-94d0-e55799e55ee8 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:29.301001 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322ffa9-b17a-48b7-94d0-e55799e55ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:29.326076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-7322ffa9-b17a-48b7-94d0-e55799e55ee8 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:29.327611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7322ffa9-b17a-48b7-94d0-e55799e55ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:29.379634 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fb47f-15f6-467b-b723-92a11f8c1984 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:29.380307 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fb47f-15f6-467b-b723-92a11f8c1984 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:29.380816 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fb47f-15f6-467b-b723-92a11f8c1984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:29.411520 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-b17fb47f-15f6-467b-b723-92a11f8c1984 None None] MFA Rules not processed for user `3107c6d79451405a963c5816d92055b3`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:29.411520 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b17fb47f-15f6-467b-b723-92a11f8c1984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:29.517674 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3464/6901] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:36:29.523733 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c356b-fa6f-4f32-84d0-629db6a764e7 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:29.523919 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c356b-fa6f-4f32-84d0-629db6a764e7 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:29.526270 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c356b-fa6f-4f32-84d0-629db6a764e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:29.572534 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3438/6902] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:29 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:36:29.577825 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-121c356b-fa6f-4f32-84d0-629db6a764e7 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:29.577825 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-121c356b-fa6f-4f32-84d0-629db6a764e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:29.589749 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3465/6903] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:36:29.591138 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17fb47f-15f6-467b-b723-92a11f8c1984 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:29.611249 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17fb47f-15f6-467b-b723-92a11f8c1984 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:29.634383 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97a21d-646d-4d05-b68d-62316bf860d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:29.634383 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97a21d-646d-4d05-b68d-62316bf860d5 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:29.634383 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97a21d-646d-4d05-b68d-62316bf860d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:29.634808 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97a21d-646d-4d05-b68d-62316bf860d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:29.638217 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c97a21d-646d-4d05-b68d-62316bf860d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:36:29.638571 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c97a21d-646d-4d05-b68d-62316bf860d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:29.644825 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c97a21d-646d-4d05-b68d-62316bf860d5 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:29.691910 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3439/6904] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:36:29.693104 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c356b-fa6f-4f32-84d0-629db6a764e7 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:29.705704 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c356b-fa6f-4f32-84d0-629db6a764e7 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:29.711778 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01dc379-0406-4ff7-80d7-17c78c0b304a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:29.712575 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01dc379-0406-4ff7-80d7-17c78c0b304a admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:29.713051 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01dc379-0406-4ff7-80d7-17c78c0b304a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:29.713231 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01dc379-0406-4ff7-80d7-17c78c0b304a admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:29.714500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01dc379-0406-4ff7-80d7-17c78c0b304a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:29.716942 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01dc379-0406-4ff7-80d7-17c78c0b304a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:29.843680 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3466/6905] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:36:29 2022] POST /identity/v3/projects => generated 387 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:36:29.849733 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97a21d-646d-4d05-b68d-62316bf860d5 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:29.869526 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97a21d-646d-4d05-b68d-62316bf860d5 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:29.980727 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f38e2-b22b-4f7c-accb-fcb7de53cc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:29.981715 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f38e2-b22b-4f7c-accb-fcb7de53cc4f admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:29.982025 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f38e2-b22b-4f7c-accb-fcb7de53cc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:29.982671 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f38e2-b22b-4f7c-accb-fcb7de53cc4f admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:29.983655 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4f38e2-b22b-4f7c-accb-fcb7de53cc4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:29.986090 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4f38e2-b22b-4f7c-accb-fcb7de53cc4f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:30.079428 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3440/6906] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:36:29 2022] POST /identity/v3/users => generated 294 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:36:30.083016 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01dc379-0406-4ff7-80d7-17c78c0b304a admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:30.104336 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01dc379-0406-4ff7-80d7-17c78c0b304a admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:30.117066 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835d2e1-8195-41d6-a7b4-e2aa5f89ad9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:30.118485 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835d2e1-8195-41d6-a7b4-e2aa5f89ad9d admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:30.118485 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835d2e1-8195-41d6-a7b4-e2aa5f89ad9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:30.118833 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835d2e1-8195-41d6-a7b4-e2aa5f89ad9d admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:30.119730 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7835d2e1-8195-41d6-a7b4-e2aa5f89ad9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:30.121499 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7835d2e1-8195-41d6-a7b4-e2aa5f89ad9d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:30.157016 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3467/6907] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:36:30.159797 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f38e2-b22b-4f7c-accb-fcb7de53cc4f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:30.189563 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f38e2-b22b-4f7c-accb-fcb7de53cc4f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:30.189563 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d40e0f-84c2-4be2-9495-dbb07f5dfc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:30.189563 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d40e0f-84c2-4be2-9495-dbb07f5dfc70 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:30.189563 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d40e0f-84c2-4be2-9495-dbb07f5dfc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:30.190744 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d40e0f-84c2-4be2-9495-dbb07f5dfc70 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:30.195447 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d40e0f-84c2-4be2-9495-dbb07f5dfc70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:30.197553 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d40e0f-84c2-4be2-9495-dbb07f5dfc70 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:30.221410 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3441/6908] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:36:30.225337 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835d2e1-8195-41d6-a7b4-e2aa5f89ad9d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:30.238106 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835d2e1-8195-41d6-a7b4-e2aa5f89ad9d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:30.261409 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581ef40-4a84-4f28-bbb5-53fa12c1cc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:30.263006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581ef40-4a84-4f28-bbb5-53fa12c1cc12 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:30.263391 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581ef40-4a84-4f28-bbb5-53fa12c1cc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:30.263765 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581ef40-4a84-4f28-bbb5-53fa12c1cc12 admin admin] PATH_INFO: `/v3/projects/ae63aae880ee46f7839a0e268d0a3aef/users/1090c9d3b67248329aa35d8905355264/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:30.299899 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581ef40-4a84-4f28-bbb5-53fa12c1cc12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae63aae880ee46f7839a0e268d0a3aef, user_id=1090c9d3b67248329aa35d8905355264, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:30.305653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581ef40-4a84-4f28-bbb5-53fa12c1cc12 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:30.401023 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78350537-305f-46ed-8d2b-fc32cb24333b None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:30.401365 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78350537-305f-46ed-8d2b-fc32cb24333b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:30.402286 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78350537-305f-46ed-8d2b-fc32cb24333b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:30.403224 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3468/6909] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:36:30 2022] PUT /identity/v3/projects/ae63aae880ee46f7839a0e268d0a3aef/users/1090c9d3b67248329aa35d8905355264/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:36:30.459658 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-78350537-305f-46ed-8d2b-fc32cb24333b None None] MFA Rules not processed for user `1090c9d3b67248329aa35d8905355264`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:30.460882 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-78350537-305f-46ed-8d2b-fc32cb24333b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:30.608843 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3442/6910] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:36:30.614684 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581ef40-4a84-4f28-bbb5-53fa12c1cc12 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:30.751085 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581ef40-4a84-4f28-bbb5-53fa12c1cc12 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:30.756647 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b9614-4e7e-497b-92ee-193040e9f143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:30.757451 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b9614-4e7e-497b-92ee-193040e9f143 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:30.758068 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b9614-4e7e-497b-92ee-193040e9f143 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:30.758250 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b9614-4e7e-497b-92ee-193040e9f143 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:30.759035 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b9614-4e7e-497b-92ee-193040e9f143 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:30.761105 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b9614-4e7e-497b-92ee-193040e9f143 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:30.926716 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3469/6911] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:36:30 2022] POST /identity/v3/projects => generated 385 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:36:30.927770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78350537-305f-46ed-8d2b-fc32cb24333b None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:30.948271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78350537-305f-46ed-8d2b-fc32cb24333b None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:31.095700 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd654c9-b93a-4817-b115-76b558c03631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:31.096603 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd654c9-b93a-4817-b115-76b558c03631 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:31.096894 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd654c9-b93a-4817-b115-76b558c03631 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:31.097169 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd654c9-b93a-4817-b115-76b558c03631 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:31.097900 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd654c9-b93a-4817-b115-76b558c03631 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:31.100430 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd654c9-b93a-4817-b115-76b558c03631 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:31.309805 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3443/6912] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:36:30 2022] POST /identity/v3/users => generated 299 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:36:31.313669 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b9614-4e7e-497b-92ee-193040e9f143 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:31.329787 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b9614-4e7e-497b-92ee-193040e9f143 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:31.350733 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d20340b-ebbf-4d56-807d-cea1f1847af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:31.352371 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20340b-ebbf-4d56-807d-cea1f1847af9 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:31.352741 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20340b-ebbf-4d56-807d-cea1f1847af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:31.353960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20340b-ebbf-4d56-807d-cea1f1847af9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:31.361449 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d20340b-ebbf-4d56-807d-cea1f1847af9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:31.361449 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d20340b-ebbf-4d56-807d-cea1f1847af9 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:31.396914 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3470/6913] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:36:31.397629 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd654c9-b93a-4817-b115-76b558c03631 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:31.416088 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd654c9-b93a-4817-b115-76b558c03631 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:31.423113 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d059d-050f-4229-8568-023ccdbd17fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:31.427134 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d059d-050f-4229-8568-023ccdbd17fc admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:31.428563 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d059d-050f-4229-8568-023ccdbd17fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:31.429163 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d059d-050f-4229-8568-023ccdbd17fc admin admin] PATH_INFO: `/v3/projects/143bd17416cd4558b2cfb3aa696cfd46/users/7cb61f35f7d14c9490acc0c5da1821f8/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:31.452394 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4d059d-050f-4229-8568-023ccdbd17fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=143bd17416cd4558b2cfb3aa696cfd46, user_id=7cb61f35f7d14c9490acc0c5da1821f8, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:31.457562 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4d059d-050f-4229-8568-023ccdbd17fc admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:31.563872 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3444/6914] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:36:31 2022] PUT /identity/v3/projects/143bd17416cd4558b2cfb3aa696cfd46/users/7cb61f35f7d14c9490acc0c5da1821f8/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:36:31.569148 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d20340b-ebbf-4d56-807d-cea1f1847af9 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:31.589744 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d20340b-ebbf-4d56-807d-cea1f1847af9 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:31.726165 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60330fcb-8dae-41dd-bb45-fa6674d22839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:31.727442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60330fcb-8dae-41dd-bb45-fa6674d22839 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:31.728638 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60330fcb-8dae-41dd-bb45-fa6674d22839 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:31.729106 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60330fcb-8dae-41dd-bb45-fa6674d22839 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:31.730415 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60330fcb-8dae-41dd-bb45-fa6674d22839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:31.732974 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60330fcb-8dae-41dd-bb45-fa6674d22839 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:31.749895 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3471/6915] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:36:31.751401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d059d-050f-4229-8568-023ccdbd17fc admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:31.773411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d059d-050f-4229-8568-023ccdbd17fc admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:31.791189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f043e8c-c848-4a18-b70d-ddecf50f88a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:31.793058 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f043e8c-c848-4a18-b70d-ddecf50f88a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:31.793584 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f043e8c-c848-4a18-b70d-ddecf50f88a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:31.793922 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f043e8c-c848-4a18-b70d-ddecf50f88a1 admin admin] PATH_INFO: `/v3/projects/143bd17416cd4558b2cfb3aa696cfd46/users/7cb61f35f7d14c9490acc0c5da1821f8/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:31.796222 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f043e8c-c848-4a18-b70d-ddecf50f88a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=143bd17416cd4558b2cfb3aa696cfd46, user_id=7cb61f35f7d14c9490acc0c5da1821f8, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:31.800667 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f043e8c-c848-4a18-b70d-ddecf50f88a1 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:31.815241 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3445/6916] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:36:31 2022] PUT /identity/v3/projects/143bd17416cd4558b2cfb3aa696cfd46/users/7cb61f35f7d14c9490acc0c5da1821f8/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:36:31.826919 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8b4c9-3217-4166-b2b6-138aa0a843d8 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:31.828030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8b4c9-3217-4166-b2b6-138aa0a843d8 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:31.828482 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8b4c9-3217-4166-b2b6-138aa0a843d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:31.864858 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-b7b8b4c9-3217-4166-b2b6-138aa0a843d8 None None] MFA Rules not processed for user `7cb61f35f7d14c9490acc0c5da1821f8`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:31.868424 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b7b8b4c9-3217-4166-b2b6-138aa0a843d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:31.976905 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3472/6917] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:36:32.000779 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f043e8c-c848-4a18-b70d-ddecf50f88a1 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:32.004517 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3f043e8c-c848-4a18-b70d-ddecf50f88a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:32.156941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f043e8c-c848-4a18-b70d-ddecf50f88a1 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:32.165127 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e1a667-cc67-4886-9f77-7feebdfdd7f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:32.166173 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1a667-cc67-4886-9f77-7feebdfdd7f8 service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:32.166562 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1a667-cc67-4886-9f77-7feebdfdd7f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:32.167319 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1a667-cc67-4886-9f77-7feebdfdd7f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:32.194282 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e1a667-cc67-4886-9f77-7feebdfdd7f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:32.199252 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e1a667-cc67-4886-9f77-7feebdfdd7f8 service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:32.223622 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3446/6918] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:36:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:36:32.314162 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8b4c9-3217-4166-b2b6-138aa0a843d8 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:32.474512 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8b4c9-3217-4166-b2b6-138aa0a843d8 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:32.492036 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccba8f6-8423-4c7e-aa89-24b0548fff06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:32.492934 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccba8f6-8423-4c7e-aa89-24b0548fff06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:32.493216 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccba8f6-8423-4c7e-aa89-24b0548fff06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:32.493493 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccba8f6-8423-4c7e-aa89-24b0548fff06 admin admin] PATH_INFO: `/v3/users/1090c9d3b67248329aa35d8905355264` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:32.495391 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccba8f6-8423-4c7e-aa89-24b0548fff06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1090c9d3b67248329aa35d8905355264)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:32.499225 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccba8f6-8423-4c7e-aa89-24b0548fff06 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:32.840179 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9ccba8f6-8423-4c7e-aa89-24b0548fff06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1090c9d3b67248329aa35d8905355264'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:32.855197 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e1a667-cc67-4886-9f77-7feebdfdd7f8 service cinder] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:32.857537 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f5e1a667-cc67-4886-9f77-7feebdfdd7f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:32.858628 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9ccba8f6-8423-4c7e-aa89-24b0548fff06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1090c9d3b67248329aa35d8905355264'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:32.886021 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e1a667-cc67-4886-9f77-7feebdfdd7f8 service cinder] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:32.891161 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd885b4-4aa0-43c0-a983-a70464adcb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:32.892199 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd885b4-4aa0-43c0-a983-a70464adcb4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:32.892501 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd885b4-4aa0-43c0-a983-a70464adcb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:32.893395 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd885b4-4aa0-43c0-a983-a70464adcb4d admin admin] PATH_INFO: `/v3/users/7757dd58d9db44f89d86bf2217719d09` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:32.894739 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd885b4-4aa0-43c0-a983-a70464adcb4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7757dd58d9db44f89d86bf2217719d09)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:32.897114 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd885b4-4aa0-43c0-a983-a70464adcb4d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:32.943327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9ccba8f6-8423-4c7e-aa89-24b0548fff06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1090c9d3b67248329aa35d8905355264'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:32.952564 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9ccba8f6-8423-4c7e-aa89-24b0548fff06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1090c9d3b67248329aa35d8905355264'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:32.955299 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9ccba8f6-8423-4c7e-aa89-24b0548fff06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1090c9d3b67248329aa35d8905355264'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:32.972484 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3473/6919] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:36:32 2022] DELETE /identity/v3/users/1090c9d3b67248329aa35d8905355264 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:36:32.978356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420fc19-9041-4048-aa7e-db8e77f2a80f None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:32.978812 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420fc19-9041-4048-aa7e-db8e77f2a80f None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:32.979210 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420fc19-9041-4048-aa7e-db8e77f2a80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:33.014511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-f420fc19-9041-4048-aa7e-db8e77f2a80f None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:33.016466 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f420fc19-9041-4048-aa7e-db8e77f2a80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:33.137386 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3fd885b4-4aa0-43c0-a983-a70464adcb4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7757dd58d9db44f89d86bf2217719d09'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:33.199488 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3fd885b4-4aa0-43c0-a983-a70464adcb4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7757dd58d9db44f89d86bf2217719d09'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:33.245893 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3474/6920] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:36:33.271147 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420fc19-9041-4048-aa7e-db8e77f2a80f None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:33.272838 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f420fc19-9041-4048-aa7e-db8e77f2a80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:33.291792 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3fd885b4-4aa0-43c0-a983-a70464adcb4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7757dd58d9db44f89d86bf2217719d09'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:33.293581 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3fd885b4-4aa0-43c0-a983-a70464adcb4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7757dd58d9db44f89d86bf2217719d09'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:33.306704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3fd885b4-4aa0-43c0-a983-a70464adcb4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7757dd58d9db44f89d86bf2217719d09'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:33.316740 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3447/6921] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:36:32 2022] DELETE /identity/v3/users/7757dd58d9db44f89d86bf2217719d09 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:36:33.322717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f9b00-cbed-4ebf-b5a7-3660f3c016d5 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:33.323018 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f9b00-cbed-4ebf-b5a7-3660f3c016d5 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:33.323299 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f9b00-cbed-4ebf-b5a7-3660f3c016d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:33.343203 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-754f9b00-cbed-4ebf-b5a7-3660f3c016d5 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:33.344457 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-754f9b00-cbed-4ebf-b5a7-3660f3c016d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:33.360067 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420fc19-9041-4048-aa7e-db8e77f2a80f None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:33.413016 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3448/6922] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:36:33.422871 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f9b00-cbed-4ebf-b5a7-3660f3c016d5 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:33.424635 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-754f9b00-cbed-4ebf-b5a7-3660f3c016d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:33.426868 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b16c68c-5a62-4d90-9160-bb5afb90423b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:33.427522 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16c68c-5a62-4d90-9160-bb5afb90423b service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:33.427919 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16c68c-5a62-4d90-9160-bb5afb90423b service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:33.428198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16c68c-5a62-4d90-9160-bb5afb90423b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:33.430069 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6b16c68c-5a62-4d90-9160-bb5afb90423b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:33.445851 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f9b00-cbed-4ebf-b5a7-3660f3c016d5 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:33.446077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b16c68c-5a62-4d90-9160-bb5afb90423b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:33.446186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b16c68c-5a62-4d90-9160-bb5afb90423b service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:33.447044 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8289a-3dc0-44ff-b8b3-d6cabb9ecdd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:33.447833 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8289a-3dc0-44ff-b8b3-d6cabb9ecdd8 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:33.448122 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8289a-3dc0-44ff-b8b3-d6cabb9ecdd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:33.448398 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8289a-3dc0-44ff-b8b3-d6cabb9ecdd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:33.460161 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf8289a-3dc0-44ff-b8b3-d6cabb9ecdd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:33.461041 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf8289a-3dc0-44ff-b8b3-d6cabb9ecdd8 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:33.463668 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3475/6923] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:36:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:36:33.472674 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3449/6924] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:36:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:36:33.937399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b16c68c-5a62-4d90-9160-bb5afb90423b service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:33.938925 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6b16c68c-5a62-4d90-9160-bb5afb90423b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:33.951160 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b16c68c-5a62-4d90-9160-bb5afb90423b service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:33.956226 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5616f-325f-4ec3-97cd-bbcce77e287e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:33.957093 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5616f-325f-4ec3-97cd-bbcce77e287e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:33.957864 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5616f-325f-4ec3-97cd-bbcce77e287e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:33.957864 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5616f-325f-4ec3-97cd-bbcce77e287e admin admin] PATH_INFO: `/v3/projects/280a6ce7a084421bbd267c7ac5c907ca` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:33.958860 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c5616f-325f-4ec3-97cd-bbcce77e287e admin admin] RBAC: Authorizing `identity:delete_project(project_id=280a6ce7a084421bbd267c7ac5c907ca)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:33.960781 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c5616f-325f-4ec3-97cd-bbcce77e287e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:34.075400 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f2c5616f-325f-4ec3-97cd-bbcce77e287e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '280a6ce7a084421bbd267c7ac5c907ca', 'request_id': 'req-f2c5616f-325f-4ec3-97cd-bbcce77e287e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:34.082535 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f2c5616f-325f-4ec3-97cd-bbcce77e287e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '280a6ce7a084421bbd267c7ac5c907ca', 'request_id': 'req-f2c5616f-325f-4ec3-97cd-bbcce77e287e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:34.089127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f2c5616f-325f-4ec3-97cd-bbcce77e287e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '280a6ce7a084421bbd267c7ac5c907ca', 'request_id': 'req-f2c5616f-325f-4ec3-97cd-bbcce77e287e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:34.178322 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f2c5616f-325f-4ec3-97cd-bbcce77e287e admin admin] The token cache is being invalidate because project 280a6ce7a084421bbd267c7ac5c907ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:36:34.178661 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f2c5616f-325f-4ec3-97cd-bbcce77e287e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:34.179265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f2c5616f-325f-4ec3-97cd-bbcce77e287e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:34.181101 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3476/6925] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:36:33 2022] DELETE /identity/v3/projects/280a6ce7a084421bbd267c7ac5c907ca => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:36:34.186305 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfcd961-63f8-46d3-8fce-3850b8a338f8 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:34.186858 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfcd961-63f8-46d3-8fce-3850b8a338f8 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:34.186858 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfcd961-63f8-46d3-8fce-3850b8a338f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:34.208679 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-cbfcd961-63f8-46d3-8fce-3850b8a338f8 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:34.209948 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-cbfcd961-63f8-46d3-8fce-3850b8a338f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:34.311960 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3450/6926] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:36:34.322016 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb5677-3b0d-4221-b205-f221760d3b1c None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:34.326443 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb5677-3b0d-4221-b205-f221760d3b1c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:34.326443 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb5677-3b0d-4221-b205-f221760d3b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:34.362378 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-3bdb5677-3b0d-4221-b205-f221760d3b1c None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:34.365592 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3bdb5677-3b0d-4221-b205-f221760d3b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:34.375310 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3477/6927] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:36:34.383686 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfcd961-63f8-46d3-8fce-3850b8a338f8 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:34.398584 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfcd961-63f8-46d3-8fce-3850b8a338f8 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:34.406544 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f706521-957e-4947-9a12-6023127095ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:34.413086 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f706521-957e-4947-9a12-6023127095ae admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:34.413086 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f706521-957e-4947-9a12-6023127095ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:34.413086 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f706521-957e-4947-9a12-6023127095ae admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:34.413086 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f706521-957e-4947-9a12-6023127095ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:36:34.413086 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f706521-957e-4947-9a12-6023127095ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:34.413086 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f706521-957e-4947-9a12-6023127095ae admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:34.425683 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3451/6928] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:36:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:36:34.438856 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb5677-3b0d-4221-b205-f221760d3b1c None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:34.452807 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb5677-3b0d-4221-b205-f221760d3b1c None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:34.463697 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42e14c-7727-4105-a18c-a1d5c8158db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:34.465108 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42e14c-7727-4105-a18c-a1d5c8158db1 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:34.465620 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42e14c-7727-4105-a18c-a1d5c8158db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:34.466630 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42e14c-7727-4105-a18c-a1d5c8158db1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:34.467662 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42e14c-7727-4105-a18c-a1d5c8158db1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:34.480022 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42e14c-7727-4105-a18c-a1d5c8158db1 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:34.549202 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f706521-957e-4947-9a12-6023127095ae admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:34.551107 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8f706521-957e-4947-9a12-6023127095ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:34.565579 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f706521-957e-4947-9a12-6023127095ae admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:34.571824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52e8ec-4c27-4a9a-93eb-811ee7288fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:34.572781 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52e8ec-4c27-4a9a-93eb-811ee7288fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:34.573330 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52e8ec-4c27-4a9a-93eb-811ee7288fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:34.575056 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52e8ec-4c27-4a9a-93eb-811ee7288fa9 admin admin] PATH_INFO: `/v3/projects/ae63aae880ee46f7839a0e268d0a3aef` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:34.586079 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52e8ec-4c27-4a9a-93eb-811ee7288fa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae63aae880ee46f7839a0e268d0a3aef)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:34.589530 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52e8ec-4c27-4a9a-93eb-811ee7288fa9 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:34.600912 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3478/6929] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:36:34 2022] POST /identity/v3/projects => generated 369 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:36:34.604949 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42e14c-7727-4105-a18c-a1d5c8158db1 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:34.697873 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42e14c-7727-4105-a18c-a1d5c8158db1 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:34.713578 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5b52e8ec-4c27-4a9a-93eb-811ee7288fa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae63aae880ee46f7839a0e268d0a3aef', 'request_id': 'req-5b52e8ec-4c27-4a9a-93eb-811ee7288fa9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:34.719630 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5b52e8ec-4c27-4a9a-93eb-811ee7288fa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae63aae880ee46f7839a0e268d0a3aef', 'request_id': 'req-5b52e8ec-4c27-4a9a-93eb-811ee7288fa9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:34.733574 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5b52e8ec-4c27-4a9a-93eb-811ee7288fa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae63aae880ee46f7839a0e268d0a3aef', 'request_id': 'req-5b52e8ec-4c27-4a9a-93eb-811ee7288fa9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:34.790149 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091e730-b6b0-4465-a9e3-5aee3479b15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:34.790919 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091e730-b6b0-4465-a9e3-5aee3479b15a admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:34.791309 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091e730-b6b0-4465-a9e3-5aee3479b15a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:34.791748 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091e730-b6b0-4465-a9e3-5aee3479b15a admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:34.792552 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091e730-b6b0-4465-a9e3-5aee3479b15a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:34.795575 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091e730-b6b0-4465-a9e3-5aee3479b15a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:34.863822 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5b52e8ec-4c27-4a9a-93eb-811ee7288fa9 admin admin] The token cache is being invalidate because project ae63aae880ee46f7839a0e268d0a3aef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:36:34.864162 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5b52e8ec-4c27-4a9a-93eb-811ee7288fa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:34.864945 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5b52e8ec-4c27-4a9a-93eb-811ee7288fa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:34.868036 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3452/6930] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:36:34 2022] DELETE /identity/v3/projects/ae63aae880ee46f7839a0e268d0a3aef => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:36:34.872524 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52e8ec-4c27-4a9a-93eb-811ee7288fa9 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:34.876476 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5b52e8ec-4c27-4a9a-93eb-811ee7288fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:34.897634 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52e8ec-4c27-4a9a-93eb-811ee7288fa9 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:34.905006 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e872a-c1fa-4503-8917-648b0008d899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:34.906038 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e872a-c1fa-4503-8917-648b0008d899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:34.906330 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e872a-c1fa-4503-8917-648b0008d899 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:34.906629 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e872a-c1fa-4503-8917-648b0008d899 admin admin] PATH_INFO: `/v3/users/7cb61f35f7d14c9490acc0c5da1821f8` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:34.908918 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e872a-c1fa-4503-8917-648b0008d899 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cb61f35f7d14c9490acc0c5da1821f8)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:34.911280 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e872a-c1fa-4503-8917-648b0008d899 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:34.952104 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3479/6931] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:36:34 2022] POST /identity/v3/users => generated 285 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:36:34.956632 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091e730-b6b0-4465-a9e3-5aee3479b15a admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:34.958626 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e091e730-b6b0-4465-a9e3-5aee3479b15a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:34.972871 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091e730-b6b0-4465-a9e3-5aee3479b15a admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:34.980159 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d814647c-7090-4f95-8133-01153457ed4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:34.980914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814647c-7090-4f95-8133-01153457ed4f admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:34.981312 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814647c-7090-4f95-8133-01153457ed4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:34.981725 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814647c-7090-4f95-8133-01153457ed4f admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:34.982598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d814647c-7090-4f95-8133-01153457ed4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:34.994181 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d814647c-7090-4f95-8133-01153457ed4f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:35.000760 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3480/6932] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:36:35.005440 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d814647c-7090-4f95-8133-01153457ed4f admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:35.020987 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d814647c-7090-4f95-8133-01153457ed4f admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:35.026506 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2af5d-c565-4799-8259-51dca028fe5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:35.027204 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2af5d-c565-4799-8259-51dca028fe5d admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:35.027538 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2af5d-c565-4799-8259-51dca028fe5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:35.027820 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2af5d-c565-4799-8259-51dca028fe5d admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:35.028557 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f2af5d-c565-4799-8259-51dca028fe5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:35.030373 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f2af5d-c565-4799-8259-51dca028fe5d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:35.052279 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3481/6933] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:36:35.060112 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2af5d-c565-4799-8259-51dca028fe5d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:35.076107 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2af5d-c565-4799-8259-51dca028fe5d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:35.083041 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12244210-8782-4208-ab26-25e09975a4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:35.084110 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12244210-8782-4208-ab26-25e09975a4c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:35.084416 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12244210-8782-4208-ab26-25e09975a4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:35.084684 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12244210-8782-4208-ab26-25e09975a4c9 admin admin] PATH_INFO: `/v3/projects/d24ab3357252430bb71551114c9bf7a3/users/06938e94defa4e68b43b0ea0477b8995/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:35.119624 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12244210-8782-4208-ab26-25e09975a4c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d24ab3357252430bb71551114c9bf7a3, user_id=06938e94defa4e68b43b0ea0477b8995, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:35.122376 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12244210-8782-4208-ab26-25e09975a4c9 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:35.186891 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-601e872a-c1fa-4503-8917-648b0008d899 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cb61f35f7d14c9490acc0c5da1821f8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:35.225218 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-601e872a-c1fa-4503-8917-648b0008d899 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cb61f35f7d14c9490acc0c5da1821f8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:35.225444 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3482/6934] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:36:35 2022] PUT /identity/v3/projects/d24ab3357252430bb71551114c9bf7a3/users/06938e94defa4e68b43b0ea0477b8995/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:36:35.238291 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783f257-aaa7-4a56-9608-4794ee3ad67d None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:35.238654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783f257-aaa7-4a56-9608-4794ee3ad67d None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:35.238855 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783f257-aaa7-4a56-9608-4794ee3ad67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:35.289641 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-f783f257-aaa7-4a56-9608-4794ee3ad67d None None] MFA Rules not processed for user `06938e94defa4e68b43b0ea0477b8995`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:35.290314 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f783f257-aaa7-4a56-9608-4794ee3ad67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:35.350174 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-601e872a-c1fa-4503-8917-648b0008d899 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cb61f35f7d14c9490acc0c5da1821f8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:35.350174 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-601e872a-c1fa-4503-8917-648b0008d899 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cb61f35f7d14c9490acc0c5da1821f8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:35.360671 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-601e872a-c1fa-4503-8917-648b0008d899 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cb61f35f7d14c9490acc0c5da1821f8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:35.374027 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3453/6935] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:36:34 2022] DELETE /identity/v3/users/7cb61f35f7d14c9490acc0c5da1821f8 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:36:35.404203 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3483/6936] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:35 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:36:35.419445 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e872a-c1fa-4503-8917-648b0008d899 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:35.420874 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-601e872a-c1fa-4503-8917-648b0008d899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:35.525744 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e872a-c1fa-4503-8917-648b0008d899 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:35.531953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d3284-1284-4371-98f9-eaebc318db67 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e302b1298dd04d6590e3d079f7b13b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:35.532627 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d3284-1284-4371-98f9-eaebc318db67 service glance] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:35.532972 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d3284-1284-4371-98f9-eaebc318db67 service glance] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:35.534592 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d3284-1284-4371-98f9-eaebc318db67 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:35.630732 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65d3284-1284-4371-98f9-eaebc318db67 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:35.632356 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65d3284-1284-4371-98f9-eaebc318db67 service glance] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:35.642126 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3454/6937] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:36:35 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:36:36.477923 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f783f257-aaa7-4a56-9608-4794ee3ad67d None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:36.482148 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f783f257-aaa7-4a56-9608-4794ee3ad67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:36.633500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f783f257-aaa7-4a56-9608-4794ee3ad67d None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:36.780592 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42d098-d8e7-42d4-b4b4-84f5b3172cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:36.781490 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42d098-d8e7-42d4-b4b4-84f5b3172cf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:36.781946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42d098-d8e7-42d4-b4b4-84f5b3172cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:36.782233 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42d098-d8e7-42d4-b4b4-84f5b3172cf9 admin admin] PATH_INFO: `/v3/projects/143bd17416cd4558b2cfb3aa696cfd46` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:36.791594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc42d098-d8e7-42d4-b4b4-84f5b3172cf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=143bd17416cd4558b2cfb3aa696cfd46)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:36.796200 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc42d098-d8e7-42d4-b4b4-84f5b3172cf9 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:37.040492 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cc42d098-d8e7-42d4-b4b4-84f5b3172cf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '143bd17416cd4558b2cfb3aa696cfd46', 'request_id': 'req-cc42d098-d8e7-42d4-b4b4-84f5b3172cf9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:37.053817 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cc42d098-d8e7-42d4-b4b4-84f5b3172cf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '143bd17416cd4558b2cfb3aa696cfd46', 'request_id': 'req-cc42d098-d8e7-42d4-b4b4-84f5b3172cf9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:37.062609 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cc42d098-d8e7-42d4-b4b4-84f5b3172cf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '143bd17416cd4558b2cfb3aa696cfd46', 'request_id': 'req-cc42d098-d8e7-42d4-b4b4-84f5b3172cf9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:37.137893 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cc42d098-d8e7-42d4-b4b4-84f5b3172cf9 admin admin] The token cache is being invalidate because project 143bd17416cd4558b2cfb3aa696cfd46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:36:37.138192 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cc42d098-d8e7-42d4-b4b4-84f5b3172cf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:37.139832 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cc42d098-d8e7-42d4-b4b4-84f5b3172cf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:37.143545 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3484/6938] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:36:36 2022] DELETE /identity/v3/projects/143bd17416cd4558b2cfb3aa696cfd46 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:36:37.148636 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ad1d2-96b1-49ee-81b5-3d5786c3cb5c None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:37.149459 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ad1d2-96b1-49ee-81b5-3d5786c3cb5c None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:37.149744 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ad1d2-96b1-49ee-81b5-3d5786c3cb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:37.209277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-291ad1d2-96b1-49ee-81b5-3d5786c3cb5c None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:37.210570 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-291ad1d2-96b1-49ee-81b5-3d5786c3cb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:37.316571 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3455/6939] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:36:37.324219 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a190f9-c38c-4dd7-a5c5-aa6ae33184ee None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:37.324595 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a190f9-c38c-4dd7-a5c5-aa6ae33184ee None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:37.324951 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a190f9-c38c-4dd7-a5c5-aa6ae33184ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:37.373664 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-84a190f9-c38c-4dd7-a5c5-aa6ae33184ee None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:37.378256 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-84a190f9-c38c-4dd7-a5c5-aa6ae33184ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:37.404093 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3485/6940] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:36:37.408974 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ad1d2-96b1-49ee-81b5-3d5786c3cb5c None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:37.436545 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ad1d2-96b1-49ee-81b5-3d5786c3cb5c None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:37.452318 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad239b-87ee-4e15-a16a-a07258db2006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:37.453338 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad239b-87ee-4e15-a16a-a07258db2006 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:37.454161 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad239b-87ee-4e15-a16a-a07258db2006 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:37.454875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad239b-87ee-4e15-a16a-a07258db2006 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:37.456504 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ad239b-87ee-4e15-a16a-a07258db2006 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:36:37.458115 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ad239b-87ee-4e15-a16a-a07258db2006 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:37.463669 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ad239b-87ee-4e15-a16a-a07258db2006 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:37.490444 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3456/6941] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:36:37.490758 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a190f9-c38c-4dd7-a5c5-aa6ae33184ee None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:37.499656 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a190f9-c38c-4dd7-a5c5-aa6ae33184ee None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:37.506098 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def0db4-9df6-469e-9224-a982ecf575d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:37.506971 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def0db4-9df6-469e-9224-a982ecf575d3 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:37.507625 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def0db4-9df6-469e-9224-a982ecf575d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:37.508072 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def0db4-9df6-469e-9224-a982ecf575d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:37.508957 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def0db4-9df6-469e-9224-a982ecf575d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:37.511085 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def0db4-9df6-469e-9224-a982ecf575d3 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:37.679653 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3486/6942] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:36:37 2022] POST /identity/v3/projects => generated 377 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:36:37.684678 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad239b-87ee-4e15-a16a-a07258db2006 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:37.713731 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad239b-87ee-4e15-a16a-a07258db2006 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:37.946072 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9836101-c009-45df-aa0d-094955f11f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:37.946851 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9836101-c009-45df-aa0d-094955f11f19 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:37.957142 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9836101-c009-45df-aa0d-094955f11f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:37.957565 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9836101-c009-45df-aa0d-094955f11f19 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:37.958361 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9836101-c009-45df-aa0d-094955f11f19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:37.962866 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9836101-c009-45df-aa0d-094955f11f19 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:38.092643 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3457/6943] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:36:37 2022] POST /identity/v3/users => generated 289 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:36:38.097830 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def0db4-9df6-469e-9224-a982ecf575d3 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:38.122370 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def0db4-9df6-469e-9224-a982ecf575d3 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:38.154588 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c736c6-ce8f-4d4f-ac07-f6b58c840fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:38.163781 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c736c6-ce8f-4d4f-ac07-f6b58c840fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:38.164681 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c736c6-ce8f-4d4f-ac07-f6b58c840fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:38.165153 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c736c6-ce8f-4d4f-ac07-f6b58c840fa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:38.169432 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c736c6-ce8f-4d4f-ac07-f6b58c840fa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:38.171768 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c736c6-ce8f-4d4f-ac07-f6b58c840fa3 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:38.225941 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3487/6944] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:36:38.226921 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9836101-c009-45df-aa0d-094955f11f19 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:38.252719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9836101-c009-45df-aa0d-094955f11f19 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:38.275472 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8fe0e7-220f-43a2-be7a-d2754422eb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:38.277883 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fe0e7-220f-43a2-be7a-d2754422eb35 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:38.278246 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fe0e7-220f-43a2-be7a-d2754422eb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:38.278604 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fe0e7-220f-43a2-be7a-d2754422eb35 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:38.284680 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8fe0e7-220f-43a2-be7a-d2754422eb35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:38.286566 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8fe0e7-220f-43a2-be7a-d2754422eb35 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:38.313822 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3458/6945] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:36:38.319892 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c736c6-ce8f-4d4f-ac07-f6b58c840fa3 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:38.339919 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c736c6-ce8f-4d4f-ac07-f6b58c840fa3 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:38.356061 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48017a4-94af-4c9e-8373-caf12c09f9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:38.357809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48017a4-94af-4c9e-8373-caf12c09f9bb admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:38.363730 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48017a4-94af-4c9e-8373-caf12c09f9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:38.364456 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48017a4-94af-4c9e-8373-caf12c09f9bb admin admin] PATH_INFO: `/v3/projects/66982596ce804354884463ff7cd4c08b/users/eea928c0944b4ff3ac23f102bf0d2a69/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:38.387439 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48017a4-94af-4c9e-8373-caf12c09f9bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=66982596ce804354884463ff7cd4c08b, user_id=eea928c0944b4ff3ac23f102bf0d2a69, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:38.398147 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48017a4-94af-4c9e-8373-caf12c09f9bb admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:38.464138 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3488/6946] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:36:38 2022] PUT /identity/v3/projects/66982596ce804354884463ff7cd4c08b/users/eea928c0944b4ff3ac23f102bf0d2a69/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:36:38.477478 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9d412-68c0-4cc9-be8c-42c412b7e53f None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:38.477939 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9d412-68c0-4cc9-be8c-42c412b7e53f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:38.478296 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9d412-68c0-4cc9-be8c-42c412b7e53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:38.506784 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-9ec9d412-68c0-4cc9-be8c-42c412b7e53f None None] MFA Rules not processed for user `eea928c0944b4ff3ac23f102bf0d2a69`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:38.508110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-9ec9d412-68c0-4cc9-be8c-42c412b7e53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:38.625454 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3459/6947] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:36:38.629918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48017a4-94af-4c9e-8373-caf12c09f9bb admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:38.701901 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9d412-68c0-4cc9-be8c-42c412b7e53f None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:38.708158 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-9ec9d412-68c0-4cc9-be8c-42c412b7e53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:38.722306 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48017a4-94af-4c9e-8373-caf12c09f9bb admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:38.726249 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9d412-68c0-4cc9-be8c-42c412b7e53f None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:38.732519 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95455a3f-c03b-49a1-aef3-0341b6537382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:38.734235 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95455a3f-c03b-49a1-aef3-0341b6537382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:38.737160 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95455a3f-c03b-49a1-aef3-0341b6537382 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:38.737160 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95455a3f-c03b-49a1-aef3-0341b6537382 admin admin] PATH_INFO: `/v3/users/5ee252de0fb74adda84ee09c01e84eeb` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:38.737385 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658912d2-9068-40fa-866d-ba1fb77e2be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:38.738005 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658912d2-9068-40fa-866d-ba1fb77e2be2 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:38.738129 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95455a3f-c03b-49a1-aef3-0341b6537382 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ee252de0fb74adda84ee09c01e84eeb)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:38.738612 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658912d2-9068-40fa-866d-ba1fb77e2be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:38.738894 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658912d2-9068-40fa-866d-ba1fb77e2be2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:38.739798 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658912d2-9068-40fa-866d-ba1fb77e2be2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:38.741845 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95455a3f-c03b-49a1-aef3-0341b6537382 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:38.742157 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658912d2-9068-40fa-866d-ba1fb77e2be2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:38.843516 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3489/6948] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:36:38 2022] POST /identity/v3/projects => generated 379 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:36:38.844933 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658912d2-9068-40fa-866d-ba1fb77e2be2 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:38.961266 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658912d2-9068-40fa-866d-ba1fb77e2be2 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:38.963629 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-95455a3f-c03b-49a1-aef3-0341b6537382 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ee252de0fb74adda84ee09c01e84eeb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:38.984102 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9881e4f9-7ba7-4e94-b819-b8b81e809b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:38.985057 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881e4f9-7ba7-4e94-b819-b8b81e809b3d admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:38.988538 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881e4f9-7ba7-4e94-b819-b8b81e809b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:38.989432 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881e4f9-7ba7-4e94-b819-b8b81e809b3d admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:38.990548 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9881e4f9-7ba7-4e94-b819-b8b81e809b3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:38.994942 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9881e4f9-7ba7-4e94-b819-b8b81e809b3d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:39.003980 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-95455a3f-c03b-49a1-aef3-0341b6537382 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ee252de0fb74adda84ee09c01e84eeb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:39.052041 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-95455a3f-c03b-49a1-aef3-0341b6537382 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ee252de0fb74adda84ee09c01e84eeb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:39.052895 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-95455a3f-c03b-49a1-aef3-0341b6537382 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ee252de0fb74adda84ee09c01e84eeb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:39.061628 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-95455a3f-c03b-49a1-aef3-0341b6537382 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ee252de0fb74adda84ee09c01e84eeb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:39.069911 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3460/6949] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:36:38 2022] DELETE /identity/v3/users/5ee252de0fb74adda84ee09c01e84eeb => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:36:39.075252 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da573e-8bcb-4159-9bb3-0767ec335235 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:39.075964 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da573e-8bcb-4159-9bb3-0767ec335235 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:39.076777 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da573e-8bcb-4159-9bb3-0767ec335235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:39.098160 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-95da573e-8bcb-4159-9bb3-0767ec335235 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:39.099645 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-95da573e-8bcb-4159-9bb3-0767ec335235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:39.105869 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3490/6950] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:36:38 2022] POST /identity/v3/users => generated 296 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:36:39.109815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9881e4f9-7ba7-4e94-b819-b8b81e809b3d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:39.113867 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9881e4f9-7ba7-4e94-b819-b8b81e809b3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:39.129441 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9881e4f9-7ba7-4e94-b819-b8b81e809b3d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:39.174983 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3461/6951] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:36:39.188956 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da573e-8bcb-4159-9bb3-0767ec335235 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:39.191420 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-95da573e-8bcb-4159-9bb3-0767ec335235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:39.208660 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a3aab-4d76-450c-805c-d78a275514a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:39.209352 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a3aab-4d76-450c-805c-d78a275514a4 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:39.209627 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a3aab-4d76-450c-805c-d78a275514a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:39.209941 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a3aab-4d76-450c-805c-d78a275514a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:39.210675 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a3aab-4d76-450c-805c-d78a275514a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:39.212306 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a3aab-4d76-450c-805c-d78a275514a4 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:39.222536 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3491/6952] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:36:39.226571 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a3aab-4d76-450c-805c-d78a275514a4 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:39.236440 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a3aab-4d76-450c-805c-d78a275514a4 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:39.241128 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8222288-00bc-4c68-ae3e-1ce82c0c2385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:39.242041 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8222288-00bc-4c68-ae3e-1ce82c0c2385 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:39.242321 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8222288-00bc-4c68-ae3e-1ce82c0c2385 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:39.242594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8222288-00bc-4c68-ae3e-1ce82c0c2385 admin admin] PATH_INFO: `/v3/projects/8e16046b3b5c4ac48a22f4bfcbca77d0/users/e63df914074944fe887d9248f1f12efe/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:39.258898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8222288-00bc-4c68-ae3e-1ce82c0c2385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e16046b3b5c4ac48a22f4bfcbca77d0, user_id=e63df914074944fe887d9248f1f12efe, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:39.259144 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da573e-8bcb-4159-9bb3-0767ec335235 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:39.261581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8222288-00bc-4c68-ae3e-1ce82c0c2385 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:39.262908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc850b0-7ffb-4d5b-b862-ef7da67adc17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:39.263559 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc850b0-7ffb-4d5b-b862-ef7da67adc17 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:39.263841 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc850b0-7ffb-4d5b-b862-ef7da67adc17 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:39.264114 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc850b0-7ffb-4d5b-b862-ef7da67adc17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:39.275893 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc850b0-7ffb-4d5b-b862-ef7da67adc17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:39.278030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc850b0-7ffb-4d5b-b862-ef7da67adc17 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:39.294699 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3462/6953] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:36:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:36:39.391665 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3492/6954] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:36:39 2022] PUT /identity/v3/projects/8e16046b3b5c4ac48a22f4bfcbca77d0/users/e63df914074944fe887d9248f1f12efe/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:36:39.396509 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc850b0-7ffb-4d5b-b862-ef7da67adc17 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:39.409225 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc850b0-7ffb-4d5b-b862-ef7da67adc17 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:39.490885 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f351b1b-5b74-4e48-a184-c633cd2c6cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:39.491568 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f351b1b-5b74-4e48-a184-c633cd2c6cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:39.491854 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f351b1b-5b74-4e48-a184-c633cd2c6cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:39.492136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f351b1b-5b74-4e48-a184-c633cd2c6cc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:39.493048 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f351b1b-5b74-4e48-a184-c633cd2c6cc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:39.494715 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f351b1b-5b74-4e48-a184-c633cd2c6cc2 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:39.511093 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3463/6955] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:36:39.512820 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8222288-00bc-4c68-ae3e-1ce82c0c2385 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:39.527793 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8222288-00bc-4c68-ae3e-1ce82c0c2385 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:39.533678 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab66edc-e388-4277-a5c5-5e8225313137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:39.535249 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab66edc-e388-4277-a5c5-5e8225313137 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:39.535249 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab66edc-e388-4277-a5c5-5e8225313137 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:39.541715 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab66edc-e388-4277-a5c5-5e8225313137 admin admin] PATH_INFO: `/v3/projects/8e16046b3b5c4ac48a22f4bfcbca77d0/users/e63df914074944fe887d9248f1f12efe/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:39.549945 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab66edc-e388-4277-a5c5-5e8225313137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e16046b3b5c4ac48a22f4bfcbca77d0, user_id=e63df914074944fe887d9248f1f12efe, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:39.555134 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab66edc-e388-4277-a5c5-5e8225313137 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:39.573457 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3493/6956] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:36:39 2022] PUT /identity/v3/projects/8e16046b3b5c4ac48a22f4bfcbca77d0/users/e63df914074944fe887d9248f1f12efe/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:36:39.587184 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a739b1e-e66f-479b-b1eb-0646897e88ba None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:39.587584 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a739b1e-e66f-479b-b1eb-0646897e88ba None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:39.587925 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a739b1e-e66f-479b-b1eb-0646897e88ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:39.623923 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-0a739b1e-e66f-479b-b1eb-0646897e88ba None None] MFA Rules not processed for user `e63df914074944fe887d9248f1f12efe`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:39.628583 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0a739b1e-e66f-479b-b1eb-0646897e88ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:39.732718 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3464/6957] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:39 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:36:39.742936 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab66edc-e388-4277-a5c5-5e8225313137 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:39.745840 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7ab66edc-e388-4277-a5c5-5e8225313137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:39.816606 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab66edc-e388-4277-a5c5-5e8225313137 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:39.821056 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb30e9d-5223-4ed0-ac5f-30d5227a29d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:39.822126 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb30e9d-5223-4ed0-ac5f-30d5227a29d5 service cinder] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:39.822737 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb30e9d-5223-4ed0-ac5f-30d5227a29d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:39.823212 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb30e9d-5223-4ed0-ac5f-30d5227a29d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:39.835688 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb30e9d-5223-4ed0-ac5f-30d5227a29d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:39.837594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb30e9d-5223-4ed0-ac5f-30d5227a29d5 service cinder] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:39.849234 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3494/6958] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:36:39 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:36:40.842538 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a739b1e-e66f-479b-b1eb-0646897e88ba None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:40.844049 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0a739b1e-e66f-479b-b1eb-0646897e88ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:40.956795 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a739b1e-e66f-479b-b1eb-0646897e88ba None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:40.963999 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eaf4e4-58d5-4a54-a195-38b5a62c421d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:40.965164 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eaf4e4-58d5-4a54-a195-38b5a62c421d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:40.966633 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eaf4e4-58d5-4a54-a195-38b5a62c421d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:40.967340 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eaf4e4-58d5-4a54-a195-38b5a62c421d admin admin] PATH_INFO: `/v3/projects/228c9fcbe55946858e8c46db94e0f921` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:40.968970 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eaf4e4-58d5-4a54-a195-38b5a62c421d admin admin] RBAC: Authorizing `identity:delete_project(project_id=228c9fcbe55946858e8c46db94e0f921)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:40.972464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eaf4e4-58d5-4a54-a195-38b5a62c421d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:41.107410 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a1eaf4e4-58d5-4a54-a195-38b5a62c421d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '228c9fcbe55946858e8c46db94e0f921', 'request_id': 'req-a1eaf4e4-58d5-4a54-a195-38b5a62c421d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:41.115119 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a1eaf4e4-58d5-4a54-a195-38b5a62c421d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '228c9fcbe55946858e8c46db94e0f921', 'request_id': 'req-a1eaf4e4-58d5-4a54-a195-38b5a62c421d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:41.123290 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a1eaf4e4-58d5-4a54-a195-38b5a62c421d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '228c9fcbe55946858e8c46db94e0f921', 'request_id': 'req-a1eaf4e4-58d5-4a54-a195-38b5a62c421d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:41.164264 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb30e9d-5223-4ed0-ac5f-30d5227a29d5 service cinder] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:41.174772 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb30e9d-5223-4ed0-ac5f-30d5227a29d5 service cinder] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:41.213098 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a1eaf4e4-58d5-4a54-a195-38b5a62c421d admin admin] The token cache is being invalidate because project 228c9fcbe55946858e8c46db94e0f921 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:36:41.214231 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a1eaf4e4-58d5-4a54-a195-38b5a62c421d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:41.215084 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a1eaf4e4-58d5-4a54-a195-38b5a62c421d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:41.217409 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3465/6959] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:36:40 2022] DELETE /identity/v3/projects/228c9fcbe55946858e8c46db94e0f921 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:36:41.222307 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eaf4e4-58d5-4a54-a195-38b5a62c421d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:41.223933 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a1eaf4e4-58d5-4a54-a195-38b5a62c421d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:41.297153 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86b10a-b1ce-457a-b818-de5cf0e86802 tempest-VolumeQuotaClassesTest-226686700 tempest-VolumeQuotaClassesTest-226686700-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e63df914074944fe887d9248f1f12efe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e16046b3b5c4ac48a22f4bfcbca77d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:41.298553 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86b10a-b1ce-457a-b818-de5cf0e86802 tempest-VolumeQuotaClassesTest-226686700 tempest-VolumeQuotaClassesTest-226686700-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:41.299835 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86b10a-b1ce-457a-b818-de5cf0e86802 tempest-VolumeQuotaClassesTest-226686700 tempest-VolumeQuotaClassesTest-226686700-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:41.300314 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86b10a-b1ce-457a-b818-de5cf0e86802 tempest-VolumeQuotaClassesTest-226686700 tempest-VolumeQuotaClassesTest-226686700-project-admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:41.301622 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be86b10a-b1ce-457a-b818-de5cf0e86802 tempest-VolumeQuotaClassesTest-226686700 tempest-VolumeQuotaClassesTest-226686700-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:36:41.302571 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be86b10a-b1ce-457a-b818-de5cf0e86802 tempest-VolumeQuotaClassesTest-226686700 tempest-VolumeQuotaClassesTest-226686700-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:41.305630 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be86b10a-b1ce-457a-b818-de5cf0e86802 tempest-VolumeQuotaClassesTest-226686700 tempest-VolumeQuotaClassesTest-226686700-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:41.323165 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eaf4e4-58d5-4a54-a195-38b5a62c421d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:41.325474 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3495/6960] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:36:41.329987 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86b10a-b1ce-457a-b818-de5cf0e86802 tempest-VolumeQuotaClassesTest-226686700 tempest-VolumeQuotaClassesTest-226686700-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:41.330847 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-be86b10a-b1ce-457a-b818-de5cf0e86802 tempest-VolumeQuotaClassesTest-226686700 tempest-VolumeQuotaClassesTest-226686700-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:41.334057 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92412a0-6672-488a-9d6c-1f023a2db92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:41.334956 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92412a0-6672-488a-9d6c-1f023a2db92d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:41.336125 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92412a0-6672-488a-9d6c-1f023a2db92d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:41.336125 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92412a0-6672-488a-9d6c-1f023a2db92d admin admin] PATH_INFO: `/v3/users/668d6c095cee419bb830ce8b1c547aa4` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:41.337457 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92412a0-6672-488a-9d6c-1f023a2db92d admin admin] RBAC: Authorizing `identity:delete_user(user_id=668d6c095cee419bb830ce8b1c547aa4)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:41.339782 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92412a0-6672-488a-9d6c-1f023a2db92d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:41.354134 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86b10a-b1ce-457a-b818-de5cf0e86802 tempest-VolumeQuotaClassesTest-226686700 tempest-VolumeQuotaClassesTest-226686700-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:41.360560 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049cc9a5-5ee7-4c47-98a9-8a542ec087f6 tempest-VolumeQuotaClassesTest-226686700 tempest-VolumeQuotaClassesTest-226686700-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e63df914074944fe887d9248f1f12efe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e16046b3b5c4ac48a22f4bfcbca77d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:41.363616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049cc9a5-5ee7-4c47-98a9-8a542ec087f6 tempest-VolumeQuotaClassesTest-226686700 tempest-VolumeQuotaClassesTest-226686700-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:41.364086 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049cc9a5-5ee7-4c47-98a9-8a542ec087f6 tempest-VolumeQuotaClassesTest-226686700 tempest-VolumeQuotaClassesTest-226686700-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:41.364559 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049cc9a5-5ee7-4c47-98a9-8a542ec087f6 tempest-VolumeQuotaClassesTest-226686700 tempest-VolumeQuotaClassesTest-226686700-project-admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:41.365518 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049cc9a5-5ee7-4c47-98a9-8a542ec087f6 tempest-VolumeQuotaClassesTest-226686700 tempest-VolumeQuotaClassesTest-226686700-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:41.367967 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049cc9a5-5ee7-4c47-98a9-8a542ec087f6 tempest-VolumeQuotaClassesTest-226686700 tempest-VolumeQuotaClassesTest-226686700-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:41.539819 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3496/6961] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:36:41 2022] POST /identity/v3/projects => generated 354 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:36:41.544184 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049cc9a5-5ee7-4c47-98a9-8a542ec087f6 tempest-VolumeQuotaClassesTest-226686700 tempest-VolumeQuotaClassesTest-226686700-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:41.574984 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f92412a0-6672-488a-9d6c-1f023a2db92d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '668d6c095cee419bb830ce8b1c547aa4'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:41.626532 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f92412a0-6672-488a-9d6c-1f023a2db92d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '668d6c095cee419bb830ce8b1c547aa4'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:41.702247 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049cc9a5-5ee7-4c47-98a9-8a542ec087f6 tempest-VolumeQuotaClassesTest-226686700 tempest-VolumeQuotaClassesTest-226686700-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:41.704568 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f92412a0-6672-488a-9d6c-1f023a2db92d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '668d6c095cee419bb830ce8b1c547aa4'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:41.706446 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f92412a0-6672-488a-9d6c-1f023a2db92d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '668d6c095cee419bb830ce8b1c547aa4'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:41.718132 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436bb03-d44e-48d5-86d8-093c48d5495b tempest-VolumeQuotaClassesTest-226686700 tempest-VolumeQuotaClassesTest-226686700-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e63df914074944fe887d9248f1f12efe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e16046b3b5c4ac48a22f4bfcbca77d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:41.718823 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436bb03-d44e-48d5-86d8-093c48d5495b tempest-VolumeQuotaClassesTest-226686700 tempest-VolumeQuotaClassesTest-226686700-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:41.719110 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436bb03-d44e-48d5-86d8-093c48d5495b tempest-VolumeQuotaClassesTest-226686700 tempest-VolumeQuotaClassesTest-226686700-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:41.719393 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b436bb03-d44e-48d5-86d8-093c48d5495b tempest-VolumeQuotaClassesTest-226686700 tempest-VolumeQuotaClassesTest-226686700-project-admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:41.719711 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f92412a0-6672-488a-9d6c-1f023a2db92d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '668d6c095cee419bb830ce8b1c547aa4'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:41.720173 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b436bb03-d44e-48d5-86d8-093c48d5495b tempest-VolumeQuotaClassesTest-226686700 tempest-VolumeQuotaClassesTest-226686700-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:36:41.720521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b436bb03-d44e-48d5-86d8-093c48d5495b tempest-VolumeQuotaClassesTest-226686700 tempest-VolumeQuotaClassesTest-226686700-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:41.722208 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b436bb03-d44e-48d5-86d8-093c48d5495b tempest-VolumeQuotaClassesTest-226686700 tempest-VolumeQuotaClassesTest-226686700-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:41.729071 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3466/6962] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:36:41 2022] DELETE /identity/v3/users/668d6c095cee419bb830ce8b1c547aa4 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:36:41.749490 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3497/6963] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:36:41.812005 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92412a0-6672-488a-9d6c-1f023a2db92d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:41.814105 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f92412a0-6672-488a-9d6c-1f023a2db92d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:41.997337 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92412a0-6672-488a-9d6c-1f023a2db92d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:42.007313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f7e51-ef87-43c7-8c64-3957fdc27647 tempest-VolumeQuotaClassesTest-226686700 tempest-VolumeQuotaClassesTest-226686700-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e63df914074944fe887d9248f1f12efe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e16046b3b5c4ac48a22f4bfcbca77d0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:42.008548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f7e51-ef87-43c7-8c64-3957fdc27647 tempest-VolumeQuotaClassesTest-226686700 tempest-VolumeQuotaClassesTest-226686700-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:42.008974 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f7e51-ef87-43c7-8c64-3957fdc27647 tempest-VolumeQuotaClassesTest-226686700 tempest-VolumeQuotaClassesTest-226686700-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:42.009215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f7e51-ef87-43c7-8c64-3957fdc27647 tempest-VolumeQuotaClassesTest-226686700 tempest-VolumeQuotaClassesTest-226686700-project-admin] PATH_INFO: `/v3/projects/525195b1e2244a28b705d5eb10d935a4` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:42.011050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806f7e51-ef87-43c7-8c64-3957fdc27647 tempest-VolumeQuotaClassesTest-226686700 tempest-VolumeQuotaClassesTest-226686700-project-admin] RBAC: Authorizing `identity:delete_project(project_id=525195b1e2244a28b705d5eb10d935a4)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:42.016674 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806f7e51-ef87-43c7-8c64-3957fdc27647 tempest-VolumeQuotaClassesTest-226686700 tempest-VolumeQuotaClassesTest-226686700-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:42.225143 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-806f7e51-ef87-43c7-8c64-3957fdc27647 tempest-VolumeQuotaClassesTest-226686700 tempest-VolumeQuotaClassesTest-226686700-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '525195b1e2244a28b705d5eb10d935a4', 'request_id': 'req-806f7e51-ef87-43c7-8c64-3957fdc27647'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:42.239074 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-806f7e51-ef87-43c7-8c64-3957fdc27647 tempest-VolumeQuotaClassesTest-226686700 tempest-VolumeQuotaClassesTest-226686700-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '525195b1e2244a28b705d5eb10d935a4', 'request_id': 'req-806f7e51-ef87-43c7-8c64-3957fdc27647'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:42.252277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-806f7e51-ef87-43c7-8c64-3957fdc27647 tempest-VolumeQuotaClassesTest-226686700 tempest-VolumeQuotaClassesTest-226686700-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '525195b1e2244a28b705d5eb10d935a4', 'request_id': 'req-806f7e51-ef87-43c7-8c64-3957fdc27647'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:42.353627 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-806f7e51-ef87-43c7-8c64-3957fdc27647 tempest-VolumeQuotaClassesTest-226686700 tempest-VolumeQuotaClassesTest-226686700-project-admin] The token cache is being invalidate because project 525195b1e2244a28b705d5eb10d935a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:36:42.353627 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-806f7e51-ef87-43c7-8c64-3957fdc27647 tempest-VolumeQuotaClassesTest-226686700 tempest-VolumeQuotaClassesTest-226686700-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:42.353627 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-806f7e51-ef87-43c7-8c64-3957fdc27647 tempest-VolumeQuotaClassesTest-226686700 tempest-VolumeQuotaClassesTest-226686700-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:42.354869 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3467/6964] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:36:41 2022] DELETE /identity/v3/projects/525195b1e2244a28b705d5eb10d935a4 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:36:42.752427 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436bb03-d44e-48d5-86d8-093c48d5495b tempest-VolumeQuotaClassesTest-226686700 tempest-VolumeQuotaClassesTest-226686700-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:42.754279 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b436bb03-d44e-48d5-86d8-093c48d5495b tempest-VolumeQuotaClassesTest-226686700 tempest-VolumeQuotaClassesTest-226686700-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:42.955077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b436bb03-d44e-48d5-86d8-093c48d5495b tempest-VolumeQuotaClassesTest-226686700 tempest-VolumeQuotaClassesTest-226686700-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:43.095117 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754c9c3-6f43-4bce-af62-59c6adcd6865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:43.096613 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754c9c3-6f43-4bce-af62-59c6adcd6865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:43.096900 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754c9c3-6f43-4bce-af62-59c6adcd6865 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:43.098181 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754c9c3-6f43-4bce-af62-59c6adcd6865 admin admin] PATH_INFO: `/v3/projects/1581d64855e948ca9b28bae7fa6c7ffc` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:43.099939 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f754c9c3-6f43-4bce-af62-59c6adcd6865 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1581d64855e948ca9b28bae7fa6c7ffc)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:43.104104 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f754c9c3-6f43-4bce-af62-59c6adcd6865 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:43.305126 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f754c9c3-6f43-4bce-af62-59c6adcd6865 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1581d64855e948ca9b28bae7fa6c7ffc', 'request_id': 'req-f754c9c3-6f43-4bce-af62-59c6adcd6865'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:43.312886 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f754c9c3-6f43-4bce-af62-59c6adcd6865 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1581d64855e948ca9b28bae7fa6c7ffc', 'request_id': 'req-f754c9c3-6f43-4bce-af62-59c6adcd6865'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:43.318189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f7e51-ef87-43c7-8c64-3957fdc27647 tempest-VolumeQuotaClassesTest-226686700 tempest-VolumeQuotaClassesTest-226686700-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:43.321023 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-806f7e51-ef87-43c7-8c64-3957fdc27647 tempest-VolumeQuotaClassesTest-226686700 tempest-VolumeQuotaClassesTest-226686700-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:43.322353 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f754c9c3-6f43-4bce-af62-59c6adcd6865 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1581d64855e948ca9b28bae7fa6c7ffc', 'request_id': 'req-f754c9c3-6f43-4bce-af62-59c6adcd6865'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:43.343587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f7e51-ef87-43c7-8c64-3957fdc27647 tempest-VolumeQuotaClassesTest-226686700 tempest-VolumeQuotaClassesTest-226686700-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:43.424447 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f754c9c3-6f43-4bce-af62-59c6adcd6865 admin admin] The token cache is being invalidate because project 1581d64855e948ca9b28bae7fa6c7ffc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:36:43.425114 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f754c9c3-6f43-4bce-af62-59c6adcd6865 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:43.427060 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f754c9c3-6f43-4bce-af62-59c6adcd6865 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:43.429493 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3498/6965] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:36:42 2022] DELETE /identity/v3/projects/1581d64855e948ca9b28bae7fa6c7ffc => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:36:43.434277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecde1bd-53a1-4efa-98fd-ff59d2c4c45f None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:43.435399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecde1bd-53a1-4efa-98fd-ff59d2c4c45f None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:43.435891 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecde1bd-53a1-4efa-98fd-ff59d2c4c45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:43.488966 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-4ecde1bd-53a1-4efa-98fd-ff59d2c4c45f None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:43.492737 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4ecde1bd-53a1-4efa-98fd-ff59d2c4c45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:43.503903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa40a53-fe6b-4a75-8ff4-1471c4b40555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:43.503903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa40a53-fe6b-4a75-8ff4-1471c4b40555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:43.503903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa40a53-fe6b-4a75-8ff4-1471c4b40555 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:43.503903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa40a53-fe6b-4a75-8ff4-1471c4b40555 admin admin] PATH_INFO: `/v3/users/eea928c0944b4ff3ac23f102bf0d2a69` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:43.505333 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa40a53-fe6b-4a75-8ff4-1471c4b40555 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eea928c0944b4ff3ac23f102bf0d2a69)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:43.507426 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa40a53-fe6b-4a75-8ff4-1471c4b40555 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:43.524154 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3499/6966] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:36:43.532962 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3778f-caf8-4677-8ba1-18aa7e8f5257 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:43.534522 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3778f-caf8-4677-8ba1-18aa7e8f5257 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:43.534973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3778f-caf8-4677-8ba1-18aa7e8f5257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:43.562703 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-8bc3778f-caf8-4677-8ba1-18aa7e8f5257 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:43.564952 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8bc3778f-caf8-4677-8ba1-18aa7e8f5257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:43.574625 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3500/6967] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:36:43.579096 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3778f-caf8-4677-8ba1-18aa7e8f5257 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:43.592696 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3778f-caf8-4677-8ba1-18aa7e8f5257 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:43.599103 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f65ce9-0a17-4b0c-bd2d-aaa00764c8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:43.599838 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f65ce9-0a17-4b0c-bd2d-aaa00764c8f9 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:43.600197 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f65ce9-0a17-4b0c-bd2d-aaa00764c8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:43.600470 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f65ce9-0a17-4b0c-bd2d-aaa00764c8f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:43.601215 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f65ce9-0a17-4b0c-bd2d-aaa00764c8f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:36:43.601526 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f65ce9-0a17-4b0c-bd2d-aaa00764c8f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:43.603560 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f65ce9-0a17-4b0c-bd2d-aaa00764c8f9 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:43.617454 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3501/6968] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:36:43.621697 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f65ce9-0a17-4b0c-bd2d-aaa00764c8f9 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:43.632418 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f65ce9-0a17-4b0c-bd2d-aaa00764c8f9 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:43.637321 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb7d96-34b4-4d4e-93aa-6012dd91089c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:43.638184 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb7d96-34b4-4d4e-93aa-6012dd91089c admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:43.638495 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb7d96-34b4-4d4e-93aa-6012dd91089c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:43.639395 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb7d96-34b4-4d4e-93aa-6012dd91089c admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:43.640099 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb7d96-34b4-4d4e-93aa-6012dd91089c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:43.642072 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb7d96-34b4-4d4e-93aa-6012dd91089c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:43.750173 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5aa40a53-fe6b-4a75-8ff4-1471c4b40555 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eea928c0944b4ff3ac23f102bf0d2a69'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:43.769309 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5aa40a53-fe6b-4a75-8ff4-1471c4b40555 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eea928c0944b4ff3ac23f102bf0d2a69'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:43.777847 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3502/6969] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:36:43 2022] POST /identity/v3/projects => generated 383 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:36:43.781885 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb7d96-34b4-4d4e-93aa-6012dd91089c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:43.851600 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5aa40a53-fe6b-4a75-8ff4-1471c4b40555 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eea928c0944b4ff3ac23f102bf0d2a69'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:43.853356 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5aa40a53-fe6b-4a75-8ff4-1471c4b40555 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eea928c0944b4ff3ac23f102bf0d2a69'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:43.863366 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5aa40a53-fe6b-4a75-8ff4-1471c4b40555 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eea928c0944b4ff3ac23f102bf0d2a69'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:43.883952 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3468/6970] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:36:43 2022] DELETE /identity/v3/users/eea928c0944b4ff3ac23f102bf0d2a69 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:36:43.888644 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a1142-191f-4b68-a910-37d8593b4feb None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:43.889083 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a1142-191f-4b68-a910-37d8593b4feb None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:43.889373 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a1142-191f-4b68-a910-37d8593b4feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:43.936875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb7d96-34b4-4d4e-93aa-6012dd91089c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:43.942965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-3a4a1142-191f-4b68-a910-37d8593b4feb None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:43.944356 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3a4a1142-191f-4b68-a910-37d8593b4feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:44.047372 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3469/6971] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:36:44.055860 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ffad1-54d3-4d3a-b06f-dfc987ee19e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:44.056572 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ffad1-54d3-4d3a-b06f-dfc987ee19e3 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:44.056855 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ffad1-54d3-4d3a-b06f-dfc987ee19e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:44.057129 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ffad1-54d3-4d3a-b06f-dfc987ee19e3 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:44.057855 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ffad1-54d3-4d3a-b06f-dfc987ee19e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:44.059812 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ffad1-54d3-4d3a-b06f-dfc987ee19e3 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:44.067255 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a1142-191f-4b68-a910-37d8593b4feb None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:44.072501 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3a4a1142-191f-4b68-a910-37d8593b4feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:44.174652 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3503/6972] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:36:43 2022] POST /identity/v3/users => generated 292 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:36:44.176340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ffad1-54d3-4d3a-b06f-dfc987ee19e3 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:44.181045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-865ffad1-54d3-4d3a-b06f-dfc987ee19e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:44.200120 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a1142-191f-4b68-a910-37d8593b4feb None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:44.208426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ffad1-54d3-4d3a-b06f-dfc987ee19e3 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:44.208562 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e3ae4-e629-4917-b97a-0c866dd09058 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:44.209145 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e3ae4-e629-4917-b97a-0c866dd09058 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:44.209494 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e3ae4-e629-4917-b97a-0c866dd09058 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:44.209802 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e3ae4-e629-4917-b97a-0c866dd09058 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:44.220429 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e3ae4-e629-4917-b97a-0c866dd09058 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:44.222470 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e496b-6246-43d5-ae43-04393ac9cb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:44.223052 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e3ae4-e629-4917-b97a-0c866dd09058 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:44.228022 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e496b-6246-43d5-ae43-04393ac9cb3e admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:44.229087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e496b-6246-43d5-ae43-04393ac9cb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:44.229598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e496b-6246-43d5-ae43-04393ac9cb3e admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:44.233209 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e496b-6246-43d5-ae43-04393ac9cb3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:44.234661 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3470/6973] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:36:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:36:44.239317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e496b-6246-43d5-ae43-04393ac9cb3e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:44.280459 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3504/6974] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:36:44.284713 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e3ae4-e629-4917-b97a-0c866dd09058 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:44.295586 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e3ae4-e629-4917-b97a-0c866dd09058 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:44.301905 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce67cbc-2a83-4ac3-a6b2-fa6e82444705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:44.302797 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce67cbc-2a83-4ac3-a6b2-fa6e82444705 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:44.303095 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce67cbc-2a83-4ac3-a6b2-fa6e82444705 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:44.303360 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce67cbc-2a83-4ac3-a6b2-fa6e82444705 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:44.304088 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce67cbc-2a83-4ac3-a6b2-fa6e82444705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:44.305719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce67cbc-2a83-4ac3-a6b2-fa6e82444705 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:44.319803 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3471/6975] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:36:44.321009 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e496b-6246-43d5-ae43-04393ac9cb3e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:44.334098 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e496b-6246-43d5-ae43-04393ac9cb3e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:44.349680 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb962eb0-a1c8-47f4-9de4-8648666a587a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:44.351640 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb962eb0-a1c8-47f4-9de4-8648666a587a admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:44.352173 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb962eb0-a1c8-47f4-9de4-8648666a587a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:44.352691 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb962eb0-a1c8-47f4-9de4-8648666a587a admin admin] PATH_INFO: `/v3/projects/39de769226a747dcb4299123cbd102ac/users/1322fb2495ad42779699d4802f222ba7/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:44.395815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb962eb0-a1c8-47f4-9de4-8648666a587a admin admin] RBAC: Authorizing `identity:create_grant(project_id=39de769226a747dcb4299123cbd102ac, user_id=1322fb2495ad42779699d4802f222ba7, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:44.407619 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb962eb0-a1c8-47f4-9de4-8648666a587a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:44.664656 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3505/6976] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:36:44 2022] PUT /identity/v3/projects/39de769226a747dcb4299123cbd102ac/users/1322fb2495ad42779699d4802f222ba7/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:36:44.675387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88e05a-f9d1-4243-ba51-2094373c7f39 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:44.677095 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88e05a-f9d1-4243-ba51-2094373c7f39 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:44.677095 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88e05a-f9d1-4243-ba51-2094373c7f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:44.709296 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-ae88e05a-f9d1-4243-ba51-2094373c7f39 None None] MFA Rules not processed for user `1322fb2495ad42779699d4802f222ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:44.710827 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ae88e05a-f9d1-4243-ba51-2094373c7f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:44.802666 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb962eb0-a1c8-47f4-9de4-8648666a587a admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:44.804887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-cb962eb0-a1c8-47f4-9de4-8648666a587a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:44.840142 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3472/6977] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:36:44.846278 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88e05a-f9d1-4243-ba51-2094373c7f39 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:44.909821 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb962eb0-a1c8-47f4-9de4-8648666a587a admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:44.936595 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8eb27-1ed4-4fed-9347-a345245b7bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:44.938839 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8eb27-1ed4-4fed-9347-a345245b7bba admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:44.939727 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8eb27-1ed4-4fed-9347-a345245b7bba admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:44.940006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8eb27-1ed4-4fed-9347-a345245b7bba admin admin] PATH_INFO: `/v3/users/9d7f9c196db74ff98dfd74722e44c19f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:44.941260 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe8eb27-1ed4-4fed-9347-a345245b7bba admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d7f9c196db74ff98dfd74722e44c19f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:44.943435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe8eb27-1ed4-4fed-9347-a345245b7bba admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:44.965496 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88e05a-f9d1-4243-ba51-2094373c7f39 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:44.973445 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6269956-38b0-4780-9b4e-e536e7c73db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:44.974830 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6269956-38b0-4780-9b4e-e536e7c73db5 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:44.975517 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6269956-38b0-4780-9b4e-e536e7c73db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:44.976392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6269956-38b0-4780-9b4e-e536e7c73db5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:44.977322 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6269956-38b0-4780-9b4e-e536e7c73db5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:44.979714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6269956-38b0-4780-9b4e-e536e7c73db5 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:45.074174 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3473/6978] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:36:44 2022] POST /identity/v3/projects => generated 381 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:36:45.082381 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6269956-38b0-4780-9b4e-e536e7c73db5 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:45.129143 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cfe8eb27-1ed4-4fed-9347-a345245b7bba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d7f9c196db74ff98dfd74722e44c19f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:45.144501 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cfe8eb27-1ed4-4fed-9347-a345245b7bba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d7f9c196db74ff98dfd74722e44c19f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:45.153441 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6269956-38b0-4780-9b4e-e536e7c73db5 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:45.158807 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8ffde-550a-4b31-a315-5f4ad94ac895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:45.163285 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8ffde-550a-4b31-a315-5f4ad94ac895 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:45.163285 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8ffde-550a-4b31-a315-5f4ad94ac895 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:45.163285 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8ffde-550a-4b31-a315-5f4ad94ac895 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:45.163285 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c8ffde-550a-4b31-a315-5f4ad94ac895 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:45.163285 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c8ffde-550a-4b31-a315-5f4ad94ac895 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:45.217126 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cfe8eb27-1ed4-4fed-9347-a345245b7bba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d7f9c196db74ff98dfd74722e44c19f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:45.224954 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cfe8eb27-1ed4-4fed-9347-a345245b7bba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d7f9c196db74ff98dfd74722e44c19f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:45.225621 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cfe8eb27-1ed4-4fed-9347-a345245b7bba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d7f9c196db74ff98dfd74722e44c19f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:45.231652 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3506/6979] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:36:44 2022] DELETE /identity/v3/users/9d7f9c196db74ff98dfd74722e44c19f => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:36:45.232441 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8eb27-1ed4-4fed-9347-a345245b7bba admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:45.233852 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-cfe8eb27-1ed4-4fed-9347-a345245b7bba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:45.288092 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3474/6980] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:36:45 2022] POST /identity/v3/users => generated 297 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:36:45.290089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8cb376-6fee-4285-a5d9-d6534ef05c27 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:45.290559 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8cb376-6fee-4285-a5d9-d6534ef05c27 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:45.291151 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8cb376-6fee-4285-a5d9-d6534ef05c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:45.310360 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8eb27-1ed4-4fed-9347-a345245b7bba admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:45.313656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-3d8cb376-6fee-4285-a5d9-d6534ef05c27 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:45.316787 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce916d17-89b8-414e-8235-99eb1a527021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:45.317513 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3d8cb376-6fee-4285-a5d9-d6534ef05c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:45.317829 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce916d17-89b8-414e-8235-99eb1a527021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:45.318616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce916d17-89b8-414e-8235-99eb1a527021 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:45.319401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce916d17-89b8-414e-8235-99eb1a527021 admin admin] PATH_INFO: `/v3/projects/66982596ce804354884463ff7cd4c08b` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:45.321465 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce916d17-89b8-414e-8235-99eb1a527021 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66982596ce804354884463ff7cd4c08b)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:45.324042 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce916d17-89b8-414e-8235-99eb1a527021 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:45.331135 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3475/6981] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:36:45.332817 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8cb376-6fee-4285-a5d9-d6534ef05c27 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:45.334455 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3d8cb376-6fee-4285-a5d9-d6534ef05c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:45.349681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8cb376-6fee-4285-a5d9-d6534ef05c27 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:45.356295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618189a4-c763-4189-adc8-aed9015544c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:45.356295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618189a4-c763-4189-adc8-aed9015544c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:45.356752 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618189a4-c763-4189-adc8-aed9015544c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:45.357246 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618189a4-c763-4189-adc8-aed9015544c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:45.358266 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618189a4-c763-4189-adc8-aed9015544c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:45.360110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618189a4-c763-4189-adc8-aed9015544c5 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:45.372058 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3476/6982] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:36:45.374490 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618189a4-c763-4189-adc8-aed9015544c5 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:45.375926 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-618189a4-c763-4189-adc8-aed9015544c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:45.469418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618189a4-c763-4189-adc8-aed9015544c5 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:45.475315 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ce916d17-89b8-414e-8235-99eb1a527021 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66982596ce804354884463ff7cd4c08b', 'request_id': 'req-ce916d17-89b8-414e-8235-99eb1a527021'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:45.484842 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ce916d17-89b8-414e-8235-99eb1a527021 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66982596ce804354884463ff7cd4c08b', 'request_id': 'req-ce916d17-89b8-414e-8235-99eb1a527021'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:45.493416 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ce916d17-89b8-414e-8235-99eb1a527021 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66982596ce804354884463ff7cd4c08b', 'request_id': 'req-ce916d17-89b8-414e-8235-99eb1a527021'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:45.526271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630bbc3-d154-431f-8f08-0c47ab2f2ef3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:45.526968 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630bbc3-d154-431f-8f08-0c47ab2f2ef3 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:45.527254 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630bbc3-d154-431f-8f08-0c47ab2f2ef3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:45.528113 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630bbc3-d154-431f-8f08-0c47ab2f2ef3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:45.567232 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ce916d17-89b8-414e-8235-99eb1a527021 admin admin] The token cache is being invalidate because project 66982596ce804354884463ff7cd4c08b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:36:45.567642 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ce916d17-89b8-414e-8235-99eb1a527021 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:45.569866 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ce916d17-89b8-414e-8235-99eb1a527021 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:45.571714 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3507/6983] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:36:45 2022] DELETE /identity/v3/projects/66982596ce804354884463ff7cd4c08b => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:36:45.575883 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce916d17-89b8-414e-8235-99eb1a527021 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:45.577702 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ce916d17-89b8-414e-8235-99eb1a527021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:45.625935 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c630bbc3-d154-431f-8f08-0c47ab2f2ef3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:45.628416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c630bbc3-d154-431f-8f08-0c47ab2f2ef3 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:45.641067 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3477/6984] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:36:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:36:45.641796 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630bbc3-d154-431f-8f08-0c47ab2f2ef3 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:45.652555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630bbc3-d154-431f-8f08-0c47ab2f2ef3 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:45.665434 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a8a181-94ba-4210-94e9-6662f9864038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:45.666433 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8a181-94ba-4210-94e9-6662f9864038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:45.666706 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8a181-94ba-4210-94e9-6662f9864038 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:45.666960 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8a181-94ba-4210-94e9-6662f9864038 admin admin] PATH_INFO: `/v3/users/e63df914074944fe887d9248f1f12efe` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:45.668199 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a8a181-94ba-4210-94e9-6662f9864038 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e63df914074944fe887d9248f1f12efe)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:45.670194 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a8a181-94ba-4210-94e9-6662f9864038 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:45.687759 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce916d17-89b8-414e-8235-99eb1a527021 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:45.696236 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801370da-eb95-4d92-a48c-8ce52d012484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:45.699099 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801370da-eb95-4d92-a48c-8ce52d012484 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:45.699099 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801370da-eb95-4d92-a48c-8ce52d012484 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:45.699099 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801370da-eb95-4d92-a48c-8ce52d012484 admin admin] PATH_INFO: `/v3/projects/32b9dabf64e24209bf574adc87a19dc2/users/6ae62bd97b1b490f8eed2de60ca5dd76/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:45.724841 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801370da-eb95-4d92-a48c-8ce52d012484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32b9dabf64e24209bf574adc87a19dc2, user_id=6ae62bd97b1b490f8eed2de60ca5dd76, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:45.727888 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801370da-eb95-4d92-a48c-8ce52d012484 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:45.801869 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3508/6985] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:36:45 2022] PUT /identity/v3/projects/32b9dabf64e24209bf574adc87a19dc2/users/6ae62bd97b1b490f8eed2de60ca5dd76/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:36:45.805609 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801370da-eb95-4d92-a48c-8ce52d012484 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:45.863402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b3a8a181-94ba-4210-94e9-6662f9864038 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e63df914074944fe887d9248f1f12efe'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:45.885877 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b3a8a181-94ba-4210-94e9-6662f9864038 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e63df914074944fe887d9248f1f12efe'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:45.916296 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801370da-eb95-4d92-a48c-8ce52d012484 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:45.923017 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6157d-4a20-4850-9506-75e7c7a67d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:45.923017 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6157d-4a20-4850-9506-75e7c7a67d88 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:45.923017 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6157d-4a20-4850-9506-75e7c7a67d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:45.923017 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6157d-4a20-4850-9506-75e7c7a67d88 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:45.924226 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af6157d-4a20-4850-9506-75e7c7a67d88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:45.926027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af6157d-4a20-4850-9506-75e7c7a67d88 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:45.962487 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3509/6986] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:36:45.966537 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6157d-4a20-4850-9506-75e7c7a67d88 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:45.972422 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b3a8a181-94ba-4210-94e9-6662f9864038 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e63df914074944fe887d9248f1f12efe'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:45.973659 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b3a8a181-94ba-4210-94e9-6662f9864038 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e63df914074944fe887d9248f1f12efe'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:45.996676 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6157d-4a20-4850-9506-75e7c7a67d88 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:46.010313 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabfa6d1-2eee-4a49-acfb-c0f5fd1b6e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:46.011538 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfa6d1-2eee-4a49-acfb-c0f5fd1b6e4e admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:46.011999 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfa6d1-2eee-4a49-acfb-c0f5fd1b6e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:46.012447 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfa6d1-2eee-4a49-acfb-c0f5fd1b6e4e admin admin] PATH_INFO: `/v3/projects/32b9dabf64e24209bf574adc87a19dc2/users/6ae62bd97b1b490f8eed2de60ca5dd76/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:46.017056 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabfa6d1-2eee-4a49-acfb-c0f5fd1b6e4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=32b9dabf64e24209bf574adc87a19dc2, user_id=6ae62bd97b1b490f8eed2de60ca5dd76, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:46.023982 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b3a8a181-94ba-4210-94e9-6662f9864038 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e63df914074944fe887d9248f1f12efe'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:46.026170 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabfa6d1-2eee-4a49-acfb-c0f5fd1b6e4e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:46.042591 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3478/6987] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:36:45 2022] DELETE /identity/v3/users/e63df914074944fe887d9248f1f12efe => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:36:46.060054 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3510/6988] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:36:45 2022] PUT /identity/v3/projects/32b9dabf64e24209bf574adc87a19dc2/users/6ae62bd97b1b490f8eed2de60ca5dd76/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:36:46.072952 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabfa6d1-2eee-4a49-acfb-c0f5fd1b6e4e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:46.073643 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcd6a6-949e-4e48-b8b0-df0f9566a498 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:46.074037 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcd6a6-949e-4e48-b8b0-df0f9566a498 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:46.074421 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcd6a6-949e-4e48-b8b0-df0f9566a498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:46.075447 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-aabfa6d1-2eee-4a49-acfb-c0f5fd1b6e4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:46.121875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-1abcd6a6-949e-4e48-b8b0-df0f9566a498 None None] MFA Rules not processed for user `6ae62bd97b1b490f8eed2de60ca5dd76`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:46.121875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1abcd6a6-949e-4e48-b8b0-df0f9566a498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:46.218327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabfa6d1-2eee-4a49-acfb-c0f5fd1b6e4e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:46.226255 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5d02f-a6e5-4ac1-be68-4ca59a02e0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:46.227133 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5d02f-a6e5-4ac1-be68-4ca59a02e0fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:46.227419 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5d02f-a6e5-4ac1-be68-4ca59a02e0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:46.227698 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5d02f-a6e5-4ac1-be68-4ca59a02e0fc admin admin] PATH_INFO: `/v3/projects/61cf3c186d6347bda4f0558e9d809056` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:46.228960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5d02f-a6e5-4ac1-be68-4ca59a02e0fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=61cf3c186d6347bda4f0558e9d809056)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:46.231004 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5d02f-a6e5-4ac1-be68-4ca59a02e0fc admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:46.275585 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3479/6989] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:36:46.293035 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abcd6a6-949e-4e48-b8b0-df0f9566a498 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:46.294908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1abcd6a6-949e-4e48-b8b0-df0f9566a498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:46.390687 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b2a5d02f-a6e5-4ac1-be68-4ca59a02e0fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61cf3c186d6347bda4f0558e9d809056', 'request_id': 'req-b2a5d02f-a6e5-4ac1-be68-4ca59a02e0fc'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:46.398895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b2a5d02f-a6e5-4ac1-be68-4ca59a02e0fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61cf3c186d6347bda4f0558e9d809056', 'request_id': 'req-b2a5d02f-a6e5-4ac1-be68-4ca59a02e0fc'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:46.400155 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abcd6a6-949e-4e48-b8b0-df0f9566a498 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:46.414811 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b2a5d02f-a6e5-4ac1-be68-4ca59a02e0fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61cf3c186d6347bda4f0558e9d809056', 'request_id': 'req-b2a5d02f-a6e5-4ac1-be68-4ca59a02e0fc'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:46.480789 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82658398-0aed-45ac-845e-1021606f9b34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:46.483201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82658398-0aed-45ac-845e-1021606f9b34 service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:46.483201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82658398-0aed-45ac-845e-1021606f9b34 service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:46.483201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82658398-0aed-45ac-845e-1021606f9b34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:46.555032 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b2a5d02f-a6e5-4ac1-be68-4ca59a02e0fc admin admin] The token cache is being invalidate because project 61cf3c186d6347bda4f0558e9d809056 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:36:46.555374 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b2a5d02f-a6e5-4ac1-be68-4ca59a02e0fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:46.556057 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b2a5d02f-a6e5-4ac1-be68-4ca59a02e0fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:46.561909 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3511/6990] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:36:46 2022] DELETE /identity/v3/projects/61cf3c186d6347bda4f0558e9d809056 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:36:46.563652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2cc6a-fe2b-40a7-b36e-cfa0e4b9cc3d None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:46.563968 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2cc6a-fe2b-40a7-b36e-cfa0e4b9cc3d None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:46.565153 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2cc6a-fe2b-40a7-b36e-cfa0e4b9cc3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:46.606971 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-4db2cc6a-fe2b-40a7-b36e-cfa0e4b9cc3d None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:46.608202 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4db2cc6a-fe2b-40a7-b36e-cfa0e4b9cc3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:46.612709 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82658398-0aed-45ac-845e-1021606f9b34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:46.614642 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82658398-0aed-45ac-845e-1021606f9b34 service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:46.640146 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3480/6991] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:36:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:36:46.799450 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaab542-7487-4fef-973b-12c4becc44a8 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:46.804344 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaab542-7487-4fef-973b-12c4becc44a8 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:46.804344 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaab542-7487-4fef-973b-12c4becc44a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:46.804587 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3512/6992] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:36:46.827851 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-daaab542-7487-4fef-973b-12c4becc44a8 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:46.829375 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-daaab542-7487-4fef-973b-12c4becc44a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:46.844465 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2cc6a-fe2b-40a7-b36e-cfa0e4b9cc3d None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:46.849735 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3481/6993] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:36:46.856456 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2cc6a-fe2b-40a7-b36e-cfa0e4b9cc3d None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:46.867486 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1212ed-3c0d-470a-aedf-6e4c03fa17cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:46.868411 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1212ed-3c0d-470a-aedf-6e4c03fa17cb admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:46.868873 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1212ed-3c0d-470a-aedf-6e4c03fa17cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:46.869561 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1212ed-3c0d-470a-aedf-6e4c03fa17cb admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:46.870544 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1212ed-3c0d-470a-aedf-6e4c03fa17cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:36:46.871057 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1212ed-3c0d-470a-aedf-6e4c03fa17cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:46.876237 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1212ed-3c0d-470a-aedf-6e4c03fa17cb admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:46.883825 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaab542-7487-4fef-973b-12c4becc44a8 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:46.889897 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-daaab542-7487-4fef-973b-12c4becc44a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:46.919016 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaab542-7487-4fef-973b-12c4becc44a8 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:46.924717 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3513/6994] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:36:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:36:46.928000 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1212ed-3c0d-470a-aedf-6e4c03fa17cb admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:46.936591 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede0122-761a-4c11-9ed9-9d64998cfa6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:46.937442 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede0122-761a-4c11-9ed9-9d64998cfa6d service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:46.937738 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede0122-761a-4c11-9ed9-9d64998cfa6d service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:46.938048 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede0122-761a-4c11-9ed9-9d64998cfa6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:46.941056 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-fede0122-761a-4c11-9ed9-9d64998cfa6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:46.943880 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1212ed-3c0d-470a-aedf-6e4c03fa17cb admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:46.958401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4b83f-34a5-49ba-905f-c4eedf96be02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:46.959416 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4b83f-34a5-49ba-905f-c4eedf96be02 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:46.959857 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4b83f-34a5-49ba-905f-c4eedf96be02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:46.960290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4b83f-34a5-49ba-905f-c4eedf96be02 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:46.961159 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb4b83f-34a5-49ba-905f-c4eedf96be02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:46.963211 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb4b83f-34a5-49ba-905f-c4eedf96be02 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:47.073098 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede0122-761a-4c11-9ed9-9d64998cfa6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:47.073098 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede0122-761a-4c11-9ed9-9d64998cfa6d service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:47.105479 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3514/6995] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:36:46 2022] POST /identity/v3/projects => generated 375 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:36:47.105723 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3482/6996] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:36:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:36:47.106784 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede0122-761a-4c11-9ed9-9d64998cfa6d service cinder] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:47.107667 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4b83f-34a5-49ba-905f-c4eedf96be02 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:47.109656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-fede0122-761a-4c11-9ed9-9d64998cfa6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:47.172219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede0122-761a-4c11-9ed9-9d64998cfa6d service cinder] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:47.212250 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4b83f-34a5-49ba-905f-c4eedf96be02 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:47.229577 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e48ba-3408-4326-85fc-091e674ae4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:47.229577 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e48ba-3408-4326-85fc-091e674ae4bc admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:47.229577 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e48ba-3408-4326-85fc-091e674ae4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:47.229577 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e48ba-3408-4326-85fc-091e674ae4bc admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:47.230500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583e48ba-3408-4326-85fc-091e674ae4bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:47.230500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583e48ba-3408-4326-85fc-091e674ae4bc admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:47.308540 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af2884-5f4d-451f-8201-bd86b7d8231f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:47.312129 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af2884-5f4d-451f-8201-bd86b7d8231f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:47.312425 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af2884-5f4d-451f-8201-bd86b7d8231f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:47.320759 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3515/6997] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:36:47 2022] POST /identity/v3/users => generated 288 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:36:47.322602 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af2884-5f4d-451f-8201-bd86b7d8231f admin admin] PATH_INFO: `/v3/projects/8e16046b3b5c4ac48a22f4bfcbca77d0` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:47.327162 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af2884-5f4d-451f-8201-bd86b7d8231f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e16046b3b5c4ac48a22f4bfcbca77d0)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:47.330454 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af2884-5f4d-451f-8201-bd86b7d8231f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:47.337228 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e48ba-3408-4326-85fc-091e674ae4bc admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:47.375086 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e48ba-3408-4326-85fc-091e674ae4bc admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:47.390877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48e215-5d48-4de5-a4b6-1465ccd366be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:47.391708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48e215-5d48-4de5-a4b6-1465ccd366be admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:47.392091 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48e215-5d48-4de5-a4b6-1465ccd366be admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:47.392954 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48e215-5d48-4de5-a4b6-1465ccd366be admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:47.394326 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab48e215-5d48-4de5-a4b6-1465ccd366be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:47.396711 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab48e215-5d48-4de5-a4b6-1465ccd366be admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:47.411169 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3516/6998] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:36:47.415297 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48e215-5d48-4de5-a4b6-1465ccd366be admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:47.425597 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48e215-5d48-4de5-a4b6-1465ccd366be admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:47.431075 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a62226-33b7-4cee-951d-85cc08986c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:47.431903 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a62226-33b7-4cee-951d-85cc08986c57 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:47.432525 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a62226-33b7-4cee-951d-85cc08986c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:47.432875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a62226-33b7-4cee-951d-85cc08986c57 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:47.433678 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a62226-33b7-4cee-951d-85cc08986c57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:47.435541 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a62226-33b7-4cee-951d-85cc08986c57 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:47.449374 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3517/6999] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:36:47.455572 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a62226-33b7-4cee-951d-85cc08986c57 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:47.474459 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a62226-33b7-4cee-951d-85cc08986c57 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:47.480783 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2399ad-fff8-496b-b416-3864e01e11f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:47.481820 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2399ad-fff8-496b-b416-3864e01e11f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:47.482187 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2399ad-fff8-496b-b416-3864e01e11f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:47.482539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2399ad-fff8-496b-b416-3864e01e11f1 admin admin] PATH_INFO: `/v3/projects/eb6e1f50c1e446f29b003d0f68f02259/users/f669580551f7425488c08017307de62a/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:47.498930 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2399ad-fff8-496b-b416-3864e01e11f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb6e1f50c1e446f29b003d0f68f02259, user_id=f669580551f7425488c08017307de62a, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:47.501898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2399ad-fff8-496b-b416-3864e01e11f1 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:47.672404 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3518/7000] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:36:47 2022] PUT /identity/v3/projects/eb6e1f50c1e446f29b003d0f68f02259/users/f669580551f7425488c08017307de62a/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:36:47.681321 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c14110-7cbf-4a83-b6e6-a617a9235559 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:47.681913 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c14110-7cbf-4a83-b6e6-a617a9235559 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:47.682273 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c14110-7cbf-4a83-b6e6-a617a9235559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:47.687852 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e8af2884-5f4d-451f-8201-bd86b7d8231f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e16046b3b5c4ac48a22f4bfcbca77d0', 'request_id': 'req-e8af2884-5f4d-451f-8201-bd86b7d8231f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:47.694476 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e8af2884-5f4d-451f-8201-bd86b7d8231f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e16046b3b5c4ac48a22f4bfcbca77d0', 'request_id': 'req-e8af2884-5f4d-451f-8201-bd86b7d8231f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:47.700852 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e8af2884-5f4d-451f-8201-bd86b7d8231f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e16046b3b5c4ac48a22f4bfcbca77d0', 'request_id': 'req-e8af2884-5f4d-451f-8201-bd86b7d8231f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:47.712541 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-d8c14110-7cbf-4a83-b6e6-a617a9235559 None None] MFA Rules not processed for user `f669580551f7425488c08017307de62a`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:47.713910 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d8c14110-7cbf-4a83-b6e6-a617a9235559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:47.784632 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3519/7001] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:36:47.791032 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e8af2884-5f4d-451f-8201-bd86b7d8231f admin admin] The token cache is being invalidate because project 8e16046b3b5c4ac48a22f4bfcbca77d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:36:47.791328 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e8af2884-5f4d-451f-8201-bd86b7d8231f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:47.793959 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e8af2884-5f4d-451f-8201-bd86b7d8231f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:47.796336 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c14110-7cbf-4a83-b6e6-a617a9235559 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:47.797731 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d8c14110-7cbf-4a83-b6e6-a617a9235559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:47.800708 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3483/7002] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:36:47 2022] DELETE /identity/v3/projects/8e16046b3b5c4ac48a22f4bfcbca77d0 => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:36:47.805879 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f625f8-aa90-489f-888b-33b8f338affc None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:47.806225 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f625f8-aa90-489f-888b-33b8f338affc None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:47.806464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f625f8-aa90-489f-888b-33b8f338affc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:47.833778 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-12f625f8-aa90-489f-888b-33b8f338affc None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:47.835143 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-12f625f8-aa90-489f-888b-33b8f338affc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:47.897168 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c14110-7cbf-4a83-b6e6-a617a9235559 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:47.902562 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947cacd-ef8c-4c35-827a-3041a3d4d868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:47.903263 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947cacd-ef8c-4c35-827a-3041a3d4d868 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:47.903653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947cacd-ef8c-4c35-827a-3041a3d4d868 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:47.904193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947cacd-ef8c-4c35-827a-3041a3d4d868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:47.906049 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7947cacd-ef8c-4c35-827a-3041a3d4d868 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:47.919577 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7947cacd-ef8c-4c35-827a-3041a3d4d868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:47.921207 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7947cacd-ef8c-4c35-827a-3041a3d4d868 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:47.922602 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3484/7003] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:36:47.924606 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b05b8-07fd-4f5f-8319-ebfe37c9ca07 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:47.924909 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b05b8-07fd-4f5f-8319-ebfe37c9ca07 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:47.925251 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b05b8-07fd-4f5f-8319-ebfe37c9ca07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:47.945073 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3520/7004] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:36:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:36:47.948439 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-db6b05b8-07fd-4f5f-8319-ebfe37c9ca07 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:47.949646 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-db6b05b8-07fd-4f5f-8319-ebfe37c9ca07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:47.962184 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3485/7005] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:36:47.963368 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947cacd-ef8c-4c35-827a-3041a3d4d868 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:47.986816 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947cacd-ef8c-4c35-827a-3041a3d4d868 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:47.997105 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a9097-4b75-4523-92a2-b6ea0800c2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:47.997935 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a9097-4b75-4523-92a2-b6ea0800c2f2 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:47.998281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a9097-4b75-4523-92a2-b6ea0800c2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:47.998626 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a9097-4b75-4523-92a2-b6ea0800c2f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:47.999829 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29a9097-4b75-4523-92a2-b6ea0800c2f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:36:48.000211 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29a9097-4b75-4523-92a2-b6ea0800c2f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:48.012723 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29a9097-4b75-4523-92a2-b6ea0800c2f2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:48.037630 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3521/7006] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:36:48.046955 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b05b8-07fd-4f5f-8319-ebfe37c9ca07 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:48.054286 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b05b8-07fd-4f5f-8319-ebfe37c9ca07 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:48.075203 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda79c04-5587-4d12-bdb7-9e39cff0ec7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:48.076730 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda79c04-5587-4d12-bdb7-9e39cff0ec7e admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:48.077238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda79c04-5587-4d12-bdb7-9e39cff0ec7e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:48.078063 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda79c04-5587-4d12-bdb7-9e39cff0ec7e admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:48.080694 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda79c04-5587-4d12-bdb7-9e39cff0ec7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:48.083725 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda79c04-5587-4d12-bdb7-9e39cff0ec7e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:48.200106 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3486/7007] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:36:48 2022] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:36:48.204352 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a9097-4b75-4523-92a2-b6ea0800c2f2 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:48.215635 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a9097-4b75-4523-92a2-b6ea0800c2f2 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:48.295400 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b024c8-7dcd-4acb-9f73-0ee8505a0f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:48.296108 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b024c8-7dcd-4acb-9f73-0ee8505a0f7c admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:48.296387 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b024c8-7dcd-4acb-9f73-0ee8505a0f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:48.296662 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b024c8-7dcd-4acb-9f73-0ee8505a0f7c admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:48.297381 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b024c8-7dcd-4acb-9f73-0ee8505a0f7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:48.301406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b024c8-7dcd-4acb-9f73-0ee8505a0f7c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:48.418525 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3522/7008] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:36:48 2022] POST /identity/v3/users => generated 292 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:36:48.422564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda79c04-5587-4d12-bdb7-9e39cff0ec7e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:48.439589 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda79c04-5587-4d12-bdb7-9e39cff0ec7e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:48.445475 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ae591-c599-4d13-91c0-8724df8cd731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:48.448257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ae591-c599-4d13-91c0-8724df8cd731 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:48.448619 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ae591-c599-4d13-91c0-8724df8cd731 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:48.449847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ae591-c599-4d13-91c0-8724df8cd731 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:48.450067 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ae591-c599-4d13-91c0-8724df8cd731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:48.451952 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ae591-c599-4d13-91c0-8724df8cd731 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:48.510566 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3487/7009] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:36:48.514333 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b024c8-7dcd-4acb-9f73-0ee8505a0f7c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:48.533485 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b024c8-7dcd-4acb-9f73-0ee8505a0f7c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:48.544576 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6627ad-1711-4bf8-a513-6512fb6e2aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:48.550603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6627ad-1711-4bf8-a513-6512fb6e2aeb admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:48.550603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6627ad-1711-4bf8-a513-6512fb6e2aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:48.550603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6627ad-1711-4bf8-a513-6512fb6e2aeb admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:48.550603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6627ad-1711-4bf8-a513-6512fb6e2aeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:48.551905 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6627ad-1711-4bf8-a513-6512fb6e2aeb admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:48.581283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ae591-c599-4d13-91c0-8724df8cd731 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:48.593973 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3523/7010] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:36:48.596598 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ae591-c599-4d13-91c0-8724df8cd731 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:48.603516 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2a47e-4937-44db-993a-fcb79302ba2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:48.604515 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2a47e-4937-44db-993a-fcb79302ba2f admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:48.608246 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2a47e-4937-44db-993a-fcb79302ba2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:48.608246 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2a47e-4937-44db-993a-fcb79302ba2f admin admin] PATH_INFO: `/v3/projects/be521704a99543fca40d4dd36fe13681/users/e1bf425862e14fe4af624987e89c4808/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:48.649118 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d2a47e-4937-44db-993a-fcb79302ba2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=be521704a99543fca40d4dd36fe13681, user_id=e1bf425862e14fe4af624987e89c4808, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:48.654745 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d2a47e-4937-44db-993a-fcb79302ba2f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:48.732874 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3488/7011] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:36:48 2022] PUT /identity/v3/projects/be521704a99543fca40d4dd36fe13681/users/e1bf425862e14fe4af624987e89c4808/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:36:48.745210 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e76f44-ecf9-4d8c-b6c0-1d5a718f3bd9 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:48.745926 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e76f44-ecf9-4d8c-b6c0-1d5a718f3bd9 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:48.746448 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e76f44-ecf9-4d8c-b6c0-1d5a718f3bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:48.811805 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-76e76f44-ecf9-4d8c-b6c0-1d5a718f3bd9 None None] MFA Rules not processed for user `e1bf425862e14fe4af624987e89c4808`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:48.814534 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-76e76f44-ecf9-4d8c-b6c0-1d5a718f3bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:48.947971 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3524/7012] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:36:48.952173 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2a47e-4937-44db-993a-fcb79302ba2f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:49.028371 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2a47e-4937-44db-993a-fcb79302ba2f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:49.031304 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e76f44-ecf9-4d8c-b6c0-1d5a718f3bd9 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:49.033303 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-76e76f44-ecf9-4d8c-b6c0-1d5a718f3bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:49.034806 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb5602-58a5-4354-ac8c-92498343280a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:49.035485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb5602-58a5-4354-ac8c-92498343280a admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:49.035772 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb5602-58a5-4354-ac8c-92498343280a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:49.036049 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb5602-58a5-4354-ac8c-92498343280a admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:49.036980 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb5602-58a5-4354-ac8c-92498343280a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:49.039644 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb5602-58a5-4354-ac8c-92498343280a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:49.053334 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e76f44-ecf9-4d8c-b6c0-1d5a718f3bd9 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:49.060469 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5399e-384b-4af4-aaae-019f965a580a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:49.061290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5399e-384b-4af4-aaae-019f965a580a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:49.061642 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5399e-384b-4af4-aaae-019f965a580a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:49.061924 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5399e-384b-4af4-aaae-019f965a580a admin admin] PATH_INFO: `/v3/users/f669580551f7425488c08017307de62a` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:49.063101 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5399e-384b-4af4-aaae-019f965a580a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f669580551f7425488c08017307de62a)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:49.065931 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5399e-384b-4af4-aaae-019f965a580a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:49.131354 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3489/7013] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:36:48 2022] POST /identity/v3/projects => generated 381 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:36:49.135350 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb5602-58a5-4354-ac8c-92498343280a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:49.200342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb5602-58a5-4354-ac8c-92498343280a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:49.205775 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6aafc-9258-412c-8712-8ff5a0fe1688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:49.206527 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6aafc-9258-412c-8712-8ff5a0fe1688 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:49.206822 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6aafc-9258-412c-8712-8ff5a0fe1688 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:49.207100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6aafc-9258-412c-8712-8ff5a0fe1688 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:49.207792 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6aafc-9258-412c-8712-8ff5a0fe1688 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:49.215343 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6aafc-9258-412c-8712-8ff5a0fe1688 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:49.257364 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c7d5399e-384b-4af4-aaae-019f965a580a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f669580551f7425488c08017307de62a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:49.272253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c7d5399e-384b-4af4-aaae-019f965a580a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f669580551f7425488c08017307de62a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:49.360901 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3490/7014] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:36:49 2022] POST /identity/v3/users => generated 297 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:36:49.364817 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6aafc-9258-412c-8712-8ff5a0fe1688 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:49.375622 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6aafc-9258-412c-8712-8ff5a0fe1688 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:49.380363 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56129b5e-112e-487c-ba90-6cfc883355ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:49.382527 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56129b5e-112e-487c-ba90-6cfc883355ce admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:49.382527 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56129b5e-112e-487c-ba90-6cfc883355ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:49.382527 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56129b5e-112e-487c-ba90-6cfc883355ce admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:49.382527 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56129b5e-112e-487c-ba90-6cfc883355ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:49.384116 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56129b5e-112e-487c-ba90-6cfc883355ce admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:49.395018 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3491/7015] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:36:49.398960 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56129b5e-112e-487c-ba90-6cfc883355ce admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:49.406303 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c7d5399e-384b-4af4-aaae-019f965a580a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f669580551f7425488c08017307de62a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:49.410269 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56129b5e-112e-487c-ba90-6cfc883355ce admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:49.415236 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991d841-5b40-43dd-afb4-c8f15477d28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:49.416150 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c7d5399e-384b-4af4-aaae-019f965a580a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f669580551f7425488c08017307de62a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:49.416326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991d841-5b40-43dd-afb4-c8f15477d28f admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:49.416472 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991d841-5b40-43dd-afb4-c8f15477d28f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:49.416882 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991d841-5b40-43dd-afb4-c8f15477d28f admin admin] PATH_INFO: `/v3/projects/569397b97c444e51b8cc6f64fb6120b7/users/df1944d2e07945b093204d2347e1216e/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:49.417244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c7d5399e-384b-4af4-aaae-019f965a580a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f669580551f7425488c08017307de62a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:49.423738 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3525/7016] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:36:49 2022] DELETE /identity/v3/users/f669580551f7425488c08017307de62a => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:36:49.428515 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d757315-cbd5-480e-bf49-4a801f774c57 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:49.431885 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d757315-cbd5-480e-bf49-4a801f774c57 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:49.431885 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d757315-cbd5-480e-bf49-4a801f774c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:49.433665 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6991d841-5b40-43dd-afb4-c8f15477d28f admin admin] RBAC: Authorizing `identity:create_grant(project_id=569397b97c444e51b8cc6f64fb6120b7, user_id=df1944d2e07945b093204d2347e1216e, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:49.436529 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6991d841-5b40-43dd-afb4-c8f15477d28f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:49.448651 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-9d757315-cbd5-480e-bf49-4a801f774c57 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:49.455513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9d757315-cbd5-480e-bf49-4a801f774c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:49.516115 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3526/7017] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:36:49.526472 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3492/7018] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:36:49 2022] PUT /identity/v3/projects/569397b97c444e51b8cc6f64fb6120b7/users/df1944d2e07945b093204d2347e1216e/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:36:49.530513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d757315-cbd5-480e-bf49-4a801f774c57 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:49.532100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9d757315-cbd5-480e-bf49-4a801f774c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:49.534798 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991d841-5b40-43dd-afb4-c8f15477d28f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:49.537544 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6991d841-5b40-43dd-afb4-c8f15477d28f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:49.546816 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d757315-cbd5-480e-bf49-4a801f774c57 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:49.615835 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080120ce-10a8-4ad2-a368-4adb83455029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:49.616516 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080120ce-10a8-4ad2-a368-4adb83455029 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:49.616802 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080120ce-10a8-4ad2-a368-4adb83455029 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:49.617150 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080120ce-10a8-4ad2-a368-4adb83455029 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:49.617786 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991d841-5b40-43dd-afb4-c8f15477d28f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:49.617932 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080120ce-10a8-4ad2-a368-4adb83455029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:49.619556 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080120ce-10a8-4ad2-a368-4adb83455029 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:49.622321 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8144c8b-463c-4100-a8df-8785232efafb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:49.623099 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8144c8b-463c-4100-a8df-8785232efafb service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:49.623479 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8144c8b-463c-4100-a8df-8785232efafb service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:49.623854 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8144c8b-463c-4100-a8df-8785232efafb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:49.633235 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3527/7019] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:36:49.634556 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080120ce-10a8-4ad2-a368-4adb83455029 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:49.636956 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8144c8b-463c-4100-a8df-8785232efafb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:49.636956 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8144c8b-463c-4100-a8df-8785232efafb service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:49.649228 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3493/7020] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:36:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:36:49.652618 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080120ce-10a8-4ad2-a368-4adb83455029 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:49.659949 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41fc1e-666e-47d8-8119-dacd0b9c8091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:49.660867 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41fc1e-666e-47d8-8119-dacd0b9c8091 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:49.661134 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41fc1e-666e-47d8-8119-dacd0b9c8091 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:49.661411 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41fc1e-666e-47d8-8119-dacd0b9c8091 admin admin] PATH_INFO: `/v3/projects/569397b97c444e51b8cc6f64fb6120b7/users/df1944d2e07945b093204d2347e1216e/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:49.664298 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e41fc1e-666e-47d8-8119-dacd0b9c8091 admin admin] RBAC: Authorizing `identity:create_grant(project_id=569397b97c444e51b8cc6f64fb6120b7, user_id=df1944d2e07945b093204d2347e1216e, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:49.668301 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e41fc1e-666e-47d8-8119-dacd0b9c8091 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:49.683722 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3528/7021] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:36:49 2022] PUT /identity/v3/projects/569397b97c444e51b8cc6f64fb6120b7/users/df1944d2e07945b093204d2347e1216e/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:36:49.694449 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460d389-9cdb-4250-9446-5c45aa70409f None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:49.694962 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460d389-9cdb-4250-9446-5c45aa70409f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:49.695514 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460d389-9cdb-4250-9446-5c45aa70409f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:49.730423 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-5460d389-9cdb-4250-9446-5c45aa70409f None None] MFA Rules not processed for user `df1944d2e07945b093204d2347e1216e`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:49.731944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5460d389-9cdb-4250-9446-5c45aa70409f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:49.812950 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3494/7022] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:49 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:36:49.829201 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41fc1e-666e-47d8-8119-dacd0b9c8091 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:49.829201 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2e41fc1e-666e-47d8-8119-dacd0b9c8091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:49.900264 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41fc1e-666e-47d8-8119-dacd0b9c8091 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:49.910205 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1fe17-2403-4edf-af63-bced17eb0722 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:49.911013 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1fe17-2403-4edf-af63-bced17eb0722 service cinder] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:49.911363 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1fe17-2403-4edf-af63-bced17eb0722 service cinder] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:49.911707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1fe17-2403-4edf-af63-bced17eb0722 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:49.924913 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1fe17-2403-4edf-af63-bced17eb0722 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:49.926881 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1fe17-2403-4edf-af63-bced17eb0722 service cinder] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:49.942214 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3529/7023] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:36:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:36:50.112399 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460d389-9cdb-4250-9446-5c45aa70409f None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:50.126252 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460d389-9cdb-4250-9446-5c45aa70409f None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:50.136888 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef161085-0f59-4eb1-9c18-cf9b7809feb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:50.136888 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef161085-0f59-4eb1-9c18-cf9b7809feb2 service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:50.136888 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef161085-0f59-4eb1-9c18-cf9b7809feb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:50.136888 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef161085-0f59-4eb1-9c18-cf9b7809feb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:50.137412 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ef161085-0f59-4eb1-9c18-cf9b7809feb2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:50.330727 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef161085-0f59-4eb1-9c18-cf9b7809feb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:50.332395 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef161085-0f59-4eb1-9c18-cf9b7809feb2 service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:50.350725 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3495/7024] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:36:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:36:50.572549 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1fe17-2403-4edf-af63-bced17eb0722 service cinder] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:50.577360 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-88e1fe17-2403-4edf-af63-bced17eb0722 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:50.703846 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1fe17-2403-4edf-af63-bced17eb0722 service cinder] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:50.717541 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6534622-8c21-46ea-a77a-6962ff504439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:50.718448 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6534622-8c21-46ea-a77a-6962ff504439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:50.718710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6534622-8c21-46ea-a77a-6962ff504439 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:50.718995 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6534622-8c21-46ea-a77a-6962ff504439 admin admin] PATH_INFO: `/v3/projects/eb6e1f50c1e446f29b003d0f68f02259` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:50.721832 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6534622-8c21-46ea-a77a-6962ff504439 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb6e1f50c1e446f29b003d0f68f02259)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:50.731508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6534622-8c21-46ea-a77a-6962ff504439 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:50.887397 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d6534622-8c21-46ea-a77a-6962ff504439 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb6e1f50c1e446f29b003d0f68f02259', 'request_id': 'req-d6534622-8c21-46ea-a77a-6962ff504439'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:50.895998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d6534622-8c21-46ea-a77a-6962ff504439 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb6e1f50c1e446f29b003d0f68f02259', 'request_id': 'req-d6534622-8c21-46ea-a77a-6962ff504439'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:50.904815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d6534622-8c21-46ea-a77a-6962ff504439 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb6e1f50c1e446f29b003d0f68f02259', 'request_id': 'req-d6534622-8c21-46ea-a77a-6962ff504439'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:50.996606 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d6534622-8c21-46ea-a77a-6962ff504439 admin admin] The token cache is being invalidate because project eb6e1f50c1e446f29b003d0f68f02259 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:36:50.998450 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d6534622-8c21-46ea-a77a-6962ff504439 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:50.998938 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d6534622-8c21-46ea-a77a-6962ff504439 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:51.000618 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3530/7025] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:36:50 2022] DELETE /identity/v3/projects/eb6e1f50c1e446f29b003d0f68f02259 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:36:51.007479 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2130afe-45e8-43be-b3e6-149bfddbbb40 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:51.008015 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2130afe-45e8-43be-b3e6-149bfddbbb40 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:51.008118 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2130afe-45e8-43be-b3e6-149bfddbbb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:51.030394 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-c2130afe-45e8-43be-b3e6-149bfddbbb40 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:51.032010 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c2130afe-45e8-43be-b3e6-149bfddbbb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:51.080202 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6534622-8c21-46ea-a77a-6962ff504439 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:51.081633 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d6534622-8c21-46ea-a77a-6962ff504439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:51.131750 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3496/7026] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:36:51.139660 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86d2c1-a5c7-41a0-a567-c62b1cc447c2 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:51.140019 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86d2c1-a5c7-41a0-a567-c62b1cc447c2 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:51.140524 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86d2c1-a5c7-41a0-a567-c62b1cc447c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:51.171991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-cb86d2c1-a5c7-41a0-a567-c62b1cc447c2 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:51.174307 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-cb86d2c1-a5c7-41a0-a567-c62b1cc447c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:51.182974 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6534622-8c21-46ea-a77a-6962ff504439 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:51.187365 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3497/7027] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:36:51.191159 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a5927-28a8-4789-8ed4-a9fb1ebab80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:51.191323 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86d2c1-a5c7-41a0-a567-c62b1cc447c2 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:51.191428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a5927-28a8-4789-8ed4-a9fb1ebab80a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:51.199307 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a5927-28a8-4789-8ed4-a9fb1ebab80a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:51.199698 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a5927-28a8-4789-8ed4-a9fb1ebab80a admin admin] PATH_INFO: `/v3/users/e1bf425862e14fe4af624987e89c4808` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:51.201627 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a5927-28a8-4789-8ed4-a9fb1ebab80a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1bf425862e14fe4af624987e89c4808)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:51.204193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a5927-28a8-4789-8ed4-a9fb1ebab80a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:51.206212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86d2c1-a5c7-41a0-a567-c62b1cc447c2 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:51.213749 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2d999-fcbf-4ce0-a466-a82480d966d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:51.214097 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2d999-fcbf-4ce0-a466-a82480d966d2 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:51.214545 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2d999-fcbf-4ce0-a466-a82480d966d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:51.214932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2d999-fcbf-4ce0-a466-a82480d966d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:51.216094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba2d999-fcbf-4ce0-a466-a82480d966d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:36:51.216751 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba2d999-fcbf-4ce0-a466-a82480d966d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:51.218852 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba2d999-fcbf-4ce0-a466-a82480d966d2 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:51.241608 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3498/7028] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:36:51.242854 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2d999-fcbf-4ce0-a466-a82480d966d2 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:51.259238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2d999-fcbf-4ce0-a466-a82480d966d2 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:51.259238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d9eb4-f5d8-4250-b715-67dd6286f678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:51.259238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d9eb4-f5d8-4250-b715-67dd6286f678 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:51.259565 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d9eb4-f5d8-4250-b715-67dd6286f678 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:51.259657 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d9eb4-f5d8-4250-b715-67dd6286f678 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:51.260306 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d9eb4-f5d8-4250-b715-67dd6286f678 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:51.262293 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d9eb4-f5d8-4250-b715-67dd6286f678 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:51.380689 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3499/7029] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:36:51 2022] POST /identity/v3/projects => generated 371 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:36:51.385781 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d9eb4-f5d8-4250-b715-67dd6286f678 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:51.388101 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-eb7a5927-28a8-4789-8ed4-a9fb1ebab80a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1bf425862e14fe4af624987e89c4808'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:51.402320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-eb7a5927-28a8-4789-8ed4-a9fb1ebab80a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1bf425862e14fe4af624987e89c4808'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:51.457059 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d9eb4-f5d8-4250-b715-67dd6286f678 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:51.457564 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-eb7a5927-28a8-4789-8ed4-a9fb1ebab80a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1bf425862e14fe4af624987e89c4808'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:51.462598 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d4483-eb5b-4f63-aeea-948319b41f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:51.463370 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d4483-eb5b-4f63-aeea-948319b41f2e admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:51.464445 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d4483-eb5b-4f63-aeea-948319b41f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:51.464952 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d4483-eb5b-4f63-aeea-948319b41f2e admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:51.465659 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d4483-eb5b-4f63-aeea-948319b41f2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:51.468153 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d4483-eb5b-4f63-aeea-948319b41f2e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:51.481125 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-eb7a5927-28a8-4789-8ed4-a9fb1ebab80a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1bf425862e14fe4af624987e89c4808'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:51.482119 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-eb7a5927-28a8-4789-8ed4-a9fb1ebab80a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1bf425862e14fe4af624987e89c4808'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:51.489358 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3531/7030] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:36:51 2022] DELETE /identity/v3/users/e1bf425862e14fe4af624987e89c4808 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:36:51.495210 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29aa1b-4947-4668-ae96-f8542920d879 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:51.495753 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29aa1b-4947-4668-ae96-f8542920d879 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:51.496262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29aa1b-4947-4668-ae96-f8542920d879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:51.517643 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-2f29aa1b-4947-4668-ae96-f8542920d879 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:51.520167 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2f29aa1b-4947-4668-ae96-f8542920d879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:51.544695 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3500/7031] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:36:51 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:36:51.548593 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d4483-eb5b-4f63-aeea-948319b41f2e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:51.551971 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-af6d4483-eb5b-4f63-aeea-948319b41f2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:51.578149 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d4483-eb5b-4f63-aeea-948319b41f2e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:51.592575 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3532/7032] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:36:51.599723 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29aa1b-4947-4668-ae96-f8542920d879 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:51.601156 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2f29aa1b-4947-4668-ae96-f8542920d879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:51.662861 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47673880-dfb1-45b9-998f-6e4a7ab4da8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:51.662861 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47673880-dfb1-45b9-998f-6e4a7ab4da8f admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:51.662861 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47673880-dfb1-45b9-998f-6e4a7ab4da8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:51.662861 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47673880-dfb1-45b9-998f-6e4a7ab4da8f admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:51.663354 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47673880-dfb1-45b9-998f-6e4a7ab4da8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:51.664501 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47673880-dfb1-45b9-998f-6e4a7ab4da8f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:51.676291 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29aa1b-4947-4668-ae96-f8542920d879 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:51.685386 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addce388-47e6-4781-80a9-e1e72c379c42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:51.685386 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addce388-47e6-4781-80a9-e1e72c379c42 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:51.685386 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addce388-47e6-4781-80a9-e1e72c379c42 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:51.685386 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addce388-47e6-4781-80a9-e1e72c379c42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:51.692211 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3501/7033] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:36:51.695864 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47673880-dfb1-45b9-998f-6e4a7ab4da8f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:51.705360 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addce388-47e6-4781-80a9-e1e72c379c42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:51.707703 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addce388-47e6-4781-80a9-e1e72c379c42 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:51.714668 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47673880-dfb1-45b9-998f-6e4a7ab4da8f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:51.720938 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3533/7034] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:36:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:36:51.721281 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711b3c5-99e6-4600-b44e-9066bb148fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:51.722030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711b3c5-99e6-4600-b44e-9066bb148fcb admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:51.725842 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711b3c5-99e6-4600-b44e-9066bb148fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:51.725842 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711b3c5-99e6-4600-b44e-9066bb148fcb admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:51.725842 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7711b3c5-99e6-4600-b44e-9066bb148fcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:51.725842 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7711b3c5-99e6-4600-b44e-9066bb148fcb admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:51.748520 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3502/7035] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:36:51.754113 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addce388-47e6-4781-80a9-e1e72c379c42 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:51.784216 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addce388-47e6-4781-80a9-e1e72c379c42 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:51.812668 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc94c52-aff6-4eaa-aa3a-82024d8a00b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:51.812668 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc94c52-aff6-4eaa-aa3a-82024d8a00b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:51.812668 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc94c52-aff6-4eaa-aa3a-82024d8a00b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:51.812668 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc94c52-aff6-4eaa-aa3a-82024d8a00b8 admin admin] PATH_INFO: `/v3/projects/32b91fc23d5644a18d82148672014680/users/f56e19ef6f9447ebb46fa009c0fb5393/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:51.843339 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc94c52-aff6-4eaa-aa3a-82024d8a00b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32b91fc23d5644a18d82148672014680, user_id=f56e19ef6f9447ebb46fa009c0fb5393, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:51.846636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc94c52-aff6-4eaa-aa3a-82024d8a00b8 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:51.923981 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3534/7036] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:36:51 2022] PUT /identity/v3/projects/32b91fc23d5644a18d82148672014680/users/f56e19ef6f9447ebb46fa009c0fb5393/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:36:51.935397 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5270b-40e2-4659-bfe7-b9d18d12cfae None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:51.935831 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5270b-40e2-4659-bfe7-b9d18d12cfae None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:51.936111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5270b-40e2-4659-bfe7-b9d18d12cfae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:51.980884 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-b4b5270b-40e2-4659-bfe7-b9d18d12cfae None None] MFA Rules not processed for user `f56e19ef6f9447ebb46fa009c0fb5393`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:51.982129 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b4b5270b-40e2-4659-bfe7-b9d18d12cfae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:52.059092 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3503/7037] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:36:52.064421 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc94c52-aff6-4eaa-aa3a-82024d8a00b8 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:52.135961 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc94c52-aff6-4eaa-aa3a-82024d8a00b8 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:52.140944 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffe2fb-d15e-4d20-a2b3-f213973dea1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:52.141746 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffe2fb-d15e-4d20-a2b3-f213973dea1f admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:52.147813 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffe2fb-d15e-4d20-a2b3-f213973dea1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:52.147813 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ffe2fb-d15e-4d20-a2b3-f213973dea1f admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:52.147813 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ffe2fb-d15e-4d20-a2b3-f213973dea1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:52.147813 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ffe2fb-d15e-4d20-a2b3-f213973dea1f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:52.236148 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3535/7038] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:36:52 2022] POST /identity/v3/projects => generated 373 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:36:52.240337 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5270b-40e2-4659-bfe7-b9d18d12cfae None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:52.252182 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5270b-40e2-4659-bfe7-b9d18d12cfae None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:52.309814 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0bf9a-dd62-436c-ab99-7cb90df86b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:52.310485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0bf9a-dd62-436c-ab99-7cb90df86b15 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:52.310770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0bf9a-dd62-436c-ab99-7cb90df86b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:52.311048 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0bf9a-dd62-436c-ab99-7cb90df86b15 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:52.311740 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b0bf9a-dd62-436c-ab99-7cb90df86b15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:52.313773 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b0bf9a-dd62-436c-ab99-7cb90df86b15 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:52.326165 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffe2fb-d15e-4d20-a2b3-f213973dea1f admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:52.329016 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-85ffe2fb-d15e-4d20-a2b3-f213973dea1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:52.340833 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ffe2fb-d15e-4d20-a2b3-f213973dea1f admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:52.345498 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f7f67-e610-4c62-af5d-4fd17c5b886f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:52.346388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f7f67-e610-4c62-af5d-4fd17c5b886f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:52.346670 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f7f67-e610-4c62-af5d-4fd17c5b886f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:52.346951 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f7f67-e610-4c62-af5d-4fd17c5b886f admin admin] PATH_INFO: `/v3/projects/be521704a99543fca40d4dd36fe13681` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:52.348190 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f7f67-e610-4c62-af5d-4fd17c5b886f admin admin] RBAC: Authorizing `identity:delete_project(project_id=be521704a99543fca40d4dd36fe13681)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:52.350152 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f7f67-e610-4c62-af5d-4fd17c5b886f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:52.392619 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3504/7039] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:36:52 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:36:52.397098 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0bf9a-dd62-436c-ab99-7cb90df86b15 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:52.404346 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0bf9a-dd62-436c-ab99-7cb90df86b15 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:52.409281 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ad327-7357-4e85-8fd5-58898e1e529e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:52.409999 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ad327-7357-4e85-8fd5-58898e1e529e admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:52.410277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ad327-7357-4e85-8fd5-58898e1e529e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:52.410568 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ad327-7357-4e85-8fd5-58898e1e529e admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:52.411303 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547ad327-7357-4e85-8fd5-58898e1e529e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:52.412934 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547ad327-7357-4e85-8fd5-58898e1e529e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:52.428747 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3505/7040] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:36:52.429911 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ad327-7357-4e85-8fd5-58898e1e529e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:52.441224 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ad327-7357-4e85-8fd5-58898e1e529e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:52.446371 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47919891-220e-48d0-bbaa-9b21cae8b73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:52.447410 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47919891-220e-48d0-bbaa-9b21cae8b73c admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:52.447822 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47919891-220e-48d0-bbaa-9b21cae8b73c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:52.448733 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47919891-220e-48d0-bbaa-9b21cae8b73c admin admin] PATH_INFO: `/v3/projects/7d3a0025e7df4365aeadc982c3f471b0/users/f3095d34ed2f45cb8c2f57b00fd6ded7/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:52.466836 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47919891-220e-48d0-bbaa-9b21cae8b73c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d3a0025e7df4365aeadc982c3f471b0, user_id=f3095d34ed2f45cb8c2f57b00fd6ded7, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:52.469647 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47919891-220e-48d0-bbaa-9b21cae8b73c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:52.538734 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3506/7041] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:36:52 2022] PUT /identity/v3/projects/7d3a0025e7df4365aeadc982c3f471b0/users/f3095d34ed2f45cb8c2f57b00fd6ded7/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:36:52.542881 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47919891-220e-48d0-bbaa-9b21cae8b73c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:52.547023 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-394f7f67-e610-4c62-af5d-4fd17c5b886f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be521704a99543fca40d4dd36fe13681', 'request_id': 'req-394f7f67-e610-4c62-af5d-4fd17c5b886f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:52.554269 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-394f7f67-e610-4c62-af5d-4fd17c5b886f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be521704a99543fca40d4dd36fe13681', 'request_id': 'req-394f7f67-e610-4c62-af5d-4fd17c5b886f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:52.563420 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-394f7f67-e610-4c62-af5d-4fd17c5b886f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be521704a99543fca40d4dd36fe13681', 'request_id': 'req-394f7f67-e610-4c62-af5d-4fd17c5b886f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:52.635985 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47919891-220e-48d0-bbaa-9b21cae8b73c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:52.667931 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-394f7f67-e610-4c62-af5d-4fd17c5b886f admin admin] The token cache is being invalidate because project be521704a99543fca40d4dd36fe13681 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:36:52.668490 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-394f7f67-e610-4c62-af5d-4fd17c5b886f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:52.668869 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-394f7f67-e610-4c62-af5d-4fd17c5b886f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:52.670511 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3536/7042] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:36:52 2022] DELETE /identity/v3/projects/be521704a99543fca40d4dd36fe13681 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:36:52.674980 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f7f67-e610-4c62-af5d-4fd17c5b886f admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:52.676501 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-394f7f67-e610-4c62-af5d-4fd17c5b886f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:52.700749 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72037558-6268-45ed-8705-b976702eb486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:52.703786 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72037558-6268-45ed-8705-b976702eb486 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:52.703786 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72037558-6268-45ed-8705-b976702eb486 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:52.703786 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72037558-6268-45ed-8705-b976702eb486 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:52.703786 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72037558-6268-45ed-8705-b976702eb486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:52.705129 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72037558-6268-45ed-8705-b976702eb486 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:52.716221 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3507/7043] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:36:52.721112 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72037558-6268-45ed-8705-b976702eb486 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:52.722867 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-72037558-6268-45ed-8705-b976702eb486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:52.736161 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72037558-6268-45ed-8705-b976702eb486 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:52.742274 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8eb7e8-c0ed-486a-b51e-3a196e69e9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:52.743290 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8eb7e8-c0ed-486a-b51e-3a196e69e9a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:52.743640 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8eb7e8-c0ed-486a-b51e-3a196e69e9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:52.744023 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8eb7e8-c0ed-486a-b51e-3a196e69e9a1 admin admin] PATH_INFO: `/v3/projects/7d3a0025e7df4365aeadc982c3f471b0/users/f3095d34ed2f45cb8c2f57b00fd6ded7/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:52.746426 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8eb7e8-c0ed-486a-b51e-3a196e69e9a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d3a0025e7df4365aeadc982c3f471b0, user_id=f3095d34ed2f45cb8c2f57b00fd6ded7, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:52.749908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8eb7e8-c0ed-486a-b51e-3a196e69e9a1 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:52.755477 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f7f67-e610-4c62-af5d-4fd17c5b886f admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:52.757404 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd49d3-9e08-4340-aaa7-317506348284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:52.758431 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd49d3-9e08-4340-aaa7-317506348284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:52.759411 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd49d3-9e08-4340-aaa7-317506348284 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:52.759411 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd49d3-9e08-4340-aaa7-317506348284 admin admin] PATH_INFO: `/v3/users/df1944d2e07945b093204d2347e1216e` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:52.760426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd49d3-9e08-4340-aaa7-317506348284 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df1944d2e07945b093204d2347e1216e)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:52.762487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd49d3-9e08-4340-aaa7-317506348284 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:52.765845 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3508/7044] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:36:52 2022] PUT /identity/v3/projects/7d3a0025e7df4365aeadc982c3f471b0/users/f3095d34ed2f45cb8c2f57b00fd6ded7/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:36:52.776171 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733106d-310a-418c-9ee9-391d68dfa0fc None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:52.776619 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733106d-310a-418c-9ee9-391d68dfa0fc None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:52.778472 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733106d-310a-418c-9ee9-391d68dfa0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:52.806881 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-1733106d-310a-418c-9ee9-391d68dfa0fc None None] MFA Rules not processed for user `f3095d34ed2f45cb8c2f57b00fd6ded7`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:52.807122 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1733106d-310a-418c-9ee9-391d68dfa0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:52.893386 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3509/7045] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:36:52.905869 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733106d-310a-418c-9ee9-391d68dfa0fc None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:52.913697 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1733106d-310a-418c-9ee9-391d68dfa0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:52.942682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7bdd49d3-9e08-4340-aaa7-317506348284 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df1944d2e07945b093204d2347e1216e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:52.955400 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7bdd49d3-9e08-4340-aaa7-317506348284 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df1944d2e07945b093204d2347e1216e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:52.976149 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733106d-310a-418c-9ee9-391d68dfa0fc None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:52.981275 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486110e-0795-46b5-b01e-b08606679118 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:52.982300 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486110e-0795-46b5-b01e-b08606679118 service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:52.982592 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486110e-0795-46b5-b01e-b08606679118 service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:52.982875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486110e-0795-46b5-b01e-b08606679118 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:52.994143 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d486110e-0795-46b5-b01e-b08606679118 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:52.995615 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d486110e-0795-46b5-b01e-b08606679118 service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:53.006498 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3510/7046] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:36:52 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:36:53.011835 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7bdd49d3-9e08-4340-aaa7-317506348284 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df1944d2e07945b093204d2347e1216e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:53.020747 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7bdd49d3-9e08-4340-aaa7-317506348284 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df1944d2e07945b093204d2347e1216e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:53.021611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7bdd49d3-9e08-4340-aaa7-317506348284 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df1944d2e07945b093204d2347e1216e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:53.029028 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3537/7047] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:36:52 2022] DELETE /identity/v3/users/df1944d2e07945b093204d2347e1216e => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:36:53.811203 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486110e-0795-46b5-b01e-b08606679118 service cinder] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:53.889157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486110e-0795-46b5-b01e-b08606679118 service cinder] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:53.959709 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207b157-66bf-4f34-a0ac-a349687a3e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:53.960621 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207b157-66bf-4f34-a0ac-a349687a3e62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:53.960919 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207b157-66bf-4f34-a0ac-a349687a3e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:53.961181 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207b157-66bf-4f34-a0ac-a349687a3e62 admin admin] PATH_INFO: `/v3/projects/569397b97c444e51b8cc6f64fb6120b7` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:53.965080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207b157-66bf-4f34-a0ac-a349687a3e62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=569397b97c444e51b8cc6f64fb6120b7)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:53.967304 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207b157-66bf-4f34-a0ac-a349687a3e62 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:54.114712 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3207b157-66bf-4f34-a0ac-a349687a3e62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '569397b97c444e51b8cc6f64fb6120b7', 'request_id': 'req-3207b157-66bf-4f34-a0ac-a349687a3e62'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:54.120533 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3207b157-66bf-4f34-a0ac-a349687a3e62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '569397b97c444e51b8cc6f64fb6120b7', 'request_id': 'req-3207b157-66bf-4f34-a0ac-a349687a3e62'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:54.128055 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3207b157-66bf-4f34-a0ac-a349687a3e62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '569397b97c444e51b8cc6f64fb6120b7', 'request_id': 'req-3207b157-66bf-4f34-a0ac-a349687a3e62'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:54.213335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd49d3-9e08-4340-aaa7-317506348284 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:54.217094 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7bdd49d3-9e08-4340-aaa7-317506348284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:54.222502 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3207b157-66bf-4f34-a0ac-a349687a3e62 admin admin] The token cache is being invalidate because project 569397b97c444e51b8cc6f64fb6120b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:36:54.223035 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3207b157-66bf-4f34-a0ac-a349687a3e62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:54.223920 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3207b157-66bf-4f34-a0ac-a349687a3e62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:54.227101 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3511/7048] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:36:53 2022] DELETE /identity/v3/projects/569397b97c444e51b8cc6f64fb6120b7 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:36:54.231132 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6f62a-cbff-4e08-b225-00199939240e None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:54.232115 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6f62a-cbff-4e08-b225-00199939240e None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:54.232997 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6f62a-cbff-4e08-b225-00199939240e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:54.256326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-f2f6f62a-cbff-4e08-b225-00199939240e None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:54.257723 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f2f6f62a-cbff-4e08-b225-00199939240e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:54.275348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd49d3-9e08-4340-aaa7-317506348284 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:54.347205 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3512/7049] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:36:54.355401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b235b-b26c-4e53-b105-57cf7fe928c1 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:54.355757 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b235b-b26c-4e53-b105-57cf7fe928c1 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:54.355973 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b235b-b26c-4e53-b105-57cf7fe928c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:54.388610 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-535b235b-b26c-4e53-b105-57cf7fe928c1 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:54.390225 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-535b235b-b26c-4e53-b105-57cf7fe928c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:54.402689 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa466fc-74db-4d96-8328-982086116fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:54.403723 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa466fc-74db-4d96-8328-982086116fa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:54.404309 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa466fc-74db-4d96-8328-982086116fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:54.404597 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa466fc-74db-4d96-8328-982086116fa4 admin admin] PATH_INFO: `/v3/users/f56e19ef6f9447ebb46fa009c0fb5393` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:54.406470 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa466fc-74db-4d96-8328-982086116fa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f56e19ef6f9447ebb46fa009c0fb5393)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:54.408467 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa466fc-74db-4d96-8328-982086116fa4 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:54.413980 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3513/7050] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:36:54.416765 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b235b-b26c-4e53-b105-57cf7fe928c1 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:54.431948 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b235b-b26c-4e53-b105-57cf7fe928c1 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:54.445604 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c7136-b2c3-421e-b73e-28546ee6f7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:54.451380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c7136-b2c3-421e-b73e-28546ee6f7ba admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:54.451970 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c7136-b2c3-421e-b73e-28546ee6f7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:54.452420 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c7136-b2c3-421e-b73e-28546ee6f7ba admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:54.453363 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c7136-b2c3-421e-b73e-28546ee6f7ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:36:54.454136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c7136-b2c3-421e-b73e-28546ee6f7ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:54.456705 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c7136-b2c3-421e-b73e-28546ee6f7ba admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:54.497409 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3514/7051] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:36:54.506838 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c7136-b2c3-421e-b73e-28546ee6f7ba admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:54.530149 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c7136-b2c3-421e-b73e-28546ee6f7ba admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:54.535847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907aac63-3dd5-4c48-81af-405006bd5f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:54.536524 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907aac63-3dd5-4c48-81af-405006bd5f69 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:54.536809 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907aac63-3dd5-4c48-81af-405006bd5f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:54.537087 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907aac63-3dd5-4c48-81af-405006bd5f69 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:54.546276 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907aac63-3dd5-4c48-81af-405006bd5f69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:54.548451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907aac63-3dd5-4c48-81af-405006bd5f69 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:54.653262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-faa466fc-74db-4d96-8328-982086116fa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f56e19ef6f9447ebb46fa009c0fb5393'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:54.675093 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-faa466fc-74db-4d96-8328-982086116fa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f56e19ef6f9447ebb46fa009c0fb5393'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:54.712971 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3515/7052] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:36:54 2022] POST /identity/v3/projects => generated 371 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:36:54.717131 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907aac63-3dd5-4c48-81af-405006bd5f69 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:54.744081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-faa466fc-74db-4d96-8328-982086116fa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f56e19ef6f9447ebb46fa009c0fb5393'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:54.754630 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-faa466fc-74db-4d96-8328-982086116fa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f56e19ef6f9447ebb46fa009c0fb5393'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:54.755821 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-faa466fc-74db-4d96-8328-982086116fa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f56e19ef6f9447ebb46fa009c0fb5393'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:54.763563 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3538/7053] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:36:54 2022] DELETE /identity/v3/users/f56e19ef6f9447ebb46fa009c0fb5393 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:36:54.767957 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617d523-3f36-44ae-9566-101049fdf32f None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:54.768385 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617d523-3f36-44ae-9566-101049fdf32f None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:54.769223 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617d523-3f36-44ae-9566-101049fdf32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:54.800346 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-a617d523-3f36-44ae-9566-101049fdf32f None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:54.801732 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a617d523-3f36-44ae-9566-101049fdf32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:54.846584 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907aac63-3dd5-4c48-81af-405006bd5f69 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:54.892745 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3539/7054] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:36:54.904960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617d523-3f36-44ae-9566-101049fdf32f None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:54.908165 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a617d523-3f36-44ae-9566-101049fdf32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:54.939472 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee5bc1-e183-4909-8ef9-ec255eaf8de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:54.940157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee5bc1-e183-4909-8ef9-ec255eaf8de3 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:54.940442 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee5bc1-e183-4909-8ef9-ec255eaf8de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:54.940720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee5bc1-e183-4909-8ef9-ec255eaf8de3 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:54.941406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee5bc1-e183-4909-8ef9-ec255eaf8de3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:54.943392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee5bc1-e183-4909-8ef9-ec255eaf8de3 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:54.988630 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617d523-3f36-44ae-9566-101049fdf32f None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:54.993491 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a7cb9-1fc9-4b5b-aa68-1935c3fa5a8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:54.993951 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a7cb9-1fc9-4b5b-aa68-1935c3fa5a8c service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:54.994142 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a7cb9-1fc9-4b5b-aa68-1935c3fa5a8c service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:54.994418 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a7cb9-1fc9-4b5b-aa68-1935c3fa5a8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:55.005527 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5a7cb9-1fc9-4b5b-aa68-1935c3fa5a8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:55.006950 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5a7cb9-1fc9-4b5b-aa68-1935c3fa5a8c service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:55.007630 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3516/7055] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:36:54 2022] POST /identity/v3/users => generated 286 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:36:55.011350 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee5bc1-e183-4909-8ef9-ec255eaf8de3 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:55.013374 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a9ee5bc1-e183-4909-8ef9-ec255eaf8de3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:55.019203 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3540/7056] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:36:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:36:55.033618 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee5bc1-e183-4909-8ef9-ec255eaf8de3 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:55.035064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a7cb9-1fc9-4b5b-aa68-1935c3fa5a8c service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:55.037220 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0b5a7cb9-1fc9-4b5b-aa68-1935c3fa5a8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:55.038078 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56879180-5dc4-4edf-b966-fcf06618e49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:55.038757 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56879180-5dc4-4edf-b966-fcf06618e49b admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:55.039053 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56879180-5dc4-4edf-b966-fcf06618e49b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:55.039312 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56879180-5dc4-4edf-b966-fcf06618e49b admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:55.040105 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56879180-5dc4-4edf-b966-fcf06618e49b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:55.041646 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56879180-5dc4-4edf-b966-fcf06618e49b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:55.061818 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3517/7057] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:36:55.063381 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a7cb9-1fc9-4b5b-aa68-1935c3fa5a8c service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:55.063853 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56879180-5dc4-4edf-b966-fcf06618e49b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:55.080606 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56879180-5dc4-4edf-b966-fcf06618e49b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:55.083104 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1962006-55e7-42bf-87c8-9b3a1c07fb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:55.084439 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1962006-55e7-42bf-87c8-9b3a1c07fb45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:55.085886 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1962006-55e7-42bf-87c8-9b3a1c07fb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:55.086190 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1962006-55e7-42bf-87c8-9b3a1c07fb45 admin admin] PATH_INFO: `/v3/users/1322fb2495ad42779699d4802f222ba7` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:55.087866 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d1c6e-2dde-4ef3-b2ff-c1b6def46478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:55.088550 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d1c6e-2dde-4ef3-b2ff-c1b6def46478 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:55.088911 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d1c6e-2dde-4ef3-b2ff-c1b6def46478 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:55.089191 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d1c6e-2dde-4ef3-b2ff-c1b6def46478 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:55.090242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d1c6e-2dde-4ef3-b2ff-c1b6def46478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:55.090447 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1962006-55e7-42bf-87c8-9b3a1c07fb45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1322fb2495ad42779699d4802f222ba7)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:55.092567 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d1c6e-2dde-4ef3-b2ff-c1b6def46478 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:55.093578 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1962006-55e7-42bf-87c8-9b3a1c07fb45 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:55.107241 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3518/7058] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:36:55.112107 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d1c6e-2dde-4ef3-b2ff-c1b6def46478 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:55.151607 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d1c6e-2dde-4ef3-b2ff-c1b6def46478 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:55.159620 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d171fc0-0b27-4047-a093-0d429ca81cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:55.160534 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d171fc0-0b27-4047-a093-0d429ca81cf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:55.160819 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d171fc0-0b27-4047-a093-0d429ca81cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:55.161098 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d171fc0-0b27-4047-a093-0d429ca81cf1 admin admin] PATH_INFO: `/v3/projects/cea651c087e04b579cee7a23e8ba9576/users/3064a1d58445411a960a2c11c5b91146/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:55.178132 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d171fc0-0b27-4047-a093-0d429ca81cf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cea651c087e04b579cee7a23e8ba9576, user_id=3064a1d58445411a960a2c11c5b91146, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:55.182021 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d171fc0-0b27-4047-a093-0d429ca81cf1 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:55.323243 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3519/7059] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:36:55 2022] PUT /identity/v3/projects/cea651c087e04b579cee7a23e8ba9576/users/3064a1d58445411a960a2c11c5b91146/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:36:55.336522 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed1496-55c9-46a7-8f81-7f374745216b None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:55.337218 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed1496-55c9-46a7-8f81-7f374745216b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:55.337716 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed1496-55c9-46a7-8f81-7f374745216b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:55.371193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e1962006-55e7-42bf-87c8-9b3a1c07fb45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1322fb2495ad42779699d4802f222ba7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:55.396229 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-bbed1496-55c9-46a7-8f81-7f374745216b None None] MFA Rules not processed for user `3064a1d58445411a960a2c11c5b91146`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:55.400445 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-bbed1496-55c9-46a7-8f81-7f374745216b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:55.406683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e1962006-55e7-42bf-87c8-9b3a1c07fb45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1322fb2495ad42779699d4802f222ba7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:55.485808 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e1962006-55e7-42bf-87c8-9b3a1c07fb45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1322fb2495ad42779699d4802f222ba7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:55.494469 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e1962006-55e7-42bf-87c8-9b3a1c07fb45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1322fb2495ad42779699d4802f222ba7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:55.495523 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e1962006-55e7-42bf-87c8-9b3a1c07fb45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1322fb2495ad42779699d4802f222ba7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:55.498941 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3520/7060] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:36:55.511462 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed1496-55c9-46a7-8f81-7f374745216b None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:55.526405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-bbed1496-55c9-46a7-8f81-7f374745216b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:55.540692 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3541/7061] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:36:55 2022] DELETE /identity/v3/users/1322fb2495ad42779699d4802f222ba7 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:36:55.546651 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579bd1e-c46b-48e2-8af4-e924cee3f4de None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:55.547032 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579bd1e-c46b-48e2-8af4-e924cee3f4de None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:55.547524 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579bd1e-c46b-48e2-8af4-e924cee3f4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:55.606214 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-a579bd1e-c46b-48e2-8af4-e924cee3f4de None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:55.607747 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a579bd1e-c46b-48e2-8af4-e924cee3f4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:55.627901 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed1496-55c9-46a7-8f81-7f374745216b None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:55.709439 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3542/7062] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:36:55.711085 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db8b97-0373-4a78-934d-df46d97b56b8 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:55.711383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db8b97-0373-4a78-934d-df46d97b56b8 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:55.711667 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db8b97-0373-4a78-934d-df46d97b56b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:55.727096 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36958b-6575-476e-8228-c06b1c889167 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:55.727096 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36958b-6575-476e-8228-c06b1c889167 service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:55.727096 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36958b-6575-476e-8228-c06b1c889167 service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:55.727096 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36958b-6575-476e-8228-c06b1c889167 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:55.728667 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1d36958b-6575-476e-8228-c06b1c889167 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:55.751635 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-93db8b97-0373-4a78-934d-df46d97b56b8 None None] MFA Rules not processed for user `3107c6d79451405a963c5816d92055b3`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:55.755756 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-93db8b97-0373-4a78-934d-df46d97b56b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:55.847731 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3543/7063] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:55 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:36:55.848733 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db8b97-0373-4a78-934d-df46d97b56b8 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:55.850232 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-93db8b97-0373-4a78-934d-df46d97b56b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:55.865243 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db8b97-0373-4a78-934d-df46d97b56b8 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:55.867792 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d36958b-6575-476e-8228-c06b1c889167 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:55.869894 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d36958b-6575-476e-8228-c06b1c889167 service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:55.870508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c41c03-1a0f-4705-ab3e-807b73a6a08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:55.871341 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c41c03-1a0f-4705-ab3e-807b73a6a08d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:55.871697 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c41c03-1a0f-4705-ab3e-807b73a6a08d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:55.872478 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c41c03-1a0f-4705-ab3e-807b73a6a08d admin admin] PATH_INFO: `/v3/projects/32b91fc23d5644a18d82148672014680` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:55.873799 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c41c03-1a0f-4705-ab3e-807b73a6a08d admin admin] RBAC: Authorizing `identity:delete_project(project_id=32b91fc23d5644a18d82148672014680)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:55.875568 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c41c03-1a0f-4705-ab3e-807b73a6a08d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:55.888401 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3521/7064] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:36:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:36:55.889401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36958b-6575-476e-8228-c06b1c889167 service cinder] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:55.897985 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1d36958b-6575-476e-8228-c06b1c889167 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:55.981607 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d36958b-6575-476e-8228-c06b1c889167 service cinder] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:55.985317 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41406210-9ebd-48d0-8c3a-8ecfaf2ddd11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:55.986772 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41406210-9ebd-48d0-8c3a-8ecfaf2ddd11 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:55.989320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41406210-9ebd-48d0-8c3a-8ecfaf2ddd11 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:55.989320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41406210-9ebd-48d0-8c3a-8ecfaf2ddd11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:55.997510 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41406210-9ebd-48d0-8c3a-8ecfaf2ddd11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:56.003264 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41406210-9ebd-48d0-8c3a-8ecfaf2ddd11 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:56.017892 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3522/7065] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:36:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:36:56.019155 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41406210-9ebd-48d0-8c3a-8ecfaf2ddd11 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:56.021158 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-41406210-9ebd-48d0-8c3a-8ecfaf2ddd11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:56.022897 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-23c41c03-1a0f-4705-ab3e-807b73a6a08d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32b91fc23d5644a18d82148672014680', 'request_id': 'req-23c41c03-1a0f-4705-ab3e-807b73a6a08d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:56.035281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-23c41c03-1a0f-4705-ab3e-807b73a6a08d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32b91fc23d5644a18d82148672014680', 'request_id': 'req-23c41c03-1a0f-4705-ab3e-807b73a6a08d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:56.039631 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41406210-9ebd-48d0-8c3a-8ecfaf2ddd11 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:56.043278 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-23c41c03-1a0f-4705-ab3e-807b73a6a08d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32b91fc23d5644a18d82148672014680', 'request_id': 'req-23c41c03-1a0f-4705-ab3e-807b73a6a08d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:56.128943 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-23c41c03-1a0f-4705-ab3e-807b73a6a08d admin admin] The token cache is being invalidate because project 32b91fc23d5644a18d82148672014680 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:36:56.129689 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-23c41c03-1a0f-4705-ab3e-807b73a6a08d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:56.130466 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-23c41c03-1a0f-4705-ab3e-807b73a6a08d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:56.132139 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3544/7066] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:36:55 2022] DELETE /identity/v3/projects/32b91fc23d5644a18d82148672014680 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:36:56.136562 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c41c03-1a0f-4705-ab3e-807b73a6a08d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:56.137372 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e31c8-bb01-47a1-9a05-f2e37e0d010c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:56.138204 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-23c41c03-1a0f-4705-ab3e-807b73a6a08d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:56.138710 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e31c8-bb01-47a1-9a05-f2e37e0d010c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:56.141833 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e31c8-bb01-47a1-9a05-f2e37e0d010c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:56.141833 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e31c8-bb01-47a1-9a05-f2e37e0d010c admin admin] PATH_INFO: `/v3/users/3064a1d58445411a960a2c11c5b91146` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:56.141833 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e31c8-bb01-47a1-9a05-f2e37e0d010c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3064a1d58445411a960a2c11c5b91146)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:56.144510 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e31c8-bb01-47a1-9a05-f2e37e0d010c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:56.161342 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c41c03-1a0f-4705-ab3e-807b73a6a08d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:56.170006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abe32d-e75a-42bf-9b62-da36bb0588c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:56.170895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abe32d-e75a-42bf-9b62-da36bb0588c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:56.171199 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abe32d-e75a-42bf-9b62-da36bb0588c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:56.177746 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abe32d-e75a-42bf-9b62-da36bb0588c8 admin admin] PATH_INFO: `/v3/users/f3095d34ed2f45cb8c2f57b00fd6ded7` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:56.177746 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6abe32d-e75a-42bf-9b62-da36bb0588c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3095d34ed2f45cb8c2f57b00fd6ded7)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:56.178605 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6abe32d-e75a-42bf-9b62-da36bb0588c8 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:56.361257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e23e31c8-bb01-47a1-9a05-f2e37e0d010c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3064a1d58445411a960a2c11c5b91146'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:56.386356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c6abe32d-e75a-42bf-9b62-da36bb0588c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3095d34ed2f45cb8c2f57b00fd6ded7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:56.388247 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e23e31c8-bb01-47a1-9a05-f2e37e0d010c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3064a1d58445411a960a2c11c5b91146'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:56.410344 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c6abe32d-e75a-42bf-9b62-da36bb0588c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3095d34ed2f45cb8c2f57b00fd6ded7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:56.527604 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e23e31c8-bb01-47a1-9a05-f2e37e0d010c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3064a1d58445411a960a2c11c5b91146'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:56.529117 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e23e31c8-bb01-47a1-9a05-f2e37e0d010c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3064a1d58445411a960a2c11c5b91146'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:56.539011 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e23e31c8-bb01-47a1-9a05-f2e37e0d010c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3064a1d58445411a960a2c11c5b91146'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:56.572901 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3523/7067] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:36:56 2022] DELETE /identity/v3/users/3064a1d58445411a960a2c11c5b91146 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:36:56.574879 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e8dcb-0247-46a6-a3a7-2e22844d866a None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:56.575286 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e8dcb-0247-46a6-a3a7-2e22844d866a None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:56.575633 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e8dcb-0247-46a6-a3a7-2e22844d866a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:56.593412 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c6abe32d-e75a-42bf-9b62-da36bb0588c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3095d34ed2f45cb8c2f57b00fd6ded7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:56.602652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c6abe32d-e75a-42bf-9b62-da36bb0588c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3095d34ed2f45cb8c2f57b00fd6ded7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:56.603224 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-ce1e8dcb-0247-46a6-a3a7-2e22844d866a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:56.604015 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c6abe32d-e75a-42bf-9b62-da36bb0588c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3095d34ed2f45cb8c2f57b00fd6ded7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:56.604638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ce1e8dcb-0247-46a6-a3a7-2e22844d866a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:56.614782 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3545/7068] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:36:56 2022] DELETE /identity/v3/users/f3095d34ed2f45cb8c2f57b00fd6ded7 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:36:56.682865 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3524/7069] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:36:56.708486 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abe32d-e75a-42bf-9b62-da36bb0588c8 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:56.710332 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c6abe32d-e75a-42bf-9b62-da36bb0588c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:56.820770 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abe32d-e75a-42bf-9b62-da36bb0588c8 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:56.828982 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e8dcb-0247-46a6-a3a7-2e22844d866a None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:56.829679 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac8e88-c4ee-4516-81cc-9fc847919583 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:56.831384 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ce1e8dcb-0247-46a6-a3a7-2e22844d866a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:56.834328 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac8e88-c4ee-4516-81cc-9fc847919583 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:56.835122 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac8e88-c4ee-4516-81cc-9fc847919583 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:56.835393 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac8e88-c4ee-4516-81cc-9fc847919583 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:56.858344 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e8dcb-0247-46a6-a3a7-2e22844d866a None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:57.007378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301959ea-e39f-4580-a190-91a5da82dd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:57.012935 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301959ea-e39f-4580-a190-91a5da82dd89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:57.013529 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301959ea-e39f-4580-a190-91a5da82dd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:57.014106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301959ea-e39f-4580-a190-91a5da82dd89 admin admin] PATH_INFO: `/v3/projects/39de769226a747dcb4299123cbd102ac` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:57.015695 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301959ea-e39f-4580-a190-91a5da82dd89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39de769226a747dcb4299123cbd102ac)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:57.016030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac8e88-c4ee-4516-81cc-9fc847919583 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:57.017550 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac8e88-c4ee-4516-81cc-9fc847919583 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:57.018386 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301959ea-e39f-4580-a190-91a5da82dd89 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:57.071574 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3546/7070] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:36:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:36:57.175374 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-301959ea-e39f-4580-a190-91a5da82dd89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39de769226a747dcb4299123cbd102ac', 'request_id': 'req-301959ea-e39f-4580-a190-91a5da82dd89'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:57.187997 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-301959ea-e39f-4580-a190-91a5da82dd89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39de769226a747dcb4299123cbd102ac', 'request_id': 'req-301959ea-e39f-4580-a190-91a5da82dd89'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:57.199041 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-301959ea-e39f-4580-a190-91a5da82dd89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39de769226a747dcb4299123cbd102ac', 'request_id': 'req-301959ea-e39f-4580-a190-91a5da82dd89'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:57.350389 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-301959ea-e39f-4580-a190-91a5da82dd89 admin admin] The token cache is being invalidate because project 39de769226a747dcb4299123cbd102ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:36:57.350389 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-301959ea-e39f-4580-a190-91a5da82dd89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:57.352703 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-301959ea-e39f-4580-a190-91a5da82dd89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:57.354614 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3525/7071] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:36:56 2022] DELETE /identity/v3/projects/39de769226a747dcb4299123cbd102ac => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:36:57.360098 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac8e88-c4ee-4516-81cc-9fc847919583 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:57.369696 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac8e88-c4ee-4516-81cc-9fc847919583 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:57.435855 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6240a0-54cd-40f8-a926-9393ebaa2d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:57.436742 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6240a0-54cd-40f8-a926-9393ebaa2d47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:57.437027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6240a0-54cd-40f8-a926-9393ebaa2d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:57.437306 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6240a0-54cd-40f8-a926-9393ebaa2d47 admin admin] PATH_INFO: `/v3/users/6ae62bd97b1b490f8eed2de60ca5dd76` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:57.439962 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6240a0-54cd-40f8-a926-9393ebaa2d47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ae62bd97b1b490f8eed2de60ca5dd76)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:57.444709 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301959ea-e39f-4580-a190-91a5da82dd89 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:57.444988 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6240a0-54cd-40f8-a926-9393ebaa2d47 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:57.448619 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-301959ea-e39f-4580-a190-91a5da82dd89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:57.479490 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301959ea-e39f-4580-a190-91a5da82dd89 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:57.505263 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791354c0-8508-41c9-9acc-1e8a43b7aed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:57.507054 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791354c0-8508-41c9-9acc-1e8a43b7aed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:57.507550 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791354c0-8508-41c9-9acc-1e8a43b7aed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:57.508066 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791354c0-8508-41c9-9acc-1e8a43b7aed0 admin admin] PATH_INFO: `/v3/projects/7d3a0025e7df4365aeadc982c3f471b0` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:57.509933 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791354c0-8508-41c9-9acc-1e8a43b7aed0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d3a0025e7df4365aeadc982c3f471b0)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:57.512329 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791354c0-8508-41c9-9acc-1e8a43b7aed0 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:57.767631 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bc6240a0-54cd-40f8-a926-9393ebaa2d47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ae62bd97b1b490f8eed2de60ca5dd76'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:57.787173 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-791354c0-8508-41c9-9acc-1e8a43b7aed0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d3a0025e7df4365aeadc982c3f471b0', 'request_id': 'req-791354c0-8508-41c9-9acc-1e8a43b7aed0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:57.787350 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bc6240a0-54cd-40f8-a926-9393ebaa2d47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ae62bd97b1b490f8eed2de60ca5dd76'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:57.803493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-791354c0-8508-41c9-9acc-1e8a43b7aed0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d3a0025e7df4365aeadc982c3f471b0', 'request_id': 'req-791354c0-8508-41c9-9acc-1e8a43b7aed0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:57.815017 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-791354c0-8508-41c9-9acc-1e8a43b7aed0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d3a0025e7df4365aeadc982c3f471b0', 'request_id': 'req-791354c0-8508-41c9-9acc-1e8a43b7aed0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:57.873833 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bc6240a0-54cd-40f8-a926-9393ebaa2d47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ae62bd97b1b490f8eed2de60ca5dd76'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:57.882550 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bc6240a0-54cd-40f8-a926-9393ebaa2d47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ae62bd97b1b490f8eed2de60ca5dd76'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:57.883327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bc6240a0-54cd-40f8-a926-9393ebaa2d47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ae62bd97b1b490f8eed2de60ca5dd76'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:57.896100 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3547/7072] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:36:57 2022] DELETE /identity/v3/users/6ae62bd97b1b490f8eed2de60ca5dd76 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:36:57.896100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6240a0-54cd-40f8-a926-9393ebaa2d47 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:57.896100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-bc6240a0-54cd-40f8-a926-9393ebaa2d47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:57.953061 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-791354c0-8508-41c9-9acc-1e8a43b7aed0 admin admin] The token cache is being invalidate because project 7d3a0025e7df4365aeadc982c3f471b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:36:57.953461 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-791354c0-8508-41c9-9acc-1e8a43b7aed0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:57.954725 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-791354c0-8508-41c9-9acc-1e8a43b7aed0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:57.956386 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3526/7073] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:36:57 2022] DELETE /identity/v3/projects/7d3a0025e7df4365aeadc982c3f471b0 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:36:57.961120 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9985f-fcc4-42a0-a88d-5e620a948215 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:57.961475 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9985f-fcc4-42a0-a88d-5e620a948215 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:57.961792 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9985f-fcc4-42a0-a88d-5e620a948215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:57.962601 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6240a0-54cd-40f8-a926-9393ebaa2d47 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:57.967147 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104fd71-7ff5-401d-a207-dd2617df20ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:57.968000 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104fd71-7ff5-401d-a207-dd2617df20ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:57.968279 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104fd71-7ff5-401d-a207-dd2617df20ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:57.968558 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104fd71-7ff5-401d-a207-dd2617df20ee admin admin] PATH_INFO: `/v3/projects/cea651c087e04b579cee7a23e8ba9576` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:57.970438 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f104fd71-7ff5-401d-a207-dd2617df20ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=cea651c087e04b579cee7a23e8ba9576)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:57.977442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f104fd71-7ff5-401d-a207-dd2617df20ee admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:57.981790 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-b0e9985f-fcc4-42a0-a88d-5e620a948215 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:57.983024 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b0e9985f-fcc4-42a0-a88d-5e620a948215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:57.991795 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3527/7074] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:36:57.999682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a01c9-c42a-4a9d-bbb4-3f747945d36a None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:57.999972 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a01c9-c42a-4a9d-bbb4-3f747945d36a None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:58.000250 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a01c9-c42a-4a9d-bbb4-3f747945d36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:58.017909 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-ff5a01c9-c42a-4a9d-bbb4-3f747945d36a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:58.019092 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ff5a01c9-c42a-4a9d-bbb4-3f747945d36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:58.027610 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3528/7075] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:36:58.031712 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a01c9-c42a-4a9d-bbb4-3f747945d36a None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:58.041327 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a01c9-c42a-4a9d-bbb4-3f747945d36a None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:58.045889 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83bd366-3998-49d9-9e62-7bd9a2f7957c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:58.046519 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bd366-3998-49d9-9e62-7bd9a2f7957c admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:58.046805 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bd366-3998-49d9-9e62-7bd9a2f7957c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:58.047083 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bd366-3998-49d9-9e62-7bd9a2f7957c admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:58.047811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83bd366-3998-49d9-9e62-7bd9a2f7957c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:36:58.048682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83bd366-3998-49d9-9e62-7bd9a2f7957c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:58.050401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83bd366-3998-49d9-9e62-7bd9a2f7957c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:58.067116 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3529/7076] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:36:58.071056 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83bd366-3998-49d9-9e62-7bd9a2f7957c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:58.086275 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83bd366-3998-49d9-9e62-7bd9a2f7957c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:58.089830 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaae434-7dc6-46ef-a9d2-74e5c3e0e6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:58.090501 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaae434-7dc6-46ef-a9d2-74e5c3e0e6b3 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:58.090785 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaae434-7dc6-46ef-a9d2-74e5c3e0e6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:58.091066 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaae434-7dc6-46ef-a9d2-74e5c3e0e6b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:58.091758 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaae434-7dc6-46ef-a9d2-74e5c3e0e6b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:58.093722 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaae434-7dc6-46ef-a9d2-74e5c3e0e6b3 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:58.132280 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f104fd71-7ff5-401d-a207-dd2617df20ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cea651c087e04b579cee7a23e8ba9576', 'request_id': 'req-f104fd71-7ff5-401d-a207-dd2617df20ee'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:58.138270 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f104fd71-7ff5-401d-a207-dd2617df20ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cea651c087e04b579cee7a23e8ba9576', 'request_id': 'req-f104fd71-7ff5-401d-a207-dd2617df20ee'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:58.145467 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f104fd71-7ff5-401d-a207-dd2617df20ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cea651c087e04b579cee7a23e8ba9576', 'request_id': 'req-f104fd71-7ff5-401d-a207-dd2617df20ee'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:58.216707 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3530/7077] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:36:58 2022] POST /identity/v3/projects => generated 401 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:36:58.229502 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaae434-7dc6-46ef-a9d2-74e5c3e0e6b3 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:58.275510 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f104fd71-7ff5-401d-a207-dd2617df20ee admin admin] The token cache is being invalidate because project cea651c087e04b579cee7a23e8ba9576 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:36:58.275798 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f104fd71-7ff5-401d-a207-dd2617df20ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:58.276544 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f104fd71-7ff5-401d-a207-dd2617df20ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:58.278251 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3548/7078] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:36:57 2022] DELETE /identity/v3/projects/cea651c087e04b579cee7a23e8ba9576 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:36:58.283801 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3adc2cb-f2e2-4735-85fc-df49155af570 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:58.284265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3adc2cb-f2e2-4735-85fc-df49155af570 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:58.284556 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3adc2cb-f2e2-4735-85fc-df49155af570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:58.310269 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-c3adc2cb-f2e2-4735-85fc-df49155af570 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:58.312500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c3adc2cb-f2e2-4735-85fc-df49155af570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:58.323049 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3549/7079] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:36:58.323994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaae434-7dc6-46ef-a9d2-74e5c3e0e6b3 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:58.328999 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630fd98-4d10-4a81-99dd-151ee379e1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:58.329725 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630fd98-4d10-4a81-99dd-151ee379e1e8 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:58.330027 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630fd98-4d10-4a81-99dd-151ee379e1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:58.330326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630fd98-4d10-4a81-99dd-151ee379e1e8 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:58.330993 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630fd98-4d10-4a81-99dd-151ee379e1e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:58.333458 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630fd98-4d10-4a81-99dd-151ee379e1e8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:58.334152 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7a50a-b7f2-415d-a525-c35fb435d6d1 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:58.334456 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7a50a-b7f2-415d-a525-c35fb435d6d1 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:58.335583 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7a50a-b7f2-415d-a525-c35fb435d6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:58.355192 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-34c7a50a-b7f2-415d-a525-c35fb435d6d1 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:58.356154 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-34c7a50a-b7f2-415d-a525-c35fb435d6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:58.366188 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3550/7080] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:36:58.370265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7a50a-b7f2-415d-a525-c35fb435d6d1 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:58.383045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7a50a-b7f2-415d-a525-c35fb435d6d1 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:58.392875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1289199c-5b3b-4718-955b-b8bb77eed893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:58.392875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289199c-5b3b-4718-955b-b8bb77eed893 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:58.392875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289199c-5b3b-4718-955b-b8bb77eed893 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:58.392875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289199c-5b3b-4718-955b-b8bb77eed893 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:58.405150 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1289199c-5b3b-4718-955b-b8bb77eed893 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:36:58.405528 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1289199c-5b3b-4718-955b-b8bb77eed893 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:58.409869 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1289199c-5b3b-4718-955b-b8bb77eed893 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:58.416863 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3531/7081] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:36:58 2022] POST /identity/v3/users => generated 301 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:36:58.421016 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630fd98-4d10-4a81-99dd-151ee379e1e8 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:58.421562 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3551/7082] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:36:58.423382 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7630fd98-4d10-4a81-99dd-151ee379e1e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:58.427416 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1289199c-5b3b-4718-955b-b8bb77eed893 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:58.437996 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630fd98-4d10-4a81-99dd-151ee379e1e8 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:58.440287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1289199c-5b3b-4718-955b-b8bb77eed893 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:58.443920 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d91070-ca01-4dea-b6ab-46dbe95ef90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:58.444823 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d91070-ca01-4dea-b6ab-46dbe95ef90c admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:58.445109 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d91070-ca01-4dea-b6ab-46dbe95ef90c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:58.445388 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d91070-ca01-4dea-b6ab-46dbe95ef90c admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:58.446397 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d91070-ca01-4dea-b6ab-46dbe95ef90c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:58.448135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d91070-ca01-4dea-b6ab-46dbe95ef90c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:58.450261 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77d3a1-d2c1-4f22-8fe7-5d661cd00a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:58.457040 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77d3a1-d2c1-4f22-8fe7-5d661cd00a1e admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:58.457331 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77d3a1-d2c1-4f22-8fe7-5d661cd00a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:58.457610 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77d3a1-d2c1-4f22-8fe7-5d661cd00a1e admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:58.466000 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d77d3a1-d2c1-4f22-8fe7-5d661cd00a1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:58.469573 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d77d3a1-d2c1-4f22-8fe7-5d661cd00a1e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:58.477882 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3532/7083] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:36:58.478352 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d91070-ca01-4dea-b6ab-46dbe95ef90c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:58.490870 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d91070-ca01-4dea-b6ab-46dbe95ef90c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:58.497311 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95909f-1d7d-4fb6-8eee-7111e1a61210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:58.498025 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95909f-1d7d-4fb6-8eee-7111e1a61210 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:58.498314 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95909f-1d7d-4fb6-8eee-7111e1a61210 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:58.498598 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95909f-1d7d-4fb6-8eee-7111e1a61210 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:58.499316 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95909f-1d7d-4fb6-8eee-7111e1a61210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:58.501897 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95909f-1d7d-4fb6-8eee-7111e1a61210 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:58.514779 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3533/7084] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:36:58.522329 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95909f-1d7d-4fb6-8eee-7111e1a61210 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:58.538307 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95909f-1d7d-4fb6-8eee-7111e1a61210 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:58.543689 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f80d2b-fe9a-4a15-8dcc-8e539abb9ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:58.547539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f80d2b-fe9a-4a15-8dcc-8e539abb9ab2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:58.547539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f80d2b-fe9a-4a15-8dcc-8e539abb9ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:58.547539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f80d2b-fe9a-4a15-8dcc-8e539abb9ab2 admin admin] PATH_INFO: `/v3/projects/26b0dafa61cd40f3988d5f44276dda51/users/478a318833914f869d7874fc4af07ede/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:58.549438 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3552/7085] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:36:58 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:36:58.555024 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77d3a1-d2c1-4f22-8fe7-5d661cd00a1e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:58.570849 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f80d2b-fe9a-4a15-8dcc-8e539abb9ab2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26b0dafa61cd40f3988d5f44276dda51, user_id=478a318833914f869d7874fc4af07ede, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:58.570849 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f80d2b-fe9a-4a15-8dcc-8e539abb9ab2 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:58.628768 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77d3a1-d2c1-4f22-8fe7-5d661cd00a1e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:58.634241 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf88113-54de-4f80-aa01-4c1d1afb2914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:58.635024 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf88113-54de-4f80-aa01-4c1d1afb2914 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:58.635722 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf88113-54de-4f80-aa01-4c1d1afb2914 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:58.636101 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf88113-54de-4f80-aa01-4c1d1afb2914 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:58.636916 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf88113-54de-4f80-aa01-4c1d1afb2914 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:58.639153 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf88113-54de-4f80-aa01-4c1d1afb2914 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:58.654863 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3534/7086] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:36:58 2022] PUT /identity/v3/projects/26b0dafa61cd40f3988d5f44276dda51/users/478a318833914f869d7874fc4af07ede/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:36:58.666288 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0282c8-a513-454c-984e-be43436a7e07 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:58.666619 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0282c8-a513-454c-984e-be43436a7e07 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:58.667079 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0282c8-a513-454c-984e-be43436a7e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:58.721149 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3553/7087] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:36:58 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:36:58.724223 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf88113-54de-4f80-aa01-4c1d1afb2914 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:58.726475 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0bf88113-54de-4f80-aa01-4c1d1afb2914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:58.735745 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-9b0282c8-a513-454c-984e-be43436a7e07 None None] MFA Rules not processed for user `478a318833914f869d7874fc4af07ede`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:58.737273 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-9b0282c8-a513-454c-984e-be43436a7e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:58.744226 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf88113-54de-4f80-aa01-4c1d1afb2914 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:58.840934 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee2fa36-0985-414f-8d52-b9efe35b60d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:58.843091 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2fa36-0985-414f-8d52-b9efe35b60d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:58.843666 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2fa36-0985-414f-8d52-b9efe35b60d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:58.844179 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2fa36-0985-414f-8d52-b9efe35b60d9 admin admin] PATH_INFO: `/v3/projects/32b9dabf64e24209bf574adc87a19dc2` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:58.846118 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee2fa36-0985-414f-8d52-b9efe35b60d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32b9dabf64e24209bf574adc87a19dc2)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:58.848097 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee2fa36-0985-414f-8d52-b9efe35b60d9 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:58.859843 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3535/7088] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:58 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:36:58.861396 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0282c8-a513-454c-984e-be43436a7e07 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:58.879051 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0282c8-a513-454c-984e-be43436a7e07 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:58.887933 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb8bab-42aa-4d54-8b9f-0734e6b3cd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:58.889169 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb8bab-42aa-4d54-8b9f-0734e6b3cd2a admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:58.889478 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb8bab-42aa-4d54-8b9f-0734e6b3cd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:58.889780 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb8bab-42aa-4d54-8b9f-0734e6b3cd2a admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:58.891185 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eb8bab-42aa-4d54-8b9f-0734e6b3cd2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:58.894125 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eb8bab-42aa-4d54-8b9f-0734e6b3cd2a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:58.906515 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3536/7089] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:36:58.910535 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb8bab-42aa-4d54-8b9f-0734e6b3cd2a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:58.920923 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb8bab-42aa-4d54-8b9f-0734e6b3cd2a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:58.927137 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017513ab-e255-49e3-8049-fbf326793898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:58.929358 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017513ab-e255-49e3-8049-fbf326793898 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:58.929358 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017513ab-e255-49e3-8049-fbf326793898 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:58.929358 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017513ab-e255-49e3-8049-fbf326793898 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:58.929844 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017513ab-e255-49e3-8049-fbf326793898 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:58.932004 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017513ab-e255-49e3-8049-fbf326793898 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:59.057593 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3537/7090] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:36:58 2022] POST /identity/v3/projects => generated 399 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:36:59.059509 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017513ab-e255-49e3-8049-fbf326793898 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:59.073572 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4ee2fa36-0985-414f-8d52-b9efe35b60d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32b9dabf64e24209bf574adc87a19dc2', 'request_id': 'req-4ee2fa36-0985-414f-8d52-b9efe35b60d9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:59.083915 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4ee2fa36-0985-414f-8d52-b9efe35b60d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32b9dabf64e24209bf574adc87a19dc2', 'request_id': 'req-4ee2fa36-0985-414f-8d52-b9efe35b60d9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:59.093435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4ee2fa36-0985-414f-8d52-b9efe35b60d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32b9dabf64e24209bf574adc87a19dc2', 'request_id': 'req-4ee2fa36-0985-414f-8d52-b9efe35b60d9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:59.158623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017513ab-e255-49e3-8049-fbf326793898 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:59.165248 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b5eeb-9efb-4a72-a72c-092169dd8034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:59.165966 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b5eeb-9efb-4a72-a72c-092169dd8034 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:59.166251 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b5eeb-9efb-4a72-a72c-092169dd8034 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:59.171578 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b5eeb-9efb-4a72-a72c-092169dd8034 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:59.171578 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b5eeb-9efb-4a72-a72c-092169dd8034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:59.171578 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b5eeb-9efb-4a72-a72c-092169dd8034 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:59.184782 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3538/7091] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:36:59.184782 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b5eeb-9efb-4a72-a72c-092169dd8034 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:59.196325 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b5eeb-9efb-4a72-a72c-092169dd8034 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:59.202037 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab3d6f-d30d-4dc0-a736-9ba6145f59d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:59.202725 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab3d6f-d30d-4dc0-a736-9ba6145f59d4 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:59.203012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab3d6f-d30d-4dc0-a736-9ba6145f59d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:59.203286 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab3d6f-d30d-4dc0-a736-9ba6145f59d4 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:59.204002 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab3d6f-d30d-4dc0-a736-9ba6145f59d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:59.206090 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab3d6f-d30d-4dc0-a736-9ba6145f59d4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:59.229939 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4ee2fa36-0985-414f-8d52-b9efe35b60d9 admin admin] The token cache is being invalidate because project 32b9dabf64e24209bf574adc87a19dc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:36:59.230558 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4ee2fa36-0985-414f-8d52-b9efe35b60d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:59.231218 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4ee2fa36-0985-414f-8d52-b9efe35b60d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:36:59.232899 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3554/7092] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:36:58 2022] DELETE /identity/v3/projects/32b9dabf64e24209bf574adc87a19dc2 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:36:59.236842 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee2fa36-0985-414f-8d52-b9efe35b60d9 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:59.236842 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4ee2fa36-0985-414f-8d52-b9efe35b60d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:59.322493 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3539/7093] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:36:59 2022] POST /identity/v3/users => generated 306 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:36:59.324637 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2646c-0ba8-4156-92d3-63c1fcd2b93d None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:59.325606 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2646c-0ba8-4156-92d3-63c1fcd2b93d None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:59.326096 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2646c-0ba8-4156-92d3-63c1fcd2b93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:59.342506 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee2fa36-0985-414f-8d52-b9efe35b60d9 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:59.348423 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b731a-20f6-464a-bc0b-bf47fb222a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:59.349335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b731a-20f6-464a-bc0b-bf47fb222a9f admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:59.350012 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b731a-20f6-464a-bc0b-bf47fb222a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:59.350012 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b731a-20f6-464a-bc0b-bf47fb222a9f admin admin] PATH_INFO: `/v3/projects/c29522e8468947d1a9d7f16b9c0f56b2/users/c77af801c8e44efca3c7298ecb02d047/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:59.368988 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b731a-20f6-464a-bc0b-bf47fb222a9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c29522e8468947d1a9d7f16b9c0f56b2, user_id=c77af801c8e44efca3c7298ecb02d047, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:59.371973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b731a-20f6-464a-bc0b-bf47fb222a9f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:59.386536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-3ea2646c-0ba8-4156-92d3-63c1fcd2b93d None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:59.391862 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3ea2646c-0ba8-4156-92d3-63c1fcd2b93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:59.397361 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3540/7094] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:36:59.398030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2646c-0ba8-4156-92d3-63c1fcd2b93d None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:59.399402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3ea2646c-0ba8-4156-92d3-63c1fcd2b93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:59.417194 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2646c-0ba8-4156-92d3-63c1fcd2b93d None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:59.422656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf9d85-fae9-4cdd-a218-2b54d1a6bf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:59.424032 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf9d85-fae9-4cdd-a218-2b54d1a6bf95 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:59.424325 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf9d85-fae9-4cdd-a218-2b54d1a6bf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:59.424737 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf9d85-fae9-4cdd-a218-2b54d1a6bf95 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:59.425659 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf9d85-fae9-4cdd-a218-2b54d1a6bf95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:59.427601 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf9d85-fae9-4cdd-a218-2b54d1a6bf95 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:59.446114 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3541/7095] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:36:59.447907 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957611b2-0b7a-4df0-b383-6c520fe91567 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:59.448872 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957611b2-0b7a-4df0-b383-6c520fe91567 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:59.449189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957611b2-0b7a-4df0-b383-6c520fe91567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:59.464726 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3555/7096] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:36:59 2022] PUT /identity/v3/projects/c29522e8468947d1a9d7f16b9c0f56b2/users/c77af801c8e44efca3c7298ecb02d047/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:36:59.466375 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b731a-20f6-464a-bc0b-bf47fb222a9f admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:59.497588 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-957611b2-0b7a-4df0-b383-6c520fe91567 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:59.498605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-957611b2-0b7a-4df0-b383-6c520fe91567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:59.550181 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b731a-20f6-464a-bc0b-bf47fb222a9f admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:59.555995 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c305a7-cff8-4940-a556-61680e417317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:59.557101 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c305a7-cff8-4940-a556-61680e417317 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:59.557582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c305a7-cff8-4940-a556-61680e417317 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:59.557946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c305a7-cff8-4940-a556-61680e417317 admin admin] PATH_INFO: `/v3/projects/f2b1f7c6eab04cfc89855295789f8e74/users/0d1b3731d23e4d40b3cf0e02289ec5b4/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:59.583708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c305a7-cff8-4940-a556-61680e417317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2b1f7c6eab04cfc89855295789f8e74, user_id=0d1b3731d23e4d40b3cf0e02289ec5b4, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:59.586535 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c305a7-cff8-4940-a556-61680e417317 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:59.594358 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3542/7097] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:36:59.594358 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76932f-cde8-4628-856a-8e8893a8c8fc None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:59.594358 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76932f-cde8-4628-856a-8e8893a8c8fc None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:59.594358 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76932f-cde8-4628-856a-8e8893a8c8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:59.635221 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-fe76932f-cde8-4628-856a-8e8893a8c8fc None None] MFA Rules not processed for user `c77af801c8e44efca3c7298ecb02d047`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:36:59.636970 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-fe76932f-cde8-4628-856a-8e8893a8c8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:59.652125 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3556/7098] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:36:59 2022] PUT /identity/v3/projects/f2b1f7c6eab04cfc89855295789f8e74/users/0d1b3731d23e4d40b3cf0e02289ec5b4/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:36:59.653584 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c305a7-cff8-4940-a556-61680e417317 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:59.784233 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3543/7099] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:36:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:36:59.785530 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe76932f-cde8-4628-856a-8e8893a8c8fc None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:59.786656 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c305a7-cff8-4940-a556-61680e417317 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:59.791853 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa47220-ee4c-4e89-97c4-176063caa5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:59.794404 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa47220-ee4c-4e89-97c4-176063caa5c3 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:59.794970 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa47220-ee4c-4e89-97c4-176063caa5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:59.795265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa47220-ee4c-4e89-97c4-176063caa5c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:59.796950 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa47220-ee4c-4e89-97c4-176063caa5c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:36:59.797096 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa47220-ee4c-4e89-97c4-176063caa5c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:59.798936 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa47220-ee4c-4e89-97c4-176063caa5c3 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:59.801461 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe76932f-cde8-4628-856a-8e8893a8c8fc None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:59.811131 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b2a23-400b-4936-8d75-a8de89e6b9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:59.812444 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b2a23-400b-4936-8d75-a8de89e6b9d8 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:59.812739 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b2a23-400b-4936-8d75-a8de89e6b9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:59.813015 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b2a23-400b-4936-8d75-a8de89e6b9d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:59.813807 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b2a23-400b-4936-8d75-a8de89e6b9d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:59.817247 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3557/7100] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:36:59.817247 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa47220-ee4c-4e89-97c4-176063caa5c3 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:59.817469 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b2a23-400b-4936-8d75-a8de89e6b9d8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:59.818801 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8aa47220-ee4c-4e89-97c4-176063caa5c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:36:59.834748 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3544/7101] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:36:59.835593 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b2a23-400b-4936-8d75-a8de89e6b9d8 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:36:59.854479 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b2a23-400b-4936-8d75-a8de89e6b9d8 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:59.891930 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd23672-279d-44b0-be5e-bd79feee7c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:59.893290 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd23672-279d-44b0-be5e-bd79feee7c08 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:59.893789 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd23672-279d-44b0-be5e-bd79feee7c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:59.895584 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd23672-279d-44b0-be5e-bd79feee7c08 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:36:59.896482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd23672-279d-44b0-be5e-bd79feee7c08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:36:59.902983 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd23672-279d-44b0-be5e-bd79feee7c08 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:36:59.960486 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa47220-ee4c-4e89-97c4-176063caa5c3 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:36:59.971985 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e59dab-a9fd-45ff-a6e3-c7e9d56de4dc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e302b1298dd04d6590e3d079f7b13b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:36:59.972912 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e59dab-a9fd-45ff-a6e3-c7e9d56de4dc service glance] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:36:59.984979 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e59dab-a9fd-45ff-a6e3-c7e9d56de4dc service glance] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:36:59.984979 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e59dab-a9fd-45ff-a6e3-c7e9d56de4dc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:00.024261 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3545/7102] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:36:59 2022] POST /identity/v3/projects => generated 385 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:37:00.026149 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd23672-279d-44b0-be5e-bd79feee7c08 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:00.144093 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd23672-279d-44b0-be5e-bd79feee7c08 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:00.153406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1d876-9f4f-4cfe-8465-7a6c11656e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:00.155682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1d876-9f4f-4cfe-8465-7a6c11656e43 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:00.155967 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1d876-9f4f-4cfe-8465-7a6c11656e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:00.156247 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1d876-9f4f-4cfe-8465-7a6c11656e43 admin admin] PATH_INFO: `/v3/projects/f2b1f7c6eab04cfc89855295789f8e74/users/0d1b3731d23e4d40b3cf0e02289ec5b4/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:00.158704 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e59dab-a9fd-45ff-a6e3-c7e9d56de4dc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:00.159104 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e1d876-9f4f-4cfe-8465-7a6c11656e43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2b1f7c6eab04cfc89855295789f8e74, user_id=0d1b3731d23e4d40b3cf0e02289ec5b4, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:00.160254 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e59dab-a9fd-45ff-a6e3-c7e9d56de4dc service glance] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:00.163016 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e1d876-9f4f-4cfe-8465-7a6c11656e43 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:00.173545 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3558/7103] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:36:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:37:00.177120 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e59dab-a9fd-45ff-a6e3-c7e9d56de4dc service glance] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:00.177885 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3546/7104] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:37:00 2022] PUT /identity/v3/projects/f2b1f7c6eab04cfc89855295789f8e74/users/0d1b3731d23e4d40b3cf0e02289ec5b4/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:37:00.188506 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58c545-1dc5-408b-968d-6f21cb060a85 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:00.188798 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58c545-1dc5-408b-968d-6f21cb060a85 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:00.189079 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58c545-1dc5-408b-968d-6f21cb060a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:00.201794 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e59dab-a9fd-45ff-a6e3-c7e9d56de4dc service glance] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:00.227821 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-6e58c545-1dc5-408b-968d-6f21cb060a85 None None] MFA Rules not processed for user `0d1b3731d23e4d40b3cf0e02289ec5b4`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:00.229248 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6e58c545-1dc5-408b-968d-6f21cb060a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:00.346144 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3547/7105] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:00 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:37:00.358242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58c545-1dc5-408b-968d-6f21cb060a85 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:00.358413 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418362e4-d17e-4b4d-a63e-118c0e98b2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:00.358578 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6e58c545-1dc5-408b-968d-6f21cb060a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:00.359053 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418362e4-d17e-4b4d-a63e-118c0e98b2d8 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:00.359053 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418362e4-d17e-4b4d-a63e-118c0e98b2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:00.359053 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418362e4-d17e-4b4d-a63e-118c0e98b2d8 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:00.359513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418362e4-d17e-4b4d-a63e-118c0e98b2d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:00.361351 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418362e4-d17e-4b4d-a63e-118c0e98b2d8 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:00.462068 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3559/7106] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:37:00 2022] POST /identity/v3/users => generated 293 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:37:00.466716 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418362e4-d17e-4b4d-a63e-118c0e98b2d8 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:00.477522 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58c545-1dc5-408b-968d-6f21cb060a85 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:00.484468 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418362e4-d17e-4b4d-a63e-118c0e98b2d8 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:00.491258 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beae77f-4702-40ce-bf85-2900f1497110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:00.491826 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7a3fe2-4fbc-416a-8a03-d745e03104d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:00.491966 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beae77f-4702-40ce-bf85-2900f1497110 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:00.492235 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beae77f-4702-40ce-bf85-2900f1497110 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:00.492504 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a3fe2-4fbc-416a-8a03-d745e03104d4 service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:00.492647 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beae77f-4702-40ce-bf85-2900f1497110 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:00.492841 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a3fe2-4fbc-416a-8a03-d745e03104d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:00.493065 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a3fe2-4fbc-416a-8a03-d745e03104d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:00.493379 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beae77f-4702-40ce-bf85-2900f1497110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:00.495281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beae77f-4702-40ce-bf85-2900f1497110 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:00.515078 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3560/7107] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:37:00.518633 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beae77f-4702-40ce-bf85-2900f1497110 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:00.530206 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7a3fe2-4fbc-416a-8a03-d745e03104d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:00.531419 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7a3fe2-4fbc-416a-8a03-d745e03104d4 service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:00.531763 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beae77f-4702-40ce-bf85-2900f1497110 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:00.539023 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385962e3-3ebd-4e2d-9edf-e1c87ec3f633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:00.539785 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385962e3-3ebd-4e2d-9edf-e1c87ec3f633 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:00.540141 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385962e3-3ebd-4e2d-9edf-e1c87ec3f633 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:00.540490 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385962e3-3ebd-4e2d-9edf-e1c87ec3f633 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:00.541292 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385962e3-3ebd-4e2d-9edf-e1c87ec3f633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:00.543340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385962e3-3ebd-4e2d-9edf-e1c87ec3f633 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:00.558791 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3561/7108] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:37:00.559872 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3548/7109] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:37:00 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:37:00.576729 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385962e3-3ebd-4e2d-9edf-e1c87ec3f633 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:00.593801 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385962e3-3ebd-4e2d-9edf-e1c87ec3f633 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:00.604959 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa31e3-615d-4c8d-8212-d79bc59939ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:00.606177 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa31e3-615d-4c8d-8212-d79bc59939ca admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:00.606559 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa31e3-615d-4c8d-8212-d79bc59939ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:00.607079 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa31e3-615d-4c8d-8212-d79bc59939ca admin admin] PATH_INFO: `/v3/projects/ea6a94bdaaa74acc884e368018624221/users/2f563accc2f64beaa8e03e66615fa360/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:00.630150 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfa31e3-615d-4c8d-8212-d79bc59939ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea6a94bdaaa74acc884e368018624221, user_id=2f563accc2f64beaa8e03e66615fa360, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:00.633118 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfa31e3-615d-4c8d-8212-d79bc59939ca admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:00.729504 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3562/7110] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:37:00 2022] PUT /identity/v3/projects/ea6a94bdaaa74acc884e368018624221/users/2f563accc2f64beaa8e03e66615fa360/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:37:00.739784 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4024538-71cc-44ca-ba07-6417a3cbfe76 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:00.740075 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4024538-71cc-44ca-ba07-6417a3cbfe76 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:00.740350 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4024538-71cc-44ca-ba07-6417a3cbfe76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:00.780188 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-c4024538-71cc-44ca-ba07-6417a3cbfe76 None None] MFA Rules not processed for user `2f563accc2f64beaa8e03e66615fa360`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:00.781421 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c4024538-71cc-44ca-ba07-6417a3cbfe76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:00.892210 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa31e3-615d-4c8d-8212-d79bc59939ca admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:00.898431 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3549/7111] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:37:00.993991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa31e3-615d-4c8d-8212-d79bc59939ca admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:00.999885 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431841d-b4c0-4350-ab10-e3f2688b35b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:01.001894 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431841d-b4c0-4350-ab10-e3f2688b35b4 service cinder] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:01.002833 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431841d-b4c0-4350-ab10-e3f2688b35b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:01.003877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431841d-b4c0-4350-ab10-e3f2688b35b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:01.006990 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5431841d-b4c0-4350-ab10-e3f2688b35b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:01.088037 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431841d-b4c0-4350-ab10-e3f2688b35b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:01.089970 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431841d-b4c0-4350-ab10-e3f2688b35b4 service cinder] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:01.101537 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3563/7112] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:37:00 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:37:01.183930 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4024538-71cc-44ca-ba07-6417a3cbfe76 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:01.185215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c4024538-71cc-44ca-ba07-6417a3cbfe76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:01.211027 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4024538-71cc-44ca-ba07-6417a3cbfe76 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:01.216920 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88667b-ba2f-48f0-a5ab-ad7d9badcbe2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:01.217974 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88667b-ba2f-48f0-a5ab-ad7d9badcbe2 service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:01.218529 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88667b-ba2f-48f0-a5ab-ad7d9badcbe2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:01.219120 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88667b-ba2f-48f0-a5ab-ad7d9badcbe2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:01.234966 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88667b-ba2f-48f0-a5ab-ad7d9badcbe2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:01.238627 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88667b-ba2f-48f0-a5ab-ad7d9badcbe2 service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:01.260143 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3550/7113] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:37:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:37:02.086635 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431841d-b4c0-4350-ab10-e3f2688b35b4 service cinder] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:02.087995 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5431841d-b4c0-4350-ab10-e3f2688b35b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:02.179539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431841d-b4c0-4350-ab10-e3f2688b35b4 service cinder] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:02.184494 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f115a-8867-49aa-9f80-d9a4f7b7625b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:02.187093 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f115a-8867-49aa-9f80-d9a4f7b7625b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:02.187093 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f115a-8867-49aa-9f80-d9a4f7b7625b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:02.187093 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f115a-8867-49aa-9f80-d9a4f7b7625b admin admin] PATH_INFO: `/v3/users/2bb2f228681d4bc2875fd58aa928ace4` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:02.187507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f115a-8867-49aa-9f80-d9a4f7b7625b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bb2f228681d4bc2875fd58aa928ace4)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:02.189834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f115a-8867-49aa-9f80-d9a4f7b7625b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:02.385561 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-366f115a-8867-49aa-9f80-d9a4f7b7625b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bb2f228681d4bc2875fd58aa928ace4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:02.401591 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-366f115a-8867-49aa-9f80-d9a4f7b7625b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bb2f228681d4bc2875fd58aa928ace4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:02.502432 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-366f115a-8867-49aa-9f80-d9a4f7b7625b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bb2f228681d4bc2875fd58aa928ace4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:02.516276 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-366f115a-8867-49aa-9f80-d9a4f7b7625b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bb2f228681d4bc2875fd58aa928ace4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:02.517080 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-366f115a-8867-49aa-9f80-d9a4f7b7625b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bb2f228681d4bc2875fd58aa928ace4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:02.529403 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3564/7114] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:37:02 2022] DELETE /identity/v3/users/2bb2f228681d4bc2875fd58aa928ace4 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:37:02.531182 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238c8d0-f2ee-4752-a36c-5d76f41a1a61 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:02.531691 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238c8d0-f2ee-4752-a36c-5d76f41a1a61 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:02.531794 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238c8d0-f2ee-4752-a36c-5d76f41a1a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:02.555717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-7238c8d0-f2ee-4752-a36c-5d76f41a1a61 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:02.557007 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7238c8d0-f2ee-4752-a36c-5d76f41a1a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:02.651956 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3551/7115] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:37:02.665848 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f115a-8867-49aa-9f80-d9a4f7b7625b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:02.667991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-366f115a-8867-49aa-9f80-d9a4f7b7625b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:02.748721 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f115a-8867-49aa-9f80-d9a4f7b7625b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:02.753059 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23c7d8-f008-42ee-99e9-10d21588e99f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:02.753736 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23c7d8-f008-42ee-99e9-10d21588e99f service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:02.754057 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23c7d8-f008-42ee-99e9-10d21588e99f service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:02.754338 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23c7d8-f008-42ee-99e9-10d21588e99f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:02.764246 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb23c7d8-f008-42ee-99e9-10d21588e99f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:02.765718 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb23c7d8-f008-42ee-99e9-10d21588e99f service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:02.780603 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3565/7116] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:37:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:37:03.076352 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238c8d0-f2ee-4752-a36c-5d76f41a1a61 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:03.078746 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7238c8d0-f2ee-4752-a36c-5d76f41a1a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:03.098753 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238c8d0-f2ee-4752-a36c-5d76f41a1a61 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:03.106383 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7e7b7-0d8a-4736-99d8-f8902c0eb243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:03.107518 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7e7b7-0d8a-4736-99d8-f8902c0eb243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:03.107968 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7e7b7-0d8a-4736-99d8-f8902c0eb243 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:03.108598 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7e7b7-0d8a-4736-99d8-f8902c0eb243 admin admin] PATH_INFO: `/v3/projects/5319e09e05a74925b8417ce40be5f90d` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:03.110714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7e7b7-0d8a-4736-99d8-f8902c0eb243 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5319e09e05a74925b8417ce40be5f90d)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:03.115363 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7e7b7-0d8a-4736-99d8-f8902c0eb243 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:03.287140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-add7e7b7-0d8a-4736-99d8-f8902c0eb243 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5319e09e05a74925b8417ce40be5f90d', 'request_id': 'req-add7e7b7-0d8a-4736-99d8-f8902c0eb243'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:03.293954 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-add7e7b7-0d8a-4736-99d8-f8902c0eb243 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5319e09e05a74925b8417ce40be5f90d', 'request_id': 'req-add7e7b7-0d8a-4736-99d8-f8902c0eb243'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:03.300114 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-add7e7b7-0d8a-4736-99d8-f8902c0eb243 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5319e09e05a74925b8417ce40be5f90d', 'request_id': 'req-add7e7b7-0d8a-4736-99d8-f8902c0eb243'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:03.478793 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-add7e7b7-0d8a-4736-99d8-f8902c0eb243 admin admin] The token cache is being invalidate because project 5319e09e05a74925b8417ce40be5f90d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:37:03.479031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-add7e7b7-0d8a-4736-99d8-f8902c0eb243 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:03.479581 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-add7e7b7-0d8a-4736-99d8-f8902c0eb243 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:03.481267 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3552/7117] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:37:03 2022] DELETE /identity/v3/projects/5319e09e05a74925b8417ce40be5f90d => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:37:03.487148 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b5dc0-1673-40fd-a59b-34f60cca7324 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:03.487629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b5dc0-1673-40fd-a59b-34f60cca7324 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:03.488313 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b5dc0-1673-40fd-a59b-34f60cca7324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:03.506169 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-f50b5dc0-1673-40fd-a59b-34f60cca7324 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:03.507580 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f50b5dc0-1673-40fd-a59b-34f60cca7324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:03.572583 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3566/7118] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:37:03.580982 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec709a-7a1c-402e-8d2f-2fc859c62877 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:03.581529 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec709a-7a1c-402e-8d2f-2fc859c62877 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:03.581630 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec709a-7a1c-402e-8d2f-2fc859c62877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:03.606890 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-89ec709a-7a1c-402e-8d2f-2fc859c62877 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:03.608138 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-89ec709a-7a1c-402e-8d2f-2fc859c62877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:03.617509 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3553/7119] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:37:03.622026 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b5dc0-1673-40fd-a59b-34f60cca7324 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:03.632840 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b5dc0-1673-40fd-a59b-34f60cca7324 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:03.639307 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca47df-8ca7-4d24-b5d5-9df286b9c1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:03.639982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca47df-8ca7-4d24-b5d5-9df286b9c1c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:03.643061 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca47df-8ca7-4d24-b5d5-9df286b9c1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:03.643061 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca47df-8ca7-4d24-b5d5-9df286b9c1c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:03.643061 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca47df-8ca7-4d24-b5d5-9df286b9c1c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:37:03.643061 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca47df-8ca7-4d24-b5d5-9df286b9c1c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:03.643782 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca47df-8ca7-4d24-b5d5-9df286b9c1c5 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:03.661611 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3567/7120] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:37:03.662855 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec709a-7a1c-402e-8d2f-2fc859c62877 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:03.673451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec709a-7a1c-402e-8d2f-2fc859c62877 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:03.678284 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78da7f-507c-4687-9e64-e0e0132e0ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:03.678963 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78da7f-507c-4687-9e64-e0e0132e0ce2 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:03.679246 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78da7f-507c-4687-9e64-e0e0132e0ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:03.679523 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78da7f-507c-4687-9e64-e0e0132e0ce2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:03.680218 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78da7f-507c-4687-9e64-e0e0132e0ce2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:03.682199 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78da7f-507c-4687-9e64-e0e0132e0ce2 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:03.799324 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3554/7121] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:37:03 2022] POST /identity/v3/projects => generated 375 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:37:03.800625 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca47df-8ca7-4d24-b5d5-9df286b9c1c5 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:03.811290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca47df-8ca7-4d24-b5d5-9df286b9c1c5 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:03.869077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72fdf2-ffde-4c58-9e73-f1c1593a795b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:03.869898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72fdf2-ffde-4c58-9e73-f1c1593a795b admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:03.870187 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72fdf2-ffde-4c58-9e73-f1c1593a795b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:03.870467 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72fdf2-ffde-4c58-9e73-f1c1593a795b admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:03.871164 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b72fdf2-ffde-4c58-9e73-f1c1593a795b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:03.873128 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b72fdf2-ffde-4c58-9e73-f1c1593a795b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:03.982559 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3568/7122] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:37:03 2022] POST /identity/v3/users => generated 288 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:37:03.988069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78da7f-507c-4687-9e64-e0e0132e0ce2 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:04.003080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78da7f-507c-4687-9e64-e0e0132e0ce2 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:04.008227 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f0ef5-cf82-40e0-b0b9-943300b05a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:04.008931 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f0ef5-cf82-40e0-b0b9-943300b05a2b admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:04.009219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f0ef5-cf82-40e0-b0b9-943300b05a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:04.009541 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f0ef5-cf82-40e0-b0b9-943300b05a2b admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:04.010337 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f0ef5-cf82-40e0-b0b9-943300b05a2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:04.012092 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f0ef5-cf82-40e0-b0b9-943300b05a2b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:04.029434 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3555/7123] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:37:04.035665 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72fdf2-ffde-4c58-9e73-f1c1593a795b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:04.052123 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72fdf2-ffde-4c58-9e73-f1c1593a795b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:04.060897 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a1928-7adc-4a45-b79e-ff0233a82875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:04.060897 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a1928-7adc-4a45-b79e-ff0233a82875 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:04.060897 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a1928-7adc-4a45-b79e-ff0233a82875 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:04.060897 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a1928-7adc-4a45-b79e-ff0233a82875 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:04.061558 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a1928-7adc-4a45-b79e-ff0233a82875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:04.062216 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a1928-7adc-4a45-b79e-ff0233a82875 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:04.084330 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3569/7124] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:37:04.092834 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f0ef5-cf82-40e0-b0b9-943300b05a2b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:04.103547 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f0ef5-cf82-40e0-b0b9-943300b05a2b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:04.108422 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200ae15-f537-4454-a1b5-cf4b40f8de13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:04.109304 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200ae15-f537-4454-a1b5-cf4b40f8de13 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:04.109616 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200ae15-f537-4454-a1b5-cf4b40f8de13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:04.109953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200ae15-f537-4454-a1b5-cf4b40f8de13 admin admin] PATH_INFO: `/v3/projects/a441440c6da24b5dac802adba8d005a7/users/ae15a1321e7544f6a3458d416bdd5100/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:04.126188 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e200ae15-f537-4454-a1b5-cf4b40f8de13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a441440c6da24b5dac802adba8d005a7, user_id=ae15a1321e7544f6a3458d416bdd5100, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:04.128928 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e200ae15-f537-4454-a1b5-cf4b40f8de13 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:04.227983 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3556/7125] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:37:04 2022] PUT /identity/v3/projects/a441440c6da24b5dac802adba8d005a7/users/ae15a1321e7544f6a3458d416bdd5100/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:37:04.238799 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0e19c-9659-4ff1-b6a8-6b154ec8407b None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:04.239114 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0e19c-9659-4ff1-b6a8-6b154ec8407b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:04.239451 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0e19c-9659-4ff1-b6a8-6b154ec8407b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:04.292790 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-76a0e19c-9659-4ff1-b6a8-6b154ec8407b None None] MFA Rules not processed for user `ae15a1321e7544f6a3458d416bdd5100`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:04.294084 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-76a0e19c-9659-4ff1-b6a8-6b154ec8407b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:04.385933 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3570/7126] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:37:04.400243 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200ae15-f537-4454-a1b5-cf4b40f8de13 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:04.402288 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e200ae15-f537-4454-a1b5-cf4b40f8de13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:04.480434 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200ae15-f537-4454-a1b5-cf4b40f8de13 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:04.484467 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1172d0-9a86-4bfe-ab4d-4824ad43d985 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:04.485772 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1172d0-9a86-4bfe-ab4d-4824ad43d985 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:04.486067 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1172d0-9a86-4bfe-ab4d-4824ad43d985 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:04.486347 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1172d0-9a86-4bfe-ab4d-4824ad43d985 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:04.495841 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1172d0-9a86-4bfe-ab4d-4824ad43d985 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:04.497359 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1172d0-9a86-4bfe-ab4d-4824ad43d985 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:04.508196 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3557/7127] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:37:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:37:13.002682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b971cf-b29f-4689-b785-5f6dff679571 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:13.003204 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b971cf-b29f-4689-b785-5f6dff679571 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:13.003293 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b971cf-b29f-4689-b785-5f6dff679571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:13.026529 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-f4b971cf-b29f-4689-b785-5f6dff679571 None None] MFA Rules not processed for user `3107c6d79451405a963c5816d92055b3`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:13.026529 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f4b971cf-b29f-4689-b785-5f6dff679571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:13.087805 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3571/7128] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:13 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:37:13.090509 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1172d0-9a86-4bfe-ab4d-4824ad43d985 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:13.172250 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1172d0-9a86-4bfe-ab4d-4824ad43d985 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:13.179265 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3688c-0671-4df6-a803-d0a000cf33df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:13.180280 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3688c-0671-4df6-a803-d0a000cf33df admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:13.180618 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3688c-0671-4df6-a803-d0a000cf33df admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:13.180949 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3688c-0671-4df6-a803-d0a000cf33df admin admin] PATH_INFO: `/v3/users/ae15a1321e7544f6a3458d416bdd5100` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:13.182244 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c3688c-0671-4df6-a803-d0a000cf33df admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae15a1321e7544f6a3458d416bdd5100)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:13.184726 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c3688c-0671-4df6-a803-d0a000cf33df admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:13.446117 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c9c3688c-0671-4df6-a803-d0a000cf33df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae15a1321e7544f6a3458d416bdd5100'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:13.458945 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c9c3688c-0671-4df6-a803-d0a000cf33df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae15a1321e7544f6a3458d416bdd5100'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:13.616002 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c9c3688c-0671-4df6-a803-d0a000cf33df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae15a1321e7544f6a3458d416bdd5100'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:13.616640 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c9c3688c-0671-4df6-a803-d0a000cf33df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae15a1321e7544f6a3458d416bdd5100'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:13.624404 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c9c3688c-0671-4df6-a803-d0a000cf33df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae15a1321e7544f6a3458d416bdd5100'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:13.631112 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3558/7129] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:37:13 2022] DELETE /identity/v3/users/ae15a1321e7544f6a3458d416bdd5100 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:37:13.635452 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0446df-8a45-455b-a995-e3444c1e9888 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:13.635746 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0446df-8a45-455b-a995-e3444c1e9888 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:13.636032 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0446df-8a45-455b-a995-e3444c1e9888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:13.658862 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-4d0446df-8a45-455b-a995-e3444c1e9888 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:13.660186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4d0446df-8a45-455b-a995-e3444c1e9888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:13.718632 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3572/7130] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:37:13.728123 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3688c-0671-4df6-a803-d0a000cf33df admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:13.729659 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c9c3688c-0671-4df6-a803-d0a000cf33df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:13.794619 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3688c-0671-4df6-a803-d0a000cf33df admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:13.800756 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612f7e8-583b-4ba4-a365-06c388a5bcf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:13.801498 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612f7e8-583b-4ba4-a365-06c388a5bcf7 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:13.801964 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612f7e8-583b-4ba4-a365-06c388a5bcf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:13.802313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612f7e8-583b-4ba4-a365-06c388a5bcf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:13.818481 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6612f7e8-583b-4ba4-a365-06c388a5bcf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:13.821524 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6612f7e8-583b-4ba4-a365-06c388a5bcf7 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:13.833248 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3559/7131] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:37:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:37:13.871629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0446df-8a45-455b-a995-e3444c1e9888 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:13.873619 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4d0446df-8a45-455b-a995-e3444c1e9888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:13.887090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0446df-8a45-455b-a995-e3444c1e9888 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:13.895198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4c42ca-ab80-4f4e-a4e7-77db1db1003e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:13.896397 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c42ca-ab80-4f4e-a4e7-77db1db1003e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:13.896867 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c42ca-ab80-4f4e-a4e7-77db1db1003e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:13.897397 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4c42ca-ab80-4f4e-a4e7-77db1db1003e admin admin] PATH_INFO: `/v3/users/478a318833914f869d7874fc4af07ede` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:13.899311 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4c42ca-ab80-4f4e-a4e7-77db1db1003e admin admin] RBAC: Authorizing `identity:delete_user(user_id=478a318833914f869d7874fc4af07ede)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:13.901668 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4c42ca-ab80-4f4e-a4e7-77db1db1003e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:14.092267 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0d4c42ca-ab80-4f4e-a4e7-77db1db1003e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '478a318833914f869d7874fc4af07ede'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:14.104374 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0d4c42ca-ab80-4f4e-a4e7-77db1db1003e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '478a318833914f869d7874fc4af07ede'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:14.121345 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612f7e8-583b-4ba4-a365-06c388a5bcf7 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:14.123923 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6612f7e8-583b-4ba4-a365-06c388a5bcf7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:14.142547 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612f7e8-583b-4ba4-a365-06c388a5bcf7 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:14.151916 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc79855-0c63-41ce-9752-37f36746a069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:14.151916 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc79855-0c63-41ce-9752-37f36746a069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:14.152202 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc79855-0c63-41ce-9752-37f36746a069 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:14.152547 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc79855-0c63-41ce-9752-37f36746a069 admin admin] PATH_INFO: `/v3/projects/a441440c6da24b5dac802adba8d005a7` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:14.153897 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc79855-0c63-41ce-9752-37f36746a069 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a441440c6da24b5dac802adba8d005a7)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:14.155981 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc79855-0c63-41ce-9752-37f36746a069 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:14.176778 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0d4c42ca-ab80-4f4e-a4e7-77db1db1003e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '478a318833914f869d7874fc4af07ede'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:14.185783 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0d4c42ca-ab80-4f4e-a4e7-77db1db1003e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '478a318833914f869d7874fc4af07ede'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:14.185783 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0d4c42ca-ab80-4f4e-a4e7-77db1db1003e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '478a318833914f869d7874fc4af07ede'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:14.193265 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3573/7132] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:37:13 2022] DELETE /identity/v3/users/478a318833914f869d7874fc4af07ede => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:37:14.197741 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3428e9-0ded-4930-9728-ba6d6f2d5edd None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:14.198100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3428e9-0ded-4930-9728-ba6d6f2d5edd None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:14.198380 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3428e9-0ded-4930-9728-ba6d6f2d5edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:14.216859 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-ec3428e9-0ded-4930-9728-ba6d6f2d5edd None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:14.218096 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ec3428e9-0ded-4930-9728-ba6d6f2d5edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:14.257398 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3bc79855-0c63-41ce-9752-37f36746a069 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a441440c6da24b5dac802adba8d005a7', 'request_id': 'req-3bc79855-0c63-41ce-9752-37f36746a069'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:14.263203 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3bc79855-0c63-41ce-9752-37f36746a069 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a441440c6da24b5dac802adba8d005a7', 'request_id': 'req-3bc79855-0c63-41ce-9752-37f36746a069'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:14.279701 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3bc79855-0c63-41ce-9752-37f36746a069 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a441440c6da24b5dac802adba8d005a7', 'request_id': 'req-3bc79855-0c63-41ce-9752-37f36746a069'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:14.282496 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3574/7133] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:37:14.292799 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3428e9-0ded-4930-9728-ba6d6f2d5edd None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:14.294324 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ec3428e9-0ded-4930-9728-ba6d6f2d5edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:14.353626 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3428e9-0ded-4930-9728-ba6d6f2d5edd None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:14.376932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3bc79855-0c63-41ce-9752-37f36746a069 admin admin] The token cache is being invalidate because project a441440c6da24b5dac802adba8d005a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:37:14.377286 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3bc79855-0c63-41ce-9752-37f36746a069 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:14.377974 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3bc79855-0c63-41ce-9752-37f36746a069 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:14.379529 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3560/7134] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:37:14 2022] DELETE /identity/v3/projects/a441440c6da24b5dac802adba8d005a7 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:37:14.384199 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc592db-287f-4bd2-96cc-943e7d329bd8 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:14.384553 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc592db-287f-4bd2-96cc-943e7d329bd8 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:14.384920 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc592db-287f-4bd2-96cc-943e7d329bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:14.403982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00e55b-7ea7-46a0-b8fb-c5418b3b5510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:14.404416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-afc592db-287f-4bd2-96cc-943e7d329bd8 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:14.404636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00e55b-7ea7-46a0-b8fb-c5418b3b5510 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:14.409001 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00e55b-7ea7-46a0-b8fb-c5418b3b5510 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:14.409001 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00e55b-7ea7-46a0-b8fb-c5418b3b5510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:14.409202 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-afc592db-287f-4bd2-96cc-943e7d329bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:14.409297 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4b00e55b-7ea7-46a0-b8fb-c5418b3b5510 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:14.465466 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3561/7135] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:37:14.471534 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00e55b-7ea7-46a0-b8fb-c5418b3b5510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:14.473171 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00e55b-7ea7-46a0-b8fb-c5418b3b5510 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:14.473645 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16133d-7539-4589-a698-0ff45fab209b None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:14.473990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16133d-7539-4589-a698-0ff45fab209b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:14.474388 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16133d-7539-4589-a698-0ff45fab209b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:14.484028 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3575/7136] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:37:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:37:14.493538 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-6f16133d-7539-4589-a698-0ff45fab209b None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:14.494838 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6f16133d-7539-4589-a698-0ff45fab209b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:14.504704 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3562/7137] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:37:14.508932 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00e55b-7ea7-46a0-b8fb-c5418b3b5510 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:14.519004 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00e55b-7ea7-46a0-b8fb-c5418b3b5510 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:14.523924 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5c5cc-6019-44b1-b88e-30a9f1433369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:14.529969 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5c5cc-6019-44b1-b88e-30a9f1433369 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:14.529969 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5c5cc-6019-44b1-b88e-30a9f1433369 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:14.529969 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5c5cc-6019-44b1-b88e-30a9f1433369 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:14.529969 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5c5cc-6019-44b1-b88e-30a9f1433369 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:37:14.529969 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5c5cc-6019-44b1-b88e-30a9f1433369 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:14.529969 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5c5cc-6019-44b1-b88e-30a9f1433369 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:14.540923 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3576/7138] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:37:14.545254 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16133d-7539-4589-a698-0ff45fab209b None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:14.555618 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16133d-7539-4589-a698-0ff45fab209b None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:14.560518 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5949c62-9b1b-4138-9f83-22a286736e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:14.561214 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5949c62-9b1b-4138-9f83-22a286736e76 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:14.561504 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5949c62-9b1b-4138-9f83-22a286736e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:14.561811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5949c62-9b1b-4138-9f83-22a286736e76 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:14.562542 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5949c62-9b1b-4138-9f83-22a286736e76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:14.566837 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5949c62-9b1b-4138-9f83-22a286736e76 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:14.736374 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3563/7139] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:37:14 2022] POST /identity/v3/projects => generated 365 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:37:14.737525 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5c5cc-6019-44b1-b88e-30a9f1433369 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:14.747757 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5c5cc-6019-44b1-b88e-30a9f1433369 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:14.816663 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9bda8-5612-4b11-9b7b-b4b25129af63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:14.817552 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9bda8-5612-4b11-9b7b-b4b25129af63 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:14.817870 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9bda8-5612-4b11-9b7b-b4b25129af63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:14.818153 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9bda8-5612-4b11-9b7b-b4b25129af63 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:14.818849 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc9bda8-5612-4b11-9b7b-b4b25129af63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:14.820794 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc9bda8-5612-4b11-9b7b-b4b25129af63 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:14.917500 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3577/7140] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:37:14 2022] POST /identity/v3/users => generated 283 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:37:14.921814 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5949c62-9b1b-4138-9f83-22a286736e76 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:14.941589 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5949c62-9b1b-4138-9f83-22a286736e76 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:14.948247 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058183a6-5d02-427f-ba04-800c9955d25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:14.948968 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058183a6-5d02-427f-ba04-800c9955d25b admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:14.949232 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058183a6-5d02-427f-ba04-800c9955d25b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:14.949580 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058183a6-5d02-427f-ba04-800c9955d25b admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:14.950375 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058183a6-5d02-427f-ba04-800c9955d25b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:14.952711 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058183a6-5d02-427f-ba04-800c9955d25b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:14.970310 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3564/7141] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:37:14.971452 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9bda8-5612-4b11-9b7b-b4b25129af63 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:14.989996 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9bda8-5612-4b11-9b7b-b4b25129af63 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:14.996419 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5facb8a6-a891-4bf4-9af4-48a8c59da138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:14.997488 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facb8a6-a891-4bf4-9af4-48a8c59da138 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:14.997965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facb8a6-a891-4bf4-9af4-48a8c59da138 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:14.998398 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facb8a6-a891-4bf4-9af4-48a8c59da138 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:14.999286 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5facb8a6-a891-4bf4-9af4-48a8c59da138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:15.001838 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5facb8a6-a891-4bf4-9af4-48a8c59da138 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:15.014507 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3578/7142] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:37:15.022104 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058183a6-5d02-427f-ba04-800c9955d25b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:15.042302 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058183a6-5d02-427f-ba04-800c9955d25b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:15.059954 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc8ba4-4d3f-4ff7-9ba6-83b92d4d2160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:15.060964 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc8ba4-4d3f-4ff7-9ba6-83b92d4d2160 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:15.061325 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc8ba4-4d3f-4ff7-9ba6-83b92d4d2160 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:15.061672 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc8ba4-4d3f-4ff7-9ba6-83b92d4d2160 admin admin] PATH_INFO: `/v3/projects/ba6f219a03684e02b7c38372cef6f3a0/users/02f6985817d347d2b74ba939500f55a1/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:15.090086 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc8ba4-4d3f-4ff7-9ba6-83b92d4d2160 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba6f219a03684e02b7c38372cef6f3a0, user_id=02f6985817d347d2b74ba939500f55a1, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:15.092641 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc8ba4-4d3f-4ff7-9ba6-83b92d4d2160 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:15.170470 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3565/7143] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:37:15 2022] PUT /identity/v3/projects/ba6f219a03684e02b7c38372cef6f3a0/users/02f6985817d347d2b74ba939500f55a1/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:37:15.181684 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882ff3d-a9f8-4cd2-8479-b7764f7e14cc None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:15.182275 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882ff3d-a9f8-4cd2-8479-b7764f7e14cc None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:15.182578 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882ff3d-a9f8-4cd2-8479-b7764f7e14cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:15.226235 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-d882ff3d-a9f8-4cd2-8479-b7764f7e14cc None None] MFA Rules not processed for user `02f6985817d347d2b74ba939500f55a1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:15.227597 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d882ff3d-a9f8-4cd2-8479-b7764f7e14cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:15.324153 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3579/7144] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:15 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:37:15.328840 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc8ba4-4d3f-4ff7-9ba6-83b92d4d2160 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:15.413651 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc8ba4-4d3f-4ff7-9ba6-83b92d4d2160 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:15.413651 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044bf07-0ab7-473c-9209-8b9d1eb7f33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:15.413651 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044bf07-0ab7-473c-9209-8b9d1eb7f33a admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:15.413651 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044bf07-0ab7-473c-9209-8b9d1eb7f33a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:15.415079 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044bf07-0ab7-473c-9209-8b9d1eb7f33a admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:15.415079 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044bf07-0ab7-473c-9209-8b9d1eb7f33a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:15.416434 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044bf07-0ab7-473c-9209-8b9d1eb7f33a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:15.567094 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882ff3d-a9f8-4cd2-8479-b7764f7e14cc None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:15.568590 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d882ff3d-a9f8-4cd2-8479-b7764f7e14cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:15.584970 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882ff3d-a9f8-4cd2-8479-b7764f7e14cc None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:15.590341 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b7674-bf5f-44c1-ac2a-d2cdfbfe86d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:15.591197 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b7674-bf5f-44c1-ac2a-d2cdfbfe86d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:15.591477 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b7674-bf5f-44c1-ac2a-d2cdfbfe86d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:15.591806 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b7674-bf5f-44c1-ac2a-d2cdfbfe86d5 admin admin] PATH_INFO: `/v3/projects/26b0dafa61cd40f3988d5f44276dda51` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:15.596919 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193b7674-bf5f-44c1-ac2a-d2cdfbfe86d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26b0dafa61cd40f3988d5f44276dda51)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:15.599010 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193b7674-bf5f-44c1-ac2a-d2cdfbfe86d5 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:15.602838 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3566/7145] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:37:15 2022] POST /identity/v3/projects => generated 363 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:37:15.605447 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044bf07-0ab7-473c-9209-8b9d1eb7f33a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:15.682135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044bf07-0ab7-473c-9209-8b9d1eb7f33a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:15.686961 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62440223-ea8b-4f19-a2b9-2637b608824d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:15.694698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62440223-ea8b-4f19-a2b9-2637b608824d admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:15.694698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62440223-ea8b-4f19-a2b9-2637b608824d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:15.694698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62440223-ea8b-4f19-a2b9-2637b608824d admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:15.694698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62440223-ea8b-4f19-a2b9-2637b608824d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:15.694698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62440223-ea8b-4f19-a2b9-2637b608824d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:15.740169 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-193b7674-bf5f-44c1-ac2a-d2cdfbfe86d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26b0dafa61cd40f3988d5f44276dda51', 'request_id': 'req-193b7674-bf5f-44c1-ac2a-d2cdfbfe86d5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:15.745544 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-193b7674-bf5f-44c1-ac2a-d2cdfbfe86d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26b0dafa61cd40f3988d5f44276dda51', 'request_id': 'req-193b7674-bf5f-44c1-ac2a-d2cdfbfe86d5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:15.753651 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-193b7674-bf5f-44c1-ac2a-d2cdfbfe86d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26b0dafa61cd40f3988d5f44276dda51', 'request_id': 'req-193b7674-bf5f-44c1-ac2a-d2cdfbfe86d5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:15.839517 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3567/7146] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:37:15 2022] POST /identity/v3/users => generated 288 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:37:15.843437 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62440223-ea8b-4f19-a2b9-2637b608824d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:15.853640 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62440223-ea8b-4f19-a2b9-2637b608824d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:15.885117 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-193b7674-bf5f-44c1-ac2a-d2cdfbfe86d5 admin admin] The token cache is being invalidate because project 26b0dafa61cd40f3988d5f44276dda51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:37:15.885500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-193b7674-bf5f-44c1-ac2a-d2cdfbfe86d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:15.886299 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-193b7674-bf5f-44c1-ac2a-d2cdfbfe86d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:15.901564 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3580/7147] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:37:15 2022] DELETE /identity/v3/projects/26b0dafa61cd40f3988d5f44276dda51 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:37:15.905101 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b7674-bf5f-44c1-ac2a-d2cdfbfe86d5 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:15.910201 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-193b7674-bf5f-44c1-ac2a-d2cdfbfe86d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:15.916570 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01e960-ad82-42cd-a7ee-b7d4a2fb5db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:15.917395 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01e960-ad82-42cd-a7ee-b7d4a2fb5db7 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:15.917677 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01e960-ad82-42cd-a7ee-b7d4a2fb5db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:15.917986 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01e960-ad82-42cd-a7ee-b7d4a2fb5db7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:15.918707 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b01e960-ad82-42cd-a7ee-b7d4a2fb5db7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:15.920401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b01e960-ad82-42cd-a7ee-b7d4a2fb5db7 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:15.932453 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3568/7148] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:37:15.934889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b7674-bf5f-44c1-ac2a-d2cdfbfe86d5 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:15.936238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01e960-ad82-42cd-a7ee-b7d4a2fb5db7 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:15.939774 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8b01e960-ad82-42cd-a7ee-b7d4a2fb5db7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:15.947186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20308ec1-7f57-40a8-901c-a593fa116bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:15.947978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20308ec1-7f57-40a8-901c-a593fa116bde admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:15.948285 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20308ec1-7f57-40a8-901c-a593fa116bde admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:15.948586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20308ec1-7f57-40a8-901c-a593fa116bde admin admin] PATH_INFO: `/v3/users/0d1b3731d23e4d40b3cf0e02289ec5b4` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:15.950526 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20308ec1-7f57-40a8-901c-a593fa116bde admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d1b3731d23e4d40b3cf0e02289ec5b4)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:15.952568 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20308ec1-7f57-40a8-901c-a593fa116bde admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:15.958006 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01e960-ad82-42cd-a7ee-b7d4a2fb5db7 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:15.963844 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fa5ad-3c1f-4afd-8cb1-98426fa66c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:15.964731 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fa5ad-3c1f-4afd-8cb1-98426fa66c40 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:15.965012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fa5ad-3c1f-4afd-8cb1-98426fa66c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:15.965290 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fa5ad-3c1f-4afd-8cb1-98426fa66c40 admin admin] PATH_INFO: `/v3/projects/672cb6b76349440c99898918494233d1/users/de372c52886447208fe3e42cbdec91fb/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:15.982921 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6fa5ad-3c1f-4afd-8cb1-98426fa66c40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=672cb6b76349440c99898918494233d1, user_id=de372c52886447208fe3e42cbdec91fb, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:15.986401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6fa5ad-3c1f-4afd-8cb1-98426fa66c40 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:16.087147 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3569/7149] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:37:15 2022] PUT /identity/v3/projects/672cb6b76349440c99898918494233d1/users/de372c52886447208fe3e42cbdec91fb/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:37:16.090767 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fa5ad-3c1f-4afd-8cb1-98426fa66c40 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:16.139440 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-20308ec1-7f57-40a8-901c-a593fa116bde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d1b3731d23e4d40b3cf0e02289ec5b4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:16.155792 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-20308ec1-7f57-40a8-901c-a593fa116bde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d1b3731d23e4d40b3cf0e02289ec5b4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:16.177040 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fa5ad-3c1f-4afd-8cb1-98426fa66c40 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:16.182287 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6ae4e-13fb-43a4-aad9-5a0e03ff8a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:16.183019 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6ae4e-13fb-43a4-aad9-5a0e03ff8a55 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:16.183252 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6ae4e-13fb-43a4-aad9-5a0e03ff8a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:16.183532 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6ae4e-13fb-43a4-aad9-5a0e03ff8a55 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:16.184425 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b6ae4e-13fb-43a4-aad9-5a0e03ff8a55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:16.186245 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b6ae4e-13fb-43a4-aad9-5a0e03ff8a55 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:16.197337 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3570/7150] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:37:16.203634 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6ae4e-13fb-43a4-aad9-5a0e03ff8a55 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:16.211568 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6ae4e-13fb-43a4-aad9-5a0e03ff8a55 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:16.216321 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee2f164-5f36-4a44-90e6-2f0dde14eb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:16.217195 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2f164-5f36-4a44-90e6-2f0dde14eb48 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:16.217478 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2f164-5f36-4a44-90e6-2f0dde14eb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:16.217783 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2f164-5f36-4a44-90e6-2f0dde14eb48 admin admin] PATH_INFO: `/v3/projects/672cb6b76349440c99898918494233d1/users/de372c52886447208fe3e42cbdec91fb/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:16.220321 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee2f164-5f36-4a44-90e6-2f0dde14eb48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=672cb6b76349440c99898918494233d1, user_id=de372c52886447208fe3e42cbdec91fb, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:16.223123 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee2f164-5f36-4a44-90e6-2f0dde14eb48 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:16.227942 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-20308ec1-7f57-40a8-901c-a593fa116bde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d1b3731d23e4d40b3cf0e02289ec5b4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:16.235152 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-20308ec1-7f57-40a8-901c-a593fa116bde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d1b3731d23e4d40b3cf0e02289ec5b4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:16.236509 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3571/7151] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:37:16 2022] PUT /identity/v3/projects/672cb6b76349440c99898918494233d1/users/de372c52886447208fe3e42cbdec91fb/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:37:16.236645 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-20308ec1-7f57-40a8-901c-a593fa116bde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d1b3731d23e4d40b3cf0e02289ec5b4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:16.242683 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3581/7152] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:37:15 2022] DELETE /identity/v3/users/0d1b3731d23e4d40b3cf0e02289ec5b4 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:37:16.247489 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f374f5-c1d7-4674-8b71-4931c04c2730 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:16.249144 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f374f5-c1d7-4674-8b71-4931c04c2730 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:16.249506 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f374f5-c1d7-4674-8b71-4931c04c2730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:16.286900 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-96f374f5-c1d7-4674-8b71-4931c04c2730 None None] MFA Rules not processed for user `de372c52886447208fe3e42cbdec91fb`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:16.289931 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-96f374f5-c1d7-4674-8b71-4931c04c2730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:16.381707 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3572/7153] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:16 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:37:16.393935 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20308ec1-7f57-40a8-901c-a593fa116bde admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:16.396822 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-20308ec1-7f57-40a8-901c-a593fa116bde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:16.459815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20308ec1-7f57-40a8-901c-a593fa116bde admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:16.466875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398f765-86f6-44a9-915a-8d99c82be7d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:16.467658 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398f765-86f6-44a9-915a-8d99c82be7d4 service cinder] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:16.468054 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398f765-86f6-44a9-915a-8d99c82be7d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:16.468405 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398f765-86f6-44a9-915a-8d99c82be7d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:16.482013 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c398f765-86f6-44a9-915a-8d99c82be7d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:16.483629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c398f765-86f6-44a9-915a-8d99c82be7d4 service cinder] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:16.495429 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3582/7154] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:37:16 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:37:16.778154 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f374f5-c1d7-4674-8b71-4931c04c2730 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:16.789419 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398f765-86f6-44a9-915a-8d99c82be7d4 service cinder] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:16.794000 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c398f765-86f6-44a9-915a-8d99c82be7d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:16.795592 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f374f5-c1d7-4674-8b71-4931c04c2730 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:16.807944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea748451-00d9-4a3d-81ba-e9c41faaf61d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:16.808605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea748451-00d9-4a3d-81ba-e9c41faaf61d service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:16.808891 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea748451-00d9-4a3d-81ba-e9c41faaf61d service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:16.809169 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea748451-00d9-4a3d-81ba-e9c41faaf61d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:16.811444 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ea748451-00d9-4a3d-81ba-e9c41faaf61d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:16.880945 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398f765-86f6-44a9-915a-8d99c82be7d4 service cinder] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:16.886208 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e861c-68cc-4fee-9da0-aef7e8545424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:16.887246 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e861c-68cc-4fee-9da0-aef7e8545424 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:16.888691 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e861c-68cc-4fee-9da0-aef7e8545424 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:16.888977 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e861c-68cc-4fee-9da0-aef7e8545424 admin admin] PATH_INFO: `/v3/projects/f2b1f7c6eab04cfc89855295789f8e74` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:16.890141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea748451-00d9-4a3d-81ba-e9c41faaf61d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:16.890801 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e861c-68cc-4fee-9da0-aef7e8545424 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2b1f7c6eab04cfc89855295789f8e74)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:16.892372 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea748451-00d9-4a3d-81ba-e9c41faaf61d service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:16.893666 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e861c-68cc-4fee-9da0-aef7e8545424 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:16.902736 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3573/7155] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:37:16 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:37:16.993808 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2b5e861c-68cc-4fee-9da0-aef7e8545424 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2b1f7c6eab04cfc89855295789f8e74', 'request_id': 'req-2b5e861c-68cc-4fee-9da0-aef7e8545424'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:16.998943 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2b5e861c-68cc-4fee-9da0-aef7e8545424 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2b1f7c6eab04cfc89855295789f8e74', 'request_id': 'req-2b5e861c-68cc-4fee-9da0-aef7e8545424'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:17.006165 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2b5e861c-68cc-4fee-9da0-aef7e8545424 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2b1f7c6eab04cfc89855295789f8e74', 'request_id': 'req-2b5e861c-68cc-4fee-9da0-aef7e8545424'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:17.079080 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2b5e861c-68cc-4fee-9da0-aef7e8545424 admin admin] The token cache is being invalidate because project f2b1f7c6eab04cfc89855295789f8e74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:37:17.079501 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2b5e861c-68cc-4fee-9da0-aef7e8545424 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:17.081387 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2b5e861c-68cc-4fee-9da0-aef7e8545424 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:17.081856 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3583/7156] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:37:16 2022] DELETE /identity/v3/projects/f2b1f7c6eab04cfc89855295789f8e74 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:37:17.086884 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e510415-0b6c-4f54-8db0-c8b826e9f1f4 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:17.087268 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e510415-0b6c-4f54-8db0-c8b826e9f1f4 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:17.087638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e510415-0b6c-4f54-8db0-c8b826e9f1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:17.105245 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-8e510415-0b6c-4f54-8db0-c8b826e9f1f4 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:17.106762 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8e510415-0b6c-4f54-8db0-c8b826e9f1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:17.203232 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3574/7157] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:37:17.210244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26c5db-5ec1-4e08-bcda-cf9fadbf98b9 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:17.213640 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26c5db-5ec1-4e08-bcda-cf9fadbf98b9 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:17.213640 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26c5db-5ec1-4e08-bcda-cf9fadbf98b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:17.229015 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-5b26c5db-5ec1-4e08-bcda-cf9fadbf98b9 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:17.230255 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5b26c5db-5ec1-4e08-bcda-cf9fadbf98b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:17.239134 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3584/7158] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:37:17.243200 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e510415-0b6c-4f54-8db0-c8b826e9f1f4 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:17.259142 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e510415-0b6c-4f54-8db0-c8b826e9f1f4 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:17.259924 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a77ce-8934-420d-a0d6-17e7db4fce82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:17.260616 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a77ce-8934-420d-a0d6-17e7db4fce82 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:17.260908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a77ce-8934-420d-a0d6-17e7db4fce82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:17.261190 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a77ce-8934-420d-a0d6-17e7db4fce82 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:17.261989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13a77ce-8934-420d-a0d6-17e7db4fce82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:37:17.262298 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13a77ce-8934-420d-a0d6-17e7db4fce82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:17.263999 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13a77ce-8934-420d-a0d6-17e7db4fce82 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:17.280240 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3575/7159] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:37:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:37:17.284681 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26c5db-5ec1-4e08-bcda-cf9fadbf98b9 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:17.296509 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26c5db-5ec1-4e08-bcda-cf9fadbf98b9 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:17.314416 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbbfa40-0b32-479c-a120-2630a13cb7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:17.315121 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbfa40-0b32-479c-a120-2630a13cb7fe admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:17.315408 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbfa40-0b32-479c-a120-2630a13cb7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:17.315691 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbfa40-0b32-479c-a120-2630a13cb7fe admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:17.316415 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbbfa40-0b32-479c-a120-2630a13cb7fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:17.323596 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbbfa40-0b32-479c-a120-2630a13cb7fe admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:17.452440 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3585/7160] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:37:17 2022] POST /identity/v3/projects => generated 375 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:37:17.456501 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a77ce-8934-420d-a0d6-17e7db4fce82 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:17.466655 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a77ce-8934-420d-a0d6-17e7db4fce82 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:17.525672 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bbadbb-0119-4133-939e-f0f4ab94b1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:17.526304 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbadbb-0119-4133-939e-f0f4ab94b1fa admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:17.526587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbadbb-0119-4133-939e-f0f4ab94b1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:17.526863 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbadbb-0119-4133-939e-f0f4ab94b1fa admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:17.527676 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bbadbb-0119-4133-939e-f0f4ab94b1fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:17.529681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bbadbb-0119-4133-939e-f0f4ab94b1fa admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:17.633899 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3576/7161] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:37:17 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:37:17.638066 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbbfa40-0b32-479c-a120-2630a13cb7fe admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:17.650958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbbfa40-0b32-479c-a120-2630a13cb7fe admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:17.658260 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f9c86-35e3-4336-8d9f-0a474148eafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:17.659257 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f9c86-35e3-4336-8d9f-0a474148eafc admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:17.659673 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f9c86-35e3-4336-8d9f-0a474148eafc admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:17.660097 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f9c86-35e3-4336-8d9f-0a474148eafc admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:17.661369 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f9c86-35e3-4336-8d9f-0a474148eafc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:17.663901 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f9c86-35e3-4336-8d9f-0a474148eafc admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:17.682207 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3586/7162] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:37:17.692711 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bbadbb-0119-4133-939e-f0f4ab94b1fa admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:17.703608 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bbadbb-0119-4133-939e-f0f4ab94b1fa admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:17.717257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8726c5e1-f13a-4682-ad34-d2b58f507d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:17.717257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726c5e1-f13a-4682-ad34-d2b58f507d85 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:17.717479 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726c5e1-f13a-4682-ad34-d2b58f507d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:17.717567 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8726c5e1-f13a-4682-ad34-d2b58f507d85 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:17.718471 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726c5e1-f13a-4682-ad34-d2b58f507d85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:17.720550 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8726c5e1-f13a-4682-ad34-d2b58f507d85 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:17.731738 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3577/7163] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:37:17.736220 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f9c86-35e3-4336-8d9f-0a474148eafc admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:17.746674 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f9c86-35e3-4336-8d9f-0a474148eafc admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:17.755762 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388c71b-41eb-4903-8a5b-d9278eb94b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:17.756754 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388c71b-41eb-4903-8a5b-d9278eb94b49 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:17.757108 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388c71b-41eb-4903-8a5b-d9278eb94b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:17.757529 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388c71b-41eb-4903-8a5b-d9278eb94b49 admin admin] PATH_INFO: `/v3/projects/8cfecbeba61c420a8185d621647a8059/users/fc2dbf2ab81b4a6d921f2ef0c0bc345e/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:17.773264 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4388c71b-41eb-4903-8a5b-d9278eb94b49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cfecbeba61c420a8185d621647a8059, user_id=fc2dbf2ab81b4a6d921f2ef0c0bc345e, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:17.780273 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4388c71b-41eb-4903-8a5b-d9278eb94b49 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:17.874584 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3587/7164] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:37:17 2022] PUT /identity/v3/projects/8cfecbeba61c420a8185d621647a8059/users/fc2dbf2ab81b4a6d921f2ef0c0bc345e/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:37:17.884939 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcbe7d2-3dd2-4879-9677-26acb1898e52 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:17.885242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcbe7d2-3dd2-4879-9677-26acb1898e52 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:17.885527 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcbe7d2-3dd2-4879-9677-26acb1898e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:17.914589 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-abcbe7d2-3dd2-4879-9677-26acb1898e52 None None] MFA Rules not processed for user `fc2dbf2ab81b4a6d921f2ef0c0bc345e`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:17.915900 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-abcbe7d2-3dd2-4879-9677-26acb1898e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:17.984712 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3578/7165] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:37:17.990172 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388c71b-41eb-4903-8a5b-d9278eb94b49 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:18.053419 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388c71b-41eb-4903-8a5b-d9278eb94b49 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:18.058563 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97fbf5-478b-4689-86c4-aa8d3aa7d63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:18.061431 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97fbf5-478b-4689-86c4-aa8d3aa7d63d admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:18.061431 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97fbf5-478b-4689-86c4-aa8d3aa7d63d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:18.061431 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97fbf5-478b-4689-86c4-aa8d3aa7d63d admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:18.061431 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97fbf5-478b-4689-86c4-aa8d3aa7d63d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:18.063293 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97fbf5-478b-4689-86c4-aa8d3aa7d63d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:18.158335 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3588/7166] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:37:17 2022] POST /identity/v3/projects => generated 375 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:37:18.159845 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcbe7d2-3dd2-4879-9677-26acb1898e52 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:18.171099 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcbe7d2-3dd2-4879-9677-26acb1898e52 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:18.232667 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff96c7-26bf-4295-bbd7-3cfc8dc00bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:18.238062 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff96c7-26bf-4295-bbd7-3cfc8dc00bad admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:18.238062 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff96c7-26bf-4295-bbd7-3cfc8dc00bad admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:18.238062 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff96c7-26bf-4295-bbd7-3cfc8dc00bad admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:18.238062 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff96c7-26bf-4295-bbd7-3cfc8dc00bad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:18.238062 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdff96c7-26bf-4295-bbd7-3cfc8dc00bad admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:18.334245 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3579/7167] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:37:18 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:37:18.335910 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97fbf5-478b-4689-86c4-aa8d3aa7d63d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:18.346560 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97fbf5-478b-4689-86c4-aa8d3aa7d63d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:18.351920 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d625f-9c08-4eee-af7f-cb8431e4d37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:18.352838 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d625f-9c08-4eee-af7f-cb8431e4d37b admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:18.352961 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d625f-9c08-4eee-af7f-cb8431e4d37b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:18.353264 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d625f-9c08-4eee-af7f-cb8431e4d37b admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:18.354041 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d625f-9c08-4eee-af7f-cb8431e4d37b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:18.356329 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d625f-9c08-4eee-af7f-cb8431e4d37b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:18.370718 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3589/7168] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:37:18.371941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff96c7-26bf-4295-bbd7-3cfc8dc00bad admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:18.386699 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff96c7-26bf-4295-bbd7-3cfc8dc00bad admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:18.397554 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d4645a-1e63-4e97-8081-29010849acc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:18.398346 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4645a-1e63-4e97-8081-29010849acc1 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:18.398626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4645a-1e63-4e97-8081-29010849acc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:18.399169 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4645a-1e63-4e97-8081-29010849acc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:18.399915 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d4645a-1e63-4e97-8081-29010849acc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:18.401815 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d4645a-1e63-4e97-8081-29010849acc1 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:18.413802 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3580/7169] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:37:18.417974 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d625f-9c08-4eee-af7f-cb8431e4d37b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:18.434774 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d625f-9c08-4eee-af7f-cb8431e4d37b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:18.440296 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42c555-db06-4dc4-af01-66ba0a4848b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:18.441247 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42c555-db06-4dc4-af01-66ba0a4848b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:18.441744 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42c555-db06-4dc4-af01-66ba0a4848b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:18.442252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42c555-db06-4dc4-af01-66ba0a4848b8 admin admin] PATH_INFO: `/v3/projects/a9a2ae2a88ea4fd5a929a9de70c40f32/users/4933721686744b198ee13a684dec4f03/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:18.481337 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c42c555-db06-4dc4-af01-66ba0a4848b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9a2ae2a88ea4fd5a929a9de70c40f32, user_id=4933721686744b198ee13a684dec4f03, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:18.484085 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c42c555-db06-4dc4-af01-66ba0a4848b8 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:18.577892 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3590/7170] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:37:18 2022] PUT /identity/v3/projects/a9a2ae2a88ea4fd5a929a9de70c40f32/users/4933721686744b198ee13a684dec4f03/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:37:18.587896 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8e8ed-17d1-4206-87e2-7a7dbee9c5e4 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:18.588184 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8e8ed-17d1-4206-87e2-7a7dbee9c5e4 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:18.588878 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8e8ed-17d1-4206-87e2-7a7dbee9c5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:18.618693 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-c0b8e8ed-17d1-4206-87e2-7a7dbee9c5e4 None None] MFA Rules not processed for user `4933721686744b198ee13a684dec4f03`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:18.619933 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c0b8e8ed-17d1-4206-87e2-7a7dbee9c5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:18.687072 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3581/7171] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:37:18.690992 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42c555-db06-4dc4-af01-66ba0a4848b8 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:18.752946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42c555-db06-4dc4-af01-66ba0a4848b8 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:18.758684 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d83d9f-a2c6-4a8a-8863-e3609b9a9527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:18.759579 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d83d9f-a2c6-4a8a-8863-e3609b9a9527 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:18.760140 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d83d9f-a2c6-4a8a-8863-e3609b9a9527 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:18.760599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d83d9f-a2c6-4a8a-8863-e3609b9a9527 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:18.761523 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d83d9f-a2c6-4a8a-8863-e3609b9a9527 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:18.763762 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d83d9f-a2c6-4a8a-8863-e3609b9a9527 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:18.853814 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3591/7172] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:37:18 2022] POST /identity/v3/projects => generated 375 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:37:18.856744 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8e8ed-17d1-4206-87e2-7a7dbee9c5e4 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:18.869577 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8e8ed-17d1-4206-87e2-7a7dbee9c5e4 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:18.933429 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa20d7-bacf-4117-b5bf-883d56fdad30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:18.934278 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa20d7-bacf-4117-b5bf-883d56fdad30 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:18.934567 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa20d7-bacf-4117-b5bf-883d56fdad30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:18.934977 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa20d7-bacf-4117-b5bf-883d56fdad30 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:18.935665 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa20d7-bacf-4117-b5bf-883d56fdad30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:18.937630 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa20d7-bacf-4117-b5bf-883d56fdad30 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:19.044930 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3582/7173] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:37:18 2022] POST /identity/v3/users => generated 294 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:37:19.049352 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d83d9f-a2c6-4a8a-8863-e3609b9a9527 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:19.059860 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d83d9f-a2c6-4a8a-8863-e3609b9a9527 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:19.064526 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68eedca-6618-40bf-8c92-8fbeab3ed342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:19.065182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68eedca-6618-40bf-8c92-8fbeab3ed342 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:19.065516 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68eedca-6618-40bf-8c92-8fbeab3ed342 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:19.065784 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68eedca-6618-40bf-8c92-8fbeab3ed342 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:19.066517 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68eedca-6618-40bf-8c92-8fbeab3ed342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:19.068169 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68eedca-6618-40bf-8c92-8fbeab3ed342 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:19.078633 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3592/7174] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:37:19.082721 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa20d7-bacf-4117-b5bf-883d56fdad30 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:19.092837 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa20d7-bacf-4117-b5bf-883d56fdad30 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:19.098303 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a37518-a5d3-4100-b227-90d1599cfd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:19.099119 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a37518-a5d3-4100-b227-90d1599cfd0e admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:19.099404 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a37518-a5d3-4100-b227-90d1599cfd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:19.099686 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a37518-a5d3-4100-b227-90d1599cfd0e admin admin] PATH_INFO: `/v3/projects/af04af1fe9be4985b4a65ed97335a1cf/users/23af625e4e1e4779b4f01ebb735701fa/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:19.114920 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a37518-a5d3-4100-b227-90d1599cfd0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=af04af1fe9be4985b4a65ed97335a1cf, user_id=23af625e4e1e4779b4f01ebb735701fa, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:19.119068 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a37518-a5d3-4100-b227-90d1599cfd0e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:19.199209 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3583/7175] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:37:19 2022] PUT /identity/v3/projects/af04af1fe9be4985b4a65ed97335a1cf/users/23af625e4e1e4779b4f01ebb735701fa/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:37:19.203117 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68eedca-6618-40bf-8c92-8fbeab3ed342 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:19.213178 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68eedca-6618-40bf-8c92-8fbeab3ed342 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:19.270241 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a8b45-8231-44a0-aea4-aa2c09067a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:19.270912 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a8b45-8231-44a0-aea4-aa2c09067a4a admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:19.271194 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a8b45-8231-44a0-aea4-aa2c09067a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:19.271590 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a8b45-8231-44a0-aea4-aa2c09067a4a admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:19.272313 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a8b45-8231-44a0-aea4-aa2c09067a4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:19.274213 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a8b45-8231-44a0-aea4-aa2c09067a4a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:19.285264 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3593/7176] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:37:19.289733 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a37518-a5d3-4100-b227-90d1599cfd0e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:19.303763 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a37518-a5d3-4100-b227-90d1599cfd0e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:19.308448 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b8b48-4dc3-4b66-bb06-1f8a1b202d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:19.309334 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b8b48-4dc3-4b66-bb06-1f8a1b202d8d admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:19.309616 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b8b48-4dc3-4b66-bb06-1f8a1b202d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:19.309934 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b8b48-4dc3-4b66-bb06-1f8a1b202d8d admin admin] PATH_INFO: `/v3/projects/af04af1fe9be4985b4a65ed97335a1cf/users/23af625e4e1e4779b4f01ebb735701fa/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:19.311959 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18b8b48-4dc3-4b66-bb06-1f8a1b202d8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=af04af1fe9be4985b4a65ed97335a1cf, user_id=23af625e4e1e4779b4f01ebb735701fa, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:19.314659 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18b8b48-4dc3-4b66-bb06-1f8a1b202d8d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:19.326525 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3584/7177] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:37:19 2022] PUT /identity/v3/projects/af04af1fe9be4985b4a65ed97335a1cf/users/23af625e4e1e4779b4f01ebb735701fa/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:37:19.338004 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddb618-af68-4a51-a505-645edfd9d63f None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:19.343063 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddb618-af68-4a51-a505-645edfd9d63f None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:19.343063 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddb618-af68-4a51-a505-645edfd9d63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:19.369917 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-b2ddb618-af68-4a51-a505-645edfd9d63f None None] MFA Rules not processed for user `23af625e4e1e4779b4f01ebb735701fa`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:19.369917 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b2ddb618-af68-4a51-a505-645edfd9d63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:19.433855 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3594/7178] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:19 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:37:19.448767 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b8b48-4dc3-4b66-bb06-1f8a1b202d8d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:19.448767 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b18b8b48-4dc3-4b66-bb06-1f8a1b202d8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:19.507554 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b8b48-4dc3-4b66-bb06-1f8a1b202d8d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:19.511479 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0880d3-1c3b-4c84-b615-4ac9037255b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:19.512148 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0880d3-1c3b-4c84-b615-4ac9037255b2 service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:19.512434 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0880d3-1c3b-4c84-b615-4ac9037255b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:19.512714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0880d3-1c3b-4c84-b615-4ac9037255b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:19.574418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0880d3-1c3b-4c84-b615-4ac9037255b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:19.576026 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0880d3-1c3b-4c84-b615-4ac9037255b2 service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:19.586709 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3585/7179] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:37:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:37:20.216341 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ddb618-af68-4a51-a505-645edfd9d63f None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:20.220931 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b2ddb618-af68-4a51-a505-645edfd9d63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:20.317293 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ddb618-af68-4a51-a505-645edfd9d63f None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:20.325785 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c48876-40ac-4710-857b-749e0d3d9143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:20.325785 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c48876-40ac-4710-857b-749e0d3d9143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:20.325785 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c48876-40ac-4710-857b-749e0d3d9143 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:20.325785 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c48876-40ac-4710-857b-749e0d3d9143 admin admin] PATH_INFO: `/v3/users/c77af801c8e44efca3c7298ecb02d047` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:20.326218 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c48876-40ac-4710-857b-749e0d3d9143 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c77af801c8e44efca3c7298ecb02d047)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:20.326819 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c48876-40ac-4710-857b-749e0d3d9143 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:20.556242 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b9c48876-40ac-4710-857b-749e0d3d9143 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c77af801c8e44efca3c7298ecb02d047'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:20.570967 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b9c48876-40ac-4710-857b-749e0d3d9143 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c77af801c8e44efca3c7298ecb02d047'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:20.638798 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b9c48876-40ac-4710-857b-749e0d3d9143 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c77af801c8e44efca3c7298ecb02d047'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:20.646495 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b9c48876-40ac-4710-857b-749e0d3d9143 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c77af801c8e44efca3c7298ecb02d047'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:20.647142 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b9c48876-40ac-4710-857b-749e0d3d9143 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c77af801c8e44efca3c7298ecb02d047'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:20.653453 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3595/7180] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:37:20 2022] DELETE /identity/v3/users/c77af801c8e44efca3c7298ecb02d047 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:37:20.658364 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d091f-1afb-4510-9950-fadf68f11674 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:20.658881 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d091f-1afb-4510-9950-fadf68f11674 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:20.659098 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d091f-1afb-4510-9950-fadf68f11674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:20.677228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-601d091f-1afb-4510-9950-fadf68f11674 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:20.678466 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-601d091f-1afb-4510-9950-fadf68f11674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:20.739556 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3586/7181] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:37:20.749654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c48876-40ac-4710-857b-749e0d3d9143 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:20.751155 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b9c48876-40ac-4710-857b-749e0d3d9143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:20.822471 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c48876-40ac-4710-857b-749e0d3d9143 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:20.827081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13e5b1-31ed-4109-8184-13bef89ae69d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:20.829526 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13e5b1-31ed-4109-8184-13bef89ae69d service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:20.829847 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13e5b1-31ed-4109-8184-13bef89ae69d service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:20.830132 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13e5b1-31ed-4109-8184-13bef89ae69d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:20.840981 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a13e5b1-31ed-4109-8184-13bef89ae69d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:20.842643 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a13e5b1-31ed-4109-8184-13bef89ae69d service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:20.859722 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3596/7182] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:37:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:37:21.348958 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d091f-1afb-4510-9950-fadf68f11674 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:21.350509 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-601d091f-1afb-4510-9950-fadf68f11674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:21.364080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d091f-1afb-4510-9950-fadf68f11674 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:21.369329 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64cc890-2704-4293-8778-ff6b4a189fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:21.370231 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64cc890-2704-4293-8778-ff6b4a189fe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:21.370512 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64cc890-2704-4293-8778-ff6b4a189fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:21.370825 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64cc890-2704-4293-8778-ff6b4a189fe9 admin admin] PATH_INFO: `/v3/projects/c29522e8468947d1a9d7f16b9c0f56b2` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:21.372009 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64cc890-2704-4293-8778-ff6b4a189fe9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c29522e8468947d1a9d7f16b9c0f56b2)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:21.373993 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64cc890-2704-4293-8778-ff6b4a189fe9 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:21.503564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e64cc890-2704-4293-8778-ff6b4a189fe9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c29522e8468947d1a9d7f16b9c0f56b2', 'request_id': 'req-e64cc890-2704-4293-8778-ff6b4a189fe9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:21.508928 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e64cc890-2704-4293-8778-ff6b4a189fe9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c29522e8468947d1a9d7f16b9c0f56b2', 'request_id': 'req-e64cc890-2704-4293-8778-ff6b4a189fe9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:21.516028 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e64cc890-2704-4293-8778-ff6b4a189fe9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c29522e8468947d1a9d7f16b9c0f56b2', 'request_id': 'req-e64cc890-2704-4293-8778-ff6b4a189fe9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:21.604184 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e64cc890-2704-4293-8778-ff6b4a189fe9 admin admin] The token cache is being invalidate because project c29522e8468947d1a9d7f16b9c0f56b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:37:21.604535 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e64cc890-2704-4293-8778-ff6b4a189fe9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:21.605167 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e64cc890-2704-4293-8778-ff6b4a189fe9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:21.606972 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3587/7183] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:37:21 2022] DELETE /identity/v3/projects/c29522e8468947d1a9d7f16b9c0f56b2 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:37:22.645029 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13e5b1-31ed-4109-8184-13bef89ae69d service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:22.646644 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9a13e5b1-31ed-4109-8184-13bef89ae69d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:22.705905 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13e5b1-31ed-4109-8184-13bef89ae69d service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:22.755041 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cddd66c-aeb9-4c0f-954f-af153e846946 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:22.755861 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cddd66c-aeb9-4c0f-954f-af153e846946 service cinder] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:22.756243 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cddd66c-aeb9-4c0f-954f-af153e846946 service cinder] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:22.756702 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cddd66c-aeb9-4c0f-954f-af153e846946 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:22.758668 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7cddd66c-aeb9-4c0f-954f-af153e846946 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:22.817092 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cddd66c-aeb9-4c0f-954f-af153e846946 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:22.818824 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cddd66c-aeb9-4c0f-954f-af153e846946 service cinder] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:22.829869 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3597/7184] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:37:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:37:28.463201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64cc890-2704-4293-8778-ff6b4a189fe9 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:28.464601 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e64cc890-2704-4293-8778-ff6b4a189fe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:28.479960 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64cc890-2704-4293-8778-ff6b4a189fe9 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:28.483905 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bbbc87-4d4b-4b05-aa62-466279711ef1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:28.484551 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbbc87-4d4b-4b05-aa62-466279711ef1 service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:28.484834 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbbc87-4d4b-4b05-aa62-466279711ef1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:28.485110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbbc87-4d4b-4b05-aa62-466279711ef1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:28.486922 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-74bbbc87-4d4b-4b05-aa62-466279711ef1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:28.550038 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bbbc87-4d4b-4b05-aa62-466279711ef1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:28.551416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bbbc87-4d4b-4b05-aa62-466279711ef1 service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:28.560894 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3588/7185] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:37:28 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:37:28.691186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cddd66c-aeb9-4c0f-954f-af153e846946 service cinder] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:28.693663 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7cddd66c-aeb9-4c0f-954f-af153e846946 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:28.717054 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bbbc87-4d4b-4b05-aa62-466279711ef1 service cinder] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:28.718621 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-74bbbc87-4d4b-4b05-aa62-466279711ef1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:28.763148 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cddd66c-aeb9-4c0f-954f-af153e846946 service cinder] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:28.771482 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490294e5-ac13-47a8-b182-ac90d948c3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:28.772869 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490294e5-ac13-47a8-b182-ac90d948c3a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:28.773405 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490294e5-ac13-47a8-b182-ac90d948c3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:28.774659 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490294e5-ac13-47a8-b182-ac90d948c3a3 admin admin] PATH_INFO: `/v3/users/2f563accc2f64beaa8e03e66615fa360` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:28.776657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490294e5-ac13-47a8-b182-ac90d948c3a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f563accc2f64beaa8e03e66615fa360)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:28.779290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490294e5-ac13-47a8-b182-ac90d948c3a3 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:28.818589 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bbbc87-4d4b-4b05-aa62-466279711ef1 service cinder] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:28.823480 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe735e-1add-4158-b924-44652c1a2f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:28.824691 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe735e-1add-4158-b924-44652c1a2f9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:28.825005 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe735e-1add-4158-b924-44652c1a2f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:28.833920 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe735e-1add-4158-b924-44652c1a2f9e admin admin] PATH_INFO: `/v3/users/06938e94defa4e68b43b0ea0477b8995` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:28.833920 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe735e-1add-4158-b924-44652c1a2f9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=06938e94defa4e68b43b0ea0477b8995)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:28.833920 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe735e-1add-4158-b924-44652c1a2f9e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:28.991083 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-490294e5-ac13-47a8-b182-ac90d948c3a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f563accc2f64beaa8e03e66615fa360'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:29.006664 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-490294e5-ac13-47a8-b182-ac90d948c3a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f563accc2f64beaa8e03e66615fa360'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:29.018653 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8bbe735e-1add-4158-b924-44652c1a2f9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06938e94defa4e68b43b0ea0477b8995'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:29.034094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8bbe735e-1add-4158-b924-44652c1a2f9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06938e94defa4e68b43b0ea0477b8995'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:29.062791 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-490294e5-ac13-47a8-b182-ac90d948c3a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f563accc2f64beaa8e03e66615fa360'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:29.073876 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-490294e5-ac13-47a8-b182-ac90d948c3a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f563accc2f64beaa8e03e66615fa360'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:29.074677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-490294e5-ac13-47a8-b182-ac90d948c3a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f563accc2f64beaa8e03e66615fa360'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:29.084959 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3598/7186] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:37:28 2022] DELETE /identity/v3/users/2f563accc2f64beaa8e03e66615fa360 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:37:29.089583 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4da090-8a0c-4265-821f-d03c2c02f896 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:29.090000 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4da090-8a0c-4265-821f-d03c2c02f896 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:29.090348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4da090-8a0c-4265-821f-d03c2c02f896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:29.107590 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8bbe735e-1add-4158-b924-44652c1a2f9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06938e94defa4e68b43b0ea0477b8995'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:29.108215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8bbe735e-1add-4158-b924-44652c1a2f9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06938e94defa4e68b43b0ea0477b8995'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:29.114915 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-9d4da090-8a0c-4265-821f-d03c2c02f896 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:29.116441 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9d4da090-8a0c-4265-821f-d03c2c02f896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:29.117615 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8bbe735e-1add-4158-b924-44652c1a2f9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06938e94defa4e68b43b0ea0477b8995'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:29.124436 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3589/7187] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:37:28 2022] DELETE /identity/v3/users/06938e94defa4e68b43b0ea0477b8995 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:37:29.131667 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043dade-7c5f-42f1-8ea0-c381216c8f67 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:29.132038 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043dade-7c5f-42f1-8ea0-c381216c8f67 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:29.132394 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043dade-7c5f-42f1-8ea0-c381216c8f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:29.154975 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-b043dade-7c5f-42f1-8ea0-c381216c8f67 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:29.156280 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b043dade-7c5f-42f1-8ea0-c381216c8f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:29.190791 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3599/7188] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:37:29.207604 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4da090-8a0c-4265-821f-d03c2c02f896 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:29.209198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9d4da090-8a0c-4265-821f-d03c2c02f896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:29.237044 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3590/7189] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:37:29.245614 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043dade-7c5f-42f1-8ea0-c381216c8f67 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:29.247122 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b043dade-7c5f-42f1-8ea0-c381216c8f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:29.275588 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4da090-8a0c-4265-821f-d03c2c02f896 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:29.311871 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043dade-7c5f-42f1-8ea0-c381216c8f67 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:29.316414 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba7f95-3f8d-4a07-985d-6102863d6bf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:29.317276 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba7f95-3f8d-4a07-985d-6102863d6bf5 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:29.317276 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba7f95-3f8d-4a07-985d-6102863d6bf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:29.317534 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba7f95-3f8d-4a07-985d-6102863d6bf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:29.325587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95cfbc-1526-4649-ae9c-d2b98b2d91c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:29.326265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95cfbc-1526-4649-ae9c-d2b98b2d91c3 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:29.326551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95cfbc-1526-4649-ae9c-d2b98b2d91c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:29.326833 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95cfbc-1526-4649-ae9c-d2b98b2d91c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:29.327141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba7f95-3f8d-4a07-985d-6102863d6bf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:29.328688 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba7f95-3f8d-4a07-985d-6102863d6bf5 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:29.339496 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da95cfbc-1526-4649-ae9c-d2b98b2d91c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:29.339496 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da95cfbc-1526-4649-ae9c-d2b98b2d91c3 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:29.339826 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3591/7190] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:37:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:37:29.356262 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3600/7191] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:37:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:37:29.877949 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba7f95-3f8d-4a07-985d-6102863d6bf5 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:29.879398 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7cba7f95-3f8d-4a07-985d-6102863d6bf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:29.894130 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba7f95-3f8d-4a07-985d-6102863d6bf5 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:29.899213 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d2694-0f76-4203-82a9-abe60d9211f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:29.900279 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d2694-0f76-4203-82a9-abe60d9211f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:29.900692 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d2694-0f76-4203-82a9-abe60d9211f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:29.901270 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d2694-0f76-4203-82a9-abe60d9211f5 admin admin] PATH_INFO: `/v3/projects/d24ab3357252430bb71551114c9bf7a3` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:29.902541 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d2694-0f76-4203-82a9-abe60d9211f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d24ab3357252430bb71551114c9bf7a3)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:29.904498 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d2694-0f76-4203-82a9-abe60d9211f5 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:29.943629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95cfbc-1526-4649-ae9c-d2b98b2d91c3 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:29.945295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-da95cfbc-1526-4649-ae9c-d2b98b2d91c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:29.960351 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95cfbc-1526-4649-ae9c-d2b98b2d91c3 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:29.969021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceaddb2-580d-479d-8300-3ef79ae4c050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:29.969938 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceaddb2-580d-479d-8300-3ef79ae4c050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:29.981959 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceaddb2-580d-479d-8300-3ef79ae4c050 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:29.981959 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceaddb2-580d-479d-8300-3ef79ae4c050 admin admin] PATH_INFO: `/v3/projects/ea6a94bdaaa74acc884e368018624221` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:29.981959 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceaddb2-580d-479d-8300-3ef79ae4c050 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea6a94bdaaa74acc884e368018624221)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:29.981959 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceaddb2-580d-479d-8300-3ef79ae4c050 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:30.035237 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6f4d2694-0f76-4203-82a9-abe60d9211f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd24ab3357252430bb71551114c9bf7a3', 'request_id': 'req-6f4d2694-0f76-4203-82a9-abe60d9211f5'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:30.040663 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6f4d2694-0f76-4203-82a9-abe60d9211f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd24ab3357252430bb71551114c9bf7a3', 'request_id': 'req-6f4d2694-0f76-4203-82a9-abe60d9211f5'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:30.047858 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6f4d2694-0f76-4203-82a9-abe60d9211f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd24ab3357252430bb71551114c9bf7a3', 'request_id': 'req-6f4d2694-0f76-4203-82a9-abe60d9211f5'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:30.064742 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4ceaddb2-580d-479d-8300-3ef79ae4c050 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea6a94bdaaa74acc884e368018624221', 'request_id': 'req-4ceaddb2-580d-479d-8300-3ef79ae4c050'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:30.070340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4ceaddb2-580d-479d-8300-3ef79ae4c050 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea6a94bdaaa74acc884e368018624221', 'request_id': 'req-4ceaddb2-580d-479d-8300-3ef79ae4c050'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:30.076462 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4ceaddb2-580d-479d-8300-3ef79ae4c050 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea6a94bdaaa74acc884e368018624221', 'request_id': 'req-4ceaddb2-580d-479d-8300-3ef79ae4c050'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:30.101472 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6f4d2694-0f76-4203-82a9-abe60d9211f5 admin admin] The token cache is being invalidate because project d24ab3357252430bb71551114c9bf7a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:37:30.101794 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6f4d2694-0f76-4203-82a9-abe60d9211f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:30.103773 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6f4d2694-0f76-4203-82a9-abe60d9211f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:30.104066 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3592/7192] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:37:29 2022] DELETE /identity/v3/projects/d24ab3357252430bb71551114c9bf7a3 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:37:30.108623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c284a22-e0cf-4d05-a5a3-05c213a05051 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:30.108916 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c284a22-e0cf-4d05-a5a3-05c213a05051 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:30.109196 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c284a22-e0cf-4d05-a5a3-05c213a05051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:30.128688 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-9c284a22-e0cf-4d05-a5a3-05c213a05051 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:30.129955 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-9c284a22-e0cf-4d05-a5a3-05c213a05051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:30.157981 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4ceaddb2-580d-479d-8300-3ef79ae4c050 admin admin] The token cache is being invalidate because project ea6a94bdaaa74acc884e368018624221 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:37:30.158383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4ceaddb2-580d-479d-8300-3ef79ae4c050 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:30.159116 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4ceaddb2-580d-479d-8300-3ef79ae4c050 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:30.160796 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3601/7193] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:37:29 2022] DELETE /identity/v3/projects/ea6a94bdaaa74acc884e368018624221 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:37:30.166178 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22db8d2-c80a-4e8b-8418-c719d3de50b9 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:30.166465 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22db8d2-c80a-4e8b-8418-c719d3de50b9 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:30.166798 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22db8d2-c80a-4e8b-8418-c719d3de50b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:30.188981 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-f22db8d2-c80a-4e8b-8418-c719d3de50b9 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:30.190864 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f22db8d2-c80a-4e8b-8418-c719d3de50b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:30.195920 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3593/7194] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:37:30.203228 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3602/7195] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:37:30.203471 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d8ed3-5670-432a-9a01-09c2a98d7e4f None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:30.203819 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d8ed3-5670-432a-9a01-09c2a98d7e4f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:30.204107 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d8ed3-5670-432a-9a01-09c2a98d7e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:30.212630 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1d9e8-7776-45b8-be87-a5035d714978 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:30.212925 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1d9e8-7776-45b8-be87-a5035d714978 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:30.213211 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1d9e8-7776-45b8-be87-a5035d714978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:30.228072 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-4d2d8ed3-5670-432a-9a01-09c2a98d7e4f None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:30.229274 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4d2d8ed3-5670-432a-9a01-09c2a98d7e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:30.231230 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-6be1d9e8-7776-45b8-be87-a5035d714978 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:30.232488 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6be1d9e8-7776-45b8-be87-a5035d714978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:30.237562 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3594/7196] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:37:30.243875 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3603/7197] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:37:30.244030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d8ed3-5670-432a-9a01-09c2a98d7e4f None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:30.244965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be1d9e8-7776-45b8-be87-a5035d714978 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:30.251565 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d8ed3-5670-432a-9a01-09c2a98d7e4f None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:30.254609 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be1d9e8-7776-45b8-be87-a5035d714978 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:30.256805 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22742390-6fb8-43ad-ba87-bfd41039db9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:30.257458 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22742390-6fb8-43ad-ba87-bfd41039db9a admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:30.257745 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22742390-6fb8-43ad-ba87-bfd41039db9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:30.258057 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22742390-6fb8-43ad-ba87-bfd41039db9a admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:30.258896 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22742390-6fb8-43ad-ba87-bfd41039db9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:37:30.259253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95905b65-c493-4b26-9632-3ef81e6c17b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:30.259388 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22742390-6fb8-43ad-ba87-bfd41039db9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:30.260540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95905b65-c493-4b26-9632-3ef81e6c17b6 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:30.260540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95905b65-c493-4b26-9632-3ef81e6c17b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:30.260540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95905b65-c493-4b26-9632-3ef81e6c17b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:30.261201 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95905b65-c493-4b26-9632-3ef81e6c17b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:37:30.261512 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95905b65-c493-4b26-9632-3ef81e6c17b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:30.263063 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22742390-6fb8-43ad-ba87-bfd41039db9a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:30.263512 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95905b65-c493-4b26-9632-3ef81e6c17b6 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:30.277823 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3595/7198] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:37:30.280557 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22742390-6fb8-43ad-ba87-bfd41039db9a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:30.283922 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3604/7199] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:37:30.288709 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95905b65-c493-4b26-9632-3ef81e6c17b6 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:30.290679 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22742390-6fb8-43ad-ba87-bfd41039db9a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:30.295236 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267796ac-955a-42f0-b070-782476ce34ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:30.295887 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267796ac-955a-42f0-b070-782476ce34ec admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:30.296172 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267796ac-955a-42f0-b070-782476ce34ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:30.296449 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267796ac-955a-42f0-b070-782476ce34ec admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:30.297130 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267796ac-955a-42f0-b070-782476ce34ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:30.298887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95905b65-c493-4b26-9632-3ef81e6c17b6 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:30.302476 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267796ac-955a-42f0-b070-782476ce34ec admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:30.303664 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c19772-b93a-45ac-8515-53461902a612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:30.304330 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c19772-b93a-45ac-8515-53461902a612 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:30.304615 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c19772-b93a-45ac-8515-53461902a612 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:30.304895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c19772-b93a-45ac-8515-53461902a612 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:30.305609 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c19772-b93a-45ac-8515-53461902a612 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:30.307689 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c19772-b93a-45ac-8515-53461902a612 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:30.381698 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3596/7200] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:37:30 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:37:30.382679 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267796ac-955a-42f0-b070-782476ce34ec admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:30.409645 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3605/7201] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:37:30 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:37:30.410657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c19772-b93a-45ac-8515-53461902a612 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:30.448478 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267796ac-955a-42f0-b070-782476ce34ec admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:30.484594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c19772-b93a-45ac-8515-53461902a612 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:30.490773 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fa48a-c4cc-4f0b-af3e-acbca57699d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:30.491487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fa48a-c4cc-4f0b-af3e-acbca57699d0 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:30.491765 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fa48a-c4cc-4f0b-af3e-acbca57699d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:30.492043 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fa48a-c4cc-4f0b-af3e-acbca57699d0 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:30.492747 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975fa48a-c4cc-4f0b-af3e-acbca57699d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:30.494752 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975fa48a-c4cc-4f0b-af3e-acbca57699d0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:30.507617 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077adf33-c374-4587-8ebb-c257e8a985bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:30.508309 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077adf33-c374-4587-8ebb-c257e8a985bc admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:30.508594 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077adf33-c374-4587-8ebb-c257e8a985bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:30.508874 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077adf33-c374-4587-8ebb-c257e8a985bc admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:30.509557 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077adf33-c374-4587-8ebb-c257e8a985bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:30.511548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077adf33-c374-4587-8ebb-c257e8a985bc admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:30.559480 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3606/7202] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:37:30 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:37:30.563402 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fa48a-c4cc-4f0b-af3e-acbca57699d0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:30.574614 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fa48a-c4cc-4f0b-af3e-acbca57699d0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:30.580722 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afab3351-9680-4a57-9cf7-5767184ee160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:30.580722 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab3351-9680-4a57-9cf7-5767184ee160 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:30.582661 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab3351-9680-4a57-9cf7-5767184ee160 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:30.582661 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab3351-9680-4a57-9cf7-5767184ee160 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:30.582661 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afab3351-9680-4a57-9cf7-5767184ee160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:30.583562 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afab3351-9680-4a57-9cf7-5767184ee160 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:30.604062 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3607/7203] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:37:30.604871 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3597/7204] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:37:30 2022] POST /identity/v3/users => generated 288 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:37:30.605593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afab3351-9680-4a57-9cf7-5767184ee160 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:30.609107 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077adf33-c374-4587-8ebb-c257e8a985bc admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:30.615801 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afab3351-9680-4a57-9cf7-5767184ee160 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:30.620489 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077adf33-c374-4587-8ebb-c257e8a985bc admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:30.620807 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fabf0da-0bf0-4c57-880d-77a56e0876f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:30.623163 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fabf0da-0bf0-4c57-880d-77a56e0876f2 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:30.623163 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fabf0da-0bf0-4c57-880d-77a56e0876f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:30.623163 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fabf0da-0bf0-4c57-880d-77a56e0876f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:30.623163 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fabf0da-0bf0-4c57-880d-77a56e0876f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:30.624380 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fabf0da-0bf0-4c57-880d-77a56e0876f2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:30.634373 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc57ba-4816-429d-b72d-c5c46121d745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:30.634987 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc57ba-4816-429d-b72d-c5c46121d745 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:30.635271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc57ba-4816-429d-b72d-c5c46121d745 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:30.635551 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc57ba-4816-429d-b72d-c5c46121d745 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:30.637569 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3608/7205] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:37:30.637705 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc57ba-4816-429d-b72d-c5c46121d745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:30.640220 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc57ba-4816-429d-b72d-c5c46121d745 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:30.643201 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fabf0da-0bf0-4c57-880d-77a56e0876f2 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:30.649921 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3598/7206] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:37:30.653570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fabf0da-0bf0-4c57-880d-77a56e0876f2 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:30.654183 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc57ba-4816-429d-b72d-c5c46121d745 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:30.659364 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a95b97-233e-4c91-aa60-09a4a7e98f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:30.661655 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a95b97-233e-4c91-aa60-09a4a7e98f65 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:30.661655 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a95b97-233e-4c91-aa60-09a4a7e98f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:30.661655 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a95b97-233e-4c91-aa60-09a4a7e98f65 admin admin] PATH_INFO: `/v3/projects/f8388ff30f2f4f8f825c0cdf907c42a3/users/32f360876ae54681813701845c90ff77/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:30.664942 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc57ba-4816-429d-b72d-c5c46121d745 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:30.669672 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d6b9b-ed0b-40cf-9768-6ef4a0664af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:30.670364 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d6b9b-ed0b-40cf-9768-6ef4a0664af4 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:30.670649 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d6b9b-ed0b-40cf-9768-6ef4a0664af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:30.670932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d6b9b-ed0b-40cf-9768-6ef4a0664af4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:30.671638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750d6b9b-ed0b-40cf-9768-6ef4a0664af4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:30.673347 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750d6b9b-ed0b-40cf-9768-6ef4a0664af4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:30.678702 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a95b97-233e-4c91-aa60-09a4a7e98f65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8388ff30f2f4f8f825c0cdf907c42a3, user_id=32f360876ae54681813701845c90ff77, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:30.685465 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a95b97-233e-4c91-aa60-09a4a7e98f65 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:30.685594 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3599/7207] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:37:30.692579 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d6b9b-ed0b-40cf-9768-6ef4a0664af4 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:30.702736 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d6b9b-ed0b-40cf-9768-6ef4a0664af4 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:30.707596 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8fc8ec-c7d7-44c8-a524-abeb188f668b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:30.708491 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fc8ec-c7d7-44c8-a524-abeb188f668b admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:30.708776 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fc8ec-c7d7-44c8-a524-abeb188f668b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:30.713017 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fc8ec-c7d7-44c8-a524-abeb188f668b admin admin] PATH_INFO: `/v3/projects/bfe2a268b20142dd8f44d77ab5c8d3fe/users/4f27f38b9e3b43d482c01038f0480fd1/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:30.723435 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8fc8ec-c7d7-44c8-a524-abeb188f668b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfe2a268b20142dd8f44d77ab5c8d3fe, user_id=4f27f38b9e3b43d482c01038f0480fd1, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:30.726089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8fc8ec-c7d7-44c8-a524-abeb188f668b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:30.781768 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3609/7208] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:37:30 2022] PUT /identity/v3/projects/f8388ff30f2f4f8f825c0cdf907c42a3/users/32f360876ae54681813701845c90ff77/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:37:30.791886 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1753b-ebac-41f0-ba53-b61b1a6d1257 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:30.792181 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1753b-ebac-41f0-ba53-b61b1a6d1257 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:30.792486 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1753b-ebac-41f0-ba53-b61b1a6d1257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:30.819451 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-7af1753b-ebac-41f0-ba53-b61b1a6d1257 None None] MFA Rules not processed for user `32f360876ae54681813701845c90ff77`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:30.820777 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7af1753b-ebac-41f0-ba53-b61b1a6d1257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:30.833621 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3600/7209] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:37:30 2022] PUT /identity/v3/projects/bfe2a268b20142dd8f44d77ab5c8d3fe/users/4f27f38b9e3b43d482c01038f0480fd1/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:37:30.843905 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefd1b6-4539-4301-8d2c-b5e7a59cde67 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:30.844258 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefd1b6-4539-4301-8d2c-b5e7a59cde67 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:30.844604 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefd1b6-4539-4301-8d2c-b5e7a59cde67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:30.874804 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-dcefd1b6-4539-4301-8d2c-b5e7a59cde67 None None] MFA Rules not processed for user `4f27f38b9e3b43d482c01038f0480fd1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:30.875139 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-dcefd1b6-4539-4301-8d2c-b5e7a59cde67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:30.888112 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3610/7210] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:37:30.900894 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1753b-ebac-41f0-ba53-b61b1a6d1257 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:30.902531 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7af1753b-ebac-41f0-ba53-b61b1a6d1257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:30.946871 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3601/7211] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:37:30.957662 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcefd1b6-4539-4301-8d2c-b5e7a59cde67 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:30.959135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-dcefd1b6-4539-4301-8d2c-b5e7a59cde67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:30.968139 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1753b-ebac-41f0-ba53-b61b1a6d1257 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:31.019274 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe2126-b5e0-4c00-810e-03688de85686 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:31.019958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe2126-b5e0-4c00-810e-03688de85686 service cinder] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:31.020291 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe2126-b5e0-4c00-810e-03688de85686 service cinder] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:31.020513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe2126-b5e0-4c00-810e-03688de85686 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:31.029853 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcefd1b6-4539-4301-8d2c-b5e7a59cde67 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:31.036574 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3a1c5-4af3-42aa-b6f9-451fc0fe063b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:31.037709 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3a1c5-4af3-42aa-b6f9-451fc0fe063b service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:31.037982 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3a1c5-4af3-42aa-b6f9-451fc0fe063b service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:31.038261 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3a1c5-4af3-42aa-b6f9-451fc0fe063b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:31.048443 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3a1c5-4af3-42aa-b6f9-451fc0fe063b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:31.050645 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3a1c5-4af3-42aa-b6f9-451fc0fe063b service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:31.062623 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3602/7212] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:37:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:37:31.089228 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fe2126-b5e0-4c00-810e-03688de85686 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:31.090672 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fe2126-b5e0-4c00-810e-03688de85686 service cinder] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:31.102023 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3611/7213] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:37:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:37:34.914282 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2be63-ba2a-47df-a826-72076e721336 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:34.914770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2be63-ba2a-47df-a826-72076e721336 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:34.914925 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2be63-ba2a-47df-a826-72076e721336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:34.936597 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-e6e2be63-ba2a-47df-a826-72076e721336 None None] MFA Rules not processed for user `3107c6d79451405a963c5816d92055b3`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:34.938166 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e6e2be63-ba2a-47df-a826-72076e721336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:34.999394 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3603/7214] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:34 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:37:39.463863 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe2126-b5e0-4c00-810e-03688de85686 service cinder] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:39.552996 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe2126-b5e0-4c00-810e-03688de85686 service cinder] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:39.557715 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efbbb1e-f084-4edb-91e4-e4dc395ac018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:39.558669 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbbb1e-f084-4edb-91e4-e4dc395ac018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:39.558955 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbbb1e-f084-4edb-91e4-e4dc395ac018 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:39.559234 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbbb1e-f084-4edb-91e4-e4dc395ac018 admin admin] PATH_INFO: `/v3/users/32f360876ae54681813701845c90ff77` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:39.560435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efbbb1e-f084-4edb-91e4-e4dc395ac018 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32f360876ae54681813701845c90ff77)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:39.562413 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efbbb1e-f084-4edb-91e4-e4dc395ac018 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:39.786068 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8efbbb1e-f084-4edb-91e4-e4dc395ac018 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32f360876ae54681813701845c90ff77'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:39.804999 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8efbbb1e-f084-4edb-91e4-e4dc395ac018 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32f360876ae54681813701845c90ff77'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:39.878830 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8efbbb1e-f084-4edb-91e4-e4dc395ac018 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32f360876ae54681813701845c90ff77'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:39.886702 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8efbbb1e-f084-4edb-91e4-e4dc395ac018 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32f360876ae54681813701845c90ff77'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:39.888890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8efbbb1e-f084-4edb-91e4-e4dc395ac018 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32f360876ae54681813701845c90ff77'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:39.893659 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3612/7215] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:37:39 2022] DELETE /identity/v3/users/32f360876ae54681813701845c90ff77 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:37:39.898616 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11176e-14f4-4252-b19b-2051b630b1d4 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:39.899499 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11176e-14f4-4252-b19b-2051b630b1d4 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:39.900050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11176e-14f4-4252-b19b-2051b630b1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:39.928769 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-7a11176e-14f4-4252-b19b-2051b630b1d4 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:39.928769 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7a11176e-14f4-4252-b19b-2051b630b1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:39.994670 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3604/7216] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:37:40.005428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efbbb1e-f084-4edb-91e4-e4dc395ac018 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:40.006907 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8efbbb1e-f084-4edb-91e4-e4dc395ac018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:40.089472 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efbbb1e-f084-4edb-91e4-e4dc395ac018 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:40.094555 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5853c-4a49-49bf-abfe-7ac78b262216 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:40.095266 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5853c-4a49-49bf-abfe-7ac78b262216 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:40.096076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5853c-4a49-49bf-abfe-7ac78b262216 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:40.096523 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5853c-4a49-49bf-abfe-7ac78b262216 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:40.116158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5853c-4a49-49bf-abfe-7ac78b262216 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:40.121159 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5853c-4a49-49bf-abfe-7ac78b262216 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:40.143897 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3613/7217] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:37:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:37:40.859403 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11176e-14f4-4252-b19b-2051b630b1d4 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:40.860944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7a11176e-14f4-4252-b19b-2051b630b1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:40.900813 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11176e-14f4-4252-b19b-2051b630b1d4 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:40.906099 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130cc35a-5764-49e0-9e78-66b7da4c9ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:40.907351 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cc35a-5764-49e0-9e78-66b7da4c9ed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:40.907694 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cc35a-5764-49e0-9e78-66b7da4c9ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:40.908150 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cc35a-5764-49e0-9e78-66b7da4c9ed0 admin admin] PATH_INFO: `/v3/projects/f8388ff30f2f4f8f825c0cdf907c42a3` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:40.909413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130cc35a-5764-49e0-9e78-66b7da4c9ed0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8388ff30f2f4f8f825c0cdf907c42a3)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:40.912227 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130cc35a-5764-49e0-9e78-66b7da4c9ed0 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:41.095451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-130cc35a-5764-49e0-9e78-66b7da4c9ed0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8388ff30f2f4f8f825c0cdf907c42a3', 'request_id': 'req-130cc35a-5764-49e0-9e78-66b7da4c9ed0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:41.100813 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-130cc35a-5764-49e0-9e78-66b7da4c9ed0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8388ff30f2f4f8f825c0cdf907c42a3', 'request_id': 'req-130cc35a-5764-49e0-9e78-66b7da4c9ed0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:41.107405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-130cc35a-5764-49e0-9e78-66b7da4c9ed0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8388ff30f2f4f8f825c0cdf907c42a3', 'request_id': 'req-130cc35a-5764-49e0-9e78-66b7da4c9ed0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:41.203965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-130cc35a-5764-49e0-9e78-66b7da4c9ed0 admin admin] The token cache is being invalidate because project f8388ff30f2f4f8f825c0cdf907c42a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:37:41.209833 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-130cc35a-5764-49e0-9e78-66b7da4c9ed0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:41.209833 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-130cc35a-5764-49e0-9e78-66b7da4c9ed0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:41.209833 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3605/7218] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:37:40 2022] DELETE /identity/v3/projects/f8388ff30f2f4f8f825c0cdf907c42a3 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:37:41.212251 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc589fb-4e9e-44fd-91c5-bd37ffd629cd None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:41.212760 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc589fb-4e9e-44fd-91c5-bd37ffd629cd None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:41.212929 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc589fb-4e9e-44fd-91c5-bd37ffd629cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:41.243645 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-7fc589fb-4e9e-44fd-91c5-bd37ffd629cd None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:41.245160 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7fc589fb-4e9e-44fd-91c5-bd37ffd629cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:41.312410 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3614/7219] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:37:41.320898 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d9792-643e-484b-9bfb-d7b3f3212387 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:41.321262 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d9792-643e-484b-9bfb-d7b3f3212387 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:41.321610 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d9792-643e-484b-9bfb-d7b3f3212387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:41.341250 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-cf8d9792-643e-484b-9bfb-d7b3f3212387 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:41.342503 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-cf8d9792-643e-484b-9bfb-d7b3f3212387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:41.351699 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3606/7220] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:37:41.355988 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc589fb-4e9e-44fd-91c5-bd37ffd629cd None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:41.367639 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc589fb-4e9e-44fd-91c5-bd37ffd629cd None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:41.376028 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe5b43-f767-4f73-aa2c-192a3f66c86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:41.376697 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe5b43-f767-4f73-aa2c-192a3f66c86b admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:41.377005 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe5b43-f767-4f73-aa2c-192a3f66c86b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:41.377282 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe5b43-f767-4f73-aa2c-192a3f66c86b admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:41.378286 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe5b43-f767-4f73-aa2c-192a3f66c86b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:37:41.378594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe5b43-f767-4f73-aa2c-192a3f66c86b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:41.381986 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe5b43-f767-4f73-aa2c-192a3f66c86b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:41.396585 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3615/7221] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:37:41.401136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d9792-643e-484b-9bfb-d7b3f3212387 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:41.412631 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d9792-643e-484b-9bfb-d7b3f3212387 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:41.417903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b5632-322b-42ed-bf96-5514b9774978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:41.418576 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b5632-322b-42ed-bf96-5514b9774978 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:41.418860 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b5632-322b-42ed-bf96-5514b9774978 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:41.419134 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b5632-322b-42ed-bf96-5514b9774978 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:41.419837 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b5632-322b-42ed-bf96-5514b9774978 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:41.421813 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b5632-322b-42ed-bf96-5514b9774978 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:41.546121 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3607/7222] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:37:41 2022] POST /identity/v3/projects => generated 371 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:37:41.547311 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe5b43-f767-4f73-aa2c-192a3f66c86b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:41.558077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe5b43-f767-4f73-aa2c-192a3f66c86b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:41.623345 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d770e7c-60fa-475c-9293-b6ac1f3522ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:41.624024 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d770e7c-60fa-475c-9293-b6ac1f3522ac admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:41.624309 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d770e7c-60fa-475c-9293-b6ac1f3522ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:41.624585 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d770e7c-60fa-475c-9293-b6ac1f3522ac admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:41.625279 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d770e7c-60fa-475c-9293-b6ac1f3522ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:41.627302 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d770e7c-60fa-475c-9293-b6ac1f3522ac admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:41.696812 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3616/7223] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:37:41 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:37:41.700824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b5632-322b-42ed-bf96-5514b9774978 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:41.712847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b5632-322b-42ed-bf96-5514b9774978 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:41.718022 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a6679-0a40-49b4-82f4-983cd66fd939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:41.718682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a6679-0a40-49b4-82f4-983cd66fd939 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:41.719020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a6679-0a40-49b4-82f4-983cd66fd939 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:41.719296 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a6679-0a40-49b4-82f4-983cd66fd939 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:41.720017 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270a6679-0a40-49b4-82f4-983cd66fd939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:41.722299 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270a6679-0a40-49b4-82f4-983cd66fd939 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:41.733228 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3608/7224] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:37:41.737209 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d770e7c-60fa-475c-9293-b6ac1f3522ac admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:41.747808 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d770e7c-60fa-475c-9293-b6ac1f3522ac admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:41.758796 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db051683-409d-4201-be78-4373d5c9ea34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:41.758796 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db051683-409d-4201-be78-4373d5c9ea34 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:41.758796 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db051683-409d-4201-be78-4373d5c9ea34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:41.758796 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db051683-409d-4201-be78-4373d5c9ea34 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:41.759203 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db051683-409d-4201-be78-4373d5c9ea34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:41.759203 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db051683-409d-4201-be78-4373d5c9ea34 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:41.768285 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3617/7225] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:37:41.774308 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a6679-0a40-49b4-82f4-983cd66fd939 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:41.787395 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a6679-0a40-49b4-82f4-983cd66fd939 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:41.792740 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e4a5e-5692-420a-99f7-2d9143d6197a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:41.793833 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e4a5e-5692-420a-99f7-2d9143d6197a admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:41.794375 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e4a5e-5692-420a-99f7-2d9143d6197a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:41.794918 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e4a5e-5692-420a-99f7-2d9143d6197a admin admin] PATH_INFO: `/v3/projects/bfeeac0c49384132a08a8d0dd5654b73/users/f93380560fd14d50af229186796db509/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:41.812965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e4a5e-5692-420a-99f7-2d9143d6197a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfeeac0c49384132a08a8d0dd5654b73, user_id=f93380560fd14d50af229186796db509, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:41.818927 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e4a5e-5692-420a-99f7-2d9143d6197a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:41.886276 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3609/7226] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:37:41 2022] PUT /identity/v3/projects/bfeeac0c49384132a08a8d0dd5654b73/users/f93380560fd14d50af229186796db509/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:37:41.898673 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526b82a-0af1-4af4-858b-985ff0947174 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:41.898949 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526b82a-0af1-4af4-858b-985ff0947174 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:41.899227 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526b82a-0af1-4af4-858b-985ff0947174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:41.930609 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-c526b82a-0af1-4af4-858b-985ff0947174 None None] MFA Rules not processed for user `f93380560fd14d50af229186796db509`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:41.932225 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c526b82a-0af1-4af4-858b-985ff0947174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:42.041138 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3618/7227] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:37:42.055937 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e4a5e-5692-420a-99f7-2d9143d6197a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:42.057942 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b96e4a5e-5692-420a-99f7-2d9143d6197a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:42.129166 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e4a5e-5692-420a-99f7-2d9143d6197a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:42.132825 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d8303-0d10-4d2f-a2c1-4d3552885ea5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e302b1298dd04d6590e3d079f7b13b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:42.133488 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d8303-0d10-4d2f-a2c1-4d3552885ea5 service glance] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:42.133801 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d8303-0d10-4d2f-a2c1-4d3552885ea5 service glance] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:42.134081 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d8303-0d10-4d2f-a2c1-4d3552885ea5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:42.143494 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d8303-0d10-4d2f-a2c1-4d3552885ea5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:42.144966 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d8303-0d10-4d2f-a2c1-4d3552885ea5 service glance] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:42.154530 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3610/7228] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:37:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:37:43.953508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526b82a-0af1-4af4-858b-985ff0947174 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:43.955682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c526b82a-0af1-4af4-858b-985ff0947174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:44.021214 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526b82a-0af1-4af4-858b-985ff0947174 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:44.026153 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e1ae6-fbd9-4d68-a02a-e198e250955a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:44.027017 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e1ae6-fbd9-4d68-a02a-e198e250955a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:44.027301 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e1ae6-fbd9-4d68-a02a-e198e250955a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:44.027582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e1ae6-fbd9-4d68-a02a-e198e250955a admin admin] PATH_INFO: `/v3/users/fc2dbf2ab81b4a6d921f2ef0c0bc345e` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:44.028777 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46e1ae6-fbd9-4d68-a02a-e198e250955a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc2dbf2ab81b4a6d921f2ef0c0bc345e)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:44.030804 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46e1ae6-fbd9-4d68-a02a-e198e250955a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:44.331522 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e46e1ae6-fbd9-4d68-a02a-e198e250955a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc2dbf2ab81b4a6d921f2ef0c0bc345e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:44.342853 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e46e1ae6-fbd9-4d68-a02a-e198e250955a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc2dbf2ab81b4a6d921f2ef0c0bc345e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:44.429668 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e46e1ae6-fbd9-4d68-a02a-e198e250955a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc2dbf2ab81b4a6d921f2ef0c0bc345e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:44.437649 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e46e1ae6-fbd9-4d68-a02a-e198e250955a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc2dbf2ab81b4a6d921f2ef0c0bc345e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:44.438400 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e46e1ae6-fbd9-4d68-a02a-e198e250955a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc2dbf2ab81b4a6d921f2ef0c0bc345e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:44.444957 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3619/7229] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:37:43 2022] DELETE /identity/v3/users/fc2dbf2ab81b4a6d921f2ef0c0bc345e => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:37:44.449716 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a21bc-f319-4a4e-9412-88cefbd92475 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:44.450214 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a21bc-f319-4a4e-9412-88cefbd92475 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:44.450328 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a21bc-f319-4a4e-9412-88cefbd92475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:44.473608 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-039a21bc-f319-4a4e-9412-88cefbd92475 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:44.475138 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-039a21bc-f319-4a4e-9412-88cefbd92475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:44.539900 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3611/7230] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:37:44.550339 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e1ae6-fbd9-4d68-a02a-e198e250955a admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:44.552034 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e46e1ae6-fbd9-4d68-a02a-e198e250955a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:44.627165 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e1ae6-fbd9-4d68-a02a-e198e250955a admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:44.635492 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38973f47-67ce-4317-9304-cc379616fe9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:44.636152 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38973f47-67ce-4317-9304-cc379616fe9d service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:44.636438 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38973f47-67ce-4317-9304-cc379616fe9d service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:44.636717 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38973f47-67ce-4317-9304-cc379616fe9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:44.647095 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38973f47-67ce-4317-9304-cc379616fe9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:44.649052 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38973f47-67ce-4317-9304-cc379616fe9d service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:44.658982 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3620/7231] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:37:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:37:45.074189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a21bc-f319-4a4e-9412-88cefbd92475 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:45.075759 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-039a21bc-f319-4a4e-9412-88cefbd92475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:45.098236 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a21bc-f319-4a4e-9412-88cefbd92475 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:45.102103 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334806a-d6f1-4494-b6ef-8ce5e147faf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:45.102966 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334806a-d6f1-4494-b6ef-8ce5e147faf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:45.103244 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334806a-d6f1-4494-b6ef-8ce5e147faf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:45.103559 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334806a-d6f1-4494-b6ef-8ce5e147faf6 admin admin] PATH_INFO: `/v3/projects/8cfecbeba61c420a8185d621647a8059` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:45.104675 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c334806a-d6f1-4494-b6ef-8ce5e147faf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cfecbeba61c420a8185d621647a8059)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:45.106674 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c334806a-d6f1-4494-b6ef-8ce5e147faf6 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:45.217641 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c334806a-d6f1-4494-b6ef-8ce5e147faf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cfecbeba61c420a8185d621647a8059', 'request_id': 'req-c334806a-d6f1-4494-b6ef-8ce5e147faf6'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:45.224464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c334806a-d6f1-4494-b6ef-8ce5e147faf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cfecbeba61c420a8185d621647a8059', 'request_id': 'req-c334806a-d6f1-4494-b6ef-8ce5e147faf6'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:45.231046 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c334806a-d6f1-4494-b6ef-8ce5e147faf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cfecbeba61c420a8185d621647a8059', 'request_id': 'req-c334806a-d6f1-4494-b6ef-8ce5e147faf6'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:45.312374 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c334806a-d6f1-4494-b6ef-8ce5e147faf6 admin admin] The token cache is being invalidate because project 8cfecbeba61c420a8185d621647a8059 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:37:45.312663 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c334806a-d6f1-4494-b6ef-8ce5e147faf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:45.313293 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c334806a-d6f1-4494-b6ef-8ce5e147faf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:45.315623 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3612/7232] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:37:45 2022] DELETE /identity/v3/projects/8cfecbeba61c420a8185d621647a8059 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:37:45.319848 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38973f47-67ce-4317-9304-cc379616fe9d service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:45.329634 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38973f47-67ce-4317-9304-cc379616fe9d service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:45.385386 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50bfa58-10cc-4a5f-aaf3-ca18ea76320c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:45.386355 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50bfa58-10cc-4a5f-aaf3-ca18ea76320c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:45.386642 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50bfa58-10cc-4a5f-aaf3-ca18ea76320c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:45.386925 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50bfa58-10cc-4a5f-aaf3-ca18ea76320c admin admin] PATH_INFO: `/v3/users/4933721686744b198ee13a684dec4f03` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:45.388125 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50bfa58-10cc-4a5f-aaf3-ca18ea76320c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4933721686744b198ee13a684dec4f03)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:45.390244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50bfa58-10cc-4a5f-aaf3-ca18ea76320c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:45.566350 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a50bfa58-10cc-4a5f-aaf3-ca18ea76320c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4933721686744b198ee13a684dec4f03'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:45.577782 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a50bfa58-10cc-4a5f-aaf3-ca18ea76320c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4933721686744b198ee13a684dec4f03'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:45.655520 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a50bfa58-10cc-4a5f-aaf3-ca18ea76320c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4933721686744b198ee13a684dec4f03'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:45.663118 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a50bfa58-10cc-4a5f-aaf3-ca18ea76320c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4933721686744b198ee13a684dec4f03'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:45.663763 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a50bfa58-10cc-4a5f-aaf3-ca18ea76320c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4933721686744b198ee13a684dec4f03'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:45.669687 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3621/7233] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:37:45 2022] DELETE /identity/v3/users/4933721686744b198ee13a684dec4f03 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:37:46.116735 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334806a-d6f1-4494-b6ef-8ce5e147faf6 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:46.119052 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c334806a-d6f1-4494-b6ef-8ce5e147faf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:46.131868 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334806a-d6f1-4494-b6ef-8ce5e147faf6 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:46.204624 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb123fc2-b36f-4090-a3f9-10ceca9afd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:46.206042 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb123fc2-b36f-4090-a3f9-10ceca9afd47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:46.206326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb123fc2-b36f-4090-a3f9-10ceca9afd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:46.206599 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb123fc2-b36f-4090-a3f9-10ceca9afd47 admin admin] PATH_INFO: `/v3/projects/a9a2ae2a88ea4fd5a929a9de70c40f32` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:46.207777 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb123fc2-b36f-4090-a3f9-10ceca9afd47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9a2ae2a88ea4fd5a929a9de70c40f32)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:46.210178 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb123fc2-b36f-4090-a3f9-10ceca9afd47 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:46.316152 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-bb123fc2-b36f-4090-a3f9-10ceca9afd47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9a2ae2a88ea4fd5a929a9de70c40f32', 'request_id': 'req-bb123fc2-b36f-4090-a3f9-10ceca9afd47'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:46.321642 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-bb123fc2-b36f-4090-a3f9-10ceca9afd47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9a2ae2a88ea4fd5a929a9de70c40f32', 'request_id': 'req-bb123fc2-b36f-4090-a3f9-10ceca9afd47'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:46.328215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-bb123fc2-b36f-4090-a3f9-10ceca9afd47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9a2ae2a88ea4fd5a929a9de70c40f32', 'request_id': 'req-bb123fc2-b36f-4090-a3f9-10ceca9afd47'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:46.625951 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-bb123fc2-b36f-4090-a3f9-10ceca9afd47 admin admin] The token cache is being invalidate because project a9a2ae2a88ea4fd5a929a9de70c40f32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:37:46.626252 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-bb123fc2-b36f-4090-a3f9-10ceca9afd47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:46.627439 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-bb123fc2-b36f-4090-a3f9-10ceca9afd47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:46.629015 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3613/7234] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:37:46 2022] DELETE /identity/v3/projects/a9a2ae2a88ea4fd5a929a9de70c40f32 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:37:46.633774 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50bfa58-10cc-4a5f-aaf3-ca18ea76320c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:46.635493 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a50bfa58-10cc-4a5f-aaf3-ca18ea76320c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:46.653572 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50bfa58-10cc-4a5f-aaf3-ca18ea76320c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:46.712572 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5f4e7-d5ae-4fc1-a0f0-0b2a04df5334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:46.713464 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5f4e7-d5ae-4fc1-a0f0-0b2a04df5334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:46.713746 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5f4e7-d5ae-4fc1-a0f0-0b2a04df5334 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:46.714050 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5f4e7-d5ae-4fc1-a0f0-0b2a04df5334 admin admin] PATH_INFO: `/v3/users/23af625e4e1e4779b4f01ebb735701fa` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:46.715228 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5f4e7-d5ae-4fc1-a0f0-0b2a04df5334 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23af625e4e1e4779b4f01ebb735701fa)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:46.717148 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5f4e7-d5ae-4fc1-a0f0-0b2a04df5334 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:46.915437 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-37f5f4e7-d5ae-4fc1-a0f0-0b2a04df5334 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23af625e4e1e4779b4f01ebb735701fa'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:46.929711 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-37f5f4e7-d5ae-4fc1-a0f0-0b2a04df5334 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23af625e4e1e4779b4f01ebb735701fa'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:46.969670 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-37f5f4e7-d5ae-4fc1-a0f0-0b2a04df5334 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23af625e4e1e4779b4f01ebb735701fa'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:46.983521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-37f5f4e7-d5ae-4fc1-a0f0-0b2a04df5334 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23af625e4e1e4779b4f01ebb735701fa'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:46.984261 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-37f5f4e7-d5ae-4fc1-a0f0-0b2a04df5334 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23af625e4e1e4779b4f01ebb735701fa'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:46.991436 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3622/7235] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:37:46 2022] DELETE /identity/v3/users/23af625e4e1e4779b4f01ebb735701fa => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:37:47.425902 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb123fc2-b36f-4090-a3f9-10ceca9afd47 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:47.425902 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-bb123fc2-b36f-4090-a3f9-10ceca9afd47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:47.438314 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb123fc2-b36f-4090-a3f9-10ceca9afd47 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:47.518287 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249b959-c9ae-47fb-bac3-ef6c971dfb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:47.519317 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249b959-c9ae-47fb-bac3-ef6c971dfb69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:47.519696 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249b959-c9ae-47fb-bac3-ef6c971dfb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:47.520357 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249b959-c9ae-47fb-bac3-ef6c971dfb69 admin admin] PATH_INFO: `/v3/projects/af04af1fe9be4985b4a65ed97335a1cf` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:47.521405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4249b959-c9ae-47fb-bac3-ef6c971dfb69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af04af1fe9be4985b4a65ed97335a1cf)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:47.523958 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4249b959-c9ae-47fb-bac3-ef6c971dfb69 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:47.601065 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5f4e7-d5ae-4fc1-a0f0-0b2a04df5334 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:47.602521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-37f5f4e7-d5ae-4fc1-a0f0-0b2a04df5334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:47.616201 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5f4e7-d5ae-4fc1-a0f0-0b2a04df5334 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:47.629494 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4249b959-c9ae-47fb-bac3-ef6c971dfb69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af04af1fe9be4985b4a65ed97335a1cf', 'request_id': 'req-4249b959-c9ae-47fb-bac3-ef6c971dfb69'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:47.635651 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4249b959-c9ae-47fb-bac3-ef6c971dfb69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af04af1fe9be4985b4a65ed97335a1cf', 'request_id': 'req-4249b959-c9ae-47fb-bac3-ef6c971dfb69'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:47.642494 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4249b959-c9ae-47fb-bac3-ef6c971dfb69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af04af1fe9be4985b4a65ed97335a1cf', 'request_id': 'req-4249b959-c9ae-47fb-bac3-ef6c971dfb69'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:47.674461 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ed218-4b03-4f05-908b-18729803f9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:47.675339 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ed218-4b03-4f05-908b-18729803f9c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:47.675651 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ed218-4b03-4f05-908b-18729803f9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:47.675928 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ed218-4b03-4f05-908b-18729803f9c2 admin admin] PATH_INFO: `/v3/users/02f6985817d347d2b74ba939500f55a1` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:47.677131 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ed218-4b03-4f05-908b-18729803f9c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02f6985817d347d2b74ba939500f55a1)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:47.679113 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ed218-4b03-4f05-908b-18729803f9c2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:47.740588 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4249b959-c9ae-47fb-bac3-ef6c971dfb69 admin admin] The token cache is being invalidate because project af04af1fe9be4985b4a65ed97335a1cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:37:47.740934 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4249b959-c9ae-47fb-bac3-ef6c971dfb69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:47.741567 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4249b959-c9ae-47fb-bac3-ef6c971dfb69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:47.743148 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3614/7236] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:37:47 2022] DELETE /identity/v3/projects/af04af1fe9be4985b4a65ed97335a1cf => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:37:47.747839 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c96cfa-bb73-4e61-a60d-f0c5eeb64d82 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:47.748130 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c96cfa-bb73-4e61-a60d-f0c5eeb64d82 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:47.748415 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c96cfa-bb73-4e61-a60d-f0c5eeb64d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:47.765988 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-e9c96cfa-bb73-4e61-a60d-f0c5eeb64d82 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:47.767801 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e9c96cfa-bb73-4e61-a60d-f0c5eeb64d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:47.782586 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3615/7237] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:37:47.793973 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79857f-4b2e-4ff6-bd24-68db5bc4fb95 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:47.794267 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79857f-4b2e-4ff6-bd24-68db5bc4fb95 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:47.794582 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79857f-4b2e-4ff6-bd24-68db5bc4fb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:47.814684 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-ba79857f-4b2e-4ff6-bd24-68db5bc4fb95 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:47.815925 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ba79857f-4b2e-4ff6-bd24-68db5bc4fb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:47.824617 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3616/7238] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:37:47.828966 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79857f-4b2e-4ff6-bd24-68db5bc4fb95 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:47.839043 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79857f-4b2e-4ff6-bd24-68db5bc4fb95 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:47.844270 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa2b16-868b-4392-b357-63aa315c4c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:47.845086 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa2b16-868b-4392-b357-63aa315c4c1a admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:47.846063 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa2b16-868b-4392-b357-63aa315c4c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:47.846348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa2b16-868b-4392-b357-63aa315c4c1a admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:47.847147 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa2b16-868b-4392-b357-63aa315c4c1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:37:47.847564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa2b16-868b-4392-b357-63aa315c4c1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:47.849000 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa2b16-868b-4392-b357-63aa315c4c1a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:47.861354 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3617/7239] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:37:47.865943 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa2b16-868b-4392-b357-63aa315c4c1a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:47.870827 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a16ed218-4b03-4f05-908b-18729803f9c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02f6985817d347d2b74ba939500f55a1'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:47.886741 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa2b16-868b-4392-b357-63aa315c4c1a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:47.890520 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a16ed218-4b03-4f05-908b-18729803f9c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02f6985817d347d2b74ba939500f55a1'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:47.891575 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5c357-9709-4453-b0fc-93260e2f6fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:47.892795 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5c357-9709-4453-b0fc-93260e2f6fc4 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:47.893088 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5c357-9709-4453-b0fc-93260e2f6fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:47.893364 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5c357-9709-4453-b0fc-93260e2f6fc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:47.894089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5c357-9709-4453-b0fc-93260e2f6fc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:47.896046 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5c357-9709-4453-b0fc-93260e2f6fc4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:47.946607 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a16ed218-4b03-4f05-908b-18729803f9c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02f6985817d347d2b74ba939500f55a1'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:47.954021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a16ed218-4b03-4f05-908b-18729803f9c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02f6985817d347d2b74ba939500f55a1'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:47.960737 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a16ed218-4b03-4f05-908b-18729803f9c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02f6985817d347d2b74ba939500f55a1'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:47.961015 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3623/7240] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:37:47 2022] DELETE /identity/v3/users/02f6985817d347d2b74ba939500f55a1 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:37:47.965334 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7b518-75ae-4cd3-b87e-539c3ed2c523 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:47.965630 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7b518-75ae-4cd3-b87e-539c3ed2c523 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:47.965949 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7b518-75ae-4cd3-b87e-539c3ed2c523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:47.982380 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3618/7241] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:37:47 2022] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:37:47.985917 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-83b7b518-75ae-4cd3-b87e-539c3ed2c523 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:47.985917 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-83b7b518-75ae-4cd3-b87e-539c3ed2c523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:47.986944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5c357-9709-4453-b0fc-93260e2f6fc4 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:47.988503 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8bb5c357-9709-4453-b0fc-93260e2f6fc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:48.044922 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3624/7242] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:37:48.051632 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5c357-9709-4453-b0fc-93260e2f6fc4 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:48.055466 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7b518-75ae-4cd3-b87e-539c3ed2c523 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:48.056482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed3a2e-dccc-44d9-be41-5f4a3f927572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:48.056865 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-83b7b518-75ae-4cd3-b87e-539c3ed2c523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:48.057157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed3a2e-dccc-44d9-be41-5f4a3f927572 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:48.057442 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed3a2e-dccc-44d9-be41-5f4a3f927572 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:48.057725 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed3a2e-dccc-44d9-be41-5f4a3f927572 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:48.058441 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed3a2e-dccc-44d9-be41-5f4a3f927572 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:48.060392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed3a2e-dccc-44d9-be41-5f4a3f927572 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:48.121557 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7b518-75ae-4cd3-b87e-539c3ed2c523 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:48.125350 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49540303-764c-428b-8f9e-69fab4c98057 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:48.126033 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49540303-764c-428b-8f9e-69fab4c98057 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:48.126977 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49540303-764c-428b-8f9e-69fab4c98057 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:48.127312 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49540303-764c-428b-8f9e-69fab4c98057 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:48.137878 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49540303-764c-428b-8f9e-69fab4c98057 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:48.139344 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49540303-764c-428b-8f9e-69fab4c98057 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:48.151103 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3625/7243] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:37:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:37:48.173102 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3619/7244] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:37:47 2022] POST /identity/v3/users => generated 286 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:37:48.174917 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49540303-764c-428b-8f9e-69fab4c98057 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:48.184725 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49540303-764c-428b-8f9e-69fab4c98057 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:48.190003 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96461f7f-6122-4fa1-8d38-08b5efcec525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:48.190693 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96461f7f-6122-4fa1-8d38-08b5efcec525 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:48.190976 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96461f7f-6122-4fa1-8d38-08b5efcec525 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:48.191251 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96461f7f-6122-4fa1-8d38-08b5efcec525 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:48.191970 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96461f7f-6122-4fa1-8d38-08b5efcec525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:48.193594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96461f7f-6122-4fa1-8d38-08b5efcec525 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:48.211502 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3626/7245] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:37:48.216838 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed3a2e-dccc-44d9-be41-5f4a3f927572 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:48.230708 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed3a2e-dccc-44d9-be41-5f4a3f927572 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:48.238951 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785c952-aa4c-47ad-8567-cde140b50416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:48.239958 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785c952-aa4c-47ad-8567-cde140b50416 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:48.240372 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785c952-aa4c-47ad-8567-cde140b50416 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:48.240913 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785c952-aa4c-47ad-8567-cde140b50416 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:48.241890 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4785c952-aa4c-47ad-8567-cde140b50416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:48.250125 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4785c952-aa4c-47ad-8567-cde140b50416 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:48.265628 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3620/7246] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:37:48.275714 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96461f7f-6122-4fa1-8d38-08b5efcec525 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:48.294465 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96461f7f-6122-4fa1-8d38-08b5efcec525 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:48.298539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d3f77-7acc-45a6-9808-b03fee19455d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:48.299464 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d3f77-7acc-45a6-9808-b03fee19455d admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:48.299737 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d3f77-7acc-45a6-9808-b03fee19455d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:48.300012 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d3f77-7acc-45a6-9808-b03fee19455d admin admin] PATH_INFO: `/v3/projects/ede1fc028b654b819f147b9e5dde458e/users/ae2e100e385e40fb9139cc6316c92159/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:48.317546 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d3f77-7acc-45a6-9808-b03fee19455d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ede1fc028b654b819f147b9e5dde458e, user_id=ae2e100e385e40fb9139cc6316c92159, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:48.320406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d3f77-7acc-45a6-9808-b03fee19455d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:48.384015 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3627/7247] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:37:48 2022] PUT /identity/v3/projects/ede1fc028b654b819f147b9e5dde458e/users/ae2e100e385e40fb9139cc6316c92159/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:37:48.398641 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da519c-46cb-4508-8708-ff33c234dcbf None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:48.398641 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da519c-46cb-4508-8708-ff33c234dcbf None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:48.398641 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da519c-46cb-4508-8708-ff33c234dcbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:48.422314 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-39da519c-46cb-4508-8708-ff33c234dcbf None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:48.423616 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-39da519c-46cb-4508-8708-ff33c234dcbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:48.517797 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3621/7248] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:37:48.530703 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d3f77-7acc-45a6-9808-b03fee19455d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:48.532588 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5e3d3f77-7acc-45a6-9808-b03fee19455d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:48.630918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d3f77-7acc-45a6-9808-b03fee19455d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:48.635905 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bcbcfa-3862-42cb-ad7c-85808c1f4530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:48.636859 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bcbcfa-3862-42cb-ad7c-85808c1f4530 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:48.637249 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bcbcfa-3862-42cb-ad7c-85808c1f4530 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:48.637536 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bcbcfa-3862-42cb-ad7c-85808c1f4530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:48.652258 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bcbcfa-3862-42cb-ad7c-85808c1f4530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:48.654077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bcbcfa-3862-42cb-ad7c-85808c1f4530 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:48.682052 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3628/7249] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:37:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:37:48.942724 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da519c-46cb-4508-8708-ff33c234dcbf None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:48.944994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-39da519c-46cb-4508-8708-ff33c234dcbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:48.963693 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da519c-46cb-4508-8708-ff33c234dcbf None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:48.969272 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4879e7d-9c45-482b-a6f1-43594fadceba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:48.970399 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4879e7d-9c45-482b-a6f1-43594fadceba admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:48.970781 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4879e7d-9c45-482b-a6f1-43594fadceba admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:48.971293 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4879e7d-9c45-482b-a6f1-43594fadceba admin admin] PATH_INFO: `/v3/projects/ba6f219a03684e02b7c38372cef6f3a0` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:48.984178 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4879e7d-9c45-482b-a6f1-43594fadceba admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba6f219a03684e02b7c38372cef6f3a0)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:48.986753 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4879e7d-9c45-482b-a6f1-43594fadceba admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:49.131342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e4879e7d-9c45-482b-a6f1-43594fadceba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba6f219a03684e02b7c38372cef6f3a0', 'request_id': 'req-e4879e7d-9c45-482b-a6f1-43594fadceba'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:49.137072 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e4879e7d-9c45-482b-a6f1-43594fadceba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba6f219a03684e02b7c38372cef6f3a0', 'request_id': 'req-e4879e7d-9c45-482b-a6f1-43594fadceba'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:49.143983 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e4879e7d-9c45-482b-a6f1-43594fadceba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba6f219a03684e02b7c38372cef6f3a0', 'request_id': 'req-e4879e7d-9c45-482b-a6f1-43594fadceba'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:49.210916 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e4879e7d-9c45-482b-a6f1-43594fadceba admin admin] The token cache is being invalidate because project ba6f219a03684e02b7c38372cef6f3a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:37:49.211541 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e4879e7d-9c45-482b-a6f1-43594fadceba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:49.212355 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e4879e7d-9c45-482b-a6f1-43594fadceba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:49.214513 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3622/7250] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:37:48 2022] DELETE /identity/v3/projects/ba6f219a03684e02b7c38372cef6f3a0 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:37:49.218878 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bcbcfa-3862-42cb-ad7c-85808c1f4530 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:49.245550 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bcbcfa-3862-42cb-ad7c-85808c1f4530 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:49.355026 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5bbf9e-067f-4100-a2a7-91000ab4cf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:49.355974 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bbf9e-067f-4100-a2a7-91000ab4cf22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:49.356511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bbf9e-067f-4100-a2a7-91000ab4cf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:49.356701 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5bbf9e-067f-4100-a2a7-91000ab4cf22 admin admin] PATH_INFO: `/v3/users/de372c52886447208fe3e42cbdec91fb` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:49.358345 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5bbf9e-067f-4100-a2a7-91000ab4cf22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de372c52886447208fe3e42cbdec91fb)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:49.361333 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5bbf9e-067f-4100-a2a7-91000ab4cf22 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:49.641077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ee5bbf9e-067f-4100-a2a7-91000ab4cf22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de372c52886447208fe3e42cbdec91fb'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:49.655615 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ee5bbf9e-067f-4100-a2a7-91000ab4cf22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de372c52886447208fe3e42cbdec91fb'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:49.724111 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ee5bbf9e-067f-4100-a2a7-91000ab4cf22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de372c52886447208fe3e42cbdec91fb'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:49.732181 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ee5bbf9e-067f-4100-a2a7-91000ab4cf22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de372c52886447208fe3e42cbdec91fb'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:49.732854 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ee5bbf9e-067f-4100-a2a7-91000ab4cf22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de372c52886447208fe3e42cbdec91fb'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:49.739935 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3629/7251] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:37:49 2022] DELETE /identity/v3/users/de372c52886447208fe3e42cbdec91fb => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:37:50.320428 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4879e7d-9c45-482b-a6f1-43594fadceba admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:50.322092 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e4879e7d-9c45-482b-a6f1-43594fadceba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:50.337453 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4879e7d-9c45-482b-a6f1-43594fadceba admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:50.395777 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b20a7-080d-48a5-bda5-443ed3e6ab1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:50.396715 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b20a7-080d-48a5-bda5-443ed3e6ab1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:50.396997 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b20a7-080d-48a5-bda5-443ed3e6ab1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:50.397274 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b20a7-080d-48a5-bda5-443ed3e6ab1a admin admin] PATH_INFO: `/v3/projects/672cb6b76349440c99898918494233d1` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:50.398762 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b20a7-080d-48a5-bda5-443ed3e6ab1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=672cb6b76349440c99898918494233d1)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:50.400725 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b20a7-080d-48a5-bda5-443ed3e6ab1a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:50.591744 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5a8b20a7-080d-48a5-bda5-443ed3e6ab1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '672cb6b76349440c99898918494233d1', 'request_id': 'req-5a8b20a7-080d-48a5-bda5-443ed3e6ab1a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:50.597700 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5a8b20a7-080d-48a5-bda5-443ed3e6ab1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '672cb6b76349440c99898918494233d1', 'request_id': 'req-5a8b20a7-080d-48a5-bda5-443ed3e6ab1a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:50.606799 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5a8b20a7-080d-48a5-bda5-443ed3e6ab1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '672cb6b76349440c99898918494233d1', 'request_id': 'req-5a8b20a7-080d-48a5-bda5-443ed3e6ab1a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:50.690753 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5a8b20a7-080d-48a5-bda5-443ed3e6ab1a admin admin] The token cache is being invalidate because project 672cb6b76349440c99898918494233d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:37:50.692747 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5a8b20a7-080d-48a5-bda5-443ed3e6ab1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:50.692747 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5a8b20a7-080d-48a5-bda5-443ed3e6ab1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:50.693830 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3623/7252] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:37:50 2022] DELETE /identity/v3/projects/672cb6b76349440c99898918494233d1 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:37:50.698458 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e191f-55fe-4a82-9824-a91f62e9c84e None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:50.698745 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e191f-55fe-4a82-9824-a91f62e9c84e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:50.699243 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e191f-55fe-4a82-9824-a91f62e9c84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:50.718671 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-566e191f-55fe-4a82-9824-a91f62e9c84e None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:50.723245 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-566e191f-55fe-4a82-9824-a91f62e9c84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:50.808715 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3630/7253] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:37:50.911716 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac96ff-d56d-44af-9a24-cf9f713d6818 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:50.912306 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac96ff-d56d-44af-9a24-cf9f713d6818 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:50.914209 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac96ff-d56d-44af-9a24-cf9f713d6818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:50.937908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-bdac96ff-d56d-44af-9a24-cf9f713d6818 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:50.940055 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-bdac96ff-d56d-44af-9a24-cf9f713d6818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:50.951858 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3624/7254] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:37:50.957446 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e191f-55fe-4a82-9824-a91f62e9c84e None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:50.971675 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e191f-55fe-4a82-9824-a91f62e9c84e None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:50.982602 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6021dee-3c0e-4d81-a7ff-f2c6ccdd47b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:50.984508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6021dee-3c0e-4d81-a7ff-f2c6ccdd47b4 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:50.984927 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6021dee-3c0e-4d81-a7ff-f2c6ccdd47b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:50.985215 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6021dee-3c0e-4d81-a7ff-f2c6ccdd47b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:50.993103 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6021dee-3c0e-4d81-a7ff-f2c6ccdd47b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:37:50.993103 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6021dee-3c0e-4d81-a7ff-f2c6ccdd47b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:50.993103 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6021dee-3c0e-4d81-a7ff-f2c6ccdd47b4 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:51.012048 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3631/7255] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:37:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:37:51.018020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac96ff-d56d-44af-9a24-cf9f713d6818 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:51.024817 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac96ff-d56d-44af-9a24-cf9f713d6818 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:51.036047 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b25d07-2ead-4be4-9434-b8f7af99f69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:51.036916 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b25d07-2ead-4be4-9434-b8f7af99f69c admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:51.038586 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b25d07-2ead-4be4-9434-b8f7af99f69c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:51.039389 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b25d07-2ead-4be4-9434-b8f7af99f69c admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:51.041463 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b25d07-2ead-4be4-9434-b8f7af99f69c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:51.044758 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b25d07-2ead-4be4-9434-b8f7af99f69c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:51.194968 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3625/7256] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:37:51 2022] POST /identity/v3/projects => generated 365 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:37:51.198754 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6021dee-3c0e-4d81-a7ff-f2c6ccdd47b4 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:51.211685 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6021dee-3c0e-4d81-a7ff-f2c6ccdd47b4 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:51.311810 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1c7a8-f56e-4f34-aac9-03f33dade687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:51.312525 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1c7a8-f56e-4f34-aac9-03f33dade687 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:51.312986 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1c7a8-f56e-4f34-aac9-03f33dade687 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:51.313274 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1c7a8-f56e-4f34-aac9-03f33dade687 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:51.314223 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1c7a8-f56e-4f34-aac9-03f33dade687 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:51.316132 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1c7a8-f56e-4f34-aac9-03f33dade687 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:51.427423 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3632/7257] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:37:51 2022] POST /identity/v3/users => generated 283 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:37:51.443073 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b25d07-2ead-4be4-9434-b8f7af99f69c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:51.459157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b25d07-2ead-4be4-9434-b8f7af99f69c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:51.466751 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e11d1c1-aabb-4e87-898f-2494a7e75921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:51.467505 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11d1c1-aabb-4e87-898f-2494a7e75921 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:51.468107 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11d1c1-aabb-4e87-898f-2494a7e75921 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:51.468555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11d1c1-aabb-4e87-898f-2494a7e75921 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:51.469459 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e11d1c1-aabb-4e87-898f-2494a7e75921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:51.478161 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e11d1c1-aabb-4e87-898f-2494a7e75921 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:51.491132 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3626/7258] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:37:51.505623 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1c7a8-f56e-4f34-aac9-03f33dade687 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:51.533212 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1c7a8-f56e-4f34-aac9-03f33dade687 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:51.548998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce39bb-5f59-43d0-8946-503b2ebe7fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:51.550072 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce39bb-5f59-43d0-8946-503b2ebe7fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:51.550591 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce39bb-5f59-43d0-8946-503b2ebe7fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:51.551081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce39bb-5f59-43d0-8946-503b2ebe7fb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:51.552045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce39bb-5f59-43d0-8946-503b2ebe7fb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:51.554090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce39bb-5f59-43d0-8946-503b2ebe7fb7 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:51.575448 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3633/7259] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:37:51.580035 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e11d1c1-aabb-4e87-898f-2494a7e75921 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:51.593340 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e11d1c1-aabb-4e87-898f-2494a7e75921 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:51.599918 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d752ba43-930c-4c90-876e-22f5e675c26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:51.602094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752ba43-930c-4c90-876e-22f5e675c26c admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:51.602553 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752ba43-930c-4c90-876e-22f5e675c26c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:51.603024 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752ba43-930c-4c90-876e-22f5e675c26c admin admin] PATH_INFO: `/v3/projects/55078acf790d40b1984a6cc9c663fb02/users/090751342d814381845745e19016241b/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:51.628805 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d752ba43-930c-4c90-876e-22f5e675c26c admin admin] RBAC: Authorizing `identity:create_grant(project_id=55078acf790d40b1984a6cc9c663fb02, user_id=090751342d814381845745e19016241b, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:51.632599 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d752ba43-930c-4c90-876e-22f5e675c26c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:51.713657 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3627/7260] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:37:51 2022] PUT /identity/v3/projects/55078acf790d40b1984a6cc9c663fb02/users/090751342d814381845745e19016241b/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:37:51.724666 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7c091-3101-4d6d-ba51-e40ade6c1965 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:51.725029 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7c091-3101-4d6d-ba51-e40ade6c1965 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:51.725532 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7c091-3101-4d6d-ba51-e40ade6c1965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:51.761946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-68f7c091-3101-4d6d-ba51-e40ade6c1965 None None] MFA Rules not processed for user `090751342d814381845745e19016241b`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:51.765408 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-68f7c091-3101-4d6d-ba51-e40ade6c1965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:51.885320 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3634/7261] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:51 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:37:51.894254 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d752ba43-930c-4c90-876e-22f5e675c26c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:52.049555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d752ba43-930c-4c90-876e-22f5e675c26c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:52.054812 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b11320-9ad2-4b71-a014-5a26c5df1ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:52.055811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b11320-9ad2-4b71-a014-5a26c5df1ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:52.056100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b11320-9ad2-4b71-a014-5a26c5df1ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:52.056395 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b11320-9ad2-4b71-a014-5a26c5df1ec9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:52.057344 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b11320-9ad2-4b71-a014-5a26c5df1ec9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:52.060109 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b11320-9ad2-4b71-a014-5a26c5df1ec9 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:52.178369 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3628/7262] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:37:51 2022] POST /identity/v3/projects => generated 363 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:37:52.182240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7c091-3101-4d6d-ba51-e40ade6c1965 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:52.198602 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7c091-3101-4d6d-ba51-e40ade6c1965 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:52.278743 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52909e-a114-4125-8255-d0d563514404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:52.279712 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52909e-a114-4125-8255-d0d563514404 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:52.280158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52909e-a114-4125-8255-d0d563514404 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:52.280629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52909e-a114-4125-8255-d0d563514404 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:52.281512 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52909e-a114-4125-8255-d0d563514404 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:52.283695 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52909e-a114-4125-8255-d0d563514404 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:52.422279 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3635/7263] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:37:52 2022] POST /identity/v3/users => generated 288 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:37:52.426750 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b11320-9ad2-4b71-a014-5a26c5df1ec9 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:52.442842 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b11320-9ad2-4b71-a014-5a26c5df1ec9 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:52.449073 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f9597-0aef-4493-b8da-d7f5ca0ceac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:52.450542 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f9597-0aef-4493-b8da-d7f5ca0ceac8 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:52.451091 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f9597-0aef-4493-b8da-d7f5ca0ceac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:52.452103 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f9597-0aef-4493-b8da-d7f5ca0ceac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:52.463751 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f9597-0aef-4493-b8da-d7f5ca0ceac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:52.465751 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f9597-0aef-4493-b8da-d7f5ca0ceac8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:52.479027 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3629/7264] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:37:52.483435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52909e-a114-4125-8255-d0d563514404 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:52.495238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52909e-a114-4125-8255-d0d563514404 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:52.503514 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72633e9-f4ab-4450-96ce-d633454e96a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:52.503514 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72633e9-f4ab-4450-96ce-d633454e96a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:52.503514 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72633e9-f4ab-4450-96ce-d633454e96a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:52.504038 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72633e9-f4ab-4450-96ce-d633454e96a9 admin admin] PATH_INFO: `/v3/projects/584f53c7ea064585bdaac97494ffc53e/users/ac7ce4327237437da1a805190e8d54ab/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:52.523848 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72633e9-f4ab-4450-96ce-d633454e96a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=584f53c7ea064585bdaac97494ffc53e, user_id=ac7ce4327237437da1a805190e8d54ab, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:52.530341 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72633e9-f4ab-4450-96ce-d633454e96a9 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:52.635161 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3636/7265] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:37:52 2022] PUT /identity/v3/projects/584f53c7ea064585bdaac97494ffc53e/users/ac7ce4327237437da1a805190e8d54ab/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:37:52.639260 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f9597-0aef-4493-b8da-d7f5ca0ceac8 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:52.659439 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f9597-0aef-4493-b8da-d7f5ca0ceac8 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:52.759526 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b829e-c973-4d89-84ef-d3e367ec666c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:52.761738 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b829e-c973-4d89-84ef-d3e367ec666c admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:52.763793 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b829e-c973-4d89-84ef-d3e367ec666c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:52.764184 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b829e-c973-4d89-84ef-d3e367ec666c admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:52.765050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b829e-c973-4d89-84ef-d3e367ec666c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:52.768276 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b829e-c973-4d89-84ef-d3e367ec666c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:52.783509 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3630/7266] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:37:52.788444 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72633e9-f4ab-4450-96ce-d633454e96a9 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:52.804811 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72633e9-f4ab-4450-96ce-d633454e96a9 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:52.812699 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48132c-131e-4033-9bc8-b41d7f6afd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:52.826066 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48132c-131e-4033-9bc8-b41d7f6afd39 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:52.828898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48132c-131e-4033-9bc8-b41d7f6afd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:52.829598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48132c-131e-4033-9bc8-b41d7f6afd39 admin admin] PATH_INFO: `/v3/projects/584f53c7ea064585bdaac97494ffc53e/users/ac7ce4327237437da1a805190e8d54ab/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:52.841414 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e48132c-131e-4033-9bc8-b41d7f6afd39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=584f53c7ea064585bdaac97494ffc53e, user_id=ac7ce4327237437da1a805190e8d54ab, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:52.847773 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e48132c-131e-4033-9bc8-b41d7f6afd39 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:52.871016 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3637/7267] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:37:52 2022] PUT /identity/v3/projects/584f53c7ea064585bdaac97494ffc53e/users/ac7ce4327237437da1a805190e8d54ab/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:37:52.872986 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abefd58-007f-43a9-91ef-a5f7f0c97f19 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:52.873287 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abefd58-007f-43a9-91ef-a5f7f0c97f19 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:52.873590 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abefd58-007f-43a9-91ef-a5f7f0c97f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:52.904189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-4abefd58-007f-43a9-91ef-a5f7f0c97f19 None None] MFA Rules not processed for user `ac7ce4327237437da1a805190e8d54ab`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:52.907063 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4abefd58-007f-43a9-91ef-a5f7f0c97f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:52.989799 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3631/7268] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:52 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:37:53.001373 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48132c-131e-4033-9bc8-b41d7f6afd39 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:53.003636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3e48132c-131e-4033-9bc8-b41d7f6afd39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:53.110895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48132c-131e-4033-9bc8-b41d7f6afd39 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:53.114890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9479b-ff7e-4a09-8f45-ccaef9fd8373 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:53.115863 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9479b-ff7e-4a09-8f45-ccaef9fd8373 service cinder] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:53.116299 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9479b-ff7e-4a09-8f45-ccaef9fd8373 service cinder] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:53.116621 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9479b-ff7e-4a09-8f45-ccaef9fd8373 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:53.127967 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9479b-ff7e-4a09-8f45-ccaef9fd8373 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:53.129582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9479b-ff7e-4a09-8f45-ccaef9fd8373 service cinder] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:53.140741 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3638/7269] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:37:53 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:37:53.427688 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abefd58-007f-43a9-91ef-a5f7f0c97f19 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:53.447817 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abefd58-007f-43a9-91ef-a5f7f0c97f19 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:53.457535 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9322c-3875-4bb2-b5be-7fd4758b2ff8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:53.458283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9322c-3875-4bb2-b5be-7fd4758b2ff8 service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:53.458630 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9322c-3875-4bb2-b5be-7fd4758b2ff8 service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:53.458912 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9322c-3875-4bb2-b5be-7fd4758b2ff8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:53.560953 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736d6c3-bd9e-4f40-a855-37d7664d433f None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:53.561251 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736d6c3-bd9e-4f40-a855-37d7664d433f None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:53.561577 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736d6c3-bd9e-4f40-a855-37d7664d433f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:53.588663 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-2736d6c3-bd9e-4f40-a855-37d7664d433f None None] MFA Rules not processed for user `3107c6d79451405a963c5816d92055b3`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:53.590211 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2736d6c3-bd9e-4f40-a855-37d7664d433f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:53.599255 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df9322c-3875-4bb2-b5be-7fd4758b2ff8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:53.601466 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df9322c-3875-4bb2-b5be-7fd4758b2ff8 service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:53.616131 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3632/7270] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:37:53 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:37:53.704164 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3639/7271] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:53 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:37:55.611609 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685db6f-5036-4c05-9356-75a59e25da88 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:55.612166 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685db6f-5036-4c05-9356-75a59e25da88 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:55.612271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685db6f-5036-4c05-9356-75a59e25da88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:55.639349 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-4685db6f-5036-4c05-9356-75a59e25da88 None None] MFA Rules not processed for user `ae2e100e385e40fb9139cc6316c92159`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:55.640477 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4685db6f-5036-4c05-9356-75a59e25da88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:55.663759 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736d6c3-bd9e-4f40-a855-37d7664d433f None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:55.665179 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2736d6c3-bd9e-4f40-a855-37d7664d433f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:55.753276 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3633/7272] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:37:55.755430 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736d6c3-bd9e-4f40-a855-37d7664d433f None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:55.764005 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685db6f-5036-4c05-9356-75a59e25da88 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:55.764005 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4685db6f-5036-4c05-9356-75a59e25da88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:55.764729 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3010a-c459-4700-a0b6-c0392b06a5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:55.764729 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3010a-c459-4700-a0b6-c0392b06a5b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:55.764729 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3010a-c459-4700-a0b6-c0392b06a5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:55.764729 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3010a-c459-4700-a0b6-c0392b06a5b4 admin admin] PATH_INFO: `/v3/users/4f27f38b9e3b43d482c01038f0480fd1` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:55.766066 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb3010a-c459-4700-a0b6-c0392b06a5b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f27f38b9e3b43d482c01038f0480fd1)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:55.768331 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb3010a-c459-4700-a0b6-c0392b06a5b4 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:55.781028 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685db6f-5036-4c05-9356-75a59e25da88 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:55.786407 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ee130-c287-4a3b-9a24-e7e7353d793a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:55.787093 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ee130-c287-4a3b-9a24-e7e7353d793a admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:55.787375 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ee130-c287-4a3b-9a24-e7e7353d793a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:55.787666 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ee130-c287-4a3b-9a24-e7e7353d793a admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:55.788468 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ee130-c287-4a3b-9a24-e7e7353d793a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:55.790475 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ee130-c287-4a3b-9a24-e7e7353d793a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:55.881416 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3634/7273] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:37:55 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:37:55.885483 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ee130-c287-4a3b-9a24-e7e7353d793a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:55.961081 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ee130-c287-4a3b-9a24-e7e7353d793a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:55.967196 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5a97e-91d4-41bc-8945-3ebb31a88fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:55.969736 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5a97e-91d4-41bc-8945-3ebb31a88fd3 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:55.971281 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5a97e-91d4-41bc-8945-3ebb31a88fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:55.971733 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5a97e-91d4-41bc-8945-3ebb31a88fd3 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:55.972601 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c5a97e-91d4-41bc-8945-3ebb31a88fd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:55.975485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c5a97e-91d4-41bc-8945-3ebb31a88fd3 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:55.980281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-adb3010a-c459-4700-a0b6-c0392b06a5b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f27f38b9e3b43d482c01038f0480fd1'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:56.006876 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-adb3010a-c459-4700-a0b6-c0392b06a5b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f27f38b9e3b43d482c01038f0480fd1'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:56.068127 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3635/7274] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:37:55 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:37:56.071728 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5a97e-91d4-41bc-8945-3ebb31a88fd3 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:56.082830 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5a97e-91d4-41bc-8945-3ebb31a88fd3 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:56.087940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61b799-01b4-4cb5-8feb-477276d6e0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:56.088614 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61b799-01b4-4cb5-8feb-477276d6e0bc admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:56.088895 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61b799-01b4-4cb5-8feb-477276d6e0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:56.089170 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61b799-01b4-4cb5-8feb-477276d6e0bc admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:56.089929 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb61b799-01b4-4cb5-8feb-477276d6e0bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:56.091540 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb61b799-01b4-4cb5-8feb-477276d6e0bc admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:56.102514 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3636/7275] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:37:56.106585 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61b799-01b4-4cb5-8feb-477276d6e0bc admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:56.117739 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61b799-01b4-4cb5-8feb-477276d6e0bc admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:56.118550 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-adb3010a-c459-4700-a0b6-c0392b06a5b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f27f38b9e3b43d482c01038f0480fd1'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:56.127754 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e9799-5f7e-4b66-b2c1-a6da983eb0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:56.127754 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e9799-5f7e-4b66-b2c1-a6da983eb0ab admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:56.127754 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e9799-5f7e-4b66-b2c1-a6da983eb0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:56.128222 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e9799-5f7e-4b66-b2c1-a6da983eb0ab admin admin] PATH_INFO: `/v3/projects/7c8d2063664e4242842a675bd6a9e4bf/users/1498ecb600b049d8b842921fa2e2645a/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:56.134220 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-adb3010a-c459-4700-a0b6-c0392b06a5b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f27f38b9e3b43d482c01038f0480fd1'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:56.135431 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-adb3010a-c459-4700-a0b6-c0392b06a5b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f27f38b9e3b43d482c01038f0480fd1'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:56.151236 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e9799-5f7e-4b66-b2c1-a6da983eb0ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c8d2063664e4242842a675bd6a9e4bf, user_id=1498ecb600b049d8b842921fa2e2645a, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:56.152797 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e9799-5f7e-4b66-b2c1-a6da983eb0ab admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:56.156954 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3640/7276] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:37:55 2022] DELETE /identity/v3/users/4f27f38b9e3b43d482c01038f0480fd1 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:37:56.161628 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e63e1-734d-44fe-80ed-e8bf94857b29 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:56.161952 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e63e1-734d-44fe-80ed-e8bf94857b29 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:56.162285 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e63e1-734d-44fe-80ed-e8bf94857b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:56.195249 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-820e63e1-734d-44fe-80ed-e8bf94857b29 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:56.197700 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-820e63e1-734d-44fe-80ed-e8bf94857b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:56.245856 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3637/7277] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:37:56 2022] PUT /identity/v3/projects/7c8d2063664e4242842a675bd6a9e4bf/users/1498ecb600b049d8b842921fa2e2645a/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:37:56.249715 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e9799-5f7e-4b66-b2c1-a6da983eb0ab admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:56.253722 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f54e9799-5f7e-4b66-b2c1-a6da983eb0ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:56.290913 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3641/7278] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:37:56.300517 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e63e1-734d-44fe-80ed-e8bf94857b29 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:56.302121 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-820e63e1-734d-44fe-80ed-e8bf94857b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:56.342445 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e9799-5f7e-4b66-b2c1-a6da983eb0ab admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:56.347630 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cfa6a-9570-4585-8ffe-2a41a601ec1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:56.348375 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cfa6a-9570-4585-8ffe-2a41a601ec1b admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:56.348960 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cfa6a-9570-4585-8ffe-2a41a601ec1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:56.348960 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1cfa6a-9570-4585-8ffe-2a41a601ec1b admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:56.350147 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1cfa6a-9570-4585-8ffe-2a41a601ec1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:56.351912 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1cfa6a-9570-4585-8ffe-2a41a601ec1b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:56.368148 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3638/7279] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:37:56.376665 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cfa6a-9570-4585-8ffe-2a41a601ec1b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:56.388214 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1cfa6a-9570-4585-8ffe-2a41a601ec1b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:56.394747 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc02b92-c6d2-4379-b9e5-46c79911e5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:56.395794 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc02b92-c6d2-4379-b9e5-46c79911e5ce admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:56.396004 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc02b92-c6d2-4379-b9e5-46c79911e5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:56.397069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc02b92-c6d2-4379-b9e5-46c79911e5ce admin admin] PATH_INFO: `/v3/projects/7c8d2063664e4242842a675bd6a9e4bf/users/1498ecb600b049d8b842921fa2e2645a/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:56.399295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc02b92-c6d2-4379-b9e5-46c79911e5ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c8d2063664e4242842a675bd6a9e4bf, user_id=1498ecb600b049d8b842921fa2e2645a, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:56.403531 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc02b92-c6d2-4379-b9e5-46c79911e5ce admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:56.420669 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e63e1-734d-44fe-80ed-e8bf94857b29 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:56.424494 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3639/7280] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:37:56 2022] PUT /identity/v3/projects/7c8d2063664e4242842a675bd6a9e4bf/users/1498ecb600b049d8b842921fa2e2645a/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:37:56.499355 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede4f82-e5e3-45b2-b894-ead0de74d7bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:56.500489 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede4f82-e5e3-45b2-b894-ead0de74d7bc service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:56.500992 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede4f82-e5e3-45b2-b894-ead0de74d7bc service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:56.502132 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede4f82-e5e3-45b2-b894-ead0de74d7bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:56.577179 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede4f82-e5e3-45b2-b894-ead0de74d7bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:56.579046 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede4f82-e5e3-45b2-b894-ead0de74d7bc service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:56.591243 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3642/7281] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:37:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:37:57.167680 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc02b92-c6d2-4379-b9e5-46c79911e5ce admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:57.170276 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-dfc02b92-c6d2-4379-b9e5-46c79911e5ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:57.191118 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc02b92-c6d2-4379-b9e5-46c79911e5ce admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:57.196442 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9403ad-7ee5-44e2-a8f5-99bdadc2b42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:57.197857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9403ad-7ee5-44e2-a8f5-99bdadc2b42a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:57.197857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9403ad-7ee5-44e2-a8f5-99bdadc2b42a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:57.199922 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9403ad-7ee5-44e2-a8f5-99bdadc2b42a admin admin] PATH_INFO: `/v3/projects/bfe2a268b20142dd8f44d77ab5c8d3fe` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:57.202351 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9403ad-7ee5-44e2-a8f5-99bdadc2b42a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfe2a268b20142dd8f44d77ab5c8d3fe)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:57.205975 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9403ad-7ee5-44e2-a8f5-99bdadc2b42a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:57.342162 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3d9403ad-7ee5-44e2-a8f5-99bdadc2b42a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfe2a268b20142dd8f44d77ab5c8d3fe', 'request_id': 'req-3d9403ad-7ee5-44e2-a8f5-99bdadc2b42a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:57.358047 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3d9403ad-7ee5-44e2-a8f5-99bdadc2b42a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfe2a268b20142dd8f44d77ab5c8d3fe', 'request_id': 'req-3d9403ad-7ee5-44e2-a8f5-99bdadc2b42a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:57.392851 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3d9403ad-7ee5-44e2-a8f5-99bdadc2b42a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfe2a268b20142dd8f44d77ab5c8d3fe', 'request_id': 'req-3d9403ad-7ee5-44e2-a8f5-99bdadc2b42a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:57.489440 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3d9403ad-7ee5-44e2-a8f5-99bdadc2b42a admin admin] The token cache is being invalidate because project bfe2a268b20142dd8f44d77ab5c8d3fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:37:57.489746 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3d9403ad-7ee5-44e2-a8f5-99bdadc2b42a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:57.491047 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3d9403ad-7ee5-44e2-a8f5-99bdadc2b42a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:57.496740 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3640/7282] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:37:57 2022] DELETE /identity/v3/projects/bfe2a268b20142dd8f44d77ab5c8d3fe => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:37:57.498253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad0b8f-1194-459c-a9f7-c548333c0bb5 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:57.498711 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad0b8f-1194-459c-a9f7-c548333c0bb5 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:57.498804 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad0b8f-1194-459c-a9f7-c548333c0bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:57.519671 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-b5ad0b8f-1194-459c-a9f7-c548333c0bb5 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:57.521097 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b5ad0b8f-1194-459c-a9f7-c548333c0bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:57.549832 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9403ad-7ee5-44e2-a8f5-99bdadc2b42a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:57.551611 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3d9403ad-7ee5-44e2-a8f5-99bdadc2b42a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:57.613075 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3643/7283] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:37:57.628382 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e96cd1-e5da-4bac-a11f-73d3cce469e5 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:57.629395 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e96cd1-e5da-4bac-a11f-73d3cce469e5 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:57.629684 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e96cd1-e5da-4bac-a11f-73d3cce469e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:57.637032 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9403ad-7ee5-44e2-a8f5-99bdadc2b42a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:57.643537 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac872fc1-d1d2-4835-b037-6b2d245fea88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:57.644527 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac872fc1-d1d2-4835-b037-6b2d245fea88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:57.644811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac872fc1-d1d2-4835-b037-6b2d245fea88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:57.645194 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac872fc1-d1d2-4835-b037-6b2d245fea88 admin admin] PATH_INFO: `/v3/users/090751342d814381845745e19016241b` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:57.646466 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac872fc1-d1d2-4835-b037-6b2d245fea88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=090751342d814381845745e19016241b)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:57.649250 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac872fc1-d1d2-4835-b037-6b2d245fea88 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:57.664141 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-c1e96cd1-e5da-4bac-a11f-73d3cce469e5 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:57.679968 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c1e96cd1-e5da-4bac-a11f-73d3cce469e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:57.721527 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3644/7284] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:37:57.724284 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e96cd1-e5da-4bac-a11f-73d3cce469e5 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:57.750536 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e96cd1-e5da-4bac-a11f-73d3cce469e5 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:57.783016 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edca06b-4fd6-4925-9b0f-a38156c3c566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:57.783711 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edca06b-4fd6-4925-9b0f-a38156c3c566 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:57.783991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edca06b-4fd6-4925-9b0f-a38156c3c566 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:57.784264 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edca06b-4fd6-4925-9b0f-a38156c3c566 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:57.785233 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edca06b-4fd6-4925-9b0f-a38156c3c566 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:37:57.786616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edca06b-4fd6-4925-9b0f-a38156c3c566 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:57.788722 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edca06b-4fd6-4925-9b0f-a38156c3c566 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:57.824829 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3645/7285] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:37:57.829131 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edca06b-4fd6-4925-9b0f-a38156c3c566 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:57.842131 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edca06b-4fd6-4925-9b0f-a38156c3c566 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:57.849233 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21809bb4-92d8-4bae-8928-828616600453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:57.850046 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21809bb4-92d8-4bae-8928-828616600453 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:57.850407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21809bb4-92d8-4bae-8928-828616600453 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:57.850757 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21809bb4-92d8-4bae-8928-828616600453 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:57.851587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21809bb4-92d8-4bae-8928-828616600453 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:57.854233 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21809bb4-92d8-4bae-8928-828616600453 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:57.885719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ac872fc1-d1d2-4835-b037-6b2d245fea88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '090751342d814381845745e19016241b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:57.900218 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ac872fc1-d1d2-4835-b037-6b2d245fea88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '090751342d814381845745e19016241b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:57.970114 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ac872fc1-d1d2-4835-b037-6b2d245fea88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '090751342d814381845745e19016241b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:57.970686 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ac872fc1-d1d2-4835-b037-6b2d245fea88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '090751342d814381845745e19016241b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:57.983474 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3646/7286] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:37:57 2022] POST /identity/v3/projects => generated 399 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:37:57.986113 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ac872fc1-d1d2-4835-b037-6b2d245fea88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '090751342d814381845745e19016241b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:57.990024 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21809bb4-92d8-4bae-8928-828616600453 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:57.994386 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-21809bb4-92d8-4bae-8928-828616600453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:58.004752 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3641/7287] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:37:57 2022] DELETE /identity/v3/users/090751342d814381845745e19016241b => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:37:58.007816 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29c60e-4386-4d83-9722-454285b5d97b None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:58.008162 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29c60e-4386-4d83-9722-454285b5d97b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:58.008532 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29c60e-4386-4d83-9722-454285b5d97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:58.049122 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-ea29c60e-4386-4d83-9722-454285b5d97b None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:58.050519 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ea29c60e-4386-4d83-9722-454285b5d97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:58.130021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21809bb4-92d8-4bae-8928-828616600453 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:58.216593 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3642/7288] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:37:58.225206 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29c60e-4386-4d83-9722-454285b5d97b None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:58.226779 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ea29c60e-4386-4d83-9722-454285b5d97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:58.250765 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde955f-f589-4379-8387-43a71b6db5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:58.251998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde955f-f589-4379-8387-43a71b6db5a0 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:58.252285 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde955f-f589-4379-8387-43a71b6db5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:58.252568 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde955f-f589-4379-8387-43a71b6db5a0 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:58.253887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde955f-f589-4379-8387-43a71b6db5a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:58.256349 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde955f-f589-4379-8387-43a71b6db5a0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:58.349829 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29c60e-4386-4d83-9722-454285b5d97b None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:58.355345 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d7dea-f797-485e-98e8-484e8f19cd3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:58.356148 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d7dea-f797-485e-98e8-484e8f19cd3a service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:58.356537 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d7dea-f797-485e-98e8-484e8f19cd3a service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:58.356917 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d7dea-f797-485e-98e8-484e8f19cd3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:58.395431 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d7dea-f797-485e-98e8-484e8f19cd3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:58.399518 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3647/7289] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:37:57 2022] POST /identity/v3/users => generated 300 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:37:58.401413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d7dea-f797-485e-98e8-484e8f19cd3a service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:58.403419 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde955f-f589-4379-8387-43a71b6db5a0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:58.423862 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde955f-f589-4379-8387-43a71b6db5a0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:58.430905 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3643/7290] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:37:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:37:58.436928 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d3884-deb0-43d4-aba5-a1de3c031b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:58.437587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d3884-deb0-43d4-aba5-a1de3c031b28 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:58.437905 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d3884-deb0-43d4-aba5-a1de3c031b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:58.438186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d3884-deb0-43d4-aba5-a1de3c031b28 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:58.439644 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d3884-deb0-43d4-aba5-a1de3c031b28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:58.441309 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d3884-deb0-43d4-aba5-a1de3c031b28 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:58.469348 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3648/7291] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:37:58.473562 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d7dea-f797-485e-98e8-484e8f19cd3a service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:58.486196 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d7dea-f797-485e-98e8-484e8f19cd3a service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:58.492299 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295dcc0-35c8-4043-9fa5-55fb12c8ce75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:58.492997 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295dcc0-35c8-4043-9fa5-55fb12c8ce75 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:58.493295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295dcc0-35c8-4043-9fa5-55fb12c8ce75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:58.493578 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295dcc0-35c8-4043-9fa5-55fb12c8ce75 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:58.494485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295dcc0-35c8-4043-9fa5-55fb12c8ce75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:58.496276 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295dcc0-35c8-4043-9fa5-55fb12c8ce75 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:58.509474 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3644/7292] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:37:58.513888 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d3884-deb0-43d4-aba5-a1de3c031b28 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:58.526510 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d3884-deb0-43d4-aba5-a1de3c031b28 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:58.531759 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a90fe4-5135-4666-be44-71767cd3897f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:58.532954 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a90fe4-5135-4666-be44-71767cd3897f admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:58.533400 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a90fe4-5135-4666-be44-71767cd3897f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:58.533873 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a90fe4-5135-4666-be44-71767cd3897f admin admin] PATH_INFO: `/v3/projects/7901698b22e64b5a9d17ffdae95763bc/users/7f383f91907a43ec8c02282cc3de6414/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:58.552024 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a90fe4-5135-4666-be44-71767cd3897f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7901698b22e64b5a9d17ffdae95763bc, user_id=7f383f91907a43ec8c02282cc3de6414, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:58.559000 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a90fe4-5135-4666-be44-71767cd3897f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:58.617581 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3649/7293] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:37:58 2022] PUT /identity/v3/projects/7901698b22e64b5a9d17ffdae95763bc/users/7f383f91907a43ec8c02282cc3de6414/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:37:58.628529 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8ff6b-2d0e-494b-8d1c-36fc8603ac93 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:58.629551 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8ff6b-2d0e-494b-8d1c-36fc8603ac93 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:58.630051 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8ff6b-2d0e-494b-8d1c-36fc8603ac93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:58.669663 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-d0d8ff6b-2d0e-494b-8d1c-36fc8603ac93 None None] MFA Rules not processed for user `7f383f91907a43ec8c02282cc3de6414`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:37:58.671933 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d0d8ff6b-2d0e-494b-8d1c-36fc8603ac93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:58.797680 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3645/7294] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:37:58 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:37:58.811608 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a90fe4-5135-4666-be44-71767cd3897f admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:58.813993 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-41a90fe4-5135-4666-be44-71767cd3897f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:58.885605 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a90fe4-5135-4666-be44-71767cd3897f admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:58.902101 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50f833-00d8-4d18-99a1-96b131b9d255 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:58.902812 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50f833-00d8-4d18-99a1-96b131b9d255 service cinder] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:58.903101 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50f833-00d8-4d18-99a1-96b131b9d255 service cinder] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:58.903378 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50f833-00d8-4d18-99a1-96b131b9d255 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:58.915242 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a50f833-00d8-4d18-99a1-96b131b9d255 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:58.917180 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a50f833-00d8-4d18-99a1-96b131b9d255 service cinder] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:58.933691 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3650/7295] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:37:58 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:37:59.552166 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d8ff6b-2d0e-494b-8d1c-36fc8603ac93 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:59.552166 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d0d8ff6b-2d0e-494b-8d1c-36fc8603ac93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:37:59.630185 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d8ff6b-2d0e-494b-8d1c-36fc8603ac93 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:37:59.633438 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f133a1a-1e6b-40b7-9d81-19d57144194d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:37:59.634355 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f133a1a-1e6b-40b7-9d81-19d57144194d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:37:59.634680 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f133a1a-1e6b-40b7-9d81-19d57144194d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:37:59.634965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f133a1a-1e6b-40b7-9d81-19d57144194d admin admin] PATH_INFO: `/v3/projects/55078acf790d40b1984a6cc9c663fb02` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:37:59.636394 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f133a1a-1e6b-40b7-9d81-19d57144194d admin admin] RBAC: Authorizing `identity:delete_project(project_id=55078acf790d40b1984a6cc9c663fb02)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:37:59.638412 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f133a1a-1e6b-40b7-9d81-19d57144194d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:37:59.796984 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8f133a1a-1e6b-40b7-9d81-19d57144194d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55078acf790d40b1984a6cc9c663fb02', 'request_id': 'req-8f133a1a-1e6b-40b7-9d81-19d57144194d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:59.830886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8f133a1a-1e6b-40b7-9d81-19d57144194d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55078acf790d40b1984a6cc9c663fb02', 'request_id': 'req-8f133a1a-1e6b-40b7-9d81-19d57144194d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:59.846762 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8f133a1a-1e6b-40b7-9d81-19d57144194d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55078acf790d40b1984a6cc9c663fb02', 'request_id': 'req-8f133a1a-1e6b-40b7-9d81-19d57144194d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:59.947250 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8f133a1a-1e6b-40b7-9d81-19d57144194d admin admin] The token cache is being invalidate because project 55078acf790d40b1984a6cc9c663fb02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:37:59.947250 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8f133a1a-1e6b-40b7-9d81-19d57144194d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:59.948748 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8f133a1a-1e6b-40b7-9d81-19d57144194d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:37:59.950765 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3646/7296] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:37:59 2022] DELETE /identity/v3/projects/55078acf790d40b1984a6cc9c663fb02 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:37:59.955358 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50f833-00d8-4d18-99a1-96b131b9d255 service cinder] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:37:59.979468 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50f833-00d8-4d18-99a1-96b131b9d255 service cinder] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:00.072146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accba8d0-1a38-40be-b07d-23ea2d152b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:00.074194 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accba8d0-1a38-40be-b07d-23ea2d152b55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:00.077515 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accba8d0-1a38-40be-b07d-23ea2d152b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:00.077515 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accba8d0-1a38-40be-b07d-23ea2d152b55 admin admin] PATH_INFO: `/v3/users/ac7ce4327237437da1a805190e8d54ab` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:00.077515 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accba8d0-1a38-40be-b07d-23ea2d152b55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac7ce4327237437da1a805190e8d54ab)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:00.081163 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accba8d0-1a38-40be-b07d-23ea2d152b55 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:00.298780 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-accba8d0-1a38-40be-b07d-23ea2d152b55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac7ce4327237437da1a805190e8d54ab'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:00.343033 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-accba8d0-1a38-40be-b07d-23ea2d152b55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac7ce4327237437da1a805190e8d54ab'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:00.415326 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-accba8d0-1a38-40be-b07d-23ea2d152b55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac7ce4327237437da1a805190e8d54ab'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:00.427719 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-accba8d0-1a38-40be-b07d-23ea2d152b55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac7ce4327237437da1a805190e8d54ab'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:00.429119 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-accba8d0-1a38-40be-b07d-23ea2d152b55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac7ce4327237437da1a805190e8d54ab'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:00.471163 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3651/7297] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:37:59 2022] DELETE /identity/v3/users/ac7ce4327237437da1a805190e8d54ab => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:38:01.046099 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f133a1a-1e6b-40b7-9d81-19d57144194d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:01.049457 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8f133a1a-1e6b-40b7-9d81-19d57144194d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:01.087133 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f133a1a-1e6b-40b7-9d81-19d57144194d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:01.172344 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b401fd-b0ef-468f-bf0b-6235dbbcfe95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:01.173923 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b401fd-b0ef-468f-bf0b-6235dbbcfe95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:01.174553 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b401fd-b0ef-468f-bf0b-6235dbbcfe95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:01.174848 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b401fd-b0ef-468f-bf0b-6235dbbcfe95 admin admin] PATH_INFO: `/v3/projects/584f53c7ea064585bdaac97494ffc53e` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:01.176407 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b401fd-b0ef-468f-bf0b-6235dbbcfe95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=584f53c7ea064585bdaac97494ffc53e)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:01.178438 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b401fd-b0ef-468f-bf0b-6235dbbcfe95 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:01.335355 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a4b401fd-b0ef-468f-bf0b-6235dbbcfe95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '584f53c7ea064585bdaac97494ffc53e', 'request_id': 'req-a4b401fd-b0ef-468f-bf0b-6235dbbcfe95'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:01.345488 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a4b401fd-b0ef-468f-bf0b-6235dbbcfe95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '584f53c7ea064585bdaac97494ffc53e', 'request_id': 'req-a4b401fd-b0ef-468f-bf0b-6235dbbcfe95'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:01.353266 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a4b401fd-b0ef-468f-bf0b-6235dbbcfe95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '584f53c7ea064585bdaac97494ffc53e', 'request_id': 'req-a4b401fd-b0ef-468f-bf0b-6235dbbcfe95'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:01.429345 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a4b401fd-b0ef-468f-bf0b-6235dbbcfe95 admin admin] The token cache is being invalidate because project 584f53c7ea064585bdaac97494ffc53e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:38:01.430028 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a4b401fd-b0ef-468f-bf0b-6235dbbcfe95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:01.430966 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a4b401fd-b0ef-468f-bf0b-6235dbbcfe95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:01.433298 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3647/7298] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:38:01 2022] DELETE /identity/v3/projects/584f53c7ea064585bdaac97494ffc53e => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:38:01.440107 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633db70-0547-4309-8201-5b89b521faab None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:01.440665 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633db70-0547-4309-8201-5b89b521faab None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:01.440839 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633db70-0547-4309-8201-5b89b521faab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:01.473814 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-d633db70-0547-4309-8201-5b89b521faab None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:38:01.478537 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d633db70-0547-4309-8201-5b89b521faab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:01.587480 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3652/7299] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:38:01.596980 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157f877-c01e-4710-bcfa-c6a78f402efb None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:01.597266 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157f877-c01e-4710-bcfa-c6a78f402efb None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:01.597965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157f877-c01e-4710-bcfa-c6a78f402efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:01.623551 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-1157f877-c01e-4710-bcfa-c6a78f402efb None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:38:01.624942 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1157f877-c01e-4710-bcfa-c6a78f402efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:01.640662 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3648/7300] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:38:01.644485 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633db70-0547-4309-8201-5b89b521faab None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:01.657672 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633db70-0547-4309-8201-5b89b521faab None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:01.665207 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031431c5-4498-4814-877c-777b1f65b390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:01.666521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031431c5-4498-4814-877c-777b1f65b390 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:01.673825 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031431c5-4498-4814-877c-777b1f65b390 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:01.674878 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031431c5-4498-4814-877c-777b1f65b390 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:01.675983 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031431c5-4498-4814-877c-777b1f65b390 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:38:01.676424 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031431c5-4498-4814-877c-777b1f65b390 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:01.678232 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031431c5-4498-4814-877c-777b1f65b390 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:01.695951 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3653/7301] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:38:01.700390 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157f877-c01e-4710-bcfa-c6a78f402efb None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:01.717596 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157f877-c01e-4710-bcfa-c6a78f402efb None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:01.726378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29e083-baf5-4dd4-80ef-91b6dc7f657d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:01.727437 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29e083-baf5-4dd4-80ef-91b6dc7f657d admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:01.727981 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29e083-baf5-4dd4-80ef-91b6dc7f657d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:01.728500 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29e083-baf5-4dd4-80ef-91b6dc7f657d admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:01.729414 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29e083-baf5-4dd4-80ef-91b6dc7f657d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:01.732033 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29e083-baf5-4dd4-80ef-91b6dc7f657d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:01.833927 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3649/7302] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:38:01 2022] POST /identity/v3/projects => generated 369 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:38:01.838320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031431c5-4498-4814-877c-777b1f65b390 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:01.851678 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031431c5-4498-4814-877c-777b1f65b390 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:01.979138 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e90ff-0199-4516-abad-ec21f6e8f13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:01.980041 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e90ff-0199-4516-abad-ec21f6e8f13a admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:01.980525 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e90ff-0199-4516-abad-ec21f6e8f13a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:01.980993 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e90ff-0199-4516-abad-ec21f6e8f13a admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:01.982548 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e90ff-0199-4516-abad-ec21f6e8f13a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:01.986456 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e90ff-0199-4516-abad-ec21f6e8f13a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:02.153587 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3654/7303] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:38:01 2022] POST /identity/v3/users => generated 285 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:38:02.158382 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29e083-baf5-4dd4-80ef-91b6dc7f657d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:02.179672 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29e083-baf5-4dd4-80ef-91b6dc7f657d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:02.192130 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730c0cf-ea50-4ad4-9ea8-8048333c71c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:02.192981 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730c0cf-ea50-4ad4-9ea8-8048333c71c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:02.193266 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730c0cf-ea50-4ad4-9ea8-8048333c71c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:02.193547 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730c0cf-ea50-4ad4-9ea8-8048333c71c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:02.194326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8730c0cf-ea50-4ad4-9ea8-8048333c71c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:02.197407 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8730c0cf-ea50-4ad4-9ea8-8048333c71c7 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:02.238993 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3650/7304] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:38:02.244399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e90ff-0199-4516-abad-ec21f6e8f13a admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:02.256739 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e90ff-0199-4516-abad-ec21f6e8f13a admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:02.278333 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ad973-8ffc-41ac-a1c5-64f79ebbe1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:02.278956 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ad973-8ffc-41ac-a1c5-64f79ebbe1fe admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:02.279238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ad973-8ffc-41ac-a1c5-64f79ebbe1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:02.279519 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ad973-8ffc-41ac-a1c5-64f79ebbe1fe admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:02.280250 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3ad973-8ffc-41ac-a1c5-64f79ebbe1fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:02.284661 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3ad973-8ffc-41ac-a1c5-64f79ebbe1fe admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:02.312716 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3655/7305] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:38:02.314925 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730c0cf-ea50-4ad4-9ea8-8048333c71c7 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:02.338512 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730c0cf-ea50-4ad4-9ea8-8048333c71c7 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:02.348068 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb835bf2-1b97-4d38-b064-538e1da66c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:02.349040 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb835bf2-1b97-4d38-b064-538e1da66c0a admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:02.349277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb835bf2-1b97-4d38-b064-538e1da66c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:02.349562 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb835bf2-1b97-4d38-b064-538e1da66c0a admin admin] PATH_INFO: `/v3/projects/2f2a927dcd02428cadef75d2c1bf3135/users/09a9bd9abd574537a93ec8c60ee5a1eb/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:02.380061 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb835bf2-1b97-4d38-b064-538e1da66c0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f2a927dcd02428cadef75d2c1bf3135, user_id=09a9bd9abd574537a93ec8c60ee5a1eb, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:02.394340 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb835bf2-1b97-4d38-b064-538e1da66c0a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:02.497012 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3651/7306] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:38:02 2022] PUT /identity/v3/projects/2f2a927dcd02428cadef75d2c1bf3135/users/09a9bd9abd574537a93ec8c60ee5a1eb/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:38:02.508112 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e20b08-9fe1-4dce-a91c-750e68de5dce None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:02.509028 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e20b08-9fe1-4dce-a91c-750e68de5dce None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:02.509490 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e20b08-9fe1-4dce-a91c-750e68de5dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:02.570079 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-90e20b08-9fe1-4dce-a91c-750e68de5dce None None] MFA Rules not processed for user `09a9bd9abd574537a93ec8c60ee5a1eb`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:38:02.571586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-90e20b08-9fe1-4dce-a91c-750e68de5dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:02.673723 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3656/7307] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:38:02 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:38:02.682804 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb835bf2-1b97-4d38-b064-538e1da66c0a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:02.802847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb835bf2-1b97-4d38-b064-538e1da66c0a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:02.808705 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb55017-19ae-482a-8716-105f9b9b25f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:02.809593 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb55017-19ae-482a-8716-105f9b9b25f1 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:02.809912 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb55017-19ae-482a-8716-105f9b9b25f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:02.810191 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb55017-19ae-482a-8716-105f9b9b25f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:02.810894 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb55017-19ae-482a-8716-105f9b9b25f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:02.812827 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb55017-19ae-482a-8716-105f9b9b25f1 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:02.942957 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3652/7308] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:38:02 2022] POST /identity/v3/projects => generated 369 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:38:02.947000 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e20b08-9fe1-4dce-a91c-750e68de5dce None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:02.957983 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e20b08-9fe1-4dce-a91c-750e68de5dce None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:03.040224 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9ac6b-eae7-414b-a741-8ad50fff9128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:03.040914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9ac6b-eae7-414b-a741-8ad50fff9128 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:03.041204 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9ac6b-eae7-414b-a741-8ad50fff9128 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:03.041488 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9ac6b-eae7-414b-a741-8ad50fff9128 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:03.042286 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9ac6b-eae7-414b-a741-8ad50fff9128 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:03.044273 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9ac6b-eae7-414b-a741-8ad50fff9128 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:03.154544 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3657/7309] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:38:02 2022] POST /identity/v3/users => generated 291 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:38:03.159331 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb55017-19ae-482a-8716-105f9b9b25f1 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:03.174829 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb55017-19ae-482a-8716-105f9b9b25f1 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:03.180676 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b23ad4-319b-49de-acce-eba8fb638981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:03.182558 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b23ad4-319b-49de-acce-eba8fb638981 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:03.182849 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b23ad4-319b-49de-acce-eba8fb638981 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:03.183126 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b23ad4-319b-49de-acce-eba8fb638981 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:03.184066 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b23ad4-319b-49de-acce-eba8fb638981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:03.185973 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b23ad4-319b-49de-acce-eba8fb638981 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:03.204306 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9ac6b-eae7-414b-a741-8ad50fff9128 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:03.205780 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3653/7310] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:38:03.216576 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9ac6b-eae7-414b-a741-8ad50fff9128 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:03.222838 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d9e20-9e1b-4ab7-8f4e-c99e231f9a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:03.230428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d9e20-9e1b-4ab7-8f4e-c99e231f9a53 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:03.230428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d9e20-9e1b-4ab7-8f4e-c99e231f9a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:03.230428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d9e20-9e1b-4ab7-8f4e-c99e231f9a53 admin admin] PATH_INFO: `/v3/projects/5078809085074791b20a7f80fe99a2bd/users/051386d21a4c40bdadbfdcb8eaad34c0/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:03.247121 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d9e20-9e1b-4ab7-8f4e-c99e231f9a53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5078809085074791b20a7f80fe99a2bd, user_id=051386d21a4c40bdadbfdcb8eaad34c0, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:03.251405 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d9e20-9e1b-4ab7-8f4e-c99e231f9a53 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:03.441304 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b23ad4-319b-49de-acce-eba8fb638981 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:03.454501 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3658/7311] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:38:03 2022] PUT /identity/v3/projects/5078809085074791b20a7f80fe99a2bd/users/051386d21a4c40bdadbfdcb8eaad34c0/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:38:03.461007 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b23ad4-319b-49de-acce-eba8fb638981 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:03.536146 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b26d65-bcee-487e-8acf-768098b582ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:03.536902 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b26d65-bcee-487e-8acf-768098b582ea admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:03.537191 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b26d65-bcee-487e-8acf-768098b582ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:03.537469 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b26d65-bcee-487e-8acf-768098b582ea admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:03.538239 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b26d65-bcee-487e-8acf-768098b582ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:03.540312 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b26d65-bcee-487e-8acf-768098b582ea admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:03.553252 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3654/7312] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:38:03.557100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d9e20-9e1b-4ab7-8f4e-c99e231f9a53 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:03.570124 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d9e20-9e1b-4ab7-8f4e-c99e231f9a53 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:03.580976 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc27a90-da3f-47d4-a0e3-c4036711a131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:03.583166 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc27a90-da3f-47d4-a0e3-c4036711a131 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:03.583166 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc27a90-da3f-47d4-a0e3-c4036711a131 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:03.583166 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc27a90-da3f-47d4-a0e3-c4036711a131 admin admin] PATH_INFO: `/v3/projects/5078809085074791b20a7f80fe99a2bd/users/051386d21a4c40bdadbfdcb8eaad34c0/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:03.586217 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc27a90-da3f-47d4-a0e3-c4036711a131 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5078809085074791b20a7f80fe99a2bd, user_id=051386d21a4c40bdadbfdcb8eaad34c0, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:03.588815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc27a90-da3f-47d4-a0e3-c4036711a131 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:03.601199 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3659/7313] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:38:03 2022] PUT /identity/v3/projects/5078809085074791b20a7f80fe99a2bd/users/051386d21a4c40bdadbfdcb8eaad34c0/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:38:03.612346 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0918845-fe1a-497b-9d52-47806447db97 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:03.612961 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0918845-fe1a-497b-9d52-47806447db97 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:03.613293 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0918845-fe1a-497b-9d52-47806447db97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:03.642974 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-e0918845-fe1a-497b-9d52-47806447db97 None None] MFA Rules not processed for user `051386d21a4c40bdadbfdcb8eaad34c0`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:38:03.644240 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e0918845-fe1a-497b-9d52-47806447db97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:03.739512 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3655/7314] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:38:03 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:38:03.754092 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc27a90-da3f-47d4-a0e3-c4036711a131 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:03.763930 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9fc27a90-da3f-47d4-a0e3-c4036711a131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:03.882164 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc27a90-da3f-47d4-a0e3-c4036711a131 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:03.907372 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820d601-b03f-42fc-8587-0e0c23690109 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:03.907963 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820d601-b03f-42fc-8587-0e0c23690109 service cinder] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:03.908248 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820d601-b03f-42fc-8587-0e0c23690109 service cinder] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:03.908528 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820d601-b03f-42fc-8587-0e0c23690109 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:03.920684 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820d601-b03f-42fc-8587-0e0c23690109 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:03.922310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820d601-b03f-42fc-8587-0e0c23690109 service cinder] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:03.933695 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3660/7315] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:38:03 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:38:04.071019 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0918845-fe1a-497b-9d52-47806447db97 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:04.073387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e0918845-fe1a-497b-9d52-47806447db97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:04.092706 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0918845-fe1a-497b-9d52-47806447db97 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:04.096426 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b80aec-7b4a-44af-9cc3-ef134ae2565f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:04.097083 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b80aec-7b4a-44af-9cc3-ef134ae2565f service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:04.097368 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b80aec-7b4a-44af-9cc3-ef134ae2565f service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:04.097660 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b80aec-7b4a-44af-9cc3-ef134ae2565f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:04.185184 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b80aec-7b4a-44af-9cc3-ef134ae2565f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:04.187101 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b80aec-7b4a-44af-9cc3-ef134ae2565f service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:04.198646 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3656/7316] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:38:04 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:38:04.616394 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57444504-1e05-4802-9d31-fa6ee83a996a None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:04.616991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57444504-1e05-4802-9d31-fa6ee83a996a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:04.616991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57444504-1e05-4802-9d31-fa6ee83a996a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:04.647177 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-57444504-1e05-4802-9d31-fa6ee83a996a None None] MFA Rules not processed for user `1498ecb600b049d8b842921fa2e2645a`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:38:04.649434 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-57444504-1e05-4802-9d31-fa6ee83a996a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:04.750565 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3661/7317] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:38:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:38:04.765031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b80aec-7b4a-44af-9cc3-ef134ae2565f service cinder] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:04.765513 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-83b80aec-7b4a-44af-9cc3-ef134ae2565f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:04.860744 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b80aec-7b4a-44af-9cc3-ef134ae2565f service cinder] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:04.885066 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c109a-2ad6-4977-973d-7a5e363f2394 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:04.885066 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c109a-2ad6-4977-973d-7a5e363f2394 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:04.885066 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c109a-2ad6-4977-973d-7a5e363f2394 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:04.885066 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c109a-2ad6-4977-973d-7a5e363f2394 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:04.887046 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-668c109a-2ad6-4977-973d-7a5e363f2394 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:04.953051 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c109a-2ad6-4977-973d-7a5e363f2394 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:04.956237 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c109a-2ad6-4977-973d-7a5e363f2394 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:04.975243 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3657/7318] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:38:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:38:08.028656 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e3f89-65dc-41c9-ba40-259a62900577 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:08.030832 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e3f89-65dc-41c9-ba40-259a62900577 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:08.032585 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e3f89-65dc-41c9-ba40-259a62900577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:08.050854 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-d42e3f89-65dc-41c9-ba40-259a62900577 None None] MFA Rules not processed for user `ae2e100e385e40fb9139cc6316c92159`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:38:08.052345 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d42e3f89-65dc-41c9-ba40-259a62900577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:08.059946 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3662/7319] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:38:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:38:09.539514 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c109a-2ad6-4977-973d-7a5e363f2394 service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:09.601429 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c109a-2ad6-4977-973d-7a5e363f2394 service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:09.606103 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc7a14-d022-4315-824e-972b440ca438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:09.607000 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc7a14-d022-4315-824e-972b440ca438 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:09.607319 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc7a14-d022-4315-824e-972b440ca438 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:09.607595 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc7a14-d022-4315-824e-972b440ca438 admin admin] PATH_INFO: `/v3/users/09a9bd9abd574537a93ec8c60ee5a1eb` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:09.609308 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fc7a14-d022-4315-824e-972b440ca438 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09a9bd9abd574537a93ec8c60ee5a1eb)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:09.610869 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fc7a14-d022-4315-824e-972b440ca438 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:09.741481 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-35fc7a14-d022-4315-824e-972b440ca438 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09a9bd9abd574537a93ec8c60ee5a1eb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:09.753612 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-35fc7a14-d022-4315-824e-972b440ca438 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09a9bd9abd574537a93ec8c60ee5a1eb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:09.842727 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-35fc7a14-d022-4315-824e-972b440ca438 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09a9bd9abd574537a93ec8c60ee5a1eb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:09.843405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-35fc7a14-d022-4315-824e-972b440ca438 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09a9bd9abd574537a93ec8c60ee5a1eb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:09.858307 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-35fc7a14-d022-4315-824e-972b440ca438 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09a9bd9abd574537a93ec8c60ee5a1eb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:09.864695 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3658/7320] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:38:09 2022] DELETE /identity/v3/users/09a9bd9abd574537a93ec8c60ee5a1eb => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:38:09.870217 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c195f-c33a-493e-85a2-f06c7e147fec None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:09.870217 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c195f-c33a-493e-85a2-f06c7e147fec None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:09.870217 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c195f-c33a-493e-85a2-f06c7e147fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:09.887934 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-ae1c195f-c33a-493e-85a2-f06c7e147fec None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:38:09.889129 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ae1c195f-c33a-493e-85a2-f06c7e147fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:09.949429 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3663/7321] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:38:09.960103 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc7a14-d022-4315-824e-972b440ca438 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:09.962390 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-35fc7a14-d022-4315-824e-972b440ca438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:10.021349 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc7a14-d022-4315-824e-972b440ca438 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:10.025345 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538eacfc-80c9-41ab-a182-a35c5a2ee6a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:10.026147 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538eacfc-80c9-41ab-a182-a35c5a2ee6a6 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:10.026434 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538eacfc-80c9-41ab-a182-a35c5a2ee6a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:10.026713 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538eacfc-80c9-41ab-a182-a35c5a2ee6a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:10.038134 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538eacfc-80c9-41ab-a182-a35c5a2ee6a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:10.039599 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538eacfc-80c9-41ab-a182-a35c5a2ee6a6 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:10.049997 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3659/7322] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:38:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:38:10.536862 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c195f-c33a-493e-85a2-f06c7e147fec None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:10.538353 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ae1c195f-c33a-493e-85a2-f06c7e147fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:10.551682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c195f-c33a-493e-85a2-f06c7e147fec None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:10.556653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e82c1-6b68-4f1a-b446-84d893ee17ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:10.557513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e82c1-6b68-4f1a-b446-84d893ee17ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:10.557814 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e82c1-6b68-4f1a-b446-84d893ee17ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:10.558096 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e82c1-6b68-4f1a-b446-84d893ee17ff admin admin] PATH_INFO: `/v3/projects/2f2a927dcd02428cadef75d2c1bf3135` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:10.559271 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e82c1-6b68-4f1a-b446-84d893ee17ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f2a927dcd02428cadef75d2c1bf3135)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:10.561369 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e82c1-6b68-4f1a-b446-84d893ee17ff admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:10.696184 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-dd1e82c1-6b68-4f1a-b446-84d893ee17ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f2a927dcd02428cadef75d2c1bf3135', 'request_id': 'req-dd1e82c1-6b68-4f1a-b446-84d893ee17ff'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:10.704232 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-dd1e82c1-6b68-4f1a-b446-84d893ee17ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f2a927dcd02428cadef75d2c1bf3135', 'request_id': 'req-dd1e82c1-6b68-4f1a-b446-84d893ee17ff'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:10.712833 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-dd1e82c1-6b68-4f1a-b446-84d893ee17ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f2a927dcd02428cadef75d2c1bf3135', 'request_id': 'req-dd1e82c1-6b68-4f1a-b446-84d893ee17ff'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:10.849306 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-dd1e82c1-6b68-4f1a-b446-84d893ee17ff admin admin] The token cache is being invalidate because project 2f2a927dcd02428cadef75d2c1bf3135 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:38:10.849947 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-dd1e82c1-6b68-4f1a-b446-84d893ee17ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:10.850592 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-dd1e82c1-6b68-4f1a-b446-84d893ee17ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:10.852175 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3664/7323] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:38:10 2022] DELETE /identity/v3/projects/2f2a927dcd02428cadef75d2c1bf3135 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:38:10.856133 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538eacfc-80c9-41ab-a182-a35c5a2ee6a6 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:10.866660 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538eacfc-80c9-41ab-a182-a35c5a2ee6a6 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:10.932528 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0e165-6ed1-4af8-97f2-e77c492db874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:10.933746 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0e165-6ed1-4af8-97f2-e77c492db874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:10.933746 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0e165-6ed1-4af8-97f2-e77c492db874 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:10.934202 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0e165-6ed1-4af8-97f2-e77c492db874 admin admin] PATH_INFO: `/v3/users/051386d21a4c40bdadbfdcb8eaad34c0` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:10.935692 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad0e165-6ed1-4af8-97f2-e77c492db874 admin admin] RBAC: Authorizing `identity:delete_user(user_id=051386d21a4c40bdadbfdcb8eaad34c0)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:10.937728 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad0e165-6ed1-4af8-97f2-e77c492db874 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:11.131745 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4ad0e165-6ed1-4af8-97f2-e77c492db874 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '051386d21a4c40bdadbfdcb8eaad34c0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:11.143524 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4ad0e165-6ed1-4af8-97f2-e77c492db874 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '051386d21a4c40bdadbfdcb8eaad34c0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:11.233870 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4ad0e165-6ed1-4af8-97f2-e77c492db874 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '051386d21a4c40bdadbfdcb8eaad34c0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:11.234620 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4ad0e165-6ed1-4af8-97f2-e77c492db874 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '051386d21a4c40bdadbfdcb8eaad34c0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:11.243853 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4ad0e165-6ed1-4af8-97f2-e77c492db874 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '051386d21a4c40bdadbfdcb8eaad34c0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:11.251305 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3660/7324] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:38:10 2022] DELETE /identity/v3/users/051386d21a4c40bdadbfdcb8eaad34c0 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:38:11.812695 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e82c1-6b68-4f1a-b446-84d893ee17ff admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:11.814304 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-dd1e82c1-6b68-4f1a-b446-84d893ee17ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:11.827780 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e82c1-6b68-4f1a-b446-84d893ee17ff admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:11.894882 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade5ad58-1f3c-415c-aaa7-475c4e35d87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:11.895740 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5ad58-1f3c-415c-aaa7-475c4e35d87d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:11.896026 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5ad58-1f3c-415c-aaa7-475c4e35d87d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:11.896304 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5ad58-1f3c-415c-aaa7-475c4e35d87d admin admin] PATH_INFO: `/v3/projects/5078809085074791b20a7f80fe99a2bd` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:11.897730 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade5ad58-1f3c-415c-aaa7-475c4e35d87d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5078809085074791b20a7f80fe99a2bd)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:11.899670 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade5ad58-1f3c-415c-aaa7-475c4e35d87d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:12.004064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ade5ad58-1f3c-415c-aaa7-475c4e35d87d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5078809085074791b20a7f80fe99a2bd', 'request_id': 'req-ade5ad58-1f3c-415c-aaa7-475c4e35d87d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:12.009947 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ade5ad58-1f3c-415c-aaa7-475c4e35d87d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5078809085074791b20a7f80fe99a2bd', 'request_id': 'req-ade5ad58-1f3c-415c-aaa7-475c4e35d87d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:12.016993 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ade5ad58-1f3c-415c-aaa7-475c4e35d87d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5078809085074791b20a7f80fe99a2bd', 'request_id': 'req-ade5ad58-1f3c-415c-aaa7-475c4e35d87d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:12.071077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ade5ad58-1f3c-415c-aaa7-475c4e35d87d admin admin] The token cache is being invalidate because project 5078809085074791b20a7f80fe99a2bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:38:12.071364 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ade5ad58-1f3c-415c-aaa7-475c4e35d87d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:12.071984 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ade5ad58-1f3c-415c-aaa7-475c4e35d87d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:12.073526 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3665/7325] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:38:11 2022] DELETE /identity/v3/projects/5078809085074791b20a7f80fe99a2bd => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:38:12.079136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550922d-4ce2-4440-a4d5-58be343d403c None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:12.079643 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550922d-4ce2-4440-a4d5-58be343d403c None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:12.079763 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550922d-4ce2-4440-a4d5-58be343d403c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:12.098574 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-4550922d-4ce2-4440-a4d5-58be343d403c None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:38:12.099843 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4550922d-4ce2-4440-a4d5-58be343d403c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:12.164352 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3661/7326] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:38:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:38:12.172352 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ecb88-8ef2-4085-ad6d-9e6e47826c6e None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:12.172725 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ecb88-8ef2-4085-ad6d-9e6e47826c6e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:12.173096 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ecb88-8ef2-4085-ad6d-9e6e47826c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:12.193319 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-9b0ecb88-8ef2-4085-ad6d-9e6e47826c6e None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:38:12.194976 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9b0ecb88-8ef2-4085-ad6d-9e6e47826c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:12.204805 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3666/7327] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:38:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:38:12.209012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550922d-4ce2-4440-a4d5-58be343d403c None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:12.220332 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550922d-4ce2-4440-a4d5-58be343d403c None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:12.225103 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999444da-5872-40b0-af3b-271e9a39dc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:12.225798 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999444da-5872-40b0-af3b-271e9a39dc5b admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:12.226091 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999444da-5872-40b0-af3b-271e9a39dc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:12.226364 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999444da-5872-40b0-af3b-271e9a39dc5b admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:12.227096 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999444da-5872-40b0-af3b-271e9a39dc5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:38:12.227404 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999444da-5872-40b0-af3b-271e9a39dc5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:12.229050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999444da-5872-40b0-af3b-271e9a39dc5b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:12.245254 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3662/7328] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:38:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:38:12.246499 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ecb88-8ef2-4085-ad6d-9e6e47826c6e None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:12.260552 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ecb88-8ef2-4085-ad6d-9e6e47826c6e None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:12.262882 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd7e5e-a160-4afc-bdc2-5a18713e02f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:12.263553 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd7e5e-a160-4afc-bdc2-5a18713e02f3 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:12.263833 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd7e5e-a160-4afc-bdc2-5a18713e02f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:12.264109 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd7e5e-a160-4afc-bdc2-5a18713e02f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:12.264815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd7e5e-a160-4afc-bdc2-5a18713e02f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:12.267477 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd7e5e-a160-4afc-bdc2-5a18713e02f3 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:12.377977 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3667/7329] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:38:12 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:38:12.384297 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999444da-5872-40b0-af3b-271e9a39dc5b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:12.397054 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999444da-5872-40b0-af3b-271e9a39dc5b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:12.463054 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f300eb4-9c3a-4bb6-a18c-04a2788a3187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:12.463756 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f300eb4-9c3a-4bb6-a18c-04a2788a3187 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:12.464038 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f300eb4-9c3a-4bb6-a18c-04a2788a3187 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:12.464311 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f300eb4-9c3a-4bb6-a18c-04a2788a3187 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:12.465150 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f300eb4-9c3a-4bb6-a18c-04a2788a3187 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:12.467159 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f300eb4-9c3a-4bb6-a18c-04a2788a3187 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:12.531705 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3663/7330] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:38:12 2022] POST /identity/v3/users => generated 287 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:38:12.535677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd7e5e-a160-4afc-bdc2-5a18713e02f3 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:12.547843 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd7e5e-a160-4afc-bdc2-5a18713e02f3 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:12.558657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0ad0d-cd0c-467a-8a0b-7d168e2b62f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:12.559347 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0ad0d-cd0c-467a-8a0b-7d168e2b62f3 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:12.559632 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0ad0d-cd0c-467a-8a0b-7d168e2b62f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:12.561203 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0ad0d-cd0c-467a-8a0b-7d168e2b62f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:12.561203 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e0ad0d-cd0c-467a-8a0b-7d168e2b62f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:12.570559 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e0ad0d-cd0c-467a-8a0b-7d168e2b62f3 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:12.585804 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3668/7331] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:38:12.589641 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f300eb4-9c3a-4bb6-a18c-04a2788a3187 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:12.605247 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f300eb4-9c3a-4bb6-a18c-04a2788a3187 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:12.617663 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9eca72-8252-4e62-923e-6e46518d39b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:12.618257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9eca72-8252-4e62-923e-6e46518d39b5 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:12.618539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9eca72-8252-4e62-923e-6e46518d39b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:12.618813 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9eca72-8252-4e62-923e-6e46518d39b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:12.619539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9eca72-8252-4e62-923e-6e46518d39b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:12.621166 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9eca72-8252-4e62-923e-6e46518d39b5 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:12.647586 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3664/7332] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:38:12.656322 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0ad0d-cd0c-467a-8a0b-7d168e2b62f3 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:12.673244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0ad0d-cd0c-467a-8a0b-7d168e2b62f3 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:12.679100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc09ed-5469-4dac-bbe2-9f99d664fd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:12.680998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc09ed-5469-4dac-bbe2-9f99d664fd5e admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:12.681500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc09ed-5469-4dac-bbe2-9f99d664fd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:12.682036 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc09ed-5469-4dac-bbe2-9f99d664fd5e admin admin] PATH_INFO: `/v3/projects/7e77c0845b9d41c596a91632b64a98e1/users/46a491d663814ab28aee4f5331924220/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:12.707535 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc09ed-5469-4dac-bbe2-9f99d664fd5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e77c0845b9d41c596a91632b64a98e1, user_id=46a491d663814ab28aee4f5331924220, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:12.711112 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc09ed-5469-4dac-bbe2-9f99d664fd5e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:12.812770 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3669/7333] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:38:12 2022] PUT /identity/v3/projects/7e77c0845b9d41c596a91632b64a98e1/users/46a491d663814ab28aee4f5331924220/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:38:12.823590 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd7d76-5f46-4342-b233-8c92075e9cc0 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:12.824070 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd7d76-5f46-4342-b233-8c92075e9cc0 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:12.824531 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd7d76-5f46-4342-b233-8c92075e9cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:12.858442 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-36dd7d76-5f46-4342-b233-8c92075e9cc0 None None] MFA Rules not processed for user `46a491d663814ab28aee4f5331924220`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:38:12.861783 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-36dd7d76-5f46-4342-b233-8c92075e9cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:13.007415 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3665/7334] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:38:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:38:13.008564 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc09ed-5469-4dac-bbe2-9f99d664fd5e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:13.082561 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc09ed-5469-4dac-bbe2-9f99d664fd5e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:13.087519 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32674d-1a4d-44d4-9ed3-5aa54dea342d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:13.088191 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32674d-1a4d-44d4-9ed3-5aa54dea342d admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:13.088483 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32674d-1a4d-44d4-9ed3-5aa54dea342d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:13.088760 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32674d-1a4d-44d4-9ed3-5aa54dea342d admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:13.089457 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32674d-1a4d-44d4-9ed3-5aa54dea342d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:13.091435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32674d-1a4d-44d4-9ed3-5aa54dea342d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:13.189746 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3670/7335] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:38:13 2022] POST /identity/v3/projects => generated 375 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:38:13.193900 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd7d76-5f46-4342-b233-8c92075e9cc0 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:13.206531 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd7d76-5f46-4342-b233-8c92075e9cc0 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:13.288262 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e8f95-e256-4455-813c-c96373c93375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:13.288961 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e8f95-e256-4455-813c-c96373c93375 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:13.289277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e8f95-e256-4455-813c-c96373c93375 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:13.289624 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e8f95-e256-4455-813c-c96373c93375 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:13.290421 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e8f95-e256-4455-813c-c96373c93375 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:13.292380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e8f95-e256-4455-813c-c96373c93375 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:13.434248 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3666/7336] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:38:13 2022] POST /identity/v3/users => generated 294 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:38:13.438255 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32674d-1a4d-44d4-9ed3-5aa54dea342d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:13.450648 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32674d-1a4d-44d4-9ed3-5aa54dea342d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:13.456443 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0fb75-722a-4bd2-9ff5-32fc2d1c9777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:13.457123 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0fb75-722a-4bd2-9ff5-32fc2d1c9777 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:13.457413 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0fb75-722a-4bd2-9ff5-32fc2d1c9777 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:13.457696 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0fb75-722a-4bd2-9ff5-32fc2d1c9777 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:13.458556 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec0fb75-722a-4bd2-9ff5-32fc2d1c9777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:13.460206 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec0fb75-722a-4bd2-9ff5-32fc2d1c9777 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:13.472860 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3671/7337] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:38:13.477308 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e8f95-e256-4455-813c-c96373c93375 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:13.487860 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e8f95-e256-4455-813c-c96373c93375 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:13.494609 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729be328-6a6d-418c-9cfa-ceae3b8c15f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:13.502318 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729be328-6a6d-418c-9cfa-ceae3b8c15f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:13.506238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729be328-6a6d-418c-9cfa-ceae3b8c15f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:13.506238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729be328-6a6d-418c-9cfa-ceae3b8c15f9 admin admin] PATH_INFO: `/v3/projects/0ba4fd6e909a4f218dd463ff39cb4f64/users/5d1afa0b8e85406296bbe95750af5ec2/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:13.526899 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729be328-6a6d-418c-9cfa-ceae3b8c15f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ba4fd6e909a4f218dd463ff39cb4f64, user_id=5d1afa0b8e85406296bbe95750af5ec2, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:13.529864 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729be328-6a6d-418c-9cfa-ceae3b8c15f9 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:13.611063 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3667/7338] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:38:13 2022] PUT /identity/v3/projects/0ba4fd6e909a4f218dd463ff39cb4f64/users/5d1afa0b8e85406296bbe95750af5ec2/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:38:13.615005 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0fb75-722a-4bd2-9ff5-32fc2d1c9777 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:13.626629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0fb75-722a-4bd2-9ff5-32fc2d1c9777 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:13.691345 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729be328-6a6d-418c-9cfa-ceae3b8c15f9 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:13.694354 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-729be328-6a6d-418c-9cfa-ceae3b8c15f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:13.745099 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48bf9c-21e5-4ace-9821-7626063b8c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:13.746038 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48bf9c-21e5-4ace-9821-7626063b8c57 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:13.746382 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48bf9c-21e5-4ace-9821-7626063b8c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:13.746727 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48bf9c-21e5-4ace-9821-7626063b8c57 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:13.747542 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48bf9c-21e5-4ace-9821-7626063b8c57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:13.751953 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48bf9c-21e5-4ace-9821-7626063b8c57 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:13.770220 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3672/7339] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:38:13.771152 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48bf9c-21e5-4ace-9821-7626063b8c57 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:13.821705 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48bf9c-21e5-4ace-9821-7626063b8c57 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:13.829241 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52646e3-11ae-4db4-8404-0dfd54afd73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:13.831711 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52646e3-11ae-4db4-8404-0dfd54afd73a admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:13.832009 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52646e3-11ae-4db4-8404-0dfd54afd73a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:13.832291 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52646e3-11ae-4db4-8404-0dfd54afd73a admin admin] PATH_INFO: `/v3/projects/0ba4fd6e909a4f218dd463ff39cb4f64/users/5d1afa0b8e85406296bbe95750af5ec2/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:13.836470 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52646e3-11ae-4db4-8404-0dfd54afd73a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ba4fd6e909a4f218dd463ff39cb4f64, user_id=5d1afa0b8e85406296bbe95750af5ec2, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:13.843959 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52646e3-11ae-4db4-8404-0dfd54afd73a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:13.872968 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3673/7340] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:38:13 2022] PUT /identity/v3/projects/0ba4fd6e909a4f218dd463ff39cb4f64/users/5d1afa0b8e85406296bbe95750af5ec2/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:38:13.880554 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729be328-6a6d-418c-9cfa-ceae3b8c15f9 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:13.884080 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f8ddd-a97d-46b7-8b1a-044d776e2fab None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:13.884467 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f8ddd-a97d-46b7-8b1a-044d776e2fab None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:13.885005 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f8ddd-a97d-46b7-8b1a-044d776e2fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:13.924441 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-d98f8ddd-a97d-46b7-8b1a-044d776e2fab None None] MFA Rules not processed for user `5d1afa0b8e85406296bbe95750af5ec2`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:38:13.930536 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d98f8ddd-a97d-46b7-8b1a-044d776e2fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:13.974199 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9434e6-b5b6-4371-8c93-fb1f955af0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:13.975980 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9434e6-b5b6-4371-8c93-fb1f955af0b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:13.975980 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9434e6-b5b6-4371-8c93-fb1f955af0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:13.976540 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9434e6-b5b6-4371-8c93-fb1f955af0b3 admin admin] PATH_INFO: `/v3/users/f93380560fd14d50af229186796db509` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:13.977695 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9434e6-b5b6-4371-8c93-fb1f955af0b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f93380560fd14d50af229186796db509)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:13.981623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9434e6-b5b6-4371-8c93-fb1f955af0b3 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:14.158162 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3674/7341] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:38:13 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:38:14.166182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f8ddd-a97d-46b7-8b1a-044d776e2fab None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:14.168096 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d98f8ddd-a97d-46b7-8b1a-044d776e2fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:14.248686 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f8ddd-a97d-46b7-8b1a-044d776e2fab None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:14.253165 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c18d8-7b15-4c15-a0d5-8d2e58eb294b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:14.253935 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c18d8-7b15-4c15-a0d5-8d2e58eb294b service cinder] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:14.254219 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c18d8-7b15-4c15-a0d5-8d2e58eb294b service cinder] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:14.254494 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c18d8-7b15-4c15-a0d5-8d2e58eb294b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:14.303514 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7d9434e6-b5b6-4371-8c93-fb1f955af0b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f93380560fd14d50af229186796db509'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:14.313517 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c18d8-7b15-4c15-a0d5-8d2e58eb294b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:14.315026 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c18d8-7b15-4c15-a0d5-8d2e58eb294b service cinder] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:14.316556 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7d9434e6-b5b6-4371-8c93-fb1f955af0b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f93380560fd14d50af229186796db509'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:14.324879 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3675/7342] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:38:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:38:14.439707 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7d9434e6-b5b6-4371-8c93-fb1f955af0b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f93380560fd14d50af229186796db509'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:14.441696 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7d9434e6-b5b6-4371-8c93-fb1f955af0b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f93380560fd14d50af229186796db509'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:14.450447 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7d9434e6-b5b6-4371-8c93-fb1f955af0b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f93380560fd14d50af229186796db509'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:14.474618 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3668/7343] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:38:13 2022] DELETE /identity/v3/users/f93380560fd14d50af229186796db509 => generated 0 bytes in 784 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:38:14.479033 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b405a8-8d5e-4273-9707-ce4d39364a6a None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:14.479563 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b405a8-8d5e-4273-9707-ce4d39364a6a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:14.480008 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b405a8-8d5e-4273-9707-ce4d39364a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:14.500510 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-24b405a8-8d5e-4273-9707-ce4d39364a6a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:38:14.501931 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-24b405a8-8d5e-4273-9707-ce4d39364a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:14.579135 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3676/7344] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:38:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:38:14.586269 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9434e6-b5b6-4371-8c93-fb1f955af0b3 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:14.588099 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7d9434e6-b5b6-4371-8c93-fb1f955af0b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:14.655502 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9434e6-b5b6-4371-8c93-fb1f955af0b3 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:14.659966 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514c1f3-c9a3-45be-a053-9966920eae3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:14.660824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514c1f3-c9a3-45be-a053-9966920eae3f service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:14.661244 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514c1f3-c9a3-45be-a053-9966920eae3f service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:14.661615 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514c1f3-c9a3-45be-a053-9966920eae3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:14.671469 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2514c1f3-c9a3-45be-a053-9966920eae3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:14.673582 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2514c1f3-c9a3-45be-a053-9966920eae3f service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:14.684179 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3669/7345] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:38:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:38:15.087808 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b405a8-8d5e-4273-9707-ce4d39364a6a None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:15.089611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-24b405a8-8d5e-4273-9707-ce4d39364a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:15.115587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b405a8-8d5e-4273-9707-ce4d39364a6a None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:15.122248 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c61af-beb3-45f6-8997-74312999e148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:15.123841 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c61af-beb3-45f6-8997-74312999e148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:15.124592 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c61af-beb3-45f6-8997-74312999e148 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:15.125103 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c61af-beb3-45f6-8997-74312999e148 admin admin] PATH_INFO: `/v3/projects/bfeeac0c49384132a08a8d0dd5654b73` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:15.130128 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c61af-beb3-45f6-8997-74312999e148 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfeeac0c49384132a08a8d0dd5654b73)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:15.135114 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c61af-beb3-45f6-8997-74312999e148 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:15.294327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-653c61af-beb3-45f6-8997-74312999e148 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfeeac0c49384132a08a8d0dd5654b73', 'request_id': 'req-653c61af-beb3-45f6-8997-74312999e148'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:15.301998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-653c61af-beb3-45f6-8997-74312999e148 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfeeac0c49384132a08a8d0dd5654b73', 'request_id': 'req-653c61af-beb3-45f6-8997-74312999e148'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:15.310379 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-653c61af-beb3-45f6-8997-74312999e148 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfeeac0c49384132a08a8d0dd5654b73', 'request_id': 'req-653c61af-beb3-45f6-8997-74312999e148'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:15.413161 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-653c61af-beb3-45f6-8997-74312999e148 admin admin] The token cache is being invalidate because project bfeeac0c49384132a08a8d0dd5654b73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:38:15.413650 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-653c61af-beb3-45f6-8997-74312999e148 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:15.414354 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-653c61af-beb3-45f6-8997-74312999e148 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:15.415984 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3677/7346] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:38:15 2022] DELETE /identity/v3/projects/bfeeac0c49384132a08a8d0dd5654b73 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:38:15.420880 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfe929-499f-47ce-b80c-a0094ff2120c None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:15.421372 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfe929-499f-47ce-b80c-a0094ff2120c None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:15.421508 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfe929-499f-47ce-b80c-a0094ff2120c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:15.440719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-2ddfe929-499f-47ce-b80c-a0094ff2120c None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:38:15.442033 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2ddfe929-499f-47ce-b80c-a0094ff2120c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:15.502566 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3670/7347] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:38:15.510211 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b15c1-bbe8-42ec-b45b-6bb91b353fc5 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:15.511433 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b15c1-bbe8-42ec-b45b-6bb91b353fc5 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:15.511433 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b15c1-bbe8-42ec-b45b-6bb91b353fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:15.529530 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-af3b15c1-bbe8-42ec-b45b-6bb91b353fc5 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:38:15.530774 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-af3b15c1-bbe8-42ec-b45b-6bb91b353fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:15.538897 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3678/7348] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:38:15.543101 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddfe929-499f-47ce-b80c-a0094ff2120c None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:15.553667 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddfe929-499f-47ce-b80c-a0094ff2120c None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:15.559602 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38124a94-5e80-4783-a4fa-30d17349167a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:15.560271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38124a94-5e80-4783-a4fa-30d17349167a admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:15.560559 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38124a94-5e80-4783-a4fa-30d17349167a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:15.560841 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38124a94-5e80-4783-a4fa-30d17349167a admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:15.561655 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38124a94-5e80-4783-a4fa-30d17349167a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:38:15.567125 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38124a94-5e80-4783-a4fa-30d17349167a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:15.567125 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38124a94-5e80-4783-a4fa-30d17349167a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:15.577717 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3671/7349] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:38:15.582086 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b15c1-bbe8-42ec-b45b-6bb91b353fc5 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:15.591292 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b15c1-bbe8-42ec-b45b-6bb91b353fc5 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:15.596017 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c28157-dfd4-4b19-b2c8-7692c663b3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:15.596670 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c28157-dfd4-4b19-b2c8-7692c663b3a4 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:15.597049 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c28157-dfd4-4b19-b2c8-7692c663b3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:15.597652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c28157-dfd4-4b19-b2c8-7692c663b3a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:15.597945 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c28157-dfd4-4b19-b2c8-7692c663b3a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:15.599860 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c28157-dfd4-4b19-b2c8-7692c663b3a4 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:15.677166 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3679/7350] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:38:15 2022] POST /identity/v3/projects => generated 365 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:38:15.678628 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38124a94-5e80-4783-a4fa-30d17349167a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:15.689592 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38124a94-5e80-4783-a4fa-30d17349167a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:15.745696 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4b4d1-8c18-4385-96ca-5cf2bd114ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:15.746437 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4b4d1-8c18-4385-96ca-5cf2bd114ae0 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:15.746721 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4b4d1-8c18-4385-96ca-5cf2bd114ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:15.747055 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4b4d1-8c18-4385-96ca-5cf2bd114ae0 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:15.747778 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d4b4d1-8c18-4385-96ca-5cf2bd114ae0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:15.749738 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d4b4d1-8c18-4385-96ca-5cf2bd114ae0 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:15.835494 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3672/7351] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:38:15 2022] POST /identity/v3/users => generated 283 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:38:15.836811 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c28157-dfd4-4b19-b2c8-7692c663b3a4 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:15.849109 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c28157-dfd4-4b19-b2c8-7692c663b3a4 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:15.854041 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab99e3-9715-4a67-96dc-795a85871bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:15.854709 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab99e3-9715-4a67-96dc-795a85871bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:15.854996 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab99e3-9715-4a67-96dc-795a85871bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:15.855296 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab99e3-9715-4a67-96dc-795a85871bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:15.856027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab99e3-9715-4a67-96dc-795a85871bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:15.857658 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab99e3-9715-4a67-96dc-795a85871bc7 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:15.868858 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3680/7352] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:38:15.872940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4b4d1-8c18-4385-96ca-5cf2bd114ae0 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:15.883165 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d4b4d1-8c18-4385-96ca-5cf2bd114ae0 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:15.887954 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e17916-da26-4905-a5d3-548f3bb69447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:15.888620 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e17916-da26-4905-a5d3-548f3bb69447 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:15.888908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e17916-da26-4905-a5d3-548f3bb69447 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:15.889191 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e17916-da26-4905-a5d3-548f3bb69447 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:15.889984 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e17916-da26-4905-a5d3-548f3bb69447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:15.891597 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e17916-da26-4905-a5d3-548f3bb69447 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:15.903235 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3673/7353] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:38:15.907681 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab99e3-9715-4a67-96dc-795a85871bc7 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:15.917685 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab99e3-9715-4a67-96dc-795a85871bc7 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:15.922868 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f656e-6c00-49bd-94ee-7fb30747ca1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:15.923750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f656e-6c00-49bd-94ee-7fb30747ca1c admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:15.924056 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f656e-6c00-49bd-94ee-7fb30747ca1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:15.924334 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f656e-6c00-49bd-94ee-7fb30747ca1c admin admin] PATH_INFO: `/v3/projects/903ce8c98e7941809c3641af803b1030/users/ee17009a1c3248b7adf0cdd17c918e0a/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:15.940437 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91f656e-6c00-49bd-94ee-7fb30747ca1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=903ce8c98e7941809c3641af803b1030, user_id=ee17009a1c3248b7adf0cdd17c918e0a, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:15.943162 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91f656e-6c00-49bd-94ee-7fb30747ca1c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:16.027847 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3681/7354] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:38:15 2022] PUT /identity/v3/projects/903ce8c98e7941809c3641af803b1030/users/ee17009a1c3248b7adf0cdd17c918e0a/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:38:16.039474 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a2cc2-f44d-4a87-be13-0b52e15968fc None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:16.039774 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a2cc2-f44d-4a87-be13-0b52e15968fc None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:16.040057 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a2cc2-f44d-4a87-be13-0b52e15968fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:16.069919 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-d70a2cc2-f44d-4a87-be13-0b52e15968fc None None] MFA Rules not processed for user `ee17009a1c3248b7adf0cdd17c918e0a`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:38:16.071268 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d70a2cc2-f44d-4a87-be13-0b52e15968fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:16.137429 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3674/7355] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:38:16 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:38:16.149070 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f656e-6c00-49bd-94ee-7fb30747ca1c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:16.150870 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d91f656e-6c00-49bd-94ee-7fb30747ca1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:16.210286 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f656e-6c00-49bd-94ee-7fb30747ca1c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:16.213941 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af982368-0773-4da2-9e06-2f0b62cfc236 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:16.214581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af982368-0773-4da2-9e06-2f0b62cfc236 service cinder] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:16.214861 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af982368-0773-4da2-9e06-2f0b62cfc236 service cinder] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:16.215137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af982368-0773-4da2-9e06-2f0b62cfc236 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:16.224086 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af982368-0773-4da2-9e06-2f0b62cfc236 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:16.225549 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af982368-0773-4da2-9e06-2f0b62cfc236 service cinder] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:16.234334 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3682/7356] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:38:16 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:38:17.378681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a2cc2-f44d-4a87-be13-0b52e15968fc None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:17.380990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d70a2cc2-f44d-4a87-be13-0b52e15968fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:17.463949 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a2cc2-f44d-4a87-be13-0b52e15968fc None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:17.468702 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdeb3eb-f289-468a-a6e6-187d3e22e8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:17.470158 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdeb3eb-f289-468a-a6e6-187d3e22e8df admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:17.470567 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdeb3eb-f289-468a-a6e6-187d3e22e8df admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:17.470846 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdeb3eb-f289-468a-a6e6-187d3e22e8df admin admin] PATH_INFO: `/v3/users/7f383f91907a43ec8c02282cc3de6414` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:17.472207 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdeb3eb-f289-468a-a6e6-187d3e22e8df admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f383f91907a43ec8c02282cc3de6414)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:17.474199 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdeb3eb-f289-468a-a6e6-187d3e22e8df admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:17.680952 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0bdeb3eb-f289-468a-a6e6-187d3e22e8df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f383f91907a43ec8c02282cc3de6414'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:17.694927 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0bdeb3eb-f289-468a-a6e6-187d3e22e8df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f383f91907a43ec8c02282cc3de6414'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:17.780262 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0bdeb3eb-f289-468a-a6e6-187d3e22e8df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f383f91907a43ec8c02282cc3de6414'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:17.780913 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0bdeb3eb-f289-468a-a6e6-187d3e22e8df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f383f91907a43ec8c02282cc3de6414'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:17.789681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0bdeb3eb-f289-468a-a6e6-187d3e22e8df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f383f91907a43ec8c02282cc3de6414'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:17.796059 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3675/7357] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:38:17 2022] DELETE /identity/v3/users/7f383f91907a43ec8c02282cc3de6414 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:38:17.800924 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43766054-9471-4b2c-b48a-5786f483bcc8 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:17.801559 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43766054-9471-4b2c-b48a-5786f483bcc8 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:17.802175 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43766054-9471-4b2c-b48a-5786f483bcc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:17.821591 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-43766054-9471-4b2c-b48a-5786f483bcc8 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:38:17.823289 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-43766054-9471-4b2c-b48a-5786f483bcc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:17.902212 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3683/7358] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:38:17.912381 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdeb3eb-f289-468a-a6e6-187d3e22e8df admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:17.913990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0bdeb3eb-f289-468a-a6e6-187d3e22e8df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:17.980108 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdeb3eb-f289-468a-a6e6-187d3e22e8df admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:17.983627 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1120c-d57e-4c7d-8698-107d5a40b970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:17.984268 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1120c-d57e-4c7d-8698-107d5a40b970 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:17.984615 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1120c-d57e-4c7d-8698-107d5a40b970 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:17.984893 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1120c-d57e-4c7d-8698-107d5a40b970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:17.993963 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb1120c-d57e-4c7d-8698-107d5a40b970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:17.995473 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb1120c-d57e-4c7d-8698-107d5a40b970 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:18.005530 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3676/7359] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:38:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:38:18.410950 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43766054-9471-4b2c-b48a-5786f483bcc8 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:18.412601 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-43766054-9471-4b2c-b48a-5786f483bcc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:18.427598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43766054-9471-4b2c-b48a-5786f483bcc8 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:18.432877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5abf127-df1b-46af-830b-f655cb325206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:18.434210 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5abf127-df1b-46af-830b-f655cb325206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:18.434494 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5abf127-df1b-46af-830b-f655cb325206 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:18.434776 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5abf127-df1b-46af-830b-f655cb325206 admin admin] PATH_INFO: `/v3/projects/7901698b22e64b5a9d17ffdae95763bc` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:18.436021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5abf127-df1b-46af-830b-f655cb325206 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7901698b22e64b5a9d17ffdae95763bc)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:18.438783 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5abf127-df1b-46af-830b-f655cb325206 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:18.569071 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f5abf127-df1b-46af-830b-f655cb325206 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7901698b22e64b5a9d17ffdae95763bc', 'request_id': 'req-f5abf127-df1b-46af-830b-f655cb325206'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:18.574717 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f5abf127-df1b-46af-830b-f655cb325206 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7901698b22e64b5a9d17ffdae95763bc', 'request_id': 'req-f5abf127-df1b-46af-830b-f655cb325206'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:18.580863 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f5abf127-df1b-46af-830b-f655cb325206 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7901698b22e64b5a9d17ffdae95763bc', 'request_id': 'req-f5abf127-df1b-46af-830b-f655cb325206'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:18.643271 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f5abf127-df1b-46af-830b-f655cb325206 admin admin] The token cache is being invalidate because project 7901698b22e64b5a9d17ffdae95763bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:38:18.643660 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f5abf127-df1b-46af-830b-f655cb325206 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:18.644325 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f5abf127-df1b-46af-830b-f655cb325206 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:18.645931 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3684/7360] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:38:18 2022] DELETE /identity/v3/projects/7901698b22e64b5a9d17ffdae95763bc => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:38:18.651961 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36c759-dc59-466a-b0a3-ed71b9e14644 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:18.652476 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36c759-dc59-466a-b0a3-ed71b9e14644 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:18.652702 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36c759-dc59-466a-b0a3-ed71b9e14644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:18.671286 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-8f36c759-dc59-466a-b0a3-ed71b9e14644 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:38:18.672933 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8f36c759-dc59-466a-b0a3-ed71b9e14644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:18.731485 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3677/7361] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:38:18.740977 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd101cb-8a13-4d25-97b6-6fca193167fa None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:18.741267 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd101cb-8a13-4d25-97b6-6fca193167fa None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:18.742504 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd101cb-8a13-4d25-97b6-6fca193167fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:18.763020 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-bbd101cb-8a13-4d25-97b6-6fca193167fa None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:38:18.764236 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-bbd101cb-8a13-4d25-97b6-6fca193167fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:18.772919 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3685/7362] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:38:18.777239 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f36c759-dc59-466a-b0a3-ed71b9e14644 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:18.787741 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f36c759-dc59-466a-b0a3-ed71b9e14644 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:18.792392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6818079d-afdc-4eb7-acaa-854429c720a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:18.793045 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818079d-afdc-4eb7-acaa-854429c720a4 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:18.793346 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818079d-afdc-4eb7-acaa-854429c720a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:18.793621 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818079d-afdc-4eb7-acaa-854429c720a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:18.794371 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6818079d-afdc-4eb7-acaa-854429c720a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:38:18.794677 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6818079d-afdc-4eb7-acaa-854429c720a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:18.796329 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6818079d-afdc-4eb7-acaa-854429c720a4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:18.808491 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3678/7363] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:38:18.813398 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd101cb-8a13-4d25-97b6-6fca193167fa None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:18.822705 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd101cb-8a13-4d25-97b6-6fca193167fa None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:18.828228 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e781c80-1541-4fcf-aff1-d7c1d3a89db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:18.829116 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e781c80-1541-4fcf-aff1-d7c1d3a89db0 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:18.829409 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e781c80-1541-4fcf-aff1-d7c1d3a89db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:18.829684 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e781c80-1541-4fcf-aff1-d7c1d3a89db0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:18.830559 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e781c80-1541-4fcf-aff1-d7c1d3a89db0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:18.832318 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e781c80-1541-4fcf-aff1-d7c1d3a89db0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:18.971277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6818079d-afdc-4eb7-acaa-854429c720a4 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:18.980605 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3686/7364] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:38:18 2022] POST /identity/v3/projects => generated 389 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:38:18.983388 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6818079d-afdc-4eb7-acaa-854429c720a4 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:19.097228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb15db61-292c-4bc6-95cc-ad7f79a68389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:19.101006 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15db61-292c-4bc6-95cc-ad7f79a68389 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:19.106376 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15db61-292c-4bc6-95cc-ad7f79a68389 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:19.106376 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15db61-292c-4bc6-95cc-ad7f79a68389 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:19.106376 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb15db61-292c-4bc6-95cc-ad7f79a68389 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:19.106376 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb15db61-292c-4bc6-95cc-ad7f79a68389 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:19.221427 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3679/7365] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:38:18 2022] POST /identity/v3/users => generated 295 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:38:19.225545 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e781c80-1541-4fcf-aff1-d7c1d3a89db0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:19.235592 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e781c80-1541-4fcf-aff1-d7c1d3a89db0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:19.240184 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52812c-4bf1-40b0-b8ca-b8fc9a3a20f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:19.241610 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52812c-4bf1-40b0-b8ca-b8fc9a3a20f0 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:19.241610 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52812c-4bf1-40b0-b8ca-b8fc9a3a20f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:19.241610 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52812c-4bf1-40b0-b8ca-b8fc9a3a20f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:19.242126 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a52812c-4bf1-40b0-b8ca-b8fc9a3a20f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:19.243735 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a52812c-4bf1-40b0-b8ca-b8fc9a3a20f0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:19.253916 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3687/7366] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:38:19.258012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb15db61-292c-4bc6-95cc-ad7f79a68389 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:19.269326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb15db61-292c-4bc6-95cc-ad7f79a68389 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:19.277702 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91b606-97f1-44ab-861f-de3d68fc972a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:19.278413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91b606-97f1-44ab-861f-de3d68fc972a admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:19.278722 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91b606-97f1-44ab-861f-de3d68fc972a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:19.278999 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91b606-97f1-44ab-861f-de3d68fc972a admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:19.279724 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91b606-97f1-44ab-861f-de3d68fc972a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:19.281992 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91b606-97f1-44ab-861f-de3d68fc972a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:19.292944 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3680/7367] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:38:19.297548 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52812c-4bf1-40b0-b8ca-b8fc9a3a20f0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:19.311021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52812c-4bf1-40b0-b8ca-b8fc9a3a20f0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:19.312392 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f2057-9557-4650-b8a0-35ed6a75c842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:19.313750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f2057-9557-4650-b8a0-35ed6a75c842 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:19.314209 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f2057-9557-4650-b8a0-35ed6a75c842 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:19.314633 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f2057-9557-4650-b8a0-35ed6a75c842 admin admin] PATH_INFO: `/v3/projects/4e3f82b1b832495896f59d90477f6e44/users/63517d4efe294384832f5674aadc0c63/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:19.332229 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f2057-9557-4650-b8a0-35ed6a75c842 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e3f82b1b832495896f59d90477f6e44, user_id=63517d4efe294384832f5674aadc0c63, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:19.335010 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f2057-9557-4650-b8a0-35ed6a75c842 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:19.398860 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3688/7368] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:38:19 2022] PUT /identity/v3/projects/4e3f82b1b832495896f59d90477f6e44/users/63517d4efe294384832f5674aadc0c63/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:38:19.411096 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802cc81-210e-4820-959a-24b161f354f0 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:19.411461 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802cc81-210e-4820-959a-24b161f354f0 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:19.411760 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802cc81-210e-4820-959a-24b161f354f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:19.440984 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-0802cc81-210e-4820-959a-24b161f354f0 None None] MFA Rules not processed for user `63517d4efe294384832f5674aadc0c63`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:38:19.442248 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0802cc81-210e-4820-959a-24b161f354f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:19.506816 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3681/7369] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:38:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:38:19.511416 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f2057-9557-4650-b8a0-35ed6a75c842 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:19.574338 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f2057-9557-4650-b8a0-35ed6a75c842 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:19.579666 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8372446-2fe9-46bb-8afd-cf75a8bcfc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:19.580320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8372446-2fe9-46bb-8afd-cf75a8bcfc80 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:19.580601 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8372446-2fe9-46bb-8afd-cf75a8bcfc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:19.580874 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8372446-2fe9-46bb-8afd-cf75a8bcfc80 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:19.581559 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8372446-2fe9-46bb-8afd-cf75a8bcfc80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:19.583539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8372446-2fe9-46bb-8afd-cf75a8bcfc80 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:19.673620 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3689/7370] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:38:19 2022] POST /identity/v3/projects => generated 387 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:38:19.677390 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802cc81-210e-4820-959a-24b161f354f0 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:19.689456 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802cc81-210e-4820-959a-24b161f354f0 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:19.750578 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2265f0a-102e-4daa-8aee-b4dd4a5d1307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:19.751250 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2265f0a-102e-4daa-8aee-b4dd4a5d1307 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:19.751592 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2265f0a-102e-4daa-8aee-b4dd4a5d1307 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:19.751812 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2265f0a-102e-4daa-8aee-b4dd4a5d1307 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:19.752505 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2265f0a-102e-4daa-8aee-b4dd4a5d1307 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:19.754516 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2265f0a-102e-4daa-8aee-b4dd4a5d1307 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:19.854379 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3682/7371] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:38:19 2022] POST /identity/v3/users => generated 294 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:38:19.858343 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8372446-2fe9-46bb-8afd-cf75a8bcfc80 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:19.869363 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8372446-2fe9-46bb-8afd-cf75a8bcfc80 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:19.884663 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c93e1-4d59-46c2-b6f6-a2208e6cbcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:19.885341 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c93e1-4d59-46c2-b6f6-a2208e6cbcbc admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:19.885623 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c93e1-4d59-46c2-b6f6-a2208e6cbcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:19.885928 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c93e1-4d59-46c2-b6f6-a2208e6cbcbc admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:19.886653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c93e1-4d59-46c2-b6f6-a2208e6cbcbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:19.888297 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c93e1-4d59-46c2-b6f6-a2208e6cbcbc admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:19.901178 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3690/7372] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:38:19.905171 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2265f0a-102e-4daa-8aee-b4dd4a5d1307 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:19.915412 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2265f0a-102e-4daa-8aee-b4dd4a5d1307 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:19.922070 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c3262-bd65-49d2-8a25-a8b934b7d47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:19.922070 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c3262-bd65-49d2-8a25-a8b934b7d47b admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:19.922070 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c3262-bd65-49d2-8a25-a8b934b7d47b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:19.922372 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c3262-bd65-49d2-8a25-a8b934b7d47b admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:19.922859 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c3262-bd65-49d2-8a25-a8b934b7d47b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:19.924464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c3262-bd65-49d2-8a25-a8b934b7d47b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:19.934748 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3683/7373] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:38:19.939410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c93e1-4d59-46c2-b6f6-a2208e6cbcbc admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:19.949635 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c93e1-4d59-46c2-b6f6-a2208e6cbcbc admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:19.955665 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc295e25-615e-4cf9-b6ba-0acbeb4118b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:19.956544 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc295e25-615e-4cf9-b6ba-0acbeb4118b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:19.956827 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc295e25-615e-4cf9-b6ba-0acbeb4118b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:19.957106 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc295e25-615e-4cf9-b6ba-0acbeb4118b8 admin admin] PATH_INFO: `/v3/projects/14733c8ecbd44e0195d7c8d62ccba663/users/52c2f3dc4c71466db3b3a2ce49d01656/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:19.972055 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc295e25-615e-4cf9-b6ba-0acbeb4118b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14733c8ecbd44e0195d7c8d62ccba663, user_id=52c2f3dc4c71466db3b3a2ce49d01656, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:19.980791 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc295e25-615e-4cf9-b6ba-0acbeb4118b8 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:20.055250 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3691/7374] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:38:19 2022] PUT /identity/v3/projects/14733c8ecbd44e0195d7c8d62ccba663/users/52c2f3dc4c71466db3b3a2ce49d01656/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:38:20.067222 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834baa6-bc36-4a45-a20a-54cb53392511 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:20.067528 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834baa6-bc36-4a45-a20a-54cb53392511 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:20.067806 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834baa6-bc36-4a45-a20a-54cb53392511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:20.097930 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-e834baa6-bc36-4a45-a20a-54cb53392511 None None] MFA Rules not processed for user `52c2f3dc4c71466db3b3a2ce49d01656`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:38:20.099181 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e834baa6-bc36-4a45-a20a-54cb53392511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:20.169529 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3684/7375] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:38:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:38:20.174817 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc295e25-615e-4cf9-b6ba-0acbeb4118b8 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:20.266509 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc295e25-615e-4cf9-b6ba-0acbeb4118b8 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:20.273776 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d351d3-b1b5-4654-ae95-ee4031e65894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:20.275341 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d351d3-b1b5-4654-ae95-ee4031e65894 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:20.275341 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d351d3-b1b5-4654-ae95-ee4031e65894 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:20.275341 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d351d3-b1b5-4654-ae95-ee4031e65894 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:20.276482 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d351d3-b1b5-4654-ae95-ee4031e65894 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:20.278547 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d351d3-b1b5-4654-ae95-ee4031e65894 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:20.362691 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3692/7376] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:38:20 2022] POST /identity/v3/projects => generated 387 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:38:20.366995 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e834baa6-bc36-4a45-a20a-54cb53392511 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:20.379386 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e834baa6-bc36-4a45-a20a-54cb53392511 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:20.446967 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ebfbd-8858-4a48-8f87-8bf51065b366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:20.447698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ebfbd-8858-4a48-8f87-8bf51065b366 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:20.447983 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ebfbd-8858-4a48-8f87-8bf51065b366 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:20.448258 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ebfbd-8858-4a48-8f87-8bf51065b366 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:20.448938 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ebfbd-8858-4a48-8f87-8bf51065b366 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:20.450929 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ebfbd-8858-4a48-8f87-8bf51065b366 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:20.563001 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d351d3-b1b5-4654-ae95-ee4031e65894 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:20.569922 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3685/7377] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:38:20 2022] POST /identity/v3/users => generated 300 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:38:20.575477 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d351d3-b1b5-4654-ae95-ee4031e65894 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:20.588298 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daca57a-c28e-4d34-b54e-c77de77cbf96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:20.588919 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ebfbd-8858-4a48-8f87-8bf51065b366 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:20.589054 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daca57a-c28e-4d34-b54e-c77de77cbf96 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:20.589403 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daca57a-c28e-4d34-b54e-c77de77cbf96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:20.589515 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daca57a-c28e-4d34-b54e-c77de77cbf96 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:20.590410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daca57a-c28e-4d34-b54e-c77de77cbf96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:20.594445 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e94ebfbd-8858-4a48-8f87-8bf51065b366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:20.602861 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daca57a-c28e-4d34-b54e-c77de77cbf96 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:20.629743 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3693/7378] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:38:20.633399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daca57a-c28e-4d34-b54e-c77de77cbf96 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:20.645500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daca57a-c28e-4d34-b54e-c77de77cbf96 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:20.653172 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80e6b0-3a08-4a11-a7fb-72ea60f0aaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:20.654114 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80e6b0-3a08-4a11-a7fb-72ea60f0aaea admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:20.654401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80e6b0-3a08-4a11-a7fb-72ea60f0aaea admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:20.654787 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80e6b0-3a08-4a11-a7fb-72ea60f0aaea admin admin] PATH_INFO: `/v3/projects/32e7a1c0d7cd48438eab586b5bc14c7e/users/6a9383d35aa74539a9882d3de6aea15f/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:20.682160 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80e6b0-3a08-4a11-a7fb-72ea60f0aaea admin admin] RBAC: Authorizing `identity:create_grant(project_id=32e7a1c0d7cd48438eab586b5bc14c7e, user_id=6a9383d35aa74539a9882d3de6aea15f, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:20.684753 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80e6b0-3a08-4a11-a7fb-72ea60f0aaea admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:20.710986 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ebfbd-8858-4a48-8f87-8bf51065b366 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:20.719615 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dedce83-f244-4a3d-80b6-64a935d5a783 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:20.726753 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dedce83-f244-4a3d-80b6-64a935d5a783 service placement] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:20.726753 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dedce83-f244-4a3d-80b6-64a935d5a783 service placement] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:20.726753 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dedce83-f244-4a3d-80b6-64a935d5a783 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:20.726753 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-9dedce83-f244-4a3d-80b6-64a935d5a783 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:20.741628 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dedce83-f244-4a3d-80b6-64a935d5a783 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:20.743698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dedce83-f244-4a3d-80b6-64a935d5a783 service placement] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:20.757219 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3686/7379] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:38:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:38:20.783221 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3694/7380] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:38:20 2022] PUT /identity/v3/projects/32e7a1c0d7cd48438eab586b5bc14c7e/users/6a9383d35aa74539a9882d3de6aea15f/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:38:20.787071 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dedce83-f244-4a3d-80b6-64a935d5a783 service placement] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:20.799323 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dedce83-f244-4a3d-80b6-64a935d5a783 service placement] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:20.860982 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698d74f-3fa5-496c-8d59-38809b830bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:20.861912 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698d74f-3fa5-496c-8d59-38809b830bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:20.862195 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698d74f-3fa5-496c-8d59-38809b830bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:20.862470 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698d74f-3fa5-496c-8d59-38809b830bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:20.863196 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5698d74f-3fa5-496c-8d59-38809b830bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:20.864865 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5698d74f-3fa5-496c-8d59-38809b830bf0 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:20.877788 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3687/7381] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:38:20.880436 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80e6b0-3a08-4a11-a7fb-72ea60f0aaea admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:20.890476 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80e6b0-3a08-4a11-a7fb-72ea60f0aaea admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:20.895107 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ac5e1-a64b-4378-82bd-d76a03b2c3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:20.895980 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ac5e1-a64b-4378-82bd-d76a03b2c3ad admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:20.896264 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ac5e1-a64b-4378-82bd-d76a03b2c3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:20.896541 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ac5e1-a64b-4378-82bd-d76a03b2c3ad admin admin] PATH_INFO: `/v3/projects/32e7a1c0d7cd48438eab586b5bc14c7e/users/6a9383d35aa74539a9882d3de6aea15f/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:20.898805 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ac5e1-a64b-4378-82bd-d76a03b2c3ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=32e7a1c0d7cd48438eab586b5bc14c7e, user_id=6a9383d35aa74539a9882d3de6aea15f, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:20.901480 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ac5e1-a64b-4378-82bd-d76a03b2c3ad admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:20.911461 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3695/7382] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:38:20 2022] PUT /identity/v3/projects/32e7a1c0d7cd48438eab586b5bc14c7e/users/6a9383d35aa74539a9882d3de6aea15f/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:38:20.921517 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf970be5-3042-48bb-9401-f063552907b6 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:20.922398 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf970be5-3042-48bb-9401-f063552907b6 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:20.922685 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf970be5-3042-48bb-9401-f063552907b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:20.951476 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-cf970be5-3042-48bb-9401-f063552907b6 None None] MFA Rules not processed for user `6a9383d35aa74539a9882d3de6aea15f`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:38:20.955425 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-cf970be5-3042-48bb-9401-f063552907b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:21.025327 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3688/7383] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:38:20 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:38:21.036896 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ac5e1-a64b-4378-82bd-d76a03b2c3ad admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:21.038628 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f50ac5e1-a64b-4378-82bd-d76a03b2c3ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:21.132363 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ac5e1-a64b-4378-82bd-d76a03b2c3ad admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:21.138441 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24136e-acbb-49a3-872f-7488693f763d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:21.139092 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24136e-acbb-49a3-872f-7488693f763d service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:21.139466 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24136e-acbb-49a3-872f-7488693f763d service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:21.139750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24136e-acbb-49a3-872f-7488693f763d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:21.200534 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de24136e-acbb-49a3-872f-7488693f763d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:21.202193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de24136e-acbb-49a3-872f-7488693f763d service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:21.212094 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3696/7384] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:38:21 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:38:21.665146 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf970be5-3042-48bb-9401-f063552907b6 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:21.666621 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-cf970be5-3042-48bb-9401-f063552907b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:21.737437 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf970be5-3042-48bb-9401-f063552907b6 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:21.742369 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cddbc0-fe94-48ca-a113-4086f1d286f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:21.743484 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cddbc0-fe94-48ca-a113-4086f1d286f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:21.743770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cddbc0-fe94-48ca-a113-4086f1d286f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:21.744048 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cddbc0-fe94-48ca-a113-4086f1d286f9 admin admin] PATH_INFO: `/v3/users/46a491d663814ab28aee4f5331924220` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:21.745409 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cddbc0-fe94-48ca-a113-4086f1d286f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46a491d663814ab28aee4f5331924220)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:21.747397 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cddbc0-fe94-48ca-a113-4086f1d286f9 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:21.950704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b5cddbc0-fe94-48ca-a113-4086f1d286f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46a491d663814ab28aee4f5331924220'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:21.963405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b5cddbc0-fe94-48ca-a113-4086f1d286f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46a491d663814ab28aee4f5331924220'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:22.014287 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b5cddbc0-fe94-48ca-a113-4086f1d286f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46a491d663814ab28aee4f5331924220'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:22.018061 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b5cddbc0-fe94-48ca-a113-4086f1d286f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46a491d663814ab28aee4f5331924220'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:22.027381 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b5cddbc0-fe94-48ca-a113-4086f1d286f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46a491d663814ab28aee4f5331924220'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:22.034270 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3689/7385] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:38:21 2022] DELETE /identity/v3/users/46a491d663814ab28aee4f5331924220 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:38:22.039423 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad06da-93c1-4d03-9c10-b980445da3d8 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:22.039423 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad06da-93c1-4d03-9c10-b980445da3d8 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:22.039994 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad06da-93c1-4d03-9c10-b980445da3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:22.056518 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-7fad06da-93c1-4d03-9c10-b980445da3d8 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:38:22.057726 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7fad06da-93c1-4d03-9c10-b980445da3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:22.120633 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3697/7386] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:38:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:38:22.131233 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cddbc0-fe94-48ca-a113-4086f1d286f9 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:22.132684 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b5cddbc0-fe94-48ca-a113-4086f1d286f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:22.200479 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cddbc0-fe94-48ca-a113-4086f1d286f9 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:22.204349 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf65082-b65e-45ed-938e-54796d09b2fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:22.205045 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf65082-b65e-45ed-938e-54796d09b2fe service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:22.205334 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf65082-b65e-45ed-938e-54796d09b2fe service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:22.205612 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf65082-b65e-45ed-938e-54796d09b2fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:22.215277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf65082-b65e-45ed-938e-54796d09b2fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:22.216742 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf65082-b65e-45ed-938e-54796d09b2fe service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:22.226610 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3690/7387] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:38:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:38:22.652533 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad06da-93c1-4d03-9c10-b980445da3d8 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:22.652533 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7fad06da-93c1-4d03-9c10-b980445da3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:22.659647 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad06da-93c1-4d03-9c10-b980445da3d8 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:22.668121 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc42891-f25e-4efb-9a42-a8c54c80683a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:22.670160 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc42891-f25e-4efb-9a42-a8c54c80683a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:22.670453 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc42891-f25e-4efb-9a42-a8c54c80683a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:22.670737 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc42891-f25e-4efb-9a42-a8c54c80683a admin admin] PATH_INFO: `/v3/projects/7e77c0845b9d41c596a91632b64a98e1` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:22.671980 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc42891-f25e-4efb-9a42-a8c54c80683a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e77c0845b9d41c596a91632b64a98e1)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:22.674963 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc42891-f25e-4efb-9a42-a8c54c80683a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:22.806855 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7bc42891-f25e-4efb-9a42-a8c54c80683a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e77c0845b9d41c596a91632b64a98e1', 'request_id': 'req-7bc42891-f25e-4efb-9a42-a8c54c80683a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:22.820235 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7bc42891-f25e-4efb-9a42-a8c54c80683a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e77c0845b9d41c596a91632b64a98e1', 'request_id': 'req-7bc42891-f25e-4efb-9a42-a8c54c80683a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:22.824331 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7bc42891-f25e-4efb-9a42-a8c54c80683a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e77c0845b9d41c596a91632b64a98e1', 'request_id': 'req-7bc42891-f25e-4efb-9a42-a8c54c80683a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:22.879227 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7bc42891-f25e-4efb-9a42-a8c54c80683a admin admin] The token cache is being invalidate because project 7e77c0845b9d41c596a91632b64a98e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:38:22.879582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7bc42891-f25e-4efb-9a42-a8c54c80683a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:22.880326 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7bc42891-f25e-4efb-9a42-a8c54c80683a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:22.883289 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3698/7388] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:38:22 2022] DELETE /identity/v3/projects/7e77c0845b9d41c596a91632b64a98e1 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:38:22.887188 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf65082-b65e-45ed-938e-54796d09b2fe service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:22.897856 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf65082-b65e-45ed-938e-54796d09b2fe service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:22.956830 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c7be9-4a3b-4555-b3b7-5ff03988c634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:22.957710 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c7be9-4a3b-4555-b3b7-5ff03988c634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:22.958031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c7be9-4a3b-4555-b3b7-5ff03988c634 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:22.958353 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c7be9-4a3b-4555-b3b7-5ff03988c634 admin admin] PATH_INFO: `/v3/users/5d1afa0b8e85406296bbe95750af5ec2` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:22.959619 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c7be9-4a3b-4555-b3b7-5ff03988c634 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d1afa0b8e85406296bbe95750af5ec2)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:22.961728 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c7be9-4a3b-4555-b3b7-5ff03988c634 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:23.103192 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c58c7be9-4a3b-4555-b3b7-5ff03988c634 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d1afa0b8e85406296bbe95750af5ec2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:23.115507 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c58c7be9-4a3b-4555-b3b7-5ff03988c634 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d1afa0b8e85406296bbe95750af5ec2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:23.222065 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c58c7be9-4a3b-4555-b3b7-5ff03988c634 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d1afa0b8e85406296bbe95750af5ec2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:23.222761 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c58c7be9-4a3b-4555-b3b7-5ff03988c634 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d1afa0b8e85406296bbe95750af5ec2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:23.230946 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c58c7be9-4a3b-4555-b3b7-5ff03988c634 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d1afa0b8e85406296bbe95750af5ec2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:23.241703 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3691/7389] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:38:22 2022] DELETE /identity/v3/users/5d1afa0b8e85406296bbe95750af5ec2 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:38:23.421444 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc42891-f25e-4efb-9a42-a8c54c80683a admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:23.422997 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7bc42891-f25e-4efb-9a42-a8c54c80683a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:23.494822 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc42891-f25e-4efb-9a42-a8c54c80683a admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:23.547755 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd76055-b102-4528-a2e7-c679398e3d2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:23.548493 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd76055-b102-4528-a2e7-c679398e3d2b service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:23.548784 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd76055-b102-4528-a2e7-c679398e3d2b service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:23.549067 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd76055-b102-4528-a2e7-c679398e3d2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:23.551172 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-fbd76055-b102-4528-a2e7-c679398e3d2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:23.620446 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd76055-b102-4528-a2e7-c679398e3d2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:23.621983 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd76055-b102-4528-a2e7-c679398e3d2b service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:23.632316 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3699/7390] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:38:23 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:38:23.905239 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c7be9-4a3b-4555-b3b7-5ff03988c634 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:23.908529 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c58c7be9-4a3b-4555-b3b7-5ff03988c634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:23.990432 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c7be9-4a3b-4555-b3b7-5ff03988c634 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:23.995963 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc03dad-06e8-461b-a5ab-4a334d464bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:23.997129 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc03dad-06e8-461b-a5ab-4a334d464bb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:23.997689 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc03dad-06e8-461b-a5ab-4a334d464bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:23.998160 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc03dad-06e8-461b-a5ab-4a334d464bb6 admin admin] PATH_INFO: `/v3/projects/0ba4fd6e909a4f218dd463ff39cb4f64` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:24.000993 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc03dad-06e8-461b-a5ab-4a334d464bb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ba4fd6e909a4f218dd463ff39cb4f64)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:24.003658 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc03dad-06e8-461b-a5ab-4a334d464bb6 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:24.139669 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3cc03dad-06e8-461b-a5ab-4a334d464bb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ba4fd6e909a4f218dd463ff39cb4f64', 'request_id': 'req-3cc03dad-06e8-461b-a5ab-4a334d464bb6'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:24.154154 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3cc03dad-06e8-461b-a5ab-4a334d464bb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ba4fd6e909a4f218dd463ff39cb4f64', 'request_id': 'req-3cc03dad-06e8-461b-a5ab-4a334d464bb6'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:24.162710 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3cc03dad-06e8-461b-a5ab-4a334d464bb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ba4fd6e909a4f218dd463ff39cb4f64', 'request_id': 'req-3cc03dad-06e8-461b-a5ab-4a334d464bb6'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:24.275044 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3cc03dad-06e8-461b-a5ab-4a334d464bb6 admin admin] The token cache is being invalidate because project 0ba4fd6e909a4f218dd463ff39cb4f64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:38:24.280529 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3cc03dad-06e8-461b-a5ab-4a334d464bb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:24.280529 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3cc03dad-06e8-461b-a5ab-4a334d464bb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:24.281353 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3692/7391] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:38:23 2022] DELETE /identity/v3/projects/0ba4fd6e909a4f218dd463ff39cb4f64 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:38:24.287290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927cd073-1a69-46e5-8e3e-805ecfcef802 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:24.291028 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927cd073-1a69-46e5-8e3e-805ecfcef802 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:24.291580 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927cd073-1a69-46e5-8e3e-805ecfcef802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:24.327130 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-927cd073-1a69-46e5-8e3e-805ecfcef802 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:38:24.328369 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-927cd073-1a69-46e5-8e3e-805ecfcef802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:24.398878 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3700/7392] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:38:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:38:24.406804 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706ceb1-b915-4728-942d-bed351e53dea None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:24.407095 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706ceb1-b915-4728-942d-bed351e53dea None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:24.407378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706ceb1-b915-4728-942d-bed351e53dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:24.429531 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-2706ceb1-b915-4728-942d-bed351e53dea None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:38:24.431205 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2706ceb1-b915-4728-942d-bed351e53dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:24.440707 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3693/7393] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:38:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:38:24.445018 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927cd073-1a69-46e5-8e3e-805ecfcef802 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:24.456740 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927cd073-1a69-46e5-8e3e-805ecfcef802 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:24.461846 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a5bb5-9d69-4b48-a651-7a33d1ab58cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:24.462567 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a5bb5-9d69-4b48-a651-7a33d1ab58cf admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:24.463186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a5bb5-9d69-4b48-a651-7a33d1ab58cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:24.463329 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a5bb5-9d69-4b48-a651-7a33d1ab58cf admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:24.464078 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a5bb5-9d69-4b48-a651-7a33d1ab58cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:38:24.464451 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a5bb5-9d69-4b48-a651-7a33d1ab58cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:24.466393 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a5bb5-9d69-4b48-a651-7a33d1ab58cf admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:24.480792 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3701/7394] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:38:24.484838 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706ceb1-b915-4728-942d-bed351e53dea None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:24.507079 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706ceb1-b915-4728-942d-bed351e53dea None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:24.514765 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a748b8-b3df-4e23-9167-99c4603e2149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:24.516773 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a748b8-b3df-4e23-9167-99c4603e2149 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:24.522411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a748b8-b3df-4e23-9167-99c4603e2149 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:24.523394 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a748b8-b3df-4e23-9167-99c4603e2149 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:24.524892 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a748b8-b3df-4e23-9167-99c4603e2149 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:24.529395 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a748b8-b3df-4e23-9167-99c4603e2149 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:24.659259 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3694/7395] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:38:24 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:38:24.660400 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a5bb5-9d69-4b48-a651-7a33d1ab58cf admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:24.673617 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a5bb5-9d69-4b48-a651-7a33d1ab58cf admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:24.774410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1412b-f69d-4970-8a35-5cfd41922087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:24.775690 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1412b-f69d-4970-8a35-5cfd41922087 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:24.776257 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1412b-f69d-4970-8a35-5cfd41922087 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:24.776920 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1412b-f69d-4970-8a35-5cfd41922087 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:24.779089 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f1412b-f69d-4970-8a35-5cfd41922087 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:24.783570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f1412b-f69d-4970-8a35-5cfd41922087 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:24.864844 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a748b8-b3df-4e23-9167-99c4603e2149 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:24.871888 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3702/7396] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:38:24 2022] POST /identity/v3/users => generated 287 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:38:24.882429 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a748b8-b3df-4e23-9167-99c4603e2149 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:24.887671 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea75be7-b057-42f5-995a-39ccfb8360a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:24.888614 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea75be7-b057-42f5-995a-39ccfb8360a5 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:24.888974 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea75be7-b057-42f5-995a-39ccfb8360a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:24.889807 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea75be7-b057-42f5-995a-39ccfb8360a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:24.890627 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea75be7-b057-42f5-995a-39ccfb8360a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:24.892995 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea75be7-b057-42f5-995a-39ccfb8360a5 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:24.905397 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3695/7397] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:38:24.910145 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1412b-f69d-4970-8a35-5cfd41922087 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:24.920693 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1412b-f69d-4970-8a35-5cfd41922087 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:24.926402 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada276c5-5398-454c-ba01-ea6f15e6d098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:24.927127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada276c5-5398-454c-ba01-ea6f15e6d098 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:24.927414 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada276c5-5398-454c-ba01-ea6f15e6d098 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:24.927687 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada276c5-5398-454c-ba01-ea6f15e6d098 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:24.928482 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada276c5-5398-454c-ba01-ea6f15e6d098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:24.930195 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada276c5-5398-454c-ba01-ea6f15e6d098 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:24.983481 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3703/7398] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:38:24.986961 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea75be7-b057-42f5-995a-39ccfb8360a5 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:24.997935 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea75be7-b057-42f5-995a-39ccfb8360a5 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:25.006869 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e6aaa-d1bf-474e-bc10-d42899aa2e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:25.011984 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e6aaa-d1bf-474e-bc10-d42899aa2e80 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:25.012437 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e6aaa-d1bf-474e-bc10-d42899aa2e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:25.012794 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e6aaa-d1bf-474e-bc10-d42899aa2e80 admin admin] PATH_INFO: `/v3/projects/69d15121a0c94d118851b13b3088463b/users/e6be1199305940a49a462e84f0c6a492/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:25.030658 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e6aaa-d1bf-474e-bc10-d42899aa2e80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69d15121a0c94d118851b13b3088463b, user_id=e6be1199305940a49a462e84f0c6a492, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:25.033481 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e6aaa-d1bf-474e-bc10-d42899aa2e80 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:25.141341 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3696/7399] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:38:24 2022] PUT /identity/v3/projects/69d15121a0c94d118851b13b3088463b/users/e6be1199305940a49a462e84f0c6a492/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:38:25.152649 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103ba4e-3fac-4839-8431-f9e883a24bea None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:25.152940 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103ba4e-3fac-4839-8431-f9e883a24bea None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:25.153218 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103ba4e-3fac-4839-8431-f9e883a24bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:25.183130 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-e103ba4e-3fac-4839-8431-f9e883a24bea None None] MFA Rules not processed for user `e6be1199305940a49a462e84f0c6a492`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:38:25.184393 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e103ba4e-3fac-4839-8431-f9e883a24bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:25.259668 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3704/7400] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:38:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:38:25.282391 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e6aaa-d1bf-474e-bc10-d42899aa2e80 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:25.284294 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8c4e6aaa-d1bf-474e-bc10-d42899aa2e80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:25.332654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103ba4e-3fac-4839-8431-f9e883a24bea None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:25.334343 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e103ba4e-3fac-4839-8431-f9e883a24bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:25.363660 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e6aaa-d1bf-474e-bc10-d42899aa2e80 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:25.367839 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9d1ec-1f13-42cf-9dd9-bd563bf857c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:25.368948 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9d1ec-1f13-42cf-9dd9-bd563bf857c0 service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:25.369428 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9d1ec-1f13-42cf-9dd9-bd563bf857c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:25.370275 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9d1ec-1f13-42cf-9dd9-bd563bf857c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:25.382655 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9d1ec-1f13-42cf-9dd9-bd563bf857c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:25.384418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9d1ec-1f13-42cf-9dd9-bd563bf857c0 service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:25.400638 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3697/7401] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:38:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:38:25.413665 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103ba4e-3fac-4839-8431-f9e883a24bea None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:25.420434 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97122d-c0d0-4086-93cc-67483a85daa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:25.423890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97122d-c0d0-4086-93cc-67483a85daa6 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:25.424272 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97122d-c0d0-4086-93cc-67483a85daa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:25.424655 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97122d-c0d0-4086-93cc-67483a85daa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:25.426640 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1d97122d-c0d0-4086-93cc-67483a85daa6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:25.430070 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9d1ec-1f13-42cf-9dd9-bd563bf857c0 service cinder] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:25.502677 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9d1ec-1f13-42cf-9dd9-bd563bf857c0 service cinder] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:25.509254 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f603e8c-90a0-491f-b8a8-4000697753bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:25.510701 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f603e8c-90a0-491f-b8a8-4000697753bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:25.510943 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f603e8c-90a0-491f-b8a8-4000697753bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:25.511225 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f603e8c-90a0-491f-b8a8-4000697753bb admin admin] PATH_INFO: `/v3/users/e6be1199305940a49a462e84f0c6a492` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:25.512752 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f603e8c-90a0-491f-b8a8-4000697753bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6be1199305940a49a462e84f0c6a492)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:25.514836 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f603e8c-90a0-491f-b8a8-4000697753bb admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:25.517835 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d97122d-c0d0-4086-93cc-67483a85daa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:25.520580 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d97122d-c0d0-4086-93cc-67483a85daa6 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:25.533128 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3705/7402] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:38:25 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:38:25.732417 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5f603e8c-90a0-491f-b8a8-4000697753bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6be1199305940a49a462e84f0c6a492'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:25.749969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5f603e8c-90a0-491f-b8a8-4000697753bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6be1199305940a49a462e84f0c6a492'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:25.833804 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5f603e8c-90a0-491f-b8a8-4000697753bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6be1199305940a49a462e84f0c6a492'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:25.833804 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5f603e8c-90a0-491f-b8a8-4000697753bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6be1199305940a49a462e84f0c6a492'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:25.837474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97122d-c0d0-4086-93cc-67483a85daa6 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:25.838975 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1d97122d-c0d0-4086-93cc-67483a85daa6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:25.848154 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5f603e8c-90a0-491f-b8a8-4000697753bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6be1199305940a49a462e84f0c6a492'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:25.865859 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3698/7403] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:38:25 2022] DELETE /identity/v3/users/e6be1199305940a49a462e84f0c6a492 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:38:25.870308 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd474735-e7e1-4cb4-b56a-2a48162b7691 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:25.870606 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd474735-e7e1-4cb4-b56a-2a48162b7691 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:25.870893 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd474735-e7e1-4cb4-b56a-2a48162b7691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:25.910246 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-cd474735-e7e1-4cb4-b56a-2a48162b7691 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:38:25.911518 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-cd474735-e7e1-4cb4-b56a-2a48162b7691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:25.985687 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97122d-c0d0-4086-93cc-67483a85daa6 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:25.992847 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3699/7404] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:38:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:38:26.017776 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd474735-e7e1-4cb4-b56a-2a48162b7691 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:26.020017 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-cd474735-e7e1-4cb4-b56a-2a48162b7691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:26.115833 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a3f0d-2178-4618-ac5f-ec36eeda26a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:26.117066 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a3f0d-2178-4618-ac5f-ec36eeda26a0 service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:26.117294 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a3f0d-2178-4618-ac5f-ec36eeda26a0 service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:26.117725 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a3f0d-2178-4618-ac5f-ec36eeda26a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:26.122370 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-044a3f0d-2178-4618-ac5f-ec36eeda26a0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:26.165938 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a3f0d-2178-4618-ac5f-ec36eeda26a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:26.168552 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a3f0d-2178-4618-ac5f-ec36eeda26a0 service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:26.180705 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd474735-e7e1-4cb4-b56a-2a48162b7691 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:26.186345 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066df82-1513-43d3-8c52-334eb721154d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:26.187213 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066df82-1513-43d3-8c52-334eb721154d service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:26.187681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066df82-1513-43d3-8c52-334eb721154d service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:26.188123 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066df82-1513-43d3-8c52-334eb721154d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:26.202567 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3706/7405] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:38:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:38:26.207048 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066df82-1513-43d3-8c52-334eb721154d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:26.208528 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066df82-1513-43d3-8c52-334eb721154d service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:26.228258 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3700/7406] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:38:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:38:26.834730 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a3f0d-2178-4618-ac5f-ec36eeda26a0 service placement] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:26.837684 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-044a3f0d-2178-4618-ac5f-ec36eeda26a0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:26.976129 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a3f0d-2178-4618-ac5f-ec36eeda26a0 service placement] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:26.982678 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e51057-851a-448f-9b1e-5f6b5f60ece3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:26.986581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e51057-851a-448f-9b1e-5f6b5f60ece3 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:26.986581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e51057-851a-448f-9b1e-5f6b5f60ece3 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:26.986581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e51057-851a-448f-9b1e-5f6b5f60ece3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:26.986581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-50e51057-851a-448f-9b1e-5f6b5f60ece3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:27.005890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e51057-851a-448f-9b1e-5f6b5f60ece3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:27.008258 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e51057-851a-448f-9b1e-5f6b5f60ece3 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:27.027660 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3707/7407] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:38:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:38:27.245552 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066df82-1513-43d3-8c52-334eb721154d service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:27.247650 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2066df82-1513-43d3-8c52-334eb721154d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:27.281027 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066df82-1513-43d3-8c52-334eb721154d service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:27.290111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268565c-00a4-480d-b184-5f5d0225ba75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:27.292281 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268565c-00a4-480d-b184-5f5d0225ba75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:27.292281 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268565c-00a4-480d-b184-5f5d0225ba75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:27.292281 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268565c-00a4-480d-b184-5f5d0225ba75 admin admin] PATH_INFO: `/v3/projects/69d15121a0c94d118851b13b3088463b` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:27.297183 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268565c-00a4-480d-b184-5f5d0225ba75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69d15121a0c94d118851b13b3088463b)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:27.305562 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268565c-00a4-480d-b184-5f5d0225ba75 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:27.481128 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1268565c-00a4-480d-b184-5f5d0225ba75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69d15121a0c94d118851b13b3088463b', 'request_id': 'req-1268565c-00a4-480d-b184-5f5d0225ba75'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:27.491021 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1268565c-00a4-480d-b184-5f5d0225ba75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69d15121a0c94d118851b13b3088463b', 'request_id': 'req-1268565c-00a4-480d-b184-5f5d0225ba75'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:27.503419 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1268565c-00a4-480d-b184-5f5d0225ba75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69d15121a0c94d118851b13b3088463b', 'request_id': 'req-1268565c-00a4-480d-b184-5f5d0225ba75'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:27.618039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1268565c-00a4-480d-b184-5f5d0225ba75 admin admin] The token cache is being invalidate because project 69d15121a0c94d118851b13b3088463b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:38:27.618343 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1268565c-00a4-480d-b184-5f5d0225ba75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:27.619432 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1268565c-00a4-480d-b184-5f5d0225ba75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:27.622659 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3701/7408] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:38:27 2022] DELETE /identity/v3/projects/69d15121a0c94d118851b13b3088463b => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:38:27.627840 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008b142-d6a1-41ad-992f-692ebcbb7936 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:27.628310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008b142-d6a1-41ad-992f-692ebcbb7936 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:27.628748 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008b142-d6a1-41ad-992f-692ebcbb7936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:27.659177 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-0008b142-d6a1-41ad-992f-692ebcbb7936 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:38:27.660417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0008b142-d6a1-41ad-992f-692ebcbb7936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:27.821475 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3708/7409] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:38:27.831104 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2296f37-7525-4c27-b5d3-124b145e5b21 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:27.831421 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2296f37-7525-4c27-b5d3-124b145e5b21 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:27.831707 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2296f37-7525-4c27-b5d3-124b145e5b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:27.876864 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-b2296f37-7525-4c27-b5d3-124b145e5b21 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:38:27.878192 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b2296f37-7525-4c27-b5d3-124b145e5b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:27.904411 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3702/7410] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:38:27.906042 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008b142-d6a1-41ad-992f-692ebcbb7936 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:27.919105 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008b142-d6a1-41ad-992f-692ebcbb7936 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:27.937948 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e9aa7-50cf-46e9-bb47-d2566ff7b43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:27.944747 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e9aa7-50cf-46e9-bb47-d2566ff7b43a admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:27.945421 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e9aa7-50cf-46e9-bb47-d2566ff7b43a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:27.947295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e9aa7-50cf-46e9-bb47-d2566ff7b43a admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:27.949428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e9aa7-50cf-46e9-bb47-d2566ff7b43a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:38:27.950200 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e9aa7-50cf-46e9-bb47-d2566ff7b43a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:27.952128 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e9aa7-50cf-46e9-bb47-d2566ff7b43a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:27.975994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2296f37-7525-4c27-b5d3-124b145e5b21 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:27.988733 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3709/7411] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:38:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:38:27.989545 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2296f37-7525-4c27-b5d3-124b145e5b21 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:28.000489 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69f199-83f3-4937-8ede-d197104aeb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:28.008079 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69f199-83f3-4937-8ede-d197104aeb5e admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:28.008079 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69f199-83f3-4937-8ede-d197104aeb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:28.008079 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69f199-83f3-4937-8ede-d197104aeb5e admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:28.009713 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69f199-83f3-4937-8ede-d197104aeb5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:28.016196 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df69f199-83f3-4937-8ede-d197104aeb5e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:28.159740 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3703/7412] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:38:27 2022] POST /identity/v3/projects => generated 373 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:38:28.164133 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e9aa7-50cf-46e9-bb47-d2566ff7b43a admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:28.186247 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e9aa7-50cf-46e9-bb47-d2566ff7b43a admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:28.379735 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843fd6c-0330-437c-b7f8-17664ed7d0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:28.380612 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843fd6c-0330-437c-b7f8-17664ed7d0f5 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:28.381003 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843fd6c-0330-437c-b7f8-17664ed7d0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:28.381383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843fd6c-0330-437c-b7f8-17664ed7d0f5 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:28.382489 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843fd6c-0330-437c-b7f8-17664ed7d0f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:28.385786 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843fd6c-0330-437c-b7f8-17664ed7d0f5 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:28.480371 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3710/7413] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:38:28 2022] POST /identity/v3/users => generated 287 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:38:28.484555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69f199-83f3-4937-8ede-d197104aeb5e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:28.522099 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69f199-83f3-4937-8ede-d197104aeb5e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:28.544295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305790f3-4699-4e2f-b459-aa07442282ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:28.545620 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305790f3-4699-4e2f-b459-aa07442282ed admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:28.545981 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305790f3-4699-4e2f-b459-aa07442282ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:28.546260 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305790f3-4699-4e2f-b459-aa07442282ed admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:28.547095 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305790f3-4699-4e2f-b459-aa07442282ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:28.549831 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305790f3-4699-4e2f-b459-aa07442282ed admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:28.573418 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3704/7414] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:38:28.576884 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843fd6c-0330-437c-b7f8-17664ed7d0f5 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:28.594619 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843fd6c-0330-437c-b7f8-17664ed7d0f5 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:28.600992 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9f79e-5ad9-4598-8a90-65f83cf3d116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:28.601857 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9f79e-5ad9-4598-8a90-65f83cf3d116 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:28.602565 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9f79e-5ad9-4598-8a90-65f83cf3d116 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:28.602565 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9f79e-5ad9-4598-8a90-65f83cf3d116 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:28.603442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d9f79e-5ad9-4598-8a90-65f83cf3d116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:28.605430 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d9f79e-5ad9-4598-8a90-65f83cf3d116 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:28.632567 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305790f3-4699-4e2f-b459-aa07442282ed admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:28.639518 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3711/7415] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:38:28.644970 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305790f3-4699-4e2f-b459-aa07442282ed admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:28.651106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955af915-2faf-4a1e-afcc-787cee90c52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:28.651905 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955af915-2faf-4a1e-afcc-787cee90c52d admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:28.652217 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955af915-2faf-4a1e-afcc-787cee90c52d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:28.652479 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955af915-2faf-4a1e-afcc-787cee90c52d admin admin] PATH_INFO: `/v3/projects/f19b8cfdb2ea490ebcb51f4f67262300/users/d6185d1aa50a4dcd919fb3410d4f30df/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:28.701671 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955af915-2faf-4a1e-afcc-787cee90c52d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f19b8cfdb2ea490ebcb51f4f67262300, user_id=d6185d1aa50a4dcd919fb3410d4f30df, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:28.714615 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955af915-2faf-4a1e-afcc-787cee90c52d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:28.804707 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3705/7416] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:38:28 2022] PUT /identity/v3/projects/f19b8cfdb2ea490ebcb51f4f67262300/users/d6185d1aa50a4dcd919fb3410d4f30df/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:38:28.824082 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4027ca-9377-46dd-95e8-2caa34304786 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:28.827639 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4027ca-9377-46dd-95e8-2caa34304786 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:28.832826 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4027ca-9377-46dd-95e8-2caa34304786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:28.979297 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-ed4027ca-9377-46dd-95e8-2caa34304786 None None] MFA Rules not processed for user `d6185d1aa50a4dcd919fb3410d4f30df`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:38:28.984280 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ed4027ca-9377-46dd-95e8-2caa34304786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:29.212258 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3712/7417] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:38:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:38:29.224077 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955af915-2faf-4a1e-afcc-787cee90c52d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:29.227958 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-955af915-2faf-4a1e-afcc-787cee90c52d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:29.473431 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955af915-2faf-4a1e-afcc-787cee90c52d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:29.482964 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902fe2f-2249-481a-abd6-e4ce5326ffdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:29.483664 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902fe2f-2249-481a-abd6-e4ce5326ffdc service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:29.483940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902fe2f-2249-481a-abd6-e4ce5326ffdc service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:29.484434 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902fe2f-2249-481a-abd6-e4ce5326ffdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:29.511736 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4902fe2f-2249-481a-abd6-e4ce5326ffdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:29.513612 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4902fe2f-2249-481a-abd6-e4ce5326ffdc service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:29.544820 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3706/7418] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:38:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:38:31.519574 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05304037-d36d-461f-95e6-cc8407e34aa6 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:31.520904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05304037-d36d-461f-95e6-cc8407e34aa6 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:31.521368 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05304037-d36d-461f-95e6-cc8407e34aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:31.569977 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-05304037-d36d-461f-95e6-cc8407e34aa6 None None] MFA Rules not processed for user `d6185d1aa50a4dcd919fb3410d4f30df`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:38:31.572395 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-05304037-d36d-461f-95e6-cc8407e34aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:31.587631 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3713/7419] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:38:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:38:33.175512 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57542516-7b14-4aea-8cdb-444d251480ff None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:33.176045 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57542516-7b14-4aea-8cdb-444d251480ff None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:33.176185 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57542516-7b14-4aea-8cdb-444d251480ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:33.194414 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-57542516-7b14-4aea-8cdb-444d251480ff None None] MFA Rules not processed for user `63517d4efe294384832f5674aadc0c63`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:38:33.195831 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-57542516-7b14-4aea-8cdb-444d251480ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:33.286346 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3707/7420] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:38:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:38:35.531212 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02de673-6ba5-42d5-8669-37dd27122600 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:35.531692 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02de673-6ba5-42d5-8669-37dd27122600 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:35.531847 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02de673-6ba5-42d5-8669-37dd27122600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:35.577399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-c02de673-6ba5-42d5-8669-37dd27122600 None None] MFA Rules not processed for user `e9fa67fb4ad4472183b95067597f043e`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:38:35.579967 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c02de673-6ba5-42d5-8669-37dd27122600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:35.659718 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3714/7421] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:38:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:38:48.339137 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57542516-7b14-4aea-8cdb-444d251480ff None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:48.342046 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-57542516-7b14-4aea-8cdb-444d251480ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:48.416357 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57542516-7b14-4aea-8cdb-444d251480ff None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:48.422835 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c3d7f-f4f6-4fad-b7aa-47c049e1b89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:48.424258 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c3d7f-f4f6-4fad-b7aa-47c049e1b89a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:48.424602 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c3d7f-f4f6-4fad-b7aa-47c049e1b89a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:48.425110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c3d7f-f4f6-4fad-b7aa-47c049e1b89a admin admin] PATH_INFO: `/v3/users/3107c6d79451405a963c5816d92055b3` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:48.426705 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c3d7f-f4f6-4fad-b7aa-47c049e1b89a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3107c6d79451405a963c5816d92055b3)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:48.429040 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c3d7f-f4f6-4fad-b7aa-47c049e1b89a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:48.710875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5d2c3d7f-f4f6-4fad-b7aa-47c049e1b89a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3107c6d79451405a963c5816d92055b3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:48.726564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5d2c3d7f-f4f6-4fad-b7aa-47c049e1b89a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3107c6d79451405a963c5816d92055b3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:48.808679 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5d2c3d7f-f4f6-4fad-b7aa-47c049e1b89a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3107c6d79451405a963c5816d92055b3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:48.810630 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5d2c3d7f-f4f6-4fad-b7aa-47c049e1b89a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3107c6d79451405a963c5816d92055b3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:48.820527 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5d2c3d7f-f4f6-4fad-b7aa-47c049e1b89a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3107c6d79451405a963c5816d92055b3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:48.831058 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3708/7422] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:38:48 2022] DELETE /identity/v3/users/3107c6d79451405a963c5816d92055b3 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:38:49.106863 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02de673-6ba5-42d5-8669-37dd27122600 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:49.119853 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02de673-6ba5-42d5-8669-37dd27122600 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:49.177834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb85d5-0613-42f7-8195-45eafcd55d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:49.178713 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb85d5-0613-42f7-8195-45eafcd55d10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:49.178998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb85d5-0613-42f7-8195-45eafcd55d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:49.179387 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb85d5-0613-42f7-8195-45eafcd55d10 admin admin] PATH_INFO: `/v3/projects/e02e106ab99f4decadf747b3ebf025c7` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:49.180623 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb85d5-0613-42f7-8195-45eafcd55d10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e02e106ab99f4decadf747b3ebf025c7)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:49.182657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb85d5-0613-42f7-8195-45eafcd55d10 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:49.315905 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8ebb85d5-0613-42f7-8195-45eafcd55d10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e02e106ab99f4decadf747b3ebf025c7', 'request_id': 'req-8ebb85d5-0613-42f7-8195-45eafcd55d10'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:49.326985 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8ebb85d5-0613-42f7-8195-45eafcd55d10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e02e106ab99f4decadf747b3ebf025c7', 'request_id': 'req-8ebb85d5-0613-42f7-8195-45eafcd55d10'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:49.330269 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8ebb85d5-0613-42f7-8195-45eafcd55d10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e02e106ab99f4decadf747b3ebf025c7', 'request_id': 'req-8ebb85d5-0613-42f7-8195-45eafcd55d10'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:49.401541 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8ebb85d5-0613-42f7-8195-45eafcd55d10 admin admin] The token cache is being invalidate because project e02e106ab99f4decadf747b3ebf025c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:38:49.401959 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8ebb85d5-0613-42f7-8195-45eafcd55d10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:49.402605 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8ebb85d5-0613-42f7-8195-45eafcd55d10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:38:49.404170 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3715/7423] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:38:49 2022] DELETE /identity/v3/projects/e02e106ab99f4decadf747b3ebf025c7 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:38:49.409799 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cf8c8-43d5-426e-941c-2dac8de8d0f8 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:49.410335 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cf8c8-43d5-426e-941c-2dac8de8d0f8 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:49.410484 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cf8c8-43d5-426e-941c-2dac8de8d0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:49.428512 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-a22cf8c8-43d5-426e-941c-2dac8de8d0f8 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:38:49.429721 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a22cf8c8-43d5-426e-941c-2dac8de8d0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:49.487251 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3709/7424] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:38:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:38:49.495686 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8bbbfc-664a-482f-ad16-757b0120e538 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:49.495979 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8bbbfc-664a-482f-ad16-757b0120e538 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:49.496264 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8bbbfc-664a-482f-ad16-757b0120e538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:49.514545 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-1b8bbbfc-664a-482f-ad16-757b0120e538 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:38:49.516428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1b8bbbfc-664a-482f-ad16-757b0120e538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:49.524553 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3716/7425] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:38:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:38:49.528894 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22cf8c8-43d5-426e-941c-2dac8de8d0f8 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:49.539486 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22cf8c8-43d5-426e-941c-2dac8de8d0f8 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:49.544162 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f0bf9-fa5f-4ecc-8e27-ef1ac1ac3377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:49.544839 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f0bf9-fa5f-4ecc-8e27-ef1ac1ac3377 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:49.545124 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f0bf9-fa5f-4ecc-8e27-ef1ac1ac3377 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:49.545404 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f0bf9-fa5f-4ecc-8e27-ef1ac1ac3377 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:49.546179 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f0bf9-fa5f-4ecc-8e27-ef1ac1ac3377 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:38:49.546487 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f0bf9-fa5f-4ecc-8e27-ef1ac1ac3377 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:49.548106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f0bf9-fa5f-4ecc-8e27-ef1ac1ac3377 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:49.559506 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3710/7426] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:38:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:38:49.564295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8bbbfc-664a-482f-ad16-757b0120e538 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:49.573610 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8bbbfc-664a-482f-ad16-757b0120e538 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:49.579069 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ce431-b839-429d-9f81-501b6870396a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:49.579664 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ce431-b839-429d-9f81-501b6870396a admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:49.579950 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ce431-b839-429d-9f81-501b6870396a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:49.580230 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ce431-b839-429d-9f81-501b6870396a admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:49.580927 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ce431-b839-429d-9f81-501b6870396a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:49.582890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ce431-b839-429d-9f81-501b6870396a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:49.658743 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3717/7427] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:38:49 2022] POST /identity/v3/projects => generated 371 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:38:49.661787 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f0bf9-fa5f-4ecc-8e27-ef1ac1ac3377 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:49.673513 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f0bf9-fa5f-4ecc-8e27-ef1ac1ac3377 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:49.732253 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa0afb7-8060-46c3-948c-9550aa5dd55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:49.732926 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0afb7-8060-46c3-948c-9550aa5dd55b admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:49.733210 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0afb7-8060-46c3-948c-9550aa5dd55b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:49.733488 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0afb7-8060-46c3-948c-9550aa5dd55b admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:49.734438 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa0afb7-8060-46c3-948c-9550aa5dd55b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:49.736389 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa0afb7-8060-46c3-948c-9550aa5dd55b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:49.797285 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3711/7428] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:38:49 2022] POST /identity/v3/users => generated 286 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:38:49.801479 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ce431-b839-429d-9f81-501b6870396a admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:49.813366 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ce431-b839-429d-9f81-501b6870396a admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:49.828954 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d92895-10fa-43f8-a6d8-44015685f1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:49.829816 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d92895-10fa-43f8-a6d8-44015685f1bc admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:49.830146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d92895-10fa-43f8-a6d8-44015685f1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:49.830469 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d92895-10fa-43f8-a6d8-44015685f1bc admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:49.831208 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d92895-10fa-43f8-a6d8-44015685f1bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:49.832833 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d92895-10fa-43f8-a6d8-44015685f1bc admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:49.843896 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3718/7429] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:38:49.847868 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa0afb7-8060-46c3-948c-9550aa5dd55b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:49.857710 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa0afb7-8060-46c3-948c-9550aa5dd55b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:49.862358 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a56a5-d360-4284-9a74-bc7063ea34a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:49.863013 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a56a5-d360-4284-9a74-bc7063ea34a6 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:49.863304 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a56a5-d360-4284-9a74-bc7063ea34a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:49.863588 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a56a5-d360-4284-9a74-bc7063ea34a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:49.864307 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a56a5-d360-4284-9a74-bc7063ea34a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:49.865955 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a56a5-d360-4284-9a74-bc7063ea34a6 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:49.876170 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3712/7430] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:38:49.880030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d92895-10fa-43f8-a6d8-44015685f1bc admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:49.889811 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d92895-10fa-43f8-a6d8-44015685f1bc admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:49.895052 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f710a1a-79b7-49d3-8061-ea1e7eab988f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:49.896401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f710a1a-79b7-49d3-8061-ea1e7eab988f admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:49.896682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f710a1a-79b7-49d3-8061-ea1e7eab988f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:49.896962 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f710a1a-79b7-49d3-8061-ea1e7eab988f admin admin] PATH_INFO: `/v3/projects/7232aa02ba6444b5a0acb5ffe699e2bc/users/49a3c47bfc674540927a9360790a838a/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:49.911759 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f710a1a-79b7-49d3-8061-ea1e7eab988f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7232aa02ba6444b5a0acb5ffe699e2bc, user_id=49a3c47bfc674540927a9360790a838a, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:49.914503 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f710a1a-79b7-49d3-8061-ea1e7eab988f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:49.996259 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3719/7431] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:38:49 2022] PUT /identity/v3/projects/7232aa02ba6444b5a0acb5ffe699e2bc/users/49a3c47bfc674540927a9360790a838a/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:38:50.007094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2de0b-d0d7-443b-96dd-a8a3a97ce481 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:50.007393 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2de0b-d0d7-443b-96dd-a8a3a97ce481 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:50.007677 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2de0b-d0d7-443b-96dd-a8a3a97ce481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:50.038734 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-ffa2de0b-d0d7-443b-96dd-a8a3a97ce481 None None] MFA Rules not processed for user `49a3c47bfc674540927a9360790a838a`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:38:50.040267 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ffa2de0b-d0d7-443b-96dd-a8a3a97ce481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:50.115909 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3713/7432] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:38:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:38:50.128252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11dfcf-879e-4a95-9a02-6157cab401ae None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:50.128768 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11dfcf-879e-4a95-9a02-6157cab401ae None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:50.128871 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11dfcf-879e-4a95-9a02-6157cab401ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:50.147751 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-2a11dfcf-879e-4a95-9a02-6157cab401ae None None] MFA Rules not processed for user `49a3c47bfc674540927a9360790a838a`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:38:50.148768 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2a11dfcf-879e-4a95-9a02-6157cab401ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:50.157070 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3720/7433] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:38:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:38:50.230848 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2de0b-d0d7-443b-96dd-a8a3a97ce481 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:50.232278 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ffa2de0b-d0d7-443b-96dd-a8a3a97ce481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:50.312349 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2de0b-d0d7-443b-96dd-a8a3a97ce481 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:50.318178 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2515b4be-e124-4da1-ab81-14b96bcfa9ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:50.318857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515b4be-e124-4da1-ab81-14b96bcfa9ec service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:50.319141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515b4be-e124-4da1-ab81-14b96bcfa9ec service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:50.319421 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515b4be-e124-4da1-ab81-14b96bcfa9ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:50.327450 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2515b4be-e124-4da1-ab81-14b96bcfa9ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:50.329135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2515b4be-e124-4da1-ab81-14b96bcfa9ec service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:50.338272 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3714/7434] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:38:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:38:52.773971 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd9c8a-990d-4101-9cc1-c924478af121 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:52.774457 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd9c8a-990d-4101-9cc1-c924478af121 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:52.774652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd9c8a-990d-4101-9cc1-c924478af121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:52.794093 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-39dd9c8a-990d-4101-9cc1-c924478af121 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:38:52.795320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-39dd9c8a-990d-4101-9cc1-c924478af121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:52.861541 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3721/7435] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:38:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:38:53.035401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2515b4be-e124-4da1-ab81-14b96bcfa9ec service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:53.036917 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2515b4be-e124-4da1-ab81-14b96bcfa9ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:53.136117 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2515b4be-e124-4da1-ab81-14b96bcfa9ec service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:53.142114 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05075a44-fe0f-4fec-aa4a-b1bc5940ddf9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:53.142785 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05075a44-fe0f-4fec-aa4a-b1bc5940ddf9 service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:53.143068 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05075a44-fe0f-4fec-aa4a-b1bc5940ddf9 service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:53.143396 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05075a44-fe0f-4fec-aa4a-b1bc5940ddf9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:53.153109 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05075a44-fe0f-4fec-aa4a-b1bc5940ddf9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:53.154902 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05075a44-fe0f-4fec-aa4a-b1bc5940ddf9 service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:53.163950 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3715/7436] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:38:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:38:54.065289 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cc574-87fa-4b44-bc28-89c01b3cfd4e None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:54.065805 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cc574-87fa-4b44-bc28-89c01b3cfd4e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:54.065918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cc574-87fa-4b44-bc28-89c01b3cfd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:54.084019 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-696cc574-87fa-4b44-bc28-89c01b3cfd4e None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:38:54.085236 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-696cc574-87fa-4b44-bc28-89c01b3cfd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:54.092634 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3722/7437] 10.222.0.23 () {58 vars in 967 bytes} [Sat Apr 30 21:38:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:38:54.105713 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05075a44-fe0f-4fec-aa4a-b1bc5940ddf9 service swift] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:54.130931 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05075a44-fe0f-4fec-aa4a-b1bc5940ddf9 service swift] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:54.137105 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6392b-a13b-44dc-811f-13dfac3ce1f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:54.139437 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6392b-a13b-44dc-811f-13dfac3ce1f4 service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:54.139437 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6392b-a13b-44dc-811f-13dfac3ce1f4 service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:54.139437 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6392b-a13b-44dc-811f-13dfac3ce1f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:54.147550 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6392b-a13b-44dc-811f-13dfac3ce1f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:54.149371 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6392b-a13b-44dc-811f-13dfac3ce1f4 service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:54.160684 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3716/7438] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:38:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:38:54.824174 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fdb63-7381-4482-a5b3-aeee8fd955b7 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:54.829558 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fdb63-7381-4482-a5b3-aeee8fd955b7 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:54.829558 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fdb63-7381-4482-a5b3-aeee8fd955b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:54.844088 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-f11fdb63-7381-4482-a5b3-aeee8fd955b7 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:38:54.845371 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f11fdb63-7381-4482-a5b3-aeee8fd955b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:54.852832 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3723/7439] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:38:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:38:54.865436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6392b-a13b-44dc-811f-13dfac3ce1f4 service swift] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:54.882869 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6392b-a13b-44dc-811f-13dfac3ce1f4 service swift] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:54.888443 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f316c-94ab-4685-95a9-c8bd35cbd04b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:54.889101 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f316c-94ab-4685-95a9-c8bd35cbd04b service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:54.889385 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f316c-94ab-4685-95a9-c8bd35cbd04b service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:54.889661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f316c-94ab-4685-95a9-c8bd35cbd04b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:54.899570 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f316c-94ab-4685-95a9-c8bd35cbd04b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:54.901481 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f316c-94ab-4685-95a9-c8bd35cbd04b service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:54.910744 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3717/7440] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:38:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:38:55.508143 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c75032-8cac-403b-b964-0a886e992d94 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:55.508681 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c75032-8cac-403b-b964-0a886e992d94 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:55.508935 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c75032-8cac-403b-b964-0a886e992d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:55.561858 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-69c75032-8cac-403b-b964-0a886e992d94 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:38:55.566954 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-69c75032-8cac-403b-b964-0a886e992d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:38:55.586356 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3724/7441] 10.222.0.23 () {58 vars in 967 bytes} [Sat Apr 30 21:38:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:38:55.601258 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f316c-94ab-4685-95a9-c8bd35cbd04b service swift] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:38:55.622727 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f316c-94ab-4685-95a9-c8bd35cbd04b service swift] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:38:55.634830 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e39a23e-8766-4d27-8350-3ce0ab6358c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:38:55.634830 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39a23e-8766-4d27-8350-3ce0ab6358c6 service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:38:55.634830 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39a23e-8766-4d27-8350-3ce0ab6358c6 service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:38:55.634830 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39a23e-8766-4d27-8350-3ce0ab6358c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:38:55.646752 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e39a23e-8766-4d27-8350-3ce0ab6358c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:38:55.649269 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e39a23e-8766-4d27-8350-3ce0ab6358c6 service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:38:55.666055 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3718/7442] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:38:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:39:02.982062 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b5823-1d06-4b3b-88d9-fe9f660be790 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:02.982644 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b5823-1d06-4b3b-88d9-fe9f660be790 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:02.982644 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b5823-1d06-4b3b-88d9-fe9f660be790 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:02.984000 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3725/7443] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 21:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:39:02.989531 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54afbf-0b25-4bcf-b0fd-4632477370fb None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:02.990143 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54afbf-0b25-4bcf-b0fd-4632477370fb None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:02.990143 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54afbf-0b25-4bcf-b0fd-4632477370fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:03.028033 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-9e54afbf-0b25-4bcf-b0fd-4632477370fb None None] MFA Rules not processed for user `0b0cb145b72a492ebb8c0e9223be47a1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:39:03.029326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-9e54afbf-0b25-4bcf-b0fd-4632477370fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:03.083028 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3719/7444] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:39:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:39:03.095629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b5823-1d06-4b3b-88d9-fe9f660be790 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:03.097317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5a6b5823-1d06-4b3b-88d9-fe9f660be790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:03.112766 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b5823-1d06-4b3b-88d9-fe9f660be790 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:03.116542 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4752f47-8f62-45fa-b940-a7e3137d1a26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:03.117192 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4752f47-8f62-45fa-b940-a7e3137d1a26 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:03.117477 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4752f47-8f62-45fa-b940-a7e3137d1a26 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:03.117778 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4752f47-8f62-45fa-b940-a7e3137d1a26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:03.126265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4752f47-8f62-45fa-b940-a7e3137d1a26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:03.128238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4752f47-8f62-45fa-b940-a7e3137d1a26 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:03.138628 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3726/7445] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:39:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:39:03.878200 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54afbf-0b25-4bcf-b0fd-4632477370fb None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:03.879718 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-9e54afbf-0b25-4bcf-b0fd-4632477370fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:03.950587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54afbf-0b25-4bcf-b0fd-4632477370fb None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:03.956280 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65325311-0067-49ce-8c10-629feeb51eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:03.957166 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65325311-0067-49ce-8c10-629feeb51eca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:03.957452 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65325311-0067-49ce-8c10-629feeb51eca admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:03.957729 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65325311-0067-49ce-8c10-629feeb51eca admin admin] PATH_INFO: `/v3/users/d6185d1aa50a4dcd919fb3410d4f30df` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:03.958974 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65325311-0067-49ce-8c10-629feeb51eca admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6185d1aa50a4dcd919fb3410d4f30df)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:03.960976 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65325311-0067-49ce-8c10-629feeb51eca admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:04.165047 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-65325311-0067-49ce-8c10-629feeb51eca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6185d1aa50a4dcd919fb3410d4f30df'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:04.178433 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-65325311-0067-49ce-8c10-629feeb51eca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6185d1aa50a4dcd919fb3410d4f30df'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:04.278324 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-65325311-0067-49ce-8c10-629feeb51eca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6185d1aa50a4dcd919fb3410d4f30df'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:04.279019 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-65325311-0067-49ce-8c10-629feeb51eca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6185d1aa50a4dcd919fb3410d4f30df'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:04.287499 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-65325311-0067-49ce-8c10-629feeb51eca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6185d1aa50a4dcd919fb3410d4f30df'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:04.293700 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3720/7446] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:39:03 2022] DELETE /identity/v3/users/d6185d1aa50a4dcd919fb3410d4f30df => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:39:04.298083 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323db10b-77e2-44eb-a669-6b97c963fa5e None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:04.298565 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323db10b-77e2-44eb-a669-6b97c963fa5e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:04.298663 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323db10b-77e2-44eb-a669-6b97c963fa5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:04.317870 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-323db10b-77e2-44eb-a669-6b97c963fa5e None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:39:04.319439 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-323db10b-77e2-44eb-a669-6b97c963fa5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:04.379729 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3727/7447] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:39:04.389552 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65325311-0067-49ce-8c10-629feeb51eca admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:04.392190 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-65325311-0067-49ce-8c10-629feeb51eca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:04.451285 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65325311-0067-49ce-8c10-629feeb51eca admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:04.455094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03aef8-d2a4-4c82-863e-46c098f6ec1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:04.456247 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03aef8-d2a4-4c82-863e-46c098f6ec1a service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:04.456532 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03aef8-d2a4-4c82-863e-46c098f6ec1a service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:04.456810 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03aef8-d2a4-4c82-863e-46c098f6ec1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:04.466107 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03aef8-d2a4-4c82-863e-46c098f6ec1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:04.467631 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03aef8-d2a4-4c82-863e-46c098f6ec1a service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:04.477816 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3721/7448] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:39:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:39:04.700515 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323db10b-77e2-44eb-a669-6b97c963fa5e None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:04.702114 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-323db10b-77e2-44eb-a669-6b97c963fa5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:04.715322 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323db10b-77e2-44eb-a669-6b97c963fa5e None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:04.720322 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf12848-5ba8-4a13-b4b5-bd32b4daee9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:04.721384 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf12848-5ba8-4a13-b4b5-bd32b4daee9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:04.721791 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf12848-5ba8-4a13-b4b5-bd32b4daee9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:04.722176 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf12848-5ba8-4a13-b4b5-bd32b4daee9d admin admin] PATH_INFO: `/v3/projects/f19b8cfdb2ea490ebcb51f4f67262300` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:04.724982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf12848-5ba8-4a13-b4b5-bd32b4daee9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f19b8cfdb2ea490ebcb51f4f67262300)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:04.731329 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf12848-5ba8-4a13-b4b5-bd32b4daee9d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:04.812977 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bdf12848-5ba8-4a13-b4b5-bd32b4daee9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f19b8cfdb2ea490ebcb51f4f67262300', 'request_id': 'req-bdf12848-5ba8-4a13-b4b5-bd32b4daee9d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:04.819020 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bdf12848-5ba8-4a13-b4b5-bd32b4daee9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f19b8cfdb2ea490ebcb51f4f67262300', 'request_id': 'req-bdf12848-5ba8-4a13-b4b5-bd32b4daee9d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:04.825198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bdf12848-5ba8-4a13-b4b5-bd32b4daee9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f19b8cfdb2ea490ebcb51f4f67262300', 'request_id': 'req-bdf12848-5ba8-4a13-b4b5-bd32b4daee9d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:04.886124 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bdf12848-5ba8-4a13-b4b5-bd32b4daee9d admin admin] The token cache is being invalidate because project f19b8cfdb2ea490ebcb51f4f67262300 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:39:04.886415 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bdf12848-5ba8-4a13-b4b5-bd32b4daee9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:04.887039 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bdf12848-5ba8-4a13-b4b5-bd32b4daee9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:04.888645 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3728/7449] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:39:04 2022] DELETE /identity/v3/projects/f19b8cfdb2ea490ebcb51f4f67262300 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:39:04.893626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49259873-b349-406c-81cf-2f75a969585d None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:04.893942 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49259873-b349-406c-81cf-2f75a969585d None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:04.894225 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49259873-b349-406c-81cf-2f75a969585d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:04.913035 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-49259873-b349-406c-81cf-2f75a969585d None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:39:04.914275 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-49259873-b349-406c-81cf-2f75a969585d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:04.973437 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3722/7450] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:39:04.980817 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb05c7-bfa0-44b8-b9ad-994de04673b8 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:04.981108 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb05c7-bfa0-44b8-b9ad-994de04673b8 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:04.981387 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb05c7-bfa0-44b8-b9ad-994de04673b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:04.999937 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-a5eb05c7-bfa0-44b8-b9ad-994de04673b8 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:39:05.001179 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a5eb05c7-bfa0-44b8-b9ad-994de04673b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:05.009897 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3729/7451] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:39:05.013873 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49259873-b349-406c-81cf-2f75a969585d None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:05.024623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49259873-b349-406c-81cf-2f75a969585d None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:05.029184 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273db7d-a1c3-468d-bd59-002875688b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:05.029856 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273db7d-a1c3-468d-bd59-002875688b49 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:05.030143 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273db7d-a1c3-468d-bd59-002875688b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:05.030420 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273db7d-a1c3-468d-bd59-002875688b49 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:05.031136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7273db7d-a1c3-468d-bd59-002875688b49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:39:05.031442 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7273db7d-a1c3-468d-bd59-002875688b49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:05.033056 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7273db7d-a1c3-468d-bd59-002875688b49 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:05.045043 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3723/7452] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:39:05.049859 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb05c7-bfa0-44b8-b9ad-994de04673b8 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:05.059087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb05c7-bfa0-44b8-b9ad-994de04673b8 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:05.063721 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3edd65-06fb-440a-81ae-343f100e92aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:05.064366 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3edd65-06fb-440a-81ae-343f100e92aa admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:05.064653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3edd65-06fb-440a-81ae-343f100e92aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:05.065585 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3edd65-06fb-440a-81ae-343f100e92aa admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:05.066314 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3edd65-06fb-440a-81ae-343f100e92aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:05.068227 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3edd65-06fb-440a-81ae-343f100e92aa admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:05.172725 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3730/7453] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:39:05 2022] POST /identity/v3/projects => generated 389 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:39:05.174005 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273db7d-a1c3-468d-bd59-002875688b49 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:05.184835 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273db7d-a1c3-468d-bd59-002875688b49 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:05.241802 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b7518-9aea-4c08-b602-8256b38721b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:05.242442 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b7518-9aea-4c08-b602-8256b38721b9 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:05.242725 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b7518-9aea-4c08-b602-8256b38721b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:05.243023 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b7518-9aea-4c08-b602-8256b38721b9 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:05.243701 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b7518-9aea-4c08-b602-8256b38721b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:05.245656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b7518-9aea-4c08-b602-8256b38721b9 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:05.322678 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3724/7454] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:39:05 2022] POST /identity/v3/users => generated 295 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:39:05.327182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3edd65-06fb-440a-81ae-343f100e92aa admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:05.338100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3edd65-06fb-440a-81ae-343f100e92aa admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:05.342798 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42680b-8137-47b6-88fd-ecc4b1911a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:05.343704 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42680b-8137-47b6-88fd-ecc4b1911a79 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:05.343995 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42680b-8137-47b6-88fd-ecc4b1911a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:05.344573 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42680b-8137-47b6-88fd-ecc4b1911a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:05.345487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b42680b-8137-47b6-88fd-ecc4b1911a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:05.347710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b42680b-8137-47b6-88fd-ecc4b1911a79 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:05.363773 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3731/7455] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:39:05.364974 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b7518-9aea-4c08-b602-8256b38721b9 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:05.377570 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b7518-9aea-4c08-b602-8256b38721b9 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:05.383262 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4d3af-1802-4b10-aeda-20c4654046c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:05.384156 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4d3af-1802-4b10-aeda-20c4654046c8 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:05.384156 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4d3af-1802-4b10-aeda-20c4654046c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:05.384479 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4d3af-1802-4b10-aeda-20c4654046c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:05.385160 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd4d3af-1802-4b10-aeda-20c4654046c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:05.386825 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd4d3af-1802-4b10-aeda-20c4654046c8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:05.397791 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3725/7456] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:39:05.401921 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42680b-8137-47b6-88fd-ecc4b1911a79 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:05.412651 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42680b-8137-47b6-88fd-ecc4b1911a79 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:05.417446 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15292065-e383-45e9-b75a-8a08f917df81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:05.418961 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15292065-e383-45e9-b75a-8a08f917df81 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:05.419441 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15292065-e383-45e9-b75a-8a08f917df81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:05.419898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15292065-e383-45e9-b75a-8a08f917df81 admin admin] PATH_INFO: `/v3/projects/fd10ab5932b44002aa3eea64dad5bf3d/users/507a432b8dbe44eeaed56750b9ec5112/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:05.438383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15292065-e383-45e9-b75a-8a08f917df81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd10ab5932b44002aa3eea64dad5bf3d, user_id=507a432b8dbe44eeaed56750b9ec5112, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:05.441093 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15292065-e383-45e9-b75a-8a08f917df81 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:05.522659 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3732/7457] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:39:05 2022] PUT /identity/v3/projects/fd10ab5932b44002aa3eea64dad5bf3d/users/507a432b8dbe44eeaed56750b9ec5112/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:39:05.532933 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8bd59b-a62a-4378-9412-d2787512334b None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:05.533238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8bd59b-a62a-4378-9412-d2787512334b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:05.534034 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8bd59b-a62a-4378-9412-d2787512334b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:05.561207 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-8e8bd59b-a62a-4378-9412-d2787512334b None None] MFA Rules not processed for user `507a432b8dbe44eeaed56750b9ec5112`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:39:05.562533 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8e8bd59b-a62a-4378-9412-d2787512334b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:05.626797 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3726/7458] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:39:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:39:05.637521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15292065-e383-45e9-b75a-8a08f917df81 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:05.639236 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-15292065-e383-45e9-b75a-8a08f917df81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:05.695228 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15292065-e383-45e9-b75a-8a08f917df81 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:05.698926 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e420e0-c4f1-43d2-ab53-49234b2ca82b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:05.699566 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e420e0-c4f1-43d2-ab53-49234b2ca82b service cinder] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:05.699915 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e420e0-c4f1-43d2-ab53-49234b2ca82b service cinder] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:05.700201 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e420e0-c4f1-43d2-ab53-49234b2ca82b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:05.709445 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e420e0-c4f1-43d2-ab53-49234b2ca82b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:05.710946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e420e0-c4f1-43d2-ab53-49234b2ca82b service cinder] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:05.720011 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3733/7459] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:39:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:39:12.980727 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8bd59b-a62a-4378-9412-d2787512334b None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:12.982177 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8e8bd59b-a62a-4378-9412-d2787512334b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:13.048099 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8bd59b-a62a-4378-9412-d2787512334b None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:13.053938 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c378f7e-cc5a-466e-9c6b-ead8e99f6db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:13.060698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c378f7e-cc5a-466e-9c6b-ead8e99f6db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:13.060698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c378f7e-cc5a-466e-9c6b-ead8e99f6db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:13.060698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c378f7e-cc5a-466e-9c6b-ead8e99f6db4 admin admin] PATH_INFO: `/v3/users/ee17009a1c3248b7adf0cdd17c918e0a` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:13.060698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c378f7e-cc5a-466e-9c6b-ead8e99f6db4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee17009a1c3248b7adf0cdd17c918e0a)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:13.060698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c378f7e-cc5a-466e-9c6b-ead8e99f6db4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:13.221332 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2c378f7e-cc5a-466e-9c6b-ead8e99f6db4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee17009a1c3248b7adf0cdd17c918e0a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:13.242992 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2c378f7e-cc5a-466e-9c6b-ead8e99f6db4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee17009a1c3248b7adf0cdd17c918e0a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:13.339710 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2c378f7e-cc5a-466e-9c6b-ead8e99f6db4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee17009a1c3248b7adf0cdd17c918e0a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:13.340662 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2c378f7e-cc5a-466e-9c6b-ead8e99f6db4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee17009a1c3248b7adf0cdd17c918e0a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:13.348734 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2c378f7e-cc5a-466e-9c6b-ead8e99f6db4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee17009a1c3248b7adf0cdd17c918e0a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:13.358439 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3727/7460] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:39:12 2022] DELETE /identity/v3/users/ee17009a1c3248b7adf0cdd17c918e0a => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:39:13.362946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3187c-425d-4e37-ad52-bd73719319d0 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:13.364064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3187c-425d-4e37-ad52-bd73719319d0 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:13.364064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3187c-425d-4e37-ad52-bd73719319d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:13.386546 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-5dc3187c-425d-4e37-ad52-bd73719319d0 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:39:13.387779 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5dc3187c-425d-4e37-ad52-bd73719319d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:13.465126 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3734/7461] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:39:13.481378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c378f7e-cc5a-466e-9c6b-ead8e99f6db4 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:13.482963 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2c378f7e-cc5a-466e-9c6b-ead8e99f6db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:13.545208 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c378f7e-cc5a-466e-9c6b-ead8e99f6db4 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:13.549134 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410bee9-44bc-499c-a83e-e17475a7e2d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:13.549823 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410bee9-44bc-499c-a83e-e17475a7e2d6 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:13.550391 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410bee9-44bc-499c-a83e-e17475a7e2d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:13.550712 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410bee9-44bc-499c-a83e-e17475a7e2d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:13.560672 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410bee9-44bc-499c-a83e-e17475a7e2d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:13.562167 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410bee9-44bc-499c-a83e-e17475a7e2d6 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:13.571788 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3728/7462] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:39:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:39:13.959047 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3187c-425d-4e37-ad52-bd73719319d0 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:13.960552 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5dc3187c-425d-4e37-ad52-bd73719319d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:13.972796 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3187c-425d-4e37-ad52-bd73719319d0 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:13.978521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f7cd2-fbc9-4ad9-b0e6-583f1ca6d9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:13.979443 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f7cd2-fbc9-4ad9-b0e6-583f1ca6d9a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:13.979799 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f7cd2-fbc9-4ad9-b0e6-583f1ca6d9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:13.980078 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f7cd2-fbc9-4ad9-b0e6-583f1ca6d9a2 admin admin] PATH_INFO: `/v3/projects/903ce8c98e7941809c3641af803b1030` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:13.981302 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f7cd2-fbc9-4ad9-b0e6-583f1ca6d9a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=903ce8c98e7941809c3641af803b1030)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:13.983264 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f7cd2-fbc9-4ad9-b0e6-583f1ca6d9a2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:14.076074 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c90f7cd2-fbc9-4ad9-b0e6-583f1ca6d9a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '903ce8c98e7941809c3641af803b1030', 'request_id': 'req-c90f7cd2-fbc9-4ad9-b0e6-583f1ca6d9a2'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:14.081292 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c90f7cd2-fbc9-4ad9-b0e6-583f1ca6d9a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '903ce8c98e7941809c3641af803b1030', 'request_id': 'req-c90f7cd2-fbc9-4ad9-b0e6-583f1ca6d9a2'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:14.088058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c90f7cd2-fbc9-4ad9-b0e6-583f1ca6d9a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '903ce8c98e7941809c3641af803b1030', 'request_id': 'req-c90f7cd2-fbc9-4ad9-b0e6-583f1ca6d9a2'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:14.174347 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c90f7cd2-fbc9-4ad9-b0e6-583f1ca6d9a2 admin admin] The token cache is being invalidate because project 903ce8c98e7941809c3641af803b1030 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:39:14.174639 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c90f7cd2-fbc9-4ad9-b0e6-583f1ca6d9a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:14.175283 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c90f7cd2-fbc9-4ad9-b0e6-583f1ca6d9a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:14.176855 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3735/7463] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:39:13 2022] DELETE /identity/v3/projects/903ce8c98e7941809c3641af803b1030 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:39:14.182064 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeaf8c1-d573-4db3-ba7e-d62d4ebe803b None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:14.182577 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeaf8c1-d573-4db3-ba7e-d62d4ebe803b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:14.182686 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeaf8c1-d573-4db3-ba7e-d62d4ebe803b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:14.200711 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-cbeaf8c1-d573-4db3-ba7e-d62d4ebe803b None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:39:14.201953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-cbeaf8c1-d573-4db3-ba7e-d62d4ebe803b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:14.262023 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3729/7464] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:39:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:39:14.271006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e167b4-412a-49a9-be78-a7ff41a46f76 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:14.272872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e167b4-412a-49a9-be78-a7ff41a46f76 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:14.272872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e167b4-412a-49a9-be78-a7ff41a46f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:14.290916 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-04e167b4-412a-49a9-be78-a7ff41a46f76 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:39:14.292127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-04e167b4-412a-49a9-be78-a7ff41a46f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:14.300395 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3736/7465] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:39:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:39:14.304654 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeaf8c1-d573-4db3-ba7e-d62d4ebe803b None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:14.314450 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeaf8c1-d573-4db3-ba7e-d62d4ebe803b None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:14.322845 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380e8cb-875d-4f2e-a444-3b183e22e285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:14.323512 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380e8cb-875d-4f2e-a444-3b183e22e285 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:14.323806 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380e8cb-875d-4f2e-a444-3b183e22e285 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:14.324087 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380e8cb-875d-4f2e-a444-3b183e22e285 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:14.324816 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380e8cb-875d-4f2e-a444-3b183e22e285 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:39:14.325126 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380e8cb-875d-4f2e-a444-3b183e22e285 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:14.326837 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380e8cb-875d-4f2e-a444-3b183e22e285 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:14.339399 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3730/7466] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:39:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:39:14.343799 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e167b4-412a-49a9-be78-a7ff41a46f76 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:14.353333 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e167b4-412a-49a9-be78-a7ff41a46f76 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:14.358109 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeead87-bed3-4c53-8151-8acd1d2315e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:14.370276 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeead87-bed3-4c53-8151-8acd1d2315e7 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:14.370276 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeead87-bed3-4c53-8151-8acd1d2315e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:14.370276 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeead87-bed3-4c53-8151-8acd1d2315e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:14.370276 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeead87-bed3-4c53-8151-8acd1d2315e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:14.370276 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeead87-bed3-4c53-8151-8acd1d2315e7 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:14.432016 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3737/7467] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:39:14 2022] POST /identity/v3/projects => generated 379 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:39:14.436297 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380e8cb-875d-4f2e-a444-3b183e22e285 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:14.447913 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380e8cb-875d-4f2e-a444-3b183e22e285 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:14.505289 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ce048-54a4-4bf0-9fa3-0dbd6d2873b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:14.505970 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ce048-54a4-4bf0-9fa3-0dbd6d2873b5 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:14.506251 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ce048-54a4-4bf0-9fa3-0dbd6d2873b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:14.506522 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ce048-54a4-4bf0-9fa3-0dbd6d2873b5 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:14.507279 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ce048-54a4-4bf0-9fa3-0dbd6d2873b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:14.509400 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ce048-54a4-4bf0-9fa3-0dbd6d2873b5 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:14.586376 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3731/7468] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:39:14 2022] POST /identity/v3/users => generated 290 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:39:14.590615 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeead87-bed3-4c53-8151-8acd1d2315e7 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:14.601723 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeead87-bed3-4c53-8151-8acd1d2315e7 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:14.606390 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6834d7ad-7319-4175-91ff-e3c0412c2aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:14.607165 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834d7ad-7319-4175-91ff-e3c0412c2aab admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:14.607445 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834d7ad-7319-4175-91ff-e3c0412c2aab admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:14.607719 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834d7ad-7319-4175-91ff-e3c0412c2aab admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:14.608437 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6834d7ad-7319-4175-91ff-e3c0412c2aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:14.610058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6834d7ad-7319-4175-91ff-e3c0412c2aab admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:14.620982 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3738/7469] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:39:14.628636 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ce048-54a4-4bf0-9fa3-0dbd6d2873b5 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:14.638582 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ce048-54a4-4bf0-9fa3-0dbd6d2873b5 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:14.643197 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b47c1a-aea9-4ece-93e7-098129cd69b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:14.643848 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b47c1a-aea9-4ece-93e7-098129cd69b9 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:14.644130 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b47c1a-aea9-4ece-93e7-098129cd69b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:14.644405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b47c1a-aea9-4ece-93e7-098129cd69b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:14.645624 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b47c1a-aea9-4ece-93e7-098129cd69b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:14.647535 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b47c1a-aea9-4ece-93e7-098129cd69b9 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:14.657198 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3732/7470] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:39:14.663814 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6834d7ad-7319-4175-91ff-e3c0412c2aab admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:14.673868 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6834d7ad-7319-4175-91ff-e3c0412c2aab admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:14.678691 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960fa94a-6dfb-49dd-84d2-50c320640345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:14.679551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960fa94a-6dfb-49dd-84d2-50c320640345 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:14.679828 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960fa94a-6dfb-49dd-84d2-50c320640345 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:14.680104 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960fa94a-6dfb-49dd-84d2-50c320640345 admin admin] PATH_INFO: `/v3/projects/ba9fb98f26e1427e993c69d547641b64/users/2e9643e1040a4d50bbf5324305b837b3/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:14.695951 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960fa94a-6dfb-49dd-84d2-50c320640345 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba9fb98f26e1427e993c69d547641b64, user_id=2e9643e1040a4d50bbf5324305b837b3, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:14.698874 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960fa94a-6dfb-49dd-84d2-50c320640345 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:14.764477 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3739/7471] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:39:14 2022] PUT /identity/v3/projects/ba9fb98f26e1427e993c69d547641b64/users/2e9643e1040a4d50bbf5324305b837b3/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:39:14.770406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea018f5-fdb8-4fc3-8220-5dab561ebf2e None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:14.770701 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea018f5-fdb8-4fc3-8220-5dab561ebf2e None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:14.770985 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea018f5-fdb8-4fc3-8220-5dab561ebf2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:14.790181 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-dea018f5-fdb8-4fc3-8220-5dab561ebf2e None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:39:14.791411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-dea018f5-fdb8-4fc3-8220-5dab561ebf2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:14.852474 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3733/7472] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:39:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:39:14.862491 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960fa94a-6dfb-49dd-84d2-50c320640345 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:14.868944 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-960fa94a-6dfb-49dd-84d2-50c320640345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:14.924056 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960fa94a-6dfb-49dd-84d2-50c320640345 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:14.928448 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b9fc5-f8e1-48ef-8694-7aa2188313f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:14.929127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b9fc5-f8e1-48ef-8694-7aa2188313f3 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:14.929390 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b9fc5-f8e1-48ef-8694-7aa2188313f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:14.929668 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b9fc5-f8e1-48ef-8694-7aa2188313f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:14.940258 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9b9fc5-f8e1-48ef-8694-7aa2188313f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:14.942375 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9b9fc5-f8e1-48ef-8694-7aa2188313f3 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:14.952477 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3740/7473] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:39:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:39:20.565159 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450dc483-3325-4f00-b97e-2c9a261be4c9 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:20.565738 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450dc483-3325-4f00-b97e-2c9a261be4c9 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:20.565738 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450dc483-3325-4f00-b97e-2c9a261be4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:20.600250 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-450dc483-3325-4f00-b97e-2c9a261be4c9 None None] MFA Rules not processed for user `2e9643e1040a4d50bbf5324305b837b3`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:39:20.601481 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-450dc483-3325-4f00-b97e-2c9a261be4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:20.692515 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3734/7474] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:39:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:39:20.700311 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b9fc5-f8e1-48ef-8694-7aa2188313f3 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:20.712144 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b9fc5-f8e1-48ef-8694-7aa2188313f3 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:20.718838 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0440815-00aa-4747-9e6b-74a09d991c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:20.720045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0440815-00aa-4747-9e6b-74a09d991c6b admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:20.720577 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0440815-00aa-4747-9e6b-74a09d991c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:20.721136 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0440815-00aa-4747-9e6b-74a09d991c6b admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:20.725895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0440815-00aa-4747-9e6b-74a09d991c6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:20.726747 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0440815-00aa-4747-9e6b-74a09d991c6b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:20.819679 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3741/7475] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:39:20 2022] POST /identity/v3/projects => generated 379 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:39:20.823861 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450dc483-3325-4f00-b97e-2c9a261be4c9 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:20.840987 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450dc483-3325-4f00-b97e-2c9a261be4c9 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:20.912947 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eecafd0-203a-477c-ab0e-daaa8d9966b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:20.913634 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eecafd0-203a-477c-ab0e-daaa8d9966b4 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:20.913984 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eecafd0-203a-477c-ab0e-daaa8d9966b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:20.914267 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eecafd0-203a-477c-ab0e-daaa8d9966b4 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:20.915116 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eecafd0-203a-477c-ab0e-daaa8d9966b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:20.916926 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eecafd0-203a-477c-ab0e-daaa8d9966b4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:21.038283 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3735/7476] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:39:20 2022] POST /identity/v3/users => generated 296 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:39:21.042491 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0440815-00aa-4747-9e6b-74a09d991c6b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:21.057375 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0440815-00aa-4747-9e6b-74a09d991c6b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:21.065399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d3fa18-3c37-4d18-8e1f-5c1dae6cd398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:21.067950 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3fa18-3c37-4d18-8e1f-5c1dae6cd398 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:21.068473 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3fa18-3c37-4d18-8e1f-5c1dae6cd398 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:21.069014 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d3fa18-3c37-4d18-8e1f-5c1dae6cd398 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:21.070051 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d3fa18-3c37-4d18-8e1f-5c1dae6cd398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:21.072259 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d3fa18-3c37-4d18-8e1f-5c1dae6cd398 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:21.095187 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3742/7477] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:39:21.100920 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eecafd0-203a-477c-ab0e-daaa8d9966b4 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:21.116118 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eecafd0-203a-477c-ab0e-daaa8d9966b4 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:21.121146 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe57c0-67a3-41b7-b58a-6a4eb1a0ab1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:21.122119 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe57c0-67a3-41b7-b58a-6a4eb1a0ab1d admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:21.122636 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe57c0-67a3-41b7-b58a-6a4eb1a0ab1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:21.122910 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe57c0-67a3-41b7-b58a-6a4eb1a0ab1d admin admin] PATH_INFO: `/v3/projects/d4ba2120895d4daaa9a12af1a9fe0ece/users/63e530f6508a49278b739cb38f6e59cd/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:21.139594 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe57c0-67a3-41b7-b58a-6a4eb1a0ab1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4ba2120895d4daaa9a12af1a9fe0ece, user_id=63e530f6508a49278b739cb38f6e59cd, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:21.142315 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe57c0-67a3-41b7-b58a-6a4eb1a0ab1d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:21.244023 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3736/7478] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:39:21 2022] PUT /identity/v3/projects/d4ba2120895d4daaa9a12af1a9fe0ece/users/63e530f6508a49278b739cb38f6e59cd/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:39:21.247929 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d3fa18-3c37-4d18-8e1f-5c1dae6cd398 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:21.258892 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d3fa18-3c37-4d18-8e1f-5c1dae6cd398 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:21.319848 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb2295-48ff-4518-9cfd-709693b75cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:21.320422 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb2295-48ff-4518-9cfd-709693b75cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:21.320708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb2295-48ff-4518-9cfd-709693b75cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:21.321010 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb2295-48ff-4518-9cfd-709693b75cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:21.321954 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb2295-48ff-4518-9cfd-709693b75cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:21.327697 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb2295-48ff-4518-9cfd-709693b75cb6 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:21.333776 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3743/7479] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:39:21.338013 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe57c0-67a3-41b7-b58a-6a4eb1a0ab1d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:21.348893 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe57c0-67a3-41b7-b58a-6a4eb1a0ab1d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:21.354122 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d3a83-3452-483a-9f14-7c34e3d6cdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:21.355135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d3a83-3452-483a-9f14-7c34e3d6cdfd admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:21.355430 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d3a83-3452-483a-9f14-7c34e3d6cdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:21.355713 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d3a83-3452-483a-9f14-7c34e3d6cdfd admin admin] PATH_INFO: `/v3/projects/d4ba2120895d4daaa9a12af1a9fe0ece/users/63e530f6508a49278b739cb38f6e59cd/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:21.357725 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d3a83-3452-483a-9f14-7c34e3d6cdfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4ba2120895d4daaa9a12af1a9fe0ece, user_id=63e530f6508a49278b739cb38f6e59cd, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:21.360429 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d3a83-3452-483a-9f14-7c34e3d6cdfd admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:21.372071 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3737/7480] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:39:21 2022] PUT /identity/v3/projects/d4ba2120895d4daaa9a12af1a9fe0ece/users/63e530f6508a49278b739cb38f6e59cd/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:39:27.509277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160eddea-8698-4214-8b28-2460281114ad None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:27.509745 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160eddea-8698-4214-8b28-2460281114ad None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:27.510067 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160eddea-8698-4214-8b28-2460281114ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:27.545384 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-160eddea-8698-4214-8b28-2460281114ad None None] MFA Rules not processed for user `63e530f6508a49278b739cb38f6e59cd`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:39:27.546812 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-160eddea-8698-4214-8b28-2460281114ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:27.628884 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3744/7481] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:39:27 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:39:27.642858 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d3a83-3452-483a-9f14-7c34e3d6cdfd admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:27.644633 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-284d3a83-3452-483a-9f14-7c34e3d6cdfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:27.729593 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d3a83-3452-483a-9f14-7c34e3d6cdfd admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:27.735320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4d4eb-6236-46d4-b25c-4cd53efe6d5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:27.736010 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4d4eb-6236-46d4-b25c-4cd53efe6d5e service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:27.736294 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4d4eb-6236-46d4-b25c-4cd53efe6d5e service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:27.736593 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4d4eb-6236-46d4-b25c-4cd53efe6d5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:27.746011 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e4d4eb-6236-46d4-b25c-4cd53efe6d5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:27.747670 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e4d4eb-6236-46d4-b25c-4cd53efe6d5e service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:27.759593 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3738/7482] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:39:27 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:39:28.187744 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160eddea-8698-4214-8b28-2460281114ad None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:28.189781 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-160eddea-8698-4214-8b28-2460281114ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:28.286342 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160eddea-8698-4214-8b28-2460281114ad None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:28.292908 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d801efa-93d6-4e60-9e1f-72e7b27b6160 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:28.293743 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d801efa-93d6-4e60-9e1f-72e7b27b6160 service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:28.294047 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d801efa-93d6-4e60-9e1f-72e7b27b6160 service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:28.294338 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d801efa-93d6-4e60-9e1f-72e7b27b6160 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:28.296203 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6d801efa-93d6-4e60-9e1f-72e7b27b6160 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:28.316422 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d801efa-93d6-4e60-9e1f-72e7b27b6160 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:28.316422 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d801efa-93d6-4e60-9e1f-72e7b27b6160 service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:28.329713 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3745/7483] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:39:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:39:28.938748 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4d4eb-6236-46d4-b25c-4cd53efe6d5e service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:28.940250 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b5e4d4eb-6236-46d4-b25c-4cd53efe6d5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:28.958021 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4d4eb-6236-46d4-b25c-4cd53efe6d5e service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:28.963107 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641b3e6-31c9-43e0-a45d-4c09f36e286e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:28.963760 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641b3e6-31c9-43e0-a45d-4c09f36e286e service placement] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:28.964041 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641b3e6-31c9-43e0-a45d-4c09f36e286e service placement] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:28.964315 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641b3e6-31c9-43e0-a45d-4c09f36e286e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:28.966146 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e641b3e6-31c9-43e0-a45d-4c09f36e286e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:28.981489 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e641b3e6-31c9-43e0-a45d-4c09f36e286e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:28.983142 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e641b3e6-31c9-43e0-a45d-4c09f36e286e service placement] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:28.999348 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3739/7484] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:39:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:39:37.059089 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d801efa-93d6-4e60-9e1f-72e7b27b6160 service placement] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:37.061278 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6d801efa-93d6-4e60-9e1f-72e7b27b6160 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:37.183721 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d801efa-93d6-4e60-9e1f-72e7b27b6160 service placement] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:37.190426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe78e6-eeae-4286-835a-ef1249667142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:37.191873 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe78e6-eeae-4286-835a-ef1249667142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:37.192619 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe78e6-eeae-4286-835a-ef1249667142 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:37.193132 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe78e6-eeae-4286-835a-ef1249667142 admin admin] PATH_INFO: `/v3/users/49a3c47bfc674540927a9360790a838a` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:37.195630 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe78e6-eeae-4286-835a-ef1249667142 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49a3c47bfc674540927a9360790a838a)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:37.198196 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe78e6-eeae-4286-835a-ef1249667142 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:37.396646 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-70fe78e6-eeae-4286-835a-ef1249667142 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49a3c47bfc674540927a9360790a838a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:37.414702 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-70fe78e6-eeae-4286-835a-ef1249667142 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49a3c47bfc674540927a9360790a838a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:37.489936 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-70fe78e6-eeae-4286-835a-ef1249667142 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49a3c47bfc674540927a9360790a838a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:37.498525 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-70fe78e6-eeae-4286-835a-ef1249667142 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49a3c47bfc674540927a9360790a838a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:37.504482 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-70fe78e6-eeae-4286-835a-ef1249667142 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49a3c47bfc674540927a9360790a838a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:37.527812 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3746/7485] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:39:37 2022] DELETE /identity/v3/users/49a3c47bfc674540927a9360790a838a => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:39:37.529942 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eea350-8d3e-4e71-add7-e78ca5ef5161 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:37.531048 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eea350-8d3e-4e71-add7-e78ca5ef5161 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:37.531544 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eea350-8d3e-4e71-add7-e78ca5ef5161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:37.552331 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-c8eea350-8d3e-4e71-add7-e78ca5ef5161 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:39:37.554078 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c8eea350-8d3e-4e71-add7-e78ca5ef5161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:37.640325 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe78e6-eeae-4286-835a-ef1249667142 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:37.642102 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-70fe78e6-eeae-4286-835a-ef1249667142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:37.691179 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3740/7486] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:39:37.742947 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eea350-8d3e-4e71-add7-e78ca5ef5161 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:37.743938 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c8eea350-8d3e-4e71-add7-e78ca5ef5161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:37.766058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe78e6-eeae-4286-835a-ef1249667142 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:37.780708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d3702-3b13-4dd4-9965-1a8434b517de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:37.781960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d3702-3b13-4dd4-9965-1a8434b517de admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:37.782443 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d3702-3b13-4dd4-9965-1a8434b517de admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:37.782892 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d3702-3b13-4dd4-9965-1a8434b517de admin admin] PATH_INFO: `/v3/users/507a432b8dbe44eeaed56750b9ec5112` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:37.785982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d3702-3b13-4dd4-9965-1a8434b517de admin admin] RBAC: Authorizing `identity:delete_user(user_id=507a432b8dbe44eeaed56750b9ec5112)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:37.789950 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d3702-3b13-4dd4-9965-1a8434b517de admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:37.889535 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eea350-8d3e-4e71-add7-e78ca5ef5161 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:37.896009 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98e961-e743-4468-97c6-8700554ae0ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:37.896704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98e961-e743-4468-97c6-8700554ae0ee service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:37.897252 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98e961-e743-4468-97c6-8700554ae0ee service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:37.898078 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98e961-e743-4468-97c6-8700554ae0ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:37.919113 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98e961-e743-4468-97c6-8700554ae0ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:37.920513 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98e961-e743-4468-97c6-8700554ae0ee service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:37.948787 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3741/7487] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:39:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:39:38.003303 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-195d3702-3b13-4dd4-9965-1a8434b517de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '507a432b8dbe44eeaed56750b9ec5112'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:38.022930 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-195d3702-3b13-4dd4-9965-1a8434b517de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '507a432b8dbe44eeaed56750b9ec5112'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:38.084540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-195d3702-3b13-4dd4-9965-1a8434b517de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '507a432b8dbe44eeaed56750b9ec5112'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:38.095203 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-195d3702-3b13-4dd4-9965-1a8434b517de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '507a432b8dbe44eeaed56750b9ec5112'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:38.095698 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-195d3702-3b13-4dd4-9965-1a8434b517de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '507a432b8dbe44eeaed56750b9ec5112'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:38.109458 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3747/7488] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:39:37 2022] DELETE /identity/v3/users/507a432b8dbe44eeaed56750b9ec5112 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:39:38.114254 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee4ba7-2622-47d8-9e35-413f3cc26890 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:38.114540 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee4ba7-2622-47d8-9e35-413f3cc26890 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:38.119803 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee4ba7-2622-47d8-9e35-413f3cc26890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:38.171272 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-adee4ba7-2622-47d8-9e35-413f3cc26890 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:39:38.173036 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-adee4ba7-2622-47d8-9e35-413f3cc26890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:38.261527 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733ec05-07ed-4abb-bca1-caddbd2636e9 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:38.262495 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733ec05-07ed-4abb-bca1-caddbd2636e9 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:38.264246 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c733ec05-07ed-4abb-bca1-caddbd2636e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:38.287614 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-c733ec05-07ed-4abb-bca1-caddbd2636e9 None None] MFA Rules not processed for user `63517d4efe294384832f5674aadc0c63`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:39:38.289169 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c733ec05-07ed-4abb-bca1-caddbd2636e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:38.319830 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3742/7489] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:39:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:39:38.334337 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee4ba7-2622-47d8-9e35-413f3cc26890 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:38.344388 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-adee4ba7-2622-47d8-9e35-413f3cc26890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:38.416481 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3748/7490] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:39:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:39:38.612438 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee4ba7-2622-47d8-9e35-413f3cc26890 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:38.624794 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ee7ec-54c4-45e3-b3ac-222e66412856 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:38.627836 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ee7ec-54c4-45e3-b3ac-222e66412856 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:38.630790 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ee7ec-54c4-45e3-b3ac-222e66412856 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:38.630790 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ee7ec-54c4-45e3-b3ac-222e66412856 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:38.659715 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ee7ec-54c4-45e3-b3ac-222e66412856 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:38.661504 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ee7ec-54c4-45e3-b3ac-222e66412856 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:38.675239 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3743/7491] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:39:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:39:38.872797 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733ec05-07ed-4abb-bca1-caddbd2636e9 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:38.874449 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c733ec05-07ed-4abb-bca1-caddbd2636e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:38.898788 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c733ec05-07ed-4abb-bca1-caddbd2636e9 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:38.915667 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d062b-0821-481c-8f4e-7441730f4a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:38.916553 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d062b-0821-481c-8f4e-7441730f4a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:38.916839 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d062b-0821-481c-8f4e-7441730f4a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:38.917122 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d062b-0821-481c-8f4e-7441730f4a0f admin admin] PATH_INFO: `/v3/projects/7232aa02ba6444b5a0acb5ffe699e2bc` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:38.927228 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69d062b-0821-481c-8f4e-7441730f4a0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7232aa02ba6444b5a0acb5ffe699e2bc)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:38.929259 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69d062b-0821-481c-8f4e-7441730f4a0f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:39.121074 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f69d062b-0821-481c-8f4e-7441730f4a0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7232aa02ba6444b5a0acb5ffe699e2bc', 'request_id': 'req-f69d062b-0821-481c-8f4e-7441730f4a0f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:39.127895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f69d062b-0821-481c-8f4e-7441730f4a0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7232aa02ba6444b5a0acb5ffe699e2bc', 'request_id': 'req-f69d062b-0821-481c-8f4e-7441730f4a0f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:39.140784 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f69d062b-0821-481c-8f4e-7441730f4a0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7232aa02ba6444b5a0acb5ffe699e2bc', 'request_id': 'req-f69d062b-0821-481c-8f4e-7441730f4a0f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:39.238384 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f69d062b-0821-481c-8f4e-7441730f4a0f admin admin] The token cache is being invalidate because project 7232aa02ba6444b5a0acb5ffe699e2bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:39:39.238738 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f69d062b-0821-481c-8f4e-7441730f4a0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:39.240817 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f69d062b-0821-481c-8f4e-7441730f4a0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:39.244850 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3749/7492] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:39:38 2022] DELETE /identity/v3/projects/7232aa02ba6444b5a0acb5ffe699e2bc => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:39:39.251791 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675788c-c7ff-4a37-a00e-c5ea157c518a None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:39.255129 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675788c-c7ff-4a37-a00e-c5ea157c518a None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:39.255129 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675788c-c7ff-4a37-a00e-c5ea157c518a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:39.286922 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-f675788c-c7ff-4a37-a00e-c5ea157c518a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:39:39.289159 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f675788c-c7ff-4a37-a00e-c5ea157c518a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:39.423922 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d062b-0821-481c-8f4e-7441730f4a0f admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:39.428021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f69d062b-0821-481c-8f4e-7441730f4a0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:39.458196 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3744/7493] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:39:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:39:39.461058 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c933d6a-8a87-41f6-80ad-8b20e3e01640 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:39.461532 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c933d6a-8a87-41f6-80ad-8b20e3e01640 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:39.462570 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c933d6a-8a87-41f6-80ad-8b20e3e01640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:39.488124 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d062b-0821-481c-8f4e-7441730f4a0f admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:39.508702 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35825a19-a8cd-4cc2-a971-eb73fd0e2bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:39.510689 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35825a19-a8cd-4cc2-a971-eb73fd0e2bb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:39.512158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35825a19-a8cd-4cc2-a971-eb73fd0e2bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:39.513015 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35825a19-a8cd-4cc2-a971-eb73fd0e2bb0 admin admin] PATH_INFO: `/v3/projects/fd10ab5932b44002aa3eea64dad5bf3d` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:39.519692 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35825a19-a8cd-4cc2-a971-eb73fd0e2bb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd10ab5932b44002aa3eea64dad5bf3d)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:39.519692 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35825a19-a8cd-4cc2-a971-eb73fd0e2bb0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:39.546344 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-0c933d6a-8a87-41f6-80ad-8b20e3e01640 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:39:39.552676 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0c933d6a-8a87-41f6-80ad-8b20e3e01640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:39.559594 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3745/7494] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:39:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:39:39.564322 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c933d6a-8a87-41f6-80ad-8b20e3e01640 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:39.575238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c933d6a-8a87-41f6-80ad-8b20e3e01640 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:39.580942 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fbf08-4bf3-4dd5-a428-56319e67a167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:39.581879 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fbf08-4bf3-4dd5-a428-56319e67a167 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:39.582336 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fbf08-4bf3-4dd5-a428-56319e67a167 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:39.587380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fbf08-4bf3-4dd5-a428-56319e67a167 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:39.587380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7fbf08-4bf3-4dd5-a428-56319e67a167 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:39:39.587380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7fbf08-4bf3-4dd5-a428-56319e67a167 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:39.589201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7fbf08-4bf3-4dd5-a428-56319e67a167 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:39.609440 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3746/7495] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:39:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:39:39.611047 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fbf08-4bf3-4dd5-a428-56319e67a167 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:39.622249 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fbf08-4bf3-4dd5-a428-56319e67a167 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:39.628252 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f062f7a-23e0-419e-83aa-fa4e07454ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:39.629290 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f062f7a-23e0-419e-83aa-fa4e07454ca4 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:39.630887 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f062f7a-23e0-419e-83aa-fa4e07454ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:39.631377 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f062f7a-23e0-419e-83aa-fa4e07454ca4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:39.632548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f062f7a-23e0-419e-83aa-fa4e07454ca4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:39.634791 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f062f7a-23e0-419e-83aa-fa4e07454ca4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:39.732870 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-35825a19-a8cd-4cc2-a971-eb73fd0e2bb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd10ab5932b44002aa3eea64dad5bf3d', 'request_id': 'req-35825a19-a8cd-4cc2-a971-eb73fd0e2bb0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:39.739164 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-35825a19-a8cd-4cc2-a971-eb73fd0e2bb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd10ab5932b44002aa3eea64dad5bf3d', 'request_id': 'req-35825a19-a8cd-4cc2-a971-eb73fd0e2bb0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:39.750849 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3747/7496] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:39:39 2022] POST /identity/v3/projects => generated 403 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:39:39.755693 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f062f7a-23e0-419e-83aa-fa4e07454ca4 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:39.756000 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-35825a19-a8cd-4cc2-a971-eb73fd0e2bb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd10ab5932b44002aa3eea64dad5bf3d', 'request_id': 'req-35825a19-a8cd-4cc2-a971-eb73fd0e2bb0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:39.862918 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f062f7a-23e0-419e-83aa-fa4e07454ca4 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:39.870417 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905024d7-69da-4c52-be58-4cae75de9e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:39.871988 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905024d7-69da-4c52-be58-4cae75de9e2a admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:39.872282 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905024d7-69da-4c52-be58-4cae75de9e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:39.872564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905024d7-69da-4c52-be58-4cae75de9e2a admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:39.873389 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905024d7-69da-4c52-be58-4cae75de9e2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:39.881062 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905024d7-69da-4c52-be58-4cae75de9e2a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:39.882370 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-35825a19-a8cd-4cc2-a971-eb73fd0e2bb0 admin admin] The token cache is being invalidate because project fd10ab5932b44002aa3eea64dad5bf3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:39:39.903827 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-35825a19-a8cd-4cc2-a971-eb73fd0e2bb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:39.903827 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-35825a19-a8cd-4cc2-a971-eb73fd0e2bb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:39.903827 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3750/7497] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:39:39 2022] DELETE /identity/v3/projects/fd10ab5932b44002aa3eea64dad5bf3d => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:39:40.036237 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3748/7498] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:39:39 2022] POST /identity/v3/users => generated 302 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:39:40.040774 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35825a19-a8cd-4cc2-a971-eb73fd0e2bb0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:40.042599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-35825a19-a8cd-4cc2-a971-eb73fd0e2bb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:40.208838 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35825a19-a8cd-4cc2-a971-eb73fd0e2bb0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:40.227056 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798047cf-49f5-4e35-b555-aefc4f327052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:40.227825 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798047cf-49f5-4e35-b555-aefc4f327052 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:40.228183 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798047cf-49f5-4e35-b555-aefc4f327052 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:40.228680 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798047cf-49f5-4e35-b555-aefc4f327052 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:40.229620 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798047cf-49f5-4e35-b555-aefc4f327052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:40.231319 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798047cf-49f5-4e35-b555-aefc4f327052 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:40.250326 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3751/7499] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:39:40.252152 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905024d7-69da-4c52-be58-4cae75de9e2a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:40.273590 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905024d7-69da-4c52-be58-4cae75de9e2a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:40.292532 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ea057-f964-4c9d-aa5e-56985307c152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:40.293232 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ea057-f964-4c9d-aa5e-56985307c152 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:40.293819 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ea057-f964-4c9d-aa5e-56985307c152 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:40.298360 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ea057-f964-4c9d-aa5e-56985307c152 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:40.299845 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139ea057-f964-4c9d-aa5e-56985307c152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:40.302661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139ea057-f964-4c9d-aa5e-56985307c152 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:40.329813 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3749/7500] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:39:40.331083 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798047cf-49f5-4e35-b555-aefc4f327052 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:40.345750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798047cf-49f5-4e35-b555-aefc4f327052 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:40.361198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8e8cb-f967-48f3-bc5a-2031c1f69617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:40.367150 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8e8cb-f967-48f3-bc5a-2031c1f69617 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:40.367150 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8e8cb-f967-48f3-bc5a-2031c1f69617 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:40.367150 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8e8cb-f967-48f3-bc5a-2031c1f69617 admin admin] PATH_INFO: `/v3/projects/3dfb4acb2ddd49c68d7809024ecceb18/users/7d28416af55f4c3089c7b7f741fdb22e/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:40.384833 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e8e8cb-f967-48f3-bc5a-2031c1f69617 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dfb4acb2ddd49c68d7809024ecceb18, user_id=7d28416af55f4c3089c7b7f741fdb22e, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:40.388395 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e8e8cb-f967-48f3-bc5a-2031c1f69617 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:40.517868 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3752/7501] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:39:40 2022] PUT /identity/v3/projects/3dfb4acb2ddd49c68d7809024ecceb18/users/7d28416af55f4c3089c7b7f741fdb22e/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:39:40.519236 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b195e-c76a-4c6f-bfce-399670560fce None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:40.519536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b195e-c76a-4c6f-bfce-399670560fce None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:40.519821 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b195e-c76a-4c6f-bfce-399670560fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:40.581829 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-9c1b195e-c76a-4c6f-bfce-399670560fce None None] MFA Rules not processed for user `7d28416af55f4c3089c7b7f741fdb22e`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:39:40.583394 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-9c1b195e-c76a-4c6f-bfce-399670560fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:40.707895 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3750/7502] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:39:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:39:40.724626 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8e8cb-f967-48f3-bc5a-2031c1f69617 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:40.835724 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8e8cb-f967-48f3-bc5a-2031c1f69617 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:40.842151 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96804cd-b224-4415-931d-0d0cb2840dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:40.843232 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96804cd-b224-4415-931d-0d0cb2840dbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:40.844631 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96804cd-b224-4415-931d-0d0cb2840dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:40.844631 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96804cd-b224-4415-931d-0d0cb2840dbf admin admin] PATH_INFO: `/v3/users/7d28416af55f4c3089c7b7f741fdb22e` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:40.845231 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96804cd-b224-4415-931d-0d0cb2840dbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d28416af55f4c3089c7b7f741fdb22e)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:40.851675 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96804cd-b224-4415-931d-0d0cb2840dbf admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:41.119732 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d96804cd-b224-4415-931d-0d0cb2840dbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d28416af55f4c3089c7b7f741fdb22e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:41.140112 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d96804cd-b224-4415-931d-0d0cb2840dbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d28416af55f4c3089c7b7f741fdb22e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:41.266804 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d96804cd-b224-4415-931d-0d0cb2840dbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d28416af55f4c3089c7b7f741fdb22e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:41.283025 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d96804cd-b224-4415-931d-0d0cb2840dbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d28416af55f4c3089c7b7f741fdb22e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:41.291421 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d96804cd-b224-4415-931d-0d0cb2840dbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d28416af55f4c3089c7b7f741fdb22e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:41.305568 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3753/7503] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:39:40 2022] DELETE /identity/v3/users/7d28416af55f4c3089c7b7f741fdb22e => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:39:41.309836 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07232b-69ba-400c-bd6f-2e9b2a569b59 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:41.310326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07232b-69ba-400c-bd6f-2e9b2a569b59 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:41.310950 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07232b-69ba-400c-bd6f-2e9b2a569b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:41.380943 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-dc07232b-69ba-400c-bd6f-2e9b2a569b59 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:39:41.382618 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-dc07232b-69ba-400c-bd6f-2e9b2a569b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:41.505516 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3751/7504] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:39:41.514352 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96804cd-b224-4415-931d-0d0cb2840dbf admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:41.515998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d96804cd-b224-4415-931d-0d0cb2840dbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:41.620960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96804cd-b224-4415-931d-0d0cb2840dbf admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:41.625094 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f7a46-5187-4186-a0a0-e82f68fa32bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:41.626308 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f7a46-5187-4186-a0a0-e82f68fa32bd service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:41.626699 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f7a46-5187-4186-a0a0-e82f68fa32bd service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:41.627200 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f7a46-5187-4186-a0a0-e82f68fa32bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:41.637725 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f7a46-5187-4186-a0a0-e82f68fa32bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:41.639556 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f7a46-5187-4186-a0a0-e82f68fa32bd service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:41.662960 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3754/7505] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:39:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:39:42.343596 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07232b-69ba-400c-bd6f-2e9b2a569b59 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:42.346852 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-dc07232b-69ba-400c-bd6f-2e9b2a569b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:42.358495 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f7a46-5187-4186-a0a0-e82f68fa32bd service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:42.360850 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8c8f7a46-5187-4186-a0a0-e82f68fa32bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:42.368273 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07232b-69ba-400c-bd6f-2e9b2a569b59 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:42.375330 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f9e92f-2e66-42ec-bd97-3de1e92c26ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:42.376464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9e92f-2e66-42ec-bd97-3de1e92c26ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:42.376928 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9e92f-2e66-42ec-bd97-3de1e92c26ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:42.377360 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9e92f-2e66-42ec-bd97-3de1e92c26ff admin admin] PATH_INFO: `/v3/projects/3dfb4acb2ddd49c68d7809024ecceb18` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:42.378842 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f7a46-5187-4186-a0a0-e82f68fa32bd service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:42.379127 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f9e92f-2e66-42ec-bd97-3de1e92c26ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dfb4acb2ddd49c68d7809024ecceb18)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:42.382247 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f9e92f-2e66-42ec-bd97-3de1e92c26ff admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:42.385950 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014b619-8829-4dcf-b151-abc77e875873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:42.386845 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014b619-8829-4dcf-b151-abc77e875873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:42.387131 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014b619-8829-4dcf-b151-abc77e875873 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:42.387421 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014b619-8829-4dcf-b151-abc77e875873 admin admin] PATH_INFO: `/v3/users/2e9643e1040a4d50bbf5324305b837b3` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:42.389092 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0014b619-8829-4dcf-b151-abc77e875873 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e9643e1040a4d50bbf5324305b837b3)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:42.391394 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0014b619-8829-4dcf-b151-abc77e875873 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:42.564927 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-19f9e92f-2e66-42ec-bd97-3de1e92c26ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dfb4acb2ddd49c68d7809024ecceb18', 'request_id': 'req-19f9e92f-2e66-42ec-bd97-3de1e92c26ff'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:42.572240 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-19f9e92f-2e66-42ec-bd97-3de1e92c26ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dfb4acb2ddd49c68d7809024ecceb18', 'request_id': 'req-19f9e92f-2e66-42ec-bd97-3de1e92c26ff'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:42.581702 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-19f9e92f-2e66-42ec-bd97-3de1e92c26ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dfb4acb2ddd49c68d7809024ecceb18', 'request_id': 'req-19f9e92f-2e66-42ec-bd97-3de1e92c26ff'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:42.674246 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-19f9e92f-2e66-42ec-bd97-3de1e92c26ff admin admin] The token cache is being invalidate because project 3dfb4acb2ddd49c68d7809024ecceb18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:39:42.674708 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-19f9e92f-2e66-42ec-bd97-3de1e92c26ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:42.675787 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-19f9e92f-2e66-42ec-bd97-3de1e92c26ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:42.679478 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3752/7506] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:39:42 2022] DELETE /identity/v3/projects/3dfb4acb2ddd49c68d7809024ecceb18 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:39:42.685564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5161430-57b8-477d-9847-183e54454cf1 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:42.685903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5161430-57b8-477d-9847-183e54454cf1 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:42.686192 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5161430-57b8-477d-9847-183e54454cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:42.710297 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-c5161430-57b8-477d-9847-183e54454cf1 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:39:42.711663 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c5161430-57b8-477d-9847-183e54454cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:42.769529 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0014b619-8829-4dcf-b151-abc77e875873 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e9643e1040a4d50bbf5324305b837b3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:42.792724 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0014b619-8829-4dcf-b151-abc77e875873 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e9643e1040a4d50bbf5324305b837b3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:42.827297 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3753/7507] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:39:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:39:42.837201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9027316-6efe-4adb-9fb4-0013f5a004d7 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:42.837561 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9027316-6efe-4adb-9fb4-0013f5a004d7 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:42.837793 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9027316-6efe-4adb-9fb4-0013f5a004d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:42.868772 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-e9027316-6efe-4adb-9fb4-0013f5a004d7 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:39:42.870395 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e9027316-6efe-4adb-9fb4-0013f5a004d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:42.872717 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0014b619-8829-4dcf-b151-abc77e875873 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e9643e1040a4d50bbf5324305b837b3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:42.880895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0014b619-8829-4dcf-b151-abc77e875873 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e9643e1040a4d50bbf5324305b837b3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:42.881852 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0014b619-8829-4dcf-b151-abc77e875873 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e9643e1040a4d50bbf5324305b837b3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:42.884178 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3754/7508] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:39:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:39:42.890704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9027316-6efe-4adb-9fb4-0013f5a004d7 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:42.893970 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3755/7509] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:39:42 2022] DELETE /identity/v3/users/2e9643e1040a4d50bbf5324305b837b3 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:39:42.901299 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9027316-6efe-4adb-9fb4-0013f5a004d7 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:42.986977 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28e2bf-7f23-435b-bb44-ca56cf1aa892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:42.987752 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28e2bf-7f23-435b-bb44-ca56cf1aa892 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:42.988035 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28e2bf-7f23-435b-bb44-ca56cf1aa892 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:42.988310 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28e2bf-7f23-435b-bb44-ca56cf1aa892 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:42.989946 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c28e2bf-7f23-435b-bb44-ca56cf1aa892 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:39:42.990255 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c28e2bf-7f23-435b-bb44-ca56cf1aa892 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:42.992184 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c28e2bf-7f23-435b-bb44-ca56cf1aa892 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:43.010169 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3755/7510] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:39:43.012427 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014b619-8829-4dcf-b151-abc77e875873 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:43.014411 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0014b619-8829-4dcf-b151-abc77e875873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:43.031804 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014b619-8829-4dcf-b151-abc77e875873 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:43.039550 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1457145-56b1-4f89-9fce-4d45b39a97fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:43.044203 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1457145-56b1-4f89-9fce-4d45b39a97fc admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:43.044203 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1457145-56b1-4f89-9fce-4d45b39a97fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:43.044203 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1457145-56b1-4f89-9fce-4d45b39a97fc admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:43.044203 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1457145-56b1-4f89-9fce-4d45b39a97fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:43.044203 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1457145-56b1-4f89-9fce-4d45b39a97fc admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:43.168597 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3756/7511] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:39:43 2022] POST /identity/v3/projects => generated 403 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:39:43.173921 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28e2bf-7f23-435b-bb44-ca56cf1aa892 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:43.194447 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28e2bf-7f23-435b-bb44-ca56cf1aa892 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:43.204575 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1457145-56b1-4f89-9fce-4d45b39a97fc admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:43.209064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d1457145-56b1-4f89-9fce-4d45b39a97fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:43.310916 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206f8a4-8034-4d59-ad1a-5526e9747934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:43.312115 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206f8a4-8034-4d59-ad1a-5526e9747934 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:43.312647 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206f8a4-8034-4d59-ad1a-5526e9747934 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:43.313175 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206f8a4-8034-4d59-ad1a-5526e9747934 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:43.314645 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206f8a4-8034-4d59-ad1a-5526e9747934 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:43.319601 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206f8a4-8034-4d59-ad1a-5526e9747934 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:43.360707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1457145-56b1-4f89-9fce-4d45b39a97fc admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:43.371403 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c426e8-3933-417a-813f-8d129a6ffccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:43.372821 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c426e8-3933-417a-813f-8d129a6ffccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:43.373329 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c426e8-3933-417a-813f-8d129a6ffccf admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:43.373929 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c426e8-3933-417a-813f-8d129a6ffccf admin admin] PATH_INFO: `/v3/projects/ba9fb98f26e1427e993c69d547641b64` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:43.376384 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c426e8-3933-417a-813f-8d129a6ffccf admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba9fb98f26e1427e993c69d547641b64)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:43.381182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c426e8-3933-417a-813f-8d129a6ffccf admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:43.449831 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3756/7512] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:39:43 2022] POST /identity/v3/users => generated 302 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:39:43.454413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206f8a4-8034-4d59-ad1a-5526e9747934 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:43.473077 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206f8a4-8034-4d59-ad1a-5526e9747934 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:43.482294 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19161c83-6c2a-4261-90aa-d2e069b202a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:43.483266 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19161c83-6c2a-4261-90aa-d2e069b202a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:43.483744 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19161c83-6c2a-4261-90aa-d2e069b202a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:43.484408 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19161c83-6c2a-4261-90aa-d2e069b202a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:43.485932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19161c83-6c2a-4261-90aa-d2e069b202a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:43.487657 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19161c83-6c2a-4261-90aa-d2e069b202a1 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:43.506166 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3757/7513] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:39:43.507218 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19161c83-6c2a-4261-90aa-d2e069b202a1 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:43.539144 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19161c83-6c2a-4261-90aa-d2e069b202a1 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:43.560333 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-14c426e8-3933-417a-813f-8d129a6ffccf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba9fb98f26e1427e993c69d547641b64', 'request_id': 'req-14c426e8-3933-417a-813f-8d129a6ffccf'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:43.574063 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-14c426e8-3933-417a-813f-8d129a6ffccf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba9fb98f26e1427e993c69d547641b64', 'request_id': 'req-14c426e8-3933-417a-813f-8d129a6ffccf'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:43.590583 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-14c426e8-3933-417a-813f-8d129a6ffccf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba9fb98f26e1427e993c69d547641b64', 'request_id': 'req-14c426e8-3933-417a-813f-8d129a6ffccf'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:43.639283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf482ff4-8ccc-4f6f-ae25-320a78e9c4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:43.640316 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf482ff4-8ccc-4f6f-ae25-320a78e9c4bc admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:43.640691 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf482ff4-8ccc-4f6f-ae25-320a78e9c4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:43.641133 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf482ff4-8ccc-4f6f-ae25-320a78e9c4bc admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:43.642357 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf482ff4-8ccc-4f6f-ae25-320a78e9c4bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:43.644647 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf482ff4-8ccc-4f6f-ae25-320a78e9c4bc admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:43.661698 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3758/7514] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:39:43.662740 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf482ff4-8ccc-4f6f-ae25-320a78e9c4bc admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:43.681907 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf482ff4-8ccc-4f6f-ae25-320a78e9c4bc admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:43.687292 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104bd487-9b49-4641-bda3-0beeab403c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:43.688205 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bd487-9b49-4641-bda3-0beeab403c42 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:43.688502 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bd487-9b49-4641-bda3-0beeab403c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:43.688887 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bd487-9b49-4641-bda3-0beeab403c42 admin admin] PATH_INFO: `/v3/projects/9f49399db95d439ba339227cc5f24e0d/users/09b358f55a53402aa504f4c25bdc46eb/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:43.689739 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-14c426e8-3933-417a-813f-8d129a6ffccf admin admin] The token cache is being invalidate because project ba9fb98f26e1427e993c69d547641b64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:39:43.690147 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-14c426e8-3933-417a-813f-8d129a6ffccf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:43.691004 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-14c426e8-3933-417a-813f-8d129a6ffccf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:43.703145 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3757/7515] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:39:43 2022] DELETE /identity/v3/projects/ba9fb98f26e1427e993c69d547641b64 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:39:43.706976 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c426e8-3933-417a-813f-8d129a6ffccf admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:43.709696 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-14c426e8-3933-417a-813f-8d129a6ffccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:43.714599 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104bd487-9b49-4641-bda3-0beeab403c42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f49399db95d439ba339227cc5f24e0d, user_id=09b358f55a53402aa504f4c25bdc46eb, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:43.717461 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104bd487-9b49-4641-bda3-0beeab403c42 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:43.729454 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c426e8-3933-417a-813f-8d129a6ffccf admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:43.741608 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc1a84-4ee1-4e34-8678-82e0fa22b313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:43.743943 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc1a84-4ee1-4e34-8678-82e0fa22b313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:43.744233 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc1a84-4ee1-4e34-8678-82e0fa22b313 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:43.744508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc1a84-4ee1-4e34-8678-82e0fa22b313 admin admin] PATH_INFO: `/v3/users/63e530f6508a49278b739cb38f6e59cd` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:43.745878 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc1a84-4ee1-4e34-8678-82e0fa22b313 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63e530f6508a49278b739cb38f6e59cd)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:43.747945 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc1a84-4ee1-4e34-8678-82e0fa22b313 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:43.810697 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3759/7516] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:39:43 2022] PUT /identity/v3/projects/9f49399db95d439ba339227cc5f24e0d/users/09b358f55a53402aa504f4c25bdc46eb/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:39:43.823674 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9223e-4ffe-4479-b3fe-2af5ea61cb3b None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:43.825276 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9223e-4ffe-4479-b3fe-2af5ea61cb3b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:43.825276 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9223e-4ffe-4479-b3fe-2af5ea61cb3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:43.854564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-57f9223e-4ffe-4479-b3fe-2af5ea61cb3b None None] MFA Rules not processed for user `09b358f55a53402aa504f4c25bdc46eb`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:39:43.855817 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-57f9223e-4ffe-4479-b3fe-2af5ea61cb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:43.955777 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3760/7517] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:39:43 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:39:43.961821 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f9223e-4ffe-4479-b3fe-2af5ea61cb3b None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:43.963226 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-57f9223e-4ffe-4479-b3fe-2af5ea61cb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:44.007281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cecc1a84-4ee1-4e34-8678-82e0fa22b313 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63e530f6508a49278b739cb38f6e59cd'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:44.022443 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cecc1a84-4ee1-4e34-8678-82e0fa22b313 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63e530f6508a49278b739cb38f6e59cd'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:44.060376 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f9223e-4ffe-4479-b3fe-2af5ea61cb3b None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:44.069112 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ecab6-4fc7-48bf-a0c9-149c4bd34e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:44.069826 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ecab6-4fc7-48bf-a0c9-149c4bd34e1b admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:44.070117 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ecab6-4fc7-48bf-a0c9-149c4bd34e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:44.070424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ecab6-4fc7-48bf-a0c9-149c4bd34e1b admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:44.071253 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ecab6-4fc7-48bf-a0c9-149c4bd34e1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:44.073227 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ecab6-4fc7-48bf-a0c9-149c4bd34e1b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:44.122467 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cecc1a84-4ee1-4e34-8678-82e0fa22b313 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63e530f6508a49278b739cb38f6e59cd'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:44.130060 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cecc1a84-4ee1-4e34-8678-82e0fa22b313 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63e530f6508a49278b739cb38f6e59cd'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:44.130768 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cecc1a84-4ee1-4e34-8678-82e0fa22b313 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63e530f6508a49278b739cb38f6e59cd'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:44.136980 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3758/7518] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:39:43 2022] DELETE /identity/v3/users/63e530f6508a49278b739cb38f6e59cd => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:39:44.214804 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3761/7519] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:39:43 2022] POST /identity/v3/projects => generated 403 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:39:44.217585 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc1a84-4ee1-4e34-8678-82e0fa22b313 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:44.219117 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-cecc1a84-4ee1-4e34-8678-82e0fa22b313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:44.316273 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc1a84-4ee1-4e34-8678-82e0fa22b313 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:44.390227 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f714745-241d-4998-bf39-b7c5a5efb24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:44.393280 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f714745-241d-4998-bf39-b7c5a5efb24b admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:44.393280 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f714745-241d-4998-bf39-b7c5a5efb24b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:44.393280 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f714745-241d-4998-bf39-b7c5a5efb24b admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:44.393280 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f714745-241d-4998-bf39-b7c5a5efb24b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:44.397606 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f714745-241d-4998-bf39-b7c5a5efb24b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:44.515591 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3759/7520] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:39:44 2022] POST /identity/v3/users => generated 308 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:39:44.517077 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ecab6-4fc7-48bf-a0c9-149c4bd34e1b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:44.529265 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ecab6-4fc7-48bf-a0c9-149c4bd34e1b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:44.534216 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b8807-11ee-452a-9b08-9adc2b78800d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:44.534935 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b8807-11ee-452a-9b08-9adc2b78800d admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:44.535308 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b8807-11ee-452a-9b08-9adc2b78800d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:44.535692 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b8807-11ee-452a-9b08-9adc2b78800d admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:44.536501 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572b8807-11ee-452a-9b08-9adc2b78800d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:44.538280 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572b8807-11ee-452a-9b08-9adc2b78800d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:44.551173 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3762/7521] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:39:44.557609 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f714745-241d-4998-bf39-b7c5a5efb24b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:44.571854 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f714745-241d-4998-bf39-b7c5a5efb24b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:44.581221 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae3ecc-1e0e-4487-868b-90bb2b11177a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:44.582550 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae3ecc-1e0e-4487-868b-90bb2b11177a admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:44.582882 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae3ecc-1e0e-4487-868b-90bb2b11177a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:44.583290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae3ecc-1e0e-4487-868b-90bb2b11177a admin admin] PATH_INFO: `/v3/projects/2e1eef29e03b4941b41b72609b78a45b/users/8c377b410ff64a2a96defa9917c13ab3/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:44.600618 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae3ecc-1e0e-4487-868b-90bb2b11177a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e1eef29e03b4941b41b72609b78a45b, user_id=8c377b410ff64a2a96defa9917c13ab3, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:44.604687 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae3ecc-1e0e-4487-868b-90bb2b11177a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:44.708120 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3760/7522] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:39:44 2022] PUT /identity/v3/projects/2e1eef29e03b4941b41b72609b78a45b/users/8c377b410ff64a2a96defa9917c13ab3/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:39:44.712607 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b8807-11ee-452a-9b08-9adc2b78800d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:44.724568 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b8807-11ee-452a-9b08-9adc2b78800d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:44.788962 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2a62b-dab4-495b-b1d1-0c4d2aecf3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:44.789567 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2a62b-dab4-495b-b1d1-0c4d2aecf3a9 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:44.789874 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2a62b-dab4-495b-b1d1-0c4d2aecf3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:44.790151 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2a62b-dab4-495b-b1d1-0c4d2aecf3a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:44.790874 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc2a62b-dab4-495b-b1d1-0c4d2aecf3a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:44.792502 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc2a62b-dab4-495b-b1d1-0c4d2aecf3a9 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:44.803373 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3763/7523] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:39:44.807768 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae3ecc-1e0e-4487-868b-90bb2b11177a admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:44.819834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae3ecc-1e0e-4487-868b-90bb2b11177a admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:44.825473 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee71446-4a9f-4a1d-8b1d-a7e7531bbb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:44.826576 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee71446-4a9f-4a1d-8b1d-a7e7531bbb38 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:44.827048 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee71446-4a9f-4a1d-8b1d-a7e7531bbb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:44.827396 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee71446-4a9f-4a1d-8b1d-a7e7531bbb38 admin admin] PATH_INFO: `/v3/projects/2e1eef29e03b4941b41b72609b78a45b/users/8c377b410ff64a2a96defa9917c13ab3/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:44.830447 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee71446-4a9f-4a1d-8b1d-a7e7531bbb38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e1eef29e03b4941b41b72609b78a45b, user_id=8c377b410ff64a2a96defa9917c13ab3, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:44.834001 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee71446-4a9f-4a1d-8b1d-a7e7531bbb38 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:44.846710 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3761/7524] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:39:44 2022] PUT /identity/v3/projects/2e1eef29e03b4941b41b72609b78a45b/users/8c377b410ff64a2a96defa9917c13ab3/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:39:44.858731 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb7dfe-10c8-42cf-b136-30d7f1ca84aa None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:44.859019 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb7dfe-10c8-42cf-b136-30d7f1ca84aa None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:44.863915 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb7dfe-10c8-42cf-b136-30d7f1ca84aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:44.887533 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-1eeb7dfe-10c8-42cf-b136-30d7f1ca84aa None None] MFA Rules not processed for user `8c377b410ff64a2a96defa9917c13ab3`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:39:44.888836 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1eeb7dfe-10c8-42cf-b136-30d7f1ca84aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:44.960915 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee71446-4a9f-4a1d-8b1d-a7e7531bbb38 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:44.962904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7ee71446-4a9f-4a1d-8b1d-a7e7531bbb38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:44.970239 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3764/7525] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:39:44 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:39:44.983766 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb7dfe-10c8-42cf-b136-30d7f1ca84aa None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:45.007108 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb7dfe-10c8-42cf-b136-30d7f1ca84aa None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:45.017056 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33071aa-53fc-4811-92c9-1e97611bf0c6 tempest-ApplicationCredentialsV3AdminTest-1563372430 tempest-ApplicationCredentialsV3AdminTest-1563372430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c377b410ff64a2a96defa9917c13ab3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1eef29e03b4941b41b72609b78a45b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:45.018394 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33071aa-53fc-4811-92c9-1e97611bf0c6 tempest-ApplicationCredentialsV3AdminTest-1563372430 tempest-ApplicationCredentialsV3AdminTest-1563372430-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:45.018885 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33071aa-53fc-4811-92c9-1e97611bf0c6 tempest-ApplicationCredentialsV3AdminTest-1563372430 tempest-ApplicationCredentialsV3AdminTest-1563372430-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:45.019640 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33071aa-53fc-4811-92c9-1e97611bf0c6 tempest-ApplicationCredentialsV3AdminTest-1563372430 tempest-ApplicationCredentialsV3AdminTest-1563372430-project-admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:45.021895 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33071aa-53fc-4811-92c9-1e97611bf0c6 tempest-ApplicationCredentialsV3AdminTest-1563372430 tempest-ApplicationCredentialsV3AdminTest-1563372430-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:45.024984 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33071aa-53fc-4811-92c9-1e97611bf0c6 tempest-ApplicationCredentialsV3AdminTest-1563372430 tempest-ApplicationCredentialsV3AdminTest-1563372430-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:45.082068 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee71446-4a9f-4a1d-8b1d-a7e7531bbb38 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:45.090410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edeeb16-9253-4950-a6eb-af8ba87e1761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:45.091293 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edeeb16-9253-4950-a6eb-af8ba87e1761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:45.091578 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edeeb16-9253-4950-a6eb-af8ba87e1761 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:45.091851 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edeeb16-9253-4950-a6eb-af8ba87e1761 admin admin] PATH_INFO: `/v3/projects/d4ba2120895d4daaa9a12af1a9fe0ece` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:45.093975 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edeeb16-9253-4950-a6eb-af8ba87e1761 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4ba2120895d4daaa9a12af1a9fe0ece)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:45.097596 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edeeb16-9253-4950-a6eb-af8ba87e1761 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:45.144420 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3765/7526] 10.222.0.23 () {60 vars in 1142 bytes} [Sat Apr 30 21:39:44 2022] POST /identity/v3/roles => generated 239 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:39:45.149212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33071aa-53fc-4811-92c9-1e97611bf0c6 tempest-ApplicationCredentialsV3AdminTest-1563372430 tempest-ApplicationCredentialsV3AdminTest-1563372430-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:45.161446 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33071aa-53fc-4811-92c9-1e97611bf0c6 tempest-ApplicationCredentialsV3AdminTest-1563372430 tempest-ApplicationCredentialsV3AdminTest-1563372430-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:45.169658 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e80c8-024e-4928-91db-03a800e68eb1 tempest-ApplicationCredentialsV3AdminTest-1563372430 tempest-ApplicationCredentialsV3AdminTest-1563372430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c377b410ff64a2a96defa9917c13ab3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1eef29e03b4941b41b72609b78a45b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:45.170891 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e80c8-024e-4928-91db-03a800e68eb1 tempest-ApplicationCredentialsV3AdminTest-1563372430 tempest-ApplicationCredentialsV3AdminTest-1563372430-project-admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:45.171280 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e80c8-024e-4928-91db-03a800e68eb1 tempest-ApplicationCredentialsV3AdminTest-1563372430 tempest-ApplicationCredentialsV3AdminTest-1563372430-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:45.171664 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e80c8-024e-4928-91db-03a800e68eb1 tempest-ApplicationCredentialsV3AdminTest-1563372430 tempest-ApplicationCredentialsV3AdminTest-1563372430-project-admin] PATH_INFO: `/v3/projects/9f49399db95d439ba339227cc5f24e0d/users/09b358f55a53402aa504f4c25bdc46eb/roles/4d8ffe0d208049cbabd24ab9f63eaa8b` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:45.175798 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4e80c8-024e-4928-91db-03a800e68eb1 tempest-ApplicationCredentialsV3AdminTest-1563372430 tempest-ApplicationCredentialsV3AdminTest-1563372430-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9f49399db95d439ba339227cc5f24e0d, user_id=09b358f55a53402aa504f4c25bdc46eb, role_id=4d8ffe0d208049cbabd24ab9f63eaa8b)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:45.180081 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4e80c8-024e-4928-91db-03a800e68eb1 tempest-ApplicationCredentialsV3AdminTest-1563372430 tempest-ApplicationCredentialsV3AdminTest-1563372430-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:45.291051 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3766/7527] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:39:45 2022] PUT /identity/v3/projects/9f49399db95d439ba339227cc5f24e0d/users/09b358f55a53402aa504f4c25bdc46eb/roles/4d8ffe0d208049cbabd24ab9f63eaa8b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:39:45.292105 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e80c8-024e-4928-91db-03a800e68eb1 tempest-ApplicationCredentialsV3AdminTest-1563372430 tempest-ApplicationCredentialsV3AdminTest-1563372430-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:45.295431 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6a4e80c8-024e-4928-91db-03a800e68eb1 tempest-ApplicationCredentialsV3AdminTest-1563372430 tempest-ApplicationCredentialsV3AdminTest-1563372430-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:45.297914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4edeeb16-9253-4950-a6eb-af8ba87e1761 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4ba2120895d4daaa9a12af1a9fe0ece', 'request_id': 'req-4edeeb16-9253-4950-a6eb-af8ba87e1761'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:45.304949 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4edeeb16-9253-4950-a6eb-af8ba87e1761 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4ba2120895d4daaa9a12af1a9fe0ece', 'request_id': 'req-4edeeb16-9253-4950-a6eb-af8ba87e1761'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:45.312073 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4edeeb16-9253-4950-a6eb-af8ba87e1761 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4ba2120895d4daaa9a12af1a9fe0ece', 'request_id': 'req-4edeeb16-9253-4950-a6eb-af8ba87e1761'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:45.384668 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e80c8-024e-4928-91db-03a800e68eb1 tempest-ApplicationCredentialsV3AdminTest-1563372430 tempest-ApplicationCredentialsV3AdminTest-1563372430-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:45.390330 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e57f3dc-d024-4547-94d1-9c5e58be2092 tempest-ApplicationCredentialsV3AdminTest-1181284548 tempest-ApplicationCredentialsV3AdminTest-1181284548-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09b358f55a53402aa504f4c25bdc46eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f49399db95d439ba339227cc5f24e0d', 'project_domain_id': 'default', 'roles': ['reader', 'tempest-test_role-750931681', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:45.391418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57f3dc-d024-4547-94d1-9c5e58be2092 tempest-ApplicationCredentialsV3AdminTest-1181284548 tempest-ApplicationCredentialsV3AdminTest-1181284548-project] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:45.391832 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57f3dc-d024-4547-94d1-9c5e58be2092 tempest-ApplicationCredentialsV3AdminTest-1181284548 tempest-ApplicationCredentialsV3AdminTest-1181284548-project] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:45.392179 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e57f3dc-d024-4547-94d1-9c5e58be2092 tempest-ApplicationCredentialsV3AdminTest-1181284548 tempest-ApplicationCredentialsV3AdminTest-1181284548-project] PATH_INFO: `/v3/users/09b358f55a53402aa504f4c25bdc46eb/application_credentials` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:45.393026 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e57f3dc-d024-4547-94d1-9c5e58be2092 tempest-ApplicationCredentialsV3AdminTest-1181284548 tempest-ApplicationCredentialsV3AdminTest-1181284548-project] RBAC: Authorizing `identity:create_application_credential(user_id=09b358f55a53402aa504f4c25bdc46eb)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:45.394821 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e57f3dc-d024-4547-94d1-9c5e58be2092 tempest-ApplicationCredentialsV3AdminTest-1181284548 tempest-ApplicationCredentialsV3AdminTest-1181284548-project] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:45.419753 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4edeeb16-9253-4950-a6eb-af8ba87e1761 admin admin] The token cache is being invalidate because project d4ba2120895d4daaa9a12af1a9fe0ece was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:39:45.420349 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4edeeb16-9253-4950-a6eb-af8ba87e1761 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:45.422368 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4edeeb16-9253-4950-a6eb-af8ba87e1761 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:45.427115 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3762/7528] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:39:44 2022] DELETE /identity/v3/projects/d4ba2120895d4daaa9a12af1a9fe0ece => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:39:45.432700 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26ac95-e6c3-4383-8fa6-8eaacea3c564 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:45.432896 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26ac95-e6c3-4383-8fa6-8eaacea3c564 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:45.433075 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26ac95-e6c3-4383-8fa6-8eaacea3c564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:45.459112 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-6e26ac95-e6c3-4383-8fa6-8eaacea3c564 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:39:45.460632 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6e26ac95-e6c3-4383-8fa6-8eaacea3c564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:45.567555 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3763/7529] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:39:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:39:45.575682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bbf82f-c8c3-4bff-bf98-50fdb8ae9a01 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:45.576183 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bbf82f-c8c3-4bff-bf98-50fdb8ae9a01 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:45.576670 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bbf82f-c8c3-4bff-bf98-50fdb8ae9a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:45.599817 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-98bbf82f-c8c3-4bff-bf98-50fdb8ae9a01 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:39:45.601125 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-98bbf82f-c8c3-4bff-bf98-50fdb8ae9a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:45.612714 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3764/7530] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:39:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:39:45.614833 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bbf82f-c8c3-4bff-bf98-50fdb8ae9a01 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:45.627052 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bbf82f-c8c3-4bff-bf98-50fdb8ae9a01 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:45.632847 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daac5c3-5c2a-4b89-9e71-c85111c023b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:45.633621 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daac5c3-5c2a-4b89-9e71-c85111c023b0 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:45.634028 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daac5c3-5c2a-4b89-9e71-c85111c023b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:45.634449 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daac5c3-5c2a-4b89-9e71-c85111c023b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:45.635404 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daac5c3-5c2a-4b89-9e71-c85111c023b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:39:45.635930 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daac5c3-5c2a-4b89-9e71-c85111c023b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:45.637648 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daac5c3-5c2a-4b89-9e71-c85111c023b0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:45.642485 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3767/7531] 10.222.0.23 () {60 vars in 1314 bytes} [Sat Apr 30 21:39:45 2022] POST /identity/v3/users/09b358f55a53402aa504f4c25bdc46eb/application_credentials => generated 659 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:39:45.644612 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13807b9f-1601-4e40-879a-a9c0b78e9878 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:45.644915 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13807b9f-1601-4e40-879a-a9c0b78e9878 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:45.645733 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13807b9f-1601-4e40-879a-a9c0b78e9878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:45.653894 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3765/7532] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:39:45.658029 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daac5c3-5c2a-4b89-9e71-c85111c023b0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:45.671095 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daac5c3-5c2a-4b89-9e71-c85111c023b0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:45.676989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-13807b9f-1601-4e40-879a-a9c0b78e9878 None None] MFA Rules not processed for user `09b358f55a53402aa504f4c25bdc46eb`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:39:45.678375 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f39f9-c941-4b70-b96e-1c6b59614fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:45.678536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-13807b9f-1601-4e40-879a-a9c0b78e9878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:45.679054 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f39f9-c941-4b70-b96e-1c6b59614fb5 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:45.679341 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f39f9-c941-4b70-b96e-1c6b59614fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:45.679785 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f39f9-c941-4b70-b96e-1c6b59614fb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:45.680491 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f39f9-c941-4b70-b96e-1c6b59614fb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:45.683294 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f39f9-c941-4b70-b96e-1c6b59614fb5 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:45.798449 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3768/7533] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:39:45 2022] POST /identity/v3/auth/tokens => generated 3386 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Apr 30 21:39:45.798677 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3766/7534] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:39:45 2022] POST /identity/v3/projects => generated 375 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:39:45.802746 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f39f9-c941-4b70-b96e-1c6b59614fb5 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:45.802906 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13807b9f-1601-4e40-879a-a9c0b78e9878 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:45.804435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c76f39f9-c941-4b70-b96e-1c6b59614fb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:45.871988 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f39f9-c941-4b70-b96e-1c6b59614fb5 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:45.872544 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13807b9f-1601-4e40-879a-a9c0b78e9878 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:45.878344 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbe954-510e-42c2-a304-c101caacf261 tempest-ApplicationCredentialsV3AdminTest-1181284548 tempest-ApplicationCredentialsV3AdminTest-1181284548-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09b358f55a53402aa504f4c25bdc46eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f49399db95d439ba339227cc5f24e0d', 'project_domain_id': 'default', 'roles': ['reader', 'tempest-test_role-750931681', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:45.878344 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbe954-510e-42c2-a304-c101caacf261 tempest-ApplicationCredentialsV3AdminTest-1181284548 tempest-ApplicationCredentialsV3AdminTest-1181284548-project] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:45.878344 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbe954-510e-42c2-a304-c101caacf261 tempest-ApplicationCredentialsV3AdminTest-1181284548 tempest-ApplicationCredentialsV3AdminTest-1181284548-project] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:45.878706 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbe954-510e-42c2-a304-c101caacf261 tempest-ApplicationCredentialsV3AdminTest-1181284548 tempest-ApplicationCredentialsV3AdminTest-1181284548-project] PATH_INFO: `/v3/users/09b358f55a53402aa504f4c25bdc46eb/application_credentials/e73a261a32a24ce885308dd9c874ecc0` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:45.882341 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dbe954-510e-42c2-a304-c101caacf261 tempest-ApplicationCredentialsV3AdminTest-1181284548 tempest-ApplicationCredentialsV3AdminTest-1181284548-project] RBAC: Authorizing `identity:delete_application_credential(user_id=09b358f55a53402aa504f4c25bdc46eb, application_credential_id=e73a261a32a24ce885308dd9c874ecc0)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:45.882341 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dbe954-510e-42c2-a304-c101caacf261 tempest-ApplicationCredentialsV3AdminTest-1181284548 tempest-ApplicationCredentialsV3AdminTest-1181284548-project] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:45.884803 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28caa165-a6f6-408d-b714-27a8f166f754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:45.886320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28caa165-a6f6-408d-b714-27a8f166f754 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:45.886930 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28caa165-a6f6-408d-b714-27a8f166f754 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:45.888236 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28caa165-a6f6-408d-b714-27a8f166f754 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:45.889541 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28caa165-a6f6-408d-b714-27a8f166f754 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:45.891937 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28caa165-a6f6-408d-b714-27a8f166f754 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:46.016424 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3767/7536] 10.222.0.23 () {58 vars in 1394 bytes} [Sat Apr 30 21:39:45 2022] DELETE /identity/v3/users/09b358f55a53402aa504f4c25bdc46eb/application_credentials/e73a261a32a24ce885308dd9c874ecc0 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:39:46.019261 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3769/7536] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:39:45 2022] POST /identity/v3/users => generated 288 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:39:46.020591 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbe954-510e-42c2-a304-c101caacf261 tempest-ApplicationCredentialsV3AdminTest-1181284548 tempest-ApplicationCredentialsV3AdminTest-1181284548-project] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:46.020736 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28caa165-a6f6-408d-b714-27a8f166f754 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:46.022743 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-28caa165-a6f6-408d-b714-27a8f166f754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:46.032083 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbe954-510e-42c2-a304-c101caacf261 tempest-ApplicationCredentialsV3AdminTest-1181284548 tempest-ApplicationCredentialsV3AdminTest-1181284548-project] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:46.037450 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c6c03-2f04-45e1-9fe0-463603aaf3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:46.038233 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c6c03-2f04-45e1-9fe0-463603aaf3d7 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:46.038572 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c6c03-2f04-45e1-9fe0-463603aaf3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:46.042602 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c6c03-2f04-45e1-9fe0-463603aaf3d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:46.042602 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c6c03-2f04-45e1-9fe0-463603aaf3d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:46.042602 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c6c03-2f04-45e1-9fe0-463603aaf3d7 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:46.053073 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3768/7537] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:39:46 2022] GET /identity/v3/roles => generated 1650 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:39:46.056885 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c6c03-2f04-45e1-9fe0-463603aaf3d7 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:46.066529 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c6c03-2f04-45e1-9fe0-463603aaf3d7 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:46.074595 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe434dc-84ff-43db-9116-323550481595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:46.074595 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe434dc-84ff-43db-9116-323550481595 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:46.074595 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe434dc-84ff-43db-9116-323550481595 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:46.074595 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe434dc-84ff-43db-9116-323550481595 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:46.075085 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe434dc-84ff-43db-9116-323550481595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:46.075085 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe434dc-84ff-43db-9116-323550481595 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:46.086097 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3769/7538] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:39:46 2022] GET /identity/v3/roles => generated 1650 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:39:46.089730 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe434dc-84ff-43db-9116-323550481595 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:46.091597 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28caa165-a6f6-408d-b714-27a8f166f754 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:46.096373 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3fb12-3338-46fc-b02a-c93b6d982174 tempest-ApplicationCredentialsV3AdminTest-1563372430 tempest-ApplicationCredentialsV3AdminTest-1563372430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c377b410ff64a2a96defa9917c13ab3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e1eef29e03b4941b41b72609b78a45b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:46.097295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3fb12-3338-46fc-b02a-c93b6d982174 tempest-ApplicationCredentialsV3AdminTest-1563372430 tempest-ApplicationCredentialsV3AdminTest-1563372430-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:46.097524 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3fb12-3338-46fc-b02a-c93b6d982174 tempest-ApplicationCredentialsV3AdminTest-1563372430 tempest-ApplicationCredentialsV3AdminTest-1563372430-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:46.097828 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3fb12-3338-46fc-b02a-c93b6d982174 tempest-ApplicationCredentialsV3AdminTest-1563372430 tempest-ApplicationCredentialsV3AdminTest-1563372430-project-admin] PATH_INFO: `/v3/roles/4d8ffe0d208049cbabd24ab9f63eaa8b` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:46.099985 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe3fb12-3338-46fc-b02a-c93b6d982174 tempest-ApplicationCredentialsV3AdminTest-1563372430 tempest-ApplicationCredentialsV3AdminTest-1563372430-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4d8ffe0d208049cbabd24ab9f63eaa8b)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:46.101343 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe434dc-84ff-43db-9116-323550481595 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:46.102392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe3fb12-3338-46fc-b02a-c93b6d982174 tempest-ApplicationCredentialsV3AdminTest-1563372430 tempest-ApplicationCredentialsV3AdminTest-1563372430-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:46.106287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef746667-01aa-499a-9c8d-1879b9abdf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:46.107162 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef746667-01aa-499a-9c8d-1879b9abdf95 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:46.107439 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef746667-01aa-499a-9c8d-1879b9abdf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:46.107715 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef746667-01aa-499a-9c8d-1879b9abdf95 admin admin] PATH_INFO: `/v3/projects/02c76e15fece44a9be2e1342513ae551/users/ee330c1468ae4085be6675b99c75c17c/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:46.124038 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef746667-01aa-499a-9c8d-1879b9abdf95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02c76e15fece44a9be2e1342513ae551, user_id=ee330c1468ae4085be6675b99c75c17c, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:46.125397 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef746667-01aa-499a-9c8d-1879b9abdf95 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:46.311717 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3770/7539] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:39:46 2022] PUT /identity/v3/projects/02c76e15fece44a9be2e1342513ae551/users/ee330c1468ae4085be6675b99c75c17c/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:39:46.316927 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862827ae-3123-439b-9905-33d774720972 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:46.317249 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862827ae-3123-439b-9905-33d774720972 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:46.317587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862827ae-3123-439b-9905-33d774720972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:46.335388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-862827ae-3123-439b-9905-33d774720972 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:39:46.336585 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-862827ae-3123-439b-9905-33d774720972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:46.358003 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ebe3fb12-3338-46fc-b02a-c93b6d982174 tempest-ApplicationCredentialsV3AdminTest-1563372430 tempest-ApplicationCredentialsV3AdminTest-1563372430-project-admin] Invalidating the token cache because role 4d8ffe0d208049cbabd24ab9f63eaa8b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:39:46.358287 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ebe3fb12-3338-46fc-b02a-c93b6d982174 tempest-ApplicationCredentialsV3AdminTest-1563372430 tempest-ApplicationCredentialsV3AdminTest-1563372430-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:46.358975 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ebe3fb12-3338-46fc-b02a-c93b6d982174 tempest-ApplicationCredentialsV3AdminTest-1563372430 tempest-ApplicationCredentialsV3AdminTest-1563372430-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:46.360983 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3770/7540] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:39:46 2022] DELETE /identity/v3/roles/4d8ffe0d208049cbabd24ab9f63eaa8b => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:39:46.366031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3fb12-3338-46fc-b02a-c93b6d982174 tempest-ApplicationCredentialsV3AdminTest-1563372430 tempest-ApplicationCredentialsV3AdminTest-1563372430-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:46.367383 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ebe3fb12-3338-46fc-b02a-c93b6d982174 tempest-ApplicationCredentialsV3AdminTest-1563372430 tempest-ApplicationCredentialsV3AdminTest-1563372430-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:46.399197 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3771/7541] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:39:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:39:46.409265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862827ae-3123-439b-9905-33d774720972 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:46.410388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-862827ae-3123-439b-9905-33d774720972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:46.435466 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3fb12-3338-46fc-b02a-c93b6d982174 tempest-ApplicationCredentialsV3AdminTest-1563372430 tempest-ApplicationCredentialsV3AdminTest-1563372430-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:46.440190 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de7fa26-5551-42a8-94ef-4c10a53ca863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:46.441064 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7fa26-5551-42a8-94ef-4c10a53ca863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:46.441348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7fa26-5551-42a8-94ef-4c10a53ca863 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:46.441623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7fa26-5551-42a8-94ef-4c10a53ca863 admin admin] PATH_INFO: `/v3/users/09b358f55a53402aa504f4c25bdc46eb` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:46.443486 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de7fa26-5551-42a8-94ef-4c10a53ca863 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09b358f55a53402aa504f4c25bdc46eb)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:46.445411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de7fa26-5551-42a8-94ef-4c10a53ca863 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:46.470332 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862827ae-3123-439b-9905-33d774720972 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:46.519181 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66189607-bbd3-4610-9b29-731c99137b64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:46.519858 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66189607-bbd3-4610-9b29-731c99137b64 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:46.520763 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66189607-bbd3-4610-9b29-731c99137b64 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:46.521085 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66189607-bbd3-4610-9b29-731c99137b64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:46.530350 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66189607-bbd3-4610-9b29-731c99137b64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:46.531785 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66189607-bbd3-4610-9b29-731c99137b64 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:46.541249 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3772/7542] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:39:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:39:46.640792 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-9de7fa26-5551-42a8-94ef-4c10a53ca863 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09b358f55a53402aa504f4c25bdc46eb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:46.655218 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-9de7fa26-5551-42a8-94ef-4c10a53ca863 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09b358f55a53402aa504f4c25bdc46eb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:46.786310 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-9de7fa26-5551-42a8-94ef-4c10a53ca863 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09b358f55a53402aa504f4c25bdc46eb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:46.787040 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-9de7fa26-5551-42a8-94ef-4c10a53ca863 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09b358f55a53402aa504f4c25bdc46eb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:46.796762 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-9de7fa26-5551-42a8-94ef-4c10a53ca863 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09b358f55a53402aa504f4c25bdc46eb'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:46.806135 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3771/7543] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:39:46 2022] DELETE /identity/v3/users/09b358f55a53402aa504f4c25bdc46eb => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:39:46.810576 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2158f-074b-4671-aa15-d49f23f4a6dc None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:46.810870 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2158f-074b-4671-aa15-d49f23f4a6dc None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:46.811152 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2158f-074b-4671-aa15-d49f23f4a6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:46.827814 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-09f2158f-074b-4671-aa15-d49f23f4a6dc None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:39:46.829046 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-09f2158f-074b-4671-aa15-d49f23f4a6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:46.887857 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3773/7544] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:39:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:39:46.899909 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de7fa26-5551-42a8-94ef-4c10a53ca863 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:46.899909 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-9de7fa26-5551-42a8-94ef-4c10a53ca863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:46.964030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de7fa26-5551-42a8-94ef-4c10a53ca863 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:46.967646 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8117cd-21f5-48ad-b40f-66d65eaf51df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:46.968314 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8117cd-21f5-48ad-b40f-66d65eaf51df service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:46.968592 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8117cd-21f5-48ad-b40f-66d65eaf51df service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:46.968865 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8117cd-21f5-48ad-b40f-66d65eaf51df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:46.978367 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8117cd-21f5-48ad-b40f-66d65eaf51df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:46.979838 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8117cd-21f5-48ad-b40f-66d65eaf51df service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:46.989269 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3772/7545] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:39:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:39:47.616567 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2158f-074b-4671-aa15-d49f23f4a6dc None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:47.622583 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-09f2158f-074b-4671-aa15-d49f23f4a6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:47.630890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2158f-074b-4671-aa15-d49f23f4a6dc None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:47.635576 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92256427-2d17-4f88-a5d1-3b6a19851a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:47.636491 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92256427-2d17-4f88-a5d1-3b6a19851a72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:47.636775 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92256427-2d17-4f88-a5d1-3b6a19851a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:47.637056 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92256427-2d17-4f88-a5d1-3b6a19851a72 admin admin] PATH_INFO: `/v3/projects/9f49399db95d439ba339227cc5f24e0d` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:47.638291 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92256427-2d17-4f88-a5d1-3b6a19851a72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f49399db95d439ba339227cc5f24e0d)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:47.640360 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92256427-2d17-4f88-a5d1-3b6a19851a72 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:47.778315 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-92256427-2d17-4f88-a5d1-3b6a19851a72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f49399db95d439ba339227cc5f24e0d', 'request_id': 'req-92256427-2d17-4f88-a5d1-3b6a19851a72'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:47.784278 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-92256427-2d17-4f88-a5d1-3b6a19851a72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f49399db95d439ba339227cc5f24e0d', 'request_id': 'req-92256427-2d17-4f88-a5d1-3b6a19851a72'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:47.790751 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-92256427-2d17-4f88-a5d1-3b6a19851a72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f49399db95d439ba339227cc5f24e0d', 'request_id': 'req-92256427-2d17-4f88-a5d1-3b6a19851a72'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:47.941970 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-92256427-2d17-4f88-a5d1-3b6a19851a72 admin admin] The token cache is being invalidate because project 9f49399db95d439ba339227cc5f24e0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:39:47.950424 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-92256427-2d17-4f88-a5d1-3b6a19851a72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:47.950424 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-92256427-2d17-4f88-a5d1-3b6a19851a72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:47.950424 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3774/7546] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:39:47 2022] DELETE /identity/v3/projects/9f49399db95d439ba339227cc5f24e0d => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:39:47.950733 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8117cd-21f5-48ad-b40f-66d65eaf51df service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:47.959577 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8117cd-21f5-48ad-b40f-66d65eaf51df service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:48.020217 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d6a74-e343-4978-8c7c-83930699239e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:48.021386 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d6a74-e343-4978-8c7c-83930699239e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:48.021694 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d6a74-e343-4978-8c7c-83930699239e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:48.022011 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d6a74-e343-4978-8c7c-83930699239e admin admin] PATH_INFO: `/v3/users/8c377b410ff64a2a96defa9917c13ab3` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:48.023564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d6a74-e343-4978-8c7c-83930699239e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c377b410ff64a2a96defa9917c13ab3)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:48.025527 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d6a74-e343-4978-8c7c-83930699239e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:48.206195 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e75d6a74-e343-4978-8c7c-83930699239e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c377b410ff64a2a96defa9917c13ab3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:48.219245 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e75d6a74-e343-4978-8c7c-83930699239e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c377b410ff64a2a96defa9917c13ab3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:48.369861 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e75d6a74-e343-4978-8c7c-83930699239e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c377b410ff64a2a96defa9917c13ab3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:48.373378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e75d6a74-e343-4978-8c7c-83930699239e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c377b410ff64a2a96defa9917c13ab3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:48.378783 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e75d6a74-e343-4978-8c7c-83930699239e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c377b410ff64a2a96defa9917c13ab3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:48.387277 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3773/7547] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:39:47 2022] DELETE /identity/v3/users/8c377b410ff64a2a96defa9917c13ab3 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:39:49.171801 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92256427-2d17-4f88-a5d1-3b6a19851a72 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:49.173395 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-92256427-2d17-4f88-a5d1-3b6a19851a72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:49.187538 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92256427-2d17-4f88-a5d1-3b6a19851a72 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:49.307373 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa68f18c-3eef-495c-ab6d-30ccc9ccc001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:49.308609 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68f18c-3eef-495c-ab6d-30ccc9ccc001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:49.308895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68f18c-3eef-495c-ab6d-30ccc9ccc001 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:49.309175 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68f18c-3eef-495c-ab6d-30ccc9ccc001 admin admin] PATH_INFO: `/v3/projects/2e1eef29e03b4941b41b72609b78a45b` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:49.310492 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa68f18c-3eef-495c-ab6d-30ccc9ccc001 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e1eef29e03b4941b41b72609b78a45b)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:49.312726 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa68f18c-3eef-495c-ab6d-30ccc9ccc001 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:49.411789 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-aa68f18c-3eef-495c-ab6d-30ccc9ccc001 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e1eef29e03b4941b41b72609b78a45b', 'request_id': 'req-aa68f18c-3eef-495c-ab6d-30ccc9ccc001'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:49.418109 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-aa68f18c-3eef-495c-ab6d-30ccc9ccc001 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e1eef29e03b4941b41b72609b78a45b', 'request_id': 'req-aa68f18c-3eef-495c-ab6d-30ccc9ccc001'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:49.425825 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-aa68f18c-3eef-495c-ab6d-30ccc9ccc001 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e1eef29e03b4941b41b72609b78a45b', 'request_id': 'req-aa68f18c-3eef-495c-ab6d-30ccc9ccc001'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:49.500562 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-aa68f18c-3eef-495c-ab6d-30ccc9ccc001 admin admin] The token cache is being invalidate because project 2e1eef29e03b4941b41b72609b78a45b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:39:49.500849 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-aa68f18c-3eef-495c-ab6d-30ccc9ccc001 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:49.501468 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-aa68f18c-3eef-495c-ab6d-30ccc9ccc001 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:49.503035 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3775/7548] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:39:49 2022] DELETE /identity/v3/projects/2e1eef29e03b4941b41b72609b78a45b => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:39:49.508573 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de709d-a3a4-4958-979c-6bfb3c1e20d2 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:49.509041 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de709d-a3a4-4958-979c-6bfb3c1e20d2 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:49.509148 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de709d-a3a4-4958-979c-6bfb3c1e20d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:49.528685 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-42de709d-a3a4-4958-979c-6bfb3c1e20d2 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:39:49.530170 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-42de709d-a3a4-4958-979c-6bfb3c1e20d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:49.591061 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3774/7549] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:39:49.600212 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512ffba-9809-404d-9cb3-a61f61a03716 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:49.600834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512ffba-9809-404d-9cb3-a61f61a03716 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:49.601200 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512ffba-9809-404d-9cb3-a61f61a03716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:49.621171 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-c512ffba-9809-404d-9cb3-a61f61a03716 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:39:49.622513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c512ffba-9809-404d-9cb3-a61f61a03716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:49.631787 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3776/7550] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:39:49.636317 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de709d-a3a4-4958-979c-6bfb3c1e20d2 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:49.647726 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de709d-a3a4-4958-979c-6bfb3c1e20d2 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:49.652596 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7821613-4e33-49cc-97ff-30f2d5f085c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:49.653569 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7821613-4e33-49cc-97ff-30f2d5f085c1 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:49.653916 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7821613-4e33-49cc-97ff-30f2d5f085c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:49.654199 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7821613-4e33-49cc-97ff-30f2d5f085c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:49.654927 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7821613-4e33-49cc-97ff-30f2d5f085c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:39:49.655235 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7821613-4e33-49cc-97ff-30f2d5f085c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:49.656890 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7821613-4e33-49cc-97ff-30f2d5f085c1 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:49.671127 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3775/7551] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:39:49.675702 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512ffba-9809-404d-9cb3-a61f61a03716 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:49.687349 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512ffba-9809-404d-9cb3-a61f61a03716 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:49.694272 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1f23e-d953-423b-bcea-0f04e39bc723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:49.695453 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1f23e-d953-423b-bcea-0f04e39bc723 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:49.695745 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1f23e-d953-423b-bcea-0f04e39bc723 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:49.696030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1f23e-d953-423b-bcea-0f04e39bc723 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:49.697226 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d1f23e-d953-423b-bcea-0f04e39bc723 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:49.699195 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d1f23e-d953-423b-bcea-0f04e39bc723 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:49.782993 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3777/7552] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:39:49 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:39:49.787369 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7821613-4e33-49cc-97ff-30f2d5f085c1 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:49.798541 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7821613-4e33-49cc-97ff-30f2d5f085c1 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:49.866871 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe444d-e43b-4901-a2c5-8980347d5e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:49.867586 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe444d-e43b-4901-a2c5-8980347d5e97 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:49.867879 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe444d-e43b-4901-a2c5-8980347d5e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:49.868160 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe444d-e43b-4901-a2c5-8980347d5e97 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:49.868857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe444d-e43b-4901-a2c5-8980347d5e97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:49.871152 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe444d-e43b-4901-a2c5-8980347d5e97 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:49.964839 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3776/7553] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:39:49 2022] POST /identity/v3/users => generated 288 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:39:49.966082 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1f23e-d953-423b-bcea-0f04e39bc723 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:49.986071 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1f23e-d953-423b-bcea-0f04e39bc723 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:49.986071 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e8c53-b85d-4207-8754-bb0d8aced092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:49.986071 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e8c53-b85d-4207-8754-bb0d8aced092 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:49.988783 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e8c53-b85d-4207-8754-bb0d8aced092 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:49.989100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e8c53-b85d-4207-8754-bb0d8aced092 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:49.994881 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e8c53-b85d-4207-8754-bb0d8aced092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:49.996796 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e8c53-b85d-4207-8754-bb0d8aced092 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:50.017167 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3778/7554] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:39:50.017496 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe444d-e43b-4901-a2c5-8980347d5e97 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:50.029477 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe444d-e43b-4901-a2c5-8980347d5e97 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:50.033720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43466c90-de36-4089-a4fb-b61433088e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:50.034517 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43466c90-de36-4089-a4fb-b61433088e79 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:50.034884 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43466c90-de36-4089-a4fb-b61433088e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:50.035181 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43466c90-de36-4089-a4fb-b61433088e79 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:50.036862 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43466c90-de36-4089-a4fb-b61433088e79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:50.038477 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43466c90-de36-4089-a4fb-b61433088e79 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:50.051336 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3777/7555] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:39:50.055455 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e8c53-b85d-4207-8754-bb0d8aced092 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:50.066355 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e8c53-b85d-4207-8754-bb0d8aced092 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:50.072024 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f2c52-88b9-4104-9d0c-09faa2d86f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:50.072953 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f2c52-88b9-4104-9d0c-09faa2d86f92 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:50.073238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f2c52-88b9-4104-9d0c-09faa2d86f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:50.073520 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f2c52-88b9-4104-9d0c-09faa2d86f92 admin admin] PATH_INFO: `/v3/projects/9e0a9d83cbe94f91adb9671f214de69e/users/375b057c81d0471bbd907d8914970ac9/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:50.091490 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f2c52-88b9-4104-9d0c-09faa2d86f92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e0a9d83cbe94f91adb9671f214de69e, user_id=375b057c81d0471bbd907d8914970ac9, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:50.094351 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f2c52-88b9-4104-9d0c-09faa2d86f92 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:50.190534 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3779/7556] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:39:50 2022] PUT /identity/v3/projects/9e0a9d83cbe94f91adb9671f214de69e/users/375b057c81d0471bbd907d8914970ac9/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:39:50.203814 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60439f4-d7a9-48bd-b759-fe01e87ccf06 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:50.204410 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60439f4-d7a9-48bd-b759-fe01e87ccf06 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:50.204866 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60439f4-d7a9-48bd-b759-fe01e87ccf06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:50.245994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-d60439f4-d7a9-48bd-b759-fe01e87ccf06 None None] MFA Rules not processed for user `375b057c81d0471bbd907d8914970ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:39:50.247404 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d60439f4-d7a9-48bd-b759-fe01e87ccf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:50.361320 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3778/7557] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:39:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:39:50.366303 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f2c52-88b9-4104-9d0c-09faa2d86f92 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:50.489192 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f2c52-88b9-4104-9d0c-09faa2d86f92 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:50.500959 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9250c6-3140-4674-b38a-8a3538102156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:50.502013 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9250c6-3140-4674-b38a-8a3538102156 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:50.502924 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9250c6-3140-4674-b38a-8a3538102156 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:50.503431 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9250c6-3140-4674-b38a-8a3538102156 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:50.504333 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9250c6-3140-4674-b38a-8a3538102156 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:50.521544 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9250c6-3140-4674-b38a-8a3538102156 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:50.664310 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3780/7558] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:39:50 2022] POST /identity/v3/projects => generated 375 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:39:50.670888 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60439f4-d7a9-48bd-b759-fe01e87ccf06 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:50.685583 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60439f4-d7a9-48bd-b759-fe01e87ccf06 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:50.770555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6e0f7-4bdc-4dcb-b7cc-0239ddb88f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:50.771732 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6e0f7-4bdc-4dcb-b7cc-0239ddb88f03 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:50.771732 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6e0f7-4bdc-4dcb-b7cc-0239ddb88f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:50.772470 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6e0f7-4bdc-4dcb-b7cc-0239ddb88f03 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:50.773523 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb6e0f7-4bdc-4dcb-b7cc-0239ddb88f03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:50.775360 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb6e0f7-4bdc-4dcb-b7cc-0239ddb88f03 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:50.886756 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3779/7559] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:39:50 2022] POST /identity/v3/users => generated 294 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:39:50.890752 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9250c6-3140-4674-b38a-8a3538102156 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:50.909129 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9250c6-3140-4674-b38a-8a3538102156 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:50.920440 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf10768-7005-4939-8711-bf1674cbb3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:50.921296 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf10768-7005-4939-8711-bf1674cbb3a3 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:50.921587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf10768-7005-4939-8711-bf1674cbb3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:50.921910 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf10768-7005-4939-8711-bf1674cbb3a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:50.922653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf10768-7005-4939-8711-bf1674cbb3a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:50.925044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf10768-7005-4939-8711-bf1674cbb3a3 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:50.943819 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3781/7560] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:39:50.944278 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6e0f7-4bdc-4dcb-b7cc-0239ddb88f03 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:50.955245 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6e0f7-4bdc-4dcb-b7cc-0239ddb88f03 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:50.961656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f201a3eb-cbf0-4f1a-b40c-d72e010027e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:50.962961 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201a3eb-cbf0-4f1a-b40c-d72e010027e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:50.963424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201a3eb-cbf0-4f1a-b40c-d72e010027e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:50.963958 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201a3eb-cbf0-4f1a-b40c-d72e010027e8 admin admin] PATH_INFO: `/v3/projects/869d4c20762445828c610cbc57d893a7/users/934911dcb1744abfae1389549085d780/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:50.985458 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f201a3eb-cbf0-4f1a-b40c-d72e010027e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=869d4c20762445828c610cbc57d893a7, user_id=934911dcb1744abfae1389549085d780, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:50.990948 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f201a3eb-cbf0-4f1a-b40c-d72e010027e8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:51.076105 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3780/7561] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:39:50 2022] PUT /identity/v3/projects/869d4c20762445828c610cbc57d893a7/users/934911dcb1744abfae1389549085d780/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:39:51.080207 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf10768-7005-4939-8711-bf1674cbb3a3 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:51.101702 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf10768-7005-4939-8711-bf1674cbb3a3 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:51.168555 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b68de-ce34-4943-bc12-b0c1662f98ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:51.169242 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b68de-ce34-4943-bc12-b0c1662f98ec admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:51.169530 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b68de-ce34-4943-bc12-b0c1662f98ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:51.169840 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b68de-ce34-4943-bc12-b0c1662f98ec admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:51.181145 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57b68de-ce34-4943-bc12-b0c1662f98ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:51.181145 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57b68de-ce34-4943-bc12-b0c1662f98ec admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:51.184911 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3782/7562] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:39:51.189108 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f201a3eb-cbf0-4f1a-b40c-d72e010027e8 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:51.212354 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f201a3eb-cbf0-4f1a-b40c-d72e010027e8 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:51.218713 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6a386-6f40-4192-9197-bb062135b4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:51.219847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6a386-6f40-4192-9197-bb062135b4ab admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:51.220277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6a386-6f40-4192-9197-bb062135b4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:51.220833 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6a386-6f40-4192-9197-bb062135b4ab admin admin] PATH_INFO: `/v3/projects/869d4c20762445828c610cbc57d893a7/users/934911dcb1744abfae1389549085d780/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:51.223080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6a386-6f40-4192-9197-bb062135b4ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=869d4c20762445828c610cbc57d893a7, user_id=934911dcb1744abfae1389549085d780, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:51.239739 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6a386-6f40-4192-9197-bb062135b4ab admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:51.302340 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3781/7563] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:39:51 2022] PUT /identity/v3/projects/869d4c20762445828c610cbc57d893a7/users/934911dcb1744abfae1389549085d780/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:39:51.305384 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4890398-9ebb-4e4e-b45f-080da87d9460 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:51.305864 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4890398-9ebb-4e4e-b45f-080da87d9460 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:51.306347 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4890398-9ebb-4e4e-b45f-080da87d9460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:51.342437 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-d4890398-9ebb-4e4e-b45f-080da87d9460 None None] MFA Rules not processed for user `934911dcb1744abfae1389549085d780`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:39:51.343986 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d4890398-9ebb-4e4e-b45f-080da87d9460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:51.452291 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3783/7564] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:39:51 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:39:51.452889 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6a386-6f40-4192-9197-bb062135b4ab admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:51.465720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6a386-6f40-4192-9197-bb062135b4ab admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:51.472362 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ca47d-ea80-4fb3-b9ac-e4fb793a3ad5 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '934911dcb1744abfae1389549085d780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869d4c20762445828c610cbc57d893a7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:51.473032 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ca47d-ea80-4fb3-b9ac-e4fb793a3ad5 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:51.474018 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ca47d-ea80-4fb3-b9ac-e4fb793a3ad5 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:51.474308 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ca47d-ea80-4fb3-b9ac-e4fb793a3ad5 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:51.475001 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ca47d-ea80-4fb3-b9ac-e4fb793a3ad5 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:51.476986 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ca47d-ea80-4fb3-b9ac-e4fb793a3ad5 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:51.560577 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3782/7565] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:39:51 2022] POST /identity/v3/projects => generated 334 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:39:51.564459 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4890398-9ebb-4e4e-b45f-080da87d9460 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:51.574024 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4890398-9ebb-4e4e-b45f-080da87d9460 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:51.635608 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f21b9-559f-45f4-a76c-6959c0e3766c tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '934911dcb1744abfae1389549085d780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869d4c20762445828c610cbc57d893a7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:51.636913 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f21b9-559f-45f4-a76c-6959c0e3766c tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:51.637204 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f21b9-559f-45f4-a76c-6959c0e3766c tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:51.637490 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f21b9-559f-45f4-a76c-6959c0e3766c tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:51.638203 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f21b9-559f-45f4-a76c-6959c0e3766c tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:51.640093 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f21b9-559f-45f4-a76c-6959c0e3766c tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:51.732374 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3784/7566] 10.222.0.23 () {60 vars in 1151 bytes} [Sat Apr 30 21:39:51 2022] POST /identity/v3/projects => generated 333 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:39:51.736506 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ca47d-ea80-4fb3-b9ac-e4fb793a3ad5 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:51.753172 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ca47d-ea80-4fb3-b9ac-e4fb793a3ad5 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:51.861295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f72001-a572-4d3f-a873-b87bd78e0e83 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '934911dcb1744abfae1389549085d780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869d4c20762445828c610cbc57d893a7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:51.862056 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f72001-a572-4d3f-a873-b87bd78e0e83 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:51.862503 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f72001-a572-4d3f-a873-b87bd78e0e83 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:51.862796 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f72001-a572-4d3f-a873-b87bd78e0e83 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:51.863503 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f72001-a572-4d3f-a873-b87bd78e0e83 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:51.867392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f72001-a572-4d3f-a873-b87bd78e0e83 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:51.991846 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3783/7567] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:39:51 2022] POST /identity/v3/projects => generated 357 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:39:51.996292 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f21b9-559f-45f4-a76c-6959c0e3766c tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:52.007706 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f21b9-559f-45f4-a76c-6959c0e3766c tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:52.083279 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4509633e-c80e-4ba0-ac8d-59e8f1a6d04f tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '934911dcb1744abfae1389549085d780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869d4c20762445828c610cbc57d893a7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:52.083671 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509633e-c80e-4ba0-ac8d-59e8f1a6d04f tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:52.083868 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509633e-c80e-4ba0-ac8d-59e8f1a6d04f tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:52.084142 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509633e-c80e-4ba0-ac8d-59e8f1a6d04f tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:52.084916 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4509633e-c80e-4ba0-ac8d-59e8f1a6d04f tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:52.087381 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4509633e-c80e-4ba0-ac8d-59e8f1a6d04f tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:52.113833 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3785/7568] 10.222.0.23 () {58 vars in 1130 bytes} [Sat Apr 30 21:39:51 2022] GET /identity/v3/projects => generated 6840 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:39:52.118669 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f72001-a572-4d3f-a873-b87bd78e0e83 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:52.130401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f72001-a572-4d3f-a873-b87bd78e0e83 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:52.140554 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6707fd-3bf7-48c3-b0bc-1cae44dae44e tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '934911dcb1744abfae1389549085d780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869d4c20762445828c610cbc57d893a7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:52.146497 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6707fd-3bf7-48c3-b0bc-1cae44dae44e tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:52.146497 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6707fd-3bf7-48c3-b0bc-1cae44dae44e tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:52.146497 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6707fd-3bf7-48c3-b0bc-1cae44dae44e tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:52.146497 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6707fd-3bf7-48c3-b0bc-1cae44dae44e tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:39:52.146497 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6707fd-3bf7-48c3-b0bc-1cae44dae44e tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:52.150022 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6707fd-3bf7-48c3-b0bc-1cae44dae44e tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:52.178910 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3784/7569] 10.222.0.23 () {58 vars in 1157 bytes} [Sat Apr 30 21:39:52 2022] GET /identity/v3/projects?enabled=False => generated 445 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:39:52.180754 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4509633e-c80e-4ba0-ac8d-59e8f1a6d04f tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:52.191730 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4509633e-c80e-4ba0-ac8d-59e8f1a6d04f tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:52.197620 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af29c6-c573-48b7-a6e7-234d9eead522 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '934911dcb1744abfae1389549085d780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869d4c20762445828c610cbc57d893a7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:52.199066 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af29c6-c573-48b7-a6e7-234d9eead522 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:52.199066 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af29c6-c573-48b7-a6e7-234d9eead522 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:52.199066 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af29c6-c573-48b7-a6e7-234d9eead522 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:52.200146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af29c6-c573-48b7-a6e7-234d9eead522 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] RBAC: Adding query filter params (parent_id=1cecff68509a419292ce053d542122ad) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:39:52.200531 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af29c6-c573-48b7-a6e7-234d9eead522 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:52.202801 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af29c6-c573-48b7-a6e7-234d9eead522 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:52.229747 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3786/7570] 10.222.0.23 () {58 vars in 1215 bytes} [Sat Apr 30 21:39:52 2022] GET /identity/v3/projects?parent_id=1cecff68509a419292ce053d542122ad => generated 497 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:39:52.234861 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6707fd-3bf7-48c3-b0bc-1cae44dae44e tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:52.247985 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6707fd-3bf7-48c3-b0bc-1cae44dae44e tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:52.253310 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c31bc5-a092-4a0b-8352-d9b3c47040a9 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '934911dcb1744abfae1389549085d780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869d4c20762445828c610cbc57d893a7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:52.255270 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c31bc5-a092-4a0b-8352-d9b3c47040a9 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:52.256695 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c31bc5-a092-4a0b-8352-d9b3c47040a9 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:52.256695 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c31bc5-a092-4a0b-8352-d9b3c47040a9 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] PATH_INFO: `/v3/projects/9c6e84417d05418dbc7b3178bc3573dc` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:52.257500 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c31bc5-a092-4a0b-8352-d9b3c47040a9 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9c6e84417d05418dbc7b3178bc3573dc)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:52.259637 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c31bc5-a092-4a0b-8352-d9b3c47040a9 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:52.454083 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-29c31bc5-a092-4a0b-8352-d9b3c47040a9 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c6e84417d05418dbc7b3178bc3573dc', 'request_id': 'req-29c31bc5-a092-4a0b-8352-d9b3c47040a9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:52.495204 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-29c31bc5-a092-4a0b-8352-d9b3c47040a9 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c6e84417d05418dbc7b3178bc3573dc', 'request_id': 'req-29c31bc5-a092-4a0b-8352-d9b3c47040a9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:52.508478 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-29c31bc5-a092-4a0b-8352-d9b3c47040a9 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c6e84417d05418dbc7b3178bc3573dc', 'request_id': 'req-29c31bc5-a092-4a0b-8352-d9b3c47040a9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:52.632668 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-29c31bc5-a092-4a0b-8352-d9b3c47040a9 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] The token cache is being invalidate because project 9c6e84417d05418dbc7b3178bc3573dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:39:52.633030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-29c31bc5-a092-4a0b-8352-d9b3c47040a9 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:52.633913 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-29c31bc5-a092-4a0b-8352-d9b3c47040a9 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:52.637800 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3785/7571] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:39:52 2022] DELETE /identity/v3/projects/9c6e84417d05418dbc7b3178bc3573dc => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:39:52.640877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af29c6-c573-48b7-a6e7-234d9eead522 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:52.643339 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-80af29c6-c573-48b7-a6e7-234d9eead522 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:52.665682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af29c6-c573-48b7-a6e7-234d9eead522 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:52.774934 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf7aaa-8d6f-4121-98e5-9b6db88ce5f3 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '934911dcb1744abfae1389549085d780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869d4c20762445828c610cbc57d893a7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:52.776392 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf7aaa-8d6f-4121-98e5-9b6db88ce5f3 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:52.776936 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf7aaa-8d6f-4121-98e5-9b6db88ce5f3 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:52.777598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf7aaa-8d6f-4121-98e5-9b6db88ce5f3 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] PATH_INFO: `/v3/projects/1cecff68509a419292ce053d542122ad` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:52.779224 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf7aaa-8d6f-4121-98e5-9b6db88ce5f3 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1cecff68509a419292ce053d542122ad)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:52.781923 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf7aaa-8d6f-4121-98e5-9b6db88ce5f3 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:52.924463 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-09bf7aaa-8d6f-4121-98e5-9b6db88ce5f3 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cecff68509a419292ce053d542122ad', 'request_id': 'req-09bf7aaa-8d6f-4121-98e5-9b6db88ce5f3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:52.932650 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-09bf7aaa-8d6f-4121-98e5-9b6db88ce5f3 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cecff68509a419292ce053d542122ad', 'request_id': 'req-09bf7aaa-8d6f-4121-98e5-9b6db88ce5f3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:52.940660 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-09bf7aaa-8d6f-4121-98e5-9b6db88ce5f3 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cecff68509a419292ce053d542122ad', 'request_id': 'req-09bf7aaa-8d6f-4121-98e5-9b6db88ce5f3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:53.055902 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-09bf7aaa-8d6f-4121-98e5-9b6db88ce5f3 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] The token cache is being invalidate because project 1cecff68509a419292ce053d542122ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:39:53.056462 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-09bf7aaa-8d6f-4121-98e5-9b6db88ce5f3 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:53.057510 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-09bf7aaa-8d6f-4121-98e5-9b6db88ce5f3 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:53.061627 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3787/7572] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:39:52 2022] DELETE /identity/v3/projects/1cecff68509a419292ce053d542122ad => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:39:53.065232 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c31bc5-a092-4a0b-8352-d9b3c47040a9 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:53.085166 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c31bc5-a092-4a0b-8352-d9b3c47040a9 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:53.215909 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2077c-c3d6-4444-929b-d319e75cae47 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '934911dcb1744abfae1389549085d780', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '869d4c20762445828c610cbc57d893a7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:53.217668 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2077c-c3d6-4444-929b-d319e75cae47 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:53.218153 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2077c-c3d6-4444-929b-d319e75cae47 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:53.218962 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2077c-c3d6-4444-929b-d319e75cae47 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] PATH_INFO: `/v3/projects/f47b4935f97f40819c3d184b54f5547c` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:53.220926 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc2077c-c3d6-4444-929b-d319e75cae47 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f47b4935f97f40819c3d184b54f5547c)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:53.223943 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc2077c-c3d6-4444-929b-d319e75cae47 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:53.260129 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705be4a-7f3d-4539-b3cd-6b3ab5072d29 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:53.260449 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705be4a-7f3d-4539-b3cd-6b3ab5072d29 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:53.260734 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705be4a-7f3d-4539-b3cd-6b3ab5072d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:53.299305 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-5705be4a-7f3d-4539-b3cd-6b3ab5072d29 None None] MFA Rules not processed for user `ee330c1468ae4085be6675b99c75c17c`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:39:53.301252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5705be4a-7f3d-4539-b3cd-6b3ab5072d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:53.370404 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7fc2077c-c3d6-4444-929b-d319e75cae47 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f47b4935f97f40819c3d184b54f5547c', 'request_id': 'req-7fc2077c-c3d6-4444-929b-d319e75cae47'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:53.380995 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7fc2077c-c3d6-4444-929b-d319e75cae47 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f47b4935f97f40819c3d184b54f5547c', 'request_id': 'req-7fc2077c-c3d6-4444-929b-d319e75cae47'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:53.390736 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7fc2077c-c3d6-4444-929b-d319e75cae47 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f47b4935f97f40819c3d184b54f5547c', 'request_id': 'req-7fc2077c-c3d6-4444-929b-d319e75cae47'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:53.400649 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3788/7573] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:39:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:39:53.404850 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5705be4a-7f3d-4539-b3cd-6b3ab5072d29 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:53.406357 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5705be4a-7f3d-4539-b3cd-6b3ab5072d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:53.471181 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5705be4a-7f3d-4539-b3cd-6b3ab5072d29 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:53.488820 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7fc2077c-c3d6-4444-929b-d319e75cae47 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] The token cache is being invalidate because project f47b4935f97f40819c3d184b54f5547c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:39:53.489108 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7fc2077c-c3d6-4444-929b-d319e75cae47 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:53.489692 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7fc2077c-c3d6-4444-929b-d319e75cae47 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:53.491330 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3786/7574] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:39:53 2022] DELETE /identity/v3/projects/f47b4935f97f40819c3d184b54f5547c => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:39:53.495417 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2077c-c3d6-4444-929b-d319e75cae47 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:53.497004 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7fc2077c-c3d6-4444-929b-d319e75cae47 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:53.531766 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322746d7-8b77-49e8-8f35-2889a1e89779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:53.532366 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322746d7-8b77-49e8-8f35-2889a1e89779 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:53.532717 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322746d7-8b77-49e8-8f35-2889a1e89779 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:53.533247 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322746d7-8b77-49e8-8f35-2889a1e89779 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:53.534007 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322746d7-8b77-49e8-8f35-2889a1e89779 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:53.535986 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322746d7-8b77-49e8-8f35-2889a1e89779 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:53.571523 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2077c-c3d6-4444-929b-d319e75cae47 tempest-ListProjectsTestJSON-193341872 tempest-ListProjectsTestJSON-193341872-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:53.576205 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b08d1d-76b2-4b71-9b9d-2d4df0d81bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:53.577075 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b08d1d-76b2-4b71-9b9d-2d4df0d81bd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:53.577360 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b08d1d-76b2-4b71-9b9d-2d4df0d81bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:53.577641 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b08d1d-76b2-4b71-9b9d-2d4df0d81bd5 admin admin] PATH_INFO: `/v3/users/375b057c81d0471bbd907d8914970ac9` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:53.578871 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b08d1d-76b2-4b71-9b9d-2d4df0d81bd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=375b057c81d0471bbd907d8914970ac9)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:53.580806 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b08d1d-76b2-4b71-9b9d-2d4df0d81bd5 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:53.631917 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3789/7575] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:39:53 2022] POST /identity/v3/projects => generated 373 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:39:53.633424 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322746d7-8b77-49e8-8f35-2889a1e89779 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:53.635499 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-322746d7-8b77-49e8-8f35-2889a1e89779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:53.713897 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322746d7-8b77-49e8-8f35-2889a1e89779 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:53.718903 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd91bc-2fd6-465a-9d90-66234bc93193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:53.719580 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd91bc-2fd6-465a-9d90-66234bc93193 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:53.731281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd91bc-2fd6-465a-9d90-66234bc93193 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:53.731281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd91bc-2fd6-465a-9d90-66234bc93193 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:53.731281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd91bc-2fd6-465a-9d90-66234bc93193 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:53.731281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd91bc-2fd6-465a-9d90-66234bc93193 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:53.764515 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-93b08d1d-76b2-4b71-9b9d-2d4df0d81bd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '375b057c81d0471bbd907d8914970ac9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:53.780209 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-93b08d1d-76b2-4b71-9b9d-2d4df0d81bd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '375b057c81d0471bbd907d8914970ac9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:53.816150 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3790/7576] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:39:53 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:39:53.822320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd91bc-2fd6-465a-9d90-66234bc93193 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:53.834209 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd91bc-2fd6-465a-9d90-66234bc93193 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:53.840382 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0bf06-5da0-4686-8aaa-0000afa1b289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:53.840382 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0bf06-5da0-4686-8aaa-0000afa1b289 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:53.840382 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0bf06-5da0-4686-8aaa-0000afa1b289 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:53.840761 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0bf06-5da0-4686-8aaa-0000afa1b289 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:53.841170 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c0bf06-5da0-4686-8aaa-0000afa1b289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:53.842851 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c0bf06-5da0-4686-8aaa-0000afa1b289 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:53.853708 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3791/7577] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:39:53.857681 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0bf06-5da0-4686-8aaa-0000afa1b289 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:53.860137 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-93b08d1d-76b2-4b71-9b9d-2d4df0d81bd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '375b057c81d0471bbd907d8914970ac9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:53.860833 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-93b08d1d-76b2-4b71-9b9d-2d4df0d81bd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '375b057c81d0471bbd907d8914970ac9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:53.869111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-93b08d1d-76b2-4b71-9b9d-2d4df0d81bd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '375b057c81d0471bbd907d8914970ac9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:53.870581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0bf06-5da0-4686-8aaa-0000afa1b289 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:53.876768 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3787/7578] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:39:53 2022] DELETE /identity/v3/users/375b057c81d0471bbd907d8914970ac9 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:39:53.881918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1dfbae-d61c-498c-a912-a0c1c4ceb92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:53.881918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1dfbae-d61c-498c-a912-a0c1c4ceb92e admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:53.881918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1dfbae-d61c-498c-a912-a0c1c4ceb92e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:53.881918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1dfbae-d61c-498c-a912-a0c1c4ceb92e admin admin] PATH_INFO: `/v3/projects/af2dd6efb5894815bdd924b6dc6a5426/users/c8667af135e44ce897538df8d12982b5/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:53.884065 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9e374-d4fc-493f-b2cb-7910fa620097 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:53.884491 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9e374-d4fc-493f-b2cb-7910fa620097 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:53.884873 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9e374-d4fc-493f-b2cb-7910fa620097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:53.895949 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1dfbae-d61c-498c-a912-a0c1c4ceb92e admin admin] RBAC: Authorizing `identity:create_grant(project_id=af2dd6efb5894815bdd924b6dc6a5426, user_id=c8667af135e44ce897538df8d12982b5, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:53.899105 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1dfbae-d61c-498c-a912-a0c1c4ceb92e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:53.919392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-3ea9e374-d4fc-493f-b2cb-7910fa620097 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:39:53.920724 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3ea9e374-d4fc-493f-b2cb-7910fa620097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:53.969563 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3792/7579] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:39:53 2022] PUT /identity/v3/projects/af2dd6efb5894815bdd924b6dc6a5426/users/c8667af135e44ce897538df8d12982b5/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:39:53.974091 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1dfbae-d61c-498c-a912-a0c1c4ceb92e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:53.975880 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2a1dfbae-d61c-498c-a912-a0c1c4ceb92e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:53.997485 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3788/7580] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:39:54.029360 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9e374-d4fc-493f-b2cb-7910fa620097 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:54.033939 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3ea9e374-d4fc-493f-b2cb-7910fa620097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:54.052516 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1dfbae-d61c-498c-a912-a0c1c4ceb92e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:54.057611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43137dd-99ae-4c7b-87f2-444d3bb1f84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:54.058385 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43137dd-99ae-4c7b-87f2-444d3bb1f84d admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:54.058737 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43137dd-99ae-4c7b-87f2-444d3bb1f84d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:54.059082 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43137dd-99ae-4c7b-87f2-444d3bb1f84d admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:54.059886 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43137dd-99ae-4c7b-87f2-444d3bb1f84d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:54.061707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43137dd-99ae-4c7b-87f2-444d3bb1f84d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:54.072526 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3793/7581] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:39:54.077580 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43137dd-99ae-4c7b-87f2-444d3bb1f84d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:54.087956 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43137dd-99ae-4c7b-87f2-444d3bb1f84d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:54.095590 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e6cfd-46c9-465f-acd2-cc5f937005cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:54.098931 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e6cfd-46c9-465f-acd2-cc5f937005cd admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:54.098931 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e6cfd-46c9-465f-acd2-cc5f937005cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:54.098931 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e6cfd-46c9-465f-acd2-cc5f937005cd admin admin] PATH_INFO: `/v3/projects/af2dd6efb5894815bdd924b6dc6a5426/users/c8667af135e44ce897538df8d12982b5/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:54.100094 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e6cfd-46c9-465f-acd2-cc5f937005cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=af2dd6efb5894815bdd924b6dc6a5426, user_id=c8667af135e44ce897538df8d12982b5, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:54.105454 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e6cfd-46c9-465f-acd2-cc5f937005cd admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:54.118459 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3794/7582] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:39:54 2022] PUT /identity/v3/projects/af2dd6efb5894815bdd924b6dc6a5426/users/c8667af135e44ce897538df8d12982b5/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:39:54.131973 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9e374-d4fc-493f-b2cb-7910fa620097 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:54.196121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1fac3-3115-4ba0-a502-6723a52fea2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:54.196781 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1fac3-3115-4ba0-a502-6723a52fea2a service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:54.197328 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1fac3-3115-4ba0-a502-6723a52fea2a service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:54.197829 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1fac3-3115-4ba0-a502-6723a52fea2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:54.267435 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa1fac3-3115-4ba0-a502-6723a52fea2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:54.274917 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa1fac3-3115-4ba0-a502-6723a52fea2a service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:54.303541 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3789/7583] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:39:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:39:55.019770 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e6cfd-46c9-465f-acd2-cc5f937005cd admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:55.021625 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-319e6cfd-46c9-465f-acd2-cc5f937005cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:55.037030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e6cfd-46c9-465f-acd2-cc5f937005cd admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:55.048225 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc99ccd-365d-426a-b648-4a85c05e5b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:55.049366 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc99ccd-365d-426a-b648-4a85c05e5b36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:55.049969 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc99ccd-365d-426a-b648-4a85c05e5b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:55.050520 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc99ccd-365d-426a-b648-4a85c05e5b36 admin admin] PATH_INFO: `/v3/projects/9e0a9d83cbe94f91adb9671f214de69e` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:55.052763 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc99ccd-365d-426a-b648-4a85c05e5b36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e0a9d83cbe94f91adb9671f214de69e)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:55.054872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc99ccd-365d-426a-b648-4a85c05e5b36 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:55.214812 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3dc99ccd-365d-426a-b648-4a85c05e5b36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e0a9d83cbe94f91adb9671f214de69e', 'request_id': 'req-3dc99ccd-365d-426a-b648-4a85c05e5b36'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:55.232708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3dc99ccd-365d-426a-b648-4a85c05e5b36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e0a9d83cbe94f91adb9671f214de69e', 'request_id': 'req-3dc99ccd-365d-426a-b648-4a85c05e5b36'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:55.243746 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3dc99ccd-365d-426a-b648-4a85c05e5b36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e0a9d83cbe94f91adb9671f214de69e', 'request_id': 'req-3dc99ccd-365d-426a-b648-4a85c05e5b36'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:55.375847 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3dc99ccd-365d-426a-b648-4a85c05e5b36 admin admin] The token cache is being invalidate because project 9e0a9d83cbe94f91adb9671f214de69e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:39:55.376135 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3dc99ccd-365d-426a-b648-4a85c05e5b36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:55.376781 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3dc99ccd-365d-426a-b648-4a85c05e5b36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:55.378582 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3795/7584] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:39:55 2022] DELETE /identity/v3/projects/9e0a9d83cbe94f91adb9671f214de69e => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:39:55.382906 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1fac3-3115-4ba0-a502-6723a52fea2a service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:55.393395 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1fac3-3115-4ba0-a502-6723a52fea2a service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:55.501321 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fcd378-4609-466c-87a4-4c506e719688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:55.502430 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcd378-4609-466c-87a4-4c506e719688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:55.502830 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcd378-4609-466c-87a4-4c506e719688 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:55.503209 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcd378-4609-466c-87a4-4c506e719688 admin admin] PATH_INFO: `/v3/users/934911dcb1744abfae1389549085d780` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:55.506076 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fcd378-4609-466c-87a4-4c506e719688 admin admin] RBAC: Authorizing `identity:delete_user(user_id=934911dcb1744abfae1389549085d780)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:55.508342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fcd378-4609-466c-87a4-4c506e719688 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:55.760847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-54fcd378-4609-466c-87a4-4c506e719688 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '934911dcb1744abfae1389549085d780'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:55.773678 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-54fcd378-4609-466c-87a4-4c506e719688 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '934911dcb1744abfae1389549085d780'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:55.855828 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-54fcd378-4609-466c-87a4-4c506e719688 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '934911dcb1744abfae1389549085d780'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:55.856475 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-54fcd378-4609-466c-87a4-4c506e719688 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '934911dcb1744abfae1389549085d780'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:55.866101 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-54fcd378-4609-466c-87a4-4c506e719688 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '934911dcb1744abfae1389549085d780'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:55.876467 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3790/7585] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:39:55 2022] DELETE /identity/v3/users/934911dcb1744abfae1389549085d780 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:39:56.460864 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc99ccd-365d-426a-b648-4a85c05e5b36 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:56.462577 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3dc99ccd-365d-426a-b648-4a85c05e5b36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:56.489922 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc99ccd-365d-426a-b648-4a85c05e5b36 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:56.556807 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8236b-6803-4755-9da2-631f259d3143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:56.560582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8236b-6803-4755-9da2-631f259d3143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:56.560582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8236b-6803-4755-9da2-631f259d3143 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:56.560582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8236b-6803-4755-9da2-631f259d3143 admin admin] PATH_INFO: `/v3/projects/869d4c20762445828c610cbc57d893a7` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:56.560582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8236b-6803-4755-9da2-631f259d3143 admin admin] RBAC: Authorizing `identity:delete_project(project_id=869d4c20762445828c610cbc57d893a7)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:56.561749 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8236b-6803-4755-9da2-631f259d3143 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:56.709863 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3ff8236b-6803-4755-9da2-631f259d3143 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '869d4c20762445828c610cbc57d893a7', 'request_id': 'req-3ff8236b-6803-4755-9da2-631f259d3143'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:56.715151 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3ff8236b-6803-4755-9da2-631f259d3143 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '869d4c20762445828c610cbc57d893a7', 'request_id': 'req-3ff8236b-6803-4755-9da2-631f259d3143'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:56.722866 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3ff8236b-6803-4755-9da2-631f259d3143 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '869d4c20762445828c610cbc57d893a7', 'request_id': 'req-3ff8236b-6803-4755-9da2-631f259d3143'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:56.848634 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3ff8236b-6803-4755-9da2-631f259d3143 admin admin] The token cache is being invalidate because project 869d4c20762445828c610cbc57d893a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:39:56.848927 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3ff8236b-6803-4755-9da2-631f259d3143 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:56.858306 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3ff8236b-6803-4755-9da2-631f259d3143 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:39:56.860079 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3796/7586] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:39:56 2022] DELETE /identity/v3/projects/869d4c20762445828c610cbc57d893a7 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:39:56.866402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f0b5a-e7fc-43a5-ae49-026d2310be06 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:56.867885 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f0b5a-e7fc-43a5-ae49-026d2310be06 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:56.868518 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f0b5a-e7fc-43a5-ae49-026d2310be06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:56.909976 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-826f0b5a-e7fc-43a5-ae49-026d2310be06 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:39:56.911563 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-826f0b5a-e7fc-43a5-ae49-026d2310be06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:56.999114 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3791/7587] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:39:57.007235 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fcfdc-78eb-4953-8681-2764fd4c8089 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:57.007584 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fcfdc-78eb-4953-8681-2764fd4c8089 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:57.008059 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fcfdc-78eb-4953-8681-2764fd4c8089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:57.028486 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-b33fcfdc-78eb-4953-8681-2764fd4c8089 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:39:57.029937 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b33fcfdc-78eb-4953-8681-2764fd4c8089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:57.043857 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3797/7588] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:39:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:39:57.048254 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f0b5a-e7fc-43a5-ae49-026d2310be06 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:57.059268 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f0b5a-e7fc-43a5-ae49-026d2310be06 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:57.064283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd731a2-fbc3-49d3-8f37-34bbe4aafbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:57.065099 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd731a2-fbc3-49d3-8f37-34bbe4aafbb5 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:57.065406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd731a2-fbc3-49d3-8f37-34bbe4aafbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:57.065861 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd731a2-fbc3-49d3-8f37-34bbe4aafbb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:57.066599 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd731a2-fbc3-49d3-8f37-34bbe4aafbb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:39:57.066905 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd731a2-fbc3-49d3-8f37-34bbe4aafbb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:57.068588 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd731a2-fbc3-49d3-8f37-34bbe4aafbb5 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:57.081619 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3792/7589] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:39:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:39:57.087054 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33fcfdc-78eb-4953-8681-2764fd4c8089 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:57.096659 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33fcfdc-78eb-4953-8681-2764fd4c8089 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:57.102780 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ef88c-e9d3-4739-8543-a2ce416e0584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:57.103606 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ef88c-e9d3-4739-8543-a2ce416e0584 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:57.103977 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ef88c-e9d3-4739-8543-a2ce416e0584 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:57.104350 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ef88c-e9d3-4739-8543-a2ce416e0584 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:57.105159 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ef88c-e9d3-4739-8543-a2ce416e0584 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:57.107792 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ef88c-e9d3-4739-8543-a2ce416e0584 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:57.212263 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3798/7590] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:39:57 2022] POST /identity/v3/projects => generated 393 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:39:57.216994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd731a2-fbc3-49d3-8f37-34bbe4aafbb5 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:57.243007 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd731a2-fbc3-49d3-8f37-34bbe4aafbb5 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:57.332363 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f9c56d-fe2f-4290-a408-1cfa2a783415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:57.333485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9c56d-fe2f-4290-a408-1cfa2a783415 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:57.334290 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9c56d-fe2f-4290-a408-1cfa2a783415 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:57.334948 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9c56d-fe2f-4290-a408-1cfa2a783415 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:57.335911 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f9c56d-fe2f-4290-a408-1cfa2a783415 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:57.338462 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f9c56d-fe2f-4290-a408-1cfa2a783415 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:57.472791 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3793/7591] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:39:57 2022] POST /identity/v3/users => generated 297 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:39:57.479506 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ef88c-e9d3-4739-8543-a2ce416e0584 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:57.492029 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ef88c-e9d3-4739-8543-a2ce416e0584 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:57.497590 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64591ba-f727-4693-9395-1aa967d528c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:57.498523 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64591ba-f727-4693-9395-1aa967d528c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:57.498809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64591ba-f727-4693-9395-1aa967d528c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:57.499236 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64591ba-f727-4693-9395-1aa967d528c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:57.499982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64591ba-f727-4693-9395-1aa967d528c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:57.501657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64591ba-f727-4693-9395-1aa967d528c7 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:57.527904 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3799/7592] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:39:57.528941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f9c56d-fe2f-4290-a408-1cfa2a783415 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:57.542724 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f9c56d-fe2f-4290-a408-1cfa2a783415 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:57.548348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92015c-c0ca-40e4-aee9-2db3d193e537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:57.549239 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92015c-c0ca-40e4-aee9-2db3d193e537 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:57.549909 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92015c-c0ca-40e4-aee9-2db3d193e537 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:57.550468 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92015c-c0ca-40e4-aee9-2db3d193e537 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:57.551401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be92015c-c0ca-40e4-aee9-2db3d193e537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:57.553255 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be92015c-c0ca-40e4-aee9-2db3d193e537 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:57.566816 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3794/7593] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:39:57.570668 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64591ba-f727-4693-9395-1aa967d528c7 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:57.585590 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64591ba-f727-4693-9395-1aa967d528c7 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:57.593018 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8be03b-7a81-43b0-882e-642fff65ff61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:57.595607 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8be03b-7a81-43b0-882e-642fff65ff61 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:57.596467 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8be03b-7a81-43b0-882e-642fff65ff61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:57.596826 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8be03b-7a81-43b0-882e-642fff65ff61 admin admin] PATH_INFO: `/v3/projects/e3313d57657f41298668cfcdeb0730cd/users/120831506447439dac31b1bc34583d86/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:57.625975 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8be03b-7a81-43b0-882e-642fff65ff61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3313d57657f41298668cfcdeb0730cd, user_id=120831506447439dac31b1bc34583d86, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:57.628662 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8be03b-7a81-43b0-882e-642fff65ff61 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:57.708503 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3800/7594] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:39:57 2022] PUT /identity/v3/projects/e3313d57657f41298668cfcdeb0730cd/users/120831506447439dac31b1bc34583d86/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:39:57.718776 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9088d8-f5f1-4adc-9708-d1bf2943b7a3 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:57.719087 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9088d8-f5f1-4adc-9708-d1bf2943b7a3 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:57.719367 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9088d8-f5f1-4adc-9708-d1bf2943b7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:57.750533 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-ba9088d8-f5f1-4adc-9708-d1bf2943b7a3 None None] MFA Rules not processed for user `120831506447439dac31b1bc34583d86`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:39:57.751847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ba9088d8-f5f1-4adc-9708-d1bf2943b7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:57.821747 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3795/7595] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:39:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:39:57.827365 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8be03b-7a81-43b0-882e-642fff65ff61 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:57.840950 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8be03b-7a81-43b0-882e-642fff65ff61 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:57.847194 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130eeff-f860-47be-be83-b2d72251be1e tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120831506447439dac31b1bc34583d86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3313d57657f41298668cfcdeb0730cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:57.848173 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130eeff-f860-47be-be83-b2d72251be1e tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:57.849071 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130eeff-f860-47be-be83-b2d72251be1e tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:57.849424 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130eeff-f860-47be-be83-b2d72251be1e tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] PATH_INFO: `/v3/users/120831506447439dac31b1bc34583d86/application_credentials` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:57.850231 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a130eeff-f860-47be-be83-b2d72251be1e tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: Authorizing `identity:create_application_credential(user_id=120831506447439dac31b1bc34583d86)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:57.851436 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a130eeff-f860-47be-be83-b2d72251be1e tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:58.014307 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3801/7596] 10.222.0.23 () {60 vars in 1313 bytes} [Sat Apr 30 21:39:57 2022] POST /identity/v3/users/120831506447439dac31b1bc34583d86/application_credentials => generated 788 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:39:58.018094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9088d8-f5f1-4adc-9708-d1bf2943b7a3 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:58.030817 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9088d8-f5f1-4adc-9708-d1bf2943b7a3 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:58.041475 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1542fb-18fa-4e49-b8f6-bd0bba4f3025 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120831506447439dac31b1bc34583d86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3313d57657f41298668cfcdeb0730cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:58.043136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1542fb-18fa-4e49-b8f6-bd0bba4f3025 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:58.043610 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1542fb-18fa-4e49-b8f6-bd0bba4f3025 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:58.044069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1542fb-18fa-4e49-b8f6-bd0bba4f3025 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] PATH_INFO: `/v3/users/120831506447439dac31b1bc34583d86/application_credentials/4d5c82baf35b40afbd9b5218b4b08165` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:58.060689 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1542fb-18fa-4e49-b8f6-bd0bba4f3025 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: Authorizing `identity:get_application_credential(user_id=120831506447439dac31b1bc34583d86, application_credential_id=4d5c82baf35b40afbd9b5218b4b08165)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:58.063265 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1542fb-18fa-4e49-b8f6-bd0bba4f3025 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:58.069404 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3796/7597] 10.222.0.23 () {58 vars in 1391 bytes} [Sat Apr 30 21:39:58 2022] GET /identity/v3/users/120831506447439dac31b1bc34583d86/application_credentials/4d5c82baf35b40afbd9b5218b4b08165 => generated 688 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:39:58.070365 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09d42b-6460-4080-9905-45e41479bac7 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:58.070668 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09d42b-6460-4080-9905-45e41479bac7 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:58.070955 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09d42b-6460-4080-9905-45e41479bac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:58.088717 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-4a09d42b-6460-4080-9905-45e41479bac7 None None] MFA Rules not processed for user `120831506447439dac31b1bc34583d86`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:39:58.097588 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4a09d42b-6460-4080-9905-45e41479bac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:39:58.266918 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1542fb-18fa-4e49-b8f6-bd0bba4f3025 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:58.276620 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3802/7598] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:39:58 2022] POST /identity/v3/auth/tokens => generated 3416 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Apr 30 21:39:58.282019 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1542fb-18fa-4e49-b8f6-bd0bba4f3025 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:58.287843 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40797def-7a39-40ca-b2fe-1551ea3f2994 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120831506447439dac31b1bc34583d86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3313d57657f41298668cfcdeb0730cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:58.289005 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40797def-7a39-40ca-b2fe-1551ea3f2994 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:58.289142 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40797def-7a39-40ca-b2fe-1551ea3f2994 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:58.289334 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40797def-7a39-40ca-b2fe-1551ea3f2994 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] PATH_INFO: `/v3/users/120831506447439dac31b1bc34583d86/application_credentials/4d5c82baf35b40afbd9b5218b4b08165` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:58.290963 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40797def-7a39-40ca-b2fe-1551ea3f2994 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: Authorizing `identity:delete_application_credential(user_id=120831506447439dac31b1bc34583d86, application_credential_id=4d5c82baf35b40afbd9b5218b4b08165)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:58.294758 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40797def-7a39-40ca-b2fe-1551ea3f2994 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:58.399020 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a09d42b-6460-4080-9905-45e41479bac7 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:58.415815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a09d42b-6460-4080-9905-45e41479bac7 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:58.416353 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3797/7599] 10.222.0.23 () {58 vars in 1394 bytes} [Sat Apr 30 21:39:58 2022] DELETE /identity/v3/users/120831506447439dac31b1bc34583d86/application_credentials/4d5c82baf35b40afbd9b5218b4b08165 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:39:58.421243 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5db2e9-5d04-4457-8eca-9ec800587fe4 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120831506447439dac31b1bc34583d86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3313d57657f41298668cfcdeb0730cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:58.426914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5db2e9-5d04-4457-8eca-9ec800587fe4 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:58.426914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5db2e9-5d04-4457-8eca-9ec800587fe4 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:58.426914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5db2e9-5d04-4457-8eca-9ec800587fe4 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] PATH_INFO: `/v3/users/120831506447439dac31b1bc34583d86/application_credentials` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:58.426914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5db2e9-5d04-4457-8eca-9ec800587fe4 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: Authorizing `identity:create_application_credential(user_id=120831506447439dac31b1bc34583d86)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:58.431763 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5db2e9-5d04-4457-8eca-9ec800587fe4 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:58.720416 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3803/7600] 10.222.0.23 () {60 vars in 1314 bytes} [Sat Apr 30 21:39:58 2022] POST /identity/v3/users/120831506447439dac31b1bc34583d86/application_credentials => generated 920 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:39:58.727969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40797def-7a39-40ca-b2fe-1551ea3f2994 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:58.752402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40797def-7a39-40ca-b2fe-1551ea3f2994 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:58.775080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab04ce3-1d09-4554-b1dc-7ac34e432409 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120831506447439dac31b1bc34583d86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3313d57657f41298668cfcdeb0730cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:58.776515 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab04ce3-1d09-4554-b1dc-7ac34e432409 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:58.776960 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab04ce3-1d09-4554-b1dc-7ac34e432409 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:58.777254 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab04ce3-1d09-4554-b1dc-7ac34e432409 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] PATH_INFO: `/v3/users/120831506447439dac31b1bc34583d86/application_credentials/3ad43486338549579c13294f511adfe1` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:58.795676 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab04ce3-1d09-4554-b1dc-7ac34e432409 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: Authorizing `identity:delete_application_credential(user_id=120831506447439dac31b1bc34583d86, application_credential_id=3ad43486338549579c13294f511adfe1)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:58.797714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab04ce3-1d09-4554-b1dc-7ac34e432409 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:58.944108 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3798/7601] 10.222.0.23 () {58 vars in 1394 bytes} [Sat Apr 30 21:39:58 2022] DELETE /identity/v3/users/120831506447439dac31b1bc34583d86/application_credentials/3ad43486338549579c13294f511adfe1 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:39:58.951310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5db2e9-5d04-4457-8eca-9ec800587fe4 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:58.968675 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5db2e9-5d04-4457-8eca-9ec800587fe4 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:58.981124 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd16a07-99db-401f-9b22-b2dccd960868 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120831506447439dac31b1bc34583d86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3313d57657f41298668cfcdeb0730cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:58.982076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd16a07-99db-401f-9b22-b2dccd960868 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:58.982522 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd16a07-99db-401f-9b22-b2dccd960868 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:58.982813 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd16a07-99db-401f-9b22-b2dccd960868 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] PATH_INFO: `/v3/users/120831506447439dac31b1bc34583d86/application_credentials` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:58.983585 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd16a07-99db-401f-9b22-b2dccd960868 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: Authorizing `identity:create_application_credential(user_id=120831506447439dac31b1bc34583d86)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:58.984774 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd16a07-99db-401f-9b22-b2dccd960868 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:59.232721 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3804/7602] 10.222.0.23 () {60 vars in 1314 bytes} [Sat Apr 30 21:39:58 2022] POST /identity/v3/users/120831506447439dac31b1bc34583d86/application_credentials => generated 812 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:39:59.237681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab04ce3-1d09-4554-b1dc-7ac34e432409 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:59.256206 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab04ce3-1d09-4554-b1dc-7ac34e432409 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:59.266498 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f190e-ba3a-4f30-922a-49f35b1f85f9 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120831506447439dac31b1bc34583d86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3313d57657f41298668cfcdeb0730cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:59.267773 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f190e-ba3a-4f30-922a-49f35b1f85f9 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:59.268284 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f190e-ba3a-4f30-922a-49f35b1f85f9 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:59.268751 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f190e-ba3a-4f30-922a-49f35b1f85f9 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] PATH_INFO: `/v3/users/120831506447439dac31b1bc34583d86/application_credentials/c5110c53a1ff47afa3eb6ad68fa5d080` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:59.289808 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4f190e-ba3a-4f30-922a-49f35b1f85f9 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: Authorizing `identity:delete_application_credential(user_id=120831506447439dac31b1bc34583d86, application_credential_id=c5110c53a1ff47afa3eb6ad68fa5d080)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:59.292266 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4f190e-ba3a-4f30-922a-49f35b1f85f9 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:59.422788 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3799/7603] 10.222.0.23 () {58 vars in 1394 bytes} [Sat Apr 30 21:39:59 2022] DELETE /identity/v3/users/120831506447439dac31b1bc34583d86/application_credentials/c5110c53a1ff47afa3eb6ad68fa5d080 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:39:59.430771 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd16a07-99db-401f-9b22-b2dccd960868 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:59.444895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd16a07-99db-401f-9b22-b2dccd960868 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:59.458596 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c198623-4b3f-4d55-bff2-cd550751fbe0 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120831506447439dac31b1bc34583d86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3313d57657f41298668cfcdeb0730cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:59.459790 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c198623-4b3f-4d55-bff2-cd550751fbe0 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:59.460254 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c198623-4b3f-4d55-bff2-cd550751fbe0 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:59.460744 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c198623-4b3f-4d55-bff2-cd550751fbe0 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] PATH_INFO: `/v3/users/120831506447439dac31b1bc34583d86/application_credentials` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:59.461742 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c198623-4b3f-4d55-bff2-cd550751fbe0 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: Authorizing `identity:create_application_credential(user_id=120831506447439dac31b1bc34583d86)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:59.463168 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c198623-4b3f-4d55-bff2-cd550751fbe0 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:59.718528 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3805/7604] 10.222.0.23 () {60 vars in 1313 bytes} [Sat Apr 30 21:39:59 2022] POST /identity/v3/users/120831506447439dac31b1bc34583d86/application_credentials => generated 789 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:39:59.719641 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f190e-ba3a-4f30-922a-49f35b1f85f9 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:39:59.744679 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f190e-ba3a-4f30-922a-49f35b1f85f9 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:39:59.762148 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b404e5-8056-471a-b104-e02c2e2682f5 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120831506447439dac31b1bc34583d86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3313d57657f41298668cfcdeb0730cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:39:59.765620 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b404e5-8056-471a-b104-e02c2e2682f5 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:39:59.766203 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b404e5-8056-471a-b104-e02c2e2682f5 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:39:59.768539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b404e5-8056-471a-b104-e02c2e2682f5 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] PATH_INFO: `/v3/users/120831506447439dac31b1bc34583d86/application_credentials` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:39:59.769970 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b404e5-8056-471a-b104-e02c2e2682f5 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: Authorizing `identity:create_application_credential(user_id=120831506447439dac31b1bc34583d86)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:39:59.775642 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b404e5-8056-471a-b104-e02c2e2682f5 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:39:59.994679 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3800/7605] 10.222.0.23 () {60 vars in 1313 bytes} [Sat Apr 30 21:39:59 2022] POST /identity/v3/users/120831506447439dac31b1bc34583d86/application_credentials => generated 788 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:39:59.998840 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c198623-4b3f-4d55-bff2-cd550751fbe0 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:00.011071 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c198623-4b3f-4d55-bff2-cd550751fbe0 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:00.016895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2c1cf-132d-4214-a957-8c226fa112b7 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120831506447439dac31b1bc34583d86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3313d57657f41298668cfcdeb0730cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:00.018155 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2c1cf-132d-4214-a957-8c226fa112b7 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:00.018616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2c1cf-132d-4214-a957-8c226fa112b7 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:00.019625 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace2c1cf-132d-4214-a957-8c226fa112b7 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] PATH_INFO: `/v3/users/120831506447439dac31b1bc34583d86/application_credentials` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:00.020931 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace2c1cf-132d-4214-a957-8c226fa112b7 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: Authorizing `identity:list_application_credentials(user_id=120831506447439dac31b1bc34583d86)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:00.023182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace2c1cf-132d-4214-a957-8c226fa112b7 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:00.039730 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3806/7606] 10.222.0.23 () {58 vars in 1292 bytes} [Sat Apr 30 21:39:59 2022] GET /identity/v3/users/120831506447439dac31b1bc34583d86/application_credentials => generated 1501 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:40:00.044190 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b404e5-8056-471a-b104-e02c2e2682f5 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:00.054885 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b404e5-8056-471a-b104-e02c2e2682f5 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:00.071222 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3d582-3f69-45c9-ad08-58a4ce65cb6f tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120831506447439dac31b1bc34583d86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3313d57657f41298668cfcdeb0730cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:00.072362 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3d582-3f69-45c9-ad08-58a4ce65cb6f tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:00.072656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3d582-3f69-45c9-ad08-58a4ce65cb6f tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:00.072949 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3d582-3f69-45c9-ad08-58a4ce65cb6f tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] PATH_INFO: `/v3/users/120831506447439dac31b1bc34583d86/application_credentials/52e01b0fef9d428bb38d8363f1c7247b` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:00.099994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d3d582-3f69-45c9-ad08-58a4ce65cb6f tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: Authorizing `identity:delete_application_credential(user_id=120831506447439dac31b1bc34583d86, application_credential_id=52e01b0fef9d428bb38d8363f1c7247b)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:00.102711 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d3d582-3f69-45c9-ad08-58a4ce65cb6f tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:00.234694 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3801/7607] 10.222.0.23 () {58 vars in 1394 bytes} [Sat Apr 30 21:40:00 2022] DELETE /identity/v3/users/120831506447439dac31b1bc34583d86/application_credentials/52e01b0fef9d428bb38d8363f1c7247b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:00.238792 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2c1cf-132d-4214-a957-8c226fa112b7 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:00.254472 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace2c1cf-132d-4214-a957-8c226fa112b7 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:00.261693 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565d93b-43e1-44b3-8ec3-d13cdf2bde10 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120831506447439dac31b1bc34583d86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3313d57657f41298668cfcdeb0730cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:00.264340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565d93b-43e1-44b3-8ec3-d13cdf2bde10 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:00.264714 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565d93b-43e1-44b3-8ec3-d13cdf2bde10 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:00.265077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565d93b-43e1-44b3-8ec3-d13cdf2bde10 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] PATH_INFO: `/v3/users/120831506447439dac31b1bc34583d86/application_credentials/2fb827f223c94cc1b054ffe8f3925f80` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:00.277065 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6565d93b-43e1-44b3-8ec3-d13cdf2bde10 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: Authorizing `identity:delete_application_credential(user_id=120831506447439dac31b1bc34583d86, application_credential_id=2fb827f223c94cc1b054ffe8f3925f80)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:00.279232 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6565d93b-43e1-44b3-8ec3-d13cdf2bde10 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:00.411626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3d582-3f69-45c9-ad08-58a4ce65cb6f tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:00.413042 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3807/7608] 10.222.0.23 () {58 vars in 1394 bytes} [Sat Apr 30 21:40:00 2022] DELETE /identity/v3/users/120831506447439dac31b1bc34583d86/application_credentials/2fb827f223c94cc1b054ffe8f3925f80 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:00.423395 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3d582-3f69-45c9-ad08-58a4ce65cb6f tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:00.428929 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5b9da-2933-41e3-be20-ba22dc7a2fa2 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120831506447439dac31b1bc34583d86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3313d57657f41298668cfcdeb0730cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:00.430181 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5b9da-2933-41e3-be20-ba22dc7a2fa2 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:00.430667 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5b9da-2933-41e3-be20-ba22dc7a2fa2 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:00.431238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5b9da-2933-41e3-be20-ba22dc7a2fa2 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] PATH_INFO: `/v3/users/120831506447439dac31b1bc34583d86/application_credentials` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:00.432635 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e5b9da-2933-41e3-be20-ba22dc7a2fa2 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: Authorizing `identity:create_application_credential(user_id=120831506447439dac31b1bc34583d86)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:00.434204 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e5b9da-2933-41e3-be20-ba22dc7a2fa2 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:00.605199 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565d93b-43e1-44b3-8ec3-d13cdf2bde10 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:00.611713 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3802/7609] 10.222.0.23 () {60 vars in 1313 bytes} [Sat Apr 30 21:40:00 2022] POST /identity/v3/users/120831506447439dac31b1bc34583d86/application_credentials => generated 789 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:40:00.616369 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565d93b-43e1-44b3-8ec3-d13cdf2bde10 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:00.622000 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cfc3ef-5b91-49a1-ac15-fb42aa9c588d tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120831506447439dac31b1bc34583d86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3313d57657f41298668cfcdeb0730cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:00.623339 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfc3ef-5b91-49a1-ac15-fb42aa9c588d tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:00.623805 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfc3ef-5b91-49a1-ac15-fb42aa9c588d tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:00.624260 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfc3ef-5b91-49a1-ac15-fb42aa9c588d tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] PATH_INFO: `/v3/users/120831506447439dac31b1bc34583d86/application_credentials` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:00.625503 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cfc3ef-5b91-49a1-ac15-fb42aa9c588d tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: Authorizing `identity:create_application_credential(user_id=120831506447439dac31b1bc34583d86)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:00.627041 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cfc3ef-5b91-49a1-ac15-fb42aa9c588d tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:00.808831 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3808/7610] 10.222.0.23 () {60 vars in 1313 bytes} [Sat Apr 30 21:40:00 2022] POST /identity/v3/users/120831506447439dac31b1bc34583d86/application_credentials => generated 788 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:40:00.812610 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5b9da-2933-41e3-be20-ba22dc7a2fa2 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:00.827923 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5b9da-2933-41e3-be20-ba22dc7a2fa2 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:00.834590 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87171848-5b64-4f87-a11c-3c6a08d15f38 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120831506447439dac31b1bc34583d86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3313d57657f41298668cfcdeb0730cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:00.837371 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87171848-5b64-4f87-a11c-3c6a08d15f38 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:00.837951 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87171848-5b64-4f87-a11c-3c6a08d15f38 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:00.838420 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87171848-5b64-4f87-a11c-3c6a08d15f38 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] PATH_INFO: `/v3/users/120831506447439dac31b1bc34583d86/application_credentials` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:00.839491 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87171848-5b64-4f87-a11c-3c6a08d15f38 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: Adding query filter params (name=tempest-application_credential-248825711) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:40:00.839997 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87171848-5b64-4f87-a11c-3c6a08d15f38 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: Authorizing `identity:list_application_credentials(user_id=120831506447439dac31b1bc34583d86)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:00.849460 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87171848-5b64-4f87-a11c-3c6a08d15f38 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:00.871121 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3803/7611] 10.222.0.23 () {58 vars in 1383 bytes} [Sat Apr 30 21:40:00 2022] GET /identity/v3/users/120831506447439dac31b1bc34583d86/application_credentials?name=tempest-application_credential-248825711 => generated 885 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:40:00.876480 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cfc3ef-5b91-49a1-ac15-fb42aa9c588d tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:00.891495 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cfc3ef-5b91-49a1-ac15-fb42aa9c588d tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:00.897970 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1d5bd-f638-4e80-8795-2ff52583a379 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120831506447439dac31b1bc34583d86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3313d57657f41298668cfcdeb0730cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:00.899220 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1d5bd-f638-4e80-8795-2ff52583a379 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:00.899539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1d5bd-f638-4e80-8795-2ff52583a379 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:00.899828 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1d5bd-f638-4e80-8795-2ff52583a379 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] PATH_INFO: `/v3/users/120831506447439dac31b1bc34583d86/application_credentials/d6fc3b60ace6437ba5da4f555abd81cf` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:00.919107 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1d5bd-f638-4e80-8795-2ff52583a379 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: Authorizing `identity:delete_application_credential(user_id=120831506447439dac31b1bc34583d86, application_credential_id=d6fc3b60ace6437ba5da4f555abd81cf)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:00.939913 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1d5bd-f638-4e80-8795-2ff52583a379 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:01.095688 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3809/7612] 10.222.0.23 () {58 vars in 1394 bytes} [Sat Apr 30 21:40:00 2022] DELETE /identity/v3/users/120831506447439dac31b1bc34583d86/application_credentials/d6fc3b60ace6437ba5da4f555abd81cf => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:01.101356 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87171848-5b64-4f87-a11c-3c6a08d15f38 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:01.112679 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87171848-5b64-4f87-a11c-3c6a08d15f38 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:01.118748 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02559831-7768-4ab5-9912-a833cba6e2e5 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '120831506447439dac31b1bc34583d86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3313d57657f41298668cfcdeb0730cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:01.126719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02559831-7768-4ab5-9912-a833cba6e2e5 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:01.126719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02559831-7768-4ab5-9912-a833cba6e2e5 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:01.126719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02559831-7768-4ab5-9912-a833cba6e2e5 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] PATH_INFO: `/v3/users/120831506447439dac31b1bc34583d86/application_credentials/ace6eba0748a456cbe4052caff19ca31` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:01.134426 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02559831-7768-4ab5-9912-a833cba6e2e5 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: Authorizing `identity:delete_application_credential(user_id=120831506447439dac31b1bc34583d86, application_credential_id=ace6eba0748a456cbe4052caff19ca31)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:01.136806 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02559831-7768-4ab5-9912-a833cba6e2e5 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:01.280502 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3804/7613] 10.222.0.23 () {58 vars in 1394 bytes} [Sat Apr 30 21:40:01 2022] DELETE /identity/v3/users/120831506447439dac31b1bc34583d86/application_credentials/ace6eba0748a456cbe4052caff19ca31 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:01.286492 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1d5bd-f638-4e80-8795-2ff52583a379 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:01.395931 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1d5bd-f638-4e80-8795-2ff52583a379 tempest-ApplicationCredentialsV3Test-1112836766 tempest-ApplicationCredentialsV3Test-1112836766-project] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:01.401358 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b05bfa-237c-44a6-82f6-27101381e846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:01.405100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b05bfa-237c-44a6-82f6-27101381e846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:01.405720 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b05bfa-237c-44a6-82f6-27101381e846 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:01.406214 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b05bfa-237c-44a6-82f6-27101381e846 admin admin] PATH_INFO: `/v3/users/120831506447439dac31b1bc34583d86` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:01.407780 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b05bfa-237c-44a6-82f6-27101381e846 admin admin] RBAC: Authorizing `identity:delete_user(user_id=120831506447439dac31b1bc34583d86)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:01.410118 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b05bfa-237c-44a6-82f6-27101381e846 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:01.642475 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-03b05bfa-237c-44a6-82f6-27101381e846 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '120831506447439dac31b1bc34583d86'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:01.783715 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-03b05bfa-237c-44a6-82f6-27101381e846 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '120831506447439dac31b1bc34583d86'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:01.867315 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-03b05bfa-237c-44a6-82f6-27101381e846 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '120831506447439dac31b1bc34583d86'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:01.876764 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-03b05bfa-237c-44a6-82f6-27101381e846 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '120831506447439dac31b1bc34583d86'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:01.878173 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-03b05bfa-237c-44a6-82f6-27101381e846 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '120831506447439dac31b1bc34583d86'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:01.888653 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3810/7614] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:40:01 2022] DELETE /identity/v3/users/120831506447439dac31b1bc34583d86 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:01.890282 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd00c2-ced0-4e6b-b252-30bba21d71ca None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:01.890791 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd00c2-ced0-4e6b-b252-30bba21d71ca None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:01.890922 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd00c2-ced0-4e6b-b252-30bba21d71ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:01.913746 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-86dd00c2-ced0-4e6b-b252-30bba21d71ca None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:40:01.915451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-86dd00c2-ced0-4e6b-b252-30bba21d71ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:01.997107 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3805/7615] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:40:02.029921 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b05bfa-237c-44a6-82f6-27101381e846 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:02.032550 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-03b05bfa-237c-44a6-82f6-27101381e846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:02.161587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b05bfa-237c-44a6-82f6-27101381e846 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:02.167456 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbfe1f8-797b-4b39-a3b7-5ad33af4f81f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:02.168226 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbfe1f8-797b-4b39-a3b7-5ad33af4f81f service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:02.168574 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbfe1f8-797b-4b39-a3b7-5ad33af4f81f service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:02.168920 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbfe1f8-797b-4b39-a3b7-5ad33af4f81f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:02.188202 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbfe1f8-797b-4b39-a3b7-5ad33af4f81f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:02.189882 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbfe1f8-797b-4b39-a3b7-5ad33af4f81f service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:02.202019 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3811/7616] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:40:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:40:02.358997 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc3324-4630-4827-b324-99b382c93e77 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:02.359297 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc3324-4630-4827-b324-99b382c93e77 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:02.359607 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc3324-4630-4827-b324-99b382c93e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:02.389857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-bcfc3324-4630-4827-b324-99b382c93e77 None None] MFA Rules not processed for user `c8667af135e44ce897538df8d12982b5`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:40:02.391084 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-bcfc3324-4630-4827-b324-99b382c93e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:02.471942 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3806/7617] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:40:02 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:40:02.482596 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbfe1f8-797b-4b39-a3b7-5ad33af4f81f service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:02.484015 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ccbfe1f8-797b-4b39-a3b7-5ad33af4f81f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:02.595983 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbfe1f8-797b-4b39-a3b7-5ad33af4f81f service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:02.606757 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72340ad7-7ad1-4bc4-b20e-32cd624913c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:02.608021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72340ad7-7ad1-4bc4-b20e-32cd624913c5 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:02.609316 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72340ad7-7ad1-4bc4-b20e-32cd624913c5 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:02.609995 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72340ad7-7ad1-4bc4-b20e-32cd624913c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:02.622023 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72340ad7-7ad1-4bc4-b20e-32cd624913c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:02.625090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72340ad7-7ad1-4bc4-b20e-32cd624913c5 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:02.642228 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3812/7618] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:40:02 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:40:02.697080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c16cab-499c-4daa-b090-3b264b78cfa7 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:02.700973 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c16cab-499c-4daa-b090-3b264b78cfa7 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:02.700973 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c16cab-499c-4daa-b090-3b264b78cfa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:02.720433 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-b1c16cab-499c-4daa-b090-3b264b78cfa7 None None] MFA Rules not processed for user `ee330c1468ae4085be6675b99c75c17c`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:40:02.722044 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b1c16cab-499c-4daa-b090-3b264b78cfa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:02.756472 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72340ad7-7ad1-4bc4-b20e-32cd624913c5 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:02.759889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-72340ad7-7ad1-4bc4-b20e-32cd624913c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:02.786450 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72340ad7-7ad1-4bc4-b20e-32cd624913c5 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:02.794189 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0d868-96ca-41e7-b4d0-d52d8c7dadcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:02.796846 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0d868-96ca-41e7-b4d0-d52d8c7dadcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:02.798148 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0d868-96ca-41e7-b4d0-d52d8c7dadcf admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:02.808330 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0d868-96ca-41e7-b4d0-d52d8c7dadcf admin admin] PATH_INFO: `/v3/projects/e3313d57657f41298668cfcdeb0730cd` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:02.808330 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c0d868-96ca-41e7-b4d0-d52d8c7dadcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3313d57657f41298668cfcdeb0730cd)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:02.808330 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c0d868-96ca-41e7-b4d0-d52d8c7dadcf admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:02.837240 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3807/7619] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:40:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:40:02.937089 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e9c0d868-96ca-41e7-b4d0-d52d8c7dadcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3313d57657f41298668cfcdeb0730cd', 'request_id': 'req-e9c0d868-96ca-41e7-b4d0-d52d8c7dadcf'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:02.946794 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e9c0d868-96ca-41e7-b4d0-d52d8c7dadcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3313d57657f41298668cfcdeb0730cd', 'request_id': 'req-e9c0d868-96ca-41e7-b4d0-d52d8c7dadcf'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:02.955047 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e9c0d868-96ca-41e7-b4d0-d52d8c7dadcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3313d57657f41298668cfcdeb0730cd', 'request_id': 'req-e9c0d868-96ca-41e7-b4d0-d52d8c7dadcf'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:03.067696 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e9c0d868-96ca-41e7-b4d0-d52d8c7dadcf admin admin] The token cache is being invalidate because project e3313d57657f41298668cfcdeb0730cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:40:03.068108 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e9c0d868-96ca-41e7-b4d0-d52d8c7dadcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:03.071782 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e9c0d868-96ca-41e7-b4d0-d52d8c7dadcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:03.071782 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3813/7620] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:40:02 2022] DELETE /identity/v3/projects/e3313d57657f41298668cfcdeb0730cd => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:40:03.075837 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ad905-82d8-47e6-b7b9-098ce45c18f0 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:03.076325 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ad905-82d8-47e6-b7b9-098ce45c18f0 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:03.076572 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ad905-82d8-47e6-b7b9-098ce45c18f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:03.095777 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-fe9ad905-82d8-47e6-b7b9-098ce45c18f0 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:40:03.096544 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-fe9ad905-82d8-47e6-b7b9-098ce45c18f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:03.141131 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0d868-96ca-41e7-b4d0-d52d8c7dadcf admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:03.142745 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e9c0d868-96ca-41e7-b4d0-d52d8c7dadcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:03.161947 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3808/7621] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:40:03.186470 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14a568-4e78-4f59-b9a4-fee37876c4a7 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:03.187301 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14a568-4e78-4f59-b9a4-fee37876c4a7 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:03.188263 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14a568-4e78-4f59-b9a4-fee37876c4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:03.210111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-0a14a568-4e78-4f59-b9a4-fee37876c4a7 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:40:03.211409 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0a14a568-4e78-4f59-b9a4-fee37876c4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:03.216909 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0d868-96ca-41e7-b4d0-d52d8c7dadcf admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:03.222680 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3809/7622] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:40:03.225850 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8080935-b517-4b1c-8e17-df5de63143cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:03.226701 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8080935-b517-4b1c-8e17-df5de63143cb service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:03.228802 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14a568-4e78-4f59-b9a4-fee37876c4a7 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:03.228946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8080935-b517-4b1c-8e17-df5de63143cb service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:03.228946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8080935-b517-4b1c-8e17-df5de63143cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:03.229920 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b8080935-b517-4b1c-8e17-df5de63143cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:03.237871 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14a568-4e78-4f59-b9a4-fee37876c4a7 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:03.246173 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a52e3-e6eb-43eb-a4af-8cefeb1c59e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:03.247136 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8080935-b517-4b1c-8e17-df5de63143cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:03.247614 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a52e3-e6eb-43eb-a4af-8cefeb1c59e3 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:03.248670 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8080935-b517-4b1c-8e17-df5de63143cb service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:03.249083 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a52e3-e6eb-43eb-a4af-8cefeb1c59e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:03.249578 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a52e3-e6eb-43eb-a4af-8cefeb1c59e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:03.250916 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a52e3-e6eb-43eb-a4af-8cefeb1c59e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:40:03.251455 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a52e3-e6eb-43eb-a4af-8cefeb1c59e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:03.265257 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3814/7623] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:40:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:40:03.267733 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a52e3-e6eb-43eb-a4af-8cefeb1c59e3 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:03.293169 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3810/7624] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:40:03.307134 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8080935-b517-4b1c-8e17-df5de63143cb service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:03.324101 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8080935-b517-4b1c-8e17-df5de63143cb service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:03.330068 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8150d0-ee2b-4049-944a-edc197ca8b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:03.330849 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8150d0-ee2b-4049-944a-edc197ca8b68 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:03.331359 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8150d0-ee2b-4049-944a-edc197ca8b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:03.331741 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8150d0-ee2b-4049-944a-edc197ca8b68 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:03.332552 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8150d0-ee2b-4049-944a-edc197ca8b68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:03.347978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8150d0-ee2b-4049-944a-edc197ca8b68 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:03.522947 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3815/7625] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:40:03 2022] POST /identity/v3/projects => generated 373 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:40:03.524739 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a52e3-e6eb-43eb-a4af-8cefeb1c59e3 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:03.547668 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a52e3-e6eb-43eb-a4af-8cefeb1c59e3 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:03.625651 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74034802-02db-4dd4-ac65-739e3678f8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:03.626428 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74034802-02db-4dd4-ac65-739e3678f8f5 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:03.626868 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74034802-02db-4dd4-ac65-739e3678f8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:03.627154 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74034802-02db-4dd4-ac65-739e3678f8f5 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:03.627886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74034802-02db-4dd4-ac65-739e3678f8f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:03.630539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74034802-02db-4dd4-ac65-739e3678f8f5 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:03.702420 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3811/7626] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:40:03 2022] POST /identity/v3/users => generated 287 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:40:03.707024 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8150d0-ee2b-4049-944a-edc197ca8b68 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:03.718847 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8150d0-ee2b-4049-944a-edc197ca8b68 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:03.724140 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f66dce-672b-4f48-bca9-8d0a74da85ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:03.724818 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f66dce-672b-4f48-bca9-8d0a74da85ce admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:03.725106 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f66dce-672b-4f48-bca9-8d0a74da85ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:03.725386 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f66dce-672b-4f48-bca9-8d0a74da85ce admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:03.726199 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f66dce-672b-4f48-bca9-8d0a74da85ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:03.728090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f66dce-672b-4f48-bca9-8d0a74da85ce admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:03.744824 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3816/7627] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:40:03.748508 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74034802-02db-4dd4-ac65-739e3678f8f5 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:03.765291 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74034802-02db-4dd4-ac65-739e3678f8f5 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:03.770262 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07118a-0ef8-4bad-9ab3-35bb71c200ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:03.771239 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07118a-0ef8-4bad-9ab3-35bb71c200ea admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:03.773328 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07118a-0ef8-4bad-9ab3-35bb71c200ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:03.773328 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07118a-0ef8-4bad-9ab3-35bb71c200ea admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:03.773328 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07118a-0ef8-4bad-9ab3-35bb71c200ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:03.775076 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07118a-0ef8-4bad-9ab3-35bb71c200ea admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:03.789975 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3812/7628] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:40:03.791200 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f66dce-672b-4f48-bca9-8d0a74da85ce admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:03.804655 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f66dce-672b-4f48-bca9-8d0a74da85ce admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:03.808059 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c2b8a-cc47-4c9b-9be9-a28145e4fc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:03.809193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c2b8a-cc47-4c9b-9be9-a28145e4fc3d admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:03.809690 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c2b8a-cc47-4c9b-9be9-a28145e4fc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:03.810503 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c2b8a-cc47-4c9b-9be9-a28145e4fc3d admin admin] PATH_INFO: `/v3/projects/84f112abf6014602b4e4d8a7fc5f112a/users/6175261cc0424a0aae49269108f0cb48/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:03.827915 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33c2b8a-cc47-4c9b-9be9-a28145e4fc3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=84f112abf6014602b4e4d8a7fc5f112a, user_id=6175261cc0424a0aae49269108f0cb48, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:03.833115 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33c2b8a-cc47-4c9b-9be9-a28145e4fc3d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:03.931451 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3817/7629] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:40:03 2022] PUT /identity/v3/projects/84f112abf6014602b4e4d8a7fc5f112a/users/6175261cc0424a0aae49269108f0cb48/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:03.946088 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256827e2-79c3-4b56-850e-9a3182609576 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:03.946389 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256827e2-79c3-4b56-850e-9a3182609576 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:03.946733 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256827e2-79c3-4b56-850e-9a3182609576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:03.991075 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-256827e2-79c3-4b56-850e-9a3182609576 None None] MFA Rules not processed for user `6175261cc0424a0aae49269108f0cb48`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:40:03.991591 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-256827e2-79c3-4b56-850e-9a3182609576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:04.071913 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3813/7630] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:40:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:40:04.073639 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c2b8a-cc47-4c9b-9be9-a28145e4fc3d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:04.092904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c2b8a-cc47-4c9b-9be9-a28145e4fc3d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:04.098073 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ecae05-2b13-4dc8-9809-a3984cb0472b tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6175261cc0424a0aae49269108f0cb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84f112abf6014602b4e4d8a7fc5f112a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:04.100204 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ecae05-2b13-4dc8-9809-a3984cb0472b tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:04.100726 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ecae05-2b13-4dc8-9809-a3984cb0472b tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:04.101244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ecae05-2b13-4dc8-9809-a3984cb0472b tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] PATH_INFO: `/v3/users/6175261cc0424a0aae49269108f0cb48/credentials/OS-EC2` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:04.105921 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ecae05-2b13-4dc8-9809-a3984cb0472b tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=6175261cc0424a0aae49269108f0cb48)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:04.105921 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ecae05-2b13-4dc8-9809-a3984cb0472b tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:04.216701 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3818/7631] 10.222.0.23 () {60 vars in 1298 bytes} [Sat Apr 30 21:40:04 2022] POST /identity/v3/users/6175261cc0424a0aae49269108f0cb48/credentials/OS-EC2 => generated 367 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:40:04.217989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256827e2-79c3-4b56-850e-9a3182609576 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:04.227686 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256827e2-79c3-4b56-850e-9a3182609576 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:04.232945 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e798fd3-ca1e-46fc-bf39-22b4cc81bc7b tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6175261cc0424a0aae49269108f0cb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84f112abf6014602b4e4d8a7fc5f112a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:04.234108 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e798fd3-ca1e-46fc-bf39-22b4cc81bc7b tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:04.234604 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e798fd3-ca1e-46fc-bf39-22b4cc81bc7b tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:04.235051 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e798fd3-ca1e-46fc-bf39-22b4cc81bc7b tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] PATH_INFO: `/v3/users/6175261cc0424a0aae49269108f0cb48/credentials/OS-EC2/53a2ce55986b4b218dac83da496a47e9` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:04.237434 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e798fd3-ca1e-46fc-bf39-22b4cc81bc7b tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=6175261cc0424a0aae49269108f0cb48, credential_id=53a2ce55986b4b218dac83da496a47e9)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:04.239147 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e798fd3-ca1e-46fc-bf39-22b4cc81bc7b tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:04.407476 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3814/7632] 10.222.0.23 () {58 vars in 1379 bytes} [Sat Apr 30 21:40:04 2022] DELETE /identity/v3/users/6175261cc0424a0aae49269108f0cb48/credentials/OS-EC2/53a2ce55986b4b218dac83da496a47e9 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:04.419221 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ecae05-2b13-4dc8-9809-a3984cb0472b tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:04.431829 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ecae05-2b13-4dc8-9809-a3984cb0472b tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:04.436942 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e60f51-3124-4a32-b410-abd03097f6bc tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6175261cc0424a0aae49269108f0cb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84f112abf6014602b4e4d8a7fc5f112a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:04.438177 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e60f51-3124-4a32-b410-abd03097f6bc tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:04.438499 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e60f51-3124-4a32-b410-abd03097f6bc tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:04.438853 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e60f51-3124-4a32-b410-abd03097f6bc tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] PATH_INFO: `/v3/users/6175261cc0424a0aae49269108f0cb48/credentials/OS-EC2` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:04.439604 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e60f51-3124-4a32-b410-abd03097f6bc tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=6175261cc0424a0aae49269108f0cb48)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:04.441213 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e60f51-3124-4a32-b410-abd03097f6bc tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:04.519820 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3819/7633] 10.222.0.23 () {60 vars in 1298 bytes} [Sat Apr 30 21:40:04 2022] POST /identity/v3/users/6175261cc0424a0aae49269108f0cb48/credentials/OS-EC2 => generated 367 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:40:04.528353 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e798fd3-ca1e-46fc-bf39-22b4cc81bc7b tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:04.544447 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e798fd3-ca1e-46fc-bf39-22b4cc81bc7b tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:04.554772 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fef0e-9a61-4efc-aca0-2a5b8eb7e9aa tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6175261cc0424a0aae49269108f0cb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84f112abf6014602b4e4d8a7fc5f112a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:04.556036 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fef0e-9a61-4efc-aca0-2a5b8eb7e9aa tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:04.556603 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fef0e-9a61-4efc-aca0-2a5b8eb7e9aa tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:04.557344 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fef0e-9a61-4efc-aca0-2a5b8eb7e9aa tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] PATH_INFO: `/v3/users/6175261cc0424a0aae49269108f0cb48/credentials/OS-EC2/ed00cd5b989a4bb8ad3955d8e248f1f2` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:04.560734 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076fef0e-9a61-4efc-aca0-2a5b8eb7e9aa tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=6175261cc0424a0aae49269108f0cb48, credential_id=ed00cd5b989a4bb8ad3955d8e248f1f2)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:04.563133 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076fef0e-9a61-4efc-aca0-2a5b8eb7e9aa tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:04.685365 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3815/7634] 10.222.0.23 () {58 vars in 1379 bytes} [Sat Apr 30 21:40:04 2022] DELETE /identity/v3/users/6175261cc0424a0aae49269108f0cb48/credentials/OS-EC2/ed00cd5b989a4bb8ad3955d8e248f1f2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:04.689632 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e60f51-3124-4a32-b410-abd03097f6bc tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:04.701873 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e60f51-3124-4a32-b410-abd03097f6bc tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:04.715365 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084ad89-8178-48c1-a751-349d3f995439 tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6175261cc0424a0aae49269108f0cb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84f112abf6014602b4e4d8a7fc5f112a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:04.717417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084ad89-8178-48c1-a751-349d3f995439 tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:04.717964 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084ad89-8178-48c1-a751-349d3f995439 tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:04.719555 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084ad89-8178-48c1-a751-349d3f995439 tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] PATH_INFO: `/v3/users/6175261cc0424a0aae49269108f0cb48/credentials/OS-EC2/ed00cd5b989a4bb8ad3955d8e248f1f2` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:04.777715 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-b084ad89-8178-48c1-a751-349d3f995439 tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] Could not find credential: 8014a3bcb4fb0d5d8268a57860a4072202be00b9b89c6619ecb256f7ffeae374.: keystone.exception.CredentialNotFound: Could not find credential: 8014a3bcb4fb0d5d8268a57860a4072202be00b9b89c6619ecb256f7ffeae374. Apr 30 21:40:04.777715 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:40:04.777715 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:40:04.777715 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:40:04.777715 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:40:04.777715 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:40:04.777715 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:40:04.777715 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:40:04.777715 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:40:04.777715 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:40:04.777715 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:40:04.777715 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:40:04.777715 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Apr 30 21:40:04.777715 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Apr 30 21:40:04.785440 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Apr 30 21:40:04.785440 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Apr 30 21:40:04.785440 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Apr 30 21:40:04.785440 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Apr 30 21:40:04.785440 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:40:04.785440 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:40:04.785440 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Apr 30 21:40:04.785440 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Apr 30 21:40:04.785440 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 21:40:04.785440 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 21:40:04.785440 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 21:40:04.785440 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 21:40:04.785440 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 21:40:04.785440 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 21:40:04.785440 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 21:40:04.785440 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 21:40:04.786855 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 21:40:04.786855 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 21:40:04.786855 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 21:40:04.786855 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 21:40:04.786855 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 21:40:04.786855 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 21:40:04.786855 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Apr 30 21:40:04.786855 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Apr 30 21:40:04.786855 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Apr 30 21:40:04.786855 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Apr 30 21:40:04.786855 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Apr 30 21:40:04.786855 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Apr 30 21:40:04.786855 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: 8014a3bcb4fb0d5d8268a57860a4072202be00b9b89c6619ecb256f7ffeae374. Apr 30 21:40:04.786855 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:40:04.786855 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3820/7635] 10.222.0.23 () {58 vars in 1376 bytes} [Sat Apr 30 21:40:04 2022] GET /identity/v3/users/6175261cc0424a0aae49269108f0cb48/credentials/OS-EC2/ed00cd5b989a4bb8ad3955d8e248f1f2 => generated 148 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 30 21:40:04.788591 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fef0e-9a61-4efc-aca0-2a5b8eb7e9aa tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:04.798954 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fef0e-9a61-4efc-aca0-2a5b8eb7e9aa tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:04.808110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0cc835-b599-447f-9c78-5abe67ded21b tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6175261cc0424a0aae49269108f0cb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84f112abf6014602b4e4d8a7fc5f112a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:04.808110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cc835-b599-447f-9c78-5abe67ded21b tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:04.808750 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cc835-b599-447f-9c78-5abe67ded21b tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:04.809343 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cc835-b599-447f-9c78-5abe67ded21b tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] PATH_INFO: `/v3/users/6175261cc0424a0aae49269108f0cb48/credentials/OS-EC2` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:04.810645 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0cc835-b599-447f-9c78-5abe67ded21b tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=6175261cc0424a0aae49269108f0cb48)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:04.814697 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0cc835-b599-447f-9c78-5abe67ded21b tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:04.896020 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3816/7636] 10.222.0.23 () {60 vars in 1298 bytes} [Sat Apr 30 21:40:04 2022] POST /identity/v3/users/6175261cc0424a0aae49269108f0cb48/credentials/OS-EC2 => generated 367 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:40:04.896411 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084ad89-8178-48c1-a751-349d3f995439 tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:04.919139 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084ad89-8178-48c1-a751-349d3f995439 tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:04.931456 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcece38-3057-4d0f-abb5-af97a53250b0 tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6175261cc0424a0aae49269108f0cb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84f112abf6014602b4e4d8a7fc5f112a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:04.932379 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcece38-3057-4d0f-abb5-af97a53250b0 tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:04.932669 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcece38-3057-4d0f-abb5-af97a53250b0 tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:04.932951 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcece38-3057-4d0f-abb5-af97a53250b0 tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] PATH_INFO: `/v3/users/6175261cc0424a0aae49269108f0cb48/credentials/OS-EC2` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:04.933651 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcece38-3057-4d0f-abb5-af97a53250b0 tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=6175261cc0424a0aae49269108f0cb48)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:04.938740 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcece38-3057-4d0f-abb5-af97a53250b0 tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:05.034939 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3821/7637] 10.222.0.23 () {60 vars in 1298 bytes} [Sat Apr 30 21:40:04 2022] POST /identity/v3/users/6175261cc0424a0aae49269108f0cb48/credentials/OS-EC2 => generated 367 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:40:05.039002 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0cc835-b599-447f-9c78-5abe67ded21b tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:05.053879 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0cc835-b599-447f-9c78-5abe67ded21b tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:05.062502 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf36910-3c65-474a-8f33-20d7c4f65d2f tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6175261cc0424a0aae49269108f0cb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84f112abf6014602b4e4d8a7fc5f112a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:05.062502 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf36910-3c65-474a-8f33-20d7c4f65d2f tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:05.077723 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf36910-3c65-474a-8f33-20d7c4f65d2f tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:05.078585 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf36910-3c65-474a-8f33-20d7c4f65d2f tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] PATH_INFO: `/v3/users/6175261cc0424a0aae49269108f0cb48/credentials/OS-EC2` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:05.080154 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf36910-3c65-474a-8f33-20d7c4f65d2f tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=6175261cc0424a0aae49269108f0cb48)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:05.103169 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf36910-3c65-474a-8f33-20d7c4f65d2f tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:05.131163 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3817/7638] 10.222.0.23 () {58 vars in 1277 bytes} [Sat Apr 30 21:40:05 2022] GET /identity/v3/users/6175261cc0424a0aae49269108f0cb48/credentials/OS-EC2 => generated 865 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:40:05.135544 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcece38-3057-4d0f-abb5-af97a53250b0 tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:05.155119 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcece38-3057-4d0f-abb5-af97a53250b0 tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:05.201089 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2e8b2c-2982-442a-8792-2d15cd98f807 tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6175261cc0424a0aae49269108f0cb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84f112abf6014602b4e4d8a7fc5f112a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:05.202471 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e8b2c-2982-442a-8792-2d15cd98f807 tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:05.202972 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e8b2c-2982-442a-8792-2d15cd98f807 tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:05.203260 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e8b2c-2982-442a-8792-2d15cd98f807 tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] PATH_INFO: `/v3/users/6175261cc0424a0aae49269108f0cb48/credentials/OS-EC2/7d840effaf7443db933408464d149270` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:05.206238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2e8b2c-2982-442a-8792-2d15cd98f807 tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=6175261cc0424a0aae49269108f0cb48, credential_id=7d840effaf7443db933408464d149270)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:05.208821 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2e8b2c-2982-442a-8792-2d15cd98f807 tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:05.348672 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3822/7639] 10.222.0.23 () {58 vars in 1379 bytes} [Sat Apr 30 21:40:05 2022] DELETE /identity/v3/users/6175261cc0424a0aae49269108f0cb48/credentials/OS-EC2/7d840effaf7443db933408464d149270 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:05.352740 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf36910-3c65-474a-8f33-20d7c4f65d2f tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:05.362800 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf36910-3c65-474a-8f33-20d7c4f65d2f tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:05.367216 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510acae-84e5-4a91-b0e6-8b1bc1415f5b tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6175261cc0424a0aae49269108f0cb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84f112abf6014602b4e4d8a7fc5f112a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:05.368098 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510acae-84e5-4a91-b0e6-8b1bc1415f5b tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:05.368487 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510acae-84e5-4a91-b0e6-8b1bc1415f5b tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:05.368651 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510acae-84e5-4a91-b0e6-8b1bc1415f5b tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] PATH_INFO: `/v3/users/6175261cc0424a0aae49269108f0cb48/credentials/OS-EC2/3072b20b6d6a4d6aba16af5384437847` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:05.370718 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2510acae-84e5-4a91-b0e6-8b1bc1415f5b tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=6175261cc0424a0aae49269108f0cb48, credential_id=3072b20b6d6a4d6aba16af5384437847)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:05.372203 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2510acae-84e5-4a91-b0e6-8b1bc1415f5b tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:05.563444 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3818/7640] 10.222.0.23 () {58 vars in 1379 bytes} [Sat Apr 30 21:40:05 2022] DELETE /identity/v3/users/6175261cc0424a0aae49269108f0cb48/credentials/OS-EC2/3072b20b6d6a4d6aba16af5384437847 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:05.566636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2e8b2c-2982-442a-8792-2d15cd98f807 tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:05.594146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2e8b2c-2982-442a-8792-2d15cd98f807 tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:05.617202 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc58b98-5cff-40df-83e0-c7d4c0738e3f tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6175261cc0424a0aae49269108f0cb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84f112abf6014602b4e4d8a7fc5f112a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:05.618301 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc58b98-5cff-40df-83e0-c7d4c0738e3f tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:05.618765 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc58b98-5cff-40df-83e0-c7d4c0738e3f tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:05.619334 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc58b98-5cff-40df-83e0-c7d4c0738e3f tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] PATH_INFO: `/v3/users/6175261cc0424a0aae49269108f0cb48/credentials/OS-EC2` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:05.622091 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc58b98-5cff-40df-83e0-c7d4c0738e3f tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=6175261cc0424a0aae49269108f0cb48)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:05.624356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc58b98-5cff-40df-83e0-c7d4c0738e3f tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:05.746905 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3823/7641] 10.222.0.23 () {60 vars in 1298 bytes} [Sat Apr 30 21:40:05 2022] POST /identity/v3/users/6175261cc0424a0aae49269108f0cb48/credentials/OS-EC2 => generated 367 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:40:05.751394 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510acae-84e5-4a91-b0e6-8b1bc1415f5b tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:05.769836 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510acae-84e5-4a91-b0e6-8b1bc1415f5b tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:05.781736 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be143abf-6829-4a51-a01f-cdacdde353ef tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6175261cc0424a0aae49269108f0cb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84f112abf6014602b4e4d8a7fc5f112a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:05.782832 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be143abf-6829-4a51-a01f-cdacdde353ef tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:05.783230 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be143abf-6829-4a51-a01f-cdacdde353ef tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:05.783623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be143abf-6829-4a51-a01f-cdacdde353ef tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] PATH_INFO: `/v3/users/6175261cc0424a0aae49269108f0cb48/credentials/OS-EC2/f9c18b56b46b435586dcd037368fbc9b` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:05.787817 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be143abf-6829-4a51-a01f-cdacdde353ef tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=6175261cc0424a0aae49269108f0cb48, credential_id=f9c18b56b46b435586dcd037368fbc9b)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:05.791631 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be143abf-6829-4a51-a01f-cdacdde353ef tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:05.792941 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3819/7642] 10.222.0.23 () {58 vars in 1376 bytes} [Sat Apr 30 21:40:05 2022] GET /identity/v3/users/6175261cc0424a0aae49269108f0cb48/credentials/OS-EC2/f9c18b56b46b435586dcd037368fbc9b => generated 367 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:40:05.797060 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc58b98-5cff-40df-83e0-c7d4c0738e3f tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:05.812675 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc58b98-5cff-40df-83e0-c7d4c0738e3f tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:05.824687 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa71e8-0448-49fb-b320-86e572b58a6e tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6175261cc0424a0aae49269108f0cb48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84f112abf6014602b4e4d8a7fc5f112a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:05.825993 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa71e8-0448-49fb-b320-86e572b58a6e tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:05.826449 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa71e8-0448-49fb-b320-86e572b58a6e tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:05.826899 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa71e8-0448-49fb-b320-86e572b58a6e tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] PATH_INFO: `/v3/users/6175261cc0424a0aae49269108f0cb48/credentials/OS-EC2/f9c18b56b46b435586dcd037368fbc9b` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:05.829917 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa71e8-0448-49fb-b320-86e572b58a6e tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=6175261cc0424a0aae49269108f0cb48, credential_id=f9c18b56b46b435586dcd037368fbc9b)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:05.831668 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa71e8-0448-49fb-b320-86e572b58a6e tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:05.906539 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3824/7643] 10.222.0.23 () {58 vars in 1379 bytes} [Sat Apr 30 21:40:05 2022] DELETE /identity/v3/users/6175261cc0424a0aae49269108f0cb48/credentials/OS-EC2/f9c18b56b46b435586dcd037368fbc9b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:05.912111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be143abf-6829-4a51-a01f-cdacdde353ef tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:06.001639 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be143abf-6829-4a51-a01f-cdacdde353ef tempest-EC2CredentialsTest-1930709967 tempest-EC2CredentialsTest-1930709967-project] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:06.013836 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117ef46-75a2-4200-b82c-7bace6848b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:06.013836 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117ef46-75a2-4200-b82c-7bace6848b36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:06.013836 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117ef46-75a2-4200-b82c-7bace6848b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:06.013836 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117ef46-75a2-4200-b82c-7bace6848b36 admin admin] PATH_INFO: `/v3/users/6175261cc0424a0aae49269108f0cb48` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:06.014276 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117ef46-75a2-4200-b82c-7bace6848b36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6175261cc0424a0aae49269108f0cb48)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:06.015722 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117ef46-75a2-4200-b82c-7bace6848b36 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:06.331253 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4117ef46-75a2-4200-b82c-7bace6848b36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6175261cc0424a0aae49269108f0cb48'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:06.359024 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4117ef46-75a2-4200-b82c-7bace6848b36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6175261cc0424a0aae49269108f0cb48'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:06.489687 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4117ef46-75a2-4200-b82c-7bace6848b36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6175261cc0424a0aae49269108f0cb48'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:06.491394 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4117ef46-75a2-4200-b82c-7bace6848b36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6175261cc0424a0aae49269108f0cb48'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:06.511130 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4117ef46-75a2-4200-b82c-7bace6848b36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6175261cc0424a0aae49269108f0cb48'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:06.521905 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3820/7644] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:40:05 2022] DELETE /identity/v3/users/6175261cc0424a0aae49269108f0cb48 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:06.526713 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db850aad-967f-4962-b610-b8f486c85f2d None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:06.526958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db850aad-967f-4962-b610-b8f486c85f2d None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:06.527252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db850aad-967f-4962-b610-b8f486c85f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:06.555107 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-db850aad-967f-4962-b610-b8f486c85f2d None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:40:06.556335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-db850aad-967f-4962-b610-b8f486c85f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:06.619263 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3825/7645] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:40:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:40:06.630340 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117ef46-75a2-4200-b82c-7bace6848b36 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:06.631883 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4117ef46-75a2-4200-b82c-7bace6848b36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:06.730143 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117ef46-75a2-4200-b82c-7bace6848b36 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:06.735500 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92896f3f-e8e6-44c0-8127-55b62d298821 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:06.736237 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92896f3f-e8e6-44c0-8127-55b62d298821 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:06.736591 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92896f3f-e8e6-44c0-8127-55b62d298821 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:06.736988 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92896f3f-e8e6-44c0-8127-55b62d298821 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:06.749935 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92896f3f-e8e6-44c0-8127-55b62d298821 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:06.751500 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92896f3f-e8e6-44c0-8127-55b62d298821 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:06.763040 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3821/7646] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:40:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:40:07.401348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db850aad-967f-4962-b610-b8f486c85f2d None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:07.404016 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-db850aad-967f-4962-b610-b8f486c85f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:07.432347 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db850aad-967f-4962-b610-b8f486c85f2d None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:07.460847 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341957b-04e4-4b71-b049-1f4f762aa4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:07.461632 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341957b-04e4-4b71-b049-1f4f762aa4e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:07.462363 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341957b-04e4-4b71-b049-1f4f762aa4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:07.462960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341957b-04e4-4b71-b049-1f4f762aa4e2 admin admin] PATH_INFO: `/v3/projects/84f112abf6014602b4e4d8a7fc5f112a` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:07.466221 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f341957b-04e4-4b71-b049-1f4f762aa4e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84f112abf6014602b4e4d8a7fc5f112a)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:07.469291 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f341957b-04e4-4b71-b049-1f4f762aa4e2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:07.663562 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f341957b-04e4-4b71-b049-1f4f762aa4e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84f112abf6014602b4e4d8a7fc5f112a', 'request_id': 'req-f341957b-04e4-4b71-b049-1f4f762aa4e2'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:07.676131 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f341957b-04e4-4b71-b049-1f4f762aa4e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84f112abf6014602b4e4d8a7fc5f112a', 'request_id': 'req-f341957b-04e4-4b71-b049-1f4f762aa4e2'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:07.685113 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f341957b-04e4-4b71-b049-1f4f762aa4e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84f112abf6014602b4e4d8a7fc5f112a', 'request_id': 'req-f341957b-04e4-4b71-b049-1f4f762aa4e2'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:07.776244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f341957b-04e4-4b71-b049-1f4f762aa4e2 admin admin] The token cache is being invalidate because project 84f112abf6014602b4e4d8a7fc5f112a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:40:07.776671 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f341957b-04e4-4b71-b049-1f4f762aa4e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:07.782782 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f341957b-04e4-4b71-b049-1f4f762aa4e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:07.782782 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3826/7647] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:40:07 2022] DELETE /identity/v3/projects/84f112abf6014602b4e4d8a7fc5f112a => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:07.785797 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a85a12-3397-4a6c-a2f6-14b1ab084645 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:07.786301 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a85a12-3397-4a6c-a2f6-14b1ab084645 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:07.786791 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a85a12-3397-4a6c-a2f6-14b1ab084645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:07.808213 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-25a85a12-3397-4a6c-a2f6-14b1ab084645 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:40:07.809538 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-25a85a12-3397-4a6c-a2f6-14b1ab084645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:07.959057 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3822/7648] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:40:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:40:07.970074 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e08e6-ee46-4b6b-83e2-585040d531f9 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:07.970074 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e08e6-ee46-4b6b-83e2-585040d531f9 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:07.970074 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e08e6-ee46-4b6b-83e2-585040d531f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:07.999693 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-dc5e08e6-ee46-4b6b-83e2-585040d531f9 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:40:08.003231 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-dc5e08e6-ee46-4b6b-83e2-585040d531f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:08.017106 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3827/7649] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:40:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:40:08.017347 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a85a12-3397-4a6c-a2f6-14b1ab084645 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:08.047898 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a85a12-3397-4a6c-a2f6-14b1ab084645 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:08.056126 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5b284-0428-473d-abcc-473faf0d03da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:08.056827 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5b284-0428-473d-abcc-473faf0d03da admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:08.057302 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5b284-0428-473d-abcc-473faf0d03da admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:08.057805 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5b284-0428-473d-abcc-473faf0d03da admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:08.058556 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca5b284-0428-473d-abcc-473faf0d03da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:40:08.058875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca5b284-0428-473d-abcc-473faf0d03da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:08.062145 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca5b284-0428-473d-abcc-473faf0d03da admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:08.075787 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3823/7650] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:40:08.080390 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5e08e6-ee46-4b6b-83e2-585040d531f9 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:08.095592 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5e08e6-ee46-4b6b-83e2-585040d531f9 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:08.104348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf407ed-5869-4c23-8c42-29bb4fbde3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:08.105466 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf407ed-5869-4c23-8c42-29bb4fbde3bb admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:08.106017 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf407ed-5869-4c23-8c42-29bb4fbde3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:08.106629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf407ed-5869-4c23-8c42-29bb4fbde3bb admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:08.107613 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf407ed-5869-4c23-8c42-29bb4fbde3bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:08.109749 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf407ed-5869-4c23-8c42-29bb4fbde3bb admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:08.237516 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3828/7651] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:40:08 2022] POST /identity/v3/projects => generated 375 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:40:08.238740 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5b284-0428-473d-abcc-473faf0d03da admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:08.251605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5b284-0428-473d-abcc-473faf0d03da admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:08.374864 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de520c1c-5736-4c4a-8ae1-17d5c13b3b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:08.375210 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de520c1c-5736-4c4a-8ae1-17d5c13b3b41 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:08.375484 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de520c1c-5736-4c4a-8ae1-17d5c13b3b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:08.375871 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de520c1c-5736-4c4a-8ae1-17d5c13b3b41 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:08.377336 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de520c1c-5736-4c4a-8ae1-17d5c13b3b41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:08.381219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de520c1c-5736-4c4a-8ae1-17d5c13b3b41 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:08.507427 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf407ed-5869-4c23-8c42-29bb4fbde3bb admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:08.511497 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3824/7652] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:40:08 2022] POST /identity/v3/users => generated 288 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:40:08.523460 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf407ed-5869-4c23-8c42-29bb4fbde3bb admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:08.535097 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec3e3b9-9c53-45ea-b077-18f240bd384d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:08.536355 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3e3b9-9c53-45ea-b077-18f240bd384d admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:08.536931 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3e3b9-9c53-45ea-b077-18f240bd384d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:08.537221 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3e3b9-9c53-45ea-b077-18f240bd384d admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:08.538750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec3e3b9-9c53-45ea-b077-18f240bd384d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:08.540519 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec3e3b9-9c53-45ea-b077-18f240bd384d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:08.560187 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de520c1c-5736-4c4a-8ae1-17d5c13b3b41 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:08.574028 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3829/7653] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:40:08.575585 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de520c1c-5736-4c4a-8ae1-17d5c13b3b41 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:08.581301 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d265e0-a898-48ef-9afc-e9ec8be95ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:08.582016 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d265e0-a898-48ef-9afc-e9ec8be95ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:08.582307 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d265e0-a898-48ef-9afc-e9ec8be95ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:08.582589 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d265e0-a898-48ef-9afc-e9ec8be95ec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:08.583860 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d265e0-a898-48ef-9afc-e9ec8be95ec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:08.585624 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d265e0-a898-48ef-9afc-e9ec8be95ec2 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:08.602983 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec3e3b9-9c53-45ea-b077-18f240bd384d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:08.604354 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3825/7654] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:40:08.617146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec3e3b9-9c53-45ea-b077-18f240bd384d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:08.627377 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0acdc6-f53f-4922-805a-dc4ae7fc2a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:08.629858 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0acdc6-f53f-4922-805a-dc4ae7fc2a9e admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:08.630880 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0acdc6-f53f-4922-805a-dc4ae7fc2a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:08.631343 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0acdc6-f53f-4922-805a-dc4ae7fc2a9e admin admin] PATH_INFO: `/v3/projects/978ca8b782ba493b9662742ec0723a39/users/c46381d6d2854033885043d30cee857a/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:08.690677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0acdc6-f53f-4922-805a-dc4ae7fc2a9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=978ca8b782ba493b9662742ec0723a39, user_id=c46381d6d2854033885043d30cee857a, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:08.699081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0acdc6-f53f-4922-805a-dc4ae7fc2a9e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:08.780530 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3830/7655] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:40:08 2022] PUT /identity/v3/projects/978ca8b782ba493b9662742ec0723a39/users/c46381d6d2854033885043d30cee857a/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:08.792684 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686ab80-ac39-43c3-84dc-596424636206 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:08.793221 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686ab80-ac39-43c3-84dc-596424636206 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:08.793454 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686ab80-ac39-43c3-84dc-596424636206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:08.820969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-a686ab80-ac39-43c3-84dc-596424636206 None None] MFA Rules not processed for user `c46381d6d2854033885043d30cee857a`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:40:08.822340 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a686ab80-ac39-43c3-84dc-596424636206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:08.928352 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3826/7656] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:40:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:40:08.934368 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0acdc6-f53f-4922-805a-dc4ae7fc2a9e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:09.078814 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0acdc6-f53f-4922-805a-dc4ae7fc2a9e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:09.091050 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2faa5e-766e-4674-bd94-e95586fe5c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:09.092127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2faa5e-766e-4674-bd94-e95586fe5c78 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:09.092499 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2faa5e-766e-4674-bd94-e95586fe5c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:09.092757 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2faa5e-766e-4674-bd94-e95586fe5c78 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:09.093479 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2faa5e-766e-4674-bd94-e95586fe5c78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:09.095545 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2faa5e-766e-4674-bd94-e95586fe5c78 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:09.209043 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3831/7657] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:40:08 2022] POST /identity/v3/projects => generated 375 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:40:09.210354 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686ab80-ac39-43c3-84dc-596424636206 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:09.224623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686ab80-ac39-43c3-84dc-596424636206 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:09.285679 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c6edc-214b-4553-a140-e144caeeea45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:09.286962 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c6edc-214b-4553-a140-e144caeeea45 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:09.287248 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c6edc-214b-4553-a140-e144caeeea45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:09.287530 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c6edc-214b-4553-a140-e144caeeea45 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:09.288956 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c6edc-214b-4553-a140-e144caeeea45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:09.290197 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c6edc-214b-4553-a140-e144caeeea45 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:09.405860 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3827/7658] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:40:09 2022] POST /identity/v3/users => generated 288 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:40:09.409855 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2faa5e-766e-4674-bd94-e95586fe5c78 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:09.422628 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2faa5e-766e-4674-bd94-e95586fe5c78 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:09.431943 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928090b-309d-40a1-8032-aa6cb1097b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:09.432654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928090b-309d-40a1-8032-aa6cb1097b3e admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:09.432943 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928090b-309d-40a1-8032-aa6cb1097b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:09.433340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928090b-309d-40a1-8032-aa6cb1097b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:09.434258 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5928090b-309d-40a1-8032-aa6cb1097b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:09.436862 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5928090b-309d-40a1-8032-aa6cb1097b3e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:09.453022 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3832/7659] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:40:09.459259 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c6edc-214b-4553-a140-e144caeeea45 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:09.471833 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c6edc-214b-4553-a140-e144caeeea45 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:09.483683 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d6d6d-e420-43a7-ae9e-38a228dc0200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:09.484395 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d6d6d-e420-43a7-ae9e-38a228dc0200 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:09.484681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d6d6d-e420-43a7-ae9e-38a228dc0200 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:09.484957 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d6d6d-e420-43a7-ae9e-38a228dc0200 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:09.485685 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d6d6d-e420-43a7-ae9e-38a228dc0200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:09.487349 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d6d6d-e420-43a7-ae9e-38a228dc0200 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:09.506877 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3828/7660] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:40:09.509410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928090b-309d-40a1-8032-aa6cb1097b3e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:09.531735 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928090b-309d-40a1-8032-aa6cb1097b3e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:09.537416 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5fa528-7d5e-4726-bc28-9a9f5c68fac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:09.538705 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fa528-7d5e-4726-bc28-9a9f5c68fac5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:09.539055 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fa528-7d5e-4726-bc28-9a9f5c68fac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:09.539424 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fa528-7d5e-4726-bc28-9a9f5c68fac5 admin admin] PATH_INFO: `/v3/projects/64e87bf9d16f458993aff26b30ae2403/users/ca311349c0f2455ab6c06bd1bcfa5a17/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:09.561302 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5fa528-7d5e-4726-bc28-9a9f5c68fac5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64e87bf9d16f458993aff26b30ae2403, user_id=ca311349c0f2455ab6c06bd1bcfa5a17, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:09.564278 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5fa528-7d5e-4726-bc28-9a9f5c68fac5 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:09.634765 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3833/7661] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:40:09 2022] PUT /identity/v3/projects/64e87bf9d16f458993aff26b30ae2403/users/ca311349c0f2455ab6c06bd1bcfa5a17/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:09.645089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307a476-e456-4634-a788-cbb644f2df4a None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:09.645993 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307a476-e456-4634-a788-cbb644f2df4a None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:09.646208 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307a476-e456-4634-a788-cbb644f2df4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:09.677853 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-7307a476-e456-4634-a788-cbb644f2df4a None None] MFA Rules not processed for user `ca311349c0f2455ab6c06bd1bcfa5a17`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:40:09.679090 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7307a476-e456-4634-a788-cbb644f2df4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:09.761383 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3829/7662] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:40:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:40:09.784660 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5fa528-7d5e-4726-bc28-9a9f5c68fac5 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:09.787466 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2e5fa528-7d5e-4726-bc28-9a9f5c68fac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:09.898645 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5fa528-7d5e-4726-bc28-9a9f5c68fac5 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:09.903687 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7c425-1e51-496a-a2ef-0e9d0d8d667b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e302b1298dd04d6590e3d079f7b13b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:09.904934 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7c425-1e51-496a-a2ef-0e9d0d8d667b service glance] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:09.905438 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7c425-1e51-496a-a2ef-0e9d0d8d667b service glance] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:09.906351 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7c425-1e51-496a-a2ef-0e9d0d8d667b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:09.980204 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e7c425-1e51-496a-a2ef-0e9d0d8d667b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:09.981936 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e7c425-1e51-496a-a2ef-0e9d0d8d667b service glance] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:09.993149 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3834/7663] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:40:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:40:10.264297 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ade81-89c5-4b5f-ac66-4acd07e9c3a2 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:10.266006 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ade81-89c5-4b5f-ac66-4acd07e9c3a2 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:10.266797 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ade81-89c5-4b5f-ac66-4acd07e9c3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:10.289560 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-081ade81-89c5-4b5f-ac66-4acd07e9c3a2 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:40:10.290881 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-081ade81-89c5-4b5f-ac66-4acd07e9c3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:10.356515 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3830/7664] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:40:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:40:10.506576 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7c425-1e51-496a-a2ef-0e9d0d8d667b service glance] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:10.509292 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-49e7c425-1e51-496a-a2ef-0e9d0d8d667b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:10.598117 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7c425-1e51-496a-a2ef-0e9d0d8d667b service glance] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:10.603677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351743a3-95cf-40a6-b278-5fb1e362b1a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:10.604400 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351743a3-95cf-40a6-b278-5fb1e362b1a0 service swift] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:10.604751 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351743a3-95cf-40a6-b278-5fb1e362b1a0 service swift] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:10.605095 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351743a3-95cf-40a6-b278-5fb1e362b1a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:10.614881 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351743a3-95cf-40a6-b278-5fb1e362b1a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:10.618598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351743a3-95cf-40a6-b278-5fb1e362b1a0 service swift] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:10.626450 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3835/7665] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:40:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:40:11.040354 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ade81-89c5-4b5f-ac66-4acd07e9c3a2 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:11.041771 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-081ade81-89c5-4b5f-ac66-4acd07e9c3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:11.058530 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ade81-89c5-4b5f-ac66-4acd07e9c3a2 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:11.061685 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24932ea-a0b5-4472-8f56-dc2e909e80b2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e302b1298dd04d6590e3d079f7b13b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:11.062372 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24932ea-a0b5-4472-8f56-dc2e909e80b2 service glance] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:11.062655 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24932ea-a0b5-4472-8f56-dc2e909e80b2 service glance] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:11.062930 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24932ea-a0b5-4472-8f56-dc2e909e80b2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:11.073604 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24932ea-a0b5-4472-8f56-dc2e909e80b2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:11.075022 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24932ea-a0b5-4472-8f56-dc2e909e80b2 service glance] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:11.085093 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3831/7666] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:40:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:40:11.139237 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59618ff2-6444-4c9c-a136-b9cf2f196a20 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:11.139700 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59618ff2-6444-4c9c-a136-b9cf2f196a20 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:11.145220 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59618ff2-6444-4c9c-a136-b9cf2f196a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:11.159137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-59618ff2-6444-4c9c-a136-b9cf2f196a20 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:40:11.160440 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-59618ff2-6444-4c9c-a136-b9cf2f196a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:11.167858 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3836/7667] 10.222.0.23 () {58 vars in 967 bytes} [Sat Apr 30 21:40:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:40:11.183454 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24932ea-a0b5-4472-8f56-dc2e909e80b2 service glance] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:11.199504 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24932ea-a0b5-4472-8f56-dc2e909e80b2 service glance] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:11.205962 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9336b0a-e794-4292-8fe2-1ed0d5c5930f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:11.210845 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9336b0a-e794-4292-8fe2-1ed0d5c5930f service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:11.210845 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9336b0a-e794-4292-8fe2-1ed0d5c5930f service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:11.210845 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9336b0a-e794-4292-8fe2-1ed0d5c5930f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:11.217490 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9336b0a-e794-4292-8fe2-1ed0d5c5930f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:11.219179 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9336b0a-e794-4292-8fe2-1ed0d5c5930f service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:11.229012 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3832/7668] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:40:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 30 21:40:11.672160 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59618ff2-6444-4c9c-a136-b9cf2f196a20 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:11.734353 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59618ff2-6444-4c9c-a136-b9cf2f196a20 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:11.738991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37301064-1c54-45eb-8ea1-65ecec2c7a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:11.740064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37301064-1c54-45eb-8ea1-65ecec2c7a3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:11.740397 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37301064-1c54-45eb-8ea1-65ecec2c7a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:11.741061 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37301064-1c54-45eb-8ea1-65ecec2c7a3d admin admin] PATH_INFO: `/v3/users/c46381d6d2854033885043d30cee857a` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:11.741946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37301064-1c54-45eb-8ea1-65ecec2c7a3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c46381d6d2854033885043d30cee857a)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:11.750040 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37301064-1c54-45eb-8ea1-65ecec2c7a3d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:11.947986 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-37301064-1c54-45eb-8ea1-65ecec2c7a3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c46381d6d2854033885043d30cee857a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:11.960128 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-37301064-1c54-45eb-8ea1-65ecec2c7a3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c46381d6d2854033885043d30cee857a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:12.094730 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-37301064-1c54-45eb-8ea1-65ecec2c7a3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c46381d6d2854033885043d30cee857a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:12.102599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-37301064-1c54-45eb-8ea1-65ecec2c7a3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c46381d6d2854033885043d30cee857a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:12.103273 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-37301064-1c54-45eb-8ea1-65ecec2c7a3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c46381d6d2854033885043d30cee857a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:12.112343 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3837/7669] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:40:11 2022] DELETE /identity/v3/users/c46381d6d2854033885043d30cee857a => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:12.114518 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751cf49-1ce3-47b4-8103-1148e42bd42a None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:12.114967 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751cf49-1ce3-47b4-8103-1148e42bd42a None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:12.115065 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751cf49-1ce3-47b4-8103-1148e42bd42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:12.134223 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-e751cf49-1ce3-47b4-8103-1148e42bd42a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:40:12.135421 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e751cf49-1ce3-47b4-8103-1148e42bd42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:12.193848 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3833/7670] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:40:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:40:12.203346 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37301064-1c54-45eb-8ea1-65ecec2c7a3d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:12.204736 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-37301064-1c54-45eb-8ea1-65ecec2c7a3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:12.263233 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37301064-1c54-45eb-8ea1-65ecec2c7a3d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:12.266849 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5ca26-8751-46cf-a564-26185d3cd04e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:12.268471 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5ca26-8751-46cf-a564-26185d3cd04e service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:12.268752 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5ca26-8751-46cf-a564-26185d3cd04e service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:12.269028 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5ca26-8751-46cf-a564-26185d3cd04e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:12.279540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5ca26-8751-46cf-a564-26185d3cd04e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:12.281016 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5ca26-8751-46cf-a564-26185d3cd04e service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:12.290791 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3838/7671] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:40:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:40:12.686539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751cf49-1ce3-47b4-8103-1148e42bd42a None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:12.688026 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e751cf49-1ce3-47b4-8103-1148e42bd42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:12.702352 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751cf49-1ce3-47b4-8103-1148e42bd42a None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:12.711059 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf33c4a4-08f1-4247-bbc7-05ff296b3bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:12.712058 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33c4a4-08f1-4247-bbc7-05ff296b3bbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:12.712396 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33c4a4-08f1-4247-bbc7-05ff296b3bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:12.712975 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33c4a4-08f1-4247-bbc7-05ff296b3bbc admin admin] PATH_INFO: `/v3/projects/978ca8b782ba493b9662742ec0723a39` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:12.714085 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf33c4a4-08f1-4247-bbc7-05ff296b3bbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=978ca8b782ba493b9662742ec0723a39)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:12.716409 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf33c4a4-08f1-4247-bbc7-05ff296b3bbc admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:12.861574 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-bf33c4a4-08f1-4247-bbc7-05ff296b3bbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '978ca8b782ba493b9662742ec0723a39', 'request_id': 'req-bf33c4a4-08f1-4247-bbc7-05ff296b3bbc'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:12.871055 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-bf33c4a4-08f1-4247-bbc7-05ff296b3bbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '978ca8b782ba493b9662742ec0723a39', 'request_id': 'req-bf33c4a4-08f1-4247-bbc7-05ff296b3bbc'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:12.881368 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-bf33c4a4-08f1-4247-bbc7-05ff296b3bbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '978ca8b782ba493b9662742ec0723a39', 'request_id': 'req-bf33c4a4-08f1-4247-bbc7-05ff296b3bbc'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:12.970934 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-bf33c4a4-08f1-4247-bbc7-05ff296b3bbc admin admin] The token cache is being invalidate because project 978ca8b782ba493b9662742ec0723a39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:40:12.970934 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-bf33c4a4-08f1-4247-bbc7-05ff296b3bbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:12.971156 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-bf33c4a4-08f1-4247-bbc7-05ff296b3bbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:12.972733 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3834/7672] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:40:12 2022] DELETE /identity/v3/projects/978ca8b782ba493b9662742ec0723a39 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:12.977902 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5ca26-8751-46cf-a564-26185d3cd04e service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:12.988322 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5ca26-8751-46cf-a564-26185d3cd04e service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:13.060635 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd29c52-ba58-43d5-a579-a90d69d872f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:13.061571 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd29c52-ba58-43d5-a579-a90d69d872f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:13.061880 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd29c52-ba58-43d5-a579-a90d69d872f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:13.062156 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd29c52-ba58-43d5-a579-a90d69d872f4 admin admin] PATH_INFO: `/v3/users/ca311349c0f2455ab6c06bd1bcfa5a17` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:13.065377 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd29c52-ba58-43d5-a579-a90d69d872f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca311349c0f2455ab6c06bd1bcfa5a17)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:13.065377 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd29c52-ba58-43d5-a579-a90d69d872f4 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:13.262831 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-efd29c52-ba58-43d5-a579-a90d69d872f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca311349c0f2455ab6c06bd1bcfa5a17'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:13.287195 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-efd29c52-ba58-43d5-a579-a90d69d872f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca311349c0f2455ab6c06bd1bcfa5a17'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:13.364978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-efd29c52-ba58-43d5-a579-a90d69d872f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca311349c0f2455ab6c06bd1bcfa5a17'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:13.374528 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-efd29c52-ba58-43d5-a579-a90d69d872f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca311349c0f2455ab6c06bd1bcfa5a17'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:13.375361 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-efd29c52-ba58-43d5-a579-a90d69d872f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca311349c0f2455ab6c06bd1bcfa5a17'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:13.388436 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3839/7673] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:40:12 2022] DELETE /identity/v3/users/ca311349c0f2455ab6c06bd1bcfa5a17 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:13.927553 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf33c4a4-08f1-4247-bbc7-05ff296b3bbc admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:13.929340 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-bf33c4a4-08f1-4247-bbc7-05ff296b3bbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:13.944371 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf33c4a4-08f1-4247-bbc7-05ff296b3bbc admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:14.015189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b166e-6599-4a80-848e-af7d3da69efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:14.016323 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b166e-6599-4a80-848e-af7d3da69efc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:14.016611 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b166e-6599-4a80-848e-af7d3da69efc admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:14.017015 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b166e-6599-4a80-848e-af7d3da69efc admin admin] PATH_INFO: `/v3/projects/64e87bf9d16f458993aff26b30ae2403` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:14.021689 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b166e-6599-4a80-848e-af7d3da69efc admin admin] RBAC: Authorizing `identity:delete_project(project_id=64e87bf9d16f458993aff26b30ae2403)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:14.026084 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b166e-6599-4a80-848e-af7d3da69efc admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:14.129858 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2e3b166e-6599-4a80-848e-af7d3da69efc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64e87bf9d16f458993aff26b30ae2403', 'request_id': 'req-2e3b166e-6599-4a80-848e-af7d3da69efc'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:14.135587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2e3b166e-6599-4a80-848e-af7d3da69efc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64e87bf9d16f458993aff26b30ae2403', 'request_id': 'req-2e3b166e-6599-4a80-848e-af7d3da69efc'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:14.141950 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2e3b166e-6599-4a80-848e-af7d3da69efc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64e87bf9d16f458993aff26b30ae2403', 'request_id': 'req-2e3b166e-6599-4a80-848e-af7d3da69efc'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:14.225741 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2e3b166e-6599-4a80-848e-af7d3da69efc admin admin] The token cache is being invalidate because project 64e87bf9d16f458993aff26b30ae2403 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:40:14.226065 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2e3b166e-6599-4a80-848e-af7d3da69efc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:14.226733 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2e3b166e-6599-4a80-848e-af7d3da69efc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:14.228330 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3835/7674] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:40:13 2022] DELETE /identity/v3/projects/64e87bf9d16f458993aff26b30ae2403 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:14.234474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bcf26-4251-4392-94e6-7a427c2ebdf3 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:14.234759 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bcf26-4251-4392-94e6-7a427c2ebdf3 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:14.235064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bcf26-4251-4392-94e6-7a427c2ebdf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:14.252760 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-668bcf26-4251-4392-94e6-7a427c2ebdf3 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:40:14.253982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-668bcf26-4251-4392-94e6-7a427c2ebdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:14.322187 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3840/7675] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:40:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:40:14.335040 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090b990-8e65-42c6-b5bd-7cdb51de797a None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:14.335331 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090b990-8e65-42c6-b5bd-7cdb51de797a None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:14.335616 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090b990-8e65-42c6-b5bd-7cdb51de797a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:14.360097 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-c090b990-8e65-42c6-b5bd-7cdb51de797a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:40:14.361316 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c090b990-8e65-42c6-b5bd-7cdb51de797a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:14.369491 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3836/7676] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:40:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:40:14.373778 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668bcf26-4251-4392-94e6-7a427c2ebdf3 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:14.384093 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668bcf26-4251-4392-94e6-7a427c2ebdf3 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:14.388735 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d4b93-67ef-47f5-ba96-b07e31911e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:14.389382 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d4b93-67ef-47f5-ba96-b07e31911e7d admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:14.389662 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d4b93-67ef-47f5-ba96-b07e31911e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:14.389972 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d4b93-67ef-47f5-ba96-b07e31911e7d admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:14.390684 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d4b93-67ef-47f5-ba96-b07e31911e7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:40:14.390986 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d4b93-67ef-47f5-ba96-b07e31911e7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:14.392613 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d4b93-67ef-47f5-ba96-b07e31911e7d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:14.404862 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3841/7677] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:40:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:40:14.409537 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090b990-8e65-42c6-b5bd-7cdb51de797a None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:14.419100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090b990-8e65-42c6-b5bd-7cdb51de797a None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:14.423901 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f163c2-a167-47e1-aefb-023861c62f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:14.424567 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f163c2-a167-47e1-aefb-023861c62f49 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:14.424878 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f163c2-a167-47e1-aefb-023861c62f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:14.425158 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f163c2-a167-47e1-aefb-023861c62f49 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:14.425935 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f163c2-a167-47e1-aefb-023861c62f49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:14.427869 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f163c2-a167-47e1-aefb-023861c62f49 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:14.561839 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3837/7678] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:40:14 2022] POST /identity/v3/projects => generated 369 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:40:14.566108 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d4b93-67ef-47f5-ba96-b07e31911e7d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:14.579149 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d4b93-67ef-47f5-ba96-b07e31911e7d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:14.659136 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e6dac-8547-46a4-a144-f79da04f5ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:14.659830 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e6dac-8547-46a4-a144-f79da04f5ede admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:14.660114 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e6dac-8547-46a4-a144-f79da04f5ede admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:14.660711 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e6dac-8547-46a4-a144-f79da04f5ede admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:14.661697 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438e6dac-8547-46a4-a144-f79da04f5ede admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:14.663946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438e6dac-8547-46a4-a144-f79da04f5ede admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:14.745586 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3842/7679] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:40:14 2022] POST /identity/v3/users => generated 285 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:40:14.746857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f163c2-a167-47e1-aefb-023861c62f49 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:14.757494 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f163c2-a167-47e1-aefb-023861c62f49 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:14.762406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be7eae-b1a0-4b87-98d6-e624c308392b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:14.763073 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be7eae-b1a0-4b87-98d6-e624c308392b admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:14.768128 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be7eae-b1a0-4b87-98d6-e624c308392b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:14.768128 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be7eae-b1a0-4b87-98d6-e624c308392b admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:14.768128 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be7eae-b1a0-4b87-98d6-e624c308392b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:14.768128 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be7eae-b1a0-4b87-98d6-e624c308392b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:14.777688 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3838/7680] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:40:14.781826 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e6dac-8547-46a4-a144-f79da04f5ede admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:14.793027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e6dac-8547-46a4-a144-f79da04f5ede admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:14.799858 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4997e8-37c2-4335-bdfa-1e44470201fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:14.799858 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4997e8-37c2-4335-bdfa-1e44470201fb admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:14.799858 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4997e8-37c2-4335-bdfa-1e44470201fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:14.799858 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4997e8-37c2-4335-bdfa-1e44470201fb admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:14.800295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4997e8-37c2-4335-bdfa-1e44470201fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:14.801783 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4997e8-37c2-4335-bdfa-1e44470201fb admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:14.815342 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3843/7681] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:40:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:40:14.816622 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be7eae-b1a0-4b87-98d6-e624c308392b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:14.827246 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be7eae-b1a0-4b87-98d6-e624c308392b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:14.832437 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e3952-61c5-4cc8-a448-528fff84ee12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:14.834073 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e3952-61c5-4cc8-a448-528fff84ee12 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:14.834526 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e3952-61c5-4cc8-a448-528fff84ee12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:14.834999 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e3952-61c5-4cc8-a448-528fff84ee12 admin admin] PATH_INFO: `/v3/projects/a3279192b1cf45ceb1421b11da6f2032/users/b3c1df98a3344b069fd6a17a92a3e783/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:14.855947 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e3952-61c5-4cc8-a448-528fff84ee12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3279192b1cf45ceb1421b11da6f2032, user_id=b3c1df98a3344b069fd6a17a92a3e783, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:14.860967 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e3952-61c5-4cc8-a448-528fff84ee12 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:14.936736 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3839/7682] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:40:14 2022] PUT /identity/v3/projects/a3279192b1cf45ceb1421b11da6f2032/users/b3c1df98a3344b069fd6a17a92a3e783/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:40:15.032792 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25de15-8927-4dd5-80e4-547036549443 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:15.033175 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25de15-8927-4dd5-80e4-547036549443 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:15.034969 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25de15-8927-4dd5-80e4-547036549443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:15.070540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-1d25de15-8927-4dd5-80e4-547036549443 None None] MFA Rules not processed for user `b3c1df98a3344b069fd6a17a92a3e783`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:40:15.073888 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1d25de15-8927-4dd5-80e4-547036549443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:15.160344 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3844/7683] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:40:15 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:40:15.165059 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e3952-61c5-4cc8-a448-528fff84ee12 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:15.259295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e3952-61c5-4cc8-a448-528fff84ee12 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:15.265648 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9add2-9a05-4a3f-86f8-ae4418263bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:15.266420 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9add2-9a05-4a3f-86f8-ae4418263bc5 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:15.266773 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9add2-9a05-4a3f-86f8-ae4418263bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:15.285085 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9add2-9a05-4a3f-86f8-ae4418263bc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:15.285948 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9add2-9a05-4a3f-86f8-ae4418263bc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:15.287947 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9add2-9a05-4a3f-86f8-ae4418263bc5 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:15.460414 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3840/7684] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:40:15 2022] POST /identity/v3/projects => generated 367 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:40:15.461846 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25de15-8927-4dd5-80e4-547036549443 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:15.477164 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25de15-8927-4dd5-80e4-547036549443 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:15.547890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff923cc-0aca-4d4a-aa4a-c16a9125ab6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:15.548574 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff923cc-0aca-4d4a-aa4a-c16a9125ab6e admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:15.548862 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff923cc-0aca-4d4a-aa4a-c16a9125ab6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:15.549337 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff923cc-0aca-4d4a-aa4a-c16a9125ab6e admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:15.549863 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff923cc-0aca-4d4a-aa4a-c16a9125ab6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:15.552752 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff923cc-0aca-4d4a-aa4a-c16a9125ab6e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:15.652267 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3845/7685] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:40:15 2022] POST /identity/v3/users => generated 290 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:40:15.656672 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9add2-9a05-4a3f-86f8-ae4418263bc5 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:15.679640 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9add2-9a05-4a3f-86f8-ae4418263bc5 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:15.688769 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7773006-814a-4f4f-8e46-8ae9249b2152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:15.690385 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7773006-814a-4f4f-8e46-8ae9249b2152 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:15.690902 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7773006-814a-4f4f-8e46-8ae9249b2152 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:15.691648 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7773006-814a-4f4f-8e46-8ae9249b2152 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:15.693519 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7773006-814a-4f4f-8e46-8ae9249b2152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:15.697205 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7773006-814a-4f4f-8e46-8ae9249b2152 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:15.725716 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3841/7686] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:40:15.727889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff923cc-0aca-4d4a-aa4a-c16a9125ab6e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:15.746234 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff923cc-0aca-4d4a-aa4a-c16a9125ab6e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:15.754427 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65cace-3f8a-473a-9be7-f92f06b61e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:15.755820 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65cace-3f8a-473a-9be7-f92f06b61e83 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:15.756331 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65cace-3f8a-473a-9be7-f92f06b61e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:15.756839 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65cace-3f8a-473a-9be7-f92f06b61e83 admin admin] PATH_INFO: `/v3/projects/4d466328f1dd4442a320735257f5af78/users/bf5a7e98448948ee87db54def86c1376/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:15.783933 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e65cace-3f8a-473a-9be7-f92f06b61e83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d466328f1dd4442a320735257f5af78, user_id=bf5a7e98448948ee87db54def86c1376, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:15.789935 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e65cace-3f8a-473a-9be7-f92f06b61e83 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:15.917400 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3846/7687] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:40:15 2022] PUT /identity/v3/projects/4d466328f1dd4442a320735257f5af78/users/bf5a7e98448948ee87db54def86c1376/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:15.921678 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7773006-814a-4f4f-8e46-8ae9249b2152 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:15.938962 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7773006-814a-4f4f-8e46-8ae9249b2152 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:16.002284 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543a031-27d5-4432-8fea-820079919f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:16.003106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543a031-27d5-4432-8fea-820079919f58 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:16.003665 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543a031-27d5-4432-8fea-820079919f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:16.004006 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543a031-27d5-4432-8fea-820079919f58 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:16.005895 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543a031-27d5-4432-8fea-820079919f58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:16.007763 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543a031-27d5-4432-8fea-820079919f58 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:16.019651 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3842/7688] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:40:16.024828 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65cace-3f8a-473a-9be7-f92f06b61e83 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:16.036148 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65cace-3f8a-473a-9be7-f92f06b61e83 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:16.048545 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfdc51e-8571-4d8e-8790-608ea408494e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:16.049506 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfdc51e-8571-4d8e-8790-608ea408494e admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:16.050164 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfdc51e-8571-4d8e-8790-608ea408494e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:16.050164 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfdc51e-8571-4d8e-8790-608ea408494e admin admin] PATH_INFO: `/v3/projects/4d466328f1dd4442a320735257f5af78/users/bf5a7e98448948ee87db54def86c1376/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:16.056864 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfdc51e-8571-4d8e-8790-608ea408494e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d466328f1dd4442a320735257f5af78, user_id=bf5a7e98448948ee87db54def86c1376, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:16.056864 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfdc51e-8571-4d8e-8790-608ea408494e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:16.079966 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3847/7689] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:40:16 2022] PUT /identity/v3/projects/4d466328f1dd4442a320735257f5af78/users/bf5a7e98448948ee87db54def86c1376/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:16.080149 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3afdf6-dc25-402e-b4b3-0799a4fec4b4 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:16.080149 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3afdf6-dc25-402e-b4b3-0799a4fec4b4 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:16.080366 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3afdf6-dc25-402e-b4b3-0799a4fec4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:16.109996 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-7d3afdf6-dc25-402e-b4b3-0799a4fec4b4 None None] MFA Rules not processed for user `bf5a7e98448948ee87db54def86c1376`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:40:16.111336 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7d3afdf6-dc25-402e-b4b3-0799a4fec4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:16.205478 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3843/7690] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:40:16 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:40:16.216585 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfdc51e-8571-4d8e-8790-608ea408494e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:16.218971 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-acfdc51e-8571-4d8e-8790-608ea408494e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:16.285034 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfdc51e-8571-4d8e-8790-608ea408494e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:16.288724 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18841e10-f1cd-47f7-93db-f7082aa63a81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:16.289368 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18841e10-f1cd-47f7-93db-f7082aa63a81 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:16.289696 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18841e10-f1cd-47f7-93db-f7082aa63a81 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:16.289985 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18841e10-f1cd-47f7-93db-f7082aa63a81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:16.302828 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18841e10-f1cd-47f7-93db-f7082aa63a81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:16.304438 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18841e10-f1cd-47f7-93db-f7082aa63a81 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:16.318817 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3848/7691] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:40:16 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:40:17.575164 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3afdf6-dc25-402e-b4b3-0799a4fec4b4 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:17.576647 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7d3afdf6-dc25-402e-b4b3-0799a4fec4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:17.647344 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3afdf6-dc25-402e-b4b3-0799a4fec4b4 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:17.652127 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1ebec-1746-4846-96ec-e0032666dbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:17.653003 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1ebec-1746-4846-96ec-e0032666dbed admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:17.653330 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1ebec-1746-4846-96ec-e0032666dbed admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:17.653598 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1ebec-1746-4846-96ec-e0032666dbed admin admin] PATH_INFO: `/v3/users/63517d4efe294384832f5674aadc0c63` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:17.654849 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1ebec-1746-4846-96ec-e0032666dbed admin admin] RBAC: Authorizing `identity:delete_user(user_id=63517d4efe294384832f5674aadc0c63)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:17.656809 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1ebec-1746-4846-96ec-e0032666dbed admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:17.890515 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-22f1ebec-1746-4846-96ec-e0032666dbed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63517d4efe294384832f5674aadc0c63'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:17.929520 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-22f1ebec-1746-4846-96ec-e0032666dbed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63517d4efe294384832f5674aadc0c63'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:17.935271 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18841e10-f1cd-47f7-93db-f7082aa63a81 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:17.936853 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-18841e10-f1cd-47f7-93db-f7082aa63a81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:17.953138 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18841e10-f1cd-47f7-93db-f7082aa63a81 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:17.958234 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc9494-6f69-4756-bff6-fd045a1c513b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:17.958234 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc9494-6f69-4756-bff6-fd045a1c513b service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:17.958234 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc9494-6f69-4756-bff6-fd045a1c513b service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:17.958668 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc9494-6f69-4756-bff6-fd045a1c513b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:17.962504 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-54bc9494-6f69-4756-bff6-fd045a1c513b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:17.984896 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc9494-6f69-4756-bff6-fd045a1c513b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:17.986973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc9494-6f69-4756-bff6-fd045a1c513b service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:17.999004 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3849/7692] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:40:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:40:18.004955 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-22f1ebec-1746-4846-96ec-e0032666dbed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63517d4efe294384832f5674aadc0c63'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:18.005955 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-22f1ebec-1746-4846-96ec-e0032666dbed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63517d4efe294384832f5674aadc0c63'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:18.015997 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-22f1ebec-1746-4846-96ec-e0032666dbed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63517d4efe294384832f5674aadc0c63'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:18.025803 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3844/7693] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:40:17 2022] DELETE /identity/v3/users/63517d4efe294384832f5674aadc0c63 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:18.030587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af00a2-37a7-457b-baee-0cd68af564e1 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:18.031108 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af00a2-37a7-457b-baee-0cd68af564e1 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:18.031615 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af00a2-37a7-457b-baee-0cd68af564e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:18.050558 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-d3af00a2-37a7-457b-baee-0cd68af564e1 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:40:18.052367 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d3af00a2-37a7-457b-baee-0cd68af564e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:18.132448 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3850/7694] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:40:18.142291 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1ebec-1746-4846-96ec-e0032666dbed admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:18.143993 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-22f1ebec-1746-4846-96ec-e0032666dbed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:18.242484 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1ebec-1746-4846-96ec-e0032666dbed admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:18.246469 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b03ba-5ab5-440b-99bd-e3de7a97bb46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:18.247294 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b03ba-5ab5-440b-99bd-e3de7a97bb46 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:18.247455 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b03ba-5ab5-440b-99bd-e3de7a97bb46 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:18.247689 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b03ba-5ab5-440b-99bd-e3de7a97bb46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:18.259112 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b03ba-5ab5-440b-99bd-e3de7a97bb46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:18.260605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b03ba-5ab5-440b-99bd-e3de7a97bb46 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:18.276887 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3845/7695] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:40:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:40:18.775817 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526c4fe-0fb4-4292-ac80-5c2587bfa58a None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:18.775817 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526c4fe-0fb4-4292-ac80-5c2587bfa58a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:18.775817 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526c4fe-0fb4-4292-ac80-5c2587bfa58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:18.775817 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-1526c4fe-0fb4-4292-ac80-5c2587bfa58a None None] MFA Rules not processed for user `ee330c1468ae4085be6675b99c75c17c`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:40:18.775817 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1526c4fe-0fb4-4292-ac80-5c2587bfa58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:18.775817 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3851/7696] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:40:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:40:18.865453 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b03ba-5ab5-440b-99bd-e3de7a97bb46 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:18.867091 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ef6b03ba-5ab5-440b-99bd-e3de7a97bb46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:18.885347 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b03ba-5ab5-440b-99bd-e3de7a97bb46 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:18.890887 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c3106d-1456-4a35-886f-438bf192d79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:18.891962 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3106d-1456-4a35-886f-438bf192d79c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:18.892407 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3106d-1456-4a35-886f-438bf192d79c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:18.892895 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3106d-1456-4a35-886f-438bf192d79c admin admin] PATH_INFO: `/v3/projects/4e3f82b1b832495896f59d90477f6e44` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:18.894947 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c3106d-1456-4a35-886f-438bf192d79c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e3f82b1b832495896f59d90477f6e44)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:18.901147 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c3106d-1456-4a35-886f-438bf192d79c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:18.971695 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526c4fe-0fb4-4292-ac80-5c2587bfa58a None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:18.974113 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1526c4fe-0fb4-4292-ac80-5c2587bfa58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:18.988162 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526c4fe-0fb4-4292-ac80-5c2587bfa58a None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:18.994636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19aed7a-0251-4997-a43d-6e218693e630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:18.995520 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19aed7a-0251-4997-a43d-6e218693e630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:18.995805 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19aed7a-0251-4997-a43d-6e218693e630 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:18.996081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19aed7a-0251-4997-a43d-6e218693e630 admin admin] PATH_INFO: `/v3/users/b3c1df98a3344b069fd6a17a92a3e783` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:18.997297 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19aed7a-0251-4997-a43d-6e218693e630 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3c1df98a3344b069fd6a17a92a3e783)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:18.999476 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19aed7a-0251-4997-a43d-6e218693e630 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:19.023419 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-42c3106d-1456-4a35-886f-438bf192d79c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e3f82b1b832495896f59d90477f6e44', 'request_id': 'req-42c3106d-1456-4a35-886f-438bf192d79c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:19.031764 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-42c3106d-1456-4a35-886f-438bf192d79c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e3f82b1b832495896f59d90477f6e44', 'request_id': 'req-42c3106d-1456-4a35-886f-438bf192d79c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:19.039343 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-42c3106d-1456-4a35-886f-438bf192d79c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e3f82b1b832495896f59d90477f6e44', 'request_id': 'req-42c3106d-1456-4a35-886f-438bf192d79c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:19.124231 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-42c3106d-1456-4a35-886f-438bf192d79c admin admin] The token cache is being invalidate because project 4e3f82b1b832495896f59d90477f6e44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:40:19.124759 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-42c3106d-1456-4a35-886f-438bf192d79c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:19.125402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-42c3106d-1456-4a35-886f-438bf192d79c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:19.127165 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3846/7697] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:40:18 2022] DELETE /identity/v3/projects/4e3f82b1b832495896f59d90477f6e44 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:19.131853 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c3106d-1456-4a35-886f-438bf192d79c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:19.133611 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-42c3106d-1456-4a35-886f-438bf192d79c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:19.196611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f19aed7a-0251-4997-a43d-6e218693e630 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3c1df98a3344b069fd6a17a92a3e783'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:19.201745 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c3106d-1456-4a35-886f-438bf192d79c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:19.211579 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9c904-7341-4e5e-9080-e9f3fb478d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:19.212631 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9c904-7341-4e5e-9080-e9f3fb478d38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:19.213016 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f19aed7a-0251-4997-a43d-6e218693e630 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3c1df98a3344b069fd6a17a92a3e783'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:19.213902 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9c904-7341-4e5e-9080-e9f3fb478d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:19.214837 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9c904-7341-4e5e-9080-e9f3fb478d38 admin admin] PATH_INFO: `/v3/users/52c2f3dc4c71466db3b3a2ce49d01656` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:19.219170 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9c904-7341-4e5e-9080-e9f3fb478d38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52c2f3dc4c71466db3b3a2ce49d01656)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:19.221634 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de9c904-7341-4e5e-9080-e9f3fb478d38 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:19.291930 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f19aed7a-0251-4997-a43d-6e218693e630 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3c1df98a3344b069fd6a17a92a3e783'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:19.298122 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f19aed7a-0251-4997-a43d-6e218693e630 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3c1df98a3344b069fd6a17a92a3e783'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:19.298839 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f19aed7a-0251-4997-a43d-6e218693e630 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3c1df98a3344b069fd6a17a92a3e783'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:19.304833 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3852/7698] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:40:18 2022] DELETE /identity/v3/users/b3c1df98a3344b069fd6a17a92a3e783 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:19.309129 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba1e3c-23a5-42cd-be67-63a3cd59bc66 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:19.309410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba1e3c-23a5-42cd-be67-63a3cd59bc66 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:19.309687 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba1e3c-23a5-42cd-be67-63a3cd59bc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:19.328883 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-fdba1e3c-23a5-42cd-be67-63a3cd59bc66 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:40:19.330141 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-fdba1e3c-23a5-42cd-be67-63a3cd59bc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:19.414275 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3853/7699] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:40:19.415455 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7de9c904-7341-4e5e-9080-e9f3fb478d38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52c2f3dc4c71466db3b3a2ce49d01656'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:19.425384 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba1e3c-23a5-42cd-be67-63a3cd59bc66 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:19.428217 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-fdba1e3c-23a5-42cd-be67-63a3cd59bc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:19.433136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7de9c904-7341-4e5e-9080-e9f3fb478d38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52c2f3dc4c71466db3b3a2ce49d01656'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:19.508260 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7de9c904-7341-4e5e-9080-e9f3fb478d38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52c2f3dc4c71466db3b3a2ce49d01656'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:19.508975 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7de9c904-7341-4e5e-9080-e9f3fb478d38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52c2f3dc4c71466db3b3a2ce49d01656'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:19.528009 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7de9c904-7341-4e5e-9080-e9f3fb478d38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52c2f3dc4c71466db3b3a2ce49d01656'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:19.540676 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3847/7700] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:40:19 2022] DELETE /identity/v3/users/52c2f3dc4c71466db3b3a2ce49d01656 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:40:19.560287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba1e3c-23a5-42cd-be67-63a3cd59bc66 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:19.647356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ace1c5-07ec-4362-9e87-3ee2078a35d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:19.648403 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ace1c5-07ec-4362-9e87-3ee2078a35d1 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:19.648800 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ace1c5-07ec-4362-9e87-3ee2078a35d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:19.649510 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ace1c5-07ec-4362-9e87-3ee2078a35d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:19.655282 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-16ace1c5-07ec-4362-9e87-3ee2078a35d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:19.723071 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ace1c5-07ec-4362-9e87-3ee2078a35d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:19.724661 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ace1c5-07ec-4362-9e87-3ee2078a35d1 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:19.739992 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3854/7701] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:40:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:40:20.194728 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9c904-7341-4e5e-9080-e9f3fb478d38 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:20.197380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7de9c904-7341-4e5e-9080-e9f3fb478d38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:20.239356 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de9c904-7341-4e5e-9080-e9f3fb478d38 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:20.247739 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5612aaf-34bd-496b-bbe0-ad015266c80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:20.250149 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5612aaf-34bd-496b-bbe0-ad015266c80c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:20.250664 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5612aaf-34bd-496b-bbe0-ad015266c80c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:20.251109 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5612aaf-34bd-496b-bbe0-ad015266c80c admin admin] PATH_INFO: `/v3/projects/14733c8ecbd44e0195d7c8d62ccba663` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:20.256150 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5612aaf-34bd-496b-bbe0-ad015266c80c admin admin] RBAC: Authorizing `identity:delete_project(project_id=14733c8ecbd44e0195d7c8d62ccba663)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:20.256632 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5612aaf-34bd-496b-bbe0-ad015266c80c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:20.396544 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ace1c5-07ec-4362-9e87-3ee2078a35d1 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:20.398501 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-16ace1c5-07ec-4362-9e87-3ee2078a35d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:20.420152 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ace1c5-07ec-4362-9e87-3ee2078a35d1 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:20.442989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f5612aaf-34bd-496b-bbe0-ad015266c80c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14733c8ecbd44e0195d7c8d62ccba663', 'request_id': 'req-f5612aaf-34bd-496b-bbe0-ad015266c80c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:20.452079 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f5612aaf-34bd-496b-bbe0-ad015266c80c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14733c8ecbd44e0195d7c8d62ccba663', 'request_id': 'req-f5612aaf-34bd-496b-bbe0-ad015266c80c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:20.478509 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f5612aaf-34bd-496b-bbe0-ad015266c80c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14733c8ecbd44e0195d7c8d62ccba663', 'request_id': 'req-f5612aaf-34bd-496b-bbe0-ad015266c80c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:20.509140 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c58399-d423-4400-ba98-551d17f00736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:20.510054 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c58399-d423-4400-ba98-551d17f00736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:20.510336 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c58399-d423-4400-ba98-551d17f00736 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:20.510610 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c58399-d423-4400-ba98-551d17f00736 admin admin] PATH_INFO: `/v3/projects/a3279192b1cf45ceb1421b11da6f2032` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:20.511906 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c58399-d423-4400-ba98-551d17f00736 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3279192b1cf45ceb1421b11da6f2032)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:20.513890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c58399-d423-4400-ba98-551d17f00736 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:20.591943 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f5612aaf-34bd-496b-bbe0-ad015266c80c admin admin] The token cache is being invalidate because project 14733c8ecbd44e0195d7c8d62ccba663 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:40:20.592238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f5612aaf-34bd-496b-bbe0-ad015266c80c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:20.593137 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f5612aaf-34bd-496b-bbe0-ad015266c80c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:20.597801 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3848/7702] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:40:20 2022] DELETE /identity/v3/projects/14733c8ecbd44e0195d7c8d62ccba663 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:20.599932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5612aaf-34bd-496b-bbe0-ad015266c80c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:20.601336 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f5612aaf-34bd-496b-bbe0-ad015266c80c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:20.617731 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5612aaf-34bd-496b-bbe0-ad015266c80c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:20.626890 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5933db-8c5d-4252-ae7e-31a433601591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:20.627919 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5933db-8c5d-4252-ae7e-31a433601591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:20.628210 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5933db-8c5d-4252-ae7e-31a433601591 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:20.628488 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5933db-8c5d-4252-ae7e-31a433601591 admin admin] PATH_INFO: `/v3/users/6a9383d35aa74539a9882d3de6aea15f` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:20.630571 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5933db-8c5d-4252-ae7e-31a433601591 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a9383d35aa74539a9882d3de6aea15f)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:20.633053 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5933db-8c5d-4252-ae7e-31a433601591 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:20.660636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c1c58399-d423-4400-ba98-551d17f00736 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3279192b1cf45ceb1421b11da6f2032', 'request_id': 'req-c1c58399-d423-4400-ba98-551d17f00736'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:20.681402 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c1c58399-d423-4400-ba98-551d17f00736 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3279192b1cf45ceb1421b11da6f2032', 'request_id': 'req-c1c58399-d423-4400-ba98-551d17f00736'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:20.691907 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c1c58399-d423-4400-ba98-551d17f00736 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3279192b1cf45ceb1421b11da6f2032', 'request_id': 'req-c1c58399-d423-4400-ba98-551d17f00736'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:20.816129 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c1c58399-d423-4400-ba98-551d17f00736 admin admin] The token cache is being invalidate because project a3279192b1cf45ceb1421b11da6f2032 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:40:20.816593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c1c58399-d423-4400-ba98-551d17f00736 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:20.817466 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c1c58399-d423-4400-ba98-551d17f00736 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:20.819398 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3855/7703] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:40:20 2022] DELETE /identity/v3/projects/a3279192b1cf45ceb1421b11da6f2032 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:40:20.823277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c58399-d423-4400-ba98-551d17f00736 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:20.824978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c1c58399-d423-4400-ba98-551d17f00736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:20.870335 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0d5933db-8c5d-4252-ae7e-31a433601591 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a9383d35aa74539a9882d3de6aea15f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:20.901624 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0d5933db-8c5d-4252-ae7e-31a433601591 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a9383d35aa74539a9882d3de6aea15f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:20.918885 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c58399-d423-4400-ba98-551d17f00736 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:20.924002 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050222ff-535d-480a-a3fb-5244395c8436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:20.925055 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050222ff-535d-480a-a3fb-5244395c8436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:20.925343 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050222ff-535d-480a-a3fb-5244395c8436 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:20.925623 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050222ff-535d-480a-a3fb-5244395c8436 admin admin] PATH_INFO: `/v3/users/bf5a7e98448948ee87db54def86c1376` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:20.926903 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050222ff-535d-480a-a3fb-5244395c8436 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf5a7e98448948ee87db54def86c1376)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:20.928910 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050222ff-535d-480a-a3fb-5244395c8436 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:20.969188 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0d5933db-8c5d-4252-ae7e-31a433601591 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a9383d35aa74539a9882d3de6aea15f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:20.969836 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0d5933db-8c5d-4252-ae7e-31a433601591 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a9383d35aa74539a9882d3de6aea15f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:20.977264 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0d5933db-8c5d-4252-ae7e-31a433601591 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a9383d35aa74539a9882d3de6aea15f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:20.983147 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3849/7704] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:40:20 2022] DELETE /identity/v3/users/6a9383d35aa74539a9882d3de6aea15f => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:40:21.191627 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-050222ff-535d-480a-a3fb-5244395c8436 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf5a7e98448948ee87db54def86c1376'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:21.205036 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-050222ff-535d-480a-a3fb-5244395c8436 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf5a7e98448948ee87db54def86c1376'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:21.341043 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-050222ff-535d-480a-a3fb-5244395c8436 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf5a7e98448948ee87db54def86c1376'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:21.356173 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-050222ff-535d-480a-a3fb-5244395c8436 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf5a7e98448948ee87db54def86c1376'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:21.363031 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-050222ff-535d-480a-a3fb-5244395c8436 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf5a7e98448948ee87db54def86c1376'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:21.373951 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3856/7705] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:40:20 2022] DELETE /identity/v3/users/bf5a7e98448948ee87db54def86c1376 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:40:21.774295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5933db-8c5d-4252-ae7e-31a433601591 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:21.774295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0d5933db-8c5d-4252-ae7e-31a433601591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:21.930259 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5933db-8c5d-4252-ae7e-31a433601591 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:21.999435 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf0121-ba60-4369-89d4-9188d5fd467c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:22.000537 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf0121-ba60-4369-89d4-9188d5fd467c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:22.000997 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf0121-ba60-4369-89d4-9188d5fd467c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:22.001374 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf0121-ba60-4369-89d4-9188d5fd467c admin admin] PATH_INFO: `/v3/projects/32e7a1c0d7cd48438eab586b5bc14c7e` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:22.002834 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf0121-ba60-4369-89d4-9188d5fd467c admin admin] RBAC: Authorizing `identity:delete_project(project_id=32e7a1c0d7cd48438eab586b5bc14c7e)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:22.004957 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf0121-ba60-4369-89d4-9188d5fd467c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:22.147868 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-18bf0121-ba60-4369-89d4-9188d5fd467c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32e7a1c0d7cd48438eab586b5bc14c7e', 'request_id': 'req-18bf0121-ba60-4369-89d4-9188d5fd467c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:22.154721 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-18bf0121-ba60-4369-89d4-9188d5fd467c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32e7a1c0d7cd48438eab586b5bc14c7e', 'request_id': 'req-18bf0121-ba60-4369-89d4-9188d5fd467c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:22.162631 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-18bf0121-ba60-4369-89d4-9188d5fd467c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32e7a1c0d7cd48438eab586b5bc14c7e', 'request_id': 'req-18bf0121-ba60-4369-89d4-9188d5fd467c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:22.222525 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-18bf0121-ba60-4369-89d4-9188d5fd467c admin admin] The token cache is being invalidate because project 32e7a1c0d7cd48438eab586b5bc14c7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:40:22.222933 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-18bf0121-ba60-4369-89d4-9188d5fd467c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:22.226673 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-18bf0121-ba60-4369-89d4-9188d5fd467c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:22.230396 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3850/7706] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:40:21 2022] DELETE /identity/v3/projects/32e7a1c0d7cd48438eab586b5bc14c7e => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:22.706523 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050222ff-535d-480a-a3fb-5244395c8436 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:22.709432 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-050222ff-535d-480a-a3fb-5244395c8436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:22.796428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050222ff-535d-480a-a3fb-5244395c8436 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:22.884056 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1f1a0-b853-4d50-b97d-8dfe17d8ffd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:22.885118 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1f1a0-b853-4d50-b97d-8dfe17d8ffd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:22.885413 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1f1a0-b853-4d50-b97d-8dfe17d8ffd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:22.888165 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1f1a0-b853-4d50-b97d-8dfe17d8ffd5 admin admin] PATH_INFO: `/v3/projects/4d466328f1dd4442a320735257f5af78` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:22.888165 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1f1a0-b853-4d50-b97d-8dfe17d8ffd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d466328f1dd4442a320735257f5af78)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:22.889314 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1f1a0-b853-4d50-b97d-8dfe17d8ffd5 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:23.030543 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf0121-ba60-4369-89d4-9188d5fd467c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:23.032854 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-18bf0121-ba60-4369-89d4-9188d5fd467c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:23.036240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-55e1f1a0-b853-4d50-b97d-8dfe17d8ffd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d466328f1dd4442a320735257f5af78', 'request_id': 'req-55e1f1a0-b853-4d50-b97d-8dfe17d8ffd5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:23.047880 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-55e1f1a0-b853-4d50-b97d-8dfe17d8ffd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d466328f1dd4442a320735257f5af78', 'request_id': 'req-55e1f1a0-b853-4d50-b97d-8dfe17d8ffd5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:23.048418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf0121-ba60-4369-89d4-9188d5fd467c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:23.062978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-55e1f1a0-b853-4d50-b97d-8dfe17d8ffd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d466328f1dd4442a320735257f5af78', 'request_id': 'req-55e1f1a0-b853-4d50-b97d-8dfe17d8ffd5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:23.140108 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4e028-7a37-41db-b912-917020a9c2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:23.141063 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4e028-7a37-41db-b912-917020a9c2b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:23.141352 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4e028-7a37-41db-b912-917020a9c2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:23.141690 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4e028-7a37-41db-b912-917020a9c2b0 admin admin] PATH_INFO: `/v3/users/e9fa67fb4ad4472183b95067597f043e` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:23.143027 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4e028-7a37-41db-b912-917020a9c2b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9fa67fb4ad4472183b95067597f043e)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:23.145055 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4e028-7a37-41db-b912-917020a9c2b0 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:23.153390 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-55e1f1a0-b853-4d50-b97d-8dfe17d8ffd5 admin admin] The token cache is being invalidate because project 4d466328f1dd4442a320735257f5af78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:40:23.153775 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-55e1f1a0-b853-4d50-b97d-8dfe17d8ffd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:23.159882 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-55e1f1a0-b853-4d50-b97d-8dfe17d8ffd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:23.159882 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3857/7707] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:40:22 2022] DELETE /identity/v3/projects/4d466328f1dd4442a320735257f5af78 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:23.163415 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb9627-cf91-4136-ba70-b5da338865f6 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:23.163950 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb9627-cf91-4136-ba70-b5da338865f6 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:23.164432 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb9627-cf91-4136-ba70-b5da338865f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:23.188453 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-4ddb9627-cf91-4136-ba70-b5da338865f6 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:40:23.189973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4ddb9627-cf91-4136-ba70-b5da338865f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:23.206689 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3858/7708] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:40:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:40:23.208379 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358b5ed-6e1c-44e3-8d84-66b196788059 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:23.208674 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358b5ed-6e1c-44e3-8d84-66b196788059 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:23.208967 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358b5ed-6e1c-44e3-8d84-66b196788059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:23.229672 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-d358b5ed-6e1c-44e3-8d84-66b196788059 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:40:23.231066 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d358b5ed-6e1c-44e3-8d84-66b196788059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:23.240405 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3859/7709] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:40:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:40:23.244525 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d358b5ed-6e1c-44e3-8d84-66b196788059 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:23.263898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d358b5ed-6e1c-44e3-8d84-66b196788059 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:23.263898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed53963-804c-4e68-ace1-cfdd1b8f7d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:23.263898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed53963-804c-4e68-ace1-cfdd1b8f7d65 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:23.263898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed53963-804c-4e68-ace1-cfdd1b8f7d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:23.264231 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed53963-804c-4e68-ace1-cfdd1b8f7d65 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:23.264231 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed53963-804c-4e68-ace1-cfdd1b8f7d65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:40:23.264231 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed53963-804c-4e68-ace1-cfdd1b8f7d65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:23.264582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed53963-804c-4e68-ace1-cfdd1b8f7d65 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:23.281201 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3860/7710] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:40:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:40:23.285151 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed53963-804c-4e68-ace1-cfdd1b8f7d65 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:23.295307 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed53963-804c-4e68-ace1-cfdd1b8f7d65 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:23.300021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47094bcb-4eb7-43ac-a9a1-b362694df652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:23.300674 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47094bcb-4eb7-43ac-a9a1-b362694df652 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:23.300954 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47094bcb-4eb7-43ac-a9a1-b362694df652 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:23.301229 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47094bcb-4eb7-43ac-a9a1-b362694df652 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:23.301981 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47094bcb-4eb7-43ac-a9a1-b362694df652 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:23.303951 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47094bcb-4eb7-43ac-a9a1-b362694df652 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:23.360129 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-83b4e028-7a37-41db-b912-917020a9c2b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9fa67fb4ad4472183b95067597f043e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:23.373467 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-83b4e028-7a37-41db-b912-917020a9c2b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9fa67fb4ad4472183b95067597f043e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:23.436775 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3861/7711] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:40:23 2022] POST /identity/v3/projects => generated 373 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:40:23.437958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47094bcb-4eb7-43ac-a9a1-b362694df652 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:23.457739 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-83b4e028-7a37-41db-b912-917020a9c2b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9fa67fb4ad4472183b95067597f043e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:23.459098 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-83b4e028-7a37-41db-b912-917020a9c2b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9fa67fb4ad4472183b95067597f043e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:23.467181 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-83b4e028-7a37-41db-b912-917020a9c2b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9fa67fb4ad4472183b95067597f043e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:23.477821 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3851/7712] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:40:23 2022] DELETE /identity/v3/users/e9fa67fb4ad4472183b95067597f043e => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:23.513219 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47094bcb-4eb7-43ac-a9a1-b362694df652 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:23.578462 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a25faf-067d-4094-b330-34858f212de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:23.579298 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a25faf-067d-4094-b330-34858f212de7 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:23.579589 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a25faf-067d-4094-b330-34858f212de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:23.579903 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a25faf-067d-4094-b330-34858f212de7 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:23.580742 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a25faf-067d-4094-b330-34858f212de7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:23.582804 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a25faf-067d-4094-b330-34858f212de7 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:23.650449 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3862/7713] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:40:23 2022] POST /identity/v3/users => generated 287 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:40:23.654605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4e028-7a37-41db-b912-917020a9c2b0 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:23.656032 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-83b4e028-7a37-41db-b912-917020a9c2b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:23.669849 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4e028-7a37-41db-b912-917020a9c2b0 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:23.674490 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c2798-2f6b-4e1b-b647-795d5238158b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:23.675261 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c2798-2f6b-4e1b-b647-795d5238158b admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:23.676086 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c2798-2f6b-4e1b-b647-795d5238158b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:23.676484 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c2798-2f6b-4e1b-b647-795d5238158b admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:23.677299 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c2798-2f6b-4e1b-b647-795d5238158b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:23.679267 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c2798-2f6b-4e1b-b647-795d5238158b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:23.690615 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3852/7714] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:40:23.696193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a25faf-067d-4094-b330-34858f212de7 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:23.705710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a25faf-067d-4094-b330-34858f212de7 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:23.711360 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae609f-81ac-4b79-bae6-038e4191ee51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:23.712033 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae609f-81ac-4b79-bae6-038e4191ee51 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:23.712322 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae609f-81ac-4b79-bae6-038e4191ee51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:23.712598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae609f-81ac-4b79-bae6-038e4191ee51 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:23.713331 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ae609f-81ac-4b79-bae6-038e4191ee51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:23.714982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ae609f-81ac-4b79-bae6-038e4191ee51 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:23.728815 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3863/7715] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:40:23.733076 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c2798-2f6b-4e1b-b647-795d5238158b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:23.743492 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c2798-2f6b-4e1b-b647-795d5238158b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:23.748426 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38ff11-5f08-4949-9099-60c20a9612e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:23.749304 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38ff11-5f08-4949-9099-60c20a9612e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:23.750827 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38ff11-5f08-4949-9099-60c20a9612e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:23.750827 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38ff11-5f08-4949-9099-60c20a9612e9 admin admin] PATH_INFO: `/v3/projects/ce8b86b5b17e4648a07cd953925eb2ae/users/52d300d3d2304038a1f19bc979f1d979/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:23.766291 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38ff11-5f08-4949-9099-60c20a9612e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce8b86b5b17e4648a07cd953925eb2ae, user_id=52d300d3d2304038a1f19bc979f1d979, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:23.769004 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38ff11-5f08-4949-9099-60c20a9612e9 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:23.839868 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae609f-81ac-4b79-bae6-038e4191ee51 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:23.841952 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c7ae609f-81ac-4b79-bae6-038e4191ee51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:23.860433 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae609f-81ac-4b79-bae6-038e4191ee51 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:23.882484 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3853/7716] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:40:23 2022] PUT /identity/v3/projects/ce8b86b5b17e4648a07cd953925eb2ae/users/52d300d3d2304038a1f19bc979f1d979/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:23.893737 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a85a65-b37b-4059-9ac7-97063010d2fa None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:23.896203 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a85a65-b37b-4059-9ac7-97063010d2fa None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:23.897019 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a85a65-b37b-4059-9ac7-97063010d2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:23.897915 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6a359-cbc0-4897-8217-bafc59920680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:23.899061 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6a359-cbc0-4897-8217-bafc59920680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:23.899404 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6a359-cbc0-4897-8217-bafc59920680 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:23.899688 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6a359-cbc0-4897-8217-bafc59920680 admin admin] PATH_INFO: `/v3/projects/b74e36d3bb384eeb92da16d1b201fc9a` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:23.902057 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6a359-cbc0-4897-8217-bafc59920680 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b74e36d3bb384eeb92da16d1b201fc9a)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:23.910155 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6a359-cbc0-4897-8217-bafc59920680 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:23.934958 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-b1a85a65-b37b-4059-9ac7-97063010d2fa None None] MFA Rules not processed for user `52d300d3d2304038a1f19bc979f1d979`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:40:23.936723 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b1a85a65-b37b-4059-9ac7-97063010d2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:24.053041 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3854/7717] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:40:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:40:24.056973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a3c6a359-cbc0-4897-8217-bafc59920680 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b74e36d3bb384eeb92da16d1b201fc9a', 'request_id': 'req-a3c6a359-cbc0-4897-8217-bafc59920680'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:24.065204 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a85a65-b37b-4059-9ac7-97063010d2fa None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:24.068747 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b1a85a65-b37b-4059-9ac7-97063010d2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:24.072174 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a3c6a359-cbc0-4897-8217-bafc59920680 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b74e36d3bb384eeb92da16d1b201fc9a', 'request_id': 'req-a3c6a359-cbc0-4897-8217-bafc59920680'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:24.082050 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a3c6a359-cbc0-4897-8217-bafc59920680 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b74e36d3bb384eeb92da16d1b201fc9a', 'request_id': 'req-a3c6a359-cbc0-4897-8217-bafc59920680'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:24.157829 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a85a65-b37b-4059-9ac7-97063010d2fa None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:24.183336 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a3c6a359-cbc0-4897-8217-bafc59920680 admin admin] The token cache is being invalidate because project b74e36d3bb384eeb92da16d1b201fc9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:40:24.183716 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a3c6a359-cbc0-4897-8217-bafc59920680 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:24.185396 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a3c6a359-cbc0-4897-8217-bafc59920680 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:24.189462 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3864/7718] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:40:23 2022] DELETE /identity/v3/projects/b74e36d3bb384eeb92da16d1b201fc9a => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:24.195554 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77303a4-d449-473f-b439-76da17d5d537 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:24.197097 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77303a4-d449-473f-b439-76da17d5d537 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:24.197097 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77303a4-d449-473f-b439-76da17d5d537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:24.217568 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-d77303a4-d449-473f-b439-76da17d5d537 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:40:24.218946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d77303a4-d449-473f-b439-76da17d5d537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:24.227927 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab39b1-f35f-4714-937c-ab5671629fb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:24.233900 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab39b1-f35f-4714-937c-ab5671629fb1 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:24.233900 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab39b1-f35f-4714-937c-ab5671629fb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:24.233900 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab39b1-f35f-4714-937c-ab5671629fb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:24.235123 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b6ab39b1-f35f-4714-937c-ab5671629fb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:24.305862 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3865/7719] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:40:24.316040 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf2894-f7cd-4f19-9b81-cc3e646b20b2 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:24.316327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf2894-f7cd-4f19-9b81-cc3e646b20b2 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:24.316608 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf2894-f7cd-4f19-9b81-cc3e646b20b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:24.346184 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-e4bf2894-f7cd-4f19-9b81-cc3e646b20b2 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:40:24.348087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e4bf2894-f7cd-4f19-9b81-cc3e646b20b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:24.352999 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab39b1-f35f-4714-937c-ab5671629fb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:24.354993 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab39b1-f35f-4714-937c-ab5671629fb1 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:24.356450 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3866/7720] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:40:24.360677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf2894-f7cd-4f19-9b81-cc3e646b20b2 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:24.370098 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3855/7721] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:40:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:40:24.382388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf2894-f7cd-4f19-9b81-cc3e646b20b2 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:24.388929 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9bb8ec-79df-4e94-b480-1ae8572a181b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:24.389924 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9bb8ec-79df-4e94-b480-1ae8572a181b admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:24.390287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9bb8ec-79df-4e94-b480-1ae8572a181b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:24.402277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9bb8ec-79df-4e94-b480-1ae8572a181b admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:24.403426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9bb8ec-79df-4e94-b480-1ae8572a181b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:40:24.403875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9bb8ec-79df-4e94-b480-1ae8572a181b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:24.406180 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9bb8ec-79df-4e94-b480-1ae8572a181b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:24.421849 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3867/7722] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:40:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:40:24.425423 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab39b1-f35f-4714-937c-ab5671629fb1 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:24.443111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab39b1-f35f-4714-937c-ab5671629fb1 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:24.448936 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a3b7b-660a-446d-8f6f-f0ceee2cda44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:24.451566 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a3b7b-660a-446d-8f6f-f0ceee2cda44 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:24.451566 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a3b7b-660a-446d-8f6f-f0ceee2cda44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:24.451566 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a3b7b-660a-446d-8f6f-f0ceee2cda44 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:24.451566 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a3b7b-660a-446d-8f6f-f0ceee2cda44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:24.453066 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a3b7b-660a-446d-8f6f-f0ceee2cda44 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:24.572144 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3856/7723] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:40:24 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:40:24.573091 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9bb8ec-79df-4e94-b480-1ae8572a181b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:24.583084 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9bb8ec-79df-4e94-b480-1ae8572a181b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:24.648262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569579bc-0fc9-4b24-9156-c8a77fd45d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:24.648955 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569579bc-0fc9-4b24-9156-c8a77fd45d2d admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:24.649236 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569579bc-0fc9-4b24-9156-c8a77fd45d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:24.649504 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569579bc-0fc9-4b24-9156-c8a77fd45d2d admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:24.650302 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569579bc-0fc9-4b24-9156-c8a77fd45d2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:24.652304 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569579bc-0fc9-4b24-9156-c8a77fd45d2d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:24.725575 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3868/7724] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:40:24 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:40:24.729492 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a3b7b-660a-446d-8f6f-f0ceee2cda44 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:24.740572 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a3b7b-660a-446d-8f6f-f0ceee2cda44 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:24.745847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca1d05-c364-47b9-87b6-fa4d272e655a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:24.746514 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca1d05-c364-47b9-87b6-fa4d272e655a admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:24.746821 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca1d05-c364-47b9-87b6-fa4d272e655a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:24.747095 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca1d05-c364-47b9-87b6-fa4d272e655a admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:24.747847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ca1d05-c364-47b9-87b6-fa4d272e655a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:24.749449 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ca1d05-c364-47b9-87b6-fa4d272e655a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:24.760904 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3857/7725] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:40:24.765211 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569579bc-0fc9-4b24-9156-c8a77fd45d2d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:24.776347 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569579bc-0fc9-4b24-9156-c8a77fd45d2d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:24.781642 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e0f1a-a46b-46a9-954a-640ba9945e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:24.785298 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e0f1a-a46b-46a9-954a-640ba9945e0b admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:24.785298 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e0f1a-a46b-46a9-954a-640ba9945e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:24.785298 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e0f1a-a46b-46a9-954a-640ba9945e0b admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:24.785298 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e0f1a-a46b-46a9-954a-640ba9945e0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:24.785298 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e0f1a-a46b-46a9-954a-640ba9945e0b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:24.799181 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3869/7726] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:40:24.800616 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca1d05-c364-47b9-87b6-fa4d272e655a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:24.811161 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca1d05-c364-47b9-87b6-fa4d272e655a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:24.816714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a765787a-528f-48f4-9c99-ec868d19ee39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:24.818461 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765787a-528f-48f4-9c99-ec868d19ee39 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:24.818748 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765787a-528f-48f4-9c99-ec868d19ee39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:24.819029 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765787a-528f-48f4-9c99-ec868d19ee39 admin admin] PATH_INFO: `/v3/projects/4ee1c8ed9fb14ac58f354be83ac3458d/users/2be61fa42b864a0dbf3d2ad342334368/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:24.837394 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a765787a-528f-48f4-9c99-ec868d19ee39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ee1c8ed9fb14ac58f354be83ac3458d, user_id=2be61fa42b864a0dbf3d2ad342334368, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:24.840407 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a765787a-528f-48f4-9c99-ec868d19ee39 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:24.914552 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3858/7727] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:40:24 2022] PUT /identity/v3/projects/4ee1c8ed9fb14ac58f354be83ac3458d/users/2be61fa42b864a0dbf3d2ad342334368/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:24.924543 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf71edf-df41-43ff-ab96-c64a723dba18 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:24.924828 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf71edf-df41-43ff-ab96-c64a723dba18 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:24.937468 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf71edf-df41-43ff-ab96-c64a723dba18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:24.964400 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-9cf71edf-df41-43ff-ab96-c64a723dba18 None None] MFA Rules not processed for user `2be61fa42b864a0dbf3d2ad342334368`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:40:24.965634 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9cf71edf-df41-43ff-ab96-c64a723dba18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:25.038448 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3870/7728] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:40:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:40:25.050321 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a765787a-528f-48f4-9c99-ec868d19ee39 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:25.052648 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a765787a-528f-48f4-9c99-ec868d19ee39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:25.144478 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a765787a-528f-48f4-9c99-ec868d19ee39 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:25.150928 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69886a-7c2d-442a-b4a7-338abe8786e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:25.151572 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69886a-7c2d-442a-b4a7-338abe8786e0 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:25.151861 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69886a-7c2d-442a-b4a7-338abe8786e0 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:25.152203 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69886a-7c2d-442a-b4a7-338abe8786e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:25.160067 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c69886a-7c2d-442a-b4a7-338abe8786e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:25.162377 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c69886a-7c2d-442a-b4a7-338abe8786e0 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:25.171267 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3859/7729] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:40:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:40:25.262323 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf71edf-df41-43ff-ab96-c64a723dba18 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:25.263944 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9cf71edf-df41-43ff-ab96-c64a723dba18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:25.342150 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf71edf-df41-43ff-ab96-c64a723dba18 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:25.346079 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c25ed4-70f6-48dc-a449-e4f82323c780 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:25.346740 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c25ed4-70f6-48dc-a449-e4f82323c780 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:25.347068 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c25ed4-70f6-48dc-a449-e4f82323c780 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:25.347388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c25ed4-70f6-48dc-a449-e4f82323c780 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:25.349290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-98c25ed4-70f6-48dc-a449-e4f82323c780 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:25.366728 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c25ed4-70f6-48dc-a449-e4f82323c780 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:25.368209 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c25ed4-70f6-48dc-a449-e4f82323c780 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:25.383368 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3871/7730] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:40:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:40:31.867862 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69886a-7c2d-442a-b4a7-338abe8786e0 service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:31.869842 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3c69886a-7c2d-442a-b4a7-338abe8786e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:31.932056 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69886a-7c2d-442a-b4a7-338abe8786e0 service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:31.935642 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951db741-bd9c-4afc-bb70-06987c3691fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:31.936297 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951db741-bd9c-4afc-bb70-06987c3691fe service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:31.936627 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951db741-bd9c-4afc-bb70-06987c3691fe service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:31.936884 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951db741-bd9c-4afc-bb70-06987c3691fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:31.938684 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-951db741-bd9c-4afc-bb70-06987c3691fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:31.955810 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951db741-bd9c-4afc-bb70-06987c3691fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:31.957264 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951db741-bd9c-4afc-bb70-06987c3691fe service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:31.971236 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3860/7731] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:40:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:40:37.717433 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c25ed4-70f6-48dc-a449-e4f82323c780 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:37.786467 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c25ed4-70f6-48dc-a449-e4f82323c780 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:37.791156 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482cf7fc-fe13-4386-815b-30eba3fc7077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:37.792164 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482cf7fc-fe13-4386-815b-30eba3fc7077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:37.792390 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482cf7fc-fe13-4386-815b-30eba3fc7077 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:37.792666 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482cf7fc-fe13-4386-815b-30eba3fc7077 admin admin] PATH_INFO: `/v3/users/2be61fa42b864a0dbf3d2ad342334368` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:37.793887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482cf7fc-fe13-4386-815b-30eba3fc7077 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2be61fa42b864a0dbf3d2ad342334368)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:37.795825 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482cf7fc-fe13-4386-815b-30eba3fc7077 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:37.967849 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-482cf7fc-fe13-4386-815b-30eba3fc7077 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2be61fa42b864a0dbf3d2ad342334368'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:37.980194 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-482cf7fc-fe13-4386-815b-30eba3fc7077 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2be61fa42b864a0dbf3d2ad342334368'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:38.090845 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-482cf7fc-fe13-4386-815b-30eba3fc7077 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2be61fa42b864a0dbf3d2ad342334368'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:38.100578 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-482cf7fc-fe13-4386-815b-30eba3fc7077 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2be61fa42b864a0dbf3d2ad342334368'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:38.101646 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-482cf7fc-fe13-4386-815b-30eba3fc7077 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2be61fa42b864a0dbf3d2ad342334368'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:38.112138 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3872/7732] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:40:37 2022] DELETE /identity/v3/users/2be61fa42b864a0dbf3d2ad342334368 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:38.113888 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c310c2-50d6-4539-8a50-6e5360b5a31a None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:38.114328 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c310c2-50d6-4539-8a50-6e5360b5a31a None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:38.114612 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c310c2-50d6-4539-8a50-6e5360b5a31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:38.133954 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-16c310c2-50d6-4539-8a50-6e5360b5a31a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:40:38.135187 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-16c310c2-50d6-4539-8a50-6e5360b5a31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:38.195886 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3861/7733] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:40:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:40:38.207351 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482cf7fc-fe13-4386-815b-30eba3fc7077 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:38.209167 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-482cf7fc-fe13-4386-815b-30eba3fc7077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:38.291912 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482cf7fc-fe13-4386-815b-30eba3fc7077 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:38.295829 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363245e-485e-4c98-bb58-ce4d624d5e96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:38.296757 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363245e-485e-4c98-bb58-ce4d624d5e96 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:38.297126 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363245e-485e-4c98-bb58-ce4d624d5e96 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:38.297380 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363245e-485e-4c98-bb58-ce4d624d5e96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:38.307739 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2363245e-485e-4c98-bb58-ce4d624d5e96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:38.309206 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2363245e-485e-4c98-bb58-ce4d624d5e96 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:38.320971 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3873/7734] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:40:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:40:38.922312 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c310c2-50d6-4539-8a50-6e5360b5a31a None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:38.927048 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-16c310c2-50d6-4539-8a50-6e5360b5a31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:38.952202 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c310c2-50d6-4539-8a50-6e5360b5a31a None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:38.957984 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19906307-ba4f-46bd-a5eb-72e4b4aecfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:38.959808 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19906307-ba4f-46bd-a5eb-72e4b4aecfe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:38.960097 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19906307-ba4f-46bd-a5eb-72e4b4aecfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:38.960427 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19906307-ba4f-46bd-a5eb-72e4b4aecfe2 admin admin] PATH_INFO: `/v3/projects/4ee1c8ed9fb14ac58f354be83ac3458d` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:38.961742 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19906307-ba4f-46bd-a5eb-72e4b4aecfe2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ee1c8ed9fb14ac58f354be83ac3458d)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:38.963779 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19906307-ba4f-46bd-a5eb-72e4b4aecfe2 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:39.071092 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-19906307-ba4f-46bd-a5eb-72e4b4aecfe2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ee1c8ed9fb14ac58f354be83ac3458d', 'request_id': 'req-19906307-ba4f-46bd-a5eb-72e4b4aecfe2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:39.077903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-19906307-ba4f-46bd-a5eb-72e4b4aecfe2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ee1c8ed9fb14ac58f354be83ac3458d', 'request_id': 'req-19906307-ba4f-46bd-a5eb-72e4b4aecfe2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:39.084638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-19906307-ba4f-46bd-a5eb-72e4b4aecfe2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ee1c8ed9fb14ac58f354be83ac3458d', 'request_id': 'req-19906307-ba4f-46bd-a5eb-72e4b4aecfe2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:39.146325 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-19906307-ba4f-46bd-a5eb-72e4b4aecfe2 admin admin] The token cache is being invalidate because project 4ee1c8ed9fb14ac58f354be83ac3458d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:40:39.146961 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-19906307-ba4f-46bd-a5eb-72e4b4aecfe2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:39.147296 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-19906307-ba4f-46bd-a5eb-72e4b4aecfe2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:39.149147 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3862/7735] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:40:38 2022] DELETE /identity/v3/projects/4ee1c8ed9fb14ac58f354be83ac3458d => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:39.154988 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966ce47-6f77-4389-83ce-253732c9e867 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:39.155659 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966ce47-6f77-4389-83ce-253732c9e867 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:39.155940 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966ce47-6f77-4389-83ce-253732c9e867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:39.175330 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-0966ce47-6f77-4389-83ce-253732c9e867 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:40:39.176471 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0966ce47-6f77-4389-83ce-253732c9e867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:39.240113 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3874/7736] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:40:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:40:39.248850 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93e839-a5e9-4c54-a8ae-79c563380169 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:39.249136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93e839-a5e9-4c54-a8ae-79c563380169 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:39.249466 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93e839-a5e9-4c54-a8ae-79c563380169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:39.267989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-5b93e839-a5e9-4c54-a8ae-79c563380169 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:40:39.269391 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5b93e839-a5e9-4c54-a8ae-79c563380169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:39.280014 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3863/7737] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:40:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:40:39.284313 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966ce47-6f77-4389-83ce-253732c9e867 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:39.295432 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966ce47-6f77-4389-83ce-253732c9e867 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:39.300507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469f388-514b-413f-99b3-ccd236d38e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:39.301175 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469f388-514b-413f-99b3-ccd236d38e79 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:39.301459 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469f388-514b-413f-99b3-ccd236d38e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:39.301738 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469f388-514b-413f-99b3-ccd236d38e79 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:39.302493 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469f388-514b-413f-99b3-ccd236d38e79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:40:39.302935 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469f388-514b-413f-99b3-ccd236d38e79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:39.304556 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469f388-514b-413f-99b3-ccd236d38e79 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:39.316342 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3875/7738] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:40:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:40:39.322604 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93e839-a5e9-4c54-a8ae-79c563380169 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:39.332309 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93e839-a5e9-4c54-a8ae-79c563380169 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:39.337605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d3e6c-c3d3-4ef1-af8e-e86cf6f00e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:39.338406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d3e6c-c3d3-4ef1-af8e-e86cf6f00e8a admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:39.338699 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d3e6c-c3d3-4ef1-af8e-e86cf6f00e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:39.338974 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d3e6c-c3d3-4ef1-af8e-e86cf6f00e8a admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:39.339653 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d3e6c-c3d3-4ef1-af8e-e86cf6f00e8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:39.341571 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d3e6c-c3d3-4ef1-af8e-e86cf6f00e8a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:39.447003 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3864/7739] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:40:39 2022] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:40:39.451295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469f388-514b-413f-99b3-ccd236d38e79 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:39.463844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469f388-514b-413f-99b3-ccd236d38e79 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:39.526604 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a76f31-bd45-4dd3-9896-199d2e569d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:39.527343 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a76f31-bd45-4dd3-9896-199d2e569d4c admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:39.527629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a76f31-bd45-4dd3-9896-199d2e569d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:39.527902 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a76f31-bd45-4dd3-9896-199d2e569d4c admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:39.528597 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a76f31-bd45-4dd3-9896-199d2e569d4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:39.530587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a76f31-bd45-4dd3-9896-199d2e569d4c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:39.611744 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3876/7740] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:40:39 2022] POST /identity/v3/users => generated 288 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:40:39.615903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d3e6c-c3d3-4ef1-af8e-e86cf6f00e8a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:39.626188 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d3e6c-c3d3-4ef1-af8e-e86cf6f00e8a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:39.630832 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818240a-26a0-438c-925d-c1a5b9cd157b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:39.631473 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818240a-26a0-438c-925d-c1a5b9cd157b admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:39.631761 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818240a-26a0-438c-925d-c1a5b9cd157b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:39.632044 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818240a-26a0-438c-925d-c1a5b9cd157b admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:39.636067 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0818240a-26a0-438c-925d-c1a5b9cd157b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:39.636067 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0818240a-26a0-438c-925d-c1a5b9cd157b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:39.645057 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3865/7741] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:40:39.649926 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a76f31-bd45-4dd3-9896-199d2e569d4c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:39.660479 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a76f31-bd45-4dd3-9896-199d2e569d4c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:39.666108 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157af99a-7bad-424b-9089-c1fdbe781d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:39.666887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157af99a-7bad-424b-9089-c1fdbe781d06 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:39.667247 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157af99a-7bad-424b-9089-c1fdbe781d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:39.667603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157af99a-7bad-424b-9089-c1fdbe781d06 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:39.668438 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157af99a-7bad-424b-9089-c1fdbe781d06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:39.670154 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157af99a-7bad-424b-9089-c1fdbe781d06 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:39.683756 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3877/7742] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:40:39.685402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818240a-26a0-438c-925d-c1a5b9cd157b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:39.696324 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818240a-26a0-438c-925d-c1a5b9cd157b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:39.701544 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904154c9-67c6-4386-a855-d052cb283643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:39.702414 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904154c9-67c6-4386-a855-d052cb283643 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:39.702700 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904154c9-67c6-4386-a855-d052cb283643 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:39.702979 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904154c9-67c6-4386-a855-d052cb283643 admin admin] PATH_INFO: `/v3/projects/f0448cedfd674014bb07b7ec68b171f4/users/15b04c0d57c64768a55b78db4fc0b467/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:39.722331 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904154c9-67c6-4386-a855-d052cb283643 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0448cedfd674014bb07b7ec68b171f4, user_id=15b04c0d57c64768a55b78db4fc0b467, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:39.725049 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904154c9-67c6-4386-a855-d052cb283643 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:39.810079 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3866/7743] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:40:39 2022] PUT /identity/v3/projects/f0448cedfd674014bb07b7ec68b171f4/users/15b04c0d57c64768a55b78db4fc0b467/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:39.822383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf594ae-c425-43f8-9c0f-398725dbc883 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:39.822678 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf594ae-c425-43f8-9c0f-398725dbc883 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:39.822977 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf594ae-c425-43f8-9c0f-398725dbc883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:39.850472 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-bdf594ae-c425-43f8-9c0f-398725dbc883 None None] MFA Rules not processed for user `15b04c0d57c64768a55b78db4fc0b467`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:40:39.852373 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-bdf594ae-c425-43f8-9c0f-398725dbc883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:39.922693 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3878/7744] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:40:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:40:39.926889 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904154c9-67c6-4386-a855-d052cb283643 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:39.989129 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904154c9-67c6-4386-a855-d052cb283643 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:39.994724 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f9704-4e75-4406-8ff5-3d1795524d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:39.995391 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f9704-4e75-4406-8ff5-3d1795524d15 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:39.996201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f9704-4e75-4406-8ff5-3d1795524d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:39.996201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f9704-4e75-4406-8ff5-3d1795524d15 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:39.996699 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f9704-4e75-4406-8ff5-3d1795524d15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:39.998794 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f9704-4e75-4406-8ff5-3d1795524d15 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:40.102411 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf594ae-c425-43f8-9c0f-398725dbc883 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:40.103117 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3867/7745] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:40:39 2022] POST /identity/v3/projects => generated 377 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:40:40.114175 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf594ae-c425-43f8-9c0f-398725dbc883 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:40.195588 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8df29-44e6-4899-837e-90891564bdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:40.196394 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8df29-44e6-4899-837e-90891564bdf4 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:40.196683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8df29-44e6-4899-837e-90891564bdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:40.197100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8df29-44e6-4899-837e-90891564bdf4 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:40.197924 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e8df29-44e6-4899-837e-90891564bdf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:40.200387 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e8df29-44e6-4899-837e-90891564bdf4 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:40.331886 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3879/7746] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:40:40 2022] POST /identity/v3/users => generated 295 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:40:40.336463 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f9704-4e75-4406-8ff5-3d1795524d15 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:40.351717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f9704-4e75-4406-8ff5-3d1795524d15 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:40.358138 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267af99-db72-4dde-8baa-56ba6370265f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:40.359105 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267af99-db72-4dde-8baa-56ba6370265f admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:40.359710 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267af99-db72-4dde-8baa-56ba6370265f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:40.360183 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267af99-db72-4dde-8baa-56ba6370265f admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:40.361175 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0267af99-db72-4dde-8baa-56ba6370265f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:40.363212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0267af99-db72-4dde-8baa-56ba6370265f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:40.378644 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3868/7747] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:40:40.383318 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8df29-44e6-4899-837e-90891564bdf4 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:40.394646 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8df29-44e6-4899-837e-90891564bdf4 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:40.405654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a0b95-7c92-4fba-9180-442fe7f4bd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:40.406956 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a0b95-7c92-4fba-9180-442fe7f4bd0b admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:40.407246 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a0b95-7c92-4fba-9180-442fe7f4bd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:40.407524 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a0b95-7c92-4fba-9180-442fe7f4bd0b admin admin] PATH_INFO: `/v3/projects/87c3b086076f475e9abc825846018579/users/6a09b33a32484e88a6baddbbb119a014/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:40.425065 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252a0b95-7c92-4fba-9180-442fe7f4bd0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=87c3b086076f475e9abc825846018579, user_id=6a09b33a32484e88a6baddbbb119a014, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:40.428323 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252a0b95-7c92-4fba-9180-442fe7f4bd0b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:40.505029 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3880/7748] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:40:40 2022] PUT /identity/v3/projects/87c3b086076f475e9abc825846018579/users/6a09b33a32484e88a6baddbbb119a014/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:40:40.516051 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267af99-db72-4dde-8baa-56ba6370265f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:40.527323 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267af99-db72-4dde-8baa-56ba6370265f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:40.593622 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892278d2-6161-44e7-86a7-dc01086d5e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:40.594660 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892278d2-6161-44e7-86a7-dc01086d5e1f admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:40.595048 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892278d2-6161-44e7-86a7-dc01086d5e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:40.595589 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892278d2-6161-44e7-86a7-dc01086d5e1f admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:40.596400 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892278d2-6161-44e7-86a7-dc01086d5e1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:40.598314 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892278d2-6161-44e7-86a7-dc01086d5e1f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:40.609631 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3869/7749] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:40:40.614174 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a0b95-7c92-4fba-9180-442fe7f4bd0b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:40.627395 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a0b95-7c92-4fba-9180-442fe7f4bd0b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:40.632624 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1dba10-c455-442b-90e6-df47ac2d0e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:40.633514 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1dba10-c455-442b-90e6-df47ac2d0e86 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:40.633826 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1dba10-c455-442b-90e6-df47ac2d0e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:40.634105 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1dba10-c455-442b-90e6-df47ac2d0e86 admin admin] PATH_INFO: `/v3/projects/87c3b086076f475e9abc825846018579/users/6a09b33a32484e88a6baddbbb119a014/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:40.636112 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1dba10-c455-442b-90e6-df47ac2d0e86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87c3b086076f475e9abc825846018579, user_id=6a09b33a32484e88a6baddbbb119a014, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:40.639274 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1dba10-c455-442b-90e6-df47ac2d0e86 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:40.649681 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3881/7750] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:40:40 2022] PUT /identity/v3/projects/87c3b086076f475e9abc825846018579/users/6a09b33a32484e88a6baddbbb119a014/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:40:40.660096 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa0552-3bdb-4f02-bc94-e9c59a58c1f4 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:40.660390 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa0552-3bdb-4f02-bc94-e9c59a58c1f4 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:40.660673 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa0552-3bdb-4f02-bc94-e9c59a58c1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:40.690251 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-a0aa0552-3bdb-4f02-bc94-e9c59a58c1f4 None None] MFA Rules not processed for user `6a09b33a32484e88a6baddbbb119a014`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:40:40.696823 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a0aa0552-3bdb-4f02-bc94-e9c59a58c1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:40.774858 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3870/7751] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:40:40 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:40:40.780090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1dba10-c455-442b-90e6-df47ac2d0e86 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:40.791236 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1dba10-c455-442b-90e6-df47ac2d0e86 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:40.795862 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81dee4-61e1-43f0-8d5b-cd08bba98135 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a09b33a32484e88a6baddbbb119a014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87c3b086076f475e9abc825846018579', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:40.796520 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81dee4-61e1-43f0-8d5b-cd08bba98135 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:40.796803 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81dee4-61e1-43f0-8d5b-cd08bba98135 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:40.797221 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81dee4-61e1-43f0-8d5b-cd08bba98135 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:40.797993 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81dee4-61e1-43f0-8d5b-cd08bba98135 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:40.799622 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81dee4-61e1-43f0-8d5b-cd08bba98135 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:40.881977 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3882/7752] 10.222.0.23 () {60 vars in 1148 bytes} [Sat Apr 30 21:40:40 2022] POST /identity/v3/domains => generated 245 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:40:40.886160 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa0552-3bdb-4f02-bc94-e9c59a58c1f4 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:40.895450 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa0552-3bdb-4f02-bc94-e9c59a58c1f4 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:40.963364 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1542a3-4ce9-4ed4-ab19-8786e20dfab7 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a09b33a32484e88a6baddbbb119a014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87c3b086076f475e9abc825846018579', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:40.964208 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1542a3-4ce9-4ed4-ab19-8786e20dfab7 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:40.964581 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1542a3-4ce9-4ed4-ab19-8786e20dfab7 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:40.964865 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1542a3-4ce9-4ed4-ab19-8786e20dfab7 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:40.965627 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1542a3-4ce9-4ed4-ab19-8786e20dfab7 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:40.967731 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1542a3-4ce9-4ed4-ab19-8786e20dfab7 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:41.088933 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81dee4-61e1-43f0-8d5b-cd08bba98135 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:41.098456 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3871/7753] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:40:40 2022] POST /identity/v3/projects => generated 410 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:40:41.107786 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81dee4-61e1-43f0-8d5b-cd08bba98135 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:41.191926 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af31aba-4820-4f90-9237-4e5170979518 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a09b33a32484e88a6baddbbb119a014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87c3b086076f475e9abc825846018579', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:41.193000 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af31aba-4820-4f90-9237-4e5170979518 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:41.193991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af31aba-4820-4f90-9237-4e5170979518 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:41.194424 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af31aba-4820-4f90-9237-4e5170979518 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:41.195371 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af31aba-4820-4f90-9237-4e5170979518 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:41.199401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af31aba-4820-4f90-9237-4e5170979518 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:41.305537 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3883/7754] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:40:41 2022] POST /identity/v3/users => generated 348 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:40:41.309563 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1542a3-4ce9-4ed4-ab19-8786e20dfab7 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:41.322319 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1542a3-4ce9-4ed4-ab19-8786e20dfab7 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:41.327734 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1831c-8b2a-4323-8836-104a1318b732 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a09b33a32484e88a6baddbbb119a014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87c3b086076f475e9abc825846018579', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:41.329297 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1831c-8b2a-4323-8836-104a1318b732 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:41.329711 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1831c-8b2a-4323-8836-104a1318b732 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:41.330126 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1831c-8b2a-4323-8836-104a1318b732 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:41.330975 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c1831c-8b2a-4323-8836-104a1318b732 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:41.332904 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c1831c-8b2a-4323-8836-104a1318b732 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:41.346011 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3872/7755] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:40:41.350307 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af31aba-4820-4f90-9237-4e5170979518 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:41.361086 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af31aba-4820-4f90-9237-4e5170979518 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:41.366750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba2103-7404-4c4f-957c-8f8889e6efd2 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a09b33a32484e88a6baddbbb119a014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87c3b086076f475e9abc825846018579', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:41.367488 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba2103-7404-4c4f-957c-8f8889e6efd2 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:41.367775 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba2103-7404-4c4f-957c-8f8889e6efd2 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:41.368398 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba2103-7404-4c4f-957c-8f8889e6efd2 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] PATH_INFO: `/v3/projects/91efbea7a1a249deb9542633fab23faa/users/6fc609822a9046d988c51b6872b48a88/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:41.387080 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba2103-7404-4c4f-957c-8f8889e6efd2 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] RBAC: Authorizing `identity:create_grant(project_id=91efbea7a1a249deb9542633fab23faa, user_id=6fc609822a9046d988c51b6872b48a88, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:41.390096 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba2103-7404-4c4f-957c-8f8889e6efd2 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:41.475414 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3884/7756] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:40:41 2022] PUT /identity/v3/projects/91efbea7a1a249deb9542633fab23faa/users/6fc609822a9046d988c51b6872b48a88/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:40:41.477445 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c919c04-b2ff-4348-81bd-baf4bcc727c8 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:41.477739 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c919c04-b2ff-4348-81bd-baf4bcc727c8 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:41.478046 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c919c04-b2ff-4348-81bd-baf4bcc727c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:41.597106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-0c919c04-b2ff-4348-81bd-baf4bcc727c8 None None] MFA Rules not processed for user `6fc609822a9046d988c51b6872b48a88`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:40:41.598566 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0c919c04-b2ff-4348-81bd-baf4bcc727c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:41.614494 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3873/7757] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:40:41 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:40:41.626449 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce3343-da18-4ed1-b75c-f1d7a9e5eafa None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:41.626716 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce3343-da18-4ed1-b75c-f1d7a9e5eafa None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:41.626989 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce3343-da18-4ed1-b75c-f1d7a9e5eafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:41.646279 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-5dce3343-da18-4ed1-b75c-f1d7a9e5eafa None None] MFA Rules not processed for user `6fc609822a9046d988c51b6872b48a88`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:40:41.647495 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5dce3343-da18-4ed1-b75c-f1d7a9e5eafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:41.655225 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3885/7758] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:40:41 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:40:41.659771 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c919c04-b2ff-4348-81bd-baf4bcc727c8 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:41.669722 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c919c04-b2ff-4348-81bd-baf4bcc727c8 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:41.674597 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576c50d-89ed-439d-b4b6-12594836d599 tempest-test_project-1130839668 tempest-user-1921506632] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fc609822a9046d988c51b6872b48a88', 'user_domain_id': 'a4e9b223e77f411e8c0d34e0f0e0b5ad', 'system_scope': None, 'project_id': '91efbea7a1a249deb9542633fab23faa', 'project_domain_id': 'a4e9b223e77f411e8c0d34e0f0e0b5ad', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:41.675241 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576c50d-89ed-439d-b4b6-12594836d599 tempest-test_project-1130839668 tempest-user-1921506632] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:41.675520 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576c50d-89ed-439d-b4b6-12594836d599 tempest-test_project-1130839668 tempest-user-1921506632] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:41.675794 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576c50d-89ed-439d-b4b6-12594836d599 tempest-test_project-1130839668 tempest-user-1921506632] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:41.686346 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f576c50d-89ed-439d-b4b6-12594836d599 tempest-test_project-1130839668 tempest-user-1921506632] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:41.688133 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f576c50d-89ed-439d-b4b6-12594836d599 tempest-test_project-1130839668 tempest-user-1921506632] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:41.698035 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3874/7759] 10.222.0.23 () {56 vars in 1283 bytes} [Sat Apr 30 21:40:41 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:40:41.702946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce3343-da18-4ed1-b75c-f1d7a9e5eafa None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:41.778274 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce3343-da18-4ed1-b75c-f1d7a9e5eafa None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:41.783489 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f6bb3-ce40-4e62-b088-fc2a0b1c4456 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a09b33a32484e88a6baddbbb119a014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87c3b086076f475e9abc825846018579', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:41.784477 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f6bb3-ce40-4e62-b088-fc2a0b1c4456 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:41.785245 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f6bb3-ce40-4e62-b088-fc2a0b1c4456 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:41.785245 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f6bb3-ce40-4e62-b088-fc2a0b1c4456 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] PATH_INFO: `/v3/users/6fc609822a9046d988c51b6872b48a88` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:41.786737 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f6bb3-ce40-4e62-b088-fc2a0b1c4456 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6fc609822a9046d988c51b6872b48a88)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:41.789429 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f6bb3-ce40-4e62-b088-fc2a0b1c4456 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:42.018628 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d79f6bb3-ce40-4e62-b088-fc2a0b1c4456 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fc609822a9046d988c51b6872b48a88'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:42.034652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d79f6bb3-ce40-4e62-b088-fc2a0b1c4456 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fc609822a9046d988c51b6872b48a88'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:42.106996 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d79f6bb3-ce40-4e62-b088-fc2a0b1c4456 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fc609822a9046d988c51b6872b48a88'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:42.116060 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d79f6bb3-ce40-4e62-b088-fc2a0b1c4456 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fc609822a9046d988c51b6872b48a88'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:42.117196 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d79f6bb3-ce40-4e62-b088-fc2a0b1c4456 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fc609822a9046d988c51b6872b48a88'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:42.124015 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3886/7760] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:40:41 2022] DELETE /identity/v3/users/6fc609822a9046d988c51b6872b48a88 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:42.128435 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576c50d-89ed-439d-b4b6-12594836d599 tempest-test_project-1130839668 tempest-user-1921506632] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:42.141042 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576c50d-89ed-439d-b4b6-12594836d599 tempest-test_project-1130839668 tempest-user-1921506632] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:42.205916 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876dab4f-8c2d-4c53-9ee5-317f619d2d0b tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a09b33a32484e88a6baddbbb119a014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87c3b086076f475e9abc825846018579', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:42.206967 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876dab4f-8c2d-4c53-9ee5-317f619d2d0b tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:42.207961 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876dab4f-8c2d-4c53-9ee5-317f619d2d0b tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:42.208357 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876dab4f-8c2d-4c53-9ee5-317f619d2d0b tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] PATH_INFO: `/v3/projects/91efbea7a1a249deb9542633fab23faa` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:42.209850 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876dab4f-8c2d-4c53-9ee5-317f619d2d0b tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] RBAC: Authorizing `identity:delete_project(project_id=91efbea7a1a249deb9542633fab23faa)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:42.212131 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876dab4f-8c2d-4c53-9ee5-317f619d2d0b tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:42.362333 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-876dab4f-8c2d-4c53-9ee5-317f619d2d0b tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91efbea7a1a249deb9542633fab23faa', 'request_id': 'req-876dab4f-8c2d-4c53-9ee5-317f619d2d0b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:42.368776 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-876dab4f-8c2d-4c53-9ee5-317f619d2d0b tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91efbea7a1a249deb9542633fab23faa', 'request_id': 'req-876dab4f-8c2d-4c53-9ee5-317f619d2d0b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:42.376406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-876dab4f-8c2d-4c53-9ee5-317f619d2d0b tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91efbea7a1a249deb9542633fab23faa', 'request_id': 'req-876dab4f-8c2d-4c53-9ee5-317f619d2d0b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:42.462859 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-876dab4f-8c2d-4c53-9ee5-317f619d2d0b tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] The token cache is being invalidate because project 91efbea7a1a249deb9542633fab23faa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:40:42.463315 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-876dab4f-8c2d-4c53-9ee5-317f619d2d0b tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:42.464029 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-876dab4f-8c2d-4c53-9ee5-317f619d2d0b tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:42.466132 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3875/7761] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:40:42 2022] DELETE /identity/v3/projects/91efbea7a1a249deb9542633fab23faa => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:40:42.470242 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f6bb3-ce40-4e62-b088-fc2a0b1c4456 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:42.472222 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d79f6bb3-ce40-4e62-b088-fc2a0b1c4456 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:42.491799 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f6bb3-ce40-4e62-b088-fc2a0b1c4456 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:42.585440 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed0e21-1dc6-4eed-84b4-fdf08b6061da tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a09b33a32484e88a6baddbbb119a014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87c3b086076f475e9abc825846018579', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:42.586868 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed0e21-1dc6-4eed-84b4-fdf08b6061da tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:42.587491 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed0e21-1dc6-4eed-84b4-fdf08b6061da tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:42.587905 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed0e21-1dc6-4eed-84b4-fdf08b6061da tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] PATH_INFO: `/v3/domains/a4e9b223e77f411e8c0d34e0f0e0b5ad` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:42.595489 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ed0e21-1dc6-4eed-84b4-fdf08b6061da tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a4e9b223e77f411e8c0d34e0f0e0b5ad)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:42.597468 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ed0e21-1dc6-4eed-84b4-fdf08b6061da tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:42.634356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-87ed0e21-1dc6-4eed-84b4-fdf08b6061da tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a4e9b223e77f411e8c0d34e0f0e0b5ad'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:42.635270 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-87ed0e21-1dc6-4eed-84b4-fdf08b6061da tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a4e9b223e77f411e8c0d34e0f0e0b5ad'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:42.736393 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-87ed0e21-1dc6-4eed-84b4-fdf08b6061da tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a4e9b223e77f411e8c0d34e0f0e0b5ad'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:42.737168 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-87ed0e21-1dc6-4eed-84b4-fdf08b6061da tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a4e9b223e77f411e8c0d34e0f0e0b5ad'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:42.739921 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3887/7762] 10.222.0.23 () {60 vars in 1248 bytes} [Sat Apr 30 21:40:42 2022] PATCH /identity/v3/domains/a4e9b223e77f411e8c0d34e0f0e0b5ad => generated 246 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:40:42.744116 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876dab4f-8c2d-4c53-9ee5-317f619d2d0b tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:42.745715 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-876dab4f-8c2d-4c53-9ee5-317f619d2d0b tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:42.760073 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876dab4f-8c2d-4c53-9ee5-317f619d2d0b tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:42.820684 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2589bc-6fdc-4984-916f-6c00d66fcc17 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a09b33a32484e88a6baddbbb119a014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87c3b086076f475e9abc825846018579', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:42.821719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2589bc-6fdc-4984-916f-6c00d66fcc17 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:42.822043 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2589bc-6fdc-4984-916f-6c00d66fcc17 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:42.822328 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2589bc-6fdc-4984-916f-6c00d66fcc17 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] PATH_INFO: `/v3/domains/a4e9b223e77f411e8c0d34e0f0e0b5ad` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:42.833998 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2589bc-6fdc-4984-916f-6c00d66fcc17 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a4e9b223e77f411e8c0d34e0f0e0b5ad)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:42.836217 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2589bc-6fdc-4984-916f-6c00d66fcc17 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:42.858648 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5c2589bc-6fdc-4984-916f-6c00d66fcc17 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a4e9b223e77f411e8c0d34e0f0e0b5ad'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:42.861846 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5c2589bc-6fdc-4984-916f-6c00d66fcc17 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a4e9b223e77f411e8c0d34e0f0e0b5ad'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:42.965716 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5c2589bc-6fdc-4984-916f-6c00d66fcc17 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4e9b223e77f411e8c0d34e0f0e0b5ad', 'request_id': 'req-5c2589bc-6fdc-4984-916f-6c00d66fcc17'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:42.972458 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5c2589bc-6fdc-4984-916f-6c00d66fcc17 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4e9b223e77f411e8c0d34e0f0e0b5ad', 'request_id': 'req-5c2589bc-6fdc-4984-916f-6c00d66fcc17'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:42.981531 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5c2589bc-6fdc-4984-916f-6c00d66fcc17 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4e9b223e77f411e8c0d34e0f0e0b5ad', 'request_id': 'req-5c2589bc-6fdc-4984-916f-6c00d66fcc17'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:43.090804 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5c2589bc-6fdc-4984-916f-6c00d66fcc17 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] The token cache is being invalidate because project a4e9b223e77f411e8c0d34e0f0e0b5ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:40:43.091098 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5c2589bc-6fdc-4984-916f-6c00d66fcc17 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:43.091767 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5c2589bc-6fdc-4984-916f-6c00d66fcc17 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:43.099395 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5c2589bc-6fdc-4984-916f-6c00d66fcc17 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a4e9b223e77f411e8c0d34e0f0e0b5ad', 'request_id': 'req-5c2589bc-6fdc-4984-916f-6c00d66fcc17'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:43.100703 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5c2589bc-6fdc-4984-916f-6c00d66fcc17 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a4e9b223e77f411e8c0d34e0f0e0b5ad', 'request_id': 'req-5c2589bc-6fdc-4984-916f-6c00d66fcc17'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:43.101904 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5c2589bc-6fdc-4984-916f-6c00d66fcc17 tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a4e9b223e77f411e8c0d34e0f0e0b5ad', 'request_id': 'req-5c2589bc-6fdc-4984-916f-6c00d66fcc17'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:43.110456 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3876/7763] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:40:42 2022] DELETE /identity/v3/domains/a4e9b223e77f411e8c0d34e0f0e0b5ad => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:43.115871 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed0e21-1dc6-4eed-84b4-fdf08b6061da tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:43.117514 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-87ed0e21-1dc6-4eed-84b4-fdf08b6061da tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:43.204794 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed0e21-1dc6-4eed-84b4-fdf08b6061da tempest-TestDefaultProjectId-1910170746 tempest-TestDefaultProjectId-1910170746-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:43.263105 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005af412-e339-4183-b814-1439882e3eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:43.263976 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005af412-e339-4183-b814-1439882e3eec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:43.264262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005af412-e339-4183-b814-1439882e3eec admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:43.264539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005af412-e339-4183-b814-1439882e3eec admin admin] PATH_INFO: `/v3/users/15b04c0d57c64768a55b78db4fc0b467` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:43.265738 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005af412-e339-4183-b814-1439882e3eec admin admin] RBAC: Authorizing `identity:delete_user(user_id=15b04c0d57c64768a55b78db4fc0b467)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:43.267860 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005af412-e339-4183-b814-1439882e3eec admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:43.518299 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-005af412-e339-4183-b814-1439882e3eec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15b04c0d57c64768a55b78db4fc0b467'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:43.541933 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-005af412-e339-4183-b814-1439882e3eec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15b04c0d57c64768a55b78db4fc0b467'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:43.656559 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-005af412-e339-4183-b814-1439882e3eec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15b04c0d57c64768a55b78db4fc0b467'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:43.664893 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-005af412-e339-4183-b814-1439882e3eec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15b04c0d57c64768a55b78db4fc0b467'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:43.668261 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-005af412-e339-4183-b814-1439882e3eec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15b04c0d57c64768a55b78db4fc0b467'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:43.682162 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3888/7764] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:40:43 2022] DELETE /identity/v3/users/15b04c0d57c64768a55b78db4fc0b467 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:43.683568 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4551b48-14e2-4f64-91d5-f3a2204d7827 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:43.684055 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4551b48-14e2-4f64-91d5-f3a2204d7827 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:43.684126 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4551b48-14e2-4f64-91d5-f3a2204d7827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:43.722338 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-f4551b48-14e2-4f64-91d5-f3a2204d7827 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:40:43.722338 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f4551b48-14e2-4f64-91d5-f3a2204d7827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:43.803211 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3877/7765] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:40:43.811098 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005af412-e339-4183-b814-1439882e3eec admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:43.812550 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-005af412-e339-4183-b814-1439882e3eec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:43.904886 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005af412-e339-4183-b814-1439882e3eec admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:43.906814 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb13381-75f7-4c10-b32b-6d470b34ac0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:43.907996 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb13381-75f7-4c10-b32b-6d470b34ac0c service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:43.908287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb13381-75f7-4c10-b32b-6d470b34ac0c service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:43.908568 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb13381-75f7-4c10-b32b-6d470b34ac0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:43.921245 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb13381-75f7-4c10-b32b-6d470b34ac0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:43.922771 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb13381-75f7-4c10-b32b-6d470b34ac0c service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:43.938288 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3889/7766] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:40:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:40:44.854040 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4551b48-14e2-4f64-91d5-f3a2204d7827 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:44.855899 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f4551b48-14e2-4f64-91d5-f3a2204d7827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:44.868440 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4551b48-14e2-4f64-91d5-f3a2204d7827 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:44.873417 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab11342-d968-4fe8-ac9c-a3d3956d1911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:44.874418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab11342-d968-4fe8-ac9c-a3d3956d1911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:44.874771 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab11342-d968-4fe8-ac9c-a3d3956d1911 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:44.875116 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab11342-d968-4fe8-ac9c-a3d3956d1911 admin admin] PATH_INFO: `/v3/projects/f0448cedfd674014bb07b7ec68b171f4` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:44.877250 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab11342-d968-4fe8-ac9c-a3d3956d1911 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0448cedfd674014bb07b7ec68b171f4)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:44.891423 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab11342-d968-4fe8-ac9c-a3d3956d1911 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:45.035474 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-9ab11342-d968-4fe8-ac9c-a3d3956d1911 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0448cedfd674014bb07b7ec68b171f4', 'request_id': 'req-9ab11342-d968-4fe8-ac9c-a3d3956d1911'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:45.041488 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-9ab11342-d968-4fe8-ac9c-a3d3956d1911 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0448cedfd674014bb07b7ec68b171f4', 'request_id': 'req-9ab11342-d968-4fe8-ac9c-a3d3956d1911'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:45.047869 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-9ab11342-d968-4fe8-ac9c-a3d3956d1911 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0448cedfd674014bb07b7ec68b171f4', 'request_id': 'req-9ab11342-d968-4fe8-ac9c-a3d3956d1911'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:45.103671 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-9ab11342-d968-4fe8-ac9c-a3d3956d1911 admin admin] The token cache is being invalidate because project f0448cedfd674014bb07b7ec68b171f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:40:45.104176 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-9ab11342-d968-4fe8-ac9c-a3d3956d1911 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:45.106468 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-9ab11342-d968-4fe8-ac9c-a3d3956d1911 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:45.108138 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3878/7767] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:40:44 2022] DELETE /identity/v3/projects/f0448cedfd674014bb07b7ec68b171f4 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:45.112306 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb13381-75f7-4c10-b32b-6d470b34ac0c service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:45.122324 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb13381-75f7-4c10-b32b-6d470b34ac0c service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:45.192583 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987503e-71e1-4c6b-8760-0dc462235a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:45.194285 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987503e-71e1-4c6b-8760-0dc462235a70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:45.194590 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987503e-71e1-4c6b-8760-0dc462235a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:45.194911 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987503e-71e1-4c6b-8760-0dc462235a70 admin admin] PATH_INFO: `/v3/users/6a09b33a32484e88a6baddbbb119a014` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:45.196135 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c987503e-71e1-4c6b-8760-0dc462235a70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a09b33a32484e88a6baddbbb119a014)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:45.198208 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c987503e-71e1-4c6b-8760-0dc462235a70 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:45.392758 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c987503e-71e1-4c6b-8760-0dc462235a70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a09b33a32484e88a6baddbbb119a014'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:45.406095 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c987503e-71e1-4c6b-8760-0dc462235a70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a09b33a32484e88a6baddbbb119a014'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:45.496962 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c987503e-71e1-4c6b-8760-0dc462235a70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a09b33a32484e88a6baddbbb119a014'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:45.511680 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c987503e-71e1-4c6b-8760-0dc462235a70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a09b33a32484e88a6baddbbb119a014'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:45.513076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c987503e-71e1-4c6b-8760-0dc462235a70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a09b33a32484e88a6baddbbb119a014'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:45.527183 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3890/7768] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:40:45 2022] DELETE /identity/v3/users/6a09b33a32484e88a6baddbbb119a014 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:46.226517 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab11342-d968-4fe8-ac9c-a3d3956d1911 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:46.226517 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-9ab11342-d968-4fe8-ac9c-a3d3956d1911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:46.243174 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab11342-d968-4fe8-ac9c-a3d3956d1911 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:46.330135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae763d-d875-4b3e-b824-bce2d07789ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:46.331028 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae763d-d875-4b3e-b824-bce2d07789ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:46.331318 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae763d-d875-4b3e-b824-bce2d07789ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:46.331595 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae763d-d875-4b3e-b824-bce2d07789ad admin admin] PATH_INFO: `/v3/projects/87c3b086076f475e9abc825846018579` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:46.335272 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae763d-d875-4b3e-b824-bce2d07789ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=87c3b086076f475e9abc825846018579)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:46.346301 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae763d-d875-4b3e-b824-bce2d07789ad admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:46.481510 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2eae763d-d875-4b3e-b824-bce2d07789ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87c3b086076f475e9abc825846018579', 'request_id': 'req-2eae763d-d875-4b3e-b824-bce2d07789ad'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:46.487675 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2eae763d-d875-4b3e-b824-bce2d07789ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87c3b086076f475e9abc825846018579', 'request_id': 'req-2eae763d-d875-4b3e-b824-bce2d07789ad'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:46.495401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2eae763d-d875-4b3e-b824-bce2d07789ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87c3b086076f475e9abc825846018579', 'request_id': 'req-2eae763d-d875-4b3e-b824-bce2d07789ad'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:46.567660 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2eae763d-d875-4b3e-b824-bce2d07789ad admin admin] The token cache is being invalidate because project 87c3b086076f475e9abc825846018579 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:40:46.567999 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2eae763d-d875-4b3e-b824-bce2d07789ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:46.569174 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2eae763d-d875-4b3e-b824-bce2d07789ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:46.571288 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3879/7769] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:40:46 2022] DELETE /identity/v3/projects/87c3b086076f475e9abc825846018579 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:40:46.576217 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7137fa9-822d-4ecd-9675-bb26b55c9ea5 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:46.577195 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7137fa9-822d-4ecd-9675-bb26b55c9ea5 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:46.577633 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7137fa9-822d-4ecd-9675-bb26b55c9ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:46.609853 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-e7137fa9-822d-4ecd-9675-bb26b55c9ea5 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:40:46.611348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e7137fa9-822d-4ecd-9675-bb26b55c9ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:46.709578 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3891/7770] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:40:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:40:46.710633 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fdf22-1c2a-4759-8bf9-ed5a0f3381d6 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:46.710926 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fdf22-1c2a-4759-8bf9-ed5a0f3381d6 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:46.711204 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fdf22-1c2a-4759-8bf9-ed5a0f3381d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:46.739106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-d07fdf22-1c2a-4759-8bf9-ed5a0f3381d6 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:40:46.741612 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d07fdf22-1c2a-4759-8bf9-ed5a0f3381d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:46.752507 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3880/7771] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:40:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:40:46.757636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7137fa9-822d-4ecd-9675-bb26b55c9ea5 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:46.775377 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7137fa9-822d-4ecd-9675-bb26b55c9ea5 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:46.781106 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead73f3-174b-4cfe-96dc-de16b324a91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:46.802689 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead73f3-174b-4cfe-96dc-de16b324a91d admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:46.802689 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead73f3-174b-4cfe-96dc-de16b324a91d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:46.802689 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead73f3-174b-4cfe-96dc-de16b324a91d admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:46.802689 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead73f3-174b-4cfe-96dc-de16b324a91d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:40:46.802689 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead73f3-174b-4cfe-96dc-de16b324a91d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:46.802689 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead73f3-174b-4cfe-96dc-de16b324a91d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:46.803132 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3892/7772] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:40:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:40:46.804430 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07fdf22-1c2a-4759-8bf9-ed5a0f3381d6 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:46.814571 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07fdf22-1c2a-4759-8bf9-ed5a0f3381d6 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:46.819454 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34a9fc-0b39-40e3-b360-df045d81fd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:46.820135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34a9fc-0b39-40e3-b360-df045d81fd0d admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:46.820421 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34a9fc-0b39-40e3-b360-df045d81fd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:46.820885 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34a9fc-0b39-40e3-b360-df045d81fd0d admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:46.821586 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e34a9fc-0b39-40e3-b360-df045d81fd0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:46.823569 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e34a9fc-0b39-40e3-b360-df045d81fd0d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:46.928768 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3881/7773] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:40:46 2022] POST /identity/v3/projects => generated 365 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:40:46.930333 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead73f3-174b-4cfe-96dc-de16b324a91d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:46.942170 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead73f3-174b-4cfe-96dc-de16b324a91d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:47.011257 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ccb7ee-95d5-42e9-9073-bbfa890e2e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:47.011863 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ccb7ee-95d5-42e9-9073-bbfa890e2e71 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:47.012152 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ccb7ee-95d5-42e9-9073-bbfa890e2e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:47.012465 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ccb7ee-95d5-42e9-9073-bbfa890e2e71 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:47.013311 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ccb7ee-95d5-42e9-9073-bbfa890e2e71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:47.015917 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ccb7ee-95d5-42e9-9073-bbfa890e2e71 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:47.136410 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3893/7774] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:40:46 2022] POST /identity/v3/users => generated 283 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:40:47.141013 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34a9fc-0b39-40e3-b360-df045d81fd0d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:47.152764 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34a9fc-0b39-40e3-b360-df045d81fd0d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:47.166085 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ff490-f03f-457f-8c87-8841c3607ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:47.166773 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ff490-f03f-457f-8c87-8841c3607ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:47.167140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ff490-f03f-457f-8c87-8841c3607ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:47.167451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ff490-f03f-457f-8c87-8841c3607ef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:47.168189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ff490-f03f-457f-8c87-8841c3607ef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:47.169895 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ff490-f03f-457f-8c87-8841c3607ef0 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:47.183790 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3882/7775] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:40:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:40:47.188127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ccb7ee-95d5-42e9-9073-bbfa890e2e71 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:47.198940 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ccb7ee-95d5-42e9-9073-bbfa890e2e71 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:47.203682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c90b48-f70b-4c05-9691-5b8994b0422c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:47.204354 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c90b48-f70b-4c05-9691-5b8994b0422c admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:47.204625 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c90b48-f70b-4c05-9691-5b8994b0422c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:47.204912 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c90b48-f70b-4c05-9691-5b8994b0422c admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:47.205640 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c90b48-f70b-4c05-9691-5b8994b0422c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:47.207299 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c90b48-f70b-4c05-9691-5b8994b0422c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:47.227397 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3894/7776] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:40:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:40:47.227479 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ff490-f03f-457f-8c87-8841c3607ef0 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:47.238369 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ff490-f03f-457f-8c87-8841c3607ef0 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:47.243781 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60051c38-e145-4dac-b772-3ab9a2f00f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:47.244862 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60051c38-e145-4dac-b772-3ab9a2f00f82 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:47.245316 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60051c38-e145-4dac-b772-3ab9a2f00f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:47.245791 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60051c38-e145-4dac-b772-3ab9a2f00f82 admin admin] PATH_INFO: `/v3/projects/4824f4a09e434d73a239c2dd93a0427c/users/f74abf4f58ac4cca8cfe0b8deb6298a3/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:47.262170 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60051c38-e145-4dac-b772-3ab9a2f00f82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4824f4a09e434d73a239c2dd93a0427c, user_id=f74abf4f58ac4cca8cfe0b8deb6298a3, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:47.264864 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60051c38-e145-4dac-b772-3ab9a2f00f82 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:47.343362 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3883/7777] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:40:47 2022] PUT /identity/v3/projects/4824f4a09e434d73a239c2dd93a0427c/users/f74abf4f58ac4cca8cfe0b8deb6298a3/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:47.354766 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaed49c-29a8-41eb-8693-6b7529e97c52 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:47.355052 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaed49c-29a8-41eb-8693-6b7529e97c52 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:47.355337 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaed49c-29a8-41eb-8693-6b7529e97c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:47.391677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-9aaed49c-29a8-41eb-8693-6b7529e97c52 None None] MFA Rules not processed for user `f74abf4f58ac4cca8cfe0b8deb6298a3`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:40:47.393069 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9aaed49c-29a8-41eb-8693-6b7529e97c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:47.469470 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3895/7778] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:40:47 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:40:47.474294 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60051c38-e145-4dac-b772-3ab9a2f00f82 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:47.549414 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60051c38-e145-4dac-b772-3ab9a2f00f82 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:47.567020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c719b-d93c-418d-a8b3-5591f59922aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:47.567873 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c719b-d93c-418d-a8b3-5591f59922aa admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:47.568167 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c719b-d93c-418d-a8b3-5591f59922aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:47.568484 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c719b-d93c-418d-a8b3-5591f59922aa admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:47.569485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80c719b-d93c-418d-a8b3-5591f59922aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:47.571619 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80c719b-d93c-418d-a8b3-5591f59922aa admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:47.649862 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3884/7779] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:40:47 2022] POST /identity/v3/projects => generated 365 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:40:47.655010 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaed49c-29a8-41eb-8693-6b7529e97c52 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:47.671296 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaed49c-29a8-41eb-8693-6b7529e97c52 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:47.761840 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50930b46-bd76-4faf-96f8-5193287866f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:47.762577 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50930b46-bd76-4faf-96f8-5193287866f8 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:47.763908 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50930b46-bd76-4faf-96f8-5193287866f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:47.763908 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50930b46-bd76-4faf-96f8-5193287866f8 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:47.763908 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50930b46-bd76-4faf-96f8-5193287866f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:47.765957 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50930b46-bd76-4faf-96f8-5193287866f8 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:47.860864 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3896/7780] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:40:47 2022] POST /identity/v3/users => generated 289 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:40:47.861705 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c719b-d93c-418d-a8b3-5591f59922aa admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:47.882231 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c719b-d93c-418d-a8b3-5591f59922aa admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:47.905126 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8994a-b267-4b97-846c-1f99feb7e231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:47.905126 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8994a-b267-4b97-846c-1f99feb7e231 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:47.905126 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8994a-b267-4b97-846c-1f99feb7e231 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:47.905126 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8994a-b267-4b97-846c-1f99feb7e231 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:47.905409 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de8994a-b267-4b97-846c-1f99feb7e231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:47.905409 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de8994a-b267-4b97-846c-1f99feb7e231 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:47.905409 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3885/7781] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:40:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:40:47.909015 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50930b46-bd76-4faf-96f8-5193287866f8 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:47.927315 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50930b46-bd76-4faf-96f8-5193287866f8 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:47.933504 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd465f-126e-48d5-9723-d42f35fbd888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:47.934764 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd465f-126e-48d5-9723-d42f35fbd888 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:47.935265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd465f-126e-48d5-9723-d42f35fbd888 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:47.935749 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd465f-126e-48d5-9723-d42f35fbd888 admin admin] PATH_INFO: `/v3/projects/7c81b4c1496d4619b9cdbda0abc6c089/users/d5b7786864b5469391d19ff74908a612/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:47.953710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd465f-126e-48d5-9723-d42f35fbd888 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c81b4c1496d4619b9cdbda0abc6c089, user_id=d5b7786864b5469391d19ff74908a612, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:47.956817 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd465f-126e-48d5-9723-d42f35fbd888 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:48.035370 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3897/7782] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:40:47 2022] PUT /identity/v3/projects/7c81b4c1496d4619b9cdbda0abc6c089/users/d5b7786864b5469391d19ff74908a612/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:48.036745 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8994a-b267-4b97-846c-1f99feb7e231 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:48.049034 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8994a-b267-4b97-846c-1f99feb7e231 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:48.125069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374eb6f-4653-4f7b-8003-0083337cc0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:48.126515 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374eb6f-4653-4f7b-8003-0083337cc0c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:48.126969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374eb6f-4653-4f7b-8003-0083337cc0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:48.128501 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374eb6f-4653-4f7b-8003-0083337cc0c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:48.128501 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374eb6f-4653-4f7b-8003-0083337cc0c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:48.132327 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374eb6f-4653-4f7b-8003-0083337cc0c5 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:48.145565 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3886/7783] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:40:48.151131 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd465f-126e-48d5-9723-d42f35fbd888 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:48.166173 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd465f-126e-48d5-9723-d42f35fbd888 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:48.172989 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819fa21-8190-41fb-9d10-d5ef2a1cf807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:48.174283 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819fa21-8190-41fb-9d10-d5ef2a1cf807 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:48.174618 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819fa21-8190-41fb-9d10-d5ef2a1cf807 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:48.176590 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819fa21-8190-41fb-9d10-d5ef2a1cf807 admin admin] PATH_INFO: `/v3/projects/7c81b4c1496d4619b9cdbda0abc6c089/users/d5b7786864b5469391d19ff74908a612/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:48.179399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2819fa21-8190-41fb-9d10-d5ef2a1cf807 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c81b4c1496d4619b9cdbda0abc6c089, user_id=d5b7786864b5469391d19ff74908a612, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:48.183023 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2819fa21-8190-41fb-9d10-d5ef2a1cf807 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:48.203374 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3898/7784] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:40:48 2022] PUT /identity/v3/projects/7c81b4c1496d4619b9cdbda0abc6c089/users/d5b7786864b5469391d19ff74908a612/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:48.215596 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506cbfb-92a8-40fd-9aec-b4a3e4c73500 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:48.216103 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506cbfb-92a8-40fd-9aec-b4a3e4c73500 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:48.216595 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506cbfb-92a8-40fd-9aec-b4a3e4c73500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:48.255708 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-b506cbfb-92a8-40fd-9aec-b4a3e4c73500 None None] MFA Rules not processed for user `d5b7786864b5469391d19ff74908a612`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:40:48.258459 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b506cbfb-92a8-40fd-9aec-b4a3e4c73500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:48.333038 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3887/7785] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:40:48 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:40:48.337884 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819fa21-8190-41fb-9d10-d5ef2a1cf807 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:48.348972 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819fa21-8190-41fb-9d10-d5ef2a1cf807 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:48.353633 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb073409-35ab-4bde-9ad4-405551675d18 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5b7786864b5469391d19ff74908a612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c81b4c1496d4619b9cdbda0abc6c089', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:48.354315 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb073409-35ab-4bde-9ad4-405551675d18 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:48.354603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb073409-35ab-4bde-9ad4-405551675d18 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:48.354878 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb073409-35ab-4bde-9ad4-405551675d18 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:48.357556 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb073409-35ab-4bde-9ad4-405551675d18 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:48.357556 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb073409-35ab-4bde-9ad4-405551675d18 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:48.395604 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506cbfb-92a8-40fd-9aec-b4a3e4c73500 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:48.397280 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b506cbfb-92a8-40fd-9aec-b4a3e4c73500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:48.442756 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3899/7786] 10.222.0.23 () {60 vars in 1149 bytes} [Sat Apr 30 21:40:48 2022] POST /identity/v3/domains => generated 277 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:40:48.447169 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb073409-35ab-4bde-9ad4-405551675d18 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:48.478933 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506cbfb-92a8-40fd-9aec-b4a3e4c73500 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:48.517015 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb073409-35ab-4bde-9ad4-405551675d18 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:48.522987 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99329f60-5d69-473d-ad53-9859d7a947bf tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5b7786864b5469391d19ff74908a612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c81b4c1496d4619b9cdbda0abc6c089', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:48.524684 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99329f60-5d69-473d-ad53-9859d7a947bf tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:48.525126 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99329f60-5d69-473d-ad53-9859d7a947bf tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:48.525615 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99329f60-5d69-473d-ad53-9859d7a947bf tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:48.526383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99329f60-5d69-473d-ad53-9859d7a947bf tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:48.528150 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99329f60-5d69-473d-ad53-9859d7a947bf tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:48.543973 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e58f5-1802-4f75-94b8-44010d17b992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:48.543973 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e58f5-1802-4f75-94b8-44010d17b992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:48.543973 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e58f5-1802-4f75-94b8-44010d17b992 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:48.543973 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e58f5-1802-4f75-94b8-44010d17b992 admin admin] PATH_INFO: `/v3/users/ee330c1468ae4085be6675b99c75c17c` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:48.544608 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3e58f5-1802-4f75-94b8-44010d17b992 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee330c1468ae4085be6675b99c75c17c)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:48.545215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3e58f5-1802-4f75-94b8-44010d17b992 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:48.638792 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3900/7787] 10.222.0.23 () {60 vars in 1149 bytes} [Sat Apr 30 21:40:48 2022] POST /identity/v3/domains => generated 276 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:40:48.642710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99329f60-5d69-473d-ad53-9859d7a947bf tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:48.713185 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99329f60-5d69-473d-ad53-9859d7a947bf tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:48.719188 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9775817-f347-4553-b9e1-05580eedb75e tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5b7786864b5469391d19ff74908a612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c81b4c1496d4619b9cdbda0abc6c089', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:48.720166 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9775817-f347-4553-b9e1-05580eedb75e tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:48.720532 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9775817-f347-4553-b9e1-05580eedb75e tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:48.720915 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9775817-f347-4553-b9e1-05580eedb75e tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:48.721783 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9775817-f347-4553-b9e1-05580eedb75e tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:48.731973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9775817-f347-4553-b9e1-05580eedb75e tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:48.744250 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5f3e58f5-1802-4f75-94b8-44010d17b992 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee330c1468ae4085be6675b99c75c17c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:48.758846 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5f3e58f5-1802-4f75-94b8-44010d17b992 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee330c1468ae4085be6675b99c75c17c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:48.790202 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3901/7788] 10.222.0.23 () {60 vars in 1149 bytes} [Sat Apr 30 21:40:48 2022] POST /identity/v3/domains => generated 278 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:40:48.794470 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9775817-f347-4553-b9e1-05580eedb75e tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:48.799588 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5f3e58f5-1802-4f75-94b8-44010d17b992 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee330c1468ae4085be6675b99c75c17c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:48.800354 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5f3e58f5-1802-4f75-94b8-44010d17b992 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee330c1468ae4085be6675b99c75c17c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:48.808329 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5f3e58f5-1802-4f75-94b8-44010d17b992 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee330c1468ae4085be6675b99c75c17c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:48.815123 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3888/7789] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:40:48 2022] DELETE /identity/v3/users/ee330c1468ae4085be6675b99c75c17c => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:40:48.859909 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9775817-f347-4553-b9e1-05580eedb75e tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:48.917040 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9213efe-7545-4f0d-b110-670e5afd86e4 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5b7786864b5469391d19ff74908a612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c81b4c1496d4619b9cdbda0abc6c089', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:48.919652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9213efe-7545-4f0d-b110-670e5afd86e4 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:48.919652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9213efe-7545-4f0d-b110-670e5afd86e4 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:48.919652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9213efe-7545-4f0d-b110-670e5afd86e4 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:48.919652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9213efe-7545-4f0d-b110-670e5afd86e4 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:48.920634 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9213efe-7545-4f0d-b110-670e5afd86e4 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:48.992832 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3902/7790] 10.222.0.23 () {60 vars in 1149 bytes} [Sat Apr 30 21:40:48 2022] POST /identity/v3/domains => generated 279 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:40:48.996594 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e58f5-1802-4f75-94b8-44010d17b992 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:48.998239 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5f3e58f5-1802-4f75-94b8-44010d17b992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:49.012365 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e58f5-1802-4f75-94b8-44010d17b992 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:49.069860 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69553a4-c09d-4504-9f19-b3f13f95e6fd tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5b7786864b5469391d19ff74908a612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c81b4c1496d4619b9cdbda0abc6c089', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:49.070655 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69553a4-c09d-4504-9f19-b3f13f95e6fd tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:49.070944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69553a4-c09d-4504-9f19-b3f13f95e6fd tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:49.071225 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69553a4-c09d-4504-9f19-b3f13f95e6fd tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] PATH_INFO: `/v3/domains/86efca101170409abd2d7b0c534524ba` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:49.081567 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69553a4-c09d-4504-9f19-b3f13f95e6fd tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=86efca101170409abd2d7b0c534524ba)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:49.083211 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69553a4-c09d-4504-9f19-b3f13f95e6fd tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:49.107668 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b69553a4-c09d-4504-9f19-b3f13f95e6fd tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '86efca101170409abd2d7b0c534524ba'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:49.110849 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b69553a4-c09d-4504-9f19-b3f13f95e6fd tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '86efca101170409abd2d7b0c534524ba'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:49.129495 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9213efe-7545-4f0d-b110-670e5afd86e4 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:49.133131 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d9213efe-7545-4f0d-b110-670e5afd86e4 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:49.205641 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9213efe-7545-4f0d-b110-670e5afd86e4 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:49.210488 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c56733-cb65-41e2-9ebb-0c451bc89cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:49.211356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c56733-cb65-41e2-9ebb-0c451bc89cbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:49.211638 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c56733-cb65-41e2-9ebb-0c451bc89cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:49.211908 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c56733-cb65-41e2-9ebb-0c451bc89cbc admin admin] PATH_INFO: `/v3/projects/02c76e15fece44a9be2e1342513ae551` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:49.213280 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c56733-cb65-41e2-9ebb-0c451bc89cbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=02c76e15fece44a9be2e1342513ae551)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:49.215259 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c56733-cb65-41e2-9ebb-0c451bc89cbc admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:49.231168 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b69553a4-c09d-4504-9f19-b3f13f95e6fd tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86efca101170409abd2d7b0c534524ba', 'request_id': 'req-b69553a4-c09d-4504-9f19-b3f13f95e6fd'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:49.239228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b69553a4-c09d-4504-9f19-b3f13f95e6fd tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86efca101170409abd2d7b0c534524ba', 'request_id': 'req-b69553a4-c09d-4504-9f19-b3f13f95e6fd'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:49.246116 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b69553a4-c09d-4504-9f19-b3f13f95e6fd tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86efca101170409abd2d7b0c534524ba', 'request_id': 'req-b69553a4-c09d-4504-9f19-b3f13f95e6fd'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:49.336410 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b69553a4-c09d-4504-9f19-b3f13f95e6fd tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] The token cache is being invalidate because project 86efca101170409abd2d7b0c534524ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:40:49.339214 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b69553a4-c09d-4504-9f19-b3f13f95e6fd tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:49.339214 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b69553a4-c09d-4504-9f19-b3f13f95e6fd tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:49.339390 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-01c56733-cb65-41e2-9ebb-0c451bc89cbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02c76e15fece44a9be2e1342513ae551', 'request_id': 'req-01c56733-cb65-41e2-9ebb-0c451bc89cbc'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:49.345108 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-01c56733-cb65-41e2-9ebb-0c451bc89cbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02c76e15fece44a9be2e1342513ae551', 'request_id': 'req-01c56733-cb65-41e2-9ebb-0c451bc89cbc'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:49.345364 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b69553a4-c09d-4504-9f19-b3f13f95e6fd tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '86efca101170409abd2d7b0c534524ba', 'request_id': 'req-b69553a4-c09d-4504-9f19-b3f13f95e6fd'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:49.347542 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b69553a4-c09d-4504-9f19-b3f13f95e6fd tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '86efca101170409abd2d7b0c534524ba', 'request_id': 'req-b69553a4-c09d-4504-9f19-b3f13f95e6fd'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:49.347661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b69553a4-c09d-4504-9f19-b3f13f95e6fd tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '86efca101170409abd2d7b0c534524ba', 'request_id': 'req-b69553a4-c09d-4504-9f19-b3f13f95e6fd'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:49.352171 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-01c56733-cb65-41e2-9ebb-0c451bc89cbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02c76e15fece44a9be2e1342513ae551', 'request_id': 'req-01c56733-cb65-41e2-9ebb-0c451bc89cbc'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:49.356336 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3889/7791] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:40:48 2022] DELETE /identity/v3/domains/86efca101170409abd2d7b0c534524ba => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:49.361024 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69553a4-c09d-4504-9f19-b3f13f95e6fd tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:49.362433 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b69553a4-c09d-4504-9f19-b3f13f95e6fd tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:49.420950 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-01c56733-cb65-41e2-9ebb-0c451bc89cbc admin admin] The token cache is being invalidate because project 02c76e15fece44a9be2e1342513ae551 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:40:49.421335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-01c56733-cb65-41e2-9ebb-0c451bc89cbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:49.422107 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-01c56733-cb65-41e2-9ebb-0c451bc89cbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:49.423889 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3903/7792] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:40:49 2022] DELETE /identity/v3/projects/02c76e15fece44a9be2e1342513ae551 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:49.428612 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c56733-cb65-41e2-9ebb-0c451bc89cbc admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:49.430037 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-01c56733-cb65-41e2-9ebb-0c451bc89cbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:49.431095 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69553a4-c09d-4504-9f19-b3f13f95e6fd tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:49.492841 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7b6de-5a4a-4fa6-a237-6015b9a69164 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5b7786864b5469391d19ff74908a612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c81b4c1496d4619b9cdbda0abc6c089', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:49.493625 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7b6de-5a4a-4fa6-a237-6015b9a69164 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:49.494557 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7b6de-5a4a-4fa6-a237-6015b9a69164 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:49.494557 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7b6de-5a4a-4fa6-a237-6015b9a69164 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:49.494952 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d7b6de-5a4a-4fa6-a237-6015b9a69164 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:49.496761 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d7b6de-5a4a-4fa6-a237-6015b9a69164 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:49.497938 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c56733-cb65-41e2-9ebb-0c451bc89cbc admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:49.502779 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d46879-07f3-4449-b02e-bd06df63005a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:49.503846 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d46879-07f3-4449-b02e-bd06df63005a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:49.504130 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d46879-07f3-4449-b02e-bd06df63005a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:49.504437 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d46879-07f3-4449-b02e-bd06df63005a admin admin] PATH_INFO: `/v3/users/c8667af135e44ce897538df8d12982b5` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:49.505937 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d46879-07f3-4449-b02e-bd06df63005a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8667af135e44ce897538df8d12982b5)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:49.507882 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d46879-07f3-4449-b02e-bd06df63005a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:49.565442 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3890/7793] 10.222.0.23 () {60 vars in 1148 bytes} [Sat Apr 30 21:40:49 2022] POST /identity/v3/domains => generated 249 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:40:49.569526 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7b6de-5a4a-4fa6-a237-6015b9a69164 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:49.571242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-61d7b6de-5a4a-4fa6-a237-6015b9a69164 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:49.635667 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7b6de-5a4a-4fa6-a237-6015b9a69164 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:49.640606 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c2562-a13c-4b90-b3b6-48bad2d7c9a4 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5b7786864b5469391d19ff74908a612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c81b4c1496d4619b9cdbda0abc6c089', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:49.641494 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c2562-a13c-4b90-b3b6-48bad2d7c9a4 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:49.641803 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c2562-a13c-4b90-b3b6-48bad2d7c9a4 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:49.642140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c2562-a13c-4b90-b3b6-48bad2d7c9a4 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] PATH_INFO: `/v3/domains/b67443c2659542a081d57e7fb710891f` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:49.653355 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c2562-a13c-4b90-b3b6-48bad2d7c9a4 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b67443c2659542a081d57e7fb710891f)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:49.655021 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c2562-a13c-4b90-b3b6-48bad2d7c9a4 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:49.674584 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-279c2562-a13c-4b90-b3b6-48bad2d7c9a4 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b67443c2659542a081d57e7fb710891f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:49.675299 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-279c2562-a13c-4b90-b3b6-48bad2d7c9a4 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b67443c2659542a081d57e7fb710891f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:49.713982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-82d46879-07f3-4449-b02e-bd06df63005a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8667af135e44ce897538df8d12982b5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:49.726745 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-82d46879-07f3-4449-b02e-bd06df63005a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8667af135e44ce897538df8d12982b5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:49.763645 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-279c2562-a13c-4b90-b3b6-48bad2d7c9a4 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b67443c2659542a081d57e7fb710891f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:49.764408 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-279c2562-a13c-4b90-b3b6-48bad2d7c9a4 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b67443c2659542a081d57e7fb710891f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:49.769836 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3891/7794] 10.222.0.23 () {60 vars in 1248 bytes} [Sat Apr 30 21:40:49 2022] PATCH /identity/v3/domains/b67443c2659542a081d57e7fb710891f => generated 250 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:40:49.770916 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c2562-a13c-4b90-b3b6-48bad2d7c9a4 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:49.772918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-82d46879-07f3-4449-b02e-bd06df63005a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8667af135e44ce897538df8d12982b5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:49.773039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-279c2562-a13c-4b90-b3b6-48bad2d7c9a4 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:49.782139 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-82d46879-07f3-4449-b02e-bd06df63005a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8667af135e44ce897538df8d12982b5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:49.783091 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-82d46879-07f3-4449-b02e-bd06df63005a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8667af135e44ce897538df8d12982b5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:49.795474 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3904/7795] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:40:49 2022] DELETE /identity/v3/users/c8667af135e44ce897538df8d12982b5 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:49.865775 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c2562-a13c-4b90-b3b6-48bad2d7c9a4 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:49.922885 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c282e-ed5e-4be7-9a96-4c9470410a02 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5b7786864b5469391d19ff74908a612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c81b4c1496d4619b9cdbda0abc6c089', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:49.923782 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c282e-ed5e-4be7-9a96-4c9470410a02 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:49.924069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c282e-ed5e-4be7-9a96-4c9470410a02 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:49.924349 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c282e-ed5e-4be7-9a96-4c9470410a02 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] PATH_INFO: `/v3/domains/b67443c2659542a081d57e7fb710891f` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:49.936083 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c282e-ed5e-4be7-9a96-4c9470410a02 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b67443c2659542a081d57e7fb710891f)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:49.937741 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c282e-ed5e-4be7-9a96-4c9470410a02 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:49.963888 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a05c282e-ed5e-4be7-9a96-4c9470410a02 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b67443c2659542a081d57e7fb710891f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:49.967609 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a05c282e-ed5e-4be7-9a96-4c9470410a02 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b67443c2659542a081d57e7fb710891f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:50.051598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d46879-07f3-4449-b02e-bd06df63005a admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:50.053449 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-82d46879-07f3-4449-b02e-bd06df63005a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:50.131139 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d46879-07f3-4449-b02e-bd06df63005a admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:50.134643 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a05c282e-ed5e-4be7-9a96-4c9470410a02 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b67443c2659542a081d57e7fb710891f', 'request_id': 'req-a05c282e-ed5e-4be7-9a96-4c9470410a02'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:50.148844 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a05c282e-ed5e-4be7-9a96-4c9470410a02 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b67443c2659542a081d57e7fb710891f', 'request_id': 'req-a05c282e-ed5e-4be7-9a96-4c9470410a02'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:50.151664 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a05c282e-ed5e-4be7-9a96-4c9470410a02 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b67443c2659542a081d57e7fb710891f', 'request_id': 'req-a05c282e-ed5e-4be7-9a96-4c9470410a02'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:50.190699 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc414e-5fec-4745-9745-2ee2d8c87b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:50.191739 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc414e-5fec-4745-9745-2ee2d8c87b6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:50.191891 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc414e-5fec-4745-9745-2ee2d8c87b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:50.192149 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc414e-5fec-4745-9745-2ee2d8c87b6a admin admin] PATH_INFO: `/v3/projects/af2dd6efb5894815bdd924b6dc6a5426` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:50.194055 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc414e-5fec-4745-9745-2ee2d8c87b6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=af2dd6efb5894815bdd924b6dc6a5426)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:50.196007 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc414e-5fec-4745-9745-2ee2d8c87b6a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:50.260446 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a05c282e-ed5e-4be7-9a96-4c9470410a02 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] The token cache is being invalidate because project b67443c2659542a081d57e7fb710891f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:40:50.260950 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a05c282e-ed5e-4be7-9a96-4c9470410a02 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:50.261541 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a05c282e-ed5e-4be7-9a96-4c9470410a02 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:50.269738 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a05c282e-ed5e-4be7-9a96-4c9470410a02 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b67443c2659542a081d57e7fb710891f', 'request_id': 'req-a05c282e-ed5e-4be7-9a96-4c9470410a02'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:50.271075 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a05c282e-ed5e-4be7-9a96-4c9470410a02 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b67443c2659542a081d57e7fb710891f', 'request_id': 'req-a05c282e-ed5e-4be7-9a96-4c9470410a02'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:50.272311 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a05c282e-ed5e-4be7-9a96-4c9470410a02 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b67443c2659542a081d57e7fb710891f', 'request_id': 'req-a05c282e-ed5e-4be7-9a96-4c9470410a02'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:50.282752 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3892/7796] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:40:49 2022] DELETE /identity/v3/domains/b67443c2659542a081d57e7fb710891f => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:50.292600 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c282e-ed5e-4be7-9a96-4c9470410a02 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:50.292600 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a05c282e-ed5e-4be7-9a96-4c9470410a02 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:50.335603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e5cc414e-5fec-4745-9745-2ee2d8c87b6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af2dd6efb5894815bdd924b6dc6a5426', 'request_id': 'req-e5cc414e-5fec-4745-9745-2ee2d8c87b6a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:50.342589 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e5cc414e-5fec-4745-9745-2ee2d8c87b6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af2dd6efb5894815bdd924b6dc6a5426', 'request_id': 'req-e5cc414e-5fec-4745-9745-2ee2d8c87b6a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:50.350108 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e5cc414e-5fec-4745-9745-2ee2d8c87b6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af2dd6efb5894815bdd924b6dc6a5426', 'request_id': 'req-e5cc414e-5fec-4745-9745-2ee2d8c87b6a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:50.355963 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c282e-ed5e-4be7-9a96-4c9470410a02 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:50.416386 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3fc18-2212-40f6-a5a7-f8e40e476d98 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5b7786864b5469391d19ff74908a612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c81b4c1496d4619b9cdbda0abc6c089', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:50.417218 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3fc18-2212-40f6-a5a7-f8e40e476d98 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:50.417642 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3fc18-2212-40f6-a5a7-f8e40e476d98 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:50.418147 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3fc18-2212-40f6-a5a7-f8e40e476d98 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:50.419071 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3fc18-2212-40f6-a5a7-f8e40e476d98 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:50.421511 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3fc18-2212-40f6-a5a7-f8e40e476d98 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:50.440078 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e5cc414e-5fec-4745-9745-2ee2d8c87b6a admin admin] The token cache is being invalidate because project af2dd6efb5894815bdd924b6dc6a5426 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:40:50.441050 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e5cc414e-5fec-4745-9745-2ee2d8c87b6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:50.442195 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e5cc414e-5fec-4745-9745-2ee2d8c87b6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:50.445313 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3905/7797] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:40:50 2022] DELETE /identity/v3/projects/af2dd6efb5894815bdd924b6dc6a5426 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:40:50.522303 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3893/7798] 10.222.0.23 () {60 vars in 1148 bytes} [Sat Apr 30 21:40:50 2022] POST /identity/v3/domains => generated 278 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:40:50.527096 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc414e-5fec-4745-9745-2ee2d8c87b6a admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:50.531539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e5cc414e-5fec-4745-9745-2ee2d8c87b6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:50.556852 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc414e-5fec-4745-9745-2ee2d8c87b6a admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:50.637596 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6a832-38f2-4af7-87f4-31b06987fb53 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5b7786864b5469391d19ff74908a612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c81b4c1496d4619b9cdbda0abc6c089', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:50.638624 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6a832-38f2-4af7-87f4-31b06987fb53 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:50.638981 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6a832-38f2-4af7-87f4-31b06987fb53 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:50.639334 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6a832-38f2-4af7-87f4-31b06987fb53 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] PATH_INFO: `/v3/domains/dd1f05e11ee94a8b94ceef99d0752fd9` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:50.657980 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc6a832-38f2-4af7-87f4-31b06987fb53 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=dd1f05e11ee94a8b94ceef99d0752fd9)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:50.659649 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc6a832-38f2-4af7-87f4-31b06987fb53 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:50.683388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cdc6a832-38f2-4af7-87f4-31b06987fb53 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'dd1f05e11ee94a8b94ceef99d0752fd9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:50.684291 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cdc6a832-38f2-4af7-87f4-31b06987fb53 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'dd1f05e11ee94a8b94ceef99d0752fd9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:50.814116 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cdc6a832-38f2-4af7-87f4-31b06987fb53 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'dd1f05e11ee94a8b94ceef99d0752fd9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:50.814762 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cdc6a832-38f2-4af7-87f4-31b06987fb53 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'dd1f05e11ee94a8b94ceef99d0752fd9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:50.821569 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3906/7799] 10.222.0.23 () {60 vars in 1249 bytes} [Sat Apr 30 21:40:50 2022] PATCH /identity/v3/domains/dd1f05e11ee94a8b94ceef99d0752fd9 => generated 278 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:40:50.822908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3fc18-2212-40f6-a5a7-f8e40e476d98 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:50.824715 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d1b3fc18-2212-40f6-a5a7-f8e40e476d98 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:50.839021 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3fc18-2212-40f6-a5a7-f8e40e476d98 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:50.901259 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd3426-f0f9-4ec5-b402-27cec86c9dfc tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5b7786864b5469391d19ff74908a612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c81b4c1496d4619b9cdbda0abc6c089', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:50.902213 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd3426-f0f9-4ec5-b402-27cec86c9dfc tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:50.902496 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd3426-f0f9-4ec5-b402-27cec86c9dfc tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:50.902774 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd3426-f0f9-4ec5-b402-27cec86c9dfc tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] PATH_INFO: `/v3/domains/dd1f05e11ee94a8b94ceef99d0752fd9` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:50.915177 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd3426-f0f9-4ec5-b402-27cec86c9dfc tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=dd1f05e11ee94a8b94ceef99d0752fd9)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:50.917185 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd3426-f0f9-4ec5-b402-27cec86c9dfc tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:50.921878 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3894/7800] 10.222.0.23 () {58 vars in 1226 bytes} [Sat Apr 30 21:40:50 2022] GET /identity/v3/domains/dd1f05e11ee94a8b94ceef99d0752fd9 => generated 278 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:40:50.923045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6a832-38f2-4af7-87f4-31b06987fb53 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:50.934126 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6a832-38f2-4af7-87f4-31b06987fb53 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:50.939060 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46232738-7aee-4f01-b72e-689e9db6d6e6 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5b7786864b5469391d19ff74908a612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c81b4c1496d4619b9cdbda0abc6c089', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:50.939920 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46232738-7aee-4f01-b72e-689e9db6d6e6 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:50.940201 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46232738-7aee-4f01-b72e-689e9db6d6e6 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:50.940503 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46232738-7aee-4f01-b72e-689e9db6d6e6 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] PATH_INFO: `/v3/domains/dd1f05e11ee94a8b94ceef99d0752fd9` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:50.941894 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46232738-7aee-4f01-b72e-689e9db6d6e6 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=dd1f05e11ee94a8b94ceef99d0752fd9)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:50.943532 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46232738-7aee-4f01-b72e-689e9db6d6e6 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:50.979280 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-46232738-7aee-4f01-b72e-689e9db6d6e6 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'dd1f05e11ee94a8b94ceef99d0752fd9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:50.984658 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-46232738-7aee-4f01-b72e-689e9db6d6e6 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'dd1f05e11ee94a8b94ceef99d0752fd9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:51.086136 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-46232738-7aee-4f01-b72e-689e9db6d6e6 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd1f05e11ee94a8b94ceef99d0752fd9', 'request_id': 'req-46232738-7aee-4f01-b72e-689e9db6d6e6'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:51.091528 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-46232738-7aee-4f01-b72e-689e9db6d6e6 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd1f05e11ee94a8b94ceef99d0752fd9', 'request_id': 'req-46232738-7aee-4f01-b72e-689e9db6d6e6'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:51.098205 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-46232738-7aee-4f01-b72e-689e9db6d6e6 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd1f05e11ee94a8b94ceef99d0752fd9', 'request_id': 'req-46232738-7aee-4f01-b72e-689e9db6d6e6'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:51.176950 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-46232738-7aee-4f01-b72e-689e9db6d6e6 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] The token cache is being invalidate because project dd1f05e11ee94a8b94ceef99d0752fd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:40:51.177231 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-46232738-7aee-4f01-b72e-689e9db6d6e6 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:51.178040 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-46232738-7aee-4f01-b72e-689e9db6d6e6 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:51.185772 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-46232738-7aee-4f01-b72e-689e9db6d6e6 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'dd1f05e11ee94a8b94ceef99d0752fd9', 'request_id': 'req-46232738-7aee-4f01-b72e-689e9db6d6e6'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:51.186417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-46232738-7aee-4f01-b72e-689e9db6d6e6 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'dd1f05e11ee94a8b94ceef99d0752fd9', 'request_id': 'req-46232738-7aee-4f01-b72e-689e9db6d6e6'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:51.187063 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-46232738-7aee-4f01-b72e-689e9db6d6e6 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'dd1f05e11ee94a8b94ceef99d0752fd9', 'request_id': 'req-46232738-7aee-4f01-b72e-689e9db6d6e6'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:51.196173 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3907/7801] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:40:50 2022] DELETE /identity/v3/domains/dd1f05e11ee94a8b94ceef99d0752fd9 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:51.200342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd3426-f0f9-4ec5-b402-27cec86c9dfc tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:51.202171 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a2cd3426-f0f9-4ec5-b402-27cec86c9dfc tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:51.215744 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd3426-f0f9-4ec5-b402-27cec86c9dfc tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:51.274977 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615ec3e-1986-42d4-bb87-97c77ab6b1ab tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5b7786864b5469391d19ff74908a612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c81b4c1496d4619b9cdbda0abc6c089', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:51.275720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615ec3e-1986-42d4-bb87-97c77ab6b1ab tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:51.277075 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615ec3e-1986-42d4-bb87-97c77ab6b1ab tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:51.277075 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615ec3e-1986-42d4-bb87-97c77ab6b1ab tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:51.277075 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615ec3e-1986-42d4-bb87-97c77ab6b1ab tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:51.278817 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615ec3e-1986-42d4-bb87-97c77ab6b1ab tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:51.294024 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3895/7802] 10.222.0.23 () {58 vars in 1127 bytes} [Sat Apr 30 21:40:51 2022] GET /identity/v3/domains => generated 1349 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:40:51.298517 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46232738-7aee-4f01-b72e-689e9db6d6e6 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:51.311008 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46232738-7aee-4f01-b72e-689e9db6d6e6 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:51.320742 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e737a6-b405-4181-89c9-e84d9fd35f59 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5b7786864b5469391d19ff74908a612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c81b4c1496d4619b9cdbda0abc6c089', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:51.321908 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e737a6-b405-4181-89c9-e84d9fd35f59 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:51.322290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e737a6-b405-4181-89c9-e84d9fd35f59 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:51.322627 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e737a6-b405-4181-89c9-e84d9fd35f59 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] PATH_INFO: `/v3/domains/dd1f05e11ee94a8b94ceef99d0752fd9` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:51.330977 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e737a6-b405-4181-89c9-e84d9fd35f59 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 21:40:51.342231 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-15e737a6-b405-4181-89c9-e84d9fd35f59 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Could not find domain: dd1f05e11ee94a8b94ceef99d0752fd9.: keystone.exception.DomainNotFound: Could not find domain: dd1f05e11ee94a8b94ceef99d0752fd9. Apr 30 21:40:51.342231 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:40:51.342231 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Apr 30 21:40:51.342231 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Apr 30 21:40:51.342231 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 21:40:51.342231 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 21:40:51.342231 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 21:40:51.342231 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 21:40:51.342231 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: dd1f05e11ee94a8b94ceef99d0752fd9. Apr 30 21:40:51.342231 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:40:51.342231 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 21:40:51.342231 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:40:51.342231 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:40:51.342231 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:40:51.342231 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:40:51.342231 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:40:51.343128 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:40:51.343128 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:40:51.343128 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:40:51.343128 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:40:51.343128 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:40:51.343128 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:40:51.343128 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:40:51.343128 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Apr 30 21:40:51.343128 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Apr 30 21:40:51.343128 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 21:40:51.343128 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 21:40:51.343128 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 21:40:51.343128 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 21:40:51.343128 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:40:51.343128 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:40:51.343128 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 21:40:51.346557 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 21:40:51.346557 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 21:40:51.346557 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 21:40:51.346557 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 21:40:51.346557 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 21:40:51.346557 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 21:40:51.346557 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 21:40:51.346557 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 21:40:51.346557 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 21:40:51.346557 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 21:40:51.346557 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 21:40:51.346557 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 21:40:51.346557 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 21:40:51.346557 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Apr 30 21:40:51.346557 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 21:40:51.346557 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: dd1f05e11ee94a8b94ceef99d0752fd9. Apr 30 21:40:51.346557 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:40:51.347495 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3908/7803] 10.222.0.23 () {60 vars in 1248 bytes} [Sat Apr 30 21:40:51 2022] PATCH /identity/v3/domains/dd1f05e11ee94a8b94ceef99d0752fd9 => generated 112 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 30 21:40:51.348988 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615ec3e-1986-42d4-bb87-97c77ab6b1ab tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:51.359942 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615ec3e-1986-42d4-bb87-97c77ab6b1ab tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:51.364669 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3755755-f2ea-4aaf-b54c-a5c96fbb2fa3 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5b7786864b5469391d19ff74908a612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c81b4c1496d4619b9cdbda0abc6c089', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:51.366084 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3755755-f2ea-4aaf-b54c-a5c96fbb2fa3 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:51.366384 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3755755-f2ea-4aaf-b54c-a5c96fbb2fa3 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:51.366667 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3755755-f2ea-4aaf-b54c-a5c96fbb2fa3 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:51.367398 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3755755-f2ea-4aaf-b54c-a5c96fbb2fa3 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:51.374081 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3755755-f2ea-4aaf-b54c-a5c96fbb2fa3 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:51.458499 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3896/7804] 10.222.0.23 () {60 vars in 1148 bytes} [Sat Apr 30 21:40:51 2022] POST /identity/v3/domains => generated 275 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:40:51.462631 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e737a6-b405-4181-89c9-e84d9fd35f59 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:51.472379 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e737a6-b405-4181-89c9-e84d9fd35f59 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:51.530271 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db3ce9-0a66-4236-92a2-47eebd1db278 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5b7786864b5469391d19ff74908a612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c81b4c1496d4619b9cdbda0abc6c089', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:51.530986 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db3ce9-0a66-4236-92a2-47eebd1db278 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:51.531276 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db3ce9-0a66-4236-92a2-47eebd1db278 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:51.531564 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db3ce9-0a66-4236-92a2-47eebd1db278 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:51.532265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db3ce9-0a66-4236-92a2-47eebd1db278 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:51.534286 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db3ce9-0a66-4236-92a2-47eebd1db278 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:51.626421 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3909/7805] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:40:51 2022] POST /identity/v3/users => generated 346 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:40:51.627603 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3755755-f2ea-4aaf-b54c-a5c96fbb2fa3 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:51.638660 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3755755-f2ea-4aaf-b54c-a5c96fbb2fa3 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:51.643372 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880d487-0bf7-413e-9282-c9f519f20dab tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5b7786864b5469391d19ff74908a612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c81b4c1496d4619b9cdbda0abc6c089', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:51.644042 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880d487-0bf7-413e-9282-c9f519f20dab tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:51.644329 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880d487-0bf7-413e-9282-c9f519f20dab tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:51.644609 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880d487-0bf7-413e-9282-c9f519f20dab tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] PATH_INFO: `/v3/groups` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:51.645333 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5880d487-0bf7-413e-9282-c9f519f20dab tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:51.647378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5880d487-0bf7-413e-9282-c9f519f20dab tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:51.718302 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3897/7806] 10.222.0.23 () {60 vars in 1146 bytes} [Sat Apr 30 21:40:51 2022] POST /identity/v3/groups => generated 324 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:40:51.719394 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db3ce9-0a66-4236-92a2-47eebd1db278 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:51.730061 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db3ce9-0a66-4236-92a2-47eebd1db278 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:51.734800 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d731d-e013-4099-a9c2-c203f6ca59d4 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5b7786864b5469391d19ff74908a612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c81b4c1496d4619b9cdbda0abc6c089', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:51.735790 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d731d-e013-4099-a9c2-c203f6ca59d4 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:51.736079 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d731d-e013-4099-a9c2-c203f6ca59d4 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:51.736467 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d731d-e013-4099-a9c2-c203f6ca59d4 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] PATH_INFO: `/v3/domains/be82c043ce774f829a275ead72a05654` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:51.737824 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65d731d-e013-4099-a9c2-c203f6ca59d4 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=be82c043ce774f829a275ead72a05654)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:51.739447 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65d731d-e013-4099-a9c2-c203f6ca59d4 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:51.764036 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c65d731d-e013-4099-a9c2-c203f6ca59d4 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'be82c043ce774f829a275ead72a05654'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:51.764792 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c65d731d-e013-4099-a9c2-c203f6ca59d4 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'be82c043ce774f829a275ead72a05654'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:51.837788 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c65d731d-e013-4099-a9c2-c203f6ca59d4 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'be82c043ce774f829a275ead72a05654'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:51.838867 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c65d731d-e013-4099-a9c2-c203f6ca59d4 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'be82c043ce774f829a275ead72a05654'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:51.844175 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3910/7807] 10.222.0.23 () {60 vars in 1248 bytes} [Sat Apr 30 21:40:51 2022] PATCH /identity/v3/domains/be82c043ce774f829a275ead72a05654 => generated 276 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:40:51.845311 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880d487-0bf7-413e-9282-c9f519f20dab tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:51.847155 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5880d487-0bf7-413e-9282-c9f519f20dab tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:51.859826 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880d487-0bf7-413e-9282-c9f519f20dab tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:51.918638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206d0dc-cc99-4550-a83b-a32354576b27 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5b7786864b5469391d19ff74908a612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c81b4c1496d4619b9cdbda0abc6c089', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:51.919550 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206d0dc-cc99-4550-a83b-a32354576b27 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:51.919842 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206d0dc-cc99-4550-a83b-a32354576b27 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:51.920129 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206d0dc-cc99-4550-a83b-a32354576b27 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] PATH_INFO: `/v3/domains/be82c043ce774f829a275ead72a05654` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:51.932306 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206d0dc-cc99-4550-a83b-a32354576b27 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=be82c043ce774f829a275ead72a05654)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:51.934117 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206d0dc-cc99-4550-a83b-a32354576b27 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:51.957798 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b206d0dc-cc99-4550-a83b-a32354576b27 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'be82c043ce774f829a275ead72a05654'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:51.962083 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b206d0dc-cc99-4550-a83b-a32354576b27 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'be82c043ce774f829a275ead72a05654'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:52.295234 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b206d0dc-cc99-4550-a83b-a32354576b27 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ff836893c954c21ae65f1e0a062d825'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:52.307737 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b206d0dc-cc99-4550-a83b-a32354576b27 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ff836893c954c21ae65f1e0a062d825'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:52.375678 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b206d0dc-cc99-4550-a83b-a32354576b27 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ff836893c954c21ae65f1e0a062d825'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:52.376844 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b206d0dc-cc99-4550-a83b-a32354576b27 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ff836893c954c21ae65f1e0a062d825'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:52.385265 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b206d0dc-cc99-4550-a83b-a32354576b27 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ff836893c954c21ae65f1e0a062d825'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:52.507435 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b206d0dc-cc99-4550-a83b-a32354576b27 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be82c043ce774f829a275ead72a05654', 'request_id': 'req-b206d0dc-cc99-4550-a83b-a32354576b27'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:52.514564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b206d0dc-cc99-4550-a83b-a32354576b27 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be82c043ce774f829a275ead72a05654', 'request_id': 'req-b206d0dc-cc99-4550-a83b-a32354576b27'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:52.521219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b206d0dc-cc99-4550-a83b-a32354576b27 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be82c043ce774f829a275ead72a05654', 'request_id': 'req-b206d0dc-cc99-4550-a83b-a32354576b27'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:52.617994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b206d0dc-cc99-4550-a83b-a32354576b27 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] The token cache is being invalidate because project be82c043ce774f829a275ead72a05654 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:40:52.618362 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b206d0dc-cc99-4550-a83b-a32354576b27 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:52.619025 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b206d0dc-cc99-4550-a83b-a32354576b27 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:52.627162 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b206d0dc-cc99-4550-a83b-a32354576b27 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'be82c043ce774f829a275ead72a05654', 'request_id': 'req-b206d0dc-cc99-4550-a83b-a32354576b27'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:52.631618 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b206d0dc-cc99-4550-a83b-a32354576b27 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'be82c043ce774f829a275ead72a05654', 'request_id': 'req-b206d0dc-cc99-4550-a83b-a32354576b27'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:52.631618 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b206d0dc-cc99-4550-a83b-a32354576b27 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'be82c043ce774f829a275ead72a05654', 'request_id': 'req-b206d0dc-cc99-4550-a83b-a32354576b27'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:52.637493 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3898/7808] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:40:51 2022] DELETE /identity/v3/domains/be82c043ce774f829a275ead72a05654 => generated 0 bytes in 792 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:52.641481 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d731d-e013-4099-a9c2-c203f6ca59d4 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:52.651944 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d731d-e013-4099-a9c2-c203f6ca59d4 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:52.707826 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d291435-fa5b-44d8-a492-99a25959a7e3 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5b7786864b5469391d19ff74908a612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c81b4c1496d4619b9cdbda0abc6c089', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:52.708683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d291435-fa5b-44d8-a492-99a25959a7e3 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:52.709007 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d291435-fa5b-44d8-a492-99a25959a7e3 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:52.709284 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d291435-fa5b-44d8-a492-99a25959a7e3 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] PATH_INFO: `/v3/domains/be82c043ce774f829a275ead72a05654` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:52.715958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d291435-fa5b-44d8-a492-99a25959a7e3 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=be82c043ce774f829a275ead72a05654)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:52.717927 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d291435-fa5b-44d8-a492-99a25959a7e3 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:52.734124 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-5d291435-fa5b-44d8-a492-99a25959a7e3 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Could not find domain: be82c043ce774f829a275ead72a05654.: keystone.exception.DomainNotFound: Could not find domain: be82c043ce774f829a275ead72a05654. Apr 30 21:40:52.734124 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:40:52.734124 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Apr 30 21:40:52.734124 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Apr 30 21:40:52.734124 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 21:40:52.734124 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 21:40:52.734124 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 21:40:52.734124 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 21:40:52.734124 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: be82c043ce774f829a275ead72a05654. Apr 30 21:40:52.734124 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:40:52.734124 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 21:40:52.734124 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:40:52.734124 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:40:52.734124 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:40:52.734124 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:40:52.734124 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:40:52.735097 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:40:52.735097 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:40:52.735097 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:40:52.735097 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:40:52.735097 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:40:52.735097 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:40:52.735097 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:40:52.735097 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Apr 30 21:40:52.735097 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Apr 30 21:40:52.735097 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Apr 30 21:40:52.735097 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Apr 30 21:40:52.735097 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:40:52.735097 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:40:52.735097 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 21:40:52.735097 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 21:40:52.735097 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 21:40:52.735097 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 21:40:52.737308 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 21:40:52.737308 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 21:40:52.737308 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 21:40:52.737308 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 21:40:52.737308 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 21:40:52.737308 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 21:40:52.737308 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 21:40:52.737308 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 21:40:52.737308 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 21:40:52.737308 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 21:40:52.737308 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Apr 30 21:40:52.737308 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 21:40:52.737308 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: be82c043ce774f829a275ead72a05654. Apr 30 21:40:52.737308 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:40:52.737308 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3911/7809] 10.222.0.23 () {58 vars in 1226 bytes} [Sat Apr 30 21:40:52 2022] GET /identity/v3/domains/be82c043ce774f829a275ead72a05654 => generated 112 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 30 21:40:52.743891 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206d0dc-cc99-4550-a83b-a32354576b27 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:52.745402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b206d0dc-cc99-4550-a83b-a32354576b27 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:52.757950 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206d0dc-cc99-4550-a83b-a32354576b27 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:52.762635 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07fe3d7-dfeb-4773-b8c0-2abe0f73c16b tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5b7786864b5469391d19ff74908a612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c81b4c1496d4619b9cdbda0abc6c089', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:52.763586 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fe3d7-dfeb-4773-b8c0-2abe0f73c16b tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:52.763953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fe3d7-dfeb-4773-b8c0-2abe0f73c16b tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:52.764218 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fe3d7-dfeb-4773-b8c0-2abe0f73c16b tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] PATH_INFO: `/v3/users/4ff836893c954c21ae65f1e0a062d825` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:52.773194 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07fe3d7-dfeb-4773-b8c0-2abe0f73c16b tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorizing `identity:get_user(user_id=4ff836893c954c21ae65f1e0a062d825)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:52.775600 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07fe3d7-dfeb-4773-b8c0-2abe0f73c16b tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:52.793201 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-d07fe3d7-dfeb-4773-b8c0-2abe0f73c16b tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Could not find user: 4ff836893c954c21ae65f1e0a062d825.: keystone.exception.UserNotFound: Could not find user: 4ff836893c954c21ae65f1e0a062d825. Apr 30 21:40:52.793201 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:40:52.793201 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:40:52.793201 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:40:52.793201 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:40:52.793201 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:40:52.793201 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:40:52.793201 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:40:52.793201 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:40:52.793201 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:40:52.793201 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:40:52.793201 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:40:52.793201 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Apr 30 21:40:52.793201 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_user(user_id) Apr 30 21:40:52.793201 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Apr 30 21:40:52.794265 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Apr 30 21:40:52.794265 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:40:52.794265 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:40:52.794265 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 21:40:52.794265 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 21:40:52.794265 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 21:40:52.794265 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 21:40:52.794265 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 21:40:52.794265 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 21:40:52.794265 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 21:40:52.794265 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 21:40:52.794265 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 21:40:52.794265 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 21:40:52.794265 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 21:40:52.794265 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 21:40:52.794265 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 21:40:52.794265 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 21:40:52.798416 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 21:40:52.798416 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 21:40:52.798416 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 21:40:52.798416 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 21:40:52.798416 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 21:40:52.798416 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 21:40:52.798416 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 21:40:52.798416 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 21:40:52.798416 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 21:40:52.798416 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 21:40:52.798416 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 4ff836893c954c21ae65f1e0a062d825. Apr 30 21:40:52.798416 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:40:52.798416 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3899/7810] 10.222.0.23 () {58 vars in 1220 bytes} [Sat Apr 30 21:40:52 2022] GET /identity/v3/users/4ff836893c954c21ae65f1e0a062d825 => generated 110 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 30 21:40:52.799126 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d291435-fa5b-44d8-a492-99a25959a7e3 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:52.809596 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d291435-fa5b-44d8-a492-99a25959a7e3 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:52.814212 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e863e5-1146-4e12-8f40-08c23b0155c4 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5b7786864b5469391d19ff74908a612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c81b4c1496d4619b9cdbda0abc6c089', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:52.815050 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e863e5-1146-4e12-8f40-08c23b0155c4 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:52.815337 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e863e5-1146-4e12-8f40-08c23b0155c4 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:52.815617 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e863e5-1146-4e12-8f40-08c23b0155c4 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] PATH_INFO: `/v3/groups/e3edd0838c4b4b09a44d3dff70774a32` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:52.820405 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e863e5-1146-4e12-8f40-08c23b0155c4 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorizing `identity:get_group(group_id=e3edd0838c4b4b09a44d3dff70774a32)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:52.822348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e863e5-1146-4e12-8f40-08c23b0155c4 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:52.843970 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-09e863e5-1146-4e12-8f40-08c23b0155c4 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Could not find group: e3edd0838c4b4b09a44d3dff70774a32.: keystone.exception.GroupNotFound: Could not find group: e3edd0838c4b4b09a44d3dff70774a32. Apr 30 21:40:52.843970 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:40:52.843970 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:40:52.843970 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:40:52.843970 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:40:52.843970 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:40:52.843970 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:40:52.843970 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:40:52.843970 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:40:52.843970 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:40:52.843970 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:40:52.843970 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:40:52.843970 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Apr 30 21:40:52.843970 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_group(group_id) Apr 30 21:40:52.848463 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Apr 30 21:40:52.848463 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Apr 30 21:40:52.848463 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:40:52.848463 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:40:52.848463 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 21:40:52.848463 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 21:40:52.848463 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 21:40:52.848463 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 21:40:52.848463 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 21:40:52.848463 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 21:40:52.848463 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 21:40:52.848463 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 21:40:52.848463 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 21:40:52.848463 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 21:40:52.848463 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 21:40:52.848463 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 21:40:52.848463 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 21:40:52.849373 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 21:40:52.849373 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 21:40:52.849373 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 21:40:52.849373 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 21:40:52.849373 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 21:40:52.849373 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Apr 30 21:40:52.849373 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Apr 30 21:40:52.849373 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Apr 30 21:40:52.849373 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Apr 30 21:40:52.849373 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Apr 30 21:40:52.849373 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Apr 30 21:40:52.849373 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: e3edd0838c4b4b09a44d3dff70774a32. Apr 30 21:40:52.849373 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:40:52.849373 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3912/7811] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:40:52 2022] GET /identity/v3/groups/e3edd0838c4b4b09a44d3dff70774a32 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 30 21:40:52.850813 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07fe3d7-dfeb-4773-b8c0-2abe0f73c16b tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:52.859813 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07fe3d7-dfeb-4773-b8c0-2abe0f73c16b tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:52.864391 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba10540-6780-45c4-9b35-f535df0e2483 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5b7786864b5469391d19ff74908a612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c81b4c1496d4619b9cdbda0abc6c089', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:52.865229 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba10540-6780-45c4-9b35-f535df0e2483 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:52.865528 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba10540-6780-45c4-9b35-f535df0e2483 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:52.865831 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba10540-6780-45c4-9b35-f535df0e2483 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] PATH_INFO: `/v3/groups/e3edd0838c4b4b09a44d3dff70774a32` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:52.870338 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba10540-6780-45c4-9b35-f535df0e2483 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 21:40:52.880091 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-2ba10540-6780-45c4-9b35-f535df0e2483 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Could not find group: e3edd0838c4b4b09a44d3dff70774a32.: keystone.exception.GroupNotFound: Could not find group: e3edd0838c4b4b09a44d3dff70774a32. Apr 30 21:40:52.880091 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:40:52.880091 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:40:52.880091 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:40:52.880091 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:40:52.880091 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:40:52.880091 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:40:52.880091 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:40:52.880091 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:40:52.880091 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:40:52.880091 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:40:52.880091 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:40:52.880091 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Apr 30 21:40:52.880091 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Apr 30 21:40:52.880964 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 21:40:52.880964 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 21:40:52.880964 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 21:40:52.880964 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 21:40:52.880964 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:40:52.880964 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:40:52.880964 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 21:40:52.880964 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 21:40:52.880964 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 21:40:52.880964 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 21:40:52.880964 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 21:40:52.880964 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 21:40:52.880964 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 21:40:52.880964 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 21:40:52.880964 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 21:40:52.880964 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 21:40:52.880964 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 21:40:52.882091 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 21:40:52.882091 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 21:40:52.882091 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 21:40:52.882091 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 21:40:52.882091 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 21:40:52.882091 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 21:40:52.882091 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 21:40:52.882091 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Apr 30 21:40:52.882091 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Apr 30 21:40:52.882091 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Apr 30 21:40:52.882091 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Apr 30 21:40:52.882091 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Apr 30 21:40:52.882091 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Apr 30 21:40:52.882091 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: e3edd0838c4b4b09a44d3dff70774a32. Apr 30 21:40:52.882091 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:40:52.882091 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3900/7812] 10.222.0.23 () {58 vars in 1226 bytes} [Sat Apr 30 21:40:52 2022] DELETE /identity/v3/groups/e3edd0838c4b4b09a44d3dff70774a32 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 30 21:40:52.885789 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e863e5-1146-4e12-8f40-08c23b0155c4 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:52.896143 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e863e5-1146-4e12-8f40-08c23b0155c4 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:52.901795 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc07ad4-cdb8-4223-83bc-b3fcb673a98e tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5b7786864b5469391d19ff74908a612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c81b4c1496d4619b9cdbda0abc6c089', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:52.902690 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc07ad4-cdb8-4223-83bc-b3fcb673a98e tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:52.902977 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc07ad4-cdb8-4223-83bc-b3fcb673a98e tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:52.903253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc07ad4-cdb8-4223-83bc-b3fcb673a98e tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] PATH_INFO: `/v3/users/4ff836893c954c21ae65f1e0a062d825` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:52.911290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc07ad4-cdb8-4223-83bc-b3fcb673a98e tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorizing `identity:delete_user(user_id=4ff836893c954c21ae65f1e0a062d825)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:52.913742 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc07ad4-cdb8-4223-83bc-b3fcb673a98e tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:52.930669 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-9fc07ad4-cdb8-4223-83bc-b3fcb673a98e tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Could not find user: 4ff836893c954c21ae65f1e0a062d825.: keystone.exception.UserNotFound: Could not find user: 4ff836893c954c21ae65f1e0a062d825. Apr 30 21:40:52.930669 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:40:52.930669 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:40:52.930669 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:40:52.930669 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:40:52.930669 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:40:52.930669 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:40:52.930669 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:40:52.930669 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:40:52.930669 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:40:52.930669 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:40:52.930669 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:40:52.930669 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Apr 30 21:40:52.930669 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Apr 30 21:40:52.934717 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:40:52.934717 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:40:52.934717 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 21:40:52.934717 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 21:40:52.934717 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 21:40:52.934717 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 21:40:52.934717 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Apr 30 21:40:52.934717 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Apr 30 21:40:52.934717 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:40:52.934717 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:40:52.934717 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Apr 30 21:40:52.934717 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 21:40:52.934717 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Apr 30 21:40:52.934717 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Apr 30 21:40:52.934717 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 21:40:52.934717 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 21:40:52.934717 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 21:40:52.934717 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 21:40:52.935920 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 21:40:52.935920 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 21:40:52.935920 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 21:40:52.935920 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 21:40:52.935920 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 21:40:52.935920 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 21:40:52.935920 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 21:40:52.935920 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 21:40:52.935920 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 21:40:52.935920 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 21:40:52.935920 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Apr 30 21:40:52.935920 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Apr 30 21:40:52.935920 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Apr 30 21:40:52.935920 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Apr 30 21:40:52.935920 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Apr 30 21:40:52.935920 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Apr 30 21:40:52.935920 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 4ff836893c954c21ae65f1e0a062d825. Apr 30 21:40:52.935920 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:40:52.937088 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3913/7813] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:40:52 2022] DELETE /identity/v3/users/4ff836893c954c21ae65f1e0a062d825 => generated 110 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 30 21:40:52.937161 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba10540-6780-45c4-9b35-f535df0e2483 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:52.947795 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba10540-6780-45c4-9b35-f535df0e2483 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:52.952415 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d706ba1-fedd-4edb-a838-83c7d5c5fa43 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5b7786864b5469391d19ff74908a612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c81b4c1496d4619b9cdbda0abc6c089', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:52.953292 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d706ba1-fedd-4edb-a838-83c7d5c5fa43 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:52.953575 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d706ba1-fedd-4edb-a838-83c7d5c5fa43 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:52.953880 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d706ba1-fedd-4edb-a838-83c7d5c5fa43 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] PATH_INFO: `/v3/domains/be82c043ce774f829a275ead72a05654` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:52.961378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d706ba1-fedd-4edb-a838-83c7d5c5fa43 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 21:40:52.971245 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-7d706ba1-fedd-4edb-a838-83c7d5c5fa43 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Could not find domain: be82c043ce774f829a275ead72a05654.: keystone.exception.DomainNotFound: Could not find domain: be82c043ce774f829a275ead72a05654. Apr 30 21:40:52.971245 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:40:52.971245 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Apr 30 21:40:52.971245 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Apr 30 21:40:52.971245 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 21:40:52.971245 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 21:40:52.971245 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 21:40:52.971245 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 21:40:52.971245 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: be82c043ce774f829a275ead72a05654. Apr 30 21:40:52.971245 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:40:52.971245 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 21:40:52.971245 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:40:52.971245 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:40:52.971245 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:40:52.971245 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:40:52.971245 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:40:52.972342 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:40:52.972342 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:40:52.972342 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:40:52.972342 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:40:52.972342 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:40:52.972342 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:40:52.972342 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:40:52.972342 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Apr 30 21:40:52.972342 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Apr 30 21:40:52.972342 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 21:40:52.972342 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 21:40:52.972342 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 21:40:52.972342 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 21:40:52.972342 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:40:52.972342 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:40:52.972342 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 21:40:52.973251 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 21:40:52.973251 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 21:40:52.973251 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 21:40:52.973251 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 21:40:52.973251 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 21:40:52.973251 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 21:40:52.973251 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 21:40:52.973251 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 21:40:52.973251 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 21:40:52.973251 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 21:40:52.973251 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 21:40:52.973251 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 21:40:52.973251 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 21:40:52.973251 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Apr 30 21:40:52.973251 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 21:40:52.973251 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: be82c043ce774f829a275ead72a05654. Apr 30 21:40:52.973251 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:40:52.974517 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3901/7814] 10.222.0.23 () {60 vars in 1248 bytes} [Sat Apr 30 21:40:52 2022] PATCH /identity/v3/domains/be82c043ce774f829a275ead72a05654 => generated 112 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 30 21:40:52.978713 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc07ad4-cdb8-4223-83bc-b3fcb673a98e tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:52.988949 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc07ad4-cdb8-4223-83bc-b3fcb673a98e tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:52.993743 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ef5dc-a99c-4df9-a902-64e7f1394a03 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5b7786864b5469391d19ff74908a612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c81b4c1496d4619b9cdbda0abc6c089', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:52.994545 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ef5dc-a99c-4df9-a902-64e7f1394a03 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:52.994905 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ef5dc-a99c-4df9-a902-64e7f1394a03 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:52.995257 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ef5dc-a99c-4df9-a902-64e7f1394a03 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:52.996030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ef5dc-a99c-4df9-a902-64e7f1394a03 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:52.997705 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ef5dc-a99c-4df9-a902-64e7f1394a03 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:53.011259 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3914/7815] 10.222.0.23 () {58 vars in 1127 bytes} [Sat Apr 30 21:40:52 2022] GET /identity/v3/domains => generated 1349 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:40:53.016343 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d706ba1-fedd-4edb-a838-83c7d5c5fa43 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:53.027707 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d706ba1-fedd-4edb-a838-83c7d5c5fa43 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:53.032737 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850203e-af56-4966-b777-cc923e9a2e9c tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5b7786864b5469391d19ff74908a612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c81b4c1496d4619b9cdbda0abc6c089', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:53.033397 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850203e-af56-4966-b777-cc923e9a2e9c tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:53.033681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850203e-af56-4966-b777-cc923e9a2e9c tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:53.033994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850203e-af56-4966-b777-cc923e9a2e9c tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:53.034719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1850203e-af56-4966-b777-cc923e9a2e9c tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:40:53.035025 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1850203e-af56-4966-b777-cc923e9a2e9c tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:53.036631 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1850203e-af56-4966-b777-cc923e9a2e9c tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:53.056428 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3902/7816] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:40:53 2022] GET /identity/v3/domains?enabled=True => generated 1095 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:40:53.062111 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ef5dc-a99c-4df9-a902-64e7f1394a03 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:53.071733 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ef5dc-a99c-4df9-a902-64e7f1394a03 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:53.076434 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca87a8-2dfe-4d7c-a82a-c0b742a38568 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5b7786864b5469391d19ff74908a612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c81b4c1496d4619b9cdbda0abc6c089', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:53.077654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca87a8-2dfe-4d7c-a82a-c0b742a38568 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:53.077654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca87a8-2dfe-4d7c-a82a-c0b742a38568 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:53.077654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca87a8-2dfe-4d7c-a82a-c0b742a38568 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:53.078419 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca87a8-2dfe-4d7c-a82a-c0b742a38568 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-1726183100) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:40:53.078728 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca87a8-2dfe-4d7c-a82a-c0b742a38568 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:53.080343 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca87a8-2dfe-4d7c-a82a-c0b742a38568 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:53.093586 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3915/7817] 10.222.0.23 () {58 vars in 1198 bytes} [Sat Apr 30 21:40:53 2022] GET /identity/v3/domains?name=tempest-test_domain-1726183100 => generated 409 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:40:53.097041 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850203e-af56-4966-b777-cc923e9a2e9c tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:53.109708 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850203e-af56-4966-b777-cc923e9a2e9c tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:53.114950 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8faf7-b871-41fc-bf43-93a3945e52af tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5b7786864b5469391d19ff74908a612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c81b4c1496d4619b9cdbda0abc6c089', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:53.117934 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8faf7-b871-41fc-bf43-93a3945e52af tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:53.117934 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8faf7-b871-41fc-bf43-93a3945e52af tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:53.117934 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8faf7-b871-41fc-bf43-93a3945e52af tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] PATH_INFO: `/v3/domains/be82c043ce774f829a275ead72a05654` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:53.123772 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b8faf7-b871-41fc-bf43-93a3945e52af tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 21:40:53.135803 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-90b8faf7-b871-41fc-bf43-93a3945e52af tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Could not find domain: be82c043ce774f829a275ead72a05654.: keystone.exception.DomainNotFound: Could not find domain: be82c043ce774f829a275ead72a05654. Apr 30 21:40:53.135803 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:40:53.135803 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Apr 30 21:40:53.135803 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Apr 30 21:40:53.135803 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 21:40:53.135803 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 21:40:53.135803 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 21:40:53.135803 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 21:40:53.135803 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: be82c043ce774f829a275ead72a05654. Apr 30 21:40:53.135803 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:40:53.135803 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 21:40:53.135803 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:40:53.135803 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:40:53.135803 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:40:53.135803 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:40:53.135803 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:40:53.136879 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:40:53.136879 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:40:53.136879 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:40:53.136879 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:40:53.136879 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:40:53.136879 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:40:53.136879 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:40:53.136879 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Apr 30 21:40:53.136879 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Apr 30 21:40:53.136879 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 21:40:53.136879 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 21:40:53.136879 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 21:40:53.136879 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 21:40:53.136879 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:40:53.136879 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:40:53.136879 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 21:40:53.137942 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 21:40:53.137942 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 21:40:53.137942 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 21:40:53.137942 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 21:40:53.137942 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 21:40:53.137942 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 21:40:53.137942 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 21:40:53.137942 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 21:40:53.137942 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 21:40:53.137942 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 21:40:53.137942 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 21:40:53.137942 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 21:40:53.137942 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 21:40:53.137942 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Apr 30 21:40:53.137942 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 21:40:53.137942 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: be82c043ce774f829a275ead72a05654. Apr 30 21:40:53.137942 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:40:53.139055 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3903/7818] 10.222.0.23 () {60 vars in 1248 bytes} [Sat Apr 30 21:40:53 2022] PATCH /identity/v3/domains/be82c043ce774f829a275ead72a05654 => generated 112 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Apr 30 21:40:53.141233 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca87a8-2dfe-4d7c-a82a-c0b742a38568 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:53.152178 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca87a8-2dfe-4d7c-a82a-c0b742a38568 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:53.156891 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9923fc-4e2a-4014-991e-5c0954c1c0b3 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5b7786864b5469391d19ff74908a612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c81b4c1496d4619b9cdbda0abc6c089', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:53.157794 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9923fc-4e2a-4014-991e-5c0954c1c0b3 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:53.158059 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9923fc-4e2a-4014-991e-5c0954c1c0b3 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:53.158339 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9923fc-4e2a-4014-991e-5c0954c1c0b3 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] PATH_INFO: `/v3/domains/32502400495a46479187bf86b34eeab9` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:53.170289 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9923fc-4e2a-4014-991e-5c0954c1c0b3 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=32502400495a46479187bf86b34eeab9)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:53.175230 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9923fc-4e2a-4014-991e-5c0954c1c0b3 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:53.215438 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3916/7819] 10.222.0.23 () {60 vars in 1248 bytes} [Sat Apr 30 21:40:53 2022] PATCH /identity/v3/domains/32502400495a46479187bf86b34eeab9 => generated 278 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:40:53.219386 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8faf7-b871-41fc-bf43-93a3945e52af tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:53.229674 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8faf7-b871-41fc-bf43-93a3945e52af tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:53.234348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93679139-23ac-4c0c-9d77-1e7e134a295d tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5b7786864b5469391d19ff74908a612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c81b4c1496d4619b9cdbda0abc6c089', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:53.241334 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93679139-23ac-4c0c-9d77-1e7e134a295d tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:53.241334 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93679139-23ac-4c0c-9d77-1e7e134a295d tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:53.241334 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93679139-23ac-4c0c-9d77-1e7e134a295d tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] PATH_INFO: `/v3/domains/32502400495a46479187bf86b34eeab9` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:53.248267 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93679139-23ac-4c0c-9d77-1e7e134a295d tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=32502400495a46479187bf86b34eeab9)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:53.249948 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93679139-23ac-4c0c-9d77-1e7e134a295d tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:53.272467 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-93679139-23ac-4c0c-9d77-1e7e134a295d tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '32502400495a46479187bf86b34eeab9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:53.281312 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-93679139-23ac-4c0c-9d77-1e7e134a295d tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '32502400495a46479187bf86b34eeab9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:53.405140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-93679139-23ac-4c0c-9d77-1e7e134a295d tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32502400495a46479187bf86b34eeab9', 'request_id': 'req-93679139-23ac-4c0c-9d77-1e7e134a295d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:53.410806 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-93679139-23ac-4c0c-9d77-1e7e134a295d tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32502400495a46479187bf86b34eeab9', 'request_id': 'req-93679139-23ac-4c0c-9d77-1e7e134a295d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:53.418940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-93679139-23ac-4c0c-9d77-1e7e134a295d tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32502400495a46479187bf86b34eeab9', 'request_id': 'req-93679139-23ac-4c0c-9d77-1e7e134a295d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:53.501161 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-93679139-23ac-4c0c-9d77-1e7e134a295d tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] The token cache is being invalidate because project 32502400495a46479187bf86b34eeab9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:40:53.501538 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-93679139-23ac-4c0c-9d77-1e7e134a295d tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:53.502295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-93679139-23ac-4c0c-9d77-1e7e134a295d tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:53.511402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-93679139-23ac-4c0c-9d77-1e7e134a295d tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '32502400495a46479187bf86b34eeab9', 'request_id': 'req-93679139-23ac-4c0c-9d77-1e7e134a295d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:53.512169 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-93679139-23ac-4c0c-9d77-1e7e134a295d tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '32502400495a46479187bf86b34eeab9', 'request_id': 'req-93679139-23ac-4c0c-9d77-1e7e134a295d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:53.512903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-93679139-23ac-4c0c-9d77-1e7e134a295d tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '32502400495a46479187bf86b34eeab9', 'request_id': 'req-93679139-23ac-4c0c-9d77-1e7e134a295d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:53.524500 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3904/7820] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:40:53 2022] DELETE /identity/v3/domains/32502400495a46479187bf86b34eeab9 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:53.528727 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9923fc-4e2a-4014-991e-5c0954c1c0b3 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:53.530588 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6d9923fc-4e2a-4014-991e-5c0954c1c0b3 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:53.543322 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9923fc-4e2a-4014-991e-5c0954c1c0b3 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:53.611912 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e7716-39ec-43e5-af52-dd19c278e448 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5b7786864b5469391d19ff74908a612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c81b4c1496d4619b9cdbda0abc6c089', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:53.612821 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e7716-39ec-43e5-af52-dd19c278e448 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:53.613110 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e7716-39ec-43e5-af52-dd19c278e448 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:53.613420 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e7716-39ec-43e5-af52-dd19c278e448 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] PATH_INFO: `/v3/domains/42c70ace8f344a5fa6018d523490922f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:53.625323 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e7716-39ec-43e5-af52-dd19c278e448 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=42c70ace8f344a5fa6018d523490922f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:53.627039 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e7716-39ec-43e5-af52-dd19c278e448 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:53.647100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d40e7716-39ec-43e5-af52-dd19c278e448 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '42c70ace8f344a5fa6018d523490922f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:53.649853 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d40e7716-39ec-43e5-af52-dd19c278e448 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '42c70ace8f344a5fa6018d523490922f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:53.733652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d40e7716-39ec-43e5-af52-dd19c278e448 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '42c70ace8f344a5fa6018d523490922f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:53.734322 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d40e7716-39ec-43e5-af52-dd19c278e448 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '42c70ace8f344a5fa6018d523490922f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:53.737187 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3917/7821] 10.222.0.23 () {60 vars in 1248 bytes} [Sat Apr 30 21:40:53 2022] PATCH /identity/v3/domains/42c70ace8f344a5fa6018d523490922f => generated 277 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:40:53.741428 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93679139-23ac-4c0c-9d77-1e7e134a295d tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:53.751453 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93679139-23ac-4c0c-9d77-1e7e134a295d tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:53.809648 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa988f4-5722-4d93-a670-8244335cab13 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5b7786864b5469391d19ff74908a612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c81b4c1496d4619b9cdbda0abc6c089', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:53.810541 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa988f4-5722-4d93-a670-8244335cab13 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:53.810823 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa988f4-5722-4d93-a670-8244335cab13 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:53.811094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa988f4-5722-4d93-a670-8244335cab13 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] PATH_INFO: `/v3/domains/42c70ace8f344a5fa6018d523490922f` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:53.822203 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa988f4-5722-4d93-a670-8244335cab13 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=42c70ace8f344a5fa6018d523490922f)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:53.825906 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa988f4-5722-4d93-a670-8244335cab13 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:53.846188 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0aa988f4-5722-4d93-a670-8244335cab13 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '42c70ace8f344a5fa6018d523490922f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:53.849556 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0aa988f4-5722-4d93-a670-8244335cab13 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '42c70ace8f344a5fa6018d523490922f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:53.976031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0aa988f4-5722-4d93-a670-8244335cab13 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42c70ace8f344a5fa6018d523490922f', 'request_id': 'req-0aa988f4-5722-4d93-a670-8244335cab13'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:53.981698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0aa988f4-5722-4d93-a670-8244335cab13 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42c70ace8f344a5fa6018d523490922f', 'request_id': 'req-0aa988f4-5722-4d93-a670-8244335cab13'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:53.988688 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0aa988f4-5722-4d93-a670-8244335cab13 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42c70ace8f344a5fa6018d523490922f', 'request_id': 'req-0aa988f4-5722-4d93-a670-8244335cab13'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:54.045252 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0aa988f4-5722-4d93-a670-8244335cab13 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] The token cache is being invalidate because project 42c70ace8f344a5fa6018d523490922f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:40:54.045666 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0aa988f4-5722-4d93-a670-8244335cab13 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:54.046339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0aa988f4-5722-4d93-a670-8244335cab13 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:54.054476 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0aa988f4-5722-4d93-a670-8244335cab13 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '42c70ace8f344a5fa6018d523490922f', 'request_id': 'req-0aa988f4-5722-4d93-a670-8244335cab13'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:54.055114 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0aa988f4-5722-4d93-a670-8244335cab13 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '42c70ace8f344a5fa6018d523490922f', 'request_id': 'req-0aa988f4-5722-4d93-a670-8244335cab13'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:54.055784 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-0aa988f4-5722-4d93-a670-8244335cab13 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '42c70ace8f344a5fa6018d523490922f', 'request_id': 'req-0aa988f4-5722-4d93-a670-8244335cab13'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:54.063826 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3905/7822] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:40:53 2022] DELETE /identity/v3/domains/42c70ace8f344a5fa6018d523490922f => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:40:54.068247 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e7716-39ec-43e5-af52-dd19c278e448 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:54.069671 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d40e7716-39ec-43e5-af52-dd19c278e448 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:54.082421 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e7716-39ec-43e5-af52-dd19c278e448 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:54.139902 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce835a3f-dc5c-4070-9b51-0df5afd5411d tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5b7786864b5469391d19ff74908a612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c81b4c1496d4619b9cdbda0abc6c089', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:54.140771 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce835a3f-dc5c-4070-9b51-0df5afd5411d tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:54.141043 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce835a3f-dc5c-4070-9b51-0df5afd5411d tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:54.141323 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce835a3f-dc5c-4070-9b51-0df5afd5411d tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] PATH_INFO: `/v3/domains/290f6eb5eb16480cba1e641e4eaef9aa` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:54.153378 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce835a3f-dc5c-4070-9b51-0df5afd5411d tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=290f6eb5eb16480cba1e641e4eaef9aa)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:54.155052 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce835a3f-dc5c-4070-9b51-0df5afd5411d tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:54.175352 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ce835a3f-dc5c-4070-9b51-0df5afd5411d tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '290f6eb5eb16480cba1e641e4eaef9aa'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:54.176468 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ce835a3f-dc5c-4070-9b51-0df5afd5411d tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '290f6eb5eb16480cba1e641e4eaef9aa'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:54.283045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ce835a3f-dc5c-4070-9b51-0df5afd5411d tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '290f6eb5eb16480cba1e641e4eaef9aa'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:54.283501 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ce835a3f-dc5c-4070-9b51-0df5afd5411d tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '290f6eb5eb16480cba1e641e4eaef9aa'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:54.286025 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3918/7823] 10.222.0.23 () {60 vars in 1248 bytes} [Sat Apr 30 21:40:54 2022] PATCH /identity/v3/domains/290f6eb5eb16480cba1e641e4eaef9aa => generated 278 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:40:54.290749 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa988f4-5722-4d93-a670-8244335cab13 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:54.292504 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0aa988f4-5722-4d93-a670-8244335cab13 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:54.305332 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa988f4-5722-4d93-a670-8244335cab13 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:54.361477 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21bf361-16a0-4c47-b3e9-c456ed215ec0 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5b7786864b5469391d19ff74908a612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c81b4c1496d4619b9cdbda0abc6c089', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:54.362380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bf361-16a0-4c47-b3e9-c456ed215ec0 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:54.362666 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bf361-16a0-4c47-b3e9-c456ed215ec0 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:54.362943 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bf361-16a0-4c47-b3e9-c456ed215ec0 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] PATH_INFO: `/v3/domains/290f6eb5eb16480cba1e641e4eaef9aa` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:54.373478 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21bf361-16a0-4c47-b3e9-c456ed215ec0 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=290f6eb5eb16480cba1e641e4eaef9aa)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:54.375155 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21bf361-16a0-4c47-b3e9-c456ed215ec0 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:54.398103 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f21bf361-16a0-4c47-b3e9-c456ed215ec0 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '290f6eb5eb16480cba1e641e4eaef9aa'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:54.401974 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f21bf361-16a0-4c47-b3e9-c456ed215ec0 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '290f6eb5eb16480cba1e641e4eaef9aa'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:54.515497 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f21bf361-16a0-4c47-b3e9-c456ed215ec0 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '290f6eb5eb16480cba1e641e4eaef9aa', 'request_id': 'req-f21bf361-16a0-4c47-b3e9-c456ed215ec0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:54.521393 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f21bf361-16a0-4c47-b3e9-c456ed215ec0 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '290f6eb5eb16480cba1e641e4eaef9aa', 'request_id': 'req-f21bf361-16a0-4c47-b3e9-c456ed215ec0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:54.529216 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f21bf361-16a0-4c47-b3e9-c456ed215ec0 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '290f6eb5eb16480cba1e641e4eaef9aa', 'request_id': 'req-f21bf361-16a0-4c47-b3e9-c456ed215ec0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:54.622400 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f21bf361-16a0-4c47-b3e9-c456ed215ec0 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] The token cache is being invalidate because project 290f6eb5eb16480cba1e641e4eaef9aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:40:54.622727 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f21bf361-16a0-4c47-b3e9-c456ed215ec0 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:54.623355 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f21bf361-16a0-4c47-b3e9-c456ed215ec0 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:54.630704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f21bf361-16a0-4c47-b3e9-c456ed215ec0 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '290f6eb5eb16480cba1e641e4eaef9aa', 'request_id': 'req-f21bf361-16a0-4c47-b3e9-c456ed215ec0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:54.631382 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f21bf361-16a0-4c47-b3e9-c456ed215ec0 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '290f6eb5eb16480cba1e641e4eaef9aa', 'request_id': 'req-f21bf361-16a0-4c47-b3e9-c456ed215ec0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:54.632010 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f21bf361-16a0-4c47-b3e9-c456ed215ec0 tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '290f6eb5eb16480cba1e641e4eaef9aa', 'request_id': 'req-f21bf361-16a0-4c47-b3e9-c456ed215ec0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:54.640146 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3906/7824] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:40:54 2022] DELETE /identity/v3/domains/290f6eb5eb16480cba1e641e4eaef9aa => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:54.644228 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce835a3f-dc5c-4070-9b51-0df5afd5411d tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:54.645694 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ce835a3f-dc5c-4070-9b51-0df5afd5411d tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:54.714146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce835a3f-dc5c-4070-9b51-0df5afd5411d tempest-DomainsTestJSON-188481028 tempest-DomainsTestJSON-188481028-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:54.769488 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b0860-67bd-4b65-8e44-662ca6e06f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:54.770313 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b0860-67bd-4b65-8e44-662ca6e06f48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:54.770592 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b0860-67bd-4b65-8e44-662ca6e06f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:54.770890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b0860-67bd-4b65-8e44-662ca6e06f48 admin admin] PATH_INFO: `/v3/users/f74abf4f58ac4cca8cfe0b8deb6298a3` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:54.772683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411b0860-67bd-4b65-8e44-662ca6e06f48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f74abf4f58ac4cca8cfe0b8deb6298a3)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:54.774890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411b0860-67bd-4b65-8e44-662ca6e06f48 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:55.003132 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-411b0860-67bd-4b65-8e44-662ca6e06f48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f74abf4f58ac4cca8cfe0b8deb6298a3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:55.015192 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-411b0860-67bd-4b65-8e44-662ca6e06f48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f74abf4f58ac4cca8cfe0b8deb6298a3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:55.079923 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-411b0860-67bd-4b65-8e44-662ca6e06f48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f74abf4f58ac4cca8cfe0b8deb6298a3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:55.088296 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-411b0860-67bd-4b65-8e44-662ca6e06f48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f74abf4f58ac4cca8cfe0b8deb6298a3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:55.089400 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-411b0860-67bd-4b65-8e44-662ca6e06f48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f74abf4f58ac4cca8cfe0b8deb6298a3'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:55.095909 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3919/7825] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:40:54 2022] DELETE /identity/v3/users/f74abf4f58ac4cca8cfe0b8deb6298a3 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:40:55.101330 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8273b-c231-4be6-a496-d1ef3783e0e5 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:55.101700 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8273b-c231-4be6-a496-d1ef3783e0e5 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:55.102037 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8273b-c231-4be6-a496-d1ef3783e0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:55.121998 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-6de8273b-c231-4be6-a496-d1ef3783e0e5 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:40:55.123273 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6de8273b-c231-4be6-a496-d1ef3783e0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:55.188795 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3907/7826] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:40:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:40:55.198835 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b0860-67bd-4b65-8e44-662ca6e06f48 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:55.200258 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-411b0860-67bd-4b65-8e44-662ca6e06f48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:55.262152 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b0860-67bd-4b65-8e44-662ca6e06f48 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:55.265816 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b909ff7-7695-454a-b38a-f84712f47259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:55.266475 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b909ff7-7695-454a-b38a-f84712f47259 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:55.266767 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b909ff7-7695-454a-b38a-f84712f47259 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:55.267050 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b909ff7-7695-454a-b38a-f84712f47259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:55.280772 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b909ff7-7695-454a-b38a-f84712f47259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:55.282273 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b909ff7-7695-454a-b38a-f84712f47259 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:55.292472 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3920/7827] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:40:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:40:55.710654 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8273b-c231-4be6-a496-d1ef3783e0e5 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:55.712463 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6de8273b-c231-4be6-a496-d1ef3783e0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:55.726444 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8273b-c231-4be6-a496-d1ef3783e0e5 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:55.735904 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a41bf1-81da-4dcc-9ab2-5d4a11008b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:55.736791 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a41bf1-81da-4dcc-9ab2-5d4a11008b66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:55.737154 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a41bf1-81da-4dcc-9ab2-5d4a11008b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:55.737545 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a41bf1-81da-4dcc-9ab2-5d4a11008b66 admin admin] PATH_INFO: `/v3/projects/4824f4a09e434d73a239c2dd93a0427c` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:55.738777 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a41bf1-81da-4dcc-9ab2-5d4a11008b66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4824f4a09e434d73a239c2dd93a0427c)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:55.741338 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a41bf1-81da-4dcc-9ab2-5d4a11008b66 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:55.851466 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-34a41bf1-81da-4dcc-9ab2-5d4a11008b66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4824f4a09e434d73a239c2dd93a0427c', 'request_id': 'req-34a41bf1-81da-4dcc-9ab2-5d4a11008b66'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:55.856895 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-34a41bf1-81da-4dcc-9ab2-5d4a11008b66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4824f4a09e434d73a239c2dd93a0427c', 'request_id': 'req-34a41bf1-81da-4dcc-9ab2-5d4a11008b66'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:55.863322 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-34a41bf1-81da-4dcc-9ab2-5d4a11008b66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4824f4a09e434d73a239c2dd93a0427c', 'request_id': 'req-34a41bf1-81da-4dcc-9ab2-5d4a11008b66'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:55.947806 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-34a41bf1-81da-4dcc-9ab2-5d4a11008b66 admin admin] The token cache is being invalidate because project 4824f4a09e434d73a239c2dd93a0427c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:40:55.948098 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-34a41bf1-81da-4dcc-9ab2-5d4a11008b66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:55.948740 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-34a41bf1-81da-4dcc-9ab2-5d4a11008b66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:55.950358 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3908/7828] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:40:55 2022] DELETE /identity/v3/projects/4824f4a09e434d73a239c2dd93a0427c => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:55.954380 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b909ff7-7695-454a-b38a-f84712f47259 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:55.964657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b909ff7-7695-454a-b38a-f84712f47259 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:56.022563 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81445b-9335-491c-8c89-96911c844b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:56.023436 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81445b-9335-491c-8c89-96911c844b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:56.023966 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81445b-9335-491c-8c89-96911c844b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:56.024240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81445b-9335-491c-8c89-96911c844b12 admin admin] PATH_INFO: `/v3/users/d5b7786864b5469391d19ff74908a612` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:56.025818 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81445b-9335-491c-8c89-96911c844b12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5b7786864b5469391d19ff74908a612)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:56.027787 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81445b-9335-491c-8c89-96911c844b12 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:56.247466 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7a81445b-9335-491c-8c89-96911c844b12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5b7786864b5469391d19ff74908a612'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:56.260038 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7a81445b-9335-491c-8c89-96911c844b12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5b7786864b5469391d19ff74908a612'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:56.365359 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7a81445b-9335-491c-8c89-96911c844b12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5b7786864b5469391d19ff74908a612'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:56.372803 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7a81445b-9335-491c-8c89-96911c844b12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5b7786864b5469391d19ff74908a612'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:56.373434 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7a81445b-9335-491c-8c89-96911c844b12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5b7786864b5469391d19ff74908a612'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:56.379449 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3921/7829] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:40:55 2022] DELETE /identity/v3/users/d5b7786864b5469391d19ff74908a612 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:56.789886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a41bf1-81da-4dcc-9ab2-5d4a11008b66 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:56.791639 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-34a41bf1-81da-4dcc-9ab2-5d4a11008b66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:56.806184 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a41bf1-81da-4dcc-9ab2-5d4a11008b66 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:56.866139 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c3e07-7120-442f-a713-4bcf1ceec74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:56.867020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c3e07-7120-442f-a713-4bcf1ceec74b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:56.867308 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c3e07-7120-442f-a713-4bcf1ceec74b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:56.867589 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c3e07-7120-442f-a713-4bcf1ceec74b admin admin] PATH_INFO: `/v3/projects/7c81b4c1496d4619b9cdbda0abc6c089` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:56.868788 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c3e07-7120-442f-a713-4bcf1ceec74b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c81b4c1496d4619b9cdbda0abc6c089)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:56.870786 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c3e07-7120-442f-a713-4bcf1ceec74b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:56.999839 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1b8c3e07-7120-442f-a713-4bcf1ceec74b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c81b4c1496d4619b9cdbda0abc6c089', 'request_id': 'req-1b8c3e07-7120-442f-a713-4bcf1ceec74b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:57.005477 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1b8c3e07-7120-442f-a713-4bcf1ceec74b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c81b4c1496d4619b9cdbda0abc6c089', 'request_id': 'req-1b8c3e07-7120-442f-a713-4bcf1ceec74b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:57.012152 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1b8c3e07-7120-442f-a713-4bcf1ceec74b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c81b4c1496d4619b9cdbda0abc6c089', 'request_id': 'req-1b8c3e07-7120-442f-a713-4bcf1ceec74b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:57.119630 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1b8c3e07-7120-442f-a713-4bcf1ceec74b admin admin] The token cache is being invalidate because project 7c81b4c1496d4619b9cdbda0abc6c089 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:40:57.119830 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1b8c3e07-7120-442f-a713-4bcf1ceec74b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:57.120465 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1b8c3e07-7120-442f-a713-4bcf1ceec74b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:57.122058 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3909/7830] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:40:56 2022] DELETE /identity/v3/projects/7c81b4c1496d4619b9cdbda0abc6c089 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:57.126892 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68771fe8-e388-4a98-bad9-d8971ab0dc12 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:57.127256 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68771fe8-e388-4a98-bad9-d8971ab0dc12 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:57.127610 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68771fe8-e388-4a98-bad9-d8971ab0dc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:57.176212 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-68771fe8-e388-4a98-bad9-d8971ab0dc12 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:40:57.177438 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-68771fe8-e388-4a98-bad9-d8971ab0dc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:57.235804 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3922/7831] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:40:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:40:57.243688 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c00408-a42b-43e6-9adb-6c3bd3557134 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:57.244034 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c00408-a42b-43e6-9adb-6c3bd3557134 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:57.244316 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c00408-a42b-43e6-9adb-6c3bd3557134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:57.263170 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-e0c00408-a42b-43e6-9adb-6c3bd3557134 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:40:57.264405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e0c00408-a42b-43e6-9adb-6c3bd3557134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:57.276540 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3910/7832] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:40:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:40:57.278275 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68771fe8-e388-4a98-bad9-d8971ab0dc12 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:57.289328 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68771fe8-e388-4a98-bad9-d8971ab0dc12 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:57.294458 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b79cc9-c075-442b-a219-7fda1a64fd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:57.294985 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b79cc9-c075-442b-a219-7fda1a64fd88 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:57.295269 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b79cc9-c075-442b-a219-7fda1a64fd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:57.295542 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b79cc9-c075-442b-a219-7fda1a64fd88 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:57.296265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b79cc9-c075-442b-a219-7fda1a64fd88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:40:57.296567 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b79cc9-c075-442b-a219-7fda1a64fd88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:57.298603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b79cc9-c075-442b-a219-7fda1a64fd88 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:57.310426 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3923/7833] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:40:57.315007 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c00408-a42b-43e6-9adb-6c3bd3557134 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:57.325406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c00408-a42b-43e6-9adb-6c3bd3557134 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:57.331159 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5331046-e40a-4f62-bb5c-da7ae8a7cde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:57.331829 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5331046-e40a-4f62-bb5c-da7ae8a7cde4 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:57.336387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5331046-e40a-4f62-bb5c-da7ae8a7cde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:57.336387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5331046-e40a-4f62-bb5c-da7ae8a7cde4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:57.336387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5331046-e40a-4f62-bb5c-da7ae8a7cde4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:57.336387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5331046-e40a-4f62-bb5c-da7ae8a7cde4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:57.418329 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3911/7834] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:40:57 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:40:57.422430 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b79cc9-c075-442b-a219-7fda1a64fd88 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:57.432970 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b79cc9-c075-442b-a219-7fda1a64fd88 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:57.487000 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7aec0-485d-4781-b31e-fa56e5113331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:57.487659 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7aec0-485d-4781-b31e-fa56e5113331 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:57.487940 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7aec0-485d-4781-b31e-fa56e5113331 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:57.488212 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7aec0-485d-4781-b31e-fa56e5113331 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:57.488893 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a7aec0-485d-4781-b31e-fa56e5113331 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:57.491419 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a7aec0-485d-4781-b31e-fa56e5113331 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:57.592943 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3924/7835] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:40:57 2022] POST /identity/v3/users => generated 291 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:40:57.597304 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5331046-e40a-4f62-bb5c-da7ae8a7cde4 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:57.608120 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5331046-e40a-4f62-bb5c-da7ae8a7cde4 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:57.613279 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f52de-9a66-40be-8854-0433e4ed8426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:57.614071 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f52de-9a66-40be-8854-0433e4ed8426 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:57.621666 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f52de-9a66-40be-8854-0433e4ed8426 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:57.621666 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f52de-9a66-40be-8854-0433e4ed8426 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:57.621666 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f52de-9a66-40be-8854-0433e4ed8426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:57.621666 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f52de-9a66-40be-8854-0433e4ed8426 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:57.637285 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3912/7836] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:40:57.641183 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7aec0-485d-4781-b31e-fa56e5113331 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:57.651927 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7aec0-485d-4781-b31e-fa56e5113331 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:57.656969 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36220662-6e6b-4362-83c6-a337d00fae0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:57.657685 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36220662-6e6b-4362-83c6-a337d00fae0a admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:57.658011 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36220662-6e6b-4362-83c6-a337d00fae0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:57.658291 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36220662-6e6b-4362-83c6-a337d00fae0a admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:57.659027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36220662-6e6b-4362-83c6-a337d00fae0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:57.660685 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36220662-6e6b-4362-83c6-a337d00fae0a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:57.676251 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3925/7837] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:40:57.676409 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f52de-9a66-40be-8854-0433e4ed8426 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:57.686918 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f52de-9a66-40be-8854-0433e4ed8426 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:57.691586 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a1a4e-9c1f-45ec-8ee2-d061f4a8f878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:57.692487 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a1a4e-9c1f-45ec-8ee2-d061f4a8f878 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:57.692768 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a1a4e-9c1f-45ec-8ee2-d061f4a8f878 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:57.693060 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a1a4e-9c1f-45ec-8ee2-d061f4a8f878 admin admin] PATH_INFO: `/v3/projects/86222a679b91433488d717a0420ed7ff/users/af9b80a443334243aff7a0427a6be236/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:57.707720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a1a4e-9c1f-45ec-8ee2-d061f4a8f878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86222a679b91433488d717a0420ed7ff, user_id=af9b80a443334243aff7a0427a6be236, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:57.710502 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a1a4e-9c1f-45ec-8ee2-d061f4a8f878 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:57.806747 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3913/7838] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:40:57 2022] PUT /identity/v3/projects/86222a679b91433488d717a0420ed7ff/users/af9b80a443334243aff7a0427a6be236/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:40:57.817551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9f9bc-8685-49fd-bc27-03c58664b377 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:57.817934 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9f9bc-8685-49fd-bc27-03c58664b377 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:57.818241 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9f9bc-8685-49fd-bc27-03c58664b377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:57.845093 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-a5c9f9bc-8685-49fd-bc27-03c58664b377 None None] MFA Rules not processed for user `af9b80a443334243aff7a0427a6be236`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:40:57.846341 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a5c9f9bc-8685-49fd-bc27-03c58664b377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:57.915489 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3926/7839] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:40:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:40:57.920282 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a1a4e-9c1f-45ec-8ee2-d061f4a8f878 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:57.984436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a1a4e-9c1f-45ec-8ee2-d061f4a8f878 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:57.989227 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13317935-1cec-4e2c-a0d5-942883b3c436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:57.989964 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13317935-1cec-4e2c-a0d5-942883b3c436 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:57.990264 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13317935-1cec-4e2c-a0d5-942883b3c436 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:57.990544 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13317935-1cec-4e2c-a0d5-942883b3c436 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:57.991228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13317935-1cec-4e2c-a0d5-942883b3c436 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:57.993161 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13317935-1cec-4e2c-a0d5-942883b3c436 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:58.100314 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3914/7840] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:40:57 2022] POST /identity/v3/projects => generated 381 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:40:58.103438 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9f9bc-8685-49fd-bc27-03c58664b377 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:58.114303 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9f9bc-8685-49fd-bc27-03c58664b377 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:58.176938 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429dcb6-842b-4b36-90a1-2ea45940e38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:58.177634 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429dcb6-842b-4b36-90a1-2ea45940e38d admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:58.178476 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429dcb6-842b-4b36-90a1-2ea45940e38d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:58.178751 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429dcb6-842b-4b36-90a1-2ea45940e38d admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:58.179445 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2429dcb6-842b-4b36-90a1-2ea45940e38d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:58.181425 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2429dcb6-842b-4b36-90a1-2ea45940e38d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:58.317926 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3927/7841] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:40:58 2022] POST /identity/v3/users => generated 297 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:40:58.319977 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13317935-1cec-4e2c-a0d5-942883b3c436 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:58.334756 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13317935-1cec-4e2c-a0d5-942883b3c436 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:58.340782 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afe306-5a7c-4f2f-a458-01f1ed4ae149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:58.345061 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afe306-5a7c-4f2f-a458-01f1ed4ae149 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:58.345061 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afe306-5a7c-4f2f-a458-01f1ed4ae149 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:58.345061 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afe306-5a7c-4f2f-a458-01f1ed4ae149 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:58.345061 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80afe306-5a7c-4f2f-a458-01f1ed4ae149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:58.347972 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80afe306-5a7c-4f2f-a458-01f1ed4ae149 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:58.372125 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3915/7842] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:40:58.376405 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429dcb6-842b-4b36-90a1-2ea45940e38d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:58.388281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429dcb6-842b-4b36-90a1-2ea45940e38d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:58.394796 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218748a-0c08-425e-b955-920ef41c123a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:58.395771 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218748a-0c08-425e-b955-920ef41c123a admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:58.396058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218748a-0c08-425e-b955-920ef41c123a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:58.396338 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218748a-0c08-425e-b955-920ef41c123a admin admin] PATH_INFO: `/v3/projects/4628c0885ede410791679285fcde6e93/users/4f6a80948a3c4fdd8c15b675aae4cb42/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:58.415622 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e218748a-0c08-425e-b955-920ef41c123a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4628c0885ede410791679285fcde6e93, user_id=4f6a80948a3c4fdd8c15b675aae4cb42, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:58.418731 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e218748a-0c08-425e-b955-920ef41c123a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:58.502503 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3928/7843] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:40:58 2022] PUT /identity/v3/projects/4628c0885ede410791679285fcde6e93/users/4f6a80948a3c4fdd8c15b675aae4cb42/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:58.508061 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afe306-5a7c-4f2f-a458-01f1ed4ae149 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:58.543494 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afe306-5a7c-4f2f-a458-01f1ed4ae149 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:58.642915 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785b727-795a-4189-8e23-af831bd2ca7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:58.643591 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785b727-795a-4189-8e23-af831bd2ca7c admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:58.643873 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785b727-795a-4189-8e23-af831bd2ca7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:58.644163 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785b727-795a-4189-8e23-af831bd2ca7c admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:58.644873 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4785b727-795a-4189-8e23-af831bd2ca7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:58.647230 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4785b727-795a-4189-8e23-af831bd2ca7c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:58.668202 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3916/7844] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:40:58.672086 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218748a-0c08-425e-b955-920ef41c123a admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:58.686780 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218748a-0c08-425e-b955-920ef41c123a admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:58.692557 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d4c68-ad38-41d5-9002-40c6a73fc4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:58.694033 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d4c68-ad38-41d5-9002-40c6a73fc4c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:58.694679 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d4c68-ad38-41d5-9002-40c6a73fc4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:58.694679 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d4c68-ad38-41d5-9002-40c6a73fc4c8 admin admin] PATH_INFO: `/v3/projects/4628c0885ede410791679285fcde6e93/users/4f6a80948a3c4fdd8c15b675aae4cb42/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:58.697163 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006d4c68-ad38-41d5-9002-40c6a73fc4c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4628c0885ede410791679285fcde6e93, user_id=4f6a80948a3c4fdd8c15b675aae4cb42, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:58.700095 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006d4c68-ad38-41d5-9002-40c6a73fc4c8 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:58.713803 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3929/7845] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:40:58 2022] PUT /identity/v3/projects/4628c0885ede410791679285fcde6e93/users/4f6a80948a3c4fdd8c15b675aae4cb42/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:40:58.725260 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77507dbd-dd42-4ce6-86f5-170cee07ead4 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:58.726221 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77507dbd-dd42-4ce6-86f5-170cee07ead4 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:58.726514 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77507dbd-dd42-4ce6-86f5-170cee07ead4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:58.765368 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-77507dbd-dd42-4ce6-86f5-170cee07ead4 None None] MFA Rules not processed for user `4f6a80948a3c4fdd8c15b675aae4cb42`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:40:58.766706 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-77507dbd-dd42-4ce6-86f5-170cee07ead4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:58.841144 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3917/7846] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:40:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:40:58.846504 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d4c68-ad38-41d5-9002-40c6a73fc4c8 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:58.858309 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d4c68-ad38-41d5-9002-40c6a73fc4c8 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:58.863232 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226811d1-2eed-43d1-abf9-eb16236c80f9 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6a80948a3c4fdd8c15b675aae4cb42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4628c0885ede410791679285fcde6e93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:58.864030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226811d1-2eed-43d1-abf9-eb16236c80f9 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:58.864452 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226811d1-2eed-43d1-abf9-eb16236c80f9 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:58.864837 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226811d1-2eed-43d1-abf9-eb16236c80f9 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:58.865721 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226811d1-2eed-43d1-abf9-eb16236c80f9 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:58.867556 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226811d1-2eed-43d1-abf9-eb16236c80f9 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:58.874340 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-226811d1-2eed-43d1-abf9-eb16236c80f9 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Invalid input for field 'name': '' is too short Apr 30 21:40:58.874340 ncdv-master-1 devstack@keystone.service[91018]: Failed validating 'minLength' in schema['properties']['name']: Apr 30 21:40:58.874340 ncdv-master-1 devstack@keystone.service[91018]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Apr 30 21:40:58.874340 ncdv-master-1 devstack@keystone.service[91018]: On instance['name']: Apr 30 21:40:58.874340 ncdv-master-1 devstack@keystone.service[91018]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Apr 30 21:40:58.874340 ncdv-master-1 devstack@keystone.service[91018]: Failed validating 'minLength' in schema['properties']['name']: Apr 30 21:40:58.874340 ncdv-master-1 devstack@keystone.service[91018]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Apr 30 21:40:58.874340 ncdv-master-1 devstack@keystone.service[91018]: On instance['name']: Apr 30 21:40:58.874340 ncdv-master-1 devstack@keystone.service[91018]: '' Apr 30 21:40:58.874340 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:40:58.874340 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Apr 30 21:40:58.874340 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Apr 30 21:40:58.874340 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Apr 30 21:40:58.874340 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise error Apr 30 21:40:58.874340 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Apr 30 21:40:58.874340 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:40:58.874340 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Apr 30 21:40:58.874340 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Apr 30 21:40:58.874340 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:40:58.874340 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application On instance['name']: Apr 30 21:40:58.874340 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application '' Apr 30 21:40:58.874340 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:40:58.874340 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 21:40:58.876005 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:40:58.876005 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:40:58.876005 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:40:58.876005 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:40:58.876005 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:40:58.876005 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:40:58.876005 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:40:58.876005 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:40:58.876005 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:40:58.876005 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:40:58.876005 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:40:58.876005 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:40:58.876005 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Apr 30 21:40:58.876005 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Apr 30 21:40:58.876005 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Apr 30 21:40:58.876005 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Apr 30 21:40:58.876005 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Apr 30 21:40:58.876958 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Apr 30 21:40:58.876958 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Apr 30 21:40:58.876958 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:40:58.876958 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Apr 30 21:40:58.876958 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Apr 30 21:40:58.876958 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:40:58.876958 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application On instance['name']: Apr 30 21:40:58.876958 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application '' Apr 30 21:40:58.876958 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:40:58.876958 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3930/7847] 10.222.0.23 () {60 vars in 1148 bytes} [Sat Apr 30 21:40:58 2022] POST /identity/v3/domains => generated 283 bytes in 30 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Apr 30 21:40:58.882686 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77507dbd-dd42-4ce6-86f5-170cee07ead4 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:58.892678 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77507dbd-dd42-4ce6-86f5-170cee07ead4 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:58.898358 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a2e6b-7a41-4104-afaa-cf6c564ce87d tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6a80948a3c4fdd8c15b675aae4cb42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4628c0885ede410791679285fcde6e93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:58.899298 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a2e6b-7a41-4104-afaa-cf6c564ce87d tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:58.899586 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a2e6b-7a41-4104-afaa-cf6c564ce87d tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:58.899866 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a2e6b-7a41-4104-afaa-cf6c564ce87d tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:58.900620 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a2e6b-7a41-4104-afaa-cf6c564ce87d tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:58.902426 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a2e6b-7a41-4104-afaa-cf6c564ce87d tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:58.908710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-ed7a2e6b-7a41-4104-afaa-cf6c564ce87d tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Apr 30 21:40:58.908710 ncdv-master-1 devstack@keystone.service[91017]: Failed validating 'maxLength' in schema['properties']['name']: Apr 30 21:40:58.908710 ncdv-master-1 devstack@keystone.service[91017]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Apr 30 21:40:58.908710 ncdv-master-1 devstack@keystone.service[91017]: On instance['name']: Apr 30 21:40:58.908710 ncdv-master-1 devstack@keystone.service[91017]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Apr 30 21:40:58.908710 ncdv-master-1 devstack@keystone.service[91017]: Failed validating 'maxLength' in schema['properties']['name']: Apr 30 21:40:58.908710 ncdv-master-1 devstack@keystone.service[91017]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Apr 30 21:40:58.908710 ncdv-master-1 devstack@keystone.service[91017]: On instance['name']: Apr 30 21:40:58.908710 ncdv-master-1 devstack@keystone.service[91017]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Apr 30 21:40:58.908710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:40:58.908710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Apr 30 21:40:58.908710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Apr 30 21:40:58.908710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Apr 30 21:40:58.908710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise error Apr 30 21:40:58.908710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Apr 30 21:40:58.908710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:40:58.908710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Apr 30 21:40:58.908710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Apr 30 21:40:58.908710 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:40:58.913044 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application On instance['name']: Apr 30 21:40:58.913044 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Apr 30 21:40:58.913044 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:40:58.913044 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 21:40:58.913044 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:40:58.913044 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:40:58.913044 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:40:58.913044 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:40:58.913044 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:40:58.913044 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:40:58.913044 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:40:58.913044 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:40:58.913044 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:40:58.913044 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:40:58.913044 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:40:58.913044 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:40:58.913044 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Apr 30 21:40:58.913044 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Apr 30 21:40:58.914074 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Apr 30 21:40:58.914074 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Apr 30 21:40:58.914074 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Apr 30 21:40:58.914074 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Apr 30 21:40:58.914074 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Apr 30 21:40:58.914074 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:40:58.914074 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Apr 30 21:40:58.914074 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Apr 30 21:40:58.914074 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:40:58.914074 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application On instance['name']: Apr 30 21:40:58.914074 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Apr 30 21:40:58.914074 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:40:58.914074 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3918/7848] 10.222.0.23 () {60 vars in 1148 bytes} [Sat Apr 30 21:40:58 2022] POST /identity/v3/domains => generated 412 bytes in 29 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Apr 30 21:40:58.915867 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226811d1-2eed-43d1-abf9-eb16236c80f9 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:58.926644 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226811d1-2eed-43d1-abf9-eb16236c80f9 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:58.931334 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e07220-a099-4565-bee3-accac584b1b4 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6a80948a3c4fdd8c15b675aae4cb42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4628c0885ede410791679285fcde6e93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:58.931970 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e07220-a099-4565-bee3-accac584b1b4 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:58.932259 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e07220-a099-4565-bee3-accac584b1b4 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:58.932534 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e07220-a099-4565-bee3-accac584b1b4 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:58.933280 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e07220-a099-4565-bee3-accac584b1b4 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:58.934926 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e07220-a099-4565-bee3-accac584b1b4 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:59.016211 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3931/7849] 10.222.0.23 () {60 vars in 1148 bytes} [Sat Apr 30 21:40:58 2022] POST /identity/v3/domains => generated 276 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:40:59.020792 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a2e6b-7a41-4104-afaa-cf6c564ce87d tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:59.035684 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a2e6b-7a41-4104-afaa-cf6c564ce87d tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:59.112386 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b370fec7-af11-4f79-9dd5-4db6170f0984 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6a80948a3c4fdd8c15b675aae4cb42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4628c0885ede410791679285fcde6e93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:59.113265 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370fec7-af11-4f79-9dd5-4db6170f0984 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:59.113554 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370fec7-af11-4f79-9dd5-4db6170f0984 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:59.113936 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370fec7-af11-4f79-9dd5-4db6170f0984 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] PATH_INFO: `/v3/domains/194f85c8fffb4a8dbbe7ef1766eb80b4` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:59.126158 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b370fec7-af11-4f79-9dd5-4db6170f0984 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=194f85c8fffb4a8dbbe7ef1766eb80b4)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:59.127802 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b370fec7-af11-4f79-9dd5-4db6170f0984 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:59.150028 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-b370fec7-af11-4f79-9dd5-4db6170f0984 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Apr 30 21:40:59.150028 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:40:59.150028 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:40:59.150028 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:40:59.150028 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:40:59.150028 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:40:59.150028 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:40:59.150028 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:40:59.150028 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:40:59.150028 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:40:59.150028 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:40:59.150028 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:40:59.150028 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Apr 30 21:40:59.150028 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Apr 30 21:40:59.151081 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:40:59.151081 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:40:59.151081 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Apr 30 21:40:59.151081 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Apr 30 21:40:59.151081 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Apr 30 21:40:59.151081 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Apr 30 21:40:59.151081 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Apr 30 21:40:59.151081 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:40:59.154806 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3919/7850] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:40:59 2022] DELETE /identity/v3/domains/194f85c8fffb4a8dbbe7ef1766eb80b4 => generated 120 bytes in 135 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Apr 30 21:40:59.155738 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e07220-a099-4565-bee3-accac584b1b4 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:59.166973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e07220-a099-4565-bee3-accac584b1b4 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:59.172424 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f8437-0686-4a7c-aea5-c488ff031a6c tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6a80948a3c4fdd8c15b675aae4cb42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4628c0885ede410791679285fcde6e93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:59.173313 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f8437-0686-4a7c-aea5-c488ff031a6c tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:59.173593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f8437-0686-4a7c-aea5-c488ff031a6c tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:59.173923 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f8437-0686-4a7c-aea5-c488ff031a6c tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] PATH_INFO: `/v3/domains/194f85c8fffb4a8dbbe7ef1766eb80b4` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:59.175323 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f8437-0686-4a7c-aea5-c488ff031a6c tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=194f85c8fffb4a8dbbe7ef1766eb80b4)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:59.176960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f8437-0686-4a7c-aea5-c488ff031a6c tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:59.199802 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0f3f8437-0686-4a7c-aea5-c488ff031a6c tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '194f85c8fffb4a8dbbe7ef1766eb80b4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:59.200563 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0f3f8437-0686-4a7c-aea5-c488ff031a6c tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '194f85c8fffb4a8dbbe7ef1766eb80b4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:59.295719 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0f3f8437-0686-4a7c-aea5-c488ff031a6c tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '194f85c8fffb4a8dbbe7ef1766eb80b4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:59.296352 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0f3f8437-0686-4a7c-aea5-c488ff031a6c tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '194f85c8fffb4a8dbbe7ef1766eb80b4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:59.299183 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3932/7851] 10.222.0.23 () {60 vars in 1248 bytes} [Sat Apr 30 21:40:59 2022] PATCH /identity/v3/domains/194f85c8fffb4a8dbbe7ef1766eb80b4 => generated 277 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:40:59.303434 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b370fec7-af11-4f79-9dd5-4db6170f0984 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:59.305280 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b370fec7-af11-4f79-9dd5-4db6170f0984 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:59.319460 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b370fec7-af11-4f79-9dd5-4db6170f0984 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:59.378509 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8c7be-f47a-4859-acc8-50eea010c270 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6a80948a3c4fdd8c15b675aae4cb42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4628c0885ede410791679285fcde6e93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:59.379935 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8c7be-f47a-4859-acc8-50eea010c270 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:59.379935 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8c7be-f47a-4859-acc8-50eea010c270 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:59.379935 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8c7be-f47a-4859-acc8-50eea010c270 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] PATH_INFO: `/v3/domains/194f85c8fffb4a8dbbe7ef1766eb80b4` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:59.392411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c8c7be-f47a-4859-acc8-50eea010c270 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=194f85c8fffb4a8dbbe7ef1766eb80b4)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:59.394179 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c8c7be-f47a-4859-acc8-50eea010c270 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:59.422883 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-92c8c7be-f47a-4859-acc8-50eea010c270 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '194f85c8fffb4a8dbbe7ef1766eb80b4'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:59.426272 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-92c8c7be-f47a-4859-acc8-50eea010c270 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '194f85c8fffb4a8dbbe7ef1766eb80b4'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:59.550125 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-92c8c7be-f47a-4859-acc8-50eea010c270 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '194f85c8fffb4a8dbbe7ef1766eb80b4', 'request_id': 'req-92c8c7be-f47a-4859-acc8-50eea010c270'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:59.556547 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-92c8c7be-f47a-4859-acc8-50eea010c270 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '194f85c8fffb4a8dbbe7ef1766eb80b4', 'request_id': 'req-92c8c7be-f47a-4859-acc8-50eea010c270'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:59.563581 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-92c8c7be-f47a-4859-acc8-50eea010c270 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '194f85c8fffb4a8dbbe7ef1766eb80b4', 'request_id': 'req-92c8c7be-f47a-4859-acc8-50eea010c270'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:59.645910 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-92c8c7be-f47a-4859-acc8-50eea010c270 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] The token cache is being invalidate because project 194f85c8fffb4a8dbbe7ef1766eb80b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:40:59.646358 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-92c8c7be-f47a-4859-acc8-50eea010c270 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:59.653868 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-92c8c7be-f47a-4859-acc8-50eea010c270 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:59.669466 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-92c8c7be-f47a-4859-acc8-50eea010c270 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '194f85c8fffb4a8dbbe7ef1766eb80b4', 'request_id': 'req-92c8c7be-f47a-4859-acc8-50eea010c270'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:59.671431 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-92c8c7be-f47a-4859-acc8-50eea010c270 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '194f85c8fffb4a8dbbe7ef1766eb80b4', 'request_id': 'req-92c8c7be-f47a-4859-acc8-50eea010c270'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:59.671431 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-92c8c7be-f47a-4859-acc8-50eea010c270 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '194f85c8fffb4a8dbbe7ef1766eb80b4', 'request_id': 'req-92c8c7be-f47a-4859-acc8-50eea010c270'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:40:59.681090 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3920/7852] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:40:59 2022] DELETE /identity/v3/domains/194f85c8fffb4a8dbbe7ef1766eb80b4 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:40:59.686113 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f8437-0686-4a7c-aea5-c488ff031a6c tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:59.696900 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f8437-0686-4a7c-aea5-c488ff031a6c tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:59.758594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b5fb1-5db7-4ea9-88c3-f44f398782aa tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6a80948a3c4fdd8c15b675aae4cb42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4628c0885ede410791679285fcde6e93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:59.759482 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b5fb1-5db7-4ea9-88c3-f44f398782aa tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:59.759764 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b5fb1-5db7-4ea9-88c3-f44f398782aa tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:59.760234 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b5fb1-5db7-4ea9-88c3-f44f398782aa tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] PATH_INFO: `/v3/domains/f639da07b29d4b118c28d8d5877a5d58` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:59.767825 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0b5fb1-5db7-4ea9-88c3-f44f398782aa tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 21:40:59.779085 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-bf0b5fb1-5db7-4ea9-88c3-f44f398782aa tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Could not find domain: f639da07b29d4b118c28d8d5877a5d58.: keystone.exception.DomainNotFound: Could not find domain: f639da07b29d4b118c28d8d5877a5d58. Apr 30 21:40:59.779085 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:40:59.779085 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Apr 30 21:40:59.779085 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Apr 30 21:40:59.779085 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 21:40:59.779085 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 21:40:59.779085 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 21:40:59.779085 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 21:40:59.779085 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f639da07b29d4b118c28d8d5877a5d58. Apr 30 21:40:59.779085 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:40:59.779085 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 21:40:59.779085 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:40:59.779085 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:40:59.779085 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:40:59.779085 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:40:59.781038 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:40:59.781038 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:40:59.781038 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:40:59.781038 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:40:59.781038 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:40:59.781038 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:40:59.781038 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:40:59.781038 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:40:59.781038 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Apr 30 21:40:59.781038 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Apr 30 21:40:59.781038 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 21:40:59.781038 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 21:40:59.781038 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 21:40:59.781038 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 21:40:59.781038 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:40:59.781038 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:40:59.781912 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 21:40:59.781912 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 21:40:59.781912 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 21:40:59.781912 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 21:40:59.781912 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 21:40:59.781912 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application with Lock( Apr 30 21:40:59.781912 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 21:40:59.781912 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._enter() Apr 30 21:40:59.781912 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 21:40:59.781912 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 21:40:59.781912 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 21:40:59.781912 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.creator() Apr 30 21:40:59.781912 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 21:40:59.781912 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application created_value = creator( Apr 30 21:40:59.781912 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Apr 30 21:40:59.781912 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 21:40:59.781912 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f639da07b29d4b118c28d8d5877a5d58. Apr 30 21:40:59.783080 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:40:59.783080 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3933/7853] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:40:59 2022] DELETE /identity/v3/domains/f639da07b29d4b118c28d8d5877a5d58 => generated 112 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Apr 30 21:40:59.785465 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8c7be-f47a-4859-acc8-50eea010c270 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:59.786955 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-92c8c7be-f47a-4859-acc8-50eea010c270 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:40:59.802796 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8c7be-f47a-4859-acc8-50eea010c270 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:59.807500 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a60b58-1ba9-49cd-9dfe-3e5a8ca2db08 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6a80948a3c4fdd8c15b675aae4cb42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4628c0885ede410791679285fcde6e93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:59.809201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a60b58-1ba9-49cd-9dfe-3e5a8ca2db08 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:59.809201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a60b58-1ba9-49cd-9dfe-3e5a8ca2db08 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:59.809201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a60b58-1ba9-49cd-9dfe-3e5a8ca2db08 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:59.818271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a60b58-1ba9-49cd-9dfe-3e5a8ca2db08 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:59.820329 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a60b58-1ba9-49cd-9dfe-3e5a8ca2db08 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:40:59.894921 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3921/7854] 10.222.0.23 () {60 vars in 1148 bytes} [Sat Apr 30 21:40:59 2022] POST /identity/v3/domains => generated 253 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:40:59.899771 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b5fb1-5db7-4ea9-88c3-f44f398782aa tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:40:59.909958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b5fb1-5db7-4ea9-88c3-f44f398782aa tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:40:59.966193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b0a858-d9ac-4e10-b6dd-cdf2fec13b68 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6a80948a3c4fdd8c15b675aae4cb42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4628c0885ede410791679285fcde6e93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:40:59.966861 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0a858-d9ac-4e10-b6dd-cdf2fec13b68 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:40:59.967151 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0a858-d9ac-4e10-b6dd-cdf2fec13b68 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:40:59.967431 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0a858-d9ac-4e10-b6dd-cdf2fec13b68 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:40:59.968151 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b0a858-d9ac-4e10-b6dd-cdf2fec13b68 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:40:59.969785 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b0a858-d9ac-4e10-b6dd-cdf2fec13b68 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:00.004949 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.sql.core [None req-38b0a858-d9ac-4e10-b6dd-cdf2fec13b68 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-1659092611' for key 'project.ixu_project_name_domain_id'") Apr 30 21:41:00.004949 ncdv-master-1 devstack@keystone.service[91018]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Apr 30 21:41:00.004949 ncdv-master-1 devstack@keystone.service[91018]: [parameters: {'id': 'a4968210a0c2403fb195119e24dcfdab', 'name': 'tempest-domain-dup-1659092611', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Apr 30 21:41:00.004949 ncdv-master-1 devstack@keystone.service[91018]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91018) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 30 21:41:00.013016 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-38b0a858-d9ac-4e10-b6dd-cdf2fec13b68 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1659092611.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1659092611. Apr 30 21:41:00.013016 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:41:00.013016 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Apr 30 21:41:00.013016 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self.dialect.do_execute( Apr 30 21:41:00.013016 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Apr 30 21:41:00.013016 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Apr 30 21:41:00.013016 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Apr 30 21:41:00.013016 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application result = self._query(query) Apr 30 21:41:00.013016 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Apr 30 21:41:00.013016 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application conn.query(q) Apr 30 21:41:00.013016 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Apr 30 21:41:00.013016 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Apr 30 21:41:00.013016 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Apr 30 21:41:00.014018 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application result.read() Apr 30 21:41:00.014018 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Apr 30 21:41:00.014018 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Apr 30 21:41:00.014018 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Apr 30 21:41:00.014018 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application packet.raise_for_error() Apr 30 21:41:00.014018 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Apr 30 21:41:00.014018 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Apr 30 21:41:00.014018 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Apr 30 21:41:00.014018 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Apr 30 21:41:00.014018 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-1659092611' for key 'project.ixu_project_name_domain_id'") Apr 30 21:41:00.014018 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:41:00.014018 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Apr 30 21:41:00.014018 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:41:00.014018 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:41:00.014018 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Apr 30 21:41:00.014018 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return method(*args, **kwargs) Apr 30 21:41:00.014018 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Apr 30 21:41:00.014018 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return project_ref.to_dict() Apr 30 21:41:00.018399 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Apr 30 21:41:00.018399 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application next(self.gen) Apr 30 21:41:00.018399 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Apr 30 21:41:00.018399 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application yield resource Apr 30 21:41:00.018399 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Apr 30 21:41:00.018399 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application next(self.gen) Apr 30 21:41:00.018399 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Apr 30 21:41:00.018399 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self.session.rollback() Apr 30 21:41:00.018399 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Apr 30 21:41:00.018399 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self.force_reraise() Apr 30 21:41:00.018399 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Apr 30 21:41:00.018399 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise self.value Apr 30 21:41:00.018399 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Apr 30 21:41:00.018399 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Apr 30 21:41:00.018399 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Apr 30 21:41:00.018399 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application session.commit() Apr 30 21:41:00.018399 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1431, in commit Apr 30 21:41:00.019314 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Apr 30 21:41:00.019314 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Apr 30 21:41:00.019314 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self._prepare_impl() Apr 30 21:41:00.019314 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Apr 30 21:41:00.019314 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self.session.flush() Apr 30 21:41:00.019314 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3363, in flush Apr 30 21:41:00.019314 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self._flush(objects) Apr 30 21:41:00.019314 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3503, in _flush Apr 30 21:41:00.019314 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Apr 30 21:41:00.019314 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Apr 30 21:41:00.019314 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application compat.raise_( Apr 30 21:41:00.019314 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Apr 30 21:41:00.019314 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception Apr 30 21:41:00.019314 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3463, in _flush Apr 30 21:41:00.019314 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application flush_context.execute() Apr 30 21:41:00.019314 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Apr 30 21:41:00.019314 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rec.execute(self) Apr 30 21:41:00.020248 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Apr 30 21:41:00.020248 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Apr 30 21:41:00.020248 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Apr 30 21:41:00.020248 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application _emit_insert_statements( Apr 30 21:41:00.020248 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Apr 30 21:41:00.020248 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application c = connection._execute_20( Apr 30 21:41:00.020248 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Apr 30 21:41:00.020248 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Apr 30 21:41:00.020248 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Apr 30 21:41:00.020248 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Apr 30 21:41:00.020248 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Apr 30 21:41:00.020248 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ret = self._execute_context( Apr 30 21:41:00.020248 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Apr 30 21:41:00.020248 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Apr 30 21:41:00.020248 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Apr 30 21:41:00.021059 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Apr 30 21:41:00.021059 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Apr 30 21:41:00.021059 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception Apr 30 21:41:00.021059 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Apr 30 21:41:00.021059 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self.dialect.do_execute( Apr 30 21:41:00.021059 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Apr 30 21:41:00.021059 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Apr 30 21:41:00.021059 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Apr 30 21:41:00.021059 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application result = self._query(query) Apr 30 21:41:00.021059 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Apr 30 21:41:00.021059 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application conn.query(q) Apr 30 21:41:00.021059 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Apr 30 21:41:00.021059 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Apr 30 21:41:00.021059 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Apr 30 21:41:00.021059 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application result.read() Apr 30 21:41:00.021059 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Apr 30 21:41:00.021059 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Apr 30 21:41:00.022555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Apr 30 21:41:00.022555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application packet.raise_for_error() Apr 30 21:41:00.022555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Apr 30 21:41:00.022555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Apr 30 21:41:00.022555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Apr 30 21:41:00.022555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Apr 30 21:41:00.022555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-1659092611' for key 'project.ixu_project_name_domain_id'") Apr 30 21:41:00.022555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Apr 30 21:41:00.022555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [parameters: {'id': 'a4968210a0c2403fb195119e24dcfdab', 'name': 'tempest-domain-dup-1659092611', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Apr 30 21:41:00.022555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Apr 30 21:41:00.022555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:41:00.022555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 21:41:00.022555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:41:00.022555 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:41:00.023277 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Apr 30 21:41:00.023277 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Apr 30 21:41:00.023277 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Apr 30 21:41:00.023277 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Apr 30 21:41:00.023277 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-1659092611. Apr 30 21:41:00.023277 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:41:00.023277 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 21:41:00.023277 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:41:00.023277 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:41:00.023277 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:41:00.023277 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:41:00.023277 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:41:00.023277 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:41:00.023277 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:41:00.023277 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:41:00.023277 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:41:00.023277 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:41:00.024387 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:41:00.024387 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:41:00.024387 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Apr 30 21:41:00.024387 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Apr 30 21:41:00.024387 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:41:00.024387 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:41:00.024387 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Apr 30 21:41:00.024387 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Apr 30 21:41:00.024387 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:41:00.024387 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:41:00.024387 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Apr 30 21:41:00.024387 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.Conflict( Apr 30 21:41:00.024387 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1659092611. Apr 30 21:41:00.024387 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 21:41:00.024387 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3934/7855] 10.222.0.23 () {60 vars in 1148 bytes} [Sat Apr 30 21:40:59 2022] POST /identity/v3/domains => generated 212 bytes in 115 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 30 21:41:00.025169 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a60b58-1ba9-49cd-9dfe-3e5a8ca2db08 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:00.037698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a60b58-1ba9-49cd-9dfe-3e5a8ca2db08 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:00.042691 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c51321-d8f2-430b-bee6-a3f9ad342181 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6a80948a3c4fdd8c15b675aae4cb42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4628c0885ede410791679285fcde6e93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:00.044193 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c51321-d8f2-430b-bee6-a3f9ad342181 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:00.044193 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c51321-d8f2-430b-bee6-a3f9ad342181 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:00.044371 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c51321-d8f2-430b-bee6-a3f9ad342181 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] PATH_INFO: `/v3/domains/44d72838b33e4c259f9ddb36a3737a0e` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:00.055759 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c51321-d8f2-430b-bee6-a3f9ad342181 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=44d72838b33e4c259f9ddb36a3737a0e)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:00.057430 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c51321-d8f2-430b-bee6-a3f9ad342181 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:00.076928 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-57c51321-d8f2-430b-bee6-a3f9ad342181 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '44d72838b33e4c259f9ddb36a3737a0e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:00.078366 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-57c51321-d8f2-430b-bee6-a3f9ad342181 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '44d72838b33e4c259f9ddb36a3737a0e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:00.154815 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-57c51321-d8f2-430b-bee6-a3f9ad342181 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '44d72838b33e4c259f9ddb36a3737a0e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:00.154815 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-57c51321-d8f2-430b-bee6-a3f9ad342181 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '44d72838b33e4c259f9ddb36a3737a0e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:00.157879 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3922/7856] 10.222.0.23 () {60 vars in 1248 bytes} [Sat Apr 30 21:41:00 2022] PATCH /identity/v3/domains/44d72838b33e4c259f9ddb36a3737a0e => generated 254 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:41:00.162115 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b0a858-d9ac-4e10-b6dd-cdf2fec13b68 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:00.164076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-38b0a858-d9ac-4e10-b6dd-cdf2fec13b68 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:00.178018 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b0a858-d9ac-4e10-b6dd-cdf2fec13b68 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:00.238454 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f081da0a-72e5-4f34-af64-fd8721af1dce tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6a80948a3c4fdd8c15b675aae4cb42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4628c0885ede410791679285fcde6e93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:00.239339 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081da0a-72e5-4f34-af64-fd8721af1dce tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:00.239622 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081da0a-72e5-4f34-af64-fd8721af1dce tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:00.239913 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081da0a-72e5-4f34-af64-fd8721af1dce tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] PATH_INFO: `/v3/domains/44d72838b33e4c259f9ddb36a3737a0e` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:00.260068 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f081da0a-72e5-4f34-af64-fd8721af1dce tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=44d72838b33e4c259f9ddb36a3737a0e)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:00.261856 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f081da0a-72e5-4f34-af64-fd8721af1dce tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:00.292137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f081da0a-72e5-4f34-af64-fd8721af1dce tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '44d72838b33e4c259f9ddb36a3737a0e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:00.295741 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f081da0a-72e5-4f34-af64-fd8721af1dce tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '44d72838b33e4c259f9ddb36a3737a0e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:00.406954 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f081da0a-72e5-4f34-af64-fd8721af1dce tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44d72838b33e4c259f9ddb36a3737a0e', 'request_id': 'req-f081da0a-72e5-4f34-af64-fd8721af1dce'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:00.413263 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f081da0a-72e5-4f34-af64-fd8721af1dce tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44d72838b33e4c259f9ddb36a3737a0e', 'request_id': 'req-f081da0a-72e5-4f34-af64-fd8721af1dce'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:00.420091 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f081da0a-72e5-4f34-af64-fd8721af1dce tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44d72838b33e4c259f9ddb36a3737a0e', 'request_id': 'req-f081da0a-72e5-4f34-af64-fd8721af1dce'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:00.507218 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f081da0a-72e5-4f34-af64-fd8721af1dce tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] The token cache is being invalidate because project 44d72838b33e4c259f9ddb36a3737a0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:41:00.507512 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f081da0a-72e5-4f34-af64-fd8721af1dce tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:00.508345 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f081da0a-72e5-4f34-af64-fd8721af1dce tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:00.516387 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f081da0a-72e5-4f34-af64-fd8721af1dce tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '44d72838b33e4c259f9ddb36a3737a0e', 'request_id': 'req-f081da0a-72e5-4f34-af64-fd8721af1dce'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:00.517393 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f081da0a-72e5-4f34-af64-fd8721af1dce tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '44d72838b33e4c259f9ddb36a3737a0e', 'request_id': 'req-f081da0a-72e5-4f34-af64-fd8721af1dce'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:00.518142 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f081da0a-72e5-4f34-af64-fd8721af1dce tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '44d72838b33e4c259f9ddb36a3737a0e', 'request_id': 'req-f081da0a-72e5-4f34-af64-fd8721af1dce'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:00.528468 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3935/7857] 10.222.0.23 () {58 vars in 1229 bytes} [Sat Apr 30 21:41:00 2022] DELETE /identity/v3/domains/44d72838b33e4c259f9ddb36a3737a0e => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:41:00.533637 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c51321-d8f2-430b-bee6-a3f9ad342181 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:00.543672 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c51321-d8f2-430b-bee6-a3f9ad342181 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:00.608801 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33122aa-bdd2-4444-8c17-e51a085d70a3 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f6a80948a3c4fdd8c15b675aae4cb42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4628c0885ede410791679285fcde6e93', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:00.612246 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33122aa-bdd2-4444-8c17-e51a085d70a3 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] REQUEST_METHOD: `PATCH` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:00.612510 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33122aa-bdd2-4444-8c17-e51a085d70a3 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:00.612798 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33122aa-bdd2-4444-8c17-e51a085d70a3 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] PATH_INFO: `/v3/domains/194f85c8fffb4a8dbbe7ef1766eb80b4` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:00.624142 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33122aa-bdd2-4444-8c17-e51a085d70a3 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 30 21:41:00.635441 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-b33122aa-bdd2-4444-8c17-e51a085d70a3 tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Could not find domain: 194f85c8fffb4a8dbbe7ef1766eb80b4.: keystone.exception.DomainNotFound: Could not find domain: 194f85c8fffb4a8dbbe7ef1766eb80b4. Apr 30 21:41:00.635441 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:41:00.635441 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Apr 30 21:41:00.635441 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Apr 30 21:41:00.635441 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 21:41:00.635441 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 21:41:00.635441 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 21:41:00.635441 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 21:41:00.635441 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 194f85c8fffb4a8dbbe7ef1766eb80b4. Apr 30 21:41:00.635441 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:41:00.635441 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 21:41:00.635441 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:41:00.635441 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:41:00.635441 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:41:00.635441 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:41:00.636410 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:41:00.636410 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:41:00.636410 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:41:00.636410 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:41:00.636410 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:41:00.636410 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:41:00.636410 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:41:00.636410 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:41:00.636410 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Apr 30 21:41:00.636410 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Apr 30 21:41:00.636410 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Apr 30 21:41:00.636410 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Apr 30 21:41:00.636410 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Apr 30 21:41:00.636410 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Apr 30 21:41:00.636410 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:41:00.636410 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:41:00.638048 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Apr 30 21:41:00.638048 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Apr 30 21:41:00.638048 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Apr 30 21:41:00.638048 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.get_or_create( Apr 30 21:41:00.638048 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Apr 30 21:41:00.638048 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application with Lock( Apr 30 21:41:00.638048 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Apr 30 21:41:00.638048 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self._enter() Apr 30 21:41:00.638048 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Apr 30 21:41:00.638048 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Apr 30 21:41:00.638048 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Apr 30 21:41:00.638048 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.creator() Apr 30 21:41:00.638048 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Apr 30 21:41:00.638048 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application created_value = creator( Apr 30 21:41:00.638048 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Apr 30 21:41:00.638048 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Apr 30 21:41:00.638048 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 194f85c8fffb4a8dbbe7ef1766eb80b4. Apr 30 21:41:00.639109 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:41:00.639109 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3923/7858] 10.222.0.23 () {60 vars in 1248 bytes} [Sat Apr 30 21:41:00 2022] PATCH /identity/v3/domains/194f85c8fffb4a8dbbe7ef1766eb80b4 => generated 112 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Apr 30 21:41:00.640845 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f081da0a-72e5-4f34-af64-fd8721af1dce tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:00.642542 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f081da0a-72e5-4f34-af64-fd8721af1dce tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:00.718699 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f081da0a-72e5-4f34-af64-fd8721af1dce tempest-DomainsNegativeTestJSON-505089188 tempest-DomainsNegativeTestJSON-505089188-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:00.726285 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d76464-1f93-4d8e-b8f9-539533d9ea4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:00.727174 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d76464-1f93-4d8e-b8f9-539533d9ea4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:00.727460 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d76464-1f93-4d8e-b8f9-539533d9ea4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:00.727739 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d76464-1f93-4d8e-b8f9-539533d9ea4f admin admin] PATH_INFO: `/v3/users/af9b80a443334243aff7a0427a6be236` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:00.729229 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d76464-1f93-4d8e-b8f9-539533d9ea4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=af9b80a443334243aff7a0427a6be236)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:00.731390 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d76464-1f93-4d8e-b8f9-539533d9ea4f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:00.905622 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-39d76464-1f93-4d8e-b8f9-539533d9ea4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af9b80a443334243aff7a0427a6be236'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:00.917744 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-39d76464-1f93-4d8e-b8f9-539533d9ea4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af9b80a443334243aff7a0427a6be236'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:00.977620 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-39d76464-1f93-4d8e-b8f9-539533d9ea4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af9b80a443334243aff7a0427a6be236'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:00.986670 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-39d76464-1f93-4d8e-b8f9-539533d9ea4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af9b80a443334243aff7a0427a6be236'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:00.988331 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-39d76464-1f93-4d8e-b8f9-539533d9ea4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af9b80a443334243aff7a0427a6be236'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:00.997458 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3936/7859] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:41:00 2022] DELETE /identity/v3/users/af9b80a443334243aff7a0427a6be236 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:41:01.002379 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278346a-3cd5-4f9c-8093-43d54efefed3 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:01.004422 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278346a-3cd5-4f9c-8093-43d54efefed3 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:01.004422 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278346a-3cd5-4f9c-8093-43d54efefed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:01.026205 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-5278346a-3cd5-4f9c-8093-43d54efefed3 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:01.027775 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5278346a-3cd5-4f9c-8093-43d54efefed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:01.089312 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3924/7860] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:41:01.099172 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d76464-1f93-4d8e-b8f9-539533d9ea4f admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:01.101490 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-39d76464-1f93-4d8e-b8f9-539533d9ea4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:01.169349 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d76464-1f93-4d8e-b8f9-539533d9ea4f admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:01.173208 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01ef66-e39c-4853-a163-a542f9e14c93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:01.173902 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01ef66-e39c-4853-a163-a542f9e14c93 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:01.182389 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01ef66-e39c-4853-a163-a542f9e14c93 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:01.182389 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01ef66-e39c-4853-a163-a542f9e14c93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:01.184687 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f01ef66-e39c-4853-a163-a542f9e14c93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:01.186269 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f01ef66-e39c-4853-a163-a542f9e14c93 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:01.197724 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3937/7861] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:41:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:41:01.794701 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278346a-3cd5-4f9c-8093-43d54efefed3 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:01.796231 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5278346a-3cd5-4f9c-8093-43d54efefed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:01.812124 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278346a-3cd5-4f9c-8093-43d54efefed3 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:01.830771 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a98ca1-a168-4dbb-bbe1-6ca07829a643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:01.830771 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a98ca1-a168-4dbb-bbe1-6ca07829a643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:01.830771 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a98ca1-a168-4dbb-bbe1-6ca07829a643 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:01.830771 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a98ca1-a168-4dbb-bbe1-6ca07829a643 admin admin] PATH_INFO: `/v3/projects/86222a679b91433488d717a0420ed7ff` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:01.831286 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a98ca1-a168-4dbb-bbe1-6ca07829a643 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86222a679b91433488d717a0420ed7ff)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:01.831286 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a98ca1-a168-4dbb-bbe1-6ca07829a643 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:01.940482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-92a98ca1-a168-4dbb-bbe1-6ca07829a643 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86222a679b91433488d717a0420ed7ff', 'request_id': 'req-92a98ca1-a168-4dbb-bbe1-6ca07829a643'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:01.947004 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-92a98ca1-a168-4dbb-bbe1-6ca07829a643 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86222a679b91433488d717a0420ed7ff', 'request_id': 'req-92a98ca1-a168-4dbb-bbe1-6ca07829a643'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:01.953331 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-92a98ca1-a168-4dbb-bbe1-6ca07829a643 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86222a679b91433488d717a0420ed7ff', 'request_id': 'req-92a98ca1-a168-4dbb-bbe1-6ca07829a643'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:02.029818 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-92a98ca1-a168-4dbb-bbe1-6ca07829a643 admin admin] The token cache is being invalidate because project 86222a679b91433488d717a0420ed7ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:41:02.030938 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-92a98ca1-a168-4dbb-bbe1-6ca07829a643 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:02.031826 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-92a98ca1-a168-4dbb-bbe1-6ca07829a643 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:02.035494 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3925/7862] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:41:01 2022] DELETE /identity/v3/projects/86222a679b91433488d717a0420ed7ff => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:41:02.039884 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01ef66-e39c-4853-a163-a542f9e14c93 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:02.050071 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01ef66-e39c-4853-a163-a542f9e14c93 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:02.115070 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1887e5e-709b-4b6d-b682-4787f89e107a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:02.116360 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1887e5e-709b-4b6d-b682-4787f89e107a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:02.116795 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1887e5e-709b-4b6d-b682-4787f89e107a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:02.117395 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1887e5e-709b-4b6d-b682-4787f89e107a admin admin] PATH_INFO: `/v3/users/4f6a80948a3c4fdd8c15b675aae4cb42` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:02.118782 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1887e5e-709b-4b6d-b682-4787f89e107a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f6a80948a3c4fdd8c15b675aae4cb42)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:02.121058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1887e5e-709b-4b6d-b682-4787f89e107a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:02.348116 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a1887e5e-709b-4b6d-b682-4787f89e107a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f6a80948a3c4fdd8c15b675aae4cb42'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:02.366701 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a1887e5e-709b-4b6d-b682-4787f89e107a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f6a80948a3c4fdd8c15b675aae4cb42'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:02.485747 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a1887e5e-709b-4b6d-b682-4787f89e107a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f6a80948a3c4fdd8c15b675aae4cb42'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:02.494038 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a1887e5e-709b-4b6d-b682-4787f89e107a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f6a80948a3c4fdd8c15b675aae4cb42'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:02.494718 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a1887e5e-709b-4b6d-b682-4787f89e107a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f6a80948a3c4fdd8c15b675aae4cb42'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:02.500816 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3938/7863] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:41:02 2022] DELETE /identity/v3/users/4f6a80948a3c4fdd8c15b675aae4cb42 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:41:02.916883 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a98ca1-a168-4dbb-bbe1-6ca07829a643 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:02.926136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-92a98ca1-a168-4dbb-bbe1-6ca07829a643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:02.936127 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a98ca1-a168-4dbb-bbe1-6ca07829a643 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:03.016278 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f60d76-74bd-4739-a708-a10f44bd0a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:03.017217 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f60d76-74bd-4739-a708-a10f44bd0a7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:03.017505 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f60d76-74bd-4739-a708-a10f44bd0a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:03.017811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f60d76-74bd-4739-a708-a10f44bd0a7f admin admin] PATH_INFO: `/v3/projects/4628c0885ede410791679285fcde6e93` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:03.019022 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f60d76-74bd-4739-a708-a10f44bd0a7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4628c0885ede410791679285fcde6e93)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:03.020974 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f60d76-74bd-4739-a708-a10f44bd0a7f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:03.137135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c8f60d76-74bd-4739-a708-a10f44bd0a7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4628c0885ede410791679285fcde6e93', 'request_id': 'req-c8f60d76-74bd-4739-a708-a10f44bd0a7f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:03.143301 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c8f60d76-74bd-4739-a708-a10f44bd0a7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4628c0885ede410791679285fcde6e93', 'request_id': 'req-c8f60d76-74bd-4739-a708-a10f44bd0a7f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:03.150704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c8f60d76-74bd-4739-a708-a10f44bd0a7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4628c0885ede410791679285fcde6e93', 'request_id': 'req-c8f60d76-74bd-4739-a708-a10f44bd0a7f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:03.245517 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c8f60d76-74bd-4739-a708-a10f44bd0a7f admin admin] The token cache is being invalidate because project 4628c0885ede410791679285fcde6e93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:41:03.245959 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c8f60d76-74bd-4739-a708-a10f44bd0a7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:03.246666 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c8f60d76-74bd-4739-a708-a10f44bd0a7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:03.248227 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3926/7864] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:41:02 2022] DELETE /identity/v3/projects/4628c0885ede410791679285fcde6e93 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:41:03.253039 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b271c-ce6d-44fc-b21e-a6ffc29485fe None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:03.253502 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b271c-ce6d-44fc-b21e-a6ffc29485fe None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:03.253622 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b271c-ce6d-44fc-b21e-a6ffc29485fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:03.273167 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-840b271c-ce6d-44fc-b21e-a6ffc29485fe None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:03.274755 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-840b271c-ce6d-44fc-b21e-a6ffc29485fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:03.338505 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3939/7865] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:41:03.346365 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227671e-2718-4102-9cbb-92fcefcb9592 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:03.347190 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227671e-2718-4102-9cbb-92fcefcb9592 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:03.347190 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227671e-2718-4102-9cbb-92fcefcb9592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:03.373557 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-f227671e-2718-4102-9cbb-92fcefcb9592 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:03.374915 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f227671e-2718-4102-9cbb-92fcefcb9592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:03.386832 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3927/7866] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:41:03.388116 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b271c-ce6d-44fc-b21e-a6ffc29485fe None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:03.398948 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b271c-ce6d-44fc-b21e-a6ffc29485fe None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:03.404304 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639b087-9241-417b-8136-42291e71a72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:03.404975 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639b087-9241-417b-8136-42291e71a72a admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:03.405260 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639b087-9241-417b-8136-42291e71a72a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:03.410295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639b087-9241-417b-8136-42291e71a72a admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:03.410295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5639b087-9241-417b-8136-42291e71a72a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:41:03.410295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5639b087-9241-417b-8136-42291e71a72a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:03.410295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5639b087-9241-417b-8136-42291e71a72a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:03.423702 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3940/7867] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:41:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:41:03.424946 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227671e-2718-4102-9cbb-92fcefcb9592 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:03.435027 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227671e-2718-4102-9cbb-92fcefcb9592 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:03.439765 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd0bd7-4741-4542-b156-d7f1470c6078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:03.440420 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd0bd7-4741-4542-b156-d7f1470c6078 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:03.440707 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd0bd7-4741-4542-b156-d7f1470c6078 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:03.440986 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd0bd7-4741-4542-b156-d7f1470c6078 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:03.441681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd0bd7-4741-4542-b156-d7f1470c6078 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:03.444269 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd0bd7-4741-4542-b156-d7f1470c6078 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:03.527722 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3928/7868] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:41:03 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:41:03.531933 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639b087-9241-417b-8136-42291e71a72a admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:03.543132 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639b087-9241-417b-8136-42291e71a72a admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:03.600198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d49e63-e92c-4420-bd7b-473cb26697c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:03.600873 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d49e63-e92c-4420-bd7b-473cb26697c6 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:03.601159 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d49e63-e92c-4420-bd7b-473cb26697c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:03.601438 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d49e63-e92c-4420-bd7b-473cb26697c6 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:03.602171 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d49e63-e92c-4420-bd7b-473cb26697c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:03.604319 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d49e63-e92c-4420-bd7b-473cb26697c6 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:03.729659 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3941/7869] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:41:03 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:41:03.731130 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd0bd7-4741-4542-b156-d7f1470c6078 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:03.742246 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd0bd7-4741-4542-b156-d7f1470c6078 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:03.746850 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36f8c9-19f4-4534-86d4-994da0e02d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:03.747720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36f8c9-19f4-4534-86d4-994da0e02d10 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:03.748005 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36f8c9-19f4-4534-86d4-994da0e02d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:03.748280 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36f8c9-19f4-4534-86d4-994da0e02d10 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:03.748999 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36f8c9-19f4-4534-86d4-994da0e02d10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:03.750626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36f8c9-19f4-4534-86d4-994da0e02d10 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:03.761003 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3929/7870] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:41:03.765049 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d49e63-e92c-4420-bd7b-473cb26697c6 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:03.775623 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d49e63-e92c-4420-bd7b-473cb26697c6 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:03.780529 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09283267-bb3d-4f3b-b1fe-d1037ca99272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:03.781127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09283267-bb3d-4f3b-b1fe-d1037ca99272 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:03.781414 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09283267-bb3d-4f3b-b1fe-d1037ca99272 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:03.781698 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09283267-bb3d-4f3b-b1fe-d1037ca99272 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:03.782466 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09283267-bb3d-4f3b-b1fe-d1037ca99272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:03.784083 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09283267-bb3d-4f3b-b1fe-d1037ca99272 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:03.797477 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3942/7871] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:41:03.798701 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36f8c9-19f4-4534-86d4-994da0e02d10 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:03.809348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36f8c9-19f4-4534-86d4-994da0e02d10 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:03.814217 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4000f1-47a3-4992-badf-a5fbaa6e5844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:03.815098 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4000f1-47a3-4992-badf-a5fbaa6e5844 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:03.815373 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4000f1-47a3-4992-badf-a5fbaa6e5844 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:03.815641 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4000f1-47a3-4992-badf-a5fbaa6e5844 admin admin] PATH_INFO: `/v3/projects/83b9413829b74b99ba2b28e6dca5843a/users/13fe1febb37a412c82023a48632d49da/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:03.830469 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4000f1-47a3-4992-badf-a5fbaa6e5844 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83b9413829b74b99ba2b28e6dca5843a, user_id=13fe1febb37a412c82023a48632d49da, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:03.833125 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4000f1-47a3-4992-badf-a5fbaa6e5844 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:03.903327 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3930/7872] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:41:03 2022] PUT /identity/v3/projects/83b9413829b74b99ba2b28e6dca5843a/users/13fe1febb37a412c82023a48632d49da/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:41:03.914691 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488afff5-2f8c-4feb-9492-b5f036f46f32 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:03.914979 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488afff5-2f8c-4feb-9492-b5f036f46f32 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:03.915259 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488afff5-2f8c-4feb-9492-b5f036f46f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:03.942809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-488afff5-2f8c-4feb-9492-b5f036f46f32 None None] MFA Rules not processed for user `13fe1febb37a412c82023a48632d49da`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:03.944084 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-488afff5-2f8c-4feb-9492-b5f036f46f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:04.008382 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3943/7873] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:41:04.012892 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4000f1-47a3-4992-badf-a5fbaa6e5844 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:04.078599 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4000f1-47a3-4992-badf-a5fbaa6e5844 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:04.083497 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8650be1e-3eb6-4595-bd1c-6ab1a315aea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:04.084130 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650be1e-3eb6-4595-bd1c-6ab1a315aea8 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:04.084507 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650be1e-3eb6-4595-bd1c-6ab1a315aea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:04.084789 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650be1e-3eb6-4595-bd1c-6ab1a315aea8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:04.085489 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8650be1e-3eb6-4595-bd1c-6ab1a315aea8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:04.087478 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8650be1e-3eb6-4595-bd1c-6ab1a315aea8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:04.177429 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3931/7874] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:41:04 2022] POST /identity/v3/projects => generated 383 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:41:04.179289 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488afff5-2f8c-4feb-9492-b5f036f46f32 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:04.191872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488afff5-2f8c-4feb-9492-b5f036f46f32 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:04.249649 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688bd8e-b869-4232-a2b0-be6115a0d43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:04.250359 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688bd8e-b869-4232-a2b0-be6115a0d43d admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:04.250654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688bd8e-b869-4232-a2b0-be6115a0d43d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:04.250925 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688bd8e-b869-4232-a2b0-be6115a0d43d admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:04.251774 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e688bd8e-b869-4232-a2b0-be6115a0d43d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:04.253734 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e688bd8e-b869-4232-a2b0-be6115a0d43d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:04.363532 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3944/7875] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:41:04 2022] POST /identity/v3/users => generated 298 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:41:04.364908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8650be1e-3eb6-4595-bd1c-6ab1a315aea8 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:04.376426 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8650be1e-3eb6-4595-bd1c-6ab1a315aea8 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:04.381923 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c65ac-58a7-45d2-9a4e-5df0083a4e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:04.382602 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c65ac-58a7-45d2-9a4e-5df0083a4e09 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:04.387684 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c65ac-58a7-45d2-9a4e-5df0083a4e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:04.387684 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c65ac-58a7-45d2-9a4e-5df0083a4e09 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:04.387684 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c65ac-58a7-45d2-9a4e-5df0083a4e09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:04.387684 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c65ac-58a7-45d2-9a4e-5df0083a4e09 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:04.396591 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3932/7876] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:41:04.401107 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688bd8e-b869-4232-a2b0-be6115a0d43d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:04.411124 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688bd8e-b869-4232-a2b0-be6115a0d43d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:04.416374 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db1e55-8db0-4908-8043-660ae980f93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:04.417256 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db1e55-8db0-4908-8043-660ae980f93b admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:04.417540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db1e55-8db0-4908-8043-660ae980f93b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:04.417855 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db1e55-8db0-4908-8043-660ae980f93b admin admin] PATH_INFO: `/v3/projects/48d3efd4b4c94979b866b9ce9881ae3b/users/2355c401a18d475facd58e0fe4b0358c/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:04.434700 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db1e55-8db0-4908-8043-660ae980f93b admin admin] RBAC: Authorizing `identity:create_grant(project_id=48d3efd4b4c94979b866b9ce9881ae3b, user_id=2355c401a18d475facd58e0fe4b0358c, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:04.437379 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db1e55-8db0-4908-8043-660ae980f93b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:04.507890 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3945/7877] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:41:04 2022] PUT /identity/v3/projects/48d3efd4b4c94979b866b9ce9881ae3b/users/2355c401a18d475facd58e0fe4b0358c/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:41:04.516437 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c65ac-58a7-45d2-9a4e-5df0083a4e09 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:04.530124 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c65ac-58a7-45d2-9a4e-5df0083a4e09 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:04.591961 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472bfb9-390a-4dc4-9340-4f7e0b0fc4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:04.592735 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472bfb9-390a-4dc4-9340-4f7e0b0fc4be admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:04.593091 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472bfb9-390a-4dc4-9340-4f7e0b0fc4be admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:04.593435 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472bfb9-390a-4dc4-9340-4f7e0b0fc4be admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:04.594261 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472bfb9-390a-4dc4-9340-4f7e0b0fc4be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:04.596035 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472bfb9-390a-4dc4-9340-4f7e0b0fc4be admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:04.606023 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3933/7878] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:41:04.610393 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db1e55-8db0-4908-8043-660ae980f93b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:04.620962 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db1e55-8db0-4908-8043-660ae980f93b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:04.625866 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d3b29-14a3-4e05-8531-fde8fce049d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:04.626756 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d3b29-14a3-4e05-8531-fde8fce049d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:04.627044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d3b29-14a3-4e05-8531-fde8fce049d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:04.627321 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d3b29-14a3-4e05-8531-fde8fce049d2 admin admin] PATH_INFO: `/v3/projects/48d3efd4b4c94979b866b9ce9881ae3b/users/2355c401a18d475facd58e0fe4b0358c/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:04.629357 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d3b29-14a3-4e05-8531-fde8fce049d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48d3efd4b4c94979b866b9ce9881ae3b, user_id=2355c401a18d475facd58e0fe4b0358c, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:04.632615 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d3b29-14a3-4e05-8531-fde8fce049d2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:04.643453 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3946/7879] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:41:04 2022] PUT /identity/v3/projects/48d3efd4b4c94979b866b9ce9881ae3b/users/2355c401a18d475facd58e0fe4b0358c/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:41:04.655519 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509bc05-d7ca-4db4-903a-8986e9fc8a32 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:04.655818 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509bc05-d7ca-4db4-903a-8986e9fc8a32 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:04.656101 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509bc05-d7ca-4db4-903a-8986e9fc8a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:04.682488 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-f509bc05-d7ca-4db4-903a-8986e9fc8a32 None None] MFA Rules not processed for user `2355c401a18d475facd58e0fe4b0358c`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:04.683793 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f509bc05-d7ca-4db4-903a-8986e9fc8a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:04.751638 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3934/7880] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:41:04.756781 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d3b29-14a3-4e05-8531-fde8fce049d2 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:04.767664 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d3b29-14a3-4e05-8531-fde8fce049d2 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:04.772878 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f62d5b-6720-4760-8ed9-fea3d3705b2a tempest-ProjectsNegativeTestJSON-176238335 tempest-ProjectsNegativeTestJSON-176238335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2355c401a18d475facd58e0fe4b0358c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d3efd4b4c94979b866b9ce9881ae3b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:04.773540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f62d5b-6720-4760-8ed9-fea3d3705b2a tempest-ProjectsNegativeTestJSON-176238335 tempest-ProjectsNegativeTestJSON-176238335-project-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:04.774121 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f62d5b-6720-4760-8ed9-fea3d3705b2a tempest-ProjectsNegativeTestJSON-176238335 tempest-ProjectsNegativeTestJSON-176238335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:04.774404 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f62d5b-6720-4760-8ed9-fea3d3705b2a tempest-ProjectsNegativeTestJSON-176238335 tempest-ProjectsNegativeTestJSON-176238335-project-admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:04.775086 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f62d5b-6720-4760-8ed9-fea3d3705b2a tempest-ProjectsNegativeTestJSON-176238335 tempest-ProjectsNegativeTestJSON-176238335-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:04.776953 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f62d5b-6720-4760-8ed9-fea3d3705b2a tempest-ProjectsNegativeTestJSON-176238335 tempest-ProjectsNegativeTestJSON-176238335-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:04.875851 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3947/7881] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:41:04 2022] POST /identity/v3/projects => generated 359 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:41:04.877391 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509bc05-d7ca-4db4-903a-8986e9fc8a32 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:04.935986 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509bc05-d7ca-4db4-903a-8986e9fc8a32 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:04.988026 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea8cfb-d788-45cd-802a-b789deddf981 tempest-ProjectsNegativeTestJSON-1532583639 tempest-ProjectsNegativeTestJSON-1532583639-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13fe1febb37a412c82023a48632d49da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b9413829b74b99ba2b28e6dca5843a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:04.988893 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea8cfb-d788-45cd-802a-b789deddf981 tempest-ProjectsNegativeTestJSON-1532583639 tempest-ProjectsNegativeTestJSON-1532583639-project] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:04.989180 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea8cfb-d788-45cd-802a-b789deddf981 tempest-ProjectsNegativeTestJSON-1532583639 tempest-ProjectsNegativeTestJSON-1532583639-project] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:04.989458 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea8cfb-d788-45cd-802a-b789deddf981 tempest-ProjectsNegativeTestJSON-1532583639 tempest-ProjectsNegativeTestJSON-1532583639-project] PATH_INFO: `/v3/projects/ee0ff4cfe0f74b79acb1b8b468adede8` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:04.990685 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ea8cfb-d788-45cd-802a-b789deddf981 tempest-ProjectsNegativeTestJSON-1532583639 tempest-ProjectsNegativeTestJSON-1532583639-project] RBAC: Authorizing `identity:delete_project(project_id=ee0ff4cfe0f74b79acb1b8b468adede8)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:05.003717 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-a3ea8cfb-d788-45cd-802a-b789deddf981 tempest-ProjectsNegativeTestJSON-1532583639 tempest-ProjectsNegativeTestJSON-1532583639-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Apr 30 21:41:05.003717 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:41:05.003717 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:41:05.003717 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:41:05.003717 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:41:05.003717 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:41:05.003717 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:41:05.003717 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:41:05.003717 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:41:05.003717 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:41:05.003717 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:41:05.003717 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:41:05.003717 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete Apr 30 21:41:05.003717 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Apr 30 21:41:05.004725 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Apr 30 21:41:05.004725 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application enforcer_obj._enforce( Apr 30 21:41:05.004725 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Apr 30 21:41:05.004725 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Apr 30 21:41:05.004725 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Apr 30 21:41:05.004725 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Apr 30 21:41:05.004725 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Apr 30 21:41:05.004725 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:41:05.005660 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3935/7882] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:41:04 2022] DELETE /identity/v3/projects/ee0ff4cfe0f74b79acb1b8b468adede8 => generated 136 bytes in 129 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Apr 30 21:41:05.011107 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f62d5b-6720-4760-8ed9-fea3d3705b2a tempest-ProjectsNegativeTestJSON-176238335 tempest-ProjectsNegativeTestJSON-176238335-project-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:05.073229 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f62d5b-6720-4760-8ed9-fea3d3705b2a tempest-ProjectsNegativeTestJSON-176238335 tempest-ProjectsNegativeTestJSON-176238335-project-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:05.079403 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5053c8-3937-4b96-8e75-32737dd36551 tempest-ProjectsNegativeTestJSON-176238335 tempest-ProjectsNegativeTestJSON-176238335-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2355c401a18d475facd58e0fe4b0358c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d3efd4b4c94979b866b9ce9881ae3b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:05.080580 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5053c8-3937-4b96-8e75-32737dd36551 tempest-ProjectsNegativeTestJSON-176238335 tempest-ProjectsNegativeTestJSON-176238335-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:05.080835 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5053c8-3937-4b96-8e75-32737dd36551 tempest-ProjectsNegativeTestJSON-176238335 tempest-ProjectsNegativeTestJSON-176238335-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:05.081092 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5053c8-3937-4b96-8e75-32737dd36551 tempest-ProjectsNegativeTestJSON-176238335 tempest-ProjectsNegativeTestJSON-176238335-project-admin] PATH_INFO: `/v3/projects/ee0ff4cfe0f74b79acb1b8b468adede8` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:05.083587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5053c8-3937-4b96-8e75-32737dd36551 tempest-ProjectsNegativeTestJSON-176238335 tempest-ProjectsNegativeTestJSON-176238335-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ee0ff4cfe0f74b79acb1b8b468adede8)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:05.085028 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5053c8-3937-4b96-8e75-32737dd36551 tempest-ProjectsNegativeTestJSON-176238335 tempest-ProjectsNegativeTestJSON-176238335-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:05.216272 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7d5053c8-3937-4b96-8e75-32737dd36551 tempest-ProjectsNegativeTestJSON-176238335 tempest-ProjectsNegativeTestJSON-176238335-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee0ff4cfe0f74b79acb1b8b468adede8', 'request_id': 'req-7d5053c8-3937-4b96-8e75-32737dd36551'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:05.222637 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7d5053c8-3937-4b96-8e75-32737dd36551 tempest-ProjectsNegativeTestJSON-176238335 tempest-ProjectsNegativeTestJSON-176238335-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee0ff4cfe0f74b79acb1b8b468adede8', 'request_id': 'req-7d5053c8-3937-4b96-8e75-32737dd36551'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:05.234796 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7d5053c8-3937-4b96-8e75-32737dd36551 tempest-ProjectsNegativeTestJSON-176238335 tempest-ProjectsNegativeTestJSON-176238335-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee0ff4cfe0f74b79acb1b8b468adede8', 'request_id': 'req-7d5053c8-3937-4b96-8e75-32737dd36551'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:05.325870 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7d5053c8-3937-4b96-8e75-32737dd36551 tempest-ProjectsNegativeTestJSON-176238335 tempest-ProjectsNegativeTestJSON-176238335-project-admin] The token cache is being invalidate because project ee0ff4cfe0f74b79acb1b8b468adede8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:41:05.326548 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7d5053c8-3937-4b96-8e75-32737dd36551 tempest-ProjectsNegativeTestJSON-176238335 tempest-ProjectsNegativeTestJSON-176238335-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:05.326886 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7d5053c8-3937-4b96-8e75-32737dd36551 tempest-ProjectsNegativeTestJSON-176238335 tempest-ProjectsNegativeTestJSON-176238335-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:05.328527 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3948/7883] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:41:05 2022] DELETE /identity/v3/projects/ee0ff4cfe0f74b79acb1b8b468adede8 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:41:05.333546 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea8cfb-d788-45cd-802a-b789deddf981 tempest-ProjectsNegativeTestJSON-1532583639 tempest-ProjectsNegativeTestJSON-1532583639-project] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:05.335997 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a3ea8cfb-d788-45cd-802a-b789deddf981 tempest-ProjectsNegativeTestJSON-1532583639 tempest-ProjectsNegativeTestJSON-1532583639-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:05.429905 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea8cfb-d788-45cd-802a-b789deddf981 tempest-ProjectsNegativeTestJSON-1532583639 tempest-ProjectsNegativeTestJSON-1532583639-project] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:05.492216 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1f05c-9167-4639-97f5-592e7de52cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:05.493090 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1f05c-9167-4639-97f5-592e7de52cb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:05.493373 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1f05c-9167-4639-97f5-592e7de52cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:05.493655 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1f05c-9167-4639-97f5-592e7de52cb8 admin admin] PATH_INFO: `/v3/users/13fe1febb37a412c82023a48632d49da` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:05.494876 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd1f05c-9167-4639-97f5-592e7de52cb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13fe1febb37a412c82023a48632d49da)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:05.496827 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd1f05c-9167-4639-97f5-592e7de52cb8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:05.722018 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3bd1f05c-9167-4639-97f5-592e7de52cb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13fe1febb37a412c82023a48632d49da'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:05.734665 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3bd1f05c-9167-4639-97f5-592e7de52cb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13fe1febb37a412c82023a48632d49da'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:05.799965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3bd1f05c-9167-4639-97f5-592e7de52cb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13fe1febb37a412c82023a48632d49da'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:05.800742 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3bd1f05c-9167-4639-97f5-592e7de52cb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13fe1febb37a412c82023a48632d49da'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:05.808887 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3bd1f05c-9167-4639-97f5-592e7de52cb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13fe1febb37a412c82023a48632d49da'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:05.815579 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3936/7884] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:41:05 2022] DELETE /identity/v3/users/13fe1febb37a412c82023a48632d49da => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:41:05.820544 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f390145-92ab-4bca-b815-8931738069b7 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:05.821100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f390145-92ab-4bca-b815-8931738069b7 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:05.821424 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f390145-92ab-4bca-b815-8931738069b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:05.841882 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-0f390145-92ab-4bca-b815-8931738069b7 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:05.843473 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0f390145-92ab-4bca-b815-8931738069b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:05.904531 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3949/7885] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:41:05.921298 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1f05c-9167-4639-97f5-592e7de52cb8 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:05.922916 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3bd1f05c-9167-4639-97f5-592e7de52cb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:05.984462 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1f05c-9167-4639-97f5-592e7de52cb8 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:05.988038 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e9e3a-468a-4de6-b33c-35724ca9ef60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:05.988692 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e9e3a-468a-4de6-b33c-35724ca9ef60 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:05.988994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e9e3a-468a-4de6-b33c-35724ca9ef60 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:05.989262 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e9e3a-468a-4de6-b33c-35724ca9ef60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:05.999152 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e9e3a-468a-4de6-b33c-35724ca9ef60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:06.000637 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e9e3a-468a-4de6-b33c-35724ca9ef60 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:06.010764 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3937/7886] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:41:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:41:06.592485 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f390145-92ab-4bca-b815-8931738069b7 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:06.594877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0f390145-92ab-4bca-b815-8931738069b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:06.616267 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f390145-92ab-4bca-b815-8931738069b7 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:06.621337 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea55986-c01c-4b1e-91c5-d36d6ef3f11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:06.622375 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea55986-c01c-4b1e-91c5-d36d6ef3f11e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:06.622870 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea55986-c01c-4b1e-91c5-d36d6ef3f11e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:06.623216 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea55986-c01c-4b1e-91c5-d36d6ef3f11e admin admin] PATH_INFO: `/v3/projects/83b9413829b74b99ba2b28e6dca5843a` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:06.626623 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea55986-c01c-4b1e-91c5-d36d6ef3f11e admin admin] RBAC: Authorizing `identity:delete_project(project_id=83b9413829b74b99ba2b28e6dca5843a)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:06.628620 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea55986-c01c-4b1e-91c5-d36d6ef3f11e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:06.754202 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9ea55986-c01c-4b1e-91c5-d36d6ef3f11e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83b9413829b74b99ba2b28e6dca5843a', 'request_id': 'req-9ea55986-c01c-4b1e-91c5-d36d6ef3f11e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:06.760224 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9ea55986-c01c-4b1e-91c5-d36d6ef3f11e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83b9413829b74b99ba2b28e6dca5843a', 'request_id': 'req-9ea55986-c01c-4b1e-91c5-d36d6ef3f11e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:06.766671 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9ea55986-c01c-4b1e-91c5-d36d6ef3f11e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83b9413829b74b99ba2b28e6dca5843a', 'request_id': 'req-9ea55986-c01c-4b1e-91c5-d36d6ef3f11e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:06.833466 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9ea55986-c01c-4b1e-91c5-d36d6ef3f11e admin admin] The token cache is being invalidate because project 83b9413829b74b99ba2b28e6dca5843a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:41:06.833685 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9ea55986-c01c-4b1e-91c5-d36d6ef3f11e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:06.834992 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9ea55986-c01c-4b1e-91c5-d36d6ef3f11e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:06.836564 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3950/7887] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:41:06 2022] DELETE /identity/v3/projects/83b9413829b74b99ba2b28e6dca5843a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:41:06.840583 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e9e3a-468a-4de6-b33c-35724ca9ef60 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:06.850638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e9e3a-468a-4de6-b33c-35724ca9ef60 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:06.909649 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27d6f1-5a6b-4878-be75-13f695adbc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:06.910575 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27d6f1-5a6b-4878-be75-13f695adbc7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:06.910864 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27d6f1-5a6b-4878-be75-13f695adbc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:06.911147 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27d6f1-5a6b-4878-be75-13f695adbc7b admin admin] PATH_INFO: `/v3/users/2355c401a18d475facd58e0fe4b0358c` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:06.912899 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e27d6f1-5a6b-4878-be75-13f695adbc7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2355c401a18d475facd58e0fe4b0358c)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:06.914920 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e27d6f1-5a6b-4878-be75-13f695adbc7b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:07.082869 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3e27d6f1-5a6b-4878-be75-13f695adbc7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2355c401a18d475facd58e0fe4b0358c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:07.096560 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3e27d6f1-5a6b-4878-be75-13f695adbc7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2355c401a18d475facd58e0fe4b0358c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:07.160067 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3e27d6f1-5a6b-4878-be75-13f695adbc7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2355c401a18d475facd58e0fe4b0358c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:07.160697 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3e27d6f1-5a6b-4878-be75-13f695adbc7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2355c401a18d475facd58e0fe4b0358c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:07.169680 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3e27d6f1-5a6b-4878-be75-13f695adbc7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2355c401a18d475facd58e0fe4b0358c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:07.176174 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3938/7888] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:41:06 2022] DELETE /identity/v3/users/2355c401a18d475facd58e0fe4b0358c => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:41:07.607665 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea55986-c01c-4b1e-91c5-d36d6ef3f11e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:07.609148 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9ea55986-c01c-4b1e-91c5-d36d6ef3f11e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:07.624554 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea55986-c01c-4b1e-91c5-d36d6ef3f11e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:07.683068 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6d4df-a891-458d-928d-1113c7edc62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:07.683935 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6d4df-a891-458d-928d-1113c7edc62d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:07.684250 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6d4df-a891-458d-928d-1113c7edc62d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:07.684532 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6d4df-a891-458d-928d-1113c7edc62d admin admin] PATH_INFO: `/v3/projects/48d3efd4b4c94979b866b9ce9881ae3b` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:07.685719 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd6d4df-a891-458d-928d-1113c7edc62d admin admin] RBAC: Authorizing `identity:delete_project(project_id=48d3efd4b4c94979b866b9ce9881ae3b)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:07.687685 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd6d4df-a891-458d-928d-1113c7edc62d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:07.810090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bcd6d4df-a891-458d-928d-1113c7edc62d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48d3efd4b4c94979b866b9ce9881ae3b', 'request_id': 'req-bcd6d4df-a891-458d-928d-1113c7edc62d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:07.815348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bcd6d4df-a891-458d-928d-1113c7edc62d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48d3efd4b4c94979b866b9ce9881ae3b', 'request_id': 'req-bcd6d4df-a891-458d-928d-1113c7edc62d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:07.825858 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bcd6d4df-a891-458d-928d-1113c7edc62d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48d3efd4b4c94979b866b9ce9881ae3b', 'request_id': 'req-bcd6d4df-a891-458d-928d-1113c7edc62d'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:07.896599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bcd6d4df-a891-458d-928d-1113c7edc62d admin admin] The token cache is being invalidate because project 48d3efd4b4c94979b866b9ce9881ae3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:41:07.896812 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bcd6d4df-a891-458d-928d-1113c7edc62d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:07.897589 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-bcd6d4df-a891-458d-928d-1113c7edc62d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:07.899750 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3951/7889] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:41:07 2022] DELETE /identity/v3/projects/48d3efd4b4c94979b866b9ce9881ae3b => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:41:07.905184 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450e81e-f2ee-4565-ae5b-684f600544d4 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:07.905650 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450e81e-f2ee-4565-ae5b-684f600544d4 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:07.905775 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450e81e-f2ee-4565-ae5b-684f600544d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:07.924256 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-9450e81e-f2ee-4565-ae5b-684f600544d4 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:07.925488 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-9450e81e-f2ee-4565-ae5b-684f600544d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:07.984558 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3939/7890] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:41:07.993285 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d62c7-ba15-4329-baff-dd92ab954bcc None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:07.993613 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d62c7-ba15-4329-baff-dd92ab954bcc None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:07.993926 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d62c7-ba15-4329-baff-dd92ab954bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:08.013306 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-685d62c7-ba15-4329-baff-dd92ab954bcc None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:08.014553 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-685d62c7-ba15-4329-baff-dd92ab954bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:08.022565 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3952/7891] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:41:08.026983 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450e81e-f2ee-4565-ae5b-684f600544d4 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:08.036621 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450e81e-f2ee-4565-ae5b-684f600544d4 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:08.041356 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025b105-6717-421f-9733-7bab1ad85722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:08.042062 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025b105-6717-421f-9733-7bab1ad85722 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:08.042350 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025b105-6717-421f-9733-7bab1ad85722 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:08.042624 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7025b105-6717-421f-9733-7bab1ad85722 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:08.043349 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7025b105-6717-421f-9733-7bab1ad85722 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:41:08.043649 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7025b105-6717-421f-9733-7bab1ad85722 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:08.045295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7025b105-6717-421f-9733-7bab1ad85722 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:08.060887 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3940/7892] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:41:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:41:08.062044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d62c7-ba15-4329-baff-dd92ab954bcc None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:08.073086 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d62c7-ba15-4329-baff-dd92ab954bcc None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:08.079883 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5f01d-cdfa-4721-9608-7fff2c077212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:08.080558 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5f01d-cdfa-4721-9608-7fff2c077212 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:08.080838 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5f01d-cdfa-4721-9608-7fff2c077212 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:08.081110 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5f01d-cdfa-4721-9608-7fff2c077212 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:08.081834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a5f01d-cdfa-4721-9608-7fff2c077212 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:08.083783 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a5f01d-cdfa-4721-9608-7fff2c077212 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:08.179976 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3953/7893] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:41:08 2022] POST /identity/v3/projects => generated 371 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:41:08.184124 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025b105-6717-421f-9733-7bab1ad85722 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:08.194340 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7025b105-6717-421f-9733-7bab1ad85722 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:08.253267 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82ad7e-3233-4b5c-bf79-3d6f6b074d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:08.254211 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82ad7e-3233-4b5c-bf79-3d6f6b074d18 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:08.254429 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82ad7e-3233-4b5c-bf79-3d6f6b074d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:08.254725 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82ad7e-3233-4b5c-bf79-3d6f6b074d18 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:08.255450 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e82ad7e-3233-4b5c-bf79-3d6f6b074d18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:08.257520 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e82ad7e-3233-4b5c-bf79-3d6f6b074d18 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:08.371047 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3941/7894] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:41:08 2022] POST /identity/v3/users => generated 286 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:41:08.375246 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5f01d-cdfa-4721-9608-7fff2c077212 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:08.385492 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5f01d-cdfa-4721-9608-7fff2c077212 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:08.390131 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762411af-19d2-4d37-a5d2-5575a27afca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:08.390786 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762411af-19d2-4d37-a5d2-5575a27afca1 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:08.391070 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762411af-19d2-4d37-a5d2-5575a27afca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:08.391440 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762411af-19d2-4d37-a5d2-5575a27afca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:08.392071 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762411af-19d2-4d37-a5d2-5575a27afca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:08.393676 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762411af-19d2-4d37-a5d2-5575a27afca1 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:08.404327 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3954/7895] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:41:08.408477 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82ad7e-3233-4b5c-bf79-3d6f6b074d18 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:08.419003 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82ad7e-3233-4b5c-bf79-3d6f6b074d18 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:08.423716 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2031e59-7f35-4ebb-867f-ca1f80ee2702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:08.424380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2031e59-7f35-4ebb-867f-ca1f80ee2702 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:08.424664 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2031e59-7f35-4ebb-867f-ca1f80ee2702 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:08.424942 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2031e59-7f35-4ebb-867f-ca1f80ee2702 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:08.425668 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2031e59-7f35-4ebb-867f-ca1f80ee2702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:08.427339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2031e59-7f35-4ebb-867f-ca1f80ee2702 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:08.439344 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3942/7896] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:41:08.443637 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762411af-19d2-4d37-a5d2-5575a27afca1 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:08.453955 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762411af-19d2-4d37-a5d2-5575a27afca1 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:08.458631 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5288d-b634-44f1-95d9-b89b16dc0ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:08.459524 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5288d-b634-44f1-95d9-b89b16dc0ba3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:08.459807 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5288d-b634-44f1-95d9-b89b16dc0ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:08.460089 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5288d-b634-44f1-95d9-b89b16dc0ba3 admin admin] PATH_INFO: `/v3/projects/79c47e0f81424d2297e3e148d698f25e/users/a67f9645b2fe443792e60f7904dbf3c0/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:08.475508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf5288d-b634-44f1-95d9-b89b16dc0ba3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79c47e0f81424d2297e3e148d698f25e, user_id=a67f9645b2fe443792e60f7904dbf3c0, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:08.478221 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf5288d-b634-44f1-95d9-b89b16dc0ba3 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:08.531697 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3955/7897] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:41:08 2022] PUT /identity/v3/projects/79c47e0f81424d2297e3e148d698f25e/users/a67f9645b2fe443792e60f7904dbf3c0/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:41:08.544271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb201cd-b4ab-4a41-95d9-368d7c871450 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:08.544605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb201cd-b4ab-4a41-95d9-368d7c871450 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:08.544892 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb201cd-b4ab-4a41-95d9-368d7c871450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:08.572436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-dfb201cd-b4ab-4a41-95d9-368d7c871450 None None] MFA Rules not processed for user `a67f9645b2fe443792e60f7904dbf3c0`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:08.573277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-dfb201cd-b4ab-4a41-95d9-368d7c871450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:08.638625 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3943/7898] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:41:08.643680 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5288d-b634-44f1-95d9-b89b16dc0ba3 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:08.654873 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5288d-b634-44f1-95d9-b89b16dc0ba3 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:08.660648 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938dab4-a031-4608-8b0d-92b10a9e9be9 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67f9645b2fe443792e60f7904dbf3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79c47e0f81424d2297e3e148d698f25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:08.661786 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938dab4-a031-4608-8b0d-92b10a9e9be9 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:08.662084 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938dab4-a031-4608-8b0d-92b10a9e9be9 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:08.664843 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938dab4-a031-4608-8b0d-92b10a9e9be9 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] PATH_INFO: `/v3/users/a67f9645b2fe443792e60f7904dbf3c0/application_credentials` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:08.664843 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f938dab4-a031-4608-8b0d-92b10a9e9be9 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] RBAC: Authorizing `identity:create_application_credential(user_id=a67f9645b2fe443792e60f7904dbf3c0)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:08.665026 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f938dab4-a031-4608-8b0d-92b10a9e9be9 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:08.816122 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb201cd-b4ab-4a41-95d9-368d7c871450 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:08.816502 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3956/7899] 10.222.0.23 () {60 vars in 1314 bytes} [Sat Apr 30 21:41:08 2022] POST /identity/v3/users/a67f9645b2fe443792e60f7904dbf3c0/application_credentials => generated 921 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:41:08.828120 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb201cd-b4ab-4a41-95d9-368d7c871450 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:08.832576 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6e715-5222-4ebb-9023-f523026961ed tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67f9645b2fe443792e60f7904dbf3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79c47e0f81424d2297e3e148d698f25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:08.833726 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6e715-5222-4ebb-9023-f523026961ed tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:08.834557 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6e715-5222-4ebb-9023-f523026961ed tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:08.834841 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6e715-5222-4ebb-9023-f523026961ed tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] PATH_INFO: `/v3/users/a67f9645b2fe443792e60f7904dbf3c0/access_rules/f2e6e569348541949a684e6896cb4982` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:08.836276 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b6e715-5222-4ebb-9023-f523026961ed tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] RBAC: Authorizing `identity:delete_access_rule(user_id=a67f9645b2fe443792e60f7904dbf3c0, access_rule_id=f2e6e569348541949a684e6896cb4982)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:08.838005 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b6e715-5222-4ebb-9023-f523026961ed tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:08.887287 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application [None req-b6b6e715-5222-4ebb-9023-f523026961ed tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Apr 30 21:41:08.887287 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:41:08.887287 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Apr 30 21:41:08.887287 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application session.delete(ref) Apr 30 21:41:08.887287 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Apr 30 21:41:08.887287 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application next(self.gen) Apr 30 21:41:08.887287 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Apr 30 21:41:08.887287 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application yield resource Apr 30 21:41:08.887287 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Apr 30 21:41:08.887287 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application next(self.gen) Apr 30 21:41:08.887287 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Apr 30 21:41:08.887287 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self.session.rollback() Apr 30 21:41:08.887287 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Apr 30 21:41:08.887287 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self.force_reraise() Apr 30 21:41:08.887287 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Apr 30 21:41:08.887287 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise self.value Apr 30 21:41:08.888257 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Apr 30 21:41:08.888257 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Apr 30 21:41:08.888257 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Apr 30 21:41:08.888257 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application session.commit() Apr 30 21:41:08.888257 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1431, in commit Apr 30 21:41:08.888257 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Apr 30 21:41:08.888257 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Apr 30 21:41:08.888257 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._prepare_impl() Apr 30 21:41:08.888257 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Apr 30 21:41:08.888257 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self.session.flush() Apr 30 21:41:08.888257 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3363, in flush Apr 30 21:41:08.888257 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._flush(objects) Apr 30 21:41:08.888257 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3503, in _flush Apr 30 21:41:08.888257 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Apr 30 21:41:08.888257 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Apr 30 21:41:08.888257 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application compat.raise_( Apr 30 21:41:08.889054 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Apr 30 21:41:08.889054 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception Apr 30 21:41:08.889054 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3463, in _flush Apr 30 21:41:08.889054 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application flush_context.execute() Apr 30 21:41:08.889054 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Apr 30 21:41:08.889054 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rec.execute(self) Apr 30 21:41:08.889054 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Apr 30 21:41:08.889054 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Apr 30 21:41:08.889054 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Apr 30 21:41:08.889054 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self._synchronize( Apr 30 21:41:08.889054 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Apr 30 21:41:08.889054 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Apr 30 21:41:08.889054 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Apr 30 21:41:08.889054 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise AssertionError( Apr 30 21:41:08.889054 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Apr 30 21:41:08.889054 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:41:08.890043 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Apr 30 21:41:08.890043 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:41:08.890043 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 21:41:08.890043 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 21:41:08.890043 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 21:41:08.890043 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 21:41:08.890043 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 21:41:08.890043 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 21:41:08.890043 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 21:41:08.890043 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 21:41:08.890043 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 21:41:08.890043 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 21:41:08.890043 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 21:41:08.890043 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Apr 30 21:41:08.890043 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Apr 30 21:41:08.890043 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 21:41:08.890043 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 21:41:08.891114 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Apr 30 21:41:08.891114 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Apr 30 21:41:08.891114 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Apr 30 21:41:08.891114 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Apr 30 21:41:08.891114 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Apr 30 21:41:08.891114 ncdv-master-1 devstack@keystone.service[91017]: ERROR keystone.server.flask.application Apr 30 21:41:08.891114 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3944/7900] 10.222.0.23 () {58 vars in 1361 bytes} [Sat Apr 30 21:41:08 2022] DELETE /identity/v3/users/a67f9645b2fe443792e60f7904dbf3c0/access_rules/f2e6e569348541949a684e6896cb4982 => generated 89 bytes in 74 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Apr 30 21:41:08.893883 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938dab4-a031-4608-8b0d-92b10a9e9be9 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:08.907091 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938dab4-a031-4608-8b0d-92b10a9e9be9 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:08.911623 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea378a-76ab-4e16-ad99-3701040d9331 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67f9645b2fe443792e60f7904dbf3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79c47e0f81424d2297e3e148d698f25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:08.913177 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea378a-76ab-4e16-ad99-3701040d9331 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:08.913461 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea378a-76ab-4e16-ad99-3701040d9331 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:08.913742 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea378a-76ab-4e16-ad99-3701040d9331 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] PATH_INFO: `/v3/users/a67f9645b2fe443792e60f7904dbf3c0/application_credentials/86a3e057c23f419e80355e788f2e2108` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:08.926427 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea378a-76ab-4e16-ad99-3701040d9331 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] RBAC: Authorizing `identity:delete_application_credential(user_id=a67f9645b2fe443792e60f7904dbf3c0, application_credential_id=86a3e057c23f419e80355e788f2e2108)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:08.928002 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea378a-76ab-4e16-ad99-3701040d9331 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:09.017882 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3957/7901] 10.222.0.23 () {58 vars in 1394 bytes} [Sat Apr 30 21:41:08 2022] DELETE /identity/v3/users/a67f9645b2fe443792e60f7904dbf3c0/application_credentials/86a3e057c23f419e80355e788f2e2108 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:41:09.018086 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6e715-5222-4ebb-9023-f523026961ed tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:09.029525 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6e715-5222-4ebb-9023-f523026961ed tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:09.035348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0cc30-0b67-48d2-923a-f456ac038515 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67f9645b2fe443792e60f7904dbf3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79c47e0f81424d2297e3e148d698f25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:09.036392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0cc30-0b67-48d2-923a-f456ac038515 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:09.036794 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0cc30-0b67-48d2-923a-f456ac038515 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:09.037701 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0cc30-0b67-48d2-923a-f456ac038515 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] PATH_INFO: `/v3/users/a67f9645b2fe443792e60f7904dbf3c0/access_rules` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:09.039339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0cc30-0b67-48d2-923a-f456ac038515 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] RBAC: Authorizing `identity:list_access_rules(user_id=a67f9645b2fe443792e60f7904dbf3c0)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:09.040995 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0cc30-0b67-48d2-923a-f456ac038515 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:09.050007 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3945/7902] 10.222.0.23 () {58 vars in 1259 bytes} [Sat Apr 30 21:41:09 2022] GET /identity/v3/users/a67f9645b2fe443792e60f7904dbf3c0/access_rules => generated 369 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:41:09.052171 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea378a-76ab-4e16-ad99-3701040d9331 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:09.066190 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea378a-76ab-4e16-ad99-3701040d9331 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:09.072161 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75254fed-cb75-4252-902a-ad912355806f tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67f9645b2fe443792e60f7904dbf3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79c47e0f81424d2297e3e148d698f25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:09.073647 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75254fed-cb75-4252-902a-ad912355806f tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:09.074001 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75254fed-cb75-4252-902a-ad912355806f tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:09.074307 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75254fed-cb75-4252-902a-ad912355806f tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] PATH_INFO: `/v3/users/a67f9645b2fe443792e60f7904dbf3c0/access_rules/f2e6e569348541949a684e6896cb4982` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:09.075991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75254fed-cb75-4252-902a-ad912355806f tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] RBAC: Authorizing `identity:delete_access_rule(user_id=a67f9645b2fe443792e60f7904dbf3c0, access_rule_id=f2e6e569348541949a684e6896cb4982)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:09.077910 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75254fed-cb75-4252-902a-ad912355806f tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:09.156184 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3958/7903] 10.222.0.23 () {58 vars in 1361 bytes} [Sat Apr 30 21:41:09 2022] DELETE /identity/v3/users/a67f9645b2fe443792e60f7904dbf3c0/access_rules/f2e6e569348541949a684e6896cb4982 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:41:09.160326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0cc30-0b67-48d2-923a-f456ac038515 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:09.170972 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0cc30-0b67-48d2-923a-f456ac038515 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:09.175583 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a9cf92-0191-4b5b-99b1-a811d565d96c tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67f9645b2fe443792e60f7904dbf3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79c47e0f81424d2297e3e148d698f25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:09.184601 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9cf92-0191-4b5b-99b1-a811d565d96c tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:09.184601 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9cf92-0191-4b5b-99b1-a811d565d96c tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:09.184601 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9cf92-0191-4b5b-99b1-a811d565d96c tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] PATH_INFO: `/v3/users/a67f9645b2fe443792e60f7904dbf3c0/access_rules` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:09.184601 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a9cf92-0191-4b5b-99b1-a811d565d96c tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] RBAC: Authorizing `identity:list_access_rules(user_id=a67f9645b2fe443792e60f7904dbf3c0)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:09.184601 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a9cf92-0191-4b5b-99b1-a811d565d96c tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:09.185875 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3946/7904] 10.222.0.23 () {58 vars in 1259 bytes} [Sat Apr 30 21:41:09 2022] GET /identity/v3/users/a67f9645b2fe443792e60f7904dbf3c0/access_rules => generated 158 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:41:09.190036 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75254fed-cb75-4252-902a-ad912355806f tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:09.199352 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75254fed-cb75-4252-902a-ad912355806f tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:09.203991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a5b76-87d1-4ae2-ae0e-90af128c8a39 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67f9645b2fe443792e60f7904dbf3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79c47e0f81424d2297e3e148d698f25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:09.204867 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a5b76-87d1-4ae2-ae0e-90af128c8a39 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:09.205152 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a5b76-87d1-4ae2-ae0e-90af128c8a39 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:09.205459 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a5b76-87d1-4ae2-ae0e-90af128c8a39 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] PATH_INFO: `/v3/users/a67f9645b2fe443792e60f7904dbf3c0/application_credentials` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:09.206242 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a5b76-87d1-4ae2-ae0e-90af128c8a39 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] RBAC: Authorizing `identity:create_application_credential(user_id=a67f9645b2fe443792e60f7904dbf3c0)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:09.207403 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a5b76-87d1-4ae2-ae0e-90af128c8a39 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:09.367012 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3959/7905] 10.222.0.23 () {60 vars in 1314 bytes} [Sat Apr 30 21:41:09 2022] POST /identity/v3/users/a67f9645b2fe443792e60f7904dbf3c0/application_credentials => generated 920 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:41:09.371197 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a9cf92-0191-4b5b-99b1-a811d565d96c tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:09.383542 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a9cf92-0191-4b5b-99b1-a811d565d96c tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:09.387996 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67138c24-40b6-40e5-a6e2-fe9df4d0e404 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67f9645b2fe443792e60f7904dbf3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79c47e0f81424d2297e3e148d698f25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:09.390908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67138c24-40b6-40e5-a6e2-fe9df4d0e404 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:09.390908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67138c24-40b6-40e5-a6e2-fe9df4d0e404 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:09.390908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67138c24-40b6-40e5-a6e2-fe9df4d0e404 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] PATH_INFO: `/v3/users/a67f9645b2fe443792e60f7904dbf3c0/access_rules` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:09.390908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67138c24-40b6-40e5-a6e2-fe9df4d0e404 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] RBAC: Authorizing `identity:list_access_rules(user_id=a67f9645b2fe443792e60f7904dbf3c0)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:09.392254 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67138c24-40b6-40e5-a6e2-fe9df4d0e404 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:09.403258 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3947/7906] 10.222.0.23 () {58 vars in 1259 bytes} [Sat Apr 30 21:41:09 2022] GET /identity/v3/users/a67f9645b2fe443792e60f7904dbf3c0/access_rules => generated 369 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:41:09.405565 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a5b76-87d1-4ae2-ae0e-90af128c8a39 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:09.415604 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a5b76-87d1-4ae2-ae0e-90af128c8a39 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:09.419820 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8e888-99b5-4620-b87b-8dc412293408 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67f9645b2fe443792e60f7904dbf3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79c47e0f81424d2297e3e148d698f25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:09.420693 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8e888-99b5-4620-b87b-8dc412293408 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:09.420984 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8e888-99b5-4620-b87b-8dc412293408 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:09.421268 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8e888-99b5-4620-b87b-8dc412293408 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] PATH_INFO: `/v3/users/a67f9645b2fe443792e60f7904dbf3c0/application_credentials` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:09.422044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8e888-99b5-4620-b87b-8dc412293408 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] RBAC: Authorizing `identity:create_application_credential(user_id=a67f9645b2fe443792e60f7904dbf3c0)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:09.423207 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8e888-99b5-4620-b87b-8dc412293408 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:09.588657 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3960/7907] 10.222.0.23 () {60 vars in 1314 bytes} [Sat Apr 30 21:41:09 2022] POST /identity/v3/users/a67f9645b2fe443792e60f7904dbf3c0/application_credentials => generated 921 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:41:09.592799 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67138c24-40b6-40e5-a6e2-fe9df4d0e404 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:09.602781 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67138c24-40b6-40e5-a6e2-fe9df4d0e404 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:09.606900 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1914a27-37f8-4b33-acc0-27e75e88203d tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a67f9645b2fe443792e60f7904dbf3c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79c47e0f81424d2297e3e148d698f25e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:09.607815 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1914a27-37f8-4b33-acc0-27e75e88203d tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:09.608107 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1914a27-37f8-4b33-acc0-27e75e88203d tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:09.608394 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1914a27-37f8-4b33-acc0-27e75e88203d tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] PATH_INFO: `/v3/users/a67f9645b2fe443792e60f7904dbf3c0/access_rules/9b2ca1f381df497a9136319598053da9` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:09.609584 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1914a27-37f8-4b33-acc0-27e75e88203d tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] RBAC: Authorizing `identity:get_access_rule(user_id=a67f9645b2fe443792e60f7904dbf3c0, access_rule_id=9b2ca1f381df497a9136319598053da9)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:09.611101 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1914a27-37f8-4b33-acc0-27e75e88203d tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:09.617716 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3948/7908] 10.222.0.23 () {58 vars in 1358 bytes} [Sat Apr 30 21:41:09 2022] GET /identity/v3/users/a67f9645b2fe443792e60f7904dbf3c0/access_rules/9b2ca1f381df497a9136319598053da9 => generated 229 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:41:09.622922 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8e888-99b5-4620-b87b-8dc412293408 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:09.695942 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8e888-99b5-4620-b87b-8dc412293408 tempest-AccessRulesV3Test-1458021225 tempest-AccessRulesV3Test-1458021225-project] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:09.701136 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed9155-58eb-42d5-be8c-f29dcaed6920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:09.702043 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed9155-58eb-42d5-be8c-f29dcaed6920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:09.702332 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed9155-58eb-42d5-be8c-f29dcaed6920 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:09.702616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed9155-58eb-42d5-be8c-f29dcaed6920 admin admin] PATH_INFO: `/v3/users/a67f9645b2fe443792e60f7904dbf3c0` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:09.703905 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ed9155-58eb-42d5-be8c-f29dcaed6920 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a67f9645b2fe443792e60f7904dbf3c0)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:09.705942 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ed9155-58eb-42d5-be8c-f29dcaed6920 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:09.860331 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-37ed9155-58eb-42d5-be8c-f29dcaed6920 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a67f9645b2fe443792e60f7904dbf3c0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:10.031332 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-37ed9155-58eb-42d5-be8c-f29dcaed6920 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a67f9645b2fe443792e60f7904dbf3c0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:10.120110 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-37ed9155-58eb-42d5-be8c-f29dcaed6920 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a67f9645b2fe443792e60f7904dbf3c0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:10.127512 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-37ed9155-58eb-42d5-be8c-f29dcaed6920 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a67f9645b2fe443792e60f7904dbf3c0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:10.128150 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-37ed9155-58eb-42d5-be8c-f29dcaed6920 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a67f9645b2fe443792e60f7904dbf3c0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:10.134229 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3961/7909] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:41:09 2022] DELETE /identity/v3/users/a67f9645b2fe443792e60f7904dbf3c0 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:41:10.138852 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03cb05-0cc6-44d9-9c6e-606a93de6021 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:10.139352 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03cb05-0cc6-44d9-9c6e-606a93de6021 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:10.139774 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03cb05-0cc6-44d9-9c6e-606a93de6021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:10.160335 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-3f03cb05-0cc6-44d9-9c6e-606a93de6021 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:10.161601 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3f03cb05-0cc6-44d9-9c6e-606a93de6021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:10.223119 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3949/7910] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:41:10.234099 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed9155-58eb-42d5-be8c-f29dcaed6920 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:10.235655 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-37ed9155-58eb-42d5-be8c-f29dcaed6920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:10.303524 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed9155-58eb-42d5-be8c-f29dcaed6920 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:10.307323 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905ec11-ba76-4c8c-b9c2-4f5dad559b1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:10.307976 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905ec11-ba76-4c8c-b9c2-4f5dad559b1a service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:10.308259 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905ec11-ba76-4c8c-b9c2-4f5dad559b1a service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:10.308607 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905ec11-ba76-4c8c-b9c2-4f5dad559b1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:10.319420 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8905ec11-ba76-4c8c-b9c2-4f5dad559b1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:10.321422 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8905ec11-ba76-4c8c-b9c2-4f5dad559b1a service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:10.331939 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3962/7911] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:41:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:41:10.784514 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03cb05-0cc6-44d9-9c6e-606a93de6021 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:10.786057 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3f03cb05-0cc6-44d9-9c6e-606a93de6021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:10.804822 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03cb05-0cc6-44d9-9c6e-606a93de6021 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:10.811000 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b11bf0-7981-4cd8-a273-39e29dffd5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:10.812322 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b11bf0-7981-4cd8-a273-39e29dffd5e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:10.812874 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b11bf0-7981-4cd8-a273-39e29dffd5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:10.813395 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b11bf0-7981-4cd8-a273-39e29dffd5e3 admin admin] PATH_INFO: `/v3/projects/79c47e0f81424d2297e3e148d698f25e` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:10.814982 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b11bf0-7981-4cd8-a273-39e29dffd5e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79c47e0f81424d2297e3e148d698f25e)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:10.817417 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b11bf0-7981-4cd8-a273-39e29dffd5e3 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:10.972190 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-27b11bf0-7981-4cd8-a273-39e29dffd5e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79c47e0f81424d2297e3e148d698f25e', 'request_id': 'req-27b11bf0-7981-4cd8-a273-39e29dffd5e3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:10.979500 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-27b11bf0-7981-4cd8-a273-39e29dffd5e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79c47e0f81424d2297e3e148d698f25e', 'request_id': 'req-27b11bf0-7981-4cd8-a273-39e29dffd5e3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:10.985614 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-27b11bf0-7981-4cd8-a273-39e29dffd5e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79c47e0f81424d2297e3e148d698f25e', 'request_id': 'req-27b11bf0-7981-4cd8-a273-39e29dffd5e3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:11.056957 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-27b11bf0-7981-4cd8-a273-39e29dffd5e3 admin admin] The token cache is being invalidate because project 79c47e0f81424d2297e3e148d698f25e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:41:11.057345 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-27b11bf0-7981-4cd8-a273-39e29dffd5e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:11.058018 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-27b11bf0-7981-4cd8-a273-39e29dffd5e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:11.059818 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3950/7912] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:41:10 2022] DELETE /identity/v3/projects/79c47e0f81424d2297e3e148d698f25e => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:41:11.065479 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87982ea-3f45-4cb2-bb13-8ab92d8dbd66 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:11.065978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87982ea-3f45-4cb2-bb13-8ab92d8dbd66 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:11.066065 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87982ea-3f45-4cb2-bb13-8ab92d8dbd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:11.084914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-f87982ea-3f45-4cb2-bb13-8ab92d8dbd66 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:11.086272 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f87982ea-3f45-4cb2-bb13-8ab92d8dbd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:11.147654 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3963/7913] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:41:11.155273 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b481dd-6b58-4841-8452-0d9b15ac3c5a None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:11.155793 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b481dd-6b58-4841-8452-0d9b15ac3c5a None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:11.155893 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b481dd-6b58-4841-8452-0d9b15ac3c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:11.175179 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-94b481dd-6b58-4841-8452-0d9b15ac3c5a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:11.176619 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-94b481dd-6b58-4841-8452-0d9b15ac3c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:11.185023 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3951/7914] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:41:11.189700 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87982ea-3f45-4cb2-bb13-8ab92d8dbd66 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:11.200016 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87982ea-3f45-4cb2-bb13-8ab92d8dbd66 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:11.204781 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a58f97-6909-4c8e-ba66-8ef6ce27a4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:11.205439 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a58f97-6909-4c8e-ba66-8ef6ce27a4ab admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:11.205726 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a58f97-6909-4c8e-ba66-8ef6ce27a4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:11.206040 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a58f97-6909-4c8e-ba66-8ef6ce27a4ab admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:11.206764 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a58f97-6909-4c8e-ba66-8ef6ce27a4ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:41:11.207105 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a58f97-6909-4c8e-ba66-8ef6ce27a4ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:11.208791 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a58f97-6909-4c8e-ba66-8ef6ce27a4ab admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:11.224802 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3964/7915] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:41:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:41:11.228369 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b481dd-6b58-4841-8452-0d9b15ac3c5a None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:11.235932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b481dd-6b58-4841-8452-0d9b15ac3c5a None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:11.240778 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee25a4-ea08-4429-a727-69aab37a5e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:11.241427 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee25a4-ea08-4429-a727-69aab37a5e89 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:11.241713 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee25a4-ea08-4429-a727-69aab37a5e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:11.242119 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee25a4-ea08-4429-a727-69aab37a5e89 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:11.242811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee25a4-ea08-4429-a727-69aab37a5e89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:11.244773 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee25a4-ea08-4429-a727-69aab37a5e89 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:11.356416 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3952/7916] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:41:11 2022] POST /identity/v3/projects => generated 397 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:41:11.360823 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a58f97-6909-4c8e-ba66-8ef6ce27a4ab admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:11.371816 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a58f97-6909-4c8e-ba66-8ef6ce27a4ab admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:11.430396 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387a183-695f-4560-95e0-6540cc012052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:11.431081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387a183-695f-4560-95e0-6540cc012052 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:11.431368 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387a183-695f-4560-95e0-6540cc012052 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:11.431662 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387a183-695f-4560-95e0-6540cc012052 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:11.432348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387a183-695f-4560-95e0-6540cc012052 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:11.434356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387a183-695f-4560-95e0-6540cc012052 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:11.544955 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3965/7917] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:41:11 2022] POST /identity/v3/users => generated 305 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:41:11.546432 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee25a4-ea08-4429-a727-69aab37a5e89 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:11.557300 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee25a4-ea08-4429-a727-69aab37a5e89 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:11.562034 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b67404-49d6-4809-9def-ab9739e71460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:11.562738 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b67404-49d6-4809-9def-ab9739e71460 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:11.563001 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b67404-49d6-4809-9def-ab9739e71460 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:11.563281 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b67404-49d6-4809-9def-ab9739e71460 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:11.564007 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b67404-49d6-4809-9def-ab9739e71460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:11.565661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b67404-49d6-4809-9def-ab9739e71460 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:11.576884 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3953/7918] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:41:11.581351 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387a183-695f-4560-95e0-6540cc012052 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:11.591763 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387a183-695f-4560-95e0-6540cc012052 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:11.596386 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d743a0-7745-48ad-8077-a1a6921a38f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:11.597270 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d743a0-7745-48ad-8077-a1a6921a38f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:11.597682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d743a0-7745-48ad-8077-a1a6921a38f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:11.598024 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d743a0-7745-48ad-8077-a1a6921a38f2 admin admin] PATH_INFO: `/v3/projects/5c75008e40764761902c5b2ededf4b91/users/a6e1d11db94647eebbf81ec555240d8d/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:11.613240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d743a0-7745-48ad-8077-a1a6921a38f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c75008e40764761902c5b2ededf4b91, user_id=a6e1d11db94647eebbf81ec555240d8d, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:11.616539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d743a0-7745-48ad-8077-a1a6921a38f2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:11.726280 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3966/7919] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:41:11 2022] PUT /identity/v3/projects/5c75008e40764761902c5b2ededf4b91/users/a6e1d11db94647eebbf81ec555240d8d/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:41:11.730312 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b67404-49d6-4809-9def-ab9739e71460 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:11.741080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b67404-49d6-4809-9def-ab9739e71460 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:11.796159 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338cc4f-a92e-4cec-98ff-7a281194f42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:11.796839 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338cc4f-a92e-4cec-98ff-7a281194f42d admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:11.797145 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338cc4f-a92e-4cec-98ff-7a281194f42d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:11.797418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338cc4f-a92e-4cec-98ff-7a281194f42d admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:11.798164 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338cc4f-a92e-4cec-98ff-7a281194f42d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:11.799781 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338cc4f-a92e-4cec-98ff-7a281194f42d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:11.810120 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3954/7920] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:41:11.814100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d743a0-7745-48ad-8077-a1a6921a38f2 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:11.825024 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d743a0-7745-48ad-8077-a1a6921a38f2 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:11.829750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c33319-e0d6-4c27-907e-ca1758d1bf90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:11.830677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c33319-e0d6-4c27-907e-ca1758d1bf90 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:11.830949 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c33319-e0d6-4c27-907e-ca1758d1bf90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:11.831230 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c33319-e0d6-4c27-907e-ca1758d1bf90 admin admin] PATH_INFO: `/v3/projects/5c75008e40764761902c5b2ededf4b91/users/a6e1d11db94647eebbf81ec555240d8d/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:11.833243 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c33319-e0d6-4c27-907e-ca1758d1bf90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c75008e40764761902c5b2ededf4b91, user_id=a6e1d11db94647eebbf81ec555240d8d, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:11.837129 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c33319-e0d6-4c27-907e-ca1758d1bf90 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:11.850962 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3967/7921] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:41:11 2022] PUT /identity/v3/projects/5c75008e40764761902c5b2ededf4b91/users/a6e1d11db94647eebbf81ec555240d8d/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:41:11.861261 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df024ece-063e-4cce-a40a-a0d802d881f1 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:11.861555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df024ece-063e-4cce-a40a-a0d802d881f1 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:11.861874 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df024ece-063e-4cce-a40a-a0d802d881f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:11.888887 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-df024ece-063e-4cce-a40a-a0d802d881f1 None None] MFA Rules not processed for user `a6e1d11db94647eebbf81ec555240d8d`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:11.890163 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-df024ece-063e-4cce-a40a-a0d802d881f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:11.955926 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3955/7922] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:11 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:41:11.960446 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c33319-e0d6-4c27-907e-ca1758d1bf90 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:12.022998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c33319-e0d6-4c27-907e-ca1758d1bf90 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:12.027971 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf5683-06a7-49ad-b368-ca97f7b8c872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:12.028630 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf5683-06a7-49ad-b368-ca97f7b8c872 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:12.028916 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf5683-06a7-49ad-b368-ca97f7b8c872 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:12.029194 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf5683-06a7-49ad-b368-ca97f7b8c872 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:12.029912 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf5683-06a7-49ad-b368-ca97f7b8c872 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:12.031869 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf5683-06a7-49ad-b368-ca97f7b8c872 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:12.125658 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3968/7923] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:41:11 2022] POST /identity/v3/projects => generated 399 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:41:12.126650 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df024ece-063e-4cce-a40a-a0d802d881f1 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:12.140626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df024ece-063e-4cce-a40a-a0d802d881f1 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:12.197973 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21dd5d0-60a9-44d8-84f1-7146db6e8d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:12.198630 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21dd5d0-60a9-44d8-84f1-7146db6e8d35 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:12.198999 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21dd5d0-60a9-44d8-84f1-7146db6e8d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:12.199280 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21dd5d0-60a9-44d8-84f1-7146db6e8d35 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:12.199977 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21dd5d0-60a9-44d8-84f1-7146db6e8d35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:12.202053 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21dd5d0-60a9-44d8-84f1-7146db6e8d35 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:12.300575 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3956/7924] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:41:12 2022] POST /identity/v3/users => generated 300 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:41:12.302812 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf5683-06a7-49ad-b368-ca97f7b8c872 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:12.313808 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf5683-06a7-49ad-b368-ca97f7b8c872 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:12.318436 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e56bb-e288-4dec-a5d8-61c2fbf9ab4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:12.319140 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e56bb-e288-4dec-a5d8-61c2fbf9ab4e admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:12.319424 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e56bb-e288-4dec-a5d8-61c2fbf9ab4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:12.319704 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e56bb-e288-4dec-a5d8-61c2fbf9ab4e admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:12.320429 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e56bb-e288-4dec-a5d8-61c2fbf9ab4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:12.322064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e56bb-e288-4dec-a5d8-61c2fbf9ab4e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:12.332120 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3969/7925] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:41:12.336720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21dd5d0-60a9-44d8-84f1-7146db6e8d35 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:12.346782 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21dd5d0-60a9-44d8-84f1-7146db6e8d35 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:12.352070 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78cab9-3540-450a-8e4c-dbf8de43a80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:12.352726 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78cab9-3540-450a-8e4c-dbf8de43a80c admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:12.353012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78cab9-3540-450a-8e4c-dbf8de43a80c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:12.353294 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78cab9-3540-450a-8e4c-dbf8de43a80c admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:12.354080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78cab9-3540-450a-8e4c-dbf8de43a80c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:12.355692 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78cab9-3540-450a-8e4c-dbf8de43a80c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:12.365474 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3957/7926] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:41:12.369590 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e56bb-e288-4dec-a5d8-61c2fbf9ab4e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:12.379584 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e56bb-e288-4dec-a5d8-61c2fbf9ab4e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:12.384723 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a443e9-62f5-4b6c-82a6-012b4ff61ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:12.385286 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a443e9-62f5-4b6c-82a6-012b4ff61ff3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:12.385572 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a443e9-62f5-4b6c-82a6-012b4ff61ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:12.385886 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a443e9-62f5-4b6c-82a6-012b4ff61ff3 admin admin] PATH_INFO: `/v3/projects/7f26f89cf89f40a5a45238e7298198d0/users/de340401893a4b61a2791882c743fa2b/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:12.402565 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a443e9-62f5-4b6c-82a6-012b4ff61ff3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f26f89cf89f40a5a45238e7298198d0, user_id=de340401893a4b61a2791882c743fa2b, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:12.405276 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a443e9-62f5-4b6c-82a6-012b4ff61ff3 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:12.490455 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3970/7927] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:41:12 2022] PUT /identity/v3/projects/7f26f89cf89f40a5a45238e7298198d0/users/de340401893a4b61a2791882c743fa2b/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:41:12.501469 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19dc9dc-d783-49da-9699-553272ec154e None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:12.501774 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19dc9dc-d783-49da-9699-553272ec154e None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:12.502064 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19dc9dc-d783-49da-9699-553272ec154e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:12.528988 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-f19dc9dc-d783-49da-9699-553272ec154e None None] MFA Rules not processed for user `de340401893a4b61a2791882c743fa2b`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:12.530222 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f19dc9dc-d783-49da-9699-553272ec154e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:12.602846 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3958/7928] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:41:12.610329 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a443e9-62f5-4b6c-82a6-012b4ff61ff3 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:12.612219 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a9a443e9-62f5-4b6c-82a6-012b4ff61ff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:12.670984 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a443e9-62f5-4b6c-82a6-012b4ff61ff3 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:12.674774 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce473db1-a1d0-4598-ab95-8bd8bd251ed2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e302b1298dd04d6590e3d079f7b13b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:12.675424 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce473db1-a1d0-4598-ab95-8bd8bd251ed2 service glance] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:12.675725 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce473db1-a1d0-4598-ab95-8bd8bd251ed2 service glance] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:12.676007 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce473db1-a1d0-4598-ab95-8bd8bd251ed2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:12.736357 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce473db1-a1d0-4598-ab95-8bd8bd251ed2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:12.737842 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce473db1-a1d0-4598-ab95-8bd8bd251ed2 service glance] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:12.747527 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3971/7929] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:41:12 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:41:13.453670 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19dc9dc-d783-49da-9699-553272ec154e None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:13.522850 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19dc9dc-d783-49da-9699-553272ec154e None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:13.527703 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f197ff60-ea99-4b43-b3e1-24a79a3d17c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:13.528563 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197ff60-ea99-4b43-b3e1-24a79a3d17c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:13.528848 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197ff60-ea99-4b43-b3e1-24a79a3d17c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:13.529125 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197ff60-ea99-4b43-b3e1-24a79a3d17c9 admin admin] PATH_INFO: `/v3/users/a6e1d11db94647eebbf81ec555240d8d` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:13.530345 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f197ff60-ea99-4b43-b3e1-24a79a3d17c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6e1d11db94647eebbf81ec555240d8d)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:13.532315 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f197ff60-ea99-4b43-b3e1-24a79a3d17c9 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:13.738218 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f197ff60-ea99-4b43-b3e1-24a79a3d17c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6e1d11db94647eebbf81ec555240d8d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:13.750951 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f197ff60-ea99-4b43-b3e1-24a79a3d17c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6e1d11db94647eebbf81ec555240d8d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:13.817839 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f197ff60-ea99-4b43-b3e1-24a79a3d17c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6e1d11db94647eebbf81ec555240d8d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:13.818854 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f197ff60-ea99-4b43-b3e1-24a79a3d17c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6e1d11db94647eebbf81ec555240d8d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:13.831275 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f197ff60-ea99-4b43-b3e1-24a79a3d17c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6e1d11db94647eebbf81ec555240d8d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:13.838565 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3959/7930] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:41:13 2022] DELETE /identity/v3/users/a6e1d11db94647eebbf81ec555240d8d => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:41:13.843030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc1d90-e4f1-4914-a202-307172573c07 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:13.843479 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc1d90-e4f1-4914-a202-307172573c07 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:13.843581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc1d90-e4f1-4914-a202-307172573c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:13.864715 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-79dc1d90-e4f1-4914-a202-307172573c07 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:13.865999 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-79dc1d90-e4f1-4914-a202-307172573c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:13.930342 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3972/7931] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:41:13.940873 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f197ff60-ea99-4b43-b3e1-24a79a3d17c9 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:13.943316 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f197ff60-ea99-4b43-b3e1-24a79a3d17c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:14.011640 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f197ff60-ea99-4b43-b3e1-24a79a3d17c9 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:14.015412 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306725c-f1b7-424d-a76b-f1eb1c1e5c74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:14.016072 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306725c-f1b7-424d-a76b-f1eb1c1e5c74 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:14.017277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306725c-f1b7-424d-a76b-f1eb1c1e5c74 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:14.017277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306725c-f1b7-424d-a76b-f1eb1c1e5c74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:14.031727 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d306725c-f1b7-424d-a76b-f1eb1c1e5c74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:14.033626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d306725c-f1b7-424d-a76b-f1eb1c1e5c74 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:14.045444 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3960/7932] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:41:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:41:14.309519 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc1d90-e4f1-4914-a202-307172573c07 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:14.309519 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-79dc1d90-e4f1-4914-a202-307172573c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:14.323678 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc1d90-e4f1-4914-a202-307172573c07 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:14.327354 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3452c-4b93-4ec0-a53d-0ceb3df42f3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:14.328035 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3452c-4b93-4ec0-a53d-0ceb3df42f3a service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:14.328342 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3452c-4b93-4ec0-a53d-0ceb3df42f3a service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:14.328621 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3452c-4b93-4ec0-a53d-0ceb3df42f3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:14.330526 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-dee3452c-4b93-4ec0-a53d-0ceb3df42f3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:14.343637 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee3452c-4b93-4ec0-a53d-0ceb3df42f3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:14.345191 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee3452c-4b93-4ec0-a53d-0ceb3df42f3a service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:14.355824 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3973/7933] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:41:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:41:14.626960 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306725c-f1b7-424d-a76b-f1eb1c1e5c74 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:14.629272 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d306725c-f1b7-424d-a76b-f1eb1c1e5c74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:14.645383 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306725c-f1b7-424d-a76b-f1eb1c1e5c74 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:14.656675 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489afe6c-e728-4ef8-a3e1-d61a6fb02d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:14.656675 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489afe6c-e728-4ef8-a3e1-d61a6fb02d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:14.656675 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489afe6c-e728-4ef8-a3e1-d61a6fb02d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:14.656675 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489afe6c-e728-4ef8-a3e1-d61a6fb02d05 admin admin] PATH_INFO: `/v3/projects/5c75008e40764761902c5b2ededf4b91` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:14.656962 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489afe6c-e728-4ef8-a3e1-d61a6fb02d05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c75008e40764761902c5b2ededf4b91)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:14.657449 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489afe6c-e728-4ef8-a3e1-d61a6fb02d05 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:14.757170 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3452c-4b93-4ec0-a53d-0ceb3df42f3a service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:14.758718 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-dee3452c-4b93-4ec0-a53d-0ceb3df42f3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:14.776566 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3452c-4b93-4ec0-a53d-0ceb3df42f3a service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:14.792427 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-489afe6c-e728-4ef8-a3e1-d61a6fb02d05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c75008e40764761902c5b2ededf4b91', 'request_id': 'req-489afe6c-e728-4ef8-a3e1-d61a6fb02d05'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:14.798825 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-489afe6c-e728-4ef8-a3e1-d61a6fb02d05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c75008e40764761902c5b2ededf4b91', 'request_id': 'req-489afe6c-e728-4ef8-a3e1-d61a6fb02d05'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:14.805007 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-489afe6c-e728-4ef8-a3e1-d61a6fb02d05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c75008e40764761902c5b2ededf4b91', 'request_id': 'req-489afe6c-e728-4ef8-a3e1-d61a6fb02d05'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:14.833783 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e8fab-2b55-410b-99ee-ecb4ee08169b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:14.835352 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e8fab-2b55-410b-99ee-ecb4ee08169b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:14.836835 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e8fab-2b55-410b-99ee-ecb4ee08169b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:14.836835 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e8fab-2b55-410b-99ee-ecb4ee08169b admin admin] PATH_INFO: `/v3/users/52d300d3d2304038a1f19bc979f1d979` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:14.837100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e8fab-2b55-410b-99ee-ecb4ee08169b admin admin] RBAC: Authorizing `identity:delete_user(user_id=52d300d3d2304038a1f19bc979f1d979)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:14.839075 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e8fab-2b55-410b-99ee-ecb4ee08169b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:14.889714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-489afe6c-e728-4ef8-a3e1-d61a6fb02d05 admin admin] The token cache is being invalidate because project 5c75008e40764761902c5b2ededf4b91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:41:14.890039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-489afe6c-e728-4ef8-a3e1-d61a6fb02d05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:14.890777 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-489afe6c-e728-4ef8-a3e1-d61a6fb02d05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:14.892231 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3961/7934] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:41:14 2022] DELETE /identity/v3/projects/5c75008e40764761902c5b2ededf4b91 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:41:14.896305 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489afe6c-e728-4ef8-a3e1-d61a6fb02d05 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:14.898227 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-489afe6c-e728-4ef8-a3e1-d61a6fb02d05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:14.911185 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489afe6c-e728-4ef8-a3e1-d61a6fb02d05 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:14.916540 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c68206-1d95-4ebc-b74a-4d910218200b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:14.917407 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c68206-1d95-4ebc-b74a-4d910218200b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:14.917712 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c68206-1d95-4ebc-b74a-4d910218200b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:14.918004 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c68206-1d95-4ebc-b74a-4d910218200b admin admin] PATH_INFO: `/v3/users/de340401893a4b61a2791882c743fa2b` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:14.919198 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c68206-1d95-4ebc-b74a-4d910218200b admin admin] RBAC: Authorizing `identity:delete_user(user_id=de340401893a4b61a2791882c743fa2b)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:14.923185 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c68206-1d95-4ebc-b74a-4d910218200b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:15.024568 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-eb4e8fab-2b55-410b-99ee-ecb4ee08169b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52d300d3d2304038a1f19bc979f1d979'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:15.036005 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-eb4e8fab-2b55-410b-99ee-ecb4ee08169b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52d300d3d2304038a1f19bc979f1d979'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:15.099496 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-33c68206-1d95-4ebc-b74a-4d910218200b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de340401893a4b61a2791882c743fa2b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:15.111229 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-33c68206-1d95-4ebc-b74a-4d910218200b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de340401893a4b61a2791882c743fa2b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:15.114288 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-eb4e8fab-2b55-410b-99ee-ecb4ee08169b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52d300d3d2304038a1f19bc979f1d979'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:15.121326 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-eb4e8fab-2b55-410b-99ee-ecb4ee08169b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52d300d3d2304038a1f19bc979f1d979'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:15.122008 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-eb4e8fab-2b55-410b-99ee-ecb4ee08169b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52d300d3d2304038a1f19bc979f1d979'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:15.127864 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3974/7935] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:41:14 2022] DELETE /identity/v3/users/52d300d3d2304038a1f19bc979f1d979 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:41:15.132609 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b567504-3f8e-4868-9f04-54efc81de881 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:15.132904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b567504-3f8e-4868-9f04-54efc81de881 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:15.133182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b567504-3f8e-4868-9f04-54efc81de881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:15.150593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-7b567504-3f8e-4868-9f04-54efc81de881 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:15.151873 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7b567504-3f8e-4868-9f04-54efc81de881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:15.181604 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-33c68206-1d95-4ebc-b74a-4d910218200b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de340401893a4b61a2791882c743fa2b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:15.182267 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-33c68206-1d95-4ebc-b74a-4d910218200b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de340401893a4b61a2791882c743fa2b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:15.189525 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-33c68206-1d95-4ebc-b74a-4d910218200b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de340401893a4b61a2791882c743fa2b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:15.196036 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3962/7936] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:41:14 2022] DELETE /identity/v3/users/de340401893a4b61a2791882c743fa2b => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:41:15.208866 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3975/7937] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:41:15.219350 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c68206-1d95-4ebc-b74a-4d910218200b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:15.220884 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-33c68206-1d95-4ebc-b74a-4d910218200b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:15.286110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c68206-1d95-4ebc-b74a-4d910218200b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:15.290184 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6981d4-f6f4-42f3-8b04-5d78399dce39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:15.290991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6981d4-f6f4-42f3-8b04-5d78399dce39 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:15.292852 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6981d4-f6f4-42f3-8b04-5d78399dce39 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:15.292852 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6981d4-f6f4-42f3-8b04-5d78399dce39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:15.350704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6981d4-f6f4-42f3-8b04-5d78399dce39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:15.352194 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6981d4-f6f4-42f3-8b04-5d78399dce39 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:15.361659 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3963/7938] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:41:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:41:15.686567 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b567504-3f8e-4868-9f04-54efc81de881 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:15.687984 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7b567504-3f8e-4868-9f04-54efc81de881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:15.699986 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b567504-3f8e-4868-9f04-54efc81de881 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:15.704794 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa39f8d-7839-4a13-ae54-6fa362dc7ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:15.705701 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa39f8d-7839-4a13-ae54-6fa362dc7ecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:15.706034 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa39f8d-7839-4a13-ae54-6fa362dc7ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:15.706313 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa39f8d-7839-4a13-ae54-6fa362dc7ecf admin admin] PATH_INFO: `/v3/projects/ce8b86b5b17e4648a07cd953925eb2ae` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:15.707544 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa39f8d-7839-4a13-ae54-6fa362dc7ecf admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce8b86b5b17e4648a07cd953925eb2ae)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:15.709514 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa39f8d-7839-4a13-ae54-6fa362dc7ecf admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:15.718093 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6981d4-f6f4-42f3-8b04-5d78399dce39 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:15.720672 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7f6981d4-f6f4-42f3-8b04-5d78399dce39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:15.735998 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6981d4-f6f4-42f3-8b04-5d78399dce39 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:15.741484 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeac975-0d2a-44b5-975f-7105c9971a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:15.742308 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeac975-0d2a-44b5-975f-7105c9971a7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:15.742679 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeac975-0d2a-44b5-975f-7105c9971a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:15.747994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeac975-0d2a-44b5-975f-7105c9971a7b admin admin] PATH_INFO: `/v3/projects/7f26f89cf89f40a5a45238e7298198d0` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:15.747994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeac975-0d2a-44b5-975f-7105c9971a7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f26f89cf89f40a5a45238e7298198d0)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:15.747994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeac975-0d2a-44b5-975f-7105c9971a7b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:15.795346 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2aa39f8d-7839-4a13-ae54-6fa362dc7ecf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce8b86b5b17e4648a07cd953925eb2ae', 'request_id': 'req-2aa39f8d-7839-4a13-ae54-6fa362dc7ecf'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:15.800551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2aa39f8d-7839-4a13-ae54-6fa362dc7ecf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce8b86b5b17e4648a07cd953925eb2ae', 'request_id': 'req-2aa39f8d-7839-4a13-ae54-6fa362dc7ecf'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:15.807393 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2aa39f8d-7839-4a13-ae54-6fa362dc7ecf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce8b86b5b17e4648a07cd953925eb2ae', 'request_id': 'req-2aa39f8d-7839-4a13-ae54-6fa362dc7ecf'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:15.840031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5eeac975-0d2a-44b5-975f-7105c9971a7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f26f89cf89f40a5a45238e7298198d0', 'request_id': 'req-5eeac975-0d2a-44b5-975f-7105c9971a7b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:15.845396 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5eeac975-0d2a-44b5-975f-7105c9971a7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f26f89cf89f40a5a45238e7298198d0', 'request_id': 'req-5eeac975-0d2a-44b5-975f-7105c9971a7b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:15.852284 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5eeac975-0d2a-44b5-975f-7105c9971a7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f26f89cf89f40a5a45238e7298198d0', 'request_id': 'req-5eeac975-0d2a-44b5-975f-7105c9971a7b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:15.879404 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2aa39f8d-7839-4a13-ae54-6fa362dc7ecf admin admin] The token cache is being invalidate because project ce8b86b5b17e4648a07cd953925eb2ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:41:15.879691 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2aa39f8d-7839-4a13-ae54-6fa362dc7ecf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:15.880381 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2aa39f8d-7839-4a13-ae54-6fa362dc7ecf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:15.882144 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3976/7939] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:41:15 2022] DELETE /identity/v3/projects/ce8b86b5b17e4648a07cd953925eb2ae => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:41:15.886991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf49de-6bfc-4dff-81f4-4e8e5f87b2c3 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:15.887286 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf49de-6bfc-4dff-81f4-4e8e5f87b2c3 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:15.887570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf49de-6bfc-4dff-81f4-4e8e5f87b2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:15.905650 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-eaaf49de-6bfc-4dff-81f4-4e8e5f87b2c3 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:15.907024 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-eaaf49de-6bfc-4dff-81f4-4e8e5f87b2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:15.949124 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5eeac975-0d2a-44b5-975f-7105c9971a7b admin admin] The token cache is being invalidate because project 7f26f89cf89f40a5a45238e7298198d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:41:15.949578 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5eeac975-0d2a-44b5-975f-7105c9971a7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:15.950461 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5eeac975-0d2a-44b5-975f-7105c9971a7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:15.952674 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3964/7940] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:41:15 2022] DELETE /identity/v3/projects/7f26f89cf89f40a5a45238e7298198d0 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:41:15.959272 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a83fa-3d49-43e3-bda8-9e7f5aaa69b4 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:15.959701 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a83fa-3d49-43e3-bda8-9e7f5aaa69b4 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:15.960100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a83fa-3d49-43e3-bda8-9e7f5aaa69b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:15.964665 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3977/7941] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:41:15.972266 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff64e83-9eb5-4b00-b498-2f17d01cbcd8 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:15.972563 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff64e83-9eb5-4b00-b498-2f17d01cbcd8 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:15.972850 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff64e83-9eb5-4b00-b498-2f17d01cbcd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:15.987314 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-576a83fa-3d49-43e3-bda8-9e7f5aaa69b4 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:15.988756 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-576a83fa-3d49-43e3-bda8-9e7f5aaa69b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:15.992335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-5ff64e83-9eb5-4b00-b498-2f17d01cbcd8 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:15.993534 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5ff64e83-9eb5-4b00-b498-2f17d01cbcd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:15.998767 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3965/7942] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:41:16.002523 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3978/7943] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:41:16.006722 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a83fa-3d49-43e3-bda8-9e7f5aaa69b4 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:16.008418 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eea2d0-e10c-49ac-88ae-85cb4747aef9 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:16.008728 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eea2d0-e10c-49ac-88ae-85cb4747aef9 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:16.009006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eea2d0-e10c-49ac-88ae-85cb4747aef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:16.016565 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a83fa-3d49-43e3-bda8-9e7f5aaa69b4 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:16.021443 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2aae1-b1e1-4e52-a0f2-e83d37f10e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:16.022634 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2aae1-b1e1-4e52-a0f2-e83d37f10e25 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:16.022922 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2aae1-b1e1-4e52-a0f2-e83d37f10e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:16.023201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2aae1-b1e1-4e52-a0f2-e83d37f10e25 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:16.024178 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2aae1-b1e1-4e52-a0f2-e83d37f10e25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:41:16.024487 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2aae1-b1e1-4e52-a0f2-e83d37f10e25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:16.026140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2aae1-b1e1-4e52-a0f2-e83d37f10e25 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:16.035253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-08eea2d0-e10c-49ac-88ae-85cb4747aef9 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:16.037215 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-08eea2d0-e10c-49ac-88ae-85cb4747aef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:16.038643 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3966/7944] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:41:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:41:16.042732 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2aae1-b1e1-4e52-a0f2-e83d37f10e25 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:16.048702 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3979/7945] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:41:16.052763 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2aae1-b1e1-4e52-a0f2-e83d37f10e25 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:16.052930 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eea2d0-e10c-49ac-88ae-85cb4747aef9 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:16.057795 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e54ea-8259-4187-ba2e-49b93e63ee34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:16.058534 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e54ea-8259-4187-ba2e-49b93e63ee34 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:16.058821 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e54ea-8259-4187-ba2e-49b93e63ee34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:16.059102 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e54ea-8259-4187-ba2e-49b93e63ee34 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:16.059791 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e54ea-8259-4187-ba2e-49b93e63ee34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:16.065012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e54ea-8259-4187-ba2e-49b93e63ee34 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:16.065115 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eea2d0-e10c-49ac-88ae-85cb4747aef9 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:16.069807 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c42c7-d6e8-4008-b627-f02215c5cf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:16.070693 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c42c7-d6e8-4008-b627-f02215c5cf1b admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:16.071119 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c42c7-d6e8-4008-b627-f02215c5cf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:16.071575 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c42c7-d6e8-4008-b627-f02215c5cf1b admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:16.072676 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c42c7-d6e8-4008-b627-f02215c5cf1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:41:16.073137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c42c7-d6e8-4008-b627-f02215c5cf1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:16.075697 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c42c7-d6e8-4008-b627-f02215c5cf1b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:16.088912 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3980/7946] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:41:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:41:16.093331 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c42c7-d6e8-4008-b627-f02215c5cf1b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:16.103691 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c42c7-d6e8-4008-b627-f02215c5cf1b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:16.108579 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69631b2d-6114-4f3f-9925-43d20d2cdc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:16.109223 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69631b2d-6114-4f3f-9925-43d20d2cdc87 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:16.109511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69631b2d-6114-4f3f-9925-43d20d2cdc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:16.109827 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69631b2d-6114-4f3f-9925-43d20d2cdc87 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:16.110510 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69631b2d-6114-4f3f-9925-43d20d2cdc87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:16.112421 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69631b2d-6114-4f3f-9925-43d20d2cdc87 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:16.171933 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3967/7947] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:41:16 2022] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:41:16.175902 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e54ea-8259-4187-ba2e-49b93e63ee34 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:16.200384 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3981/7948] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:41:16 2022] POST /identity/v3/projects => generated 387 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:41:16.204487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69631b2d-6114-4f3f-9925-43d20d2cdc87 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:16.239138 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e54ea-8259-4187-ba2e-49b93e63ee34 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:16.267168 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69631b2d-6114-4f3f-9925-43d20d2cdc87 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:16.272853 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b509c-51ea-4062-95ca-6d074a964a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:16.273544 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b509c-51ea-4062-95ca-6d074a964a09 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:16.273864 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b509c-51ea-4062-95ca-6d074a964a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:16.274401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b509c-51ea-4062-95ca-6d074a964a09 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:16.275105 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b509c-51ea-4062-95ca-6d074a964a09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:16.277087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b509c-51ea-4062-95ca-6d074a964a09 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:16.300355 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ecabf-fb9b-45f1-8f60-ea1eec16a6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:16.300355 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ecabf-fb9b-45f1-8f60-ea1eec16a6f6 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:16.300355 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ecabf-fb9b-45f1-8f60-ea1eec16a6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:16.300355 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ecabf-fb9b-45f1-8f60-ea1eec16a6f6 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:16.300934 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ecabf-fb9b-45f1-8f60-ea1eec16a6f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:16.302979 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ecabf-fb9b-45f1-8f60-ea1eec16a6f6 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:16.389876 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3982/7949] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:41:16 2022] POST /identity/v3/users => generated 294 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:41:16.394166 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b509c-51ea-4062-95ca-6d074a964a09 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:16.405339 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b509c-51ea-4062-95ca-6d074a964a09 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:16.410048 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43aaf36-980e-463f-8e94-b123832ca8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:16.410707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43aaf36-980e-463f-8e94-b123832ca8b6 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:16.410987 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43aaf36-980e-463f-8e94-b123832ca8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:16.411333 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43aaf36-980e-463f-8e94-b123832ca8b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:16.412053 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43aaf36-980e-463f-8e94-b123832ca8b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:16.414269 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43aaf36-980e-463f-8e94-b123832ca8b6 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:16.426561 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3968/7950] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:41:16 2022] POST /identity/v3/users => generated 292 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:41:16.433222 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3983/7951] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:41:16.433332 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ecabf-fb9b-45f1-8f60-ea1eec16a6f6 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:16.435962 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43aaf36-980e-463f-8e94-b123832ca8b6 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:16.438211 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ecabf-fb9b-45f1-8f60-ea1eec16a6f6 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:16.444597 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eced6c-3f77-436d-a5f2-26af5b28892f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:16.445298 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eced6c-3f77-436d-a5f2-26af5b28892f admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:16.445566 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eced6c-3f77-436d-a5f2-26af5b28892f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:16.445877 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eced6c-3f77-436d-a5f2-26af5b28892f admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:16.446594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43aaf36-980e-463f-8e94-b123832ca8b6 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:16.446695 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eced6c-3f77-436d-a5f2-26af5b28892f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:16.448244 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eced6c-3f77-436d-a5f2-26af5b28892f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:16.454822 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b00e1-71e7-49e9-9dfc-3b9152bb91c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:16.455490 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b00e1-71e7-49e9-9dfc-3b9152bb91c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:16.455775 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b00e1-71e7-49e9-9dfc-3b9152bb91c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:16.456054 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b00e1-71e7-49e9-9dfc-3b9152bb91c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:16.456815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b00e1-71e7-49e9-9dfc-3b9152bb91c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:16.458641 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b00e1-71e7-49e9-9dfc-3b9152bb91c7 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:16.464492 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3969/7952] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:41:16.467178 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eced6c-3f77-436d-a5f2-26af5b28892f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:16.473881 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3984/7953] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:41:16.475001 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b00e1-71e7-49e9-9dfc-3b9152bb91c7 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:16.477509 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eced6c-3f77-436d-a5f2-26af5b28892f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:16.482389 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b553e7c0-efa1-4669-8b38-945430f1a91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:16.483076 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553e7c0-efa1-4669-8b38-945430f1a91d admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:16.483357 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553e7c0-efa1-4669-8b38-945430f1a91d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:16.483641 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553e7c0-efa1-4669-8b38-945430f1a91d admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:16.484358 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b553e7c0-efa1-4669-8b38-945430f1a91d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:16.484999 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b00e1-71e7-49e9-9dfc-3b9152bb91c7 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:16.486013 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b553e7c0-efa1-4669-8b38-945430f1a91d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:16.489988 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fce219-0b01-4bd4-8b71-8505eab27fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:16.490862 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fce219-0b01-4bd4-8b71-8505eab27fdd admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:16.491172 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fce219-0b01-4bd4-8b71-8505eab27fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:16.491444 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fce219-0b01-4bd4-8b71-8505eab27fdd admin admin] PATH_INFO: `/v3/projects/e3bd8388c3054a518df465db152bde67/users/aee3661c828f4c75b48da4f658ae9b6f/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:16.497911 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3970/7954] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:41:16.502261 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b553e7c0-efa1-4669-8b38-945430f1a91d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:16.506652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fce219-0b01-4bd4-8b71-8505eab27fdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3bd8388c3054a518df465db152bde67, user_id=aee3661c828f4c75b48da4f658ae9b6f, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:16.509331 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fce219-0b01-4bd4-8b71-8505eab27fdd admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:16.512520 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b553e7c0-efa1-4669-8b38-945430f1a91d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:16.517122 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fcb479-b294-4d8e-bb29-3a8822288866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:16.518022 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcb479-b294-4d8e-bb29-3a8822288866 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:16.518309 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcb479-b294-4d8e-bb29-3a8822288866 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:16.518588 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcb479-b294-4d8e-bb29-3a8822288866 admin admin] PATH_INFO: `/v3/projects/b3802fb0d3c14722838c7c85bf0ca42b/users/ca4b37e3738e45739ea5521edb48f41e/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:16.533773 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fcb479-b294-4d8e-bb29-3a8822288866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3802fb0d3c14722838c7c85bf0ca42b, user_id=ca4b37e3738e45739ea5521edb48f41e, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:16.536452 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fcb479-b294-4d8e-bb29-3a8822288866 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:16.607011 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3985/7955] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:41:16 2022] PUT /identity/v3/projects/e3bd8388c3054a518df465db152bde67/users/aee3661c828f4c75b48da4f658ae9b6f/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:41:16.617988 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25693122-5349-4e3c-8443-a722dce778c5 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:16.618279 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25693122-5349-4e3c-8443-a722dce778c5 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:16.618560 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25693122-5349-4e3c-8443-a722dce778c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:16.634793 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3971/7956] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:41:16 2022] PUT /identity/v3/projects/b3802fb0d3c14722838c7c85bf0ca42b/users/ca4b37e3738e45739ea5521edb48f41e/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:41:16.644292 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-25693122-5349-4e3c-8443-a722dce778c5 None None] MFA Rules not processed for user `aee3661c828f4c75b48da4f658ae9b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:16.644988 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072a675-0b9b-48e1-80b6-a1a0f7d75ac6 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:16.645278 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072a675-0b9b-48e1-80b6-a1a0f7d75ac6 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:16.645555 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-25693122-5349-4e3c-8443-a722dce778c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:16.645692 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5072a675-0b9b-48e1-80b6-a1a0f7d75ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:16.671730 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-5072a675-0b9b-48e1-80b6-a1a0f7d75ac6 None None] MFA Rules not processed for user `ca4b37e3738e45739ea5521edb48f41e`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:16.672944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5072a675-0b9b-48e1-80b6-a1a0f7d75ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:16.716723 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3986/7957] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:41:16.728822 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25693122-5349-4e3c-8443-a722dce778c5 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:16.730195 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-25693122-5349-4e3c-8443-a722dce778c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:16.745181 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3972/7958] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:41:16.755348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5072a675-0b9b-48e1-80b6-a1a0f7d75ac6 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:16.756720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5072a675-0b9b-48e1-80b6-a1a0f7d75ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:16.789779 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25693122-5349-4e3c-8443-a722dce778c5 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:16.793513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84c0a2-0b46-4c75-9de3-1ed956f35c28 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e302b1298dd04d6590e3d079f7b13b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:16.794194 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84c0a2-0b46-4c75-9de3-1ed956f35c28 service glance] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:16.794502 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84c0a2-0b46-4c75-9de3-1ed956f35c28 service glance] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:16.794774 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84c0a2-0b46-4c75-9de3-1ed956f35c28 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:16.803399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae84c0a2-0b46-4c75-9de3-1ed956f35c28 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:16.804855 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae84c0a2-0b46-4c75-9de3-1ed956f35c28 service glance] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:16.813734 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3987/7959] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:41:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:41:16.815289 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5072a675-0b9b-48e1-80b6-a1a0f7d75ac6 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:16.818944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fa621-e5a2-4d4e-b96b-e9c1c2c7fa66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:16.819589 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fa621-e5a2-4d4e-b96b-e9c1c2c7fa66 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:16.819873 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fa621-e5a2-4d4e-b96b-e9c1c2c7fa66 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:16.820153 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fa621-e5a2-4d4e-b96b-e9c1c2c7fa66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:16.828641 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fa621-e5a2-4d4e-b96b-e9c1c2c7fa66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:16.830160 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fa621-e5a2-4d4e-b96b-e9c1c2c7fa66 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:16.839796 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3973/7960] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:41:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:41:17.057183 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae41527-69f7-47d8-981f-adf6ca789a92 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:17.057694 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae41527-69f7-47d8-981f-adf6ca789a92 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:17.057817 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae41527-69f7-47d8-981f-adf6ca789a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:17.086254 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-eae41527-69f7-47d8-981f-adf6ca789a92 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:17.087373 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-eae41527-69f7-47d8-981f-adf6ca789a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:17.140745 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3988/7961] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:41:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:41:17.278387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fa621-e5a2-4d4e-b96b-e9c1c2c7fa66 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:17.280206 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a92fa621-e5a2-4d4e-b96b-e9c1c2c7fa66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:17.359800 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fa621-e5a2-4d4e-b96b-e9c1c2c7fa66 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:17.364717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9678e-5ea8-41ad-9e96-3d4e831a6b0a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:17.365391 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9678e-5ea8-41ad-9e96-3d4e831a6b0a service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:17.365677 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9678e-5ea8-41ad-9e96-3d4e831a6b0a service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:17.365996 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9678e-5ea8-41ad-9e96-3d4e831a6b0a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:17.373957 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9678e-5ea8-41ad-9e96-3d4e831a6b0a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:17.375558 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9678e-5ea8-41ad-9e96-3d4e831a6b0a service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:17.384039 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3974/7962] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:41:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:41:18.036889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc91469-1e8d-4a78-a0f4-86ec8290bb1b None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:18.037732 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc91469-1e8d-4a78-a0f4-86ec8290bb1b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:18.038025 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc91469-1e8d-4a78-a0f4-86ec8290bb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:18.056257 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-efc91469-1e8d-4a78-a0f4-86ec8290bb1b None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:18.057478 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-efc91469-1e8d-4a78-a0f4-86ec8290bb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:18.065649 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3989/7963] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:41:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:41:18.077889 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9678e-5ea8-41ad-9e96-3d4e831a6b0a service swift] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:18.091408 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9678e-5ea8-41ad-9e96-3d4e831a6b0a service swift] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:18.096536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f728e-1c67-4df8-b9e6-8b7dcec24170 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:18.097184 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f728e-1c67-4df8-b9e6-8b7dcec24170 service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:18.097461 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f728e-1c67-4df8-b9e6-8b7dcec24170 service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:18.097934 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f728e-1c67-4df8-b9e6-8b7dcec24170 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:18.107615 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f728e-1c67-4df8-b9e6-8b7dcec24170 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:18.109226 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f728e-1c67-4df8-b9e6-8b7dcec24170 service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:18.118419 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3975/7964] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:41:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:41:19.035705 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67401fe4-1d07-4977-a687-e83ec6857895 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:19.035705 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67401fe4-1d07-4977-a687-e83ec6857895 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:19.035705 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67401fe4-1d07-4977-a687-e83ec6857895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:19.051385 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-67401fe4-1d07-4977-a687-e83ec6857895 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:19.052617 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-67401fe4-1d07-4977-a687-e83ec6857895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:19.060168 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3990/7965] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:41:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:41:19.073924 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f728e-1c67-4df8-b9e6-8b7dcec24170 service swift] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:19.088504 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f728e-1c67-4df8-b9e6-8b7dcec24170 service swift] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:19.093881 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6471373-0940-4f85-8971-4d0ae7277cf9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:19.094533 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6471373-0940-4f85-8971-4d0ae7277cf9 service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:19.094821 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6471373-0940-4f85-8971-4d0ae7277cf9 service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:19.095102 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6471373-0940-4f85-8971-4d0ae7277cf9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:19.104611 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6471373-0940-4f85-8971-4d0ae7277cf9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:19.106260 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6471373-0940-4f85-8971-4d0ae7277cf9 service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:19.119726 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3976/7966] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:41:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:41:19.629595 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a054a50-5391-4768-a623-05821e78c3fe None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:19.629925 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a054a50-5391-4768-a623-05821e78c3fe None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:19.630211 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a054a50-5391-4768-a623-05821e78c3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:19.648473 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-1a054a50-5391-4768-a623-05821e78c3fe None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:19.650015 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1a054a50-5391-4768-a623-05821e78c3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:19.659332 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3991/7967] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:41:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:41:19.672460 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6471373-0940-4f85-8971-4d0ae7277cf9 service swift] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:19.690016 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6471373-0940-4f85-8971-4d0ae7277cf9 service swift] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:19.697977 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed103a87-dc8e-49ba-80df-41475b5e6e26 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:19.698743 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed103a87-dc8e-49ba-80df-41475b5e6e26 service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:19.699818 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed103a87-dc8e-49ba-80df-41475b5e6e26 service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:19.700170 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed103a87-dc8e-49ba-80df-41475b5e6e26 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:19.712940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed103a87-dc8e-49ba-80df-41475b5e6e26 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:19.715044 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed103a87-dc8e-49ba-80df-41475b5e6e26 service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:19.724210 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3977/7968] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:41:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:41:20.357685 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6041d8-cd44-41d5-9fd4-98669f0462af None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:20.358262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6041d8-cd44-41d5-9fd4-98669f0462af None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:20.358262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6041d8-cd44-41d5-9fd4-98669f0462af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:20.397543 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-ba6041d8-cd44-41d5-9fd4-98669f0462af None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:20.398832 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ba6041d8-cd44-41d5-9fd4-98669f0462af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:20.406656 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3992/7969] 10.222.0.23 () {58 vars in 967 bytes} [Sat Apr 30 21:41:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:41:20.426237 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed103a87-dc8e-49ba-80df-41475b5e6e26 service swift] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:20.440250 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed103a87-dc8e-49ba-80df-41475b5e6e26 service swift] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:20.447202 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d7287-44a1-42c5-ac3b-23575408e29f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:20.448051 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d7287-44a1-42c5-ac3b-23575408e29f service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:20.448584 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d7287-44a1-42c5-ac3b-23575408e29f service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:20.449225 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d7287-44a1-42c5-ac3b-23575408e29f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:20.458573 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d7287-44a1-42c5-ac3b-23575408e29f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:20.461151 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d7287-44a1-42c5-ac3b-23575408e29f service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:20.470111 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3978/7970] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:41:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:41:21.002625 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342edb23-af48-4234-9875-d8f5d49c561a None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:21.002918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342edb23-af48-4234-9875-d8f5d49c561a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:21.003201 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342edb23-af48-4234-9875-d8f5d49c561a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:21.021298 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-342edb23-af48-4234-9875-d8f5d49c561a None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:21.022491 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-342edb23-af48-4234-9875-d8f5d49c561a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:21.030812 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3993/7971] 10.222.0.23 () {58 vars in 967 bytes} [Sat Apr 30 21:41:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:41:21.045228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d7287-44a1-42c5-ac3b-23575408e29f service swift] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:21.062030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d7287-44a1-42c5-ac3b-23575408e29f service swift] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:21.064231 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3e320-aa5b-47b8-957d-35f94c5bcee9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:21.064953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3e320-aa5b-47b8-957d-35f94c5bcee9 service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:21.065313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3e320-aa5b-47b8-957d-35f94c5bcee9 service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:21.065661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3e320-aa5b-47b8-957d-35f94c5bcee9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:21.074566 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b3e320-aa5b-47b8-957d-35f94c5bcee9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:21.076156 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b3e320-aa5b-47b8-957d-35f94c5bcee9 service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:21.084800 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3979/7972] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:41:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:41:21.583180 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342edb23-af48-4234-9875-d8f5d49c561a None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:21.653175 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342edb23-af48-4234-9875-d8f5d49c561a None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:21.657853 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350bb09-656b-4345-8a9d-2f0acdbec3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:21.658750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350bb09-656b-4345-8a9d-2f0acdbec3f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:21.659033 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350bb09-656b-4345-8a9d-2f0acdbec3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:21.659495 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350bb09-656b-4345-8a9d-2f0acdbec3f6 admin admin] PATH_INFO: `/v3/users/aee3661c828f4c75b48da4f658ae9b6f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:21.660734 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350bb09-656b-4345-8a9d-2f0acdbec3f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aee3661c828f4c75b48da4f658ae9b6f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:21.663283 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350bb09-656b-4345-8a9d-2f0acdbec3f6 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:21.868641 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c350bb09-656b-4345-8a9d-2f0acdbec3f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aee3661c828f4c75b48da4f658ae9b6f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:21.883304 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c350bb09-656b-4345-8a9d-2f0acdbec3f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aee3661c828f4c75b48da4f658ae9b6f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:21.960618 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c350bb09-656b-4345-8a9d-2f0acdbec3f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aee3661c828f4c75b48da4f658ae9b6f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:21.968270 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c350bb09-656b-4345-8a9d-2f0acdbec3f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aee3661c828f4c75b48da4f658ae9b6f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:21.968973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-c350bb09-656b-4345-8a9d-2f0acdbec3f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aee3661c828f4c75b48da4f658ae9b6f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:21.975704 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3994/7973] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:41:21 2022] DELETE /identity/v3/users/aee3661c828f4c75b48da4f658ae9b6f => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:41:21.980321 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca2fbf-56ca-4d81-8b1b-f48f7b94ff53 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:21.980788 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca2fbf-56ca-4d81-8b1b-f48f7b94ff53 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:21.980877 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca2fbf-56ca-4d81-8b1b-f48f7b94ff53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:22.000961 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-58ca2fbf-56ca-4d81-8b1b-f48f7b94ff53 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:22.002287 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-58ca2fbf-56ca-4d81-8b1b-f48f7b94ff53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:22.098314 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3980/7974] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:41:22.109202 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350bb09-656b-4345-8a9d-2f0acdbec3f6 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:22.112261 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c350bb09-656b-4345-8a9d-2f0acdbec3f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:22.199117 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350bb09-656b-4345-8a9d-2f0acdbec3f6 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:22.203926 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc741a-61a2-410b-a456-8cea8c5e5fdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:22.204644 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc741a-61a2-410b-a456-8cea8c5e5fdd service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:22.204970 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc741a-61a2-410b-a456-8cea8c5e5fdd service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:22.205252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc741a-61a2-410b-a456-8cea8c5e5fdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:22.218821 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc741a-61a2-410b-a456-8cea8c5e5fdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:22.220418 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc741a-61a2-410b-a456-8cea8c5e5fdd service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:22.235523 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3995/7975] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:41:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:41:22.790034 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca2fbf-56ca-4d81-8b1b-f48f7b94ff53 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:22.791594 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-58ca2fbf-56ca-4d81-8b1b-f48f7b94ff53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:22.812974 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca2fbf-56ca-4d81-8b1b-f48f7b94ff53 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:22.818997 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b4ca2-1814-40fc-8333-d31665774199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:22.820152 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b4ca2-1814-40fc-8333-d31665774199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:22.820630 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b4ca2-1814-40fc-8333-d31665774199 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:22.821084 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b4ca2-1814-40fc-8333-d31665774199 admin admin] PATH_INFO: `/v3/projects/e3bd8388c3054a518df465db152bde67` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:22.822626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b4ca2-1814-40fc-8333-d31665774199 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3bd8388c3054a518df465db152bde67)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:22.824788 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b4ca2-1814-40fc-8333-d31665774199 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:23.016477 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ba6b4ca2-1814-40fc-8333-d31665774199 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3bd8388c3054a518df465db152bde67', 'request_id': 'req-ba6b4ca2-1814-40fc-8333-d31665774199'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:23.043745 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ba6b4ca2-1814-40fc-8333-d31665774199 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3bd8388c3054a518df465db152bde67', 'request_id': 'req-ba6b4ca2-1814-40fc-8333-d31665774199'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:23.059559 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ba6b4ca2-1814-40fc-8333-d31665774199 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3bd8388c3054a518df465db152bde67', 'request_id': 'req-ba6b4ca2-1814-40fc-8333-d31665774199'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:23.189485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ba6b4ca2-1814-40fc-8333-d31665774199 admin admin] The token cache is being invalidate because project e3bd8388c3054a518df465db152bde67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:41:23.193941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ba6b4ca2-1814-40fc-8333-d31665774199 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:23.193941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ba6b4ca2-1814-40fc-8333-d31665774199 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:23.196561 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3981/7976] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:41:22 2022] DELETE /identity/v3/projects/e3bd8388c3054a518df465db152bde67 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:41:23.201620 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99465d-ce3c-46ce-94cf-7966472a5fed None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:23.202249 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99465d-ce3c-46ce-94cf-7966472a5fed None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:23.202249 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99465d-ce3c-46ce-94cf-7966472a5fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:23.238997 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-0a99465d-ce3c-46ce-94cf-7966472a5fed None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:23.240664 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0a99465d-ce3c-46ce-94cf-7966472a5fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:23.340708 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3996/7977] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:41:23.350155 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086258c6-1f39-4616-840d-f38d1f4005c5 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:23.350758 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086258c6-1f39-4616-840d-f38d1f4005c5 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:23.351263 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086258c6-1f39-4616-840d-f38d1f4005c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:23.369643 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-086258c6-1f39-4616-840d-f38d1f4005c5 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:23.370948 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-086258c6-1f39-4616-840d-f38d1f4005c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:23.379300 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3982/7978] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:41:23.384178 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99465d-ce3c-46ce-94cf-7966472a5fed None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:23.394438 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99465d-ce3c-46ce-94cf-7966472a5fed None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:23.400177 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e599c-8d74-4878-82bf-b3d7733ff537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:23.400849 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e599c-8d74-4878-82bf-b3d7733ff537 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:23.401133 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e599c-8d74-4878-82bf-b3d7733ff537 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:23.401414 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e599c-8d74-4878-82bf-b3d7733ff537 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:23.402193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e599c-8d74-4878-82bf-b3d7733ff537 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:41:23.402504 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e599c-8d74-4878-82bf-b3d7733ff537 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:23.404408 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e599c-8d74-4878-82bf-b3d7733ff537 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:23.426998 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3997/7979] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:41:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:41:23.434133 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086258c6-1f39-4616-840d-f38d1f4005c5 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:23.454448 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086258c6-1f39-4616-840d-f38d1f4005c5 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:23.462249 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64e990-52c5-46ca-8b50-0a983c57a0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:23.463646 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64e990-52c5-46ca-8b50-0a983c57a0f6 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:23.463646 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64e990-52c5-46ca-8b50-0a983c57a0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:23.465281 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64e990-52c5-46ca-8b50-0a983c57a0f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:23.466547 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64e990-52c5-46ca-8b50-0a983c57a0f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:23.470300 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64e990-52c5-46ca-8b50-0a983c57a0f6 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:23.600361 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3983/7980] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:41:23 2022] POST /identity/v3/projects => generated 373 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:41:23.602223 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e599c-8d74-4878-82bf-b3d7733ff537 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:23.616720 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e599c-8d74-4878-82bf-b3d7733ff537 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:23.711018 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453d3b7-2fa8-4047-a7fc-11163229e71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:23.711564 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453d3b7-2fa8-4047-a7fc-11163229e71c admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:23.711853 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453d3b7-2fa8-4047-a7fc-11163229e71c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:23.712130 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453d3b7-2fa8-4047-a7fc-11163229e71c admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:23.712834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453d3b7-2fa8-4047-a7fc-11163229e71c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:23.714883 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453d3b7-2fa8-4047-a7fc-11163229e71c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:23.797323 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3998/7981] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:41:23 2022] POST /identity/v3/users => generated 287 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:41:23.804533 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64e990-52c5-46ca-8b50-0a983c57a0f6 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:23.815133 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64e990-52c5-46ca-8b50-0a983c57a0f6 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:23.822570 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e4e09-ff7d-4130-8d7f-c2124f0df924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:23.823593 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e4e09-ff7d-4130-8d7f-c2124f0df924 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:23.824045 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e4e09-ff7d-4130-8d7f-c2124f0df924 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:23.824518 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e4e09-ff7d-4130-8d7f-c2124f0df924 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:23.825461 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1e4e09-ff7d-4130-8d7f-c2124f0df924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:23.827840 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1e4e09-ff7d-4130-8d7f-c2124f0df924 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:23.843912 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3984/7982] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:41:23.847782 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453d3b7-2fa8-4047-a7fc-11163229e71c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:23.860089 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453d3b7-2fa8-4047-a7fc-11163229e71c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:23.867863 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cedbd83-eb7d-4dc5-befc-a38d7d8ff65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:23.869663 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cedbd83-eb7d-4dc5-befc-a38d7d8ff65a admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:23.869983 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cedbd83-eb7d-4dc5-befc-a38d7d8ff65a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:23.870262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cedbd83-eb7d-4dc5-befc-a38d7d8ff65a admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:23.870998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cedbd83-eb7d-4dc5-befc-a38d7d8ff65a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:23.873289 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cedbd83-eb7d-4dc5-befc-a38d7d8ff65a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:23.890608 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 3999/7983] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:41:23.894504 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e4e09-ff7d-4130-8d7f-c2124f0df924 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:23.910138 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1e4e09-ff7d-4130-8d7f-c2124f0df924 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:23.918466 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b80da-f8b0-49bf-b1b4-79d110249559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:23.920171 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b80da-f8b0-49bf-b1b4-79d110249559 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:23.920698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b80da-f8b0-49bf-b1b4-79d110249559 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:23.921194 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b80da-f8b0-49bf-b1b4-79d110249559 admin admin] PATH_INFO: `/v3/projects/2c43d84b07b546d8a3a28e428ee1c66d/users/db5ade7b84a34b8993d51c69d9b92e22/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:23.940455 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b80da-f8b0-49bf-b1b4-79d110249559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c43d84b07b546d8a3a28e428ee1c66d, user_id=db5ade7b84a34b8993d51c69d9b92e22, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:23.944661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b80da-f8b0-49bf-b1b4-79d110249559 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:24.030015 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3985/7984] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:41:23 2022] PUT /identity/v3/projects/2c43d84b07b546d8a3a28e428ee1c66d/users/db5ade7b84a34b8993d51c69d9b92e22/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:41:24.043476 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b984b5-1346-46bd-aef3-77ff523d1bdd None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:24.043769 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b984b5-1346-46bd-aef3-77ff523d1bdd None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:24.044060 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b984b5-1346-46bd-aef3-77ff523d1bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:24.092426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-f2b984b5-1346-46bd-aef3-77ff523d1bdd None None] MFA Rules not processed for user `db5ade7b84a34b8993d51c69d9b92e22`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:24.093798 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f2b984b5-1346-46bd-aef3-77ff523d1bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:24.206862 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4000/7985] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:41:24.219268 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b80da-f8b0-49bf-b1b4-79d110249559 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:24.221226 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-9f2b80da-f8b0-49bf-b1b4-79d110249559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:24.338032 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b80da-f8b0-49bf-b1b4-79d110249559 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:24.353474 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eaeca2-8503-4a69-91c9-d6d54ddf7c12 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e302b1298dd04d6590e3d079f7b13b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:24.354694 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eaeca2-8503-4a69-91c9-d6d54ddf7c12 service glance] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:24.355270 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eaeca2-8503-4a69-91c9-d6d54ddf7c12 service glance] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:24.355702 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eaeca2-8503-4a69-91c9-d6d54ddf7c12 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:24.376503 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eaeca2-8503-4a69-91c9-d6d54ddf7c12 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:24.380699 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eaeca2-8503-4a69-91c9-d6d54ddf7c12 service glance] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:24.392332 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3986/7986] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:41:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:41:24.539877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b984b5-1346-46bd-aef3-77ff523d1bdd None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:24.684601 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b984b5-1346-46bd-aef3-77ff523d1bdd None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:24.689870 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d19d7b-5223-4c28-bf20-284a258485c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:24.691208 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d19d7b-5223-4c28-bf20-284a258485c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:24.691655 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d19d7b-5223-4c28-bf20-284a258485c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:24.692011 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d19d7b-5223-4c28-bf20-284a258485c7 admin admin] PATH_INFO: `/v3/users/db5ade7b84a34b8993d51c69d9b92e22` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:24.694068 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d19d7b-5223-4c28-bf20-284a258485c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db5ade7b84a34b8993d51c69d9b92e22)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:24.696820 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d19d7b-5223-4c28-bf20-284a258485c7 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:24.889586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-17d19d7b-5223-4c28-bf20-284a258485c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db5ade7b84a34b8993d51c69d9b92e22'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:24.903988 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-17d19d7b-5223-4c28-bf20-284a258485c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db5ade7b84a34b8993d51c69d9b92e22'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:24.970396 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-17d19d7b-5223-4c28-bf20-284a258485c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db5ade7b84a34b8993d51c69d9b92e22'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:24.979065 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-17d19d7b-5223-4c28-bf20-284a258485c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db5ade7b84a34b8993d51c69d9b92e22'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:24.979745 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-17d19d7b-5223-4c28-bf20-284a258485c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db5ade7b84a34b8993d51c69d9b92e22'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:24.990168 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4001/7987] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:41:24 2022] DELETE /identity/v3/users/db5ade7b84a34b8993d51c69d9b92e22 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:41:24.993914 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456c5e0-67a3-49d8-8962-b4b82815b7a0 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:24.994315 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456c5e0-67a3-49d8-8962-b4b82815b7a0 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:24.995301 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456c5e0-67a3-49d8-8962-b4b82815b7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:25.016375 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-9456c5e0-67a3-49d8-8962-b4b82815b7a0 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:25.017823 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-9456c5e0-67a3-49d8-8962-b4b82815b7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:25.092766 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3987/7988] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:41:25.103003 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d19d7b-5223-4c28-bf20-284a258485c7 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:25.104594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-17d19d7b-5223-4c28-bf20-284a258485c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:25.165670 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d19d7b-5223-4c28-bf20-284a258485c7 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:25.169479 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e19e5f-024b-42ec-95d8-563eb4044d1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:25.170160 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e19e5f-024b-42ec-95d8-563eb4044d1e service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:25.170438 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e19e5f-024b-42ec-95d8-563eb4044d1e service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:25.170799 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e19e5f-024b-42ec-95d8-563eb4044d1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:25.181121 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e19e5f-024b-42ec-95d8-563eb4044d1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:25.183386 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e19e5f-024b-42ec-95d8-563eb4044d1e service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:25.192683 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4002/7989] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:41:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:41:25.644940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456c5e0-67a3-49d8-8962-b4b82815b7a0 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:25.646774 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-9456c5e0-67a3-49d8-8962-b4b82815b7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:25.666015 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456c5e0-67a3-49d8-8962-b4b82815b7a0 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:25.675986 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ba5a3-15f7-46b3-a97d-2b8ac967afca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:25.675986 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ba5a3-15f7-46b3-a97d-2b8ac967afca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:25.675986 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ba5a3-15f7-46b3-a97d-2b8ac967afca admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:25.675986 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ba5a3-15f7-46b3-a97d-2b8ac967afca admin admin] PATH_INFO: `/v3/projects/2c43d84b07b546d8a3a28e428ee1c66d` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:25.676320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ba5a3-15f7-46b3-a97d-2b8ac967afca admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c43d84b07b546d8a3a28e428ee1c66d)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:25.678504 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ba5a3-15f7-46b3-a97d-2b8ac967afca admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:25.779621 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-882ba5a3-15f7-46b3-a97d-2b8ac967afca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c43d84b07b546d8a3a28e428ee1c66d', 'request_id': 'req-882ba5a3-15f7-46b3-a97d-2b8ac967afca'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:25.785386 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-882ba5a3-15f7-46b3-a97d-2b8ac967afca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c43d84b07b546d8a3a28e428ee1c66d', 'request_id': 'req-882ba5a3-15f7-46b3-a97d-2b8ac967afca'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:25.792638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-882ba5a3-15f7-46b3-a97d-2b8ac967afca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c43d84b07b546d8a3a28e428ee1c66d', 'request_id': 'req-882ba5a3-15f7-46b3-a97d-2b8ac967afca'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:25.878871 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-882ba5a3-15f7-46b3-a97d-2b8ac967afca admin admin] The token cache is being invalidate because project 2c43d84b07b546d8a3a28e428ee1c66d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:41:25.879261 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-882ba5a3-15f7-46b3-a97d-2b8ac967afca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:25.879842 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-882ba5a3-15f7-46b3-a97d-2b8ac967afca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:25.881552 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3988/7990] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:41:25 2022] DELETE /identity/v3/projects/2c43d84b07b546d8a3a28e428ee1c66d => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:41:25.886882 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdef37b-8eca-4798-a47e-b7fce2601656 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:25.887414 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdef37b-8eca-4798-a47e-b7fce2601656 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:25.887515 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdef37b-8eca-4798-a47e-b7fce2601656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:25.906056 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-5bdef37b-8eca-4798-a47e-b7fce2601656 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:25.907288 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5bdef37b-8eca-4798-a47e-b7fce2601656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:25.984527 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4003/7991] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:41:25.992096 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3eac97-a7a7-40d3-a36d-2a551bc4da59 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:25.992572 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3eac97-a7a7-40d3-a36d-2a551bc4da59 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:25.993093 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3eac97-a7a7-40d3-a36d-2a551bc4da59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:26.014073 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-3d3eac97-a7a7-40d3-a36d-2a551bc4da59 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:26.015581 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3d3eac97-a7a7-40d3-a36d-2a551bc4da59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:26.024826 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3989/7992] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:41:26.029371 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdef37b-8eca-4798-a47e-b7fce2601656 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:26.040244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdef37b-8eca-4798-a47e-b7fce2601656 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:26.045370 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e0ae34-f62e-4506-a0b4-73c53848ba61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:26.046098 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0ae34-f62e-4506-a0b4-73c53848ba61 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:26.046386 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0ae34-f62e-4506-a0b4-73c53848ba61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:26.046668 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0ae34-f62e-4506-a0b4-73c53848ba61 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:26.047396 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e0ae34-f62e-4506-a0b4-73c53848ba61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:41:26.047707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e0ae34-f62e-4506-a0b4-73c53848ba61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:26.049511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e0ae34-f62e-4506-a0b4-73c53848ba61 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:26.061669 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4004/7993] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:41:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:41:26.067228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3eac97-a7a7-40d3-a36d-2a551bc4da59 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:26.076748 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3eac97-a7a7-40d3-a36d-2a551bc4da59 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:26.085205 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf67b5-f91e-49c9-8398-02a26d1bad47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:26.086294 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf67b5-f91e-49c9-8398-02a26d1bad47 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:26.086673 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf67b5-f91e-49c9-8398-02a26d1bad47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:26.087153 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf67b5-f91e-49c9-8398-02a26d1bad47 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:26.087938 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf67b5-f91e-49c9-8398-02a26d1bad47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:26.089991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf67b5-f91e-49c9-8398-02a26d1bad47 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:26.207136 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3990/7994] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:41:26 2022] POST /identity/v3/projects => generated 407 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:41:26.208292 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e0ae34-f62e-4506-a0b4-73c53848ba61 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:26.218809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e0ae34-f62e-4506-a0b4-73c53848ba61 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:26.276914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b94cf-1df8-48ac-b1f5-f4abac1dfb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:26.276914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b94cf-1df8-48ac-b1f5-f4abac1dfb52 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:26.276914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b94cf-1df8-48ac-b1f5-f4abac1dfb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:26.276914 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b94cf-1df8-48ac-b1f5-f4abac1dfb52 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:26.277403 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b94cf-1df8-48ac-b1f5-f4abac1dfb52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:26.279034 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b94cf-1df8-48ac-b1f5-f4abac1dfb52 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:26.372032 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4005/7995] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:41:26 2022] POST /identity/v3/users => generated 304 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:41:26.376192 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf67b5-f91e-49c9-8398-02a26d1bad47 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:26.390109 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf67b5-f91e-49c9-8398-02a26d1bad47 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:26.392282 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0ba91-9b71-4f72-89e3-0fc5832175fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:26.392947 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0ba91-9b71-4f72-89e3-0fc5832175fc admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:26.393230 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0ba91-9b71-4f72-89e3-0fc5832175fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:26.393507 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0ba91-9b71-4f72-89e3-0fc5832175fc admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:26.394264 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d0ba91-9b71-4f72-89e3-0fc5832175fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:26.395881 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d0ba91-9b71-4f72-89e3-0fc5832175fc admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:26.410665 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3991/7996] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:41:26.412159 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b94cf-1df8-48ac-b1f5-f4abac1dfb52 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:26.422511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b94cf-1df8-48ac-b1f5-f4abac1dfb52 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:26.427324 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71b80e-c078-47f7-8a8c-cd1e2b104d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:26.428097 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71b80e-c078-47f7-8a8c-cd1e2b104d96 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:26.428385 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71b80e-c078-47f7-8a8c-cd1e2b104d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:26.428663 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71b80e-c078-47f7-8a8c-cd1e2b104d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:26.429387 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71b80e-c078-47f7-8a8c-cd1e2b104d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:26.431014 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71b80e-c078-47f7-8a8c-cd1e2b104d96 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:26.441818 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4006/7997] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:41:26.446787 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0ba91-9b71-4f72-89e3-0fc5832175fc admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:26.456868 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0ba91-9b71-4f72-89e3-0fc5832175fc admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:26.462217 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f1299-07f5-4811-bc5e-3927b707a8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:26.463175 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f1299-07f5-4811-bc5e-3927b707a8dd admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:26.463456 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f1299-07f5-4811-bc5e-3927b707a8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:26.463800 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f1299-07f5-4811-bc5e-3927b707a8dd admin admin] PATH_INFO: `/v3/projects/7f078b331ba346bfa0c88fb953e9b6fb/users/fae728ee459946f28834ca6946a406da/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:26.479609 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f1299-07f5-4811-bc5e-3927b707a8dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f078b331ba346bfa0c88fb953e9b6fb, user_id=fae728ee459946f28834ca6946a406da, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:26.482878 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34f1299-07f5-4811-bc5e-3927b707a8dd admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:26.564564 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3992/7998] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:41:26 2022] PUT /identity/v3/projects/7f078b331ba346bfa0c88fb953e9b6fb/users/fae728ee459946f28834ca6946a406da/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:41:26.653090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068224c-ffca-4f8d-a086-f57baad529dc None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:26.653404 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068224c-ffca-4f8d-a086-f57baad529dc None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:26.653671 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068224c-ffca-4f8d-a086-f57baad529dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:26.682857 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-5068224c-ffca-4f8d-a086-f57baad529dc None None] MFA Rules not processed for user `fae728ee459946f28834ca6946a406da`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:26.684230 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5068224c-ffca-4f8d-a086-f57baad529dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:26.756551 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4007/7999] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:26 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:41:26.761037 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f1299-07f5-4811-bc5e-3927b707a8dd admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:26.834987 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f1299-07f5-4811-bc5e-3927b707a8dd admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:26.840366 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2c3c2-386d-4cd9-9074-0cec89d0f4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:26.841032 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2c3c2-386d-4cd9-9074-0cec89d0f4cd admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:26.841318 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2c3c2-386d-4cd9-9074-0cec89d0f4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:26.841600 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2c3c2-386d-4cd9-9074-0cec89d0f4cd admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:26.842340 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2c3c2-386d-4cd9-9074-0cec89d0f4cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:26.844270 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2c3c2-386d-4cd9-9074-0cec89d0f4cd admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:26.939395 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3993/8000] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:41:26 2022] POST /identity/v3/projects => generated 407 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:41:26.943274 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068224c-ffca-4f8d-a086-f57baad529dc None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:26.954807 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068224c-ffca-4f8d-a086-f57baad529dc None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:27.014201 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df611cd7-dfd2-4b1c-9d05-cf188aaaf505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:27.014787 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df611cd7-dfd2-4b1c-9d05-cf188aaaf505 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:27.015067 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df611cd7-dfd2-4b1c-9d05-cf188aaaf505 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:27.015392 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df611cd7-dfd2-4b1c-9d05-cf188aaaf505 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:27.016089 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df611cd7-dfd2-4b1c-9d05-cf188aaaf505 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:27.018046 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df611cd7-dfd2-4b1c-9d05-cf188aaaf505 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:27.113657 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4008/8001] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:41:26 2022] POST /identity/v3/users => generated 310 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:41:27.118068 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2c3c2-386d-4cd9-9074-0cec89d0f4cd admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:27.128261 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2c3c2-386d-4cd9-9074-0cec89d0f4cd admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:27.132826 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7705c-ed38-4e08-9d9e-282fde78a1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:27.133477 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7705c-ed38-4e08-9d9e-282fde78a1ed admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:27.133772 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7705c-ed38-4e08-9d9e-282fde78a1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:27.134069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7705c-ed38-4e08-9d9e-282fde78a1ed admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:27.134782 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7705c-ed38-4e08-9d9e-282fde78a1ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:27.136700 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7705c-ed38-4e08-9d9e-282fde78a1ed admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:27.147456 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3994/8002] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:41:27.151878 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df611cd7-dfd2-4b1c-9d05-cf188aaaf505 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:27.161952 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df611cd7-dfd2-4b1c-9d05-cf188aaaf505 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:27.167223 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8750b86-0464-4f7a-a740-b0ec8402dfab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:27.168105 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8750b86-0464-4f7a-a740-b0ec8402dfab admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:27.168434 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8750b86-0464-4f7a-a740-b0ec8402dfab admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:27.168705 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8750b86-0464-4f7a-a740-b0ec8402dfab admin admin] PATH_INFO: `/v3/projects/7ee0f84e47bf4a7180f37d7d37fca51e/users/006c31ef5ecc48d68c1daed1301f4eef/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:27.183949 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8750b86-0464-4f7a-a740-b0ec8402dfab admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ee0f84e47bf4a7180f37d7d37fca51e, user_id=006c31ef5ecc48d68c1daed1301f4eef, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:27.186911 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8750b86-0464-4f7a-a740-b0ec8402dfab admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:27.263567 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4009/8003] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:41:27 2022] PUT /identity/v3/projects/7ee0f84e47bf4a7180f37d7d37fca51e/users/006c31ef5ecc48d68c1daed1301f4eef/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:41:27.267558 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7705c-ed38-4e08-9d9e-282fde78a1ed admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:27.278919 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7705c-ed38-4e08-9d9e-282fde78a1ed admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:27.335391 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e706a-a682-4c7e-a91a-1d62182730fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:27.336148 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e706a-a682-4c7e-a91a-1d62182730fa admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:27.336380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e706a-a682-4c7e-a91a-1d62182730fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:27.336687 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e706a-a682-4c7e-a91a-1d62182730fa admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:27.337432 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e706a-a682-4c7e-a91a-1d62182730fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:27.339157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e706a-a682-4c7e-a91a-1d62182730fa admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:27.348927 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3995/8004] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:41:27.353239 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8750b86-0464-4f7a-a740-b0ec8402dfab admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:27.363511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8750b86-0464-4f7a-a740-b0ec8402dfab admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:27.370657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdc3d0e-b3fd-4c8f-a157-bd1aaf92327d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:27.370657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc3d0e-b3fd-4c8f-a157-bd1aaf92327d admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:27.370657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc3d0e-b3fd-4c8f-a157-bd1aaf92327d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:27.370657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc3d0e-b3fd-4c8f-a157-bd1aaf92327d admin admin] PATH_INFO: `/v3/projects/7ee0f84e47bf4a7180f37d7d37fca51e/users/006c31ef5ecc48d68c1daed1301f4eef/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:27.372032 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdc3d0e-b3fd-4c8f-a157-bd1aaf92327d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ee0f84e47bf4a7180f37d7d37fca51e, user_id=006c31ef5ecc48d68c1daed1301f4eef, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:27.374686 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdc3d0e-b3fd-4c8f-a157-bd1aaf92327d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:27.385465 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4010/8005] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:41:27 2022] PUT /identity/v3/projects/7ee0f84e47bf4a7180f37d7d37fca51e/users/006c31ef5ecc48d68c1daed1301f4eef/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:41:27.402281 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e181f5f-d8ad-4ac4-9293-96fc476a9429 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:27.402817 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e181f5f-d8ad-4ac4-9293-96fc476a9429 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:27.403395 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e181f5f-d8ad-4ac4-9293-96fc476a9429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:27.433341 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-1e181f5f-d8ad-4ac4-9293-96fc476a9429 None None] MFA Rules not processed for user `006c31ef5ecc48d68c1daed1301f4eef`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:27.436590 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1e181f5f-d8ad-4ac4-9293-96fc476a9429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:27.510385 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3996/8006] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:27 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:41:27.522007 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdc3d0e-b3fd-4c8f-a157-bd1aaf92327d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:27.523747 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4bdc3d0e-b3fd-4c8f-a157-bd1aaf92327d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:27.586992 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdc3d0e-b3fd-4c8f-a157-bd1aaf92327d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:27.591833 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d2d22-3b47-43ea-9356-14b5ce3570b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:27.592501 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d2d22-3b47-43ea-9356-14b5ce3570b2 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:27.592791 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d2d22-3b47-43ea-9356-14b5ce3570b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:27.593161 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d2d22-3b47-43ea-9356-14b5ce3570b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:27.655809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d2d22-3b47-43ea-9356-14b5ce3570b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:27.657384 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d2d22-3b47-43ea-9356-14b5ce3570b2 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:27.667928 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4011/8007] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:41:27 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:41:28.887952 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e181f5f-d8ad-4ac4-9293-96fc476a9429 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:28.890150 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1e181f5f-d8ad-4ac4-9293-96fc476a9429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:28.981185 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e181f5f-d8ad-4ac4-9293-96fc476a9429 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:28.987715 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949019c8-5809-4a80-b3d9-20d7c2ac7e32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:28.988548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949019c8-5809-4a80-b3d9-20d7c2ac7e32 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:28.988947 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949019c8-5809-4a80-b3d9-20d7c2ac7e32 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:28.989329 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949019c8-5809-4a80-b3d9-20d7c2ac7e32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:28.998995 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949019c8-5809-4a80-b3d9-20d7c2ac7e32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:29.000846 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949019c8-5809-4a80-b3d9-20d7c2ac7e32 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:29.012216 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3997/8008] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:41:28 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:41:36.172054 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d2d22-3b47-43ea-9356-14b5ce3570b2 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:36.238005 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d2d22-3b47-43ea-9356-14b5ce3570b2 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:36.243836 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06edefed-abba-4d60-b9ec-639553f520f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:36.244860 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edefed-abba-4d60-b9ec-639553f520f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:36.245143 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edefed-abba-4d60-b9ec-639553f520f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:36.245420 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edefed-abba-4d60-b9ec-639553f520f4 admin admin] PATH_INFO: `/v3/users/fae728ee459946f28834ca6946a406da` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:36.246653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06edefed-abba-4d60-b9ec-639553f520f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fae728ee459946f28834ca6946a406da)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:36.248742 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06edefed-abba-4d60-b9ec-639553f520f4 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:36.481126 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-06edefed-abba-4d60-b9ec-639553f520f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fae728ee459946f28834ca6946a406da'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:36.493597 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-06edefed-abba-4d60-b9ec-639553f520f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fae728ee459946f28834ca6946a406da'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:36.554175 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949019c8-5809-4a80-b3d9-20d7c2ac7e32 service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:36.555657 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-949019c8-5809-4a80-b3d9-20d7c2ac7e32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:36.569745 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949019c8-5809-4a80-b3d9-20d7c2ac7e32 service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:36.574922 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529680f3-0321-42ee-b20b-f87e6e2f76a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:36.575385 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529680f3-0321-42ee-b20b-f87e6e2f76a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:36.575561 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529680f3-0321-42ee-b20b-f87e6e2f76a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:36.575761 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529680f3-0321-42ee-b20b-f87e6e2f76a9 admin admin] PATH_INFO: `/v3/users/ca4b37e3738e45739ea5521edb48f41e` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:36.577446 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529680f3-0321-42ee-b20b-f87e6e2f76a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca4b37e3738e45739ea5521edb48f41e)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:36.579418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529680f3-0321-42ee-b20b-f87e6e2f76a9 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:36.593170 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-06edefed-abba-4d60-b9ec-639553f520f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fae728ee459946f28834ca6946a406da'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:36.600643 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-06edefed-abba-4d60-b9ec-639553f520f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fae728ee459946f28834ca6946a406da'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:36.601321 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-06edefed-abba-4d60-b9ec-639553f520f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fae728ee459946f28834ca6946a406da'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:36.607337 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4012/8009] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:41:36 2022] DELETE /identity/v3/users/fae728ee459946f28834ca6946a406da => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:41:36.611901 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea52a5-61e4-4ce3-86c5-b2d98fb591b5 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:36.612325 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea52a5-61e4-4ce3-86c5-b2d98fb591b5 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:36.612712 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea52a5-61e4-4ce3-86c5-b2d98fb591b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:36.630475 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-3bea52a5-61e4-4ce3-86c5-b2d98fb591b5 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:36.632414 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3bea52a5-61e4-4ce3-86c5-b2d98fb591b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:36.693002 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4013/8010] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:41:36.702654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea52a5-61e4-4ce3-86c5-b2d98fb591b5 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:36.704075 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3bea52a5-61e4-4ce3-86c5-b2d98fb591b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:36.762450 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea52a5-61e4-4ce3-86c5-b2d98fb591b5 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:36.766348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c111c5-809c-4eca-9eb3-b6672ff65963 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:36.767001 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c111c5-809c-4eca-9eb3-b6672ff65963 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:36.767285 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c111c5-809c-4eca-9eb3-b6672ff65963 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:36.767562 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c111c5-809c-4eca-9eb3-b6672ff65963 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:36.776956 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c111c5-809c-4eca-9eb3-b6672ff65963 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:36.778435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c111c5-809c-4eca-9eb3-b6672ff65963 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:36.783563 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-529680f3-0321-42ee-b20b-f87e6e2f76a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca4b37e3738e45739ea5521edb48f41e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:36.788384 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4014/8011] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:41:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:41:36.801063 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-529680f3-0321-42ee-b20b-f87e6e2f76a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca4b37e3738e45739ea5521edb48f41e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:36.873051 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-529680f3-0321-42ee-b20b-f87e6e2f76a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca4b37e3738e45739ea5521edb48f41e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:36.873687 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-529680f3-0321-42ee-b20b-f87e6e2f76a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca4b37e3738e45739ea5521edb48f41e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:36.881030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-529680f3-0321-42ee-b20b-f87e6e2f76a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca4b37e3738e45739ea5521edb48f41e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:36.887287 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3998/8012] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:41:36 2022] DELETE /identity/v3/users/ca4b37e3738e45739ea5521edb48f41e => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:41:36.891951 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e45a7f-c495-4f3b-acf1-9885c41c63ed None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:36.892243 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e45a7f-c495-4f3b-acf1-9885c41c63ed None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:36.892531 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e45a7f-c495-4f3b-acf1-9885c41c63ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:36.911391 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-59e45a7f-c495-4f3b-acf1-9885c41c63ed None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:36.913129 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-59e45a7f-c495-4f3b-acf1-9885c41c63ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:36.971711 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4015/8013] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:41:36.981978 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529680f3-0321-42ee-b20b-f87e6e2f76a9 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:36.983389 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-529680f3-0321-42ee-b20b-f87e6e2f76a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:37.024675 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e45a7f-c495-4f3b-acf1-9885c41c63ed None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:37.026495 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-59e45a7f-c495-4f3b-acf1-9885c41c63ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:37.040641 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e45a7f-c495-4f3b-acf1-9885c41c63ed None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:37.046075 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce6000-a3b8-40f1-abc6-bbf6d32f7a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:37.046955 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce6000-a3b8-40f1-abc6-bbf6d32f7a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:37.049570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce6000-a3b8-40f1-abc6-bbf6d32f7a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:37.049570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce6000-a3b8-40f1-abc6-bbf6d32f7a51 admin admin] PATH_INFO: `/v3/projects/7f078b331ba346bfa0c88fb953e9b6fb` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:37.049570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce6000-a3b8-40f1-abc6-bbf6d32f7a51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f078b331ba346bfa0c88fb953e9b6fb)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:37.050932 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce6000-a3b8-40f1-abc6-bbf6d32f7a51 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:37.055865 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529680f3-0321-42ee-b20b-f87e6e2f76a9 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:37.067549 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa34dad-9f2d-4de6-bd52-1039306d679d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:37.068291 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa34dad-9f2d-4de6-bd52-1039306d679d service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:37.068658 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa34dad-9f2d-4de6-bd52-1039306d679d service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:37.069000 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa34dad-9f2d-4de6-bd52-1039306d679d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:37.079254 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa34dad-9f2d-4de6-bd52-1039306d679d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:37.080767 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa34dad-9f2d-4de6-bd52-1039306d679d service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:37.091188 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 3999/8014] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:41:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:41:37.155015 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b7ce6000-a3b8-40f1-abc6-bbf6d32f7a51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f078b331ba346bfa0c88fb953e9b6fb', 'request_id': 'req-b7ce6000-a3b8-40f1-abc6-bbf6d32f7a51'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:37.160408 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b7ce6000-a3b8-40f1-abc6-bbf6d32f7a51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f078b331ba346bfa0c88fb953e9b6fb', 'request_id': 'req-b7ce6000-a3b8-40f1-abc6-bbf6d32f7a51'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:37.167648 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b7ce6000-a3b8-40f1-abc6-bbf6d32f7a51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f078b331ba346bfa0c88fb953e9b6fb', 'request_id': 'req-b7ce6000-a3b8-40f1-abc6-bbf6d32f7a51'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:37.228208 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b7ce6000-a3b8-40f1-abc6-bbf6d32f7a51 admin admin] The token cache is being invalidate because project 7f078b331ba346bfa0c88fb953e9b6fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:41:37.228848 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b7ce6000-a3b8-40f1-abc6-bbf6d32f7a51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:37.229234 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-b7ce6000-a3b8-40f1-abc6-bbf6d32f7a51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:37.230856 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4016/8015] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:41:37 2022] DELETE /identity/v3/projects/7f078b331ba346bfa0c88fb953e9b6fb => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:41:37.235326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa34dad-9f2d-4de6-bd52-1039306d679d service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:37.247764 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa34dad-9f2d-4de6-bd52-1039306d679d service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:37.303659 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f14afd-f36c-430b-8f35-bdd444ae6622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:37.304527 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f14afd-f36c-430b-8f35-bdd444ae6622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:37.304809 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f14afd-f36c-430b-8f35-bdd444ae6622 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:37.305085 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f14afd-f36c-430b-8f35-bdd444ae6622 admin admin] PATH_INFO: `/v3/users/006c31ef5ecc48d68c1daed1301f4eef` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:37.306358 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f14afd-f36c-430b-8f35-bdd444ae6622 admin admin] RBAC: Authorizing `identity:delete_user(user_id=006c31ef5ecc48d68c1daed1301f4eef)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:37.308312 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f14afd-f36c-430b-8f35-bdd444ae6622 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:37.328060 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce6000-a3b8-40f1-abc6-bbf6d32f7a51 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:37.332162 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b7ce6000-a3b8-40f1-abc6-bbf6d32f7a51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:37.344628 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce6000-a3b8-40f1-abc6-bbf6d32f7a51 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:37.349455 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dea6b2e-0e1e-4823-b75e-248f71c38c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:37.352179 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea6b2e-0e1e-4823-b75e-248f71c38c97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:37.352372 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea6b2e-0e1e-4823-b75e-248f71c38c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:37.352648 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dea6b2e-0e1e-4823-b75e-248f71c38c97 admin admin] PATH_INFO: `/v3/projects/b3802fb0d3c14722838c7c85bf0ca42b` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:37.354343 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea6b2e-0e1e-4823-b75e-248f71c38c97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3802fb0d3c14722838c7c85bf0ca42b)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:37.365554 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dea6b2e-0e1e-4823-b75e-248f71c38c97 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:37.483334 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-83f14afd-f36c-430b-8f35-bdd444ae6622 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '006c31ef5ecc48d68c1daed1301f4eef'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:37.484345 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6dea6b2e-0e1e-4823-b75e-248f71c38c97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3802fb0d3c14722838c7c85bf0ca42b', 'request_id': 'req-6dea6b2e-0e1e-4823-b75e-248f71c38c97'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:37.490116 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6dea6b2e-0e1e-4823-b75e-248f71c38c97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3802fb0d3c14722838c7c85bf0ca42b', 'request_id': 'req-6dea6b2e-0e1e-4823-b75e-248f71c38c97'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:37.496301 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-83f14afd-f36c-430b-8f35-bdd444ae6622 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '006c31ef5ecc48d68c1daed1301f4eef'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:37.497588 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6dea6b2e-0e1e-4823-b75e-248f71c38c97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3802fb0d3c14722838c7c85bf0ca42b', 'request_id': 'req-6dea6b2e-0e1e-4823-b75e-248f71c38c97'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:37.548721 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-83f14afd-f36c-430b-8f35-bdd444ae6622 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '006c31ef5ecc48d68c1daed1301f4eef'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:37.549349 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-83f14afd-f36c-430b-8f35-bdd444ae6622 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '006c31ef5ecc48d68c1daed1301f4eef'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:37.557064 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-83f14afd-f36c-430b-8f35-bdd444ae6622 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '006c31ef5ecc48d68c1daed1301f4eef'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:37.562893 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4000/8016] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:41:37 2022] DELETE /identity/v3/users/006c31ef5ecc48d68c1daed1301f4eef => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:41:37.600598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6dea6b2e-0e1e-4823-b75e-248f71c38c97 admin admin] The token cache is being invalidate because project b3802fb0d3c14722838c7c85bf0ca42b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:41:37.600997 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6dea6b2e-0e1e-4823-b75e-248f71c38c97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:37.601698 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6dea6b2e-0e1e-4823-b75e-248f71c38c97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:37.603382 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4017/8017] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:41:37 2022] DELETE /identity/v3/projects/b3802fb0d3c14722838c7c85bf0ca42b => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:41:37.608562 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0a668-1e7e-4a5a-9d8a-2b637552434a None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:37.608960 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0a668-1e7e-4a5a-9d8a-2b637552434a None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:37.609138 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0a668-1e7e-4a5a-9d8a-2b637552434a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:37.628626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-c6e0a668-1e7e-4a5a-9d8a-2b637552434a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:37.629866 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c6e0a668-1e7e-4a5a-9d8a-2b637552434a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:37.689286 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4001/8018] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:41:37.696938 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f595cf0-e2a1-49df-a1c3-8ffe4566f779 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:37.697233 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f595cf0-e2a1-49df-a1c3-8ffe4566f779 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:37.697518 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f595cf0-e2a1-49df-a1c3-8ffe4566f779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:37.717302 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-9f595cf0-e2a1-49df-a1c3-8ffe4566f779 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:37.718552 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9f595cf0-e2a1-49df-a1c3-8ffe4566f779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:37.727347 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4018/8019] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:41:37.736341 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0a668-1e7e-4a5a-9d8a-2b637552434a None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:37.746771 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0a668-1e7e-4a5a-9d8a-2b637552434a None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:37.751354 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ddda59-be13-4338-ba32-ece8fe8b7a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:37.752004 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddda59-be13-4338-ba32-ece8fe8b7a37 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:37.752292 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddda59-be13-4338-ba32-ece8fe8b7a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:37.752569 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddda59-be13-4338-ba32-ece8fe8b7a37 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:37.753290 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ddda59-be13-4338-ba32-ece8fe8b7a37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:41:37.753598 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ddda59-be13-4338-ba32-ece8fe8b7a37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:37.755259 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ddda59-be13-4338-ba32-ece8fe8b7a37 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:37.766397 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4002/8020] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:41:37.770581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f595cf0-e2a1-49df-a1c3-8ffe4566f779 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:37.780549 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f595cf0-e2a1-49df-a1c3-8ffe4566f779 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:37.785257 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a4f78-ff53-4a56-8ab9-dab4a48e788b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:37.785984 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a4f78-ff53-4a56-8ab9-dab4a48e788b admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:37.786272 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a4f78-ff53-4a56-8ab9-dab4a48e788b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:37.786551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a4f78-ff53-4a56-8ab9-dab4a48e788b admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:37.787879 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a4f78-ff53-4a56-8ab9-dab4a48e788b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:37.789786 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a4f78-ff53-4a56-8ab9-dab4a48e788b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:37.806729 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ddda59-be13-4338-ba32-ece8fe8b7a37 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:37.808758 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f0ddda59-be13-4338-ba32-ece8fe8b7a37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:37.822547 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ddda59-be13-4338-ba32-ece8fe8b7a37 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:37.828601 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011170a8-e01a-4e26-870e-5efc641ad84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:37.829479 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011170a8-e01a-4e26-870e-5efc641ad84a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:37.829816 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011170a8-e01a-4e26-870e-5efc641ad84a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:37.830117 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011170a8-e01a-4e26-870e-5efc641ad84a admin admin] PATH_INFO: `/v3/projects/7ee0f84e47bf4a7180f37d7d37fca51e` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:37.831595 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011170a8-e01a-4e26-870e-5efc641ad84a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ee0f84e47bf4a7180f37d7d37fca51e)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:37.834824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011170a8-e01a-4e26-870e-5efc641ad84a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:37.880599 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4019/8021] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:41:37 2022] POST /identity/v3/projects => generated 361 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:41:37.884646 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a4f78-ff53-4a56-8ab9-dab4a48e788b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:37.947564 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a4f78-ff53-4a56-8ab9-dab4a48e788b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:37.952571 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350ee46-ebb2-4eb7-8cf8-f22c10c132a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:37.953245 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350ee46-ebb2-4eb7-8cf8-f22c10c132a1 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:37.953534 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350ee46-ebb2-4eb7-8cf8-f22c10c132a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:37.953838 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350ee46-ebb2-4eb7-8cf8-f22c10c132a1 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:37.954527 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350ee46-ebb2-4eb7-8cf8-f22c10c132a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:37.956465 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350ee46-ebb2-4eb7-8cf8-f22c10c132a1 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:37.967673 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-011170a8-e01a-4e26-870e-5efc641ad84a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ee0f84e47bf4a7180f37d7d37fca51e', 'request_id': 'req-011170a8-e01a-4e26-870e-5efc641ad84a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:37.973046 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-011170a8-e01a-4e26-870e-5efc641ad84a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ee0f84e47bf4a7180f37d7d37fca51e', 'request_id': 'req-011170a8-e01a-4e26-870e-5efc641ad84a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:37.980170 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-011170a8-e01a-4e26-870e-5efc641ad84a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ee0f84e47bf4a7180f37d7d37fca51e', 'request_id': 'req-011170a8-e01a-4e26-870e-5efc641ad84a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:38.053270 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4020/8022] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:41:37 2022] POST /identity/v3/users => generated 281 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:41:38.056286 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350ee46-ebb2-4eb7-8cf8-f22c10c132a1 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:38.065601 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350ee46-ebb2-4eb7-8cf8-f22c10c132a1 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:38.078318 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-011170a8-e01a-4e26-870e-5efc641ad84a admin admin] The token cache is being invalidate because project 7ee0f84e47bf4a7180f37d7d37fca51e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:41:38.078614 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-011170a8-e01a-4e26-870e-5efc641ad84a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:38.079306 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-011170a8-e01a-4e26-870e-5efc641ad84a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:38.080878 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4003/8023] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:41:37 2022] DELETE /identity/v3/projects/7ee0f84e47bf4a7180f37d7d37fca51e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:41:38.086580 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463d0b5-2bac-48d9-8adb-f75a03028722 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:38.086947 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463d0b5-2bac-48d9-8adb-f75a03028722 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:38.087304 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463d0b5-2bac-48d9-8adb-f75a03028722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:38.106377 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-2463d0b5-2bac-48d9-8adb-f75a03028722 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:38.107693 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2463d0b5-2bac-48d9-8adb-f75a03028722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:38.122329 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258ad02-911d-46a9-9891-5e819fcc2a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:38.122993 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258ad02-911d-46a9-9891-5e819fcc2a5c admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:38.123275 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258ad02-911d-46a9-9891-5e819fcc2a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:38.123601 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258ad02-911d-46a9-9891-5e819fcc2a5c admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:38.124352 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e258ad02-911d-46a9-9891-5e819fcc2a5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:38.126030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e258ad02-911d-46a9-9891-5e819fcc2a5c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:38.135867 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4021/8024] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:41:38.139840 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258ad02-911d-46a9-9891-5e819fcc2a5c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:38.141693 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e258ad02-911d-46a9-9891-5e819fcc2a5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:38.155146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258ad02-911d-46a9-9891-5e819fcc2a5c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:38.159950 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf12928-7376-41ed-9211-71a9d5f219ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:38.160605 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf12928-7376-41ed-9211-71a9d5f219ef admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:38.160889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf12928-7376-41ed-9211-71a9d5f219ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:38.161172 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf12928-7376-41ed-9211-71a9d5f219ef admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:38.162805 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf12928-7376-41ed-9211-71a9d5f219ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:38.164182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf12928-7376-41ed-9211-71a9d5f219ef admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:38.170514 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4004/8025] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:41:38.175410 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4022/8026] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:41:38.178963 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf12928-7376-41ed-9211-71a9d5f219ef admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:38.179521 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061222d-4d45-4da8-bbc0-ce793e9cab51 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:38.179818 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061222d-4d45-4da8-bbc0-ce793e9cab51 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:38.180097 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061222d-4d45-4da8-bbc0-ce793e9cab51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:38.188696 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf12928-7376-41ed-9211-71a9d5f219ef admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:38.194573 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79bbf5c-ec90-4e79-95ec-ec754124045e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:38.195456 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bbf5c-ec90-4e79-95ec-ec754124045e admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:38.195906 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bbf5c-ec90-4e79-95ec-ec754124045e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:38.196197 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bbf5c-ec90-4e79-95ec-ec754124045e admin admin] PATH_INFO: `/v3/projects/a546cbdb63014478aa6fc35c9e34058a/users/9604bd842ddd4d608c0438a9f3577053/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:38.200023 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-3061222d-4d45-4da8-bbc0-ce793e9cab51 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:38.201281 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3061222d-4d45-4da8-bbc0-ce793e9cab51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:38.209969 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4005/8027] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:41:38.212297 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79bbf5c-ec90-4e79-95ec-ec754124045e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a546cbdb63014478aa6fc35c9e34058a, user_id=9604bd842ddd4d608c0438a9f3577053, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:38.214123 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061222d-4d45-4da8-bbc0-ce793e9cab51 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:38.215198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79bbf5c-ec90-4e79-95ec-ec754124045e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:38.223211 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061222d-4d45-4da8-bbc0-ce793e9cab51 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:38.227876 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b3adb-3ec0-4ef0-ba63-348a2c903978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:38.228482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b3adb-3ec0-4ef0-ba63-348a2c903978 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:38.228769 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b3adb-3ec0-4ef0-ba63-348a2c903978 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:38.229032 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b3adb-3ec0-4ef0-ba63-348a2c903978 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:38.229746 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b3adb-3ec0-4ef0-ba63-348a2c903978 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:41:38.230226 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b3adb-3ec0-4ef0-ba63-348a2c903978 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:38.231838 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b3adb-3ec0-4ef0-ba63-348a2c903978 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:38.243318 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4006/8028] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:41:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:41:38.247378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b3adb-3ec0-4ef0-ba63-348a2c903978 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:38.257459 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b3adb-3ec0-4ef0-ba63-348a2c903978 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:38.262013 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b26e7-e5e0-40cf-8768-f40f4d086518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:38.262627 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b26e7-e5e0-40cf-8768-f40f4d086518 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:38.262909 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b26e7-e5e0-40cf-8768-f40f4d086518 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:38.263184 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b26e7-e5e0-40cf-8768-f40f4d086518 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:38.263845 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b26e7-e5e0-40cf-8768-f40f4d086518 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:38.265701 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b26e7-e5e0-40cf-8768-f40f4d086518 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:38.285705 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4023/8029] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:41:38 2022] PUT /identity/v3/projects/a546cbdb63014478aa6fc35c9e34058a/users/9604bd842ddd4d608c0438a9f3577053/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:41:38.291477 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854acd67-c240-4190-9840-9d301528b8a9 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:38.291767 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854acd67-c240-4190-9840-9d301528b8a9 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:38.292043 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854acd67-c240-4190-9840-9d301528b8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:38.317573 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-854acd67-c240-4190-9840-9d301528b8a9 None None] MFA Rules not processed for user `9604bd842ddd4d608c0438a9f3577053`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:38.319300 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-854acd67-c240-4190-9840-9d301528b8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:38.371637 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4007/8030] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:41:38 2022] POST /identity/v3/projects => generated 381 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:41:38.375777 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b26e7-e5e0-40cf-8768-f40f4d086518 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:38.381669 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4024/8031] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:41:38.393514 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854acd67-c240-4190-9840-9d301528b8a9 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:38.394971 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-854acd67-c240-4190-9840-9d301528b8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:38.439651 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b26e7-e5e0-40cf-8768-f40f4d086518 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:38.444952 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca994f08-ed18-49d4-9e15-fb879b7850ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:38.445622 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca994f08-ed18-49d4-9e15-fb879b7850ca admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:38.445949 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca994f08-ed18-49d4-9e15-fb879b7850ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:38.446233 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca994f08-ed18-49d4-9e15-fb879b7850ca admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:38.446923 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca994f08-ed18-49d4-9e15-fb879b7850ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:38.448881 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca994f08-ed18-49d4-9e15-fb879b7850ca admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:38.452885 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854acd67-c240-4190-9840-9d301528b8a9 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:38.504104 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52cef45-e7e4-4096-8061-4c993403151b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:38.504749 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cef45-e7e4-4096-8061-4c993403151b service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:38.505034 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cef45-e7e4-4096-8061-4c993403151b service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:38.505311 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cef45-e7e4-4096-8061-4c993403151b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:38.554014 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4008/8032] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:41:38 2022] POST /identity/v3/users => generated 291 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:41:38.558123 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca994f08-ed18-49d4-9e15-fb879b7850ca admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:38.562413 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52cef45-e7e4-4096-8061-4c993403151b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:38.564052 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52cef45-e7e4-4096-8061-4c993403151b service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:38.569050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca994f08-ed18-49d4-9e15-fb879b7850ca admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:38.573952 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03663986-a96d-468a-a9a0-2a7e8f307b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:38.574861 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03663986-a96d-468a-a9a0-2a7e8f307b50 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:38.575307 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03663986-a96d-468a-a9a0-2a7e8f307b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:38.575510 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4025/8033] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:41:38 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:41:38.575721 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03663986-a96d-468a-a9a0-2a7e8f307b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:38.576665 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03663986-a96d-468a-a9a0-2a7e8f307b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:38.578467 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03663986-a96d-468a-a9a0-2a7e8f307b50 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:38.590230 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4009/8034] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:41:38.593593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52cef45-e7e4-4096-8061-4c993403151b service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:38.604273 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52cef45-e7e4-4096-8061-4c993403151b service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:38.609064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe449f-7a87-4fac-a878-1d50872a8ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:38.609742 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe449f-7a87-4fac-a878-1d50872a8ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:38.610047 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe449f-7a87-4fac-a878-1d50872a8ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:38.610328 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe449f-7a87-4fac-a878-1d50872a8ce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:38.611049 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe449f-7a87-4fac-a878-1d50872a8ce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:38.612707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe449f-7a87-4fac-a878-1d50872a8ce7 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:38.623150 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4026/8035] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:41:38.627378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03663986-a96d-468a-a9a0-2a7e8f307b50 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:38.637972 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03663986-a96d-468a-a9a0-2a7e8f307b50 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:38.642768 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64562a21-a3c9-42e9-ab6d-c22e2648da6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:38.643639 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64562a21-a3c9-42e9-ab6d-c22e2648da6f admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:38.643920 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64562a21-a3c9-42e9-ab6d-c22e2648da6f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:38.644195 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64562a21-a3c9-42e9-ab6d-c22e2648da6f admin admin] PATH_INFO: `/v3/projects/fe45a728ebc84950ac5eadf89185c360/users/bd88872ef84a4baaa29086b6c8ca8352/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:38.661048 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64562a21-a3c9-42e9-ab6d-c22e2648da6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe45a728ebc84950ac5eadf89185c360, user_id=bd88872ef84a4baaa29086b6c8ca8352, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:38.664425 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64562a21-a3c9-42e9-ab6d-c22e2648da6f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:38.743900 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4010/8036] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:41:38 2022] PUT /identity/v3/projects/fe45a728ebc84950ac5eadf89185c360/users/bd88872ef84a4baaa29086b6c8ca8352/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:41:38.756031 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d3449-5ca5-4cc3-8b31-b337dad1f8ba None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:38.756431 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d3449-5ca5-4cc3-8b31-b337dad1f8ba None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:38.756719 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d3449-5ca5-4cc3-8b31-b337dad1f8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:38.784440 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-066d3449-5ca5-4cc3-8b31-b337dad1f8ba None None] MFA Rules not processed for user `bd88872ef84a4baaa29086b6c8ca8352`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:38.785674 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-066d3449-5ca5-4cc3-8b31-b337dad1f8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:38.848075 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4027/8037] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:41:38.859898 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64562a21-a3c9-42e9-ab6d-c22e2648da6f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:38.861808 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-64562a21-a3c9-42e9-ab6d-c22e2648da6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:38.924996 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64562a21-a3c9-42e9-ab6d-c22e2648da6f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:38.928819 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014ca11-16a8-4ae7-b92d-8fe20f2fddc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:38.929473 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014ca11-16a8-4ae7-b92d-8fe20f2fddc8 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:38.929787 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014ca11-16a8-4ae7-b92d-8fe20f2fddc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:38.930075 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014ca11-16a8-4ae7-b92d-8fe20f2fddc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:38.938472 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014ca11-16a8-4ae7-b92d-8fe20f2fddc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:38.939920 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014ca11-16a8-4ae7-b92d-8fe20f2fddc8 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:38.949440 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4011/8038] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:41:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:41:52.182696 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d3449-5ca5-4cc3-8b31-b337dad1f8ba None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:52.261796 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d3449-5ca5-4cc3-8b31-b337dad1f8ba None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:52.267330 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c9a29-f95b-4f00-a258-afd335397a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:52.268569 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c9a29-f95b-4f00-a258-afd335397a16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:52.268961 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c9a29-f95b-4f00-a258-afd335397a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:52.269340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c9a29-f95b-4f00-a258-afd335397a16 admin admin] PATH_INFO: `/v3/users/9604bd842ddd4d608c0438a9f3577053` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:52.270805 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8c9a29-f95b-4f00-a258-afd335397a16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9604bd842ddd4d608c0438a9f3577053)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:52.273406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8c9a29-f95b-4f00-a258-afd335397a16 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:52.451006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-fc8c9a29-f95b-4f00-a258-afd335397a16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9604bd842ddd4d608c0438a9f3577053'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:52.473517 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-fc8c9a29-f95b-4f00-a258-afd335397a16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9604bd842ddd4d608c0438a9f3577053'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:52.539214 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-fc8c9a29-f95b-4f00-a258-afd335397a16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9604bd842ddd4d608c0438a9f3577053'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:52.547826 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-fc8c9a29-f95b-4f00-a258-afd335397a16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9604bd842ddd4d608c0438a9f3577053'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:52.548706 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-fc8c9a29-f95b-4f00-a258-afd335397a16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9604bd842ddd4d608c0438a9f3577053'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:52.557273 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4028/8039] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:41:52 2022] DELETE /identity/v3/users/9604bd842ddd4d608c0438a9f3577053 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:41:52.561537 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aee5b2-19dc-401e-afb5-2b74727fcec9 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:52.562043 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aee5b2-19dc-401e-afb5-2b74727fcec9 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:52.562121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aee5b2-19dc-401e-afb5-2b74727fcec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:52.586159 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-58aee5b2-19dc-401e-afb5-2b74727fcec9 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:52.588155 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-58aee5b2-19dc-401e-afb5-2b74727fcec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:52.670743 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4012/8040] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:41:52.679259 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c9a29-f95b-4f00-a258-afd335397a16 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:52.681251 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-fc8c9a29-f95b-4f00-a258-afd335397a16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:52.763866 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c9a29-f95b-4f00-a258-afd335397a16 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:52.768167 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d457397-497d-405c-9fd7-cbbb4798d11c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:52.771240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d457397-497d-405c-9fd7-cbbb4798d11c service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:52.771240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d457397-497d-405c-9fd7-cbbb4798d11c service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:52.771240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d457397-497d-405c-9fd7-cbbb4798d11c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:52.784156 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d457397-497d-405c-9fd7-cbbb4798d11c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:52.788039 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d457397-497d-405c-9fd7-cbbb4798d11c service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:52.805948 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4029/8041] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:41:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:41:53.076413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aee5b2-19dc-401e-afb5-2b74727fcec9 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:53.084789 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-58aee5b2-19dc-401e-afb5-2b74727fcec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:53.103110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aee5b2-19dc-401e-afb5-2b74727fcec9 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:53.108377 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67984541-3d20-47bb-8b44-971404361840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:53.110086 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67984541-3d20-47bb-8b44-971404361840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:53.110086 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67984541-3d20-47bb-8b44-971404361840 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:53.110086 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67984541-3d20-47bb-8b44-971404361840 admin admin] PATH_INFO: `/v3/projects/a546cbdb63014478aa6fc35c9e34058a` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:53.111097 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67984541-3d20-47bb-8b44-971404361840 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a546cbdb63014478aa6fc35c9e34058a)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:53.113265 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67984541-3d20-47bb-8b44-971404361840 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:53.239040 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-67984541-3d20-47bb-8b44-971404361840 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a546cbdb63014478aa6fc35c9e34058a', 'request_id': 'req-67984541-3d20-47bb-8b44-971404361840'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:53.245262 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-67984541-3d20-47bb-8b44-971404361840 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a546cbdb63014478aa6fc35c9e34058a', 'request_id': 'req-67984541-3d20-47bb-8b44-971404361840'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:53.251443 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-67984541-3d20-47bb-8b44-971404361840 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a546cbdb63014478aa6fc35c9e34058a', 'request_id': 'req-67984541-3d20-47bb-8b44-971404361840'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:53.309572 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-67984541-3d20-47bb-8b44-971404361840 admin admin] The token cache is being invalidate because project a546cbdb63014478aa6fc35c9e34058a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:41:53.309902 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-67984541-3d20-47bb-8b44-971404361840 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:53.310568 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-67984541-3d20-47bb-8b44-971404361840 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:53.312174 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4013/8042] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:41:53 2022] DELETE /identity/v3/projects/a546cbdb63014478aa6fc35c9e34058a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:41:53.317099 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdaa129-2d8b-4ecc-83cf-5effef23ed74 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:53.317584 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdaa129-2d8b-4ecc-83cf-5effef23ed74 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:53.317674 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdaa129-2d8b-4ecc-83cf-5effef23ed74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:53.335273 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-fbdaa129-2d8b-4ecc-83cf-5effef23ed74 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:53.336881 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-fbdaa129-2d8b-4ecc-83cf-5effef23ed74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:53.404361 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4030/8043] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:41:53.413853 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cef6a3-ecf5-4699-aeb1-2e37bacedf43 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:53.414146 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cef6a3-ecf5-4699-aeb1-2e37bacedf43 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:53.414432 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cef6a3-ecf5-4699-aeb1-2e37bacedf43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:53.435192 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-60cef6a3-ecf5-4699-aeb1-2e37bacedf43 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:53.436412 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-60cef6a3-ecf5-4699-aeb1-2e37bacedf43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:53.445485 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4014/8044] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:41:53.450253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdaa129-2d8b-4ecc-83cf-5effef23ed74 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:53.460006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdaa129-2d8b-4ecc-83cf-5effef23ed74 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:53.464560 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b9fe9-b75e-44ad-b011-a625d60fabe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:53.465276 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b9fe9-b75e-44ad-b011-a625d60fabe2 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:53.465504 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b9fe9-b75e-44ad-b011-a625d60fabe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:53.470629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b9fe9-b75e-44ad-b011-a625d60fabe2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:53.470629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b9fe9-b75e-44ad-b011-a625d60fabe2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:41:53.470629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b9fe9-b75e-44ad-b011-a625d60fabe2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:53.470629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b9fe9-b75e-44ad-b011-a625d60fabe2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:53.484172 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4031/8045] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:41:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:41:53.485782 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cef6a3-ecf5-4699-aeb1-2e37bacedf43 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:53.496050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cef6a3-ecf5-4699-aeb1-2e37bacedf43 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:53.500838 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d5ca9-fa98-48c0-bf0a-509fcaff4b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:53.501830 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d5ca9-fa98-48c0-bf0a-509fcaff4b54 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:53.502116 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d5ca9-fa98-48c0-bf0a-509fcaff4b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:53.514723 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d5ca9-fa98-48c0-bf0a-509fcaff4b54 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:53.514723 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3d5ca9-fa98-48c0-bf0a-509fcaff4b54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:53.514723 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3d5ca9-fa98-48c0-bf0a-509fcaff4b54 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:53.629342 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4015/8046] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:41:53 2022] POST /identity/v3/projects => generated 377 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:41:53.630413 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b9fe9-b75e-44ad-b011-a625d60fabe2 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:53.641055 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b9fe9-b75e-44ad-b011-a625d60fabe2 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:53.698837 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61978ccc-50fa-4fbc-a52f-eb819af3d751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:53.699425 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61978ccc-50fa-4fbc-a52f-eb819af3d751 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:53.699711 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61978ccc-50fa-4fbc-a52f-eb819af3d751 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:53.699989 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61978ccc-50fa-4fbc-a52f-eb819af3d751 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:53.700669 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61978ccc-50fa-4fbc-a52f-eb819af3d751 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:53.702676 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61978ccc-50fa-4fbc-a52f-eb819af3d751 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:53.745837 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d5ca9-fa98-48c0-bf0a-509fcaff4b54 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:53.747635 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4e3d5ca9-fa98-48c0-bf0a-509fcaff4b54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:53.762039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d5ca9-fa98-48c0-bf0a-509fcaff4b54 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:53.766928 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bcd04-f88d-44e8-b4fc-a1900777bdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:53.767803 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bcd04-f88d-44e8-b4fc-a1900777bdaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:53.768090 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bcd04-f88d-44e8-b4fc-a1900777bdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:53.768370 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bcd04-f88d-44e8-b4fc-a1900777bdaf admin admin] PATH_INFO: `/v3/users/bd88872ef84a4baaa29086b6c8ca8352` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:53.769571 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83bcd04-f88d-44e8-b4fc-a1900777bdaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd88872ef84a4baaa29086b6c8ca8352)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:53.772169 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83bcd04-f88d-44e8-b4fc-a1900777bdaf admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:53.818573 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4032/8047] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:41:53 2022] POST /identity/v3/users => generated 289 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:41:53.822399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61978ccc-50fa-4fbc-a52f-eb819af3d751 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:53.831771 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61978ccc-50fa-4fbc-a52f-eb819af3d751 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:53.837254 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3a24e-85e0-45fe-b68b-57c8b21b99e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:53.837939 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3a24e-85e0-45fe-b68b-57c8b21b99e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:53.841052 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3a24e-85e0-45fe-b68b-57c8b21b99e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:53.841052 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3a24e-85e0-45fe-b68b-57c8b21b99e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:53.841052 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae3a24e-85e0-45fe-b68b-57c8b21b99e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:53.841052 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae3a24e-85e0-45fe-b68b-57c8b21b99e0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:53.851120 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4033/8048] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:41:53.854738 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3a24e-85e0-45fe-b68b-57c8b21b99e0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:53.863900 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3a24e-85e0-45fe-b68b-57c8b21b99e0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:53.871202 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b5eac-0087-4c64-9ebf-58b97b12af43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:53.871991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b5eac-0087-4c64-9ebf-58b97b12af43 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:53.872277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b5eac-0087-4c64-9ebf-58b97b12af43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:53.872555 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b5eac-0087-4c64-9ebf-58b97b12af43 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:53.873269 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b5eac-0087-4c64-9ebf-58b97b12af43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:53.875087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b5eac-0087-4c64-9ebf-58b97b12af43 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:53.886468 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4034/8049] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:41:53.890675 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b5eac-0087-4c64-9ebf-58b97b12af43 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:53.903197 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b5eac-0087-4c64-9ebf-58b97b12af43 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:53.908675 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e146bb-5272-45cc-b04b-3c2ea04cbbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:53.909559 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e146bb-5272-45cc-b04b-3c2ea04cbbf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:53.909882 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e146bb-5272-45cc-b04b-3c2ea04cbbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:53.910161 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e146bb-5272-45cc-b04b-3c2ea04cbbf8 admin admin] PATH_INFO: `/v3/projects/8960f959309d452bab71d14b1cac7cff/users/3a65c4805e6c4754b099c12f7b09db0c/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:53.925022 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e146bb-5272-45cc-b04b-3c2ea04cbbf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8960f959309d452bab71d14b1cac7cff, user_id=3a65c4805e6c4754b099c12f7b09db0c, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:53.927779 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e146bb-5272-45cc-b04b-3c2ea04cbbf8 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:54.037860 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f83bcd04-f88d-44e8-b4fc-a1900777bdaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd88872ef84a4baaa29086b6c8ca8352'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:54.041372 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4035/8050] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:41:53 2022] PUT /identity/v3/projects/8960f959309d452bab71d14b1cac7cff/users/3a65c4805e6c4754b099c12f7b09db0c/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:41:54.051548 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5224ac-fcaf-4fc0-866d-93cf1d70f265 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:54.051835 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5224ac-fcaf-4fc0-866d-93cf1d70f265 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:54.052173 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5224ac-fcaf-4fc0-866d-93cf1d70f265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:54.053944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f83bcd04-f88d-44e8-b4fc-a1900777bdaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd88872ef84a4baaa29086b6c8ca8352'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:54.079276 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-3f5224ac-fcaf-4fc0-866d-93cf1d70f265 None None] MFA Rules not processed for user `3a65c4805e6c4754b099c12f7b09db0c`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:54.081619 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3f5224ac-fcaf-4fc0-866d-93cf1d70f265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:54.132954 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f83bcd04-f88d-44e8-b4fc-a1900777bdaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd88872ef84a4baaa29086b6c8ca8352'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:54.133595 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f83bcd04-f88d-44e8-b4fc-a1900777bdaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd88872ef84a4baaa29086b6c8ca8352'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:54.141472 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f83bcd04-f88d-44e8-b4fc-a1900777bdaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd88872ef84a4baaa29086b6c8ca8352'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:54.145921 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4036/8051] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:41:54.148597 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4016/8052] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:41:53 2022] DELETE /identity/v3/users/bd88872ef84a4baaa29086b6c8ca8352 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:41:54.153135 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271353ca-f653-4642-8cc9-a6deaddb18db None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:54.153545 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271353ca-f653-4642-8cc9-a6deaddb18db None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:54.153851 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271353ca-f653-4642-8cc9-a6deaddb18db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:54.164810 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bcd04-f88d-44e8-b4fc-a1900777bdaf admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:54.166335 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f83bcd04-f88d-44e8-b4fc-a1900777bdaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:54.171814 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-271353ca-f653-4642-8cc9-a6deaddb18db None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:54.172892 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-271353ca-f653-4642-8cc9-a6deaddb18db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:54.234811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bcd04-f88d-44e8-b4fc-a1900777bdaf admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:54.236541 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4037/8053] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:41:54.239748 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d711b41-026e-450d-afb4-2c51db788c02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:54.243116 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d711b41-026e-450d-afb4-2c51db788c02 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:54.243116 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d711b41-026e-450d-afb4-2c51db788c02 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:54.243116 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d711b41-026e-450d-afb4-2c51db788c02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:54.243116 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2d711b41-026e-450d-afb4-2c51db788c02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:54.246816 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271353ca-f653-4642-8cc9-a6deaddb18db None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:54.259392 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271353ca-f653-4642-8cc9-a6deaddb18db None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:54.263116 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4e860-c753-40ad-9d3d-9d97512c50fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:54.263757 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4e860-c753-40ad-9d3d-9d97512c50fe service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:54.264039 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4e860-c753-40ad-9d3d-9d97512c50fe service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:54.264312 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4e860-c753-40ad-9d3d-9d97512c50fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:54.275615 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f4e860-c753-40ad-9d3d-9d97512c50fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:54.277341 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f4e860-c753-40ad-9d3d-9d97512c50fe service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:54.288670 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4038/8054] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:41:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:41:54.305454 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d711b41-026e-450d-afb4-2c51db788c02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:54.311054 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d711b41-026e-450d-afb4-2c51db788c02 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:54.315953 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4017/8055] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:41:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:41:54.330960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4e860-c753-40ad-9d3d-9d97512c50fe service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:54.332437 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-33f4e860-c753-40ad-9d3d-9d97512c50fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:54.345861 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4e860-c753-40ad-9d3d-9d97512c50fe service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:54.350662 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff63b52-7e26-459f-9277-0126560a998f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:54.351528 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff63b52-7e26-459f-9277-0126560a998f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:54.351808 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff63b52-7e26-459f-9277-0126560a998f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:54.352090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff63b52-7e26-459f-9277-0126560a998f admin admin] PATH_INFO: `/v3/users/3a65c4805e6c4754b099c12f7b09db0c` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:54.353279 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff63b52-7e26-459f-9277-0126560a998f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a65c4805e6c4754b099c12f7b09db0c)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:54.355264 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff63b52-7e26-459f-9277-0126560a998f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:54.591653 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d711b41-026e-450d-afb4-2c51db788c02 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:54.593272 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2d711b41-026e-450d-afb4-2c51db788c02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:54.610056 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4ff63b52-7e26-459f-9277-0126560a998f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a65c4805e6c4754b099c12f7b09db0c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:54.611314 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d711b41-026e-450d-afb4-2c51db788c02 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:54.616809 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fde813-6e21-4b91-a336-401a4c2a2f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:54.617680 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fde813-6e21-4b91-a336-401a4c2a2f28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:54.618015 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fde813-6e21-4b91-a336-401a4c2a2f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:54.618295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fde813-6e21-4b91-a336-401a4c2a2f28 admin admin] PATH_INFO: `/v3/projects/fe45a728ebc84950ac5eadf89185c360` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:54.619517 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fde813-6e21-4b91-a336-401a4c2a2f28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe45a728ebc84950ac5eadf89185c360)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:54.621513 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fde813-6e21-4b91-a336-401a4c2a2f28 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:54.625330 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4ff63b52-7e26-459f-9277-0126560a998f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a65c4805e6c4754b099c12f7b09db0c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:54.687245 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4ff63b52-7e26-459f-9277-0126560a998f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a65c4805e6c4754b099c12f7b09db0c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:54.696378 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4ff63b52-7e26-459f-9277-0126560a998f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a65c4805e6c4754b099c12f7b09db0c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:54.701714 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4ff63b52-7e26-459f-9277-0126560a998f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a65c4805e6c4754b099c12f7b09db0c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:54.703436 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4039/8056] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:41:54 2022] DELETE /identity/v3/users/3a65c4805e6c4754b099c12f7b09db0c => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:41:54.707925 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ed7ef-f823-4d96-95bb-d7cc8ef559e4 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:54.708289 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ed7ef-f823-4d96-95bb-d7cc8ef559e4 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:54.708556 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ed7ef-f823-4d96-95bb-d7cc8ef559e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:54.727662 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-a89ed7ef-f823-4d96-95bb-d7cc8ef559e4 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:54.734554 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a89ed7ef-f823-4d96-95bb-d7cc8ef559e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:54.742637 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-28fde813-6e21-4b91-a336-401a4c2a2f28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe45a728ebc84950ac5eadf89185c360', 'request_id': 'req-28fde813-6e21-4b91-a336-401a4c2a2f28'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:54.748759 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-28fde813-6e21-4b91-a336-401a4c2a2f28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe45a728ebc84950ac5eadf89185c360', 'request_id': 'req-28fde813-6e21-4b91-a336-401a4c2a2f28'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:54.755554 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-28fde813-6e21-4b91-a336-401a4c2a2f28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe45a728ebc84950ac5eadf89185c360', 'request_id': 'req-28fde813-6e21-4b91-a336-401a4c2a2f28'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:54.790896 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4040/8057] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:41:54.800653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ed7ef-f823-4d96-95bb-d7cc8ef559e4 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:54.801903 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a89ed7ef-f823-4d96-95bb-d7cc8ef559e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:54.821770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-28fde813-6e21-4b91-a336-401a4c2a2f28 admin admin] The token cache is being invalidate because project fe45a728ebc84950ac5eadf89185c360 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:41:54.822098 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-28fde813-6e21-4b91-a336-401a4c2a2f28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:54.822752 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-28fde813-6e21-4b91-a336-401a4c2a2f28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:54.824294 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4018/8058] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:41:54 2022] DELETE /identity/v3/projects/fe45a728ebc84950ac5eadf89185c360 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:41:54.829134 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85afd4-349c-497f-b618-25af6d9281a5 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:54.829424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85afd4-349c-497f-b618-25af6d9281a5 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:54.829707 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85afd4-349c-497f-b618-25af6d9281a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:54.847572 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-8a85afd4-349c-497f-b618-25af6d9281a5 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:54.848769 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8a85afd4-349c-497f-b618-25af6d9281a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:54.857267 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4019/8059] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:41:54.860429 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ed7ef-f823-4d96-95bb-d7cc8ef559e4 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:54.864150 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745cf2fb-0efe-47ea-852d-6f1d152a3221 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:54.864835 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745cf2fb-0efe-47ea-852d-6f1d152a3221 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:54.864957 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c26941-788d-4192-a89c-18d10c12abf4 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:54.865143 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745cf2fb-0efe-47ea-852d-6f1d152a3221 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:54.865866 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c26941-788d-4192-a89c-18d10c12abf4 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:54.865972 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745cf2fb-0efe-47ea-852d-6f1d152a3221 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:54.866163 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c26941-788d-4192-a89c-18d10c12abf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:54.867768 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-745cf2fb-0efe-47ea-852d-6f1d152a3221 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:54.879934 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745cf2fb-0efe-47ea-852d-6f1d152a3221 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:54.881419 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745cf2fb-0efe-47ea-852d-6f1d152a3221 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:54.884005 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-d9c26941-788d-4192-a89c-18d10c12abf4 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:54.885181 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d9c26941-788d-4192-a89c-18d10c12abf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:54.891002 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4041/8060] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:41:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:41:54.893174 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4020/8061] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:41:54.897159 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745cf2fb-0efe-47ea-852d-6f1d152a3221 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:54.906507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745cf2fb-0efe-47ea-852d-6f1d152a3221 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:54.911300 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75bcaea-2e3e-4b06-8e94-184ed8056fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:54.912592 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75bcaea-2e3e-4b06-8e94-184ed8056fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:54.912910 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75bcaea-2e3e-4b06-8e94-184ed8056fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:54.913258 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75bcaea-2e3e-4b06-8e94-184ed8056fa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:54.914089 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75bcaea-2e3e-4b06-8e94-184ed8056fa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:41:54.914486 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75bcaea-2e3e-4b06-8e94-184ed8056fa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:54.916158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75bcaea-2e3e-4b06-8e94-184ed8056fa1 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:54.931593 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4042/8062] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:41:54.932864 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c26941-788d-4192-a89c-18d10c12abf4 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:54.942571 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c26941-788d-4192-a89c-18d10c12abf4 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:54.947384 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde566bf-e629-4a45-a0d7-6752912ad91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:54.948046 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde566bf-e629-4a45-a0d7-6752912ad91d admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:54.948397 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde566bf-e629-4a45-a0d7-6752912ad91d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:54.948711 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde566bf-e629-4a45-a0d7-6752912ad91d admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:54.949410 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde566bf-e629-4a45-a0d7-6752912ad91d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:54.951430 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde566bf-e629-4a45-a0d7-6752912ad91d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:55.046520 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4021/8063] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:41:54 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:41:55.050840 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75bcaea-2e3e-4b06-8e94-184ed8056fa1 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:55.060860 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75bcaea-2e3e-4b06-8e94-184ed8056fa1 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:55.123704 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ebf5f-9c50-49d2-af87-eb8fd481f7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:55.123704 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ebf5f-9c50-49d2-af87-eb8fd481f7ea admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:55.123704 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ebf5f-9c50-49d2-af87-eb8fd481f7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:55.123704 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ebf5f-9c50-49d2-af87-eb8fd481f7ea admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:55.132075 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524ebf5f-9c50-49d2-af87-eb8fd481f7ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:55.134177 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524ebf5f-9c50-49d2-af87-eb8fd481f7ea admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:55.208061 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4043/8064] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:41:55 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:41:55.209903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde566bf-e629-4a45-a0d7-6752912ad91d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:55.219637 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde566bf-e629-4a45-a0d7-6752912ad91d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:55.224252 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c639cd-ddeb-4c28-b24b-4c78519bc28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:55.224948 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c639cd-ddeb-4c28-b24b-4c78519bc28e admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:55.225230 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c639cd-ddeb-4c28-b24b-4c78519bc28e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:55.225504 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c639cd-ddeb-4c28-b24b-4c78519bc28e admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:55.226251 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c639cd-ddeb-4c28-b24b-4c78519bc28e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:55.230959 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c639cd-ddeb-4c28-b24b-4c78519bc28e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:55.238591 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4022/8065] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:41:55.243601 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ebf5f-9c50-49d2-af87-eb8fd481f7ea admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:55.258080 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ebf5f-9c50-49d2-af87-eb8fd481f7ea admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:55.262884 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af4e33-ae51-45b1-bf2c-5952e202f9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:55.263552 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af4e33-ae51-45b1-bf2c-5952e202f9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:55.263839 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af4e33-ae51-45b1-bf2c-5952e202f9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:55.264120 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af4e33-ae51-45b1-bf2c-5952e202f9e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:55.264845 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af4e33-ae51-45b1-bf2c-5952e202f9e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:55.266575 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af4e33-ae51-45b1-bf2c-5952e202f9e5 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:55.279538 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4044/8066] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:41:55.283662 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c639cd-ddeb-4c28-b24b-4c78519bc28e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:55.293796 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c639cd-ddeb-4c28-b24b-4c78519bc28e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:55.298708 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfac2c7-c176-4e4e-ae4d-354918e3acb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:55.299467 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfac2c7-c176-4e4e-ae4d-354918e3acb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:55.299741 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfac2c7-c176-4e4e-ae4d-354918e3acb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:55.299921 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af4e33-ae51-45b1-bf2c-5952e202f9e5 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:55.300047 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfac2c7-c176-4e4e-ae4d-354918e3acb6 admin admin] PATH_INFO: `/v3/projects/1ae60d361c18453db192babfe66705c1/users/4e64b96aa2f940569ee08c2be4d09503/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:55.301838 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b7af4e33-ae51-45b1-bf2c-5952e202f9e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:55.317129 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af4e33-ae51-45b1-bf2c-5952e202f9e5 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:55.322808 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942edc5b-ae77-43c6-8dc0-1c2053a752f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:55.323740 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942edc5b-ae77-43c6-8dc0-1c2053a752f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:55.323951 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942edc5b-ae77-43c6-8dc0-1c2053a752f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:55.324231 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942edc5b-ae77-43c6-8dc0-1c2053a752f2 admin admin] PATH_INFO: `/v3/projects/8960f959309d452bab71d14b1cac7cff` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:55.325459 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942edc5b-ae77-43c6-8dc0-1c2053a752f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8960f959309d452bab71d14b1cac7cff)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:55.326954 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfac2c7-c176-4e4e-ae4d-354918e3acb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ae60d361c18453db192babfe66705c1, user_id=4e64b96aa2f940569ee08c2be4d09503, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:55.327462 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942edc5b-ae77-43c6-8dc0-1c2053a752f2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:55.329640 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfac2c7-c176-4e4e-ae4d-354918e3acb6 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:55.413090 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4023/8067] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:41:55 2022] PUT /identity/v3/projects/1ae60d361c18453db192babfe66705c1/users/4e64b96aa2f940569ee08c2be4d09503/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:41:55.423063 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e159316-d35e-4c32-92a4-9db222aab5ad None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:55.424144 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e159316-d35e-4c32-92a4-9db222aab5ad None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:55.424144 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e159316-d35e-4c32-92a4-9db222aab5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:55.436157 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-942edc5b-ae77-43c6-8dc0-1c2053a752f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8960f959309d452bab71d14b1cac7cff', 'request_id': 'req-942edc5b-ae77-43c6-8dc0-1c2053a752f2'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:55.441512 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-942edc5b-ae77-43c6-8dc0-1c2053a752f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8960f959309d452bab71d14b1cac7cff', 'request_id': 'req-942edc5b-ae77-43c6-8dc0-1c2053a752f2'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:55.448328 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-942edc5b-ae77-43c6-8dc0-1c2053a752f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8960f959309d452bab71d14b1cac7cff', 'request_id': 'req-942edc5b-ae77-43c6-8dc0-1c2053a752f2'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:55.450623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-8e159316-d35e-4c32-92a4-9db222aab5ad None None] MFA Rules not processed for user `4e64b96aa2f940569ee08c2be4d09503`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:55.451880 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8e159316-d35e-4c32-92a4-9db222aab5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:55.502998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-942edc5b-ae77-43c6-8dc0-1c2053a752f2 admin admin] The token cache is being invalidate because project 8960f959309d452bab71d14b1cac7cff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:41:55.503381 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-942edc5b-ae77-43c6-8dc0-1c2053a752f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:55.504492 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-942edc5b-ae77-43c6-8dc0-1c2053a752f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:55.506036 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4045/8068] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:41:55 2022] DELETE /identity/v3/projects/8960f959309d452bab71d14b1cac7cff => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:41:55.511118 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc0851-3ed1-4341-9d61-94e85e261bfb None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:55.511407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc0851-3ed1-4341-9d61-94e85e261bfb None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:55.511694 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc0851-3ed1-4341-9d61-94e85e261bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:55.516463 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4024/8069] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:41:55.527530 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e159316-d35e-4c32-92a4-9db222aab5ad None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:55.528981 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8e159316-d35e-4c32-92a4-9db222aab5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:55.530911 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-dbcc0851-3ed1-4341-9d61-94e85e261bfb None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:55.532954 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-dbcc0851-3ed1-4341-9d61-94e85e261bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:55.593453 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e159316-d35e-4c32-92a4-9db222aab5ad None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:55.596533 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4046/8070] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:41:55.597263 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c4641-0ef8-46b5-9f53-c59f92f2b800 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:55.597988 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c4641-0ef8-46b5-9f53-c59f92f2b800 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:55.598272 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c4641-0ef8-46b5-9f53-c59f92f2b800 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:55.598548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c4641-0ef8-46b5-9f53-c59f92f2b800 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:55.600925 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-405c4641-0ef8-46b5-9f53-c59f92f2b800 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:55.605087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb7f0d-0c9d-4e29-beca-cf745ca7331c None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:55.605381 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb7f0d-0c9d-4e29-beca-cf745ca7331c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:55.605661 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb7f0d-0c9d-4e29-beca-cf745ca7331c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:55.612437 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c4641-0ef8-46b5-9f53-c59f92f2b800 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:55.613934 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c4641-0ef8-46b5-9f53-c59f92f2b800 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:55.623410 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4025/8071] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:41:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:41:55.624052 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-b5fb7f0d-0c9d-4e29-beca-cf745ca7331c None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:55.625537 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b5fb7f0d-0c9d-4e29-beca-cf745ca7331c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:55.633651 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4047/8072] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:41:55.637696 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c4641-0ef8-46b5-9f53-c59f92f2b800 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:55.648445 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c4641-0ef8-46b5-9f53-c59f92f2b800 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:55.653430 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0565928c-d983-496a-8f78-934e704a5e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:55.654163 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565928c-d983-496a-8f78-934e704a5e16 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:55.654610 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565928c-d983-496a-8f78-934e704a5e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:55.654894 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565928c-d983-496a-8f78-934e704a5e16 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:55.655617 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0565928c-d983-496a-8f78-934e704a5e16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:41:55.655924 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0565928c-d983-496a-8f78-934e704a5e16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:55.657529 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0565928c-d983-496a-8f78-934e704a5e16 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:55.669921 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4026/8073] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:41:55.674347 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb7f0d-0c9d-4e29-beca-cf745ca7331c None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:55.684422 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb7f0d-0c9d-4e29-beca-cf745ca7331c None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:55.689153 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe71fdb-0591-46b7-a3a2-6bfa94e2dc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:55.690010 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe71fdb-0591-46b7-a3a2-6bfa94e2dc32 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:55.690292 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe71fdb-0591-46b7-a3a2-6bfa94e2dc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:55.690596 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe71fdb-0591-46b7-a3a2-6bfa94e2dc32 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:55.691288 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe71fdb-0591-46b7-a3a2-6bfa94e2dc32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:55.693183 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe71fdb-0591-46b7-a3a2-6bfa94e2dc32 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:55.805979 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4048/8074] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:41:55 2022] POST /identity/v3/projects => generated 403 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:41:55.807087 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0565928c-d983-496a-8f78-934e704a5e16 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:55.817214 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0565928c-d983-496a-8f78-934e704a5e16 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:55.874314 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b87b63-cdf3-4572-8b34-6173087d644e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:55.874992 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b87b63-cdf3-4572-8b34-6173087d644e admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:55.875274 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b87b63-cdf3-4572-8b34-6173087d644e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:55.875544 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b87b63-cdf3-4572-8b34-6173087d644e admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:55.876311 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b87b63-cdf3-4572-8b34-6173087d644e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:55.881550 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b87b63-cdf3-4572-8b34-6173087d644e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:55.922461 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe71fdb-0591-46b7-a3a2-6bfa94e2dc32 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:55.924263 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5fe71fdb-0591-46b7-a3a2-6bfa94e2dc32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:55.936886 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe71fdb-0591-46b7-a3a2-6bfa94e2dc32 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:55.941479 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871524c1-abb2-4a6d-ac15-b8adcbee2661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:55.942380 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871524c1-abb2-4a6d-ac15-b8adcbee2661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:55.942663 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871524c1-abb2-4a6d-ac15-b8adcbee2661 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:55.942943 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871524c1-abb2-4a6d-ac15-b8adcbee2661 admin admin] PATH_INFO: `/v3/users/4e64b96aa2f940569ee08c2be4d09503` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:55.944190 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871524c1-abb2-4a6d-ac15-b8adcbee2661 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e64b96aa2f940569ee08c2be4d09503)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:55.946186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871524c1-abb2-4a6d-ac15-b8adcbee2661 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:55.987985 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4027/8075] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:41:55 2022] POST /identity/v3/users => generated 302 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:41:55.992068 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b87b63-cdf3-4572-8b34-6173087d644e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:56.004266 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b87b63-cdf3-4572-8b34-6173087d644e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:56.009003 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55cdb1-0910-4a63-91d3-5a63e94780b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:56.009651 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55cdb1-0910-4a63-91d3-5a63e94780b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:56.009966 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55cdb1-0910-4a63-91d3-5a63e94780b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:56.014050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55cdb1-0910-4a63-91d3-5a63e94780b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:56.014050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c55cdb1-0910-4a63-91d3-5a63e94780b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:56.014050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c55cdb1-0910-4a63-91d3-5a63e94780b8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:56.023175 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4028/8076] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:41:56.027271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55cdb1-0910-4a63-91d3-5a63e94780b8 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:56.036568 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55cdb1-0910-4a63-91d3-5a63e94780b8 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:56.041891 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6966a16-43a8-40a9-9e35-75e6f2f4f4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:56.043530 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6966a16-43a8-40a9-9e35-75e6f2f4f4d3 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:56.043530 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6966a16-43a8-40a9-9e35-75e6f2f4f4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:56.043530 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6966a16-43a8-40a9-9e35-75e6f2f4f4d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:56.043860 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6966a16-43a8-40a9-9e35-75e6f2f4f4d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:56.045405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6966a16-43a8-40a9-9e35-75e6f2f4f4d3 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:56.055726 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4029/8077] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:41:56.059424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6966a16-43a8-40a9-9e35-75e6f2f4f4d3 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:56.068913 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6966a16-43a8-40a9-9e35-75e6f2f4f4d3 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:56.073621 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5467a-58c9-4127-857b-cca30b0624ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:56.074645 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5467a-58c9-4127-857b-cca30b0624ee admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:56.074933 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5467a-58c9-4127-857b-cca30b0624ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:56.075210 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5467a-58c9-4127-857b-cca30b0624ee admin admin] PATH_INFO: `/v3/projects/488e643367734a5f8e3b5fa52db27b06/users/70a154891a444faa9ae5c741862ac9a9/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:56.089889 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff5467a-58c9-4127-857b-cca30b0624ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=488e643367734a5f8e3b5fa52db27b06, user_id=70a154891a444faa9ae5c741862ac9a9, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:56.092552 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff5467a-58c9-4127-857b-cca30b0624ee admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:56.126817 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-871524c1-abb2-4a6d-ac15-b8adcbee2661 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e64b96aa2f940569ee08c2be4d09503'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:56.139301 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-871524c1-abb2-4a6d-ac15-b8adcbee2661 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e64b96aa2f940569ee08c2be4d09503'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:56.197040 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4030/8078] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:41:56 2022] PUT /identity/v3/projects/488e643367734a5f8e3b5fa52db27b06/users/70a154891a444faa9ae5c741862ac9a9/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:41:56.208303 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f86ba2-1d48-4005-b476-ae04b3729be6 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:56.208581 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f86ba2-1d48-4005-b476-ae04b3729be6 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:56.208861 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f86ba2-1d48-4005-b476-ae04b3729be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:56.235129 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-82f86ba2-1d48-4005-b476-ae04b3729be6 None None] MFA Rules not processed for user `70a154891a444faa9ae5c741862ac9a9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:56.236374 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-82f86ba2-1d48-4005-b476-ae04b3729be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:56.258315 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-871524c1-abb2-4a6d-ac15-b8adcbee2661 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e64b96aa2f940569ee08c2be4d09503'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:56.266149 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-871524c1-abb2-4a6d-ac15-b8adcbee2661 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e64b96aa2f940569ee08c2be4d09503'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:56.266884 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-871524c1-abb2-4a6d-ac15-b8adcbee2661 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e64b96aa2f940569ee08c2be4d09503'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:56.277385 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4049/8079] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:41:55 2022] DELETE /identity/v3/users/4e64b96aa2f940569ee08c2be4d09503 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:41:56.279012 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bfd897-53ec-49de-ba74-f1526c087faf None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:56.283469 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bfd897-53ec-49de-ba74-f1526c087faf None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:56.283469 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bfd897-53ec-49de-ba74-f1526c087faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:56.296836 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-07bfd897-53ec-49de-ba74-f1526c087faf None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:56.298175 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-07bfd897-53ec-49de-ba74-f1526c087faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:56.305296 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4031/8080] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:41:56.320822 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f86ba2-1d48-4005-b476-ae04b3729be6 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:56.322203 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-82f86ba2-1d48-4005-b476-ae04b3729be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:56.356461 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4050/8081] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:41:56.366330 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bfd897-53ec-49de-ba74-f1526c087faf None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:56.367716 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-07bfd897-53ec-49de-ba74-f1526c087faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:56.387027 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f86ba2-1d48-4005-b476-ae04b3729be6 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:56.391704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645aa96-ecbe-4960-a747-572ae2401368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:56.392503 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645aa96-ecbe-4960-a747-572ae2401368 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:56.392909 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645aa96-ecbe-4960-a747-572ae2401368 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:56.393292 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645aa96-ecbe-4960-a747-572ae2401368 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:56.394042 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645aa96-ecbe-4960-a747-572ae2401368 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:56.396016 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645aa96-ecbe-4960-a747-572ae2401368 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:56.426283 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bfd897-53ec-49de-ba74-f1526c087faf None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:56.429925 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13e19a-5bb2-4304-8bca-52bccd94c1d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:56.430565 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13e19a-5bb2-4304-8bca-52bccd94c1d5 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:56.430844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13e19a-5bb2-4304-8bca-52bccd94c1d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:56.431118 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13e19a-5bb2-4304-8bca-52bccd94c1d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:56.440445 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13e19a-5bb2-4304-8bca-52bccd94c1d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:56.441920 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13e19a-5bb2-4304-8bca-52bccd94c1d5 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:56.451873 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4051/8082] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:41:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:41:56.488754 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4032/8083] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:41:56 2022] POST /identity/v3/projects => generated 405 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:41:56.494830 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13e19a-5bb2-4304-8bca-52bccd94c1d5 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:56.505570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13e19a-5bb2-4304-8bca-52bccd94c1d5 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:56.566467 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeaa7dc-0d1d-4a0e-923f-504aa20cafb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:56.567135 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeaa7dc-0d1d-4a0e-923f-504aa20cafb2 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:56.567417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeaa7dc-0d1d-4a0e-923f-504aa20cafb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:56.567694 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeaa7dc-0d1d-4a0e-923f-504aa20cafb2 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:56.569000 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeaa7dc-0d1d-4a0e-923f-504aa20cafb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:56.571017 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeaa7dc-0d1d-4a0e-923f-504aa20cafb2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:56.663683 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4052/8084] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:41:56 2022] POST /identity/v3/users => generated 309 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:41:56.667933 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645aa96-ecbe-4960-a747-572ae2401368 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:56.679604 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645aa96-ecbe-4960-a747-572ae2401368 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:56.685633 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb251c-977f-431c-af69-8895952a9ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:56.686344 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb251c-977f-431c-af69-8895952a9ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:56.686638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb251c-977f-431c-af69-8895952a9ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:56.686934 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb251c-977f-431c-af69-8895952a9ec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:56.687736 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb251c-977f-431c-af69-8895952a9ec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:56.689343 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb251c-977f-431c-af69-8895952a9ec6 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:56.700823 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4033/8085] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:41:56.705395 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeaa7dc-0d1d-4a0e-923f-504aa20cafb2 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:56.715522 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeaa7dc-0d1d-4a0e-923f-504aa20cafb2 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:56.720344 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed5b10-7ab7-4346-8cc0-f1bba35b2844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:56.731503 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed5b10-7ab7-4346-8cc0-f1bba35b2844 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:56.731503 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed5b10-7ab7-4346-8cc0-f1bba35b2844 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:56.731503 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed5b10-7ab7-4346-8cc0-f1bba35b2844 admin admin] PATH_INFO: `/v3/projects/eb4c6b85c5c94304b2ab6441501be6ad/users/1a8ea1d55c214bb5af540e645f41e1e0/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:56.737069 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed5b10-7ab7-4346-8cc0-f1bba35b2844 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb4c6b85c5c94304b2ab6441501be6ad, user_id=1a8ea1d55c214bb5af540e645f41e1e0, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:56.739788 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed5b10-7ab7-4346-8cc0-f1bba35b2844 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:56.812645 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4053/8086] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:41:56 2022] PUT /identity/v3/projects/eb4c6b85c5c94304b2ab6441501be6ad/users/1a8ea1d55c214bb5af540e645f41e1e0/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:41:56.816802 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb251c-977f-431c-af69-8895952a9ec6 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:56.827433 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb251c-977f-431c-af69-8895952a9ec6 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:56.880701 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b3130-6bf1-48c3-a463-31a2cb0fb4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:56.882110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b3130-6bf1-48c3-a463-31a2cb0fb4d0 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:56.882278 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b3130-6bf1-48c3-a463-31a2cb0fb4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:56.882567 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b3130-6bf1-48c3-a463-31a2cb0fb4d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:56.883333 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b3130-6bf1-48c3-a463-31a2cb0fb4d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:56.884882 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b3130-6bf1-48c3-a463-31a2cb0fb4d0 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:56.891473 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed5b10-7ab7-4346-8cc0-f1bba35b2844 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:56.894649 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5aed5b10-7ab7-4346-8cc0-f1bba35b2844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:56.897863 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4034/8087] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:41:56.901252 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b3130-6bf1-48c3-a463-31a2cb0fb4d0 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:56.911914 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b3130-6bf1-48c3-a463-31a2cb0fb4d0 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:56.917482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db42c6d-d70e-48b8-9500-1e499a08c213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:56.918418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db42c6d-d70e-48b8-9500-1e499a08c213 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:56.922965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db42c6d-d70e-48b8-9500-1e499a08c213 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:56.922965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db42c6d-d70e-48b8-9500-1e499a08c213 admin admin] PATH_INFO: `/v3/projects/eb4c6b85c5c94304b2ab6441501be6ad/users/1a8ea1d55c214bb5af540e645f41e1e0/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:56.922965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db42c6d-d70e-48b8-9500-1e499a08c213 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb4c6b85c5c94304b2ab6441501be6ad, user_id=1a8ea1d55c214bb5af540e645f41e1e0, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:56.923238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed5b10-7ab7-4346-8cc0-f1bba35b2844 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:56.923727 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db42c6d-d70e-48b8-9500-1e499a08c213 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:56.927472 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2308bd3-cda8-4997-a7f7-0514927ee5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:56.928979 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2308bd3-cda8-4997-a7f7-0514927ee5e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:56.929192 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2308bd3-cda8-4997-a7f7-0514927ee5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:56.929467 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2308bd3-cda8-4997-a7f7-0514927ee5e0 admin admin] PATH_INFO: `/v3/projects/1ae60d361c18453db192babfe66705c1` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:56.930748 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2308bd3-cda8-4997-a7f7-0514927ee5e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ae60d361c18453db192babfe66705c1)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:56.932656 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2308bd3-cda8-4997-a7f7-0514927ee5e0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:56.935435 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4035/8088] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:41:56 2022] PUT /identity/v3/projects/eb4c6b85c5c94304b2ab6441501be6ad/users/1a8ea1d55c214bb5af540e645f41e1e0/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:41:56.945648 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e33eb-eaba-4017-9b42-516af87708d5 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:56.946033 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e33eb-eaba-4017-9b42-516af87708d5 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:56.946327 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e33eb-eaba-4017-9b42-516af87708d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:56.973534 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-7d7e33eb-eaba-4017-9b42-516af87708d5 None None] MFA Rules not processed for user `1a8ea1d55c214bb5af540e645f41e1e0`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:56.975398 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7d7e33eb-eaba-4017-9b42-516af87708d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:57.027974 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e2308bd3-cda8-4997-a7f7-0514927ee5e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ae60d361c18453db192babfe66705c1', 'request_id': 'req-e2308bd3-cda8-4997-a7f7-0514927ee5e0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:57.033346 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e2308bd3-cda8-4997-a7f7-0514927ee5e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ae60d361c18453db192babfe66705c1', 'request_id': 'req-e2308bd3-cda8-4997-a7f7-0514927ee5e0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:57.040072 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e2308bd3-cda8-4997-a7f7-0514927ee5e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ae60d361c18453db192babfe66705c1', 'request_id': 'req-e2308bd3-cda8-4997-a7f7-0514927ee5e0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:57.042512 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4036/8089] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:56 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:41:57.054345 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e33eb-eaba-4017-9b42-516af87708d5 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:57.065136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7d7e33eb-eaba-4017-9b42-516af87708d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:57.113491 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e33eb-eaba-4017-9b42-516af87708d5 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:57.142000 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e2308bd3-cda8-4997-a7f7-0514927ee5e0 admin admin] The token cache is being invalidate because project 1ae60d361c18453db192babfe66705c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:41:57.142284 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e2308bd3-cda8-4997-a7f7-0514927ee5e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:57.142957 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e2308bd3-cda8-4997-a7f7-0514927ee5e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:57.144537 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4054/8090] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:41:56 2022] DELETE /identity/v3/projects/1ae60d361c18453db192babfe66705c1 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:41:57.149964 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b0bac-4e52-40fa-ad5c-1936ded85d10 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:57.150317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b0bac-4e52-40fa-ad5c-1936ded85d10 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:57.150663 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b0bac-4e52-40fa-ad5c-1936ded85d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:57.164073 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94fa5c-b8b8-4652-a6c7-c459c1045434 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:57.164656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94fa5c-b8b8-4652-a6c7-c459c1045434 service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:57.164939 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94fa5c-b8b8-4652-a6c7-c459c1045434 service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:57.165215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94fa5c-b8b8-4652-a6c7-c459c1045434 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:57.167237 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5f94fa5c-b8b8-4652-a6c7-c459c1045434 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:57.170242 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-050b0bac-4e52-40fa-ad5c-1936ded85d10 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:57.171459 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-050b0bac-4e52-40fa-ad5c-1936ded85d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:57.230003 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94fa5c-b8b8-4652-a6c7-c459c1045434 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:57.231734 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94fa5c-b8b8-4652-a6c7-c459c1045434 service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:57.238984 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4055/8091] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:41:57.244320 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4037/8092] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:41:57 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:41:57.248481 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4a2f7-4875-4236-8a15-640a4685842c None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:57.248778 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4a2f7-4875-4236-8a15-640a4685842c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:57.249063 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4a2f7-4875-4236-8a15-640a4685842c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:57.267055 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-03c4a2f7-4875-4236-8a15-640a4685842c None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:57.268311 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-03c4a2f7-4875-4236-8a15-640a4685842c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:57.277111 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4056/8093] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:41:57.281462 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94fa5c-b8b8-4652-a6c7-c459c1045434 service cinder] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:57.292679 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94fa5c-b8b8-4652-a6c7-c459c1045434 service cinder] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:57.297519 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc782d22-a9f5-4753-9b53-a65c93169e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:57.298224 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc782d22-a9f5-4753-9b53-a65c93169e7b admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:57.298536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc782d22-a9f5-4753-9b53-a65c93169e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:57.298818 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc782d22-a9f5-4753-9b53-a65c93169e7b admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:57.299592 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc782d22-a9f5-4753-9b53-a65c93169e7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:41:57.299907 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc782d22-a9f5-4753-9b53-a65c93169e7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:57.301548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc782d22-a9f5-4753-9b53-a65c93169e7b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:57.316287 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4038/8094] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:41:57.321100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4a2f7-4875-4236-8a15-640a4685842c None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:57.330454 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4a2f7-4875-4236-8a15-640a4685842c None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:57.335179 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdfdea2-3f77-4435-9f03-6ae668702365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:57.335869 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfdea2-3f77-4435-9f03-6ae668702365 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:57.336152 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfdea2-3f77-4435-9f03-6ae668702365 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:57.336428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfdea2-3f77-4435-9f03-6ae668702365 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:57.337114 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdfdea2-3f77-4435-9f03-6ae668702365 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:57.339054 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdfdea2-3f77-4435-9f03-6ae668702365 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:57.386611 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc782d22-a9f5-4753-9b53-a65c93169e7b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:57.388412 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-fc782d22-a9f5-4753-9b53-a65c93169e7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:57.401364 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc782d22-a9f5-4753-9b53-a65c93169e7b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:57.406016 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e29d3e-0656-4eb6-8510-c3a7b81989fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:57.406878 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e29d3e-0656-4eb6-8510-c3a7b81989fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:57.407160 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e29d3e-0656-4eb6-8510-c3a7b81989fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:57.407433 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e29d3e-0656-4eb6-8510-c3a7b81989fd admin admin] PATH_INFO: `/v3/users/70a154891a444faa9ae5c741862ac9a9` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:57.408653 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e29d3e-0656-4eb6-8510-c3a7b81989fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=70a154891a444faa9ae5c741862ac9a9)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:57.410679 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e29d3e-0656-4eb6-8510-c3a7b81989fd admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:57.426633 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4057/8095] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:41:57 2022] POST /identity/v3/projects => generated 359 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:41:57.428139 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdfdea2-3f77-4435-9f03-6ae668702365 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:57.486861 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdfdea2-3f77-4435-9f03-6ae668702365 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:57.492291 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1a9e3-1732-46e3-b8e5-0c156eb1d8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:57.492984 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1a9e3-1732-46e3-b8e5-0c156eb1d8dd admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:57.493315 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1a9e3-1732-46e3-b8e5-0c156eb1d8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:57.493598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1a9e3-1732-46e3-b8e5-0c156eb1d8dd admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:57.494339 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a1a9e3-1732-46e3-b8e5-0c156eb1d8dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:57.496349 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a1a9e3-1732-46e3-b8e5-0c156eb1d8dd admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:57.601115 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4058/8096] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:41:57 2022] POST /identity/v3/users => generated 280 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:41:57.605144 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1a9e3-1732-46e3-b8e5-0c156eb1d8dd admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:57.615058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1a9e3-1732-46e3-b8e5-0c156eb1d8dd admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:57.620262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28d5c1-8236-443c-a19d-904cd751efbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:57.620917 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28d5c1-8236-443c-a19d-904cd751efbd admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:57.621198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28d5c1-8236-443c-a19d-904cd751efbd admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:57.621298 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d0e29d3e-0656-4eb6-8510-c3a7b81989fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70a154891a444faa9ae5c741862ac9a9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:57.621475 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28d5c1-8236-443c-a19d-904cd751efbd admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:57.622261 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed28d5c1-8236-443c-a19d-904cd751efbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:57.623868 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed28d5c1-8236-443c-a19d-904cd751efbd admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:57.633550 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d0e29d3e-0656-4eb6-8510-c3a7b81989fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70a154891a444faa9ae5c741862ac9a9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:57.634604 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4059/8097] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:41:57.638579 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28d5c1-8236-443c-a19d-904cd751efbd admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:57.648105 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28d5c1-8236-443c-a19d-904cd751efbd admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:57.653090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa199f-0dbf-4387-8b33-cb3b63e66acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:57.653714 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa199f-0dbf-4387-8b33-cb3b63e66acf admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:57.654030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa199f-0dbf-4387-8b33-cb3b63e66acf admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:57.654310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa199f-0dbf-4387-8b33-cb3b63e66acf admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:57.655014 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa199f-0dbf-4387-8b33-cb3b63e66acf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:57.656693 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa199f-0dbf-4387-8b33-cb3b63e66acf admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:57.667444 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4060/8098] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:41:57.673136 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa199f-0dbf-4387-8b33-cb3b63e66acf admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:57.682446 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa199f-0dbf-4387-8b33-cb3b63e66acf admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:57.687311 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed57d5-39ef-4e63-9044-6412c2a861e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:57.688157 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed57d5-39ef-4e63-9044-6412c2a861e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:57.688436 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed57d5-39ef-4e63-9044-6412c2a861e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:57.688711 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed57d5-39ef-4e63-9044-6412c2a861e4 admin admin] PATH_INFO: `/v3/projects/6ab8dab5b457417db332136906fb204a/users/0c8b3c5311484f528fde13cc9f838c71/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:57.702669 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed57d5-39ef-4e63-9044-6412c2a861e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ab8dab5b457417db332136906fb204a, user_id=0c8b3c5311484f528fde13cc9f838c71, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:57.705305 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed57d5-39ef-4e63-9044-6412c2a861e4 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:57.721107 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d0e29d3e-0656-4eb6-8510-c3a7b81989fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70a154891a444faa9ae5c741862ac9a9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:57.725136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d0e29d3e-0656-4eb6-8510-c3a7b81989fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70a154891a444faa9ae5c741862ac9a9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:57.729589 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d0e29d3e-0656-4eb6-8510-c3a7b81989fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70a154891a444faa9ae5c741862ac9a9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:57.735769 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4039/8099] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:41:57 2022] DELETE /identity/v3/users/70a154891a444faa9ae5c741862ac9a9 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:41:57.740230 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64664428-bfc0-49ec-a4cd-d32af3183207 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:57.741064 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64664428-bfc0-49ec-a4cd-d32af3183207 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:57.741361 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64664428-bfc0-49ec-a4cd-d32af3183207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:57.758196 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-64664428-bfc0-49ec-a4cd-d32af3183207 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:57.759441 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-64664428-bfc0-49ec-a4cd-d32af3183207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:57.778758 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4061/8100] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:41:57 2022] PUT /identity/v3/projects/6ab8dab5b457417db332136906fb204a/users/0c8b3c5311484f528fde13cc9f838c71/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:41:57.788874 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128de3c-d3d6-480d-9a51-555d5d8054e1 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:57.793889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128de3c-d3d6-480d-9a51-555d5d8054e1 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:57.793889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128de3c-d3d6-480d-9a51-555d5d8054e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:57.816465 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-3128de3c-d3d6-480d-9a51-555d5d8054e1 None None] MFA Rules not processed for user `0c8b3c5311484f528fde13cc9f838c71`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:57.817681 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3128de3c-d3d6-480d-9a51-555d5d8054e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:57.818073 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4040/8101] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:41:57.827640 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64664428-bfc0-49ec-a4cd-d32af3183207 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:57.833518 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-64664428-bfc0-49ec-a4cd-d32af3183207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:57.880943 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4062/8102] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:57 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:41:57.888373 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64664428-bfc0-49ec-a4cd-d32af3183207 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:57.891036 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128de3c-d3d6-480d-9a51-555d5d8054e1 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:57.937494 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939a2af-1ff4-4905-86d9-e79ed734ae80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:57.938104 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939a2af-1ff4-4905-86d9-e79ed734ae80 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:57.938385 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939a2af-1ff4-4905-86d9-e79ed734ae80 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:57.938657 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939a2af-1ff4-4905-86d9-e79ed734ae80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:57.947018 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128de3c-d3d6-480d-9a51-555d5d8054e1 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:57.950727 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7646599-4e55-4aba-8fc5-99e701d81aa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:57.951372 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7646599-4e55-4aba-8fc5-99e701d81aa0 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:57.951653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7646599-4e55-4aba-8fc5-99e701d81aa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:57.952180 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7646599-4e55-4aba-8fc5-99e701d81aa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:57.960394 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7646599-4e55-4aba-8fc5-99e701d81aa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:57.961871 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7646599-4e55-4aba-8fc5-99e701d81aa0 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:57.970640 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4063/8103] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:41:57 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:41:57.998960 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939a2af-1ff4-4905-86d9-e79ed734ae80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:58.000419 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939a2af-1ff4-4905-86d9-e79ed734ae80 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:58.010461 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4041/8104] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:41:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:41:58.420665 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7646599-4e55-4aba-8fc5-99e701d81aa0 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:58.422261 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e7646599-4e55-4aba-8fc5-99e701d81aa0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:58.449523 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7646599-4e55-4aba-8fc5-99e701d81aa0 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:58.454724 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0ffa6-3135-497c-b694-c394b137fc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:58.455778 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0ffa6-3135-497c-b694-c394b137fc89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:58.456062 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0ffa6-3135-497c-b694-c394b137fc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:58.456342 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0ffa6-3135-497c-b694-c394b137fc89 admin admin] PATH_INFO: `/v3/projects/488e643367734a5f8e3b5fa52db27b06` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:58.457553 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb0ffa6-3135-497c-b694-c394b137fc89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=488e643367734a5f8e3b5fa52db27b06)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:58.460314 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb0ffa6-3135-497c-b694-c394b137fc89 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:58.579827 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4cb0ffa6-3135-497c-b694-c394b137fc89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '488e643367734a5f8e3b5fa52db27b06', 'request_id': 'req-4cb0ffa6-3135-497c-b694-c394b137fc89'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:58.586854 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4cb0ffa6-3135-497c-b694-c394b137fc89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '488e643367734a5f8e3b5fa52db27b06', 'request_id': 'req-4cb0ffa6-3135-497c-b694-c394b137fc89'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:58.593486 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4cb0ffa6-3135-497c-b694-c394b137fc89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '488e643367734a5f8e3b5fa52db27b06', 'request_id': 'req-4cb0ffa6-3135-497c-b694-c394b137fc89'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:58.680825 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4cb0ffa6-3135-497c-b694-c394b137fc89 admin admin] The token cache is being invalidate because project 488e643367734a5f8e3b5fa52db27b06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:41:58.681287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4cb0ffa6-3135-497c-b694-c394b137fc89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:58.682103 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4cb0ffa6-3135-497c-b694-c394b137fc89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:58.683871 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4064/8105] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:41:58 2022] DELETE /identity/v3/projects/488e643367734a5f8e3b5fa52db27b06 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:41:58.687826 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939a2af-1ff4-4905-86d9-e79ed734ae80 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:58.698335 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939a2af-1ff4-4905-86d9-e79ed734ae80 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:58.752713 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b42a45-06ff-4b03-88b7-cfa1a271a221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:58.753599 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b42a45-06ff-4b03-88b7-cfa1a271a221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:58.753897 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b42a45-06ff-4b03-88b7-cfa1a271a221 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:58.754177 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b42a45-06ff-4b03-88b7-cfa1a271a221 admin admin] PATH_INFO: `/v3/users/1a8ea1d55c214bb5af540e645f41e1e0` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:58.755356 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b42a45-06ff-4b03-88b7-cfa1a271a221 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a8ea1d55c214bb5af540e645f41e1e0)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:58.757868 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b42a45-06ff-4b03-88b7-cfa1a271a221 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:58.932641 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-84b42a45-06ff-4b03-88b7-cfa1a271a221 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a8ea1d55c214bb5af540e645f41e1e0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:58.944838 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-84b42a45-06ff-4b03-88b7-cfa1a271a221 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a8ea1d55c214bb5af540e645f41e1e0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:59.024238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-84b42a45-06ff-4b03-88b7-cfa1a271a221 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a8ea1d55c214bb5af540e645f41e1e0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:59.025210 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-84b42a45-06ff-4b03-88b7-cfa1a271a221 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a8ea1d55c214bb5af540e645f41e1e0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:59.032950 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-84b42a45-06ff-4b03-88b7-cfa1a271a221 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a8ea1d55c214bb5af540e645f41e1e0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:59.039750 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4042/8106] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:41:58 2022] DELETE /identity/v3/users/1a8ea1d55c214bb5af540e645f41e1e0 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:41:59.448237 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0ffa6-3135-497c-b694-c394b137fc89 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:59.449692 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4cb0ffa6-3135-497c-b694-c394b137fc89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:59.462514 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0ffa6-3135-497c-b694-c394b137fc89 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:59.520792 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc905ce5-574f-461d-b6b6-e7642a832ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:59.522198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc905ce5-574f-461d-b6b6-e7642a832ad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:59.522483 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc905ce5-574f-461d-b6b6-e7642a832ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:59.522758 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc905ce5-574f-461d-b6b6-e7642a832ad5 admin admin] PATH_INFO: `/v3/projects/eb4c6b85c5c94304b2ab6441501be6ad` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:59.524001 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc905ce5-574f-461d-b6b6-e7642a832ad5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb4c6b85c5c94304b2ab6441501be6ad)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:59.526249 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc905ce5-574f-461d-b6b6-e7642a832ad5 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:59.650781 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cc905ce5-574f-461d-b6b6-e7642a832ad5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb4c6b85c5c94304b2ab6441501be6ad', 'request_id': 'req-cc905ce5-574f-461d-b6b6-e7642a832ad5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:59.655943 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cc905ce5-574f-461d-b6b6-e7642a832ad5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb4c6b85c5c94304b2ab6441501be6ad', 'request_id': 'req-cc905ce5-574f-461d-b6b6-e7642a832ad5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:59.662043 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cc905ce5-574f-461d-b6b6-e7642a832ad5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb4c6b85c5c94304b2ab6441501be6ad', 'request_id': 'req-cc905ce5-574f-461d-b6b6-e7642a832ad5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:59.764231 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cc905ce5-574f-461d-b6b6-e7642a832ad5 admin admin] The token cache is being invalidate because project eb4c6b85c5c94304b2ab6441501be6ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:41:59.764521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cc905ce5-574f-461d-b6b6-e7642a832ad5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:59.765152 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cc905ce5-574f-461d-b6b6-e7642a832ad5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:41:59.766735 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4065/8107] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:41:59 2022] DELETE /identity/v3/projects/eb4c6b85c5c94304b2ab6441501be6ad => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:41:59.772124 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5b4cc-5d58-4c47-ad4d-65ce3ebca173 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:59.772418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5b4cc-5d58-4c47-ad4d-65ce3ebca173 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:59.772726 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5b4cc-5d58-4c47-ad4d-65ce3ebca173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:59.799241 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-1de5b4cc-5d58-4c47-ad4d-65ce3ebca173 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:59.799241 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1de5b4cc-5d58-4c47-ad4d-65ce3ebca173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:59.856487 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4043/8108] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:41:59.864586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332300ca-a72d-4fae-af25-1a0cf4fc3b6d None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:59.864881 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332300ca-a72d-4fae-af25-1a0cf4fc3b6d None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:59.865164 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332300ca-a72d-4fae-af25-1a0cf4fc3b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:59.884427 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-332300ca-a72d-4fae-af25-1a0cf4fc3b6d None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:41:59.885875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-332300ca-a72d-4fae-af25-1a0cf4fc3b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:41:59.899759 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4066/8109] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:41:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:41:59.900193 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5b4cc-5d58-4c47-ad4d-65ce3ebca173 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:59.911529 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5b4cc-5d58-4c47-ad4d-65ce3ebca173 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:59.917049 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b5dddc-110d-48a0-9acc-67bd3b7d35c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:59.917988 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5dddc-110d-48a0-9acc-67bd3b7d35c9 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:59.918395 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5dddc-110d-48a0-9acc-67bd3b7d35c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:59.918738 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5dddc-110d-48a0-9acc-67bd3b7d35c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:59.919623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b5dddc-110d-48a0-9acc-67bd3b7d35c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:41:59.920187 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b5dddc-110d-48a0-9acc-67bd3b7d35c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:59.922140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b5dddc-110d-48a0-9acc-67bd3b7d35c9 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:41:59.936122 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4044/8110] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:41:59.940625 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332300ca-a72d-4fae-af25-1a0cf4fc3b6d None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:41:59.950825 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332300ca-a72d-4fae-af25-1a0cf4fc3b6d None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:41:59.956562 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c76644-0bb3-42bc-bd8c-14bd752426e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:41:59.957226 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c76644-0bb3-42bc-bd8c-14bd752426e0 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:41:59.958437 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c76644-0bb3-42bc-bd8c-14bd752426e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:41:59.958437 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c76644-0bb3-42bc-bd8c-14bd752426e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:41:59.958678 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c76644-0bb3-42bc-bd8c-14bd752426e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:41:59.961319 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c76644-0bb3-42bc-bd8c-14bd752426e0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:00.063904 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4067/8111] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:41:59 2022] POST /identity/v3/projects => generated 403 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:42:00.069372 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b5dddc-110d-48a0-9acc-67bd3b7d35c9 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:00.080406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b5dddc-110d-48a0-9acc-67bd3b7d35c9 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:00.144392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52392db-af5e-4c58-9f77-2b446c388f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:00.145318 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52392db-af5e-4c58-9f77-2b446c388f82 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:00.145769 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52392db-af5e-4c58-9f77-2b446c388f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:00.146155 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52392db-af5e-4c58-9f77-2b446c388f82 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:00.147678 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52392db-af5e-4c58-9f77-2b446c388f82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:00.150121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52392db-af5e-4c58-9f77-2b446c388f82 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:00.245804 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4045/8112] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:42:00 2022] POST /identity/v3/users => generated 302 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:42:00.249675 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c76644-0bb3-42bc-bd8c-14bd752426e0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:00.260526 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c76644-0bb3-42bc-bd8c-14bd752426e0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:00.265148 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b654c6-415a-4048-8f45-c68e7302f96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:00.265987 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b654c6-415a-4048-8f45-c68e7302f96c admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:00.266271 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b654c6-415a-4048-8f45-c68e7302f96c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:00.266565 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b654c6-415a-4048-8f45-c68e7302f96c admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:00.267260 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b654c6-415a-4048-8f45-c68e7302f96c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:00.268866 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b654c6-415a-4048-8f45-c68e7302f96c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:00.283494 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4068/8113] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:42:00.287586 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52392db-af5e-4c58-9f77-2b446c388f82 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:00.297947 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52392db-af5e-4c58-9f77-2b446c388f82 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:00.303456 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454d41e-0bae-4ada-85ae-e7b322c2dd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:00.304112 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454d41e-0bae-4ada-85ae-e7b322c2dd94 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:00.304395 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454d41e-0bae-4ada-85ae-e7b322c2dd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:00.304672 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454d41e-0bae-4ada-85ae-e7b322c2dd94 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:00.305386 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454d41e-0bae-4ada-85ae-e7b322c2dd94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:00.307026 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454d41e-0bae-4ada-85ae-e7b322c2dd94 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:00.318164 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4046/8114] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:42:00.322616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b654c6-415a-4048-8f45-c68e7302f96c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:00.332631 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b654c6-415a-4048-8f45-c68e7302f96c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:00.337747 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7919161-e4a4-4c11-8bcf-e4bb06b3def6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:00.342050 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7919161-e4a4-4c11-8bcf-e4bb06b3def6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:00.342050 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7919161-e4a4-4c11-8bcf-e4bb06b3def6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:00.342050 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7919161-e4a4-4c11-8bcf-e4bb06b3def6 admin admin] PATH_INFO: `/v3/projects/41bf2ae4f1f24eb39fe38f4782b6c969/users/57068a2c57784ab48fb24cb92a4543e3/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:00.357449 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7919161-e4a4-4c11-8bcf-e4bb06b3def6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41bf2ae4f1f24eb39fe38f4782b6c969, user_id=57068a2c57784ab48fb24cb92a4543e3, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:00.361041 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7919161-e4a4-4c11-8bcf-e4bb06b3def6 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:00.452500 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4069/8115] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:42:00 2022] PUT /identity/v3/projects/41bf2ae4f1f24eb39fe38f4782b6c969/users/57068a2c57784ab48fb24cb92a4543e3/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:42:00.457865 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e07a3c-0367-4374-b24f-95cacd9e8ad1 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:00.458099 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e07a3c-0367-4374-b24f-95cacd9e8ad1 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:00.458432 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e07a3c-0367-4374-b24f-95cacd9e8ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:00.477636 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-66e07a3c-0367-4374-b24f-95cacd9e8ad1 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:42:00.479057 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-66e07a3c-0367-4374-b24f-95cacd9e8ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:42:00.538580 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4047/8116] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:42:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:42:00.548369 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7919161-e4a4-4c11-8bcf-e4bb06b3def6 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:00.550123 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d7919161-e4a4-4c11-8bcf-e4bb06b3def6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:42:00.615648 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7919161-e4a4-4c11-8bcf-e4bb06b3def6 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:00.619354 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8550a-5e99-4684-ba7d-b8e26b80f41d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:00.619995 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8550a-5e99-4684-ba7d-b8e26b80f41d service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:00.620309 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8550a-5e99-4684-ba7d-b8e26b80f41d service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:00.620582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8550a-5e99-4684-ba7d-b8e26b80f41d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:00.630017 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb8550a-5e99-4684-ba7d-b8e26b80f41d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:00.631459 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb8550a-5e99-4684-ba7d-b8e26b80f41d service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:00.641018 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4070/8117] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:42:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:42:02.763930 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9637f-999a-4cfc-8bfe-9eefa2fde4a1 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:02.764417 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9637f-999a-4cfc-8bfe-9eefa2fde4a1 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:02.764507 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9637f-999a-4cfc-8bfe-9eefa2fde4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:02.802856 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-b7c9637f-999a-4cfc-8bfe-9eefa2fde4a1 None None] MFA Rules not processed for user `57068a2c57784ab48fb24cb92a4543e3`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:42:02.806317 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b7c9637f-999a-4cfc-8bfe-9eefa2fde4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:42:02.874960 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4048/8118] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:42:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:42:02.879033 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8550a-5e99-4684-ba7d-b8e26b80f41d service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:02.889084 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8550a-5e99-4684-ba7d-b8e26b80f41d service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:02.893896 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13111d12-bd28-40d8-b04f-0a3fc36f0405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:02.894765 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13111d12-bd28-40d8-b04f-0a3fc36f0405 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:02.895244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13111d12-bd28-40d8-b04f-0a3fc36f0405 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:02.895569 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13111d12-bd28-40d8-b04f-0a3fc36f0405 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:02.896293 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13111d12-bd28-40d8-b04f-0a3fc36f0405 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:02.899346 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13111d12-bd28-40d8-b04f-0a3fc36f0405 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:02.999757 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4071/8119] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:42:02 2022] POST /identity/v3/projects => generated 405 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:42:03.003806 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9637f-999a-4cfc-8bfe-9eefa2fde4a1 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:03.016252 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9637f-999a-4cfc-8bfe-9eefa2fde4a1 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:03.085003 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b63fa9-459d-4e16-b770-485bb17f7823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:03.085909 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b63fa9-459d-4e16-b770-485bb17f7823 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:03.086269 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b63fa9-459d-4e16-b770-485bb17f7823 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:03.086681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b63fa9-459d-4e16-b770-485bb17f7823 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:03.087512 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b63fa9-459d-4e16-b770-485bb17f7823 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:03.089588 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b63fa9-459d-4e16-b770-485bb17f7823 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:03.209908 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4049/8120] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:42:03 2022] POST /identity/v3/users => generated 309 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:42:03.213892 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13111d12-bd28-40d8-b04f-0a3fc36f0405 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:03.234076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13111d12-bd28-40d8-b04f-0a3fc36f0405 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:03.239986 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e837f-1376-46c4-bcec-8a0b6e108b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:03.240752 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e837f-1376-46c4-bcec-8a0b6e108b11 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:03.241038 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e837f-1376-46c4-bcec-8a0b6e108b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:03.241847 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e837f-1376-46c4-bcec-8a0b6e108b11 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:03.242435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e837f-1376-46c4-bcec-8a0b6e108b11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:03.244071 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e837f-1376-46c4-bcec-8a0b6e108b11 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:03.258980 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4072/8121] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:42:03.260234 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b63fa9-459d-4e16-b770-485bb17f7823 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:03.272732 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b63fa9-459d-4e16-b770-485bb17f7823 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:03.284136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f5cdbe-0018-46e6-be27-1d713c9d0fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:03.285983 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5cdbe-0018-46e6-be27-1d713c9d0fcf admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:03.286459 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5cdbe-0018-46e6-be27-1d713c9d0fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:03.286841 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f5cdbe-0018-46e6-be27-1d713c9d0fcf admin admin] PATH_INFO: `/v3/projects/89d059729fda4d359c0b61f8b9a23293/users/09c8177c9b5c4be08815ceabf567ed6a/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:03.306459 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f5cdbe-0018-46e6-be27-1d713c9d0fcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=89d059729fda4d359c0b61f8b9a23293, user_id=09c8177c9b5c4be08815ceabf567ed6a, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:03.309650 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f5cdbe-0018-46e6-be27-1d713c9d0fcf admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:03.392367 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4050/8122] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:42:03 2022] PUT /identity/v3/projects/89d059729fda4d359c0b61f8b9a23293/users/09c8177c9b5c4be08815ceabf567ed6a/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:42:03.396420 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e837f-1376-46c4-bcec-8a0b6e108b11 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:03.407529 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e837f-1376-46c4-bcec-8a0b6e108b11 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:03.546593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804577f0-b30a-40b4-b293-3f6622725425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:03.547522 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804577f0-b30a-40b4-b293-3f6622725425 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:03.548039 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804577f0-b30a-40b4-b293-3f6622725425 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:03.548413 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804577f0-b30a-40b4-b293-3f6622725425 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:03.549495 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804577f0-b30a-40b4-b293-3f6622725425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:03.552093 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804577f0-b30a-40b4-b293-3f6622725425 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:03.571856 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4073/8123] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:42:03.573579 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f5cdbe-0018-46e6-be27-1d713c9d0fcf admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:03.592471 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f5cdbe-0018-46e6-be27-1d713c9d0fcf admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:03.603542 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0b7dd-b774-46b7-87ae-d05ed538054e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:03.603732 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0b7dd-b774-46b7-87ae-d05ed538054e admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:03.604015 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0b7dd-b774-46b7-87ae-d05ed538054e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:03.604340 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0b7dd-b774-46b7-87ae-d05ed538054e admin admin] PATH_INFO: `/v3/projects/89d059729fda4d359c0b61f8b9a23293/users/09c8177c9b5c4be08815ceabf567ed6a/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:03.607671 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0b7dd-b774-46b7-87ae-d05ed538054e admin admin] RBAC: Authorizing `identity:create_grant(project_id=89d059729fda4d359c0b61f8b9a23293, user_id=09c8177c9b5c4be08815ceabf567ed6a, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:03.618313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0b7dd-b774-46b7-87ae-d05ed538054e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:03.635289 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4051/8124] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:42:03 2022] PUT /identity/v3/projects/89d059729fda4d359c0b61f8b9a23293/users/09c8177c9b5c4be08815ceabf567ed6a/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:42:04.917732 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b73568-e254-4bd3-9fba-ddd5329f74fe None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:04.918307 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b73568-e254-4bd3-9fba-ddd5329f74fe None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:04.918307 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b73568-e254-4bd3-9fba-ddd5329f74fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:04.947922 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-e4b73568-e254-4bd3-9fba-ddd5329f74fe None None] MFA Rules not processed for user `09c8177c9b5c4be08815ceabf567ed6a`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:42:04.949208 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e4b73568-e254-4bd3-9fba-ddd5329f74fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:42:05.023033 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4074/8125] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:42:04 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:42:06.781539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0b7dd-b774-46b7-87ae-d05ed538054e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:06.847859 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0b7dd-b774-46b7-87ae-d05ed538054e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:06.852541 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f3274-ba31-462c-8f8e-086134cd8ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:06.853503 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f3274-ba31-462c-8f8e-086134cd8ecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:06.853856 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f3274-ba31-462c-8f8e-086134cd8ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:06.854136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f3274-ba31-462c-8f8e-086134cd8ecd admin admin] PATH_INFO: `/v3/users/57068a2c57784ab48fb24cb92a4543e3` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:06.855339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f3274-ba31-462c-8f8e-086134cd8ecd admin admin] RBAC: Authorizing `identity:delete_user(user_id=57068a2c57784ab48fb24cb92a4543e3)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:06.857377 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f3274-ba31-462c-8f8e-086134cd8ecd admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:07.037627 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-404f3274-ba31-462c-8f8e-086134cd8ecd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57068a2c57784ab48fb24cb92a4543e3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:42:07.049890 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-404f3274-ba31-462c-8f8e-086134cd8ecd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57068a2c57784ab48fb24cb92a4543e3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:42:07.133009 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-404f3274-ba31-462c-8f8e-086134cd8ecd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57068a2c57784ab48fb24cb92a4543e3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:42:07.133661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-404f3274-ba31-462c-8f8e-086134cd8ecd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57068a2c57784ab48fb24cb92a4543e3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:42:07.141691 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-404f3274-ba31-462c-8f8e-086134cd8ecd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57068a2c57784ab48fb24cb92a4543e3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:42:07.148267 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4052/8126] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:42:06 2022] DELETE /identity/v3/users/57068a2c57784ab48fb24cb92a4543e3 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:42:07.420959 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b73568-e254-4bd3-9fba-ddd5329f74fe None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:07.433386 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b73568-e254-4bd3-9fba-ddd5329f74fe None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:07.491209 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf81a3-3037-4d31-8439-da4fc0b51a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:07.492073 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf81a3-3037-4d31-8439-da4fc0b51a7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:07.492358 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf81a3-3037-4d31-8439-da4fc0b51a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:07.492631 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf81a3-3037-4d31-8439-da4fc0b51a7f admin admin] PATH_INFO: `/v3/projects/41bf2ae4f1f24eb39fe38f4782b6c969` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:07.493854 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf81a3-3037-4d31-8439-da4fc0b51a7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=41bf2ae4f1f24eb39fe38f4782b6c969)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:07.495772 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf81a3-3037-4d31-8439-da4fc0b51a7f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:07.614740 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1dbf81a3-3037-4d31-8439-da4fc0b51a7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41bf2ae4f1f24eb39fe38f4782b6c969', 'request_id': 'req-1dbf81a3-3037-4d31-8439-da4fc0b51a7f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:42:07.620568 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1dbf81a3-3037-4d31-8439-da4fc0b51a7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41bf2ae4f1f24eb39fe38f4782b6c969', 'request_id': 'req-1dbf81a3-3037-4d31-8439-da4fc0b51a7f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:42:07.626996 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1dbf81a3-3037-4d31-8439-da4fc0b51a7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41bf2ae4f1f24eb39fe38f4782b6c969', 'request_id': 'req-1dbf81a3-3037-4d31-8439-da4fc0b51a7f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:42:07.702314 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1dbf81a3-3037-4d31-8439-da4fc0b51a7f admin admin] The token cache is being invalidate because project 41bf2ae4f1f24eb39fe38f4782b6c969 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:42:07.702758 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1dbf81a3-3037-4d31-8439-da4fc0b51a7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:42:07.703401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-1dbf81a3-3037-4d31-8439-da4fc0b51a7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:42:07.705194 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4075/8127] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:42:07 2022] DELETE /identity/v3/projects/41bf2ae4f1f24eb39fe38f4782b6c969 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:42:07.709004 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f3274-ba31-462c-8f8e-086134cd8ecd admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:07.710539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-404f3274-ba31-462c-8f8e-086134cd8ecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:42:07.725661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f3274-ba31-462c-8f8e-086134cd8ecd admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:07.781998 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc8a93-09e0-4e7c-9cc9-b68cb6c58f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:07.782877 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc8a93-09e0-4e7c-9cc9-b68cb6c58f99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:07.783165 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc8a93-09e0-4e7c-9cc9-b68cb6c58f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:07.783438 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc8a93-09e0-4e7c-9cc9-b68cb6c58f99 admin admin] PATH_INFO: `/v3/users/09c8177c9b5c4be08815ceabf567ed6a` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:07.784638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc8a93-09e0-4e7c-9cc9-b68cb6c58f99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09c8177c9b5c4be08815ceabf567ed6a)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:07.786672 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc8a93-09e0-4e7c-9cc9-b68cb6c58f99 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:07.984754 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-eedc8a93-09e0-4e7c-9cc9-b68cb6c58f99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09c8177c9b5c4be08815ceabf567ed6a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:42:07.996322 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-eedc8a93-09e0-4e7c-9cc9-b68cb6c58f99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09c8177c9b5c4be08815ceabf567ed6a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:42:08.091038 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-eedc8a93-09e0-4e7c-9cc9-b68cb6c58f99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09c8177c9b5c4be08815ceabf567ed6a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:42:08.091641 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-eedc8a93-09e0-4e7c-9cc9-b68cb6c58f99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09c8177c9b5c4be08815ceabf567ed6a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:42:08.099207 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-eedc8a93-09e0-4e7c-9cc9-b68cb6c58f99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09c8177c9b5c4be08815ceabf567ed6a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:42:08.106438 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4053/8128] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:42:07 2022] DELETE /identity/v3/users/09c8177c9b5c4be08815ceabf567ed6a => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:42:08.353617 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf81a3-3037-4d31-8439-da4fc0b51a7f admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:08.355250 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1dbf81a3-3037-4d31-8439-da4fc0b51a7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:42:08.368607 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf81a3-3037-4d31-8439-da4fc0b51a7f admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:08.439423 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4ff6c-96a9-4add-8d2f-3450335cddf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:08.440294 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4ff6c-96a9-4add-8d2f-3450335cddf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:08.440583 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4ff6c-96a9-4add-8d2f-3450335cddf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:08.440866 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4ff6c-96a9-4add-8d2f-3450335cddf4 admin admin] PATH_INFO: `/v3/projects/89d059729fda4d359c0b61f8b9a23293` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:08.442123 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4ff6c-96a9-4add-8d2f-3450335cddf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89d059729fda4d359c0b61f8b9a23293)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:08.444661 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4ff6c-96a9-4add-8d2f-3450335cddf4 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:08.563337 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-eef4ff6c-96a9-4add-8d2f-3450335cddf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89d059729fda4d359c0b61f8b9a23293', 'request_id': 'req-eef4ff6c-96a9-4add-8d2f-3450335cddf4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:42:08.571019 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-eef4ff6c-96a9-4add-8d2f-3450335cddf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89d059729fda4d359c0b61f8b9a23293', 'request_id': 'req-eef4ff6c-96a9-4add-8d2f-3450335cddf4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:42:08.578415 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-eef4ff6c-96a9-4add-8d2f-3450335cddf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89d059729fda4d359c0b61f8b9a23293', 'request_id': 'req-eef4ff6c-96a9-4add-8d2f-3450335cddf4'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:42:08.675218 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-eef4ff6c-96a9-4add-8d2f-3450335cddf4 admin admin] The token cache is being invalidate because project 89d059729fda4d359c0b61f8b9a23293 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:42:08.675653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-eef4ff6c-96a9-4add-8d2f-3450335cddf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:42:08.676596 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-eef4ff6c-96a9-4add-8d2f-3450335cddf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:42:08.679182 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4076/8129] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:42:08 2022] DELETE /identity/v3/projects/89d059729fda4d359c0b61f8b9a23293 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:42:08.684118 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b0327-64bc-4966-9123-4a20ba64fc69 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:08.684413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b0327-64bc-4966-9123-4a20ba64fc69 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:08.684699 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b0327-64bc-4966-9123-4a20ba64fc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:08.705018 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-e73b0327-64bc-4966-9123-4a20ba64fc69 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:42:08.707576 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e73b0327-64bc-4966-9123-4a20ba64fc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:42:08.774904 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4054/8130] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:42:08.783015 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454dd8c-60a4-4701-bb25-e901fd0607f3 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:08.783305 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454dd8c-60a4-4701-bb25-e901fd0607f3 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:08.783583 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454dd8c-60a4-4701-bb25-e901fd0607f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:08.802387 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-1454dd8c-60a4-4701-bb25-e901fd0607f3 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:42:08.804507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1454dd8c-60a4-4701-bb25-e901fd0607f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:42:08.812971 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4077/8131] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:42:08.817403 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b0327-64bc-4966-9123-4a20ba64fc69 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:08.828879 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b0327-64bc-4966-9123-4a20ba64fc69 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:08.833671 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1815ed-bc00-4a6f-b99e-b8ab80b44af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:08.834383 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1815ed-bc00-4a6f-b99e-b8ab80b44af1 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:08.834669 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1815ed-bc00-4a6f-b99e-b8ab80b44af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:08.834979 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1815ed-bc00-4a6f-b99e-b8ab80b44af1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:08.835746 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1815ed-bc00-4a6f-b99e-b8ab80b44af1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:42:08.836057 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1815ed-bc00-4a6f-b99e-b8ab80b44af1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:08.837700 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1815ed-bc00-4a6f-b99e-b8ab80b44af1 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:08.853809 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4055/8132] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:42:08.855069 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454dd8c-60a4-4701-bb25-e901fd0607f3 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:08.864760 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454dd8c-60a4-4701-bb25-e901fd0607f3 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:08.870106 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e001d04-fe7b-4ae2-8127-18643d62bf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:08.870781 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e001d04-fe7b-4ae2-8127-18643d62bf66 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:08.871065 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e001d04-fe7b-4ae2-8127-18643d62bf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:08.871343 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e001d04-fe7b-4ae2-8127-18643d62bf66 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:08.872070 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e001d04-fe7b-4ae2-8127-18643d62bf66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:08.874044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e001d04-fe7b-4ae2-8127-18643d62bf66 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:08.991745 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4078/8133] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:42:08 2022] POST /identity/v3/projects => generated 369 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:42:08.996100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1815ed-bc00-4a6f-b99e-b8ab80b44af1 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:09.007213 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1815ed-bc00-4a6f-b99e-b8ab80b44af1 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:09.065618 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94439085-7307-454e-acb9-66c53feb39ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:09.066237 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94439085-7307-454e-acb9-66c53feb39ee admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:09.066526 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94439085-7307-454e-acb9-66c53feb39ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:09.066805 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94439085-7307-454e-acb9-66c53feb39ee admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:09.067499 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94439085-7307-454e-acb9-66c53feb39ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:09.070004 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94439085-7307-454e-acb9-66c53feb39ee admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:09.167689 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4056/8134] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:42:08 2022] POST /identity/v3/users => generated 285 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:42:09.171816 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e001d04-fe7b-4ae2-8127-18643d62bf66 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:09.182194 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e001d04-fe7b-4ae2-8127-18643d62bf66 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:09.187016 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b6375-23df-4702-970f-b37c99d97f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:09.187675 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b6375-23df-4702-970f-b37c99d97f76 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:09.187959 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b6375-23df-4702-970f-b37c99d97f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:09.188239 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b6375-23df-4702-970f-b37c99d97f76 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:09.189061 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b6375-23df-4702-970f-b37c99d97f76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:09.190731 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b6375-23df-4702-970f-b37c99d97f76 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:09.201675 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4079/8135] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:42:09.205738 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94439085-7307-454e-acb9-66c53feb39ee admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:09.217228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94439085-7307-454e-acb9-66c53feb39ee admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:09.221890 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e36a7-a081-4591-839a-c9fad69f2466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:09.222951 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e36a7-a081-4591-839a-c9fad69f2466 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:09.223237 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e36a7-a081-4591-839a-c9fad69f2466 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:09.223513 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e36a7-a081-4591-839a-c9fad69f2466 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:09.224232 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e36a7-a081-4591-839a-c9fad69f2466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:09.225941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e36a7-a081-4591-839a-c9fad69f2466 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:09.236058 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4057/8136] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:42:09.241000 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b6375-23df-4702-970f-b37c99d97f76 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:09.251158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b6375-23df-4702-970f-b37c99d97f76 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:09.256375 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2dc4e1-3c88-44c0-b063-397aa216ae8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:09.257243 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2dc4e1-3c88-44c0-b063-397aa216ae8a admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:09.257540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2dc4e1-3c88-44c0-b063-397aa216ae8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:09.257876 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2dc4e1-3c88-44c0-b063-397aa216ae8a admin admin] PATH_INFO: `/v3/projects/024847d690ad4c97bcbf2cbcae3528a9/users/59ba4182e9bb48d4b62fec255ffba024/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:09.272944 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2dc4e1-3c88-44c0-b063-397aa216ae8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=024847d690ad4c97bcbf2cbcae3528a9, user_id=59ba4182e9bb48d4b62fec255ffba024, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:09.275948 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2dc4e1-3c88-44c0-b063-397aa216ae8a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:09.350907 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4080/8137] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:42:09 2022] PUT /identity/v3/projects/024847d690ad4c97bcbf2cbcae3528a9/users/59ba4182e9bb48d4b62fec255ffba024/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:42:09.367168 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a321071-353f-48ec-a66c-8aad9609a87c None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:09.367452 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a321071-353f-48ec-a66c-8aad9609a87c None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:09.367867 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a321071-353f-48ec-a66c-8aad9609a87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:09.396797 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-1a321071-353f-48ec-a66c-8aad9609a87c None None] MFA Rules not processed for user `59ba4182e9bb48d4b62fec255ffba024`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:42:09.398062 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1a321071-353f-48ec-a66c-8aad9609a87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:42:09.463293 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4058/8138] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:42:09 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:42:09.467801 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2dc4e1-3c88-44c0-b063-397aa216ae8a admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:09.534192 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2dc4e1-3c88-44c0-b063-397aa216ae8a admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:09.538904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d774a-734e-4081-8127-38805a172fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:09.539567 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d774a-734e-4081-8127-38805a172fbf admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:09.539853 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d774a-734e-4081-8127-38805a172fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:09.540136 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d774a-734e-4081-8127-38805a172fbf admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:09.540831 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d774a-734e-4081-8127-38805a172fbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:09.542801 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d774a-734e-4081-8127-38805a172fbf admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:09.625828 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4081/8139] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:42:09 2022] POST /identity/v3/projects => generated 369 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:42:09.629726 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a321071-353f-48ec-a66c-8aad9609a87c None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:09.641178 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a321071-353f-48ec-a66c-8aad9609a87c None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:09.699731 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0fc0f6-3d33-42d8-b68d-008474a90f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:09.699731 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fc0f6-3d33-42d8-b68d-008474a90f3a admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:09.699731 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fc0f6-3d33-42d8-b68d-008474a90f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:09.699731 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fc0f6-3d33-42d8-b68d-008474a90f3a admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:09.700296 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0fc0f6-3d33-42d8-b68d-008474a90f3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:09.702575 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0fc0f6-3d33-42d8-b68d-008474a90f3a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:09.784186 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4059/8140] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:42:09 2022] POST /identity/v3/users => generated 291 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:42:09.788761 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d774a-734e-4081-8127-38805a172fbf admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:09.799802 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d774a-734e-4081-8127-38805a172fbf admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:09.805115 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31935398-50d7-4213-8dcf-1ecf36a82045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:09.805810 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31935398-50d7-4213-8dcf-1ecf36a82045 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:09.806105 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31935398-50d7-4213-8dcf-1ecf36a82045 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:09.806384 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31935398-50d7-4213-8dcf-1ecf36a82045 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:09.807108 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31935398-50d7-4213-8dcf-1ecf36a82045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:09.808756 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31935398-50d7-4213-8dcf-1ecf36a82045 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:09.819847 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4082/8141] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:42:09.831631 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0fc0f6-3d33-42d8-b68d-008474a90f3a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:09.841671 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0fc0f6-3d33-42d8-b68d-008474a90f3a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:09.846452 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6052d2-b41d-4e84-8da0-9a589dde6f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:09.847278 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6052d2-b41d-4e84-8da0-9a589dde6f56 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:09.847564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6052d2-b41d-4e84-8da0-9a589dde6f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:09.847842 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6052d2-b41d-4e84-8da0-9a589dde6f56 admin admin] PATH_INFO: `/v3/projects/bb23305e90f84d90a74583bd15d98c0a/users/1f5698ba8e9241ae9c0c97341d9c123f/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:09.863373 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6052d2-b41d-4e84-8da0-9a589dde6f56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb23305e90f84d90a74583bd15d98c0a, user_id=1f5698ba8e9241ae9c0c97341d9c123f, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:09.866991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6052d2-b41d-4e84-8da0-9a589dde6f56 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:09.955945 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4060/8142] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:42:09 2022] PUT /identity/v3/projects/bb23305e90f84d90a74583bd15d98c0a/users/1f5698ba8e9241ae9c0c97341d9c123f/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:42:09.960030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31935398-50d7-4213-8dcf-1ecf36a82045 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:09.970382 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31935398-50d7-4213-8dcf-1ecf36a82045 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:10.026604 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a58527-213c-4c0d-9593-e40b81f04876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:10.027276 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a58527-213c-4c0d-9593-e40b81f04876 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:10.027563 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a58527-213c-4c0d-9593-e40b81f04876 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:10.027976 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a58527-213c-4c0d-9593-e40b81f04876 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:10.028721 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a58527-213c-4c0d-9593-e40b81f04876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:10.030399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a58527-213c-4c0d-9593-e40b81f04876 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:10.045474 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4083/8143] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:42:10.047511 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6052d2-b41d-4e84-8da0-9a589dde6f56 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:10.059948 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6052d2-b41d-4e84-8da0-9a589dde6f56 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:10.065893 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6cd657-f1c1-418e-81e7-4ec6bfeede54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:10.066984 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cd657-f1c1-418e-81e7-4ec6bfeede54 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:10.067367 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cd657-f1c1-418e-81e7-4ec6bfeede54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:10.067744 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cd657-f1c1-418e-81e7-4ec6bfeede54 admin admin] PATH_INFO: `/v3/projects/bb23305e90f84d90a74583bd15d98c0a/users/1f5698ba8e9241ae9c0c97341d9c123f/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:10.070211 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6cd657-f1c1-418e-81e7-4ec6bfeede54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb23305e90f84d90a74583bd15d98c0a, user_id=1f5698ba8e9241ae9c0c97341d9c123f, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:10.073741 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6cd657-f1c1-418e-81e7-4ec6bfeede54 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:10.095468 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4061/8144] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:42:10 2022] PUT /identity/v3/projects/bb23305e90f84d90a74583bd15d98c0a/users/1f5698ba8e9241ae9c0c97341d9c123f/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:42:10.097256 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe578114-af48-4be5-ae9e-1c5cc37487d5 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:10.097494 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe578114-af48-4be5-ae9e-1c5cc37487d5 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:10.097793 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe578114-af48-4be5-ae9e-1c5cc37487d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:10.126416 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-fe578114-af48-4be5-ae9e-1c5cc37487d5 None None] MFA Rules not processed for user `1f5698ba8e9241ae9c0c97341d9c123f`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:42:10.127743 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-fe578114-af48-4be5-ae9e-1c5cc37487d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:42:10.216568 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4084/8145] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:42:10 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:42:10.228866 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6cd657-f1c1-418e-81e7-4ec6bfeede54 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:10.230866 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1c6cd657-f1c1-418e-81e7-4ec6bfeede54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:42:10.309548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6cd657-f1c1-418e-81e7-4ec6bfeede54 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:10.314080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a74eb-3634-4792-a765-972b0dba7449 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:10.314864 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a74eb-3634-4792-a765-972b0dba7449 service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:10.315355 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a74eb-3634-4792-a765-972b0dba7449 service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:10.315752 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a74eb-3634-4792-a765-972b0dba7449 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:10.326259 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a74eb-3634-4792-a765-972b0dba7449 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:10.327818 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a74eb-3634-4792-a765-972b0dba7449 service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:10.338718 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4062/8146] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:42:10 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:42:13.303417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe578114-af48-4be5-ae9e-1c5cc37487d5 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:13.371404 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe578114-af48-4be5-ae9e-1c5cc37487d5 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:13.376061 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d6b31-6967-46db-b605-6c96a5db1047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:13.376964 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d6b31-6967-46db-b605-6c96a5db1047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:13.377545 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d6b31-6967-46db-b605-6c96a5db1047 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:13.378123 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d6b31-6967-46db-b605-6c96a5db1047 admin admin] PATH_INFO: `/v3/users/59ba4182e9bb48d4b62fec255ffba024` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:13.379493 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d6b31-6967-46db-b605-6c96a5db1047 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59ba4182e9bb48d4b62fec255ffba024)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:13.382235 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d6b31-6967-46db-b605-6c96a5db1047 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:13.568793 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-613d6b31-6967-46db-b605-6c96a5db1047 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59ba4182e9bb48d4b62fec255ffba024'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:42:13.580769 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-613d6b31-6967-46db-b605-6c96a5db1047 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59ba4182e9bb48d4b62fec255ffba024'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:42:13.659252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-613d6b31-6967-46db-b605-6c96a5db1047 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59ba4182e9bb48d4b62fec255ffba024'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:42:13.668074 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-613d6b31-6967-46db-b605-6c96a5db1047 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59ba4182e9bb48d4b62fec255ffba024'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:42:13.668847 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-613d6b31-6967-46db-b605-6c96a5db1047 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59ba4182e9bb48d4b62fec255ffba024'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:42:13.675158 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4085/8147] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:42:13 2022] DELETE /identity/v3/users/59ba4182e9bb48d4b62fec255ffba024 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:42:13.680661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e33a8-e799-4cb3-bce8-3d1026643684 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:13.680661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e33a8-e799-4cb3-bce8-3d1026643684 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:13.681204 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e33a8-e799-4cb3-bce8-3d1026643684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:13.700922 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-294e33a8-e799-4cb3-bce8-3d1026643684 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:42:13.702220 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-294e33a8-e799-4cb3-bce8-3d1026643684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:42:13.764123 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4063/8148] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:42:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:42:13.774980 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d6b31-6967-46db-b605-6c96a5db1047 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:13.776443 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-613d6b31-6967-46db-b605-6c96a5db1047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:42:13.839707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d6b31-6967-46db-b605-6c96a5db1047 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:13.843565 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23fcd9-8189-4c32-97e6-1a3995e18404 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:13.844391 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23fcd9-8189-4c32-97e6-1a3995e18404 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:13.844685 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23fcd9-8189-4c32-97e6-1a3995e18404 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:13.844966 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23fcd9-8189-4c32-97e6-1a3995e18404 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:13.855410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23fcd9-8189-4c32-97e6-1a3995e18404 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:13.856866 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23fcd9-8189-4c32-97e6-1a3995e18404 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:13.866829 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4086/8149] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:42:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:42:14.429730 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e33a8-e799-4cb3-bce8-3d1026643684 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:14.431185 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-294e33a8-e799-4cb3-bce8-3d1026643684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:42:14.443589 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e33a8-e799-4cb3-bce8-3d1026643684 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:14.453181 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe66d3-703e-447f-884c-3dc34274e911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:14.454096 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe66d3-703e-447f-884c-3dc34274e911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:14.454382 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe66d3-703e-447f-884c-3dc34274e911 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:14.454661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe66d3-703e-447f-884c-3dc34274e911 admin admin] PATH_INFO: `/v3/projects/024847d690ad4c97bcbf2cbcae3528a9` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:14.455969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe66d3-703e-447f-884c-3dc34274e911 admin admin] RBAC: Authorizing `identity:delete_project(project_id=024847d690ad4c97bcbf2cbcae3528a9)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:14.457968 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe66d3-703e-447f-884c-3dc34274e911 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:14.602661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2bfe66d3-703e-447f-884c-3dc34274e911 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '024847d690ad4c97bcbf2cbcae3528a9', 'request_id': 'req-2bfe66d3-703e-447f-884c-3dc34274e911'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:42:14.617234 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2bfe66d3-703e-447f-884c-3dc34274e911 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '024847d690ad4c97bcbf2cbcae3528a9', 'request_id': 'req-2bfe66d3-703e-447f-884c-3dc34274e911'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:42:14.632340 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2bfe66d3-703e-447f-884c-3dc34274e911 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '024847d690ad4c97bcbf2cbcae3528a9', 'request_id': 'req-2bfe66d3-703e-447f-884c-3dc34274e911'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:42:14.712181 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2bfe66d3-703e-447f-884c-3dc34274e911 admin admin] The token cache is being invalidate because project 024847d690ad4c97bcbf2cbcae3528a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:42:14.713816 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2bfe66d3-703e-447f-884c-3dc34274e911 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:42:14.716126 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2bfe66d3-703e-447f-884c-3dc34274e911 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:42:14.718123 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4064/8150] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:42:14 2022] DELETE /identity/v3/projects/024847d690ad4c97bcbf2cbcae3528a9 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:42:14.722315 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23fcd9-8189-4c32-97e6-1a3995e18404 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:14.735129 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23fcd9-8189-4c32-97e6-1a3995e18404 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:14.820060 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b038a7-46f6-4d63-b2e0-370eb1c64297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:14.821170 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b038a7-46f6-4d63-b2e0-370eb1c64297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:14.821620 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b038a7-46f6-4d63-b2e0-370eb1c64297 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:14.822074 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b038a7-46f6-4d63-b2e0-370eb1c64297 admin admin] PATH_INFO: `/v3/users/1f5698ba8e9241ae9c0c97341d9c123f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:14.823819 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b038a7-46f6-4d63-b2e0-370eb1c64297 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f5698ba8e9241ae9c0c97341d9c123f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:14.826382 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b038a7-46f6-4d63-b2e0-370eb1c64297 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:15.068302 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-63b038a7-46f6-4d63-b2e0-370eb1c64297 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f5698ba8e9241ae9c0c97341d9c123f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:42:15.096837 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-63b038a7-46f6-4d63-b2e0-370eb1c64297 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f5698ba8e9241ae9c0c97341d9c123f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:42:15.167959 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-63b038a7-46f6-4d63-b2e0-370eb1c64297 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f5698ba8e9241ae9c0c97341d9c123f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:42:15.179063 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-63b038a7-46f6-4d63-b2e0-370eb1c64297 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f5698ba8e9241ae9c0c97341d9c123f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:42:15.179889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-63b038a7-46f6-4d63-b2e0-370eb1c64297 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f5698ba8e9241ae9c0c97341d9c123f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:42:15.186902 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4087/8151] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:42:14 2022] DELETE /identity/v3/users/1f5698ba8e9241ae9c0c97341d9c123f => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:42:15.617324 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe66d3-703e-447f-884c-3dc34274e911 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:15.619774 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2bfe66d3-703e-447f-884c-3dc34274e911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:42:15.637987 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe66d3-703e-447f-884c-3dc34274e911 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:15.705877 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a697aa52-0e4f-4622-929d-2bc26e966592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:15.706751 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697aa52-0e4f-4622-929d-2bc26e966592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:15.707061 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697aa52-0e4f-4622-929d-2bc26e966592 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:15.707823 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697aa52-0e4f-4622-929d-2bc26e966592 admin admin] PATH_INFO: `/v3/projects/bb23305e90f84d90a74583bd15d98c0a` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:15.710331 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a697aa52-0e4f-4622-929d-2bc26e966592 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb23305e90f84d90a74583bd15d98c0a)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:15.712542 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a697aa52-0e4f-4622-929d-2bc26e966592 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:15.817465 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a697aa52-0e4f-4622-929d-2bc26e966592 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb23305e90f84d90a74583bd15d98c0a', 'request_id': 'req-a697aa52-0e4f-4622-929d-2bc26e966592'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:42:15.824434 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a697aa52-0e4f-4622-929d-2bc26e966592 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb23305e90f84d90a74583bd15d98c0a', 'request_id': 'req-a697aa52-0e4f-4622-929d-2bc26e966592'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:42:15.831165 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a697aa52-0e4f-4622-929d-2bc26e966592 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb23305e90f84d90a74583bd15d98c0a', 'request_id': 'req-a697aa52-0e4f-4622-929d-2bc26e966592'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:42:15.896211 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a697aa52-0e4f-4622-929d-2bc26e966592 admin admin] The token cache is being invalidate because project bb23305e90f84d90a74583bd15d98c0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:42:15.897365 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a697aa52-0e4f-4622-929d-2bc26e966592 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:42:15.898232 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a697aa52-0e4f-4622-929d-2bc26e966592 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:42:15.900694 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4065/8152] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:42:15 2022] DELETE /identity/v3/projects/bb23305e90f84d90a74583bd15d98c0a => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:42:15.910080 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05d417-b095-413e-a222-e406373354b0 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:15.910555 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05d417-b095-413e-a222-e406373354b0 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:15.910634 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05d417-b095-413e-a222-e406373354b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:15.929079 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-1f05d417-b095-413e-a222-e406373354b0 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:42:15.930415 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1f05d417-b095-413e-a222-e406373354b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:42:15.993932 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4088/8153] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:42:16.002868 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393f156-9b2c-4ec1-90b3-a0d33a07858b None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:16.003239 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393f156-9b2c-4ec1-90b3-a0d33a07858b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:16.003618 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393f156-9b2c-4ec1-90b3-a0d33a07858b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:16.023582 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-7393f156-9b2c-4ec1-90b3-a0d33a07858b None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:42:16.025045 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7393f156-9b2c-4ec1-90b3-a0d33a07858b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:42:16.033271 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4066/8154] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:42:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:42:16.038190 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05d417-b095-413e-a222-e406373354b0 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:16.048240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05d417-b095-413e-a222-e406373354b0 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:16.052863 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9bfa6-7878-4ff3-88ba-980098094f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:16.053506 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9bfa6-7878-4ff3-88ba-980098094f20 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:16.053887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9bfa6-7878-4ff3-88ba-980098094f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:16.054168 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9bfa6-7878-4ff3-88ba-980098094f20 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:16.054884 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9bfa6-7878-4ff3-88ba-980098094f20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:42:16.055192 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9bfa6-7878-4ff3-88ba-980098094f20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:16.056802 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9bfa6-7878-4ff3-88ba-980098094f20 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:16.071911 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4089/8155] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:42:16.077470 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393f156-9b2c-4ec1-90b3-a0d33a07858b None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:16.082826 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393f156-9b2c-4ec1-90b3-a0d33a07858b None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:16.088410 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3756b40f-1a14-4992-a81b-aec0f6bc49dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:16.089162 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756b40f-1a14-4992-a81b-aec0f6bc49dd admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:16.089532 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756b40f-1a14-4992-a81b-aec0f6bc49dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:16.089843 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756b40f-1a14-4992-a81b-aec0f6bc49dd admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:16.090704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3756b40f-1a14-4992-a81b-aec0f6bc49dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:16.092640 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3756b40f-1a14-4992-a81b-aec0f6bc49dd admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:16.203573 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4067/8156] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:42:16 2022] POST /identity/v3/projects => generated 377 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:42:16.207599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9bfa6-7878-4ff3-88ba-980098094f20 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:16.222027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9bfa6-7878-4ff3-88ba-980098094f20 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:16.281960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce584c4e-7323-4132-93c9-47b25ffbd74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:16.282636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce584c4e-7323-4132-93c9-47b25ffbd74a admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:16.282921 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce584c4e-7323-4132-93c9-47b25ffbd74a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:16.283193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce584c4e-7323-4132-93c9-47b25ffbd74a admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:16.283965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce584c4e-7323-4132-93c9-47b25ffbd74a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:16.285933 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce584c4e-7323-4132-93c9-47b25ffbd74a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:16.380009 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4090/8157] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:42:16 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:42:16.381982 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3756b40f-1a14-4992-a81b-aec0f6bc49dd admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:16.392090 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3756b40f-1a14-4992-a81b-aec0f6bc49dd admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:16.396830 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf040b2-ec9b-4e45-8cdf-8c48a8edb5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:16.397577 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf040b2-ec9b-4e45-8cdf-8c48a8edb5be admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:16.397893 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf040b2-ec9b-4e45-8cdf-8c48a8edb5be admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:16.398174 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf040b2-ec9b-4e45-8cdf-8c48a8edb5be admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:16.398890 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf040b2-ec9b-4e45-8cdf-8c48a8edb5be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:16.400763 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf040b2-ec9b-4e45-8cdf-8c48a8edb5be admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:16.411242 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4068/8158] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:42:16.415726 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce584c4e-7323-4132-93c9-47b25ffbd74a admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:16.425630 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce584c4e-7323-4132-93c9-47b25ffbd74a admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:16.431734 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e2649-cfd8-45ca-95f3-5fbaf024bbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:16.432327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e2649-cfd8-45ca-95f3-5fbaf024bbef admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:16.432611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e2649-cfd8-45ca-95f3-5fbaf024bbef admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:16.432883 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e2649-cfd8-45ca-95f3-5fbaf024bbef admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:16.433608 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e2649-cfd8-45ca-95f3-5fbaf024bbef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:16.435246 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e2649-cfd8-45ca-95f3-5fbaf024bbef admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:16.445336 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4091/8159] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:42:16.453793 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf040b2-ec9b-4e45-8cdf-8c48a8edb5be admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:16.463761 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf040b2-ec9b-4e45-8cdf-8c48a8edb5be admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:16.468663 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ec250-599d-4069-b352-b884db448fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:16.469548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ec250-599d-4069-b352-b884db448fb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:16.469876 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ec250-599d-4069-b352-b884db448fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:16.470156 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ec250-599d-4069-b352-b884db448fb8 admin admin] PATH_INFO: `/v3/projects/50cc8aa73054488585bff076ca15cd47/users/5f3844e94a3349f4910da1ab405fa87a/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:16.485178 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ec250-599d-4069-b352-b884db448fb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50cc8aa73054488585bff076ca15cd47, user_id=5f3844e94a3349f4910da1ab405fa87a, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:16.487953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ec250-599d-4069-b352-b884db448fb8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:16.585459 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4069/8160] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:42:16 2022] PUT /identity/v3/projects/50cc8aa73054488585bff076ca15cd47/users/5f3844e94a3349f4910da1ab405fa87a/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:42:16.596687 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f27503-fa1b-40b1-9e61-6496caa8c050 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:16.596982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f27503-fa1b-40b1-9e61-6496caa8c050 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:16.597265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f27503-fa1b-40b1-9e61-6496caa8c050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:16.635887 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-b9f27503-fa1b-40b1-9e61-6496caa8c050 None None] MFA Rules not processed for user `5f3844e94a3349f4910da1ab405fa87a`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:42:16.637120 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b9f27503-fa1b-40b1-9e61-6496caa8c050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:42:16.709800 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4092/8161] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:42:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:42:16.714475 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ec250-599d-4069-b352-b884db448fb8 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:16.792504 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ec250-599d-4069-b352-b884db448fb8 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:16.801027 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e533c2a-9345-41bc-8e0d-268d7f19e93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:16.805064 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e533c2a-9345-41bc-8e0d-268d7f19e93b admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:16.805515 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e533c2a-9345-41bc-8e0d-268d7f19e93b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:16.805940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e533c2a-9345-41bc-8e0d-268d7f19e93b admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:16.807221 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e533c2a-9345-41bc-8e0d-268d7f19e93b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:16.811941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e533c2a-9345-41bc-8e0d-268d7f19e93b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:16.922100 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4070/8162] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:42:16 2022] POST /identity/v3/projects => generated 375 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:42:16.926166 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f27503-fa1b-40b1-9e61-6496caa8c050 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:16.938910 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f27503-fa1b-40b1-9e61-6496caa8c050 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:17.000186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898a063-b1a0-49ea-a904-5fe176e6c5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:17.000786 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898a063-b1a0-49ea-a904-5fe176e6c5fe admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:17.001073 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898a063-b1a0-49ea-a904-5fe176e6c5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:17.001352 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898a063-b1a0-49ea-a904-5fe176e6c5fe admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:17.002163 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7898a063-b1a0-49ea-a904-5fe176e6c5fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:17.004131 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7898a063-b1a0-49ea-a904-5fe176e6c5fe admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:17.082881 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4093/8163] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:42:16 2022] POST /identity/v3/users => generated 294 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:42:17.086878 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e533c2a-9345-41bc-8e0d-268d7f19e93b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:17.098196 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e533c2a-9345-41bc-8e0d-268d7f19e93b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:17.103531 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41f910-25f1-4fda-b594-ec4cade867c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:17.104218 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41f910-25f1-4fda-b594-ec4cade867c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:17.104507 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41f910-25f1-4fda-b594-ec4cade867c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:17.104790 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41f910-25f1-4fda-b594-ec4cade867c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:17.105522 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e41f910-25f1-4fda-b594-ec4cade867c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:17.107212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e41f910-25f1-4fda-b594-ec4cade867c7 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:17.120168 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4071/8164] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:42:17.124859 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898a063-b1a0-49ea-a904-5fe176e6c5fe admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:17.136471 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898a063-b1a0-49ea-a904-5fe176e6c5fe admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:17.141839 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf119c2a-4c0f-445d-8ce6-ba2a597c25a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:17.143103 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf119c2a-4c0f-445d-8ce6-ba2a597c25a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:17.143362 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf119c2a-4c0f-445d-8ce6-ba2a597c25a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:17.143647 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf119c2a-4c0f-445d-8ce6-ba2a597c25a3 admin admin] PATH_INFO: `/v3/projects/489943ed072b4e34a9ae0afa4b7c7b01/users/db67da2a01af49e5918b6d4f9941dfc8/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:17.160961 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf119c2a-4c0f-445d-8ce6-ba2a597c25a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=489943ed072b4e34a9ae0afa4b7c7b01, user_id=db67da2a01af49e5918b6d4f9941dfc8, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:17.164315 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf119c2a-4c0f-445d-8ce6-ba2a597c25a3 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:17.236292 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4094/8165] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:42:17 2022] PUT /identity/v3/projects/489943ed072b4e34a9ae0afa4b7c7b01/users/db67da2a01af49e5918b6d4f9941dfc8/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:42:17.241195 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41f910-25f1-4fda-b594-ec4cade867c7 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:17.251817 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41f910-25f1-4fda-b594-ec4cade867c7 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:17.312617 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed25532-1f50-4000-adab-943ecedfaf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:17.313299 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed25532-1f50-4000-adab-943ecedfaf8d admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:17.313589 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed25532-1f50-4000-adab-943ecedfaf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:17.313907 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed25532-1f50-4000-adab-943ecedfaf8d admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:17.314643 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed25532-1f50-4000-adab-943ecedfaf8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:17.316260 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed25532-1f50-4000-adab-943ecedfaf8d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:17.329461 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4072/8166] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:42:17.330786 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf119c2a-4c0f-445d-8ce6-ba2a597c25a3 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:17.341544 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf119c2a-4c0f-445d-8ce6-ba2a597c25a3 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:17.346350 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230888f9-8aaa-4497-a5e3-fa272f119ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:17.347344 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230888f9-8aaa-4497-a5e3-fa272f119ae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:17.347702 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230888f9-8aaa-4497-a5e3-fa272f119ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:17.348050 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230888f9-8aaa-4497-a5e3-fa272f119ae5 admin admin] PATH_INFO: `/v3/projects/489943ed072b4e34a9ae0afa4b7c7b01/users/db67da2a01af49e5918b6d4f9941dfc8/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:17.350850 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230888f9-8aaa-4497-a5e3-fa272f119ae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=489943ed072b4e34a9ae0afa4b7c7b01, user_id=db67da2a01af49e5918b6d4f9941dfc8, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:17.353646 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230888f9-8aaa-4497-a5e3-fa272f119ae5 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:17.364685 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4095/8167] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:42:17 2022] PUT /identity/v3/projects/489943ed072b4e34a9ae0afa4b7c7b01/users/db67da2a01af49e5918b6d4f9941dfc8/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:42:17.375821 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e54041-e25c-4643-acda-82233b787577 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:17.376144 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e54041-e25c-4643-acda-82233b787577 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:17.376426 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e54041-e25c-4643-acda-82233b787577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:17.403429 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-67e54041-e25c-4643-acda-82233b787577 None None] MFA Rules not processed for user `db67da2a01af49e5918b6d4f9941dfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:42:17.404662 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-67e54041-e25c-4643-acda-82233b787577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:42:17.483840 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4073/8168] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:42:17 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:42:17.496955 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230888f9-8aaa-4497-a5e3-fa272f119ae5 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:17.498898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-230888f9-8aaa-4497-a5e3-fa272f119ae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:42:17.562590 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230888f9-8aaa-4497-a5e3-fa272f119ae5 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:17.567987 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6feda-40dc-4ec9-83e8-04bd3c728e38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:17.568702 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6feda-40dc-4ec9-83e8-04bd3c728e38 service cinder] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:17.568992 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6feda-40dc-4ec9-83e8-04bd3c728e38 service cinder] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:17.569274 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6feda-40dc-4ec9-83e8-04bd3c728e38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:17.628057 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed6feda-40dc-4ec9-83e8-04bd3c728e38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:17.629615 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed6feda-40dc-4ec9-83e8-04bd3c728e38 service cinder] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:17.644706 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4096/8169] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:42:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:42:24.004198 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e54041-e25c-4643-acda-82233b787577 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:42:24.005738 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-67e54041-e25c-4643-acda-82233b787577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:42:24.019863 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e54041-e25c-4643-acda-82233b787577 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:42:24.023372 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a344c-c23b-459a-bf1c-17534c67bc99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:42:24.024019 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a344c-c23b-459a-bf1c-17534c67bc99 service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:42:24.024301 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a344c-c23b-459a-bf1c-17534c67bc99 service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:42:24.024571 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a344c-c23b-459a-bf1c-17534c67bc99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:42:24.034586 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a344c-c23b-459a-bf1c-17534c67bc99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:42:24.038276 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a344c-c23b-459a-bf1c-17534c67bc99 service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:42:24.047047 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4074/8170] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:42:24 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:43:01.091586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6feda-40dc-4ec9-83e8-04bd3c728e38 service cinder] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:01.154360 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6feda-40dc-4ec9-83e8-04bd3c728e38 service cinder] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:01.158937 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8555bc2-7a19-4740-a8d2-a2b121edb8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:01.159808 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8555bc2-7a19-4740-a8d2-a2b121edb8b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:01.160087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8555bc2-7a19-4740-a8d2-a2b121edb8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:01.160358 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8555bc2-7a19-4740-a8d2-a2b121edb8b8 admin admin] PATH_INFO: `/v3/users/5f3844e94a3349f4910da1ab405fa87a` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:01.161620 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8555bc2-7a19-4740-a8d2-a2b121edb8b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f3844e94a3349f4910da1ab405fa87a)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:01.163578 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8555bc2-7a19-4740-a8d2-a2b121edb8b8 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:01.335890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f8555bc2-7a19-4740-a8d2-a2b121edb8b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f3844e94a3349f4910da1ab405fa87a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:01.347842 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f8555bc2-7a19-4740-a8d2-a2b121edb8b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f3844e94a3349f4910da1ab405fa87a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:01.422934 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f8555bc2-7a19-4740-a8d2-a2b121edb8b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f3844e94a3349f4910da1ab405fa87a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:01.430286 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f8555bc2-7a19-4740-a8d2-a2b121edb8b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f3844e94a3349f4910da1ab405fa87a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:01.431565 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f8555bc2-7a19-4740-a8d2-a2b121edb8b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f3844e94a3349f4910da1ab405fa87a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:01.436864 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4097/8171] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:43:01 2022] DELETE /identity/v3/users/5f3844e94a3349f4910da1ab405fa87a => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:43:01.441287 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d4440-fd40-46cd-9afe-6d86521f990c None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:01.441811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d4440-fd40-46cd-9afe-6d86521f990c None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:01.441910 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d4440-fd40-46cd-9afe-6d86521f990c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:01.460463 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-c04d4440-fd40-46cd-9afe-6d86521f990c None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:01.462275 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c04d4440-fd40-46cd-9afe-6d86521f990c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:01.532414 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4075/8172] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:43:01.542907 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8555bc2-7a19-4740-a8d2-a2b121edb8b8 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:01.544532 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f8555bc2-7a19-4740-a8d2-a2b121edb8b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:01.612104 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8555bc2-7a19-4740-a8d2-a2b121edb8b8 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:01.618290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce3078-0cf7-4443-9346-142d86e5482b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:01.618987 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce3078-0cf7-4443-9346-142d86e5482b service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:01.619275 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce3078-0cf7-4443-9346-142d86e5482b service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:01.619553 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce3078-0cf7-4443-9346-142d86e5482b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:01.630322 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce3078-0cf7-4443-9346-142d86e5482b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:01.632407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce3078-0cf7-4443-9346-142d86e5482b service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:01.644211 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4098/8173] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:43:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:43:02.053239 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d4440-fd40-46cd-9afe-6d86521f990c None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:02.054752 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c04d4440-fd40-46cd-9afe-6d86521f990c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:02.070050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d4440-fd40-46cd-9afe-6d86521f990c None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:02.079639 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c22865f-3fbd-49c1-a96e-ff2624f0ad06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:02.079639 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22865f-3fbd-49c1-a96e-ff2624f0ad06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:02.079639 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22865f-3fbd-49c1-a96e-ff2624f0ad06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:02.079639 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22865f-3fbd-49c1-a96e-ff2624f0ad06 admin admin] PATH_INFO: `/v3/projects/50cc8aa73054488585bff076ca15cd47` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:02.080234 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c22865f-3fbd-49c1-a96e-ff2624f0ad06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50cc8aa73054488585bff076ca15cd47)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:02.081241 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c22865f-3fbd-49c1-a96e-ff2624f0ad06 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:02.180582 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5c22865f-3fbd-49c1-a96e-ff2624f0ad06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50cc8aa73054488585bff076ca15cd47', 'request_id': 'req-5c22865f-3fbd-49c1-a96e-ff2624f0ad06'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:02.186310 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5c22865f-3fbd-49c1-a96e-ff2624f0ad06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50cc8aa73054488585bff076ca15cd47', 'request_id': 'req-5c22865f-3fbd-49c1-a96e-ff2624f0ad06'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:02.192490 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5c22865f-3fbd-49c1-a96e-ff2624f0ad06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50cc8aa73054488585bff076ca15cd47', 'request_id': 'req-5c22865f-3fbd-49c1-a96e-ff2624f0ad06'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:02.287215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5c22865f-3fbd-49c1-a96e-ff2624f0ad06 admin admin] The token cache is being invalidate because project 50cc8aa73054488585bff076ca15cd47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:43:02.292877 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5c22865f-3fbd-49c1-a96e-ff2624f0ad06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:02.292877 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-5c22865f-3fbd-49c1-a96e-ff2624f0ad06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:02.292877 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4076/8174] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:43:02 2022] DELETE /identity/v3/projects/50cc8aa73054488585bff076ca15cd47 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:43:02.294640 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce3078-0cf7-4443-9346-142d86e5482b service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:02.305080 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce3078-0cf7-4443-9346-142d86e5482b service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:02.364006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91ce0b-33f4-4ca7-868b-efcf92408231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:02.364523 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91ce0b-33f4-4ca7-868b-efcf92408231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:02.364802 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91ce0b-33f4-4ca7-868b-efcf92408231 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:02.365074 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91ce0b-33f4-4ca7-868b-efcf92408231 admin admin] PATH_INFO: `/v3/users/db67da2a01af49e5918b6d4f9941dfc8` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:02.366699 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb91ce0b-33f4-4ca7-868b-efcf92408231 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db67da2a01af49e5918b6d4f9941dfc8)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:02.369029 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb91ce0b-33f4-4ca7-868b-efcf92408231 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:02.538950 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cb91ce0b-33f4-4ca7-868b-efcf92408231 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db67da2a01af49e5918b6d4f9941dfc8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:02.551315 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cb91ce0b-33f4-4ca7-868b-efcf92408231 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db67da2a01af49e5918b6d4f9941dfc8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:02.640176 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cb91ce0b-33f4-4ca7-868b-efcf92408231 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db67da2a01af49e5918b6d4f9941dfc8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:02.647876 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cb91ce0b-33f4-4ca7-868b-efcf92408231 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db67da2a01af49e5918b6d4f9941dfc8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:02.648815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-cb91ce0b-33f4-4ca7-868b-efcf92408231 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db67da2a01af49e5918b6d4f9941dfc8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:02.659337 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4099/8175] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:43:02 2022] DELETE /identity/v3/users/db67da2a01af49e5918b6d4f9941dfc8 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:43:03.131872 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c22865f-3fbd-49c1-a96e-ff2624f0ad06 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:03.134020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5c22865f-3fbd-49c1-a96e-ff2624f0ad06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:03.154183 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c22865f-3fbd-49c1-a96e-ff2624f0ad06 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:03.224346 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed272228-2a38-44b7-b3e4-04e7ce3ac4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:03.224346 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed272228-2a38-44b7-b3e4-04e7ce3ac4e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:03.224346 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed272228-2a38-44b7-b3e4-04e7ce3ac4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:03.224346 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed272228-2a38-44b7-b3e4-04e7ce3ac4e4 admin admin] PATH_INFO: `/v3/projects/489943ed072b4e34a9ae0afa4b7c7b01` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:03.224703 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed272228-2a38-44b7-b3e4-04e7ce3ac4e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=489943ed072b4e34a9ae0afa4b7c7b01)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:03.225584 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed272228-2a38-44b7-b3e4-04e7ce3ac4e4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:03.344754 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ed272228-2a38-44b7-b3e4-04e7ce3ac4e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '489943ed072b4e34a9ae0afa4b7c7b01', 'request_id': 'req-ed272228-2a38-44b7-b3e4-04e7ce3ac4e4'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:03.349959 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ed272228-2a38-44b7-b3e4-04e7ce3ac4e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '489943ed072b4e34a9ae0afa4b7c7b01', 'request_id': 'req-ed272228-2a38-44b7-b3e4-04e7ce3ac4e4'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:03.356102 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ed272228-2a38-44b7-b3e4-04e7ce3ac4e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '489943ed072b4e34a9ae0afa4b7c7b01', 'request_id': 'req-ed272228-2a38-44b7-b3e4-04e7ce3ac4e4'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:03.446938 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ed272228-2a38-44b7-b3e4-04e7ce3ac4e4 admin admin] The token cache is being invalidate because project 489943ed072b4e34a9ae0afa4b7c7b01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:43:03.447229 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ed272228-2a38-44b7-b3e4-04e7ce3ac4e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:03.448199 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ed272228-2a38-44b7-b3e4-04e7ce3ac4e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:03.449699 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4077/8176] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:43:03 2022] DELETE /identity/v3/projects/489943ed072b4e34a9ae0afa4b7c7b01 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:43:03.454763 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc7244-2dae-47ca-bca1-86b87e3405f1 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:03.455298 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc7244-2dae-47ca-bca1-86b87e3405f1 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:03.455298 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc7244-2dae-47ca-bca1-86b87e3405f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:03.475648 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-d3dc7244-2dae-47ca-bca1-86b87e3405f1 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:03.477062 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d3dc7244-2dae-47ca-bca1-86b87e3405f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:03.541152 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4100/8177] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:43:03.549224 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb852e-9516-460b-b281-6e80b377c948 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:03.549687 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb852e-9516-460b-b281-6e80b377c948 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:03.550385 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb852e-9516-460b-b281-6e80b377c948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:03.572698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-90bb852e-9516-460b-b281-6e80b377c948 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:03.573973 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-90bb852e-9516-460b-b281-6e80b377c948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:03.587960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc7244-2dae-47ca-bca1-86b87e3405f1 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:03.588481 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4078/8178] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:43:03.598466 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc7244-2dae-47ca-bca1-86b87e3405f1 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:03.604121 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50a8d7-15f1-4383-97ed-84a3b511de90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:03.604786 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50a8d7-15f1-4383-97ed-84a3b511de90 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:03.613302 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50a8d7-15f1-4383-97ed-84a3b511de90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:03.613302 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50a8d7-15f1-4383-97ed-84a3b511de90 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:03.613302 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc50a8d7-15f1-4383-97ed-84a3b511de90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:43:03.613302 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc50a8d7-15f1-4383-97ed-84a3b511de90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:03.613302 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc50a8d7-15f1-4383-97ed-84a3b511de90 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:03.620484 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4101/8179] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:43:03.624823 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb852e-9516-460b-b281-6e80b377c948 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:03.634159 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb852e-9516-460b-b281-6e80b377c948 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:03.639741 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafae62c-dbde-4197-9924-89cd749225b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:03.640403 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafae62c-dbde-4197-9924-89cd749225b3 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:03.640689 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafae62c-dbde-4197-9924-89cd749225b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:03.642091 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafae62c-dbde-4197-9924-89cd749225b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:03.642091 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafae62c-dbde-4197-9924-89cd749225b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:03.643833 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafae62c-dbde-4197-9924-89cd749225b3 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:03.733430 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4079/8180] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:43:03 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:43:03.734733 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50a8d7-15f1-4383-97ed-84a3b511de90 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:03.745688 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50a8d7-15f1-4383-97ed-84a3b511de90 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:03.801698 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de285a-ee87-4096-91c4-0c9d9c7d7f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:03.802409 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de285a-ee87-4096-91c4-0c9d9c7d7f96 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:03.802698 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de285a-ee87-4096-91c4-0c9d9c7d7f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:03.802979 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de285a-ee87-4096-91c4-0c9d9c7d7f96 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:03.803664 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de285a-ee87-4096-91c4-0c9d9c7d7f96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:03.806323 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de285a-ee87-4096-91c4-0c9d9c7d7f96 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:03.880690 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4102/8181] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:43:03 2022] POST /identity/v3/users => generated 283 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:43:03.884341 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafae62c-dbde-4197-9924-89cd749225b3 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:03.894813 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafae62c-dbde-4197-9924-89cd749225b3 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:03.899506 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55b2ff-87da-41fd-b611-3489cd566891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:03.900468 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55b2ff-87da-41fd-b611-3489cd566891 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:03.900727 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55b2ff-87da-41fd-b611-3489cd566891 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:03.901002 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55b2ff-87da-41fd-b611-3489cd566891 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:03.901720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55b2ff-87da-41fd-b611-3489cd566891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:03.903635 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55b2ff-87da-41fd-b611-3489cd566891 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:03.913835 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4080/8182] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:43:03.918454 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de285a-ee87-4096-91c4-0c9d9c7d7f96 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:03.928677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de285a-ee87-4096-91c4-0c9d9c7d7f96 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:03.934045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd43d52-bbfe-49cb-a213-58a63b0523af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:03.934707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd43d52-bbfe-49cb-a213-58a63b0523af admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:03.935017 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd43d52-bbfe-49cb-a213-58a63b0523af admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:03.935294 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd43d52-bbfe-49cb-a213-58a63b0523af admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:03.936014 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd43d52-bbfe-49cb-a213-58a63b0523af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:03.937607 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd43d52-bbfe-49cb-a213-58a63b0523af admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:03.948074 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4103/8183] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:43:03.953539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55b2ff-87da-41fd-b611-3489cd566891 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:03.964216 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55b2ff-87da-41fd-b611-3489cd566891 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:03.968955 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c97c92-2a05-4179-8246-29054926a2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:03.969874 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c97c92-2a05-4179-8246-29054926a2cd admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:03.970185 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c97c92-2a05-4179-8246-29054926a2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:03.970449 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c97c92-2a05-4179-8246-29054926a2cd admin admin] PATH_INFO: `/v3/projects/a1bce6a0d61d43199f4e4e2dd0bb96b6/users/be9f074146594ea6a20c1a0de97e6330/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:03.984885 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c97c92-2a05-4179-8246-29054926a2cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1bce6a0d61d43199f4e4e2dd0bb96b6, user_id=be9f074146594ea6a20c1a0de97e6330, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:03.987631 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c97c92-2a05-4179-8246-29054926a2cd admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:04.065293 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4081/8184] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:43:03 2022] PUT /identity/v3/projects/a1bce6a0d61d43199f4e4e2dd0bb96b6/users/be9f074146594ea6a20c1a0de97e6330/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:43:04.076322 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cde8a3-c707-4fd4-a982-3a232da52ea3 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:04.076631 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cde8a3-c707-4fd4-a982-3a232da52ea3 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:04.076962 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cde8a3-c707-4fd4-a982-3a232da52ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:04.103168 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-80cde8a3-c707-4fd4-a982-3a232da52ea3 None None] MFA Rules not processed for user `be9f074146594ea6a20c1a0de97e6330`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:04.104448 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-80cde8a3-c707-4fd4-a982-3a232da52ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:04.168640 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4104/8185] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:04 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:43:04.173218 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c97c92-2a05-4179-8246-29054926a2cd admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:04.234324 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c97c92-2a05-4179-8246-29054926a2cd admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:04.239144 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2b617-b693-4dee-ab99-fc9fc8406d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:04.239808 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2b617-b693-4dee-ab99-fc9fc8406d02 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:04.240098 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2b617-b693-4dee-ab99-fc9fc8406d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:04.240372 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2b617-b693-4dee-ab99-fc9fc8406d02 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:04.241076 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b2b617-b693-4dee-ab99-fc9fc8406d02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:04.243567 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b2b617-b693-4dee-ab99-fc9fc8406d02 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:04.350365 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4082/8186] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:43:04 2022] POST /identity/v3/projects => generated 365 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:43:04.355089 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cde8a3-c707-4fd4-a982-3a232da52ea3 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:04.372275 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cde8a3-c707-4fd4-a982-3a232da52ea3 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:04.442307 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263fc4dd-9a8c-4de4-a5da-39119f6d96c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:04.443006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263fc4dd-9a8c-4de4-a5da-39119f6d96c5 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:04.443285 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263fc4dd-9a8c-4de4-a5da-39119f6d96c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:04.443560 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263fc4dd-9a8c-4de4-a5da-39119f6d96c5 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:04.444253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263fc4dd-9a8c-4de4-a5da-39119f6d96c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:04.446429 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263fc4dd-9a8c-4de4-a5da-39119f6d96c5 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:04.564392 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4105/8187] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:43:04 2022] POST /identity/v3/users => generated 289 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:43:04.568408 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2b617-b693-4dee-ab99-fc9fc8406d02 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:04.579267 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2b617-b693-4dee-ab99-fc9fc8406d02 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:04.583840 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e8821-3c05-4157-85aa-d30cd9479f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:04.584494 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e8821-3c05-4157-85aa-d30cd9479f32 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:04.584776 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e8821-3c05-4157-85aa-d30cd9479f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:04.585074 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e8821-3c05-4157-85aa-d30cd9479f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:04.585807 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e8821-3c05-4157-85aa-d30cd9479f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:04.588054 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e8821-3c05-4157-85aa-d30cd9479f32 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:04.602566 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4083/8188] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:43:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:43:04.603797 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263fc4dd-9a8c-4de4-a5da-39119f6d96c5 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:04.613504 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263fc4dd-9a8c-4de4-a5da-39119f6d96c5 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:04.618672 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0149fae-bd2a-435b-aff1-02efeb2f1aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:04.619559 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0149fae-bd2a-435b-aff1-02efeb2f1aa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:04.619840 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0149fae-bd2a-435b-aff1-02efeb2f1aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:04.620404 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0149fae-bd2a-435b-aff1-02efeb2f1aa0 admin admin] PATH_INFO: `/v3/projects/f8facefae2b34dd9a57ce85eaed498cd/users/2380b4aa640e448c9e6188ec0d3a1f32/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:04.638128 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0149fae-bd2a-435b-aff1-02efeb2f1aa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8facefae2b34dd9a57ce85eaed498cd, user_id=2380b4aa640e448c9e6188ec0d3a1f32, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:04.640811 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0149fae-bd2a-435b-aff1-02efeb2f1aa0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:04.712375 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4106/8189] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:43:04 2022] PUT /identity/v3/projects/f8facefae2b34dd9a57ce85eaed498cd/users/2380b4aa640e448c9e6188ec0d3a1f32/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:43:04.717274 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e8821-3c05-4157-85aa-d30cd9479f32 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:04.730539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e8821-3c05-4157-85aa-d30cd9479f32 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:04.807723 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36528caf-1425-4382-b170-f6477d124ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:04.808541 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36528caf-1425-4382-b170-f6477d124ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:04.808961 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36528caf-1425-4382-b170-f6477d124ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:04.809471 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36528caf-1425-4382-b170-f6477d124ef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:04.810348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36528caf-1425-4382-b170-f6477d124ef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:04.812374 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36528caf-1425-4382-b170-f6477d124ef9 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:04.823226 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4084/8190] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:43:04 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:43:04.827254 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0149fae-bd2a-435b-aff1-02efeb2f1aa0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:04.839219 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0149fae-bd2a-435b-aff1-02efeb2f1aa0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:04.844289 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b14483-0878-47b7-ac0e-44c2cb056bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:04.845312 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b14483-0878-47b7-ac0e-44c2cb056bc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:04.845595 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b14483-0878-47b7-ac0e-44c2cb056bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:04.845980 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b14483-0878-47b7-ac0e-44c2cb056bc3 admin admin] PATH_INFO: `/v3/projects/f8facefae2b34dd9a57ce85eaed498cd/users/2380b4aa640e448c9e6188ec0d3a1f32/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:04.848090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b14483-0878-47b7-ac0e-44c2cb056bc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8facefae2b34dd9a57ce85eaed498cd, user_id=2380b4aa640e448c9e6188ec0d3a1f32, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:04.850808 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b14483-0878-47b7-ac0e-44c2cb056bc3 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:04.862751 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4107/8191] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:43:04 2022] PUT /identity/v3/projects/f8facefae2b34dd9a57ce85eaed498cd/users/2380b4aa640e448c9e6188ec0d3a1f32/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:43:04.874373 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8db06-0e70-4b76-b6a9-91ff8b28f6ee None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:04.874674 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8db06-0e70-4b76-b6a9-91ff8b28f6ee None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:04.874963 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8db06-0e70-4b76-b6a9-91ff8b28f6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:04.902481 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-20a8db06-0e70-4b76-b6a9-91ff8b28f6ee None None] MFA Rules not processed for user `2380b4aa640e448c9e6188ec0d3a1f32`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:04.903794 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-20a8db06-0e70-4b76-b6a9-91ff8b28f6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:04.982344 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4085/8192] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:04 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:43:04.994640 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b14483-0878-47b7-ac0e-44c2cb056bc3 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:04.996697 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b4b14483-0878-47b7-ac0e-44c2cb056bc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:05.073137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b14483-0878-47b7-ac0e-44c2cb056bc3 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:05.076846 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e29e03-866f-41a4-af98-cd902faa5dc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:05.077503 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e29e03-866f-41a4-af98-cd902faa5dc4 service cinder] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:05.077807 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e29e03-866f-41a4-af98-cd902faa5dc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:05.078086 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e29e03-866f-41a4-af98-cd902faa5dc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:05.087939 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e29e03-866f-41a4-af98-cd902faa5dc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:05.089390 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e29e03-866f-41a4-af98-cd902faa5dc4 service cinder] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:05.099024 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4108/8193] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:43:04 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:43:05.364196 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8db06-0e70-4b76-b6a9-91ff8b28f6ee None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:05.376276 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8db06-0e70-4b76-b6a9-91ff8b28f6ee None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:05.379972 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90939f87-8787-401e-a5a1-e166f0fb2fa1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:05.380623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90939f87-8787-401e-a5a1-e166f0fb2fa1 service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:05.380910 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90939f87-8787-401e-a5a1-e166f0fb2fa1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:05.381185 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90939f87-8787-401e-a5a1-e166f0fb2fa1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:05.438438 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90939f87-8787-401e-a5a1-e166f0fb2fa1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:05.439896 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90939f87-8787-401e-a5a1-e166f0fb2fa1 service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:05.449474 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4086/8194] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:43:05 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:43:07.495015 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e29e03-866f-41a4-af98-cd902faa5dc4 service cinder] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:07.496499 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-37e29e03-866f-41a4-af98-cd902faa5dc4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:07.571917 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e29e03-866f-41a4-af98-cd902faa5dc4 service cinder] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:07.577671 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f3cca-e5e6-4be5-abbc-a3c3f8d5aefb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:07.578337 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f3cca-e5e6-4be5-abbc-a3c3f8d5aefb service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:07.578616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f3cca-e5e6-4be5-abbc-a3c3f8d5aefb service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:07.578888 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f3cca-e5e6-4be5-abbc-a3c3f8d5aefb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:07.580668 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8b4f3cca-e5e6-4be5-abbc-a3c3f8d5aefb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:07.639641 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4f3cca-e5e6-4be5-abbc-a3c3f8d5aefb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:07.641280 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4f3cca-e5e6-4be5-abbc-a3c3f8d5aefb service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:07.651329 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4109/8195] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:43:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:43:09.344990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90939f87-8787-401e-a5a1-e166f0fb2fa1 service cinder] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:09.346538 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-90939f87-8787-401e-a5a1-e166f0fb2fa1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:09.418458 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90939f87-8787-401e-a5a1-e166f0fb2fa1 service cinder] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:09.422861 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7af7f7-e652-408b-8890-082bbaf2ef05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:09.423727 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7af7f7-e652-408b-8890-082bbaf2ef05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:09.424013 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7af7f7-e652-408b-8890-082bbaf2ef05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:09.424294 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7af7f7-e652-408b-8890-082bbaf2ef05 admin admin] PATH_INFO: `/v3/users/0c8b3c5311484f528fde13cc9f838c71` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:09.425487 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7af7f7-e652-408b-8890-082bbaf2ef05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c8b3c5311484f528fde13cc9f838c71)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:09.427475 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7af7f7-e652-408b-8890-082bbaf2ef05 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:09.665101 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-da7af7f7-e652-408b-8890-082bbaf2ef05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c8b3c5311484f528fde13cc9f838c71'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:09.678033 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-da7af7f7-e652-408b-8890-082bbaf2ef05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c8b3c5311484f528fde13cc9f838c71'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:09.759910 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-da7af7f7-e652-408b-8890-082bbaf2ef05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c8b3c5311484f528fde13cc9f838c71'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:09.760697 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-da7af7f7-e652-408b-8890-082bbaf2ef05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c8b3c5311484f528fde13cc9f838c71'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:09.770072 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-da7af7f7-e652-408b-8890-082bbaf2ef05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c8b3c5311484f528fde13cc9f838c71'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:09.776296 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4087/8196] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:43:09 2022] DELETE /identity/v3/users/0c8b3c5311484f528fde13cc9f838c71 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:43:09.781039 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7dc75-dfea-4188-894d-f1ab1e05912b None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:09.781501 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7dc75-dfea-4188-894d-f1ab1e05912b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:09.782478 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7dc75-dfea-4188-894d-f1ab1e05912b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:09.804448 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-aea7dc75-dfea-4188-894d-f1ab1e05912b None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:09.817019 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-aea7dc75-dfea-4188-894d-f1ab1e05912b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:09.875217 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4110/8197] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:43:09.885669 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7af7f7-e652-408b-8890-082bbaf2ef05 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:09.887125 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-da7af7f7-e652-408b-8890-082bbaf2ef05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:09.953859 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7af7f7-e652-408b-8890-082bbaf2ef05 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:09.957724 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d72ff5-1051-47a9-8133-a9e1feee33b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:09.958607 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d72ff5-1051-47a9-8133-a9e1feee33b5 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:09.958961 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d72ff5-1051-47a9-8133-a9e1feee33b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:09.959348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d72ff5-1051-47a9-8133-a9e1feee33b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:09.969976 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d72ff5-1051-47a9-8133-a9e1feee33b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:09.971664 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d72ff5-1051-47a9-8133-a9e1feee33b5 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:09.981648 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4088/8198] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:43:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:43:10.215394 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea7dc75-dfea-4188-894d-f1ab1e05912b None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:10.217937 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-aea7dc75-dfea-4188-894d-f1ab1e05912b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:10.240091 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea7dc75-dfea-4188-894d-f1ab1e05912b None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:10.245995 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31677731-d485-49d9-a680-4bac562e4a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:10.246946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31677731-d485-49d9-a680-4bac562e4a2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:10.247300 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31677731-d485-49d9-a680-4bac562e4a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:10.247662 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31677731-d485-49d9-a680-4bac562e4a2c admin admin] PATH_INFO: `/v3/projects/6ab8dab5b457417db332136906fb204a` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:10.250659 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31677731-d485-49d9-a680-4bac562e4a2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ab8dab5b457417db332136906fb204a)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:10.252790 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31677731-d485-49d9-a680-4bac562e4a2c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:10.400730 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-31677731-d485-49d9-a680-4bac562e4a2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ab8dab5b457417db332136906fb204a', 'request_id': 'req-31677731-d485-49d9-a680-4bac562e4a2c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:10.410401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-31677731-d485-49d9-a680-4bac562e4a2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ab8dab5b457417db332136906fb204a', 'request_id': 'req-31677731-d485-49d9-a680-4bac562e4a2c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:10.420122 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-31677731-d485-49d9-a680-4bac562e4a2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ab8dab5b457417db332136906fb204a', 'request_id': 'req-31677731-d485-49d9-a680-4bac562e4a2c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:10.511278 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-31677731-d485-49d9-a680-4bac562e4a2c admin admin] The token cache is being invalidate because project 6ab8dab5b457417db332136906fb204a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:43:10.511674 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-31677731-d485-49d9-a680-4bac562e4a2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:10.512400 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-31677731-d485-49d9-a680-4bac562e4a2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:10.517803 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4111/8199] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:43:10 2022] DELETE /identity/v3/projects/6ab8dab5b457417db332136906fb204a => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:43:10.519639 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8cb11-222d-40bf-9c91-dd19b7c94d99 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:10.520503 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8cb11-222d-40bf-9c91-dd19b7c94d99 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:10.520997 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8cb11-222d-40bf-9c91-dd19b7c94d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:10.551914 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-f8d8cb11-222d-40bf-9c91-dd19b7c94d99 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:10.551914 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f8d8cb11-222d-40bf-9c91-dd19b7c94d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:10.695567 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4089/8200] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:43:10.703456 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab348ec1-bab8-4185-b95f-1ef4d6a2cf3a None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:10.703884 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab348ec1-bab8-4185-b95f-1ef4d6a2cf3a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:10.704492 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab348ec1-bab8-4185-b95f-1ef4d6a2cf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:10.724969 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-ab348ec1-bab8-4185-b95f-1ef4d6a2cf3a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:10.726232 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ab348ec1-bab8-4185-b95f-1ef4d6a2cf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:10.737840 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4112/8201] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:43:10.748260 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8cb11-222d-40bf-9c91-dd19b7c94d99 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:10.765682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8cb11-222d-40bf-9c91-dd19b7c94d99 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:10.772448 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db772496-acc7-4a30-9f0f-3bd4048b2d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:10.776927 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db772496-acc7-4a30-9f0f-3bd4048b2d03 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:10.776927 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db772496-acc7-4a30-9f0f-3bd4048b2d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:10.777132 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db772496-acc7-4a30-9f0f-3bd4048b2d03 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:10.777726 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db772496-acc7-4a30-9f0f-3bd4048b2d03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:43:10.779570 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db772496-acc7-4a30-9f0f-3bd4048b2d03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:10.779712 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db772496-acc7-4a30-9f0f-3bd4048b2d03 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:10.792837 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4090/8202] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:43:10.797750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab348ec1-bab8-4185-b95f-1ef4d6a2cf3a None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:10.808304 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab348ec1-bab8-4185-b95f-1ef4d6a2cf3a None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:10.812994 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a30e86-862f-4f71-beaf-01b6d0b85e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:10.814405 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a30e86-862f-4f71-beaf-01b6d0b85e91 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:10.814405 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a30e86-862f-4f71-beaf-01b6d0b85e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:10.814680 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a30e86-862f-4f71-beaf-01b6d0b85e91 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:10.815377 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a30e86-862f-4f71-beaf-01b6d0b85e91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:10.817435 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a30e86-862f-4f71-beaf-01b6d0b85e91 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:10.912354 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4113/8203] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:43:10 2022] POST /identity/v3/projects => generated 379 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:43:10.912663 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db772496-acc7-4a30-9f0f-3bd4048b2d03 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:10.924522 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db772496-acc7-4a30-9f0f-3bd4048b2d03 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:10.987475 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b93d15-9f6b-45e6-bf6d-96619d5f8d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:10.988182 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b93d15-9f6b-45e6-bf6d-96619d5f8d44 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:10.988468 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b93d15-9f6b-45e6-bf6d-96619d5f8d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:10.988744 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b93d15-9f6b-45e6-bf6d-96619d5f8d44 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:10.989425 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b93d15-9f6b-45e6-bf6d-96619d5f8d44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:10.991395 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b93d15-9f6b-45e6-bf6d-96619d5f8d44 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:11.077859 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4091/8204] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:43:10 2022] POST /identity/v3/users => generated 290 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:43:11.082160 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a30e86-862f-4f71-beaf-01b6d0b85e91 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:11.093689 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a30e86-862f-4f71-beaf-01b6d0b85e91 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:11.099191 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e4db9-2176-446f-9dbf-f51a56deaed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:11.099880 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e4db9-2176-446f-9dbf-f51a56deaed3 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:11.100179 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e4db9-2176-446f-9dbf-f51a56deaed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:11.106952 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e4db9-2176-446f-9dbf-f51a56deaed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:11.106952 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326e4db9-2176-446f-9dbf-f51a56deaed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:11.106952 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326e4db9-2176-446f-9dbf-f51a56deaed3 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:11.114565 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4114/8205] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:43:11.118893 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b93d15-9f6b-45e6-bf6d-96619d5f8d44 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:11.129995 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b93d15-9f6b-45e6-bf6d-96619d5f8d44 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:11.135456 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaddba2-aa63-4625-a81f-b5d20ab79848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:11.136126 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaddba2-aa63-4625-a81f-b5d20ab79848 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:11.136411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaddba2-aa63-4625-a81f-b5d20ab79848 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:11.136691 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaddba2-aa63-4625-a81f-b5d20ab79848 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:11.137416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaddba2-aa63-4625-a81f-b5d20ab79848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:11.139068 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaddba2-aa63-4625-a81f-b5d20ab79848 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:11.151098 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4092/8206] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:43:11.155509 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e4db9-2176-446f-9dbf-f51a56deaed3 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:11.179496 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e4db9-2176-446f-9dbf-f51a56deaed3 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:11.186198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c73b5-d97c-47b3-b131-690fef585a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:11.187246 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c73b5-d97c-47b3-b131-690fef585a0c admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:11.187539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c73b5-d97c-47b3-b131-690fef585a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:11.187834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c73b5-d97c-47b3-b131-690fef585a0c admin admin] PATH_INFO: `/v3/projects/bf35a578c0774f66aa663bc96ffa8f6f/users/b3cc0544f6d14dd9b50a0a40703b2ba2/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:11.206970 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c73b5-d97c-47b3-b131-690fef585a0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf35a578c0774f66aa663bc96ffa8f6f, user_id=b3cc0544f6d14dd9b50a0a40703b2ba2, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:11.210938 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c73b5-d97c-47b3-b131-690fef585a0c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:11.322663 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4115/8207] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:43:11 2022] PUT /identity/v3/projects/bf35a578c0774f66aa663bc96ffa8f6f/users/b3cc0544f6d14dd9b50a0a40703b2ba2/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:43:11.333613 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7d2ea-748f-4ee9-8558-65c7ee28fadb None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:11.333966 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7d2ea-748f-4ee9-8558-65c7ee28fadb None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:11.334227 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7d2ea-748f-4ee9-8558-65c7ee28fadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:11.362306 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-80f7d2ea-748f-4ee9-8558-65c7ee28fadb None None] MFA Rules not processed for user `b3cc0544f6d14dd9b50a0a40703b2ba2`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:11.363535 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-80f7d2ea-748f-4ee9-8558-65c7ee28fadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:11.443680 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4093/8208] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:43:11.455456 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c73b5-d97c-47b3-b131-690fef585a0c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:11.457611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9f6c73b5-d97c-47b3-b131-690fef585a0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:11.528578 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c73b5-d97c-47b3-b131-690fef585a0c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:11.533096 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb2131-76a7-46fa-a3e8-5e2467e43e9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:11.533668 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb2131-76a7-46fa-a3e8-5e2467e43e9a service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:11.534040 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb2131-76a7-46fa-a3e8-5e2467e43e9a service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:11.534322 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb2131-76a7-46fa-a3e8-5e2467e43e9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:11.544927 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb2131-76a7-46fa-a3e8-5e2467e43e9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:11.546497 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb2131-76a7-46fa-a3e8-5e2467e43e9a service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:11.558464 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4116/8209] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:43:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:43:11.577491 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7d2ea-748f-4ee9-8558-65c7ee28fadb None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:11.645257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7d2ea-748f-4ee9-8558-65c7ee28fadb None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:11.651250 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08635d29-c82b-4a51-92c3-67d876285735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:11.652152 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08635d29-c82b-4a51-92c3-67d876285735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:11.652579 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08635d29-c82b-4a51-92c3-67d876285735 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:11.652856 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08635d29-c82b-4a51-92c3-67d876285735 admin admin] PATH_INFO: `/v3/users/b3cc0544f6d14dd9b50a0a40703b2ba2` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:11.654118 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08635d29-c82b-4a51-92c3-67d876285735 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3cc0544f6d14dd9b50a0a40703b2ba2)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:11.656094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08635d29-c82b-4a51-92c3-67d876285735 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:11.869138 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-08635d29-c82b-4a51-92c3-67d876285735 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3cc0544f6d14dd9b50a0a40703b2ba2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:11.885076 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-08635d29-c82b-4a51-92c3-67d876285735 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3cc0544f6d14dd9b50a0a40703b2ba2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:11.939634 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-08635d29-c82b-4a51-92c3-67d876285735 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3cc0544f6d14dd9b50a0a40703b2ba2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:11.940289 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-08635d29-c82b-4a51-92c3-67d876285735 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3cc0544f6d14dd9b50a0a40703b2ba2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:11.949039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-08635d29-c82b-4a51-92c3-67d876285735 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3cc0544f6d14dd9b50a0a40703b2ba2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:11.955550 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4094/8210] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:43:11 2022] DELETE /identity/v3/users/b3cc0544f6d14dd9b50a0a40703b2ba2 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:43:11.960205 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba635c8-3373-41c7-945e-4625a23654c1 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:11.960704 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba635c8-3373-41c7-945e-4625a23654c1 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:11.960912 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba635c8-3373-41c7-945e-4625a23654c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:11.980193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-fba635c8-3373-41c7-945e-4625a23654c1 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:11.981358 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-fba635c8-3373-41c7-945e-4625a23654c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:12.045074 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4117/8211] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:43:12.055575 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08635d29-c82b-4a51-92c3-67d876285735 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:12.057023 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-08635d29-c82b-4a51-92c3-67d876285735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:12.118938 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08635d29-c82b-4a51-92c3-67d876285735 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:12.122755 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf1c5c-e602-4ebe-bc95-c6f9dcb7fbc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:12.123566 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf1c5c-e602-4ebe-bc95-c6f9dcb7fbc0 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:12.123857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf1c5c-e602-4ebe-bc95-c6f9dcb7fbc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:12.124135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf1c5c-e602-4ebe-bc95-c6f9dcb7fbc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:12.134895 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaf1c5c-e602-4ebe-bc95-c6f9dcb7fbc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:12.136377 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaf1c5c-e602-4ebe-bc95-c6f9dcb7fbc0 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:12.147303 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4095/8212] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:43:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:43:12.699252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba635c8-3373-41c7-945e-4625a23654c1 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:12.700941 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-fba635c8-3373-41c7-945e-4625a23654c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:12.719746 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba635c8-3373-41c7-945e-4625a23654c1 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:12.728943 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aede40e-0e8d-4b6f-9a74-39096d61b49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:12.729955 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aede40e-0e8d-4b6f-9a74-39096d61b49f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:12.730309 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aede40e-0e8d-4b6f-9a74-39096d61b49f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:12.730785 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aede40e-0e8d-4b6f-9a74-39096d61b49f admin admin] PATH_INFO: `/v3/projects/bf35a578c0774f66aa663bc96ffa8f6f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:12.732106 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aede40e-0e8d-4b6f-9a74-39096d61b49f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf35a578c0774f66aa663bc96ffa8f6f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:12.735363 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aede40e-0e8d-4b6f-9a74-39096d61b49f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:12.854961 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7aede40e-0e8d-4b6f-9a74-39096d61b49f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf35a578c0774f66aa663bc96ffa8f6f', 'request_id': 'req-7aede40e-0e8d-4b6f-9a74-39096d61b49f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:12.861637 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7aede40e-0e8d-4b6f-9a74-39096d61b49f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf35a578c0774f66aa663bc96ffa8f6f', 'request_id': 'req-7aede40e-0e8d-4b6f-9a74-39096d61b49f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:12.868390 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7aede40e-0e8d-4b6f-9a74-39096d61b49f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf35a578c0774f66aa663bc96ffa8f6f', 'request_id': 'req-7aede40e-0e8d-4b6f-9a74-39096d61b49f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:12.928160 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7aede40e-0e8d-4b6f-9a74-39096d61b49f admin admin] The token cache is being invalidate because project bf35a578c0774f66aa663bc96ffa8f6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:43:12.928451 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7aede40e-0e8d-4b6f-9a74-39096d61b49f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:12.929192 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7aede40e-0e8d-4b6f-9a74-39096d61b49f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:12.931411 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4118/8213] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:43:12 2022] DELETE /identity/v3/projects/bf35a578c0774f66aa663bc96ffa8f6f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:43:12.936536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a25f7d-3279-4bde-8cc6-15a2daf12b4a None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:12.937006 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a25f7d-3279-4bde-8cc6-15a2daf12b4a None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:12.937108 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a25f7d-3279-4bde-8cc6-15a2daf12b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:12.959126 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-61a25f7d-3279-4bde-8cc6-15a2daf12b4a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:12.959126 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-61a25f7d-3279-4bde-8cc6-15a2daf12b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:12.966281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aede40e-0e8d-4b6f-9a74-39096d61b49f admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:12.967843 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7aede40e-0e8d-4b6f-9a74-39096d61b49f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:13.020565 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4096/8214] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:43:13.027460 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aede40e-0e8d-4b6f-9a74-39096d61b49f admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:13.031339 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0da009-2df8-4854-975b-a834f1bb3948 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:13.032281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0da009-2df8-4854-975b-a834f1bb3948 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:13.032574 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0da009-2df8-4854-975b-a834f1bb3948 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:13.032988 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0da009-2df8-4854-975b-a834f1bb3948 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:13.033875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36a3a9-1448-4861-83c1-a32311cc4aa9 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:13.034268 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36a3a9-1448-4861-83c1-a32311cc4aa9 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:13.034745 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36a3a9-1448-4861-83c1-a32311cc4aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:13.034920 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0d0da009-2df8-4854-975b-a834f1bb3948 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:13.048930 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0da009-2df8-4854-975b-a834f1bb3948 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:13.059429 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0da009-2df8-4854-975b-a834f1bb3948 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:13.061473 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4119/8215] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:43:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:43:13.063843 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-ac36a3a9-1448-4861-83c1-a32311cc4aa9 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:13.066246 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ac36a3a9-1448-4861-83c1-a32311cc4aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:13.074975 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4097/8216] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:43:13.080022 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0da009-2df8-4854-975b-a834f1bb3948 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:13.091810 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0da009-2df8-4854-975b-a834f1bb3948 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:13.096470 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6cfb4-6a22-450e-a2c8-afea342f9380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:13.097122 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6cfb4-6a22-450e-a2c8-afea342f9380 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:13.097401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6cfb4-6a22-450e-a2c8-afea342f9380 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:13.097675 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6cfb4-6a22-450e-a2c8-afea342f9380 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:13.098423 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f6cfb4-6a22-450e-a2c8-afea342f9380 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:43:13.098727 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f6cfb4-6a22-450e-a2c8-afea342f9380 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:13.100334 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f6cfb4-6a22-450e-a2c8-afea342f9380 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:13.120393 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4120/8217] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:43:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:43:13.121450 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36a3a9-1448-4861-83c1-a32311cc4aa9 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:13.130941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36a3a9-1448-4861-83c1-a32311cc4aa9 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:13.136104 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043a314-ec59-44f8-adf1-e0a77bd0e483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:13.136756 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043a314-ec59-44f8-adf1-e0a77bd0e483 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:13.137036 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043a314-ec59-44f8-adf1-e0a77bd0e483 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:13.137307 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043a314-ec59-44f8-adf1-e0a77bd0e483 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:13.138031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043a314-ec59-44f8-adf1-e0a77bd0e483 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:13.139983 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043a314-ec59-44f8-adf1-e0a77bd0e483 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:13.261829 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4098/8218] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:43:13 2022] POST /identity/v3/projects => generated 367 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:43:13.266350 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6cfb4-6a22-450e-a2c8-afea342f9380 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:13.278167 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6cfb4-6a22-450e-a2c8-afea342f9380 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:13.334597 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5787c2b-d13c-4c78-a8a0-9eb2d5f415fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:13.335607 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5787c2b-d13c-4c78-a8a0-9eb2d5f415fb admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:13.335889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5787c2b-d13c-4c78-a8a0-9eb2d5f415fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:13.336701 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5787c2b-d13c-4c78-a8a0-9eb2d5f415fb admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:13.337425 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5787c2b-d13c-4c78-a8a0-9eb2d5f415fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:13.339480 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5787c2b-d13c-4c78-a8a0-9eb2d5f415fb admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:13.446165 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4121/8219] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:43:13 2022] POST /identity/v3/users => generated 284 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:43:13.447384 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043a314-ec59-44f8-adf1-e0a77bd0e483 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:13.457708 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043a314-ec59-44f8-adf1-e0a77bd0e483 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:13.462946 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c0953-c970-45b1-9fe3-c8310d4d7ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:13.463609 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c0953-c970-45b1-9fe3-c8310d4d7ebb admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:13.463893 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c0953-c970-45b1-9fe3-c8310d4d7ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:13.464171 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c0953-c970-45b1-9fe3-c8310d4d7ebb admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:13.465018 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c0953-c970-45b1-9fe3-c8310d4d7ebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:13.466691 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c0953-c970-45b1-9fe3-c8310d4d7ebb admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:13.478609 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4099/8220] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:43:13.482759 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5787c2b-d13c-4c78-a8a0-9eb2d5f415fb admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:13.493193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5787c2b-d13c-4c78-a8a0-9eb2d5f415fb admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:13.498137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771d630-f4f9-49d4-bf36-b0336651e6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:13.498856 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771d630-f4f9-49d4-bf36-b0336651e6f0 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:13.499145 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771d630-f4f9-49d4-bf36-b0336651e6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:13.499425 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771d630-f4f9-49d4-bf36-b0336651e6f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:13.500154 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771d630-f4f9-49d4-bf36-b0336651e6f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:13.501869 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771d630-f4f9-49d4-bf36-b0336651e6f0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:13.524687 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4122/8221] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:43:13.527014 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c0953-c970-45b1-9fe3-c8310d4d7ebb admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:13.538844 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c0953-c970-45b1-9fe3-c8310d4d7ebb admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:13.547401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4512d0-f412-4e7c-9014-c400a173f48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:13.548504 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4512d0-f412-4e7c-9014-c400a173f48b admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:13.548870 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4512d0-f412-4e7c-9014-c400a173f48b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:13.549222 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4512d0-f412-4e7c-9014-c400a173f48b admin admin] PATH_INFO: `/v3/projects/267027ce25334d25b3ce478433c2fd1f/users/48bb2192c73a4a48aa3395a419524e38/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:13.566783 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4512d0-f412-4e7c-9014-c400a173f48b admin admin] RBAC: Authorizing `identity:create_grant(project_id=267027ce25334d25b3ce478433c2fd1f, user_id=48bb2192c73a4a48aa3395a419524e38, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:13.569457 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4512d0-f412-4e7c-9014-c400a173f48b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:13.680299 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4100/8222] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:43:13 2022] PUT /identity/v3/projects/267027ce25334d25b3ce478433c2fd1f/users/48bb2192c73a4a48aa3395a419524e38/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:43:13.691562 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fff845-86eb-4bae-92ba-8ccefcffa11a None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:13.692214 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fff845-86eb-4bae-92ba-8ccefcffa11a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:13.693173 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fff845-86eb-4bae-92ba-8ccefcffa11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:13.723726 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-b5fff845-86eb-4bae-92ba-8ccefcffa11a None None] MFA Rules not processed for user `48bb2192c73a4a48aa3395a419524e38`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:13.724936 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b5fff845-86eb-4bae-92ba-8ccefcffa11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:13.790500 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4123/8223] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:13 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:43:13.801232 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4512d0-f412-4e7c-9014-c400a173f48b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:13.812242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5f4512d0-f412-4e7c-9014-c400a173f48b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:13.873469 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4512d0-f412-4e7c-9014-c400a173f48b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:13.877234 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83057bf7-c1c7-46bb-ba49-13db08c77ca9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:13.877979 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83057bf7-c1c7-46bb-ba49-13db08c77ca9 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:13.878267 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83057bf7-c1c7-46bb-ba49-13db08c77ca9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:13.878539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83057bf7-c1c7-46bb-ba49-13db08c77ca9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:13.887729 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83057bf7-c1c7-46bb-ba49-13db08c77ca9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:13.889184 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83057bf7-c1c7-46bb-ba49-13db08c77ca9 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:13.898364 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4101/8224] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:43:13 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:43:16.362538 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fff845-86eb-4bae-92ba-8ccefcffa11a None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:16.364038 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b5fff845-86eb-4bae-92ba-8ccefcffa11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:16.476161 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fff845-86eb-4bae-92ba-8ccefcffa11a None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:16.484677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead63d6a-31d7-4ddc-a415-03d367566344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:16.484677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead63d6a-31d7-4ddc-a415-03d367566344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:16.484677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead63d6a-31d7-4ddc-a415-03d367566344 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:16.484677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead63d6a-31d7-4ddc-a415-03d367566344 admin admin] PATH_INFO: `/v3/users/be9f074146594ea6a20c1a0de97e6330` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:16.486173 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead63d6a-31d7-4ddc-a415-03d367566344 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be9f074146594ea6a20c1a0de97e6330)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:16.488688 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead63d6a-31d7-4ddc-a415-03d367566344 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:16.723695 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ead63d6a-31d7-4ddc-a415-03d367566344 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be9f074146594ea6a20c1a0de97e6330'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:16.744189 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ead63d6a-31d7-4ddc-a415-03d367566344 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be9f074146594ea6a20c1a0de97e6330'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:16.817315 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ead63d6a-31d7-4ddc-a415-03d367566344 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be9f074146594ea6a20c1a0de97e6330'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:16.825301 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ead63d6a-31d7-4ddc-a415-03d367566344 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be9f074146594ea6a20c1a0de97e6330'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:16.825982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ead63d6a-31d7-4ddc-a415-03d367566344 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be9f074146594ea6a20c1a0de97e6330'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:16.833257 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4124/8225] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:43:16 2022] DELETE /identity/v3/users/be9f074146594ea6a20c1a0de97e6330 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:43:16.837785 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17362f65-972e-42e9-b6e9-b50b49a3440b None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:16.838281 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17362f65-972e-42e9-b6e9-b50b49a3440b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:16.838371 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17362f65-972e-42e9-b6e9-b50b49a3440b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:16.855530 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-17362f65-972e-42e9-b6e9-b50b49a3440b None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:16.856719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-17362f65-972e-42e9-b6e9-b50b49a3440b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:16.917268 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4102/8226] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:43:16.930074 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead63d6a-31d7-4ddc-a415-03d367566344 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:16.931517 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ead63d6a-31d7-4ddc-a415-03d367566344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:16.998384 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead63d6a-31d7-4ddc-a415-03d367566344 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:17.002041 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75114dd-2558-45a9-b7e4-67a84fa471c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:17.002684 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75114dd-2558-45a9-b7e4-67a84fa471c6 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:17.002965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75114dd-2558-45a9-b7e4-67a84fa471c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:17.003236 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75114dd-2558-45a9-b7e4-67a84fa471c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:17.012623 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75114dd-2558-45a9-b7e4-67a84fa471c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:17.014122 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75114dd-2558-45a9-b7e4-67a84fa471c6 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:17.024425 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4125/8227] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:43:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:43:17.538421 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17362f65-972e-42e9-b6e9-b50b49a3440b None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:17.540910 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-17362f65-972e-42e9-b6e9-b50b49a3440b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:17.556421 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17362f65-972e-42e9-b6e9-b50b49a3440b None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:17.561591 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913dbbe5-94b1-46bb-9209-0a927594fe79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:17.562629 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913dbbe5-94b1-46bb-9209-0a927594fe79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:17.563766 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913dbbe5-94b1-46bb-9209-0a927594fe79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:17.563766 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913dbbe5-94b1-46bb-9209-0a927594fe79 admin admin] PATH_INFO: `/v3/projects/a1bce6a0d61d43199f4e4e2dd0bb96b6` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:17.564795 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913dbbe5-94b1-46bb-9209-0a927594fe79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1bce6a0d61d43199f4e4e2dd0bb96b6)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:17.567013 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913dbbe5-94b1-46bb-9209-0a927594fe79 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:17.666221 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-913dbbe5-94b1-46bb-9209-0a927594fe79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1bce6a0d61d43199f4e4e2dd0bb96b6', 'request_id': 'req-913dbbe5-94b1-46bb-9209-0a927594fe79'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:17.672023 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-913dbbe5-94b1-46bb-9209-0a927594fe79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1bce6a0d61d43199f4e4e2dd0bb96b6', 'request_id': 'req-913dbbe5-94b1-46bb-9209-0a927594fe79'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:17.678242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-913dbbe5-94b1-46bb-9209-0a927594fe79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1bce6a0d61d43199f4e4e2dd0bb96b6', 'request_id': 'req-913dbbe5-94b1-46bb-9209-0a927594fe79'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:17.768816 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-913dbbe5-94b1-46bb-9209-0a927594fe79 admin admin] The token cache is being invalidate because project a1bce6a0d61d43199f4e4e2dd0bb96b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:43:17.768946 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-913dbbe5-94b1-46bb-9209-0a927594fe79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:17.769580 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-913dbbe5-94b1-46bb-9209-0a927594fe79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:17.772297 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4103/8228] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:43:17 2022] DELETE /identity/v3/projects/a1bce6a0d61d43199f4e4e2dd0bb96b6 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:43:17.776834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75114dd-2558-45a9-b7e4-67a84fa471c6 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:17.790602 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75114dd-2558-45a9-b7e4-67a84fa471c6 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:17.849858 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e3147-c437-4593-90a2-281a0af42d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:17.850722 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e3147-c437-4593-90a2-281a0af42d28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:17.851003 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e3147-c437-4593-90a2-281a0af42d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:17.851277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e3147-c437-4593-90a2-281a0af42d28 admin admin] PATH_INFO: `/v3/users/2380b4aa640e448c9e6188ec0d3a1f32` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:17.853029 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e3147-c437-4593-90a2-281a0af42d28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2380b4aa640e448c9e6188ec0d3a1f32)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:17.854957 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e3147-c437-4593-90a2-281a0af42d28 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:18.072334 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-048e3147-c437-4593-90a2-281a0af42d28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2380b4aa640e448c9e6188ec0d3a1f32'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:18.085549 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-048e3147-c437-4593-90a2-281a0af42d28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2380b4aa640e448c9e6188ec0d3a1f32'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:18.188730 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-048e3147-c437-4593-90a2-281a0af42d28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2380b4aa640e448c9e6188ec0d3a1f32'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:18.196172 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-048e3147-c437-4593-90a2-281a0af42d28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2380b4aa640e448c9e6188ec0d3a1f32'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:18.197261 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-048e3147-c437-4593-90a2-281a0af42d28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2380b4aa640e448c9e6188ec0d3a1f32'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:18.202750 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4126/8229] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:43:17 2022] DELETE /identity/v3/users/2380b4aa640e448c9e6188ec0d3a1f32 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:43:18.667856 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913dbbe5-94b1-46bb-9209-0a927594fe79 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:18.671056 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-913dbbe5-94b1-46bb-9209-0a927594fe79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:18.719414 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913dbbe5-94b1-46bb-9209-0a927594fe79 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:18.784090 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0cde85-6972-4b52-82e3-adfbec235d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:18.786014 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cde85-6972-4b52-82e3-adfbec235d8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:18.786345 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cde85-6972-4b52-82e3-adfbec235d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:18.786776 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cde85-6972-4b52-82e3-adfbec235d8f admin admin] PATH_INFO: `/v3/projects/f8facefae2b34dd9a57ce85eaed498cd` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:18.788592 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0cde85-6972-4b52-82e3-adfbec235d8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8facefae2b34dd9a57ce85eaed498cd)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:18.790596 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0cde85-6972-4b52-82e3-adfbec235d8f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:18.926001 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-da0cde85-6972-4b52-82e3-adfbec235d8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8facefae2b34dd9a57ce85eaed498cd', 'request_id': 'req-da0cde85-6972-4b52-82e3-adfbec235d8f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:18.931771 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-da0cde85-6972-4b52-82e3-adfbec235d8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8facefae2b34dd9a57ce85eaed498cd', 'request_id': 'req-da0cde85-6972-4b52-82e3-adfbec235d8f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:18.939279 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-da0cde85-6972-4b52-82e3-adfbec235d8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8facefae2b34dd9a57ce85eaed498cd', 'request_id': 'req-da0cde85-6972-4b52-82e3-adfbec235d8f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:19.031540 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-da0cde85-6972-4b52-82e3-adfbec235d8f admin admin] The token cache is being invalidate because project f8facefae2b34dd9a57ce85eaed498cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:43:19.031835 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-da0cde85-6972-4b52-82e3-adfbec235d8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:19.032797 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-da0cde85-6972-4b52-82e3-adfbec235d8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:19.034427 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4104/8230] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:43:18 2022] DELETE /identity/v3/projects/f8facefae2b34dd9a57ce85eaed498cd => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:43:19.039668 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b50d8-f12f-419f-9b8f-4a737d839839 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:19.040407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b50d8-f12f-419f-9b8f-4a737d839839 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:19.040407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b50d8-f12f-419f-9b8f-4a737d839839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:19.078365 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-df4b50d8-f12f-419f-9b8f-4a737d839839 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:19.078365 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-df4b50d8-f12f-419f-9b8f-4a737d839839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:19.137823 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4127/8231] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:43:19.146970 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555eaaa0-31d0-4465-8081-9862ff85abfb None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:19.147276 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555eaaa0-31d0-4465-8081-9862ff85abfb None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:19.147545 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555eaaa0-31d0-4465-8081-9862ff85abfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:19.166835 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-555eaaa0-31d0-4465-8081-9862ff85abfb None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:19.168054 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-555eaaa0-31d0-4465-8081-9862ff85abfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:19.176211 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4105/8232] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:43:19.181122 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b50d8-f12f-419f-9b8f-4a737d839839 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:19.191599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b50d8-f12f-419f-9b8f-4a737d839839 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:19.197034 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef40bb-4088-4c45-be13-e84ebcfdcf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:19.197700 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef40bb-4088-4c45-be13-e84ebcfdcf74 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:19.198011 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef40bb-4088-4c45-be13-e84ebcfdcf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:19.198287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef40bb-4088-4c45-be13-e84ebcfdcf74 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:19.199056 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef40bb-4088-4c45-be13-e84ebcfdcf74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:43:19.199369 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef40bb-4088-4c45-be13-e84ebcfdcf74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:19.200982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef40bb-4088-4c45-be13-e84ebcfdcf74 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:19.214971 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4128/8233] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:43:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:43:19.219378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555eaaa0-31d0-4465-8081-9862ff85abfb None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:19.229427 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555eaaa0-31d0-4465-8081-9862ff85abfb None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:19.237185 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45462d4e-ef62-449e-96ed-779611ee1b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:19.237902 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45462d4e-ef62-449e-96ed-779611ee1b47 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:19.238182 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45462d4e-ef62-449e-96ed-779611ee1b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:19.238511 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45462d4e-ef62-449e-96ed-779611ee1b47 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:19.239223 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45462d4e-ef62-449e-96ed-779611ee1b47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:19.241190 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45462d4e-ef62-449e-96ed-779611ee1b47 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:19.358790 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4106/8234] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:43:19 2022] POST /identity/v3/projects => generated 381 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:43:19.363227 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef40bb-4088-4c45-be13-e84ebcfdcf74 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:19.376464 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef40bb-4088-4c45-be13-e84ebcfdcf74 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:19.438165 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949b38a-a6d3-4a80-8d39-b43eb6e0be49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:19.438902 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949b38a-a6d3-4a80-8d39-b43eb6e0be49 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:19.439181 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949b38a-a6d3-4a80-8d39-b43eb6e0be49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:19.439514 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949b38a-a6d3-4a80-8d39-b43eb6e0be49 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:19.440218 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a949b38a-a6d3-4a80-8d39-b43eb6e0be49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:19.442267 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a949b38a-a6d3-4a80-8d39-b43eb6e0be49 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:19.562875 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4129/8235] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:43:19 2022] POST /identity/v3/users => generated 291 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:43:19.567410 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45462d4e-ef62-449e-96ed-779611ee1b47 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:19.578667 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45462d4e-ef62-449e-96ed-779611ee1b47 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:19.583519 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ce248-86b7-4066-a18f-1be5b8f4508d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:19.584250 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ce248-86b7-4066-a18f-1be5b8f4508d admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:19.588971 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ce248-86b7-4066-a18f-1be5b8f4508d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:19.588971 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ce248-86b7-4066-a18f-1be5b8f4508d admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:19.588971 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ce248-86b7-4066-a18f-1be5b8f4508d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:19.588971 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ce248-86b7-4066-a18f-1be5b8f4508d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:19.603015 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4107/8236] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:43:19.604522 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949b38a-a6d3-4a80-8d39-b43eb6e0be49 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:19.615844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949b38a-a6d3-4a80-8d39-b43eb6e0be49 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:19.621714 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e7b19-55df-40fc-b02b-6be6be50da2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:19.622410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e7b19-55df-40fc-b02b-6be6be50da2e admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:19.622688 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e7b19-55df-40fc-b02b-6be6be50da2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:19.622972 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e7b19-55df-40fc-b02b-6be6be50da2e admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:19.623715 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e7b19-55df-40fc-b02b-6be6be50da2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:19.625313 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e7b19-55df-40fc-b02b-6be6be50da2e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:19.635408 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4130/8237] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:43:19.639641 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ce248-86b7-4066-a18f-1be5b8f4508d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:19.651829 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ce248-86b7-4066-a18f-1be5b8f4508d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:19.657067 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6463e8-5966-4bf1-a802-589231673199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:19.658191 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6463e8-5966-4bf1-a802-589231673199 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:19.658503 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6463e8-5966-4bf1-a802-589231673199 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:19.661500 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6463e8-5966-4bf1-a802-589231673199 admin admin] PATH_INFO: `/v3/projects/8ef386dbdc8a4edd93cd2a608684c477/users/7868e39fd64f4e50beb4037631158d56/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:19.685630 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6463e8-5966-4bf1-a802-589231673199 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ef386dbdc8a4edd93cd2a608684c477, user_id=7868e39fd64f4e50beb4037631158d56, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:19.688745 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6463e8-5966-4bf1-a802-589231673199 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:19.786486 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4108/8238] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:43:19 2022] PUT /identity/v3/projects/8ef386dbdc8a4edd93cd2a608684c477/users/7868e39fd64f4e50beb4037631158d56/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:43:19.799332 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9d530-ab9b-414f-9e34-44a481d3b4b2 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:19.799890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9d530-ab9b-414f-9e34-44a481d3b4b2 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:19.800391 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9d530-ab9b-414f-9e34-44a481d3b4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:19.837054 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-65f9d530-ab9b-414f-9e34-44a481d3b4b2 None None] MFA Rules not processed for user `7868e39fd64f4e50beb4037631158d56`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:19.838377 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-65f9d530-ab9b-414f-9e34-44a481d3b4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:19.936725 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4131/8239] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:43:19.940977 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6463e8-5966-4bf1-a802-589231673199 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:20.008516 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6463e8-5966-4bf1-a802-589231673199 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:20.013278 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535b7d1-b3f2-4dbb-8121-7ff0a348d270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:20.013977 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535b7d1-b3f2-4dbb-8121-7ff0a348d270 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:20.014267 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535b7d1-b3f2-4dbb-8121-7ff0a348d270 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:20.014551 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535b7d1-b3f2-4dbb-8121-7ff0a348d270 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:20.015271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1535b7d1-b3f2-4dbb-8121-7ff0a348d270 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:20.017209 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1535b7d1-b3f2-4dbb-8121-7ff0a348d270 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:20.115271 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4109/8240] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:43:19 2022] POST /identity/v3/projects => generated 379 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:43:20.119140 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9d530-ab9b-414f-9e34-44a481d3b4b2 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:20.130299 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9d530-ab9b-414f-9e34-44a481d3b4b2 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:20.222198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d000431-8fd2-4fce-9d43-93cf5b4142b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:20.222921 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d000431-8fd2-4fce-9d43-93cf5b4142b0 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:20.223208 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d000431-8fd2-4fce-9d43-93cf5b4142b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:20.223486 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d000431-8fd2-4fce-9d43-93cf5b4142b0 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:20.224192 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d000431-8fd2-4fce-9d43-93cf5b4142b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:20.226227 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d000431-8fd2-4fce-9d43-93cf5b4142b0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:20.343680 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4132/8241] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:43:20 2022] POST /identity/v3/users => generated 296 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:43:20.345232 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535b7d1-b3f2-4dbb-8121-7ff0a348d270 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:20.355908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535b7d1-b3f2-4dbb-8121-7ff0a348d270 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:20.360885 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222ab5e1-bc3c-4681-b978-c283824f7cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:20.364981 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ab5e1-bc3c-4681-b978-c283824f7cdb admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:20.365310 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ab5e1-bc3c-4681-b978-c283824f7cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:20.365601 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ab5e1-bc3c-4681-b978-c283824f7cdb admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:20.366383 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222ab5e1-bc3c-4681-b978-c283824f7cdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:20.368837 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222ab5e1-bc3c-4681-b978-c283824f7cdb admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:20.386781 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4110/8242] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:43:20 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:43:20.395578 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d000431-8fd2-4fce-9d43-93cf5b4142b0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:20.407397 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d000431-8fd2-4fce-9d43-93cf5b4142b0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:20.412284 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5212cfb-53c1-4914-bf1e-a8cfad747223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:20.413172 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5212cfb-53c1-4914-bf1e-a8cfad747223 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:20.413457 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5212cfb-53c1-4914-bf1e-a8cfad747223 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:20.413733 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5212cfb-53c1-4914-bf1e-a8cfad747223 admin admin] PATH_INFO: `/v3/projects/28555f5094594d3eb2d9d0df9ac4606e/users/745455f25b2344f98e4004c43b49eb4b/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:20.430680 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5212cfb-53c1-4914-bf1e-a8cfad747223 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28555f5094594d3eb2d9d0df9ac4606e, user_id=745455f25b2344f98e4004c43b49eb4b, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:20.438074 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5212cfb-53c1-4914-bf1e-a8cfad747223 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:20.534372 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4133/8243] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:43:20 2022] PUT /identity/v3/projects/28555f5094594d3eb2d9d0df9ac4606e/users/745455f25b2344f98e4004c43b49eb4b/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:43:20.538538 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222ab5e1-bc3c-4681-b978-c283824f7cdb admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:20.548546 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222ab5e1-bc3c-4681-b978-c283824f7cdb admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:20.605349 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f423e3-ff35-4680-8292-032eecb544ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:20.606054 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f423e3-ff35-4680-8292-032eecb544ac admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:20.606350 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f423e3-ff35-4680-8292-032eecb544ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:20.606673 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f423e3-ff35-4680-8292-032eecb544ac admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:20.607392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f423e3-ff35-4680-8292-032eecb544ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:20.609000 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f423e3-ff35-4680-8292-032eecb544ac admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:20.623704 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4111/8244] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:43:20 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:43:20.623890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5212cfb-53c1-4914-bf1e-a8cfad747223 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:20.635926 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5212cfb-53c1-4914-bf1e-a8cfad747223 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:20.656049 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4d4de-c1a2-450a-86f7-6bef6ef08358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:20.656967 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4d4de-c1a2-450a-86f7-6bef6ef08358 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:20.657246 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4d4de-c1a2-450a-86f7-6bef6ef08358 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:20.657524 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4d4de-c1a2-450a-86f7-6bef6ef08358 admin admin] PATH_INFO: `/v3/projects/28555f5094594d3eb2d9d0df9ac4606e/users/745455f25b2344f98e4004c43b49eb4b/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:20.659790 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d4d4de-c1a2-450a-86f7-6bef6ef08358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28555f5094594d3eb2d9d0df9ac4606e, user_id=745455f25b2344f98e4004c43b49eb4b, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:20.662528 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d4d4de-c1a2-450a-86f7-6bef6ef08358 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:20.678731 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4134/8245] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:43:20 2022] PUT /identity/v3/projects/28555f5094594d3eb2d9d0df9ac4606e/users/745455f25b2344f98e4004c43b49eb4b/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:43:20.689611 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1b331-f837-4ed0-a705-2d7f507f6736 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:20.690696 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1b331-f837-4ed0-a705-2d7f507f6736 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:20.691588 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1b331-f837-4ed0-a705-2d7f507f6736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:20.726042 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-5fb1b331-f837-4ed0-a705-2d7f507f6736 None None] MFA Rules not processed for user `745455f25b2344f98e4004c43b49eb4b`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:20.727813 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5fb1b331-f837-4ed0-a705-2d7f507f6736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:20.826839 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4112/8246] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:20 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:43:20.839084 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4d4de-c1a2-450a-86f7-6bef6ef08358 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:20.846035 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-97d4d4de-c1a2-450a-86f7-6bef6ef08358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:20.917048 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4d4de-c1a2-450a-86f7-6bef6ef08358 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:20.921470 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb28288-9555-49b2-950d-6c53516bc826 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:20.922915 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb28288-9555-49b2-950d-6c53516bc826 service cinder] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:20.923300 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb28288-9555-49b2-950d-6c53516bc826 service cinder] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:20.923693 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb28288-9555-49b2-950d-6c53516bc826 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:20.934203 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb28288-9555-49b2-950d-6c53516bc826 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:20.935769 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb28288-9555-49b2-950d-6c53516bc826 service cinder] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:20.972746 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4135/8247] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:43:20 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:43:21.491417 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1b331-f837-4ed0-a705-2d7f507f6736 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:21.492923 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5fb1b331-f837-4ed0-a705-2d7f507f6736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:21.559268 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1b331-f837-4ed0-a705-2d7f507f6736 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:21.563895 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98330b04-5e6e-4361-abd0-6b9d54c76d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:21.564775 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98330b04-5e6e-4361-abd0-6b9d54c76d41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:21.565060 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98330b04-5e6e-4361-abd0-6b9d54c76d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:21.565354 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98330b04-5e6e-4361-abd0-6b9d54c76d41 admin admin] PATH_INFO: `/v3/users/ae2e100e385e40fb9139cc6316c92159` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:21.566601 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98330b04-5e6e-4361-abd0-6b9d54c76d41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae2e100e385e40fb9139cc6316c92159)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:21.568543 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98330b04-5e6e-4361-abd0-6b9d54c76d41 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:21.627610 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb28288-9555-49b2-950d-6c53516bc826 service cinder] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:21.640083 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb28288-9555-49b2-950d-6c53516bc826 service cinder] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:21.645381 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8550f16c-4c19-4b5c-92a2-d0b2b31e65cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:21.646334 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550f16c-4c19-4b5c-92a2-d0b2b31e65cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:21.646622 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550f16c-4c19-4b5c-92a2-d0b2b31e65cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:21.646900 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550f16c-4c19-4b5c-92a2-d0b2b31e65cd admin admin] PATH_INFO: `/v3/users/7868e39fd64f4e50beb4037631158d56` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:21.648097 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8550f16c-4c19-4b5c-92a2-d0b2b31e65cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7868e39fd64f4e50beb4037631158d56)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:21.651069 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8550f16c-4c19-4b5c-92a2-d0b2b31e65cd admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:21.831125 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-98330b04-5e6e-4361-abd0-6b9d54c76d41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae2e100e385e40fb9139cc6316c92159'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:21.844322 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-98330b04-5e6e-4361-abd0-6b9d54c76d41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae2e100e385e40fb9139cc6316c92159'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:21.885240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8550f16c-4c19-4b5c-92a2-d0b2b31e65cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7868e39fd64f4e50beb4037631158d56'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:21.902493 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8550f16c-4c19-4b5c-92a2-d0b2b31e65cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7868e39fd64f4e50beb4037631158d56'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:21.928152 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-98330b04-5e6e-4361-abd0-6b9d54c76d41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae2e100e385e40fb9139cc6316c92159'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:21.928816 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-98330b04-5e6e-4361-abd0-6b9d54c76d41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae2e100e385e40fb9139cc6316c92159'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:21.936352 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-98330b04-5e6e-4361-abd0-6b9d54c76d41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae2e100e385e40fb9139cc6316c92159'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:21.942249 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4113/8248] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:43:21 2022] DELETE /identity/v3/users/ae2e100e385e40fb9139cc6316c92159 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:43:21.997123 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8550f16c-4c19-4b5c-92a2-d0b2b31e65cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7868e39fd64f4e50beb4037631158d56'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:22.005646 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8550f16c-4c19-4b5c-92a2-d0b2b31e65cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7868e39fd64f4e50beb4037631158d56'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:22.006389 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-8550f16c-4c19-4b5c-92a2-d0b2b31e65cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7868e39fd64f4e50beb4037631158d56'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:22.013240 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4136/8249] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:43:21 2022] DELETE /identity/v3/users/7868e39fd64f4e50beb4037631158d56 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:43:22.017949 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb13425-cc79-449f-9cf3-f82fcc840469 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:22.018240 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb13425-cc79-449f-9cf3-f82fcc840469 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:22.018533 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb13425-cc79-449f-9cf3-f82fcc840469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:22.037072 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-4fb13425-cc79-449f-9cf3-f82fcc840469 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:22.038307 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4fb13425-cc79-449f-9cf3-f82fcc840469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:22.105349 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4114/8250] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:43:22.114961 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8550f16c-4c19-4b5c-92a2-d0b2b31e65cd admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:22.116505 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8550f16c-4c19-4b5c-92a2-d0b2b31e65cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:22.185672 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8550f16c-4c19-4b5c-92a2-d0b2b31e65cd admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:22.189331 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11956a-1fc6-4601-af1f-41d5a3a87b1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:22.190012 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11956a-1fc6-4601-af1f-41d5a3a87b1f service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:22.190295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11956a-1fc6-4601-af1f-41d5a3a87b1f service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:22.190570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11956a-1fc6-4601-af1f-41d5a3a87b1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:22.200252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d11956a-1fc6-4601-af1f-41d5a3a87b1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:22.201938 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d11956a-1fc6-4601-af1f-41d5a3a87b1f service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:22.210613 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb13425-cc79-449f-9cf3-f82fcc840469 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:22.213583 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4137/8251] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:43:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:43:22.215577 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4fb13425-cc79-449f-9cf3-f82fcc840469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:22.228539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb13425-cc79-449f-9cf3-f82fcc840469 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:22.234657 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285e56e-031a-441c-af2e-c4bee4ef170b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:22.238439 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285e56e-031a-441c-af2e-c4bee4ef170b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:22.239286 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285e56e-031a-441c-af2e-c4bee4ef170b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:22.239754 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285e56e-031a-441c-af2e-c4bee4ef170b admin admin] PATH_INFO: `/v3/projects/ede1fc028b654b819f147b9e5dde458e` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:22.241183 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285e56e-031a-441c-af2e-c4bee4ef170b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ede1fc028b654b819f147b9e5dde458e)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:22.243905 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285e56e-031a-441c-af2e-c4bee4ef170b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:22.390713 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e285e56e-031a-441c-af2e-c4bee4ef170b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ede1fc028b654b819f147b9e5dde458e', 'request_id': 'req-e285e56e-031a-441c-af2e-c4bee4ef170b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:22.396019 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e285e56e-031a-441c-af2e-c4bee4ef170b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ede1fc028b654b819f147b9e5dde458e', 'request_id': 'req-e285e56e-031a-441c-af2e-c4bee4ef170b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:22.403134 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e285e56e-031a-441c-af2e-c4bee4ef170b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ede1fc028b654b819f147b9e5dde458e', 'request_id': 'req-e285e56e-031a-441c-af2e-c4bee4ef170b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:22.491106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e285e56e-031a-441c-af2e-c4bee4ef170b admin admin] The token cache is being invalidate because project ede1fc028b654b819f147b9e5dde458e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:43:22.491398 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e285e56e-031a-441c-af2e-c4bee4ef170b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:22.492056 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e285e56e-031a-441c-af2e-c4bee4ef170b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:22.495299 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4115/8252] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:43:22 2022] DELETE /identity/v3/projects/ede1fc028b654b819f147b9e5dde458e => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:43:22.499493 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11956a-1fc6-4601-af1f-41d5a3a87b1f service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:22.511024 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11956a-1fc6-4601-af1f-41d5a3a87b1f service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:22.570719 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948c46f-f3f8-4b44-9a90-04ddfab5b150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:22.572083 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948c46f-f3f8-4b44-9a90-04ddfab5b150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:22.572394 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948c46f-f3f8-4b44-9a90-04ddfab5b150 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:22.572772 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948c46f-f3f8-4b44-9a90-04ddfab5b150 admin admin] PATH_INFO: `/v3/users/1498ecb600b049d8b842921fa2e2645a` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:22.574160 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0948c46f-f3f8-4b44-9a90-04ddfab5b150 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1498ecb600b049d8b842921fa2e2645a)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:22.576224 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0948c46f-f3f8-4b44-9a90-04ddfab5b150 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:22.717357 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285e56e-031a-441c-af2e-c4bee4ef170b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:22.719077 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e285e56e-031a-441c-af2e-c4bee4ef170b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:22.737487 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285e56e-031a-441c-af2e-c4bee4ef170b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:22.742447 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16811dc1-8d16-44d0-a5cf-1af8bdd91acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:22.743605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16811dc1-8d16-44d0-a5cf-1af8bdd91acd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:22.743605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16811dc1-8d16-44d0-a5cf-1af8bdd91acd admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:22.743930 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16811dc1-8d16-44d0-a5cf-1af8bdd91acd admin admin] PATH_INFO: `/v3/projects/8ef386dbdc8a4edd93cd2a608684c477` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:22.745304 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16811dc1-8d16-44d0-a5cf-1af8bdd91acd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ef386dbdc8a4edd93cd2a608684c477)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:22.747269 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16811dc1-8d16-44d0-a5cf-1af8bdd91acd admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:22.754647 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0948c46f-f3f8-4b44-9a90-04ddfab5b150 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1498ecb600b049d8b842921fa2e2645a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:22.766669 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0948c46f-f3f8-4b44-9a90-04ddfab5b150 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1498ecb600b049d8b842921fa2e2645a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:22.848193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0948c46f-f3f8-4b44-9a90-04ddfab5b150 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1498ecb600b049d8b842921fa2e2645a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:22.856522 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0948c46f-f3f8-4b44-9a90-04ddfab5b150 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1498ecb600b049d8b842921fa2e2645a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:22.859126 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0948c46f-f3f8-4b44-9a90-04ddfab5b150 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1498ecb600b049d8b842921fa2e2645a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:22.863459 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4138/8253] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:43:22 2022] DELETE /identity/v3/users/1498ecb600b049d8b842921fa2e2645a => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:43:22.866646 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-16811dc1-8d16-44d0-a5cf-1af8bdd91acd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ef386dbdc8a4edd93cd2a608684c477', 'request_id': 'req-16811dc1-8d16-44d0-a5cf-1af8bdd91acd'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:22.872721 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-16811dc1-8d16-44d0-a5cf-1af8bdd91acd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ef386dbdc8a4edd93cd2a608684c477', 'request_id': 'req-16811dc1-8d16-44d0-a5cf-1af8bdd91acd'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:22.879204 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-16811dc1-8d16-44d0-a5cf-1af8bdd91acd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ef386dbdc8a4edd93cd2a608684c477', 'request_id': 'req-16811dc1-8d16-44d0-a5cf-1af8bdd91acd'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:22.955221 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-16811dc1-8d16-44d0-a5cf-1af8bdd91acd admin admin] The token cache is being invalidate because project 8ef386dbdc8a4edd93cd2a608684c477 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:43:22.955600 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-16811dc1-8d16-44d0-a5cf-1af8bdd91acd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:22.956474 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-16811dc1-8d16-44d0-a5cf-1af8bdd91acd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:22.959411 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4116/8254] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:43:22 2022] DELETE /identity/v3/projects/8ef386dbdc8a4edd93cd2a608684c477 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:43:22.964092 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948c46f-f3f8-4b44-9a90-04ddfab5b150 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:22.966306 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0948c46f-f3f8-4b44-9a90-04ddfab5b150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:23.030344 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948c46f-f3f8-4b44-9a90-04ddfab5b150 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:23.034927 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83460a8-3214-4fa3-bc5e-81eb54b11b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:23.035795 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83460a8-3214-4fa3-bc5e-81eb54b11b13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:23.036075 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83460a8-3214-4fa3-bc5e-81eb54b11b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:23.036350 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83460a8-3214-4fa3-bc5e-81eb54b11b13 admin admin] PATH_INFO: `/v3/users/745455f25b2344f98e4004c43b49eb4b` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:23.037547 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83460a8-3214-4fa3-bc5e-81eb54b11b13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=745455f25b2344f98e4004c43b49eb4b)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:23.040122 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83460a8-3214-4fa3-bc5e-81eb54b11b13 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:23.112451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16811dc1-8d16-44d0-a5cf-1af8bdd91acd admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:23.114053 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-16811dc1-8d16-44d0-a5cf-1af8bdd91acd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:23.191198 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16811dc1-8d16-44d0-a5cf-1af8bdd91acd admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:23.195990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58429e71-a150-47f5-9efd-930a883edf32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:23.196852 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58429e71-a150-47f5-9efd-930a883edf32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:23.197133 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58429e71-a150-47f5-9efd-930a883edf32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:23.197406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58429e71-a150-47f5-9efd-930a883edf32 admin admin] PATH_INFO: `/v3/projects/7c8d2063664e4242842a675bd6a9e4bf` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:23.198656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58429e71-a150-47f5-9efd-930a883edf32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c8d2063664e4242842a675bd6a9e4bf)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:23.200563 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58429e71-a150-47f5-9efd-930a883edf32 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:23.247572 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a83460a8-3214-4fa3-bc5e-81eb54b11b13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '745455f25b2344f98e4004c43b49eb4b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:23.258688 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a83460a8-3214-4fa3-bc5e-81eb54b11b13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '745455f25b2344f98e4004c43b49eb4b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:23.326187 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-58429e71-a150-47f5-9efd-930a883edf32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c8d2063664e4242842a675bd6a9e4bf', 'request_id': 'req-58429e71-a150-47f5-9efd-930a883edf32'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:23.332094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-58429e71-a150-47f5-9efd-930a883edf32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c8d2063664e4242842a675bd6a9e4bf', 'request_id': 'req-58429e71-a150-47f5-9efd-930a883edf32'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:23.332197 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a83460a8-3214-4fa3-bc5e-81eb54b11b13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '745455f25b2344f98e4004c43b49eb4b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:23.338460 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-58429e71-a150-47f5-9efd-930a883edf32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c8d2063664e4242842a675bd6a9e4bf', 'request_id': 'req-58429e71-a150-47f5-9efd-930a883edf32'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:23.341860 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a83460a8-3214-4fa3-bc5e-81eb54b11b13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '745455f25b2344f98e4004c43b49eb4b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:23.342422 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a83460a8-3214-4fa3-bc5e-81eb54b11b13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '745455f25b2344f98e4004c43b49eb4b'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:23.349297 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4139/8255] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:43:22 2022] DELETE /identity/v3/users/745455f25b2344f98e4004c43b49eb4b => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:43:23.422988 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-58429e71-a150-47f5-9efd-930a883edf32 admin admin] The token cache is being invalidate because project 7c8d2063664e4242842a675bd6a9e4bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:43:23.423336 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-58429e71-a150-47f5-9efd-930a883edf32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:23.424100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-58429e71-a150-47f5-9efd-930a883edf32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:23.426314 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4117/8256] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:43:23 2022] DELETE /identity/v3/projects/7c8d2063664e4242842a675bd6a9e4bf => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:43:23.432211 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9b9a8-fc2e-4108-9951-2ee8777f6ee4 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:23.433139 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9b9a8-fc2e-4108-9951-2ee8777f6ee4 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:23.433524 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9b9a8-fc2e-4108-9951-2ee8777f6ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:23.455014 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-17c9b9a8-fc2e-4108-9951-2ee8777f6ee4 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:23.456266 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-17c9b9a8-fc2e-4108-9951-2ee8777f6ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:23.517157 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4140/8257] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:43:23.525342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f151427-9360-42a1-9a0e-06be45e14871 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:23.525916 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f151427-9360-42a1-9a0e-06be45e14871 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:23.526197 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f151427-9360-42a1-9a0e-06be45e14871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:23.554425 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-2f151427-9360-42a1-9a0e-06be45e14871 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:23.555634 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2f151427-9360-42a1-9a0e-06be45e14871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:23.564165 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4118/8258] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:43:23.568434 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c9b9a8-fc2e-4108-9951-2ee8777f6ee4 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:23.579964 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c9b9a8-fc2e-4108-9951-2ee8777f6ee4 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:23.588284 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c08fe-f795-4725-8cc6-fbb622ea6c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:23.588284 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c08fe-f795-4725-8cc6-fbb622ea6c7d admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:23.588284 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c08fe-f795-4725-8cc6-fbb622ea6c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:23.588284 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c08fe-f795-4725-8cc6-fbb622ea6c7d admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:23.588620 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c08fe-f795-4725-8cc6-fbb622ea6c7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:43:23.588620 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c08fe-f795-4725-8cc6-fbb622ea6c7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:23.589867 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c08fe-f795-4725-8cc6-fbb622ea6c7d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:23.605083 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4141/8259] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:43:23.614692 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f151427-9360-42a1-9a0e-06be45e14871 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:23.624869 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f151427-9360-42a1-9a0e-06be45e14871 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:23.630288 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846e62e-5f15-4616-a777-5259f9b5054f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:23.634942 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846e62e-5f15-4616-a777-5259f9b5054f admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:23.634942 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846e62e-5f15-4616-a777-5259f9b5054f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:23.634942 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846e62e-5f15-4616-a777-5259f9b5054f admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:23.634942 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846e62e-5f15-4616-a777-5259f9b5054f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:23.634942 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8846e62e-5f15-4616-a777-5259f9b5054f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:23.733893 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4119/8260] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:43:23 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:43:23.737979 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c08fe-f795-4725-8cc6-fbb622ea6c7d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:23.748031 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c08fe-f795-4725-8cc6-fbb622ea6c7d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:23.806100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fac797-3e9f-47c2-acf4-7e38baa05749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:23.806906 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fac797-3e9f-47c2-acf4-7e38baa05749 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:23.807713 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fac797-3e9f-47c2-acf4-7e38baa05749 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:23.808010 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fac797-3e9f-47c2-acf4-7e38baa05749 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:23.808722 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fac797-3e9f-47c2-acf4-7e38baa05749 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:23.811357 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fac797-3e9f-47c2-acf4-7e38baa05749 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:23.811682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846e62e-5f15-4616-a777-5259f9b5054f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:23.813842 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8846e62e-5f15-4616-a777-5259f9b5054f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:23.834782 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8846e62e-5f15-4616-a777-5259f9b5054f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:23.853017 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f358d3-8f51-4c91-a9d0-e1ce86a96146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:23.856015 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f358d3-8f51-4c91-a9d0-e1ce86a96146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:23.856015 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f358d3-8f51-4c91-a9d0-e1ce86a96146 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:23.856015 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f358d3-8f51-4c91-a9d0-e1ce86a96146 admin admin] PATH_INFO: `/v3/projects/28555f5094594d3eb2d9d0df9ac4606e` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:23.856015 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f358d3-8f51-4c91-a9d0-e1ce86a96146 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28555f5094594d3eb2d9d0df9ac4606e)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:23.858311 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f358d3-8f51-4c91-a9d0-e1ce86a96146 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:23.894653 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4142/8261] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:43:23 2022] POST /identity/v3/users => generated 292 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:43:23.899334 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fac797-3e9f-47c2-acf4-7e38baa05749 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:23.909484 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fac797-3e9f-47c2-acf4-7e38baa05749 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:23.914315 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a255c6-ebfb-4456-a4fe-96fb26de6ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:23.914968 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a255c6-ebfb-4456-a4fe-96fb26de6ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:23.915286 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a255c6-ebfb-4456-a4fe-96fb26de6ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:23.915542 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a255c6-ebfb-4456-a4fe-96fb26de6ce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:23.916300 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a255c6-ebfb-4456-a4fe-96fb26de6ce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:23.917935 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a255c6-ebfb-4456-a4fe-96fb26de6ce0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:23.927727 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4143/8262] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:43:23.934341 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a255c6-ebfb-4456-a4fe-96fb26de6ce0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:23.943613 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a255c6-ebfb-4456-a4fe-96fb26de6ce0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:23.948804 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b5596-101d-4628-9780-335f680a5d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:23.949410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b5596-101d-4628-9780-335f680a5d76 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:23.949697 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b5596-101d-4628-9780-335f680a5d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:23.950006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b5596-101d-4628-9780-335f680a5d76 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:23.950704 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60b5596-101d-4628-9780-335f680a5d76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:23.952236 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60b5596-101d-4628-9780-335f680a5d76 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:23.963537 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4144/8263] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:43:23.967538 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b5596-101d-4628-9780-335f680a5d76 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:23.977561 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b5596-101d-4628-9780-335f680a5d76 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:23.983450 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0fe94-cdb7-4c2f-8af5-2251dbeffac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:23.992660 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0fe94-cdb7-4c2f-8af5-2251dbeffac5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:23.992660 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0fe94-cdb7-4c2f-8af5-2251dbeffac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:23.992660 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0fe94-cdb7-4c2f-8af5-2251dbeffac5 admin admin] PATH_INFO: `/v3/projects/abef47ea98c94b53836ceb8e201788f7/users/34a160f829dd4dc6af9f2254653dc0b8/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:23.998299 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-54f358d3-8f51-4c91-a9d0-e1ce86a96146 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28555f5094594d3eb2d9d0df9ac4606e', 'request_id': 'req-54f358d3-8f51-4c91-a9d0-e1ce86a96146'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:24.002848 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff0fe94-cdb7-4c2f-8af5-2251dbeffac5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abef47ea98c94b53836ceb8e201788f7, user_id=34a160f829dd4dc6af9f2254653dc0b8, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:24.003867 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-54f358d3-8f51-4c91-a9d0-e1ce86a96146 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28555f5094594d3eb2d9d0df9ac4606e', 'request_id': 'req-54f358d3-8f51-4c91-a9d0-e1ce86a96146'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:24.005609 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff0fe94-cdb7-4c2f-8af5-2251dbeffac5 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:24.012406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-54f358d3-8f51-4c91-a9d0-e1ce86a96146 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28555f5094594d3eb2d9d0df9ac4606e', 'request_id': 'req-54f358d3-8f51-4c91-a9d0-e1ce86a96146'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:24.092215 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4145/8264] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:43:23 2022] PUT /identity/v3/projects/abef47ea98c94b53836ceb8e201788f7/users/34a160f829dd4dc6af9f2254653dc0b8/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:43:24.097334 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c05f3f-fa10-465b-83e8-f2b9a6bc46c4 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:24.097632 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c05f3f-fa10-465b-83e8-f2b9a6bc46c4 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:24.097952 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c05f3f-fa10-465b-83e8-f2b9a6bc46c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:24.115259 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-69c05f3f-fa10-465b-83e8-f2b9a6bc46c4 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:24.116466 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-69c05f3f-fa10-465b-83e8-f2b9a6bc46c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:24.148226 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-54f358d3-8f51-4c91-a9d0-e1ce86a96146 admin admin] The token cache is being invalidate because project 28555f5094594d3eb2d9d0df9ac4606e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:43:24.148555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-54f358d3-8f51-4c91-a9d0-e1ce86a96146 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:24.149239 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-54f358d3-8f51-4c91-a9d0-e1ce86a96146 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:24.151097 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4120/8265] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:43:23 2022] DELETE /identity/v3/projects/28555f5094594d3eb2d9d0df9ac4606e => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:43:24.155794 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6b7ed-5207-4b6c-9f47-af0da11066ab None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:24.156082 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6b7ed-5207-4b6c-9f47-af0da11066ab None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:24.156361 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6b7ed-5207-4b6c-9f47-af0da11066ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:24.176353 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-80a6b7ed-5207-4b6c-9f47-af0da11066ab None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:24.179330 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-80a6b7ed-5207-4b6c-9f47-af0da11066ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:24.181187 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4146/8266] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:43:24.196403 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c05f3f-fa10-465b-83e8-f2b9a6bc46c4 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:24.199300 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-69c05f3f-fa10-465b-83e8-f2b9a6bc46c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:24.201721 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4121/8267] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:43:24.209716 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1149a-a921-4914-8759-f3c8ed86d91e None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:24.210116 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1149a-a921-4914-8759-f3c8ed86d91e None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:24.210411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1149a-a921-4914-8759-f3c8ed86d91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:24.242802 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-56a1149a-a921-4914-8759-f3c8ed86d91e None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:24.244031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-56a1149a-a921-4914-8759-f3c8ed86d91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:24.252635 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4122/8268] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:43:24.256873 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1149a-a921-4914-8759-f3c8ed86d91e None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:24.266245 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1149a-a921-4914-8759-f3c8ed86d91e None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:24.271089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a47bf-f512-42dd-ac9b-3b100aaf598b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:24.271887 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a47bf-f512-42dd-ac9b-3b100aaf598b admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:24.272352 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a47bf-f512-42dd-ac9b-3b100aaf598b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:24.272887 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a47bf-f512-42dd-ac9b-3b100aaf598b admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:24.274452 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a47bf-f512-42dd-ac9b-3b100aaf598b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:43:24.274862 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a47bf-f512-42dd-ac9b-3b100aaf598b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:24.275149 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c05f3f-fa10-465b-83e8-f2b9a6bc46c4 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:24.277225 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a47bf-f512-42dd-ac9b-3b100aaf598b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:24.279741 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5716c6d-ca1a-4c8f-bed3-c4337d60f510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:24.284201 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5716c6d-ca1a-4c8f-bed3-c4337d60f510 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:24.284201 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5716c6d-ca1a-4c8f-bed3-c4337d60f510 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:24.284201 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5716c6d-ca1a-4c8f-bed3-c4337d60f510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:24.290775 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4123/8269] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:43:24.295138 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5716c6d-ca1a-4c8f-bed3-c4337d60f510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:24.295265 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a47bf-f512-42dd-ac9b-3b100aaf598b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:24.296814 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5716c6d-ca1a-4c8f-bed3-c4337d60f510 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:24.305017 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a47bf-f512-42dd-ac9b-3b100aaf598b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:24.306908 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4147/8270] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:43:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:43:24.309881 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a6a8f-ee12-421c-8f88-c31147aed632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:24.310522 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a6a8f-ee12-421c-8f88-c31147aed632 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:24.310804 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a6a8f-ee12-421c-8f88-c31147aed632 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:24.311075 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a6a8f-ee12-421c-8f88-c31147aed632 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:24.311750 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a6a8f-ee12-421c-8f88-c31147aed632 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:24.313669 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a6a8f-ee12-421c-8f88-c31147aed632 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:24.428222 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4124/8271] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:43:24 2022] POST /identity/v3/projects => generated 361 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:43:24.430977 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5716c6d-ca1a-4c8f-bed3-c4337d60f510 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:24.440736 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5716c6d-ca1a-4c8f-bed3-c4337d60f510 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:24.516980 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9243cfb-6a1a-49df-a6c4-0e55dc4d6c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:24.516980 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9243cfb-6a1a-49df-a6c4-0e55dc4d6c25 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:24.516980 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9243cfb-6a1a-49df-a6c4-0e55dc4d6c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:24.516980 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9243cfb-6a1a-49df-a6c4-0e55dc4d6c25 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:24.517405 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9243cfb-6a1a-49df-a6c4-0e55dc4d6c25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:24.517405 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9243cfb-6a1a-49df-a6c4-0e55dc4d6c25 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:24.657538 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4148/8272] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:43:24 2022] POST /identity/v3/users => generated 281 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:43:24.674698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a6a8f-ee12-421c-8f88-c31147aed632 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:24.685394 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a6a8f-ee12-421c-8f88-c31147aed632 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:24.690297 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be16fd-427c-4ec2-a300-0a3aedb8a881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:24.691264 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be16fd-427c-4ec2-a300-0a3aedb8a881 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:24.691553 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be16fd-427c-4ec2-a300-0a3aedb8a881 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:24.691833 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be16fd-427c-4ec2-a300-0a3aedb8a881 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:24.692604 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be16fd-427c-4ec2-a300-0a3aedb8a881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:24.694271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be16fd-427c-4ec2-a300-0a3aedb8a881 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:24.705526 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4125/8273] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:43:24.709695 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9243cfb-6a1a-49df-a6c4-0e55dc4d6c25 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:24.720636 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9243cfb-6a1a-49df-a6c4-0e55dc4d6c25 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:24.725301 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39168b3a-9a39-4ce7-856e-658bcf8f86ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:24.726000 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39168b3a-9a39-4ce7-856e-658bcf8f86ab admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:24.726287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39168b3a-9a39-4ce7-856e-658bcf8f86ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:24.726656 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39168b3a-9a39-4ce7-856e-658bcf8f86ab admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:24.727410 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39168b3a-9a39-4ce7-856e-658bcf8f86ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:24.730778 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39168b3a-9a39-4ce7-856e-658bcf8f86ab admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:24.742449 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4149/8274] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:43:24.745544 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be16fd-427c-4ec2-a300-0a3aedb8a881 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:24.757022 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be16fd-427c-4ec2-a300-0a3aedb8a881 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:24.762404 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abcdf35-e773-4dd8-91ed-e428dc56fc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:24.763285 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abcdf35-e773-4dd8-91ed-e428dc56fc6c admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:24.763567 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abcdf35-e773-4dd8-91ed-e428dc56fc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:24.763846 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abcdf35-e773-4dd8-91ed-e428dc56fc6c admin admin] PATH_INFO: `/v3/projects/6696a65676ec45a09ffcf270f3ae30dc/users/726b30454fc947aba6ac9edb77bb06dd/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:24.780252 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abcdf35-e773-4dd8-91ed-e428dc56fc6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6696a65676ec45a09ffcf270f3ae30dc, user_id=726b30454fc947aba6ac9edb77bb06dd, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:24.782981 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abcdf35-e773-4dd8-91ed-e428dc56fc6c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:24.869087 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4126/8275] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:43:24 2022] PUT /identity/v3/projects/6696a65676ec45a09ffcf270f3ae30dc/users/726b30454fc947aba6ac9edb77bb06dd/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:43:24.970556 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393cc54-3fbf-4cc6-858e-3d6314800054 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:24.971138 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393cc54-3fbf-4cc6-858e-3d6314800054 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:24.971138 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393cc54-3fbf-4cc6-858e-3d6314800054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:24.997854 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-e393cc54-3fbf-4cc6-858e-3d6314800054 None None] MFA Rules not processed for user `726b30454fc947aba6ac9edb77bb06dd`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:24.999080 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e393cc54-3fbf-4cc6-858e-3d6314800054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:25.069508 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4150/8276] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:24 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:43:25.107243 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abcdf35-e773-4dd8-91ed-e428dc56fc6c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:25.109183 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7abcdf35-e773-4dd8-91ed-e428dc56fc6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:25.171235 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abcdf35-e773-4dd8-91ed-e428dc56fc6c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:25.174958 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd7830-44c1-4606-add4-0f1db800edec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:25.175611 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd7830-44c1-4606-add4-0f1db800edec service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:25.175900 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd7830-44c1-4606-add4-0f1db800edec service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:25.176182 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd7830-44c1-4606-add4-0f1db800edec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:25.185421 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd7830-44c1-4606-add4-0f1db800edec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:25.186954 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd7830-44c1-4606-add4-0f1db800edec service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:25.196505 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4127/8277] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:43:25 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:43:25.210401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e393cc54-3fbf-4cc6-858e-3d6314800054 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:25.275154 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e393cc54-3fbf-4cc6-858e-3d6314800054 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:25.281283 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd6fe4-9822-4c2b-97fa-73fd78ba69e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:25.282783 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd6fe4-9822-4c2b-97fa-73fd78ba69e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:25.283126 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd6fe4-9822-4c2b-97fa-73fd78ba69e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:25.283415 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd6fe4-9822-4c2b-97fa-73fd78ba69e7 admin admin] PATH_INFO: `/v3/users/726b30454fc947aba6ac9edb77bb06dd` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:25.284781 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd6fe4-9822-4c2b-97fa-73fd78ba69e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=726b30454fc947aba6ac9edb77bb06dd)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:25.286807 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd6fe4-9822-4c2b-97fa-73fd78ba69e7 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:25.465416 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6fbd6fe4-9822-4c2b-97fa-73fd78ba69e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '726b30454fc947aba6ac9edb77bb06dd'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:25.478504 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6fbd6fe4-9822-4c2b-97fa-73fd78ba69e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '726b30454fc947aba6ac9edb77bb06dd'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:25.585407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6fbd6fe4-9822-4c2b-97fa-73fd78ba69e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '726b30454fc947aba6ac9edb77bb06dd'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:25.593516 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6fbd6fe4-9822-4c2b-97fa-73fd78ba69e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '726b30454fc947aba6ac9edb77bb06dd'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:25.594249 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6fbd6fe4-9822-4c2b-97fa-73fd78ba69e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '726b30454fc947aba6ac9edb77bb06dd'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:25.600424 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4151/8278] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:43:25 2022] DELETE /identity/v3/users/726b30454fc947aba6ac9edb77bb06dd => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:43:25.605815 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb4078-dce6-4dd3-8257-7611b1903174 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:25.606108 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb4078-dce6-4dd3-8257-7611b1903174 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:25.606418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb4078-dce6-4dd3-8257-7611b1903174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:25.616137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd6fe4-9822-4c2b-97fa-73fd78ba69e7 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:25.618499 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6fbd6fe4-9822-4c2b-97fa-73fd78ba69e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:25.627148 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-82eb4078-dce6-4dd3-8257-7611b1903174 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:25.628447 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-82eb4078-dce6-4dd3-8257-7611b1903174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:25.694684 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4128/8279] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:43:25.704484 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb4078-dce6-4dd3-8257-7611b1903174 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:25.705982 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-82eb4078-dce6-4dd3-8257-7611b1903174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:25.730491 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd6fe4-9822-4c2b-97fa-73fd78ba69e7 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:25.736123 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb1299-a79a-4f71-b904-18e6c9975f4b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:25.736782 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb1299-a79a-4f71-b904-18e6c9975f4b service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:25.737064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb1299-a79a-4f71-b904-18e6c9975f4b service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:25.737339 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb1299-a79a-4f71-b904-18e6c9975f4b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:25.739326 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-faeb1299-a79a-4f71-b904-18e6c9975f4b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:25.753726 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb1299-a79a-4f71-b904-18e6c9975f4b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:25.755354 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb1299-a79a-4f71-b904-18e6c9975f4b service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:25.768097 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb4078-dce6-4dd3-8257-7611b1903174 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:25.768529 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4152/8280] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:43:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:43:25.771837 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fb4f3-1b76-4008-a591-007b29c10af5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:25.773983 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fb4f3-1b76-4008-a591-007b29c10af5 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:25.773983 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fb4f3-1b76-4008-a591-007b29c10af5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:25.773983 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fb4f3-1b76-4008-a591-007b29c10af5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:25.783496 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648fb4f3-1b76-4008-a591-007b29c10af5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:25.784979 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648fb4f3-1b76-4008-a591-007b29c10af5 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:25.795525 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4129/8281] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:43:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:43:26.353921 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb1299-a79a-4f71-b904-18e6c9975f4b service placement] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:26.356050 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-faeb1299-a79a-4f71-b904-18e6c9975f4b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:26.375393 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb1299-a79a-4f71-b904-18e6c9975f4b service placement] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:26.385580 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2114fa8-a3f4-41f4-a36c-b2c1d8e53f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:26.387262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2114fa8-a3f4-41f4-a36c-b2c1d8e53f18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:26.387552 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2114fa8-a3f4-41f4-a36c-b2c1d8e53f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:26.387825 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2114fa8-a3f4-41f4-a36c-b2c1d8e53f18 admin admin] PATH_INFO: `/v3/projects/6696a65676ec45a09ffcf270f3ae30dc` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:26.389148 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2114fa8-a3f4-41f4-a36c-b2c1d8e53f18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6696a65676ec45a09ffcf270f3ae30dc)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:26.391148 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2114fa8-a3f4-41f4-a36c-b2c1d8e53f18 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:26.576310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a2114fa8-a3f4-41f4-a36c-b2c1d8e53f18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6696a65676ec45a09ffcf270f3ae30dc', 'request_id': 'req-a2114fa8-a3f4-41f4-a36c-b2c1d8e53f18'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:26.583330 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a2114fa8-a3f4-41f4-a36c-b2c1d8e53f18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6696a65676ec45a09ffcf270f3ae30dc', 'request_id': 'req-a2114fa8-a3f4-41f4-a36c-b2c1d8e53f18'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:26.595289 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a2114fa8-a3f4-41f4-a36c-b2c1d8e53f18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6696a65676ec45a09ffcf270f3ae30dc', 'request_id': 'req-a2114fa8-a3f4-41f4-a36c-b2c1d8e53f18'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:26.710708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a2114fa8-a3f4-41f4-a36c-b2c1d8e53f18 admin admin] The token cache is being invalidate because project 6696a65676ec45a09ffcf270f3ae30dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:43:26.715024 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a2114fa8-a3f4-41f4-a36c-b2c1d8e53f18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:26.715024 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a2114fa8-a3f4-41f4-a36c-b2c1d8e53f18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:26.715024 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4153/8282] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:43:26 2022] DELETE /identity/v3/projects/6696a65676ec45a09ffcf270f3ae30dc => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:43:26.718325 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b5200-a97d-4b64-9f2f-216223cf7317 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:26.718816 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b5200-a97d-4b64-9f2f-216223cf7317 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:26.718922 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b5200-a97d-4b64-9f2f-216223cf7317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:26.740281 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-e12b5200-a97d-4b64-9f2f-216223cf7317 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:26.743770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e12b5200-a97d-4b64-9f2f-216223cf7317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:26.823037 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4130/8283] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:43:26.831155 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb74500-ff19-4a4c-8442-38bcf421af99 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:26.831696 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb74500-ff19-4a4c-8442-38bcf421af99 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:26.832164 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb74500-ff19-4a4c-8442-38bcf421af99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:26.857025 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-fcb74500-ff19-4a4c-8442-38bcf421af99 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:26.858411 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-fcb74500-ff19-4a4c-8442-38bcf421af99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:26.871193 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4154/8284] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:43:26.872313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b5200-a97d-4b64-9f2f-216223cf7317 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:26.883255 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b5200-a97d-4b64-9f2f-216223cf7317 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:26.888145 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cfb3d1-6267-41d9-845c-c27488306ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:26.889038 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cfb3d1-6267-41d9-845c-c27488306ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:26.889426 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cfb3d1-6267-41d9-845c-c27488306ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:26.889792 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cfb3d1-6267-41d9-845c-c27488306ef0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:26.890862 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cfb3d1-6267-41d9-845c-c27488306ef0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:43:26.891243 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cfb3d1-6267-41d9-845c-c27488306ef0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:26.892944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cfb3d1-6267-41d9-845c-c27488306ef0 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:26.907317 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4131/8285] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:43:26.911850 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb74500-ff19-4a4c-8442-38bcf421af99 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:26.924791 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb74500-ff19-4a4c-8442-38bcf421af99 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:26.933157 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed42a3-29be-4647-84ba-f8103fa79b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:26.933877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed42a3-29be-4647-84ba-f8103fa79b4a admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:26.934367 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed42a3-29be-4647-84ba-f8103fa79b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:26.934649 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed42a3-29be-4647-84ba-f8103fa79b4a admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:26.935925 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed42a3-29be-4647-84ba-f8103fa79b4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:26.938066 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed42a3-29be-4647-84ba-f8103fa79b4a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:27.052375 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4155/8286] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:43:26 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:43:27.057099 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cfb3d1-6267-41d9-845c-c27488306ef0 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:27.079063 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cfb3d1-6267-41d9-845c-c27488306ef0 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:27.143914 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df01056-42bb-424e-8a86-0e355fb78499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:27.144601 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df01056-42bb-424e-8a86-0e355fb78499 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:27.144893 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df01056-42bb-424e-8a86-0e355fb78499 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:27.145174 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df01056-42bb-424e-8a86-0e355fb78499 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:27.145912 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df01056-42bb-424e-8a86-0e355fb78499 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:27.148048 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df01056-42bb-424e-8a86-0e355fb78499 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:27.262258 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4132/8287] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:43:27 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:43:27.266238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed42a3-29be-4647-84ba-f8103fa79b4a admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:27.285723 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed42a3-29be-4647-84ba-f8103fa79b4a admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:27.301009 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5354f8-ae13-44d8-860e-3a8cda4ff8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:27.305441 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5354f8-ae13-44d8-860e-3a8cda4ff8e6 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:27.305441 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5354f8-ae13-44d8-860e-3a8cda4ff8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:27.305441 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5354f8-ae13-44d8-860e-3a8cda4ff8e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:27.305441 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5354f8-ae13-44d8-860e-3a8cda4ff8e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:27.307551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5354f8-ae13-44d8-860e-3a8cda4ff8e6 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:27.321902 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4156/8288] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:43:27.323766 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df01056-42bb-424e-8a86-0e355fb78499 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:27.334539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df01056-42bb-424e-8a86-0e355fb78499 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:27.341029 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e70e1-024a-4cc1-af25-24204ccc9103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:27.341830 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e70e1-024a-4cc1-af25-24204ccc9103 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:27.342209 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e70e1-024a-4cc1-af25-24204ccc9103 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:27.342588 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e70e1-024a-4cc1-af25-24204ccc9103 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:27.343378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e70e1-024a-4cc1-af25-24204ccc9103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:27.345047 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e70e1-024a-4cc1-af25-24204ccc9103 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:27.361835 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4133/8289] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:43:27.368148 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5354f8-ae13-44d8-860e-3a8cda4ff8e6 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:27.373978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5354f8-ae13-44d8-860e-3a8cda4ff8e6 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:27.379101 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620b5a3-fe98-4e28-95b8-5be42c28352c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:27.380003 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620b5a3-fe98-4e28-95b8-5be42c28352c admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:27.380306 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620b5a3-fe98-4e28-95b8-5be42c28352c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:27.380714 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620b5a3-fe98-4e28-95b8-5be42c28352c admin admin] PATH_INFO: `/v3/projects/786a3b8d82e44b2ca6ff802cf02c28c7/users/d25e8bbbe40f40d689a1e4ab5c9c452e/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:27.401461 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620b5a3-fe98-4e28-95b8-5be42c28352c admin admin] RBAC: Authorizing `identity:create_grant(project_id=786a3b8d82e44b2ca6ff802cf02c28c7, user_id=d25e8bbbe40f40d689a1e4ab5c9c452e, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:27.404157 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620b5a3-fe98-4e28-95b8-5be42c28352c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:27.484267 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4157/8290] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:43:27 2022] PUT /identity/v3/projects/786a3b8d82e44b2ca6ff802cf02c28c7/users/d25e8bbbe40f40d689a1e4ab5c9c452e/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:43:27.495293 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547c98b-fe42-40fc-9aad-90727c7537fe None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:27.495710 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547c98b-fe42-40fc-9aad-90727c7537fe None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:27.496087 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547c98b-fe42-40fc-9aad-90727c7537fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:27.530101 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-d547c98b-fe42-40fc-9aad-90727c7537fe None None] MFA Rules not processed for user `d25e8bbbe40f40d689a1e4ab5c9c452e`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:27.531437 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d547c98b-fe42-40fc-9aad-90727c7537fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:27.606438 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4134/8291] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:43:27.610209 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620b5a3-fe98-4e28-95b8-5be42c28352c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:27.683383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620b5a3-fe98-4e28-95b8-5be42c28352c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:27.688895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ba85c-2d89-44d5-b695-7eb0e0fed555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:27.689669 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ba85c-2d89-44d5-b695-7eb0e0fed555 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:27.690258 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ba85c-2d89-44d5-b695-7eb0e0fed555 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:27.690824 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ba85c-2d89-44d5-b695-7eb0e0fed555 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:27.691389 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ba85c-2d89-44d5-b695-7eb0e0fed555 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:27.693399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ba85c-2d89-44d5-b695-7eb0e0fed555 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:27.786019 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4158/8292] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:43:27 2022] POST /identity/v3/projects => generated 383 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:43:27.790248 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547c98b-fe42-40fc-9aad-90727c7537fe None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:27.803857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547c98b-fe42-40fc-9aad-90727c7537fe None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:27.871953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff4b8c-3371-4115-b65f-2697beda56cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:27.872952 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff4b8c-3371-4115-b65f-2697beda56cd admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:27.873313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff4b8c-3371-4115-b65f-2697beda56cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:27.873659 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff4b8c-3371-4115-b65f-2697beda56cd admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:27.874912 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff4b8c-3371-4115-b65f-2697beda56cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:27.877573 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff4b8c-3371-4115-b65f-2697beda56cd admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:27.996218 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4135/8293] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:43:27 2022] POST /identity/v3/users => generated 292 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:43:28.000401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ba85c-2d89-44d5-b695-7eb0e0fed555 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:28.011789 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ba85c-2d89-44d5-b695-7eb0e0fed555 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:28.021227 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42afb2c9-e918-4d57-a562-2fbdfd5d4fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:28.021946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42afb2c9-e918-4d57-a562-2fbdfd5d4fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:28.022403 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42afb2c9-e918-4d57-a562-2fbdfd5d4fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:28.022684 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42afb2c9-e918-4d57-a562-2fbdfd5d4fc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:28.023417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42afb2c9-e918-4d57-a562-2fbdfd5d4fc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:28.026045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42afb2c9-e918-4d57-a562-2fbdfd5d4fc2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:28.038658 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4159/8294] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:43:28.043432 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff4b8c-3371-4115-b65f-2697beda56cd admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:28.055828 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff4b8c-3371-4115-b65f-2697beda56cd admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:28.061819 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a4abb6-16e1-466a-a2aa-7354570746e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:28.062659 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4abb6-16e1-466a-a2aa-7354570746e9 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:28.062951 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4abb6-16e1-466a-a2aa-7354570746e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:28.063230 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4abb6-16e1-466a-a2aa-7354570746e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:28.063961 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a4abb6-16e1-466a-a2aa-7354570746e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:28.065587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a4abb6-16e1-466a-a2aa-7354570746e9 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:28.079547 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4136/8295] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:43:28.083927 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42afb2c9-e918-4d57-a562-2fbdfd5d4fc2 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:28.096304 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42afb2c9-e918-4d57-a562-2fbdfd5d4fc2 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:28.102836 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81548a0f-9e00-4d2a-902f-a79c68fbbf87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:28.103745 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81548a0f-9e00-4d2a-902f-a79c68fbbf87 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:28.104023 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81548a0f-9e00-4d2a-902f-a79c68fbbf87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:28.104299 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81548a0f-9e00-4d2a-902f-a79c68fbbf87 admin admin] PATH_INFO: `/v3/projects/dc6e9a2d111a4e38b77adcd9211620e5/users/a569be00b74b40efb151951027f143b0/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:28.123532 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81548a0f-9e00-4d2a-902f-a79c68fbbf87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc6e9a2d111a4e38b77adcd9211620e5, user_id=a569be00b74b40efb151951027f143b0, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:28.126392 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81548a0f-9e00-4d2a-902f-a79c68fbbf87 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:28.227559 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4160/8296] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:43:28 2022] PUT /identity/v3/projects/dc6e9a2d111a4e38b77adcd9211620e5/users/a569be00b74b40efb151951027f143b0/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:43:28.239645 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ac03f-fbc1-46a8-9a5c-51dfae72875f None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:28.239944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ac03f-fbc1-46a8-9a5c-51dfae72875f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:28.240228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ac03f-fbc1-46a8-9a5c-51dfae72875f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:28.278587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-099ac03f-fbc1-46a8-9a5c-51dfae72875f None None] MFA Rules not processed for user `a569be00b74b40efb151951027f143b0`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:28.280219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-099ac03f-fbc1-46a8-9a5c-51dfae72875f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:28.390627 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4137/8297] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:43:28.395369 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81548a0f-9e00-4d2a-902f-a79c68fbbf87 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:28.482671 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81548a0f-9e00-4d2a-902f-a79c68fbbf87 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:28.487788 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edb9b4-6e47-406d-9aaa-6e2e50591e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:28.488484 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edb9b4-6e47-406d-9aaa-6e2e50591e6b admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:28.488769 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edb9b4-6e47-406d-9aaa-6e2e50591e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:28.489051 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edb9b4-6e47-406d-9aaa-6e2e50591e6b admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:28.489850 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edb9b4-6e47-406d-9aaa-6e2e50591e6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:28.491812 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edb9b4-6e47-406d-9aaa-6e2e50591e6b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:28.616300 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4161/8298] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:43:28 2022] POST /identity/v3/projects => generated 383 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:43:28.618862 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ac03f-fbc1-46a8-9a5c-51dfae72875f None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:28.631910 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ac03f-fbc1-46a8-9a5c-51dfae72875f None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:28.724315 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b13280-9ae7-43c2-b0dc-b2cf81711b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:28.725071 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b13280-9ae7-43c2-b0dc-b2cf81711b92 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:28.725421 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b13280-9ae7-43c2-b0dc-b2cf81711b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:28.725781 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b13280-9ae7-43c2-b0dc-b2cf81711b92 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:28.726540 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b13280-9ae7-43c2-b0dc-b2cf81711b92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:28.730422 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b13280-9ae7-43c2-b0dc-b2cf81711b92 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:28.835957 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4138/8299] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:43:28 2022] POST /identity/v3/users => generated 298 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:43:28.840465 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edb9b4-6e47-406d-9aaa-6e2e50591e6b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:28.853611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edb9b4-6e47-406d-9aaa-6e2e50591e6b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:28.859217 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d2804-4907-434d-88d2-d475ec7bb1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:28.860277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d2804-4907-434d-88d2-d475ec7bb1f7 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:28.860277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d2804-4907-434d-88d2-d475ec7bb1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:28.860470 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d2804-4907-434d-88d2-d475ec7bb1f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:28.861211 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2d2804-4907-434d-88d2-d475ec7bb1f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:28.862854 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2d2804-4907-434d-88d2-d475ec7bb1f7 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:28.874603 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4162/8300] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:43:28.878498 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b13280-9ae7-43c2-b0dc-b2cf81711b92 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:28.899654 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b13280-9ae7-43c2-b0dc-b2cf81711b92 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:28.901982 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdc671-99c5-4abb-bc64-5a50d98dcc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:28.902928 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdc671-99c5-4abb-bc64-5a50d98dcc79 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:28.903215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdc671-99c5-4abb-bc64-5a50d98dcc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:28.903499 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdc671-99c5-4abb-bc64-5a50d98dcc79 admin admin] PATH_INFO: `/v3/projects/b868a32d150847a9bae4edd0668f086f/users/6ebc302d3ab04ac2a77fe70a3792a95c/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:28.922900 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccdc671-99c5-4abb-bc64-5a50d98dcc79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b868a32d150847a9bae4edd0668f086f, user_id=6ebc302d3ab04ac2a77fe70a3792a95c, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:28.924459 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccdc671-99c5-4abb-bc64-5a50d98dcc79 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:29.031365 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4139/8301] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:43:28 2022] PUT /identity/v3/projects/b868a32d150847a9bae4edd0668f086f/users/6ebc302d3ab04ac2a77fe70a3792a95c/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:43:29.035693 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d2804-4907-434d-88d2-d475ec7bb1f7 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:29.046945 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d2804-4907-434d-88d2-d475ec7bb1f7 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:29.120771 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8aa64-a6e2-4b20-ac9c-210db21928c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:29.122217 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8aa64-a6e2-4b20-ac9c-210db21928c1 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:29.122940 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8aa64-a6e2-4b20-ac9c-210db21928c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:29.123560 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8aa64-a6e2-4b20-ac9c-210db21928c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:29.125019 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da8aa64-a6e2-4b20-ac9c-210db21928c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:29.128036 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da8aa64-a6e2-4b20-ac9c-210db21928c1 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:29.143965 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4163/8302] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:43:29.147511 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdc671-99c5-4abb-bc64-5a50d98dcc79 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:29.160134 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdc671-99c5-4abb-bc64-5a50d98dcc79 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:29.166832 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff97ee-fe17-4ac1-a9f2-9900ec3cc59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:29.168807 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff97ee-fe17-4ac1-a9f2-9900ec3cc59b admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:29.168807 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff97ee-fe17-4ac1-a9f2-9900ec3cc59b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:29.168807 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff97ee-fe17-4ac1-a9f2-9900ec3cc59b admin admin] PATH_INFO: `/v3/projects/b868a32d150847a9bae4edd0668f086f/users/6ebc302d3ab04ac2a77fe70a3792a95c/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:29.170476 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff97ee-fe17-4ac1-a9f2-9900ec3cc59b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b868a32d150847a9bae4edd0668f086f, user_id=6ebc302d3ab04ac2a77fe70a3792a95c, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:29.173141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff97ee-fe17-4ac1-a9f2-9900ec3cc59b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:29.184182 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4140/8303] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:43:29 2022] PUT /identity/v3/projects/b868a32d150847a9bae4edd0668f086f/users/6ebc302d3ab04ac2a77fe70a3792a95c/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:43:29.195624 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015115a1-799c-4bf7-a54d-13827a421fb1 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:29.196801 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015115a1-799c-4bf7-a54d-13827a421fb1 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:29.197911 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015115a1-799c-4bf7-a54d-13827a421fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:29.229577 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-015115a1-799c-4bf7-a54d-13827a421fb1 None None] MFA Rules not processed for user `6ebc302d3ab04ac2a77fe70a3792a95c`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:29.230972 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-015115a1-799c-4bf7-a54d-13827a421fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:29.301004 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4164/8304] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:43:29.312309 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff97ee-fe17-4ac1-a9f2-9900ec3cc59b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:29.314125 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-acff97ee-fe17-4ac1-a9f2-9900ec3cc59b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:29.377688 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff97ee-fe17-4ac1-a9f2-9900ec3cc59b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:29.382352 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3708a69f-4ff8-4a4f-ad39-ca5c5d00ea58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:29.383103 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708a69f-4ff8-4a4f-ad39-ca5c5d00ea58 service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:29.384000 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708a69f-4ff8-4a4f-ad39-ca5c5d00ea58 service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:29.384276 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708a69f-4ff8-4a4f-ad39-ca5c5d00ea58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:29.459193 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3708a69f-4ff8-4a4f-ad39-ca5c5d00ea58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:29.460979 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3708a69f-4ff8-4a4f-ad39-ca5c5d00ea58 service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:29.472442 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4141/8305] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:43:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:43:29.590817 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015115a1-799c-4bf7-a54d-13827a421fb1 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:29.592980 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-015115a1-799c-4bf7-a54d-13827a421fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:29.665404 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015115a1-799c-4bf7-a54d-13827a421fb1 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:29.669918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a7430-37c0-4e29-90e9-472491a23b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:29.670785 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a7430-37c0-4e29-90e9-472491a23b37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:29.671090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a7430-37c0-4e29-90e9-472491a23b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:29.671365 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a7430-37c0-4e29-90e9-472491a23b37 admin admin] PATH_INFO: `/v3/users/48bb2192c73a4a48aa3395a419524e38` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:29.672543 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a7430-37c0-4e29-90e9-472491a23b37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48bb2192c73a4a48aa3395a419524e38)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:29.674666 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a7430-37c0-4e29-90e9-472491a23b37 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:29.841654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-289a7430-37c0-4e29-90e9-472491a23b37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48bb2192c73a4a48aa3395a419524e38'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:29.870156 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-289a7430-37c0-4e29-90e9-472491a23b37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48bb2192c73a4a48aa3395a419524e38'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:29.978840 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-289a7430-37c0-4e29-90e9-472491a23b37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48bb2192c73a4a48aa3395a419524e38'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:29.989510 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-289a7430-37c0-4e29-90e9-472491a23b37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48bb2192c73a4a48aa3395a419524e38'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:29.990752 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-289a7430-37c0-4e29-90e9-472491a23b37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48bb2192c73a4a48aa3395a419524e38'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:29.997387 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4165/8306] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:43:29 2022] DELETE /identity/v3/users/48bb2192c73a4a48aa3395a419524e38 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:43:30.002169 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f8418-a707-4c32-afd1-09efff4d86de None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:30.010339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f8418-a707-4c32-afd1-09efff4d86de None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:30.010339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f8418-a707-4c32-afd1-09efff4d86de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:30.020391 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-6e5f8418-a707-4c32-afd1-09efff4d86de None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:30.021599 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6e5f8418-a707-4c32-afd1-09efff4d86de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:30.095842 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4142/8307] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:43:30.108679 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a7430-37c0-4e29-90e9-472491a23b37 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:30.111371 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-289a7430-37c0-4e29-90e9-472491a23b37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:30.192365 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a7430-37c0-4e29-90e9-472491a23b37 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:30.196652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b310d017-a259-4099-842c-ceafb937fe81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:30.197779 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310d017-a259-4099-842c-ceafb937fe81 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:30.198228 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310d017-a259-4099-842c-ceafb937fe81 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:30.198677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310d017-a259-4099-842c-ceafb937fe81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:30.209747 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b310d017-a259-4099-842c-ceafb937fe81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:30.213229 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b310d017-a259-4099-842c-ceafb937fe81 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:30.240907 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4166/8308] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:43:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:43:30.671767 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f8418-a707-4c32-afd1-09efff4d86de None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:30.673471 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6e5f8418-a707-4c32-afd1-09efff4d86de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:30.706144 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f8418-a707-4c32-afd1-09efff4d86de None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:30.726047 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e4d9f-7d49-45b4-8192-2806fffe307b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:30.726047 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e4d9f-7d49-45b4-8192-2806fffe307b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:30.726047 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e4d9f-7d49-45b4-8192-2806fffe307b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:30.726047 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e4d9f-7d49-45b4-8192-2806fffe307b admin admin] PATH_INFO: `/v3/projects/267027ce25334d25b3ce478433c2fd1f` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:30.726424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e4d9f-7d49-45b4-8192-2806fffe307b admin admin] RBAC: Authorizing `identity:delete_project(project_id=267027ce25334d25b3ce478433c2fd1f)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:30.728040 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e4d9f-7d49-45b4-8192-2806fffe307b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:30.885727 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-551e4d9f-7d49-45b4-8192-2806fffe307b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '267027ce25334d25b3ce478433c2fd1f', 'request_id': 'req-551e4d9f-7d49-45b4-8192-2806fffe307b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:30.893638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-551e4d9f-7d49-45b4-8192-2806fffe307b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '267027ce25334d25b3ce478433c2fd1f', 'request_id': 'req-551e4d9f-7d49-45b4-8192-2806fffe307b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:30.901061 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-551e4d9f-7d49-45b4-8192-2806fffe307b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '267027ce25334d25b3ce478433c2fd1f', 'request_id': 'req-551e4d9f-7d49-45b4-8192-2806fffe307b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:31.014002 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-551e4d9f-7d49-45b4-8192-2806fffe307b admin admin] The token cache is being invalidate because project 267027ce25334d25b3ce478433c2fd1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:43:31.015074 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-551e4d9f-7d49-45b4-8192-2806fffe307b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:31.016794 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-551e4d9f-7d49-45b4-8192-2806fffe307b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:31.018911 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4143/8309] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:43:30 2022] DELETE /identity/v3/projects/267027ce25334d25b3ce478433c2fd1f => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:43:31.024293 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f66290-7273-465f-95a9-3e9dd0426389 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:31.024842 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f66290-7273-465f-95a9-3e9dd0426389 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:31.024842 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f66290-7273-465f-95a9-3e9dd0426389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:31.048503 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-17f66290-7273-465f-95a9-3e9dd0426389 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:31.049816 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-17f66290-7273-465f-95a9-3e9dd0426389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:31.135836 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4167/8310] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:43:31.138570 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b67969-eb69-449d-b5eb-120c3e708034 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:31.139216 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b67969-eb69-449d-b5eb-120c3e708034 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:31.139667 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b67969-eb69-449d-b5eb-120c3e708034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:31.165820 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-d2b67969-eb69-449d-b5eb-120c3e708034 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:31.169884 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d2b67969-eb69-449d-b5eb-120c3e708034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:31.183686 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4144/8311] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:43:31.184519 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f66290-7273-465f-95a9-3e9dd0426389 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:31.198612 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f66290-7273-465f-95a9-3e9dd0426389 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:31.218416 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3bb09-3e68-4e3f-ab0b-651c66c968e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:31.219320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3bb09-3e68-4e3f-ab0b-651c66c968e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:31.219770 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3bb09-3e68-4e3f-ab0b-651c66c968e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:31.220207 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3bb09-3e68-4e3f-ab0b-651c66c968e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:31.221124 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3bb09-3e68-4e3f-ab0b-651c66c968e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:43:31.221590 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3bb09-3e68-4e3f-ab0b-651c66c968e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:31.223425 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3bb09-3e68-4e3f-ab0b-651c66c968e0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:31.241809 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4168/8312] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:43:31.246252 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b67969-eb69-449d-b5eb-120c3e708034 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:31.257301 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b67969-eb69-449d-b5eb-120c3e708034 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:31.262504 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8900438a-50b4-4a5f-a8bd-520198ed5bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:31.263303 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900438a-50b4-4a5f-a8bd-520198ed5bd4 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:31.263873 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900438a-50b4-4a5f-a8bd-520198ed5bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:31.264152 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900438a-50b4-4a5f-a8bd-520198ed5bd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:31.264862 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8900438a-50b4-4a5f-a8bd-520198ed5bd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:31.266857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8900438a-50b4-4a5f-a8bd-520198ed5bd4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:31.389101 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4145/8313] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:43:31 2022] POST /identity/v3/projects => generated 353 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:43:31.393577 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3bb09-3e68-4e3f-ab0b-651c66c968e0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:31.405334 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3bb09-3e68-4e3f-ab0b-651c66c968e0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:31.483162 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a14f8-859e-4422-8563-8da8d3d91615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:31.483759 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a14f8-859e-4422-8563-8da8d3d91615 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:31.484123 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a14f8-859e-4422-8563-8da8d3d91615 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:31.484566 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a14f8-859e-4422-8563-8da8d3d91615 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:31.485048 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a14f8-859e-4422-8563-8da8d3d91615 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:31.487031 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a14f8-859e-4422-8563-8da8d3d91615 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:31.551331 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2d503-68aa-4052-87bf-c9bb63d75d08 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:31.551840 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2d503-68aa-4052-87bf-c9bb63d75d08 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:31.552168 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2d503-68aa-4052-87bf-c9bb63d75d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:31.578905 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-91f2d503-68aa-4052-87bf-c9bb63d75d08 None None] MFA Rules not processed for user `34a160f829dd4dc6af9f2254653dc0b8`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:31.580113 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-91f2d503-68aa-4052-87bf-c9bb63d75d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:31.597261 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4169/8314] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:43:31 2022] POST /identity/v3/users => generated 277 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:43:31.601609 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a14f8-859e-4422-8563-8da8d3d91615 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:31.611311 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a14f8-859e-4422-8563-8da8d3d91615 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:31.616225 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186eb9f-a1c6-4bb1-bc37-f6b22c0a4b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:31.616880 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186eb9f-a1c6-4bb1-bc37-f6b22c0a4b09 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:31.617167 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186eb9f-a1c6-4bb1-bc37-f6b22c0a4b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:31.617443 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186eb9f-a1c6-4bb1-bc37-f6b22c0a4b09 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:31.618244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186eb9f-a1c6-4bb1-bc37-f6b22c0a4b09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:31.619912 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186eb9f-a1c6-4bb1-bc37-f6b22c0a4b09 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:31.630625 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4170/8315] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:43:31.635566 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186eb9f-a1c6-4bb1-bc37-f6b22c0a4b09 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:31.645571 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186eb9f-a1c6-4bb1-bc37-f6b22c0a4b09 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:31.648377 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4146/8316] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:43:31.654957 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f2d503-68aa-4052-87bf-c9bb63d75d08 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:31.656072 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e4577-28bf-4bc2-b969-2e04947f37f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:31.656289 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-91f2d503-68aa-4052-87bf-c9bb63d75d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:31.656748 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e4577-28bf-4bc2-b969-2e04947f37f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:31.658960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e4577-28bf-4bc2-b969-2e04947f37f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:31.658960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e4577-28bf-4bc2-b969-2e04947f37f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:31.658960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e4577-28bf-4bc2-b969-2e04947f37f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:31.659831 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e4577-28bf-4bc2-b969-2e04947f37f8 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:31.671002 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f2d503-68aa-4052-87bf-c9bb63d75d08 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:31.671594 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4171/8317] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:43:31.675735 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e4577-28bf-4bc2-b969-2e04947f37f8 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:31.678957 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9f6ea-890a-43c1-af24-4ae95a67e206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:31.679627 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9f6ea-890a-43c1-af24-4ae95a67e206 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:31.679912 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9f6ea-890a-43c1-af24-4ae95a67e206 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:31.680216 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9f6ea-890a-43c1-af24-4ae95a67e206 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:31.680959 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd9f6ea-890a-43c1-af24-4ae95a67e206 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:31.683004 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd9f6ea-890a-43c1-af24-4ae95a67e206 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:31.685646 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e4577-28bf-4bc2-b969-2e04947f37f8 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:31.690970 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447de1f-0baf-47eb-8bcb-1998febd6194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:31.691858 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447de1f-0baf-47eb-8bcb-1998febd6194 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:31.692143 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447de1f-0baf-47eb-8bcb-1998febd6194 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:31.692421 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447de1f-0baf-47eb-8bcb-1998febd6194 admin admin] PATH_INFO: `/v3/projects/b1efedef0adb40518f752fb3e3891067/users/35c29cf1e77b4d17b549eba366faf559/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:31.708867 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447de1f-0baf-47eb-8bcb-1998febd6194 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1efedef0adb40518f752fb3e3891067, user_id=35c29cf1e77b4d17b549eba366faf559, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:31.712190 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447de1f-0baf-47eb-8bcb-1998febd6194 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:31.758337 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4147/8318] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:43:31 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:43:31.762626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9f6ea-890a-43c1-af24-4ae95a67e206 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:31.812538 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4172/8319] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:43:31 2022] PUT /identity/v3/projects/b1efedef0adb40518f752fb3e3891067/users/35c29cf1e77b4d17b549eba366faf559/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:43:31.823372 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae2d12-19ed-4756-8eb7-32ae0a17f270 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:31.823675 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae2d12-19ed-4756-8eb7-32ae0a17f270 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:31.823932 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae2d12-19ed-4756-8eb7-32ae0a17f270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:31.828734 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9f6ea-890a-43c1-af24-4ae95a67e206 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:31.849671 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-68ae2d12-19ed-4756-8eb7-32ae0a17f270 None None] MFA Rules not processed for user `35c29cf1e77b4d17b549eba366faf559`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:31.851707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-68ae2d12-19ed-4756-8eb7-32ae0a17f270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:31.932260 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4173/8320] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:31 2022] POST /identity/v3/auth/tokens => generated 3220 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:43:31.941123 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae2d12-19ed-4756-8eb7-32ae0a17f270 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:31.942623 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-68ae2d12-19ed-4756-8eb7-32ae0a17f270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:32.008447 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae2d12-19ed-4756-8eb7-32ae0a17f270 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:32.012653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d457020a-a10a-48da-bc3d-4c70064566ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:32.013299 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457020a-a10a-48da-bc3d-4c70064566ef service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:32.013579 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457020a-a10a-48da-bc3d-4c70064566ef service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:32.013884 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457020a-a10a-48da-bc3d-4c70064566ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:32.022539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d457020a-a10a-48da-bc3d-4c70064566ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:32.024650 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d457020a-a10a-48da-bc3d-4c70064566ef service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:32.035088 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4174/8321] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:43:31 2022] GET /identity/v3/auth/tokens => generated 3220 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:43:32.043010 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7cee8-f6ba-4d01-8457-c6e415b7985f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:32.043755 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7cee8-f6ba-4d01-8457-c6e415b7985f admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:32.044041 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7cee8-f6ba-4d01-8457-c6e415b7985f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:32.044309 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7cee8-f6ba-4d01-8457-c6e415b7985f admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:32.044993 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7cee8-f6ba-4d01-8457-c6e415b7985f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:32.046981 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7cee8-f6ba-4d01-8457-c6e415b7985f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:32.160430 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4148/8322] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:43:31 2022] POST /identity/v3/users => generated 298 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:43:32.164392 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d457020a-a10a-48da-bc3d-4c70064566ef service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:32.176095 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d457020a-a10a-48da-bc3d-4c70064566ef service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:32.181484 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc63e69-9ac7-4959-9473-d2100be72fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:32.182582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc63e69-9ac7-4959-9473-d2100be72fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:32.183023 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc63e69-9ac7-4959-9473-d2100be72fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:32.183464 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc63e69-9ac7-4959-9473-d2100be72fc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:32.184202 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc63e69-9ac7-4959-9473-d2100be72fc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:32.185844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc63e69-9ac7-4959-9473-d2100be72fc2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:32.196193 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4175/8323] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:43:32.200304 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7cee8-f6ba-4d01-8457-c6e415b7985f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:32.210206 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7cee8-f6ba-4d01-8457-c6e415b7985f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:32.214865 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba702dc-fff3-4b27-8b58-ba88c6bee11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:32.216269 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba702dc-fff3-4b27-8b58-ba88c6bee11b admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:32.216558 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba702dc-fff3-4b27-8b58-ba88c6bee11b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:32.217065 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba702dc-fff3-4b27-8b58-ba88c6bee11b admin admin] PATH_INFO: `/v3/projects/4e950dfad85341278d19bcf55ae75eff/users/cb9dcd957e4e4b8b8dba0bc415a18e96/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:32.238092 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba702dc-fff3-4b27-8b58-ba88c6bee11b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e950dfad85341278d19bcf55ae75eff, user_id=cb9dcd957e4e4b8b8dba0bc415a18e96, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:32.251494 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba702dc-fff3-4b27-8b58-ba88c6bee11b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:32.334248 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4149/8324] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:43:32 2022] PUT /identity/v3/projects/4e950dfad85341278d19bcf55ae75eff/users/cb9dcd957e4e4b8b8dba0bc415a18e96/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:43:32.341180 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc63e69-9ac7-4959-9473-d2100be72fc2 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:32.352873 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc63e69-9ac7-4959-9473-d2100be72fc2 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:32.434269 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca16ba-7f24-4d9a-87da-0aec464b0d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:32.434947 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca16ba-7f24-4d9a-87da-0aec464b0d39 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:32.435301 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca16ba-7f24-4d9a-87da-0aec464b0d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:32.435687 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca16ba-7f24-4d9a-87da-0aec464b0d39 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:32.436413 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ca16ba-7f24-4d9a-87da-0aec464b0d39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:32.438287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ca16ba-7f24-4d9a-87da-0aec464b0d39 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:32.451682 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4176/8325] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:43:32.453876 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba702dc-fff3-4b27-8b58-ba88c6bee11b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:32.466163 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba702dc-fff3-4b27-8b58-ba88c6bee11b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:32.471138 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d314cee-5f15-4913-9821-7403c61e1ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:32.472038 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d314cee-5f15-4913-9821-7403c61e1ae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:32.472316 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d314cee-5f15-4913-9821-7403c61e1ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:32.472587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d314cee-5f15-4913-9821-7403c61e1ae3 admin admin] PATH_INFO: `/v3/projects/4e950dfad85341278d19bcf55ae75eff/users/cb9dcd957e4e4b8b8dba0bc415a18e96/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:32.474773 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d314cee-5f15-4913-9821-7403c61e1ae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e950dfad85341278d19bcf55ae75eff, user_id=cb9dcd957e4e4b8b8dba0bc415a18e96, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:32.478048 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d314cee-5f15-4913-9821-7403c61e1ae3 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:32.489078 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4150/8326] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:43:32 2022] PUT /identity/v3/projects/4e950dfad85341278d19bcf55ae75eff/users/cb9dcd957e4e4b8b8dba0bc415a18e96/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:43:32.612549 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca16ba-7f24-4d9a-87da-0aec464b0d39 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:32.614478 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b4ca16ba-7f24-4d9a-87da-0aec464b0d39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:32.709237 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca16ba-7f24-4d9a-87da-0aec464b0d39 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:32.781365 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732e386-bc23-45f0-924f-1096e76acd0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:32.782237 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732e386-bc23-45f0-924f-1096e76acd0b service cinder] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:32.782659 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732e386-bc23-45f0-924f-1096e76acd0b service cinder] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:32.783300 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732e386-bc23-45f0-924f-1096e76acd0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:32.785529 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b732e386-bc23-45f0-924f-1096e76acd0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:32.872690 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732e386-bc23-45f0-924f-1096e76acd0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:32.874770 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732e386-bc23-45f0-924f-1096e76acd0b service cinder] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:32.889201 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4177/8327] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:43:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:43:33.830079 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d314cee-5f15-4913-9821-7403c61e1ae3 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:33.834206 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2d314cee-5f15-4913-9821-7403c61e1ae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:33.928417 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d314cee-5f15-4913-9821-7403c61e1ae3 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:33.935828 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e5724e-a10c-498b-bb59-5d1c79491f69 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:33.936509 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5724e-a10c-498b-bb59-5d1c79491f69 service placement] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:33.936795 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5724e-a10c-498b-bb59-5d1c79491f69 service placement] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:33.937259 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5724e-a10c-498b-bb59-5d1c79491f69 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:33.940127 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b1e5724e-a10c-498b-bb59-5d1c79491f69 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:33.968682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e5724e-a10c-498b-bb59-5d1c79491f69 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:33.974277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e5724e-a10c-498b-bb59-5d1c79491f69 service placement] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:33.994751 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4151/8328] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:43:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:43:34.751219 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732e386-bc23-45f0-924f-1096e76acd0b service cinder] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:34.761829 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732e386-bc23-45f0-924f-1096e76acd0b service cinder] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:34.765897 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107eca55-3f67-4494-8128-4b592a9d922f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:34.766687 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107eca55-3f67-4494-8128-4b592a9d922f service cinder] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:34.767219 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107eca55-3f67-4494-8128-4b592a9d922f service cinder] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:34.767869 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107eca55-3f67-4494-8128-4b592a9d922f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:34.770284 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-107eca55-3f67-4494-8128-4b592a9d922f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:34.900251 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107eca55-3f67-4494-8128-4b592a9d922f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:34.902082 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107eca55-3f67-4494-8128-4b592a9d922f service cinder] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:34.924588 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4178/8329] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:43:34 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:43:35.138788 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e5724e-a10c-498b-bb59-5d1c79491f69 service placement] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:35.271642 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e5724e-a10c-498b-bb59-5d1c79491f69 service placement] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:35.286118 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2f3d9-c8a4-4946-9c0e-7007f209966b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:35.287200 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2f3d9-c8a4-4946-9c0e-7007f209966b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:35.287615 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2f3d9-c8a4-4946-9c0e-7007f209966b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:35.287925 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2f3d9-c8a4-4946-9c0e-7007f209966b admin admin] PATH_INFO: `/v3/users/35c29cf1e77b4d17b549eba366faf559` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:35.289267 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2f3d9-c8a4-4946-9c0e-7007f209966b admin admin] RBAC: Authorizing `identity:delete_user(user_id=35c29cf1e77b4d17b549eba366faf559)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:35.291390 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2f3d9-c8a4-4946-9c0e-7007f209966b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:35.526685 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a2a2f3d9-c8a4-4946-9c0e-7007f209966b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35c29cf1e77b4d17b549eba366faf559'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:35.554891 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a2a2f3d9-c8a4-4946-9c0e-7007f209966b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35c29cf1e77b4d17b549eba366faf559'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:35.651705 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a2a2f3d9-c8a4-4946-9c0e-7007f209966b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35c29cf1e77b4d17b549eba366faf559'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:35.652834 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a2a2f3d9-c8a4-4946-9c0e-7007f209966b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35c29cf1e77b4d17b549eba366faf559'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:35.672115 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-a2a2f3d9-c8a4-4946-9c0e-7007f209966b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35c29cf1e77b4d17b549eba366faf559'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:35.678267 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4152/8330] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:43:35 2022] DELETE /identity/v3/users/35c29cf1e77b4d17b549eba366faf559 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:43:35.683163 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee75e13-3825-4840-995f-dd2b4c1dfaad None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:35.683644 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee75e13-3825-4840-995f-dd2b4c1dfaad None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:35.683996 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee75e13-3825-4840-995f-dd2b4c1dfaad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:35.702925 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-5ee75e13-3825-4840-995f-dd2b4c1dfaad None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:35.704187 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5ee75e13-3825-4840-995f-dd2b4c1dfaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:35.767630 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4179/8331] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:43:35.778865 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2f3d9-c8a4-4946-9c0e-7007f209966b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:35.782687 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a2a2f3d9-c8a4-4946-9c0e-7007f209966b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:35.850123 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2f3d9-c8a4-4946-9c0e-7007f209966b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:35.853918 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6798d55-42bb-4101-86ae-d5a0c959410b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:35.854584 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6798d55-42bb-4101-86ae-d5a0c959410b service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:35.854913 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6798d55-42bb-4101-86ae-d5a0c959410b service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:35.855339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6798d55-42bb-4101-86ae-d5a0c959410b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:35.872832 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6798d55-42bb-4101-86ae-d5a0c959410b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:35.874380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6798d55-42bb-4101-86ae-d5a0c959410b service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:35.900258 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4153/8332] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:43:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:43:36.160193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee75e13-3825-4840-995f-dd2b4c1dfaad None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:36.163149 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5ee75e13-3825-4840-995f-dd2b4c1dfaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:36.182336 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee75e13-3825-4840-995f-dd2b4c1dfaad None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:36.189343 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f9285-784d-4d22-8963-5e25b433623f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:36.190365 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f9285-784d-4d22-8963-5e25b433623f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:36.190822 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f9285-784d-4d22-8963-5e25b433623f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:36.190930 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f9285-784d-4d22-8963-5e25b433623f admin admin] PATH_INFO: `/v3/projects/b1efedef0adb40518f752fb3e3891067` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:36.192188 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f9285-784d-4d22-8963-5e25b433623f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1efedef0adb40518f752fb3e3891067)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:36.194720 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f9285-784d-4d22-8963-5e25b433623f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:36.346040 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-040f9285-784d-4d22-8963-5e25b433623f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1efedef0adb40518f752fb3e3891067', 'request_id': 'req-040f9285-784d-4d22-8963-5e25b433623f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:36.353796 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-040f9285-784d-4d22-8963-5e25b433623f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1efedef0adb40518f752fb3e3891067', 'request_id': 'req-040f9285-784d-4d22-8963-5e25b433623f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:36.376419 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-040f9285-784d-4d22-8963-5e25b433623f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1efedef0adb40518f752fb3e3891067', 'request_id': 'req-040f9285-784d-4d22-8963-5e25b433623f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:36.515805 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-040f9285-784d-4d22-8963-5e25b433623f admin admin] The token cache is being invalidate because project b1efedef0adb40518f752fb3e3891067 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:43:36.516096 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-040f9285-784d-4d22-8963-5e25b433623f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:36.517509 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-040f9285-784d-4d22-8963-5e25b433623f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:36.519071 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4180/8333] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:43:36 2022] DELETE /identity/v3/projects/b1efedef0adb40518f752fb3e3891067 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:43:36.524267 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb7ee2-8784-43c9-81cf-5dd9a127de7d None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:36.524819 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb7ee2-8784-43c9-81cf-5dd9a127de7d None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:36.524819 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb7ee2-8784-43c9-81cf-5dd9a127de7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:36.557606 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-86eb7ee2-8784-43c9-81cf-5dd9a127de7d None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:36.559155 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-86eb7ee2-8784-43c9-81cf-5dd9a127de7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:36.658212 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4154/8334] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:43:36.665507 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd6483-d397-4d8f-a380-9c32e409cab9 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:36.672953 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd6483-d397-4d8f-a380-9c32e409cab9 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:36.672953 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd6483-d397-4d8f-a380-9c32e409cab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:36.705672 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-d1bd6483-d397-4d8f-a380-9c32e409cab9 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:36.708999 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d1bd6483-d397-4d8f-a380-9c32e409cab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:36.718622 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4181/8335] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:43:36.722813 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb7ee2-8784-43c9-81cf-5dd9a127de7d None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:36.736419 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eb7ee2-8784-43c9-81cf-5dd9a127de7d None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:36.742425 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d4d3a-0346-4633-8222-c2c928437470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:36.744583 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d4d3a-0346-4633-8222-c2c928437470 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:36.745114 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d4d3a-0346-4633-8222-c2c928437470 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:36.745605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d4d3a-0346-4633-8222-c2c928437470 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:36.747031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d4d3a-0346-4633-8222-c2c928437470 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:43:36.747577 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d4d3a-0346-4633-8222-c2c928437470 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:36.750453 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d4d3a-0346-4633-8222-c2c928437470 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:36.768287 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4155/8336] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:43:36.772875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd6483-d397-4d8f-a380-9c32e409cab9 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:36.787843 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd6483-d397-4d8f-a380-9c32e409cab9 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:36.794388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9748ff6-6521-487f-8f27-0e713690051d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:36.795747 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9748ff6-6521-487f-8f27-0e713690051d admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:36.796267 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9748ff6-6521-487f-8f27-0e713690051d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:36.797050 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9748ff6-6521-487f-8f27-0e713690051d admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:36.798101 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9748ff6-6521-487f-8f27-0e713690051d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:36.800565 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9748ff6-6521-487f-8f27-0e713690051d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:37.011959 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4182/8337] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:43:36 2022] POST /identity/v3/projects => generated 379 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:43:37.016193 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d4d3a-0346-4633-8222-c2c928437470 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:37.027067 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d4d3a-0346-4633-8222-c2c928437470 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:37.093249 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c5cb0-a6b7-4def-b787-3ddc01cae181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:37.094123 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c5cb0-a6b7-4def-b787-3ddc01cae181 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:37.094480 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c5cb0-a6b7-4def-b787-3ddc01cae181 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:37.094835 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c5cb0-a6b7-4def-b787-3ddc01cae181 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:37.096209 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c5cb0-a6b7-4def-b787-3ddc01cae181 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:37.098949 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c5cb0-a6b7-4def-b787-3ddc01cae181 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:37.208542 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4156/8338] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:43:37 2022] POST /identity/v3/users => generated 290 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:43:37.209826 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9748ff6-6521-487f-8f27-0e713690051d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:37.223463 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9748ff6-6521-487f-8f27-0e713690051d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:37.229440 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be316a1f-9ba9-4fb1-a741-89649f707061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:37.230146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be316a1f-9ba9-4fb1-a741-89649f707061 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:37.230460 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be316a1f-9ba9-4fb1-a741-89649f707061 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:37.230779 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be316a1f-9ba9-4fb1-a741-89649f707061 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:37.231660 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be316a1f-9ba9-4fb1-a741-89649f707061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:37.240946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be316a1f-9ba9-4fb1-a741-89649f707061 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:37.252841 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4183/8339] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:43:37.256756 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c5cb0-a6b7-4def-b787-3ddc01cae181 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:37.267296 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c5cb0-a6b7-4def-b787-3ddc01cae181 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:37.272349 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abce5a4-79d6-455e-bd2a-62d8425f59df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:37.273014 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abce5a4-79d6-455e-bd2a-62d8425f59df admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:37.274450 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abce5a4-79d6-455e-bd2a-62d8425f59df admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:37.274989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abce5a4-79d6-455e-bd2a-62d8425f59df admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:37.276565 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abce5a4-79d6-455e-bd2a-62d8425f59df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:37.278589 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abce5a4-79d6-455e-bd2a-62d8425f59df admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:37.291419 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4157/8340] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:43:37.295443 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be316a1f-9ba9-4fb1-a741-89649f707061 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:37.305660 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be316a1f-9ba9-4fb1-a741-89649f707061 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:37.313270 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d909e-be62-44e9-8a1a-b2cdf0b96809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:37.314215 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d909e-be62-44e9-8a1a-b2cdf0b96809 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:37.314499 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d909e-be62-44e9-8a1a-b2cdf0b96809 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:37.314773 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d909e-be62-44e9-8a1a-b2cdf0b96809 admin admin] PATH_INFO: `/v3/projects/9d059f828e0d4a2fbfed837f74f3ecdd/users/bf629beb150b45d2a0075c053261c7f1/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:37.330297 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d909e-be62-44e9-8a1a-b2cdf0b96809 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d059f828e0d4a2fbfed837f74f3ecdd, user_id=bf629beb150b45d2a0075c053261c7f1, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:37.332955 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d909e-be62-44e9-8a1a-b2cdf0b96809 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:37.420023 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4184/8341] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:43:37 2022] PUT /identity/v3/projects/9d059f828e0d4a2fbfed837f74f3ecdd/users/bf629beb150b45d2a0075c053261c7f1/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:43:37.433247 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ef7a0-b6f8-4c73-a48c-c9ea73755791 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:37.433542 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ef7a0-b6f8-4c73-a48c-c9ea73755791 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:37.433855 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ef7a0-b6f8-4c73-a48c-c9ea73755791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:37.464431 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-7b9ef7a0-b6f8-4c73-a48c-c9ea73755791 None None] MFA Rules not processed for user `bf629beb150b45d2a0075c053261c7f1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:37.466311 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7b9ef7a0-b6f8-4c73-a48c-c9ea73755791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:37.546408 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4158/8342] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:43:37.548225 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d909e-be62-44e9-8a1a-b2cdf0b96809 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:37.613488 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d909e-be62-44e9-8a1a-b2cdf0b96809 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:37.620792 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa0a7d-e58a-4037-b08e-88b768ff977c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:37.621634 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa0a7d-e58a-4037-b08e-88b768ff977c admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:37.621950 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa0a7d-e58a-4037-b08e-88b768ff977c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:37.622715 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa0a7d-e58a-4037-b08e-88b768ff977c admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:37.623058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa0a7d-e58a-4037-b08e-88b768ff977c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:37.625077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa0a7d-e58a-4037-b08e-88b768ff977c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:37.713352 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4185/8343] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:43:37 2022] POST /identity/v3/projects => generated 381 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:43:37.717452 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ef7a0-b6f8-4c73-a48c-c9ea73755791 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:37.728175 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ef7a0-b6f8-4c73-a48c-c9ea73755791 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:37.795831 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561be02-a798-429c-8420-d8225667b1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:37.796584 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561be02-a798-429c-8420-d8225667b1e0 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:37.796911 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561be02-a798-429c-8420-d8225667b1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:37.797190 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561be02-a798-429c-8420-d8225667b1e0 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:37.797949 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0561be02-a798-429c-8420-d8225667b1e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:37.799895 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0561be02-a798-429c-8420-d8225667b1e0 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:37.895065 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4159/8344] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:43:37 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:43:37.899680 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa0a7d-e58a-4037-b08e-88b768ff977c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:37.912543 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa0a7d-e58a-4037-b08e-88b768ff977c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:37.917837 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ac49f-4ac3-46a7-b3aa-c0d3976213db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:37.918721 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ac49f-4ac3-46a7-b3aa-c0d3976213db admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:37.919188 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ac49f-4ac3-46a7-b3aa-c0d3976213db admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:37.919617 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ac49f-4ac3-46a7-b3aa-c0d3976213db admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:37.920557 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ac49f-4ac3-46a7-b3aa-c0d3976213db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:37.922222 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ac49f-4ac3-46a7-b3aa-c0d3976213db admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:37.936363 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4186/8345] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:43:37.940675 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561be02-a798-429c-8420-d8225667b1e0 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:37.953276 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561be02-a798-429c-8420-d8225667b1e0 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:37.958955 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed38636-25ab-45c7-97be-a1fbdc3ae1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:37.961160 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed38636-25ab-45c7-97be-a1fbdc3ae1c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:37.961160 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed38636-25ab-45c7-97be-a1fbdc3ae1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:37.961160 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed38636-25ab-45c7-97be-a1fbdc3ae1c0 admin admin] PATH_INFO: `/v3/projects/2bdac16fac414838974a4b64a7f68f89/users/e517d52f6fff4e95b757ab742c98c9c6/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:37.977884 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed38636-25ab-45c7-97be-a1fbdc3ae1c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bdac16fac414838974a4b64a7f68f89, user_id=e517d52f6fff4e95b757ab742c98c9c6, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:37.981101 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed38636-25ab-45c7-97be-a1fbdc3ae1c0 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:38.120700 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4160/8346] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:43:37 2022] PUT /identity/v3/projects/2bdac16fac414838974a4b64a7f68f89/users/e517d52f6fff4e95b757ab742c98c9c6/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:43:38.124688 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ac49f-4ac3-46a7-b3aa-c0d3976213db admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:38.140196 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ac49f-4ac3-46a7-b3aa-c0d3976213db admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:38.212760 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866542f5-4121-42e0-8f79-f875d97baacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:38.213551 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866542f5-4121-42e0-8f79-f875d97baacf admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:38.214093 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866542f5-4121-42e0-8f79-f875d97baacf admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:38.214479 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866542f5-4121-42e0-8f79-f875d97baacf admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:38.215429 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866542f5-4121-42e0-8f79-f875d97baacf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:38.217282 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866542f5-4121-42e0-8f79-f875d97baacf admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:38.233356 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4187/8347] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:43:38.237095 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed38636-25ab-45c7-97be-a1fbdc3ae1c0 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:38.251918 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed38636-25ab-45c7-97be-a1fbdc3ae1c0 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:38.259914 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d623a-5ae6-43b6-ae89-700165b7c510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:38.260827 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d623a-5ae6-43b6-ae89-700165b7c510 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:38.261113 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d623a-5ae6-43b6-ae89-700165b7c510 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:38.261397 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d623a-5ae6-43b6-ae89-700165b7c510 admin admin] PATH_INFO: `/v3/projects/2bdac16fac414838974a4b64a7f68f89/users/e517d52f6fff4e95b757ab742c98c9c6/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:38.263481 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d623a-5ae6-43b6-ae89-700165b7c510 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bdac16fac414838974a4b64a7f68f89, user_id=e517d52f6fff4e95b757ab742c98c9c6, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:38.267193 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d623a-5ae6-43b6-ae89-700165b7c510 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:38.294074 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4161/8348] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:43:38 2022] PUT /identity/v3/projects/2bdac16fac414838974a4b64a7f68f89/users/e517d52f6fff4e95b757ab742c98c9c6/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:43:38.304185 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2a304-4f5c-4d6b-b02c-b54a9a8026e0 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:38.304482 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2a304-4f5c-4d6b-b02c-b54a9a8026e0 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:38.304759 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2a304-4f5c-4d6b-b02c-b54a9a8026e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:38.334442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-38e2a304-4f5c-4d6b-b02c-b54a9a8026e0 None None] MFA Rules not processed for user `e517d52f6fff4e95b757ab742c98c9c6`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:38.335733 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-38e2a304-4f5c-4d6b-b02c-b54a9a8026e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:38.422389 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4188/8349] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:38 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:43:38.431508 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d623a-5ae6-43b6-ae89-700165b7c510 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:38.433891 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-356d623a-5ae6-43b6-ae89-700165b7c510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:38.520089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d623a-5ae6-43b6-ae89-700165b7c510 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:38.523974 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb056a7-f124-4fd5-84c7-4235569c4a00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:38.524817 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb056a7-f124-4fd5-84c7-4235569c4a00 service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:38.525276 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb056a7-f124-4fd5-84c7-4235569c4a00 service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:38.525969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb056a7-f124-4fd5-84c7-4235569c4a00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:38.535990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb056a7-f124-4fd5-84c7-4235569c4a00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:38.537806 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb056a7-f124-4fd5-84c7-4235569c4a00 service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:38.552017 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4162/8350] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:43:38 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:43:38.803699 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2a304-4f5c-4d6b-b02c-b54a9a8026e0 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:38.817649 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2a304-4f5c-4d6b-b02c-b54a9a8026e0 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:38.822384 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332dd155-9b5a-4b89-bb6c-ad114b79158c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:38.823207 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332dd155-9b5a-4b89-bb6c-ad114b79158c service cinder] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:38.823484 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332dd155-9b5a-4b89-bb6c-ad114b79158c service cinder] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:38.823757 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332dd155-9b5a-4b89-bb6c-ad114b79158c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:38.892177 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332dd155-9b5a-4b89-bb6c-ad114b79158c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:38.893645 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332dd155-9b5a-4b89-bb6c-ad114b79158c service cinder] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:38.903440 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4189/8351] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:43:38 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:43:39.209257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768b7e2-3921-4838-a077-37046ce857c1 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:39.212135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768b7e2-3921-4838-a077-37046ce857c1 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:39.212135 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768b7e2-3921-4838-a077-37046ce857c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:39.244191 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-4768b7e2-3921-4838-a077-37046ce857c1 None None] MFA Rules not processed for user `cb9dcd957e4e4b8b8dba0bc415a18e96`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:39.245430 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4768b7e2-3921-4838-a077-37046ce857c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:39.336630 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4163/8352] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:43:39.349454 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332dd155-9b5a-4b89-bb6c-ad114b79158c service cinder] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:39.351213 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-332dd155-9b5a-4b89-bb6c-ad114b79158c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:39.437396 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332dd155-9b5a-4b89-bb6c-ad114b79158c service cinder] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:39.441056 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a8442-c913-4f0a-b1aa-bf8691bfcb21 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e302b1298dd04d6590e3d079f7b13b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:39.441826 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a8442-c913-4f0a-b1aa-bf8691bfcb21 service glance] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:39.442105 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a8442-c913-4f0a-b1aa-bf8691bfcb21 service glance] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:39.442407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a8442-c913-4f0a-b1aa-bf8691bfcb21 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:39.444303 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a16a8442-c913-4f0a-b1aa-bf8691bfcb21 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:39.512584 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a8442-c913-4f0a-b1aa-bf8691bfcb21 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:39.514426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a8442-c913-4f0a-b1aa-bf8691bfcb21 service glance] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:39.536362 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4190/8353] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:43:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:43:52.789568 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768b7e2-3921-4838-a077-37046ce857c1 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:52.791057 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4768b7e2-3921-4838-a077-37046ce857c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:52.854193 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768b7e2-3921-4838-a077-37046ce857c1 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:52.858664 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56be4f-029e-45e2-bad8-5da0e1859a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:52.859520 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56be4f-029e-45e2-bad8-5da0e1859a20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:52.859802 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56be4f-029e-45e2-bad8-5da0e1859a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:52.860071 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56be4f-029e-45e2-bad8-5da0e1859a20 admin admin] PATH_INFO: `/v3/users/d25e8bbbe40f40d689a1e4ab5c9c452e` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:52.861231 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56be4f-029e-45e2-bad8-5da0e1859a20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d25e8bbbe40f40d689a1e4ab5c9c452e)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:52.863171 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56be4f-029e-45e2-bad8-5da0e1859a20 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:53.082633 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7c56be4f-029e-45e2-bad8-5da0e1859a20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd25e8bbbe40f40d689a1e4ab5c9c452e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:53.094140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7c56be4f-029e-45e2-bad8-5da0e1859a20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd25e8bbbe40f40d689a1e4ab5c9c452e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:53.189037 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7c56be4f-029e-45e2-bad8-5da0e1859a20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd25e8bbbe40f40d689a1e4ab5c9c452e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:53.189684 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7c56be4f-029e-45e2-bad8-5da0e1859a20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd25e8bbbe40f40d689a1e4ab5c9c452e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:53.197687 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7c56be4f-029e-45e2-bad8-5da0e1859a20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd25e8bbbe40f40d689a1e4ab5c9c452e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:53.203574 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4164/8354] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:43:52 2022] DELETE /identity/v3/users/d25e8bbbe40f40d689a1e4ab5c9c452e => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:43:53.208422 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71fa7b7-9bd9-44ef-b904-c84f5353c4ec None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:53.208899 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71fa7b7-9bd9-44ef-b904-c84f5353c4ec None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:53.209042 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71fa7b7-9bd9-44ef-b904-c84f5353c4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:53.228236 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-e71fa7b7-9bd9-44ef-b904-c84f5353c4ec None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:53.229419 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e71fa7b7-9bd9-44ef-b904-c84f5353c4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:53.291837 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4191/8355] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:43:53.301922 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56be4f-029e-45e2-bad8-5da0e1859a20 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:53.303326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7c56be4f-029e-45e2-bad8-5da0e1859a20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:53.363590 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56be4f-029e-45e2-bad8-5da0e1859a20 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:53.367065 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d23de7-60bc-4517-9de2-fa83908106fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:53.367707 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d23de7-60bc-4517-9de2-fa83908106fa service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:53.367987 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d23de7-60bc-4517-9de2-fa83908106fa service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:53.368301 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d23de7-60bc-4517-9de2-fa83908106fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:53.377317 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d23de7-60bc-4517-9de2-fa83908106fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:53.378782 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d23de7-60bc-4517-9de2-fa83908106fa service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:53.389315 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4165/8356] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:43:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:43:53.782844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71fa7b7-9bd9-44ef-b904-c84f5353c4ec None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:53.784851 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e71fa7b7-9bd9-44ef-b904-c84f5353c4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:53.801605 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71fa7b7-9bd9-44ef-b904-c84f5353c4ec None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:53.806963 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca98e3d-ac7f-4c1c-8d22-bfea75a3ff4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:53.807858 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca98e3d-ac7f-4c1c-8d22-bfea75a3ff4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:53.808404 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca98e3d-ac7f-4c1c-8d22-bfea75a3ff4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:53.808832 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca98e3d-ac7f-4c1c-8d22-bfea75a3ff4c admin admin] PATH_INFO: `/v3/projects/786a3b8d82e44b2ca6ff802cf02c28c7` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:53.810623 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca98e3d-ac7f-4c1c-8d22-bfea75a3ff4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=786a3b8d82e44b2ca6ff802cf02c28c7)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:53.812573 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca98e3d-ac7f-4c1c-8d22-bfea75a3ff4c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:53.959764 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6ca98e3d-ac7f-4c1c-8d22-bfea75a3ff4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '786a3b8d82e44b2ca6ff802cf02c28c7', 'request_id': 'req-6ca98e3d-ac7f-4c1c-8d22-bfea75a3ff4c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:53.965040 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6ca98e3d-ac7f-4c1c-8d22-bfea75a3ff4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '786a3b8d82e44b2ca6ff802cf02c28c7', 'request_id': 'req-6ca98e3d-ac7f-4c1c-8d22-bfea75a3ff4c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:53.971179 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6ca98e3d-ac7f-4c1c-8d22-bfea75a3ff4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '786a3b8d82e44b2ca6ff802cf02c28c7', 'request_id': 'req-6ca98e3d-ac7f-4c1c-8d22-bfea75a3ff4c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:54.057380 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6ca98e3d-ac7f-4c1c-8d22-bfea75a3ff4c admin admin] The token cache is being invalidate because project 786a3b8d82e44b2ca6ff802cf02c28c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:43:54.057750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6ca98e3d-ac7f-4c1c-8d22-bfea75a3ff4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:54.058359 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6ca98e3d-ac7f-4c1c-8d22-bfea75a3ff4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:54.059894 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4192/8357] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:43:53 2022] DELETE /identity/v3/projects/786a3b8d82e44b2ca6ff802cf02c28c7 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:43:54.063898 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d23de7-60bc-4517-9de2-fa83908106fa service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:54.073681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d23de7-60bc-4517-9de2-fa83908106fa service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:54.136129 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2baaff-233e-4021-920c-db1950a40869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:54.136998 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2baaff-233e-4021-920c-db1950a40869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:54.137285 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2baaff-233e-4021-920c-db1950a40869 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:54.137563 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2baaff-233e-4021-920c-db1950a40869 admin admin] PATH_INFO: `/v3/users/a569be00b74b40efb151951027f143b0` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:54.138783 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2baaff-233e-4021-920c-db1950a40869 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a569be00b74b40efb151951027f143b0)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:54.140724 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2baaff-233e-4021-920c-db1950a40869 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:54.342878 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ac2baaff-233e-4021-920c-db1950a40869 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a569be00b74b40efb151951027f143b0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:54.355548 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ac2baaff-233e-4021-920c-db1950a40869 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a569be00b74b40efb151951027f143b0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:54.432035 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ac2baaff-233e-4021-920c-db1950a40869 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a569be00b74b40efb151951027f143b0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:54.432661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ac2baaff-233e-4021-920c-db1950a40869 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a569be00b74b40efb151951027f143b0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:54.439893 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ac2baaff-233e-4021-920c-db1950a40869 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a569be00b74b40efb151951027f143b0'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:54.445877 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4166/8358] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:43:54 2022] DELETE /identity/v3/users/a569be00b74b40efb151951027f143b0 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:43:54.851101 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca98e3d-ac7f-4c1c-8d22-bfea75a3ff4c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:54.852624 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6ca98e3d-ac7f-4c1c-8d22-bfea75a3ff4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:54.867158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca98e3d-ac7f-4c1c-8d22-bfea75a3ff4c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:54.935118 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c7e4b-e21e-444e-a488-7c8d84717fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:54.936037 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c7e4b-e21e-444e-a488-7c8d84717fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:54.936326 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c7e4b-e21e-444e-a488-7c8d84717fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:54.936614 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c7e4b-e21e-444e-a488-7c8d84717fa9 admin admin] PATH_INFO: `/v3/projects/dc6e9a2d111a4e38b77adcd9211620e5` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:54.937896 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c7e4b-e21e-444e-a488-7c8d84717fa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc6e9a2d111a4e38b77adcd9211620e5)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:54.939834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c7e4b-e21e-444e-a488-7c8d84717fa9 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:55.068548 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ec1c7e4b-e21e-444e-a488-7c8d84717fa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc6e9a2d111a4e38b77adcd9211620e5', 'request_id': 'req-ec1c7e4b-e21e-444e-a488-7c8d84717fa9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:55.074048 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ec1c7e4b-e21e-444e-a488-7c8d84717fa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc6e9a2d111a4e38b77adcd9211620e5', 'request_id': 'req-ec1c7e4b-e21e-444e-a488-7c8d84717fa9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:55.080285 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ec1c7e4b-e21e-444e-a488-7c8d84717fa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc6e9a2d111a4e38b77adcd9211620e5', 'request_id': 'req-ec1c7e4b-e21e-444e-a488-7c8d84717fa9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:55.154118 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ec1c7e4b-e21e-444e-a488-7c8d84717fa9 admin admin] The token cache is being invalidate because project dc6e9a2d111a4e38b77adcd9211620e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:43:55.154401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ec1c7e4b-e21e-444e-a488-7c8d84717fa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:55.155022 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-ec1c7e4b-e21e-444e-a488-7c8d84717fa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:55.156592 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4193/8359] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:43:54 2022] DELETE /identity/v3/projects/dc6e9a2d111a4e38b77adcd9211620e5 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:43:55.160944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2baaff-233e-4021-920c-db1950a40869 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:55.162400 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ac2baaff-233e-4021-920c-db1950a40869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:55.175534 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2baaff-233e-4021-920c-db1950a40869 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:55.236407 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5507b74-ca2e-4fa6-a864-0bad5bbb35ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:55.237341 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5507b74-ca2e-4fa6-a864-0bad5bbb35ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:55.237648 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5507b74-ca2e-4fa6-a864-0bad5bbb35ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:55.237962 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5507b74-ca2e-4fa6-a864-0bad5bbb35ef admin admin] PATH_INFO: `/v3/users/6ebc302d3ab04ac2a77fe70a3792a95c` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:55.239175 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5507b74-ca2e-4fa6-a864-0bad5bbb35ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ebc302d3ab04ac2a77fe70a3792a95c)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:55.241160 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5507b74-ca2e-4fa6-a864-0bad5bbb35ef admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:55.398763 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f5507b74-ca2e-4fa6-a864-0bad5bbb35ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ebc302d3ab04ac2a77fe70a3792a95c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:55.410340 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f5507b74-ca2e-4fa6-a864-0bad5bbb35ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ebc302d3ab04ac2a77fe70a3792a95c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:55.492261 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f5507b74-ca2e-4fa6-a864-0bad5bbb35ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ebc302d3ab04ac2a77fe70a3792a95c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:55.493038 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f5507b74-ca2e-4fa6-a864-0bad5bbb35ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ebc302d3ab04ac2a77fe70a3792a95c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:55.501638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f5507b74-ca2e-4fa6-a864-0bad5bbb35ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ebc302d3ab04ac2a77fe70a3792a95c'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:55.507871 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4167/8360] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:43:55 2022] DELETE /identity/v3/users/6ebc302d3ab04ac2a77fe70a3792a95c => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:43:55.916068 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c7e4b-e21e-444e-a488-7c8d84717fa9 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:55.918332 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ec1c7e4b-e21e-444e-a488-7c8d84717fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:55.931161 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c7e4b-e21e-444e-a488-7c8d84717fa9 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:55.994778 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6bf29d-b170-4631-83fa-257cc14c12be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:55.995637 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bf29d-b170-4631-83fa-257cc14c12be admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:55.995916 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bf29d-b170-4631-83fa-257cc14c12be admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:55.996187 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bf29d-b170-4631-83fa-257cc14c12be admin admin] PATH_INFO: `/v3/projects/b868a32d150847a9bae4edd0668f086f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:55.997359 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6bf29d-b170-4631-83fa-257cc14c12be admin admin] RBAC: Authorizing `identity:delete_project(project_id=b868a32d150847a9bae4edd0668f086f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:55.999390 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6bf29d-b170-4631-83fa-257cc14c12be admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:56.108540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6a6bf29d-b170-4631-83fa-257cc14c12be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b868a32d150847a9bae4edd0668f086f', 'request_id': 'req-6a6bf29d-b170-4631-83fa-257cc14c12be'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:56.114010 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6a6bf29d-b170-4631-83fa-257cc14c12be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b868a32d150847a9bae4edd0668f086f', 'request_id': 'req-6a6bf29d-b170-4631-83fa-257cc14c12be'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:56.120085 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6a6bf29d-b170-4631-83fa-257cc14c12be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b868a32d150847a9bae4edd0668f086f', 'request_id': 'req-6a6bf29d-b170-4631-83fa-257cc14c12be'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:56.196451 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6a6bf29d-b170-4631-83fa-257cc14c12be admin admin] The token cache is being invalidate because project b868a32d150847a9bae4edd0668f086f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:43:56.196738 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6a6bf29d-b170-4631-83fa-257cc14c12be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:56.197354 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6a6bf29d-b170-4631-83fa-257cc14c12be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:43:56.199445 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4194/8361] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:43:55 2022] DELETE /identity/v3/projects/b868a32d150847a9bae4edd0668f086f => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:43:56.204600 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026623bc-e87a-4008-9ff6-7701051d23fa None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:56.205093 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026623bc-e87a-4008-9ff6-7701051d23fa None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:56.205188 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026623bc-e87a-4008-9ff6-7701051d23fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:56.223097 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-026623bc-e87a-4008-9ff6-7701051d23fa None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:56.224301 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-026623bc-e87a-4008-9ff6-7701051d23fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:56.288981 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4168/8362] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:43:56.298427 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfcc29-5cf7-4261-a5a6-3c1ce5f207da None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:56.298717 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfcc29-5cf7-4261-a5a6-3c1ce5f207da None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:56.298999 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfcc29-5cf7-4261-a5a6-3c1ce5f207da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:56.317540 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-d7cfcc29-5cf7-4261-a5a6-3c1ce5f207da None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:56.318842 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d7cfcc29-5cf7-4261-a5a6-3c1ce5f207da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:56.327552 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4195/8363] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:43:56.331916 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026623bc-e87a-4008-9ff6-7701051d23fa None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:56.342467 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026623bc-e87a-4008-9ff6-7701051d23fa None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:56.347145 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406f9fc-af69-43b3-a858-dbbd9f9fd7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:56.347799 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406f9fc-af69-43b3-a858-dbbd9f9fd7a9 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:56.348085 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406f9fc-af69-43b3-a858-dbbd9f9fd7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:56.348361 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406f9fc-af69-43b3-a858-dbbd9f9fd7a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:56.349078 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2406f9fc-af69-43b3-a858-dbbd9f9fd7a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:43:56.349385 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2406f9fc-af69-43b3-a858-dbbd9f9fd7a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:56.351032 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2406f9fc-af69-43b3-a858-dbbd9f9fd7a9 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:56.362820 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4169/8364] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:43:56.367128 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cfcc29-5cf7-4261-a5a6-3c1ce5f207da None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:56.376882 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cfcc29-5cf7-4261-a5a6-3c1ce5f207da None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:56.381657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a184cd3-5418-4623-a993-d967f885e334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:56.382347 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a184cd3-5418-4623-a993-d967f885e334 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:56.382620 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a184cd3-5418-4623-a993-d967f885e334 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:56.382894 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a184cd3-5418-4623-a993-d967f885e334 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:56.383679 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a184cd3-5418-4623-a993-d967f885e334 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:56.386140 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a184cd3-5418-4623-a993-d967f885e334 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:56.505807 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4196/8365] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:43:56 2022] POST /identity/v3/projects => generated 381 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:43:56.507126 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406f9fc-af69-43b3-a858-dbbd9f9fd7a9 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:56.517887 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406f9fc-af69-43b3-a858-dbbd9f9fd7a9 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:56.574111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0bd837-2964-4242-85fa-fea8cda6e1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:56.574777 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bd837-2964-4242-85fa-fea8cda6e1fc admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:56.575060 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bd837-2964-4242-85fa-fea8cda6e1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:56.575335 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bd837-2964-4242-85fa-fea8cda6e1fc admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:56.576007 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0bd837-2964-4242-85fa-fea8cda6e1fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:56.577957 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0bd837-2964-4242-85fa-fea8cda6e1fc admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:56.726376 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4170/8366] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:43:56 2022] POST /identity/v3/users => generated 291 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:43:56.730531 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a184cd3-5418-4623-a993-d967f885e334 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:56.741135 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a184cd3-5418-4623-a993-d967f885e334 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:56.746297 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a56b08-f6d6-4e20-894a-906960aa620c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:56.746958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a56b08-f6d6-4e20-894a-906960aa620c admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:56.747275 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a56b08-f6d6-4e20-894a-906960aa620c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:56.747556 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a56b08-f6d6-4e20-894a-906960aa620c admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:56.748278 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a56b08-f6d6-4e20-894a-906960aa620c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:56.749962 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a56b08-f6d6-4e20-894a-906960aa620c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:56.760988 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4197/8367] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:43:56.764924 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0bd837-2964-4242-85fa-fea8cda6e1fc admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:56.775070 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0bd837-2964-4242-85fa-fea8cda6e1fc admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:56.780036 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a84d2-9eda-48a0-9c32-f169fdc11535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:56.780692 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a84d2-9eda-48a0-9c32-f169fdc11535 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:56.780976 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a84d2-9eda-48a0-9c32-f169fdc11535 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:56.781256 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a84d2-9eda-48a0-9c32-f169fdc11535 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:56.782006 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a84d2-9eda-48a0-9c32-f169fdc11535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:56.783615 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a84d2-9eda-48a0-9c32-f169fdc11535 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:56.793953 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4171/8368] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:43:56.798058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a56b08-f6d6-4e20-894a-906960aa620c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:56.809903 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a56b08-f6d6-4e20-894a-906960aa620c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:56.813750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcad24a-83d9-4226-91d6-8a023b97d8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:56.814652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcad24a-83d9-4226-91d6-8a023b97d8b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:56.814934 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcad24a-83d9-4226-91d6-8a023b97d8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:56.815205 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcad24a-83d9-4226-91d6-8a023b97d8b2 admin admin] PATH_INFO: `/v3/projects/d1febcefe29f461ea37667520a278022/users/0ed9fb1a529f4247acd72a6de21ceb4c/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:56.833080 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcad24a-83d9-4226-91d6-8a023b97d8b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1febcefe29f461ea37667520a278022, user_id=0ed9fb1a529f4247acd72a6de21ceb4c, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:56.833080 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcad24a-83d9-4226-91d6-8a023b97d8b2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:56.938202 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4198/8369] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:43:56 2022] PUT /identity/v3/projects/d1febcefe29f461ea37667520a278022/users/0ed9fb1a529f4247acd72a6de21ceb4c/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:43:56.943276 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158df1c7-3eac-4b21-b195-678cefcf17ec None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:56.943568 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158df1c7-3eac-4b21-b195-678cefcf17ec None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:56.943848 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158df1c7-3eac-4b21-b195-678cefcf17ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:56.962118 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-158df1c7-3eac-4b21-b195-678cefcf17ec None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:56.963312 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-158df1c7-3eac-4b21-b195-678cefcf17ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:57.029285 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4172/8370] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:43:57.042751 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcad24a-83d9-4226-91d6-8a023b97d8b2 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:57.044570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ffcad24a-83d9-4226-91d6-8a023b97d8b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:57.109620 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcad24a-83d9-4226-91d6-8a023b97d8b2 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:57.113234 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e65df8-2272-48e9-bcc6-01b3228a4294 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:57.113897 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e65df8-2272-48e9-bcc6-01b3228a4294 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:57.114180 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e65df8-2272-48e9-bcc6-01b3228a4294 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:57.114453 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e65df8-2272-48e9-bcc6-01b3228a4294 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:57.124183 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e65df8-2272-48e9-bcc6-01b3228a4294 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:57.125621 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e65df8-2272-48e9-bcc6-01b3228a4294 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:57.135424 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4199/8371] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:43:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:43:58.485770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b7e0c-e1ac-4eee-b836-5aa26edd229d None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:58.486350 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b7e0c-e1ac-4eee-b836-5aa26edd229d None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:58.486350 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b7e0c-e1ac-4eee-b836-5aa26edd229d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:58.513666 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-732b7e0c-e1ac-4eee-b836-5aa26edd229d None None] MFA Rules not processed for user `0ed9fb1a529f4247acd72a6de21ceb4c`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:43:58.514920 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-732b7e0c-e1ac-4eee-b836-5aa26edd229d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:58.583214 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4173/8372] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:43:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:43:58.594261 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e65df8-2272-48e9-bcc6-01b3228a4294 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:43:58.596223 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-78e65df8-2272-48e9-bcc6-01b3228a4294 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:43:58.656855 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e65df8-2272-48e9-bcc6-01b3228a4294 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:43:58.660632 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6e51c-3818-4ea6-a7ea-d2da095780d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:43:58.661271 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6e51c-3818-4ea6-a7ea-d2da095780d1 service cinder] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:43:58.661554 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6e51c-3818-4ea6-a7ea-d2da095780d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:43:58.661867 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6e51c-3818-4ea6-a7ea-d2da095780d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:43:58.670953 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f6e51c-3818-4ea6-a7ea-d2da095780d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:43:58.672364 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f6e51c-3818-4ea6-a7ea-d2da095780d1 service cinder] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:43:58.681223 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4200/8373] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:43:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:44:12.919905 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b7e0c-e1ac-4eee-b836-5aa26edd229d None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:12.921944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-732b7e0c-e1ac-4eee-b836-5aa26edd229d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:44:12.934995 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b7e0c-e1ac-4eee-b836-5aa26edd229d None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:12.939412 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812fd0a-ffbe-4971-9f8a-f59a9420bad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:12.940262 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812fd0a-ffbe-4971-9f8a-f59a9420bad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:12.940546 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812fd0a-ffbe-4971-9f8a-f59a9420bad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:12.940823 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812fd0a-ffbe-4971-9f8a-f59a9420bad8 admin admin] PATH_INFO: `/v3/users/bf629beb150b45d2a0075c053261c7f1` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:12.942028 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4812fd0a-ffbe-4971-9f8a-f59a9420bad8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf629beb150b45d2a0075c053261c7f1)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:12.943931 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4812fd0a-ffbe-4971-9f8a-f59a9420bad8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:13.123820 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4812fd0a-ffbe-4971-9f8a-f59a9420bad8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf629beb150b45d2a0075c053261c7f1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:13.135386 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4812fd0a-ffbe-4971-9f8a-f59a9420bad8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf629beb150b45d2a0075c053261c7f1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:13.206030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4812fd0a-ffbe-4971-9f8a-f59a9420bad8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf629beb150b45d2a0075c053261c7f1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:13.206651 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4812fd0a-ffbe-4971-9f8a-f59a9420bad8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf629beb150b45d2a0075c053261c7f1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:13.213825 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4812fd0a-ffbe-4971-9f8a-f59a9420bad8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf629beb150b45d2a0075c053261c7f1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:13.220286 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4174/8374] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:44:12 2022] DELETE /identity/v3/users/bf629beb150b45d2a0075c053261c7f1 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:44:13.224835 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555226e3-e2b5-4934-8ff8-78de15cb9e73 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:13.225316 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555226e3-e2b5-4934-8ff8-78de15cb9e73 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:13.225420 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555226e3-e2b5-4934-8ff8-78de15cb9e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:13.242783 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-555226e3-e2b5-4934-8ff8-78de15cb9e73 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:44:13.243971 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-555226e3-e2b5-4934-8ff8-78de15cb9e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:44:13.304116 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4201/8375] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:44:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:44:13.315031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812fd0a-ffbe-4971-9f8a-f59a9420bad8 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:13.316429 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4812fd0a-ffbe-4971-9f8a-f59a9420bad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:44:13.378744 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812fd0a-ffbe-4971-9f8a-f59a9420bad8 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:13.383127 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe5492-b450-4393-b853-449277584f48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:13.383829 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe5492-b450-4393-b853-449277584f48 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:13.384111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe5492-b450-4393-b853-449277584f48 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:13.384378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe5492-b450-4393-b853-449277584f48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:13.394996 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbe5492-b450-4393-b853-449277584f48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:13.396468 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbe5492-b450-4393-b853-449277584f48 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:13.406745 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4175/8376] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:44:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:44:13.836348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555226e3-e2b5-4934-8ff8-78de15cb9e73 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:13.839569 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-555226e3-e2b5-4934-8ff8-78de15cb9e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:44:13.856232 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555226e3-e2b5-4934-8ff8-78de15cb9e73 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:13.862728 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec7af9-5267-4875-815c-9437d330117a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:13.868627 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec7af9-5267-4875-815c-9437d330117a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:13.868627 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec7af9-5267-4875-815c-9437d330117a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:13.868627 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec7af9-5267-4875-815c-9437d330117a admin admin] PATH_INFO: `/v3/projects/9d059f828e0d4a2fbfed837f74f3ecdd` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:13.868627 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec7af9-5267-4875-815c-9437d330117a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d059f828e0d4a2fbfed837f74f3ecdd)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:13.868627 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baec7af9-5267-4875-815c-9437d330117a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:13.990222 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-baec7af9-5267-4875-815c-9437d330117a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d059f828e0d4a2fbfed837f74f3ecdd', 'request_id': 'req-baec7af9-5267-4875-815c-9437d330117a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:13.995672 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-baec7af9-5267-4875-815c-9437d330117a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d059f828e0d4a2fbfed837f74f3ecdd', 'request_id': 'req-baec7af9-5267-4875-815c-9437d330117a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:14.002243 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-baec7af9-5267-4875-815c-9437d330117a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d059f828e0d4a2fbfed837f74f3ecdd', 'request_id': 'req-baec7af9-5267-4875-815c-9437d330117a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:14.077554 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-baec7af9-5267-4875-815c-9437d330117a admin admin] The token cache is being invalidate because project 9d059f828e0d4a2fbfed837f74f3ecdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:44:14.077890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-baec7af9-5267-4875-815c-9437d330117a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:14.078525 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-baec7af9-5267-4875-815c-9437d330117a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:14.080136 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4202/8377] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:44:13 2022] DELETE /identity/v3/projects/9d059f828e0d4a2fbfed837f74f3ecdd => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:44:14.084204 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe5492-b450-4393-b853-449277584f48 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:14.095577 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe5492-b450-4393-b853-449277584f48 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:14.161895 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b124f7f-c123-48b6-8b24-392b763916c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:14.163299 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b124f7f-c123-48b6-8b24-392b763916c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:14.163599 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b124f7f-c123-48b6-8b24-392b763916c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:14.163990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b124f7f-c123-48b6-8b24-392b763916c3 admin admin] PATH_INFO: `/v3/users/e517d52f6fff4e95b757ab742c98c9c6` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:14.165373 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b124f7f-c123-48b6-8b24-392b763916c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e517d52f6fff4e95b757ab742c98c9c6)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:14.167326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b124f7f-c123-48b6-8b24-392b763916c3 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:14.392969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2b124f7f-c123-48b6-8b24-392b763916c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e517d52f6fff4e95b757ab742c98c9c6'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:14.405337 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2b124f7f-c123-48b6-8b24-392b763916c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e517d52f6fff4e95b757ab742c98c9c6'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:14.494424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2b124f7f-c123-48b6-8b24-392b763916c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e517d52f6fff4e95b757ab742c98c9c6'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:14.495061 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2b124f7f-c123-48b6-8b24-392b763916c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e517d52f6fff4e95b757ab742c98c9c6'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:14.503112 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2b124f7f-c123-48b6-8b24-392b763916c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e517d52f6fff4e95b757ab742c98c9c6'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:14.509002 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4176/8378] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:44:14 2022] DELETE /identity/v3/users/e517d52f6fff4e95b757ab742c98c9c6 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:44:14.995961 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec7af9-5267-4875-815c-9437d330117a admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:14.997441 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-baec7af9-5267-4875-815c-9437d330117a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:44:15.011994 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec7af9-5267-4875-815c-9437d330117a admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:15.068904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76afe2f9-6cfb-4b15-9ded-75e98828f917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:15.069775 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76afe2f9-6cfb-4b15-9ded-75e98828f917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:15.070068 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76afe2f9-6cfb-4b15-9ded-75e98828f917 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:15.070348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76afe2f9-6cfb-4b15-9ded-75e98828f917 admin admin] PATH_INFO: `/v3/projects/2bdac16fac414838974a4b64a7f68f89` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:15.071513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76afe2f9-6cfb-4b15-9ded-75e98828f917 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bdac16fac414838974a4b64a7f68f89)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:15.073498 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76afe2f9-6cfb-4b15-9ded-75e98828f917 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:15.183287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-76afe2f9-6cfb-4b15-9ded-75e98828f917 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bdac16fac414838974a4b64a7f68f89', 'request_id': 'req-76afe2f9-6cfb-4b15-9ded-75e98828f917'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:15.188662 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-76afe2f9-6cfb-4b15-9ded-75e98828f917 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bdac16fac414838974a4b64a7f68f89', 'request_id': 'req-76afe2f9-6cfb-4b15-9ded-75e98828f917'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:15.194743 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-76afe2f9-6cfb-4b15-9ded-75e98828f917 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bdac16fac414838974a4b64a7f68f89', 'request_id': 'req-76afe2f9-6cfb-4b15-9ded-75e98828f917'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:15.288550 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-76afe2f9-6cfb-4b15-9ded-75e98828f917 admin admin] The token cache is being invalidate because project 2bdac16fac414838974a4b64a7f68f89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:44:15.288839 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-76afe2f9-6cfb-4b15-9ded-75e98828f917 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:15.289485 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-76afe2f9-6cfb-4b15-9ded-75e98828f917 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:15.291061 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4203/8379] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:44:14 2022] DELETE /identity/v3/projects/2bdac16fac414838974a4b64a7f68f89 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:44:15.296677 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6d3dd-7244-44b8-ad2a-3667c42ffd51 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:15.297177 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6d3dd-7244-44b8-ad2a-3667c42ffd51 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:15.297271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6d3dd-7244-44b8-ad2a-3667c42ffd51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:15.316801 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-9ff6d3dd-7244-44b8-ad2a-3667c42ffd51 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:44:15.318035 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-9ff6d3dd-7244-44b8-ad2a-3667c42ffd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:44:15.379455 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4177/8380] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:44:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:44:15.387313 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6315f-a5d7-45a6-be61-c8a1932e9962 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:15.387595 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6315f-a5d7-45a6-be61-c8a1932e9962 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:15.387874 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6315f-a5d7-45a6-be61-c8a1932e9962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:15.407397 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-55e6315f-a5d7-45a6-be61-c8a1932e9962 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:44:15.408647 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-55e6315f-a5d7-45a6-be61-c8a1932e9962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:44:15.416741 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4204/8381] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:44:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:44:15.421896 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6d3dd-7244-44b8-ad2a-3667c42ffd51 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:15.431447 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6d3dd-7244-44b8-ad2a-3667c42ffd51 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:15.435965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a0e3b-f259-4b57-96bf-1df3b1f67354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:15.436609 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a0e3b-f259-4b57-96bf-1df3b1f67354 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:15.436890 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a0e3b-f259-4b57-96bf-1df3b1f67354 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:15.437163 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a0e3b-f259-4b57-96bf-1df3b1f67354 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:15.437908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a0e3b-f259-4b57-96bf-1df3b1f67354 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:44:15.438212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a0e3b-f259-4b57-96bf-1df3b1f67354 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:15.439808 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a0e3b-f259-4b57-96bf-1df3b1f67354 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:15.452020 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4178/8382] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:44:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:44:15.456440 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6315f-a5d7-45a6-be61-c8a1932e9962 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:15.465842 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6315f-a5d7-45a6-be61-c8a1932e9962 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:15.473985 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0bcd6-fae0-45ec-ba97-96b836725268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:15.474650 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0bcd6-fae0-45ec-ba97-96b836725268 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:15.474933 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0bcd6-fae0-45ec-ba97-96b836725268 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:15.475210 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0bcd6-fae0-45ec-ba97-96b836725268 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:15.475950 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c0bcd6-fae0-45ec-ba97-96b836725268 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:15.477989 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c0bcd6-fae0-45ec-ba97-96b836725268 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:15.573328 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4205/8383] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:44:15 2022] POST /identity/v3/projects => generated 379 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:44:15.578220 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a0e3b-f259-4b57-96bf-1df3b1f67354 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:15.588106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a0e3b-f259-4b57-96bf-1df3b1f67354 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:15.644903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8e8d5-b8e8-4a4d-a81d-7b4cc8e8cc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:15.645578 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8e8d5-b8e8-4a4d-a81d-7b4cc8e8cc1e admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:15.645902 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8e8d5-b8e8-4a4d-a81d-7b4cc8e8cc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:15.646181 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8e8d5-b8e8-4a4d-a81d-7b4cc8e8cc1e admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:15.646875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e8e8d5-b8e8-4a4d-a81d-7b4cc8e8cc1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:15.648805 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e8e8d5-b8e8-4a4d-a81d-7b4cc8e8cc1e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:15.737820 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4179/8384] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:44:15 2022] POST /identity/v3/users => generated 290 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:44:15.742216 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0bcd6-fae0-45ec-ba97-96b836725268 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:15.752549 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0bcd6-fae0-45ec-ba97-96b836725268 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:15.757224 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263535ad-2f96-4826-91a2-df0ef0ad3148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:15.757906 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263535ad-2f96-4826-91a2-df0ef0ad3148 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:15.758191 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263535ad-2f96-4826-91a2-df0ef0ad3148 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:15.758468 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263535ad-2f96-4826-91a2-df0ef0ad3148 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:15.759720 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263535ad-2f96-4826-91a2-df0ef0ad3148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:15.760982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263535ad-2f96-4826-91a2-df0ef0ad3148 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:15.773370 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4206/8385] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:44:15.778271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8e8d5-b8e8-4a4d-a81d-7b4cc8e8cc1e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:15.788817 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8e8d5-b8e8-4a4d-a81d-7b4cc8e8cc1e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:15.793389 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfddea1c-5809-4ee9-bd3d-06be6bb4c70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:15.794064 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfddea1c-5809-4ee9-bd3d-06be6bb4c70e admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:15.794348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfddea1c-5809-4ee9-bd3d-06be6bb4c70e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:15.794617 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfddea1c-5809-4ee9-bd3d-06be6bb4c70e admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:15.795357 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfddea1c-5809-4ee9-bd3d-06be6bb4c70e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:15.796943 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfddea1c-5809-4ee9-bd3d-06be6bb4c70e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:15.806598 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4180/8386] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:44:15.810593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263535ad-2f96-4826-91a2-df0ef0ad3148 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:15.821651 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263535ad-2f96-4826-91a2-df0ef0ad3148 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:15.826324 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a9434-91e7-4362-82e7-4a240bb8dbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:15.827731 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a9434-91e7-4362-82e7-4a240bb8dbe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:15.828315 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a9434-91e7-4362-82e7-4a240bb8dbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:15.828594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a9434-91e7-4362-82e7-4a240bb8dbe5 admin admin] PATH_INFO: `/v3/projects/3a08f7eeff594200b8cf2a49affb2b70/users/e78f0279911c43fea0076117836fa82d/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:15.842996 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538a9434-91e7-4362-82e7-4a240bb8dbe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a08f7eeff594200b8cf2a49affb2b70, user_id=e78f0279911c43fea0076117836fa82d, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:15.845883 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538a9434-91e7-4362-82e7-4a240bb8dbe5 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:15.946401 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4207/8387] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:44:15 2022] PUT /identity/v3/projects/3a08f7eeff594200b8cf2a49affb2b70/users/e78f0279911c43fea0076117836fa82d/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:44:15.956889 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe2933-c639-4d38-9157-50d1cb747d80 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:15.957177 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe2933-c639-4d38-9157-50d1cb747d80 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:15.957458 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe2933-c639-4d38-9157-50d1cb747d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:15.983248 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-9cbe2933-c639-4d38-9157-50d1cb747d80 None None] MFA Rules not processed for user `e78f0279911c43fea0076117836fa82d`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:44:15.984502 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-9cbe2933-c639-4d38-9157-50d1cb747d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:44:16.049691 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4181/8388] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:44:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:44:16.054328 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a9434-91e7-4362-82e7-4a240bb8dbe5 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:16.114846 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a9434-91e7-4362-82e7-4a240bb8dbe5 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:16.119617 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245c155-13b7-4775-909b-a84febf065ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:16.120274 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245c155-13b7-4775-909b-a84febf065ee admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:16.120558 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245c155-13b7-4775-909b-a84febf065ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:16.120837 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245c155-13b7-4775-909b-a84febf065ee admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:16.121615 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245c155-13b7-4775-909b-a84febf065ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:16.124148 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245c155-13b7-4775-909b-a84febf065ee admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:16.239769 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4208/8389] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:44:16 2022] POST /identity/v3/projects => generated 375 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:44:16.244108 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe2933-c639-4d38-9157-50d1cb747d80 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:16.255975 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe2933-c639-4d38-9157-50d1cb747d80 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:16.312385 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc4d87-d486-4658-916a-78c568d79937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:16.313130 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc4d87-d486-4658-916a-78c568d79937 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:16.313566 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc4d87-d486-4658-916a-78c568d79937 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:16.313905 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc4d87-d486-4658-916a-78c568d79937 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:16.314636 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc4d87-d486-4658-916a-78c568d79937 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:16.316572 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc4d87-d486-4658-916a-78c568d79937 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:16.446340 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4182/8390] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:44:16 2022] POST /identity/v3/users => generated 288 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:44:16.450564 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245c155-13b7-4775-909b-a84febf065ee admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:16.460764 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245c155-13b7-4775-909b-a84febf065ee admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:16.465267 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d20e5-88ee-4835-be3e-4e5e4b5c33d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:16.465956 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d20e5-88ee-4835-be3e-4e5e4b5c33d9 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:16.466240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d20e5-88ee-4835-be3e-4e5e4b5c33d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:16.466514 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d20e5-88ee-4835-be3e-4e5e4b5c33d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:16.467270 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d20e5-88ee-4835-be3e-4e5e4b5c33d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:16.468861 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d20e5-88ee-4835-be3e-4e5e4b5c33d9 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:16.482671 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4209/8391] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:44:16.485805 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc4d87-d486-4658-916a-78c568d79937 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:16.496116 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc4d87-d486-4658-916a-78c568d79937 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:16.501706 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a8c1d-fbd2-4e93-9661-a7d851dce78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:16.502405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a8c1d-fbd2-4e93-9661-a7d851dce78c admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:16.502690 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a8c1d-fbd2-4e93-9661-a7d851dce78c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:16.502979 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a8c1d-fbd2-4e93-9661-a7d851dce78c admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:16.504283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a8c1d-fbd2-4e93-9661-a7d851dce78c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:16.505711 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a8c1d-fbd2-4e93-9661-a7d851dce78c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:16.516912 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4183/8392] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:44:16.521163 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d20e5-88ee-4835-be3e-4e5e4b5c33d9 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:16.532541 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d20e5-88ee-4835-be3e-4e5e4b5c33d9 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:16.537158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e2998c-b7f4-41ad-bef8-2be8c600b58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:16.538121 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e2998c-b7f4-41ad-bef8-2be8c600b58a admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:16.538400 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e2998c-b7f4-41ad-bef8-2be8c600b58a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:16.538675 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e2998c-b7f4-41ad-bef8-2be8c600b58a admin admin] PATH_INFO: `/v3/projects/0a6b6a3c28e64bcd81acbacd30c2358f/users/f04b0ea892e8405ca94b4f66b9a19775/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:16.553317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e2998c-b7f4-41ad-bef8-2be8c600b58a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a6b6a3c28e64bcd81acbacd30c2358f, user_id=f04b0ea892e8405ca94b4f66b9a19775, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:16.556072 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e2998c-b7f4-41ad-bef8-2be8c600b58a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:16.680857 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4210/8393] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:44:16 2022] PUT /identity/v3/projects/0a6b6a3c28e64bcd81acbacd30c2358f/users/f04b0ea892e8405ca94b4f66b9a19775/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:44:16.691818 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b12ac-a241-4b5b-bbe2-b519e784eff8 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:16.692109 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b12ac-a241-4b5b-bbe2-b519e784eff8 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:16.692389 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b12ac-a241-4b5b-bbe2-b519e784eff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:16.719713 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-520b12ac-a241-4b5b-bbe2-b519e784eff8 None None] MFA Rules not processed for user `f04b0ea892e8405ca94b4f66b9a19775`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:44:16.720852 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-520b12ac-a241-4b5b-bbe2-b519e784eff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:44:16.783255 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4184/8394] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:44:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:44:16.787761 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e2998c-b7f4-41ad-bef8-2be8c600b58a admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:16.849509 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e2998c-b7f4-41ad-bef8-2be8c600b58a admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:16.854619 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ce9da-8cb5-4073-a19d-2ff46bf9ac00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:16.855314 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ce9da-8cb5-4073-a19d-2ff46bf9ac00 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:16.855604 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ce9da-8cb5-4073-a19d-2ff46bf9ac00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:16.855900 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ce9da-8cb5-4073-a19d-2ff46bf9ac00 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:16.856621 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ce9da-8cb5-4073-a19d-2ff46bf9ac00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:16.859334 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ce9da-8cb5-4073-a19d-2ff46bf9ac00 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:16.935928 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4211/8395] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:44:16 2022] POST /identity/v3/projects => generated 379 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:44:16.939875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b12ac-a241-4b5b-bbe2-b519e784eff8 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:16.950877 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b12ac-a241-4b5b-bbe2-b519e784eff8 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:17.009898 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e80b1d-4f06-43d0-be3b-640a39c5c696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:17.010755 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e80b1d-4f06-43d0-be3b-640a39c5c696 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:17.011040 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e80b1d-4f06-43d0-be3b-640a39c5c696 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:17.011317 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e80b1d-4f06-43d0-be3b-640a39c5c696 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:17.012042 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e80b1d-4f06-43d0-be3b-640a39c5c696 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:17.014802 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e80b1d-4f06-43d0-be3b-640a39c5c696 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:17.126652 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4185/8396] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:44:16 2022] POST /identity/v3/users => generated 296 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:44:17.130642 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ce9da-8cb5-4073-a19d-2ff46bf9ac00 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:17.141274 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ce9da-8cb5-4073-a19d-2ff46bf9ac00 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:17.145883 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c70d2f-d808-4996-b1bd-5e2e41b2415f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:17.146766 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c70d2f-d808-4996-b1bd-5e2e41b2415f admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:17.146891 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c70d2f-d808-4996-b1bd-5e2e41b2415f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:17.147081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c70d2f-d808-4996-b1bd-5e2e41b2415f admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:17.151523 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c70d2f-d808-4996-b1bd-5e2e41b2415f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:17.152685 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c70d2f-d808-4996-b1bd-5e2e41b2415f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:17.166208 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4212/8397] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:44:17.170434 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e80b1d-4f06-43d0-be3b-640a39c5c696 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:17.180430 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e80b1d-4f06-43d0-be3b-640a39c5c696 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:17.185138 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ddb1a-7ef6-4ca5-9209-6e698c9c0179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:17.186037 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ddb1a-7ef6-4ca5-9209-6e698c9c0179 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:17.186317 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ddb1a-7ef6-4ca5-9209-6e698c9c0179 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:17.186588 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ddb1a-7ef6-4ca5-9209-6e698c9c0179 admin admin] PATH_INFO: `/v3/projects/1aeda4303e6f4c44af29521fadb3f268/users/5dd30243e6254adead228b333796282d/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:17.200712 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ddb1a-7ef6-4ca5-9209-6e698c9c0179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aeda4303e6f4c44af29521fadb3f268, user_id=5dd30243e6254adead228b333796282d, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:17.203915 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ddb1a-7ef6-4ca5-9209-6e698c9c0179 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:17.291679 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4186/8398] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:44:17 2022] PUT /identity/v3/projects/1aeda4303e6f4c44af29521fadb3f268/users/5dd30243e6254adead228b333796282d/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:44:17.295655 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c70d2f-d808-4996-b1bd-5e2e41b2415f admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:17.305544 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c70d2f-d808-4996-b1bd-5e2e41b2415f admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:17.366370 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2b549-0b5d-4ac1-810e-134f5608204b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:17.366370 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2b549-0b5d-4ac1-810e-134f5608204b admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:17.366370 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2b549-0b5d-4ac1-810e-134f5608204b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:17.366370 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2b549-0b5d-4ac1-810e-134f5608204b admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:17.366900 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2b549-0b5d-4ac1-810e-134f5608204b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:17.368536 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2b549-0b5d-4ac1-810e-134f5608204b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:17.379098 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4213/8399] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:44:17.383192 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ddb1a-7ef6-4ca5-9209-6e698c9c0179 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:17.394257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ddb1a-7ef6-4ca5-9209-6e698c9c0179 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:17.398817 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb65a6-2ca0-44a1-8dd1-1c1180af8d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:17.399685 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb65a6-2ca0-44a1-8dd1-1c1180af8d92 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:17.399967 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb65a6-2ca0-44a1-8dd1-1c1180af8d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:17.400243 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb65a6-2ca0-44a1-8dd1-1c1180af8d92 admin admin] PATH_INFO: `/v3/projects/1aeda4303e6f4c44af29521fadb3f268/users/5dd30243e6254adead228b333796282d/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:17.402489 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffb65a6-2ca0-44a1-8dd1-1c1180af8d92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aeda4303e6f4c44af29521fadb3f268, user_id=5dd30243e6254adead228b333796282d, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:17.405219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffb65a6-2ca0-44a1-8dd1-1c1180af8d92 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:17.415084 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4187/8400] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:44:17 2022] PUT /identity/v3/projects/1aeda4303e6f4c44af29521fadb3f268/users/5dd30243e6254adead228b333796282d/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:44:17.424987 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d383094-76a5-4dea-9dac-614235ac15bf None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:17.425300 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d383094-76a5-4dea-9dac-614235ac15bf None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:17.425580 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d383094-76a5-4dea-9dac-614235ac15bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:17.453171 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-7d383094-76a5-4dea-9dac-614235ac15bf None None] MFA Rules not processed for user `5dd30243e6254adead228b333796282d`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:44:17.454445 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7d383094-76a5-4dea-9dac-614235ac15bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:44:17.672024 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4214/8401] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:44:17 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:44:17.683310 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb65a6-2ca0-44a1-8dd1-1c1180af8d92 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:17.685021 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-bffb65a6-2ca0-44a1-8dd1-1c1180af8d92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:44:17.760361 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb65a6-2ca0-44a1-8dd1-1c1180af8d92 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:17.764247 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0105319-5855-451d-9793-53ef0abbd1a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:17.764893 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0105319-5855-451d-9793-53ef0abbd1a1 service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:17.765175 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0105319-5855-451d-9793-53ef0abbd1a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:17.765474 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0105319-5855-451d-9793-53ef0abbd1a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:17.774631 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0105319-5855-451d-9793-53ef0abbd1a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:17.776336 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0105319-5855-451d-9793-53ef0abbd1a1 service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:17.786716 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4188/8402] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:44:17 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:44:17.907112 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d383094-76a5-4dea-9dac-614235ac15bf None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:17.908524 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7d383094-76a5-4dea-9dac-614235ac15bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:44:17.923318 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d383094-76a5-4dea-9dac-614235ac15bf None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:17.926796 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d70bed-e9d5-4eba-a2ca-880bb6ed79a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:17.927420 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d70bed-e9d5-4eba-a2ca-880bb6ed79a7 service cinder] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:17.927695 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d70bed-e9d5-4eba-a2ca-880bb6ed79a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:17.927969 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d70bed-e9d5-4eba-a2ca-880bb6ed79a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:17.984364 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d70bed-e9d5-4eba-a2ca-880bb6ed79a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:17.986017 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d70bed-e9d5-4eba-a2ca-880bb6ed79a7 service cinder] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:17.997292 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4215/8403] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:44:17 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:44:44.100497 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0105319-5855-451d-9793-53ef0abbd1a1 service cinder] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:44.163156 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0105319-5855-451d-9793-53ef0abbd1a1 service cinder] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:44.168295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced4a54-a169-4673-a182-148137fea5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:44.169628 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced4a54-a169-4673-a182-148137fea5f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:44.169628 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced4a54-a169-4673-a182-148137fea5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:44.169874 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced4a54-a169-4673-a182-148137fea5f7 admin admin] PATH_INFO: `/v3/users/e78f0279911c43fea0076117836fa82d` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:44.170933 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ced4a54-a169-4673-a182-148137fea5f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e78f0279911c43fea0076117836fa82d)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:44.172950 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ced4a54-a169-4673-a182-148137fea5f7 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:44.416452 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2ced4a54-a169-4673-a182-148137fea5f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e78f0279911c43fea0076117836fa82d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:44.428469 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2ced4a54-a169-4673-a182-148137fea5f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e78f0279911c43fea0076117836fa82d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:44.491919 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2ced4a54-a169-4673-a182-148137fea5f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e78f0279911c43fea0076117836fa82d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:44.492583 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2ced4a54-a169-4673-a182-148137fea5f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e78f0279911c43fea0076117836fa82d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:44.501493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2ced4a54-a169-4673-a182-148137fea5f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e78f0279911c43fea0076117836fa82d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:44.508422 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4189/8404] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:44:44 2022] DELETE /identity/v3/users/e78f0279911c43fea0076117836fa82d => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:44:44.513058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129f109-198b-4b7a-af06-e3230bb79df4 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:44.513587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129f109-198b-4b7a-af06-e3230bb79df4 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:44.513587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129f109-198b-4b7a-af06-e3230bb79df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:44.530588 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-e129f109-198b-4b7a-af06-e3230bb79df4 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:44:44.531825 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e129f109-198b-4b7a-af06-e3230bb79df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:44:44.588330 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4216/8405] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:44:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:44:44.598918 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced4a54-a169-4673-a182-148137fea5f7 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:44.600341 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2ced4a54-a169-4673-a182-148137fea5f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:44:44.659209 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced4a54-a169-4673-a182-148137fea5f7 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:44.663481 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc113cc9-8e30-4cb7-b1cb-200951959f58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:44.665924 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc113cc9-8e30-4cb7-b1cb-200951959f58 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:44.665924 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc113cc9-8e30-4cb7-b1cb-200951959f58 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:44.665924 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc113cc9-8e30-4cb7-b1cb-200951959f58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:44.674317 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc113cc9-8e30-4cb7-b1cb-200951959f58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:44.676401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc113cc9-8e30-4cb7-b1cb-200951959f58 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:44.690479 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4190/8406] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:44:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:44:45.122055 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129f109-198b-4b7a-af06-e3230bb79df4 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:45.123465 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e129f109-198b-4b7a-af06-e3230bb79df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:44:45.135462 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129f109-198b-4b7a-af06-e3230bb79df4 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:45.142063 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1518c-143f-4b87-9490-2a0e2b56e2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:45.142063 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1518c-143f-4b87-9490-2a0e2b56e2a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:45.142063 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1518c-143f-4b87-9490-2a0e2b56e2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:45.142063 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1518c-143f-4b87-9490-2a0e2b56e2a9 admin admin] PATH_INFO: `/v3/projects/3a08f7eeff594200b8cf2a49affb2b70` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:45.143186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b1518c-143f-4b87-9490-2a0e2b56e2a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a08f7eeff594200b8cf2a49affb2b70)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:45.145928 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b1518c-143f-4b87-9490-2a0e2b56e2a9 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:45.263181 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-81b1518c-143f-4b87-9490-2a0e2b56e2a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a08f7eeff594200b8cf2a49affb2b70', 'request_id': 'req-81b1518c-143f-4b87-9490-2a0e2b56e2a9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:45.268634 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-81b1518c-143f-4b87-9490-2a0e2b56e2a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a08f7eeff594200b8cf2a49affb2b70', 'request_id': 'req-81b1518c-143f-4b87-9490-2a0e2b56e2a9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:45.275674 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-81b1518c-143f-4b87-9490-2a0e2b56e2a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a08f7eeff594200b8cf2a49affb2b70', 'request_id': 'req-81b1518c-143f-4b87-9490-2a0e2b56e2a9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:45.337267 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-81b1518c-143f-4b87-9490-2a0e2b56e2a9 admin admin] The token cache is being invalidate because project 3a08f7eeff594200b8cf2a49affb2b70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:44:45.337558 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-81b1518c-143f-4b87-9490-2a0e2b56e2a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:45.338218 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-81b1518c-143f-4b87-9490-2a0e2b56e2a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:45.339757 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4217/8407] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:44:45 2022] DELETE /identity/v3/projects/3a08f7eeff594200b8cf2a49affb2b70 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:44:45.343865 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc113cc9-8e30-4cb7-b1cb-200951959f58 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:45.354166 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc113cc9-8e30-4cb7-b1cb-200951959f58 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:45.408340 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0546e-cf52-45c4-8525-4f8db4482e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:45.409125 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0546e-cf52-45c4-8525-4f8db4482e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:45.409407 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0546e-cf52-45c4-8525-4f8db4482e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:45.409684 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0546e-cf52-45c4-8525-4f8db4482e9f admin admin] PATH_INFO: `/v3/users/f04b0ea892e8405ca94b4f66b9a19775` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:45.411516 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a0546e-cf52-45c4-8525-4f8db4482e9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f04b0ea892e8405ca94b4f66b9a19775)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:45.413484 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a0546e-cf52-45c4-8525-4f8db4482e9f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:45.611228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-32a0546e-cf52-45c4-8525-4f8db4482e9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f04b0ea892e8405ca94b4f66b9a19775'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:45.622605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-32a0546e-cf52-45c4-8525-4f8db4482e9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f04b0ea892e8405ca94b4f66b9a19775'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:45.706403 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-32a0546e-cf52-45c4-8525-4f8db4482e9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f04b0ea892e8405ca94b4f66b9a19775'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:45.707029 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-32a0546e-cf52-45c4-8525-4f8db4482e9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f04b0ea892e8405ca94b4f66b9a19775'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:45.714999 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-32a0546e-cf52-45c4-8525-4f8db4482e9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f04b0ea892e8405ca94b4f66b9a19775'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:45.720839 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4191/8408] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:44:45 2022] DELETE /identity/v3/users/f04b0ea892e8405ca94b4f66b9a19775 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:44:46.134576 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1518c-143f-4b87-9490-2a0e2b56e2a9 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:46.136102 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-81b1518c-143f-4b87-9490-2a0e2b56e2a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:44:46.149363 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1518c-143f-4b87-9490-2a0e2b56e2a9 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:46.204945 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828eb73-a46b-4ba0-af78-4850084ff409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:46.207998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828eb73-a46b-4ba0-af78-4850084ff409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:46.207998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828eb73-a46b-4ba0-af78-4850084ff409 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:46.207998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828eb73-a46b-4ba0-af78-4850084ff409 admin admin] PATH_INFO: `/v3/projects/0a6b6a3c28e64bcd81acbacd30c2358f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:46.207998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3828eb73-a46b-4ba0-af78-4850084ff409 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a6b6a3c28e64bcd81acbacd30c2358f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:46.211364 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3828eb73-a46b-4ba0-af78-4850084ff409 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:46.372332 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3828eb73-a46b-4ba0-af78-4850084ff409 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a6b6a3c28e64bcd81acbacd30c2358f', 'request_id': 'req-3828eb73-a46b-4ba0-af78-4850084ff409'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:46.377640 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3828eb73-a46b-4ba0-af78-4850084ff409 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a6b6a3c28e64bcd81acbacd30c2358f', 'request_id': 'req-3828eb73-a46b-4ba0-af78-4850084ff409'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:46.384324 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3828eb73-a46b-4ba0-af78-4850084ff409 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a6b6a3c28e64bcd81acbacd30c2358f', 'request_id': 'req-3828eb73-a46b-4ba0-af78-4850084ff409'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:46.446510 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3828eb73-a46b-4ba0-af78-4850084ff409 admin admin] The token cache is being invalidate because project 0a6b6a3c28e64bcd81acbacd30c2358f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:44:46.446806 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3828eb73-a46b-4ba0-af78-4850084ff409 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:46.447448 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3828eb73-a46b-4ba0-af78-4850084ff409 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:46.449011 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4218/8409] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:44:46 2022] DELETE /identity/v3/projects/0a6b6a3c28e64bcd81acbacd30c2358f => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:44:46.453151 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0546e-cf52-45c4-8525-4f8db4482e9f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:46.454599 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-32a0546e-cf52-45c4-8525-4f8db4482e9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:44:46.467224 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0546e-cf52-45c4-8525-4f8db4482e9f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:46.524258 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a63bcba-0944-4c89-ae43-db0515c5dce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:46.525621 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63bcba-0944-4c89-ae43-db0515c5dce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:46.525621 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63bcba-0944-4c89-ae43-db0515c5dce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:46.526369 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63bcba-0944-4c89-ae43-db0515c5dce2 admin admin] PATH_INFO: `/v3/users/5dd30243e6254adead228b333796282d` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:46.527327 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a63bcba-0944-4c89-ae43-db0515c5dce2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dd30243e6254adead228b333796282d)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:46.529317 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a63bcba-0944-4c89-ae43-db0515c5dce2 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:46.713046 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2a63bcba-0944-4c89-ae43-db0515c5dce2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dd30243e6254adead228b333796282d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:46.725690 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2a63bcba-0944-4c89-ae43-db0515c5dce2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dd30243e6254adead228b333796282d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:46.808886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2a63bcba-0944-4c89-ae43-db0515c5dce2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dd30243e6254adead228b333796282d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:46.809502 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2a63bcba-0944-4c89-ae43-db0515c5dce2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dd30243e6254adead228b333796282d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:46.816669 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-2a63bcba-0944-4c89-ae43-db0515c5dce2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dd30243e6254adead228b333796282d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:46.822728 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4192/8410] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:44:46 2022] DELETE /identity/v3/users/5dd30243e6254adead228b333796282d => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:44:47.309925 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828eb73-a46b-4ba0-af78-4850084ff409 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:47.311842 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3828eb73-a46b-4ba0-af78-4850084ff409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:44:47.328185 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828eb73-a46b-4ba0-af78-4850084ff409 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:47.384091 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3caa154-06a2-43ed-ae6f-392a06e18122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:47.384943 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3caa154-06a2-43ed-ae6f-392a06e18122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:47.385223 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3caa154-06a2-43ed-ae6f-392a06e18122 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:47.385496 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3caa154-06a2-43ed-ae6f-392a06e18122 admin admin] PATH_INFO: `/v3/projects/1aeda4303e6f4c44af29521fadb3f268` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:47.386707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3caa154-06a2-43ed-ae6f-392a06e18122 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1aeda4303e6f4c44af29521fadb3f268)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:47.388616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3caa154-06a2-43ed-ae6f-392a06e18122 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:47.557131 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f3caa154-06a2-43ed-ae6f-392a06e18122 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1aeda4303e6f4c44af29521fadb3f268', 'request_id': 'req-f3caa154-06a2-43ed-ae6f-392a06e18122'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:47.562318 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f3caa154-06a2-43ed-ae6f-392a06e18122 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1aeda4303e6f4c44af29521fadb3f268', 'request_id': 'req-f3caa154-06a2-43ed-ae6f-392a06e18122'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:47.568748 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f3caa154-06a2-43ed-ae6f-392a06e18122 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1aeda4303e6f4c44af29521fadb3f268', 'request_id': 'req-f3caa154-06a2-43ed-ae6f-392a06e18122'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:47.638363 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f3caa154-06a2-43ed-ae6f-392a06e18122 admin admin] The token cache is being invalidate because project 1aeda4303e6f4c44af29521fadb3f268 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:44:47.638662 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f3caa154-06a2-43ed-ae6f-392a06e18122 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:47.639333 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f3caa154-06a2-43ed-ae6f-392a06e18122 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:47.640879 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4219/8411] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:44:47 2022] DELETE /identity/v3/projects/1aeda4303e6f4c44af29521fadb3f268 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:44:47.647268 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71128fdd-924b-4223-9618-71eec99df806 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:47.647855 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71128fdd-924b-4223-9618-71eec99df806 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:47.647855 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71128fdd-924b-4223-9618-71eec99df806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:47.666021 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-71128fdd-924b-4223-9618-71eec99df806 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:44:47.667236 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-71128fdd-924b-4223-9618-71eec99df806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:44:47.726312 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4193/8412] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:44:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:44:47.735086 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1abe8-4340-47e1-8a11-95e6beb689c0 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:47.735381 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1abe8-4340-47e1-8a11-95e6beb689c0 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:47.735664 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1abe8-4340-47e1-8a11-95e6beb689c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:47.755080 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-b7a1abe8-4340-47e1-8a11-95e6beb689c0 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:44:47.756288 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b7a1abe8-4340-47e1-8a11-95e6beb689c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:44:47.764483 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4220/8413] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:44:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:44:47.768635 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71128fdd-924b-4223-9618-71eec99df806 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:47.778707 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71128fdd-924b-4223-9618-71eec99df806 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:47.783579 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288d064-8f94-478f-93dd-cc1951af62ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:47.784239 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288d064-8f94-478f-93dd-cc1951af62ec admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:47.784522 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288d064-8f94-478f-93dd-cc1951af62ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:47.784798 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288d064-8f94-478f-93dd-cc1951af62ec admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:47.785517 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288d064-8f94-478f-93dd-cc1951af62ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:44:47.785970 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288d064-8f94-478f-93dd-cc1951af62ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:47.787952 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288d064-8f94-478f-93dd-cc1951af62ec admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:47.802308 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4194/8414] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:44:47.806973 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1abe8-4340-47e1-8a11-95e6beb689c0 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:47.816367 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1abe8-4340-47e1-8a11-95e6beb689c0 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:47.821616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d653e6-11c9-4712-bbd2-a692602ffc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:47.822298 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d653e6-11c9-4712-bbd2-a692602ffc61 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:47.822581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d653e6-11c9-4712-bbd2-a692602ffc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:47.822890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d653e6-11c9-4712-bbd2-a692602ffc61 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:47.823581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d653e6-11c9-4712-bbd2-a692602ffc61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:47.825477 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d653e6-11c9-4712-bbd2-a692602ffc61 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:47.910420 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4221/8415] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:44:47 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:44:47.914837 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288d064-8f94-478f-93dd-cc1951af62ec admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:47.924827 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288d064-8f94-478f-93dd-cc1951af62ec admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:47.983675 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d748c-0250-4ec4-9d02-ac90d58df2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:47.984342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d748c-0250-4ec4-9d02-ac90d58df2db admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:47.984626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d748c-0250-4ec4-9d02-ac90d58df2db admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:47.984904 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d748c-0250-4ec4-9d02-ac90d58df2db admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:47.985697 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d748c-0250-4ec4-9d02-ac90d58df2db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:47.987693 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d748c-0250-4ec4-9d02-ac90d58df2db admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:48.087475 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4195/8416] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:44:47 2022] POST /identity/v3/users => generated 292 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:44:48.091679 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d653e6-11c9-4712-bbd2-a692602ffc61 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:48.102414 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d653e6-11c9-4712-bbd2-a692602ffc61 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:48.107202 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f959272-b939-430d-a0b3-b126bf005d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:48.107882 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f959272-b939-430d-a0b3-b126bf005d53 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:48.108166 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f959272-b939-430d-a0b3-b126bf005d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:48.108438 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f959272-b939-430d-a0b3-b126bf005d53 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:48.109150 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f959272-b939-430d-a0b3-b126bf005d53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:48.110780 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f959272-b939-430d-a0b3-b126bf005d53 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:48.121069 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4222/8417] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:44:48.126689 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d748c-0250-4ec4-9d02-ac90d58df2db admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:48.137540 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d748c-0250-4ec4-9d02-ac90d58df2db admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:48.142311 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd80e79-7c82-458d-91bd-9132a899cb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:48.142972 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd80e79-7c82-458d-91bd-9132a899cb04 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:48.143262 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd80e79-7c82-458d-91bd-9132a899cb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:48.143545 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd80e79-7c82-458d-91bd-9132a899cb04 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:48.144271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd80e79-7c82-458d-91bd-9132a899cb04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:48.146575 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd80e79-7c82-458d-91bd-9132a899cb04 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:48.156902 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4196/8418] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:44:48.161304 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f959272-b939-430d-a0b3-b126bf005d53 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:48.171204 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f959272-b939-430d-a0b3-b126bf005d53 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:48.175802 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880c9bd-58cb-4c9f-9a70-59c87070dd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:48.177025 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880c9bd-58cb-4c9f-9a70-59c87070dd32 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:48.177308 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880c9bd-58cb-4c9f-9a70-59c87070dd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:48.177582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880c9bd-58cb-4c9f-9a70-59c87070dd32 admin admin] PATH_INFO: `/v3/projects/edddb750b217486bbf251e48c427c04a/users/630ed17d2c8f4a3f948a48086e227479/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:48.191578 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3880c9bd-58cb-4c9f-9a70-59c87070dd32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edddb750b217486bbf251e48c427c04a, user_id=630ed17d2c8f4a3f948a48086e227479, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:48.194771 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3880c9bd-58cb-4c9f-9a70-59c87070dd32 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:48.307325 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4223/8419] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:44:48 2022] PUT /identity/v3/projects/edddb750b217486bbf251e48c427c04a/users/630ed17d2c8f4a3f948a48086e227479/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:44:48.320000 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1337d45-e4bd-445e-8b32-84d75d427ee4 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:48.320300 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1337d45-e4bd-445e-8b32-84d75d427ee4 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:48.320760 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1337d45-e4bd-445e-8b32-84d75d427ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:48.349474 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-a1337d45-e4bd-445e-8b32-84d75d427ee4 None None] MFA Rules not processed for user `630ed17d2c8f4a3f948a48086e227479`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:44:48.350671 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a1337d45-e4bd-445e-8b32-84d75d427ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:44:48.416055 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4197/8420] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:44:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:44:48.420667 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880c9bd-58cb-4c9f-9a70-59c87070dd32 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:48.480176 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880c9bd-58cb-4c9f-9a70-59c87070dd32 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:48.484776 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448c8ec-52ce-4b2e-81b3-3133ced440f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:48.485425 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448c8ec-52ce-4b2e-81b3-3133ced440f8 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:48.485708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448c8ec-52ce-4b2e-81b3-3133ced440f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:48.486014 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448c8ec-52ce-4b2e-81b3-3133ced440f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:48.486690 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a448c8ec-52ce-4b2e-81b3-3133ced440f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:48.488602 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a448c8ec-52ce-4b2e-81b3-3133ced440f8 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:48.599290 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4224/8421] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:44:48 2022] POST /identity/v3/projects => generated 385 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:44:48.603645 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1337d45-e4bd-445e-8b32-84d75d427ee4 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:48.614643 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1337d45-e4bd-445e-8b32-84d75d427ee4 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:48.670973 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986dd450-c445-4721-b52b-838cf0c7e5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:48.671701 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986dd450-c445-4721-b52b-838cf0c7e5ff admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:48.671912 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986dd450-c445-4721-b52b-838cf0c7e5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:48.672192 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986dd450-c445-4721-b52b-838cf0c7e5ff admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:48.672915 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986dd450-c445-4721-b52b-838cf0c7e5ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:48.674918 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986dd450-c445-4721-b52b-838cf0c7e5ff admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:48.812133 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4198/8422] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:44:48 2022] POST /identity/v3/users => generated 299 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:44:48.816063 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448c8ec-52ce-4b2e-81b3-3133ced440f8 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:48.827457 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448c8ec-52ce-4b2e-81b3-3133ced440f8 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:48.832198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9635bd-0785-40e4-98ec-bf69e5d55999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:48.833500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9635bd-0785-40e4-98ec-bf69e5d55999 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:48.833802 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9635bd-0785-40e4-98ec-bf69e5d55999 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:48.834081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9635bd-0785-40e4-98ec-bf69e5d55999 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:48.834797 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9635bd-0785-40e4-98ec-bf69e5d55999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:48.836387 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9635bd-0785-40e4-98ec-bf69e5d55999 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:48.847086 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4225/8423] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:44:48.851162 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986dd450-c445-4721-b52b-838cf0c7e5ff admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:48.861288 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986dd450-c445-4721-b52b-838cf0c7e5ff admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:48.865847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa1c36-7c6d-43a0-8717-a23778bb323b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:48.866716 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa1c36-7c6d-43a0-8717-a23778bb323b admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:48.867000 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa1c36-7c6d-43a0-8717-a23778bb323b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:48.867279 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa1c36-7c6d-43a0-8717-a23778bb323b admin admin] PATH_INFO: `/v3/projects/661fd24c5213465db88beb995628bc73/users/abae2f89305f4f2dbae3ea662146c687/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:48.883763 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa1c36-7c6d-43a0-8717-a23778bb323b admin admin] RBAC: Authorizing `identity:create_grant(project_id=661fd24c5213465db88beb995628bc73, user_id=abae2f89305f4f2dbae3ea662146c687, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:48.886454 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa1c36-7c6d-43a0-8717-a23778bb323b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:49.009654 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4199/8424] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:44:48 2022] PUT /identity/v3/projects/661fd24c5213465db88beb995628bc73/users/abae2f89305f4f2dbae3ea662146c687/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:44:49.013640 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9635bd-0785-40e4-98ec-bf69e5d55999 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:49.023823 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9635bd-0785-40e4-98ec-bf69e5d55999 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:49.080104 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11f8aa-dc41-43db-aa5b-8dc8b7aa4554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:49.080774 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11f8aa-dc41-43db-aa5b-8dc8b7aa4554 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:49.081054 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11f8aa-dc41-43db-aa5b-8dc8b7aa4554 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:49.081328 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11f8aa-dc41-43db-aa5b-8dc8b7aa4554 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:49.082086 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11f8aa-dc41-43db-aa5b-8dc8b7aa4554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:49.084176 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11f8aa-dc41-43db-aa5b-8dc8b7aa4554 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:49.093537 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4226/8425] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:44:49.097733 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa1c36-7c6d-43a0-8717-a23778bb323b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:49.108337 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa1c36-7c6d-43a0-8717-a23778bb323b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:49.113243 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e58e2d-4a39-4724-989b-7e96183d439d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:49.114105 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e58e2d-4a39-4724-989b-7e96183d439d admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:49.114386 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e58e2d-4a39-4724-989b-7e96183d439d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:49.114700 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e58e2d-4a39-4724-989b-7e96183d439d admin admin] PATH_INFO: `/v3/projects/661fd24c5213465db88beb995628bc73/users/abae2f89305f4f2dbae3ea662146c687/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:49.116723 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e58e2d-4a39-4724-989b-7e96183d439d admin admin] RBAC: Authorizing `identity:create_grant(project_id=661fd24c5213465db88beb995628bc73, user_id=abae2f89305f4f2dbae3ea662146c687, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:49.119505 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e58e2d-4a39-4724-989b-7e96183d439d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:49.129651 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4200/8426] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:44:49 2022] PUT /identity/v3/projects/661fd24c5213465db88beb995628bc73/users/abae2f89305f4f2dbae3ea662146c687/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:44:49.140071 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9ca29-a43a-4eeb-8e71-6453300b2d8b None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:49.140368 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9ca29-a43a-4eeb-8e71-6453300b2d8b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:49.140652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9ca29-a43a-4eeb-8e71-6453300b2d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:49.167776 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-4fc9ca29-a43a-4eeb-8e71-6453300b2d8b None None] MFA Rules not processed for user `abae2f89305f4f2dbae3ea662146c687`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:44:49.168995 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4fc9ca29-a43a-4eeb-8e71-6453300b2d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:44:49.235047 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4227/8427] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:44:49 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:44:49.246212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e58e2d-4a39-4724-989b-7e96183d439d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:49.247895 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-95e58e2d-4a39-4724-989b-7e96183d439d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:44:49.307876 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e58e2d-4a39-4724-989b-7e96183d439d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:49.311720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5482562e-63d8-47a0-bbc6-ee8ccff44e08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:49.312428 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482562e-63d8-47a0-bbc6-ee8ccff44e08 service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:49.312717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482562e-63d8-47a0-bbc6-ee8ccff44e08 service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:49.313019 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482562e-63d8-47a0-bbc6-ee8ccff44e08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:49.322829 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5482562e-63d8-47a0-bbc6-ee8ccff44e08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:49.324318 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5482562e-63d8-47a0-bbc6-ee8ccff44e08 service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:49.334910 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4201/8428] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:44:49 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:44:50.393456 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9ca29-a43a-4eeb-8e71-6453300b2d8b None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:50.454541 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9ca29-a43a-4eeb-8e71-6453300b2d8b None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:50.459124 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e2c3d2-ccab-42e4-ac76-14b0ee6d200f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:50.460014 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2c3d2-ccab-42e4-ac76-14b0ee6d200f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:50.460290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2c3d2-ccab-42e4-ac76-14b0ee6d200f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:50.460570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2c3d2-ccab-42e4-ac76-14b0ee6d200f admin admin] PATH_INFO: `/v3/users/630ed17d2c8f4a3f948a48086e227479` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:50.461798 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e2c3d2-ccab-42e4-ac76-14b0ee6d200f admin admin] RBAC: Authorizing `identity:delete_user(user_id=630ed17d2c8f4a3f948a48086e227479)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:50.463737 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e2c3d2-ccab-42e4-ac76-14b0ee6d200f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:50.721178 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-26e2c3d2-ccab-42e4-ac76-14b0ee6d200f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '630ed17d2c8f4a3f948a48086e227479'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:50.732532 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-26e2c3d2-ccab-42e4-ac76-14b0ee6d200f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '630ed17d2c8f4a3f948a48086e227479'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:50.832177 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-26e2c3d2-ccab-42e4-ac76-14b0ee6d200f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '630ed17d2c8f4a3f948a48086e227479'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:50.839528 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-26e2c3d2-ccab-42e4-ac76-14b0ee6d200f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '630ed17d2c8f4a3f948a48086e227479'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:50.840157 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-26e2c3d2-ccab-42e4-ac76-14b0ee6d200f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '630ed17d2c8f4a3f948a48086e227479'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:50.846297 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4228/8429] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:44:50 2022] DELETE /identity/v3/users/630ed17d2c8f4a3f948a48086e227479 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:44:50.850936 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e468a-6318-4b2a-9b2e-991850f38433 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:50.851412 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e468a-6318-4b2a-9b2e-991850f38433 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:50.851517 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e468a-6318-4b2a-9b2e-991850f38433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:50.869736 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-ff0e468a-6318-4b2a-9b2e-991850f38433 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:44:50.870951 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ff0e468a-6318-4b2a-9b2e-991850f38433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:44:50.929227 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4202/8430] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:44:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:44:50.939396 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e2c3d2-ccab-42e4-ac76-14b0ee6d200f admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:50.940806 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-26e2c3d2-ccab-42e4-ac76-14b0ee6d200f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:44:51.000938 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e2c3d2-ccab-42e4-ac76-14b0ee6d200f admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:51.004543 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea341df9-ef21-4926-8c7b-c7fc934e857c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:51.005182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea341df9-ef21-4926-8c7b-c7fc934e857c service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:51.005468 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea341df9-ef21-4926-8c7b-c7fc934e857c service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:51.005767 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea341df9-ef21-4926-8c7b-c7fc934e857c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:51.014824 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea341df9-ef21-4926-8c7b-c7fc934e857c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:51.016260 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea341df9-ef21-4926-8c7b-c7fc934e857c service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:51.025613 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4229/8431] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:44:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:44:51.430632 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e468a-6318-4b2a-9b2e-991850f38433 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:51.432115 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ff0e468a-6318-4b2a-9b2e-991850f38433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:44:51.445155 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e468a-6318-4b2a-9b2e-991850f38433 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:51.450027 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336aec4-52b4-4e15-99fc-c149730a0913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:51.451012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336aec4-52b4-4e15-99fc-c149730a0913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:51.451295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336aec4-52b4-4e15-99fc-c149730a0913 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:51.451579 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336aec4-52b4-4e15-99fc-c149730a0913 admin admin] PATH_INFO: `/v3/projects/edddb750b217486bbf251e48c427c04a` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:51.452778 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336aec4-52b4-4e15-99fc-c149730a0913 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edddb750b217486bbf251e48c427c04a)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:51.454780 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336aec4-52b4-4e15-99fc-c149730a0913 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:51.566518 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6336aec4-52b4-4e15-99fc-c149730a0913 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edddb750b217486bbf251e48c427c04a', 'request_id': 'req-6336aec4-52b4-4e15-99fc-c149730a0913'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:51.571985 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6336aec4-52b4-4e15-99fc-c149730a0913 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edddb750b217486bbf251e48c427c04a', 'request_id': 'req-6336aec4-52b4-4e15-99fc-c149730a0913'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:51.578153 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6336aec4-52b4-4e15-99fc-c149730a0913 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edddb750b217486bbf251e48c427c04a', 'request_id': 'req-6336aec4-52b4-4e15-99fc-c149730a0913'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:51.674448 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6336aec4-52b4-4e15-99fc-c149730a0913 admin admin] The token cache is being invalidate because project edddb750b217486bbf251e48c427c04a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:44:51.674659 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6336aec4-52b4-4e15-99fc-c149730a0913 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:51.675269 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6336aec4-52b4-4e15-99fc-c149730a0913 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:51.676820 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4203/8432] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:44:51 2022] DELETE /identity/v3/projects/edddb750b217486bbf251e48c427c04a => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:44:51.681057 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea341df9-ef21-4926-8c7b-c7fc934e857c service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:51.690872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea341df9-ef21-4926-8c7b-c7fc934e857c service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:51.746761 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f51208-ad64-472f-a58a-bb8a17d307e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:51.747611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f51208-ad64-472f-a58a-bb8a17d307e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:51.747888 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f51208-ad64-472f-a58a-bb8a17d307e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:51.748155 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f51208-ad64-472f-a58a-bb8a17d307e4 admin admin] PATH_INFO: `/v3/users/abae2f89305f4f2dbae3ea662146c687` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:51.749320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f51208-ad64-472f-a58a-bb8a17d307e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abae2f89305f4f2dbae3ea662146c687)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:51.751247 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f51208-ad64-472f-a58a-bb8a17d307e4 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:51.976640 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a9f51208-ad64-472f-a58a-bb8a17d307e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abae2f89305f4f2dbae3ea662146c687'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:51.988162 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a9f51208-ad64-472f-a58a-bb8a17d307e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abae2f89305f4f2dbae3ea662146c687'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:52.080484 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a9f51208-ad64-472f-a58a-bb8a17d307e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abae2f89305f4f2dbae3ea662146c687'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:52.087853 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a9f51208-ad64-472f-a58a-bb8a17d307e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abae2f89305f4f2dbae3ea662146c687'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:52.088504 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a9f51208-ad64-472f-a58a-bb8a17d307e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abae2f89305f4f2dbae3ea662146c687'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:52.098334 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4230/8433] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:44:51 2022] DELETE /identity/v3/users/abae2f89305f4f2dbae3ea662146c687 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:44:52.531785 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336aec4-52b4-4e15-99fc-c149730a0913 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:52.534051 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6336aec4-52b4-4e15-99fc-c149730a0913 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:44:52.549223 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336aec4-52b4-4e15-99fc-c149730a0913 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:52.607136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bacc7c7-9f8c-4285-9deb-d559d9646857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:52.607987 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacc7c7-9f8c-4285-9deb-d559d9646857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:52.608269 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacc7c7-9f8c-4285-9deb-d559d9646857 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:52.608537 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacc7c7-9f8c-4285-9deb-d559d9646857 admin admin] PATH_INFO: `/v3/projects/661fd24c5213465db88beb995628bc73` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:52.609707 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bacc7c7-9f8c-4285-9deb-d559d9646857 admin admin] RBAC: Authorizing `identity:delete_project(project_id=661fd24c5213465db88beb995628bc73)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:52.611636 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bacc7c7-9f8c-4285-9deb-d559d9646857 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:52.726808 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3bacc7c7-9f8c-4285-9deb-d559d9646857 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '661fd24c5213465db88beb995628bc73', 'request_id': 'req-3bacc7c7-9f8c-4285-9deb-d559d9646857'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:52.732310 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3bacc7c7-9f8c-4285-9deb-d559d9646857 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '661fd24c5213465db88beb995628bc73', 'request_id': 'req-3bacc7c7-9f8c-4285-9deb-d559d9646857'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:52.738487 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3bacc7c7-9f8c-4285-9deb-d559d9646857 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '661fd24c5213465db88beb995628bc73', 'request_id': 'req-3bacc7c7-9f8c-4285-9deb-d559d9646857'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:52.817330 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3bacc7c7-9f8c-4285-9deb-d559d9646857 admin admin] The token cache is being invalidate because project 661fd24c5213465db88beb995628bc73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:44:52.817568 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3bacc7c7-9f8c-4285-9deb-d559d9646857 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:52.818248 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3bacc7c7-9f8c-4285-9deb-d559d9646857 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:44:52.819868 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4204/8434] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:44:52 2022] DELETE /identity/v3/projects/661fd24c5213465db88beb995628bc73 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:44:52.825123 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189af4b5-0a39-48fa-9741-899cfc0001dd None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:52.825678 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189af4b5-0a39-48fa-9741-899cfc0001dd None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:52.825678 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189af4b5-0a39-48fa-9741-899cfc0001dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:52.843860 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-189af4b5-0a39-48fa-9741-899cfc0001dd None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:44:52.845064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-189af4b5-0a39-48fa-9741-899cfc0001dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:44:52.905579 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4231/8435] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:44:52.916032 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffc195-6dba-4aa6-87b7-b3c1d4672089 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:52.916322 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffc195-6dba-4aa6-87b7-b3c1d4672089 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:52.916620 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffc195-6dba-4aa6-87b7-b3c1d4672089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:52.937934 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-f8ffc195-6dba-4aa6-87b7-b3c1d4672089 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:44:52.939139 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f8ffc195-6dba-4aa6-87b7-b3c1d4672089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:44:52.947609 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4205/8436] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:44:52.952089 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189af4b5-0a39-48fa-9741-899cfc0001dd None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:52.962466 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189af4b5-0a39-48fa-9741-899cfc0001dd None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:52.967146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e674353c-e613-48c3-aa4f-2326e00cc64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:52.967794 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674353c-e613-48c3-aa4f-2326e00cc64b admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:52.968070 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674353c-e613-48c3-aa4f-2326e00cc64b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:52.968343 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674353c-e613-48c3-aa4f-2326e00cc64b admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:52.969055 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e674353c-e613-48c3-aa4f-2326e00cc64b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:44:52.969358 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e674353c-e613-48c3-aa4f-2326e00cc64b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:52.971048 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e674353c-e613-48c3-aa4f-2326e00cc64b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:52.982763 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4232/8437] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:44:52.987036 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ffc195-6dba-4aa6-87b7-b3c1d4672089 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:52.996309 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ffc195-6dba-4aa6-87b7-b3c1d4672089 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:53.001015 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73958f-a43b-426c-80ff-5ca1d8d00a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:53.001661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73958f-a43b-426c-80ff-5ca1d8d00a67 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:53.001978 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73958f-a43b-426c-80ff-5ca1d8d00a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:53.002260 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73958f-a43b-426c-80ff-5ca1d8d00a67 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:53.002956 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73958f-a43b-426c-80ff-5ca1d8d00a67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:53.004927 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73958f-a43b-426c-80ff-5ca1d8d00a67 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:53.137724 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4206/8438] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:44:52 2022] POST /identity/v3/projects => generated 381 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:44:53.142145 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e674353c-e613-48c3-aa4f-2326e00cc64b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:53.153304 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e674353c-e613-48c3-aa4f-2326e00cc64b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:53.216277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd22043-ea10-4504-b4bf-6ae019502534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:53.217389 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd22043-ea10-4504-b4bf-6ae019502534 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:53.218011 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd22043-ea10-4504-b4bf-6ae019502534 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:53.218296 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd22043-ea10-4504-b4bf-6ae019502534 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:53.218991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd22043-ea10-4504-b4bf-6ae019502534 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:53.221362 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd22043-ea10-4504-b4bf-6ae019502534 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:53.342388 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4233/8439] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:44:53 2022] POST /identity/v3/users => generated 291 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:44:53.346454 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73958f-a43b-426c-80ff-5ca1d8d00a67 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:53.357079 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73958f-a43b-426c-80ff-5ca1d8d00a67 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:53.362228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532eba0-ea42-4332-983f-c640c0d20f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:53.362366 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532eba0-ea42-4332-983f-c640c0d20f60 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:53.362623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532eba0-ea42-4332-983f-c640c0d20f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:53.362903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532eba0-ea42-4332-983f-c640c0d20f60 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:53.363656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532eba0-ea42-4332-983f-c640c0d20f60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:53.365271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532eba0-ea42-4332-983f-c640c0d20f60 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:53.375513 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4207/8440] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:44:53.380001 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd22043-ea10-4504-b4bf-6ae019502534 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:53.391732 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd22043-ea10-4504-b4bf-6ae019502534 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:53.396354 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4f33f-c806-472c-bfe6-5334f7c9d16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:53.397626 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4f33f-c806-472c-bfe6-5334f7c9d16a admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:53.397964 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4f33f-c806-472c-bfe6-5334f7c9d16a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:53.398242 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4f33f-c806-472c-bfe6-5334f7c9d16a admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:53.398961 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff4f33f-c806-472c-bfe6-5334f7c9d16a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:53.400558 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff4f33f-c806-472c-bfe6-5334f7c9d16a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:53.410965 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4234/8441] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:44:53.415251 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532eba0-ea42-4332-983f-c640c0d20f60 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:53.425057 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532eba0-ea42-4332-983f-c640c0d20f60 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:53.430919 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0f714-c271-4f72-bf6b-196d4c20ed6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:53.431944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0f714-c271-4f72-bf6b-196d4c20ed6b admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:53.432326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0f714-c271-4f72-bf6b-196d4c20ed6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:53.432704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0f714-c271-4f72-bf6b-196d4c20ed6b admin admin] PATH_INFO: `/v3/projects/e0cfe2796f7949e0a521d95f29f0d9a2/users/022bb44621924aa0bab1e519cf502a00/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:53.449590 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e0f714-c271-4f72-bf6b-196d4c20ed6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0cfe2796f7949e0a521d95f29f0d9a2, user_id=022bb44621924aa0bab1e519cf502a00, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:53.452402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e0f714-c271-4f72-bf6b-196d4c20ed6b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:53.518276 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4208/8442] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:44:53 2022] PUT /identity/v3/projects/e0cfe2796f7949e0a521d95f29f0d9a2/users/022bb44621924aa0bab1e519cf502a00/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:44:53.630534 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f07425-ad65-4cd7-b797-5c5743a00034 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:53.631654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f07425-ad65-4cd7-b797-5c5743a00034 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:53.631937 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f07425-ad65-4cd7-b797-5c5743a00034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:53.660943 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-c3f07425-ad65-4cd7-b797-5c5743a00034 None None] MFA Rules not processed for user `022bb44621924aa0bab1e519cf502a00`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:44:53.662235 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c3f07425-ad65-4cd7-b797-5c5743a00034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:44:53.726452 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4235/8443] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:44:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:44:53.731018 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0f714-c271-4f72-bf6b-196d4c20ed6b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:53.791669 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0f714-c271-4f72-bf6b-196d4c20ed6b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:53.796440 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16159207-d3d6-4ddc-8095-3f17e1b96f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:53.797314 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16159207-d3d6-4ddc-8095-3f17e1b96f42 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:53.797603 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16159207-d3d6-4ddc-8095-3f17e1b96f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:53.797932 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16159207-d3d6-4ddc-8095-3f17e1b96f42 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:53.798626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16159207-d3d6-4ddc-8095-3f17e1b96f42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:53.800579 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16159207-d3d6-4ddc-8095-3f17e1b96f42 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:53.905496 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4209/8444] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:44:53 2022] POST /identity/v3/projects => generated 383 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:44:53.909574 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f07425-ad65-4cd7-b797-5c5743a00034 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:53.920896 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f07425-ad65-4cd7-b797-5c5743a00034 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:53.977089 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9effac-1089-4de8-a64d-d35f0b188c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:53.977763 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9effac-1089-4de8-a64d-d35f0b188c35 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:53.978076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9effac-1089-4de8-a64d-d35f0b188c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:53.978356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9effac-1089-4de8-a64d-d35f0b188c35 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:53.979045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9effac-1089-4de8-a64d-d35f0b188c35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:53.980979 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9effac-1089-4de8-a64d-d35f0b188c35 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:54.077670 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4236/8445] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:44:53 2022] POST /identity/v3/users => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:44:54.081675 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16159207-d3d6-4ddc-8095-3f17e1b96f42 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:54.092100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16159207-d3d6-4ddc-8095-3f17e1b96f42 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:54.096875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebeef29-cf88-4380-84cd-1aaed6b8496e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:54.097528 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebeef29-cf88-4380-84cd-1aaed6b8496e admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:54.097843 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebeef29-cf88-4380-84cd-1aaed6b8496e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:54.098124 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebeef29-cf88-4380-84cd-1aaed6b8496e admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:54.098837 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebeef29-cf88-4380-84cd-1aaed6b8496e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:54.100951 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebeef29-cf88-4380-84cd-1aaed6b8496e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:54.114300 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4210/8446] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:44:54.119148 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9effac-1089-4de8-a64d-d35f0b188c35 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:54.129376 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9effac-1089-4de8-a64d-d35f0b188c35 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:54.134186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602427e-c944-4cad-899f-bfa275e3e418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:54.135011 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602427e-c944-4cad-899f-bfa275e3e418 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:54.135292 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602427e-c944-4cad-899f-bfa275e3e418 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:54.135569 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602427e-c944-4cad-899f-bfa275e3e418 admin admin] PATH_INFO: `/v3/projects/f33bf15f5e94469e913e2480ceb1409b/users/125bd20e89f4411abdc481e30e941e99/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:54.150318 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6602427e-c944-4cad-899f-bfa275e3e418 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f33bf15f5e94469e913e2480ceb1409b, user_id=125bd20e89f4411abdc481e30e941e99, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:54.153248 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6602427e-c944-4cad-899f-bfa275e3e418 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:54.224399 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4237/8447] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:44:54 2022] PUT /identity/v3/projects/f33bf15f5e94469e913e2480ceb1409b/users/125bd20e89f4411abdc481e30e941e99/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:44:54.229032 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebeef29-cf88-4380-84cd-1aaed6b8496e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:54.240868 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebeef29-cf88-4380-84cd-1aaed6b8496e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:54.299421 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a318bc0-7f4e-4939-8abb-9683364dbb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:54.300094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a318bc0-7f4e-4939-8abb-9683364dbb8a admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:54.300378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a318bc0-7f4e-4939-8abb-9683364dbb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:54.300655 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a318bc0-7f4e-4939-8abb-9683364dbb8a admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:54.301402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a318bc0-7f4e-4939-8abb-9683364dbb8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:54.303776 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a318bc0-7f4e-4939-8abb-9683364dbb8a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:54.313201 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4211/8448] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:44:54.317426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602427e-c944-4cad-899f-bfa275e3e418 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:54.328028 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602427e-c944-4cad-899f-bfa275e3e418 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:54.332900 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101db391-37bc-4646-9875-273e6b2c9e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:54.333821 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101db391-37bc-4646-9875-273e6b2c9e1f admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:54.334616 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101db391-37bc-4646-9875-273e6b2c9e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:54.334893 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101db391-37bc-4646-9875-273e6b2c9e1f admin admin] PATH_INFO: `/v3/projects/f33bf15f5e94469e913e2480ceb1409b/users/125bd20e89f4411abdc481e30e941e99/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:54.336851 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101db391-37bc-4646-9875-273e6b2c9e1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f33bf15f5e94469e913e2480ceb1409b, user_id=125bd20e89f4411abdc481e30e941e99, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:54.339542 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101db391-37bc-4646-9875-273e6b2c9e1f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:54.350400 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4238/8449] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:44:54 2022] PUT /identity/v3/projects/f33bf15f5e94469e913e2480ceb1409b/users/125bd20e89f4411abdc481e30e941e99/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:44:54.365938 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62c1c0-4173-4fee-b1bf-b57ee91a5766 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:54.366233 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62c1c0-4173-4fee-b1bf-b57ee91a5766 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:54.366516 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62c1c0-4173-4fee-b1bf-b57ee91a5766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:54.393838 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-4b62c1c0-4173-4fee-b1bf-b57ee91a5766 None None] MFA Rules not processed for user `125bd20e89f4411abdc481e30e941e99`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:44:54.394966 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4b62c1c0-4173-4fee-b1bf-b57ee91a5766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:44:54.464130 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4212/8450] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:44:54 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:44:54.476793 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101db391-37bc-4646-9875-273e6b2c9e1f admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:44:54.478664 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-101db391-37bc-4646-9875-273e6b2c9e1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:44:54.555739 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101db391-37bc-4646-9875-273e6b2c9e1f admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:44:54.560981 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde94028-629a-4a50-bd0d-d27986ded3b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:44:54.560981 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde94028-629a-4a50-bd0d-d27986ded3b7 service cinder] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:44:54.560981 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde94028-629a-4a50-bd0d-d27986ded3b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:44:54.560981 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde94028-629a-4a50-bd0d-d27986ded3b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:44:54.620268 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde94028-629a-4a50-bd0d-d27986ded3b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:44:54.621712 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde94028-629a-4a50-bd0d-d27986ded3b7 service cinder] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:44:54.630606 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4239/8451] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:44:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:45:26.791712 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b62c1c0-4173-4fee-b1bf-b57ee91a5766 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:45:26.793294 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4b62c1c0-4173-4fee-b1bf-b57ee91a5766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:45:26.806540 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b62c1c0-4173-4fee-b1bf-b57ee91a5766 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:45:26.810674 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b5cee-de5c-43ea-ae0b-b7d9192c1fc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:45:26.811314 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b5cee-de5c-43ea-ae0b-b7d9192c1fc4 service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:45:26.811597 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b5cee-de5c-43ea-ae0b-b7d9192c1fc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:45:26.811892 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b5cee-de5c-43ea-ae0b-b7d9192c1fc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:45:26.821559 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69b5cee-de5c-43ea-ae0b-b7d9192c1fc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:45:26.823051 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69b5cee-de5c-43ea-ae0b-b7d9192c1fc4 service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:45:26.833172 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4213/8452] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:45:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:46:30.333411 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de2f32-cc57-46c1-bc32-dd0f5d85e3bd None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:46:30.334069 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de2f32-cc57-46c1-bc32-dd0f5d85e3bd None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:46:30.334069 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de2f32-cc57-46c1-bc32-dd0f5d85e3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:46:30.355880 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-54de2f32-cc57-46c1-bc32-dd0f5d85e3bd None None] MFA Rules not processed for user `34a160f829dd4dc6af9f2254653dc0b8`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:46:30.355880 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-54de2f32-cc57-46c1-bc32-dd0f5d85e3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:46:30.407554 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4240/8453] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:46:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:46:30.445933 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b5cee-de5c-43ea-ae0b-b7d9192c1fc4 service cinder] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:46:30.456157 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b5cee-de5c-43ea-ae0b-b7d9192c1fc4 service cinder] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:46:30.459819 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3918510-db46-459a-9f73-59ddeb190776 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:46:30.460457 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3918510-db46-459a-9f73-59ddeb190776 service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:46:30.460737 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3918510-db46-459a-9f73-59ddeb190776 service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:46:30.461012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3918510-db46-459a-9f73-59ddeb190776 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:46:30.462899 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c3918510-db46-459a-9f73-59ddeb190776 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:46:30.538628 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3918510-db46-459a-9f73-59ddeb190776 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:46:30.540140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3918510-db46-459a-9f73-59ddeb190776 service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:46:30.563044 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4214/8454] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:46:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:46:30.972262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de2f32-cc57-46c1-bc32-dd0f5d85e3bd None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:46:30.973660 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-54de2f32-cc57-46c1-bc32-dd0f5d85e3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:46:31.032744 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de2f32-cc57-46c1-bc32-dd0f5d85e3bd None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:46:31.036380 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ad2f5-f690-41eb-be83-9402f05ec3b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:46:31.037024 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ad2f5-f690-41eb-be83-9402f05ec3b0 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:46:31.037305 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ad2f5-f690-41eb-be83-9402f05ec3b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:46:31.038210 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ad2f5-f690-41eb-be83-9402f05ec3b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:46:31.042287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a54ad2f5-f690-41eb-be83-9402f05ec3b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:46:31.051514 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54ad2f5-f690-41eb-be83-9402f05ec3b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:46:31.052940 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54ad2f5-f690-41eb-be83-9402f05ec3b0 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:46:31.063026 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4241/8455] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:46:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:46:31.867983 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3918510-db46-459a-9f73-59ddeb190776 service cinder] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:46:31.869638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c3918510-db46-459a-9f73-59ddeb190776 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:46:31.877004 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ad2f5-f690-41eb-be83-9402f05ec3b0 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:46:31.889383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ad2f5-f690-41eb-be83-9402f05ec3b0 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:46:31.893025 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f606148-e2a8-49ef-8e2a-f2aaf4800924 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:46:31.893657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f606148-e2a8-49ef-8e2a-f2aaf4800924 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:46:31.894053 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f606148-e2a8-49ef-8e2a-f2aaf4800924 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:46:31.894242 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f606148-e2a8-49ef-8e2a-f2aaf4800924 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:46:31.896003 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3f606148-e2a8-49ef-8e2a-f2aaf4800924 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:46:31.913354 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f606148-e2a8-49ef-8e2a-f2aaf4800924 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:46:31.914930 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f606148-e2a8-49ef-8e2a-f2aaf4800924 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:46:31.929411 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4242/8456] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:46:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:46:31.952573 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3918510-db46-459a-9f73-59ddeb190776 service cinder] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:46:31.957751 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723d2e6-c4fb-453d-aa77-37957c3ab22b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:46:31.958450 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723d2e6-c4fb-453d-aa77-37957c3ab22b service placement] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:46:31.958797 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723d2e6-c4fb-453d-aa77-37957c3ab22b service placement] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:46:31.959084 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723d2e6-c4fb-453d-aa77-37957c3ab22b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:46:31.961463 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4723d2e6-c4fb-453d-aa77-37957c3ab22b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:46:31.980887 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4723d2e6-c4fb-453d-aa77-37957c3ab22b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:46:31.980887 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4723d2e6-c4fb-453d-aa77-37957c3ab22b service placement] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:46:31.991114 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4215/8457] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:46:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:46:35.763397 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f606148-e2a8-49ef-8e2a-f2aaf4800924 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:46:35.764950 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3f606148-e2a8-49ef-8e2a-f2aaf4800924 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:46:35.781647 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f606148-e2a8-49ef-8e2a-f2aaf4800924 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:46:35.783539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e5a92-0258-4666-a334-c0a341e0c8c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:46:35.784295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e5a92-0258-4666-a334-c0a341e0c8c6 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:46:35.784653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e5a92-0258-4666-a334-c0a341e0c8c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:46:35.785034 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e5a92-0258-4666-a334-c0a341e0c8c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:46:35.787158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-750e5a92-0258-4666-a334-c0a341e0c8c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:46:35.800832 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e5a92-0258-4666-a334-c0a341e0c8c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:46:35.802441 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e5a92-0258-4666-a334-c0a341e0c8c6 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:46:35.814742 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4243/8458] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:46:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:46:36.666316 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723d2e6-c4fb-453d-aa77-37957c3ab22b service placement] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:46:36.671572 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4723d2e6-c4fb-453d-aa77-37957c3ab22b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:46:36.689900 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723d2e6-c4fb-453d-aa77-37957c3ab22b service placement] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:46:36.698440 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2954dc9-04f8-418f-8297-a749cf8d4429 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:46:36.699957 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2954dc9-04f8-418f-8297-a749cf8d4429 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:46:36.701053 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2954dc9-04f8-418f-8297-a749cf8d4429 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:46:36.701291 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2954dc9-04f8-418f-8297-a749cf8d4429 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:46:36.703577 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d2954dc9-04f8-418f-8297-a749cf8d4429 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:46:36.720737 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2954dc9-04f8-418f-8297-a749cf8d4429 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:46:36.722532 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2954dc9-04f8-418f-8297-a749cf8d4429 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:46:36.736976 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4216/8459] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:46:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:46:44.909968 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e5a92-0258-4666-a334-c0a341e0c8c6 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:46:44.930111 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e5a92-0258-4666-a334-c0a341e0c8c6 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:46:44.936530 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30fffdc-4446-4382-a7bf-8185a807d0e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:46:44.937186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fffdc-4446-4382-a7bf-8185a807d0e6 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:46:44.937498 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fffdc-4446-4382-a7bf-8185a807d0e6 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:46:44.937821 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fffdc-4446-4382-a7bf-8185a807d0e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:46:44.939584 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a30fffdc-4446-4382-a7bf-8185a807d0e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:46:44.955097 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30fffdc-4446-4382-a7bf-8185a807d0e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:46:44.961584 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30fffdc-4446-4382-a7bf-8185a807d0e6 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:46:44.969423 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4244/8460] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:46:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:46:48.390837 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2954dc9-04f8-418f-8297-a749cf8d4429 service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:46:48.403628 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2954dc9-04f8-418f-8297-a749cf8d4429 service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:46:48.407194 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb8cb8-b292-4af5-b036-2a9ea9f03b3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:46:48.415461 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb8cb8-b292-4af5-b036-2a9ea9f03b3f service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:46:48.415461 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb8cb8-b292-4af5-b036-2a9ea9f03b3f service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:46:48.415461 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb8cb8-b292-4af5-b036-2a9ea9f03b3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:46:48.415461 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-58eb8cb8-b292-4af5-b036-2a9ea9f03b3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:46:48.471714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb8cb8-b292-4af5-b036-2a9ea9f03b3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:46:48.473165 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb8cb8-b292-4af5-b036-2a9ea9f03b3f service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:46:48.482895 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4217/8461] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:46:48 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:46:49.057677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a03948-f541-41ea-aa45-e085327e592f None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:46:49.058259 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a03948-f541-41ea-aa45-e085327e592f None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:46:49.058389 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a03948-f541-41ea-aa45-e085327e592f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:46:49.076007 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-b7a03948-f541-41ea-aa45-e085327e592f None None] MFA Rules not processed for user `0ed9fb1a529f4247acd72a6de21ceb4c`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:46:49.077217 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b7a03948-f541-41ea-aa45-e085327e592f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:46:49.134768 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4245/8462] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:46:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Apr 30 21:46:49.372844 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb8cb8-b292-4af5-b036-2a9ea9f03b3f service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:46:49.383725 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb8cb8-b292-4af5-b036-2a9ea9f03b3f service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:46:49.387465 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd239c-654d-4170-bfeb-bfd467a089ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:46:49.388136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd239c-654d-4170-bfeb-bfd467a089ad service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:46:49.388451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd239c-654d-4170-bfeb-bfd467a089ad service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:46:49.388854 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd239c-654d-4170-bfeb-bfd467a089ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:46:49.390661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-11fd239c-654d-4170-bfeb-bfd467a089ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:46:49.403091 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd239c-654d-4170-bfeb-bfd467a089ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:46:49.405209 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd239c-654d-4170-bfeb-bfd467a089ad service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:46:49.416056 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4218/8463] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:46:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:46:52.491372 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a03948-f541-41ea-aa45-e085327e592f None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:46:52.511357 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a03948-f541-41ea-aa45-e085327e592f None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:46:52.518049 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db1d81-d4fb-49a8-892c-342efdbd8fbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:46:52.518704 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db1d81-d4fb-49a8-892c-342efdbd8fbd service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:46:52.518985 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db1d81-d4fb-49a8-892c-342efdbd8fbd service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:46:52.519261 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db1d81-d4fb-49a8-892c-342efdbd8fbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:46:52.521104 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f8db1d81-d4fb-49a8-892c-342efdbd8fbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:46:52.539071 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db1d81-d4fb-49a8-892c-342efdbd8fbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:46:52.539071 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db1d81-d4fb-49a8-892c-342efdbd8fbd service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:46:52.553659 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4246/8464] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:46:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:46:53.392141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd239c-654d-4170-bfeb-bfd467a089ad service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:46:53.404716 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd239c-654d-4170-bfeb-bfd467a089ad service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:46:53.408441 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54e2cb-b02c-4390-b138-1a7361265e50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:46:53.409086 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54e2cb-b02c-4390-b138-1a7361265e50 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:46:53.409367 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54e2cb-b02c-4390-b138-1a7361265e50 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:46:53.409645 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54e2cb-b02c-4390-b138-1a7361265e50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:46:53.411442 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-fc54e2cb-b02c-4390-b138-1a7361265e50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:46:53.423538 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc54e2cb-b02c-4390-b138-1a7361265e50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:46:53.424982 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc54e2cb-b02c-4390-b138-1a7361265e50 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:46:53.435478 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4219/8465] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:46:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:47:05.720810 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db1d81-d4fb-49a8-892c-342efdbd8fbd service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:47:05.782716 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db1d81-d4fb-49a8-892c-342efdbd8fbd service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:47:05.787220 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c41f99-bbcb-48dc-808c-835dfa7f28bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:47:05.788069 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c41f99-bbcb-48dc-808c-835dfa7f28bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:47:05.788351 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c41f99-bbcb-48dc-808c-835dfa7f28bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:47:05.788626 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c41f99-bbcb-48dc-808c-835dfa7f28bd admin admin] PATH_INFO: `/v3/users/022bb44621924aa0bab1e519cf502a00` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:47:05.789826 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c41f99-bbcb-48dc-808c-835dfa7f28bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=022bb44621924aa0bab1e519cf502a00)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:47:05.791765 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c41f99-bbcb-48dc-808c-835dfa7f28bd admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:47:06.007893 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-38c41f99-bbcb-48dc-808c-835dfa7f28bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '022bb44621924aa0bab1e519cf502a00'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:47:06.019699 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-38c41f99-bbcb-48dc-808c-835dfa7f28bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '022bb44621924aa0bab1e519cf502a00'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:47:06.118783 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-38c41f99-bbcb-48dc-808c-835dfa7f28bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '022bb44621924aa0bab1e519cf502a00'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:47:06.126327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-38c41f99-bbcb-48dc-808c-835dfa7f28bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '022bb44621924aa0bab1e519cf502a00'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:47:06.126986 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-38c41f99-bbcb-48dc-808c-835dfa7f28bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '022bb44621924aa0bab1e519cf502a00'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:47:06.133243 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4247/8466] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:47:05 2022] DELETE /identity/v3/users/022bb44621924aa0bab1e519cf502a00 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:47:06.137994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75c134-89a8-432a-8dbd-91682b60677e None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:47:06.138440 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75c134-89a8-432a-8dbd-91682b60677e None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:47:06.138575 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75c134-89a8-432a-8dbd-91682b60677e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:47:06.156692 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-4e75c134-89a8-432a-8dbd-91682b60677e None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:47:06.158497 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4e75c134-89a8-432a-8dbd-91682b60677e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:47:06.215802 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4220/8467] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:47:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:47:06.226078 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c41f99-bbcb-48dc-808c-835dfa7f28bd admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:47:06.227490 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-38c41f99-bbcb-48dc-808c-835dfa7f28bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:47:06.287212 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c41f99-bbcb-48dc-808c-835dfa7f28bd admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:47:06.290822 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6534a-8177-4c4c-bb84-ac1989f784b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:47:06.291460 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6534a-8177-4c4c-bb84-ac1989f784b7 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:47:06.291744 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6534a-8177-4c4c-bb84-ac1989f784b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:47:06.292015 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6534a-8177-4c4c-bb84-ac1989f784b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:47:06.301343 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f6534a-8177-4c4c-bb84-ac1989f784b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:47:06.302847 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f6534a-8177-4c4c-bb84-ac1989f784b7 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:47:06.312391 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4248/8468] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:47:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:47:06.807493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75c134-89a8-432a-8dbd-91682b60677e None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:47:06.811984 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4e75c134-89a8-432a-8dbd-91682b60677e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:47:06.821402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75c134-89a8-432a-8dbd-91682b60677e None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:47:06.826173 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82098206-0d46-4f87-b534-f82b56f950e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:47:06.827084 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82098206-0d46-4f87-b534-f82b56f950e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:47:06.827344 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82098206-0d46-4f87-b534-f82b56f950e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:47:06.827674 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82098206-0d46-4f87-b534-f82b56f950e3 admin admin] PATH_INFO: `/v3/projects/e0cfe2796f7949e0a521d95f29f0d9a2` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:47:06.828790 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82098206-0d46-4f87-b534-f82b56f950e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0cfe2796f7949e0a521d95f29f0d9a2)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:47:06.830760 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82098206-0d46-4f87-b534-f82b56f950e3 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:47:06.966097 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-82098206-0d46-4f87-b534-f82b56f950e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0cfe2796f7949e0a521d95f29f0d9a2', 'request_id': 'req-82098206-0d46-4f87-b534-f82b56f950e3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:47:06.971488 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-82098206-0d46-4f87-b534-f82b56f950e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0cfe2796f7949e0a521d95f29f0d9a2', 'request_id': 'req-82098206-0d46-4f87-b534-f82b56f950e3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:47:06.977645 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-82098206-0d46-4f87-b534-f82b56f950e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0cfe2796f7949e0a521d95f29f0d9a2', 'request_id': 'req-82098206-0d46-4f87-b534-f82b56f950e3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:47:07.079485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-82098206-0d46-4f87-b534-f82b56f950e3 admin admin] The token cache is being invalidate because project e0cfe2796f7949e0a521d95f29f0d9a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:47:07.079707 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-82098206-0d46-4f87-b534-f82b56f950e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:47:07.080336 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-82098206-0d46-4f87-b534-f82b56f950e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:47:07.081946 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4221/8469] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:47:06 2022] DELETE /identity/v3/projects/e0cfe2796f7949e0a521d95f29f0d9a2 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:47:07.086125 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6534a-8177-4c4c-bb84-ac1989f784b7 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:47:07.096121 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6534a-8177-4c4c-bb84-ac1989f784b7 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:47:07.152536 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eabe009-2181-41c9-8d12-82c71ccf4619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:47:07.153399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabe009-2181-41c9-8d12-82c71ccf4619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:47:07.153686 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabe009-2181-41c9-8d12-82c71ccf4619 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:47:07.154000 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabe009-2181-41c9-8d12-82c71ccf4619 admin admin] PATH_INFO: `/v3/users/125bd20e89f4411abdc481e30e941e99` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:47:07.155194 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eabe009-2181-41c9-8d12-82c71ccf4619 admin admin] RBAC: Authorizing `identity:delete_user(user_id=125bd20e89f4411abdc481e30e941e99)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:47:07.157124 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eabe009-2181-41c9-8d12-82c71ccf4619 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:47:07.421614 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6eabe009-2181-41c9-8d12-82c71ccf4619 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '125bd20e89f4411abdc481e30e941e99'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:47:07.433661 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6eabe009-2181-41c9-8d12-82c71ccf4619 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '125bd20e89f4411abdc481e30e941e99'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:47:07.531986 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6eabe009-2181-41c9-8d12-82c71ccf4619 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '125bd20e89f4411abdc481e30e941e99'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:47:07.540398 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6eabe009-2181-41c9-8d12-82c71ccf4619 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '125bd20e89f4411abdc481e30e941e99'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:47:07.541136 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6eabe009-2181-41c9-8d12-82c71ccf4619 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '125bd20e89f4411abdc481e30e941e99'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:47:07.547542 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4249/8470] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:47:07 2022] DELETE /identity/v3/users/125bd20e89f4411abdc481e30e941e99 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:47:07.933814 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82098206-0d46-4f87-b534-f82b56f950e3 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:47:07.935385 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-82098206-0d46-4f87-b534-f82b56f950e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:47:07.958315 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82098206-0d46-4f87-b534-f82b56f950e3 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:47:08.032389 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee318b-0269-494c-8119-d183b44a748f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:47:08.033341 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee318b-0269-494c-8119-d183b44a748f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:47:08.033622 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee318b-0269-494c-8119-d183b44a748f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:47:08.033940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee318b-0269-494c-8119-d183b44a748f admin admin] PATH_INFO: `/v3/projects/f33bf15f5e94469e913e2480ceb1409b` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:47:08.035118 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee318b-0269-494c-8119-d183b44a748f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f33bf15f5e94469e913e2480ceb1409b)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:47:08.037018 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee318b-0269-494c-8119-d183b44a748f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:47:08.163258 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-92ee318b-0269-494c-8119-d183b44a748f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f33bf15f5e94469e913e2480ceb1409b', 'request_id': 'req-92ee318b-0269-494c-8119-d183b44a748f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:47:08.168949 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-92ee318b-0269-494c-8119-d183b44a748f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f33bf15f5e94469e913e2480ceb1409b', 'request_id': 'req-92ee318b-0269-494c-8119-d183b44a748f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:47:08.175404 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-92ee318b-0269-494c-8119-d183b44a748f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f33bf15f5e94469e913e2480ceb1409b', 'request_id': 'req-92ee318b-0269-494c-8119-d183b44a748f'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:47:08.269606 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-92ee318b-0269-494c-8119-d183b44a748f admin admin] The token cache is being invalidate because project f33bf15f5e94469e913e2480ceb1409b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:47:08.269941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-92ee318b-0269-494c-8119-d183b44a748f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:47:08.270674 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-92ee318b-0269-494c-8119-d183b44a748f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:47:08.272767 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4222/8471] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:47:07 2022] DELETE /identity/v3/projects/f33bf15f5e94469e913e2480ceb1409b => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:47:08.277587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fb98f-b776-4b06-8d36-0000da652995 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:47:08.278111 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fb98f-b776-4b06-8d36-0000da652995 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:47:08.278201 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fb98f-b776-4b06-8d36-0000da652995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:47:08.295386 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-0a2fb98f-b776-4b06-8d36-0000da652995 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:47:08.296628 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0a2fb98f-b776-4b06-8d36-0000da652995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:47:08.354834 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4250/8472] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:47:08.363293 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1a870-d767-4d17-9554-aeb183c77fad None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:47:08.367436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1a870-d767-4d17-9554-aeb183c77fad None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:47:08.367436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1a870-d767-4d17-9554-aeb183c77fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:47:08.383229 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-ddd1a870-d767-4d17-9554-aeb183c77fad None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:47:08.384447 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ddd1a870-d767-4d17-9554-aeb183c77fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:47:08.392533 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4223/8473] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:47:08.396926 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2fb98f-b776-4b06-8d36-0000da652995 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:47:08.407221 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2fb98f-b776-4b06-8d36-0000da652995 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:47:08.411884 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec560a-45e1-4a20-bd53-c3abbddfec7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:47:08.412534 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec560a-45e1-4a20-bd53-c3abbddfec7b admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:47:08.412818 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec560a-45e1-4a20-bd53-c3abbddfec7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:47:08.413097 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec560a-45e1-4a20-bd53-c3abbddfec7b admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:47:08.413851 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec560a-45e1-4a20-bd53-c3abbddfec7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:47:08.414163 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec560a-45e1-4a20-bd53-c3abbddfec7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:47:08.415766 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec560a-45e1-4a20-bd53-c3abbddfec7b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:47:08.427874 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4251/8474] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:47:08.432394 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1a870-d767-4d17-9554-aeb183c77fad None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:47:08.442637 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1a870-d767-4d17-9554-aeb183c77fad None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:47:08.447574 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40d871-67a2-40d0-9958-b32cc5b9c321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:47:08.448203 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40d871-67a2-40d0-9958-b32cc5b9c321 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:47:08.448516 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40d871-67a2-40d0-9958-b32cc5b9c321 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:47:08.448847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40d871-67a2-40d0-9958-b32cc5b9c321 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:47:08.449626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f40d871-67a2-40d0-9958-b32cc5b9c321 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:47:08.451618 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f40d871-67a2-40d0-9958-b32cc5b9c321 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:47:08.613916 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4224/8475] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:47:08 2022] POST /identity/v3/projects => generated 375 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 21:47:08.618431 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec560a-45e1-4a20-bd53-c3abbddfec7b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:47:08.628984 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec560a-45e1-4a20-bd53-c3abbddfec7b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:47:08.687198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ecc4a1-6805-4a75-a846-b71c296924c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:47:08.687869 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecc4a1-6805-4a75-a846-b71c296924c7 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:47:08.688149 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecc4a1-6805-4a75-a846-b71c296924c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:47:08.688423 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecc4a1-6805-4a75-a846-b71c296924c7 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:47:08.689173 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ecc4a1-6805-4a75-a846-b71c296924c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:47:08.691297 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ecc4a1-6805-4a75-a846-b71c296924c7 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:47:08.790040 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4252/8476] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:47:08 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:47:08.794442 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40d871-67a2-40d0-9958-b32cc5b9c321 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:47:08.809631 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40d871-67a2-40d0-9958-b32cc5b9c321 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:47:08.810779 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5698c-cb78-4f91-8554-f4fe2e21eb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:47:08.811447 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5698c-cb78-4f91-8554-f4fe2e21eb0e admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:47:08.811779 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5698c-cb78-4f91-8554-f4fe2e21eb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:47:08.812062 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5698c-cb78-4f91-8554-f4fe2e21eb0e admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:47:08.812825 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f5698c-cb78-4f91-8554-f4fe2e21eb0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:47:08.814483 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f5698c-cb78-4f91-8554-f4fe2e21eb0e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:47:08.824685 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4225/8477] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:47:08.828798 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ecc4a1-6805-4a75-a846-b71c296924c7 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:47:08.838794 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ecc4a1-6805-4a75-a846-b71c296924c7 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:47:08.843501 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703552f-c721-4202-8ea8-ac033dceaf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:47:08.844155 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703552f-c721-4202-8ea8-ac033dceaf85 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:47:08.844441 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703552f-c721-4202-8ea8-ac033dceaf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:47:08.844722 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703552f-c721-4202-8ea8-ac033dceaf85 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:47:08.846006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a703552f-c721-4202-8ea8-ac033dceaf85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:47:08.847607 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a703552f-c721-4202-8ea8-ac033dceaf85 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:47:08.857456 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4253/8478] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:47:08.862362 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5698c-cb78-4f91-8554-f4fe2e21eb0e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:47:08.874180 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5698c-cb78-4f91-8554-f4fe2e21eb0e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:47:08.877902 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e751195-9365-4f85-8721-a60df5449e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:47:08.878828 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e751195-9365-4f85-8721-a60df5449e5e admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:47:08.879150 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e751195-9365-4f85-8721-a60df5449e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:47:08.879431 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e751195-9365-4f85-8721-a60df5449e5e admin admin] PATH_INFO: `/v3/projects/6b4f79742058492f8104e7a2b11f0e39/users/98aa9a3301214f75afea712de78a06fc/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:47:08.896445 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e751195-9365-4f85-8721-a60df5449e5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b4f79742058492f8104e7a2b11f0e39, user_id=98aa9a3301214f75afea712de78a06fc, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:47:08.901538 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e751195-9365-4f85-8721-a60df5449e5e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:47:08.983676 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4226/8479] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:47:08 2022] PUT /identity/v3/projects/6b4f79742058492f8104e7a2b11f0e39/users/98aa9a3301214f75afea712de78a06fc/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:47:08.995508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1eb992-4a89-44f7-bbd9-c647d44fae1c None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:47:08.995901 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1eb992-4a89-44f7-bbd9-c647d44fae1c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:47:08.996078 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1eb992-4a89-44f7-bbd9-c647d44fae1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:47:09.026650 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-fe1eb992-4a89-44f7-bbd9-c647d44fae1c None None] MFA Rules not processed for user `98aa9a3301214f75afea712de78a06fc`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:47:09.028082 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-fe1eb992-4a89-44f7-bbd9-c647d44fae1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:47:09.094456 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4254/8480] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:47:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:47:09.106328 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e751195-9365-4f85-8721-a60df5449e5e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:47:09.108129 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0e751195-9365-4f85-8721-a60df5449e5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:47:09.168970 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e751195-9365-4f85-8721-a60df5449e5e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:47:09.172705 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab6e69-8401-4494-a0d0-9d2d57a62674 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:47:09.174569 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab6e69-8401-4494-a0d0-9d2d57a62674 service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:47:09.174569 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab6e69-8401-4494-a0d0-9d2d57a62674 service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:47:09.174569 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab6e69-8401-4494-a0d0-9d2d57a62674 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:47:09.182989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab6e69-8401-4494-a0d0-9d2d57a62674 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:47:09.184459 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab6e69-8401-4494-a0d0-9d2d57a62674 service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:47:09.194247 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4227/8481] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:47:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:47:37.346097 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1eb992-4a89-44f7-bbd9-c647d44fae1c None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:47:37.409230 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1eb992-4a89-44f7-bbd9-c647d44fae1c None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:47:37.414253 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277670d6-aeb3-402f-b729-3e146acf8183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:47:37.415107 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277670d6-aeb3-402f-b729-3e146acf8183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:47:37.415384 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277670d6-aeb3-402f-b729-3e146acf8183 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:47:37.415656 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277670d6-aeb3-402f-b729-3e146acf8183 admin admin] PATH_INFO: `/v3/users/98aa9a3301214f75afea712de78a06fc` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:47:37.416815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277670d6-aeb3-402f-b729-3e146acf8183 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98aa9a3301214f75afea712de78a06fc)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:47:37.418766 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277670d6-aeb3-402f-b729-3e146acf8183 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:47:37.628933 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-277670d6-aeb3-402f-b729-3e146acf8183 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98aa9a3301214f75afea712de78a06fc'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:47:37.640486 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-277670d6-aeb3-402f-b729-3e146acf8183 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98aa9a3301214f75afea712de78a06fc'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:47:37.708618 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-277670d6-aeb3-402f-b729-3e146acf8183 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98aa9a3301214f75afea712de78a06fc'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:47:37.716342 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-277670d6-aeb3-402f-b729-3e146acf8183 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98aa9a3301214f75afea712de78a06fc'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:47:37.716976 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-277670d6-aeb3-402f-b729-3e146acf8183 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98aa9a3301214f75afea712de78a06fc'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:47:37.722927 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4255/8482] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:47:37 2022] DELETE /identity/v3/users/98aa9a3301214f75afea712de78a06fc => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:47:37.728108 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25fab0-c589-4302-93c3-d0e2243f1119 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:47:37.736236 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25fab0-c589-4302-93c3-d0e2243f1119 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:47:37.736236 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25fab0-c589-4302-93c3-d0e2243f1119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:47:37.748004 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-3e25fab0-c589-4302-93c3-d0e2243f1119 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:47:37.749187 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3e25fab0-c589-4302-93c3-d0e2243f1119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:47:37.808879 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4228/8483] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:47:37.819202 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277670d6-aeb3-402f-b729-3e146acf8183 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:47:37.823080 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-277670d6-aeb3-402f-b729-3e146acf8183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:47:37.879173 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277670d6-aeb3-402f-b729-3e146acf8183 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:47:37.883430 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4503f0-1a15-4fd8-bd6b-3660322cb81f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:47:37.886287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4503f0-1a15-4fd8-bd6b-3660322cb81f service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:47:37.886287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4503f0-1a15-4fd8-bd6b-3660322cb81f service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:47:37.886287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4503f0-1a15-4fd8-bd6b-3660322cb81f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:47:37.894338 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4503f0-1a15-4fd8-bd6b-3660322cb81f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:47:37.895844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4503f0-1a15-4fd8-bd6b-3660322cb81f service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:47:37.906812 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4256/8484] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:47:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:47:38.339354 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25fab0-c589-4302-93c3-d0e2243f1119 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:47:38.340892 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3e25fab0-c589-4302-93c3-d0e2243f1119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:47:38.353648 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25fab0-c589-4302-93c3-d0e2243f1119 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:47:38.358581 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87dbc99-5541-40ca-a070-0df484b6e969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:47:38.359101 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87dbc99-5541-40ca-a070-0df484b6e969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:47:38.359378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87dbc99-5541-40ca-a070-0df484b6e969 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:47:38.361078 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87dbc99-5541-40ca-a070-0df484b6e969 admin admin] PATH_INFO: `/v3/projects/6b4f79742058492f8104e7a2b11f0e39` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:47:38.362321 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87dbc99-5541-40ca-a070-0df484b6e969 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b4f79742058492f8104e7a2b11f0e39)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:47:38.364232 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87dbc99-5541-40ca-a070-0df484b6e969 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:47:38.476026 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e87dbc99-5541-40ca-a070-0df484b6e969 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b4f79742058492f8104e7a2b11f0e39', 'request_id': 'req-e87dbc99-5541-40ca-a070-0df484b6e969'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:47:38.481778 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e87dbc99-5541-40ca-a070-0df484b6e969 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b4f79742058492f8104e7a2b11f0e39', 'request_id': 'req-e87dbc99-5541-40ca-a070-0df484b6e969'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:47:38.488253 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e87dbc99-5541-40ca-a070-0df484b6e969 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b4f79742058492f8104e7a2b11f0e39', 'request_id': 'req-e87dbc99-5541-40ca-a070-0df484b6e969'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:47:38.553404 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e87dbc99-5541-40ca-a070-0df484b6e969 admin admin] The token cache is being invalidate because project 6b4f79742058492f8104e7a2b11f0e39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:47:38.553725 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e87dbc99-5541-40ca-a070-0df484b6e969 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:47:38.554362 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-e87dbc99-5541-40ca-a070-0df484b6e969 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:47:38.555956 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4229/8485] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:47:38 2022] DELETE /identity/v3/projects/6b4f79742058492f8104e7a2b11f0e39 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:47:38.561996 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ba9a2-ad48-4b9e-a8af-f10babfd5227 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:47:38.562466 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ba9a2-ad48-4b9e-a8af-f10babfd5227 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:47:38.562570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ba9a2-ad48-4b9e-a8af-f10babfd5227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:47:38.579942 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-c30ba9a2-ad48-4b9e-a8af-f10babfd5227 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:47:38.581128 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c30ba9a2-ad48-4b9e-a8af-f10babfd5227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:47:38.638478 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4257/8486] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:47:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:47:38.646550 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf9154-d5eb-4780-9b32-35cd7a21f911 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:47:38.647419 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf9154-d5eb-4780-9b32-35cd7a21f911 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:47:38.647708 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf9154-d5eb-4780-9b32-35cd7a21f911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:47:38.666298 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-9abf9154-d5eb-4780-9b32-35cd7a21f911 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:47:38.667523 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-9abf9154-d5eb-4780-9b32-35cd7a21f911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:47:38.675480 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4230/8487] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:47:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:47:38.679727 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ba9a2-ad48-4b9e-a8af-f10babfd5227 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:47:38.689787 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ba9a2-ad48-4b9e-a8af-f10babfd5227 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:47:38.694897 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0ff33-ecdc-4664-8d8e-18642d295093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:47:38.698648 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0ff33-ecdc-4664-8d8e-18642d295093 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:47:38.698648 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0ff33-ecdc-4664-8d8e-18642d295093 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:47:38.698648 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0ff33-ecdc-4664-8d8e-18642d295093 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:47:38.698648 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0ff33-ecdc-4664-8d8e-18642d295093 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:47:38.698648 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0ff33-ecdc-4664-8d8e-18642d295093 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:47:38.699097 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0ff33-ecdc-4664-8d8e-18642d295093 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:47:38.711584 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4258/8488] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:47:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 21:47:38.718834 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf9154-d5eb-4780-9b32-35cd7a21f911 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:47:38.728379 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf9154-d5eb-4780-9b32-35cd7a21f911 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:47:38.733080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66aa59-a5cb-4ec3-86b8-cbbc4e702316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:47:38.733728 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66aa59-a5cb-4ec3-86b8-cbbc4e702316 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:47:38.734042 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66aa59-a5cb-4ec3-86b8-cbbc4e702316 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:47:38.734316 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66aa59-a5cb-4ec3-86b8-cbbc4e702316 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:47:38.735004 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66aa59-a5cb-4ec3-86b8-cbbc4e702316 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:47:38.736944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66aa59-a5cb-4ec3-86b8-cbbc4e702316 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:47:38.819576 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4231/8489] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:47:38 2022] POST /identity/v3/projects => generated 369 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:47:38.823740 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0ff33-ecdc-4664-8d8e-18642d295093 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:47:38.833962 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0ff33-ecdc-4664-8d8e-18642d295093 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:47:38.888856 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a873d626-c4cb-4d85-9e02-acb2675eecd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:47:38.889436 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873d626-c4cb-4d85-9e02-acb2675eecd6 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:47:38.889727 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873d626-c4cb-4d85-9e02-acb2675eecd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:47:38.890041 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873d626-c4cb-4d85-9e02-acb2675eecd6 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:47:38.890724 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a873d626-c4cb-4d85-9e02-acb2675eecd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:47:38.892661 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a873d626-c4cb-4d85-9e02-acb2675eecd6 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:47:38.993340 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4259/8490] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:47:38 2022] POST /identity/v3/users => generated 285 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:47:38.997401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66aa59-a5cb-4ec3-86b8-cbbc4e702316 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:47:39.008254 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66aa59-a5cb-4ec3-86b8-cbbc4e702316 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:47:39.015413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad85c84-9684-4c34-8e21-a5bb36e87e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:47:39.015413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad85c84-9684-4c34-8e21-a5bb36e87e2b admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:47:39.015413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad85c84-9684-4c34-8e21-a5bb36e87e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:47:39.015413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad85c84-9684-4c34-8e21-a5bb36e87e2b admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:47:39.015811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad85c84-9684-4c34-8e21-a5bb36e87e2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:47:39.016770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad85c84-9684-4c34-8e21-a5bb36e87e2b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:47:39.027919 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4232/8491] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:47:39.031982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a873d626-c4cb-4d85-9e02-acb2675eecd6 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:47:39.042309 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a873d626-c4cb-4d85-9e02-acb2675eecd6 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:47:39.046958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067328a6-1e80-4558-9735-3a9f71231d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:47:39.047615 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067328a6-1e80-4558-9735-3a9f71231d5b admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:47:39.047899 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067328a6-1e80-4558-9735-3a9f71231d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:47:39.048177 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067328a6-1e80-4558-9735-3a9f71231d5b admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:47:39.048927 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067328a6-1e80-4558-9735-3a9f71231d5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:47:39.050585 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067328a6-1e80-4558-9735-3a9f71231d5b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:47:39.060990 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4260/8492] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:47:39.067141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad85c84-9684-4c34-8e21-a5bb36e87e2b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:47:39.075800 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad85c84-9684-4c34-8e21-a5bb36e87e2b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:47:39.080451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b96330-ca8f-4e89-b601-8093db0f8e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:47:39.081320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b96330-ca8f-4e89-b601-8093db0f8e94 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:47:39.081606 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b96330-ca8f-4e89-b601-8093db0f8e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:47:39.081987 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b96330-ca8f-4e89-b601-8093db0f8e94 admin admin] PATH_INFO: `/v3/projects/cf9af556d4c3479a89d448e8bc633a3e/users/2df099ec39004e72a4e49a6eb1694aee/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:47:39.096454 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b96330-ca8f-4e89-b601-8093db0f8e94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf9af556d4c3479a89d448e8bc633a3e, user_id=2df099ec39004e72a4e49a6eb1694aee, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:47:39.099324 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b96330-ca8f-4e89-b601-8093db0f8e94 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:47:39.165816 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4233/8493] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:47:39 2022] PUT /identity/v3/projects/cf9af556d4c3479a89d448e8bc633a3e/users/2df099ec39004e72a4e49a6eb1694aee/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:47:39.176255 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e10c08-06b7-4a1c-956f-fbcd7084868b None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:47:39.176544 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e10c08-06b7-4a1c-956f-fbcd7084868b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:47:39.176822 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e10c08-06b7-4a1c-956f-fbcd7084868b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:47:39.203278 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-81e10c08-06b7-4a1c-956f-fbcd7084868b None None] MFA Rules not processed for user `2df099ec39004e72a4e49a6eb1694aee`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:47:39.204468 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-81e10c08-06b7-4a1c-956f-fbcd7084868b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:47:39.266451 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4261/8494] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:47:39 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:47:39.271311 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b96330-ca8f-4e89-b601-8093db0f8e94 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:47:39.333596 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b96330-ca8f-4e89-b601-8093db0f8e94 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:47:39.338352 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153d121-138a-4357-9824-1f5196277a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:47:39.338974 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153d121-138a-4357-9824-1f5196277a7c admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:47:39.339257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153d121-138a-4357-9824-1f5196277a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:47:39.339589 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153d121-138a-4357-9824-1f5196277a7c admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:47:39.340269 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153d121-138a-4357-9824-1f5196277a7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:47:39.342221 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153d121-138a-4357-9824-1f5196277a7c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:47:39.452806 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4234/8495] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:47:39 2022] POST /identity/v3/projects => generated 375 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:47:39.456791 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e10c08-06b7-4a1c-956f-fbcd7084868b None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:47:39.467802 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e10c08-06b7-4a1c-956f-fbcd7084868b None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:47:39.521330 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79aecd-f11d-4006-9de1-325c3f8a7047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:47:39.522021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79aecd-f11d-4006-9de1-325c3f8a7047 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:47:39.522303 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79aecd-f11d-4006-9de1-325c3f8a7047 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:47:39.522579 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79aecd-f11d-4006-9de1-325c3f8a7047 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:47:39.523257 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc79aecd-f11d-4006-9de1-325c3f8a7047 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:47:39.525174 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc79aecd-f11d-4006-9de1-325c3f8a7047 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:47:39.611490 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4262/8496] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:47:39 2022] POST /identity/v3/users => generated 294 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:47:39.615428 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153d121-138a-4357-9824-1f5196277a7c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:47:39.626847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153d121-138a-4357-9824-1f5196277a7c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:47:39.631571 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d49f3-0a57-492b-8351-592719cf51f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:47:39.632318 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d49f3-0a57-492b-8351-592719cf51f2 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:47:39.632507 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d49f3-0a57-492b-8351-592719cf51f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:47:39.632784 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d49f3-0a57-492b-8351-592719cf51f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:47:39.633525 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d49f3-0a57-492b-8351-592719cf51f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:47:39.635174 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d49f3-0a57-492b-8351-592719cf51f2 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:47:39.645683 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4235/8497] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:47:39.650287 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79aecd-f11d-4006-9de1-325c3f8a7047 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:47:39.660525 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79aecd-f11d-4006-9de1-325c3f8a7047 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:47:39.665850 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76375366-1199-4617-9619-4ddd3c2b1859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:47:39.666733 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76375366-1199-4617-9619-4ddd3c2b1859 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:47:39.667017 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76375366-1199-4617-9619-4ddd3c2b1859 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:47:39.667294 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76375366-1199-4617-9619-4ddd3c2b1859 admin admin] PATH_INFO: `/v3/projects/d55b5ba538c44f6cbff879308a2a2adb/users/f4a3611d5aeb408a948f806ae9f885a2/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:47:39.681683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76375366-1199-4617-9619-4ddd3c2b1859 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d55b5ba538c44f6cbff879308a2a2adb, user_id=f4a3611d5aeb408a948f806ae9f885a2, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:47:39.684417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76375366-1199-4617-9619-4ddd3c2b1859 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:47:39.783629 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4263/8498] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:47:39 2022] PUT /identity/v3/projects/d55b5ba538c44f6cbff879308a2a2adb/users/f4a3611d5aeb408a948f806ae9f885a2/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:47:39.788195 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d49f3-0a57-492b-8351-592719cf51f2 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:47:39.798302 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d49f3-0a57-492b-8351-592719cf51f2 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:47:39.854701 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aefa3ec-d8f4-40d8-a639-71b3e6bb23c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:47:39.855425 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aefa3ec-d8f4-40d8-a639-71b3e6bb23c8 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:47:39.855658 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aefa3ec-d8f4-40d8-a639-71b3e6bb23c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:47:39.855939 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aefa3ec-d8f4-40d8-a639-71b3e6bb23c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:47:39.856660 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aefa3ec-d8f4-40d8-a639-71b3e6bb23c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:47:39.858316 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aefa3ec-d8f4-40d8-a639-71b3e6bb23c8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:47:39.868186 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4236/8499] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:47:39.872419 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76375366-1199-4617-9619-4ddd3c2b1859 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:47:39.882713 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76375366-1199-4617-9619-4ddd3c2b1859 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:47:39.887550 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fdd623-aef1-424c-8f37-f4c0c3febaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:47:39.888568 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fdd623-aef1-424c-8f37-f4c0c3febaf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:47:39.888847 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fdd623-aef1-424c-8f37-f4c0c3febaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:47:39.889122 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fdd623-aef1-424c-8f37-f4c0c3febaf3 admin admin] PATH_INFO: `/v3/projects/d55b5ba538c44f6cbff879308a2a2adb/users/f4a3611d5aeb408a948f806ae9f885a2/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:47:39.891124 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fdd623-aef1-424c-8f37-f4c0c3febaf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d55b5ba538c44f6cbff879308a2a2adb, user_id=f4a3611d5aeb408a948f806ae9f885a2, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:47:39.893810 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fdd623-aef1-424c-8f37-f4c0c3febaf3 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:47:39.904723 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4264/8500] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:47:39 2022] PUT /identity/v3/projects/d55b5ba538c44f6cbff879308a2a2adb/users/f4a3611d5aeb408a948f806ae9f885a2/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:47:39.916695 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a930a4b-3183-49aa-afd1-e5b7ea3992b1 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:47:39.916989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a930a4b-3183-49aa-afd1-e5b7ea3992b1 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:47:39.919134 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a930a4b-3183-49aa-afd1-e5b7ea3992b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:47:39.943180 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-7a930a4b-3183-49aa-afd1-e5b7ea3992b1 None None] MFA Rules not processed for user `f4a3611d5aeb408a948f806ae9f885a2`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:47:39.944399 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7a930a4b-3183-49aa-afd1-e5b7ea3992b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:47:40.010470 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4237/8501] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:47:39 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:47:40.021548 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fdd623-aef1-424c-8f37-f4c0c3febaf3 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:47:40.023765 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-04fdd623-aef1-424c-8f37-f4c0c3febaf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:47:40.082012 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fdd623-aef1-424c-8f37-f4c0c3febaf3 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:47:40.086187 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945b965-be9d-4ed4-b1f6-d2179cb4e50b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:47:40.086813 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945b965-be9d-4ed4-b1f6-d2179cb4e50b service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:47:40.087091 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945b965-be9d-4ed4-b1f6-d2179cb4e50b service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:47:40.087364 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945b965-be9d-4ed4-b1f6-d2179cb4e50b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:47:40.141184 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945b965-be9d-4ed4-b1f6-d2179cb4e50b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:47:40.142669 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945b965-be9d-4ed4-b1f6-d2179cb4e50b service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:47:40.152438 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4265/8502] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:47:40 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:47:42.905379 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a930a4b-3183-49aa-afd1-e5b7ea3992b1 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:47:42.906864 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7a930a4b-3183-49aa-afd1-e5b7ea3992b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:47:42.922290 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a930a4b-3183-49aa-afd1-e5b7ea3992b1 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:47:42.925984 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbe7ba-eeac-4435-bed8-5c37abb4242d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:47:42.926636 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbe7ba-eeac-4435-bed8-5c37abb4242d service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:47:42.926922 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbe7ba-eeac-4435-bed8-5c37abb4242d service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:47:42.927200 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbe7ba-eeac-4435-bed8-5c37abb4242d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:47:42.941108 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fbe7ba-eeac-4435-bed8-5c37abb4242d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:47:42.941108 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fbe7ba-eeac-4435-bed8-5c37abb4242d service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:47:42.948487 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4238/8503] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:47:42 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:47:49.812487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695282d5-dbc6-474c-adf5-8938d9470005 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:47:49.812987 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695282d5-dbc6-474c-adf5-8938d9470005 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:47:49.813103 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695282d5-dbc6-474c-adf5-8938d9470005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:47:49.830770 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-695282d5-dbc6-474c-adf5-8938d9470005 None None] MFA Rules not processed for user `2df099ec39004e72a4e49a6eb1694aee`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:47:49.832130 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-695282d5-dbc6-474c-adf5-8938d9470005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:47:49.839377 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4266/8504] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:47:49 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:48:30.604348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbe7ba-eeac-4435-bed8-5c37abb4242d service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:48:30.605776 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b1fbe7ba-eeac-4435-bed8-5c37abb4242d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:48:30.683553 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbe7ba-eeac-4435-bed8-5c37abb4242d service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:48:30.694764 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d4be5-7a70-4a93-bc93-c0b1299aa876 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:48:30.694764 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d4be5-7a70-4a93-bc93-c0b1299aa876 service placement] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:48:30.694764 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d4be5-7a70-4a93-bc93-c0b1299aa876 service placement] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:48:30.694764 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d4be5-7a70-4a93-bc93-c0b1299aa876 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:48:30.696408 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-277d4be5-7a70-4a93-bc93-c0b1299aa876 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:48:30.712334 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d4be5-7a70-4a93-bc93-c0b1299aa876 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:48:30.713966 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d4be5-7a70-4a93-bc93-c0b1299aa876 service placement] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:48:30.725964 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4239/8505] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:48:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:48:36.781137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695282d5-dbc6-474c-adf5-8938d9470005 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:48:36.785191 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-695282d5-dbc6-474c-adf5-8938d9470005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:48:36.801477 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695282d5-dbc6-474c-adf5-8938d9470005 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:48:36.807172 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457cca4-e474-4f4a-8064-5e9d6ecfc951 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:48:36.807814 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457cca4-e474-4f4a-8064-5e9d6ecfc951 service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:48:36.808095 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457cca4-e474-4f4a-8064-5e9d6ecfc951 service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:48:36.808408 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457cca4-e474-4f4a-8064-5e9d6ecfc951 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:48:36.810182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2457cca4-e474-4f4a-8064-5e9d6ecfc951 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:48:36.826767 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2457cca4-e474-4f4a-8064-5e9d6ecfc951 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:48:36.828417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2457cca4-e474-4f4a-8064-5e9d6ecfc951 service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:48:36.842844 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4267/8506] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:48:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:48:48.637039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4d7b6-eaf6-4ee5-b753-837a01908718 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:48:48.637575 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4d7b6-eaf6-4ee5-b753-837a01908718 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:48:48.637575 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4d7b6-eaf6-4ee5-b753-837a01908718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:48:48.655171 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-2fd4d7b6-eaf6-4ee5-b753-837a01908718 None None] MFA Rules not processed for user `2df099ec39004e72a4e49a6eb1694aee`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:48:48.659978 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2fd4d7b6-eaf6-4ee5-b753-837a01908718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:48:48.663731 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4240/8507] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:48:48 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:48:53.117511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457cca4-e474-4f4a-8064-5e9d6ecfc951 service placement] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:48:53.131600 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457cca4-e474-4f4a-8064-5e9d6ecfc951 service placement] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:48:53.137063 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c78b2-34ed-49e1-a1d4-6df48987b43e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:48:53.138248 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c78b2-34ed-49e1-a1d4-6df48987b43e service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:48:53.138649 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c78b2-34ed-49e1-a1d4-6df48987b43e service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:48:53.139021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c78b2-34ed-49e1-a1d4-6df48987b43e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:48:53.142493 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2f3c78b2-34ed-49e1-a1d4-6df48987b43e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:48:53.215670 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c78b2-34ed-49e1-a1d4-6df48987b43e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:48:53.217301 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c78b2-34ed-49e1-a1d4-6df48987b43e service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:48:53.228561 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4268/8508] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:48:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:48:58.776709 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4d7b6-eaf6-4ee5-b753-837a01908718 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:48:58.778134 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2fd4d7b6-eaf6-4ee5-b753-837a01908718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:48:58.847198 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4d7b6-eaf6-4ee5-b753-837a01908718 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:48:58.850778 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d36b86-8379-4658-8dda-fe74e71fbead service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:48:58.851418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d36b86-8379-4658-8dda-fe74e71fbead service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:48:58.851698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d36b86-8379-4658-8dda-fe74e71fbead service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:48:58.851968 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d36b86-8379-4658-8dda-fe74e71fbead service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:48:58.853824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c8d36b86-8379-4658-8dda-fe74e71fbead service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:48:58.910954 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d36b86-8379-4658-8dda-fe74e71fbead service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:48:58.912421 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d36b86-8379-4658-8dda-fe74e71fbead service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:48:58.921246 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4241/8509] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:48:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:49:15.980138 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c78b2-34ed-49e1-a1d4-6df48987b43e service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:49:15.991626 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c78b2-34ed-49e1-a1d4-6df48987b43e service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:49:15.996068 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7447a-58d3-444d-8d6d-a057f9b71d29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:49:15.996718 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7447a-58d3-444d-8d6d-a057f9b71d29 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:49:15.997002 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7447a-58d3-444d-8d6d-a057f9b71d29 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:49:15.997282 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7447a-58d3-444d-8d6d-a057f9b71d29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:49:15.999181 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-30a7447a-58d3-444d-8d6d-a057f9b71d29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:49:16.067753 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a7447a-58d3-444d-8d6d-a057f9b71d29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:49:16.069745 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a7447a-58d3-444d-8d6d-a057f9b71d29 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:49:16.080651 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4269/8510] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:49:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:49:23.848584 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfec81f-4959-4f77-a395-dea949429c9d None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:49:23.849069 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfec81f-4959-4f77-a395-dea949429c9d None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:49:23.849185 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfec81f-4959-4f77-a395-dea949429c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:49:23.868142 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-7bfec81f-4959-4f77-a395-dea949429c9d None None] MFA Rules not processed for user `0ed9fb1a529f4247acd72a6de21ceb4c`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:49:23.869707 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7bfec81f-4959-4f77-a395-dea949429c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:49:23.876890 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4242/8511] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:49:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:49:24.178035 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7447a-58d3-444d-8d6d-a057f9b71d29 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:49:24.179575 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-30a7447a-58d3-444d-8d6d-a057f9b71d29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:49:24.192212 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7447a-58d3-444d-8d6d-a057f9b71d29 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:49:24.196762 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e124c53-56b8-4793-8109-035181c2495f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:49:24.197632 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e124c53-56b8-4793-8109-035181c2495f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:49:24.197957 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e124c53-56b8-4793-8109-035181c2495f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:49:24.198457 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e124c53-56b8-4793-8109-035181c2495f admin admin] PATH_INFO: `/v3/users/34a160f829dd4dc6af9f2254653dc0b8` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:49:24.199626 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e124c53-56b8-4793-8109-035181c2495f admin admin] RBAC: Authorizing `identity:delete_user(user_id=34a160f829dd4dc6af9f2254653dc0b8)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:49:24.201562 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e124c53-56b8-4793-8109-035181c2495f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:49:24.339892 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4e124c53-56b8-4793-8109-035181c2495f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34a160f829dd4dc6af9f2254653dc0b8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:49:24.351723 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4e124c53-56b8-4793-8109-035181c2495f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34a160f829dd4dc6af9f2254653dc0b8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:49:24.394086 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4e124c53-56b8-4793-8109-035181c2495f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34a160f829dd4dc6af9f2254653dc0b8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:49:24.402872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4e124c53-56b8-4793-8109-035181c2495f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34a160f829dd4dc6af9f2254653dc0b8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:49:24.404349 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-4e124c53-56b8-4793-8109-035181c2495f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34a160f829dd4dc6af9f2254653dc0b8'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:49:24.411299 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4270/8512] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:49:24 2022] DELETE /identity/v3/users/34a160f829dd4dc6af9f2254653dc0b8 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:49:24.693180 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfec81f-4959-4f77-a395-dea949429c9d None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:49:24.706874 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfec81f-4959-4f77-a395-dea949429c9d None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:49:24.779493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d6e2b2-ee97-4b1c-8733-22b6039e9df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:49:24.783640 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6e2b2-ee97-4b1c-8733-22b6039e9df7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:49:24.783640 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6e2b2-ee97-4b1c-8733-22b6039e9df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:49:24.783640 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6e2b2-ee97-4b1c-8733-22b6039e9df7 admin admin] PATH_INFO: `/v3/projects/abef47ea98c94b53836ceb8e201788f7` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:49:24.783984 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d6e2b2-ee97-4b1c-8733-22b6039e9df7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abef47ea98c94b53836ceb8e201788f7)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:49:24.787369 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d6e2b2-ee97-4b1c-8733-22b6039e9df7 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:49:24.940221 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-76d6e2b2-ee97-4b1c-8733-22b6039e9df7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abef47ea98c94b53836ceb8e201788f7', 'request_id': 'req-76d6e2b2-ee97-4b1c-8733-22b6039e9df7'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:49:24.947436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-76d6e2b2-ee97-4b1c-8733-22b6039e9df7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abef47ea98c94b53836ceb8e201788f7', 'request_id': 'req-76d6e2b2-ee97-4b1c-8733-22b6039e9df7'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:49:24.954841 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-76d6e2b2-ee97-4b1c-8733-22b6039e9df7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abef47ea98c94b53836ceb8e201788f7', 'request_id': 'req-76d6e2b2-ee97-4b1c-8733-22b6039e9df7'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:49:25.056679 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-76d6e2b2-ee97-4b1c-8733-22b6039e9df7 admin admin] The token cache is being invalidate because project abef47ea98c94b53836ceb8e201788f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:49:25.057094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-76d6e2b2-ee97-4b1c-8733-22b6039e9df7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:49:25.057818 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-76d6e2b2-ee97-4b1c-8733-22b6039e9df7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:49:25.059485 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4243/8513] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:49:24 2022] DELETE /identity/v3/projects/abef47ea98c94b53836ceb8e201788f7 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:49:25.063791 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e124c53-56b8-4793-8109-035181c2495f admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:49:25.065319 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4e124c53-56b8-4793-8109-035181c2495f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:49:25.080625 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e124c53-56b8-4793-8109-035181c2495f admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:49:25.138995 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e86241-6337-4b97-abbc-c8b98f86d4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:49:25.139834 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e86241-6337-4b97-abbc-c8b98f86d4c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:49:25.140122 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e86241-6337-4b97-abbc-c8b98f86d4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:49:25.140404 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e86241-6337-4b97-abbc-c8b98f86d4c0 admin admin] PATH_INFO: `/v3/users/cb9dcd957e4e4b8b8dba0bc415a18e96` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:49:25.141991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e86241-6337-4b97-abbc-c8b98f86d4c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb9dcd957e4e4b8b8dba0bc415a18e96)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:49:25.143938 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e86241-6337-4b97-abbc-c8b98f86d4c0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:49:25.333138 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-93e86241-6337-4b97-abbc-c8b98f86d4c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb9dcd957e4e4b8b8dba0bc415a18e96'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:49:25.345501 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-93e86241-6337-4b97-abbc-c8b98f86d4c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb9dcd957e4e4b8b8dba0bc415a18e96'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:49:25.405687 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-93e86241-6337-4b97-abbc-c8b98f86d4c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb9dcd957e4e4b8b8dba0bc415a18e96'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:49:25.412855 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-93e86241-6337-4b97-abbc-c8b98f86d4c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb9dcd957e4e4b8b8dba0bc415a18e96'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:49:25.414463 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-93e86241-6337-4b97-abbc-c8b98f86d4c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb9dcd957e4e4b8b8dba0bc415a18e96'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:49:25.419235 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4271/8514] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:49:25 2022] DELETE /identity/v3/users/cb9dcd957e4e4b8b8dba0bc415a18e96 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:49:25.664123 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d6e2b2-ee97-4b1c-8733-22b6039e9df7 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:49:25.665783 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-76d6e2b2-ee97-4b1c-8733-22b6039e9df7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:49:25.685020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d6e2b2-ee97-4b1c-8733-22b6039e9df7 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:49:25.753955 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa7aed-0e79-473f-bb7c-2dea5c7ac7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:49:25.754886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa7aed-0e79-473f-bb7c-2dea5c7ac7a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:49:25.755172 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa7aed-0e79-473f-bb7c-2dea5c7ac7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:49:25.755448 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa7aed-0e79-473f-bb7c-2dea5c7ac7a8 admin admin] PATH_INFO: `/v3/projects/4e950dfad85341278d19bcf55ae75eff` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:49:25.757263 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa7aed-0e79-473f-bb7c-2dea5c7ac7a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e950dfad85341278d19bcf55ae75eff)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:49:25.759240 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa7aed-0e79-473f-bb7c-2dea5c7ac7a8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:49:25.850721 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-cbfa7aed-0e79-473f-bb7c-2dea5c7ac7a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e950dfad85341278d19bcf55ae75eff', 'request_id': 'req-cbfa7aed-0e79-473f-bb7c-2dea5c7ac7a8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:49:25.856385 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-cbfa7aed-0e79-473f-bb7c-2dea5c7ac7a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e950dfad85341278d19bcf55ae75eff', 'request_id': 'req-cbfa7aed-0e79-473f-bb7c-2dea5c7ac7a8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:49:25.862558 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-cbfa7aed-0e79-473f-bb7c-2dea5c7ac7a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e950dfad85341278d19bcf55ae75eff', 'request_id': 'req-cbfa7aed-0e79-473f-bb7c-2dea5c7ac7a8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:49:25.913307 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-cbfa7aed-0e79-473f-bb7c-2dea5c7ac7a8 admin admin] The token cache is being invalidate because project 4e950dfad85341278d19bcf55ae75eff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:49:25.913532 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-cbfa7aed-0e79-473f-bb7c-2dea5c7ac7a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:49:25.914141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-cbfa7aed-0e79-473f-bb7c-2dea5c7ac7a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:49:25.915672 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4244/8515] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:49:25 2022] DELETE /identity/v3/projects/4e950dfad85341278d19bcf55ae75eff => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:49:53.277063 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c40f5a-ed10-4a54-9bac-afc85170aa9b None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:49:53.277996 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c40f5a-ed10-4a54-9bac-afc85170aa9b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:49:53.278456 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c40f5a-ed10-4a54-9bac-afc85170aa9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:49:53.296105 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-50c40f5a-ed10-4a54-9bac-afc85170aa9b None None] MFA Rules not processed for user `2df099ec39004e72a4e49a6eb1694aee`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:49:53.297316 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-50c40f5a-ed10-4a54-9bac-afc85170aa9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:49:53.350397 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4272/8516] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:49:53 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:50:50.631931 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa7aed-0e79-473f-bb7c-2dea5c7ac7a8 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:50:50.634219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-cbfa7aed-0e79-473f-bb7c-2dea5c7ac7a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:50:50.752409 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa7aed-0e79-473f-bb7c-2dea5c7ac7a8 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:50:50.757191 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e119a10-b588-4086-afa7-728ea72ad4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:50:50.759925 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e119a10-b588-4086-afa7-728ea72ad4bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:50:50.759925 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e119a10-b588-4086-afa7-728ea72ad4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:50:50.759925 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e119a10-b588-4086-afa7-728ea72ad4bd admin admin] PATH_INFO: `/v3/users/2df099ec39004e72a4e49a6eb1694aee` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:50:50.760349 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e119a10-b588-4086-afa7-728ea72ad4bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2df099ec39004e72a4e49a6eb1694aee)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:50:50.762423 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e119a10-b588-4086-afa7-728ea72ad4bd admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:50:50.918382 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1e119a10-b588-4086-afa7-728ea72ad4bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2df099ec39004e72a4e49a6eb1694aee'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:50:50.930837 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1e119a10-b588-4086-afa7-728ea72ad4bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2df099ec39004e72a4e49a6eb1694aee'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:50:51.010469 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1e119a10-b588-4086-afa7-728ea72ad4bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2df099ec39004e72a4e49a6eb1694aee'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:50:51.011098 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1e119a10-b588-4086-afa7-728ea72ad4bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2df099ec39004e72a4e49a6eb1694aee'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:50:51.018422 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-1e119a10-b588-4086-afa7-728ea72ad4bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2df099ec39004e72a4e49a6eb1694aee'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:50:51.025018 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4245/8517] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:50:50 2022] DELETE /identity/v3/users/2df099ec39004e72a4e49a6eb1694aee => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:50:51.029788 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de2cd9-b24a-43b0-98cf-2c9a7326a45b None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:50:51.030240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de2cd9-b24a-43b0-98cf-2c9a7326a45b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:50:51.030240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de2cd9-b24a-43b0-98cf-2c9a7326a45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:50:51.059868 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-f2de2cd9-b24a-43b0-98cf-2c9a7326a45b None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:50:51.061097 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f2de2cd9-b24a-43b0-98cf-2c9a7326a45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:50:51.128154 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4273/8518] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:50:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:50:51.138042 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e119a10-b588-4086-afa7-728ea72ad4bd admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:50:51.140798 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1e119a10-b588-4086-afa7-728ea72ad4bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:50:51.227158 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e119a10-b588-4086-afa7-728ea72ad4bd admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:50:51.230766 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd133d-9a8d-42ea-911f-448e8ace1c52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:50:51.231512 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd133d-9a8d-42ea-911f-448e8ace1c52 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:50:51.231796 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd133d-9a8d-42ea-911f-448e8ace1c52 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:50:51.232094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd133d-9a8d-42ea-911f-448e8ace1c52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:50:51.241019 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cd133d-9a8d-42ea-911f-448e8ace1c52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:50:51.242589 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cd133d-9a8d-42ea-911f-448e8ace1c52 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:50:51.252041 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4246/8519] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:50:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:50:51.457074 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de2cd9-b24a-43b0-98cf-2c9a7326a45b None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:50:51.458618 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f2de2cd9-b24a-43b0-98cf-2c9a7326a45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:50:51.470649 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de2cd9-b24a-43b0-98cf-2c9a7326a45b None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:50:51.475526 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518cd5e-2eac-4912-ae90-0b4b4b3d3fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:50:51.477143 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518cd5e-2eac-4912-ae90-0b4b4b3d3fa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:50:51.477423 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518cd5e-2eac-4912-ae90-0b4b4b3d3fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:50:51.477726 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518cd5e-2eac-4912-ae90-0b4b4b3d3fa0 admin admin] PATH_INFO: `/v3/projects/cf9af556d4c3479a89d448e8bc633a3e` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:50:51.478949 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518cd5e-2eac-4912-ae90-0b4b4b3d3fa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf9af556d4c3479a89d448e8bc633a3e)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:50:51.480912 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518cd5e-2eac-4912-ae90-0b4b4b3d3fa0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:50:51.598495 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a518cd5e-2eac-4912-ae90-0b4b4b3d3fa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf9af556d4c3479a89d448e8bc633a3e', 'request_id': 'req-a518cd5e-2eac-4912-ae90-0b4b4b3d3fa0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:50:51.604501 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a518cd5e-2eac-4912-ae90-0b4b4b3d3fa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf9af556d4c3479a89d448e8bc633a3e', 'request_id': 'req-a518cd5e-2eac-4912-ae90-0b4b4b3d3fa0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:50:51.610715 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a518cd5e-2eac-4912-ae90-0b4b4b3d3fa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf9af556d4c3479a89d448e8bc633a3e', 'request_id': 'req-a518cd5e-2eac-4912-ae90-0b4b4b3d3fa0'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:50:51.688716 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a518cd5e-2eac-4912-ae90-0b4b4b3d3fa0 admin admin] The token cache is being invalidate because project cf9af556d4c3479a89d448e8bc633a3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:50:51.689002 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a518cd5e-2eac-4912-ae90-0b4b4b3d3fa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:50:51.689619 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a518cd5e-2eac-4912-ae90-0b4b4b3d3fa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:50:51.691256 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4274/8520] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:50:51 2022] DELETE /identity/v3/projects/cf9af556d4c3479a89d448e8bc633a3e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:50:51.695398 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd133d-9a8d-42ea-911f-448e8ace1c52 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:50:51.705162 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd133d-9a8d-42ea-911f-448e8ace1c52 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:50:51.759273 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342b8a2-4629-4b42-888c-5bc1797d014d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:50:51.760134 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342b8a2-4629-4b42-888c-5bc1797d014d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:50:51.760420 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342b8a2-4629-4b42-888c-5bc1797d014d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:50:51.760697 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342b8a2-4629-4b42-888c-5bc1797d014d admin admin] PATH_INFO: `/v3/users/f4a3611d5aeb408a948f806ae9f885a2` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:50:51.761903 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342b8a2-4629-4b42-888c-5bc1797d014d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4a3611d5aeb408a948f806ae9f885a2)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:50:51.763830 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342b8a2-4629-4b42-888c-5bc1797d014d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:50:51.909559 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6342b8a2-4629-4b42-888c-5bc1797d014d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4a3611d5aeb408a948f806ae9f885a2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:50:51.922578 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6342b8a2-4629-4b42-888c-5bc1797d014d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4a3611d5aeb408a948f806ae9f885a2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:50:51.981685 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6342b8a2-4629-4b42-888c-5bc1797d014d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4a3611d5aeb408a948f806ae9f885a2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:50:51.982338 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6342b8a2-4629-4b42-888c-5bc1797d014d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4a3611d5aeb408a948f806ae9f885a2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:50:51.989826 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-6342b8a2-4629-4b42-888c-5bc1797d014d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4a3611d5aeb408a948f806ae9f885a2'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:50:51.995729 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4247/8521] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:50:51 2022] DELETE /identity/v3/users/f4a3611d5aeb408a948f806ae9f885a2 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:50:52.452976 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518cd5e-2eac-4912-ae90-0b4b4b3d3fa0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:50:52.452976 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a518cd5e-2eac-4912-ae90-0b4b4b3d3fa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:50:52.460953 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518cd5e-2eac-4912-ae90-0b4b4b3d3fa0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:50:52.517106 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d234247-2567-42fa-a6bd-780b69825b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:50:52.518002 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d234247-2567-42fa-a6bd-780b69825b3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:50:52.518290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d234247-2567-42fa-a6bd-780b69825b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:50:52.518573 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d234247-2567-42fa-a6bd-780b69825b3e admin admin] PATH_INFO: `/v3/projects/d55b5ba538c44f6cbff879308a2a2adb` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:50:52.519784 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d234247-2567-42fa-a6bd-780b69825b3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d55b5ba538c44f6cbff879308a2a2adb)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:50:52.521702 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d234247-2567-42fa-a6bd-780b69825b3e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:50:52.633408 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3d234247-2567-42fa-a6bd-780b69825b3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd55b5ba538c44f6cbff879308a2a2adb', 'request_id': 'req-3d234247-2567-42fa-a6bd-780b69825b3e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:50:52.638761 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3d234247-2567-42fa-a6bd-780b69825b3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd55b5ba538c44f6cbff879308a2a2adb', 'request_id': 'req-3d234247-2567-42fa-a6bd-780b69825b3e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:50:52.644904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3d234247-2567-42fa-a6bd-780b69825b3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd55b5ba538c44f6cbff879308a2a2adb', 'request_id': 'req-3d234247-2567-42fa-a6bd-780b69825b3e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:50:52.723877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3d234247-2567-42fa-a6bd-780b69825b3e admin admin] The token cache is being invalidate because project d55b5ba538c44f6cbff879308a2a2adb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:50:52.724110 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3d234247-2567-42fa-a6bd-780b69825b3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:50:52.724764 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-3d234247-2567-42fa-a6bd-780b69825b3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:50:52.726895 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4275/8522] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:50:52 2022] DELETE /identity/v3/projects/d55b5ba538c44f6cbff879308a2a2adb => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:50:52.733449 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b74b1-bb7a-409b-b428-d3ddfadc6ed1 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:50:52.733964 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b74b1-bb7a-409b-b428-d3ddfadc6ed1 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:50:52.734064 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b74b1-bb7a-409b-b428-d3ddfadc6ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:50:52.752429 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-b22b74b1-bb7a-409b-b428-d3ddfadc6ed1 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:50:52.753612 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b22b74b1-bb7a-409b-b428-d3ddfadc6ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:50:52.811554 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4248/8523] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:50:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:50:52.820472 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b63c20-4058-4bbd-807c-b80c041479e7 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:50:52.820766 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b63c20-4058-4bbd-807c-b80c041479e7 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:50:52.821054 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b63c20-4058-4bbd-807c-b80c041479e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:50:52.839281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-69b63c20-4058-4bbd-807c-b80c041479e7 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:50:52.840483 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-69b63c20-4058-4bbd-807c-b80c041479e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:50:52.848396 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4276/8524] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:50:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:50:52.853156 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b74b1-bb7a-409b-b428-d3ddfadc6ed1 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:50:52.862770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b74b1-bb7a-409b-b428-d3ddfadc6ed1 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:50:52.868175 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc3416-275f-4786-b4ae-675e360b79d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:50:52.868820 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc3416-275f-4786-b4ae-675e360b79d5 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:50:52.869289 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc3416-275f-4786-b4ae-675e360b79d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:50:52.869571 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc3416-275f-4786-b4ae-675e360b79d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:50:52.870403 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc3416-275f-4786-b4ae-675e360b79d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:50:52.870714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc3416-275f-4786-b4ae-675e360b79d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:50:52.872349 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc3416-275f-4786-b4ae-675e360b79d5 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:50:52.883822 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4249/8525] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:50:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:50:52.888304 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b63c20-4058-4bbd-807c-b80c041479e7 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:50:52.897566 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b63c20-4058-4bbd-807c-b80c041479e7 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:50:52.902626 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee054ce-efd2-449b-b14c-643418e2fb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:50:52.906314 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee054ce-efd2-449b-b14c-643418e2fb5f admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:50:52.906314 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee054ce-efd2-449b-b14c-643418e2fb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:50:52.906314 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee054ce-efd2-449b-b14c-643418e2fb5f admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:50:52.906314 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee054ce-efd2-449b-b14c-643418e2fb5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:50:52.907064 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee054ce-efd2-449b-b14c-643418e2fb5f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:50:53.005339 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4277/8526] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:50:52 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:50:53.009426 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc3416-275f-4786-b4ae-675e360b79d5 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:50:53.019534 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc3416-275f-4786-b4ae-675e360b79d5 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:50:53.073769 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688ed66-7e5f-41f7-9ccf-f671e7fe8797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:50:53.074453 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688ed66-7e5f-41f7-9ccf-f671e7fe8797 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:50:53.074735 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688ed66-7e5f-41f7-9ccf-f671e7fe8797 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:50:53.075005 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688ed66-7e5f-41f7-9ccf-f671e7fe8797 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:50:53.075677 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688ed66-7e5f-41f7-9ccf-f671e7fe8797 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:50:53.077613 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688ed66-7e5f-41f7-9ccf-f671e7fe8797 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:50:53.161369 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4250/8527] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:50:53 2022] POST /identity/v3/users => generated 289 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:50:53.166336 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee054ce-efd2-449b-b14c-643418e2fb5f admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:50:53.176844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee054ce-efd2-449b-b14c-643418e2fb5f admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:50:53.181474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d4221-8296-4c91-a49b-3f7b4b04afeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:50:53.182191 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d4221-8296-4c91-a49b-3f7b4b04afeb admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:50:53.182473 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d4221-8296-4c91-a49b-3f7b4b04afeb admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:50:53.182754 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d4221-8296-4c91-a49b-3f7b4b04afeb admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:50:53.183485 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3d4221-8296-4c91-a49b-3f7b4b04afeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:50:53.185125 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3d4221-8296-4c91-a49b-3f7b4b04afeb admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:50:53.195643 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4278/8528] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:50:53.199722 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688ed66-7e5f-41f7-9ccf-f671e7fe8797 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:50:53.210245 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688ed66-7e5f-41f7-9ccf-f671e7fe8797 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:50:53.215815 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c9761-911c-40e3-8e61-a243db15cade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:50:53.216482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c9761-911c-40e3-8e61-a243db15cade admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:50:53.216770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c9761-911c-40e3-8e61-a243db15cade admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:50:53.217051 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c9761-911c-40e3-8e61-a243db15cade admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:50:53.217800 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c9761-911c-40e3-8e61-a243db15cade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:50:53.219420 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c9761-911c-40e3-8e61-a243db15cade admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:50:53.230152 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4251/8529] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:50:53.234203 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d4221-8296-4c91-a49b-3f7b4b04afeb admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:50:53.244478 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d4221-8296-4c91-a49b-3f7b4b04afeb admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:50:53.249190 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ec574-9311-48e9-b69a-767990c0b6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:50:53.250096 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ec574-9311-48e9-b69a-767990c0b6c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:50:53.250389 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ec574-9311-48e9-b69a-767990c0b6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:50:53.250672 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ec574-9311-48e9-b69a-767990c0b6c3 admin admin] PATH_INFO: `/v3/projects/9e063926f9194aa7b6cf535aae766b03/users/b8aa6b4d5c154ab396ad1d657c27f9b1/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:50:53.265993 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ec574-9311-48e9-b69a-767990c0b6c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e063926f9194aa7b6cf535aae766b03, user_id=b8aa6b4d5c154ab396ad1d657c27f9b1, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:50:53.268602 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ec574-9311-48e9-b69a-767990c0b6c3 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:50:53.318321 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4279/8530] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:50:53 2022] PUT /identity/v3/projects/9e063926f9194aa7b6cf535aae766b03/users/b8aa6b4d5c154ab396ad1d657c27f9b1/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:50:53.323681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1541a9a-a9e7-479d-82ed-a3dfdba05d02 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:50:53.323992 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1541a9a-a9e7-479d-82ed-a3dfdba05d02 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:50:53.324275 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1541a9a-a9e7-479d-82ed-a3dfdba05d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:50:53.342298 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-b1541a9a-a9e7-479d-82ed-a3dfdba05d02 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:50:53.343510 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b1541a9a-a9e7-479d-82ed-a3dfdba05d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:50:53.401584 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4252/8531] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:50:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:50:53.411538 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ec574-9311-48e9-b69a-767990c0b6c3 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:50:53.413434 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-488ec574-9311-48e9-b69a-767990c0b6c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:50:53.478726 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ec574-9311-48e9-b69a-767990c0b6c3 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:50:53.482494 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7618cd2-d8e4-44c3-b545-fdff77404b44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:50:53.483145 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7618cd2-d8e4-44c3-b545-fdff77404b44 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:50:53.483439 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7618cd2-d8e4-44c3-b545-fdff77404b44 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:50:53.483711 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7618cd2-d8e4-44c3-b545-fdff77404b44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:50:53.493654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7618cd2-d8e4-44c3-b545-fdff77404b44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:50:53.495130 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7618cd2-d8e4-44c3-b545-fdff77404b44 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:50:53.508521 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4280/8532] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:50:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:50:54.778176 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33012731-3839-4c96-b0e3-c217102d184e None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:50:54.778641 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33012731-3839-4c96-b0e3-c217102d184e None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:50:54.778968 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33012731-3839-4c96-b0e3-c217102d184e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:50:54.805856 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-33012731-3839-4c96-b0e3-c217102d184e None None] MFA Rules not processed for user `b8aa6b4d5c154ab396ad1d657c27f9b1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:50:54.807095 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-33012731-3839-4c96-b0e3-c217102d184e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:50:54.872971 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4253/8533] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:50:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:50:54.877716 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7618cd2-d8e4-44c3-b545-fdff77404b44 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:50:54.888090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7618cd2-d8e4-44c3-b545-fdff77404b44 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:50:54.893179 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b3d77-4ba1-4f1b-b94c-7c7e125c995b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:50:54.893860 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b3d77-4ba1-4f1b-b94c-7c7e125c995b admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:50:54.894147 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b3d77-4ba1-4f1b-b94c-7c7e125c995b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:50:54.894423 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b3d77-4ba1-4f1b-b94c-7c7e125c995b admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:50:54.895119 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b3d77-4ba1-4f1b-b94c-7c7e125c995b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:50:54.897032 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b3d77-4ba1-4f1b-b94c-7c7e125c995b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:50:54.959896 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4281/8534] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:50:54 2022] POST /identity/v3/projects => generated 375 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:50:54.964116 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33012731-3839-4c96-b0e3-c217102d184e None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:50:54.974753 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33012731-3839-4c96-b0e3-c217102d184e None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:50:55.029295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d58372-9cc3-4928-a89a-97aaf10b6687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:50:55.029955 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d58372-9cc3-4928-a89a-97aaf10b6687 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:50:55.030337 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d58372-9cc3-4928-a89a-97aaf10b6687 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:50:55.030616 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d58372-9cc3-4928-a89a-97aaf10b6687 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:50:55.031297 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d58372-9cc3-4928-a89a-97aaf10b6687 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:50:55.033246 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d58372-9cc3-4928-a89a-97aaf10b6687 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:50:55.120402 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4254/8535] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:50:54 2022] POST /identity/v3/users => generated 294 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:50:55.125658 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b3d77-4ba1-4f1b-b94c-7c7e125c995b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:50:55.136726 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b3d77-4ba1-4f1b-b94c-7c7e125c995b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:50:55.141608 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35c4ac-ff62-4d18-9121-e05869a94d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:50:55.142491 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35c4ac-ff62-4d18-9121-e05869a94d47 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:50:55.143971 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35c4ac-ff62-4d18-9121-e05869a94d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:50:55.143971 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35c4ac-ff62-4d18-9121-e05869a94d47 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:50:55.143971 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35c4ac-ff62-4d18-9121-e05869a94d47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:50:55.145242 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35c4ac-ff62-4d18-9121-e05869a94d47 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:50:55.156812 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4282/8536] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:50:55.160971 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d58372-9cc3-4928-a89a-97aaf10b6687 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:50:55.171756 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d58372-9cc3-4928-a89a-97aaf10b6687 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:50:55.176413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131fccfa-1b1e-4dd1-bdc7-d280f131fba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:50:55.177312 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fccfa-1b1e-4dd1-bdc7-d280f131fba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:50:55.177603 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fccfa-1b1e-4dd1-bdc7-d280f131fba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:50:55.177936 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fccfa-1b1e-4dd1-bdc7-d280f131fba4 admin admin] PATH_INFO: `/v3/projects/f550ea943f1e4c6bbbc70da63f4588c6/users/68d0f2ff8325449fb99157e2906d44a3/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:50:55.192862 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131fccfa-1b1e-4dd1-bdc7-d280f131fba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f550ea943f1e4c6bbbc70da63f4588c6, user_id=68d0f2ff8325449fb99157e2906d44a3, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:50:55.195821 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131fccfa-1b1e-4dd1-bdc7-d280f131fba4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:50:55.273099 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4255/8537] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:50:55 2022] PUT /identity/v3/projects/f550ea943f1e4c6bbbc70da63f4588c6/users/68d0f2ff8325449fb99157e2906d44a3/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:50:55.278012 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35c4ac-ff62-4d18-9121-e05869a94d47 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:50:55.288629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35c4ac-ff62-4d18-9121-e05869a94d47 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:50:55.342739 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac483d7-ddd2-4642-94e3-975ba2f07450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:50:55.343405 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac483d7-ddd2-4642-94e3-975ba2f07450 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:50:55.343690 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac483d7-ddd2-4642-94e3-975ba2f07450 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:50:55.343969 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac483d7-ddd2-4642-94e3-975ba2f07450 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:50:55.344693 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac483d7-ddd2-4642-94e3-975ba2f07450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:50:55.346342 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac483d7-ddd2-4642-94e3-975ba2f07450 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:50:55.356419 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4283/8538] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:50:55.360620 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131fccfa-1b1e-4dd1-bdc7-d280f131fba4 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:50:55.370935 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131fccfa-1b1e-4dd1-bdc7-d280f131fba4 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:50:55.375604 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45348ab-b406-4358-9c49-d401379caf2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:50:55.376479 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45348ab-b406-4358-9c49-d401379caf2d admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:50:55.376766 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45348ab-b406-4358-9c49-d401379caf2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:50:55.377131 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45348ab-b406-4358-9c49-d401379caf2d admin admin] PATH_INFO: `/v3/projects/f550ea943f1e4c6bbbc70da63f4588c6/users/68d0f2ff8325449fb99157e2906d44a3/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:50:55.379204 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45348ab-b406-4358-9c49-d401379caf2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f550ea943f1e4c6bbbc70da63f4588c6, user_id=68d0f2ff8325449fb99157e2906d44a3, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:50:55.381908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45348ab-b406-4358-9c49-d401379caf2d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:50:55.391888 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4256/8539] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:50:55 2022] PUT /identity/v3/projects/f550ea943f1e4c6bbbc70da63f4588c6/users/68d0f2ff8325449fb99157e2906d44a3/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:50:56.583586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d61a6f-733b-44d4-98df-7df940e32cad None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:50:56.584130 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d61a6f-733b-44d4-98df-7df940e32cad None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:50:56.584235 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d61a6f-733b-44d4-98df-7df940e32cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:50:56.611802 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-b1d61a6f-733b-44d4-98df-7df940e32cad None None] MFA Rules not processed for user `68d0f2ff8325449fb99157e2906d44a3`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:50:56.618796 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b1d61a6f-733b-44d4-98df-7df940e32cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:50:56.682053 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4284/8540] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:50:56 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:50:56.692939 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a807d54-0ac7-40dd-a823-4afe09894231 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:50:56.693448 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a807d54-0ac7-40dd-a823-4afe09894231 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:50:56.693799 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a807d54-0ac7-40dd-a823-4afe09894231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:50:56.713622 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-9a807d54-0ac7-40dd-a823-4afe09894231 None None] MFA Rules not processed for user `b8aa6b4d5c154ab396ad1d657c27f9b1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:50:56.714852 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-9a807d54-0ac7-40dd-a823-4afe09894231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:50:56.767800 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4257/8541] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:50:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:50:56.779521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d61a6f-733b-44d4-98df-7df940e32cad None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:50:56.780958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b1d61a6f-733b-44d4-98df-7df940e32cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:50:56.871029 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d61a6f-733b-44d4-98df-7df940e32cad None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:50:56.876621 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2cddf0-2116-4766-80ee-5c620d431737 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:50:56.877263 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2cddf0-2116-4766-80ee-5c620d431737 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:50:56.877548 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2cddf0-2116-4766-80ee-5c620d431737 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:50:56.877858 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2cddf0-2116-4766-80ee-5c620d431737 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:50:56.886091 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2cddf0-2116-4766-80ee-5c620d431737 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:50:56.887919 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2cddf0-2116-4766-80ee-5c620d431737 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:50:56.896665 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4285/8542] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:50:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:51:24.202225 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a807d54-0ac7-40dd-a823-4afe09894231 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:51:24.269094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a807d54-0ac7-40dd-a823-4afe09894231 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:51:24.272845 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4baf3a-8603-41af-8d48-3a7475f3f1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:51:24.274749 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4baf3a-8603-41af-8d48-3a7475f3f1e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:51:24.275058 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4baf3a-8603-41af-8d48-3a7475f3f1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:51:24.276071 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4baf3a-8603-41af-8d48-3a7475f3f1e8 admin admin] PATH_INFO: `/v3/users/b8aa6b4d5c154ab396ad1d657c27f9b1` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:51:24.277918 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4baf3a-8603-41af-8d48-3a7475f3f1e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8aa6b4d5c154ab396ad1d657c27f9b1)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:51:24.280272 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4baf3a-8603-41af-8d48-3a7475f3f1e8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:51:24.437552 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ed4baf3a-8603-41af-8d48-3a7475f3f1e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8aa6b4d5c154ab396ad1d657c27f9b1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:51:24.449856 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ed4baf3a-8603-41af-8d48-3a7475f3f1e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8aa6b4d5c154ab396ad1d657c27f9b1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:51:24.495382 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ed4baf3a-8603-41af-8d48-3a7475f3f1e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8aa6b4d5c154ab396ad1d657c27f9b1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:51:24.496215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ed4baf3a-8603-41af-8d48-3a7475f3f1e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8aa6b4d5c154ab396ad1d657c27f9b1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:51:24.503869 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ed4baf3a-8603-41af-8d48-3a7475f3f1e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8aa6b4d5c154ab396ad1d657c27f9b1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:51:24.510396 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4258/8543] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:51:24 2022] DELETE /identity/v3/users/b8aa6b4d5c154ab396ad1d657c27f9b1 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:51:24.726137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2cddf0-2116-4766-80ee-5c620d431737 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:51:24.738529 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2cddf0-2116-4766-80ee-5c620d431737 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:51:24.797056 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021abf8-d304-4650-b9a0-fbf29e5c6fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:51:24.797869 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021abf8-d304-4650-b9a0-fbf29e5c6fc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:51:24.798155 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021abf8-d304-4650-b9a0-fbf29e5c6fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:51:24.798429 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021abf8-d304-4650-b9a0-fbf29e5c6fc5 admin admin] PATH_INFO: `/v3/projects/9e063926f9194aa7b6cf535aae766b03` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:51:24.799627 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021abf8-d304-4650-b9a0-fbf29e5c6fc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e063926f9194aa7b6cf535aae766b03)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:51:24.801548 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021abf8-d304-4650-b9a0-fbf29e5c6fc5 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:51:24.908868 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d021abf8-d304-4650-b9a0-fbf29e5c6fc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e063926f9194aa7b6cf535aae766b03', 'request_id': 'req-d021abf8-d304-4650-b9a0-fbf29e5c6fc5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:51:24.914449 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d021abf8-d304-4650-b9a0-fbf29e5c6fc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e063926f9194aa7b6cf535aae766b03', 'request_id': 'req-d021abf8-d304-4650-b9a0-fbf29e5c6fc5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:51:24.921697 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d021abf8-d304-4650-b9a0-fbf29e5c6fc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e063926f9194aa7b6cf535aae766b03', 'request_id': 'req-d021abf8-d304-4650-b9a0-fbf29e5c6fc5'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:51:25.027327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d021abf8-d304-4650-b9a0-fbf29e5c6fc5 admin admin] The token cache is being invalidate because project 9e063926f9194aa7b6cf535aae766b03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:51:25.027710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d021abf8-d304-4650-b9a0-fbf29e5c6fc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:51:25.028397 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d021abf8-d304-4650-b9a0-fbf29e5c6fc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:51:25.030135 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4286/8544] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:51:24 2022] DELETE /identity/v3/projects/9e063926f9194aa7b6cf535aae766b03 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:51:25.034206 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4baf3a-8603-41af-8d48-3a7475f3f1e8 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:51:25.035752 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ed4baf3a-8603-41af-8d48-3a7475f3f1e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:51:25.052918 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4baf3a-8603-41af-8d48-3a7475f3f1e8 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:51:25.115902 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af2441-a7af-41dc-b4b0-3288ac00d94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:51:25.116799 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af2441-a7af-41dc-b4b0-3288ac00d94e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:51:25.117065 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af2441-a7af-41dc-b4b0-3288ac00d94e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:51:25.117342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af2441-a7af-41dc-b4b0-3288ac00d94e admin admin] PATH_INFO: `/v3/users/68d0f2ff8325449fb99157e2906d44a3` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:51:25.118578 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af2441-a7af-41dc-b4b0-3288ac00d94e admin admin] RBAC: Authorizing `identity:delete_user(user_id=68d0f2ff8325449fb99157e2906d44a3)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:51:25.120621 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af2441-a7af-41dc-b4b0-3288ac00d94e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:51:25.297889 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-16af2441-a7af-41dc-b4b0-3288ac00d94e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68d0f2ff8325449fb99157e2906d44a3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:51:25.310188 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-16af2441-a7af-41dc-b4b0-3288ac00d94e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68d0f2ff8325449fb99157e2906d44a3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:51:25.364227 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-16af2441-a7af-41dc-b4b0-3288ac00d94e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68d0f2ff8325449fb99157e2906d44a3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:51:25.364850 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-16af2441-a7af-41dc-b4b0-3288ac00d94e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68d0f2ff8325449fb99157e2906d44a3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:51:25.372839 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-16af2441-a7af-41dc-b4b0-3288ac00d94e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68d0f2ff8325449fb99157e2906d44a3'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:51:25.378980 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4259/8545] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:51:25 2022] DELETE /identity/v3/users/68d0f2ff8325449fb99157e2906d44a3 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:51:25.613048 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021abf8-d304-4650-b9a0-fbf29e5c6fc5 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:51:25.614732 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d021abf8-d304-4650-b9a0-fbf29e5c6fc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:51:25.628721 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021abf8-d304-4650-b9a0-fbf29e5c6fc5 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:51:25.690272 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c03ef-be7d-4d83-8157-0a130ea13fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:51:25.691178 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c03ef-be7d-4d83-8157-0a130ea13fd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:51:25.691466 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c03ef-be7d-4d83-8157-0a130ea13fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:51:25.691744 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c03ef-be7d-4d83-8157-0a130ea13fd9 admin admin] PATH_INFO: `/v3/projects/f550ea943f1e4c6bbbc70da63f4588c6` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:51:25.692951 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4c03ef-be7d-4d83-8157-0a130ea13fd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f550ea943f1e4c6bbbc70da63f4588c6)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:51:25.695031 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4c03ef-be7d-4d83-8157-0a130ea13fd9 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:51:25.793186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6e4c03ef-be7d-4d83-8157-0a130ea13fd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f550ea943f1e4c6bbbc70da63f4588c6', 'request_id': 'req-6e4c03ef-be7d-4d83-8157-0a130ea13fd9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:51:25.798570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6e4c03ef-be7d-4d83-8157-0a130ea13fd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f550ea943f1e4c6bbbc70da63f4588c6', 'request_id': 'req-6e4c03ef-be7d-4d83-8157-0a130ea13fd9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:51:25.804723 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6e4c03ef-be7d-4d83-8157-0a130ea13fd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f550ea943f1e4c6bbbc70da63f4588c6', 'request_id': 'req-6e4c03ef-be7d-4d83-8157-0a130ea13fd9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:51:25.842807 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6e4c03ef-be7d-4d83-8157-0a130ea13fd9 admin admin] The token cache is being invalidate because project f550ea943f1e4c6bbbc70da63f4588c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:51:25.843027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6e4c03ef-be7d-4d83-8157-0a130ea13fd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:51:25.843641 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-6e4c03ef-be7d-4d83-8157-0a130ea13fd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:51:25.845161 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4287/8546] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:51:25 2022] DELETE /identity/v3/projects/f550ea943f1e4c6bbbc70da63f4588c6 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:51:25.850333 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4a556-27e2-4dbb-90b0-7241114fc4ef None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:51:25.850629 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4a556-27e2-4dbb-90b0-7241114fc4ef None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:51:25.850910 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4a556-27e2-4dbb-90b0-7241114fc4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:51:25.897605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-aca4a556-27e2-4dbb-90b0-7241114fc4ef None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:51:25.898848 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-aca4a556-27e2-4dbb-90b0-7241114fc4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:51:25.956041 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4260/8547] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:51:25.964450 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54342e4d-925b-46cf-a6b6-5370f176b21d None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:51:25.964739 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54342e4d-925b-46cf-a6b6-5370f176b21d None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:51:25.965041 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54342e4d-925b-46cf-a6b6-5370f176b21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:51:25.983465 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-54342e4d-925b-46cf-a6b6-5370f176b21d None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:51:25.984653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-54342e4d-925b-46cf-a6b6-5370f176b21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:51:25.992394 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4288/8548] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:51:25.996626 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4a556-27e2-4dbb-90b0-7241114fc4ef None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:51:26.006471 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4a556-27e2-4dbb-90b0-7241114fc4ef None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:51:26.011281 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a4db7-8f19-4ce8-a349-f2c7dabf9aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:51:26.011955 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a4db7-8f19-4ce8-a349-f2c7dabf9aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:51:26.012346 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a4db7-8f19-4ce8-a349-f2c7dabf9aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:51:26.012638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a4db7-8f19-4ce8-a349-f2c7dabf9aa4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:51:26.013395 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4a4db7-8f19-4ce8-a349-f2c7dabf9aa4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:51:26.013706 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4a4db7-8f19-4ce8-a349-f2c7dabf9aa4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:51:26.015418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4a4db7-8f19-4ce8-a349-f2c7dabf9aa4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:51:26.028024 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4261/8549] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:51:26.033632 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54342e4d-925b-46cf-a6b6-5370f176b21d None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:51:26.043512 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54342e4d-925b-46cf-a6b6-5370f176b21d None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:51:26.051258 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218678cf-d373-4c2b-87e9-0c0f7b0c2a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:51:26.051922 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218678cf-d373-4c2b-87e9-0c0f7b0c2a03 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:51:26.052204 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218678cf-d373-4c2b-87e9-0c0f7b0c2a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:51:26.052480 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218678cf-d373-4c2b-87e9-0c0f7b0c2a03 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:51:26.053169 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218678cf-d373-4c2b-87e9-0c0f7b0c2a03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:51:26.055136 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218678cf-d373-4c2b-87e9-0c0f7b0c2a03 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:51:26.126982 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4289/8550] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:51:26 2022] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:51:26.131224 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a4db7-8f19-4ce8-a349-f2c7dabf9aa4 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:51:26.141711 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a4db7-8f19-4ce8-a349-f2c7dabf9aa4 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:51:26.199039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ac4c9-c62f-42f8-90c0-3ac77bebbfd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:51:26.199720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ac4c9-c62f-42f8-90c0-3ac77bebbfd0 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:51:26.200010 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ac4c9-c62f-42f8-90c0-3ac77bebbfd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:51:26.200301 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ac4c9-c62f-42f8-90c0-3ac77bebbfd0 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:51:26.201032 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626ac4c9-c62f-42f8-90c0-3ac77bebbfd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:51:26.203025 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626ac4c9-c62f-42f8-90c0-3ac77bebbfd0 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:51:26.313231 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4262/8551] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:51:26 2022] POST /identity/v3/users => generated 289 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:51:26.317120 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218678cf-d373-4c2b-87e9-0c0f7b0c2a03 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:51:26.328007 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218678cf-d373-4c2b-87e9-0c0f7b0c2a03 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:51:26.332598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc9781-1182-4250-aa27-26807f39c928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:51:26.333248 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc9781-1182-4250-aa27-26807f39c928 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:51:26.333536 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc9781-1182-4250-aa27-26807f39c928 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:51:26.333835 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc9781-1182-4250-aa27-26807f39c928 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:51:26.334550 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dc9781-1182-4250-aa27-26807f39c928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:51:26.336154 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dc9781-1182-4250-aa27-26807f39c928 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:51:26.348031 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4290/8552] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 21:51:26.352088 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ac4c9-c62f-42f8-90c0-3ac77bebbfd0 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:51:26.362311 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ac4c9-c62f-42f8-90c0-3ac77bebbfd0 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:51:26.369438 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddddb2a-0861-4220-a2fe-0a2a10237606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:51:26.369438 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddddb2a-0861-4220-a2fe-0a2a10237606 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:51:26.369438 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddddb2a-0861-4220-a2fe-0a2a10237606 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:51:26.369438 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddddb2a-0861-4220-a2fe-0a2a10237606 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:51:26.369888 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddddb2a-0861-4220-a2fe-0a2a10237606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:51:26.370681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddddb2a-0861-4220-a2fe-0a2a10237606 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:51:26.380554 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4263/8553] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:51:26.384744 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc9781-1182-4250-aa27-26807f39c928 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:51:26.395395 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc9781-1182-4250-aa27-26807f39c928 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:51:26.400324 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226e219-6617-4699-ade4-e3b02d3420a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:51:26.401750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226e219-6617-4699-ade4-e3b02d3420a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:51:26.402093 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226e219-6617-4699-ade4-e3b02d3420a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:51:26.402371 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226e219-6617-4699-ade4-e3b02d3420a0 admin admin] PATH_INFO: `/v3/projects/839ab2af4d6b40c3b957be9c7dc78b26/users/4d838be38c1941eba44ffcfc6c17f002/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:51:26.417283 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226e219-6617-4699-ade4-e3b02d3420a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=839ab2af4d6b40c3b957be9c7dc78b26, user_id=4d838be38c1941eba44ffcfc6c17f002, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:51:26.420008 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226e219-6617-4699-ade4-e3b02d3420a0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:51:26.513418 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4291/8554] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:51:26 2022] PUT /identity/v3/projects/839ab2af4d6b40c3b957be9c7dc78b26/users/4d838be38c1941eba44ffcfc6c17f002/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:51:26.518696 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7593a80-03b5-4be5-878d-c5509df3e6af None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:51:26.518990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7593a80-03b5-4be5-878d-c5509df3e6af None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:51:26.519454 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7593a80-03b5-4be5-878d-c5509df3e6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:51:26.538779 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-c7593a80-03b5-4be5-878d-c5509df3e6af None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:51:26.540076 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c7593a80-03b5-4be5-878d-c5509df3e6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:51:26.599057 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4264/8555] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:51:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:51:26.608965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226e219-6617-4699-ade4-e3b02d3420a0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:51:26.610813 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3226e219-6617-4699-ade4-e3b02d3420a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:51:26.668175 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226e219-6617-4699-ade4-e3b02d3420a0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:51:26.671723 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7c7e6-fa85-4230-b718-9daa9c4cee4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:51:26.672359 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7c7e6-fa85-4230-b718-9daa9c4cee4c service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:51:26.672639 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7c7e6-fa85-4230-b718-9daa9c4cee4c service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:51:26.672912 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7c7e6-fa85-4230-b718-9daa9c4cee4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:51:26.681830 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c7c7e6-fa85-4230-b718-9daa9c4cee4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:51:26.683328 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c7c7e6-fa85-4230-b718-9daa9c4cee4c service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:51:26.692536 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4292/8556] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:51:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:51:32.111683 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53209f67-b2d1-4e6c-a035-5eafdca930ae None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:51:32.112225 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53209f67-b2d1-4e6c-a035-5eafdca930ae None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:51:32.112225 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53209f67-b2d1-4e6c-a035-5eafdca930ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:51:32.141866 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-53209f67-b2d1-4e6c-a035-5eafdca930ae None None] MFA Rules not processed for user `4d838be38c1941eba44ffcfc6c17f002`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:51:32.143173 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-53209f67-b2d1-4e6c-a035-5eafdca930ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:51:32.214158 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4265/8557] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:51:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:51:32.218441 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7c7e6-fa85-4230-b718-9daa9c4cee4c service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:51:32.230378 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7c7e6-fa85-4230-b718-9daa9c4cee4c service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:51:32.235330 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecd12c-cd34-443f-9ae5-a433ee16ff2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:51:32.235986 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecd12c-cd34-443f-9ae5-a433ee16ff2d admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:51:32.236268 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecd12c-cd34-443f-9ae5-a433ee16ff2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:51:32.236543 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecd12c-cd34-443f-9ae5-a433ee16ff2d admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:51:32.237233 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ecd12c-cd34-443f-9ae5-a433ee16ff2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:51:32.239171 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ecd12c-cd34-443f-9ae5-a433ee16ff2d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:51:32.348562 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4293/8558] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:51:32 2022] POST /identity/v3/projects => generated 379 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:51:32.352765 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53209f67-b2d1-4e6c-a035-5eafdca930ae None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:51:32.363630 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53209f67-b2d1-4e6c-a035-5eafdca930ae None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:51:32.419681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302c0e3-c5a3-4255-ba96-0a56b1404765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:51:32.420356 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302c0e3-c5a3-4255-ba96-0a56b1404765 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:51:32.420646 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302c0e3-c5a3-4255-ba96-0a56b1404765 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:51:32.420924 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302c0e3-c5a3-4255-ba96-0a56b1404765 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:51:32.421605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0302c0e3-c5a3-4255-ba96-0a56b1404765 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:51:32.423604 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0302c0e3-c5a3-4255-ba96-0a56b1404765 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:51:32.483958 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4266/8559] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:51:32 2022] POST /identity/v3/users => generated 296 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:51:32.488020 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecd12c-cd34-443f-9ae5-a433ee16ff2d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:51:32.499664 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecd12c-cd34-443f-9ae5-a433ee16ff2d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:51:32.504485 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ce8de-dbc7-4661-ae10-c4f7049524d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:51:32.505150 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ce8de-dbc7-4661-ae10-c4f7049524d5 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:51:32.505453 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ce8de-dbc7-4661-ae10-c4f7049524d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:51:32.505730 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ce8de-dbc7-4661-ae10-c4f7049524d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:51:32.506486 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ce8de-dbc7-4661-ae10-c4f7049524d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:51:32.508250 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ce8de-dbc7-4661-ae10-c4f7049524d5 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:51:32.520138 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4294/8560] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:51:32.524560 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302c0e3-c5a3-4255-ba96-0a56b1404765 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:51:32.535224 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302c0e3-c5a3-4255-ba96-0a56b1404765 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:51:32.539817 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b1ea3-c19f-4d71-8d94-9d83fa7e7ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:51:32.540678 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b1ea3-c19f-4d71-8d94-9d83fa7e7ed5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:51:32.540955 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b1ea3-c19f-4d71-8d94-9d83fa7e7ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:51:32.541227 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b1ea3-c19f-4d71-8d94-9d83fa7e7ed5 admin admin] PATH_INFO: `/v3/projects/f6180e89be2d47d08e89a0fc4dba5abd/users/a3f48ce0bfa5471990cb06e76772f64f/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:51:32.555588 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7b1ea3-c19f-4d71-8d94-9d83fa7e7ed5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6180e89be2d47d08e89a0fc4dba5abd, user_id=a3f48ce0bfa5471990cb06e76772f64f, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:51:32.558385 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7b1ea3-c19f-4d71-8d94-9d83fa7e7ed5 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:51:32.615315 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4267/8561] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:51:32 2022] PUT /identity/v3/projects/f6180e89be2d47d08e89a0fc4dba5abd/users/a3f48ce0bfa5471990cb06e76772f64f/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:51:32.619518 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ce8de-dbc7-4661-ae10-c4f7049524d5 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:51:32.629388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ce8de-dbc7-4661-ae10-c4f7049524d5 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:51:32.684321 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603e960-cdf5-4bc9-a151-0d1140fb1364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:51:32.685019 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603e960-cdf5-4bc9-a151-0d1140fb1364 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:51:32.685330 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603e960-cdf5-4bc9-a151-0d1140fb1364 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:51:32.685611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603e960-cdf5-4bc9-a151-0d1140fb1364 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:51:32.686394 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2603e960-cdf5-4bc9-a151-0d1140fb1364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:51:32.688000 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2603e960-cdf5-4bc9-a151-0d1140fb1364 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:51:32.698699 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4295/8562] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:51:32.702722 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b1ea3-c19f-4d71-8d94-9d83fa7e7ed5 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:51:32.714495 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b1ea3-c19f-4d71-8d94-9d83fa7e7ed5 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:51:32.720768 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11c99a-f9e9-41b5-b962-5080c6b55b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:51:32.720768 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11c99a-f9e9-41b5-b962-5080c6b55b28 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:51:32.720768 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11c99a-f9e9-41b5-b962-5080c6b55b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:51:32.721049 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11c99a-f9e9-41b5-b962-5080c6b55b28 admin admin] PATH_INFO: `/v3/projects/f6180e89be2d47d08e89a0fc4dba5abd/users/a3f48ce0bfa5471990cb06e76772f64f/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:51:32.722959 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11c99a-f9e9-41b5-b962-5080c6b55b28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6180e89be2d47d08e89a0fc4dba5abd, user_id=a3f48ce0bfa5471990cb06e76772f64f, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:51:32.725946 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11c99a-f9e9-41b5-b962-5080c6b55b28 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:51:32.739911 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4268/8563] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:51:32 2022] PUT /identity/v3/projects/f6180e89be2d47d08e89a0fc4dba5abd/users/a3f48ce0bfa5471990cb06e76772f64f/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:51:38.486966 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acffe0-fd3c-4dca-859d-b07682d59f2d None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:51:38.487448 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acffe0-fd3c-4dca-859d-b07682d59f2d None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:51:38.488166 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acffe0-fd3c-4dca-859d-b07682d59f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:51:38.518445 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-c4acffe0-fd3c-4dca-859d-b07682d59f2d None None] MFA Rules not processed for user `a3f48ce0bfa5471990cb06e76772f64f`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:51:38.519995 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c4acffe0-fd3c-4dca-859d-b07682d59f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:51:38.597517 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4296/8564] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:51:38 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:51:38.610140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11c99a-f9e9-41b5-b962-5080c6b55b28 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:51:38.611888 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ec11c99a-f9e9-41b5-b962-5080c6b55b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:51:38.702212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11c99a-f9e9-41b5-b962-5080c6b55b28 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:51:38.706081 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffdad1f-0f56-4c0c-8824-c47cad44416f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e302b1298dd04d6590e3d079f7b13b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:51:38.706748 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdad1f-0f56-4c0c-8824-c47cad44416f service glance] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:51:38.707024 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdad1f-0f56-4c0c-8824-c47cad44416f service glance] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:51:38.707493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdad1f-0f56-4c0c-8824-c47cad44416f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:51:38.786479 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffdad1f-0f56-4c0c-8824-c47cad44416f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:51:38.787941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffdad1f-0f56-4c0c-8824-c47cad44416f service glance] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:51:38.797294 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4269/8565] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:51:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:51:48.475664 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9125b5c-8bb3-447d-914e-3be66419d44f None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:51:48.476223 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9125b5c-8bb3-447d-914e-3be66419d44f None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:51:48.476223 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9125b5c-8bb3-447d-914e-3be66419d44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:51:48.494060 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-b9125b5c-8bb3-447d-914e-3be66419d44f None None] MFA Rules not processed for user `4d838be38c1941eba44ffcfc6c17f002`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:51:48.495242 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b9125b5c-8bb3-447d-914e-3be66419d44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:51:48.502077 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4297/8566] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:51:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:51:48.536682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffdad1f-0f56-4c0c-8824-c47cad44416f service glance] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:51:48.538120 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8ffdad1f-0f56-4c0c-8824-c47cad44416f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:51:48.596142 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffdad1f-0f56-4c0c-8824-c47cad44416f service glance] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:51:48.599847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe2a47-c843-4023-bb49-c9f74e8e4f74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:51:48.603189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe2a47-c843-4023-bb49-c9f74e8e4f74 service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:51:48.603189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe2a47-c843-4023-bb49-c9f74e8e4f74 service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:51:48.603189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe2a47-c843-4023-bb49-c9f74e8e4f74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:51:48.603189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e6fe2a47-c843-4023-bb49-c9f74e8e4f74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:51:48.677103 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fe2a47-c843-4023-bb49-c9f74e8e4f74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:51:48.678621 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fe2a47-c843-4023-bb49-c9f74e8e4f74 service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:51:48.692989 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4270/8567] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:51:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:51:48.952217 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9125b5c-8bb3-447d-914e-3be66419d44f None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:51:49.007911 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9125b5c-8bb3-447d-914e-3be66419d44f None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:51:49.012005 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937346a3-8bd3-4452-841f-2f0c9a8efa79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:51:49.012642 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937346a3-8bd3-4452-841f-2f0c9a8efa79 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:51:49.012922 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937346a3-8bd3-4452-841f-2f0c9a8efa79 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:51:49.013226 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937346a3-8bd3-4452-841f-2f0c9a8efa79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:51:49.015010 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-937346a3-8bd3-4452-841f-2f0c9a8efa79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:51:49.027493 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937346a3-8bd3-4452-841f-2f0c9a8efa79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:51:49.028918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937346a3-8bd3-4452-841f-2f0c9a8efa79 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:51:49.039154 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4298/8568] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:51:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:51:49.461775 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe2a47-c843-4023-bb49-c9f74e8e4f74 service cinder] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:51:49.463253 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e6fe2a47-c843-4023-bb49-c9f74e8e4f74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:51:49.468722 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937346a3-8bd3-4452-841f-2f0c9a8efa79 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:51:49.479938 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937346a3-8bd3-4452-841f-2f0c9a8efa79 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:51:49.483842 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17858b-1ffc-41b3-a9a4-e448c8cdd080 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:51:49.484566 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17858b-1ffc-41b3-a9a4-e448c8cdd080 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:51:49.484862 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17858b-1ffc-41b3-a9a4-e448c8cdd080 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:51:49.485147 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17858b-1ffc-41b3-a9a4-e448c8cdd080 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:51:49.486967 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5e17858b-1ffc-41b3-a9a4-e448c8cdd080 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:51:49.510557 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17858b-1ffc-41b3-a9a4-e448c8cdd080 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:51:49.512062 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17858b-1ffc-41b3-a9a4-e448c8cdd080 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:51:49.527734 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4299/8569] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:51:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:51:49.547745 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe2a47-c843-4023-bb49-c9f74e8e4f74 service cinder] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:51:49.553191 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13f205-7bc6-4cb9-8f76-b5b150f6a5de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:51:49.553888 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13f205-7bc6-4cb9-8f76-b5b150f6a5de service placement] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:51:49.554174 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13f205-7bc6-4cb9-8f76-b5b150f6a5de service placement] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:51:49.554462 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13f205-7bc6-4cb9-8f76-b5b150f6a5de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:51:49.556221 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6f13f205-7bc6-4cb9-8f76-b5b150f6a5de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:51:49.571601 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13f205-7bc6-4cb9-8f76-b5b150f6a5de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:51:49.574752 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13f205-7bc6-4cb9-8f76-b5b150f6a5de service placement] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:51:49.589955 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4271/8570] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:51:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:51:52.385975 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17858b-1ffc-41b3-a9a4-e448c8cdd080 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:51:52.388186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5e17858b-1ffc-41b3-a9a4-e448c8cdd080 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:51:52.406808 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17858b-1ffc-41b3-a9a4-e448c8cdd080 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:51:52.415449 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02b5f2-9ffd-4d21-b86c-515606b1659e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:51:52.416364 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02b5f2-9ffd-4d21-b86c-515606b1659e service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:51:52.416764 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02b5f2-9ffd-4d21-b86c-515606b1659e service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:51:52.417177 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02b5f2-9ffd-4d21-b86c-515606b1659e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:51:52.419304 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6d02b5f2-9ffd-4d21-b86c-515606b1659e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:51:52.434915 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02b5f2-9ffd-4d21-b86c-515606b1659e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:51:52.436388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02b5f2-9ffd-4d21-b86c-515606b1659e service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:51:52.452599 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4300/8571] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:51:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:51:53.226553 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13f205-7bc6-4cb9-8f76-b5b150f6a5de service placement] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:51:53.229320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6f13f205-7bc6-4cb9-8f76-b5b150f6a5de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:51:53.252929 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13f205-7bc6-4cb9-8f76-b5b150f6a5de service placement] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:51:53.265619 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187fbf3-07fc-4a55-ac7e-1de329165924 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:51:53.265619 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187fbf3-07fc-4a55-ac7e-1de329165924 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:51:53.265619 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187fbf3-07fc-4a55-ac7e-1de329165924 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:51:53.265619 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187fbf3-07fc-4a55-ac7e-1de329165924 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:51:53.266057 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0187fbf3-07fc-4a55-ac7e-1de329165924 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:51:53.286872 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0187fbf3-07fc-4a55-ac7e-1de329165924 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:51:53.288576 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0187fbf3-07fc-4a55-ac7e-1de329165924 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:51:53.308694 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4272/8572] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:51:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:52:04.340127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02b5f2-9ffd-4d21-b86c-515606b1659e service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:52:04.356166 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02b5f2-9ffd-4d21-b86c-515606b1659e service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:52:04.361899 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef620b4e-5219-4980-ba88-efcaa0831a7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:52:04.362434 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef620b4e-5219-4980-ba88-efcaa0831a7a service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:52:04.362715 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef620b4e-5219-4980-ba88-efcaa0831a7a service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:52:04.362991 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef620b4e-5219-4980-ba88-efcaa0831a7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:52:04.364755 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ef620b4e-5219-4980-ba88-efcaa0831a7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:52:04.379570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef620b4e-5219-4980-ba88-efcaa0831a7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:52:04.381162 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef620b4e-5219-4980-ba88-efcaa0831a7a service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:52:04.394823 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4301/8573] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:52:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:52:27.301666 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187fbf3-07fc-4a55-ac7e-1de329165924 service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:52:27.314192 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187fbf3-07fc-4a55-ac7e-1de329165924 service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:52:27.318060 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3ffc1-f2a8-49e5-99cd-840296ead1d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:52:27.318714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3ffc1-f2a8-49e5-99cd-840296ead1d0 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:52:27.319000 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3ffc1-f2a8-49e5-99cd-840296ead1d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:52:27.319282 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3ffc1-f2a8-49e5-99cd-840296ead1d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:52:27.322010 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-dcf3ffc1-f2a8-49e5-99cd-840296ead1d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:52:27.392422 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3ffc1-f2a8-49e5-99cd-840296ead1d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:52:27.393906 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3ffc1-f2a8-49e5-99cd-840296ead1d0 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:52:27.403745 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4273/8574] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:52:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:52:28.421366 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef620b4e-5219-4980-ba88-efcaa0831a7a service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:52:28.422997 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ef620b4e-5219-4980-ba88-efcaa0831a7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:52:28.437591 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef620b4e-5219-4980-ba88-efcaa0831a7a service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:52:28.442818 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1dd0c-a809-4070-aecb-40e1ad6baeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:52:28.443684 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1dd0c-a809-4070-aecb-40e1ad6baeb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:52:28.443960 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1dd0c-a809-4070-aecb-40e1ad6baeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:52:28.446455 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1dd0c-a809-4070-aecb-40e1ad6baeb0 admin admin] PATH_INFO: `/v3/users/0ed9fb1a529f4247acd72a6de21ceb4c` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:52:28.446455 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b1dd0c-a809-4070-aecb-40e1ad6baeb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ed9fb1a529f4247acd72a6de21ceb4c)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:52:28.447329 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b1dd0c-a809-4070-aecb-40e1ad6baeb0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:52:28.604856 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-80b1dd0c-a809-4070-aecb-40e1ad6baeb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ed9fb1a529f4247acd72a6de21ceb4c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:52:28.616451 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-80b1dd0c-a809-4070-aecb-40e1ad6baeb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ed9fb1a529f4247acd72a6de21ceb4c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:52:28.724081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-80b1dd0c-a809-4070-aecb-40e1ad6baeb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ed9fb1a529f4247acd72a6de21ceb4c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:52:28.731320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-80b1dd0c-a809-4070-aecb-40e1ad6baeb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ed9fb1a529f4247acd72a6de21ceb4c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:52:28.731941 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-80b1dd0c-a809-4070-aecb-40e1ad6baeb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ed9fb1a529f4247acd72a6de21ceb4c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:52:28.738105 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4302/8575] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:52:28 2022] DELETE /identity/v3/users/0ed9fb1a529f4247acd72a6de21ceb4c => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 21:52:28.959914 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3ffc1-f2a8-49e5-99cd-840296ead1d0 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:52:28.970768 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3ffc1-f2a8-49e5-99cd-840296ead1d0 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:52:29.028302 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82646e88-891b-41d0-9909-30dd3cf051e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:52:29.029188 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82646e88-891b-41d0-9909-30dd3cf051e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:52:29.029479 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82646e88-891b-41d0-9909-30dd3cf051e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:52:29.029774 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82646e88-891b-41d0-9909-30dd3cf051e1 admin admin] PATH_INFO: `/v3/projects/d1febcefe29f461ea37667520a278022` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:52:29.030994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82646e88-891b-41d0-9909-30dd3cf051e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1febcefe29f461ea37667520a278022)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:52:29.033200 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82646e88-891b-41d0-9909-30dd3cf051e1 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:52:29.135074 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-82646e88-891b-41d0-9909-30dd3cf051e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1febcefe29f461ea37667520a278022', 'request_id': 'req-82646e88-891b-41d0-9909-30dd3cf051e1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:52:29.140389 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-82646e88-891b-41d0-9909-30dd3cf051e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1febcefe29f461ea37667520a278022', 'request_id': 'req-82646e88-891b-41d0-9909-30dd3cf051e1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:52:29.146589 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-82646e88-891b-41d0-9909-30dd3cf051e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1febcefe29f461ea37667520a278022', 'request_id': 'req-82646e88-891b-41d0-9909-30dd3cf051e1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:52:29.225937 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-82646e88-891b-41d0-9909-30dd3cf051e1 admin admin] The token cache is being invalidate because project d1febcefe29f461ea37667520a278022 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:52:29.226273 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-82646e88-891b-41d0-9909-30dd3cf051e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:52:29.226884 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-82646e88-891b-41d0-9909-30dd3cf051e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:52:29.228418 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4274/8576] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:52:28 2022] DELETE /identity/v3/projects/d1febcefe29f461ea37667520a278022 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:52:29.233696 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b414f15-aed7-4901-a459-fd3cd5b826fc None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:52:29.234023 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b414f15-aed7-4901-a459-fd3cd5b826fc None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:52:29.234329 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b414f15-aed7-4901-a459-fd3cd5b826fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:52:29.252564 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-9b414f15-aed7-4901-a459-fd3cd5b826fc None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:52:29.253782 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9b414f15-aed7-4901-a459-fd3cd5b826fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:52:29.313322 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4303/8577] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:52:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:52:29.321551 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2131e0-fd62-48a2-9f57-4f1d9c6eea39 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:52:29.321927 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2131e0-fd62-48a2-9f57-4f1d9c6eea39 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:52:29.322205 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2131e0-fd62-48a2-9f57-4f1d9c6eea39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:52:29.341648 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-2e2131e0-fd62-48a2-9f57-4f1d9c6eea39 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:52:29.342908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2e2131e0-fd62-48a2-9f57-4f1d9c6eea39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:52:29.351017 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4275/8578] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:52:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:52:29.355257 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b414f15-aed7-4901-a459-fd3cd5b826fc None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:52:29.366376 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b414f15-aed7-4901-a459-fd3cd5b826fc None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:52:29.371314 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96108ded-6ece-46ce-a7af-d444018c9d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:52:29.371976 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96108ded-6ece-46ce-a7af-d444018c9d22 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:52:29.372261 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96108ded-6ece-46ce-a7af-d444018c9d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:52:29.372541 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96108ded-6ece-46ce-a7af-d444018c9d22 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:52:29.373261 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96108ded-6ece-46ce-a7af-d444018c9d22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 21:52:29.373569 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96108ded-6ece-46ce-a7af-d444018c9d22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:52:29.375226 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96108ded-6ece-46ce-a7af-d444018c9d22 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:52:29.387595 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4304/8579] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 21:52:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 21:52:29.392005 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2131e0-fd62-48a2-9f57-4f1d9c6eea39 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:52:29.401560 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2131e0-fd62-48a2-9f57-4f1d9c6eea39 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:52:29.406263 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955c73a-0678-4872-ae1b-7f54fa09786e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:52:29.406907 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955c73a-0678-4872-ae1b-7f54fa09786e admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:52:29.407189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955c73a-0678-4872-ae1b-7f54fa09786e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:52:29.407465 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955c73a-0678-4872-ae1b-7f54fa09786e admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:52:29.408143 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955c73a-0678-4872-ae1b-7f54fa09786e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:52:29.410081 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955c73a-0678-4872-ae1b-7f54fa09786e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:52:29.485049 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4276/8580] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:52:29 2022] POST /identity/v3/projects => generated 391 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:52:29.490008 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96108ded-6ece-46ce-a7af-d444018c9d22 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:52:29.499866 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96108ded-6ece-46ce-a7af-d444018c9d22 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:52:29.557774 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467edee-294c-416a-ac78-c1c8d4320c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:52:29.558467 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467edee-294c-416a-ac78-c1c8d4320c76 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:52:29.558755 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467edee-294c-416a-ac78-c1c8d4320c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:52:29.559033 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467edee-294c-416a-ac78-c1c8d4320c76 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:52:29.559768 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467edee-294c-416a-ac78-c1c8d4320c76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:52:29.561645 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6467edee-294c-416a-ac78-c1c8d4320c76 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:52:29.649465 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4305/8581] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:52:29 2022] POST /identity/v3/users => generated 296 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:52:29.653473 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955c73a-0678-4872-ae1b-7f54fa09786e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:52:29.663854 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955c73a-0678-4872-ae1b-7f54fa09786e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:52:29.668444 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2da51-dcf4-4e79-a083-700d7e4bf57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:52:29.669102 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2da51-dcf4-4e79-a083-700d7e4bf57e admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:52:29.669386 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2da51-dcf4-4e79-a083-700d7e4bf57e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:52:29.669661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2da51-dcf4-4e79-a083-700d7e4bf57e admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:52:29.670462 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2da51-dcf4-4e79-a083-700d7e4bf57e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:52:29.672066 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2da51-dcf4-4e79-a083-700d7e4bf57e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:52:29.682206 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4277/8582] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:52:29.685959 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467edee-294c-416a-ac78-c1c8d4320c76 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:52:29.696165 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467edee-294c-416a-ac78-c1c8d4320c76 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:52:29.700788 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09193c4a-5e96-4853-af0e-69cdfd6a10e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:52:29.701434 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09193c4a-5e96-4853-af0e-69cdfd6a10e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:52:29.701718 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09193c4a-5e96-4853-af0e-69cdfd6a10e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:52:29.702027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09193c4a-5e96-4853-af0e-69cdfd6a10e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:52:29.702747 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09193c4a-5e96-4853-af0e-69cdfd6a10e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:52:29.704402 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09193c4a-5e96-4853-af0e-69cdfd6a10e8 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:52:29.716468 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4306/8583] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:52:29.720465 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2da51-dcf4-4e79-a083-700d7e4bf57e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:52:29.730697 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2da51-dcf4-4e79-a083-700d7e4bf57e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:52:29.735416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0bde67-88b2-4cf1-9c3f-a1ea4e807c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:52:29.736288 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0bde67-88b2-4cf1-9c3f-a1ea4e807c63 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:52:29.736655 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0bde67-88b2-4cf1-9c3f-a1ea4e807c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:52:29.736840 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0bde67-88b2-4cf1-9c3f-a1ea4e807c63 admin admin] PATH_INFO: `/v3/projects/12f7d764a613404a9be3d0a9d325c8f6/users/9294e527a38c483482c6a49091c226c9/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:52:29.751028 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0bde67-88b2-4cf1-9c3f-a1ea4e807c63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12f7d764a613404a9be3d0a9d325c8f6, user_id=9294e527a38c483482c6a49091c226c9, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:52:29.753678 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0bde67-88b2-4cf1-9c3f-a1ea4e807c63 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:52:29.849002 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4278/8584] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:52:29 2022] PUT /identity/v3/projects/12f7d764a613404a9be3d0a9d325c8f6/users/9294e527a38c483482c6a49091c226c9/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:52:29.859553 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80099c4-3679-4012-adf0-903c24f0e9ff None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:52:29.862782 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80099c4-3679-4012-adf0-903c24f0e9ff None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:52:29.862782 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80099c4-3679-4012-adf0-903c24f0e9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:52:29.890900 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-b80099c4-3679-4012-adf0-903c24f0e9ff None None] MFA Rules not processed for user `9294e527a38c483482c6a49091c226c9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:52:29.892103 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b80099c4-3679-4012-adf0-903c24f0e9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:52:29.953770 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4307/8585] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:52:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:52:29.958446 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0bde67-88b2-4cf1-9c3f-a1ea4e807c63 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:52:30.018528 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0bde67-88b2-4cf1-9c3f-a1ea4e807c63 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:52:30.023154 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8062b5e-9214-4407-9b41-dba33f0ad181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:52:30.024061 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8062b5e-9214-4407-9b41-dba33f0ad181 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:52:30.024344 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8062b5e-9214-4407-9b41-dba33f0ad181 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:52:30.024619 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8062b5e-9214-4407-9b41-dba33f0ad181 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:52:30.025292 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8062b5e-9214-4407-9b41-dba33f0ad181 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:52:30.027317 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8062b5e-9214-4407-9b41-dba33f0ad181 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:52:30.130810 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4279/8586] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 21:52:29 2022] POST /identity/v3/projects => generated 391 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:52:30.134903 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80099c4-3679-4012-adf0-903c24f0e9ff None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:52:30.145449 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80099c4-3679-4012-adf0-903c24f0e9ff None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:52:30.200290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d291d063-7599-4c5f-87dd-d59a9114f5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:52:30.200951 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291d063-7599-4c5f-87dd-d59a9114f5b0 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:52:30.201231 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291d063-7599-4c5f-87dd-d59a9114f5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:52:30.201508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291d063-7599-4c5f-87dd-d59a9114f5b0 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:52:30.202242 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d291d063-7599-4c5f-87dd-d59a9114f5b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:52:30.206222 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d291d063-7599-4c5f-87dd-d59a9114f5b0 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:52:30.307155 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4308/8587] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 21:52:30 2022] POST /identity/v3/users => generated 302 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 21:52:30.311241 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8062b5e-9214-4407-9b41-dba33f0ad181 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:52:30.321584 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8062b5e-9214-4407-9b41-dba33f0ad181 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:52:30.326224 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b967ae-790d-43d2-ae31-405b5b7a7ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:52:30.326883 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b967ae-790d-43d2-ae31-405b5b7a7ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:52:30.327171 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b967ae-790d-43d2-ae31-405b5b7a7ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:52:30.327451 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b967ae-790d-43d2-ae31-405b5b7a7ae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:52:30.328430 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b967ae-790d-43d2-ae31-405b5b7a7ae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:52:30.330092 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b967ae-790d-43d2-ae31-405b5b7a7ae7 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:52:30.340720 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4280/8588] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:52:30.345010 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d291d063-7599-4c5f-87dd-d59a9114f5b0 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:52:30.355752 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d291d063-7599-4c5f-87dd-d59a9114f5b0 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:52:30.360414 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c0643-8875-4741-9ab9-ee241e6298de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:52:30.361290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c0643-8875-4741-9ab9-ee241e6298de admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:52:30.361574 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c0643-8875-4741-9ab9-ee241e6298de admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:52:30.361888 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c0643-8875-4741-9ab9-ee241e6298de admin admin] PATH_INFO: `/v3/projects/a1a221b784f54288ba132d18b7785965/users/1f895f6258fe4d38bfa01a33d9d51f2e/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:52:30.376855 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c0643-8875-4741-9ab9-ee241e6298de admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1a221b784f54288ba132d18b7785965, user_id=1f895f6258fe4d38bfa01a33d9d51f2e, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:52:30.379608 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c0643-8875-4741-9ab9-ee241e6298de admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:52:30.478416 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4309/8589] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:52:30 2022] PUT /identity/v3/projects/a1a221b784f54288ba132d18b7785965/users/1f895f6258fe4d38bfa01a33d9d51f2e/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:52:30.482494 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b967ae-790d-43d2-ae31-405b5b7a7ae7 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:52:30.493032 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b967ae-790d-43d2-ae31-405b5b7a7ae7 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:52:30.549746 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012ca47-5b5a-46a8-bf66-13ab3986652d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:52:30.550438 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012ca47-5b5a-46a8-bf66-13ab3986652d admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:52:30.550763 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012ca47-5b5a-46a8-bf66-13ab3986652d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:52:30.551040 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012ca47-5b5a-46a8-bf66-13ab3986652d admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:52:30.552458 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012ca47-5b5a-46a8-bf66-13ab3986652d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:52:30.554136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012ca47-5b5a-46a8-bf66-13ab3986652d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:52:30.563924 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4281/8590] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 21:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 21:52:30.568221 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c0643-8875-4741-9ab9-ee241e6298de admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:52:30.578697 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c0643-8875-4741-9ab9-ee241e6298de admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:52:30.583795 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df289cb9-b296-44b9-9831-7e9218813d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:52:30.584673 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df289cb9-b296-44b9-9831-7e9218813d30 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:52:30.584999 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df289cb9-b296-44b9-9831-7e9218813d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:52:30.585278 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df289cb9-b296-44b9-9831-7e9218813d30 admin admin] PATH_INFO: `/v3/projects/a1a221b784f54288ba132d18b7785965/users/1f895f6258fe4d38bfa01a33d9d51f2e/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:52:30.587303 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df289cb9-b296-44b9-9831-7e9218813d30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1a221b784f54288ba132d18b7785965, user_id=1f895f6258fe4d38bfa01a33d9d51f2e, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:52:30.589983 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df289cb9-b296-44b9-9831-7e9218813d30 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:52:30.600565 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4310/8591] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 21:52:30 2022] PUT /identity/v3/projects/a1a221b784f54288ba132d18b7785965/users/1f895f6258fe4d38bfa01a33d9d51f2e/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:52:30.610952 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a64a5-d3d5-475b-8b5d-ea518a69ea47 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:52:30.611311 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a64a5-d3d5-475b-8b5d-ea518a69ea47 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:52:30.611661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a64a5-d3d5-475b-8b5d-ea518a69ea47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:52:30.637275 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-032a64a5-d3d5-475b-8b5d-ea518a69ea47 None None] MFA Rules not processed for user `1f895f6258fe4d38bfa01a33d9d51f2e`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:52:30.638506 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-032a64a5-d3d5-475b-8b5d-ea518a69ea47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:52:30.704891 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4282/8592] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:52:30 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:52:30.717250 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df289cb9-b296-44b9-9831-7e9218813d30 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:52:30.718976 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-df289cb9-b296-44b9-9831-7e9218813d30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:52:30.797850 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df289cb9-b296-44b9-9831-7e9218813d30 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:52:30.803864 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd1511-df93-4a86-b062-786f3830f20d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:52:30.805913 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd1511-df93-4a86-b062-786f3830f20d service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:52:30.805913 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd1511-df93-4a86-b062-786f3830f20d service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:52:30.805913 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd1511-df93-4a86-b062-786f3830f20d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:52:30.859998 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd1511-df93-4a86-b062-786f3830f20d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:52:30.861583 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd1511-df93-4a86-b062-786f3830f20d service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:52:30.870397 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4311/8593] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:52:30 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:52:35.668559 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a64a5-d3d5-475b-8b5d-ea518a69ea47 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:52:35.670202 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-032a64a5-d3d5-475b-8b5d-ea518a69ea47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:52:35.732011 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a64a5-d3d5-475b-8b5d-ea518a69ea47 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:52:35.735567 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707ea21-bbc0-4443-9cd2-60015c41cd6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:52:35.736403 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707ea21-bbc0-4443-9cd2-60015c41cd6d service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:52:35.736690 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707ea21-bbc0-4443-9cd2-60015c41cd6d service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:52:35.736969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707ea21-bbc0-4443-9cd2-60015c41cd6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:52:35.747225 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b707ea21-bbc0-4443-9cd2-60015c41cd6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:52:35.750696 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b707ea21-bbc0-4443-9cd2-60015c41cd6d service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:52:35.758717 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4283/8594] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:52:35 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:52:36.774688 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721b73c-abc1-4121-bcfc-2064ef855b65 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:52:36.777292 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721b73c-abc1-4121-bcfc-2064ef855b65 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:52:36.777292 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721b73c-abc1-4121-bcfc-2064ef855b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:52:36.799051 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-2721b73c-abc1-4121-bcfc-2064ef855b65 None None] MFA Rules not processed for user `4d838be38c1941eba44ffcfc6c17f002`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:52:36.800570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2721b73c-abc1-4121-bcfc-2064ef855b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:52:36.874130 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4312/8595] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:52:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:52:37.649825 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707ea21-bbc0-4443-9cd2-60015c41cd6d service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:52:37.677160 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707ea21-bbc0-4443-9cd2-60015c41cd6d service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:52:37.690385 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8314f0-9f84-4b7d-8946-71981052b0fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:52:37.691360 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8314f0-9f84-4b7d-8946-71981052b0fa service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:52:37.692358 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8314f0-9f84-4b7d-8946-71981052b0fa service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:52:37.692809 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8314f0-9f84-4b7d-8946-71981052b0fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:52:37.695204 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ee8314f0-9f84-4b7d-8946-71981052b0fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:52:37.713406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8314f0-9f84-4b7d-8946-71981052b0fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:52:37.721775 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8314f0-9f84-4b7d-8946-71981052b0fa service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:52:37.744482 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4284/8596] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:52:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:52:39.745603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6220e-00d1-48e1-8faa-8579f555f138 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:52:39.746223 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6220e-00d1-48e1-8faa-8579f555f138 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:52:39.746517 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6220e-00d1-48e1-8faa-8579f555f138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:52:39.776692 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-98f6220e-00d1-48e1-8faa-8579f555f138 None None] MFA Rules not processed for user `9294e527a38c483482c6a49091c226c9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:52:39.778597 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-98f6220e-00d1-48e1-8faa-8579f555f138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:52:39.792930 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4313/8597] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:52:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:52:44.038086 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8314f0-9f84-4b7d-8946-71981052b0fa service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:52:44.050790 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8314f0-9f84-4b7d-8946-71981052b0fa service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:52:44.055534 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4840c43-21e8-4164-805e-e9d243f9d8c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:52:44.056258 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4840c43-21e8-4164-805e-e9d243f9d8c8 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:52:44.056549 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4840c43-21e8-4164-805e-e9d243f9d8c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:52:44.056826 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4840c43-21e8-4164-805e-e9d243f9d8c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:52:44.058710 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f4840c43-21e8-4164-805e-e9d243f9d8c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:52:44.075193 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4840c43-21e8-4164-805e-e9d243f9d8c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:52:44.076670 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4840c43-21e8-4164-805e-e9d243f9d8c8 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:52:44.088360 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4285/8598] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:52:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:52:45.289018 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6220e-00d1-48e1-8faa-8579f555f138 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:52:45.291222 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-98f6220e-00d1-48e1-8faa-8579f555f138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:52:45.311955 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6220e-00d1-48e1-8faa-8579f555f138 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:52:45.318077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6305c4-5a30-46a8-8f0b-0c9a33fcc61d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:52:45.318827 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6305c4-5a30-46a8-8f0b-0c9a33fcc61d service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:52:45.319180 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6305c4-5a30-46a8-8f0b-0c9a33fcc61d service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:52:45.319556 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6305c4-5a30-46a8-8f0b-0c9a33fcc61d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:52:45.321453 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6b6305c4-5a30-46a8-8f0b-0c9a33fcc61d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:52:45.337207 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6305c4-5a30-46a8-8f0b-0c9a33fcc61d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:52:45.339710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6305c4-5a30-46a8-8f0b-0c9a33fcc61d service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:52:45.364555 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4314/8599] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:52:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:52:54.550071 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd18154-ad71-4ef4-847e-4269021553f5 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:52:54.551110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd18154-ad71-4ef4-847e-4269021553f5 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:52:54.551284 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd18154-ad71-4ef4-847e-4269021553f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:52:54.608541 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-ccd18154-ad71-4ef4-847e-4269021553f5 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:52:54.609812 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ccd18154-ad71-4ef4-847e-4269021553f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:52:54.673440 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4286/8600] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 21:52:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:52:54.796393 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6305c4-5a30-46a8-8f0b-0c9a33fcc61d service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:52:54.797824 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6b6305c4-5a30-46a8-8f0b-0c9a33fcc61d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:52:54.892014 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6305c4-5a30-46a8-8f0b-0c9a33fcc61d service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:52:54.897305 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77996b38-3ac2-403f-9f1a-c543a959f54d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:52:54.897978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77996b38-3ac2-403f-9f1a-c543a959f54d service swift] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:52:54.898534 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77996b38-3ac2-403f-9f1a-c543a959f54d service swift] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:52:54.898993 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77996b38-3ac2-403f-9f1a-c543a959f54d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:52:54.907216 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77996b38-3ac2-403f-9f1a-c543a959f54d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:52:54.908813 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77996b38-3ac2-403f-9f1a-c543a959f54d service swift] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:52:54.917701 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4315/8601] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:52:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:52:57.353318 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c380d-e266-4fd5-8007-521367bc3eb5 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:52:57.353926 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c380d-e266-4fd5-8007-521367bc3eb5 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:52:57.353926 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c380d-e266-4fd5-8007-521367bc3eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:52:57.387097 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-8c0c380d-e266-4fd5-8007-521367bc3eb5 None None] MFA Rules not processed for user `4d838be38c1941eba44ffcfc6c17f002`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:52:57.387097 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8c0c380d-e266-4fd5-8007-521367bc3eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:52:57.387097 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4287/8602] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:52:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:53:32.272249 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77996b38-3ac2-403f-9f1a-c543a959f54d service swift] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:53:32.274103 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-77996b38-3ac2-403f-9f1a-c543a959f54d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:53:32.366012 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77996b38-3ac2-403f-9f1a-c543a959f54d service swift] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:53:32.371110 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794339b4-cb0c-4460-b2cf-8fc95c83bdfa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:53:32.371751 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794339b4-cb0c-4460-b2cf-8fc95c83bdfa service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:53:32.373484 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794339b4-cb0c-4460-b2cf-8fc95c83bdfa service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:53:32.373484 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794339b4-cb0c-4460-b2cf-8fc95c83bdfa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:53:32.374200 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-794339b4-cb0c-4460-b2cf-8fc95c83bdfa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:53:32.388679 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794339b4-cb0c-4460-b2cf-8fc95c83bdfa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:53:32.390313 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794339b4-cb0c-4460-b2cf-8fc95c83bdfa service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:53:32.403377 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4316/8603] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:53:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:53:32.772359 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c380d-e266-4fd5-8007-521367bc3eb5 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:53:32.774149 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8c0c380d-e266-4fd5-8007-521367bc3eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:53:32.798529 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c380d-e266-4fd5-8007-521367bc3eb5 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:53:32.802126 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed3829-b626-4011-ba5a-8da1d9b86169 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:53:32.807545 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed3829-b626-4011-ba5a-8da1d9b86169 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:53:32.807545 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed3829-b626-4011-ba5a-8da1d9b86169 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:53:32.807545 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed3829-b626-4011-ba5a-8da1d9b86169 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:53:32.807545 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-29ed3829-b626-4011-ba5a-8da1d9b86169 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:53:32.817348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ed3829-b626-4011-ba5a-8da1d9b86169 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:53:32.818828 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ed3829-b626-4011-ba5a-8da1d9b86169 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:53:32.828942 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4288/8604] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:53:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:53:32.974572 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21608416-1933-4c7e-97a3-d2bd0e1703b2 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:53:32.974866 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21608416-1933-4c7e-97a3-d2bd0e1703b2 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:53:32.975127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21608416-1933-4c7e-97a3-d2bd0e1703b2 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:53:32.976505 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4317/8605] 10.222.0.23 () {54 vars in 921 bytes} [Sat Apr 30 21:53:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:53:32.981371 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945a628-2278-4993-ad79-34aecb7d5e89 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:53:32.981665 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945a628-2278-4993-ad79-34aecb7d5e89 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:53:32.981970 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945a628-2278-4993-ad79-34aecb7d5e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:53:33.018060 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-5945a628-2278-4993-ad79-34aecb7d5e89 None None] MFA Rules not processed for user `4ad3f89b7037413a83c7905cef263b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:53:33.019296 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5945a628-2278-4993-ad79-34aecb7d5e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:53:33.028167 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4289/8606] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Apr 30 21:53:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:53:33.049558 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21608416-1933-4c7e-97a3-d2bd0e1703b2 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:53:33.065683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21608416-1933-4c7e-97a3-d2bd0e1703b2 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:53:33.070597 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea969b54-740a-4940-9d43-eaa47fb523e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:53:33.075892 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea969b54-740a-4940-9d43-eaa47fb523e2 service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:53:33.075892 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea969b54-740a-4940-9d43-eaa47fb523e2 service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:53:33.075892 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea969b54-740a-4940-9d43-eaa47fb523e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:53:33.079904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea969b54-740a-4940-9d43-eaa47fb523e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:53:33.081484 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea969b54-740a-4940-9d43-eaa47fb523e2 service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:53:33.091125 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4318/8607] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:53:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:53:33.463268 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945a628-2278-4993-ad79-34aecb7d5e89 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:53:33.475727 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945a628-2278-4993-ad79-34aecb7d5e89 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:53:33.479295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e523f92-b521-4a8b-887e-1ac5f16ffe4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:53:33.479939 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e523f92-b521-4a8b-887e-1ac5f16ffe4d service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:53:33.480225 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e523f92-b521-4a8b-887e-1ac5f16ffe4d service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:53:33.480504 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e523f92-b521-4a8b-887e-1ac5f16ffe4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:53:33.482354 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-9e523f92-b521-4a8b-887e-1ac5f16ffe4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:53:33.497900 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e523f92-b521-4a8b-887e-1ac5f16ffe4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:53:33.499351 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e523f92-b521-4a8b-887e-1ac5f16ffe4d service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:53:33.512924 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4290/8608] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:53:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:53:34.281168 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea969b54-740a-4940-9d43-eaa47fb523e2 service placement] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:53:34.282789 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ea969b54-740a-4940-9d43-eaa47fb523e2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:53:34.299561 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea969b54-740a-4940-9d43-eaa47fb523e2 service placement] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:53:34.304739 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481a2e6-829c-46a9-9d89-4e04971f274a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:53:34.309501 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481a2e6-829c-46a9-9d89-4e04971f274a service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:53:34.309501 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481a2e6-829c-46a9-9d89-4e04971f274a service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:53:34.309501 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481a2e6-829c-46a9-9d89-4e04971f274a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:53:34.309501 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9481a2e6-829c-46a9-9d89-4e04971f274a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:53:34.322239 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9481a2e6-829c-46a9-9d89-4e04971f274a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:53:34.323811 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9481a2e6-829c-46a9-9d89-4e04971f274a service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:53:34.336482 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4319/8609] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:53:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:53:40.786789 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e523f92-b521-4a8b-887e-1ac5f16ffe4d service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:53:40.800667 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e523f92-b521-4a8b-887e-1ac5f16ffe4d service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:53:40.805781 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f7372-2de4-42e0-9cd0-f110c285fa17 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:53:40.806433 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f7372-2de4-42e0-9cd0-f110c285fa17 service placement] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:53:40.806724 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f7372-2de4-42e0-9cd0-f110c285fa17 service placement] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:53:40.806998 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f7372-2de4-42e0-9cd0-f110c285fa17 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:53:40.808914 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ac7f7372-2de4-42e0-9cd0-f110c285fa17 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:53:40.824190 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f7372-2de4-42e0-9cd0-f110c285fa17 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:53:40.827438 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f7372-2de4-42e0-9cd0-f110c285fa17 service placement] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:53:40.839589 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4291/8610] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:53:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:54:09.399279 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f1ea3-20b6-4d9b-8a0c-0b67ef1bcf5e None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:54:09.399798 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f1ea3-20b6-4d9b-8a0c-0b67ef1bcf5e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:54:09.399904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f1ea3-20b6-4d9b-8a0c-0b67ef1bcf5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:54:09.418245 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-4b2f1ea3-20b6-4d9b-8a0c-0b67ef1bcf5e None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:54:09.419433 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4b2f1ea3-20b6-4d9b-8a0c-0b67ef1bcf5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:54:09.426726 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4320/8611] 10.222.0.23 () {58 vars in 967 bytes} [Sat Apr 30 21:54:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:54:09.572888 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f7372-2de4-42e0-9cd0-f110c285fa17 service placement] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:54:09.586533 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f7372-2de4-42e0-9cd0-f110c285fa17 service placement] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:54:09.591607 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58243ec-65be-4af6-a2e6-678c2da1aafe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:54:09.592243 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58243ec-65be-4af6-a2e6-678c2da1aafe service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:54:09.592527 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58243ec-65be-4af6-a2e6-678c2da1aafe service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:54:09.592806 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58243ec-65be-4af6-a2e6-678c2da1aafe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:54:09.601372 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58243ec-65be-4af6-a2e6-678c2da1aafe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:54:09.602998 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58243ec-65be-4af6-a2e6-678c2da1aafe service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:54:09.611635 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4292/8612] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 21:54:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 21:54:17.556865 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c2386-5497-41a9-92f0-de3daeb22d84 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:54:17.557370 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c2386-5497-41a9-92f0-de3daeb22d84 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:54:17.557481 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c2386-5497-41a9-92f0-de3daeb22d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:54:17.574425 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-3c2c2386-5497-41a9-92f0-de3daeb22d84 None None] MFA Rules not processed for user `4d838be38c1941eba44ffcfc6c17f002`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:54:17.575612 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3c2c2386-5497-41a9-92f0-de3daeb22d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:54:17.582931 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4321/8613] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:54:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:54:31.674166 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58243ec-65be-4af6-a2e6-678c2da1aafe service swift] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:54:31.685774 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58243ec-65be-4af6-a2e6-678c2da1aafe service swift] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:54:31.689355 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873fb8ce-15c5-4818-b94e-1377b8d6f638 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:54:31.690029 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873fb8ce-15c5-4818-b94e-1377b8d6f638 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:54:31.690318 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873fb8ce-15c5-4818-b94e-1377b8d6f638 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:54:31.690598 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873fb8ce-15c5-4818-b94e-1377b8d6f638 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:54:31.692480 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-873fb8ce-15c5-4818-b94e-1377b8d6f638 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:54:31.756504 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873fb8ce-15c5-4818-b94e-1377b8d6f638 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:54:31.757994 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873fb8ce-15c5-4818-b94e-1377b8d6f638 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:54:31.767924 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4293/8614] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:54:31 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:54:44.279224 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d362e-f57c-4f9b-b109-da974b9383b1 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:54:44.279692 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d362e-f57c-4f9b-b109-da974b9383b1 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:54:44.279787 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d362e-f57c-4f9b-b109-da974b9383b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:54:44.301100 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-876d362e-f57c-4f9b-b109-da974b9383b1 None None] MFA Rules not processed for user `9294e527a38c483482c6a49091c226c9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:54:44.302397 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-876d362e-f57c-4f9b-b109-da974b9383b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:54:44.309516 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4322/8615] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:54:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:55:35.085635 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873fb8ce-15c5-4818-b94e-1377b8d6f638 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:55:35.097280 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873fb8ce-15c5-4818-b94e-1377b8d6f638 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:55:35.101335 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98404c1c-b876-4305-8c7a-6ffd9f84b821 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:55:35.102033 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98404c1c-b876-4305-8c7a-6ffd9f84b821 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:55:35.102442 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98404c1c-b876-4305-8c7a-6ffd9f84b821 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:55:35.102727 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98404c1c-b876-4305-8c7a-6ffd9f84b821 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:55:35.104546 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-98404c1c-b876-4305-8c7a-6ffd9f84b821 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:55:35.117296 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98404c1c-b876-4305-8c7a-6ffd9f84b821 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:55:35.118758 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98404c1c-b876-4305-8c7a-6ffd9f84b821 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:55:35.129741 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4294/8616] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:55:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:55:35.265820 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5b36d-c074-4c24-b1fd-496e8849ab6b None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:55:35.266398 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5b36d-c074-4c24-b1fd-496e8849ab6b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:55:35.266398 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5b36d-c074-4c24-b1fd-496e8849ab6b None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:55:35.267745 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4323/8617] 10.222.0.23 () {54 vars in 921 bytes} [Sat Apr 30 21:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:55:35.274249 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756be05-6ff9-401e-9965-0a3c1f0b21a1 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:55:35.274444 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756be05-6ff9-401e-9965-0a3c1f0b21a1 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:55:35.274675 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756be05-6ff9-401e-9965-0a3c1f0b21a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:55:35.293678 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-1756be05-6ff9-401e-9965-0a3c1f0b21a1 None None] MFA Rules not processed for user `4ad3f89b7037413a83c7905cef263b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:55:35.295006 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1756be05-6ff9-401e-9965-0a3c1f0b21a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:55:35.304146 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4295/8618] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Apr 30 21:55:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:55:35.324412 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c5b36d-c074-4c24-b1fd-496e8849ab6b None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:55:35.341039 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c5b36d-c074-4c24-b1fd-496e8849ab6b None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:55:35.346925 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c62a75-5fd6-497d-a58e-1d68ac6ee0c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:55:35.347562 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c62a75-5fd6-497d-a58e-1d68ac6ee0c4 service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:55:35.347846 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c62a75-5fd6-497d-a58e-1d68ac6ee0c4 service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:55:35.348122 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c62a75-5fd6-497d-a58e-1d68ac6ee0c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:55:35.356400 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c62a75-5fd6-497d-a58e-1d68ac6ee0c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:55:35.360843 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c62a75-5fd6-497d-a58e-1d68ac6ee0c4 service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:55:35.367692 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4324/8619] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:55:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:55:35.634396 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756be05-6ff9-401e-9965-0a3c1f0b21a1 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:55:35.647206 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756be05-6ff9-401e-9965-0a3c1f0b21a1 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:55:35.650840 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000589eb-182e-40ed-9a53-a297c7c966cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:55:35.651484 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000589eb-182e-40ed-9a53-a297c7c966cd service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:55:35.651769 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000589eb-182e-40ed-9a53-a297c7c966cd service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:55:35.652053 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000589eb-182e-40ed-9a53-a297c7c966cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:55:35.653844 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-000589eb-182e-40ed-9a53-a297c7c966cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:55:35.669276 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000589eb-182e-40ed-9a53-a297c7c966cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:55:35.670740 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000589eb-182e-40ed-9a53-a297c7c966cd service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:55:35.683846 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4296/8620] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:55:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:56:51.636266 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6392f3-7f42-46c9-b7bb-d436282cbdbd None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:56:51.636818 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6392f3-7f42-46c9-b7bb-d436282cbdbd None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:56:51.636927 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6392f3-7f42-46c9-b7bb-d436282cbdbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:56:51.656815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-9e6392f3-7f42-46c9-b7bb-d436282cbdbd None None] MFA Rules not processed for user `9294e527a38c483482c6a49091c226c9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:56:51.658530 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9e6392f3-7f42-46c9-b7bb-d436282cbdbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:56:51.666397 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4325/8621] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:56:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:56:51.709368 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000589eb-182e-40ed-9a53-a297c7c966cd service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:56:51.710805 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-000589eb-182e-40ed-9a53-a297c7c966cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:56:51.778302 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000589eb-182e-40ed-9a53-a297c7c966cd service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:56:51.782453 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf93d5-f883-4564-812e-f62151f4f12f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e302b1298dd04d6590e3d079f7b13b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:56:51.783348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf93d5-f883-4564-812e-f62151f4f12f service glance] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:56:51.783867 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf93d5-f883-4564-812e-f62151f4f12f service glance] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:56:51.784221 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf93d5-f883-4564-812e-f62151f4f12f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:56:51.786295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b1bf93d5-f883-4564-812e-f62151f4f12f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:56:51.806228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf93d5-f883-4564-812e-f62151f4f12f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:56:51.808361 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf93d5-f883-4564-812e-f62151f4f12f service glance] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:56:51.832757 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4297/8622] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:56:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:56:52.114937 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6392f3-7f42-46c9-b7bb-d436282cbdbd None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:56:52.127161 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6392f3-7f42-46c9-b7bb-d436282cbdbd None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:56:52.130804 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ca9b2-ab48-480d-a596-c47cb04ef4cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:56:52.131585 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ca9b2-ab48-480d-a596-c47cb04ef4cd service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:56:52.131869 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ca9b2-ab48-480d-a596-c47cb04ef4cd service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:56:52.132146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ca9b2-ab48-480d-a596-c47cb04ef4cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:56:52.134081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ec0ca9b2-ab48-480d-a596-c47cb04ef4cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:56:52.147250 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ca9b2-ab48-480d-a596-c47cb04ef4cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:56:52.149036 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ca9b2-ab48-480d-a596-c47cb04ef4cd service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:56:52.163836 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4326/8623] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:56:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:56:52.640403 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf93d5-f883-4564-812e-f62151f4f12f service glance] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:56:52.664820 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf93d5-f883-4564-812e-f62151f4f12f service glance] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:56:52.665314 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ca9b2-ab48-480d-a596-c47cb04ef4cd service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:56:52.672984 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed1761-f439-4d15-aef0-6db4e1188b32 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:56:52.674065 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed1761-f439-4d15-aef0-6db4e1188b32 service placement] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:56:52.674578 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed1761-f439-4d15-aef0-6db4e1188b32 service placement] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:56:52.676512 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ca9b2-ab48-480d-a596-c47cb04ef4cd service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:56:52.676888 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed1761-f439-4d15-aef0-6db4e1188b32 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:56:52.679337 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-92ed1761-f439-4d15-aef0-6db4e1188b32 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:56:52.681204 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931bdad-5291-4436-a290-02bd78a66274 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:56:52.682081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931bdad-5291-4436-a290-02bd78a66274 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:56:52.683082 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931bdad-5291-4436-a290-02bd78a66274 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:56:52.683510 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931bdad-5291-4436-a290-02bd78a66274 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:56:52.685593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0931bdad-5291-4436-a290-02bd78a66274 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:56:52.704122 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931bdad-5291-4436-a290-02bd78a66274 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:56:52.705603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931bdad-5291-4436-a290-02bd78a66274 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:56:52.708919 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ed1761-f439-4d15-aef0-6db4e1188b32 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:56:52.711359 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ed1761-f439-4d15-aef0-6db4e1188b32 service placement] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:56:52.720440 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4327/8624] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:56:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:56:52.728570 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4298/8625] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:56:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:57:05.915609 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931bdad-5291-4436-a290-02bd78a66274 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:57:05.935177 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931bdad-5291-4436-a290-02bd78a66274 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:57:05.943498 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fcc0f-d632-4a07-9ced-d1454e04b233 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:57:05.944156 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fcc0f-d632-4a07-9ced-d1454e04b233 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:57:05.944443 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fcc0f-d632-4a07-9ced-d1454e04b233 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:57:05.944722 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fcc0f-d632-4a07-9ced-d1454e04b233 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:57:05.946676 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3f7fcc0f-d632-4a07-9ced-d1454e04b233 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:57:05.961720 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7fcc0f-d632-4a07-9ced-d1454e04b233 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:57:05.963316 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7fcc0f-d632-4a07-9ced-d1454e04b233 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:57:05.976676 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4328/8626] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:57:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:57:30.285914 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed1761-f439-4d15-aef0-6db4e1188b32 service placement] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:57:30.297639 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed1761-f439-4d15-aef0-6db4e1188b32 service placement] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:57:30.301332 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d95471-a7d5-4ceb-a23a-3a7ac42aa14c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:57:30.301992 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d95471-a7d5-4ceb-a23a-3a7ac42aa14c service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:57:30.302274 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d95471-a7d5-4ceb-a23a-3a7ac42aa14c service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:57:30.302546 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d95471-a7d5-4ceb-a23a-3a7ac42aa14c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:57:30.304286 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e0d95471-a7d5-4ceb-a23a-3a7ac42aa14c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:57:30.315927 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d95471-a7d5-4ceb-a23a-3a7ac42aa14c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:57:30.317351 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d95471-a7d5-4ceb-a23a-3a7ac42aa14c service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:57:30.327625 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4299/8627] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:57:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:57:33.514488 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fcc0f-d632-4a07-9ced-d1454e04b233 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:57:33.528310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fcc0f-d632-4a07-9ced-d1454e04b233 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:57:33.534256 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741feff6-d32d-4afa-8fd0-2c653880d83a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:57:33.536411 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741feff6-d32d-4afa-8fd0-2c653880d83a service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:57:33.536411 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741feff6-d32d-4afa-8fd0-2c653880d83a service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:57:33.536411 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741feff6-d32d-4afa-8fd0-2c653880d83a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:57:33.543193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741feff6-d32d-4afa-8fd0-2c653880d83a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:57:33.544761 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741feff6-d32d-4afa-8fd0-2c653880d83a service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:57:33.554266 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4329/8628] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:57:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:57:40.460463 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d95471-a7d5-4ceb-a23a-3a7ac42aa14c service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:57:40.475940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d95471-a7d5-4ceb-a23a-3a7ac42aa14c service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:57:40.481528 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35afed7a-d09d-441e-b3fc-a22fca1c103e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:57:40.482138 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afed7a-d09d-441e-b3fc-a22fca1c103e service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:57:40.482424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afed7a-d09d-441e-b3fc-a22fca1c103e service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:57:40.482698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afed7a-d09d-441e-b3fc-a22fca1c103e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:57:40.490990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35afed7a-d09d-441e-b3fc-a22fca1c103e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:57:40.492579 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35afed7a-d09d-441e-b3fc-a22fca1c103e service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:57:40.502608 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4300/8629] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:57:40 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:57:41.203320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc1f8b-3ffb-4c55-b70b-bdf330ddf54d None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:57:41.203849 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc1f8b-3ffb-4c55-b70b-bdf330ddf54d None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:57:41.203849 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc1f8b-3ffb-4c55-b70b-bdf330ddf54d None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:57:41.205235 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4330/8630] 10.222.0.23 () {54 vars in 921 bytes} [Sat Apr 30 21:57:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 21:57:41.209974 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8a44f-2995-4b5d-b6fc-bfaf48df0f2b None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:57:41.210266 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8a44f-2995-4b5d-b6fc-bfaf48df0f2b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:57:41.210587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8a44f-2995-4b5d-b6fc-bfaf48df0f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:57:41.229134 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-b2f8a44f-2995-4b5d-b6fc-bfaf48df0f2b None None] MFA Rules not processed for user `4ad3f89b7037413a83c7905cef263b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:57:41.230354 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b2f8a44f-2995-4b5d-b6fc-bfaf48df0f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:57:41.239519 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4301/8631] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Apr 30 21:57:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:57:41.260844 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc1f8b-3ffb-4c55-b70b-bdf330ddf54d None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:57:41.279404 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc1f8b-3ffb-4c55-b70b-bdf330ddf54d None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:57:41.284918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658fd66-bb07-4fe1-b8d4-806e966840e0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:57:41.288319 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658fd66-bb07-4fe1-b8d4-806e966840e0 service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:57:41.288319 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658fd66-bb07-4fe1-b8d4-806e966840e0 service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:57:41.288319 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658fd66-bb07-4fe1-b8d4-806e966840e0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:57:41.294718 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9658fd66-bb07-4fe1-b8d4-806e966840e0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:57:41.296303 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9658fd66-bb07-4fe1-b8d4-806e966840e0 service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:57:41.307370 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4331/8632] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:57:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:57:44.944019 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8a44f-2995-4b5d-b6fc-bfaf48df0f2b None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:57:44.959150 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8a44f-2995-4b5d-b6fc-bfaf48df0f2b None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:57:44.965685 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd2268-13b8-4469-a054-d1badbf6d073 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:57:44.966367 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd2268-13b8-4469-a054-d1badbf6d073 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:57:44.966645 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd2268-13b8-4469-a054-d1badbf6d073 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:57:44.966916 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd2268-13b8-4469-a054-d1badbf6d073 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:57:44.979540 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd2268-13b8-4469-a054-d1badbf6d073 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:57:44.982606 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd2268-13b8-4469-a054-d1badbf6d073 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:57:44.996200 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4302/8633] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:57:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:57:47.119117 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427e0b5-0f98-4bd7-b0f0-7cf0e1a95761 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:57:47.119642 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427e0b5-0f98-4bd7-b0f0-7cf0e1a95761 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:57:47.119642 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427e0b5-0f98-4bd7-b0f0-7cf0e1a95761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:57:47.156653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-d427e0b5-0f98-4bd7-b0f0-7cf0e1a95761 None None] MFA Rules not processed for user `0b0cb145b72a492ebb8c0e9223be47a1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:57:47.157986 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d427e0b5-0f98-4bd7-b0f0-7cf0e1a95761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:57:47.164591 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4332/8634] 10.222.0.23 () {58 vars in 1061 bytes} [Sat Apr 30 21:57:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:57:47.170403 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd2268-13b8-4469-a054-d1badbf6d073 service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:57:47.179574 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd2268-13b8-4469-a054-d1badbf6d073 service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:57:47.183222 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62cc782-b072-48b0-9c7c-fa3107a751f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:57:47.183855 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cc782-b072-48b0-9c7c-fa3107a751f7 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:57:47.184134 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cc782-b072-48b0-9c7c-fa3107a751f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:57:47.184408 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cc782-b072-48b0-9c7c-fa3107a751f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:57:47.194732 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62cc782-b072-48b0-9c7c-fa3107a751f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:57:47.196158 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62cc782-b072-48b0-9c7c-fa3107a751f7 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:57:47.207338 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4303/8635] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:57:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:57:52.750941 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427e0b5-0f98-4bd7-b0f0-7cf0e1a95761 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:57:52.766437 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427e0b5-0f98-4bd7-b0f0-7cf0e1a95761 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:57:52.772465 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deafaf5-f1e7-48ed-b6bd-d1cb7a7a61d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:57:52.773200 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deafaf5-f1e7-48ed-b6bd-d1cb7a7a61d1 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:57:52.773560 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deafaf5-f1e7-48ed-b6bd-d1cb7a7a61d1 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:57:52.773961 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deafaf5-f1e7-48ed-b6bd-d1cb7a7a61d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:57:52.776271 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3deafaf5-f1e7-48ed-b6bd-d1cb7a7a61d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:57:52.788230 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deafaf5-f1e7-48ed-b6bd-d1cb7a7a61d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:57:52.790493 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deafaf5-f1e7-48ed-b6bd-d1cb7a7a61d1 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:57:52.800090 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4333/8636] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:57:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:57:58.228333 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62cc782-b072-48b0-9c7c-fa3107a751f7 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:57:58.247820 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62cc782-b072-48b0-9c7c-fa3107a751f7 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:57:58.253710 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92bff9-1b87-4402-bb06-dc3e4976a221 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:57:58.255274 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92bff9-1b87-4402-bb06-dc3e4976a221 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:57:58.255645 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92bff9-1b87-4402-bb06-dc3e4976a221 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:57:58.255924 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92bff9-1b87-4402-bb06-dc3e4976a221 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:57:58.257833 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-af92bff9-1b87-4402-bb06-dc3e4976a221 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:57:58.278415 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af92bff9-1b87-4402-bb06-dc3e4976a221 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:57:58.283440 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af92bff9-1b87-4402-bb06-dc3e4976a221 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:57:58.298168 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4304/8637] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:57:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:58:06.366472 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deafaf5-f1e7-48ed-b6bd-d1cb7a7a61d1 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:58:06.375534 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deafaf5-f1e7-48ed-b6bd-d1cb7a7a61d1 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:58:06.382710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8bd6d9-7d92-41fb-800c-9ee61b0b5f92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:58:06.383375 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bd6d9-7d92-41fb-800c-9ee61b0b5f92 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:58:06.383815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bd6d9-7d92-41fb-800c-9ee61b0b5f92 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:58:06.383954 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bd6d9-7d92-41fb-800c-9ee61b0b5f92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:58:06.387421 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-af8bd6d9-7d92-41fb-800c-9ee61b0b5f92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:58:06.455189 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8bd6d9-7d92-41fb-800c-9ee61b0b5f92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:58:06.456665 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8bd6d9-7d92-41fb-800c-9ee61b0b5f92 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:58:06.476828 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4334/8638] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:58:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:58:14.790020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6152d74-b547-4d3a-862f-7c69d78eb145 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:58:14.790843 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6152d74-b547-4d3a-862f-7c69d78eb145 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:58:14.791276 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6152d74-b547-4d3a-862f-7c69d78eb145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:58:14.813581 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-f6152d74-b547-4d3a-862f-7c69d78eb145 None None] MFA Rules not processed for user `9294e527a38c483482c6a49091c226c9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:58:14.815053 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f6152d74-b547-4d3a-862f-7c69d78eb145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:58:14.845863 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4305/8639] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 21:58:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 21:58:15.927351 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8bd6d9-7d92-41fb-800c-9ee61b0b5f92 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:58:15.929587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-af8bd6d9-7d92-41fb-800c-9ee61b0b5f92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:58:15.943347 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8bd6d9-7d92-41fb-800c-9ee61b0b5f92 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:58:15.948543 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a56bc-bb33-4f9c-b826-ec02651f0cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:58:15.951247 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a56bc-bb33-4f9c-b826-ec02651f0cdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:58:15.951247 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a56bc-bb33-4f9c-b826-ec02651f0cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:58:15.951247 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a56bc-bb33-4f9c-b826-ec02651f0cdc admin admin] PATH_INFO: `/v3/users/4d838be38c1941eba44ffcfc6c17f002` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:58:15.952288 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829a56bc-bb33-4f9c-b826-ec02651f0cdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d838be38c1941eba44ffcfc6c17f002)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:58:15.954746 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829a56bc-bb33-4f9c-b826-ec02651f0cdc admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:58:16.050049 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9f5a6-727d-4da3-8f68-488e1d608caa None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:58:16.050513 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9f5a6-727d-4da3-8f68-488e1d608caa None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:58:16.051185 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9f5a6-727d-4da3-8f68-488e1d608caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:58:16.075938 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-e1c9f5a6-727d-4da3-8f68-488e1d608caa None None] MFA Rules not processed for user `4ad3f89b7037413a83c7905cef263b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 21:58:16.077200 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e1c9f5a6-727d-4da3-8f68-488e1d608caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:58:16.091331 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4306/8640] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Apr 30 21:58:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 21:58:16.104784 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9f5a6-727d-4da3-8f68-488e1d608caa None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:58:16.120719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9f5a6-727d-4da3-8f68-488e1d608caa None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:58:16.126279 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d5824-b41c-4b82-a51c-29da95abd597 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:58:16.126940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d5824-b41c-4b82-a51c-29da95abd597 service placement] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:58:16.127230 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d5824-b41c-4b82-a51c-29da95abd597 service placement] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:58:16.127506 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d5824-b41c-4b82-a51c-29da95abd597 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:58:16.136871 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d5824-b41c-4b82-a51c-29da95abd597 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:58:16.138634 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d5824-b41c-4b82-a51c-29da95abd597 service placement] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:58:16.150193 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4307/8641] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:58:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 21:58:16.214436 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-829a56bc-bb33-4f9c-b826-ec02651f0cdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d838be38c1941eba44ffcfc6c17f002'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:58:16.246227 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-829a56bc-bb33-4f9c-b826-ec02651f0cdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d838be38c1941eba44ffcfc6c17f002'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:58:16.352181 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-829a56bc-bb33-4f9c-b826-ec02651f0cdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d838be38c1941eba44ffcfc6c17f002'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:58:16.361688 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-829a56bc-bb33-4f9c-b826-ec02651f0cdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d838be38c1941eba44ffcfc6c17f002'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:58:16.362680 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-829a56bc-bb33-4f9c-b826-ec02651f0cdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d838be38c1941eba44ffcfc6c17f002'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:58:16.370906 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4335/8642] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:58:15 2022] DELETE /identity/v3/users/4d838be38c1941eba44ffcfc6c17f002 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:58:16.693616 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d5824-b41c-4b82-a51c-29da95abd597 service placement] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:58:16.710813 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d5824-b41c-4b82-a51c-29da95abd597 service placement] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:58:16.807983 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3bca5-3c90-4250-b110-c80ccc5f91a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:58:16.808891 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3bca5-3c90-4250-b110-c80ccc5f91a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:58:16.809172 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3bca5-3c90-4250-b110-c80ccc5f91a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:58:16.809445 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3bca5-3c90-4250-b110-c80ccc5f91a8 admin admin] PATH_INFO: `/v3/projects/839ab2af4d6b40c3b957be9c7dc78b26` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:58:16.810723 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e3bca5-3c90-4250-b110-c80ccc5f91a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=839ab2af4d6b40c3b957be9c7dc78b26)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:58:16.812653 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e3bca5-3c90-4250-b110-c80ccc5f91a8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:58:16.916418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-04e3bca5-3c90-4250-b110-c80ccc5f91a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '839ab2af4d6b40c3b957be9c7dc78b26', 'request_id': 'req-04e3bca5-3c90-4250-b110-c80ccc5f91a8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:58:16.922255 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-04e3bca5-3c90-4250-b110-c80ccc5f91a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '839ab2af4d6b40c3b957be9c7dc78b26', 'request_id': 'req-04e3bca5-3c90-4250-b110-c80ccc5f91a8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:58:16.928740 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-04e3bca5-3c90-4250-b110-c80ccc5f91a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '839ab2af4d6b40c3b957be9c7dc78b26', 'request_id': 'req-04e3bca5-3c90-4250-b110-c80ccc5f91a8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:58:17.018827 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-04e3bca5-3c90-4250-b110-c80ccc5f91a8 admin admin] The token cache is being invalidate because project 839ab2af4d6b40c3b957be9c7dc78b26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:58:17.019116 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-04e3bca5-3c90-4250-b110-c80ccc5f91a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:58:17.051938 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-04e3bca5-3c90-4250-b110-c80ccc5f91a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:58:17.051938 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4308/8643] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:58:16 2022] DELETE /identity/v3/projects/839ab2af4d6b40c3b957be9c7dc78b26 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:58:17.052811 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a56bc-bb33-4f9c-b826-ec02651f0cdc admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:58:17.052811 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-829a56bc-bb33-4f9c-b826-ec02651f0cdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:58:17.052811 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a56bc-bb33-4f9c-b826-ec02651f0cdc admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:58:17.106649 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a41efc-5413-4ef9-aa4c-88ae4836360f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:58:17.107608 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a41efc-5413-4ef9-aa4c-88ae4836360f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:58:17.107987 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a41efc-5413-4ef9-aa4c-88ae4836360f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:58:17.108309 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a41efc-5413-4ef9-aa4c-88ae4836360f admin admin] PATH_INFO: `/v3/users/a3f48ce0bfa5471990cb06e76772f64f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:58:17.109640 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a41efc-5413-4ef9-aa4c-88ae4836360f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3f48ce0bfa5471990cb06e76772f64f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:58:17.111679 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a41efc-5413-4ef9-aa4c-88ae4836360f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:58:17.359759 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-81a41efc-5413-4ef9-aa4c-88ae4836360f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3f48ce0bfa5471990cb06e76772f64f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:58:17.372765 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-81a41efc-5413-4ef9-aa4c-88ae4836360f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3f48ce0bfa5471990cb06e76772f64f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:58:17.524030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-81a41efc-5413-4ef9-aa4c-88ae4836360f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3f48ce0bfa5471990cb06e76772f64f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:58:17.532158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-81a41efc-5413-4ef9-aa4c-88ae4836360f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3f48ce0bfa5471990cb06e76772f64f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:58:17.532905 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-81a41efc-5413-4ef9-aa4c-88ae4836360f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3f48ce0bfa5471990cb06e76772f64f'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:58:17.539150 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4336/8644] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 21:58:17 2022] DELETE /identity/v3/users/a3f48ce0bfa5471990cb06e76772f64f => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:58:17.836861 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3bca5-3c90-4250-b110-c80ccc5f91a8 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:58:17.838889 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-04e3bca5-3c90-4250-b110-c80ccc5f91a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:58:17.854824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3bca5-3c90-4250-b110-c80ccc5f91a8 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:58:17.912709 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b9e2d-4060-401b-a43a-c09b4caf026e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:58:17.913972 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b9e2d-4060-401b-a43a-c09b4caf026e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:58:17.914271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b9e2d-4060-401b-a43a-c09b4caf026e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:58:17.914555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b9e2d-4060-401b-a43a-c09b4caf026e admin admin] PATH_INFO: `/v3/projects/f6180e89be2d47d08e89a0fc4dba5abd` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:58:17.915770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b9e2d-4060-401b-a43a-c09b4caf026e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6180e89be2d47d08e89a0fc4dba5abd)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:58:17.917929 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b9e2d-4060-401b-a43a-c09b4caf026e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:58:18.043450 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f70b9e2d-4060-401b-a43a-c09b4caf026e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6180e89be2d47d08e89a0fc4dba5abd', 'request_id': 'req-f70b9e2d-4060-401b-a43a-c09b4caf026e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:58:18.048732 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f70b9e2d-4060-401b-a43a-c09b4caf026e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6180e89be2d47d08e89a0fc4dba5abd', 'request_id': 'req-f70b9e2d-4060-401b-a43a-c09b4caf026e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:58:18.054790 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f70b9e2d-4060-401b-a43a-c09b4caf026e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6180e89be2d47d08e89a0fc4dba5abd', 'request_id': 'req-f70b9e2d-4060-401b-a43a-c09b4caf026e'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:58:18.119258 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f70b9e2d-4060-401b-a43a-c09b4caf026e admin admin] The token cache is being invalidate because project f6180e89be2d47d08e89a0fc4dba5abd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 21:58:18.119551 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f70b9e2d-4060-401b-a43a-c09b4caf026e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:58:18.120260 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f70b9e2d-4060-401b-a43a-c09b4caf026e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 21:58:18.121901 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4309/8645] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 21:58:17 2022] DELETE /identity/v3/projects/f6180e89be2d47d08e89a0fc4dba5abd => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 21:58:43.636428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a41efc-5413-4ef9-aa4c-88ae4836360f admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:58:43.637890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-81a41efc-5413-4ef9-aa4c-88ae4836360f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:58:43.707477 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a41efc-5413-4ef9-aa4c-88ae4836360f admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:58:43.764569 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b158374-e37b-4cab-aad4-b9d280749a64 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:58:43.765209 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b158374-e37b-4cab-aad4-b9d280749a64 service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:58:43.765519 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b158374-e37b-4cab-aad4-b9d280749a64 service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:58:43.765822 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b158374-e37b-4cab-aad4-b9d280749a64 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:58:43.767629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6b158374-e37b-4cab-aad4-b9d280749a64 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:58:43.781505 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b158374-e37b-4cab-aad4-b9d280749a64 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:58:43.783159 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b158374-e37b-4cab-aad4-b9d280749a64 service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:58:43.795317 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4337/8646] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:58:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 21:58:45.787196 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b9e2d-4060-401b-a43a-c09b4caf026e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 21:58:45.788680 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f70b9e2d-4060-401b-a43a-c09b4caf026e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:58:45.810466 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b9e2d-4060-401b-a43a-c09b4caf026e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 21:58:45.817886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeabb33-3c40-48b0-ae33-69fd9d70b448 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 21:58:45.818556 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeabb33-3c40-48b0-ae33-69fd9d70b448 service placement] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 21:58:45.818840 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeabb33-3c40-48b0-ae33-69fd9d70b448 service placement] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 21:58:45.819116 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeabb33-3c40-48b0-ae33-69fd9d70b448 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 21:58:45.820996 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4aeabb33-3c40-48b0-ae33-69fd9d70b448 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 21:58:45.836988 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeabb33-3c40-48b0-ae33-69fd9d70b448 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 21:58:45.839878 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeabb33-3c40-48b0-ae33-69fd9d70b448 service placement] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 21:58:45.853029 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4310/8647] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 21:58:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:00:00.081174 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b158374-e37b-4cab-aad4-b9d280749a64 service placement] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:00.082783 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6b158374-e37b-4cab-aad4-b9d280749a64 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:00:00.148167 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b158374-e37b-4cab-aad4-b9d280749a64 service placement] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:00.153409 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c836648-095d-4807-b76a-85736b3676a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:00.154312 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c836648-095d-4807-b76a-85736b3676a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:00.154614 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c836648-095d-4807-b76a-85736b3676a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:00.154872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c836648-095d-4807-b76a-85736b3676a1 admin admin] PATH_INFO: `/v3/users/9294e527a38c483482c6a49091c226c9` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:00.156079 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c836648-095d-4807-b76a-85736b3676a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9294e527a38c483482c6a49091c226c9)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:00.158034 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c836648-095d-4807-b76a-85736b3676a1 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:00.420782 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9c836648-095d-4807-b76a-85736b3676a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9294e527a38c483482c6a49091c226c9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:00.432161 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9c836648-095d-4807-b76a-85736b3676a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9294e527a38c483482c6a49091c226c9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:00.538839 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9c836648-095d-4807-b76a-85736b3676a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9294e527a38c483482c6a49091c226c9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:00.545864 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9c836648-095d-4807-b76a-85736b3676a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9294e527a38c483482c6a49091c226c9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:00.546519 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-9c836648-095d-4807-b76a-85736b3676a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9294e527a38c483482c6a49091c226c9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:00.552269 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4338/8648] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 22:00:00 2022] DELETE /identity/v3/users/9294e527a38c483482c6a49091c226c9 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:00:00.557499 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b32628-1475-4cec-9986-bdb4d67a9313 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:00.558049 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b32628-1475-4cec-9986-bdb4d67a9313 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:00.558161 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b32628-1475-4cec-9986-bdb4d67a9313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:00.575940 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-30b32628-1475-4cec-9986-bdb4d67a9313 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:00:00.579564 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-30b32628-1475-4cec-9986-bdb4d67a9313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:00:00.632641 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4311/8649] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:00:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:00:00.643360 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c836648-095d-4807-b76a-85736b3676a1 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:00.644764 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9c836648-095d-4807-b76a-85736b3676a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:00:00.701247 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c836648-095d-4807-b76a-85736b3676a1 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:00.704840 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd33f785-6e14-48b0-87a4-a289209c0313 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:00.705478 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33f785-6e14-48b0-87a4-a289209c0313 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:00.705770 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33f785-6e14-48b0-87a4-a289209c0313 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:00.706053 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33f785-6e14-48b0-87a4-a289209c0313 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:00.714819 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd33f785-6e14-48b0-87a4-a289209c0313 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:00.716252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd33f785-6e14-48b0-87a4-a289209c0313 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:00.725419 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4339/8650] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:00:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:00:00.941076 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b32628-1475-4cec-9986-bdb4d67a9313 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:00.942549 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-30b32628-1475-4cec-9986-bdb4d67a9313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:00:00.958941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b32628-1475-4cec-9986-bdb4d67a9313 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:00.963890 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16250ac2-8e7b-4db1-9240-fa83f9a9707a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:00.964820 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16250ac2-8e7b-4db1-9240-fa83f9a9707a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:00.965010 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16250ac2-8e7b-4db1-9240-fa83f9a9707a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:00.965469 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16250ac2-8e7b-4db1-9240-fa83f9a9707a admin admin] PATH_INFO: `/v3/projects/12f7d764a613404a9be3d0a9d325c8f6` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:00.966808 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16250ac2-8e7b-4db1-9240-fa83f9a9707a admin admin] RBAC: Authorizing `identity:delete_project(project_id=12f7d764a613404a9be3d0a9d325c8f6)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:00.968721 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16250ac2-8e7b-4db1-9240-fa83f9a9707a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:01.087306 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-16250ac2-8e7b-4db1-9240-fa83f9a9707a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12f7d764a613404a9be3d0a9d325c8f6', 'request_id': 'req-16250ac2-8e7b-4db1-9240-fa83f9a9707a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:01.092488 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-16250ac2-8e7b-4db1-9240-fa83f9a9707a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12f7d764a613404a9be3d0a9d325c8f6', 'request_id': 'req-16250ac2-8e7b-4db1-9240-fa83f9a9707a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:01.098571 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-16250ac2-8e7b-4db1-9240-fa83f9a9707a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12f7d764a613404a9be3d0a9d325c8f6', 'request_id': 'req-16250ac2-8e7b-4db1-9240-fa83f9a9707a'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:01.166162 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-16250ac2-8e7b-4db1-9240-fa83f9a9707a admin admin] The token cache is being invalidate because project 12f7d764a613404a9be3d0a9d325c8f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 22:00:01.166953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-16250ac2-8e7b-4db1-9240-fa83f9a9707a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:01.167567 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-16250ac2-8e7b-4db1-9240-fa83f9a9707a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:01.169111 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4312/8651] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 22:00:00 2022] DELETE /identity/v3/projects/12f7d764a613404a9be3d0a9d325c8f6 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:00:01.173240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd33f785-6e14-48b0-87a4-a289209c0313 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:01.183358 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd33f785-6e14-48b0-87a4-a289209c0313 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:01.238303 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f8453-b734-4a4e-a952-45b9606dcb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:01.239181 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f8453-b734-4a4e-a952-45b9606dcb5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:01.239468 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f8453-b734-4a4e-a952-45b9606dcb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:01.239777 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f8453-b734-4a4e-a952-45b9606dcb5b admin admin] PATH_INFO: `/v3/users/1f895f6258fe4d38bfa01a33d9d51f2e` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:01.240976 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518f8453-b734-4a4e-a952-45b9606dcb5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f895f6258fe4d38bfa01a33d9d51f2e)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:01.242957 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518f8453-b734-4a4e-a952-45b9606dcb5b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:01.400496 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-518f8453-b734-4a4e-a952-45b9606dcb5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f895f6258fe4d38bfa01a33d9d51f2e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:01.412272 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-518f8453-b734-4a4e-a952-45b9606dcb5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f895f6258fe4d38bfa01a33d9d51f2e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:01.481588 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-518f8453-b734-4a4e-a952-45b9606dcb5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f895f6258fe4d38bfa01a33d9d51f2e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:01.489040 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-518f8453-b734-4a4e-a952-45b9606dcb5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f895f6258fe4d38bfa01a33d9d51f2e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:01.489677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-518f8453-b734-4a4e-a952-45b9606dcb5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f895f6258fe4d38bfa01a33d9d51f2e'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:01.495654 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4340/8652] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 22:00:01 2022] DELETE /identity/v3/users/1f895f6258fe4d38bfa01a33d9d51f2e => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:00:01.724092 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16250ac2-8e7b-4db1-9240-fa83f9a9707a admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:01.725876 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-16250ac2-8e7b-4db1-9240-fa83f9a9707a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:00:01.741043 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16250ac2-8e7b-4db1-9240-fa83f9a9707a admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:01.800237 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173cabb1-ce5c-4247-a1b9-99de62de6a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:01.801094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173cabb1-ce5c-4247-a1b9-99de62de6a5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:01.801380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173cabb1-ce5c-4247-a1b9-99de62de6a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:01.801660 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173cabb1-ce5c-4247-a1b9-99de62de6a5b admin admin] PATH_INFO: `/v3/projects/a1a221b784f54288ba132d18b7785965` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:01.802964 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173cabb1-ce5c-4247-a1b9-99de62de6a5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1a221b784f54288ba132d18b7785965)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:01.804885 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173cabb1-ce5c-4247-a1b9-99de62de6a5b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:01.904775 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-173cabb1-ce5c-4247-a1b9-99de62de6a5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1a221b784f54288ba132d18b7785965', 'request_id': 'req-173cabb1-ce5c-4247-a1b9-99de62de6a5b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:01.910208 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-173cabb1-ce5c-4247-a1b9-99de62de6a5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1a221b784f54288ba132d18b7785965', 'request_id': 'req-173cabb1-ce5c-4247-a1b9-99de62de6a5b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:01.916271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-173cabb1-ce5c-4247-a1b9-99de62de6a5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1a221b784f54288ba132d18b7785965', 'request_id': 'req-173cabb1-ce5c-4247-a1b9-99de62de6a5b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:01.983243 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-173cabb1-ce5c-4247-a1b9-99de62de6a5b admin admin] The token cache is being invalidate because project a1a221b784f54288ba132d18b7785965 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 22:00:01.983466 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-173cabb1-ce5c-4247-a1b9-99de62de6a5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:01.984075 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-173cabb1-ce5c-4247-a1b9-99de62de6a5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:01.985593 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4313/8653] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 22:00:01 2022] DELETE /identity/v3/projects/a1a221b784f54288ba132d18b7785965 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 22:00:01.990932 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb71d63-2a79-44f2-bda7-a3855f5dd318 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:01.991288 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb71d63-2a79-44f2-bda7-a3855f5dd318 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:01.991569 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb71d63-2a79-44f2-bda7-a3855f5dd318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:02.008741 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-ddb71d63-2a79-44f2-bda7-a3855f5dd318 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:00:02.010486 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ddb71d63-2a79-44f2-bda7-a3855f5dd318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:00:02.068055 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4341/8654] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:00:02.077853 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d39b7c-8a15-4800-8b15-fc67fc346de2 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:02.078140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d39b7c-8a15-4800-8b15-fc67fc346de2 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:02.078415 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d39b7c-8a15-4800-8b15-fc67fc346de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:02.105611 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-c2d39b7c-8a15-4800-8b15-fc67fc346de2 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:00:02.106872 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c2d39b7c-8a15-4800-8b15-fc67fc346de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:00:02.114982 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4314/8655] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:00:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:00:02.119242 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb71d63-2a79-44f2-bda7-a3855f5dd318 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:02.129418 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb71d63-2a79-44f2-bda7-a3855f5dd318 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:02.133964 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa666e72-ca67-4fdb-aae9-3bf832c77d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:02.134614 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa666e72-ca67-4fdb-aae9-3bf832c77d6c admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:02.134897 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa666e72-ca67-4fdb-aae9-3bf832c77d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:02.135778 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa666e72-ca67-4fdb-aae9-3bf832c77d6c admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:02.136495 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa666e72-ca67-4fdb-aae9-3bf832c77d6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 22:00:02.136803 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa666e72-ca67-4fdb-aae9-3bf832c77d6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:02.138442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa666e72-ca67-4fdb-aae9-3bf832c77d6c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:02.150353 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4342/8656] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 22:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 22:00:02.154509 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d39b7c-8a15-4800-8b15-fc67fc346de2 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:02.163664 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d39b7c-8a15-4800-8b15-fc67fc346de2 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:02.168320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350f0d5-604d-4130-b049-d3d51eae60f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:02.168966 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350f0d5-604d-4130-b049-d3d51eae60f3 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:02.169251 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350f0d5-604d-4130-b049-d3d51eae60f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:02.169529 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350f0d5-604d-4130-b049-d3d51eae60f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:02.170254 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350f0d5-604d-4130-b049-d3d51eae60f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:02.172270 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350f0d5-604d-4130-b049-d3d51eae60f3 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:02.292034 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4315/8657] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 22:00:02 2022] POST /identity/v3/projects => generated 365 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 22:00:02.296256 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa666e72-ca67-4fdb-aae9-3bf832c77d6c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:02.307278 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa666e72-ca67-4fdb-aae9-3bf832c77d6c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:02.362458 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c2712-807b-4139-b266-5e02f0346224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:02.363141 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c2712-807b-4139-b266-5e02f0346224 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:02.363436 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c2712-807b-4139-b266-5e02f0346224 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:02.363716 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c2712-807b-4139-b266-5e02f0346224 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:02.364406 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c2712-807b-4139-b266-5e02f0346224 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:02.366383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c2712-807b-4139-b266-5e02f0346224 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:02.433985 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4343/8658] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 22:00:02 2022] POST /identity/v3/users => generated 283 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 22:00:02.438217 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350f0d5-604d-4130-b049-d3d51eae60f3 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:02.448782 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350f0d5-604d-4130-b049-d3d51eae60f3 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:02.453608 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664571b-a3fd-4b30-bdb4-297963e3ce1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:02.454308 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664571b-a3fd-4b30-bdb4-297963e3ce1e admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:02.454648 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664571b-a3fd-4b30-bdb4-297963e3ce1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:02.454933 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664571b-a3fd-4b30-bdb4-297963e3ce1e admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:02.455658 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664571b-a3fd-4b30-bdb4-297963e3ce1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:02.457326 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664571b-a3fd-4b30-bdb4-297963e3ce1e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:02.467451 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4316/8659] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 22:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 22:00:02.473063 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c2712-807b-4139-b266-5e02f0346224 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:02.483926 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c2712-807b-4139-b266-5e02f0346224 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:02.488641 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c9d7f1-bee1-4ece-a52d-0534eadc39cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:02.489380 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c9d7f1-bee1-4ece-a52d-0534eadc39cf admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:02.489686 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c9d7f1-bee1-4ece-a52d-0534eadc39cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:02.489996 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c9d7f1-bee1-4ece-a52d-0534eadc39cf admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:02.490720 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c9d7f1-bee1-4ece-a52d-0534eadc39cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:02.492332 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c9d7f1-bee1-4ece-a52d-0534eadc39cf admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:02.503031 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4344/8660] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 22:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 22:00:02.507344 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664571b-a3fd-4b30-bdb4-297963e3ce1e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:02.517329 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664571b-a3fd-4b30-bdb4-297963e3ce1e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:02.521933 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a41d4d-18d6-4d59-bac8-c88bdc0ef1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:02.522801 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a41d4d-18d6-4d59-bac8-c88bdc0ef1be admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:02.523918 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a41d4d-18d6-4d59-bac8-c88bdc0ef1be admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:02.523918 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a41d4d-18d6-4d59-bac8-c88bdc0ef1be admin admin] PATH_INFO: `/v3/projects/4a83d197ad9d48f9b03772e3d41eca4a/users/83f1bd3e9c274bbba96f34f060819c41/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:02.537959 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a41d4d-18d6-4d59-bac8-c88bdc0ef1be admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a83d197ad9d48f9b03772e3d41eca4a, user_id=83f1bd3e9c274bbba96f34f060819c41, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:02.540611 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a41d4d-18d6-4d59-bac8-c88bdc0ef1be admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:02.618765 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4317/8661] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 22:00:02 2022] PUT /identity/v3/projects/4a83d197ad9d48f9b03772e3d41eca4a/users/83f1bd3e9c274bbba96f34f060819c41/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:00:02.624588 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5656204-2bfb-4384-8082-81b541597abc None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:02.624882 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5656204-2bfb-4384-8082-81b541597abc None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:02.625158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5656204-2bfb-4384-8082-81b541597abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:02.642856 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-b5656204-2bfb-4384-8082-81b541597abc None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:00:02.644043 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b5656204-2bfb-4384-8082-81b541597abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:00:02.704896 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4345/8662] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:00:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:00:02.714489 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a41d4d-18d6-4d59-bac8-c88bdc0ef1be admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:02.716147 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-57a41d4d-18d6-4d59-bac8-c88bdc0ef1be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:00:02.772698 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a41d4d-18d6-4d59-bac8-c88bdc0ef1be admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:02.776386 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839161a-86a8-45ce-80ff-08596137d5ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:02.777034 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839161a-86a8-45ce-80ff-08596137d5ad service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:02.777319 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839161a-86a8-45ce-80ff-08596137d5ad service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:02.777594 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839161a-86a8-45ce-80ff-08596137d5ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:02.786432 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2839161a-86a8-45ce-80ff-08596137d5ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:02.787877 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2839161a-86a8-45ce-80ff-08596137d5ad service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:02.799764 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4318/8663] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:00:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:00:08.171477 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd0091-fe07-4974-b0b1-ad4b62fe8b98 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:08.172016 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd0091-fe07-4974-b0b1-ad4b62fe8b98 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:08.172118 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd0091-fe07-4974-b0b1-ad4b62fe8b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:08.199670 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-99dd0091-fe07-4974-b0b1-ad4b62fe8b98 None None] MFA Rules not processed for user `83f1bd3e9c274bbba96f34f060819c41`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:00:08.200987 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-99dd0091-fe07-4974-b0b1-ad4b62fe8b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:00:08.271702 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4346/8664] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:00:08 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:00:08.279485 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839161a-86a8-45ce-80ff-08596137d5ad service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:08.289803 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839161a-86a8-45ce-80ff-08596137d5ad service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:08.295894 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016fa02-ef82-4be5-b028-29a00f805d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:08.296713 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016fa02-ef82-4be5-b028-29a00f805d08 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:08.297061 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016fa02-ef82-4be5-b028-29a00f805d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:08.297408 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016fa02-ef82-4be5-b028-29a00f805d08 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:08.298214 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016fa02-ef82-4be5-b028-29a00f805d08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:08.300179 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016fa02-ef82-4be5-b028-29a00f805d08 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:08.434480 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4319/8665] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 22:00:08 2022] POST /identity/v3/users => generated 287 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 22:00:08.438686 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd0091-fe07-4974-b0b1-ad4b62fe8b98 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:08.450549 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd0091-fe07-4974-b0b1-ad4b62fe8b98 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:08.455506 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67142810-5c09-42b5-a169-e5e82a9b13f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:08.456184 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67142810-5c09-42b5-a169-e5e82a9b13f6 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:08.456470 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67142810-5c09-42b5-a169-e5e82a9b13f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:08.456774 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67142810-5c09-42b5-a169-e5e82a9b13f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:08.457506 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67142810-5c09-42b5-a169-e5e82a9b13f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:08.459277 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67142810-5c09-42b5-a169-e5e82a9b13f6 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:08.470574 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4347/8666] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 22:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 22:00:08.486897 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016fa02-ef82-4be5-b028-29a00f805d08 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:08.497635 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016fa02-ef82-4be5-b028-29a00f805d08 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:08.503014 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe22780-c1c6-4826-8789-6fa9914100e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:08.503896 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe22780-c1c6-4826-8789-6fa9914100e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:08.504182 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe22780-c1c6-4826-8789-6fa9914100e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:08.504460 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe22780-c1c6-4826-8789-6fa9914100e1 admin admin] PATH_INFO: `/v3/system/users/6b27e3fa3530486eb5d16150647bbf3b/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:08.522423 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe22780-c1c6-4826-8789-6fa9914100e1 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6b27e3fa3530486eb5d16150647bbf3b, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:08.523482 ncdv-master-1 devstack@keystone.service[91017]: WARNING py.warnings [None req-ffe22780-c1c6-4826-8789-6fa9914100e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 22:00:08.523482 ncdv-master-1 devstack@keystone.service[91017]: warnings.warn(msg) Apr 30 22:00:08.523482 ncdv-master-1 devstack@keystone.service[91017]: Apr 30 22:00:08.524400 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe22780-c1c6-4826-8789-6fa9914100e1 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:08.565495 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4320/8667] 10.222.0.23 () {60 vars in 1377 bytes} [Sat Apr 30 22:00:08 2022] PUT /identity/v3/system/users/6b27e3fa3530486eb5d16150647bbf3b/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 22:00:08.580617 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620cb56-7214-4933-94e5-ff95b7ed7ebf None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:08.580911 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620cb56-7214-4933-94e5-ff95b7ed7ebf None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:08.581187 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620cb56-7214-4933-94e5-ff95b7ed7ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:08.606474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-0620cb56-7214-4933-94e5-ff95b7ed7ebf None None] MFA Rules not processed for user `6b27e3fa3530486eb5d16150647bbf3b`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:00:08.607665 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0620cb56-7214-4933-94e5-ff95b7ed7ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:00:08.679392 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4348/8668] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:00:08 2022] POST /identity/v3/auth/tokens => generated 2404 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 30 22:00:08.683944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe22780-c1c6-4826-8789-6fa9914100e1 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:08.794176 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe22780-c1c6-4826-8789-6fa9914100e1 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:08.829494 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829a088-fb1b-4e1a-9160-ec39f5191566 None tempest-ImageQuotaTest-680186824-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b27e3fa3530486eb5d16150647bbf3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:08.830196 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829a088-fb1b-4e1a-9160-ec39f5191566 None tempest-ImageQuotaTest-680186824-system-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:08.830482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829a088-fb1b-4e1a-9160-ec39f5191566 None tempest-ImageQuotaTest-680186824-system-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:08.830798 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829a088-fb1b-4e1a-9160-ec39f5191566 None tempest-ImageQuotaTest-680186824-system-admin] PATH_INFO: `/v3/services` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:08.831493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d829a088-fb1b-4e1a-9160-ec39f5191566 None tempest-ImageQuotaTest-680186824-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:08.832875 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d829a088-fb1b-4e1a-9160-ec39f5191566 None tempest-ImageQuotaTest-680186824-system-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:08.839802 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4321/8669] 10.222.0.23 () {58 vars in 1109 bytes} [Sat Apr 30 22:00:08 2022] GET /identity/v3/services => generated 2191 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 22:00:08.845058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620cb56-7214-4933-94e5-ff95b7ed7ebf None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:08.946770 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620cb56-7214-4933-94e5-ff95b7ed7ebf None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:08.981056 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01330d19-b384-4603-bd97-bd2fa15fdcbc None tempest-ImageQuotaTest-680186824-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b27e3fa3530486eb5d16150647bbf3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:08.981748 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01330d19-b384-4603-bd97-bd2fa15fdcbc None tempest-ImageQuotaTest-680186824-system-admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:08.982060 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01330d19-b384-4603-bd97-bd2fa15fdcbc None tempest-ImageQuotaTest-680186824-system-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:08.982335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01330d19-b384-4603-bd97-bd2fa15fdcbc None tempest-ImageQuotaTest-680186824-system-admin] PATH_INFO: `/v3/limits` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:08.983065 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01330d19-b384-4603-bd97-bd2fa15fdcbc None tempest-ImageQuotaTest-680186824-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:08.984412 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01330d19-b384-4603-bd97-bd2fa15fdcbc None tempest-ImageQuotaTest-680186824-system-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:09.026906 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-01330d19-b384-4603-bd97-bd2fa15fdcbc None tempest-ImageQuotaTest-680186824-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Apr 30 22:00:09.026906 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 22:00:09.026906 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 22:00:09.026906 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 22:00:09.026906 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 22:00:09.026906 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 22:00:09.026906 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 22:00:09.026906 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 22:00:09.026906 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 22:00:09.026906 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 22:00:09.026906 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 22:00:09.026906 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 22:00:09.026906 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Apr 30 22:00:09.026906 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Apr 30 22:00:09.028137 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 22:00:09.028137 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 22:00:09.028137 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Apr 30 22:00:09.028137 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Apr 30 22:00:09.028137 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Apr 30 22:00:09.028137 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return method(*args, **kwargs) Apr 30 22:00:09.028137 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Apr 30 22:00:09.028137 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Apr 30 22:00:09.028137 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Apr 30 22:00:09.028137 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.NoLimitReference Apr 30 22:00:09.028137 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Apr 30 22:00:09.028137 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 22:00:09.029017 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4349/8670] 10.222.0.23 () {60 vars in 1125 bytes} [Sat Apr 30 22:00:08 2022] POST /identity/v3/limits => generated 124 bytes in 184 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Apr 30 22:00:09.034161 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829a088-fb1b-4e1a-9160-ec39f5191566 None tempest-ImageQuotaTest-680186824-system-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:09.142401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829a088-fb1b-4e1a-9160-ec39f5191566 None tempest-ImageQuotaTest-680186824-system-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:09.179746 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa1ba3-df92-4aff-ab1c-5cb6168e766c None tempest-ImageQuotaTest-680186824-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b27e3fa3530486eb5d16150647bbf3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:09.180411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa1ba3-df92-4aff-ab1c-5cb6168e766c None tempest-ImageQuotaTest-680186824-system-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:09.180696 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa1ba3-df92-4aff-ab1c-5cb6168e766c None tempest-ImageQuotaTest-680186824-system-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:09.180975 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa1ba3-df92-4aff-ab1c-5cb6168e766c None tempest-ImageQuotaTest-680186824-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:09.182341 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa1ba3-df92-4aff-ab1c-5cb6168e766c None tempest-ImageQuotaTest-680186824-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:09.183455 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa1ba3-df92-4aff-ab1c-5cb6168e766c None tempest-ImageQuotaTest-680186824-system-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:09.189991 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4322/8671] 10.222.0.23 () {58 vars in 1136 bytes} [Sat Apr 30 22:00:09 2022] GET /identity/v3/registered_limits => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 22:00:09.196145 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01330d19-b384-4603-bd97-bd2fa15fdcbc None tempest-ImageQuotaTest-680186824-system-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:09.313990 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01330d19-b384-4603-bd97-bd2fa15fdcbc None tempest-ImageQuotaTest-680186824-system-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:09.347978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576db99-cbc7-471a-baf9-5040f4d57a30 None tempest-ImageQuotaTest-680186824-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b27e3fa3530486eb5d16150647bbf3b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:09.348646 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576db99-cbc7-471a-baf9-5040f4d57a30 None tempest-ImageQuotaTest-680186824-system-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:09.348934 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576db99-cbc7-471a-baf9-5040f4d57a30 None tempest-ImageQuotaTest-680186824-system-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:09.349214 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576db99-cbc7-471a-baf9-5040f4d57a30 None tempest-ImageQuotaTest-680186824-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:09.349951 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5576db99-cbc7-471a-baf9-5040f4d57a30 None tempest-ImageQuotaTest-680186824-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:09.351032 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5576db99-cbc7-471a-baf9-5040f4d57a30 None tempest-ImageQuotaTest-680186824-system-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:09.356714 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4350/8672] 10.222.0.23 () {58 vars in 1136 bytes} [Sat Apr 30 22:00:09 2022] GET /identity/v3/registered_limits => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 22:00:12.787195 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa1ba3-df92-4aff-ab1c-5cb6168e766c None tempest-ImageQuotaTest-680186824-system-admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:12.799594 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa1ba3-df92-4aff-ab1c-5cb6168e766c None tempest-ImageQuotaTest-680186824-system-admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:12.804167 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3daa0a-acc6-4153-9c6f-2d6ff7ef1217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:12.805023 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3daa0a-acc6-4153-9c6f-2d6ff7ef1217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:12.805305 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3daa0a-acc6-4153-9c6f-2d6ff7ef1217 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:12.805581 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3daa0a-acc6-4153-9c6f-2d6ff7ef1217 admin admin] PATH_INFO: `/v3/users/83f1bd3e9c274bbba96f34f060819c41` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:12.807280 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3daa0a-acc6-4153-9c6f-2d6ff7ef1217 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83f1bd3e9c274bbba96f34f060819c41)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:12.809221 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3daa0a-acc6-4153-9c6f-2d6ff7ef1217 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:13.006401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4c3daa0a-acc6-4153-9c6f-2d6ff7ef1217 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83f1bd3e9c274bbba96f34f060819c41'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:13.018517 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4c3daa0a-acc6-4153-9c6f-2d6ff7ef1217 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83f1bd3e9c274bbba96f34f060819c41'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:13.078866 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4c3daa0a-acc6-4153-9c6f-2d6ff7ef1217 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83f1bd3e9c274bbba96f34f060819c41'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:13.079503 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4c3daa0a-acc6-4153-9c6f-2d6ff7ef1217 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83f1bd3e9c274bbba96f34f060819c41'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:13.086701 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4c3daa0a-acc6-4153-9c6f-2d6ff7ef1217 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83f1bd3e9c274bbba96f34f060819c41'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:13.098217 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4323/8673] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 22:00:12 2022] DELETE /identity/v3/users/83f1bd3e9c274bbba96f34f060819c41 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:00:13.320685 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576db99-cbc7-471a-baf9-5040f4d57a30 None tempest-ImageQuotaTest-680186824-system-admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:13.323238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5576db99-cbc7-471a-baf9-5040f4d57a30 None tempest-ImageQuotaTest-680186824-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:00:13.392320 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576db99-cbc7-471a-baf9-5040f4d57a30 None tempest-ImageQuotaTest-680186824-system-admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:13.396932 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25761460-f585-4061-9e64-f976c5bcf076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:13.397813 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25761460-f585-4061-9e64-f976c5bcf076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:13.402749 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25761460-f585-4061-9e64-f976c5bcf076 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:13.402749 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25761460-f585-4061-9e64-f976c5bcf076 admin admin] PATH_INFO: `/v3/projects/4a83d197ad9d48f9b03772e3d41eca4a` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:13.402749 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25761460-f585-4061-9e64-f976c5bcf076 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a83d197ad9d48f9b03772e3d41eca4a)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:13.402749 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25761460-f585-4061-9e64-f976c5bcf076 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:13.502316 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-25761460-f585-4061-9e64-f976c5bcf076 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a83d197ad9d48f9b03772e3d41eca4a', 'request_id': 'req-25761460-f585-4061-9e64-f976c5bcf076'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:13.507517 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-25761460-f585-4061-9e64-f976c5bcf076 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a83d197ad9d48f9b03772e3d41eca4a', 'request_id': 'req-25761460-f585-4061-9e64-f976c5bcf076'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:13.514226 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-25761460-f585-4061-9e64-f976c5bcf076 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a83d197ad9d48f9b03772e3d41eca4a', 'request_id': 'req-25761460-f585-4061-9e64-f976c5bcf076'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:13.600588 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-25761460-f585-4061-9e64-f976c5bcf076 admin admin] The token cache is being invalidate because project 4a83d197ad9d48f9b03772e3d41eca4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 22:00:13.600808 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-25761460-f585-4061-9e64-f976c5bcf076 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:13.601434 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-25761460-f585-4061-9e64-f976c5bcf076 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:13.603065 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4351/8674] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 22:00:13 2022] DELETE /identity/v3/projects/4a83d197ad9d48f9b03772e3d41eca4a => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:00:13.607030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3daa0a-acc6-4153-9c6f-2d6ff7ef1217 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:13.617236 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3daa0a-acc6-4153-9c6f-2d6ff7ef1217 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:13.672330 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422e3da-6eb2-4127-8e18-e0c7d8793d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:13.673184 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422e3da-6eb2-4127-8e18-e0c7d8793d53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:13.673465 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422e3da-6eb2-4127-8e18-e0c7d8793d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:13.673737 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422e3da-6eb2-4127-8e18-e0c7d8793d53 admin admin] PATH_INFO: `/v3/users/6b27e3fa3530486eb5d16150647bbf3b` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:13.675016 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7422e3da-6eb2-4127-8e18-e0c7d8793d53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b27e3fa3530486eb5d16150647bbf3b)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:13.676941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7422e3da-6eb2-4127-8e18-e0c7d8793d53 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:13.868382 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7422e3da-6eb2-4127-8e18-e0c7d8793d53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b27e3fa3530486eb5d16150647bbf3b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:13.880314 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7422e3da-6eb2-4127-8e18-e0c7d8793d53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b27e3fa3530486eb5d16150647bbf3b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:13.938450 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7422e3da-6eb2-4127-8e18-e0c7d8793d53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b27e3fa3530486eb5d16150647bbf3b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:13.939064 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7422e3da-6eb2-4127-8e18-e0c7d8793d53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b27e3fa3530486eb5d16150647bbf3b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:13.946154 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7422e3da-6eb2-4127-8e18-e0c7d8793d53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b27e3fa3530486eb5d16150647bbf3b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:13.952175 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4324/8675] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 22:00:13 2022] DELETE /identity/v3/users/6b27e3fa3530486eb5d16150647bbf3b => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:00:14.361076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25761460-f585-4061-9e64-f976c5bcf076 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:14.362651 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-25761460-f585-4061-9e64-f976c5bcf076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:00:14.382718 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25761460-f585-4061-9e64-f976c5bcf076 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:14.441044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4586551-4910-43bf-8297-1fb55d5f0549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:14.441744 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4586551-4910-43bf-8297-1fb55d5f0549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:14.442055 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4586551-4910-43bf-8297-1fb55d5f0549 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:14.442331 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4586551-4910-43bf-8297-1fb55d5f0549 admin admin] PATH_INFO: `/v3/projects/None` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:14.449421 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4586551-4910-43bf-8297-1fb55d5f0549 admin admin] RBAC: Authorizing `identity:delete_project(project_id=None)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:14.451315 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4586551-4910-43bf-8297-1fb55d5f0549 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:14.464525 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application [None req-d4586551-4910-43bf-8297-1fb55d5f0549 admin admin] Could not find project: None.: keystone.exception.ProjectNotFound: Could not find project: None. Apr 30 22:00:14.464525 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Traceback (most recent call last): Apr 30 22:00:14.464525 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Apr 30 22:00:14.464525 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application rv = self.dispatch_request() Apr 30 22:00:14.464525 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Apr 30 22:00:14.464525 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Apr 30 22:00:14.464525 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Apr 30 22:00:14.464525 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Apr 30 22:00:14.464525 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Apr 30 22:00:14.464525 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Apr 30 22:00:14.464525 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Apr 30 22:00:14.464525 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Apr 30 22:00:14.464525 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Apr 30 22:00:14.464525 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Apr 30 22:00:14.464525 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Apr 30 22:00:14.464525 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Apr 30 22:00:14.465806 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Apr 30 22:00:14.465806 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Apr 30 22:00:14.465806 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Apr 30 22:00:14.465806 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Apr 30 22:00:14.465806 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Apr 30 22:00:14.465806 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Apr 30 22:00:14.465806 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: None. Apr 30 22:00:14.465806 ncdv-master-1 devstack@keystone.service[91018]: ERROR keystone.server.flask.application Apr 30 22:00:14.465806 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4352/8676] 10.222.0.23 () {58 vars in 1148 bytes} [Sat Apr 30 22:00:14 2022] DELETE /identity/v3/projects/None => generated 85 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 30 22:00:24.666007 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac59bec-72d4-40d5-baef-46cfff3e15a5 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:24.666543 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac59bec-72d4-40d5-baef-46cfff3e15a5 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:24.666543 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac59bec-72d4-40d5-baef-46cfff3e15a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:24.685301 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-3ac59bec-72d4-40d5-baef-46cfff3e15a5 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:00:24.686605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3ac59bec-72d4-40d5-baef-46cfff3e15a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:00:24.694631 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4325/8677] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:00:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:00:24.710271 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864fcba-9635-44ac-837e-1a8b44ac5995 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:24.710782 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864fcba-9635-44ac-837e-1a8b44ac5995 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:24.711934 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864fcba-9635-44ac-837e-1a8b44ac5995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:24.729444 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-1864fcba-9635-44ac-837e-1a8b44ac5995 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:00:24.730694 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1864fcba-9635-44ac-837e-1a8b44ac5995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:00:24.738481 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4353/8678] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:00:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 22:00:24.743150 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac59bec-72d4-40d5-baef-46cfff3e15a5 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:24.753282 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac59bec-72d4-40d5-baef-46cfff3e15a5 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:24.757925 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88314721-38c3-470c-b759-4bb29077ecba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:24.763039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88314721-38c3-470c-b759-4bb29077ecba admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:24.763039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88314721-38c3-470c-b759-4bb29077ecba admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:24.763039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88314721-38c3-470c-b759-4bb29077ecba admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:24.763039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88314721-38c3-470c-b759-4bb29077ecba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 22:00:24.763039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88314721-38c3-470c-b759-4bb29077ecba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:24.763039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88314721-38c3-470c-b759-4bb29077ecba admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:24.774115 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4326/8679] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 22:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 22:00:24.792811 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864fcba-9635-44ac-837e-1a8b44ac5995 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:24.802401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864fcba-9635-44ac-837e-1a8b44ac5995 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:24.807464 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab0079-7a27-4608-88a4-a130c3374574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:24.808105 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab0079-7a27-4608-88a4-a130c3374574 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:24.808384 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab0079-7a27-4608-88a4-a130c3374574 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:24.808657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab0079-7a27-4608-88a4-a130c3374574 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:24.809422 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab0079-7a27-4608-88a4-a130c3374574 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:24.811424 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab0079-7a27-4608-88a4-a130c3374574 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:24.897200 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4354/8680] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 22:00:24 2022] POST /identity/v3/projects => generated 391 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 22:00:24.901641 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88314721-38c3-470c-b759-4bb29077ecba admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:24.911931 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88314721-38c3-470c-b759-4bb29077ecba admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:24.966793 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef2819-2520-4557-802e-4780479b1012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:24.967680 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef2819-2520-4557-802e-4780479b1012 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:24.967813 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef2819-2520-4557-802e-4780479b1012 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:24.968094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef2819-2520-4557-802e-4780479b1012 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:24.968783 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef2819-2520-4557-802e-4780479b1012 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:24.970830 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef2819-2520-4557-802e-4780479b1012 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:25.055885 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4327/8681] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 22:00:24 2022] POST /identity/v3/users => generated 296 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 22:00:25.060667 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab0079-7a27-4608-88a4-a130c3374574 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:25.071047 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab0079-7a27-4608-88a4-a130c3374574 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:25.075716 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da37f7-4831-4358-ac81-0e466ef27c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:25.076367 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da37f7-4831-4358-ac81-0e466ef27c5f admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:25.076683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da37f7-4831-4358-ac81-0e466ef27c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:25.076931 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da37f7-4831-4358-ac81-0e466ef27c5f admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:25.077662 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da37f7-4831-4358-ac81-0e466ef27c5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:25.079284 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da37f7-4831-4358-ac81-0e466ef27c5f admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:25.089735 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4355/8682] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 22:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 22:00:25.093678 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef2819-2520-4557-802e-4780479b1012 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:25.103962 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef2819-2520-4557-802e-4780479b1012 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:25.108543 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1903167-6b55-48dd-a714-a0f1bfe52db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:25.109180 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1903167-6b55-48dd-a714-a0f1bfe52db1 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:25.109468 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1903167-6b55-48dd-a714-a0f1bfe52db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:25.109744 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1903167-6b55-48dd-a714-a0f1bfe52db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:25.110479 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1903167-6b55-48dd-a714-a0f1bfe52db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:25.112060 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1903167-6b55-48dd-a714-a0f1bfe52db1 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:25.122480 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4328/8683] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 22:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 22:00:25.126478 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da37f7-4831-4358-ac81-0e466ef27c5f admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:25.136552 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da37f7-4831-4358-ac81-0e466ef27c5f admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:25.141710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a113d-8de9-4d85-8e45-34cb11ca1cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:25.143231 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a113d-8de9-4d85-8e45-34cb11ca1cd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:25.143516 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a113d-8de9-4d85-8e45-34cb11ca1cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:25.143796 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a113d-8de9-4d85-8e45-34cb11ca1cd2 admin admin] PATH_INFO: `/v3/projects/2bae0a08aedf4727bc608812485cfd5e/users/f1c0ee25ae4a4265b191f1291e8997f9/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:25.158079 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a113d-8de9-4d85-8e45-34cb11ca1cd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bae0a08aedf4727bc608812485cfd5e, user_id=f1c0ee25ae4a4265b191f1291e8997f9, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:25.160727 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a113d-8de9-4d85-8e45-34cb11ca1cd2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:25.267882 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4356/8684] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 22:00:25 2022] PUT /identity/v3/projects/2bae0a08aedf4727bc608812485cfd5e/users/f1c0ee25ae4a4265b191f1291e8997f9/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 22:00:25.279378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb74cdb-9dde-47d4-ae90-2c6c1733e1d7 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:25.279555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb74cdb-9dde-47d4-ae90-2c6c1733e1d7 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:25.279834 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb74cdb-9dde-47d4-ae90-2c6c1733e1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:25.307337 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-6cb74cdb-9dde-47d4-ae90-2c6c1733e1d7 None None] MFA Rules not processed for user `f1c0ee25ae4a4265b191f1291e8997f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:00:25.308538 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6cb74cdb-9dde-47d4-ae90-2c6c1733e1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:00:25.372572 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4329/8685] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:00:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 22:00:25.377242 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a113d-8de9-4d85-8e45-34cb11ca1cd2 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:25.437627 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a113d-8de9-4d85-8e45-34cb11ca1cd2 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:25.442403 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a35e37-9efe-4a42-ac3f-e97853a7a9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:25.443085 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a35e37-9efe-4a42-ac3f-e97853a7a9bd admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:25.443368 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a35e37-9efe-4a42-ac3f-e97853a7a9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:25.443646 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a35e37-9efe-4a42-ac3f-e97853a7a9bd admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:25.444333 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a35e37-9efe-4a42-ac3f-e97853a7a9bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:25.446289 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a35e37-9efe-4a42-ac3f-e97853a7a9bd admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:25.532017 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4357/8686] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 22:00:25 2022] POST /identity/v3/projects => generated 391 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 22:00:25.536125 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb74cdb-9dde-47d4-ae90-2c6c1733e1d7 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:25.547378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb74cdb-9dde-47d4-ae90-2c6c1733e1d7 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:25.601546 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8f2fc-3e8e-421e-9ce5-d8896e5128f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:25.602237 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8f2fc-3e8e-421e-9ce5-d8896e5128f1 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:25.602523 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8f2fc-3e8e-421e-9ce5-d8896e5128f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:25.602804 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df8f2fc-3e8e-421e-9ce5-d8896e5128f1 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:25.604051 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df8f2fc-3e8e-421e-9ce5-d8896e5128f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:25.606101 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df8f2fc-3e8e-421e-9ce5-d8896e5128f1 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:25.716003 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4330/8687] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 22:00:25 2022] POST /identity/v3/users => generated 302 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 22:00:25.720814 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a35e37-9efe-4a42-ac3f-e97853a7a9bd admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:25.735040 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a35e37-9efe-4a42-ac3f-e97853a7a9bd admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:25.741799 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08362efd-ff00-4be5-b3dd-f05778ccdcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:25.741799 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08362efd-ff00-4be5-b3dd-f05778ccdcd1 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:25.741799 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08362efd-ff00-4be5-b3dd-f05778ccdcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:25.741799 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08362efd-ff00-4be5-b3dd-f05778ccdcd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:25.742244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08362efd-ff00-4be5-b3dd-f05778ccdcd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:25.743244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08362efd-ff00-4be5-b3dd-f05778ccdcd1 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:25.755222 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4358/8688] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 22:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 22:00:25.759623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8f2fc-3e8e-421e-9ce5-d8896e5128f1 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:25.770229 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df8f2fc-3e8e-421e-9ce5-d8896e5128f1 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:25.774888 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb22be0-e8f8-40df-9107-8e01d80e63a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:25.775756 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb22be0-e8f8-40df-9107-8e01d80e63a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:25.776037 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb22be0-e8f8-40df-9107-8e01d80e63a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:25.776309 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb22be0-e8f8-40df-9107-8e01d80e63a7 admin admin] PATH_INFO: `/v3/projects/0e65c38e3ff842df99c336b404c2479a/users/686799762ca943a0bca4b4bb0ae53722/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:25.791468 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb22be0-e8f8-40df-9107-8e01d80e63a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e65c38e3ff842df99c336b404c2479a, user_id=686799762ca943a0bca4b4bb0ae53722, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:25.794199 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb22be0-e8f8-40df-9107-8e01d80e63a7 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:25.881325 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4331/8689] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 22:00:25 2022] PUT /identity/v3/projects/0e65c38e3ff842df99c336b404c2479a/users/686799762ca943a0bca4b4bb0ae53722/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:00:25.885289 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08362efd-ff00-4be5-b3dd-f05778ccdcd1 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:25.895542 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08362efd-ff00-4be5-b3dd-f05778ccdcd1 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:25.951516 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cec1ec-68f8-471a-b5b7-e348f880bdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:25.952169 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cec1ec-68f8-471a-b5b7-e348f880bdc2 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:25.952450 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cec1ec-68f8-471a-b5b7-e348f880bdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:25.952723 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cec1ec-68f8-471a-b5b7-e348f880bdc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:25.953428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cec1ec-68f8-471a-b5b7-e348f880bdc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:25.955102 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cec1ec-68f8-471a-b5b7-e348f880bdc2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:25.964496 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4359/8690] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 22:00:25 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 22:00:25.968742 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb22be0-e8f8-40df-9107-8e01d80e63a7 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:25.979735 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb22be0-e8f8-40df-9107-8e01d80e63a7 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:25.984380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858cd4b-f48a-486f-b4e0-68da3c303a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:25.985258 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858cd4b-f48a-486f-b4e0-68da3c303a22 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:25.985539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858cd4b-f48a-486f-b4e0-68da3c303a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:25.985851 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858cd4b-f48a-486f-b4e0-68da3c303a22 admin admin] PATH_INFO: `/v3/projects/0e65c38e3ff842df99c336b404c2479a/users/686799762ca943a0bca4b4bb0ae53722/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:25.987846 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858cd4b-f48a-486f-b4e0-68da3c303a22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e65c38e3ff842df99c336b404c2479a, user_id=686799762ca943a0bca4b4bb0ae53722, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:25.990536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858cd4b-f48a-486f-b4e0-68da3c303a22 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:26.004989 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4332/8691] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 22:00:25 2022] PUT /identity/v3/projects/0e65c38e3ff842df99c336b404c2479a/users/686799762ca943a0bca4b4bb0ae53722/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 22:00:26.017554 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091e6fe-9891-4b52-834f-4bfcbeffd43d None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:26.017870 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091e6fe-9891-4b52-834f-4bfcbeffd43d None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:26.018146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091e6fe-9891-4b52-834f-4bfcbeffd43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:26.050987 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-e091e6fe-9891-4b52-834f-4bfcbeffd43d None None] MFA Rules not processed for user `686799762ca943a0bca4b4bb0ae53722`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:00:26.050987 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e091e6fe-9891-4b52-834f-4bfcbeffd43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:00:26.117378 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4360/8692] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:00:26 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:00:26.129398 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293be4eb-7c74-4dbb-906a-1ecf195ac37d None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:26.130624 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293be4eb-7c74-4dbb-906a-1ecf195ac37d None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:26.130624 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293be4eb-7c74-4dbb-906a-1ecf195ac37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:26.147862 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-293be4eb-7c74-4dbb-906a-1ecf195ac37d None None] MFA Rules not processed for user `f1c0ee25ae4a4265b191f1291e8997f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:00:26.149132 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-293be4eb-7c74-4dbb-906a-1ecf195ac37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:00:26.204445 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4333/8693] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:00:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:00:26.227678 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091e6fe-9891-4b52-834f-4bfcbeffd43d None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:26.229635 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e091e6fe-9891-4b52-834f-4bfcbeffd43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:00:26.305904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091e6fe-9891-4b52-834f-4bfcbeffd43d None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:26.311594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebe4cd-71b0-4420-afe9-10efd5fc7b62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:26.312244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebe4cd-71b0-4420-afe9-10efd5fc7b62 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:26.312529 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebe4cd-71b0-4420-afe9-10efd5fc7b62 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:26.312807 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebe4cd-71b0-4420-afe9-10efd5fc7b62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:26.320657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaebe4cd-71b0-4420-afe9-10efd5fc7b62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:26.322314 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaebe4cd-71b0-4420-afe9-10efd5fc7b62 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:26.335537 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4361/8694] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:00:26 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:00:27.212381 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268172ee-0df6-4ee9-b620-b0e332ae25ae None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:27.212827 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268172ee-0df6-4ee9-b620-b0e332ae25ae None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:27.213111 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268172ee-0df6-4ee9-b620-b0e332ae25ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:27.234035 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-268172ee-0df6-4ee9-b620-b0e332ae25ae None None] MFA Rules not processed for user `4ad3f89b7037413a83c7905cef263b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:00:27.235268 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-268172ee-0df6-4ee9-b620-b0e332ae25ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:00:27.298395 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4334/8695] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Apr 30 22:00:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 22:00:27.310366 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebe4cd-71b0-4420-afe9-10efd5fc7b62 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:27.311752 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-eaebe4cd-71b0-4420-afe9-10efd5fc7b62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:00:27.328208 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebe4cd-71b0-4420-afe9-10efd5fc7b62 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:27.333159 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3b930-6aba-4d88-a240-ac58e16cf207 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:27.333824 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3b930-6aba-4d88-a240-ac58e16cf207 service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:27.334112 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3b930-6aba-4d88-a240-ac58e16cf207 service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:27.334388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3b930-6aba-4d88-a240-ac58e16cf207 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:27.342716 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3b930-6aba-4d88-a240-ac58e16cf207 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:27.344298 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3b930-6aba-4d88-a240-ac58e16cf207 service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:27.354510 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4362/8696] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:00:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:00:39.037622 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268172ee-0df6-4ee9-b620-b0e332ae25ae None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:39.052702 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268172ee-0df6-4ee9-b620-b0e332ae25ae None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:39.058414 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91355ba5-37d6-4879-8fbd-df5a16bb2514 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:39.058824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91355ba5-37d6-4879-8fbd-df5a16bb2514 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:39.059108 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91355ba5-37d6-4879-8fbd-df5a16bb2514 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:39.059385 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91355ba5-37d6-4879-8fbd-df5a16bb2514 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:39.067574 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91355ba5-37d6-4879-8fbd-df5a16bb2514 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:39.069166 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91355ba5-37d6-4879-8fbd-df5a16bb2514 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:39.078577 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4335/8697] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:00:39 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:00:39.092798 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2587cd-bac5-4183-90b7-343bcb8d2c9d None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:39.093249 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2587cd-bac5-4183-90b7-343bcb8d2c9d None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:39.093373 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2587cd-bac5-4183-90b7-343bcb8d2c9d None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:39.094748 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4363/8698] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 22:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 22:00:39.099116 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91355ba5-37d6-4879-8fbd-df5a16bb2514 service nova] Authenticating service token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 30 22:00:39.113141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91355ba5-37d6-4879-8fbd-df5a16bb2514 service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:39.121329 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91355ba5-37d6-4879-8fbd-df5a16bb2514 service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:39.125886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059403d0-3cd2-4988-be32-6d691814d0f3 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686799762ca943a0bca4b4bb0ae53722', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e65c38e3ff842df99c336b404c2479a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:39.126728 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059403d0-3cd2-4988-be32-6d691814d0f3 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:39.126991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059403d0-3cd2-4988-be32-6d691814d0f3 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:39.127266 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059403d0-3cd2-4988-be32-6d691814d0f3 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] PATH_INFO: `/v3/projects/0e65c38e3ff842df99c336b404c2479a` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:39.128434 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059403d0-3cd2-4988-be32-6d691814d0f3 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] RBAC: Authorizing `identity:get_project(project_id=0e65c38e3ff842df99c336b404c2479a)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:39.130238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059403d0-3cd2-4988-be32-6d691814d0f3 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:39.133901 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4336/8699] 10.222.0.23 () {58 vars in 1443 bytes} [Sat Apr 30 22:00:39 2022] GET /identity/v3/projects/0e65c38e3ff842df99c336b404c2479a => generated 391 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 22:00:39.349734 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2587cd-bac5-4183-90b7-343bcb8d2c9d None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:39.351504 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7c2587cd-bac5-4183-90b7-343bcb8d2c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:00:39.408073 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2587cd-bac5-4183-90b7-343bcb8d2c9d None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:39.411491 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89df80-df39-4572-a35a-26ad9b67fe48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:39.412229 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89df80-df39-4572-a35a-26ad9b67fe48 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:39.416909 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89df80-df39-4572-a35a-26ad9b67fe48 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:39.416909 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89df80-df39-4572-a35a-26ad9b67fe48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:39.416909 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3a89df80-df39-4572-a35a-26ad9b67fe48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:00:39.426312 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a89df80-df39-4572-a35a-26ad9b67fe48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:39.427767 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a89df80-df39-4572-a35a-26ad9b67fe48 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:39.438021 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4364/8700] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:00:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:00:39.642322 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485818c-4e4f-4dae-9737-79ae082f3bdb None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:39.642613 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485818c-4e4f-4dae-9737-79ae082f3bdb None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:39.642893 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485818c-4e4f-4dae-9737-79ae082f3bdb None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:39.644258 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4337/8701] 10.222.0.23 () {54 vars in 912 bytes} [Sat Apr 30 22:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 22:00:39.648912 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89df80-df39-4572-a35a-26ad9b67fe48 service neutron] Authenticating service token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Apr 30 22:00:39.650400 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3a89df80-df39-4572-a35a-26ad9b67fe48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:00:39.668443 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89df80-df39-4572-a35a-26ad9b67fe48 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:39.677498 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89df80-df39-4572-a35a-26ad9b67fe48 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:39.682579 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696e9ab-9864-45a1-a9d8-ea69d728eac6 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686799762ca943a0bca4b4bb0ae53722', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e65c38e3ff842df99c336b404c2479a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:39.683421 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696e9ab-9864-45a1-a9d8-ea69d728eac6 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:39.683707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696e9ab-9864-45a1-a9d8-ea69d728eac6 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:39.683988 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696e9ab-9864-45a1-a9d8-ea69d728eac6 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] PATH_INFO: `/v3/projects/0e65c38e3ff842df99c336b404c2479a` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:39.685193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4696e9ab-9864-45a1-a9d8-ea69d728eac6 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] RBAC: Authorizing `identity:get_project(project_id=0e65c38e3ff842df99c336b404c2479a)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:39.687017 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4696e9ab-9864-45a1-a9d8-ea69d728eac6 tempest-ServersAdminNegativeTestJSON-621064565 tempest-ServersAdminNegativeTestJSON-621064565-project-admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:39.688680 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4365/8702] 10.222.0.23 () {58 vars in 1443 bytes} [Sat Apr 30 22:00:39 2022] GET /identity/v3/projects/0e65c38e3ff842df99c336b404c2479a => generated 391 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 22:00:43.848957 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485818c-4e4f-4dae-9737-79ae082f3bdb None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:43.911902 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485818c-4e4f-4dae-9737-79ae082f3bdb None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:43.917189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c26754-ce93-437b-a7cb-3d83f9a89eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:43.918077 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c26754-ce93-437b-a7cb-3d83f9a89eb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:43.918365 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c26754-ce93-437b-a7cb-3d83f9a89eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:43.918642 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c26754-ce93-437b-a7cb-3d83f9a89eb3 admin admin] PATH_INFO: `/v3/users/f1c0ee25ae4a4265b191f1291e8997f9` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:43.919817 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c26754-ce93-437b-a7cb-3d83f9a89eb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1c0ee25ae4a4265b191f1291e8997f9)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:43.921784 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c26754-ce93-437b-a7cb-3d83f9a89eb3 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:44.089414 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d7c26754-ce93-437b-a7cb-3d83f9a89eb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1c0ee25ae4a4265b191f1291e8997f9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:44.100815 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d7c26754-ce93-437b-a7cb-3d83f9a89eb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1c0ee25ae4a4265b191f1291e8997f9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:44.181410 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d7c26754-ce93-437b-a7cb-3d83f9a89eb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1c0ee25ae4a4265b191f1291e8997f9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:44.182184 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d7c26754-ce93-437b-a7cb-3d83f9a89eb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1c0ee25ae4a4265b191f1291e8997f9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:44.189822 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d7c26754-ce93-437b-a7cb-3d83f9a89eb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1c0ee25ae4a4265b191f1291e8997f9'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:44.195797 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4338/8703] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 22:00:43 2022] DELETE /identity/v3/users/f1c0ee25ae4a4265b191f1291e8997f9 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:00:44.200529 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca33e1-1373-44b9-91af-40bd2a187240 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:44.201019 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca33e1-1373-44b9-91af-40bd2a187240 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:44.201120 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca33e1-1373-44b9-91af-40bd2a187240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:44.219284 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-cbca33e1-1373-44b9-91af-40bd2a187240 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:00:44.220569 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-cbca33e1-1373-44b9-91af-40bd2a187240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:00:44.277975 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4366/8704] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:00:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 22:00:44.287293 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8dbbbc-3a08-4323-aa5e-9176ae4e6c7e None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:44.287623 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8dbbbc-3a08-4323-aa5e-9176ae4e6c7e None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:44.287908 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8dbbbc-3a08-4323-aa5e-9176ae4e6c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:44.306553 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-7a8dbbbc-3a08-4323-aa5e-9176ae4e6c7e None None] MFA Rules not processed for user `0b0cb145b72a492ebb8c0e9223be47a1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:00:44.307752 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7a8dbbbc-3a08-4323-aa5e-9176ae4e6c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:00:44.357910 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4339/8705] 10.222.0.23 () {58 vars in 1061 bytes} [Sat Apr 30 22:00:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:00:44.363884 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca33e1-1373-44b9-91af-40bd2a187240 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:44.373609 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca33e1-1373-44b9-91af-40bd2a187240 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:44.379387 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8195408-5957-4fe0-a32d-f54ef2e88354 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:44.379387 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8195408-5957-4fe0-a32d-f54ef2e88354 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:44.379387 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8195408-5957-4fe0-a32d-f54ef2e88354 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:44.379387 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8195408-5957-4fe0-a32d-f54ef2e88354 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:44.387269 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8195408-5957-4fe0-a32d-f54ef2e88354 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:44.388706 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8195408-5957-4fe0-a32d-f54ef2e88354 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:44.398315 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4367/8706] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:00:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:00:44.631854 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8dbbbc-3a08-4323-aa5e-9176ae4e6c7e None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:44.631854 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7a8dbbbc-3a08-4323-aa5e-9176ae4e6c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:00:44.651200 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8dbbbc-3a08-4323-aa5e-9176ae4e6c7e None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:44.656180 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daff536-45db-4103-9c20-b32ec53bbd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:44.657045 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daff536-45db-4103-9c20-b32ec53bbd65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:44.657330 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daff536-45db-4103-9c20-b32ec53bbd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:44.657606 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daff536-45db-4103-9c20-b32ec53bbd65 admin admin] PATH_INFO: `/v3/projects/2bae0a08aedf4727bc608812485cfd5e` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:44.658956 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daff536-45db-4103-9c20-b32ec53bbd65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bae0a08aedf4727bc608812485cfd5e)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:44.661134 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daff536-45db-4103-9c20-b32ec53bbd65 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:44.798132 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4daff536-45db-4103-9c20-b32ec53bbd65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bae0a08aedf4727bc608812485cfd5e', 'request_id': 'req-4daff536-45db-4103-9c20-b32ec53bbd65'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:44.803814 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4daff536-45db-4103-9c20-b32ec53bbd65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bae0a08aedf4727bc608812485cfd5e', 'request_id': 'req-4daff536-45db-4103-9c20-b32ec53bbd65'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:44.810399 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4daff536-45db-4103-9c20-b32ec53bbd65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bae0a08aedf4727bc608812485cfd5e', 'request_id': 'req-4daff536-45db-4103-9c20-b32ec53bbd65'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:44.878201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4daff536-45db-4103-9c20-b32ec53bbd65 admin admin] The token cache is being invalidate because project 2bae0a08aedf4727bc608812485cfd5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 22:00:44.878863 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4daff536-45db-4103-9c20-b32ec53bbd65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:44.879291 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-4daff536-45db-4103-9c20-b32ec53bbd65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:44.881301 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4340/8707] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 22:00:44 2022] DELETE /identity/v3/projects/2bae0a08aedf4727bc608812485cfd5e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:00:44.885743 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8195408-5957-4fe0-a32d-f54ef2e88354 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:44.895920 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8195408-5957-4fe0-a32d-f54ef2e88354 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:44.957632 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0091f7dc-0668-4da9-938b-52c22dd386fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:44.958707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091f7dc-0668-4da9-938b-52c22dd386fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:44.959003 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091f7dc-0668-4da9-938b-52c22dd386fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:44.959288 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091f7dc-0668-4da9-938b-52c22dd386fe admin admin] PATH_INFO: `/v3/users/686799762ca943a0bca4b4bb0ae53722` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:44.960526 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0091f7dc-0668-4da9-938b-52c22dd386fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=686799762ca943a0bca4b4bb0ae53722)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:44.962578 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0091f7dc-0668-4da9-938b-52c22dd386fe admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:45.190696 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0091f7dc-0668-4da9-938b-52c22dd386fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '686799762ca943a0bca4b4bb0ae53722'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:45.202462 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0091f7dc-0668-4da9-938b-52c22dd386fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '686799762ca943a0bca4b4bb0ae53722'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:45.281034 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0091f7dc-0668-4da9-938b-52c22dd386fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '686799762ca943a0bca4b4bb0ae53722'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:45.288324 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0091f7dc-0668-4da9-938b-52c22dd386fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '686799762ca943a0bca4b4bb0ae53722'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:45.288996 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-0091f7dc-0668-4da9-938b-52c22dd386fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '686799762ca943a0bca4b4bb0ae53722'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:45.296576 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4368/8708] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 22:00:44 2022] DELETE /identity/v3/users/686799762ca943a0bca4b4bb0ae53722 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:00:46.052073 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daff536-45db-4103-9c20-b32ec53bbd65 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:46.053594 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4daff536-45db-4103-9c20-b32ec53bbd65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:00:46.068049 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daff536-45db-4103-9c20-b32ec53bbd65 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:46.130787 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983fe379-986c-444a-aa58-8f34216662e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:46.131689 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fe379-986c-444a-aa58-8f34216662e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:46.131968 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fe379-986c-444a-aa58-8f34216662e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:46.132240 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fe379-986c-444a-aa58-8f34216662e8 admin admin] PATH_INFO: `/v3/projects/0e65c38e3ff842df99c336b404c2479a` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:46.133472 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983fe379-986c-444a-aa58-8f34216662e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e65c38e3ff842df99c336b404c2479a)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:46.135911 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983fe379-986c-444a-aa58-8f34216662e8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:46.230300 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-983fe379-986c-444a-aa58-8f34216662e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e65c38e3ff842df99c336b404c2479a', 'request_id': 'req-983fe379-986c-444a-aa58-8f34216662e8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:46.235630 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-983fe379-986c-444a-aa58-8f34216662e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e65c38e3ff842df99c336b404c2479a', 'request_id': 'req-983fe379-986c-444a-aa58-8f34216662e8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:46.241781 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-983fe379-986c-444a-aa58-8f34216662e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e65c38e3ff842df99c336b404c2479a', 'request_id': 'req-983fe379-986c-444a-aa58-8f34216662e8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:46.318180 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-983fe379-986c-444a-aa58-8f34216662e8 admin admin] The token cache is being invalidate because project 0e65c38e3ff842df99c336b404c2479a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 22:00:46.318478 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-983fe379-986c-444a-aa58-8f34216662e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:46.319100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-983fe379-986c-444a-aa58-8f34216662e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:00:46.320675 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4341/8709] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 22:00:46 2022] DELETE /identity/v3/projects/0e65c38e3ff842df99c336b404c2479a => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:00:46.327173 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac41aab-273b-4a90-831b-ba14b9804656 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:46.327643 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac41aab-273b-4a90-831b-ba14b9804656 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:46.327761 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac41aab-273b-4a90-831b-ba14b9804656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:46.345595 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-2ac41aab-273b-4a90-831b-ba14b9804656 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:00:46.346827 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2ac41aab-273b-4a90-831b-ba14b9804656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:00:46.404869 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4369/8710] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:00:46.415625 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24e4fa-8c20-45dc-a8ec-a4c4d39bbe0c None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:46.415918 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24e4fa-8c20-45dc-a8ec-a4c4d39bbe0c None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:46.416200 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24e4fa-8c20-45dc-a8ec-a4c4d39bbe0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:46.434682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-cc24e4fa-8c20-45dc-a8ec-a4c4d39bbe0c None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:00:46.436030 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-cc24e4fa-8c20-45dc-a8ec-a4c4d39bbe0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:00:46.447615 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4342/8711] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 22:00:46.451872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac41aab-273b-4a90-831b-ba14b9804656 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:46.461442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac41aab-273b-4a90-831b-ba14b9804656 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:46.466193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352997e9-ec49-4e4c-85d0-5720e55c35d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:46.466850 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352997e9-ec49-4e4c-85d0-5720e55c35d8 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:46.467134 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352997e9-ec49-4e4c-85d0-5720e55c35d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:46.467413 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352997e9-ec49-4e4c-85d0-5720e55c35d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:46.468135 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352997e9-ec49-4e4c-85d0-5720e55c35d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 22:00:46.468442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352997e9-ec49-4e4c-85d0-5720e55c35d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:46.470080 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352997e9-ec49-4e4c-85d0-5720e55c35d8 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:46.481478 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4370/8712] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 22:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 22:00:46.490658 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc24e4fa-8c20-45dc-a8ec-a4c4d39bbe0c None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:46.500471 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc24e4fa-8c20-45dc-a8ec-a4c4d39bbe0c None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:46.505143 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda99f3-3faf-4ce7-9a0b-09b2b511cb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:46.505910 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda99f3-3faf-4ce7-9a0b-09b2b511cb16 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:46.510930 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda99f3-3faf-4ce7-9a0b-09b2b511cb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:46.510930 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda99f3-3faf-4ce7-9a0b-09b2b511cb16 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:46.510930 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda99f3-3faf-4ce7-9a0b-09b2b511cb16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:46.510930 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda99f3-3faf-4ce7-9a0b-09b2b511cb16 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:46.615966 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4343/8713] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 22:00:46 2022] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 22:00:46.617042 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352997e9-ec49-4e4c-85d0-5720e55c35d8 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:46.629468 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352997e9-ec49-4e4c-85d0-5720e55c35d8 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:46.686826 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267fe7fa-f97b-471a-94ab-0bbd4c82cef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:46.687538 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fe7fa-f97b-471a-94ab-0bbd4c82cef2 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:46.687872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fe7fa-f97b-471a-94ab-0bbd4c82cef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:46.688084 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fe7fa-f97b-471a-94ab-0bbd4c82cef2 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:46.688774 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267fe7fa-f97b-471a-94ab-0bbd4c82cef2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:46.690858 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267fe7fa-f97b-471a-94ab-0bbd4c82cef2 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:46.804906 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4371/8714] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 22:00:46 2022] POST /identity/v3/users => generated 290 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 22:00:46.809637 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda99f3-3faf-4ce7-9a0b-09b2b511cb16 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:46.819952 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda99f3-3faf-4ce7-9a0b-09b2b511cb16 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:46.824621 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26972f84-e543-44b1-8334-331f9e9e8b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:46.825280 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26972f84-e543-44b1-8334-331f9e9e8b43 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:46.825566 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26972f84-e543-44b1-8334-331f9e9e8b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:46.825884 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26972f84-e543-44b1-8334-331f9e9e8b43 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:46.826599 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26972f84-e543-44b1-8334-331f9e9e8b43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:46.828219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26972f84-e543-44b1-8334-331f9e9e8b43 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:46.838868 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4344/8715] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 22:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 22:00:46.844189 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267fe7fa-f97b-471a-94ab-0bbd4c82cef2 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:46.854776 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267fe7fa-f97b-471a-94ab-0bbd4c82cef2 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:46.859326 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee09d6-cc4e-49a0-895b-e48d60f6daad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:46.859992 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee09d6-cc4e-49a0-895b-e48d60f6daad admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:46.860267 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee09d6-cc4e-49a0-895b-e48d60f6daad admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:46.860545 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee09d6-cc4e-49a0-895b-e48d60f6daad admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:46.861267 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee09d6-cc4e-49a0-895b-e48d60f6daad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:46.862912 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee09d6-cc4e-49a0-895b-e48d60f6daad admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:46.873400 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4372/8716] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 22:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 22:00:46.877818 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26972f84-e543-44b1-8334-331f9e9e8b43 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:46.887957 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26972f84-e543-44b1-8334-331f9e9e8b43 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:46.892867 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a8382-b301-49c4-971d-7345f9afb019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:46.893745 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a8382-b301-49c4-971d-7345f9afb019 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:46.894060 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a8382-b301-49c4-971d-7345f9afb019 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:46.894339 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a8382-b301-49c4-971d-7345f9afb019 admin admin] PATH_INFO: `/v3/projects/b34dde3a4dd64ad1ab4c082b5d7ba735/users/5b6f19685e3f4fe79b47dffd24a4c765/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:46.908418 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a8382-b301-49c4-971d-7345f9afb019 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b34dde3a4dd64ad1ab4c082b5d7ba735, user_id=5b6f19685e3f4fe79b47dffd24a4c765, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:46.911143 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a8382-b301-49c4-971d-7345f9afb019 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:46.983010 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4345/8717] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 22:00:46 2022] PUT /identity/v3/projects/b34dde3a4dd64ad1ab4c082b5d7ba735/users/5b6f19685e3f4fe79b47dffd24a4c765/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:00:46.988213 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97433533-638c-44b0-9fc6-1811b97bfb9d None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:46.988513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97433533-638c-44b0-9fc6-1811b97bfb9d None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:46.988793 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97433533-638c-44b0-9fc6-1811b97bfb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:47.007487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-97433533-638c-44b0-9fc6-1811b97bfb9d None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:00:47.008703 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-97433533-638c-44b0-9fc6-1811b97bfb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:00:47.069097 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4373/8718] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:00:47.079381 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a8382-b301-49c4-971d-7345f9afb019 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:47.081277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-234a8382-b301-49c4-971d-7345f9afb019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:00:47.144435 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a8382-b301-49c4-971d-7345f9afb019 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:47.147984 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd25aa4-2959-44e2-bb7f-dd2d087f0b92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:47.148651 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd25aa4-2959-44e2-bb7f-dd2d087f0b92 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:47.148939 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd25aa4-2959-44e2-bb7f-dd2d087f0b92 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:47.149214 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd25aa4-2959-44e2-bb7f-dd2d087f0b92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:47.159656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd25aa4-2959-44e2-bb7f-dd2d087f0b92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:47.161114 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd25aa4-2959-44e2-bb7f-dd2d087f0b92 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:47.171283 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4346/8719] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:00:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:00:48.334517 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547a249-61f3-480a-9ada-02460622caa9 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:48.335090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547a249-61f3-480a-9ada-02460622caa9 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:48.335090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547a249-61f3-480a-9ada-02460622caa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:48.366458 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-a547a249-61f3-480a-9ada-02460622caa9 None None] MFA Rules not processed for user `5b6f19685e3f4fe79b47dffd24a4c765`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:00:48.367700 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a547a249-61f3-480a-9ada-02460622caa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:00:48.433723 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4374/8720] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:00:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:00:48.444894 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b073d64-308b-49d0-aae3-946c111f5922 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:48.445454 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b073d64-308b-49d0-aae3-946c111f5922 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:48.445454 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b073d64-308b-49d0-aae3-946c111f5922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:48.462299 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-3b073d64-308b-49d0-aae3-946c111f5922 None None] MFA Rules not processed for user `5b6f19685e3f4fe79b47dffd24a4c765`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:00:48.463497 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3b073d64-308b-49d0-aae3-946c111f5922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:00:48.470600 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4347/8721] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:00:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:00:48.482729 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547a249-61f3-480a-9ada-02460622caa9 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:00:48.484108 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a547a249-61f3-480a-9ada-02460622caa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:00:48.564525 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547a249-61f3-480a-9ada-02460622caa9 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:00:48.570054 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c2e6f-6e1a-4d04-be46-ab84daf0ff3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:00:48.570701 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c2e6f-6e1a-4d04-be46-ab84daf0ff3b service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:00:48.570986 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c2e6f-6e1a-4d04-be46-ab84daf0ff3b service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:00:48.571265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c2e6f-6e1a-4d04-be46-ab84daf0ff3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:00:48.579322 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66c2e6f-6e1a-4d04-be46-ab84daf0ff3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:00:48.580864 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66c2e6f-6e1a-4d04-be46-ab84daf0ff3b service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:00:48.590399 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4375/8722] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:00:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:01:01.390186 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b073d64-308b-49d0-aae3-946c111f5922 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:01:01.392614 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3b073d64-308b-49d0-aae3-946c111f5922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:01:01.451862 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b073d64-308b-49d0-aae3-946c111f5922 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:01:01.455922 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0624c455-3518-4328-914d-2c40e6dffec0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:01:01.456590 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0624c455-3518-4328-914d-2c40e6dffec0 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:01:01.456877 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0624c455-3518-4328-914d-2c40e6dffec0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:01:01.457158 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0624c455-3518-4328-914d-2c40e6dffec0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:01:01.459043 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0624c455-3518-4328-914d-2c40e6dffec0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:01:01.472034 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0624c455-3518-4328-914d-2c40e6dffec0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:01:01.473551 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0624c455-3518-4328-914d-2c40e6dffec0 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:01:01.485290 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4348/8723] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:01:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:01:01.641379 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e0669-6d29-4e88-a8c3-a600d6cf7baf None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:01:01.641996 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e0669-6d29-4e88-a8c3-a600d6cf7baf None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:01:01.641996 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e0669-6d29-4e88-a8c3-a600d6cf7baf None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:01:01.643347 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4376/8724] 10.222.0.23 () {54 vars in 921 bytes} [Sat Apr 30 22:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 22:01:01.648910 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375a63c-975c-45d6-a0cc-b2f0f738cc59 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:01:01.649288 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375a63c-975c-45d6-a0cc-b2f0f738cc59 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:01:01.649578 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375a63c-975c-45d6-a0cc-b2f0f738cc59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:01:01.669012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-e375a63c-975c-45d6-a0cc-b2f0f738cc59 None None] MFA Rules not processed for user `4ad3f89b7037413a83c7905cef263b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:01:01.670267 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e375a63c-975c-45d6-a0cc-b2f0f738cc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:01:01.752288 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4349/8725] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Apr 30 22:01:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:01:01.772812 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e0669-6d29-4e88-a8c3-a600d6cf7baf None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:01:01.774501 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-259e0669-6d29-4e88-a8c3-a600d6cf7baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:01:01.793245 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e0669-6d29-4e88-a8c3-a600d6cf7baf None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:01:01.798229 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c981861-ce91-4474-a4fe-3a7e9e25d8e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:01:01.798858 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c981861-ce91-4474-a4fe-3a7e9e25d8e8 service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:01:01.799412 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c981861-ce91-4474-a4fe-3a7e9e25d8e8 service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:01:01.799690 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c981861-ce91-4474-a4fe-3a7e9e25d8e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:01:01.808598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c981861-ce91-4474-a4fe-3a7e9e25d8e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:01:01.810229 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c981861-ce91-4474-a4fe-3a7e9e25d8e8 service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:01:01.819573 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4377/8726] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:01:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:01:02.179592 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375a63c-975c-45d6-a0cc-b2f0f738cc59 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:01:02.189352 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375a63c-975c-45d6-a0cc-b2f0f738cc59 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:01:02.193274 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb51673-9bb4-4fab-8737-500f892f1def service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:01:02.193944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb51673-9bb4-4fab-8737-500f892f1def service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:01:02.194229 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb51673-9bb4-4fab-8737-500f892f1def service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:01:02.194502 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb51673-9bb4-4fab-8737-500f892f1def service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:01:02.196230 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2eb51673-9bb4-4fab-8737-500f892f1def service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:01:02.233116 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb51673-9bb4-4fab-8737-500f892f1def service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:01:02.234632 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb51673-9bb4-4fab-8737-500f892f1def service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:01:02.248582 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4350/8727] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:01:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:01:42.547101 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c981861-ce91-4474-a4fe-3a7e9e25d8e8 service placement] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:01:42.558133 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c981861-ce91-4474-a4fe-3a7e9e25d8e8 service placement] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:01:42.563457 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0f654-6a08-40b1-b685-8d8f906a9870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:01:42.568368 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0f654-6a08-40b1-b685-8d8f906a9870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:01:42.568368 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0f654-6a08-40b1-b685-8d8f906a9870 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:01:42.568368 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0f654-6a08-40b1-b685-8d8f906a9870 admin admin] PATH_INFO: `/v3/users/5b6f19685e3f4fe79b47dffd24a4c765` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:01:42.568368 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0f654-6a08-40b1-b685-8d8f906a9870 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b6f19685e3f4fe79b47dffd24a4c765)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:01:42.568368 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0f654-6a08-40b1-b685-8d8f906a9870 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:01:42.773500 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f1a0f654-6a08-40b1-b685-8d8f906a9870 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b6f19685e3f4fe79b47dffd24a4c765'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:01:42.785123 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f1a0f654-6a08-40b1-b685-8d8f906a9870 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b6f19685e3f4fe79b47dffd24a4c765'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:01:42.855425 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f1a0f654-6a08-40b1-b685-8d8f906a9870 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b6f19685e3f4fe79b47dffd24a4c765'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:01:42.863366 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f1a0f654-6a08-40b1-b685-8d8f906a9870 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b6f19685e3f4fe79b47dffd24a4c765'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:01:42.864138 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-f1a0f654-6a08-40b1-b685-8d8f906a9870 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b6f19685e3f4fe79b47dffd24a4c765'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:01:42.870179 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4378/8728] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 22:01:42 2022] DELETE /identity/v3/users/5b6f19685e3f4fe79b47dffd24a4c765 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:01:43.081897 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb51673-9bb4-4fab-8737-500f892f1def service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:01:43.092499 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb51673-9bb4-4fab-8737-500f892f1def service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:01:43.159630 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea69a81d-d5cd-4dfb-8043-110f04d444fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:01:43.160493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69a81d-d5cd-4dfb-8043-110f04d444fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:01:43.160776 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69a81d-d5cd-4dfb-8043-110f04d444fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:01:43.161053 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69a81d-d5cd-4dfb-8043-110f04d444fa admin admin] PATH_INFO: `/v3/projects/b34dde3a4dd64ad1ab4c082b5d7ba735` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:01:43.162272 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea69a81d-d5cd-4dfb-8043-110f04d444fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b34dde3a4dd64ad1ab4c082b5d7ba735)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:01:43.164215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea69a81d-d5cd-4dfb-8043-110f04d444fa admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:01:43.256503 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ea69a81d-d5cd-4dfb-8043-110f04d444fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'request_id': 'req-ea69a81d-d5cd-4dfb-8043-110f04d444fa'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:01:43.261825 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ea69a81d-d5cd-4dfb-8043-110f04d444fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'request_id': 'req-ea69a81d-d5cd-4dfb-8043-110f04d444fa'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:01:43.268879 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ea69a81d-d5cd-4dfb-8043-110f04d444fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b34dde3a4dd64ad1ab4c082b5d7ba735', 'request_id': 'req-ea69a81d-d5cd-4dfb-8043-110f04d444fa'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:01:43.353751 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ea69a81d-d5cd-4dfb-8043-110f04d444fa admin admin] The token cache is being invalidate because project b34dde3a4dd64ad1ab4c082b5d7ba735 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 22:01:43.354018 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ea69a81d-d5cd-4dfb-8043-110f04d444fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:01:43.354686 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ea69a81d-d5cd-4dfb-8043-110f04d444fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:01:43.356224 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4351/8729] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 22:01:43 2022] DELETE /identity/v3/projects/b34dde3a4dd64ad1ab4c082b5d7ba735 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:01:43.361467 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7545db-1f89-438f-88c4-b44a66ce7fc1 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:01:43.361772 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7545db-1f89-438f-88c4-b44a66ce7fc1 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:01:43.362087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7545db-1f89-438f-88c4-b44a66ce7fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:01:43.416757 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-fa7545db-1f89-438f-88c4-b44a66ce7fc1 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:01:43.418006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-fa7545db-1f89-438f-88c4-b44a66ce7fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:01:43.475847 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4379/8730] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:01:43.484234 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6eea1-e88c-4948-8bc6-2c8612cb303a None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:01:43.484522 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6eea1-e88c-4948-8bc6-2c8612cb303a None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:01:43.484801 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6eea1-e88c-4948-8bc6-2c8612cb303a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:01:43.502851 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-9ad6eea1-e88c-4948-8bc6-2c8612cb303a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:01:43.504042 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-9ad6eea1-e88c-4948-8bc6-2c8612cb303a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:01:43.511885 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4352/8731] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:01:43.520417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7545db-1f89-438f-88c4-b44a66ce7fc1 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:01:43.530190 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7545db-1f89-438f-88c4-b44a66ce7fc1 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:01:43.535006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb8d30-3eea-4f5b-9183-56f159689e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:01:43.535666 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb8d30-3eea-4f5b-9183-56f159689e26 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:01:43.535948 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb8d30-3eea-4f5b-9183-56f159689e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:01:43.536226 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb8d30-3eea-4f5b-9183-56f159689e26 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:01:43.536939 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb8d30-3eea-4f5b-9183-56f159689e26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 22:01:43.537245 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb8d30-3eea-4f5b-9183-56f159689e26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:01:43.538881 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb8d30-3eea-4f5b-9183-56f159689e26 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:01:43.550704 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4380/8732] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 22:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 22:01:43.555091 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6eea1-e88c-4948-8bc6-2c8612cb303a None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:01:43.564928 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6eea1-e88c-4948-8bc6-2c8612cb303a None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:01:43.569590 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff3b5f-4aea-410c-8c77-0d0240f44bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:01:43.570277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff3b5f-4aea-410c-8c77-0d0240f44bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:01:43.570571 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff3b5f-4aea-410c-8c77-0d0240f44bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:01:43.570853 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff3b5f-4aea-410c-8c77-0d0240f44bc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:01:43.571556 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff3b5f-4aea-410c-8c77-0d0240f44bc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:01:43.573484 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff3b5f-4aea-410c-8c77-0d0240f44bc1 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:01:43.665397 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4353/8733] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 22:01:43 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 22:01:43.670085 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb8d30-3eea-4f5b-9183-56f159689e26 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:01:43.680422 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb8d30-3eea-4f5b-9183-56f159689e26 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:01:43.733933 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b27f56-5aa3-4170-982a-8aec76b1b04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:01:43.734593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b27f56-5aa3-4170-982a-8aec76b1b04d admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:01:43.734873 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b27f56-5aa3-4170-982a-8aec76b1b04d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:01:43.735146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b27f56-5aa3-4170-982a-8aec76b1b04d admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:01:43.735828 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b27f56-5aa3-4170-982a-8aec76b1b04d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:01:43.737788 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b27f56-5aa3-4170-982a-8aec76b1b04d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:01:43.827938 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4381/8734] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 22:01:43 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 22:01:43.831928 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff3b5f-4aea-410c-8c77-0d0240f44bc1 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:01:43.842218 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff3b5f-4aea-410c-8c77-0d0240f44bc1 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:01:43.846817 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b849a-5a05-4f77-8394-8f3fb68676e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:01:43.847473 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b849a-5a05-4f77-8394-8f3fb68676e2 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:01:43.847757 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b849a-5a05-4f77-8394-8f3fb68676e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:01:43.848036 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b849a-5a05-4f77-8394-8f3fb68676e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:01:43.848750 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b849a-5a05-4f77-8394-8f3fb68676e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:01:43.850404 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b849a-5a05-4f77-8394-8f3fb68676e2 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:01:43.860934 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4354/8735] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 22:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 22:01:43.864933 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b27f56-5aa3-4170-982a-8aec76b1b04d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:01:43.875874 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b27f56-5aa3-4170-982a-8aec76b1b04d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:01:43.880771 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ef129-c416-4d90-8248-4057790d4584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:01:43.881437 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ef129-c416-4d90-8248-4057790d4584 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:01:43.881722 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ef129-c416-4d90-8248-4057790d4584 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:01:43.882112 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ef129-c416-4d90-8248-4057790d4584 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:01:43.882836 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ef129-c416-4d90-8248-4057790d4584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:01:43.884440 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ef129-c416-4d90-8248-4057790d4584 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:01:43.895229 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4382/8736] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 22:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 22:01:43.899223 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b849a-5a05-4f77-8394-8f3fb68676e2 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:01:43.909597 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b849a-5a05-4f77-8394-8f3fb68676e2 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:01:43.914334 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921aff04-51d5-4097-bdf7-b783e5458539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:01:43.915204 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921aff04-51d5-4097-bdf7-b783e5458539 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:01:43.915546 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921aff04-51d5-4097-bdf7-b783e5458539 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:01:43.915774 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921aff04-51d5-4097-bdf7-b783e5458539 admin admin] PATH_INFO: `/v3/projects/65065d04e6dc45cb9798be1c9703ad2f/users/0de908a2758a4489b9a3ef80078f2b1b/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:01:43.930717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921aff04-51d5-4097-bdf7-b783e5458539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65065d04e6dc45cb9798be1c9703ad2f, user_id=0de908a2758a4489b9a3ef80078f2b1b, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:01:43.933384 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921aff04-51d5-4097-bdf7-b783e5458539 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:01:44.011969 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4355/8737] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 22:01:43 2022] PUT /identity/v3/projects/65065d04e6dc45cb9798be1c9703ad2f/users/0de908a2758a4489b9a3ef80078f2b1b/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 22:01:44.017569 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e8f50-c579-4e0a-af7a-72878da8352c None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:01:44.017883 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e8f50-c579-4e0a-af7a-72878da8352c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:01:44.018167 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e8f50-c579-4e0a-af7a-72878da8352c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:01:44.036182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-1b3e8f50-c579-4e0a-af7a-72878da8352c None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:01:44.037395 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1b3e8f50-c579-4e0a-af7a-72878da8352c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:01:44.094853 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4383/8738] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:01:44.104637 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921aff04-51d5-4097-bdf7-b783e5458539 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:01:44.107071 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-921aff04-51d5-4097-bdf7-b783e5458539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:01:44.162314 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921aff04-51d5-4097-bdf7-b783e5458539 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:01:44.166042 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e5d13-a100-42d6-a8ca-7b28d911e319 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:01:44.166638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e5d13-a100-42d6-a8ca-7b28d911e319 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:01:44.166928 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e5d13-a100-42d6-a8ca-7b28d911e319 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:01:44.167208 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e5d13-a100-42d6-a8ca-7b28d911e319 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:01:44.176724 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4e5d13-a100-42d6-a8ca-7b28d911e319 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:01:44.178220 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4e5d13-a100-42d6-a8ca-7b28d911e319 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:01:44.187568 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4356/8739] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:01:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:01:45.429579 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f74cd-6f9d-4972-a9f8-47bc6db2d9dc None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:01:45.430189 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f74cd-6f9d-4972-a9f8-47bc6db2d9dc None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:01:45.430189 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f74cd-6f9d-4972-a9f8-47bc6db2d9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:01:45.463266 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-e82f74cd-6f9d-4972-a9f8-47bc6db2d9dc None None] MFA Rules not processed for user `0de908a2758a4489b9a3ef80078f2b1b`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:01:45.464498 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e82f74cd-6f9d-4972-a9f8-47bc6db2d9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:01:45.531550 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4384/8740] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:01:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 22:01:45.541944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7638e4-c284-48fb-b013-bc3125558007 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:01:45.542498 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7638e4-c284-48fb-b013-bc3125558007 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:01:45.542498 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7638e4-c284-48fb-b013-bc3125558007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:01:45.559986 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-6f7638e4-c284-48fb-b013-bc3125558007 None None] MFA Rules not processed for user `0de908a2758a4489b9a3ef80078f2b1b`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:01:45.561215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6f7638e4-c284-48fb-b013-bc3125558007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:01:45.568222 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4357/8741] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:01:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:01:45.580621 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f74cd-6f9d-4972-a9f8-47bc6db2d9dc None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:01:45.582056 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e82f74cd-6f9d-4972-a9f8-47bc6db2d9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:01:45.657521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f74cd-6f9d-4972-a9f8-47bc6db2d9dc None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:01:45.663099 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ed737-e1da-46c3-ab46-168093fe4aea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:01:45.663756 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ed737-e1da-46c3-ab46-168093fe4aea service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:01:45.664041 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ed737-e1da-46c3-ab46-168093fe4aea service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:01:45.664321 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ed737-e1da-46c3-ab46-168093fe4aea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:01:45.673065 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ed737-e1da-46c3-ab46-168093fe4aea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:01:45.674638 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ed737-e1da-46c3-ab46-168093fe4aea service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:01:45.683879 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4385/8742] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:01:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:01:52.062276 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7638e4-c284-48fb-b013-bc3125558007 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:01:52.063660 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6f7638e4-c284-48fb-b013-bc3125558007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:01:52.075314 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7638e4-c284-48fb-b013-bc3125558007 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:01:52.078822 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082aa469-cfba-4702-a888-f26f712fd339 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:01:52.079455 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082aa469-cfba-4702-a888-f26f712fd339 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:01:52.079734 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082aa469-cfba-4702-a888-f26f712fd339 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:01:52.080009 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082aa469-cfba-4702-a888-f26f712fd339 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:01:52.081681 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-082aa469-cfba-4702-a888-f26f712fd339 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:01:52.097543 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082aa469-cfba-4702-a888-f26f712fd339 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:01:52.099000 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082aa469-cfba-4702-a888-f26f712fd339 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:01:52.112701 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4358/8743] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:01:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:01:53.293669 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ed737-e1da-46c3-ab46-168093fe4aea service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:01:53.304617 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ed737-e1da-46c3-ab46-168093fe4aea service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:01:53.308225 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06347d40-6887-4944-9487-cdb7714150a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:01:53.309487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06347d40-6887-4944-9487-cdb7714150a2 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:01:53.309776 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06347d40-6887-4944-9487-cdb7714150a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:01:53.310065 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06347d40-6887-4944-9487-cdb7714150a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:01:53.311865 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-06347d40-6887-4944-9487-cdb7714150a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:01:53.328385 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06347d40-6887-4944-9487-cdb7714150a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:01:53.329871 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06347d40-6887-4944-9487-cdb7714150a2 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:01:53.344687 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4386/8744] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:01:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:01:58.158231 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63337733-4370-41bd-b88d-1c388d8e9d2f None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:01:58.158786 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63337733-4370-41bd-b88d-1c388d8e9d2f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:01:58.158786 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63337733-4370-41bd-b88d-1c388d8e9d2f None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:01:58.160070 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4359/8745] 10.222.0.23 () {54 vars in 921 bytes} [Sat Apr 30 22:01:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 22:01:58.164838 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0de68b-7cda-4215-843f-b1a2ef027905 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:01:58.165292 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0de68b-7cda-4215-843f-b1a2ef027905 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:01:58.165412 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0de68b-7cda-4215-843f-b1a2ef027905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:01:58.183854 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-ae0de68b-7cda-4215-843f-b1a2ef027905 None None] MFA Rules not processed for user `4ad3f89b7037413a83c7905cef263b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:01:58.185052 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ae0de68b-7cda-4215-843f-b1a2ef027905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:01:58.245557 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4387/8746] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Apr 30 22:01:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:01:58.266644 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63337733-4370-41bd-b88d-1c388d8e9d2f None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:01:58.268349 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-63337733-4370-41bd-b88d-1c388d8e9d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:01:58.288082 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63337733-4370-41bd-b88d-1c388d8e9d2f None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:01:58.293095 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e431e1-c33f-49ee-ac37-5fba29faf77a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:01:58.293737 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e431e1-c33f-49ee-ac37-5fba29faf77a service placement] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:01:58.294050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e431e1-c33f-49ee-ac37-5fba29faf77a service placement] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:01:58.294332 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e431e1-c33f-49ee-ac37-5fba29faf77a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:01:58.302620 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e431e1-c33f-49ee-ac37-5fba29faf77a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:01:58.304213 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e431e1-c33f-49ee-ac37-5fba29faf77a service placement] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:01:58.313925 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4360/8747] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:01:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:02:31.030272 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0de68b-7cda-4215-843f-b1a2ef027905 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:02:31.039679 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0de68b-7cda-4215-843f-b1a2ef027905 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:02:31.044222 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61d336-d761-47de-b2b4-42e31e9192f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:02:31.044860 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61d336-d761-47de-b2b4-42e31e9192f2 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:02:31.045140 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61d336-d761-47de-b2b4-42e31e9192f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:02:31.045418 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61d336-d761-47de-b2b4-42e31e9192f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:02:31.047269 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7e61d336-d761-47de-b2b4-42e31e9192f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:02:31.060182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61d336-d761-47de-b2b4-42e31e9192f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:02:31.061716 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61d336-d761-47de-b2b4-42e31e9192f2 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:02:31.073727 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4388/8748] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:02:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:02:35.409939 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e431e1-c33f-49ee-ac37-5fba29faf77a service placement] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:02:35.425536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e431e1-c33f-49ee-ac37-5fba29faf77a service placement] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:02:35.431038 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b1429-c08e-4b94-bea2-e3a49d3fb2e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:02:35.432382 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b1429-c08e-4b94-bea2-e3a49d3fb2e6 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:02:35.432382 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b1429-c08e-4b94-bea2-e3a49d3fb2e6 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:02:35.432382 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b1429-c08e-4b94-bea2-e3a49d3fb2e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:02:35.434099 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5a7b1429-c08e-4b94-bea2-e3a49d3fb2e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:02:35.448827 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b1429-c08e-4b94-bea2-e3a49d3fb2e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:02:35.450436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b1429-c08e-4b94-bea2-e3a49d3fb2e6 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:02:35.464418 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4361/8749] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:02:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:02:36.134063 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea22eb-71e8-409a-b5bb-a37dd56e26fd None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:02:36.134611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea22eb-71e8-409a-b5bb-a37dd56e26fd None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:02:36.134611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea22eb-71e8-409a-b5bb-a37dd56e26fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:02:36.154182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-54ea22eb-71e8-409a-b5bb-a37dd56e26fd None None] MFA Rules not processed for user `0de908a2758a4489b9a3ef80078f2b1b`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:02:36.155391 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-54ea22eb-71e8-409a-b5bb-a37dd56e26fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:02:36.162334 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4389/8750] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:02:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:02:48.022800 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef08e6-0fdb-4cd0-82bb-2cbc6df8bc90 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:02:48.023353 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef08e6-0fdb-4cd0-82bb-2cbc6df8bc90 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:02:48.023353 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef08e6-0fdb-4cd0-82bb-2cbc6df8bc90 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:02:48.024637 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4362/8751] 10.222.0.23 () {54 vars in 921 bytes} [Sat Apr 30 22:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 22:02:48.029570 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7ebc4-5800-4416-92c4-e0a278dd6dcc None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:02:48.030031 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7ebc4-5800-4416-92c4-e0a278dd6dcc None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:02:48.033080 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd7ebc4-5800-4416-92c4-e0a278dd6dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:02:48.048290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-dbd7ebc4-5800-4416-92c4-e0a278dd6dcc None None] MFA Rules not processed for user `4ad3f89b7037413a83c7905cef263b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:02:48.049496 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-dbd7ebc4-5800-4416-92c4-e0a278dd6dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:02:48.066964 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4390/8752] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Apr 30 22:02:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:02:48.087329 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef08e6-0fdb-4cd0-82bb-2cbc6df8bc90 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:02:48.103211 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef08e6-0fdb-4cd0-82bb-2cbc6df8bc90 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:02:48.108088 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7932a6-7dcf-4ad4-9bb6-40d39722ace0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:02:48.108717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7932a6-7dcf-4ad4-9bb6-40d39722ace0 service placement] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:02:48.108998 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7932a6-7dcf-4ad4-9bb6-40d39722ace0 service placement] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:02:48.109274 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7932a6-7dcf-4ad4-9bb6-40d39722ace0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:02:48.117399 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7932a6-7dcf-4ad4-9bb6-40d39722ace0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:02:48.119011 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7932a6-7dcf-4ad4-9bb6-40d39722ace0 service placement] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:02:48.129022 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4363/8753] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:02:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:03:27.505027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7ebc4-5800-4416-92c4-e0a278dd6dcc None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:03:27.520113 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd7ebc4-5800-4416-92c4-e0a278dd6dcc None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:03:27.525475 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38e90a-a1ff-485c-87bc-27ffc45e1904 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:03:27.526133 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38e90a-a1ff-485c-87bc-27ffc45e1904 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:03:27.526417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38e90a-a1ff-485c-87bc-27ffc45e1904 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:03:27.526694 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38e90a-a1ff-485c-87bc-27ffc45e1904 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:03:27.529099 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ce38e90a-a1ff-485c-87bc-27ffc45e1904 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:03:27.543889 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce38e90a-a1ff-485c-87bc-27ffc45e1904 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:03:27.546336 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce38e90a-a1ff-485c-87bc-27ffc45e1904 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:03:27.559339 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4391/8754] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:03:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:03:29.787156 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7932a6-7dcf-4ad4-9bb6-40d39722ace0 service placement] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:03:29.798638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7932a6-7dcf-4ad4-9bb6-40d39722ace0 service placement] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:03:29.803267 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a60aa6-b668-4f23-9b5a-0c4faefb6a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:03:29.804133 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a60aa6-b668-4f23-9b5a-0c4faefb6a19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:03:29.804416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a60aa6-b668-4f23-9b5a-0c4faefb6a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:03:29.804697 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a60aa6-b668-4f23-9b5a-0c4faefb6a19 admin admin] PATH_INFO: `/v3/users/0de908a2758a4489b9a3ef80078f2b1b` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:03:29.806033 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a60aa6-b668-4f23-9b5a-0c4faefb6a19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0de908a2758a4489b9a3ef80078f2b1b)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:03:29.808008 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a60aa6-b668-4f23-9b5a-0c4faefb6a19 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:03:30.003900 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-65a60aa6-b668-4f23-9b5a-0c4faefb6a19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0de908a2758a4489b9a3ef80078f2b1b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:03:30.015538 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-65a60aa6-b668-4f23-9b5a-0c4faefb6a19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0de908a2758a4489b9a3ef80078f2b1b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:03:30.077201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-65a60aa6-b668-4f23-9b5a-0c4faefb6a19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0de908a2758a4489b9a3ef80078f2b1b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:03:30.077792 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-65a60aa6-b668-4f23-9b5a-0c4faefb6a19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0de908a2758a4489b9a3ef80078f2b1b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:03:30.084858 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-65a60aa6-b668-4f23-9b5a-0c4faefb6a19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0de908a2758a4489b9a3ef80078f2b1b'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:03:30.090914 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4364/8755] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 22:03:29 2022] DELETE /identity/v3/users/0de908a2758a4489b9a3ef80078f2b1b => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:03:30.319854 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38e90a-a1ff-485c-87bc-27ffc45e1904 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:03:30.332685 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38e90a-a1ff-485c-87bc-27ffc45e1904 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:03:30.390743 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198117e0-b12c-4947-afb6-2bb787323d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:03:30.391717 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198117e0-b12c-4947-afb6-2bb787323d25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:03:30.392001 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198117e0-b12c-4947-afb6-2bb787323d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:03:30.392303 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198117e0-b12c-4947-afb6-2bb787323d25 admin admin] PATH_INFO: `/v3/projects/65065d04e6dc45cb9798be1c9703ad2f` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:03:30.393473 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198117e0-b12c-4947-afb6-2bb787323d25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65065d04e6dc45cb9798be1c9703ad2f)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:03:30.395446 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198117e0-b12c-4947-afb6-2bb787323d25 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:03:30.524552 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-198117e0-b12c-4947-afb6-2bb787323d25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65065d04e6dc45cb9798be1c9703ad2f', 'request_id': 'req-198117e0-b12c-4947-afb6-2bb787323d25'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:03:30.530580 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-198117e0-b12c-4947-afb6-2bb787323d25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65065d04e6dc45cb9798be1c9703ad2f', 'request_id': 'req-198117e0-b12c-4947-afb6-2bb787323d25'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:03:30.536698 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-198117e0-b12c-4947-afb6-2bb787323d25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65065d04e6dc45cb9798be1c9703ad2f', 'request_id': 'req-198117e0-b12c-4947-afb6-2bb787323d25'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:03:30.659875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-198117e0-b12c-4947-afb6-2bb787323d25 admin admin] The token cache is being invalidate because project 65065d04e6dc45cb9798be1c9703ad2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 22:03:30.660109 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-198117e0-b12c-4947-afb6-2bb787323d25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:03:30.660691 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-198117e0-b12c-4947-afb6-2bb787323d25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:03:30.662283 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4392/8756] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 22:03:30 2022] DELETE /identity/v3/projects/65065d04e6dc45cb9798be1c9703ad2f => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:03:30.667515 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7cf66-cedb-49ef-9f3a-37d9a339618c None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:03:30.667805 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7cf66-cedb-49ef-9f3a-37d9a339618c None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:03:30.668082 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7cf66-cedb-49ef-9f3a-37d9a339618c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:03:30.687627 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-95d7cf66-cedb-49ef-9f3a-37d9a339618c None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:03:30.688800 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-95d7cf66-cedb-49ef-9f3a-37d9a339618c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:03:30.746772 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4365/8757] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:03:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:03:30.754366 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925ec27-967b-4fbe-ac71-6394cb2f1756 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:03:30.754656 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925ec27-967b-4fbe-ac71-6394cb2f1756 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:03:30.754935 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925ec27-967b-4fbe-ac71-6394cb2f1756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:03:30.773648 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-3925ec27-967b-4fbe-ac71-6394cb2f1756 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:03:30.774868 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3925ec27-967b-4fbe-ac71-6394cb2f1756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:03:30.783283 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4393/8758] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:03:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 22:03:30.787272 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d7cf66-cedb-49ef-9f3a-37d9a339618c None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:03:30.797390 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d7cf66-cedb-49ef-9f3a-37d9a339618c None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:03:30.802356 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f2513-7ef4-4739-a79b-9167647e145b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:03:30.806034 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f2513-7ef4-4739-a79b-9167647e145b admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:03:30.806034 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f2513-7ef4-4739-a79b-9167647e145b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:03:30.806034 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f2513-7ef4-4739-a79b-9167647e145b admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:03:30.806034 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f2513-7ef4-4739-a79b-9167647e145b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 22:03:30.806034 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f2513-7ef4-4739-a79b-9167647e145b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:03:30.806656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f2513-7ef4-4739-a79b-9167647e145b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:03:30.817973 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4366/8759] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 22:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 22:03:30.822453 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925ec27-967b-4fbe-ac71-6394cb2f1756 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:03:30.832407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925ec27-967b-4fbe-ac71-6394cb2f1756 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:03:30.837150 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9fd53c-8015-43a9-b955-cb0a1c2bfd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:03:30.837837 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fd53c-8015-43a9-b955-cb0a1c2bfd5a admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:03:30.838124 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fd53c-8015-43a9-b955-cb0a1c2bfd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:03:30.838399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fd53c-8015-43a9-b955-cb0a1c2bfd5a admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:03:30.839081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9fd53c-8015-43a9-b955-cb0a1c2bfd5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:03:30.840993 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9fd53c-8015-43a9-b955-cb0a1c2bfd5a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:03:30.925457 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4394/8760] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 22:03:30 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 22:03:30.929465 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f2513-7ef4-4739-a79b-9167647e145b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:03:30.939495 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f2513-7ef4-4739-a79b-9167647e145b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:03:30.994285 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df9b44-e4b3-448e-999a-e547b29e3b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:03:30.994955 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df9b44-e4b3-448e-999a-e547b29e3b42 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:03:30.995242 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df9b44-e4b3-448e-999a-e547b29e3b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:03:30.995539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df9b44-e4b3-448e-999a-e547b29e3b42 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:03:30.996226 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94df9b44-e4b3-448e-999a-e547b29e3b42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:03:30.998253 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94df9b44-e4b3-448e-999a-e547b29e3b42 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:03:31.054745 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4367/8761] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 22:03:30 2022] POST /identity/v3/users => generated 290 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 22:03:31.058789 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9fd53c-8015-43a9-b955-cb0a1c2bfd5a admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:03:31.069418 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9fd53c-8015-43a9-b955-cb0a1c2bfd5a admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:03:31.073995 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c3e3b-bb6b-4b60-b35f-d2a988e3ac36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:03:31.074641 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c3e3b-bb6b-4b60-b35f-d2a988e3ac36 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:03:31.074922 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c3e3b-bb6b-4b60-b35f-d2a988e3ac36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:03:31.075197 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c3e3b-bb6b-4b60-b35f-d2a988e3ac36 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:03:31.075905 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555c3e3b-bb6b-4b60-b35f-d2a988e3ac36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:03:31.078094 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555c3e3b-bb6b-4b60-b35f-d2a988e3ac36 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:03:31.088283 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4395/8762] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 22:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 22:03:31.092303 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df9b44-e4b3-448e-999a-e547b29e3b42 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:03:31.102215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df9b44-e4b3-448e-999a-e547b29e3b42 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:03:31.106977 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566c842-ca6d-412a-ad11-50d90dc909f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:03:31.107613 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566c842-ca6d-412a-ad11-50d90dc909f0 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:03:31.107981 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566c842-ca6d-412a-ad11-50d90dc909f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:03:31.108341 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566c842-ca6d-412a-ad11-50d90dc909f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:03:31.109088 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d566c842-ca6d-412a-ad11-50d90dc909f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:03:31.110713 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d566c842-ca6d-412a-ad11-50d90dc909f0 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:03:31.120404 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4368/8763] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 22:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 22:03:31.124947 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c3e3b-bb6b-4b60-b35f-d2a988e3ac36 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:03:31.135094 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c3e3b-bb6b-4b60-b35f-d2a988e3ac36 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:03:31.140726 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3439712-13f7-4117-a85d-f494851b70a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:03:31.141598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3439712-13f7-4117-a85d-f494851b70a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:03:31.141918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3439712-13f7-4117-a85d-f494851b70a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:03:31.142198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3439712-13f7-4117-a85d-f494851b70a1 admin admin] PATH_INFO: `/v3/projects/2fad6f6856db4b229be0837d3874a1f5/users/303501939f1f44069213c3ef0166497d/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:03:31.159930 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3439712-13f7-4117-a85d-f494851b70a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fad6f6856db4b229be0837d3874a1f5, user_id=303501939f1f44069213c3ef0166497d, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:03:31.162714 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3439712-13f7-4117-a85d-f494851b70a1 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:03:31.208788 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4396/8764] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 22:03:31 2022] PUT /identity/v3/projects/2fad6f6856db4b229be0837d3874a1f5/users/303501939f1f44069213c3ef0166497d/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 22:03:31.213873 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ae862-32d9-445d-bf96-fcd3418ea45a None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:03:31.214168 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ae862-32d9-445d-bf96-fcd3418ea45a None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:03:31.214449 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ae862-32d9-445d-bf96-fcd3418ea45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:03:31.231744 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-bd5ae862-32d9-445d-bf96-fcd3418ea45a None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:03:31.232942 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-bd5ae862-32d9-445d-bf96-fcd3418ea45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:03:31.290027 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4369/8765] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:03:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:03:31.300491 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3439712-13f7-4117-a85d-f494851b70a1 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:03:31.302281 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b3439712-13f7-4117-a85d-f494851b70a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:03:31.357192 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3439712-13f7-4117-a85d-f494851b70a1 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:03:31.360741 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3491ea-974f-4a42-930a-fc14a57b31ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:03:31.361405 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3491ea-974f-4a42-930a-fc14a57b31ba service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:03:31.361687 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3491ea-974f-4a42-930a-fc14a57b31ba service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:03:31.361989 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3491ea-974f-4a42-930a-fc14a57b31ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:03:31.370875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3491ea-974f-4a42-930a-fc14a57b31ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:03:31.372309 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3491ea-974f-4a42-930a-fc14a57b31ba service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:03:31.382090 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4397/8766] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:03:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 22:03:36.835464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55a5ec-db47-4ecb-b122-28180adedd69 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:03:36.836025 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55a5ec-db47-4ecb-b122-28180adedd69 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:03:36.836164 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55a5ec-db47-4ecb-b122-28180adedd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:03:36.864905 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-3c55a5ec-db47-4ecb-b122-28180adedd69 None None] MFA Rules not processed for user `303501939f1f44069213c3ef0166497d`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:03:36.866625 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3c55a5ec-db47-4ecb-b122-28180adedd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:03:36.938014 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4370/8767] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:03:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:03:36.949205 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3491ea-974f-4a42-930a-fc14a57b31ba service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:03:36.950696 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-fc3491ea-974f-4a42-930a-fc14a57b31ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:03:37.027522 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3491ea-974f-4a42-930a-fc14a57b31ba service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:03:37.033345 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045d134-8840-4dc7-a794-d3223e5c92a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:03:37.034039 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045d134-8840-4dc7-a794-d3223e5c92a4 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:03:37.034326 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045d134-8840-4dc7-a794-d3223e5c92a4 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:03:37.034603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045d134-8840-4dc7-a794-d3223e5c92a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:03:37.043353 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2045d134-8840-4dc7-a794-d3223e5c92a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:03:37.044968 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2045d134-8840-4dc7-a794-d3223e5c92a4 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:03:37.055561 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4398/8768] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:03:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:03:39.497240 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25589b34-e5a1-4afa-9d76-8ab2ab2f3ccb None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:03:39.498955 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25589b34-e5a1-4afa-9d76-8ab2ab2f3ccb None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:03:39.498955 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25589b34-e5a1-4afa-9d76-8ab2ab2f3ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:03:39.527212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-25589b34-e5a1-4afa-9d76-8ab2ab2f3ccb None None] MFA Rules not processed for user `303501939f1f44069213c3ef0166497d`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:03:39.529040 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-25589b34-e5a1-4afa-9d76-8ab2ab2f3ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:03:39.536878 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4371/8769] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:03:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:03:40.308418 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045d134-8840-4dc7-a794-d3223e5c92a4 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:03:40.309949 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2045d134-8840-4dc7-a794-d3223e5c92a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:03:40.411895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045d134-8840-4dc7-a794-d3223e5c92a4 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:03:40.417054 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a2615-aeaa-45cf-b0a3-a17fbb89cd48 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:03:40.417699 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a2615-aeaa-45cf-b0a3-a17fbb89cd48 service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:03:40.418013 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a2615-aeaa-45cf-b0a3-a17fbb89cd48 service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:03:40.418292 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a2615-aeaa-45cf-b0a3-a17fbb89cd48 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:03:40.421093 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c49a2615-aeaa-45cf-b0a3-a17fbb89cd48 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:03:40.433527 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a2615-aeaa-45cf-b0a3-a17fbb89cd48 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:03:40.435231 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a2615-aeaa-45cf-b0a3-a17fbb89cd48 service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:03:40.445865 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4399/8770] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:03:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:03:43.275526 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25589b34-e5a1-4afa-9d76-8ab2ab2f3ccb None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:03:43.298819 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25589b34-e5a1-4afa-9d76-8ab2ab2f3ccb None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:03:43.300576 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746644c-8a77-4767-8ea5-349d8ec15786 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:03:43.301517 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746644c-8a77-4767-8ea5-349d8ec15786 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:03:43.301517 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746644c-8a77-4767-8ea5-349d8ec15786 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:03:43.301777 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746644c-8a77-4767-8ea5-349d8ec15786 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:03:43.303713 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a746644c-8a77-4767-8ea5-349d8ec15786 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:03:43.316780 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746644c-8a77-4767-8ea5-349d8ec15786 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:03:43.318369 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746644c-8a77-4767-8ea5-349d8ec15786 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:03:43.329817 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4372/8771] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:03:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:03:48.612087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a2615-aeaa-45cf-b0a3-a17fbb89cd48 service placement] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:03:48.625654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a2615-aeaa-45cf-b0a3-a17fbb89cd48 service placement] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:03:48.630903 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b77371-a3fb-41b3-b6c0-998b8ff4986d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:03:48.631545 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b77371-a3fb-41b3-b6c0-998b8ff4986d service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:03:48.631833 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b77371-a3fb-41b3-b6c0-998b8ff4986d service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:03:48.632110 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b77371-a3fb-41b3-b6c0-998b8ff4986d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:03:48.633923 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f1b77371-a3fb-41b3-b6c0-998b8ff4986d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:03:48.648982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b77371-a3fb-41b3-b6c0-998b8ff4986d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:03:48.650683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b77371-a3fb-41b3-b6c0-998b8ff4986d service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:03:48.662906 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4400/8772] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:03:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:03:49.766115 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746644c-8a77-4767-8ea5-349d8ec15786 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:03:49.767748 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a746644c-8a77-4767-8ea5-349d8ec15786 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:03:49.786002 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746644c-8a77-4767-8ea5-349d8ec15786 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:03:49.791337 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5e4fc-2f03-4aa4-9504-6f37d90f9db9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:03:49.791993 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5e4fc-2f03-4aa4-9504-6f37d90f9db9 service placement] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:03:49.792277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5e4fc-2f03-4aa4-9504-6f37d90f9db9 service placement] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:03:49.792556 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5e4fc-2f03-4aa4-9504-6f37d90f9db9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:03:49.794374 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-dbe5e4fc-2f03-4aa4-9504-6f37d90f9db9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:03:49.809435 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe5e4fc-2f03-4aa4-9504-6f37d90f9db9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:03:49.811671 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe5e4fc-2f03-4aa4-9504-6f37d90f9db9 service placement] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:03:49.824597 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4373/8773] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:03:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:03:55.745129 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10864fbe-019d-4c14-adbd-2f67af506b3a None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:03:55.745665 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10864fbe-019d-4c14-adbd-2f67af506b3a None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:03:55.745665 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10864fbe-019d-4c14-adbd-2f67af506b3a None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:03:55.747067 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4401/8774] 10.222.0.23 () {54 vars in 921 bytes} [Sat Apr 30 22:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 22:03:55.752517 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7cdd9-8967-4aff-bd3f-67c202d37389 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:03:55.752982 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7cdd9-8967-4aff-bd3f-67c202d37389 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:03:55.753105 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7cdd9-8967-4aff-bd3f-67c202d37389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:03:55.797071 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-f4a7cdd9-8967-4aff-bd3f-67c202d37389 None None] MFA Rules not processed for user `4ad3f89b7037413a83c7905cef263b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:03:55.798288 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f4a7cdd9-8967-4aff-bd3f-67c202d37389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:03:55.806663 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4374/8775] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Apr 30 22:03:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:03:55.827982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10864fbe-019d-4c14-adbd-2f67af506b3a None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:03:55.844350 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10864fbe-019d-4c14-adbd-2f67af506b3a None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:03:55.849355 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184d44c-8ef7-441d-8c02-b8d9c85aeb71 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:03:55.850152 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184d44c-8ef7-441d-8c02-b8d9c85aeb71 service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:03:55.850440 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184d44c-8ef7-441d-8c02-b8d9c85aeb71 service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:03:55.850719 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184d44c-8ef7-441d-8c02-b8d9c85aeb71 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:03:55.859619 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184d44c-8ef7-441d-8c02-b8d9c85aeb71 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:03:55.861206 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184d44c-8ef7-441d-8c02-b8d9c85aeb71 service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:03:55.870903 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4402/8776] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:03:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:04:32.021091 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af8084-3196-4025-9d7a-a7928c6e4a79 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:04:32.021704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af8084-3196-4025-9d7a-a7928c6e4a79 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:04:32.021704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af8084-3196-4025-9d7a-a7928c6e4a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:04:32.040591 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-f3af8084-3196-4025-9d7a-a7928c6e4a79 None None] MFA Rules not processed for user `303501939f1f44069213c3ef0166497d`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:04:32.042349 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f3af8084-3196-4025-9d7a-a7928c6e4a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:04:32.048888 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4375/8777] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:04:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:05:12.311508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1551929-2cdd-4c54-b104-7e18ea78825d None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:05:12.312094 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1551929-2cdd-4c54-b104-7e18ea78825d None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:05:12.312094 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1551929-2cdd-4c54-b104-7e18ea78825d None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:05:12.313440 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4403/8778] 10.222.0.23 () {54 vars in 921 bytes} [Sat Apr 30 22:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 22:05:12.318427 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e139d39-6380-4ab0-830a-e8cbfcc756f9 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:05:12.318880 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e139d39-6380-4ab0-830a-e8cbfcc756f9 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:05:12.318997 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e139d39-6380-4ab0-830a-e8cbfcc756f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:05:12.337410 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-0e139d39-6380-4ab0-830a-e8cbfcc756f9 None None] MFA Rules not processed for user `4ad3f89b7037413a83c7905cef263b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:05:12.338659 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0e139d39-6380-4ab0-830a-e8cbfcc756f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:05:12.347183 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4376/8779] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Apr 30 22:05:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:05:12.367016 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1551929-2cdd-4c54-b104-7e18ea78825d None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:05:12.383630 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1551929-2cdd-4c54-b104-7e18ea78825d None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:05:12.389432 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8330f42-d856-4f12-a546-f599fb7465f2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:05:12.390096 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8330f42-d856-4f12-a546-f599fb7465f2 service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:05:12.390380 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8330f42-d856-4f12-a546-f599fb7465f2 service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:05:12.390656 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8330f42-d856-4f12-a546-f599fb7465f2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:05:12.399007 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8330f42-d856-4f12-a546-f599fb7465f2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:05:12.400589 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8330f42-d856-4f12-a546-f599fb7465f2 service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:05:12.410221 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4404/8780] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:05:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:05:31.496941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4ddc0-0117-42e6-9f6b-5aef906718af None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:05:31.497433 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4ddc0-0117-42e6-9f6b-5aef906718af None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:05:31.499925 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4ddc0-0117-42e6-9f6b-5aef906718af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:05:31.516948 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-82d4ddc0-0117-42e6-9f6b-5aef906718af None None] MFA Rules not processed for user `303501939f1f44069213c3ef0166497d`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:05:31.518224 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-82d4ddc0-0117-42e6-9f6b-5aef906718af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:05:31.525922 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4377/8781] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:05:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:05:45.858902 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb19532-5961-435e-85c5-c87ad40f56c8 None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:05:45.859582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb19532-5961-435e-85c5-c87ad40f56c8 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:05:45.859582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb19532-5961-435e-85c5-c87ad40f56c8 None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:05:45.861417 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4405/8782] 10.222.0.23 () {54 vars in 921 bytes} [Sat Apr 30 22:05:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 22:05:45.867056 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bc875-505e-4a19-b4eb-31eaac99289e None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:05:45.867628 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bc875-505e-4a19-b4eb-31eaac99289e None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:05:45.867779 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bc875-505e-4a19-b4eb-31eaac99289e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:05:45.888225 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-ec3bc875-505e-4a19-b4eb-31eaac99289e None None] MFA Rules not processed for user `4ad3f89b7037413a83c7905cef263b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:05:45.890287 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ec3bc875-505e-4a19-b4eb-31eaac99289e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:05:45.899548 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4378/8783] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Apr 30 22:05:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:05:45.925107 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb19532-5961-435e-85c5-c87ad40f56c8 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:05:45.942416 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb19532-5961-435e-85c5-c87ad40f56c8 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:05:45.947577 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc36fae-2293-4946-bb8d-4d2b13031880 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:05:45.948223 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc36fae-2293-4946-bb8d-4d2b13031880 service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:05:45.948509 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc36fae-2293-4946-bb8d-4d2b13031880 service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:05:45.948846 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc36fae-2293-4946-bb8d-4d2b13031880 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:05:45.958424 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc36fae-2293-4946-bb8d-4d2b13031880 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:05:45.960027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc36fae-2293-4946-bb8d-4d2b13031880 service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:05:45.970003 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4406/8784] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:05:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:05:46.335445 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3bc875-505e-4a19-b4eb-31eaac99289e None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:05:46.349190 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3bc875-505e-4a19-b4eb-31eaac99289e None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:05:46.354391 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa1475-f042-4862-97aa-c20f7ccf9b33 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:05:46.360406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa1475-f042-4862-97aa-c20f7ccf9b33 service placement] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:05:46.360406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa1475-f042-4862-97aa-c20f7ccf9b33 service placement] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:05:46.360406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa1475-f042-4862-97aa-c20f7ccf9b33 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:05:46.360406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e8fa1475-f042-4862-97aa-c20f7ccf9b33 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:05:46.370704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fa1475-f042-4862-97aa-c20f7ccf9b33 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:05:46.372379 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fa1475-f042-4862-97aa-c20f7ccf9b33 service placement] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:05:46.384417 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4379/8785] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:05:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:05:50.554802 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513fd02-0f0a-48e0-b160-f9b5377b238b None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:05:50.555337 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513fd02-0f0a-48e0-b160-f9b5377b238b None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:05:50.555337 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513fd02-0f0a-48e0-b160-f9b5377b238b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:05:50.574389 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-6513fd02-0f0a-48e0-b160-f9b5377b238b None None] MFA Rules not processed for user `4ad3f89b7037413a83c7905cef263b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:05:50.579535 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6513fd02-0f0a-48e0-b160-f9b5377b238b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:05:50.585306 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4407/8786] 10.222.0.20 () {58 vars in 1015 bytes} [Sat Apr 30 22:05:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:05:50.599320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa1475-f042-4862-97aa-c20f7ccf9b33 service placement] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:05:50.612219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa1475-f042-4862-97aa-c20f7ccf9b33 service placement] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:05:50.617507 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46293c-8951-48c5-9446-fd81543e49da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:05:50.618190 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46293c-8951-48c5-9446-fd81543e49da service placement] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:05:50.618505 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46293c-8951-48c5-9446-fd81543e49da service placement] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:05:50.618784 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46293c-8951-48c5-9446-fd81543e49da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:05:50.629816 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b46293c-8951-48c5-9446-fd81543e49da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:05:50.632587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b46293c-8951-48c5-9446-fd81543e49da service placement] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:05:50.641974 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4380/8787] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:05:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:05:52.772508 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a641b-f921-4cb6-a214-64030de34d5d None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:05:52.773099 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a641b-f921-4cb6-a214-64030de34d5d None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:05:52.773099 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a641b-f921-4cb6-a214-64030de34d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:05:52.791167 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-b62a641b-f921-4cb6-a214-64030de34d5d None None] MFA Rules not processed for user `4ad3f89b7037413a83c7905cef263b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:05:52.792376 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b62a641b-f921-4cb6-a214-64030de34d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:05:52.801238 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4408/8788] 10.222.0.35 () {58 vars in 1015 bytes} [Sat Apr 30 22:05:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:05:52.813240 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d576308-9399-4455-aa01-cddd0003d1b0 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:05:52.813682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d576308-9399-4455-aa01-cddd0003d1b0 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:05:52.813897 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d576308-9399-4455-aa01-cddd0003d1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:05:52.832817 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-8d576308-9399-4455-aa01-cddd0003d1b0 None None] MFA Rules not processed for user `4ad3f89b7037413a83c7905cef263b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:05:52.834172 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8d576308-9399-4455-aa01-cddd0003d1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:05:52.843193 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4381/8789] 10.222.0.23 () {58 vars in 1057 bytes} [Sat Apr 30 22:05:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:05:52.849553 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a641b-f921-4cb6-a214-64030de34d5d None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:05:52.860143 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a641b-f921-4cb6-a214-64030de34d5d None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:05:52.865398 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ab429-fc58-4378-9e25-074aa535564a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:05:52.866114 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ab429-fc58-4378-9e25-074aa535564a service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:05:52.866400 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ab429-fc58-4378-9e25-074aa535564a service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:05:52.866681 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ab429-fc58-4378-9e25-074aa535564a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:05:52.876222 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ab429-fc58-4378-9e25-074aa535564a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:05:52.877882 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ab429-fc58-4378-9e25-074aa535564a service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:05:52.888021 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4409/8790] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:05:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:06:39.218228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158100a2-eb90-480d-9999-466ce8cedbc2 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:06:39.218746 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158100a2-eb90-480d-9999-466ce8cedbc2 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:06:39.218855 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158100a2-eb90-480d-9999-466ce8cedbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:06:39.235683 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-158100a2-eb90-480d-9999-466ce8cedbc2 None None] MFA Rules not processed for user `303501939f1f44069213c3ef0166497d`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:06:39.236874 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-158100a2-eb90-480d-9999-466ce8cedbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:06:39.243748 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4382/8791] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:06:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:06:39.539333 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ab429-fc58-4378-9e25-074aa535564a service placement] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:06:39.548363 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ab429-fc58-4378-9e25-074aa535564a service placement] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:06:39.553039 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5b39a-997c-4ce6-bbab-08ce72ffcdb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:06:39.553670 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5b39a-997c-4ce6-bbab-08ce72ffcdb9 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:06:39.554047 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5b39a-997c-4ce6-bbab-08ce72ffcdb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:06:39.554965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5b39a-997c-4ce6-bbab-08ce72ffcdb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:06:39.557006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2aa5b39a-997c-4ce6-bbab-08ce72ffcdb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:06:39.569626 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa5b39a-997c-4ce6-bbab-08ce72ffcdb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:06:39.571073 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa5b39a-997c-4ce6-bbab-08ce72ffcdb9 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:06:39.581127 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4410/8792] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:06:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:06:53.377684 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158100a2-eb90-480d-9999-466ce8cedbc2 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:06:53.387841 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158100a2-eb90-480d-9999-466ce8cedbc2 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:06:53.391523 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2432d9-7f36-44c8-9707-573890360d26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:06:53.392204 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2432d9-7f36-44c8-9707-573890360d26 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:06:53.392497 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2432d9-7f36-44c8-9707-573890360d26 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:06:53.392779 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2432d9-7f36-44c8-9707-573890360d26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:06:53.394682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7d2432d9-7f36-44c8-9707-573890360d26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:06:53.411293 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2432d9-7f36-44c8-9707-573890360d26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:06:53.412752 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2432d9-7f36-44c8-9707-573890360d26 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:06:53.436446 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4383/8793] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:06:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:06:53.606806 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1014d47-798f-4219-972c-1c78ec1bd0e2 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:06:53.607290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1014d47-798f-4219-972c-1c78ec1bd0e2 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:06:53.607417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1014d47-798f-4219-972c-1c78ec1bd0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:06:53.654861 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-c1014d47-798f-4219-972c-1c78ec1bd0e2 None None] MFA Rules not processed for user `f3dc7765f32c4b00a7e41f2754b9595b`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:06:53.656080 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c1014d47-798f-4219-972c-1c78ec1bd0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:06:53.714053 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4411/8794] 10.222.0.23 () {58 vars in 1060 bytes} [Sat Apr 30 22:06:53 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:06:53.719982 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2432d9-7f36-44c8-9707-573890360d26 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:06:53.729657 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2432d9-7f36-44c8-9707-573890360d26 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:06:53.733793 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596bb523-4e7f-41a1-b6a2-a277300157cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3dc7765f32c4b00a7e41f2754b9595b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:06:53.733975 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596bb523-4e7f-41a1-b6a2-a277300157cb service cinder] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:06:53.734261 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596bb523-4e7f-41a1-b6a2-a277300157cb service cinder] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:06:53.734538 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596bb523-4e7f-41a1-b6a2-a277300157cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:06:53.736316 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-596bb523-4e7f-41a1-b6a2-a277300157cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:06:53.754589 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596bb523-4e7f-41a1-b6a2-a277300157cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:06:53.756054 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596bb523-4e7f-41a1-b6a2-a277300157cb service cinder] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:06:53.769582 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4384/8795] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:06:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:06:57.962233 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1014d47-798f-4219-972c-1c78ec1bd0e2 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:06:57.963739 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c1014d47-798f-4219-972c-1c78ec1bd0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:06:57.975298 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1014d47-798f-4219-972c-1c78ec1bd0e2 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:06:57.978965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488602d-f7d6-49c7-9cc1-71be3a0eb041 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:06:57.979611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488602d-f7d6-49c7-9cc1-71be3a0eb041 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:06:57.979896 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488602d-f7d6-49c7-9cc1-71be3a0eb041 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:06:57.980175 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488602d-f7d6-49c7-9cc1-71be3a0eb041 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:06:57.982052 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a488602d-f7d6-49c7-9cc1-71be3a0eb041 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:06:57.994547 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a488602d-f7d6-49c7-9cc1-71be3a0eb041 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:06:57.996012 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a488602d-f7d6-49c7-9cc1-71be3a0eb041 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:06:58.006334 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4412/8796] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:06:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:06:58.141692 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb50c58-6f19-43c3-9712-c1f2392ddea6 None None] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:06:58.142388 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb50c58-6f19-43c3-9712-c1f2392ddea6 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:06:58.142388 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb50c58-6f19-43c3-9712-c1f2392ddea6 None None] PATH_INFO: `/` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:06:58.144143 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4385/8797] 10.222.0.23 () {54 vars in 921 bytes} [Sat Apr 30 22:06:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 22:06:58.149092 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be378337-167f-4ed3-907e-d75a08f09cb1 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:06:58.149383 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be378337-167f-4ed3-907e-d75a08f09cb1 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:06:58.149666 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be378337-167f-4ed3-907e-d75a08f09cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:06:58.168245 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-be378337-167f-4ed3-907e-d75a08f09cb1 None None] MFA Rules not processed for user `4ad3f89b7037413a83c7905cef263b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:06:58.169444 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-be378337-167f-4ed3-907e-d75a08f09cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:06:58.178160 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4413/8798] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Apr 30 22:06:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:06:58.198560 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb50c58-6f19-43c3-9712-c1f2392ddea6 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:06:58.212267 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb50c58-6f19-43c3-9712-c1f2392ddea6 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:06:58.217186 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be17b8-b1b7-4868-9cdb-a6856997ef2c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:06:58.217855 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be17b8-b1b7-4868-9cdb-a6856997ef2c service placement] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:06:58.218140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be17b8-b1b7-4868-9cdb-a6856997ef2c service placement] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:06:58.218416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be17b8-b1b7-4868-9cdb-a6856997ef2c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:06:58.227406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7be17b8-b1b7-4868-9cdb-a6856997ef2c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:06:58.229043 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7be17b8-b1b7-4868-9cdb-a6856997ef2c service placement] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:06:58.239182 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4386/8799] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:06:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:06:58.504350 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be378337-167f-4ed3-907e-d75a08f09cb1 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:06:58.514264 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be378337-167f-4ed3-907e-d75a08f09cb1 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:06:58.517892 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56958b23-6dac-48cd-bd30-36e64012f926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:06:58.523948 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56958b23-6dac-48cd-bd30-36e64012f926 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:06:58.523948 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56958b23-6dac-48cd-bd30-36e64012f926 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:06:58.523948 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56958b23-6dac-48cd-bd30-36e64012f926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:06:58.523948 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-56958b23-6dac-48cd-bd30-36e64012f926 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:06:58.538467 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56958b23-6dac-48cd-bd30-36e64012f926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:06:58.539926 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56958b23-6dac-48cd-bd30-36e64012f926 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:06:58.553496 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4414/8800] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:06:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:07:31.972042 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be17b8-b1b7-4868-9cdb-a6856997ef2c service placement] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:07:31.981532 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be17b8-b1b7-4868-9cdb-a6856997ef2c service placement] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:07:31.985237 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9c0e8-4300-4331-bcd4-32e1e1b7a9c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:07:31.985916 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9c0e8-4300-4331-bcd4-32e1e1b7a9c8 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:07:31.986206 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9c0e8-4300-4331-bcd4-32e1e1b7a9c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:07:31.986491 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9c0e8-4300-4331-bcd4-32e1e1b7a9c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:07:31.988288 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e1b9c0e8-4300-4331-bcd4-32e1e1b7a9c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:07:32.000654 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b9c0e8-4300-4331-bcd4-32e1e1b7a9c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:07:32.002143 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b9c0e8-4300-4331-bcd4-32e1e1b7a9c8 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:07:32.013357 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4387/8801] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:07:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:07:44.523462 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56958b23-6dac-48cd-bd30-36e64012f926 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:07:44.525030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-56958b23-6dac-48cd-bd30-36e64012f926 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:07:44.546260 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56958b23-6dac-48cd-bd30-36e64012f926 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:07:44.546908 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088b6e9-2773-4c2d-a9f6-d23233cb1799 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:07:44.547573 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088b6e9-2773-4c2d-a9f6-d23233cb1799 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:07:44.547859 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088b6e9-2773-4c2d-a9f6-d23233cb1799 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:07:44.548137 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088b6e9-2773-4c2d-a9f6-d23233cb1799 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:07:44.549924 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f088b6e9-2773-4c2d-a9f6-d23233cb1799 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:07:44.564853 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f088b6e9-2773-4c2d-a9f6-d23233cb1799 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:07:44.566499 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f088b6e9-2773-4c2d-a9f6-d23233cb1799 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:07:44.580238 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4415/8802] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:07:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:07:56.063673 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9c0e8-4300-4331-bcd4-32e1e1b7a9c8 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:07:56.076015 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9c0e8-4300-4331-bcd4-32e1e1b7a9c8 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:07:56.088488 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296974e4-8d5e-40f3-b37c-8ddb759d8044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:07:56.088488 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296974e4-8d5e-40f3-b37c-8ddb759d8044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:07:56.088488 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296974e4-8d5e-40f3-b37c-8ddb759d8044 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:07:56.088488 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296974e4-8d5e-40f3-b37c-8ddb759d8044 admin admin] PATH_INFO: `/v3/users/303501939f1f44069213c3ef0166497d` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:07:56.088880 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296974e4-8d5e-40f3-b37c-8ddb759d8044 admin admin] RBAC: Authorizing `identity:delete_user(user_id=303501939f1f44069213c3ef0166497d)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:07:56.088880 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296974e4-8d5e-40f3-b37c-8ddb759d8044 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:07:56.274185 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-296974e4-8d5e-40f3-b37c-8ddb759d8044 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '303501939f1f44069213c3ef0166497d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:07:56.286179 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-296974e4-8d5e-40f3-b37c-8ddb759d8044 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '303501939f1f44069213c3ef0166497d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:07:56.329970 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-296974e4-8d5e-40f3-b37c-8ddb759d8044 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '303501939f1f44069213c3ef0166497d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:07:56.330543 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-296974e4-8d5e-40f3-b37c-8ddb759d8044 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '303501939f1f44069213c3ef0166497d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:07:56.337602 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-296974e4-8d5e-40f3-b37c-8ddb759d8044 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '303501939f1f44069213c3ef0166497d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:07:56.343481 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4388/8803] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 22:07:56 2022] DELETE /identity/v3/users/303501939f1f44069213c3ef0166497d => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:07:56.607008 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088b6e9-2773-4c2d-a9f6-d23233cb1799 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:07:56.619829 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088b6e9-2773-4c2d-a9f6-d23233cb1799 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:07:56.678285 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96624363-5bf8-4e6a-89df-db5987f8a0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:07:56.679146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96624363-5bf8-4e6a-89df-db5987f8a0ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:07:56.679462 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96624363-5bf8-4e6a-89df-db5987f8a0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:07:56.679745 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96624363-5bf8-4e6a-89df-db5987f8a0ed admin admin] PATH_INFO: `/v3/projects/2fad6f6856db4b229be0837d3874a1f5` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:07:56.680934 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96624363-5bf8-4e6a-89df-db5987f8a0ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fad6f6856db4b229be0837d3874a1f5)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:07:56.682953 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96624363-5bf8-4e6a-89df-db5987f8a0ed admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:07:56.776115 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-96624363-5bf8-4e6a-89df-db5987f8a0ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fad6f6856db4b229be0837d3874a1f5', 'request_id': 'req-96624363-5bf8-4e6a-89df-db5987f8a0ed'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:07:56.781635 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-96624363-5bf8-4e6a-89df-db5987f8a0ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fad6f6856db4b229be0837d3874a1f5', 'request_id': 'req-96624363-5bf8-4e6a-89df-db5987f8a0ed'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:07:56.787771 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-96624363-5bf8-4e6a-89df-db5987f8a0ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fad6f6856db4b229be0837d3874a1f5', 'request_id': 'req-96624363-5bf8-4e6a-89df-db5987f8a0ed'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:07:56.872542 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-96624363-5bf8-4e6a-89df-db5987f8a0ed admin admin] The token cache is being invalidate because project 2fad6f6856db4b229be0837d3874a1f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 22:07:56.872803 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-96624363-5bf8-4e6a-89df-db5987f8a0ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:07:56.873350 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-96624363-5bf8-4e6a-89df-db5987f8a0ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:07:56.874916 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4416/8804] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 22:07:56 2022] DELETE /identity/v3/projects/2fad6f6856db4b229be0837d3874a1f5 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:07:56.880240 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae345bf-62b0-473e-ba9b-63f79a53c1b7 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:07:56.880543 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae345bf-62b0-473e-ba9b-63f79a53c1b7 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:07:56.880852 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae345bf-62b0-473e-ba9b-63f79a53c1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:07:56.904782 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-3ae345bf-62b0-473e-ba9b-63f79a53c1b7 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:07:56.906080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3ae345bf-62b0-473e-ba9b-63f79a53c1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:07:56.964663 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4389/8805] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:07:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:07:56.972762 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d6eaa-2c95-4c08-92da-7bc70eaf439c None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:07:56.973122 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d6eaa-2c95-4c08-92da-7bc70eaf439c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:07:56.973474 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d6eaa-2c95-4c08-92da-7bc70eaf439c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:07:56.992688 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-172d6eaa-2c95-4c08-92da-7bc70eaf439c None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:07:56.993947 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-172d6eaa-2c95-4c08-92da-7bc70eaf439c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:07:57.001774 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4417/8806] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:07:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:07:57.005959 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae345bf-62b0-473e-ba9b-63f79a53c1b7 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:07:57.016444 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae345bf-62b0-473e-ba9b-63f79a53c1b7 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:07:57.021019 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5dd7d9-ece4-4d2f-85da-0ddfd2736ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:07:57.021668 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5dd7d9-ece4-4d2f-85da-0ddfd2736ceb admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:07:57.021989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5dd7d9-ece4-4d2f-85da-0ddfd2736ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:07:57.022271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5dd7d9-ece4-4d2f-85da-0ddfd2736ceb admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:07:57.022991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5dd7d9-ece4-4d2f-85da-0ddfd2736ceb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 22:07:57.023853 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5dd7d9-ece4-4d2f-85da-0ddfd2736ceb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:07:57.025466 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5dd7d9-ece4-4d2f-85da-0ddfd2736ceb admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:07:57.036929 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4390/8807] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 22:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 22:07:57.041101 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d6eaa-2c95-4c08-92da-7bc70eaf439c None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:07:57.050041 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d6eaa-2c95-4c08-92da-7bc70eaf439c None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:07:57.054635 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557beba-f81b-408e-b526-17f05885f128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:07:57.055268 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557beba-f81b-408e-b526-17f05885f128 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:07:57.055547 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557beba-f81b-408e-b526-17f05885f128 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:07:57.055818 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557beba-f81b-408e-b526-17f05885f128 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:07:57.056502 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557beba-f81b-408e-b526-17f05885f128 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:07:57.058434 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557beba-f81b-408e-b526-17f05885f128 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:07:57.148928 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4418/8808] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 22:07:57 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 22:07:57.153059 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5dd7d9-ece4-4d2f-85da-0ddfd2736ceb admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:07:57.163299 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5dd7d9-ece4-4d2f-85da-0ddfd2736ceb admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:07:57.219106 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7d034-cf0e-4758-8431-ca997f3b7233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:07:57.219769 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7d034-cf0e-4758-8431-ca997f3b7233 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:07:57.220051 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7d034-cf0e-4758-8431-ca997f3b7233 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:07:57.220327 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7d034-cf0e-4758-8431-ca997f3b7233 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:07:57.221004 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7d034-cf0e-4758-8431-ca997f3b7233 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:07:57.222991 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7d034-cf0e-4758-8431-ca997f3b7233 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:07:57.318532 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4391/8809] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 22:07:57 2022] POST /identity/v3/users => generated 291 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 22:07:57.323213 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557beba-f81b-408e-b526-17f05885f128 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:07:57.333293 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557beba-f81b-408e-b526-17f05885f128 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:07:57.337958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf1c0fc-6b3a-4adb-8f9e-53211f069d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:07:57.338600 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf1c0fc-6b3a-4adb-8f9e-53211f069d13 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:07:57.338879 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf1c0fc-6b3a-4adb-8f9e-53211f069d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:07:57.339152 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf1c0fc-6b3a-4adb-8f9e-53211f069d13 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:07:57.339865 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf1c0fc-6b3a-4adb-8f9e-53211f069d13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:07:57.341510 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf1c0fc-6b3a-4adb-8f9e-53211f069d13 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:07:57.351568 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4419/8810] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 22:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 22:07:57.355743 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7d034-cf0e-4758-8431-ca997f3b7233 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:07:57.365662 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7d034-cf0e-4758-8431-ca997f3b7233 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:07:57.370873 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d16718-eb12-4385-8e93-79cc77496fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:07:57.371525 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d16718-eb12-4385-8e93-79cc77496fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:07:57.371813 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d16718-eb12-4385-8e93-79cc77496fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:07:57.372091 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d16718-eb12-4385-8e93-79cc77496fb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:07:57.372803 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d16718-eb12-4385-8e93-79cc77496fb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:07:57.374492 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d16718-eb12-4385-8e93-79cc77496fb0 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:07:57.385194 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4392/8811] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 22:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 22:07:57.389077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf1c0fc-6b3a-4adb-8f9e-53211f069d13 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:07:57.399134 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf1c0fc-6b3a-4adb-8f9e-53211f069d13 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:07:57.403721 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e3a80-416c-47d1-9a4d-45aeb2157f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:07:57.404591 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e3a80-416c-47d1-9a4d-45aeb2157f14 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:07:57.404877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e3a80-416c-47d1-9a4d-45aeb2157f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:07:57.405159 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e3a80-416c-47d1-9a4d-45aeb2157f14 admin admin] PATH_INFO: `/v3/projects/3f727643ff9b47fcab67ab5e3ef4db86/users/55cbd9baa3484ef492ba23f07470f7db/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:07:57.419534 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e3a80-416c-47d1-9a4d-45aeb2157f14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f727643ff9b47fcab67ab5e3ef4db86, user_id=55cbd9baa3484ef492ba23f07470f7db, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:07:57.422280 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e3a80-416c-47d1-9a4d-45aeb2157f14 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:07:57.529878 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4420/8812] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 22:07:57 2022] PUT /identity/v3/projects/3f727643ff9b47fcab67ab5e3ef4db86/users/55cbd9baa3484ef492ba23f07470f7db/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:07:57.534951 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d722ba4-fb82-46c3-806e-52869a07949d None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:07:57.535248 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d722ba4-fb82-46c3-806e-52869a07949d None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:07:57.535534 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d722ba4-fb82-46c3-806e-52869a07949d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:07:57.553367 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-0d722ba4-fb82-46c3-806e-52869a07949d None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:07:57.555115 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-0d722ba4-fb82-46c3-806e-52869a07949d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:07:57.612614 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4393/8813] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:07:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:07:57.622919 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e3a80-416c-47d1-9a4d-45aeb2157f14 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:07:57.624589 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-144e3a80-416c-47d1-9a4d-45aeb2157f14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:07:57.680788 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e3a80-416c-47d1-9a4d-45aeb2157f14 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:07:57.684327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1dbda0-74d1-4d3a-81cc-22fd9243ebc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:07:57.684965 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1dbda0-74d1-4d3a-81cc-22fd9243ebc6 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:07:57.685245 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1dbda0-74d1-4d3a-81cc-22fd9243ebc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:07:57.685521 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1dbda0-74d1-4d3a-81cc-22fd9243ebc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:07:57.694292 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1dbda0-74d1-4d3a-81cc-22fd9243ebc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:07:57.695726 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1dbda0-74d1-4d3a-81cc-22fd9243ebc6 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:07:57.704857 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4421/8814] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:07:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 22:07:58.793274 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a9bb0-4b1a-493e-ad0a-ae1ff80121c3 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:07:58.793837 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a9bb0-4b1a-493e-ad0a-ae1ff80121c3 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:07:58.793990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a9bb0-4b1a-493e-ad0a-ae1ff80121c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:07:58.822743 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-2f3a9bb0-4b1a-493e-ad0a-ae1ff80121c3 None None] MFA Rules not processed for user `55cbd9baa3484ef492ba23f07470f7db`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:07:58.823970 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2f3a9bb0-4b1a-493e-ad0a-ae1ff80121c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:07:58.889881 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4394/8815] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:07:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:07:58.900985 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc23941-0c77-4491-9d48-cee95647c2cf None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:07:58.901580 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc23941-0c77-4491-9d48-cee95647c2cf None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:07:58.901704 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc23941-0c77-4491-9d48-cee95647c2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:07:58.918809 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-5dc23941-0c77-4491-9d48-cee95647c2cf None None] MFA Rules not processed for user `55cbd9baa3484ef492ba23f07470f7db`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:07:58.920176 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5dc23941-0c77-4491-9d48-cee95647c2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:07:58.927733 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4422/8816] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:07:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:07:58.941459 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a9bb0-4b1a-493e-ad0a-ae1ff80121c3 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:07:58.945819 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2f3a9bb0-4b1a-493e-ad0a-ae1ff80121c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:07:59.020786 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a9bb0-4b1a-493e-ad0a-ae1ff80121c3 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:07:59.027757 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455ad45-e112-4a9e-90dc-c43fbd079aa8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:07:59.028426 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455ad45-e112-4a9e-90dc-c43fbd079aa8 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:07:59.028707 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455ad45-e112-4a9e-90dc-c43fbd079aa8 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:07:59.028986 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455ad45-e112-4a9e-90dc-c43fbd079aa8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:07:59.036984 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3455ad45-e112-4a9e-90dc-c43fbd079aa8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:07:59.038610 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3455ad45-e112-4a9e-90dc-c43fbd079aa8 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:07:59.047285 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4395/8817] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:07:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:08:11.341980 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f009c-40ed-4fb0-8d8e-ccfd9e27e5d5 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:08:11.342532 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f009c-40ed-4fb0-8d8e-ccfd9e27e5d5 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:08:11.342532 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f009c-40ed-4fb0-8d8e-ccfd9e27e5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:08:11.359684 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-0f1f009c-40ed-4fb0-8d8e-ccfd9e27e5d5 None None] MFA Rules not processed for user `55cbd9baa3484ef492ba23f07470f7db`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:08:11.360871 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0f1f009c-40ed-4fb0-8d8e-ccfd9e27e5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:08:11.367737 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4423/8818] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:08:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:08:17.681535 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f4ab8-271a-4d4d-8dab-b1d103638364 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:08:17.682134 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f4ab8-271a-4d4d-8dab-b1d103638364 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:08:17.682134 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f4ab8-271a-4d4d-8dab-b1d103638364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:08:17.718684 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-8b1f4ab8-271a-4d4d-8dab-b1d103638364 None None] MFA Rules not processed for user `fca4ee1f64c8489ebe7296f9f8f0ab41`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:08:17.719945 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8b1f4ab8-271a-4d4d-8dab-b1d103638364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:08:17.730053 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4396/8819] 10.222.0.23 () {58 vars in 1057 bytes} [Sat Apr 30 22:08:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:08:18.903815 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344a77f-3a31-4108-81ba-de17a8b07f23 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:08:18.904373 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344a77f-3a31-4108-81ba-de17a8b07f23 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:08:18.904373 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344a77f-3a31-4108-81ba-de17a8b07f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:08:18.923263 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-0344a77f-3a31-4108-81ba-de17a8b07f23 None None] MFA Rules not processed for user `fca4ee1f64c8489ebe7296f9f8f0ab41`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:08:18.924482 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0344a77f-3a31-4108-81ba-de17a8b07f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:08:18.934566 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4424/8820] 10.222.0.23 () {58 vars in 1057 bytes} [Sat Apr 30 22:08:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:08:22.427269 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe399ba3-9171-4803-9233-0ab1da3f30c7 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:08:22.427821 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe399ba3-9171-4803-9233-0ab1da3f30c7 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:08:22.427821 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe399ba3-9171-4803-9233-0ab1da3f30c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:08:22.445891 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-fe399ba3-9171-4803-9233-0ab1da3f30c7 None None] MFA Rules not processed for user `fca4ee1f64c8489ebe7296f9f8f0ab41`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:08:22.447066 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-fe399ba3-9171-4803-9233-0ab1da3f30c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:08:22.456167 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4397/8821] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 22:08:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:08:22.467303 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344a77f-3a31-4108-81ba-de17a8b07f23 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:08:22.476686 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344a77f-3a31-4108-81ba-de17a8b07f23 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:08:22.480284 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4745b-b0ba-4bcd-bd45-5eb179c1631a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:08:22.480916 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4745b-b0ba-4bcd-bd45-5eb179c1631a service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:08:22.481197 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4745b-b0ba-4bcd-bd45-5eb179c1631a service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:08:22.481471 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4745b-b0ba-4bcd-bd45-5eb179c1631a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:08:22.491492 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a4745b-b0ba-4bcd-bd45-5eb179c1631a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:08:22.492918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a4745b-b0ba-4bcd-bd45-5eb179c1631a service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:08:22.503817 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4425/8822] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:08:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:08:24.159033 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc68fa1-acf1-4636-8960-c01ff5c52b84 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:08:24.159549 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc68fa1-acf1-4636-8960-c01ff5c52b84 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:08:24.159693 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc68fa1-acf1-4636-8960-c01ff5c52b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:08:24.177009 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-7cc68fa1-acf1-4636-8960-c01ff5c52b84 None None] MFA Rules not processed for user `fca4ee1f64c8489ebe7296f9f8f0ab41`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:08:24.178283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7cc68fa1-acf1-4636-8960-c01ff5c52b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:08:24.187845 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4398/8823] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 22:08:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:08:24.200554 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4745b-b0ba-4bcd-bd45-5eb179c1631a service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:08:24.209193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4745b-b0ba-4bcd-bd45-5eb179c1631a service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:08:24.213571 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f8ea2-1d9d-4d90-94b1-1f7a996532fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:08:24.214330 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f8ea2-1d9d-4d90-94b1-1f7a996532fb service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:08:24.214683 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f8ea2-1d9d-4d90-94b1-1f7a996532fb service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:08:24.215045 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f8ea2-1d9d-4d90-94b1-1f7a996532fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:08:24.225513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44f8ea2-1d9d-4d90-94b1-1f7a996532fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:08:24.226995 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44f8ea2-1d9d-4d90-94b1-1f7a996532fb service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:08:24.238121 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4426/8824] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:08:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:08:30.053862 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc68fa1-acf1-4636-8960-c01ff5c52b84 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:08:30.064954 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc68fa1-acf1-4636-8960-c01ff5c52b84 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:08:30.070986 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c8959-2dc7-4de9-b3e6-1ce2b6bb75ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:08:30.071657 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c8959-2dc7-4de9-b3e6-1ce2b6bb75ea service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:08:30.071941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c8959-2dc7-4de9-b3e6-1ce2b6bb75ea service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:08:30.072217 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c8959-2dc7-4de9-b3e6-1ce2b6bb75ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:08:30.074010 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-233c8959-2dc7-4de9-b3e6-1ce2b6bb75ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:08:30.089113 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c8959-2dc7-4de9-b3e6-1ce2b6bb75ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:08:30.090765 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c8959-2dc7-4de9-b3e6-1ce2b6bb75ea service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:08:30.104236 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4399/8825] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:08:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:08:32.152215 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f8ea2-1d9d-4d90-94b1-1f7a996532fb service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:08:32.181717 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f8ea2-1d9d-4d90-94b1-1f7a996532fb service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:08:32.187464 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ece61-2f4d-41c6-8c7e-6cb3561de067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:08:32.188495 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ece61-2f4d-41c6-8c7e-6cb3561de067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:08:32.188831 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ece61-2f4d-41c6-8c7e-6cb3561de067 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:08:32.189211 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ece61-2f4d-41c6-8c7e-6cb3561de067 admin admin] PATH_INFO: `/v3/users/55cbd9baa3484ef492ba23f07470f7db` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:08:32.190652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ece61-2f4d-41c6-8c7e-6cb3561de067 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55cbd9baa3484ef492ba23f07470f7db)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:08:32.193114 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ece61-2f4d-41c6-8c7e-6cb3561de067 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:08:32.377017 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d04ece61-2f4d-41c6-8c7e-6cb3561de067 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55cbd9baa3484ef492ba23f07470f7db'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:08:32.388591 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d04ece61-2f4d-41c6-8c7e-6cb3561de067 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55cbd9baa3484ef492ba23f07470f7db'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:08:32.466654 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d04ece61-2f4d-41c6-8c7e-6cb3561de067 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55cbd9baa3484ef492ba23f07470f7db'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:08:32.474254 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d04ece61-2f4d-41c6-8c7e-6cb3561de067 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55cbd9baa3484ef492ba23f07470f7db'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:08:32.475597 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d04ece61-2f4d-41c6-8c7e-6cb3561de067 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55cbd9baa3484ef492ba23f07470f7db'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:08:32.485349 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4427/8826] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 22:08:32 2022] DELETE /identity/v3/users/55cbd9baa3484ef492ba23f07470f7db => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:08:32.725214 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c8959-2dc7-4de9-b3e6-1ce2b6bb75ea service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:08:32.741013 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c8959-2dc7-4de9-b3e6-1ce2b6bb75ea service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:08:32.796290 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf1bc9-005a-4f52-ab20-2b9811200457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:08:32.797963 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf1bc9-005a-4f52-ab20-2b9811200457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:08:32.797963 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf1bc9-005a-4f52-ab20-2b9811200457 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:08:32.797963 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf1bc9-005a-4f52-ab20-2b9811200457 admin admin] PATH_INFO: `/v3/projects/3f727643ff9b47fcab67ab5e3ef4db86` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:08:32.798990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf1bc9-005a-4f52-ab20-2b9811200457 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f727643ff9b47fcab67ab5e3ef4db86)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:08:32.800924 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf1bc9-005a-4f52-ab20-2b9811200457 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:08:32.911083 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7eaf1bc9-005a-4f52-ab20-2b9811200457 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f727643ff9b47fcab67ab5e3ef4db86', 'request_id': 'req-7eaf1bc9-005a-4f52-ab20-2b9811200457'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:08:32.916895 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7eaf1bc9-005a-4f52-ab20-2b9811200457 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f727643ff9b47fcab67ab5e3ef4db86', 'request_id': 'req-7eaf1bc9-005a-4f52-ab20-2b9811200457'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:08:32.922941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7eaf1bc9-005a-4f52-ab20-2b9811200457 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f727643ff9b47fcab67ab5e3ef4db86', 'request_id': 'req-7eaf1bc9-005a-4f52-ab20-2b9811200457'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:08:32.991332 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7eaf1bc9-005a-4f52-ab20-2b9811200457 admin admin] The token cache is being invalidate because project 3f727643ff9b47fcab67ab5e3ef4db86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 22:08:32.992138 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7eaf1bc9-005a-4f52-ab20-2b9811200457 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:08:32.992790 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-7eaf1bc9-005a-4f52-ab20-2b9811200457 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:08:32.994480 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4400/8827] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 22:08:32 2022] DELETE /identity/v3/projects/3f727643ff9b47fcab67ab5e3ef4db86 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:08:32.999514 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b740cd-85f0-4e2d-a4de-5eae5177c080 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:08:32.999807 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b740cd-85f0-4e2d-a4de-5eae5177c080 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:08:33.000088 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b740cd-85f0-4e2d-a4de-5eae5177c080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:08:33.018258 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-b5b740cd-85f0-4e2d-a4de-5eae5177c080 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:08:33.019467 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b5b740cd-85f0-4e2d-a4de-5eae5177c080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:08:33.077689 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4428/8828] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:08:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:08:33.085729 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6c800-d84d-40ae-a7ef-8a6aa2116493 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:08:33.086054 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6c800-d84d-40ae-a7ef-8a6aa2116493 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:08:33.086367 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6c800-d84d-40ae-a7ef-8a6aa2116493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:08:33.104948 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-e3a6c800-d84d-40ae-a7ef-8a6aa2116493 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:08:33.106187 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e3a6c800-d84d-40ae-a7ef-8a6aa2116493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:08:33.114367 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4401/8829] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:08:33.119428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b740cd-85f0-4e2d-a4de-5eae5177c080 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:08:33.129021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b740cd-85f0-4e2d-a4de-5eae5177c080 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:08:33.134061 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecef1af-77ef-4a84-94b8-b68af2690035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:08:33.134764 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecef1af-77ef-4a84-94b8-b68af2690035 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:08:33.139013 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecef1af-77ef-4a84-94b8-b68af2690035 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:08:33.139013 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecef1af-77ef-4a84-94b8-b68af2690035 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:08:33.139013 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecef1af-77ef-4a84-94b8-b68af2690035 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 22:08:33.139013 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecef1af-77ef-4a84-94b8-b68af2690035 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:08:33.139013 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecef1af-77ef-4a84-94b8-b68af2690035 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:08:33.149872 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4429/8830] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 22:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 22:08:33.154473 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6c800-d84d-40ae-a7ef-8a6aa2116493 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:08:33.164082 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6c800-d84d-40ae-a7ef-8a6aa2116493 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:08:33.169595 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7038c-8073-4a22-a72b-647714ae1042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:08:33.169595 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7038c-8073-4a22-a72b-647714ae1042 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:08:33.170003 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7038c-8073-4a22-a72b-647714ae1042 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:08:33.170281 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7038c-8073-4a22-a72b-647714ae1042 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:08:33.170973 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b7038c-8073-4a22-a72b-647714ae1042 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:08:33.172924 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b7038c-8073-4a22-a72b-647714ae1042 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:08:33.250787 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4402/8831] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 22:08:33 2022] POST /identity/v3/projects => generated 367 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 22:08:33.254975 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecef1af-77ef-4a84-94b8-b68af2690035 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:08:33.265433 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecef1af-77ef-4a84-94b8-b68af2690035 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:08:33.321289 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3af07-7df2-413f-99e6-a6067a90fb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:08:33.321995 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3af07-7df2-413f-99e6-a6067a90fb61 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:08:33.322278 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3af07-7df2-413f-99e6-a6067a90fb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:08:33.322553 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3af07-7df2-413f-99e6-a6067a90fb61 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:08:33.323245 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3af07-7df2-413f-99e6-a6067a90fb61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:08:33.325198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3af07-7df2-413f-99e6-a6067a90fb61 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:08:33.397526 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4430/8832] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 22:08:33 2022] POST /identity/v3/users => generated 284 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 22:08:33.402237 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7038c-8073-4a22-a72b-647714ae1042 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:08:33.412433 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7038c-8073-4a22-a72b-647714ae1042 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:08:33.417780 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d509c-3b33-43f0-babe-d5dcc7a11739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:08:33.418442 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d509c-3b33-43f0-babe-d5dcc7a11739 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:08:33.418729 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d509c-3b33-43f0-babe-d5dcc7a11739 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:08:33.419015 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d509c-3b33-43f0-babe-d5dcc7a11739 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:08:33.419729 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7d509c-3b33-43f0-babe-d5dcc7a11739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:08:33.421341 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7d509c-3b33-43f0-babe-d5dcc7a11739 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:08:33.431594 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4403/8833] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 22:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 22:08:33.435400 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3af07-7df2-413f-99e6-a6067a90fb61 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:08:33.445291 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3af07-7df2-413f-99e6-a6067a90fb61 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:08:33.449955 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d546b5-0d21-4347-b003-5ad448cb3871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:08:33.450599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d546b5-0d21-4347-b003-5ad448cb3871 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:08:33.450879 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d546b5-0d21-4347-b003-5ad448cb3871 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:08:33.451160 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d546b5-0d21-4347-b003-5ad448cb3871 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:08:33.451872 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d546b5-0d21-4347-b003-5ad448cb3871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:08:33.453460 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d546b5-0d21-4347-b003-5ad448cb3871 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:08:33.464232 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4431/8834] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 22:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 22:08:33.468177 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d509c-3b33-43f0-babe-d5dcc7a11739 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:08:33.478797 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d509c-3b33-43f0-babe-d5dcc7a11739 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:08:33.483374 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc952b-d283-439e-98e3-4aceae20a08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:08:33.488304 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc952b-d283-439e-98e3-4aceae20a08c admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:08:33.488304 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc952b-d283-439e-98e3-4aceae20a08c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:08:33.488304 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc952b-d283-439e-98e3-4aceae20a08c admin admin] PATH_INFO: `/v3/projects/fcb9ede3806446609c06128c4bb7b9da/users/d867d8e4d9a344abbc959c4adb989f0c/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:08:33.499226 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc952b-d283-439e-98e3-4aceae20a08c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcb9ede3806446609c06128c4bb7b9da, user_id=d867d8e4d9a344abbc959c4adb989f0c, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:08:33.502149 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc952b-d283-439e-98e3-4aceae20a08c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:08:33.563380 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4404/8835] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 22:08:33 2022] PUT /identity/v3/projects/fcb9ede3806446609c06128c4bb7b9da/users/d867d8e4d9a344abbc959c4adb989f0c/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:08:33.622853 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48ff4d-bf0d-47b7-a2f9-4c6a9979437c None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:08:33.623275 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48ff4d-bf0d-47b7-a2f9-4c6a9979437c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:08:33.623569 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48ff4d-bf0d-47b7-a2f9-4c6a9979437c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:08:33.651642 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-fb48ff4d-bf0d-47b7-a2f9-4c6a9979437c None None] MFA Rules not processed for user `d867d8e4d9a344abbc959c4adb989f0c`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:08:33.652854 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-fb48ff4d-bf0d-47b7-a2f9-4c6a9979437c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:08:33.714759 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4432/8836] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:08:33 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:08:33.724746 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc952b-d283-439e-98e3-4aceae20a08c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:08:33.726528 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f3dc952b-d283-439e-98e3-4aceae20a08c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:08:33.782915 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc952b-d283-439e-98e3-4aceae20a08c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:08:33.786520 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b62fb34-d32a-41f0-8d52-164c077721a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:08:33.787164 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62fb34-d32a-41f0-8d52-164c077721a2 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:08:33.787448 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62fb34-d32a-41f0-8d52-164c077721a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:08:33.787727 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62fb34-d32a-41f0-8d52-164c077721a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:08:33.795924 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b62fb34-d32a-41f0-8d52-164c077721a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:08:33.797359 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b62fb34-d32a-41f0-8d52-164c077721a2 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:08:33.807182 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4405/8837] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:08:33 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:08:51.708763 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48ff4d-bf0d-47b7-a2f9-4c6a9979437c None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:08:51.776397 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48ff4d-bf0d-47b7-a2f9-4c6a9979437c None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:08:51.780820 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381aa47-8df2-4062-af49-d5b313f9c598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:08:51.781707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381aa47-8df2-4062-af49-d5b313f9c598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:08:51.782042 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381aa47-8df2-4062-af49-d5b313f9c598 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:08:51.782316 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381aa47-8df2-4062-af49-d5b313f9c598 admin admin] PATH_INFO: `/v3/users/d867d8e4d9a344abbc959c4adb989f0c` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:08:51.783484 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d381aa47-8df2-4062-af49-d5b313f9c598 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d867d8e4d9a344abbc959c4adb989f0c)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:08:51.785399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d381aa47-8df2-4062-af49-d5b313f9c598 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:08:51.935777 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d381aa47-8df2-4062-af49-d5b313f9c598 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd867d8e4d9a344abbc959c4adb989f0c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:08:51.947697 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d381aa47-8df2-4062-af49-d5b313f9c598 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd867d8e4d9a344abbc959c4adb989f0c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:08:52.043127 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d381aa47-8df2-4062-af49-d5b313f9c598 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd867d8e4d9a344abbc959c4adb989f0c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:08:52.050845 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d381aa47-8df2-4062-af49-d5b313f9c598 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd867d8e4d9a344abbc959c4adb989f0c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:08:52.051481 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-d381aa47-8df2-4062-af49-d5b313f9c598 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd867d8e4d9a344abbc959c4adb989f0c'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:08:52.057837 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4433/8838] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 22:08:51 2022] DELETE /identity/v3/users/d867d8e4d9a344abbc959c4adb989f0c => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:08:52.062863 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f37f33-80ae-4e6d-abe4-516c372c84d9 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:08:52.063365 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f37f33-80ae-4e6d-abe4-516c372c84d9 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:08:52.063493 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f37f33-80ae-4e6d-abe4-516c372c84d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:08:52.080522 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-a3f37f33-80ae-4e6d-abe4-516c372c84d9 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:08:52.081704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a3f37f33-80ae-4e6d-abe4-516c372c84d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:08:52.138560 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4406/8839] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:08:52.148335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381aa47-8df2-4062-af49-d5b313f9c598 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:08:52.149866 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-d381aa47-8df2-4062-af49-d5b313f9c598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:08:52.206781 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381aa47-8df2-4062-af49-d5b313f9c598 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:08:52.210525 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ce713-2b89-4376-85fc-70764741b7d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:08:52.211162 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ce713-2b89-4376-85fc-70764741b7d3 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:08:52.211447 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ce713-2b89-4376-85fc-70764741b7d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:08:52.211722 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ce713-2b89-4376-85fc-70764741b7d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:08:52.220437 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ce713-2b89-4376-85fc-70764741b7d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:08:52.221902 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ce713-2b89-4376-85fc-70764741b7d3 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:08:52.231245 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4434/8840] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:08:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:08:52.467585 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f37f33-80ae-4e6d-abe4-516c372c84d9 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:08:52.469046 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a3f37f33-80ae-4e6d-abe4-516c372c84d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:08:52.481521 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f37f33-80ae-4e6d-abe4-516c372c84d9 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:08:52.486435 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc7692-8172-4596-8aed-06bbe09d31d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:08:52.487329 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc7692-8172-4596-8aed-06bbe09d31d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:08:52.487617 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc7692-8172-4596-8aed-06bbe09d31d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:08:52.487899 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc7692-8172-4596-8aed-06bbe09d31d8 admin admin] PATH_INFO: `/v3/projects/fcb9ede3806446609c06128c4bb7b9da` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:08:52.489113 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc7692-8172-4596-8aed-06bbe09d31d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcb9ede3806446609c06128c4bb7b9da)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:08:52.491714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc7692-8172-4596-8aed-06bbe09d31d8 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:08:52.620850 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ccbc7692-8172-4596-8aed-06bbe09d31d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcb9ede3806446609c06128c4bb7b9da', 'request_id': 'req-ccbc7692-8172-4596-8aed-06bbe09d31d8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:08:52.626166 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ccbc7692-8172-4596-8aed-06bbe09d31d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcb9ede3806446609c06128c4bb7b9da', 'request_id': 'req-ccbc7692-8172-4596-8aed-06bbe09d31d8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:08:52.632610 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ccbc7692-8172-4596-8aed-06bbe09d31d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcb9ede3806446609c06128c4bb7b9da', 'request_id': 'req-ccbc7692-8172-4596-8aed-06bbe09d31d8'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:08:52.717352 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ccbc7692-8172-4596-8aed-06bbe09d31d8 admin admin] The token cache is being invalidate because project fcb9ede3806446609c06128c4bb7b9da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 22:08:52.717682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ccbc7692-8172-4596-8aed-06bbe09d31d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:08:52.718307 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-ccbc7692-8172-4596-8aed-06bbe09d31d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:08:52.719935 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4407/8841] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 22:08:52 2022] DELETE /identity/v3/projects/fcb9ede3806446609c06128c4bb7b9da => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:08:52.725898 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffcb7dd-388e-4345-a6c8-536599d5da48 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:08:52.726393 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffcb7dd-388e-4345-a6c8-536599d5da48 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:08:52.732784 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffcb7dd-388e-4345-a6c8-536599d5da48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:08:52.744373 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-5ffcb7dd-388e-4345-a6c8-536599d5da48 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:08:52.745608 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5ffcb7dd-388e-4345-a6c8-536599d5da48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:08:52.804872 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4435/8842] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:08:52.813591 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450763f-8630-4ce4-912c-81c84cf30de2 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:08:52.814119 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450763f-8630-4ce4-912c-81c84cf30de2 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:08:52.814404 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450763f-8630-4ce4-912c-81c84cf30de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:08:52.832762 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-1450763f-8630-4ce4-912c-81c84cf30de2 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:08:52.834012 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1450763f-8630-4ce4-912c-81c84cf30de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:08:52.842841 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4408/8843] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:08:52.847313 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffcb7dd-388e-4345-a6c8-536599d5da48 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:08:52.857512 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffcb7dd-388e-4345-a6c8-536599d5da48 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:08:52.862087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ae5d6-2ac4-4260-85b1-8007196552ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:08:52.862737 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ae5d6-2ac4-4260-85b1-8007196552ad admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:08:52.863019 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ae5d6-2ac4-4260-85b1-8007196552ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:08:52.863295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ae5d6-2ac4-4260-85b1-8007196552ad admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:08:52.864006 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ae5d6-2ac4-4260-85b1-8007196552ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 22:08:52.864313 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ae5d6-2ac4-4260-85b1-8007196552ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:08:52.865943 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ae5d6-2ac4-4260-85b1-8007196552ad admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:08:52.877399 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4436/8844] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 22:08:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 22:08:52.881926 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1450763f-8630-4ce4-912c-81c84cf30de2 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:08:52.891130 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1450763f-8630-4ce4-912c-81c84cf30de2 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:08:52.895800 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e7fd8-5279-4d1e-a0c7-c1545124cc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:08:52.896448 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e7fd8-5279-4d1e-a0c7-c1545124cc19 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:08:52.896732 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e7fd8-5279-4d1e-a0c7-c1545124cc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:08:52.897559 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e7fd8-5279-4d1e-a0c7-c1545124cc19 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:08:52.898295 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6e7fd8-5279-4d1e-a0c7-c1545124cc19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:08:52.900220 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6e7fd8-5279-4d1e-a0c7-c1545124cc19 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:08:52.982246 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4409/8845] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 22:08:52 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 22:08:52.986333 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ae5d6-2ac4-4260-85b1-8007196552ad admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:08:52.996700 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ae5d6-2ac4-4260-85b1-8007196552ad admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:08:53.053259 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e868c-430a-497a-9dea-76fc21eadead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:08:53.053986 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e868c-430a-497a-9dea-76fc21eadead admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:08:53.054272 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e868c-430a-497a-9dea-76fc21eadead admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:08:53.054548 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e868c-430a-497a-9dea-76fc21eadead admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:08:53.055269 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e868c-430a-497a-9dea-76fc21eadead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:08:53.057295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e868c-430a-497a-9dea-76fc21eadead admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:08:53.162836 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4437/8846] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 22:08:52 2022] POST /identity/v3/users => generated 287 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 22:08:53.166683 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e7fd8-5279-4d1e-a0c7-c1545124cc19 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:08:53.177027 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e7fd8-5279-4d1e-a0c7-c1545124cc19 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:08:53.181702 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9cc54a-c1df-47d3-ace8-da793f1580dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:08:53.182429 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cc54a-c1df-47d3-ace8-da793f1580dd admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:08:53.182712 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cc54a-c1df-47d3-ace8-da793f1580dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:08:53.182986 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cc54a-c1df-47d3-ace8-da793f1580dd admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:08:53.183774 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9cc54a-c1df-47d3-ace8-da793f1580dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:08:53.185383 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9cc54a-c1df-47d3-ace8-da793f1580dd admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:08:53.196976 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4410/8847] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 22:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 22:08:53.200847 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e868c-430a-497a-9dea-76fc21eadead admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:08:53.211342 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e868c-430a-497a-9dea-76fc21eadead admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:08:53.215952 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce40f2a-d2d1-4c78-b90d-c1cbd72f2db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:08:53.216601 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce40f2a-d2d1-4c78-b90d-c1cbd72f2db8 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:08:53.216882 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce40f2a-d2d1-4c78-b90d-c1cbd72f2db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:08:53.217160 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce40f2a-d2d1-4c78-b90d-c1cbd72f2db8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:08:53.217905 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce40f2a-d2d1-4c78-b90d-c1cbd72f2db8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:08:53.219497 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce40f2a-d2d1-4c78-b90d-c1cbd72f2db8 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:08:53.229203 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4438/8848] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 22:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 22:08:53.233248 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9cc54a-c1df-47d3-ace8-da793f1580dd admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:08:53.243291 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9cc54a-c1df-47d3-ace8-da793f1580dd admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:08:53.248094 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c47722-9be9-4b56-a031-efd29e54e726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:08:53.248980 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c47722-9be9-4b56-a031-efd29e54e726 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:08:53.249261 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c47722-9be9-4b56-a031-efd29e54e726 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:08:53.249534 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c47722-9be9-4b56-a031-efd29e54e726 admin admin] PATH_INFO: `/v3/projects/f3e2b7962a9d406ca40fef323b6d61d4/users/99c2666ed5e84655bcaf32b7edadb538/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:08:53.265059 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c47722-9be9-4b56-a031-efd29e54e726 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3e2b7962a9d406ca40fef323b6d61d4, user_id=99c2666ed5e84655bcaf32b7edadb538, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:08:53.269266 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c47722-9be9-4b56-a031-efd29e54e726 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:08:53.351867 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4411/8849] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 22:08:53 2022] PUT /identity/v3/projects/f3e2b7962a9d406ca40fef323b6d61d4/users/99c2666ed5e84655bcaf32b7edadb538/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:08:53.361946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85704b45-58d7-4688-adc6-dbc95a5d079c None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:08:53.362213 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85704b45-58d7-4688-adc6-dbc95a5d079c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:08:53.362493 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85704b45-58d7-4688-adc6-dbc95a5d079c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:08:53.388992 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-85704b45-58d7-4688-adc6-dbc95a5d079c None None] MFA Rules not processed for user `99c2666ed5e84655bcaf32b7edadb538`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:08:53.390229 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-85704b45-58d7-4688-adc6-dbc95a5d079c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:08:53.452521 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4439/8850] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:08:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:08:53.462937 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c47722-9be9-4b56-a031-efd29e54e726 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:08:53.464619 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f6c47722-9be9-4b56-a031-efd29e54e726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:08:53.524957 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c47722-9be9-4b56-a031-efd29e54e726 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:08:53.528699 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5cdd9c-248c-44c1-a132-62bf6e06e1c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:08:53.529342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cdd9c-248c-44c1-a132-62bf6e06e1c5 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:08:53.529621 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cdd9c-248c-44c1-a132-62bf6e06e1c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:08:53.529929 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cdd9c-248c-44c1-a132-62bf6e06e1c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:08:53.538200 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5cdd9c-248c-44c1-a132-62bf6e06e1c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:08:53.539668 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5cdd9c-248c-44c1-a132-62bf6e06e1c5 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:08:53.548289 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4412/8851] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:08:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:08:59.169527 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85704b45-58d7-4688-adc6-dbc95a5d079c None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:08:59.232713 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85704b45-58d7-4688-adc6-dbc95a5d079c None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:08:59.237341 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa07a9-3d9d-4dc3-a4e9-3ccd909f5040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:08:59.238249 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa07a9-3d9d-4dc3-a4e9-3ccd909f5040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:08:59.238567 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa07a9-3d9d-4dc3-a4e9-3ccd909f5040 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:08:59.238855 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa07a9-3d9d-4dc3-a4e9-3ccd909f5040 admin admin] PATH_INFO: `/v3/users/99c2666ed5e84655bcaf32b7edadb538` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:08:59.240163 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aa07a9-3d9d-4dc3-a4e9-3ccd909f5040 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99c2666ed5e84655bcaf32b7edadb538)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:08:59.242828 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aa07a9-3d9d-4dc3-a4e9-3ccd909f5040 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:08:59.415295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-82aa07a9-3d9d-4dc3-a4e9-3ccd909f5040 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99c2666ed5e84655bcaf32b7edadb538'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:08:59.426638 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-82aa07a9-3d9d-4dc3-a4e9-3ccd909f5040 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99c2666ed5e84655bcaf32b7edadb538'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:08:59.499104 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-82aa07a9-3d9d-4dc3-a4e9-3ccd909f5040 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99c2666ed5e84655bcaf32b7edadb538'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:08:59.506369 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-82aa07a9-3d9d-4dc3-a4e9-3ccd909f5040 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99c2666ed5e84655bcaf32b7edadb538'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:08:59.508848 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-82aa07a9-3d9d-4dc3-a4e9-3ccd909f5040 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99c2666ed5e84655bcaf32b7edadb538'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:08:59.512886 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4440/8852] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 22:08:59 2022] DELETE /identity/v3/users/99c2666ed5e84655bcaf32b7edadb538 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:08:59.517693 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96320b-2071-4236-b53c-d5692fc14022 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:08:59.518233 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96320b-2071-4236-b53c-d5692fc14022 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:08:59.518358 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96320b-2071-4236-b53c-d5692fc14022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:08:59.543265 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-6d96320b-2071-4236-b53c-d5692fc14022 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:08:59.544633 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6d96320b-2071-4236-b53c-d5692fc14022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:08:59.604987 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4413/8853] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:08:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:08:59.614585 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa07a9-3d9d-4dc3-a4e9-3ccd909f5040 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:08:59.616117 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-82aa07a9-3d9d-4dc3-a4e9-3ccd909f5040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:08:59.673691 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa07a9-3d9d-4dc3-a4e9-3ccd909f5040 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:08:59.677278 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6a8a2-df1f-4cdf-bc89-cd6b58700ce4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:08:59.677986 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6a8a2-df1f-4cdf-bc89-cd6b58700ce4 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:08:59.678266 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6a8a2-df1f-4cdf-bc89-cd6b58700ce4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:08:59.678545 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6a8a2-df1f-4cdf-bc89-cd6b58700ce4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:08:59.687399 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6a8a2-df1f-4cdf-bc89-cd6b58700ce4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:08:59.688836 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6a8a2-df1f-4cdf-bc89-cd6b58700ce4 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:08:59.698180 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4441/8854] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:08:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:08:59.942053 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96320b-2071-4236-b53c-d5692fc14022 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:08:59.943970 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6d96320b-2071-4236-b53c-d5692fc14022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:08:59.956367 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96320b-2071-4236-b53c-d5692fc14022 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:08:59.961947 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8172a-25bb-487b-9f61-c2bec27649ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:08:59.963407 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8172a-25bb-487b-9f61-c2bec27649ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:08:59.963407 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8172a-25bb-487b-9f61-c2bec27649ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:08:59.963775 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8172a-25bb-487b-9f61-c2bec27649ed admin admin] PATH_INFO: `/v3/projects/f3e2b7962a9d406ca40fef323b6d61d4` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:08:59.964770 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c8172a-25bb-487b-9f61-c2bec27649ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3e2b7962a9d406ca40fef323b6d61d4)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:08:59.966775 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c8172a-25bb-487b-9f61-c2bec27649ed admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:09:00.059413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-36c8172a-25bb-487b-9f61-c2bec27649ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3e2b7962a9d406ca40fef323b6d61d4', 'request_id': 'req-36c8172a-25bb-487b-9f61-c2bec27649ed'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:09:00.064905 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-36c8172a-25bb-487b-9f61-c2bec27649ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3e2b7962a9d406ca40fef323b6d61d4', 'request_id': 'req-36c8172a-25bb-487b-9f61-c2bec27649ed'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:09:00.071507 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-36c8172a-25bb-487b-9f61-c2bec27649ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3e2b7962a9d406ca40fef323b6d61d4', 'request_id': 'req-36c8172a-25bb-487b-9f61-c2bec27649ed'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:09:00.128248 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-36c8172a-25bb-487b-9f61-c2bec27649ed admin admin] The token cache is being invalidate because project f3e2b7962a9d406ca40fef323b6d61d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 22:09:00.128533 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-36c8172a-25bb-487b-9f61-c2bec27649ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:09:00.129154 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-36c8172a-25bb-487b-9f61-c2bec27649ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:09:00.130832 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4414/8855] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 22:08:59 2022] DELETE /identity/v3/projects/f3e2b7962a9d406ca40fef323b6d61d4 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:09:00.137569 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595c96c-1d1c-43ff-aa5b-56b9644cec38 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:09:00.137900 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595c96c-1d1c-43ff-aa5b-56b9644cec38 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:09:00.138188 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595c96c-1d1c-43ff-aa5b-56b9644cec38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:09:00.156407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-6595c96c-1d1c-43ff-aa5b-56b9644cec38 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:09:00.157666 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6595c96c-1d1c-43ff-aa5b-56b9644cec38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:09:00.219569 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4442/8856] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:09:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:09:00.227330 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe9606-607d-48c7-bfe2-8babe7463d62 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:09:00.227621 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe9606-607d-48c7-bfe2-8babe7463d62 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:09:00.227902 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe9606-607d-48c7-bfe2-8babe7463d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:09:00.246597 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-04fe9606-607d-48c7-bfe2-8babe7463d62 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:09:00.247796 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-04fe9606-607d-48c7-bfe2-8babe7463d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:09:00.255685 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4415/8857] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:09:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:09:00.260826 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595c96c-1d1c-43ff-aa5b-56b9644cec38 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:09:00.270447 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595c96c-1d1c-43ff-aa5b-56b9644cec38 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:09:00.275158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7552ee-0a08-461a-9b63-4cf4880f13f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:09:00.275817 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7552ee-0a08-461a-9b63-4cf4880f13f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:09:00.276097 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7552ee-0a08-461a-9b63-4cf4880f13f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:09:00.276372 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7552ee-0a08-461a-9b63-4cf4880f13f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:09:00.277087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7552ee-0a08-461a-9b63-4cf4880f13f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 22:09:00.277394 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7552ee-0a08-461a-9b63-4cf4880f13f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:09:00.279033 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7552ee-0a08-461a-9b63-4cf4880f13f4 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:09:00.291360 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4443/8858] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 22:09:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 22:09:00.295130 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe9606-607d-48c7-bfe2-8babe7463d62 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:09:00.304817 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe9606-607d-48c7-bfe2-8babe7463d62 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:09:00.309431 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390575a0-ed89-4f54-a002-5b053cbde3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:09:00.310107 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390575a0-ed89-4f54-a002-5b053cbde3c7 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:09:00.310391 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390575a0-ed89-4f54-a002-5b053cbde3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:09:00.310664 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390575a0-ed89-4f54-a002-5b053cbde3c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:09:00.311399 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390575a0-ed89-4f54-a002-5b053cbde3c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:09:00.313318 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390575a0-ed89-4f54-a002-5b053cbde3c7 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:09:00.387372 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4416/8859] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 22:09:00 2022] POST /identity/v3/projects => generated 383 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 22:09:00.391408 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7552ee-0a08-461a-9b63-4cf4880f13f4 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:09:00.401354 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7552ee-0a08-461a-9b63-4cf4880f13f4 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:09:00.455794 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba8cb78-902d-472f-a3d0-23a573656e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:09:00.456457 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8cb78-902d-472f-a3d0-23a573656e6e admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:09:00.456766 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8cb78-902d-472f-a3d0-23a573656e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:09:00.457047 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8cb78-902d-472f-a3d0-23a573656e6e admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:09:00.457728 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba8cb78-902d-472f-a3d0-23a573656e6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:09:00.459681 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba8cb78-902d-472f-a3d0-23a573656e6e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:09:00.540053 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4444/8860] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 22:09:00 2022] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 22:09:00.544063 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390575a0-ed89-4f54-a002-5b053cbde3c7 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:09:00.555856 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390575a0-ed89-4f54-a002-5b053cbde3c7 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:09:00.560716 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef2375-fc68-405f-b52c-e43f871ab94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:09:00.561380 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef2375-fc68-405f-b52c-e43f871ab94f admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:09:00.561662 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef2375-fc68-405f-b52c-e43f871ab94f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:09:00.561975 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef2375-fc68-405f-b52c-e43f871ab94f admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:09:00.562693 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef2375-fc68-405f-b52c-e43f871ab94f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:09:00.564304 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef2375-fc68-405f-b52c-e43f871ab94f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:09:00.575732 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4417/8861] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 22:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 22:09:00.579871 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba8cb78-902d-472f-a3d0-23a573656e6e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:09:00.589731 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba8cb78-902d-472f-a3d0-23a573656e6e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:09:00.594355 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67648b4b-faa2-401c-b2ee-33b3005c9532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:09:00.595005 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67648b4b-faa2-401c-b2ee-33b3005c9532 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:09:00.595284 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67648b4b-faa2-401c-b2ee-33b3005c9532 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:09:00.595556 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67648b4b-faa2-401c-b2ee-33b3005c9532 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:09:00.596361 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67648b4b-faa2-401c-b2ee-33b3005c9532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:09:00.597976 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67648b4b-faa2-401c-b2ee-33b3005c9532 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:09:00.610371 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4445/8862] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 22:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 22:09:00.614529 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef2375-fc68-405f-b52c-e43f871ab94f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:09:00.625283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef2375-fc68-405f-b52c-e43f871ab94f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:09:00.630078 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfba191-cb51-4c1b-96b0-d244fdc91243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:09:00.631265 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfba191-cb51-4c1b-96b0-d244fdc91243 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:09:00.631554 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfba191-cb51-4c1b-96b0-d244fdc91243 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:09:00.631837 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfba191-cb51-4c1b-96b0-d244fdc91243 admin admin] PATH_INFO: `/v3/projects/29d93461dcdc458386181f7e31c7450b/users/722d6f7c30804cfda68ac3dc86a643c5/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:09:00.646412 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfba191-cb51-4c1b-96b0-d244fdc91243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29d93461dcdc458386181f7e31c7450b, user_id=722d6f7c30804cfda68ac3dc86a643c5, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:09:00.649109 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfba191-cb51-4c1b-96b0-d244fdc91243 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:09:00.716606 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4418/8863] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 22:09:00 2022] PUT /identity/v3/projects/29d93461dcdc458386181f7e31c7450b/users/722d6f7c30804cfda68ac3dc86a643c5/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 22:09:00.721735 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd661dc1-37bd-4076-ba64-57812b6f58d6 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:09:00.722043 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd661dc1-37bd-4076-ba64-57812b6f58d6 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:09:00.722319 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd661dc1-37bd-4076-ba64-57812b6f58d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:09:00.739832 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-fd661dc1-37bd-4076-ba64-57812b6f58d6 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:09:00.741610 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-fd661dc1-37bd-4076-ba64-57812b6f58d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:09:00.800038 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4446/8864] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:09:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 22:09:00.810453 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfba191-cb51-4c1b-96b0-d244fdc91243 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:09:00.812264 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-9bfba191-cb51-4c1b-96b0-d244fdc91243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:09:00.869223 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfba191-cb51-4c1b-96b0-d244fdc91243 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:09:00.872955 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7c18d-39ed-4162-9927-3046c4cd2bad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:09:00.873597 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7c18d-39ed-4162-9927-3046c4cd2bad service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:09:00.873914 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7c18d-39ed-4162-9927-3046c4cd2bad service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:09:00.874191 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7c18d-39ed-4162-9927-3046c4cd2bad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:09:00.883489 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7c18d-39ed-4162-9927-3046c4cd2bad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:09:00.884969 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7c18d-39ed-4162-9927-3046c4cd2bad service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:09:00.894381 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4419/8865] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:09:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:09:06.186310 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11dd4e-aa07-483b-ae2a-3b4b418f421c None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:09:06.186761 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11dd4e-aa07-483b-ae2a-3b4b418f421c None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:09:06.186899 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11dd4e-aa07-483b-ae2a-3b4b418f421c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:09:06.217939 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-7b11dd4e-aa07-483b-ae2a-3b4b418f421c None None] MFA Rules not processed for user `722d6f7c30804cfda68ac3dc86a643c5`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:09:06.219165 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7b11dd4e-aa07-483b-ae2a-3b4b418f421c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:09:06.290537 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4447/8866] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:09:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:09:06.295161 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7c18d-39ed-4162-9927-3046c4cd2bad service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:09:06.306067 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7c18d-39ed-4162-9927-3046c4cd2bad service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:09:06.311147 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488fdcf2-bb55-496c-a78f-c59238ad734c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:09:06.311920 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fdcf2-bb55-496c-a78f-c59238ad734c admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:09:06.312270 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fdcf2-bb55-496c-a78f-c59238ad734c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:09:06.312615 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fdcf2-bb55-496c-a78f-c59238ad734c admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:09:06.313323 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488fdcf2-bb55-496c-a78f-c59238ad734c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:09:06.317682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488fdcf2-bb55-496c-a78f-c59238ad734c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:09:06.406138 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4420/8867] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 22:09:06 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 22:09:06.410203 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11dd4e-aa07-483b-ae2a-3b4b418f421c None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:09:06.422087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11dd4e-aa07-483b-ae2a-3b4b418f421c None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:09:06.478046 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d6e30-5a37-4791-9b92-d18270309292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:09:06.479489 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d6e30-5a37-4791-9b92-d18270309292 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:09:06.479783 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d6e30-5a37-4791-9b92-d18270309292 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:09:06.480166 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d6e30-5a37-4791-9b92-d18270309292 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:09:06.480911 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8d6e30-5a37-4791-9b92-d18270309292 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:09:06.482928 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8d6e30-5a37-4791-9b92-d18270309292 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:09:06.592451 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4448/8868] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 22:09:06 2022] POST /identity/v3/users => generated 299 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 22:09:06.596707 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488fdcf2-bb55-496c-a78f-c59238ad734c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:09:06.607733 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488fdcf2-bb55-496c-a78f-c59238ad734c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:09:06.612996 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856be0d3-25ab-4dc2-8985-16f80a8e61fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:09:06.613651 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856be0d3-25ab-4dc2-8985-16f80a8e61fa admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:09:06.613974 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856be0d3-25ab-4dc2-8985-16f80a8e61fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:09:06.614313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856be0d3-25ab-4dc2-8985-16f80a8e61fa admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:09:06.615058 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856be0d3-25ab-4dc2-8985-16f80a8e61fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:09:06.616721 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856be0d3-25ab-4dc2-8985-16f80a8e61fa admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:09:06.627544 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4421/8869] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 22:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 22:09:06.632701 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d6e30-5a37-4791-9b92-d18270309292 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:09:06.642635 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d6e30-5a37-4791-9b92-d18270309292 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:09:06.648044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6941d4-451d-4556-b605-c24cd12fcd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:09:06.653000 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6941d4-451d-4556-b605-c24cd12fcd1c admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:09:06.653000 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6941d4-451d-4556-b605-c24cd12fcd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:09:06.653000 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6941d4-451d-4556-b605-c24cd12fcd1c admin admin] PATH_INFO: `/v3/projects/c19a5242ea654503aee1a715a284eaa1/users/c636f76ff6f347918908949ed914d796/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:09:06.664583 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6941d4-451d-4556-b605-c24cd12fcd1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c19a5242ea654503aee1a715a284eaa1, user_id=c636f76ff6f347918908949ed914d796, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:09:06.667198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6941d4-451d-4556-b605-c24cd12fcd1c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:09:06.751364 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4449/8870] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 22:09:06 2022] PUT /identity/v3/projects/c19a5242ea654503aee1a715a284eaa1/users/c636f76ff6f347918908949ed914d796/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 22:09:06.755142 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856be0d3-25ab-4dc2-8985-16f80a8e61fa admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:09:06.765466 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856be0d3-25ab-4dc2-8985-16f80a8e61fa admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:09:06.826943 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593723c2-e3b0-45d5-9115-20f08706dc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:09:06.827621 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593723c2-e3b0-45d5-9115-20f08706dc4a admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:09:06.828039 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593723c2-e3b0-45d5-9115-20f08706dc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:09:06.828186 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593723c2-e3b0-45d5-9115-20f08706dc4a admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:09:06.829011 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593723c2-e3b0-45d5-9115-20f08706dc4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:09:06.830562 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593723c2-e3b0-45d5-9115-20f08706dc4a admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:09:06.841343 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4422/8871] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 22:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 22:09:06.845698 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6941d4-451d-4556-b605-c24cd12fcd1c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:09:06.856606 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6941d4-451d-4556-b605-c24cd12fcd1c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:09:06.861466 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626fdbeb-46cd-46e5-994e-d036a4502511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:09:06.862374 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626fdbeb-46cd-46e5-994e-d036a4502511 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:09:06.862652 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626fdbeb-46cd-46e5-994e-d036a4502511 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:09:06.862924 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626fdbeb-46cd-46e5-994e-d036a4502511 admin admin] PATH_INFO: `/v3/projects/c19a5242ea654503aee1a715a284eaa1/users/c636f76ff6f347918908949ed914d796/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:09:06.865013 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626fdbeb-46cd-46e5-994e-d036a4502511 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c19a5242ea654503aee1a715a284eaa1, user_id=c636f76ff6f347918908949ed914d796, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:09:06.867806 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626fdbeb-46cd-46e5-994e-d036a4502511 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:09:06.878252 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4450/8872] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 22:09:06 2022] PUT /identity/v3/projects/c19a5242ea654503aee1a715a284eaa1/users/c636f76ff6f347918908949ed914d796/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:09:12.484938 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5c402-7456-4812-a1af-209b345ecce2 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:09:12.485501 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5c402-7456-4812-a1af-209b345ecce2 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:09:12.485501 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5c402-7456-4812-a1af-209b345ecce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:09:12.512525 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-abe5c402-7456-4812-a1af-209b345ecce2 None None] MFA Rules not processed for user `c636f76ff6f347918908949ed914d796`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:09:12.513841 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-abe5c402-7456-4812-a1af-209b345ecce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:09:12.583159 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4423/8873] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:09:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:09:12.603391 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaacaaf-11b9-47ff-a1e7-700eb07d94c2 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:09:12.603850 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaacaaf-11b9-47ff-a1e7-700eb07d94c2 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:09:12.604003 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaacaaf-11b9-47ff-a1e7-700eb07d94c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:09:12.653745 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-9aaacaaf-11b9-47ff-a1e7-700eb07d94c2 None None] MFA Rules not processed for user `e302b1298dd04d6590e3d079f7b13b29`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:09:12.655032 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9aaacaaf-11b9-47ff-a1e7-700eb07d94c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:09:12.714477 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4451/8874] 10.222.0.23 () {58 vars in 1059 bytes} [Sat Apr 30 22:09:12 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:09:12.720585 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5c402-7456-4812-a1af-209b345ecce2 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:09:12.729981 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5c402-7456-4812-a1af-209b345ecce2 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:09:12.733555 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7adcc19-bd93-40d7-a077-28239c6bd091 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e302b1298dd04d6590e3d079f7b13b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:09:12.734233 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7adcc19-bd93-40d7-a077-28239c6bd091 service glance] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:09:12.734518 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7adcc19-bd93-40d7-a077-28239c6bd091 service glance] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:09:12.734795 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7adcc19-bd93-40d7-a077-28239c6bd091 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:09:12.790300 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7adcc19-bd93-40d7-a077-28239c6bd091 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:09:12.791763 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7adcc19-bd93-40d7-a077-28239c6bd091 service glance] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:09:12.800634 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4424/8875] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:09:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:09:13.067718 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c09ab-2dff-4afa-a7ea-76443e021ee8 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:09:13.068012 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c09ab-2dff-4afa-a7ea-76443e021ee8 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:09:13.068916 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c09ab-2dff-4afa-a7ea-76443e021ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:09:13.125940 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-937c09ab-2dff-4afa-a7ea-76443e021ee8 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:09:13.125940 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-937c09ab-2dff-4afa-a7ea-76443e021ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:09:13.190330 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4452/8876] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 22:09:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:09:13.325807 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de50063-2231-4a76-b49b-a2a14872babd None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:09:13.326126 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de50063-2231-4a76-b49b-a2a14872babd None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:09:13.326405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de50063-2231-4a76-b49b-a2a14872babd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:09:13.374122 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-2de50063-2231-4a76-b49b-a2a14872babd None None] MFA Rules not processed for user `27edf527e36c4ee7a9065688f4bed942`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:09:13.375321 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2de50063-2231-4a76-b49b-a2a14872babd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:09:13.446909 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4425/8877] 10.222.0.23 () {58 vars in 1039 bytes} [Sat Apr 30 22:09:13 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:09:13.453384 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c09ab-2dff-4afa-a7ea-76443e021ee8 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:09:13.466657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c09ab-2dff-4afa-a7ea-76443e021ee8 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:09:13.471997 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e040d7-9576-49fb-870b-072336d3fd18 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:09:13.472814 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e040d7-9576-49fb-870b-072336d3fd18 service swift] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:09:13.473108 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e040d7-9576-49fb-870b-072336d3fd18 service swift] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:09:13.473523 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e040d7-9576-49fb-870b-072336d3fd18 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:09:13.493573 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e040d7-9576-49fb-870b-072336d3fd18 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:09:13.495278 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e040d7-9576-49fb-870b-072336d3fd18 service swift] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:09:13.505612 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4453/8878] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 22:09:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 22:09:23.499464 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a3017-6949-4874-9bc7-69754f2c422f None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:09:23.500100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a3017-6949-4874-9bc7-69754f2c422f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:09:23.500100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a3017-6949-4874-9bc7-69754f2c422f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:09:23.518173 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-d54a3017-6949-4874-9bc7-69754f2c422f None None] MFA Rules not processed for user `722d6f7c30804cfda68ac3dc86a643c5`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:09:23.519405 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d54a3017-6949-4874-9bc7-69754f2c422f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:09:23.526414 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4426/8879] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:09:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:09:23.768978 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822c6b7-47d4-48ac-9fc0-fa2f329f14bf None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:09:23.769549 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822c6b7-47d4-48ac-9fc0-fa2f329f14bf None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:09:23.769549 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822c6b7-47d4-48ac-9fc0-fa2f329f14bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:09:23.805264 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-4822c6b7-47d4-48ac-9fc0-fa2f329f14bf None None] MFA Rules not processed for user `0b0cb145b72a492ebb8c0e9223be47a1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:09:23.806564 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4822c6b7-47d4-48ac-9fc0-fa2f329f14bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:09:23.856102 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4454/8880] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 22:09:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:09:23.868128 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a3017-6949-4874-9bc7-69754f2c422f None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:09:23.877657 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a3017-6949-4874-9bc7-69754f2c422f None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:09:23.881517 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fe298-a3b9-42e5-bb81-ee5194ad4699 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:09:23.882262 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fe298-a3b9-42e5-bb81-ee5194ad4699 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:09:23.882551 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fe298-a3b9-42e5-bb81-ee5194ad4699 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:09:23.882832 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fe298-a3b9-42e5-bb81-ee5194ad4699 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:09:23.889810 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320fe298-a3b9-42e5-bb81-ee5194ad4699 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:09:23.891265 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320fe298-a3b9-42e5-bb81-ee5194ad4699 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:09:23.899537 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4427/8881] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:09:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:09:24.311245 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822c6b7-47d4-48ac-9fc0-fa2f329f14bf None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:09:24.312707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4822c6b7-47d4-48ac-9fc0-fa2f329f14bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:09:24.383442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822c6b7-47d4-48ac-9fc0-fa2f329f14bf None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:09:24.388744 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa73a57-fc5a-48ee-9cef-647712cf0970 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:09:24.389384 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa73a57-fc5a-48ee-9cef-647712cf0970 service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:09:24.389665 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa73a57-fc5a-48ee-9cef-647712cf0970 service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:09:24.389974 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa73a57-fc5a-48ee-9cef-647712cf0970 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:09:24.391710 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7fa73a57-fc5a-48ee-9cef-647712cf0970 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:09:24.403255 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa73a57-fc5a-48ee-9cef-647712cf0970 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:09:24.404833 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa73a57-fc5a-48ee-9cef-647712cf0970 service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:09:24.415312 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4455/8882] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:09:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:09:26.959473 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f651c-ca27-44a5-a741-d58481f59079 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:09:26.960004 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f651c-ca27-44a5-a741-d58481f59079 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:09:26.960109 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f651c-ca27-44a5-a741-d58481f59079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:09:26.977814 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-c76f651c-ca27-44a5-a741-d58481f59079 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:09:26.979080 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c76f651c-ca27-44a5-a741-d58481f59079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:09:26.986303 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4428/8883] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 22:09:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:09:26.998482 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa73a57-fc5a-48ee-9cef-647712cf0970 service placement] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:09:27.010490 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa73a57-fc5a-48ee-9cef-647712cf0970 service placement] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:09:27.015418 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957dcd96-59f2-469c-aeb8-731e1606c259 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:09:27.016108 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957dcd96-59f2-469c-aeb8-731e1606c259 service swift] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:09:27.016405 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957dcd96-59f2-469c-aeb8-731e1606c259 service swift] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:09:27.016690 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957dcd96-59f2-469c-aeb8-731e1606c259 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:09:27.025492 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957dcd96-59f2-469c-aeb8-731e1606c259 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:09:27.027134 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957dcd96-59f2-469c-aeb8-731e1606c259 service swift] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:09:27.035142 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4456/8884] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 22:09:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 30 22:09:35.047375 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f98b18-5ecf-4071-9aa3-a81269d759aa None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:09:35.047955 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f98b18-5ecf-4071-9aa3-a81269d759aa None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:09:35.047955 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f98b18-5ecf-4071-9aa3-a81269d759aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:09:35.066123 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-85f98b18-5ecf-4071-9aa3-a81269d759aa None None] MFA Rules not processed for user `0b0cb145b72a492ebb8c0e9223be47a1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:09:35.067382 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-85f98b18-5ecf-4071-9aa3-a81269d759aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:09:35.074408 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4429/8885] 10.222.0.20 () {58 vars in 1015 bytes} [Sat Apr 30 22:09:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:09:35.087810 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957dcd96-59f2-469c-aeb8-731e1606c259 service swift] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:09:35.097215 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957dcd96-59f2-469c-aeb8-731e1606c259 service swift] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:09:35.100865 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642bb05-82f6-4fd6-b69a-28c4d65f20e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:09:35.101501 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642bb05-82f6-4fd6-b69a-28c4d65f20e9 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:09:35.101801 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642bb05-82f6-4fd6-b69a-28c4d65f20e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:09:35.102077 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642bb05-82f6-4fd6-b69a-28c4d65f20e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:09:35.109353 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642bb05-82f6-4fd6-b69a-28c4d65f20e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:09:35.110865 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642bb05-82f6-4fd6-b69a-28c4d65f20e9 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:09:35.118915 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4457/8886] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:09:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:09:35.839745 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044030ab-a415-4af1-b107-0cd4f72e3de5 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:09:35.840047 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044030ab-a415-4af1-b107-0cd4f72e3de5 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:09:35.840322 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044030ab-a415-4af1-b107-0cd4f72e3de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:09:35.860468 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-044030ab-a415-4af1-b107-0cd4f72e3de5 None None] MFA Rules not processed for user `fca4ee1f64c8489ebe7296f9f8f0ab41`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:09:35.861714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-044030ab-a415-4af1-b107-0cd4f72e3de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:09:35.958131 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4430/8887] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Apr 30 22:09:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:09:35.996726 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642bb05-82f6-4fd6-b69a-28c4d65f20e9 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:09:35.998201 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2642bb05-82f6-4fd6-b69a-28c4d65f20e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:09:36.021034 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642bb05-82f6-4fd6-b69a-28c4d65f20e9 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:09:36.027458 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15363891-92a4-40bd-9088-666502a736cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:09:36.028252 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15363891-92a4-40bd-9088-666502a736cf service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:09:36.028609 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15363891-92a4-40bd-9088-666502a736cf service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:09:36.029999 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15363891-92a4-40bd-9088-666502a736cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:09:36.040802 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15363891-92a4-40bd-9088-666502a736cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:09:36.046476 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15363891-92a4-40bd-9088-666502a736cf service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:09:36.058401 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4458/8888] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:09:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:09:41.267592 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db6e26-e9e3-430b-8988-d88458ffc678 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:09:41.268138 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db6e26-e9e3-430b-8988-d88458ffc678 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:09:41.268245 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db6e26-e9e3-430b-8988-d88458ffc678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:09:41.288503 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-d6db6e26-e9e3-430b-8988-d88458ffc678 None None] MFA Rules not processed for user `fca4ee1f64c8489ebe7296f9f8f0ab41`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:09:41.290314 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d6db6e26-e9e3-430b-8988-d88458ffc678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:09:41.299970 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4431/8889] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Apr 30 22:09:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:09:41.312920 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15363891-92a4-40bd-9088-666502a736cf service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:09:41.324594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15363891-92a4-40bd-9088-666502a736cf service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:09:41.330241 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfa250-9bcd-41e8-ae8a-8b5972da96e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:09:41.330882 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfa250-9bcd-41e8-ae8a-8b5972da96e3 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:09:41.331172 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfa250-9bcd-41e8-ae8a-8b5972da96e3 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:09:41.331450 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfa250-9bcd-41e8-ae8a-8b5972da96e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:09:41.341074 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcfa250-9bcd-41e8-ae8a-8b5972da96e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:09:41.342701 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcfa250-9bcd-41e8-ae8a-8b5972da96e3 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:09:41.353560 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4459/8890] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:09:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:09:49.666760 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db6e26-e9e3-430b-8988-d88458ffc678 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:09:49.675998 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db6e26-e9e3-430b-8988-d88458ffc678 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:09:49.679711 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064faa78-6d0e-4e4a-a853-0b22932b7335 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:09:49.681019 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064faa78-6d0e-4e4a-a853-0b22932b7335 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:09:49.681305 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064faa78-6d0e-4e4a-a853-0b22932b7335 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:09:49.681600 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064faa78-6d0e-4e4a-a853-0b22932b7335 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:09:49.690602 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064faa78-6d0e-4e4a-a853-0b22932b7335 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:09:49.692043 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064faa78-6d0e-4e4a-a853-0b22932b7335 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:09:49.702008 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4432/8891] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:09:49 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:10:53.563371 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfa250-9bcd-41e8-ae8a-8b5972da96e3 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:10:53.575304 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfa250-9bcd-41e8-ae8a-8b5972da96e3 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:10:53.580332 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257a3e9-04c1-43dc-8759-0765abf9f1d2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:10:53.581004 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257a3e9-04c1-43dc-8759-0765abf9f1d2 service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:10:53.581285 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257a3e9-04c1-43dc-8759-0765abf9f1d2 service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:10:53.581558 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9257a3e9-04c1-43dc-8759-0765abf9f1d2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:10:53.583368 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9257a3e9-04c1-43dc-8759-0765abf9f1d2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:10:53.594740 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9257a3e9-04c1-43dc-8759-0765abf9f1d2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:10:53.596321 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9257a3e9-04c1-43dc-8759-0765abf9f1d2 service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:10:53.606040 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4460/8892] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:10:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:10:57.733495 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f69155-6526-42cc-826b-d5ca3ac2bdd9 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:10:57.734035 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f69155-6526-42cc-826b-d5ca3ac2bdd9 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:10:57.734150 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f69155-6526-42cc-826b-d5ca3ac2bdd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:10:57.751955 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-e3f69155-6526-42cc-826b-d5ca3ac2bdd9 None None] MFA Rules not processed for user `4ad3f89b7037413a83c7905cef263b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:10:57.753150 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e3f69155-6526-42cc-826b-d5ca3ac2bdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:10:57.762483 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4433/8893] 10.222.0.23 () {58 vars in 1057 bytes} [Sat Apr 30 22:10:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:10:57.768466 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257a3e9-04c1-43dc-8759-0765abf9f1d2 service placement] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:10:57.779274 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9257a3e9-04c1-43dc-8759-0765abf9f1d2 service placement] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:10:57.784288 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f44a93-ad39-4345-9f0a-d2657d562d7c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:10:57.784919 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f44a93-ad39-4345-9f0a-d2657d562d7c service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:10:57.785515 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f44a93-ad39-4345-9f0a-d2657d562d7c service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:10:57.785830 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f44a93-ad39-4345-9f0a-d2657d562d7c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:10:57.787577 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-03f44a93-ad39-4345-9f0a-d2657d562d7c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:10:57.798528 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f44a93-ad39-4345-9f0a-d2657d562d7c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:10:57.800106 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f44a93-ad39-4345-9f0a-d2657d562d7c service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:10:57.809731 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4461/8894] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:10:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:11:15.490100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c402b-aa53-44d8-ae70-6e2506a9f691 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:11:15.492500 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c402b-aa53-44d8-ae70-6e2506a9f691 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:11:15.492500 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c402b-aa53-44d8-ae70-6e2506a9f691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:11:15.517974 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-a42c402b-aa53-44d8-ae70-6e2506a9f691 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:11:15.519682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a42c402b-aa53-44d8-ae70-6e2506a9f691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:11:15.551506 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4434/8895] 10.222.0.23 () {58 vars in 967 bytes} [Sat Apr 30 22:11:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:11:15.591721 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f44a93-ad39-4345-9f0a-d2657d562d7c service placement] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:11:15.641021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f44a93-ad39-4345-9f0a-d2657d562d7c service placement] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:11:15.646773 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd8271-0014-4833-a7a0-d6ba13c3bd1c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:11:15.647421 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd8271-0014-4833-a7a0-d6ba13c3bd1c service swift] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:11:15.647709 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd8271-0014-4833-a7a0-d6ba13c3bd1c service swift] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:11:15.647986 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd8271-0014-4833-a7a0-d6ba13c3bd1c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:11:15.656230 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd8271-0014-4833-a7a0-d6ba13c3bd1c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:11:15.657857 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd8271-0014-4833-a7a0-d6ba13c3bd1c service swift] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:11:15.665884 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4462/8896] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 22:11:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 22:11:24.016986 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c402b-aa53-44d8-ae70-6e2506a9f691 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:11:24.079378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c402b-aa53-44d8-ae70-6e2506a9f691 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:11:24.084429 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48467617-faa6-4a70-bd31-b772550ebc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:11:24.085322 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48467617-faa6-4a70-bd31-b772550ebc61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:11:24.085570 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48467617-faa6-4a70-bd31-b772550ebc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:11:24.085900 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48467617-faa6-4a70-bd31-b772550ebc61 admin admin] PATH_INFO: `/v3/users/722d6f7c30804cfda68ac3dc86a643c5` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:11:24.087101 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48467617-faa6-4a70-bd31-b772550ebc61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=722d6f7c30804cfda68ac3dc86a643c5)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:11:24.089130 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48467617-faa6-4a70-bd31-b772550ebc61 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:11:24.252304 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-48467617-faa6-4a70-bd31-b772550ebc61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '722d6f7c30804cfda68ac3dc86a643c5'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:11:24.264284 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-48467617-faa6-4a70-bd31-b772550ebc61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '722d6f7c30804cfda68ac3dc86a643c5'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:11:24.348582 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-48467617-faa6-4a70-bd31-b772550ebc61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '722d6f7c30804cfda68ac3dc86a643c5'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:11:24.349211 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-48467617-faa6-4a70-bd31-b772550ebc61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '722d6f7c30804cfda68ac3dc86a643c5'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:11:24.356611 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-48467617-faa6-4a70-bd31-b772550ebc61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '722d6f7c30804cfda68ac3dc86a643c5'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:11:24.362777 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4435/8897] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 22:11:24 2022] DELETE /identity/v3/users/722d6f7c30804cfda68ac3dc86a643c5 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:11:24.620344 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd8271-0014-4833-a7a0-d6ba13c3bd1c service swift] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:11:24.632247 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd8271-0014-4833-a7a0-d6ba13c3bd1c service swift] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:11:24.687448 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2966ffd-1aab-4f94-b7f6-8d22f8d139c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:11:24.688304 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2966ffd-1aab-4f94-b7f6-8d22f8d139c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:11:24.688586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2966ffd-1aab-4f94-b7f6-8d22f8d139c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:11:24.688863 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2966ffd-1aab-4f94-b7f6-8d22f8d139c9 admin admin] PATH_INFO: `/v3/projects/29d93461dcdc458386181f7e31c7450b` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:11:24.690065 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2966ffd-1aab-4f94-b7f6-8d22f8d139c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29d93461dcdc458386181f7e31c7450b)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:11:24.692011 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2966ffd-1aab-4f94-b7f6-8d22f8d139c9 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:11:24.789503 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e2966ffd-1aab-4f94-b7f6-8d22f8d139c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29d93461dcdc458386181f7e31c7450b', 'request_id': 'req-e2966ffd-1aab-4f94-b7f6-8d22f8d139c9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:11:24.794963 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e2966ffd-1aab-4f94-b7f6-8d22f8d139c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29d93461dcdc458386181f7e31c7450b', 'request_id': 'req-e2966ffd-1aab-4f94-b7f6-8d22f8d139c9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:11:24.801591 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e2966ffd-1aab-4f94-b7f6-8d22f8d139c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29d93461dcdc458386181f7e31c7450b', 'request_id': 'req-e2966ffd-1aab-4f94-b7f6-8d22f8d139c9'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:11:24.874653 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e2966ffd-1aab-4f94-b7f6-8d22f8d139c9 admin admin] The token cache is being invalidate because project 29d93461dcdc458386181f7e31c7450b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 22:11:24.874856 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e2966ffd-1aab-4f94-b7f6-8d22f8d139c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:11:24.875484 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-e2966ffd-1aab-4f94-b7f6-8d22f8d139c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:11:24.877017 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4463/8898] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 22:11:24 2022] DELETE /identity/v3/projects/29d93461dcdc458386181f7e31c7450b => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:11:24.881238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48467617-faa6-4a70-bd31-b772550ebc61 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:11:24.882633 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-48467617-faa6-4a70-bd31-b772550ebc61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:11:24.895448 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48467617-faa6-4a70-bd31-b772550ebc61 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:11:24.950190 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a9745-2099-4c2a-88e4-32e97296221b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:11:24.951052 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a9745-2099-4c2a-88e4-32e97296221b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:11:24.951337 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a9745-2099-4c2a-88e4-32e97296221b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:11:24.951612 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a9745-2099-4c2a-88e4-32e97296221b admin admin] PATH_INFO: `/v3/users/c636f76ff6f347918908949ed914d796` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:11:24.952800 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a9745-2099-4c2a-88e4-32e97296221b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c636f76ff6f347918908949ed914d796)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:11:24.954760 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a9745-2099-4c2a-88e4-32e97296221b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:11:25.111416 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-889a9745-2099-4c2a-88e4-32e97296221b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c636f76ff6f347918908949ed914d796'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:11:25.122926 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-889a9745-2099-4c2a-88e4-32e97296221b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c636f76ff6f347918908949ed914d796'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:11:25.201400 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-889a9745-2099-4c2a-88e4-32e97296221b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c636f76ff6f347918908949ed914d796'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:11:25.202052 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-889a9745-2099-4c2a-88e4-32e97296221b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c636f76ff6f347918908949ed914d796'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:11:25.210731 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-889a9745-2099-4c2a-88e4-32e97296221b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c636f76ff6f347918908949ed914d796'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:11:25.216216 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4436/8899] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 22:11:24 2022] DELETE /identity/v3/users/c636f76ff6f347918908949ed914d796 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:11:25.465377 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2966ffd-1aab-4f94-b7f6-8d22f8d139c9 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:11:25.466911 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e2966ffd-1aab-4f94-b7f6-8d22f8d139c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:11:25.483014 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2966ffd-1aab-4f94-b7f6-8d22f8d139c9 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:11:25.540458 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e1a16-1e67-4eae-948f-86075cd18431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:11:25.541303 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e1a16-1e67-4eae-948f-86075cd18431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:11:25.541586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e1a16-1e67-4eae-948f-86075cd18431 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:11:25.541890 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e1a16-1e67-4eae-948f-86075cd18431 admin admin] PATH_INFO: `/v3/projects/c19a5242ea654503aee1a715a284eaa1` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:11:25.543054 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e1a16-1e67-4eae-948f-86075cd18431 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c19a5242ea654503aee1a715a284eaa1)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:11:25.544969 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e1a16-1e67-4eae-948f-86075cd18431 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:11:25.624079 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7a8e1a16-1e67-4eae-948f-86075cd18431 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c19a5242ea654503aee1a715a284eaa1', 'request_id': 'req-7a8e1a16-1e67-4eae-948f-86075cd18431'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:11:25.635705 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7a8e1a16-1e67-4eae-948f-86075cd18431 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c19a5242ea654503aee1a715a284eaa1', 'request_id': 'req-7a8e1a16-1e67-4eae-948f-86075cd18431'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:11:25.642090 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7a8e1a16-1e67-4eae-948f-86075cd18431 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c19a5242ea654503aee1a715a284eaa1', 'request_id': 'req-7a8e1a16-1e67-4eae-948f-86075cd18431'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:11:25.708295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7a8e1a16-1e67-4eae-948f-86075cd18431 admin admin] The token cache is being invalidate because project c19a5242ea654503aee1a715a284eaa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 22:11:25.708520 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7a8e1a16-1e67-4eae-948f-86075cd18431 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:11:25.709136 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-7a8e1a16-1e67-4eae-948f-86075cd18431 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:11:25.710790 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4464/8900] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 22:11:25 2022] DELETE /identity/v3/projects/c19a5242ea654503aee1a715a284eaa1 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:11:25.716032 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edfcb43-685f-4f85-8d79-690fe33a6709 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:11:25.716310 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edfcb43-685f-4f85-8d79-690fe33a6709 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:11:25.716599 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edfcb43-685f-4f85-8d79-690fe33a6709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:11:25.734947 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-7edfcb43-685f-4f85-8d79-690fe33a6709 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:11:25.736177 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7edfcb43-685f-4f85-8d79-690fe33a6709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:11:25.794017 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4437/8901] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:11:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:11:25.802301 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639d689-2a21-4dbd-b0ef-e0bdc9d48960 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:11:25.802594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639d689-2a21-4dbd-b0ef-e0bdc9d48960 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:11:25.802875 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639d689-2a21-4dbd-b0ef-e0bdc9d48960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:11:25.821646 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-b639d689-2a21-4dbd-b0ef-e0bdc9d48960 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:11:25.822897 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-b639d689-2a21-4dbd-b0ef-e0bdc9d48960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:11:25.830881 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4465/8902] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:11:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:11:25.834993 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edfcb43-685f-4f85-8d79-690fe33a6709 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:11:25.844463 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edfcb43-685f-4f85-8d79-690fe33a6709 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:11:25.848999 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0e4ea-364c-408c-9328-0acd6068b109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:11:25.849651 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0e4ea-364c-408c-9328-0acd6068b109 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:11:25.849964 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0e4ea-364c-408c-9328-0acd6068b109 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:11:25.850245 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0e4ea-364c-408c-9328-0acd6068b109 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:11:25.850968 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0e4ea-364c-408c-9328-0acd6068b109 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 22:11:25.851281 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0e4ea-364c-408c-9328-0acd6068b109 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:11:25.852889 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0e4ea-364c-408c-9328-0acd6068b109 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:11:25.864802 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4438/8903] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 22:11:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 22:11:25.869003 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639d689-2a21-4dbd-b0ef-e0bdc9d48960 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:11:25.879022 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639d689-2a21-4dbd-b0ef-e0bdc9d48960 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:11:25.883713 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745d1c2-1da6-48f2-a19a-5fb542598f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:11:25.884358 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745d1c2-1da6-48f2-a19a-5fb542598f9d admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:11:25.884641 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745d1c2-1da6-48f2-a19a-5fb542598f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:11:25.884920 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745d1c2-1da6-48f2-a19a-5fb542598f9d admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:11:25.885610 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745d1c2-1da6-48f2-a19a-5fb542598f9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:11:25.887561 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745d1c2-1da6-48f2-a19a-5fb542598f9d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:11:25.996366 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4466/8904] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 22:11:25 2022] POST /identity/v3/projects => generated 391 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 22:11:26.000510 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0e4ea-364c-408c-9328-0acd6068b109 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:11:26.011288 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0e4ea-364c-408c-9328-0acd6068b109 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:11:26.065335 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bbd3a1-e4a9-40a3-9fa6-d839f153d574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:11:26.066668 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbd3a1-e4a9-40a3-9fa6-d839f153d574 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:11:26.066951 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbd3a1-e4a9-40a3-9fa6-d839f153d574 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:11:26.067230 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbd3a1-e4a9-40a3-9fa6-d839f153d574 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:11:26.067901 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bbd3a1-e4a9-40a3-9fa6-d839f153d574 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:11:26.069939 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bbd3a1-e4a9-40a3-9fa6-d839f153d574 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:11:26.172419 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4439/8905] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 22:11:25 2022] POST /identity/v3/users => generated 296 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 22:11:26.177225 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745d1c2-1da6-48f2-a19a-5fb542598f9d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:11:26.187919 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745d1c2-1da6-48f2-a19a-5fb542598f9d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:11:26.192707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163210c-0c39-4aeb-bf2b-b33034179f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:11:26.193362 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163210c-0c39-4aeb-bf2b-b33034179f4b admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:11:26.193646 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163210c-0c39-4aeb-bf2b-b33034179f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:11:26.194058 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163210c-0c39-4aeb-bf2b-b33034179f4b admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:11:26.194681 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7163210c-0c39-4aeb-bf2b-b33034179f4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:11:26.196351 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7163210c-0c39-4aeb-bf2b-b33034179f4b admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:11:26.206221 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4467/8906] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 22:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 22:11:26.210264 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bbd3a1-e4a9-40a3-9fa6-d839f153d574 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:11:26.220100 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bbd3a1-e4a9-40a3-9fa6-d839f153d574 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:11:26.225153 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479ecf9-96d2-4015-bff0-2c759dc08d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:11:26.225834 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479ecf9-96d2-4015-bff0-2c759dc08d8b admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:11:26.226122 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479ecf9-96d2-4015-bff0-2c759dc08d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:11:26.226402 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479ecf9-96d2-4015-bff0-2c759dc08d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:11:26.227122 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479ecf9-96d2-4015-bff0-2c759dc08d8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:11:26.228733 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479ecf9-96d2-4015-bff0-2c759dc08d8b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:11:26.239146 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4440/8907] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 22:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 22:11:26.243208 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163210c-0c39-4aeb-bf2b-b33034179f4b admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:11:26.253426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163210c-0c39-4aeb-bf2b-b33034179f4b admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:11:26.258096 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784788cf-d240-4662-a918-9de341b9ec7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:11:26.259023 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784788cf-d240-4662-a918-9de341b9ec7d admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:11:26.259328 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784788cf-d240-4662-a918-9de341b9ec7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:11:26.259601 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784788cf-d240-4662-a918-9de341b9ec7d admin admin] PATH_INFO: `/v3/projects/8f25dc6783c0491a86c2170aed9e0817/users/55661e0ba64a400a8449a280f2ac5236/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:11:26.274034 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784788cf-d240-4662-a918-9de341b9ec7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f25dc6783c0491a86c2170aed9e0817, user_id=55661e0ba64a400a8449a280f2ac5236, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:11:26.276713 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784788cf-d240-4662-a918-9de341b9ec7d admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:11:26.395733 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4468/8908] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 22:11:26 2022] PUT /identity/v3/projects/8f25dc6783c0491a86c2170aed9e0817/users/55661e0ba64a400a8449a280f2ac5236/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:11:26.406627 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b07fb-e518-4c5d-93c3-9e71584fea42 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:11:26.406918 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b07fb-e518-4c5d-93c3-9e71584fea42 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:11:26.407199 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b07fb-e518-4c5d-93c3-9e71584fea42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:11:26.434543 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-ee2b07fb-e518-4c5d-93c3-9e71584fea42 None None] MFA Rules not processed for user `55661e0ba64a400a8449a280f2ac5236`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:11:26.435784 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ee2b07fb-e518-4c5d-93c3-9e71584fea42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:11:26.499384 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4441/8909] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:11:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 22:11:26.504262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784788cf-d240-4662-a918-9de341b9ec7d admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:11:26.564198 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784788cf-d240-4662-a918-9de341b9ec7d admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:11:26.569136 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172970a-6c73-4a41-aec8-cb4593d477be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:11:26.569817 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172970a-6c73-4a41-aec8-cb4593d477be admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:11:26.570102 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172970a-6c73-4a41-aec8-cb4593d477be admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:11:26.570408 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172970a-6c73-4a41-aec8-cb4593d477be admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:11:26.571133 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172970a-6c73-4a41-aec8-cb4593d477be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:11:26.573096 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172970a-6c73-4a41-aec8-cb4593d477be admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:11:26.710194 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4469/8910] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 22:11:26 2022] POST /identity/v3/projects => generated 393 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 22:11:26.714378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b07fb-e518-4c5d-93c3-9e71584fea42 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:11:26.725825 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b07fb-e518-4c5d-93c3-9e71584fea42 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:11:26.780119 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52007989-5cb4-4b0a-b569-8287c4b118a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:11:26.780713 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52007989-5cb4-4b0a-b569-8287c4b118a0 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:11:26.780993 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52007989-5cb4-4b0a-b569-8287c4b118a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:11:26.781267 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52007989-5cb4-4b0a-b569-8287c4b118a0 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:11:26.781989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52007989-5cb4-4b0a-b569-8287c4b118a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:11:26.783911 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52007989-5cb4-4b0a-b569-8287c4b118a0 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:11:26.882352 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4442/8911] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 22:11:26 2022] POST /identity/v3/users => generated 303 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 22:11:26.886343 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172970a-6c73-4a41-aec8-cb4593d477be admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:11:26.896749 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172970a-6c73-4a41-aec8-cb4593d477be admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:11:26.901341 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb11d2-f720-490b-9589-24e6fae02043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:11:26.902023 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb11d2-f720-490b-9589-24e6fae02043 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:11:26.902334 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb11d2-f720-490b-9589-24e6fae02043 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:11:26.902581 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb11d2-f720-490b-9589-24e6fae02043 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:11:26.903292 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb11d2-f720-490b-9589-24e6fae02043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:11:26.904881 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb11d2-f720-490b-9589-24e6fae02043 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:11:26.916814 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4470/8912] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 22:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 22:11:26.923209 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52007989-5cb4-4b0a-b569-8287c4b118a0 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:11:26.933890 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52007989-5cb4-4b0a-b569-8287c4b118a0 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:11:26.938650 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49a107-5e9d-4ad9-825c-474ab70b1878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:11:26.939523 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49a107-5e9d-4ad9-825c-474ab70b1878 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:11:26.939805 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49a107-5e9d-4ad9-825c-474ab70b1878 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:11:26.940083 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49a107-5e9d-4ad9-825c-474ab70b1878 admin admin] PATH_INFO: `/v3/projects/4d59a390335b46c7b84523a8f386348e/users/597015e414fb4a8184bb6855295827d7/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:11:26.954442 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49a107-5e9d-4ad9-825c-474ab70b1878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d59a390335b46c7b84523a8f386348e, user_id=597015e414fb4a8184bb6855295827d7, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:11:26.957112 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49a107-5e9d-4ad9-825c-474ab70b1878 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:11:27.052010 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4443/8913] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 22:11:26 2022] PUT /identity/v3/projects/4d59a390335b46c7b84523a8f386348e/users/597015e414fb4a8184bb6855295827d7/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 22:11:27.052214 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb11d2-f720-490b-9589-24e6fae02043 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:11:27.060642 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb11d2-f720-490b-9589-24e6fae02043 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:11:27.115339 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78777338-c904-446b-8a71-912f2a203c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:11:27.120384 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78777338-c904-446b-8a71-912f2a203c54 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:11:27.120384 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78777338-c904-446b-8a71-912f2a203c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:11:27.120384 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78777338-c904-446b-8a71-912f2a203c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:11:27.120384 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78777338-c904-446b-8a71-912f2a203c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:11:27.120384 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78777338-c904-446b-8a71-912f2a203c54 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:11:27.129099 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4471/8914] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 22:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 22:11:27.133237 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49a107-5e9d-4ad9-825c-474ab70b1878 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:11:27.143604 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49a107-5e9d-4ad9-825c-474ab70b1878 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:11:27.149530 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf575ab-ddad-41f9-995d-701b906b048d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:11:27.149530 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf575ab-ddad-41f9-995d-701b906b048d admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:11:27.149818 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf575ab-ddad-41f9-995d-701b906b048d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:11:27.149944 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf575ab-ddad-41f9-995d-701b906b048d admin admin] PATH_INFO: `/v3/projects/4d59a390335b46c7b84523a8f386348e/users/597015e414fb4a8184bb6855295827d7/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:11:27.151853 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf575ab-ddad-41f9-995d-701b906b048d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d59a390335b46c7b84523a8f386348e, user_id=597015e414fb4a8184bb6855295827d7, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:11:27.154572 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf575ab-ddad-41f9-995d-701b906b048d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:11:27.165242 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4444/8915] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 22:11:27 2022] PUT /identity/v3/projects/4d59a390335b46c7b84523a8f386348e/users/597015e414fb4a8184bb6855295827d7/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 22:11:27.176095 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c969ad2-7ea6-473c-9066-2a0e765c77bc None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:11:27.176390 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c969ad2-7ea6-473c-9066-2a0e765c77bc None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:11:27.176763 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c969ad2-7ea6-473c-9066-2a0e765c77bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:11:27.203663 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-8c969ad2-7ea6-473c-9066-2a0e765c77bc None None] MFA Rules not processed for user `597015e414fb4a8184bb6855295827d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:11:27.206856 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8c969ad2-7ea6-473c-9066-2a0e765c77bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:11:27.271668 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4472/8916] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:11:27 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:11:27.283750 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf575ab-ddad-41f9-995d-701b906b048d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:11:27.286128 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8bf575ab-ddad-41f9-995d-701b906b048d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:11:27.368850 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf575ab-ddad-41f9-995d-701b906b048d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:11:27.374334 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d449ea8-762c-4861-b35d-6c161c3e85cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:11:27.374976 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d449ea8-762c-4861-b35d-6c161c3e85cd service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:11:27.375258 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d449ea8-762c-4861-b35d-6c161c3e85cd service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:11:27.375536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d449ea8-762c-4861-b35d-6c161c3e85cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:11:27.429738 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d449ea8-762c-4861-b35d-6c161c3e85cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:11:27.431364 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d449ea8-762c-4861-b35d-6c161c3e85cd service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:11:27.440174 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4445/8917] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:11:27 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:11:32.972331 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c969ad2-7ea6-473c-9066-2a0e765c77bc None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:11:32.973842 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8c969ad2-7ea6-473c-9066-2a0e765c77bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:11:33.042676 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c969ad2-7ea6-473c-9066-2a0e765c77bc None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:11:33.046290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c237b-c3ef-49bb-98a5-4c198c526a60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:11:33.054005 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c237b-c3ef-49bb-98a5-4c198c526a60 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:11:33.054005 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c237b-c3ef-49bb-98a5-4c198c526a60 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:11:33.054005 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c237b-c3ef-49bb-98a5-4c198c526a60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:11:33.057520 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c237b-c3ef-49bb-98a5-4c198c526a60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:11:33.059011 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c237b-c3ef-49bb-98a5-4c198c526a60 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:11:33.068584 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4473/8918] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:11:32 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:11:36.152053 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c3011-c657-44a6-a057-a829675c92ee None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:11:36.152508 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c3011-c657-44a6-a057-a829675c92ee None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:11:36.152612 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c3011-c657-44a6-a057-a829675c92ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:11:36.173535 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-5b1c3011-c657-44a6-a057-a829675c92ee None None] MFA Rules not processed for user `55661e0ba64a400a8449a280f2ac5236`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:11:36.175425 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-5b1c3011-c657-44a6-a057-a829675c92ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:11:36.183273 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4446/8919] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:11:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:11:37.030335 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c237b-c3ef-49bb-98a5-4c198c526a60 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:11:37.032718 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-559c237b-c3ef-49bb-98a5-4c198c526a60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:11:37.109784 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c237b-c3ef-49bb-98a5-4c198c526a60 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:11:37.115319 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c6e12-7746-4e3a-97b4-7c5120916e5b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:11:37.118568 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c6e12-7746-4e3a-97b4-7c5120916e5b service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:11:37.118568 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c6e12-7746-4e3a-97b4-7c5120916e5b service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:11:37.118568 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c6e12-7746-4e3a-97b4-7c5120916e5b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:11:37.118568 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-bf0c6e12-7746-4e3a-97b4-7c5120916e5b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:11:37.130993 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0c6e12-7746-4e3a-97b4-7c5120916e5b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:11:37.132613 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0c6e12-7746-4e3a-97b4-7c5120916e5b service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:11:37.142542 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4474/8920] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:11:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:11:40.197609 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb3e40-90a9-4094-accc-5d94fabf3b80 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:11:40.202975 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb3e40-90a9-4094-accc-5d94fabf3b80 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:11:40.202975 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb3e40-90a9-4094-accc-5d94fabf3b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:11:40.217751 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-d1bb3e40-90a9-4094-accc-5d94fabf3b80 None None] MFA Rules not processed for user `0b0cb145b72a492ebb8c0e9223be47a1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:11:40.219117 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d1bb3e40-90a9-4094-accc-5d94fabf3b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:11:40.226894 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4447/8921] 10.222.0.35 () {58 vars in 1015 bytes} [Sat Apr 30 22:11:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:11:40.238945 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c6e12-7746-4e3a-97b4-7c5120916e5b service placement] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:11:40.248594 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c6e12-7746-4e3a-97b4-7c5120916e5b service placement] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:11:40.252397 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c2b98-be01-471b-a7cd-676f027df547 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:11:40.253317 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c2b98-be01-471b-a7cd-676f027df547 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:11:40.253608 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c2b98-be01-471b-a7cd-676f027df547 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:11:40.253961 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c2b98-be01-471b-a7cd-676f027df547 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:11:40.261456 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c2b98-be01-471b-a7cd-676f027df547 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:11:40.263016 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c2b98-be01-471b-a7cd-676f027df547 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:11:40.275483 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4475/8922] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:11:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:12:46.704197 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867b4c7-077d-44ae-9388-719ded462c95 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:12:46.713315 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867b4c7-077d-44ae-9388-719ded462c95 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:12:46.713315 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867b4c7-077d-44ae-9388-719ded462c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:12:46.724241 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-2867b4c7-077d-44ae-9388-719ded462c95 None None] MFA Rules not processed for user `55661e0ba64a400a8449a280f2ac5236`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:12:46.725714 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-2867b4c7-077d-44ae-9388-719ded462c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:12:46.733031 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4448/8923] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:12:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:12:47.081039 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96268398-c342-477d-ae06-bc7746b77aa9 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:12:47.081655 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96268398-c342-477d-ae06-bc7746b77aa9 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:12:47.081655 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96268398-c342-477d-ae06-bc7746b77aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:12:47.115131 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-96268398-c342-477d-ae06-bc7746b77aa9 None None] MFA Rules not processed for user `0b0cb145b72a492ebb8c0e9223be47a1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:12:47.116397 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-96268398-c342-477d-ae06-bc7746b77aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:12:47.124370 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4476/8924] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 22:12:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 22:12:47.138450 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867b4c7-077d-44ae-9388-719ded462c95 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:12:47.153077 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867b4c7-077d-44ae-9388-719ded462c95 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:12:47.157728 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99e665-5cc2-48c3-a223-7470955fa9cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:12:47.158517 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99e665-5cc2-48c3-a223-7470955fa9cc service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:12:47.158872 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99e665-5cc2-48c3-a223-7470955fa9cc service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:12:47.159223 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99e665-5cc2-48c3-a223-7470955fa9cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:12:47.168002 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b99e665-5cc2-48c3-a223-7470955fa9cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:12:47.169597 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b99e665-5cc2-48c3-a223-7470955fa9cc service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:12:47.178640 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4449/8925] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:12:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:13:38.069117 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96268398-c342-477d-ae06-bc7746b77aa9 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:13:38.077698 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96268398-c342-477d-ae06-bc7746b77aa9 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:13:38.081484 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba3acd7-6dd4-4e6d-8f15-926eb41889f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:13:38.082185 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3acd7-6dd4-4e6d-8f15-926eb41889f8 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:13:38.086587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3acd7-6dd4-4e6d-8f15-926eb41889f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:13:38.086587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba3acd7-6dd4-4e6d-8f15-926eb41889f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:13:38.086587 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7ba3acd7-6dd4-4e6d-8f15-926eb41889f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:13:38.098138 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba3acd7-6dd4-4e6d-8f15-926eb41889f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:13:38.100112 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba3acd7-6dd4-4e6d-8f15-926eb41889f8 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:13:38.111327 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4477/8926] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:13:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:13:39.363073 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99e665-5cc2-48c3-a223-7470955fa9cc service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:13:39.372050 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99e665-5cc2-48c3-a223-7470955fa9cc service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:13:39.375909 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5555416-6a4f-490b-b1b2-cb63a04aa0ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:13:39.376530 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5555416-6a4f-490b-b1b2-cb63a04aa0ce service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:13:39.376808 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5555416-6a4f-490b-b1b2-cb63a04aa0ce service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:13:39.377079 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5555416-6a4f-490b-b1b2-cb63a04aa0ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:13:39.378860 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b5555416-6a4f-490b-b1b2-cb63a04aa0ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:13:39.392384 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5555416-6a4f-490b-b1b2-cb63a04aa0ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:13:39.393830 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5555416-6a4f-490b-b1b2-cb63a04aa0ce service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:13:39.404422 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4450/8927] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:13:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:14:43.982634 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4ac7b-ac08-4386-a542-1ac932685e4e None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:14:43.983215 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4ac7b-ac08-4386-a542-1ac932685e4e None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:14:43.983326 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4ac7b-ac08-4386-a542-1ac932685e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:14:44.002455 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-beb4ac7b-ac08-4386-a542-1ac932685e4e None None] MFA Rules not processed for user `55661e0ba64a400a8449a280f2ac5236`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:14:44.003798 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-beb4ac7b-ac08-4386-a542-1ac932685e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:14:44.011751 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4478/8928] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:14:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 22:14:44.327127 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5555416-6a4f-490b-b1b2-cb63a04aa0ce service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:14:44.345161 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5555416-6a4f-490b-b1b2-cb63a04aa0ce service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:14:44.348850 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318fe3ad-21f1-4e9c-b5d0-2874c709fdc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:14:44.349510 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318fe3ad-21f1-4e9c-b5d0-2874c709fdc3 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:14:44.349819 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318fe3ad-21f1-4e9c-b5d0-2874c709fdc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:14:44.350096 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318fe3ad-21f1-4e9c-b5d0-2874c709fdc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:14:44.351919 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-318fe3ad-21f1-4e9c-b5d0-2874c709fdc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:14:44.362553 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318fe3ad-21f1-4e9c-b5d0-2874c709fdc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:14:44.365278 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318fe3ad-21f1-4e9c-b5d0-2874c709fdc3 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:14:44.374531 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4451/8929] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:14:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:14:48.446903 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4ac7b-ac08-4386-a542-1ac932685e4e None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:14:48.467473 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4ac7b-ac08-4386-a542-1ac932685e4e None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:14:48.474514 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faee232-c6eb-4733-b4f5-6a48cdbf109d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:14:48.478096 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faee232-c6eb-4733-b4f5-6a48cdbf109d service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:14:48.478096 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faee232-c6eb-4733-b4f5-6a48cdbf109d service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:14:48.478096 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faee232-c6eb-4733-b4f5-6a48cdbf109d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:14:48.485418 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8faee232-c6eb-4733-b4f5-6a48cdbf109d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:14:48.502963 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faee232-c6eb-4733-b4f5-6a48cdbf109d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:14:48.510958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faee232-c6eb-4733-b4f5-6a48cdbf109d service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:14:48.535809 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4479/8930] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:14:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:14:54.455467 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318fe3ad-21f1-4e9c-b5d0-2874c709fdc3 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:14:54.468396 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318fe3ad-21f1-4e9c-b5d0-2874c709fdc3 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:14:54.474290 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ac4a7-f2b2-4dce-8343-d4c5a1ad275b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:14:54.474968 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ac4a7-f2b2-4dce-8343-d4c5a1ad275b service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:14:54.476163 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ac4a7-f2b2-4dce-8343-d4c5a1ad275b service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:14:54.476454 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ac4a7-f2b2-4dce-8343-d4c5a1ad275b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:14:54.478281 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ff1ac4a7-f2b2-4dce-8343-d4c5a1ad275b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:14:54.490279 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1ac4a7-f2b2-4dce-8343-d4c5a1ad275b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:14:54.493693 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1ac4a7-f2b2-4dce-8343-d4c5a1ad275b service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:14:54.507012 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4452/8931] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:14:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:14:58.606256 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b97cc-5ba0-4b03-bda5-871a55178716 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:14:58.606861 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b97cc-5ba0-4b03-bda5-871a55178716 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:14:58.607269 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b97cc-5ba0-4b03-bda5-871a55178716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:14:58.642671 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-aa0b97cc-5ba0-4b03-bda5-871a55178716 None None] MFA Rules not processed for user `fca4ee1f64c8489ebe7296f9f8f0ab41`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:14:58.644175 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-aa0b97cc-5ba0-4b03-bda5-871a55178716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:14:58.654346 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4480/8932] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Apr 30 22:14:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:14:58.667793 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ac4a7-f2b2-4dce-8343-d4c5a1ad275b service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:14:58.669951 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ff1ac4a7-f2b2-4dce-8343-d4c5a1ad275b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:14:58.683934 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ac4a7-f2b2-4dce-8343-d4c5a1ad275b service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:14:58.690025 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998fa51-252d-4ed0-8b17-8d25a8cad393 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:14:58.690482 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998fa51-252d-4ed0-8b17-8d25a8cad393 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:14:58.690769 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998fa51-252d-4ed0-8b17-8d25a8cad393 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:14:58.691047 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998fa51-252d-4ed0-8b17-8d25a8cad393 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:14:58.700463 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998fa51-252d-4ed0-8b17-8d25a8cad393 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:14:58.702097 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998fa51-252d-4ed0-8b17-8d25a8cad393 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:14:58.714318 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4453/8933] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:14:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:15:29.002535 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb0ea25-4a0f-4356-88b6-e0e1f9cf17c5 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:15:29.003186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb0ea25-4a0f-4356-88b6-e0e1f9cf17c5 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:15:29.003186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb0ea25-4a0f-4356-88b6-e0e1f9cf17c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:15:29.021096 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-9bb0ea25-4a0f-4356-88b6-e0e1f9cf17c5 None None] MFA Rules not processed for user `0b0cb145b72a492ebb8c0e9223be47a1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:15:29.036173 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9bb0ea25-4a0f-4356-88b6-e0e1f9cf17c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:15:29.036173 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4481/8934] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Apr 30 22:15:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:15:29.041024 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998fa51-252d-4ed0-8b17-8d25a8cad393 service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:15:29.042432 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b998fa51-252d-4ed0-8b17-8d25a8cad393 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:15:29.053977 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998fa51-252d-4ed0-8b17-8d25a8cad393 service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:15:29.057615 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba94a2-b022-46de-9457-9545199d4fdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:15:29.058283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba94a2-b022-46de-9457-9545199d4fdb service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:15:29.064816 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba94a2-b022-46de-9457-9545199d4fdb service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:15:29.064816 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba94a2-b022-46de-9457-9545199d4fdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:15:29.065781 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aba94a2-b022-46de-9457-9545199d4fdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:15:29.067332 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aba94a2-b022-46de-9457-9545199d4fdb service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:15:29.075591 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4454/8935] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:15:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:15:29.227948 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16e0c2-f437-4bb8-bbf5-4d63a243d9ba None None] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:15:29.228240 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16e0c2-f437-4bb8-bbf5-4d63a243d9ba None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:15:29.228523 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16e0c2-f437-4bb8-bbf5-4d63a243d9ba None None] PATH_INFO: `/` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:15:29.229952 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4482/8936] 10.222.0.23 () {54 vars in 921 bytes} [Sat Apr 30 22:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 30 22:15:29.235076 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0c293-ce92-400d-8fb6-5c032f6abd74 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:15:29.236638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0c293-ce92-400d-8fb6-5c032f6abd74 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:15:29.236638 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0c293-ce92-400d-8fb6-5c032f6abd74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:15:29.283931 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-bdf0c293-ce92-400d-8fb6-5c032f6abd74 None None] MFA Rules not processed for user `4ad3f89b7037413a83c7905cef263b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:15:29.285142 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-bdf0c293-ce92-400d-8fb6-5c032f6abd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:15:29.303337 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4455/8937] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Apr 30 22:15:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:15:29.323984 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16e0c2-f437-4bb8-bbf5-4d63a243d9ba None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:15:29.325790 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-dd16e0c2-f437-4bb8-bbf5-4d63a243d9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:15:29.341983 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16e0c2-f437-4bb8-bbf5-4d63a243d9ba None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:15:29.346993 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a928d-936d-40e9-9944-1d44015c0516 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:15:29.347632 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a928d-936d-40e9-9944-1d44015c0516 service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:15:29.347915 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a928d-936d-40e9-9944-1d44015c0516 service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:15:29.348194 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a928d-936d-40e9-9944-1d44015c0516 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:15:29.356401 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a928d-936d-40e9-9944-1d44015c0516 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:15:29.358029 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a928d-936d-40e9-9944-1d44015c0516 service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:15:29.368299 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4483/8938] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:15:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:15:30.714892 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39daf6-6611-4fe3-8312-503444ad0256 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:15:30.715347 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39daf6-6611-4fe3-8312-503444ad0256 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:15:30.715590 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39daf6-6611-4fe3-8312-503444ad0256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:15:30.734314 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-eb39daf6-6611-4fe3-8312-503444ad0256 None None] MFA Rules not processed for user `fca4ee1f64c8489ebe7296f9f8f0ab41`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:15:30.735502 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-eb39daf6-6611-4fe3-8312-503444ad0256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:15:30.745318 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4456/8939] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Apr 30 22:15:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:15:30.756582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a928d-936d-40e9-9944-1d44015c0516 service placement] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:15:30.765655 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a928d-936d-40e9-9944-1d44015c0516 service placement] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:15:30.769200 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be56b69-1bf3-43a9-a585-656effcd9965 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:15:30.769860 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be56b69-1bf3-43a9-a585-656effcd9965 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:15:30.770140 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be56b69-1bf3-43a9-a585-656effcd9965 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:15:30.770413 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be56b69-1bf3-43a9-a585-656effcd9965 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:15:30.780192 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be56b69-1bf3-43a9-a585-656effcd9965 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:15:30.781611 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be56b69-1bf3-43a9-a585-656effcd9965 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:15:30.792476 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4484/8940] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:15:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:15:30.851525 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb39daf6-6611-4fe3-8312-503444ad0256 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:15:30.862637 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb39daf6-6611-4fe3-8312-503444ad0256 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:15:30.868134 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77fb42-ae53-44a7-8bf0-ebdd9b3a2404 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:15:30.868800 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77fb42-ae53-44a7-8bf0-ebdd9b3a2404 service placement] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:15:30.869082 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77fb42-ae53-44a7-8bf0-ebdd9b3a2404 service placement] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:15:30.869364 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77fb42-ae53-44a7-8bf0-ebdd9b3a2404 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:15:30.871143 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-7a77fb42-ae53-44a7-8bf0-ebdd9b3a2404 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:15:30.883499 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77fb42-ae53-44a7-8bf0-ebdd9b3a2404 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:15:30.885117 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77fb42-ae53-44a7-8bf0-ebdd9b3a2404 service placement] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:15:30.894857 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4457/8941] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:15:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:15:53.515722 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be56b69-1bf3-43a9-a585-656effcd9965 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:15:53.525053 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be56b69-1bf3-43a9-a585-656effcd9965 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:15:53.528726 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba58d5b-9ceb-4adf-b25f-b3a5bb5bb754 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:15:53.529369 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba58d5b-9ceb-4adf-b25f-b3a5bb5bb754 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:15:53.529650 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba58d5b-9ceb-4adf-b25f-b3a5bb5bb754 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:15:53.530060 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba58d5b-9ceb-4adf-b25f-b3a5bb5bb754 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:15:53.531891 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-1ba58d5b-9ceb-4adf-b25f-b3a5bb5bb754 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:15:53.548369 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba58d5b-9ceb-4adf-b25f-b3a5bb5bb754 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:15:53.549866 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba58d5b-9ceb-4adf-b25f-b3a5bb5bb754 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:15:53.558140 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4485/8942] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:15:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:15:55.565453 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77fb42-ae53-44a7-8bf0-ebdd9b3a2404 service placement] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:15:55.576867 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77fb42-ae53-44a7-8bf0-ebdd9b3a2404 service placement] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:15:55.581937 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47c581-4f9c-4537-9e47-3e496571f866 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:15:55.582591 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47c581-4f9c-4537-9e47-3e496571f866 service placement] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:15:55.582877 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47c581-4f9c-4537-9e47-3e496571f866 service placement] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:15:55.583156 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47c581-4f9c-4537-9e47-3e496571f866 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:15:55.584924 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-bb47c581-4f9c-4537-9e47-3e496571f866 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:15:55.596232 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb47c581-4f9c-4537-9e47-3e496571f866 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:15:55.597844 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb47c581-4f9c-4537-9e47-3e496571f866 service placement] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:15:55.608262 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4458/8943] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:15:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:15:58.782718 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba58d5b-9ceb-4adf-b25f-b3a5bb5bb754 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:15:58.797839 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba58d5b-9ceb-4adf-b25f-b3a5bb5bb754 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:15:58.803176 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83c309-ca5d-4c4d-8fa0-6838821558af service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:15:58.803841 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83c309-ca5d-4c4d-8fa0-6838821558af service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:15:58.804120 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83c309-ca5d-4c4d-8fa0-6838821558af service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:15:58.804404 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83c309-ca5d-4c4d-8fa0-6838821558af service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:15:58.806438 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3e83c309-ca5d-4c4d-8fa0-6838821558af service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:15:58.820992 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e83c309-ca5d-4c4d-8fa0-6838821558af service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:15:58.822757 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e83c309-ca5d-4c4d-8fa0-6838821558af service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:15:58.833474 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4486/8944] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:15:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:16:29.821739 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47c581-4f9c-4537-9e47-3e496571f866 service placement] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:16:29.831921 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47c581-4f9c-4537-9e47-3e496571f866 service placement] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:16:29.835717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca7418-992e-4c15-a030-c339be5183eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:16:29.836387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca7418-992e-4c15-a030-c339be5183eb service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:16:29.836672 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca7418-992e-4c15-a030-c339be5183eb service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:16:29.836948 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca7418-992e-4c15-a030-c339be5183eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:16:29.845867 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca7418-992e-4c15-a030-c339be5183eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:16:29.847313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca7418-992e-4c15-a030-c339be5183eb service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:16:29.856629 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4459/8945] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:16:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:16:43.457325 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83c309-ca5d-4c4d-8fa0-6838821558af service placement] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:16:43.467083 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83c309-ca5d-4c4d-8fa0-6838821558af service placement] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:16:43.470650 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc6eb5-645f-4955-83fc-4a745999b724 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:16:43.471332 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc6eb5-645f-4955-83fc-4a745999b724 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:16:43.471755 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc6eb5-645f-4955-83fc-4a745999b724 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:16:43.472024 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc6eb5-645f-4955-83fc-4a745999b724 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:16:43.481056 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc6eb5-645f-4955-83fc-4a745999b724 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:16:43.482518 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc6eb5-645f-4955-83fc-4a745999b724 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:16:43.492127 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4487/8946] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:16:43 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:16:47.019516 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18bd9e-1aba-4bfe-b1d9-a4ce29827a7b None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:16:47.019934 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18bd9e-1aba-4bfe-b1d9-a4ce29827a7b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:16:47.020034 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18bd9e-1aba-4bfe-b1d9-a4ce29827a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:16:47.037244 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-1c18bd9e-1aba-4bfe-b1d9-a4ce29827a7b None None] MFA Rules not processed for user `55661e0ba64a400a8449a280f2ac5236`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:16:47.038497 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-1c18bd9e-1aba-4bfe-b1d9-a4ce29827a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:16:47.045956 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4460/8947] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:16:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:16:47.791444 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc6eb5-645f-4955-83fc-4a745999b724 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:16:47.829086 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc6eb5-645f-4955-83fc-4a745999b724 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:16:47.838867 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f57a8-5139-478a-9089-26f1ef52153f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:16:47.839666 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f57a8-5139-478a-9089-26f1ef52153f service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:16:47.840047 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f57a8-5139-478a-9089-26f1ef52153f service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:16:47.840428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f57a8-5139-478a-9089-26f1ef52153f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:16:47.850290 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f57a8-5139-478a-9089-26f1ef52153f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:16:47.854164 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f57a8-5139-478a-9089-26f1ef52153f service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:16:47.871882 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4488/8948] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:16:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:16:50.956176 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18bd9e-1aba-4bfe-b1d9-a4ce29827a7b None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:16:50.966970 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18bd9e-1aba-4bfe-b1d9-a4ce29827a7b None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:16:50.970942 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b7f28-2167-4b7c-a9a0-193a522ffa0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:16:50.971702 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b7f28-2167-4b7c-a9a0-193a522ffa0b service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:16:50.972091 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b7f28-2167-4b7c-a9a0-193a522ffa0b service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:16:50.972456 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b7f28-2167-4b7c-a9a0-193a522ffa0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:16:50.984024 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b7f28-2167-4b7c-a9a0-193a522ffa0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:16:50.985525 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b7f28-2167-4b7c-a9a0-193a522ffa0b service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:16:50.994100 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4461/8949] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:16:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:18:45.006119 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da14182-6d93-4ca1-9486-4da4748b3fe1 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:18:45.010245 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da14182-6d93-4ca1-9486-4da4748b3fe1 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:18:45.010245 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da14182-6d93-4ca1-9486-4da4748b3fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:18:45.027378 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-7da14182-6d93-4ca1-9486-4da4748b3fe1 None None] MFA Rules not processed for user `55661e0ba64a400a8449a280f2ac5236`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:18:45.029213 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-7da14182-6d93-4ca1-9486-4da4748b3fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:18:45.038116 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4489/8950] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:18:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:18:45.075345 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4052c-4bd6-43f7-93bf-36b3c51a1bb8 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:18:45.076283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4052c-4bd6-43f7-93bf-36b3c51a1bb8 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:18:45.076835 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4052c-4bd6-43f7-93bf-36b3c51a1bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:18:45.098391 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-deb4052c-4bd6-43f7-93bf-36b3c51a1bb8 None None] MFA Rules not processed for user `e302b1298dd04d6590e3d079f7b13b29`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:18:45.100219 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-deb4052c-4bd6-43f7-93bf-36b3c51a1bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:18:45.162874 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4462/8951] 10.222.0.23 () {58 vars in 1059 bytes} [Sat Apr 30 22:18:45 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:18:45.169033 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da14182-6d93-4ca1-9486-4da4748b3fe1 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:18:45.179186 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da14182-6d93-4ca1-9486-4da4748b3fe1 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:18:45.183075 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3219c98b-03bc-4c8d-bd6f-6929ac7ec6e6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e302b1298dd04d6590e3d079f7b13b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:18:45.183731 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219c98b-03bc-4c8d-bd6f-6929ac7ec6e6 service glance] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:18:45.184216 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219c98b-03bc-4c8d-bd6f-6929ac7ec6e6 service glance] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:18:45.184656 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219c98b-03bc-4c8d-bd6f-6929ac7ec6e6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:18:45.196946 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3219c98b-03bc-4c8d-bd6f-6929ac7ec6e6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:18:45.198471 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3219c98b-03bc-4c8d-bd6f-6929ac7ec6e6 service glance] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:18:45.225474 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4490/8952] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:18:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:18:45.908294 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4052c-4bd6-43f7-93bf-36b3c51a1bb8 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:18:45.918292 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4052c-4bd6-43f7-93bf-36b3c51a1bb8 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:18:45.922516 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638c236-0f94-4c8d-beac-9f591cf6a037 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:18:45.923423 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638c236-0f94-4c8d-beac-9f591cf6a037 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:18:45.923917 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638c236-0f94-4c8d-beac-9f591cf6a037 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:18:45.924291 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638c236-0f94-4c8d-beac-9f591cf6a037 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:18:45.937849 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2638c236-0f94-4c8d-beac-9f591cf6a037 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:18:45.939406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2638c236-0f94-4c8d-beac-9f591cf6a037 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:18:45.952757 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4463/8953] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:18:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:19:50.874257 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3219c98b-03bc-4c8d-bd6f-6929ac7ec6e6 service glance] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:19:50.955407 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3219c98b-03bc-4c8d-bd6f-6929ac7ec6e6 service glance] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:19:50.960022 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d477d-b5a9-4580-be33-6b2223fcc00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:19:50.960883 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d477d-b5a9-4580-be33-6b2223fcc00c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:19:50.961166 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d477d-b5a9-4580-be33-6b2223fcc00c admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:19:50.961444 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d477d-b5a9-4580-be33-6b2223fcc00c admin admin] PATH_INFO: `/v3/users/55661e0ba64a400a8449a280f2ac5236` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:19:50.962657 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1d477d-b5a9-4580-be33-6b2223fcc00c admin admin] RBAC: Authorizing `identity:delete_user(user_id=55661e0ba64a400a8449a280f2ac5236)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:19:50.964588 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1d477d-b5a9-4580-be33-6b2223fcc00c admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:19:51.102398 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5f1d477d-b5a9-4580-be33-6b2223fcc00c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55661e0ba64a400a8449a280f2ac5236'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:19:51.114302 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5f1d477d-b5a9-4580-be33-6b2223fcc00c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55661e0ba64a400a8449a280f2ac5236'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:19:51.185682 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5f1d477d-b5a9-4580-be33-6b2223fcc00c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55661e0ba64a400a8449a280f2ac5236'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:19:51.193268 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5f1d477d-b5a9-4580-be33-6b2223fcc00c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55661e0ba64a400a8449a280f2ac5236'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:19:51.193949 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-5f1d477d-b5a9-4580-be33-6b2223fcc00c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55661e0ba64a400a8449a280f2ac5236'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:19:51.199786 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4491/8954] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 22:19:50 2022] DELETE /identity/v3/users/55661e0ba64a400a8449a280f2ac5236 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:19:51.204692 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c3067-ef87-4686-90a4-3228a3e9ed1f None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:19:51.205179 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c3067-ef87-4686-90a4-3228a3e9ed1f None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:19:51.205343 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c3067-ef87-4686-90a4-3228a3e9ed1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:19:51.242397 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-eb4c3067-ef87-4686-90a4-3228a3e9ed1f None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:19:51.243591 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-eb4c3067-ef87-4686-90a4-3228a3e9ed1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:19:51.302164 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4464/8955] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:19:51.312283 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d477d-b5a9-4580-be33-6b2223fcc00c admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:19:51.317836 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5f1d477d-b5a9-4580-be33-6b2223fcc00c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:19:51.382734 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d477d-b5a9-4580-be33-6b2223fcc00c admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:19:51.386361 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76989e27-218f-4ae2-9d61-8f73aaaa00a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:19:51.387008 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76989e27-218f-4ae2-9d61-8f73aaaa00a5 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:19:51.387291 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76989e27-218f-4ae2-9d61-8f73aaaa00a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:19:51.387571 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76989e27-218f-4ae2-9d61-8f73aaaa00a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:19:51.397804 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76989e27-218f-4ae2-9d61-8f73aaaa00a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:19:51.399259 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76989e27-218f-4ae2-9d61-8f73aaaa00a5 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:19:51.409469 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4492/8956] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:19:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:19:51.616315 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c3067-ef87-4686-90a4-3228a3e9ed1f None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:19:51.621845 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-eb4c3067-ef87-4686-90a4-3228a3e9ed1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:19:51.632009 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c3067-ef87-4686-90a4-3228a3e9ed1f None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:19:51.638941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf6b19-0ac3-4539-8f23-9a09f66d8aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:19:51.638941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf6b19-0ac3-4539-8f23-9a09f66d8aee admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:19:51.638941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf6b19-0ac3-4539-8f23-9a09f66d8aee admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:19:51.638941 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf6b19-0ac3-4539-8f23-9a09f66d8aee admin admin] PATH_INFO: `/v3/projects/8f25dc6783c0491a86c2170aed9e0817` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:19:51.639550 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf6b19-0ac3-4539-8f23-9a09f66d8aee admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f25dc6783c0491a86c2170aed9e0817)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:19:51.641696 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf6b19-0ac3-4539-8f23-9a09f66d8aee admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:19:51.745858 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8bbf6b19-0ac3-4539-8f23-9a09f66d8aee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f25dc6783c0491a86c2170aed9e0817', 'request_id': 'req-8bbf6b19-0ac3-4539-8f23-9a09f66d8aee'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:19:51.755965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8bbf6b19-0ac3-4539-8f23-9a09f66d8aee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f25dc6783c0491a86c2170aed9e0817', 'request_id': 'req-8bbf6b19-0ac3-4539-8f23-9a09f66d8aee'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:19:51.763177 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8bbf6b19-0ac3-4539-8f23-9a09f66d8aee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f25dc6783c0491a86c2170aed9e0817', 'request_id': 'req-8bbf6b19-0ac3-4539-8f23-9a09f66d8aee'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:19:51.841713 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8bbf6b19-0ac3-4539-8f23-9a09f66d8aee admin admin] The token cache is being invalidate because project 8f25dc6783c0491a86c2170aed9e0817 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 22:19:51.842108 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8bbf6b19-0ac3-4539-8f23-9a09f66d8aee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:19:51.842861 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-8bbf6b19-0ac3-4539-8f23-9a09f66d8aee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:19:51.844421 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4465/8957] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 22:19:51 2022] DELETE /identity/v3/projects/8f25dc6783c0491a86c2170aed9e0817 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:19:51.848439 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76989e27-218f-4ae2-9d61-8f73aaaa00a5 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:19:51.858756 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76989e27-218f-4ae2-9d61-8f73aaaa00a5 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:19:51.914353 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ed35d-ab2e-4570-8231-55f10df45fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:19:51.915157 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ed35d-ab2e-4570-8231-55f10df45fab admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:19:51.915442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ed35d-ab2e-4570-8231-55f10df45fab admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:19:51.915718 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ed35d-ab2e-4570-8231-55f10df45fab admin admin] PATH_INFO: `/v3/users/597015e414fb4a8184bb6855295827d7` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:19:51.916896 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ed35d-ab2e-4570-8231-55f10df45fab admin admin] RBAC: Authorizing `identity:delete_user(user_id=597015e414fb4a8184bb6855295827d7)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:19:51.918874 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ed35d-ab2e-4570-8231-55f10df45fab admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:19:52.073163 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2e1ed35d-ab2e-4570-8231-55f10df45fab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '597015e414fb4a8184bb6855295827d7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:19:52.084539 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2e1ed35d-ab2e-4570-8231-55f10df45fab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '597015e414fb4a8184bb6855295827d7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:19:52.145536 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2e1ed35d-ab2e-4570-8231-55f10df45fab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '597015e414fb4a8184bb6855295827d7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:19:52.152620 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2e1ed35d-ab2e-4570-8231-55f10df45fab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '597015e414fb4a8184bb6855295827d7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:19:52.153295 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-2e1ed35d-ab2e-4570-8231-55f10df45fab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '597015e414fb4a8184bb6855295827d7'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:19:52.159660 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4493/8958] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 22:19:51 2022] DELETE /identity/v3/users/597015e414fb4a8184bb6855295827d7 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:19:52.490324 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf6b19-0ac3-4539-8f23-9a09f66d8aee admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:19:52.500093 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8bbf6b19-0ac3-4539-8f23-9a09f66d8aee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:19:52.512059 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf6b19-0ac3-4539-8f23-9a09f66d8aee admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:19:52.568566 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7a7d9-806d-466e-a866-8417f4f92897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:19:52.569429 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7a7d9-806d-466e-a866-8417f4f92897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:19:52.569712 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7a7d9-806d-466e-a866-8417f4f92897 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:19:52.570017 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7a7d9-806d-466e-a866-8417f4f92897 admin admin] PATH_INFO: `/v3/projects/4d59a390335b46c7b84523a8f386348e` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:19:52.571180 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c7a7d9-806d-466e-a866-8417f4f92897 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d59a390335b46c7b84523a8f386348e)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:19:52.573095 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c7a7d9-806d-466e-a866-8417f4f92897 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:19:52.688561 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b0c7a7d9-806d-466e-a866-8417f4f92897 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d59a390335b46c7b84523a8f386348e', 'request_id': 'req-b0c7a7d9-806d-466e-a866-8417f4f92897'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:19:52.694011 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b0c7a7d9-806d-466e-a866-8417f4f92897 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d59a390335b46c7b84523a8f386348e', 'request_id': 'req-b0c7a7d9-806d-466e-a866-8417f4f92897'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:19:52.700184 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b0c7a7d9-806d-466e-a866-8417f4f92897 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d59a390335b46c7b84523a8f386348e', 'request_id': 'req-b0c7a7d9-806d-466e-a866-8417f4f92897'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:19:52.750499 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b0c7a7d9-806d-466e-a866-8417f4f92897 admin admin] The token cache is being invalidate because project 4d59a390335b46c7b84523a8f386348e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 22:19:52.750726 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b0c7a7d9-806d-466e-a866-8417f4f92897 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:19:52.751437 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-b0c7a7d9-806d-466e-a866-8417f4f92897 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:19:52.753146 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4466/8959] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 22:19:52 2022] DELETE /identity/v3/projects/4d59a390335b46c7b84523a8f386348e => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:19:52.758648 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e920be6-1a18-4abc-ba3a-e5fdcbd091ad None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:19:52.758938 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e920be6-1a18-4abc-ba3a-e5fdcbd091ad None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:19:52.759218 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e920be6-1a18-4abc-ba3a-e5fdcbd091ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:19:52.797012 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-8e920be6-1a18-4abc-ba3a-e5fdcbd091ad None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:19:52.798255 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-8e920be6-1a18-4abc-ba3a-e5fdcbd091ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:19:52.857529 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4494/8960] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:19:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 22:19:52.865823 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465773cd-54eb-49d9-9e58-10600daae8d2 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:19:52.866112 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465773cd-54eb-49d9-9e58-10600daae8d2 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:19:52.866387 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465773cd-54eb-49d9-9e58-10600daae8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:19:52.885054 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-465773cd-54eb-49d9-9e58-10600daae8d2 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:19:52.886284 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-465773cd-54eb-49d9-9e58-10600daae8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:19:52.894822 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4467/8961] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:19:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:19:52.898923 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e920be6-1a18-4abc-ba3a-e5fdcbd091ad None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:19:52.908437 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e920be6-1a18-4abc-ba3a-e5fdcbd091ad None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:19:52.913506 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0db9f-9ec3-40a6-8590-b7842288ad09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:19:52.914197 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0db9f-9ec3-40a6-8590-b7842288ad09 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:19:52.914479 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0db9f-9ec3-40a6-8590-b7842288ad09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:19:52.915009 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0db9f-9ec3-40a6-8590-b7842288ad09 admin admin] PATH_INFO: `/v3/domains` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:19:52.915464 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0db9f-9ec3-40a6-8590-b7842288ad09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 22:19:52.915773 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0db9f-9ec3-40a6-8590-b7842288ad09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:19:52.917380 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0db9f-9ec3-40a6-8590-b7842288ad09 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:19:52.928603 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4495/8962] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 22:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 30 22:19:52.932742 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465773cd-54eb-49d9-9e58-10600daae8d2 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:19:52.942503 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465773cd-54eb-49d9-9e58-10600daae8d2 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:19:52.947617 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da590fbf-4a77-4951-9106-56cde88dd36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:19:52.948310 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da590fbf-4a77-4951-9106-56cde88dd36f admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:19:52.948596 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da590fbf-4a77-4951-9106-56cde88dd36f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:19:52.948874 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da590fbf-4a77-4951-9106-56cde88dd36f admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:19:52.949605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da590fbf-4a77-4951-9106-56cde88dd36f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:19:52.951628 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da590fbf-4a77-4951-9106-56cde88dd36f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:19:53.021499 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4468/8963] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 22:19:52 2022] POST /identity/v3/projects => generated 371 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 22:19:53.025787 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0db9f-9ec3-40a6-8590-b7842288ad09 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:19:53.036165 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0db9f-9ec3-40a6-8590-b7842288ad09 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:19:53.094096 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc26a5-8379-4f45-8aa3-63212447b776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:19:53.094767 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc26a5-8379-4f45-8aa3-63212447b776 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:19:53.095052 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc26a5-8379-4f45-8aa3-63212447b776 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:19:53.095333 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc26a5-8379-4f45-8aa3-63212447b776 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:19:53.096028 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc26a5-8379-4f45-8aa3-63212447b776 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:19:53.098107 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc26a5-8379-4f45-8aa3-63212447b776 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:19:53.174245 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4496/8964] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 22:19:53 2022] POST /identity/v3/users => generated 286 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 22:19:53.178294 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da590fbf-4a77-4951-9106-56cde88dd36f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:19:53.189164 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da590fbf-4a77-4951-9106-56cde88dd36f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:19:53.193979 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324ea4a-422d-4ad3-80aa-4c484f30e950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:19:53.194640 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324ea4a-422d-4ad3-80aa-4c484f30e950 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:19:53.194920 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324ea4a-422d-4ad3-80aa-4c484f30e950 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:19:53.195243 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324ea4a-422d-4ad3-80aa-4c484f30e950 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:19:53.195965 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324ea4a-422d-4ad3-80aa-4c484f30e950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:19:53.197605 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324ea4a-422d-4ad3-80aa-4c484f30e950 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:19:53.209572 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4469/8965] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 22:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 22:19:53.213513 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc26a5-8379-4f45-8aa3-63212447b776 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:19:53.223494 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc26a5-8379-4f45-8aa3-63212447b776 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:19:53.228107 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b58e21-bc6e-4237-b756-5e6ba956bfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:19:53.228796 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b58e21-bc6e-4237-b756-5e6ba956bfde admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:19:53.229082 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b58e21-bc6e-4237-b756-5e6ba956bfde admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:19:53.229363 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b58e21-bc6e-4237-b756-5e6ba956bfde admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:19:53.230161 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b58e21-bc6e-4237-b756-5e6ba956bfde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:19:53.231767 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b58e21-bc6e-4237-b756-5e6ba956bfde admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:19:53.242610 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4497/8966] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 22:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 22:19:53.247139 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324ea4a-422d-4ad3-80aa-4c484f30e950 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:19:53.258024 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324ea4a-422d-4ad3-80aa-4c484f30e950 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:19:53.262826 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b68489-8b09-4e12-8c36-c0e2ae5c6a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:19:53.263704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b68489-8b09-4e12-8c36-c0e2ae5c6a2f admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:19:53.263990 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b68489-8b09-4e12-8c36-c0e2ae5c6a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:19:53.264273 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b68489-8b09-4e12-8c36-c0e2ae5c6a2f admin admin] PATH_INFO: `/v3/projects/7a470c13c84849f28ff3b1d4bb55c4e4/users/d303e4f4105348928c5697b11e69a3d1/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:19:53.279352 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b68489-8b09-4e12-8c36-c0e2ae5c6a2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a470c13c84849f28ff3b1d4bb55c4e4, user_id=d303e4f4105348928c5697b11e69a3d1, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:19:53.282155 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b68489-8b09-4e12-8c36-c0e2ae5c6a2f admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:19:53.386015 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4470/8967] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 22:19:53 2022] PUT /identity/v3/projects/7a470c13c84849f28ff3b1d4bb55c4e4/users/d303e4f4105348928c5697b11e69a3d1/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 30 22:19:53.391124 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac672b-df2b-4848-bfd8-e16d27581072 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:19:53.391418 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac672b-df2b-4848-bfd8-e16d27581072 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:19:53.391703 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac672b-df2b-4848-bfd8-e16d27581072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:19:53.409366 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-e3ac672b-df2b-4848-bfd8-e16d27581072 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:19:53.417728 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-e3ac672b-df2b-4848-bfd8-e16d27581072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:19:53.468416 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4498/8968] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:19:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:19:53.478131 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b68489-8b09-4e12-8c36-c0e2ae5c6a2f admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:19:53.479872 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f9b68489-8b09-4e12-8c36-c0e2ae5c6a2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:19:53.537490 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b68489-8b09-4e12-8c36-c0e2ae5c6a2f admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:19:53.541088 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8620478c-68fa-4796-8027-f8ad3cb52f8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:19:53.541741 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620478c-68fa-4796-8027-f8ad3cb52f8e service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:19:53.542065 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620478c-68fa-4796-8027-f8ad3cb52f8e service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:19:53.542346 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620478c-68fa-4796-8027-f8ad3cb52f8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:19:53.552007 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8620478c-68fa-4796-8027-f8ad3cb52f8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:19:53.553457 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8620478c-68fa-4796-8027-f8ad3cb52f8e service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:19:53.563385 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4471/8969] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:19:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:19:58.522479 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375dec91-33a3-4ab1-be19-3acdba82ac37 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:19:58.523042 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375dec91-33a3-4ab1-be19-3acdba82ac37 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:19:58.523042 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375dec91-33a3-4ab1-be19-3acdba82ac37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:19:58.555808 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-375dec91-33a3-4ab1-be19-3acdba82ac37 None None] MFA Rules not processed for user `d303e4f4105348928c5697b11e69a3d1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:19:58.557405 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-375dec91-33a3-4ab1-be19-3acdba82ac37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:19:58.626763 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4499/8970] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:19:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:19:58.631406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8620478c-68fa-4796-8027-f8ad3cb52f8e service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:19:58.642090 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8620478c-68fa-4796-8027-f8ad3cb52f8e service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:19:58.646902 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ba1a8-9d97-4723-8600-3672fefe88c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:19:58.649989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ba1a8-9d97-4723-8600-3672fefe88c4 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:19:58.649989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ba1a8-9d97-4723-8600-3672fefe88c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:19:58.649989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ba1a8-9d97-4723-8600-3672fefe88c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:19:58.649989 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6ba1a8-9d97-4723-8600-3672fefe88c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:19:58.650879 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6ba1a8-9d97-4723-8600-3672fefe88c4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:19:58.736303 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4472/8971] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 22:19:58 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 22:19:58.740917 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375dec91-33a3-4ab1-be19-3acdba82ac37 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:19:58.752782 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375dec91-33a3-4ab1-be19-3acdba82ac37 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:19:58.810432 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2590ba7-b7c1-4955-9d84-4fc3e900dce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:19:58.811306 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2590ba7-b7c1-4955-9d84-4fc3e900dce5 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:19:58.811592 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2590ba7-b7c1-4955-9d84-4fc3e900dce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:19:58.811869 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2590ba7-b7c1-4955-9d84-4fc3e900dce5 admin admin] PATH_INFO: `/v3/users` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:19:58.813087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2590ba7-b7c1-4955-9d84-4fc3e900dce5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:19:58.815067 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2590ba7-b7c1-4955-9d84-4fc3e900dce5 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:19:58.929212 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4500/8972] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 22:19:58 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 22:19:58.933341 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ba1a8-9d97-4723-8600-3672fefe88c4 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:19:58.945189 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ba1a8-9d97-4723-8600-3672fefe88c4 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:19:58.949900 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add64ffa-ad6f-4a23-b227-7fcce54aa74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:19:58.950566 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add64ffa-ad6f-4a23-b227-7fcce54aa74e admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:19:58.950855 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add64ffa-ad6f-4a23-b227-7fcce54aa74e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:19:58.951130 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add64ffa-ad6f-4a23-b227-7fcce54aa74e admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:19:58.951845 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add64ffa-ad6f-4a23-b227-7fcce54aa74e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:19:58.954201 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add64ffa-ad6f-4a23-b227-7fcce54aa74e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:19:58.966277 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4473/8973] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 22:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 22:19:58.970580 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2590ba7-b7c1-4955-9d84-4fc3e900dce5 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:19:58.981080 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2590ba7-b7c1-4955-9d84-4fc3e900dce5 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:19:58.986081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d752c7c-2dcd-4109-a016-d66f4a8fad97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:19:58.986984 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d752c7c-2dcd-4109-a016-d66f4a8fad97 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:19:58.987269 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d752c7c-2dcd-4109-a016-d66f4a8fad97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:19:58.987689 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d752c7c-2dcd-4109-a016-d66f4a8fad97 admin admin] PATH_INFO: `/v3/projects/e5c273ef4c474a6e9d3ea3e0feabf298/users/13092a42d13140f4bb51260db1115b9d/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:19:59.005363 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d752c7c-2dcd-4109-a016-d66f4a8fad97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5c273ef4c474a6e9d3ea3e0feabf298, user_id=13092a42d13140f4bb51260db1115b9d, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:19:59.008081 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d752c7c-2dcd-4109-a016-d66f4a8fad97 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:19:59.105857 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4501/8974] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 22:19:58 2022] PUT /identity/v3/projects/e5c273ef4c474a6e9d3ea3e0feabf298/users/13092a42d13140f4bb51260db1115b9d/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:19:59.110075 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add64ffa-ad6f-4a23-b227-7fcce54aa74e admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:19:59.120522 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add64ffa-ad6f-4a23-b227-7fcce54aa74e admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:19:59.174820 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91743e3d-1d7c-47c0-9064-e33bc7c7512e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:19:59.175438 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91743e3d-1d7c-47c0-9064-e33bc7c7512e admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:19:59.175724 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91743e3d-1d7c-47c0-9064-e33bc7c7512e admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:19:59.176007 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91743e3d-1d7c-47c0-9064-e33bc7c7512e admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:19:59.176713 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91743e3d-1d7c-47c0-9064-e33bc7c7512e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:19:59.178429 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91743e3d-1d7c-47c0-9064-e33bc7c7512e admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:19:59.188535 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4474/8975] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 22:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 22:19:59.192865 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d752c7c-2dcd-4109-a016-d66f4a8fad97 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:19:59.203630 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d752c7c-2dcd-4109-a016-d66f4a8fad97 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:19:59.208201 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f61e77-13da-4237-8cbc-05a166d3a540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:19:59.209073 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f61e77-13da-4237-8cbc-05a166d3a540 admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:19:59.209355 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f61e77-13da-4237-8cbc-05a166d3a540 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:19:59.209626 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f61e77-13da-4237-8cbc-05a166d3a540 admin admin] PATH_INFO: `/v3/projects/e5c273ef4c474a6e9d3ea3e0feabf298/users/13092a42d13140f4bb51260db1115b9d/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:19:59.211618 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f61e77-13da-4237-8cbc-05a166d3a540 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5c273ef4c474a6e9d3ea3e0feabf298, user_id=13092a42d13140f4bb51260db1115b9d, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:19:59.214286 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f61e77-13da-4237-8cbc-05a166d3a540 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:19:59.224281 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4502/8976] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 22:19:59 2022] PUT /identity/v3/projects/e5c273ef4c474a6e9d3ea3e0feabf298/users/13092a42d13140f4bb51260db1115b9d/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:20:04.850257 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41295719-3c77-4d6f-82a7-b603eb1718b6 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:20:04.850721 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41295719-3c77-4d6f-82a7-b603eb1718b6 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:20:04.851433 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41295719-3c77-4d6f-82a7-b603eb1718b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:20:04.887156 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-41295719-3c77-4d6f-82a7-b603eb1718b6 None None] MFA Rules not processed for user `13092a42d13140f4bb51260db1115b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:20:04.888381 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-41295719-3c77-4d6f-82a7-b603eb1718b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:20:04.967466 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4475/8977] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:20:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:20:04.979047 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f61e77-13da-4237-8cbc-05a166d3a540 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:20:04.980812 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f6f61e77-13da-4237-8cbc-05a166d3a540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:20:05.059269 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f61e77-13da-4237-8cbc-05a166d3a540 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:20:05.066087 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9beba-78db-48bb-aafe-b0b904a44b67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:20:05.066585 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9beba-78db-48bb-aafe-b0b904a44b67 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:20:05.066877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9beba-78db-48bb-aafe-b0b904a44b67 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:20:05.067168 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9beba-78db-48bb-aafe-b0b904a44b67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:20:05.125951 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe9beba-78db-48bb-aafe-b0b904a44b67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:20:05.127575 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe9beba-78db-48bb-aafe-b0b904a44b67 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:20:05.139939 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4503/8978] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:20:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:20:08.194268 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3ef1d-c7bc-44e9-b591-a2fa30e8114c None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:20:08.194793 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3ef1d-c7bc-44e9-b591-a2fa30e8114c None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:20:08.195034 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3ef1d-c7bc-44e9-b591-a2fa30e8114c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:20:08.216064 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-c9b3ef1d-c7bc-44e9-b591-a2fa30e8114c None None] MFA Rules not processed for user `d303e4f4105348928c5697b11e69a3d1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:20:08.217276 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c9b3ef1d-c7bc-44e9-b591-a2fa30e8114c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:20:08.224766 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4476/8979] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:20:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:20:08.550918 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9beba-78db-48bb-aafe-b0b904a44b67 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:20:08.552517 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-4fe9beba-78db-48bb-aafe-b0b904a44b67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:20:08.611987 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9beba-78db-48bb-aafe-b0b904a44b67 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:20:08.616067 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb3e7fd-48a1-47a2-af4d-a58993b22012 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:20:08.616832 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3e7fd-48a1-47a2-af4d-a58993b22012 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:20:08.617241 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3e7fd-48a1-47a2-af4d-a58993b22012 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:20:08.617465 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3e7fd-48a1-47a2-af4d-a58993b22012 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:20:08.619301 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ceb3e7fd-48a1-47a2-af4d-a58993b22012 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:20:08.630930 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb3e7fd-48a1-47a2-af4d-a58993b22012 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:20:08.632467 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb3e7fd-48a1-47a2-af4d-a58993b22012 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:20:08.641838 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4504/8980] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:20:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:20:12.678815 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3ef1d-c7bc-44e9-b591-a2fa30e8114c None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:20:12.692963 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3ef1d-c7bc-44e9-b591-a2fa30e8114c None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:20:12.698731 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd7c83-d981-439c-b91c-959e478cf339 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:20:12.699603 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd7c83-d981-439c-b91c-959e478cf339 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:20:12.699897 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd7c83-d981-439c-b91c-959e478cf339 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:20:12.700173 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd7c83-d981-439c-b91c-959e478cf339 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:20:12.702734 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-bbfd7c83-d981-439c-b91c-959e478cf339 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:20:12.715560 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd7c83-d981-439c-b91c-959e478cf339 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:20:12.717215 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd7c83-d981-439c-b91c-959e478cf339 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:20:12.737616 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4477/8981] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:20:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:20:17.907671 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb3e7fd-48a1-47a2-af4d-a58993b22012 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:20:17.907671 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ceb3e7fd-48a1-47a2-af4d-a58993b22012 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:20:17.924432 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb3e7fd-48a1-47a2-af4d-a58993b22012 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:20:17.931482 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984b62c-0353-49d5-95d8-b70e3b3244ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:20:17.932194 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984b62c-0353-49d5-95d8-b70e3b3244ae service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:20:17.932476 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984b62c-0353-49d5-95d8-b70e3b3244ae service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:20:17.932756 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984b62c-0353-49d5-95d8-b70e3b3244ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:20:17.934559 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2984b62c-0353-49d5-95d8-b70e3b3244ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:20:17.947562 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2984b62c-0353-49d5-95d8-b70e3b3244ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:20:17.949151 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2984b62c-0353-49d5-95d8-b70e3b3244ae service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:20:17.961068 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4505/8982] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:20:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:20:19.736081 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd7c83-d981-439c-b91c-959e478cf339 service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:20:19.745575 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd7c83-d981-439c-b91c-959e478cf339 service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:20:19.749327 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de02db1-234f-40c3-893c-a7797512aede service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:20:19.750658 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de02db1-234f-40c3-893c-a7797512aede service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:20:19.750937 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de02db1-234f-40c3-893c-a7797512aede service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:20:19.751212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de02db1-234f-40c3-893c-a7797512aede service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:20:19.760173 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de02db1-234f-40c3-893c-a7797512aede service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:20:19.761609 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de02db1-234f-40c3-893c-a7797512aede service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:20:19.770979 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4478/8983] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:20:19 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:21:01.605143 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984b62c-0353-49d5-95d8-b70e3b3244ae service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:21:01.606578 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2984b62c-0353-49d5-95d8-b70e3b3244ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:21:01.676065 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984b62c-0353-49d5-95d8-b70e3b3244ae service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:21:01.681747 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04502181-595a-4fb4-9f24-0c0c1f6ec07b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:21:01.682419 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04502181-595a-4fb4-9f24-0c0c1f6ec07b service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:21:01.682707 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04502181-595a-4fb4-9f24-0c0c1f6ec07b service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:21:01.682988 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04502181-595a-4fb4-9f24-0c0c1f6ec07b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:21:01.684768 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-04502181-595a-4fb4-9f24-0c0c1f6ec07b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:21:01.696000 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04502181-595a-4fb4-9f24-0c0c1f6ec07b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:21:01.697585 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04502181-595a-4fb4-9f24-0c0c1f6ec07b service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:21:01.707341 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4506/8984] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:21:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:21:03.769396 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de02db1-234f-40c3-893c-a7797512aede service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:21:03.770857 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-6de02db1-234f-40c3-893c-a7797512aede service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:21:03.785955 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de02db1-234f-40c3-893c-a7797512aede service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:21:03.791651 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299d074-7823-4672-8451-df4d0fc27883 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:21:03.792289 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299d074-7823-4672-8451-df4d0fc27883 service placement] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:21:03.792572 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299d074-7823-4672-8451-df4d0fc27883 service placement] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:21:03.792851 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299d074-7823-4672-8451-df4d0fc27883 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:21:03.794618 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f299d074-7823-4672-8451-df4d0fc27883 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:21:03.805912 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299d074-7823-4672-8451-df4d0fc27883 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:21:03.807611 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299d074-7823-4672-8451-df4d0fc27883 service placement] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:21:03.817554 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4479/8985] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:21:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:21:55.518877 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04502181-595a-4fb4-9f24-0c0c1f6ec07b service placement] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:21:55.543247 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04502181-595a-4fb4-9f24-0c0c1f6ec07b service placement] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:21:55.547105 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90220db2-d5bf-47bc-9508-3108b84c87a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:21:55.547751 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90220db2-d5bf-47bc-9508-3108b84c87a7 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:21:55.548031 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90220db2-d5bf-47bc-9508-3108b84c87a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:21:55.548328 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90220db2-d5bf-47bc-9508-3108b84c87a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:21:55.550206 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-90220db2-d5bf-47bc-9508-3108b84c87a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:21:55.590060 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90220db2-d5bf-47bc-9508-3108b84c87a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:21:55.591496 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90220db2-d5bf-47bc-9508-3108b84c87a7 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:21:55.599269 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4507/8986] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:21:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:22:28.506959 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92eebf3-7b37-4122-94be-52ec5672c809 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:22:28.507474 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92eebf3-7b37-4122-94be-52ec5672c809 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:22:28.507600 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92eebf3-7b37-4122-94be-52ec5672c809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:22:28.554588 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-e92eebf3-7b37-4122-94be-52ec5672c809 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:22:28.555794 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-e92eebf3-7b37-4122-94be-52ec5672c809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:22:28.630537 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4480/8987] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 22:22:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:22:28.765511 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90220db2-d5bf-47bc-9508-3108b84c87a7 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:22:28.766955 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-90220db2-d5bf-47bc-9508-3108b84c87a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:22:28.875753 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90220db2-d5bf-47bc-9508-3108b84c87a7 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:22:28.880884 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2540a6f-cea9-4b63-bd8b-ea51aad167fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:22:28.881528 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2540a6f-cea9-4b63-bd8b-ea51aad167fc service swift] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:22:28.881855 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2540a6f-cea9-4b63-bd8b-ea51aad167fc service swift] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:22:28.882117 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2540a6f-cea9-4b63-bd8b-ea51aad167fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:22:28.891530 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2540a6f-cea9-4b63-bd8b-ea51aad167fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:22:28.893197 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2540a6f-cea9-4b63-bd8b-ea51aad167fc service swift] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:22:28.902020 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4508/8988] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 22:22:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 22:22:42.712936 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92eebf3-7b37-4122-94be-52ec5672c809 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:22:42.722684 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92eebf3-7b37-4122-94be-52ec5672c809 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:22:42.726263 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c8d1f-adc7-4def-8248-ab4e6062ca13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:22:42.726907 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c8d1f-adc7-4def-8248-ab4e6062ca13 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:22:42.727195 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c8d1f-adc7-4def-8248-ab4e6062ca13 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:22:42.727475 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c8d1f-adc7-4def-8248-ab4e6062ca13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:22:42.729274 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ba1c8d1f-adc7-4def-8248-ab4e6062ca13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:22:42.739112 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c8d1f-adc7-4def-8248-ab4e6062ca13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:22:42.740563 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c8d1f-adc7-4def-8248-ab4e6062ca13 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:22:42.748632 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4481/8989] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:22:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:22:43.011021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035b07b-012b-4428-bc35-b13604f59d09 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:22:43.011588 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035b07b-012b-4428-bc35-b13604f59d09 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:22:43.011588 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035b07b-012b-4428-bc35-b13604f59d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:22:43.060554 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-5035b07b-012b-4428-bc35-b13604f59d09 None None] MFA Rules not processed for user `fca4ee1f64c8489ebe7296f9f8f0ab41`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:22:43.061856 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-5035b07b-012b-4428-bc35-b13604f59d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:22:43.071500 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4509/8990] 10.222.0.23 () {58 vars in 1018 bytes} [Sat Apr 30 22:22:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:22:43.083368 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c8d1f-adc7-4def-8248-ab4e6062ca13 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:22:43.085002 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ba1c8d1f-adc7-4def-8248-ab4e6062ca13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:22:43.163082 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c8d1f-adc7-4def-8248-ab4e6062ca13 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:22:43.166717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3fea1-db61-445c-8175-f7135389f2a4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e302b1298dd04d6590e3d079f7b13b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:22:43.167389 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3fea1-db61-445c-8175-f7135389f2a4 service glance] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:22:43.167672 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3fea1-db61-445c-8175-f7135389f2a4 service glance] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:22:43.167954 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3fea1-db61-445c-8175-f7135389f2a4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:22:43.177739 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef3fea1-db61-445c-8175-f7135389f2a4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:22:43.179222 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef3fea1-db61-445c-8175-f7135389f2a4 service glance] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:22:43.190058 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4482/8991] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:22:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:22:43.388062 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5035b07b-012b-4428-bc35-b13604f59d09 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:22:43.397392 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5035b07b-012b-4428-bc35-b13604f59d09 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:22:43.401128 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c3605-8a25-41ef-a1fc-44c01d8523bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:22:43.401784 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c3605-8a25-41ef-a1fc-44c01d8523bb service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:22:43.402078 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c3605-8a25-41ef-a1fc-44c01d8523bb service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:22:43.402361 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c3605-8a25-41ef-a1fc-44c01d8523bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:22:43.404795 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-9a4c3605-8a25-41ef-a1fc-44c01d8523bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:22:43.414109 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4c3605-8a25-41ef-a1fc-44c01d8523bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:22:43.415586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4c3605-8a25-41ef-a1fc-44c01d8523bb service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:22:43.423360 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4510/8992] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:22:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:22:43.497700 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3fea1-db61-445c-8175-f7135389f2a4 service glance] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:22:43.506928 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3fea1-db61-445c-8175-f7135389f2a4 service glance] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:22:43.510501 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f7159-177a-487f-adaa-1096ac0ad13c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:22:43.511130 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f7159-177a-487f-adaa-1096ac0ad13c service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:22:43.511441 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f7159-177a-487f-adaa-1096ac0ad13c service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:22:43.511717 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f7159-177a-487f-adaa-1096ac0ad13c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:22:43.514115 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3f3f7159-177a-487f-adaa-1096ac0ad13c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:22:43.527074 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f7159-177a-487f-adaa-1096ac0ad13c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:22:43.528536 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f7159-177a-487f-adaa-1096ac0ad13c service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:22:43.539345 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4483/8993] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:22:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:22:43.599603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c3605-8a25-41ef-a1fc-44c01d8523bb service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:22:43.611506 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c3605-8a25-41ef-a1fc-44c01d8523bb service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:22:43.616558 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7295ac-af8e-425a-9168-1feae6a322eb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:22:43.617189 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7295ac-af8e-425a-9168-1feae6a322eb service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:22:43.617736 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7295ac-af8e-425a-9168-1feae6a322eb service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:22:43.618044 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7295ac-af8e-425a-9168-1feae6a322eb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:22:43.619789 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0f7295ac-af8e-425a-9168-1feae6a322eb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:22:43.631482 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7295ac-af8e-425a-9168-1feae6a322eb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:22:43.633057 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7295ac-af8e-425a-9168-1feae6a322eb service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:22:43.643360 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4511/8994] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:22:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:22:44.786438 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f7159-177a-487f-adaa-1096ac0ad13c service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:22:44.795561 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f7159-177a-487f-adaa-1096ac0ad13c service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:22:44.799349 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92492b81-d347-4b60-bfa7-a711bfd4ccfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:22:44.800019 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92492b81-d347-4b60-bfa7-a711bfd4ccfc service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:22:44.800305 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92492b81-d347-4b60-bfa7-a711bfd4ccfc service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:22:44.800584 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92492b81-d347-4b60-bfa7-a711bfd4ccfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:22:44.802378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-92492b81-d347-4b60-bfa7-a711bfd4ccfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:22:44.812373 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92492b81-d347-4b60-bfa7-a711bfd4ccfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:22:44.813838 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92492b81-d347-4b60-bfa7-a711bfd4ccfc service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:22:44.821428 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4484/8995] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:22:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:22:46.563786 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b647d39-fb70-4421-ae4c-79774f825917 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:22:46.564417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b647d39-fb70-4421-ae4c-79774f825917 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:22:46.564417 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b647d39-fb70-4421-ae4c-79774f825917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:22:46.584626 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-2b647d39-fb70-4421-ae4c-79774f825917 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:22:46.585783 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-2b647d39-fb70-4421-ae4c-79774f825917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:22:46.595772 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4512/8996] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 22:22:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:22:46.611089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92492b81-d347-4b60-bfa7-a711bfd4ccfc service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:22:46.623985 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92492b81-d347-4b60-bfa7-a711bfd4ccfc service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:22:46.629244 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f733a1-e9a6-481e-aa72-d0b84b99cb68 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:22:46.630011 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f733a1-e9a6-481e-aa72-d0b84b99cb68 service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:22:46.630370 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f733a1-e9a6-481e-aa72-d0b84b99cb68 service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:22:46.630721 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f733a1-e9a6-481e-aa72-d0b84b99cb68 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:22:46.640077 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f733a1-e9a6-481e-aa72-d0b84b99cb68 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:22:46.641848 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f733a1-e9a6-481e-aa72-d0b84b99cb68 service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:22:46.650378 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4485/8997] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 22:22:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 22:23:01.201970 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e648b-b9ca-42c8-8c3f-3e9c78725821 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:23:01.202481 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e648b-b9ca-42c8-8c3f-3e9c78725821 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:23:01.202572 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e648b-b9ca-42c8-8c3f-3e9c78725821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:23:01.220115 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-0e3e648b-b9ca-42c8-8c3f-3e9c78725821 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:23:01.221355 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-0e3e648b-b9ca-42c8-8c3f-3e9c78725821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:23:01.228580 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4513/8998] 10.222.0.23 () {58 vars in 967 bytes} [Sat Apr 30 22:23:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:23:01.241556 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f733a1-e9a6-481e-aa72-d0b84b99cb68 service swift] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:23:01.252868 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f733a1-e9a6-481e-aa72-d0b84b99cb68 service swift] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:23:01.257937 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f08ee-cd9c-42fb-826f-d8bb0916928d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:23:01.258576 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f08ee-cd9c-42fb-826f-d8bb0916928d service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:23:01.258860 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f08ee-cd9c-42fb-826f-d8bb0916928d service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:23:01.259140 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f08ee-cd9c-42fb-826f-d8bb0916928d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:23:01.267349 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f08ee-cd9c-42fb-826f-d8bb0916928d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:23:01.327035 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f08ee-cd9c-42fb-826f-d8bb0916928d service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:23:01.327035 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4486/8999] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 22:23:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 22:24:17.583838 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e648b-b9ca-42c8-8c3f-3e9c78725821 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:24:17.595531 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e648b-b9ca-42c8-8c3f-3e9c78725821 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:24:17.599166 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694b35a1-97d4-492a-9d6f-6697c5241156 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:24:17.600030 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b35a1-97d4-492a-9d6f-6697c5241156 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:24:17.600312 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b35a1-97d4-492a-9d6f-6697c5241156 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:24:17.600585 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b35a1-97d4-492a-9d6f-6697c5241156 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:24:17.602400 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-694b35a1-97d4-492a-9d6f-6697c5241156 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:24:17.616704 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b35a1-97d4-492a-9d6f-6697c5241156 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:24:17.618215 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694b35a1-97d4-492a-9d6f-6697c5241156 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:24:17.628935 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4514/9000] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:24:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 22:24:18.815544 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f08ee-cd9c-42fb-826f-d8bb0916928d service swift] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:24:18.824852 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f08ee-cd9c-42fb-826f-d8bb0916928d service swift] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:24:18.829036 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d78e5-d07e-4476-8224-74c26cb0297c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:24:18.829670 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d78e5-d07e-4476-8224-74c26cb0297c service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:24:18.829976 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d78e5-d07e-4476-8224-74c26cb0297c service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:24:18.830254 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d78e5-d07e-4476-8224-74c26cb0297c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:24:18.831975 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-602d78e5-d07e-4476-8224-74c26cb0297c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:24:18.845313 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d78e5-d07e-4476-8224-74c26cb0297c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:24:18.846756 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d78e5-d07e-4476-8224-74c26cb0297c service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:24:18.857463 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4487/9001] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:24:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:24:24.823743 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4da8a1-c497-4d7c-b9e7-fc7dc34d5246 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:24:24.828375 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4da8a1-c497-4d7c-b9e7-fc7dc34d5246 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:24:24.828375 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4da8a1-c497-4d7c-b9e7-fc7dc34d5246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:24:24.844394 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-fb4da8a1-c497-4d7c-b9e7-fc7dc34d5246 None None] MFA Rules not processed for user `d303e4f4105348928c5697b11e69a3d1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:24:24.845663 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-fb4da8a1-c497-4d7c-b9e7-fc7dc34d5246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:24:24.853815 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4515/9002] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:24:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:24:31.779943 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d78e5-d07e-4476-8224-74c26cb0297c service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:24:31.791477 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d78e5-d07e-4476-8224-74c26cb0297c service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:24:31.797104 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad0414-b85e-41d1-abed-ce48d0528f95 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:24:31.797748 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad0414-b85e-41d1-abed-ce48d0528f95 service placement] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:24:31.798058 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad0414-b85e-41d1-abed-ce48d0528f95 service placement] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:24:31.798342 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad0414-b85e-41d1-abed-ce48d0528f95 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:24:31.800095 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-89ad0414-b85e-41d1-abed-ce48d0528f95 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:24:31.811162 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad0414-b85e-41d1-abed-ce48d0528f95 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:24:31.812801 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad0414-b85e-41d1-abed-ce48d0528f95 service placement] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:24:31.822477 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4488/9003] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:24:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:24:49.324944 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4da8a1-c497-4d7c-b9e7-fc7dc34d5246 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:24:49.337428 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4da8a1-c497-4d7c-b9e7-fc7dc34d5246 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:24:49.342996 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bd3fb-8cfb-4a38-88fa-f2a2f0447566 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:24:49.343645 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bd3fb-8cfb-4a38-88fa-f2a2f0447566 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:24:49.343958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bd3fb-8cfb-4a38-88fa-f2a2f0447566 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:24:49.344238 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bd3fb-8cfb-4a38-88fa-f2a2f0447566 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:24:49.346049 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-612bd3fb-8cfb-4a38-88fa-f2a2f0447566 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:24:49.358586 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612bd3fb-8cfb-4a38-88fa-f2a2f0447566 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:24:49.363740 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612bd3fb-8cfb-4a38-88fa-f2a2f0447566 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:24:49.372147 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4516/9004] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:24:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:26:05.546322 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad0414-b85e-41d1-abed-ce48d0528f95 service placement] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:26:05.567447 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad0414-b85e-41d1-abed-ce48d0528f95 service placement] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:26:05.572466 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482d691-3532-4e7d-be18-a0bc4af6719c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:26:05.573104 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482d691-3532-4e7d-be18-a0bc4af6719c service placement] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:26:05.573386 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482d691-3532-4e7d-be18-a0bc4af6719c service placement] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:26:05.573659 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482d691-3532-4e7d-be18-a0bc4af6719c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:26:05.582797 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482d691-3532-4e7d-be18-a0bc4af6719c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:26:05.584378 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482d691-3532-4e7d-be18-a0bc4af6719c service placement] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:26:05.594189 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4489/9005] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:26:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:26:10.807764 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bd3fb-8cfb-4a38-88fa-f2a2f0447566 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:26:10.818896 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bd3fb-8cfb-4a38-88fa-f2a2f0447566 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:26:10.823941 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5f003-bdf7-4191-9382-4866e19bb470 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:26:10.824578 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5f003-bdf7-4191-9382-4866e19bb470 service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:26:10.824864 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5f003-bdf7-4191-9382-4866e19bb470 service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:26:10.825144 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5f003-bdf7-4191-9382-4866e19bb470 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:26:10.833579 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc5f003-bdf7-4191-9382-4866e19bb470 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:26:10.835248 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc5f003-bdf7-4191-9382-4866e19bb470 service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:26:10.845405 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4517/9006] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:26:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:27:00.493271 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482d691-3532-4e7d-be18-a0bc4af6719c service placement] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:27:00.512755 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482d691-3532-4e7d-be18-a0bc4af6719c service placement] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:27:00.516338 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d281569c-4dc0-4d29-bb3b-ac85cb013280 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:27:00.517009 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281569c-4dc0-4d29-bb3b-ac85cb013280 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:27:00.517289 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281569c-4dc0-4d29-bb3b-ac85cb013280 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:27:00.517568 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281569c-4dc0-4d29-bb3b-ac85cb013280 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:27:00.524839 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d281569c-4dc0-4d29-bb3b-ac85cb013280 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:27:00.526325 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d281569c-4dc0-4d29-bb3b-ac85cb013280 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:27:00.534330 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4490/9007] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:27:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:28:07.154182 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5f003-bdf7-4191-9382-4866e19bb470 service placement] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:28:07.167661 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5f003-bdf7-4191-9382-4866e19bb470 service placement] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:28:07.173523 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220dc72-a5ac-41c5-9ea1-249c1d411673 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:28:07.174204 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220dc72-a5ac-41c5-9ea1-249c1d411673 service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:28:07.174485 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220dc72-a5ac-41c5-9ea1-249c1d411673 service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:28:07.174761 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220dc72-a5ac-41c5-9ea1-249c1d411673 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:28:07.184148 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220dc72-a5ac-41c5-9ea1-249c1d411673 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:28:07.189047 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220dc72-a5ac-41c5-9ea1-249c1d411673 service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:28:07.195264 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4518/9008] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:28:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:28:11.637376 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d281569c-4dc0-4d29-bb3b-ac85cb013280 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:28:11.650925 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d281569c-4dc0-4d29-bb3b-ac85cb013280 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:28:11.656379 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca46c2d-9eff-4d14-9727-234cfddc4098 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:28:11.657662 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca46c2d-9eff-4d14-9727-234cfddc4098 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:28:11.658046 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca46c2d-9eff-4d14-9727-234cfddc4098 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:28:11.658325 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca46c2d-9eff-4d14-9727-234cfddc4098 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:28:11.667034 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca46c2d-9eff-4d14-9727-234cfddc4098 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:28:11.668643 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca46c2d-9eff-4d14-9727-234cfddc4098 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:28:11.679138 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4491/9009] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:28:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:28:13.356668 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220dc72-a5ac-41c5-9ea1-249c1d411673 service nova] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:28:13.366174 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220dc72-a5ac-41c5-9ea1-249c1d411673 service nova] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:28:13.369947 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac40f1-5e12-42f4-9856-149474b04f30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:28:13.370582 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac40f1-5e12-42f4-9856-149474b04f30 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:28:13.370860 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac40f1-5e12-42f4-9856-149474b04f30 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:28:13.371132 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac40f1-5e12-42f4-9856-149474b04f30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:28:13.431038 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac40f1-5e12-42f4-9856-149474b04f30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:28:13.432495 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac40f1-5e12-42f4-9856-149474b04f30 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:28:13.442951 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4519/9010] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:28:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:28:20.750769 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca46c2d-9eff-4d14-9727-234cfddc4098 service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:28:20.761872 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca46c2d-9eff-4d14-9727-234cfddc4098 service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:28:20.766616 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7fbba-b0b7-4ec7-930b-15ea56e8283c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:28:20.768020 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7fbba-b0b7-4ec7-930b-15ea56e8283c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:28:20.768304 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7fbba-b0b7-4ec7-930b-15ea56e8283c admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:28:20.768581 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7fbba-b0b7-4ec7-930b-15ea56e8283c admin admin] PATH_INFO: `/v3/users/d303e4f4105348928c5697b11e69a3d1` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:28:20.769800 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c7fbba-b0b7-4ec7-930b-15ea56e8283c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d303e4f4105348928c5697b11e69a3d1)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:28:20.771780 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c7fbba-b0b7-4ec7-930b-15ea56e8283c admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:28:20.946780 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c3c7fbba-b0b7-4ec7-930b-15ea56e8283c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd303e4f4105348928c5697b11e69a3d1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:28:20.959237 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c3c7fbba-b0b7-4ec7-930b-15ea56e8283c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd303e4f4105348928c5697b11e69a3d1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:28:21.059632 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c3c7fbba-b0b7-4ec7-930b-15ea56e8283c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd303e4f4105348928c5697b11e69a3d1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:28:21.060273 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c3c7fbba-b0b7-4ec7-930b-15ea56e8283c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd303e4f4105348928c5697b11e69a3d1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:28:21.068422 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-c3c7fbba-b0b7-4ec7-930b-15ea56e8283c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd303e4f4105348928c5697b11e69a3d1'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:28:21.074437 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4492/9011] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 22:28:20 2022] DELETE /identity/v3/users/d303e4f4105348928c5697b11e69a3d1 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:28:21.309033 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac40f1-5e12-42f4-9856-149474b04f30 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:28:21.321157 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac40f1-5e12-42f4-9856-149474b04f30 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:28:21.379947 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cbd81d-7395-49c4-bd5b-8c298ce8ca93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:28:21.380791 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cbd81d-7395-49c4-bd5b-8c298ce8ca93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:28:21.381070 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cbd81d-7395-49c4-bd5b-8c298ce8ca93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:28:21.381344 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cbd81d-7395-49c4-bd5b-8c298ce8ca93 admin admin] PATH_INFO: `/v3/projects/7a470c13c84849f28ff3b1d4bb55c4e4` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:28:21.382541 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cbd81d-7395-49c4-bd5b-8c298ce8ca93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a470c13c84849f28ff3b1d4bb55c4e4)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:28:21.384447 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cbd81d-7395-49c4-bd5b-8c298ce8ca93 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:28:21.502876 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-99cbd81d-7395-49c4-bd5b-8c298ce8ca93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a470c13c84849f28ff3b1d4bb55c4e4', 'request_id': 'req-99cbd81d-7395-49c4-bd5b-8c298ce8ca93'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:28:21.508216 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-99cbd81d-7395-49c4-bd5b-8c298ce8ca93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a470c13c84849f28ff3b1d4bb55c4e4', 'request_id': 'req-99cbd81d-7395-49c4-bd5b-8c298ce8ca93'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:28:21.514433 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-99cbd81d-7395-49c4-bd5b-8c298ce8ca93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a470c13c84849f28ff3b1d4bb55c4e4', 'request_id': 'req-99cbd81d-7395-49c4-bd5b-8c298ce8ca93'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:28:21.589744 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-99cbd81d-7395-49c4-bd5b-8c298ce8ca93 admin admin] The token cache is being invalidate because project 7a470c13c84849f28ff3b1d4bb55c4e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 22:28:21.589981 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-99cbd81d-7395-49c4-bd5b-8c298ce8ca93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:28:21.590597 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-99cbd81d-7395-49c4-bd5b-8c298ce8ca93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:28:21.592197 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4520/9012] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 22:28:21 2022] DELETE /identity/v3/projects/7a470c13c84849f28ff3b1d4bb55c4e4 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:28:21.596404 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7fbba-b0b7-4ec7-930b-15ea56e8283c admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:28:21.597987 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-c3c7fbba-b0b7-4ec7-930b-15ea56e8283c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:28:21.612004 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7fbba-b0b7-4ec7-930b-15ea56e8283c admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:28:21.667780 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d5639-9c3a-4808-801a-e5c6f4d71ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:28:21.668656 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d5639-9c3a-4808-801a-e5c6f4d71ee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:28:21.668945 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d5639-9c3a-4808-801a-e5c6f4d71ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:28:21.669226 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d5639-9c3a-4808-801a-e5c6f4d71ee0 admin admin] PATH_INFO: `/v3/users/13092a42d13140f4bb51260db1115b9d` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:28:21.670424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d5639-9c3a-4808-801a-e5c6f4d71ee0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13092a42d13140f4bb51260db1115b9d)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:28:21.672368 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d5639-9c3a-4808-801a-e5c6f4d71ee0 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:28:21.829531 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f53d5639-9c3a-4808-801a-e5c6f4d71ee0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13092a42d13140f4bb51260db1115b9d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:28:21.841310 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f53d5639-9c3a-4808-801a-e5c6f4d71ee0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13092a42d13140f4bb51260db1115b9d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:28:21.913029 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f53d5639-9c3a-4808-801a-e5c6f4d71ee0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13092a42d13140f4bb51260db1115b9d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:28:21.913661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f53d5639-9c3a-4808-801a-e5c6f4d71ee0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13092a42d13140f4bb51260db1115b9d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:28:21.920798 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-f53d5639-9c3a-4808-801a-e5c6f4d71ee0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13092a42d13140f4bb51260db1115b9d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:28:21.927333 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4493/9013] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 22:28:21 2022] DELETE /identity/v3/users/13092a42d13140f4bb51260db1115b9d => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:28:22.177976 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cbd81d-7395-49c4-bd5b-8c298ce8ca93 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:28:22.179450 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-99cbd81d-7395-49c4-bd5b-8c298ce8ca93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:28:22.193473 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cbd81d-7395-49c4-bd5b-8c298ce8ca93 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:28:22.253499 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8acecee-6a3e-4f66-8586-fd233d0a9c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:28:22.254388 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8acecee-6a3e-4f66-8586-fd233d0a9c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:28:22.254677 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8acecee-6a3e-4f66-8586-fd233d0a9c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:28:22.254956 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8acecee-6a3e-4f66-8586-fd233d0a9c17 admin admin] PATH_INFO: `/v3/projects/e5c273ef4c474a6e9d3ea3e0feabf298` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:28:22.256172 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8acecee-6a3e-4f66-8586-fd233d0a9c17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5c273ef4c474a6e9d3ea3e0feabf298)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:28:22.258150 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8acecee-6a3e-4f66-8586-fd233d0a9c17 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:28:22.387466 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a8acecee-6a3e-4f66-8586-fd233d0a9c17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5c273ef4c474a6e9d3ea3e0feabf298', 'request_id': 'req-a8acecee-6a3e-4f66-8586-fd233d0a9c17'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:28:22.393473 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a8acecee-6a3e-4f66-8586-fd233d0a9c17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5c273ef4c474a6e9d3ea3e0feabf298', 'request_id': 'req-a8acecee-6a3e-4f66-8586-fd233d0a9c17'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:28:22.400424 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a8acecee-6a3e-4f66-8586-fd233d0a9c17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5c273ef4c474a6e9d3ea3e0feabf298', 'request_id': 'req-a8acecee-6a3e-4f66-8586-fd233d0a9c17'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:28:22.492211 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a8acecee-6a3e-4f66-8586-fd233d0a9c17 admin admin] The token cache is being invalidate because project e5c273ef4c474a6e9d3ea3e0feabf298 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 22:28:22.492495 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a8acecee-6a3e-4f66-8586-fd233d0a9c17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:28:22.493119 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-a8acecee-6a3e-4f66-8586-fd233d0a9c17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:28:22.494772 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4521/9014] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 22:28:22 2022] DELETE /identity/v3/projects/e5c273ef4c474a6e9d3ea3e0feabf298 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:28:22.499978 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d421d46-0c86-4eeb-98c6-ba66417edb95 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:28:22.500552 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d421d46-0c86-4eeb-98c6-ba66417edb95 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:28:22.500836 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d421d46-0c86-4eeb-98c6-ba66417edb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:28:22.530558 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-8d421d46-0c86-4eeb-98c6-ba66417edb95 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:28:22.531789 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-8d421d46-0c86-4eeb-98c6-ba66417edb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:28:22.589219 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4494/9015] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:28:22.596948 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22158a07-8c5c-4757-84bf-8b852bffbe12 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:28:22.597234 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22158a07-8c5c-4757-84bf-8b852bffbe12 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:28:22.597515 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22158a07-8c5c-4757-84bf-8b852bffbe12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:28:22.616193 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-22158a07-8c5c-4757-84bf-8b852bffbe12 None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:28:22.617419 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-22158a07-8c5c-4757-84bf-8b852bffbe12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:28:22.625555 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4522/9016] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:28:22.630191 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d421d46-0c86-4eeb-98c6-ba66417edb95 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:28:22.639892 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d421d46-0c86-4eeb-98c6-ba66417edb95 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:28:22.644967 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a3164-60fb-4299-8063-a287ceeb2a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:28:22.645613 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a3164-60fb-4299-8063-a287ceeb2a87 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:28:22.645939 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a3164-60fb-4299-8063-a287ceeb2a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:28:22.646216 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a3164-60fb-4299-8063-a287ceeb2a87 admin admin] PATH_INFO: `/v3/domains` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:28:22.646924 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a3164-60fb-4299-8063-a287ceeb2a87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 30 22:28:22.647228 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a3164-60fb-4299-8063-a287ceeb2a87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:28:22.648847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a3164-60fb-4299-8063-a287ceeb2a87 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:28:22.660108 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4495/9017] 10.222.0.23 () {58 vars in 1152 bytes} [Sat Apr 30 22:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 30 22:28:22.664153 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22158a07-8c5c-4757-84bf-8b852bffbe12 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:28:22.673438 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22158a07-8c5c-4757-84bf-8b852bffbe12 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:28:22.677982 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f1fcb-ac0d-457e-b920-5e50b66227cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:28:22.678629 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f1fcb-ac0d-457e-b920-5e50b66227cf admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:28:22.678915 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f1fcb-ac0d-457e-b920-5e50b66227cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:28:22.679196 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f1fcb-ac0d-457e-b920-5e50b66227cf admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:28:22.679896 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f1fcb-ac0d-457e-b920-5e50b66227cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:28:22.681845 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f1fcb-ac0d-457e-b920-5e50b66227cf admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:28:22.776198 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4523/9018] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 22:28:22 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 22:28:22.782121 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a3164-60fb-4299-8063-a287ceeb2a87 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:28:22.792463 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a3164-60fb-4299-8063-a287ceeb2a87 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:28:22.847828 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d26481-2255-4a6d-a3d9-fd4edb08b8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:28:22.848495 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d26481-2255-4a6d-a3d9-fd4edb08b8f3 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:28:22.848780 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d26481-2255-4a6d-a3d9-fd4edb08b8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:28:22.849057 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d26481-2255-4a6d-a3d9-fd4edb08b8f3 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:28:22.849744 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d26481-2255-4a6d-a3d9-fd4edb08b8f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:28:22.851711 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d26481-2255-4a6d-a3d9-fd4edb08b8f3 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:28:22.938674 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4496/9019] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 22:28:22 2022] POST /identity/v3/users => generated 288 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 22:28:22.951264 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f1fcb-ac0d-457e-b920-5e50b66227cf admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:28:22.962162 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f1fcb-ac0d-457e-b920-5e50b66227cf admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:28:22.966779 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5e2a7-3d10-44c7-83a2-aab5cbcd28c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:28:22.967430 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5e2a7-3d10-44c7-83a2-aab5cbcd28c6 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:28:22.967709 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5e2a7-3d10-44c7-83a2-aab5cbcd28c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:28:22.967986 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5e2a7-3d10-44c7-83a2-aab5cbcd28c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:28:22.968701 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5e2a7-3d10-44c7-83a2-aab5cbcd28c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:28:22.970479 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5e2a7-3d10-44c7-83a2-aab5cbcd28c6 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:28:22.980268 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4524/9020] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 22:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 22:28:22.984145 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d26481-2255-4a6d-a3d9-fd4edb08b8f3 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:28:22.994918 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d26481-2255-4a6d-a3d9-fd4edb08b8f3 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:28:22.999532 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d2487-5be2-48a2-b6aa-c39c944ae231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:28:23.000182 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d2487-5be2-48a2-b6aa-c39c944ae231 admin admin] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:28:23.000467 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d2487-5be2-48a2-b6aa-c39c944ae231 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:28:23.000754 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d2487-5be2-48a2-b6aa-c39c944ae231 admin admin] PATH_INFO: `/v3/roles` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:28:23.002128 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515d2487-5be2-48a2-b6aa-c39c944ae231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:28:23.003728 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515d2487-5be2-48a2-b6aa-c39c944ae231 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:28:23.015291 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4497/9021] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 22:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 22:28:23.019175 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5e2a7-3d10-44c7-83a2-aab5cbcd28c6 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:28:23.029055 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5e2a7-3d10-44c7-83a2-aab5cbcd28c6 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:28:23.033726 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f807b-c729-408a-8868-6fa382fa838e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:28:23.034628 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f807b-c729-408a-8868-6fa382fa838e admin admin] REQUEST_METHOD: `PUT` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:28:23.034937 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f807b-c729-408a-8868-6fa382fa838e admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:28:23.035219 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f807b-c729-408a-8868-6fa382fa838e admin admin] PATH_INFO: `/v3/projects/c4862e1bc1ce438aa0618a97d585b7b5/users/c7b2e90478f846f6adb5bd5630e97293/roles/9f25fed676d84770b9dc2a96a769de28` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:28:23.049971 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f807b-c729-408a-8868-6fa382fa838e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4862e1bc1ce438aa0618a97d585b7b5, user_id=c7b2e90478f846f6adb5bd5630e97293, role_id=9f25fed676d84770b9dc2a96a769de28)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:28:23.052714 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f807b-c729-408a-8868-6fa382fa838e admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:28:23.127654 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4525/9022] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 22:28:23 2022] PUT /identity/v3/projects/c4862e1bc1ce438aa0618a97d585b7b5/users/c7b2e90478f846f6adb5bd5630e97293/roles/9f25fed676d84770b9dc2a96a769de28 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:28:23.132752 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc1cac-a796-4439-b934-9b8c01fc673d None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:28:23.133046 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc1cac-a796-4439-b934-9b8c01fc673d None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:28:23.133336 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc1cac-a796-4439-b934-9b8c01fc673d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:28:23.150357 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-14bc1cac-a796-4439-b934-9b8c01fc673d None None] MFA Rules not processed for user `53a451439fd64d8ca37cd0e229eb98e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:28:23.151547 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-14bc1cac-a796-4439-b934-9b8c01fc673d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:28:23.208852 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4498/9023] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:28:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:28:23.218426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f807b-c729-408a-8868-6fa382fa838e admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:28:23.220702 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-fb8f807b-c729-408a-8868-6fa382fa838e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:28:23.283970 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f807b-c729-408a-8868-6fa382fa838e admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:28:23.287751 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b49323-836c-44f1-902d-54d6637e37a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:28:23.288404 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b49323-836c-44f1-902d-54d6637e37a4 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:28:23.288691 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b49323-836c-44f1-902d-54d6637e37a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:28:23.288975 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b49323-836c-44f1-902d-54d6637e37a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:28:23.298930 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b49323-836c-44f1-902d-54d6637e37a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:28:23.300384 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b49323-836c-44f1-902d-54d6637e37a4 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:28:23.309929 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4526/9024] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:28:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 22:28:28.820828 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df03789-cd9e-4e27-80e4-a095031ec1c6 None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:28:28.821354 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df03789-cd9e-4e27-80e4-a095031ec1c6 None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:28:28.821445 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df03789-cd9e-4e27-80e4-a095031ec1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:28:28.851066 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-4df03789-cd9e-4e27-80e4-a095031ec1c6 None None] MFA Rules not processed for user `c7b2e90478f846f6adb5bd5630e97293`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:28:28.852275 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-4df03789-cd9e-4e27-80e4-a095031ec1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:28:28.929447 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4499/9025] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:28:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 30 22:28:28.934356 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b49323-836c-44f1-902d-54d6637e37a4 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:28:28.949903 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b49323-836c-44f1-902d-54d6637e37a4 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:28:28.955049 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce72c36-9606-4ec8-847a-18a1946fad75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:28:28.955750 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce72c36-9606-4ec8-847a-18a1946fad75 admin admin] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:28:28.956032 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce72c36-9606-4ec8-847a-18a1946fad75 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:28:28.956311 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce72c36-9606-4ec8-847a-18a1946fad75 admin admin] PATH_INFO: `/v3/projects` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:28:28.957009 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce72c36-9606-4ec8-847a-18a1946fad75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:28:28.959123 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce72c36-9606-4ec8-847a-18a1946fad75 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:28:29.060676 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4527/9026] 10.222.0.23 () {60 vars in 1152 bytes} [Sat Apr 30 22:28:28 2022] POST /identity/v3/projects => generated 375 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 30 22:28:29.061818 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df03789-cd9e-4e27-80e4-a095031ec1c6 None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:28:29.074873 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df03789-cd9e-4e27-80e4-a095031ec1c6 None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:28:29.135400 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fccaf-a4bc-4a8d-832a-25bd962b0018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:28:29.136131 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fccaf-a4bc-4a8d-832a-25bd962b0018 admin admin] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:28:29.136420 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fccaf-a4bc-4a8d-832a-25bd962b0018 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:28:29.136697 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fccaf-a4bc-4a8d-832a-25bd962b0018 admin admin] PATH_INFO: `/v3/users` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:28:29.137422 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fccaf-a4bc-4a8d-832a-25bd962b0018 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:28:29.139413 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fccaf-a4bc-4a8d-832a-25bd962b0018 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:28:29.230379 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4500/9027] 10.222.0.23 () {60 vars in 1143 bytes} [Sat Apr 30 22:28:29 2022] POST /identity/v3/users => generated 294 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 30 22:28:29.234595 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce72c36-9606-4ec8-847a-18a1946fad75 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:28:29.245143 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce72c36-9606-4ec8-847a-18a1946fad75 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:28:29.249715 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec82b3-ea15-40eb-9714-a92fb90f8838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:28:29.251958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec82b3-ea15-40eb-9714-a92fb90f8838 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:28:29.251958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec82b3-ea15-40eb-9714-a92fb90f8838 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:28:29.251958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec82b3-ea15-40eb-9714-a92fb90f8838 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:28:29.252196 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec82b3-ea15-40eb-9714-a92fb90f8838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:28:29.253787 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec82b3-ea15-40eb-9714-a92fb90f8838 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:28:29.264277 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4528/9028] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 22:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 30 22:28:29.269277 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fccaf-a4bc-4a8d-832a-25bd962b0018 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:28:29.283722 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fccaf-a4bc-4a8d-832a-25bd962b0018 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:28:29.289360 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c14c0c-5731-4129-b285-f2da539ffaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:28:29.291927 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c14c0c-5731-4129-b285-f2da539ffaa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:28:29.293886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c14c0c-5731-4129-b285-f2da539ffaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:28:29.293886 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c14c0c-5731-4129-b285-f2da539ffaa4 admin admin] PATH_INFO: `/v3/projects/4b3ee6f889f74dd6a9cb5bee94d0752e/users/3d0a989b6e854b32a7951e77dcd86c4d/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:28:29.308992 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c14c0c-5731-4129-b285-f2da539ffaa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b3ee6f889f74dd6a9cb5bee94d0752e, user_id=3d0a989b6e854b32a7951e77dcd86c4d, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:28:29.311858 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c14c0c-5731-4129-b285-f2da539ffaa4 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:28:29.379959 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4501/9029] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 22:28:29 2022] PUT /identity/v3/projects/4b3ee6f889f74dd6a9cb5bee94d0752e/users/3d0a989b6e854b32a7951e77dcd86c4d/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:28:29.384088 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec82b3-ea15-40eb-9714-a92fb90f8838 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:28:29.395129 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec82b3-ea15-40eb-9714-a92fb90f8838 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:28:29.450322 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a514aa-e391-4c0e-914e-65de68599126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:28:29.451027 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a514aa-e391-4c0e-914e-65de68599126 admin admin] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:28:29.451315 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a514aa-e391-4c0e-914e-65de68599126 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:28:29.451593 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a514aa-e391-4c0e-914e-65de68599126 admin admin] PATH_INFO: `/v3/roles` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:28:29.452307 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a514aa-e391-4c0e-914e-65de68599126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:28:29.453957 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a514aa-e391-4c0e-914e-65de68599126 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:28:29.464289 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4529/9030] 10.222.0.23 () {58 vars in 1121 bytes} [Sat Apr 30 22:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 30 22:28:29.468436 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c14c0c-5731-4129-b285-f2da539ffaa4 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:28:29.478953 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c14c0c-5731-4129-b285-f2da539ffaa4 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:28:29.483549 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa647468-ecfa-40d9-82c7-348d3050934d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:28:29.484411 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa647468-ecfa-40d9-82c7-348d3050934d admin admin] REQUEST_METHOD: `PUT` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:28:29.484699 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa647468-ecfa-40d9-82c7-348d3050934d admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:28:29.484977 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa647468-ecfa-40d9-82c7-348d3050934d admin admin] PATH_INFO: `/v3/projects/4b3ee6f889f74dd6a9cb5bee94d0752e/users/3d0a989b6e854b32a7951e77dcd86c4d/roles/30112eb1f3e047398c3c82fb40b72e62` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:28:29.487415 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa647468-ecfa-40d9-82c7-348d3050934d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b3ee6f889f74dd6a9cb5bee94d0752e, user_id=3d0a989b6e854b32a7951e77dcd86c4d, role_id=30112eb1f3e047398c3c82fb40b72e62)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:28:29.490164 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa647468-ecfa-40d9-82c7-348d3050934d admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:28:29.500459 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4502/9031] 10.222.0.23 () {60 vars in 1482 bytes} [Sat Apr 30 22:28:29 2022] PUT /identity/v3/projects/4b3ee6f889f74dd6a9cb5bee94d0752e/users/3d0a989b6e854b32a7951e77dcd86c4d/roles/30112eb1f3e047398c3c82fb40b72e62 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:28:35.090827 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3f820-99b5-4b17-be45-beb6bda93b78 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:28:35.091299 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3f820-99b5-4b17-be45-beb6bda93b78 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:28:35.091398 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3f820-99b5-4b17-be45-beb6bda93b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:28:35.122515 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-c7b3f820-99b5-4b17-be45-beb6bda93b78 None None] MFA Rules not processed for user `3d0a989b6e854b32a7951e77dcd86c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:28:35.124602 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-c7b3f820-99b5-4b17-be45-beb6bda93b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:28:35.194733 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4530/9032] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:28:35 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:28:35.207182 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa647468-ecfa-40d9-82c7-348d3050934d admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:28:35.209424 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-fa647468-ecfa-40d9-82c7-348d3050934d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:28:35.291167 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa647468-ecfa-40d9-82c7-348d3050934d admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:28:35.299170 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1b458-a721-43b3-9a37-b387f5269e61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:28:35.299829 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1b458-a721-43b3-9a37-b387f5269e61 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:28:35.300110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1b458-a721-43b3-9a37-b387f5269e61 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:28:35.300384 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1b458-a721-43b3-9a37-b387f5269e61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:28:35.359253 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e1b458-a721-43b3-9a37-b387f5269e61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:28:35.360921 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e1b458-a721-43b3-9a37-b387f5269e61 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:28:35.371200 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4503/9033] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:28:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:28:38.045986 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d5caf-7d2c-403a-bf6d-e57ff2779a20 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:28:38.046464 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d5caf-7d2c-403a-bf6d-e57ff2779a20 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:28:38.046464 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d5caf-7d2c-403a-bf6d-e57ff2779a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:28:38.064958 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-166d5caf-7d2c-403a-bf6d-e57ff2779a20 None None] MFA Rules not processed for user `c7b2e90478f846f6adb5bd5630e97293`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:28:38.066229 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-166d5caf-7d2c-403a-bf6d-e57ff2779a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:28:38.073105 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4531/9034] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:28:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:28:38.391110 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1b458-a721-43b3-9a37-b387f5269e61 service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:28:38.392720 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a6e1b458-a721-43b3-9a37-b387f5269e61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:28:38.449262 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1b458-a721-43b3-9a37-b387f5269e61 service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:28:38.452902 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532e48e-e4b2-43f4-9349-5d0a77eeab0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:28:38.453552 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532e48e-e4b2-43f4-9349-5d0a77eeab0a service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:28:38.453862 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532e48e-e4b2-43f4-9349-5d0a77eeab0a service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:28:38.454138 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532e48e-e4b2-43f4-9349-5d0a77eeab0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:28:38.455912 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f532e48e-e4b2-43f4-9349-5d0a77eeab0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:28:38.467158 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f532e48e-e4b2-43f4-9349-5d0a77eeab0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:28:38.468620 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f532e48e-e4b2-43f4-9349-5d0a77eeab0a service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:28:38.477227 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4504/9035] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:28:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:28:38.861519 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d5caf-7d2c-403a-bf6d-e57ff2779a20 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:28:38.862967 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-166d5caf-7d2c-403a-bf6d-e57ff2779a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:28:38.964309 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d5caf-7d2c-403a-bf6d-e57ff2779a20 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:28:38.969722 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19737a06-8881-431c-91d5-ef1b15998556 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:28:38.970405 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19737a06-8881-431c-91d5-ef1b15998556 service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:28:38.970690 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19737a06-8881-431c-91d5-ef1b15998556 service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:28:38.970966 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19737a06-8881-431c-91d5-ef1b15998556 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:28:38.972779 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-19737a06-8881-431c-91d5-ef1b15998556 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:28:38.984547 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19737a06-8881-431c-91d5-ef1b15998556 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:28:38.986595 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19737a06-8881-431c-91d5-ef1b15998556 service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:28:38.996889 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4532/9036] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:28:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:28:48.139508 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532e48e-e4b2-43f4-9349-5d0a77eeab0a service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:28:48.163885 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532e48e-e4b2-43f4-9349-5d0a77eeab0a service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:28:48.169966 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bea404-c02a-44fd-9685-cc5ca13ebf10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:28:48.170625 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bea404-c02a-44fd-9685-cc5ca13ebf10 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:28:48.170910 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bea404-c02a-44fd-9685-cc5ca13ebf10 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:28:48.171187 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bea404-c02a-44fd-9685-cc5ca13ebf10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:28:48.173649 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-02bea404-c02a-44fd-9685-cc5ca13ebf10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:28:48.186912 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bea404-c02a-44fd-9685-cc5ca13ebf10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:28:48.188680 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bea404-c02a-44fd-9685-cc5ca13ebf10 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:28:48.199758 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4505/9037] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:28:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:28:50.777904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19737a06-8881-431c-91d5-ef1b15998556 service placement] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:28:50.787132 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19737a06-8881-431c-91d5-ef1b15998556 service placement] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:28:50.790852 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428af3b3-f8bf-4fa2-8897-97997b60f5cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:28:50.791485 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428af3b3-f8bf-4fa2-8897-97997b60f5cd service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:28:50.791769 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428af3b3-f8bf-4fa2-8897-97997b60f5cd service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:28:50.792069 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428af3b3-f8bf-4fa2-8897-97997b60f5cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:28:50.801553 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428af3b3-f8bf-4fa2-8897-97997b60f5cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:28:50.803048 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428af3b3-f8bf-4fa2-8897-97997b60f5cd service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:28:50.812405 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4533/9038] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:28:50 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:30:48.340089 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bea404-c02a-44fd-9685-cc5ca13ebf10 service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:30:48.341574 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-02bea404-c02a-44fd-9685-cc5ca13ebf10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:30:48.397087 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bea404-c02a-44fd-9685-cc5ca13ebf10 service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:30:48.400661 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9dfa1-5e15-431c-af3c-ba683da641c2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e302b1298dd04d6590e3d079f7b13b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:30:48.401302 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9dfa1-5e15-431c-af3c-ba683da641c2 service glance] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:30:48.401584 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9dfa1-5e15-431c-af3c-ba683da641c2 service glance] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:30:48.401899 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9dfa1-5e15-431c-af3c-ba683da641c2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:30:48.403682 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-19b9dfa1-5e15-431c-af3c-ba683da641c2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:30:48.417029 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b9dfa1-5e15-431c-af3c-ba683da641c2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:30:48.418511 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b9dfa1-5e15-431c-af3c-ba683da641c2 service glance] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:30:48.429728 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4506/9039] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:30:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:30:53.189348 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165907b8-e1a9-461a-a7a3-c81f53d4dee5 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:30:53.189996 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165907b8-e1a9-461a-a7a3-c81f53d4dee5 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:30:53.190626 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165907b8-e1a9-461a-a7a3-c81f53d4dee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:30:53.220856 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-165907b8-e1a9-461a-a7a3-c81f53d4dee5 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:30:53.222379 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-165907b8-e1a9-461a-a7a3-c81f53d4dee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:30:53.278815 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4534/9040] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 22:30:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:30:53.452085 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9dfa1-5e15-431c-af3c-ba683da641c2 service glance] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:30:53.453511 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-19b9dfa1-5e15-431c-af3c-ba683da641c2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:30:53.522704 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9dfa1-5e15-431c-af3c-ba683da641c2 service glance] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:30:53.527719 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d82274-8f81-4098-a9d7-c23dc8de6150 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:30:53.528361 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d82274-8f81-4098-a9d7-c23dc8de6150 service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:30:53.528664 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d82274-8f81-4098-a9d7-c23dc8de6150 service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:30:53.528936 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d82274-8f81-4098-a9d7-c23dc8de6150 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:30:53.536906 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d82274-8f81-4098-a9d7-c23dc8de6150 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:30:53.538543 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d82274-8f81-4098-a9d7-c23dc8de6150 service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:30:53.546427 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4507/9041] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 22:30:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 22:31:04.430552 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66117ee-9bdc-44d9-863a-7d08ded44e10 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:31:04.431026 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66117ee-9bdc-44d9-863a-7d08ded44e10 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:31:04.431139 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66117ee-9bdc-44d9-863a-7d08ded44e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:31:04.448795 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-f66117ee-9bdc-44d9-863a-7d08ded44e10 None None] MFA Rules not processed for user `c7b2e90478f846f6adb5bd5630e97293`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:31:04.450005 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-f66117ee-9bdc-44d9-863a-7d08ded44e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:31:04.457421 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4535/9042] 10.222.0.23 () {58 vars in 957 bytes} [Sat Apr 30 22:31:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:31:04.766601 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d82274-8f81-4098-a9d7-c23dc8de6150 service swift] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:31:04.775855 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d82274-8f81-4098-a9d7-c23dc8de6150 service swift] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:31:04.779513 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e6bfd-502c-46bc-8fee-dea42a24d539 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:31:04.780151 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e6bfd-502c-46bc-8fee-dea42a24d539 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:31:04.780432 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e6bfd-502c-46bc-8fee-dea42a24d539 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:31:04.780705 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e6bfd-502c-46bc-8fee-dea42a24d539 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:31:04.782547 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3c1e6bfd-502c-46bc-8fee-dea42a24d539 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:31:04.792164 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e6bfd-502c-46bc-8fee-dea42a24d539 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:31:04.796300 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e6bfd-502c-46bc-8fee-dea42a24d539 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:31:04.801978 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4508/9043] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:31:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:31:05.219040 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66117ee-9bdc-44d9-863a-7d08ded44e10 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:31:05.232244 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66117ee-9bdc-44d9-863a-7d08ded44e10 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:31:05.238256 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c33551-e0c5-439f-a156-39b74332940d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:31:05.238912 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c33551-e0c5-439f-a156-39b74332940d service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:31:05.239195 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c33551-e0c5-439f-a156-39b74332940d service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:31:05.239493 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c33551-e0c5-439f-a156-39b74332940d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:31:05.241268 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-12c33551-e0c5-439f-a156-39b74332940d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:31:05.243921 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e6bfd-502c-46bc-8fee-dea42a24d539 service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:31:05.253210 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c33551-e0c5-439f-a156-39b74332940d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:31:05.253401 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e6bfd-502c-46bc-8fee-dea42a24d539 service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:31:05.254881 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c33551-e0c5-439f-a156-39b74332940d service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:31:05.261141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2897f-e52e-4ddb-a8fe-2dad1b277cc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:31:05.261141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2897f-e52e-4ddb-a8fe-2dad1b277cc2 service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:31:05.261141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2897f-e52e-4ddb-a8fe-2dad1b277cc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:31:05.261141 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2897f-e52e-4ddb-a8fe-2dad1b277cc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:31:05.261616 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-b1e2897f-e52e-4ddb-a8fe-2dad1b277cc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:31:05.265313 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4536/9044] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:31:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:31:05.275159 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e2897f-e52e-4ddb-a8fe-2dad1b277cc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:31:05.276724 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e2897f-e52e-4ddb-a8fe-2dad1b277cc2 service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:31:05.289338 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4509/9045] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:31:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 30 22:31:06.606265 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c33551-e0c5-439f-a156-39b74332940d service placement] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:31:06.607690 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-12c33551-e0c5-439f-a156-39b74332940d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:31:06.621688 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c33551-e0c5-439f-a156-39b74332940d service placement] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:31:06.626943 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91fc65-1cd0-43a0-a7a4-489ccbfcbf48 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:31:06.627601 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91fc65-1cd0-43a0-a7a4-489ccbfcbf48 service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:31:06.627881 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91fc65-1cd0-43a0-a7a4-489ccbfcbf48 service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:31:06.628157 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91fc65-1cd0-43a0-a7a4-489ccbfcbf48 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:31:06.629941 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-ba91fc65-1cd0-43a0-a7a4-489ccbfcbf48 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:31:06.642232 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba91fc65-1cd0-43a0-a7a4-489ccbfcbf48 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:31:06.643825 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba91fc65-1cd0-43a0-a7a4-489ccbfcbf48 service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:31:06.653807 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4537/9046] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:31:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:31:08.000788 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8676d-a363-4293-a59c-620a9532649b None None] REQUEST_METHOD: `POST` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:31:08.001316 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8676d-a363-4293-a59c-620a9532649b None None] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:31:08.001415 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8676d-a363-4293-a59c-620a9532649b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:31:08.018624 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.auth.core [None req-ede8676d-a363-4293-a59c-620a9532649b None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:31:08.019824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-ede8676d-a363-4293-a59c-620a9532649b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:31:08.027084 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4510/9047] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 22:31:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:31:08.039974 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91fc65-1cd0-43a0-a7a4-489ccbfcbf48 service placement] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:31:08.051734 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91fc65-1cd0-43a0-a7a4-489ccbfcbf48 service placement] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:31:08.057065 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56276f3e-c42e-432e-8fe1-4c0de0af777f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:31:08.057708 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56276f3e-c42e-432e-8fe1-4c0de0af777f service swift] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:31:08.058024 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56276f3e-c42e-432e-8fe1-4c0de0af777f service swift] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:31:08.058304 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56276f3e-c42e-432e-8fe1-4c0de0af777f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:31:08.066689 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56276f3e-c42e-432e-8fe1-4c0de0af777f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:31:08.070046 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56276f3e-c42e-432e-8fe1-4c0de0af777f service swift] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:31:08.076563 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4538/9048] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 22:31:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 22:31:14.756630 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede8676d-a363-4293-a59c-620a9532649b None None] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:31:14.777261 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede8676d-a363-4293-a59c-620a9532649b None None] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:31:14.782439 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187b685-5fa1-4559-b3e0-65bb033bab13 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:31:14.783115 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187b685-5fa1-4559-b3e0-65bb033bab13 service placement] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:31:14.783398 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187b685-5fa1-4559-b3e0-65bb033bab13 service placement] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:31:14.784209 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187b685-5fa1-4559-b3e0-65bb033bab13 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:31:14.786294 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-f187b685-5fa1-4559-b3e0-65bb033bab13 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:31:14.799073 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187b685-5fa1-4559-b3e0-65bb033bab13 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:31:14.801348 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187b685-5fa1-4559-b3e0-65bb033bab13 service placement] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:31:14.812189 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4511/9049] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:31:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:31:16.310358 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56276f3e-c42e-432e-8fe1-4c0de0af777f service swift] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:31:16.320368 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56276f3e-c42e-432e-8fe1-4c0de0af777f service swift] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:31:16.324204 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94931d77-db62-41e9-9a8b-a0cb809ee9e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:31:16.324855 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94931d77-db62-41e9-9a8b-a0cb809ee9e7 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:31:16.325138 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94931d77-db62-41e9-9a8b-a0cb809ee9e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:31:16.325413 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94931d77-db62-41e9-9a8b-a0cb809ee9e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:31:16.337296 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-94931d77-db62-41e9-9a8b-a0cb809ee9e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:31:16.347156 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94931d77-db62-41e9-9a8b-a0cb809ee9e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:31:16.348599 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94931d77-db62-41e9-9a8b-a0cb809ee9e7 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:31:16.356796 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4539/9050] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:31:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:32:02.513637 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187b685-5fa1-4559-b3e0-65bb033bab13 service placement] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:32:02.532495 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187b685-5fa1-4559-b3e0-65bb033bab13 service placement] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:32:02.536107 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fda5d3-2ab7-4d2e-bc49-41a3a38efccb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:32:02.536743 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fda5d3-2ab7-4d2e-bc49-41a3a38efccb service neutron] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:32:02.537031 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fda5d3-2ab7-4d2e-bc49-41a3a38efccb service neutron] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:32:02.537329 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fda5d3-2ab7-4d2e-bc49-41a3a38efccb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:32:02.539090 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-11fda5d3-2ab7-4d2e-bc49-41a3a38efccb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:32:02.580071 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fda5d3-2ab7-4d2e-bc49-41a3a38efccb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:32:02.581513 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fda5d3-2ab7-4d2e-bc49-41a3a38efccb service neutron] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:32:02.589130 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4512/9051] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:32:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:33:00.338503 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9cad6-8a9f-4f6a-9e2e-849bc4e7b0e7 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:33:00.339066 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9cad6-8a9f-4f6a-9e2e-849bc4e7b0e7 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:33:00.339066 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9cad6-8a9f-4f6a-9e2e-849bc4e7b0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:33:00.387173 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-6bd9cad6-8a9f-4f6a-9e2e-849bc4e7b0e7 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:33:00.388426 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-6bd9cad6-8a9f-4f6a-9e2e-849bc4e7b0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:33:00.411507 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4540/9052] 10.222.0.23 () {58 vars in 1009 bytes} [Sat Apr 30 22:33:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:33:00.452898 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fda5d3-2ab7-4d2e-bc49-41a3a38efccb service neutron] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:33:00.496146 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fda5d3-2ab7-4d2e-bc49-41a3a38efccb service neutron] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:33:00.501282 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b86c64-40fc-45d9-b402-fdf92bd84379 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:33:00.502028 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b86c64-40fc-45d9-b402-fdf92bd84379 service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:33:00.502311 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b86c64-40fc-45d9-b402-fdf92bd84379 service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:33:00.502587 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b86c64-40fc-45d9-b402-fdf92bd84379 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:33:00.511392 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b86c64-40fc-45d9-b402-fdf92bd84379 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:33:00.512996 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b86c64-40fc-45d9-b402-fdf92bd84379 service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:33:00.522228 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4513/9053] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 22:33:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 22:33:11.180782 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417c0e2-ff77-4987-aada-89cd7e2b96b3 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:33:11.181447 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417c0e2-ff77-4987-aada-89cd7e2b96b3 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:33:11.181447 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417c0e2-ff77-4987-aada-89cd7e2b96b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:33:11.199923 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-a417c0e2-ff77-4987-aada-89cd7e2b96b3 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:33:11.201158 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a417c0e2-ff77-4987-aada-89cd7e2b96b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:33:11.208832 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4541/9054] 10.222.0.23 () {58 vars in 967 bytes} [Sat Apr 30 22:33:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:33:11.221172 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b86c64-40fc-45d9-b402-fdf92bd84379 service swift] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:33:11.232657 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b86c64-40fc-45d9-b402-fdf92bd84379 service swift] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:33:11.237879 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869e1f4-400d-463c-8b59-9ade4ff375ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:33:11.238523 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869e1f4-400d-463c-8b59-9ade4ff375ab service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:33:11.238811 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869e1f4-400d-463c-8b59-9ade4ff375ab service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:33:11.239087 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869e1f4-400d-463c-8b59-9ade4ff375ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:33:11.248479 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9869e1f4-400d-463c-8b59-9ade4ff375ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:33:11.250136 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9869e1f4-400d-463c-8b59-9ade4ff375ab service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:33:11.258631 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4514/9055] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 22:33:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 22:33:13.039243 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417c0e2-ff77-4987-aada-89cd7e2b96b3 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:33:13.040705 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a417c0e2-ff77-4987-aada-89cd7e2b96b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:33:13.071609 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417c0e2-ff77-4987-aada-89cd7e2b96b3 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:33:13.078204 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785a6d5-c2bb-4e2a-9a43-c7e6a8ccc30e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:33:13.078855 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785a6d5-c2bb-4e2a-9a43-c7e6a8ccc30e service nova] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:33:13.079340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785a6d5-c2bb-4e2a-9a43-c7e6a8ccc30e service nova] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:33:13.079668 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785a6d5-c2bb-4e2a-9a43-c7e6a8ccc30e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:33:13.081482 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-3785a6d5-c2bb-4e2a-9a43-c7e6a8ccc30e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:33:13.094675 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785a6d5-c2bb-4e2a-9a43-c7e6a8ccc30e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:33:13.096423 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785a6d5-c2bb-4e2a-9a43-c7e6a8ccc30e service nova] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:33:13.108234 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4542/9056] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:33:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:33:15.678528 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869e1f4-400d-463c-8b59-9ade4ff375ab service swift] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:33:15.690125 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869e1f4-400d-463c-8b59-9ade4ff375ab service swift] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:33:15.696565 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ad1df-fd56-457a-b37f-ff9c294568e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fca4ee1f64c8489ebe7296f9f8f0ab41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:33:15.697198 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ad1df-fd56-457a-b37f-ff9c294568e2 service nova] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:33:15.697478 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ad1df-fd56-457a-b37f-ff9c294568e2 service nova] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:33:15.697773 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ad1df-fd56-457a-b37f-ff9c294568e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:33:15.699513 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-a77ad1df-fd56-457a-b37f-ff9c294568e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:33:15.712055 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ad1df-fd56-457a-b37f-ff9c294568e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:33:15.713674 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ad1df-fd56-457a-b37f-ff9c294568e2 service nova] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:33:15.724186 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4515/9057] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:33:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:33:16.906130 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517d639-a346-420b-8942-1d2f5b2c9043 None None] REQUEST_METHOD: `POST` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:33:16.906598 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517d639-a346-420b-8942-1d2f5b2c9043 None None] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:33:16.906736 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517d639-a346-420b-8942-1d2f5b2c9043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:33:16.930544 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.auth.core [None req-a517d639-a346-420b-8942-1d2f5b2c9043 None None] MFA Rules not processed for user `2e3511017b8e4b4f9805a65c3ac173f9`. Rule list: `[]` (Enabled: `True`). {{(pid=91018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 30 22:33:16.932233 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-a517d639-a346-420b-8942-1d2f5b2c9043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:33:16.939163 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4543/9058] 10.222.0.23 () {58 vars in 967 bytes} [Sat Apr 30 22:33:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 30 22:33:16.952654 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ad1df-fd56-457a-b37f-ff9c294568e2 service nova] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:33:16.965108 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ad1df-fd56-457a-b37f-ff9c294568e2 service nova] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:33:16.970389 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a23cf-a337-4a67-8abd-adb4caab00c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27edf527e36c4ee7a9065688f4bed942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:33:16.971107 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a23cf-a337-4a67-8abd-adb4caab00c3 service swift] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:33:16.971410 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a23cf-a337-4a67-8abd-adb4caab00c3 service swift] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:33:16.971685 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a23cf-a337-4a67-8abd-adb4caab00c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:33:16.983238 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a23cf-a337-4a67-8abd-adb4caab00c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:33:16.984824 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a23cf-a337-4a67-8abd-adb4caab00c3 service swift] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:33:16.994329 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4516/9059] 10.222.0.23 () {60 vars in 1384 bytes} [Sat Apr 30 22:33:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 30 22:33:24.635321 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517d639-a346-420b-8942-1d2f5b2c9043 None None] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:33:24.644763 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517d639-a346-420b-8942-1d2f5b2c9043 None None] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:33:24.649021 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195a2ec-280f-40b5-b23f-843920ac70a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b0cb145b72a492ebb8c0e9223be47a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:33:24.649735 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195a2ec-280f-40b5-b23f-843920ac70a3 service neutron] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:33:24.650120 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195a2ec-280f-40b5-b23f-843920ac70a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:33:24.650397 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6195a2ec-280f-40b5-b23f-843920ac70a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:33:24.720658 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6195a2ec-280f-40b5-b23f-843920ac70a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:33:24.725132 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6195a2ec-280f-40b5-b23f-843920ac70a3 service neutron] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:33:24.742942 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4544/9060] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:33:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:33:30.502320 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a23cf-a337-4a67-8abd-adb4caab00c3 service swift] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:33:30.514010 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a23cf-a337-4a67-8abd-adb4caab00c3 service swift] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:33:30.518602 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5249eb-2a51-43d6-af44-7564f1192279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:33:30.519460 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5249eb-2a51-43d6-af44-7564f1192279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:33:30.519739 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5249eb-2a51-43d6-af44-7564f1192279 admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:33:30.520014 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5249eb-2a51-43d6-af44-7564f1192279 admin admin] PATH_INFO: `/v3/users/c7b2e90478f846f6adb5bd5630e97293` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:33:30.521727 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5249eb-2a51-43d6-af44-7564f1192279 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7b2e90478f846f6adb5bd5630e97293)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:33:30.523666 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5249eb-2a51-43d6-af44-7564f1192279 admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:33:30.674909 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3c5249eb-2a51-43d6-af44-7564f1192279 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7b2e90478f846f6adb5bd5630e97293'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:33:30.686419 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3c5249eb-2a51-43d6-af44-7564f1192279 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7b2e90478f846f6adb5bd5630e97293'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:33:30.741539 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3c5249eb-2a51-43d6-af44-7564f1192279 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7b2e90478f846f6adb5bd5630e97293'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:33:30.742070 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3c5249eb-2a51-43d6-af44-7564f1192279 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7b2e90478f846f6adb5bd5630e97293'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:33:30.749893 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-3c5249eb-2a51-43d6-af44-7564f1192279 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7b2e90478f846f6adb5bd5630e97293'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:33:30.756898 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4517/9061] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 22:33:30 2022] DELETE /identity/v3/users/c7b2e90478f846f6adb5bd5630e97293 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:33:30.966612 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195a2ec-280f-40b5-b23f-843920ac70a3 service neutron] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:33:30.977248 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6195a2ec-280f-40b5-b23f-843920ac70a3 service neutron] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:33:31.036262 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2213b-c07b-40e8-ac42-55032d3edd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:33:31.037781 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2213b-c07b-40e8-ac42-55032d3edd87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:33:31.038080 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2213b-c07b-40e8-ac42-55032d3edd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:33:31.038355 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2213b-c07b-40e8-ac42-55032d3edd87 admin admin] PATH_INFO: `/v3/projects/c4862e1bc1ce438aa0618a97d585b7b5` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:33:31.039538 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2213b-c07b-40e8-ac42-55032d3edd87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4862e1bc1ce438aa0618a97d585b7b5)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:33:31.041487 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2213b-c07b-40e8-ac42-55032d3edd87 admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:33:31.152763 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-80b2213b-c07b-40e8-ac42-55032d3edd87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4862e1bc1ce438aa0618a97d585b7b5', 'request_id': 'req-80b2213b-c07b-40e8-ac42-55032d3edd87'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:33:31.158208 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-80b2213b-c07b-40e8-ac42-55032d3edd87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4862e1bc1ce438aa0618a97d585b7b5', 'request_id': 'req-80b2213b-c07b-40e8-ac42-55032d3edd87'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:33:31.165080 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-80b2213b-c07b-40e8-ac42-55032d3edd87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4862e1bc1ce438aa0618a97d585b7b5', 'request_id': 'req-80b2213b-c07b-40e8-ac42-55032d3edd87'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:33:31.284693 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-80b2213b-c07b-40e8-ac42-55032d3edd87 admin admin] The token cache is being invalidate because project c4862e1bc1ce438aa0618a97d585b7b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 22:33:31.284992 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-80b2213b-c07b-40e8-ac42-55032d3edd87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:33:31.285632 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-80b2213b-c07b-40e8-ac42-55032d3edd87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:33:31.287833 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4545/9062] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 22:33:30 2022] DELETE /identity/v3/projects/c4862e1bc1ce438aa0618a97d585b7b5 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:33:31.291812 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5249eb-2a51-43d6-af44-7564f1192279 admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:33:31.293205 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-3c5249eb-2a51-43d6-af44-7564f1192279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:33:31.306306 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5249eb-2a51-43d6-af44-7564f1192279 admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:33:31.362260 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ca5d5-9d29-4530-9f32-1e3c52b10d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:33:31.363123 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ca5d5-9d29-4530-9f32-1e3c52b10d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:33:31.363406 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ca5d5-9d29-4530-9f32-1e3c52b10d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:33:31.363703 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ca5d5-9d29-4530-9f32-1e3c52b10d1b admin admin] PATH_INFO: `/v3/users/3d0a989b6e854b32a7951e77dcd86c4d` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:33:31.364907 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ca5d5-9d29-4530-9f32-1e3c52b10d1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d0a989b6e854b32a7951e77dcd86c4d)` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:33:31.366868 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ca5d5-9d29-4530-9f32-1e3c52b10d1b admin admin] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:33:31.539182 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d89ca5d5-9d29-4530-9f32-1e3c52b10d1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d0a989b6e854b32a7951e77dcd86c4d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:33:31.551725 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d89ca5d5-9d29-4530-9f32-1e3c52b10d1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d0a989b6e854b32a7951e77dcd86c4d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:33:31.615858 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d89ca5d5-9d29-4530-9f32-1e3c52b10d1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d0a989b6e854b32a7951e77dcd86c4d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:33:31.616492 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d89ca5d5-9d29-4530-9f32-1e3c52b10d1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d0a989b6e854b32a7951e77dcd86c4d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:33:31.623866 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.notifications [None req-d89ca5d5-9d29-4530-9f32-1e3c52b10d1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d0a989b6e854b32a7951e77dcd86c4d'} {{(pid=91017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:33:31.629922 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4518/9063] 10.222.0.23 () {58 vars in 1223 bytes} [Sat Apr 30 22:33:31 2022] DELETE /identity/v3/users/3d0a989b6e854b32a7951e77dcd86c4d => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:33:32.017904 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2213b-c07b-40e8-ac42-55032d3edd87 admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:33:32.019376 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-80b2213b-c07b-40e8-ac42-55032d3edd87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:33:32.031912 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2213b-c07b-40e8-ac42-55032d3edd87 admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:33:32.089146 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88546041-fc11-4b1d-8140-10fd02fd197a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53a451439fd64d8ca37cd0e229eb98e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '137d4e571f624bfe845b398839c48b74', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:33:32.090041 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88546041-fc11-4b1d-8140-10fd02fd197a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:33:32.090327 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88546041-fc11-4b1d-8140-10fd02fd197a admin admin] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:33:32.090603 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88546041-fc11-4b1d-8140-10fd02fd197a admin admin] PATH_INFO: `/v3/projects/4b3ee6f889f74dd6a9cb5bee94d0752e` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:33:32.091792 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88546041-fc11-4b1d-8140-10fd02fd197a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b3ee6f889f74dd6a9cb5bee94d0752e)` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:33:32.093782 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88546041-fc11-4b1d-8140-10fd02fd197a admin admin] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:33:32.187340 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-88546041-fc11-4b1d-8140-10fd02fd197a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b3ee6f889f74dd6a9cb5bee94d0752e', 'request_id': 'req-88546041-fc11-4b1d-8140-10fd02fd197a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:33:32.192895 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-88546041-fc11-4b1d-8140-10fd02fd197a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b3ee6f889f74dd6a9cb5bee94d0752e', 'request_id': 'req-88546041-fc11-4b1d-8140-10fd02fd197a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:33:32.199096 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-88546041-fc11-4b1d-8140-10fd02fd197a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b3ee6f889f74dd6a9cb5bee94d0752e', 'request_id': 'req-88546041-fc11-4b1d-8140-10fd02fd197a'} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:33:32.255403 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-88546041-fc11-4b1d-8140-10fd02fd197a admin admin] The token cache is being invalidate because project 4b3ee6f889f74dd6a9cb5bee94d0752e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 30 22:33:32.255780 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-88546041-fc11-4b1d-8140-10fd02fd197a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:33:32.256442 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.notifications [None req-88546041-fc11-4b1d-8140-10fd02fd197a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 30 22:33:32.258712 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4546/9064] 10.222.0.23 () {58 vars in 1232 bytes} [Sat Apr 30 22:33:32 2022] DELETE /identity/v3/projects/4b3ee6f889f74dd6a9cb5bee94d0752e => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 30 22:36:19.739726 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ca5d5-9d29-4530-9f32-1e3c52b10d1b admin admin] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:36:19.741212 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-d89ca5d5-9d29-4530-9f32-1e3c52b10d1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:36:19.818816 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ca5d5-9d29-4530-9f32-1e3c52b10d1b admin admin] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:36:19.878082 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82228bbd-90c0-4ba7-8001-2bd4384eb32e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:36:19.878728 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82228bbd-90c0-4ba7-8001-2bd4384eb32e service placement] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:36:19.879010 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82228bbd-90c0-4ba7-8001-2bd4384eb32e service placement] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:36:19.879283 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82228bbd-90c0-4ba7-8001-2bd4384eb32e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:36:19.881081 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.fernet_utils [None req-82228bbd-90c0-4ba7-8001-2bd4384eb32e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:36:19.892676 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82228bbd-90c0-4ba7-8001-2bd4384eb32e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:36:19.894298 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82228bbd-90c0-4ba7-8001-2bd4384eb32e service placement] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:36:19.904003 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4519/9065] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:36:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:36:20.488622 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88546041-fc11-4b1d-8140-10fd02fd197a admin admin] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:36:20.490034 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-88546041-fc11-4b1d-8140-10fd02fd197a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:36:20.504452 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88546041-fc11-4b1d-8140-10fd02fd197a admin admin] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:36:20.509678 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a78155-d3f4-4f2b-8411-cfecd3620092 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:36:20.510376 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a78155-d3f4-4f2b-8411-cfecd3620092 service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:36:20.510662 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a78155-d3f4-4f2b-8411-cfecd3620092 service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:36:20.510972 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a78155-d3f4-4f2b-8411-cfecd3620092 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:36:20.512729 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-12a78155-d3f4-4f2b-8411-cfecd3620092 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:36:20.524405 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a78155-d3f4-4f2b-8411-cfecd3620092 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:36:20.528758 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a78155-d3f4-4f2b-8411-cfecd3620092 service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:36:20.536765 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4547/9066] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:36:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:41:22.723046 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82228bbd-90c0-4ba7-8001-2bd4384eb32e service placement] Authenticating user token {{(pid=91017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:41:22.733745 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82228bbd-90c0-4ba7-8001-2bd4384eb32e service placement] Validating token access rules against request {{(pid=91017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:41:22.739507 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384620b-8a0f-4f1d-a321-330c2343be73 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:41:22.740147 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384620b-8a0f-4f1d-a321-330c2343be73 service placement] REQUEST_METHOD: `GET` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:41:22.740431 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384620b-8a0f-4f1d-a321-330c2343be73 service placement] SCRIPT_NAME: `/identity` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:41:22.740707 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384620b-8a0f-4f1d-a321-330c2343be73 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:41:22.749220 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384620b-8a0f-4f1d-a321-330c2343be73 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:41:22.750847 ncdv-master-1 devstack@keystone.service[91017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384620b-8a0f-4f1d-a321-330c2343be73 service placement] RBAC: Authorization granted {{(pid=91017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:41:22.761184 ncdv-master-1 devstack@keystone.service[91017]: [pid: 91017|app: 0|req: 4520/9067] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:41:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 30 22:41:24.547596 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a78155-d3f4-4f2b-8411-cfecd3620092 service placement] Authenticating user token {{(pid=91018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 30 22:41:24.549483 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.fernet_utils [None req-12a78155-d3f4-4f2b-8411-cfecd3620092 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 30 22:41:24.574933 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a78155-d3f4-4f2b-8411-cfecd3620092 service placement] Validating token access rules against request {{(pid=91018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 30 22:41:24.580156 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac516434-662b-4481-9900-d26cd1ee3fb5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ad3f89b7037413a83c7905cef263b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b52e5e13b9144dfb663578766c2bac0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 30 22:41:24.580793 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac516434-662b-4481-9900-d26cd1ee3fb5 service placement] REQUEST_METHOD: `GET` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 30 22:41:24.581076 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac516434-662b-4481-9900-d26cd1ee3fb5 service placement] SCRIPT_NAME: `/identity` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 30 22:41:24.581354 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac516434-662b-4481-9900-d26cd1ee3fb5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 30 22:41:24.589882 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac516434-662b-4481-9900-d26cd1ee3fb5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 30 22:41:24.591471 ncdv-master-1 devstack@keystone.service[91018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac516434-662b-4481-9900-d26cd1ee3fb5 service placement] RBAC: Authorization granted {{(pid=91018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 30 22:41:24.601845 ncdv-master-1 devstack@keystone.service[91018]: [pid: 91018|app: 0|req: 4548/9068] 10.222.0.23 () {60 vars in 1365 bytes} [Sat Apr 30 22:41:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)